2024-05-20T17:42:16.016 INFO:root:teuthology version: 0.0.1.dev287+gb9e3da8 2024-05-20T17:42:16.016 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --name pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-limits} --verbose --archive /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689 -- /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/orig.config.yaml 2024-05-20T17:42:16.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-20T17:42:16.158 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689 branch: wip-pdonnell-testing-20240517.203521-squid-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-limits} email: pdonnell@redhat.com first_in_suite: false job_id: '7715689' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240517.203521-squid-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - responding to mclientcaps\(revoke\) - not advance its oldest_client_tid - failing to advance its oldest client/flush tid - Too many inodes in cache - failing to respond to cache pressure - slow requests are blocked - failing to respond to capability release - MDS cache is too large - \(MDS_CLIENT_OLDEST_TID\) - \(MDS_CACHE_OVERSIZED\) sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240517.203521-squid-debug sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9749 sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d sleep_before_teardown: 0 subset: 272/512 suite: fs suite_branch: wip-pdonnell-testing-20240517.203521-squid-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPc68zrvEU8kzS/vnQlOBWhYLrhnpqrODQFn+QLCjkSZJUcEudZRYHz3ymoR4H3gzPjZZw/j90D07aY1MwT6s4g= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfDV+gDCWfLSc4jLuTjCm5ER3ONgbXKO+UzTXRE0s9qwEx9nUucGbOym9zlAYM63J19wTC2+MxWSJF9qlTe7Mw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_limits teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a timestamp: 2024-05-20_15:44:59 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-20T17:42:16.158 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa; will attempt to use it 2024-05-20T17:42:16.159 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa/tasks 2024-05-20T17:42:16.159 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-20T17:42:16.161 INFO:teuthology.task.internal:Checking packages... 2024-05-20T17:42:16.181 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2b507c724ef6c8295ee0a35d185cdab167fd61d' 2024-05-20T17:42:16.181 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-20T17:42:16.181 INFO:teuthology.packaging:ref: None 2024-05-20T17:42:16.181 INFO:teuthology.packaging:tag: None 2024-05-20T17:42:16.181 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-20T17:42:16.181 INFO:teuthology.packaging:sha1: d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:42:16.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240517.203521-squid-debug 2024-05-20T17:42:16.424 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2744.gd2b507c7 2024-05-20T17:42:16.425 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-20T17:42:16.434 INFO:teuthology.task.internal:no buildpackages task found 2024-05-20T17:42:16.434 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-20T17:42:16.449 INFO:teuthology.task.internal:Saving configuration 2024-05-20T17:42:16.467 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-20T17:42:16.475 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-20T17:42:16.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 17:37:16.434840', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPc68zrvEU8kzS/vnQlOBWhYLrhnpqrODQFn+QLCjkSZJUcEudZRYHz3ymoR4H3gzPjZZw/j90D07aY1MwT6s4g='} 2024-05-20T17:42:16.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-20 17:37:16.436832', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfDV+gDCWfLSc4jLuTjCm5ER3ONgbXKO+UzTXRE0s9qwEx9nUucGbOym9zlAYM63J19wTC2+MxWSJF9qlTe7Mw='} 2024-05-20T17:42:16.526 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-20T17:42:16.535 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-20T17:42:16.535 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-20T17:42:16.535 INFO:teuthology.run_tasks:Running task console_log... 2024-05-20T17:42:16.597 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f63dcf03ac0>, signals=[15]) 2024-05-20T17:42:16.597 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-20T17:42:16.604 INFO:teuthology.task.internal:Opening connections... 2024-05-20T17:42:16.604 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:42:16.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:42:16.680 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:42:16.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:42:16.755 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-20T17:42:16.761 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-05-20T17:42:16.779 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-05-20T17:42:16.780 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-05-20T17:42:16.836 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-05-20T17:42:16.836 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-20T17:42:16.837 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-20T17:42:16.838 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-05-20T17:42:16.856 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-05-20T17:42:16.873 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-05-20T17:42:16.873 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-05-20T17:42:16.930 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-05-20T17:42:16.930 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-05-20T17:42:16.930 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-20T17:42:16.931 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-20T17:42:16.932 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-05-20T17:42:16.947 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-20T17:42:16.958 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-20T17:42:16.966 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-20T17:42:16.966 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-05-20T17:42:16.969 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-05-20T17:42:16.986 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-20T17:42:16.994 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-20T17:42:16.994 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-05-20T17:42:17.026 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-05-20T17:42:17.051 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-20T17:42:17.105 INFO:teuthology.run_tasks:Running task kernel... 2024-05-20T17:42:17.121 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-20T17:42:17.121 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-20T17:42:17.121 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-20T17:42:17.122 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T17:42:17.122 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-20T17:42:17.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:42:17.138 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-05-20T17:42:17.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:42:17.139 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-05-20T17:42:17.195 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-437.el9.x86_64 2024-05-20T17:42:17.195 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.14.0-437.el9.x86_64 2024-05-20T17:42:17.195 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2024-05-20T17:42:17.197 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-437.el9.x86_64 2024-05-20T17:42:17.197 INFO:teuthology.task.kernel:Running kernel on smithi006: 5.14.0-437.el9.x86_64 2024-05-20T17:42:17.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2024-05-20T17:42:19.837 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.1 MB 00:00 2024-05-20T17:42:22.146 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-05-20T17:42:24.793 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.1 MB 00:05 2024-05-20T17:42:26.778 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-20T17:42:27.834 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.2 MB 00:01 2024-05-20T17:42:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-05-20T17:42:31.578 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.2 MB 00:01 2024-05-20T17:42:32.014 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-20T17:42:33.242 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 16 kB 00:00 2024-05-20T17:42:36.171 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 21 MB 00:02 2024-05-20T17:42:37.323 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-05-20T17:42:39.271 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-20T17:42:39.271 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-20T17:42:39.363 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:42:39.372 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-05-20T17:42:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-05-20T17:42:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:Install 4 Packages 2024-05-20T17:42:39.373 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:42:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 78 M 2024-05-20T17:42:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 123 M 2024-05-20T17:42:39.373 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-05-20T17:42:39.675 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:42:39.675 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:42:39.675 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:42:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:39.721 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:39.844 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:39.845 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:39.869 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:40.005 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:40.007 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:40.028 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:40.355 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:40.378 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:40.404 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:40.558 INFO:teuthology.orchestra.run.smithi006.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 629 kB/s | 576 kB 00:00 2024-05-20T17:42:40.603 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:40.638 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:42:40.858 INFO:teuthology.orchestra.run.smithi006.stdout:(2/4): kernel-core-5.14.0-447.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-05-20T17:42:40.859 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:40.957 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:41.260 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-20T17:42:41.425 INFO:teuthology.orchestra.run.smithi006.stdout:(3/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 19 MB/s | 34 MB 00:01 2024-05-20T17:42:41.783 INFO:teuthology.orchestra.run.smithi006.stdout:(4/4): kernel-modules-core-5.14.0-447.el9.x86_6 23 MB/s | 28 MB 00:01 2024-05-20T17:42:41.787 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:42:41.787 INFO:teuthology.orchestra.run.smithi006.stdout:Total 32 MB/s | 78 MB 00:02 2024-05-20T17:42:42.504 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-05-20T17:42:42.936 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-05-20T17:42:42.936 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-05-20T17:42:43.133 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-20T17:42:43.133 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-20T17:42:43.236 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-05-20T17:42:43.251 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout:Install 4 Packages 2024-05-20T17:42:43.252 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:42:43.253 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 78 M 2024-05-20T17:42:43.253 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 123 M 2024-05-20T17:42:43.253 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-05-20T17:42:43.354 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:43.354 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:43.354 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:43.473 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:43.473 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:43.495 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:43.647 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:43.649 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:43.654 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:43.888 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-05-20T17:42:43.888 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-05-20T17:42:43.992 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:44.019 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:44.041 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:44.151 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T17:42:44.177 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T17:42:44.202 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T17:42:44.502 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T17:42:44.526 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T17:42:44.536 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:42:44.550 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T17:42:44.559 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:42:44.568 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-447.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:42:44.736 INFO:teuthology.orchestra.run.smithi171.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 403 kB/s | 576 kB 00:01 2024-05-20T17:42:44.763 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:44.809 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:42:44.888 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:45.045 INFO:teuthology.orchestra.run.smithi171.stdout:(2/4): kernel-core-5.14.0-447.el9.x86_64.rpm 8.9 MB/s | 16 MB 00:01 2024-05-20T17:42:45.045 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:42:45.520 INFO:teuthology.orchestra.run.smithi171.stdout:(3/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 15 MB/s | 34 MB 00:02 2024-05-20T17:42:45.688 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] kernel-modules-core-5.14.0-447.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-447.el9.x86_64.rpm (IP: 163.114.132.32) 2024-05-20T17:42:46.237 INFO:teuthology.orchestra.run.smithi171.stdout:(4/4): kernel-modules-core-5.14.0-447.el9.x86_6 19 MB/s | 28 MB 00:01 2024-05-20T17:42:46.239 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:42:46.240 INFO:teuthology.orchestra.run.smithi171.stdout:Total 26 MB/s | 78 MB 00:02 2024-05-20T17:42:46.427 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-05-20T17:42:46.926 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-05-20T17:42:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-20T17:42:47.142 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:42:47.277 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-05-20T17:42:47.277 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-05-20T17:42:48.194 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-05-20T17:42:48.195 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-05-20T17:42:49.953 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:42:50.080 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:42:50.587 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-05-20T17:42:51.256 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-20T17:42:51.346 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:42:54.015 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:42:54.158 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:42:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:42:55.201 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:42:58.871 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:42:58.919 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:00.296 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:03.659 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:31.270 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:31.311 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:31.620 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:31.620 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-20T17:43:31.620 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:43:31.620 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:43:32.461 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:32.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:43:32.462 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-05-20T17:43:32.462 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-20T17:43:32.462 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-20T17:43:32.462 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-20T17:43:32.462 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-20T17:43:32.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:43:32.462 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-05-20T17:43:32.815 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T17:43:32.908 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T17:43:32.909 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T17:43:32.909 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-20T17:43:32.910 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-20T17:43:32.910 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-20T17:43:32.910 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-20T17:43:32.910 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2024-05-20T17:43:32.910 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T17:43:32.962 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T17:43:32.962 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T17:43:32.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2024-05-20T17:43:32.993 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2024-05-20T17:43:32.994 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2024-05-20T17:43:32.994 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.06 2024-05-20T17:43:32.994 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 68.el9 2024-05-20T17:43:32.994 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2024-05-20T17:43:32.994 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-20T17:43:32.994 INFO:teuthology.orchestra.run.smithi006.stdout:Group : Unspecified 2024-05-20T17:43:32.995 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 8264254 2024-05-20T17:43:32.995 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2024-05-20T17:43:32.995 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-20T17:43:32.995 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-20T17:43:32.995 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-20T17:43:32.995 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-20T17:43:32.995 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : builder@centos.org 2024-05-20T17:43:32.996 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2024-05-20T17:43:32.996 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-20T17:43:32.996 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2024-05-20T17:43:32.996 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2024-05-20T17:43:32.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:43:32.996 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-20T17:43:32.996 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-20T17:43:32.996 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-20T17:43:32.997 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2024-05-20T17:43:32.997 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:43:32.997 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2024-05-20T17:43:32.998 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-20T17:43:32.998 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 5.14.0-447.el9.x86_64 2024-05-20T17:43:32.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-20T17:43:33.071 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:33.483 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:33.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-20T17:43:33.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-20T17:43:33.483 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-20T17:43:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:43:34.290 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-05-20T17:43:34.632 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T17:43:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T17:43:34.701 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T17:43:34.701 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-20T17:43:34.701 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-20T17:43:34.701 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-20T17:43:34.701 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-20T17:43:34.701 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-05-20T17:43:34.701 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-05-20T17:43:34.751 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-20T17:43:34.751 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-20T17:43:34.752 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-05-20T17:43:34.782 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-05-20T17:43:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-05-20T17:43:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-05-20T17:43:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 68.el9 2024-05-20T17:43:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-05-20T17:43:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-20T17:43:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-05-20T17:43:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8264254 2024-05-20T17:43:34.783 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-05-20T17:43:34.784 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-05-20T17:43:34.785 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:43:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-20T17:43:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-20T17:43:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-20T17:43:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-05-20T17:43:34.785 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:43:34.785 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-05-20T17:43:34.786 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-20T17:43:34.787 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 5.14.0-447.el9.x86_64 2024-05-20T17:43:34.787 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-20T17:43:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-20T17:43:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-05-20T17:43:35.167 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-05-20T17:43:35.183 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.pH3uJAL4vv 2024-05-20T17:43:35.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pH3uJAL4vv 2024-05-20T17:43:35.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.pH3uJAL4vv 2024-05-20T17:43:35.385 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.pH3uJAL4vv is 6KB 2024-05-20T17:43:35.386 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-05-20T17:43:35.435 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.pH3uJAL4vv 2024-05-20T17:43:35.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2024-05-20T17:43:35.512 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-20T17:43:35.512 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-20T17:43:35.512 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-20T17:43:35.512 INFO:teuthology.orchestra.run.smithi006.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-20T17:43:35.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-20T17:43:35.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-05-20T17:43:36.782 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-20T17:43:36.812 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-05-20T17:43:36.814 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-05-20T17:43:36.832 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.pVjcwibHSZ 2024-05-20T17:43:36.832 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pVjcwibHSZ 2024-05-20T17:43:36.906 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.pVjcwibHSZ 2024-05-20T17:43:37.043 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.pVjcwibHSZ is 6KB 2024-05-20T17:43:37.063 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.pVjcwibHSZ 2024-05-20T17:43:37.077 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-05-20T17:43:37.138 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-20T17:43:37.138 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-20T17:43:37.138 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-20T17:43:37.138 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-20T17:43:37.139 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-20T17:43:37.306 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-05-20T17:44:05.686 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-20T17:44:05.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T17:44:05.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:44:07.311 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-20T17:44:07.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T17:44:07.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:44:24.094 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-05-20T17:44:25.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-05-20T17:44:33.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T17:44:33.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:44:34.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T17:44:34.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:44:37.695 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-05-20T17:44:49.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T17:44:49.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:45:08.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-05-20T17:45:23.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T17:45:23.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:45:24.986 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-05-20T17:45:25.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T17:45:25.457 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-447.el9.x86_64"... 2024-05-20T17:45:25.458 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-05-20T17:45:25.473 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-447.el9.x86_64 2024-05-20T17:45:25.473 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-20T17:45:25.473 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-20T17:45:25.473 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-20T17:45:26.474 DEBUG:teuthology.parallel:result is None 2024-05-20T17:45:33.106 DEBUG:teuthology.orchestra.remote:timed out 2024-05-20T17:45:45.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T17:45:45.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:45:45.425 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-05-20T17:45:45.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T17:45:45.777 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-447.el9.x86_64"... 2024-05-20T17:45:45.777 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-05-20T17:45:45.794 INFO:teuthology.orchestra.run.smithi006.stdout:5.14.0-447.el9.x86_64 2024-05-20T17:45:45.794 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-20T17:45:45.794 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-20T17:45:45.794 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-20T17:45:46.796 DEBUG:teuthology.parallel:result is None 2024-05-20T17:45:46.796 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-20T17:45:46.804 INFO:teuthology.task.internal:Creating test directory... 2024-05-20T17:45:46.804 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T17:45:46.807 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-20T17:45:46.829 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-20T17:45:46.839 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-20T17:45:46.879 INFO:teuthology.task.internal:Creating archive directory... 2024-05-20T17:45:46.879 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T17:45:46.882 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-20T17:45:46.996 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-20T17:45:47.008 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-20T17:45:47.008 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T17:45:47.011 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-20T17:45:47.073 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:45:47.096 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:45:47.117 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:45:47.155 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-20T17:45:47.157 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-20T17:45:47.169 INFO:teuthology.task.internal:Configuring sudo... 2024-05-20T17:45:47.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T17:45:47.171 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-20T17:45:47.200 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-20T17:45:47.211 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-20T17:45:47.211 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T17:45:47.242 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-20T17:45:47.259 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:45:47.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:45:47.392 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:45:47.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:45:47.521 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:45:47.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T17:45:47.590 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:45:47.633 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-20T17:45:47.706 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:45:47.750 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-20T17:45:47.793 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:45:47.793 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-20T17:45:47.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-05-20T17:45:47.863 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-05-20T17:45:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T17:45:47.944 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T17:45:48.349 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-20T17:45:48.357 INFO:teuthology.task.internal:Starting timer... 2024-05-20T17:45:48.357 INFO:teuthology.run_tasks:Running task pcp... 2024-05-20T17:45:48.385 INFO:teuthology.run_tasks:Running task selinux... 2024-05-20T17:45:48.402 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-20T17:45:48.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2024-05-20T17:45:48.463 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2024-05-20T17:45:48.465 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-05-20T17:45:48.538 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-05-20T17:45:48.540 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-20T17:45:48.540 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2024-05-20T17:45:48.568 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2024-05-20T17:45:48.569 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-05-20T17:45:48.592 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-05-20T17:45:48.592 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-05-20T17:45:48.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T17:45:48.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:45:48.638 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T17:45:48.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:45:48.667 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-20T17:45:48.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2024-05-20T17:45:48.706 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-05-20T17:45:48.737 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-20T17:45:48.746 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-20T17:45:48.758 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-20T17:45:48.758 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-20T17:50:09.144 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-05-20T17:50:09.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T17:50:09.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:50:09.222 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-05-20T17:50:09.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-05-20T17:50:09.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T17:50:09.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-20T17:50:09.376 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-05-20T17:50:09.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-20T17:50:09.415 INFO:teuthology.run_tasks:Running task clock... 2024-05-20T17:50:09.426 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-20T17:50:09.426 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T17:50:09.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T17:50:09.429 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-20T17:50:09.429 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T17:50:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-20T17:50:09.472 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-20T17:50:09.483 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-20T17:50:09.497 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-20T17:50:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2024-05-20T17:50:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2024-05-20T17:50:09.523 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-20T17:50:09.524 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-05-20T17:50:09.536 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-05-20T17:50:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-20T17:50:09.552 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-20T17:50:09.567 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-20T17:50:09.589 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-05-20T17:50:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T17:50:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-05-20T17:50:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:50:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:50:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:50:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:50:09.621 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-05-20T17:50:09.624 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T17:50:09.624 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-05-20T17:50:09.625 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:50:09.625 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:50:09.625 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:50:09.625 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T17:50:09.626 INFO:teuthology.run_tasks:Running task install... 2024-05-20T17:50:09.634 DEBUG:teuthology.task.install:project ceph 2024-05-20T17:50:09.634 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}} 2024-05-20T17:50:09.634 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'} 2024-05-20T17:50:09.634 INFO:teuthology.task.install:Using flavor: default 2024-05-20T17:50:09.640 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-20T17:50:09.640 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-20T17:50:09.640 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'tag': None, 'wait_for_package': False} 2024-05-20T17:50:09.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:50:09.642 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'tag': None, 'wait_for_package': False} 2024-05-20T17:50:09.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:50:09.794 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/ 2024-05-20T17:50:09.794 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2744.gd2b507c7 2024-05-20T17:50:09.894 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/ 2024-05-20T17:50:09.894 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2744.gd2b507c7 2024-05-20T17:50:09.914 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-20T17:50:09.914 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:50:09.914 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-20T17:50:09.940 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-20T17:50:09.941 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2b507c724ef6c8295ee0a35d185cdab167fd61d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-20T17:50:10.005 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240517.203521-squid-debug/d2b507c724ef6c8295ee0a35d185cdab167fd61d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-20T17:50:10.006 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:50:10.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-20T17:50:10.007 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-20T17:50:10.035 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-20T17:50:10.035 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2b507c724ef6c8295ee0a35d185cdab167fd61d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-20T17:50:10.082 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-20T17:50:10.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-20T17:50:10.146 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-05-20T17:50:10.148 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-05-20T17:50:10.181 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-20T17:50:10.247 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2024-05-20T17:50:10.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2024-05-20T17:50:10.389 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-05-20T17:50:10.416 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-20T17:50:10.490 INFO:teuthology.orchestra.run.smithi006.stdout:45 files removed 2024-05-20T17:50:10.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-20T17:50:11.174 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 173 kB/s | 83 kB 00:00 2024-05-20T17:50:11.275 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 178 kB/s | 83 kB 00:00 2024-05-20T17:50:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 40 kB/s | 11 kB 00:00 2024-05-20T17:50:11.609 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 42 kB/s | 11 kB 00:00 2024-05-20T17:50:11.934 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-05-20T17:50:12.009 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-05-20T17:50:13.328 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.1 MB 00:01 2024-05-20T17:50:15.289 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.1 MB 00:03 2024-05-20T17:50:17.324 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 19 MB 00:02 2024-05-20T17:50:17.923 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-05-20T17:50:22.932 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-05-20T17:50:24.245 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.2 MB 00:02 2024-05-20T17:50:24.513 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 16 kB 00:00 2024-05-20T17:50:25.649 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-05-20T17:50:25.716 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 16 kB 00:00 2024-05-20T17:50:26.937 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-05-20T17:50:30.840 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-20T17:50:32.293 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-05-20T17:50:32.992 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:50:32.992 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:50:33.003 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-20T17:50:33.004 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-20T17:50:33.005 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-20T17:50:33.006 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-20T17:50:33.007 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-20T17:50:33.009 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-20T17:50:33.010 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-20T17:50:33.072 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-05-20T17:50:33.101 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-05-20T17:50:33.101 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-05-20T17:50:33.101 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 6.6 k 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.4 M 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 863 k 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 147 k 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 1.5 M 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 142 k 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 3.5 M 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 7.4 M 2024-05-20T17:50:33.102 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 49 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 9.8 M 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 46 M 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 264 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 763 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 221 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 27 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 18 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 32 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 756 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 127 k 2024-05-20T17:50:33.103 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 161 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 320 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 299 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 99 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 86 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.0 M 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 169 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-20T17:50:33.104 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.3 M 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.1 M 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-05-20T17:50:33.105 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 19 M 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 32 k 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 2.3 M 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 249 k 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 4.9 M 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 18 M 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 16 k 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 25 k 2024-05-20T17:50:33.106 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 158 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-20T17:50:33.107 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 497 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.0 M 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-20T17:50:33.108 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 45 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 135 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-20T17:50:33.109 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-20T17:50:33.110 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-20T17:50:33.111 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-20T17:50:33.112 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-20T17:50:33.113 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout:Install 148 Packages 2024-05-20T17:50:33.114 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 11 Packages 2024-05-20T17:50:33.115 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:50:33.115 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 222 M 2024-05-20T17:50:33.115 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-05-20T17:50:33.866 INFO:teuthology.orchestra.run.smithi171.stdout:(1/159): ceph-19.0.0-2744.gd2b507c7.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-05-20T17:50:34.467 INFO:teuthology.orchestra.run.smithi171.stdout:(2/159): ceph-fuse-19.0.0-2744.gd2b507c7.el9.x8 1.4 MB/s | 863 kB 00:00 2024-05-20T17:50:34.553 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:50:34.554 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-20T17:50:34.558 INFO:teuthology.orchestra.run.smithi171.stdout:(3/159): ceph-immutable-object-cache-19.0.0-274 1.6 MB/s | 147 kB 00:00 2024-05-20T17:50:34.565 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-20T17:50:34.566 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-20T17:50:34.567 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-20T17:50:34.568 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-20T17:50:34.569 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-20T17:50:34.571 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-20T17:50:34.572 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-20T17:50:34.639 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-05-20T17:50:34.666 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-05-20T17:50:34.666 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-05-20T17:50:34.666 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-05-20T17:50:34.666 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-05-20T17:50:34.666 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-20T17:50:34.666 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 6.6 k 2024-05-20T17:50:34.666 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.4 M 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 863 k 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 147 k 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 1.5 M 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 142 k 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 3.5 M 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 7.4 M 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 49 k 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 9.8 M 2024-05-20T17:50:34.667 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 46 M 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 264 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 763 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 221 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 27 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 18 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 32 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 756 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 127 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-20T17:50:34.668 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 161 k 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 320 k 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 299 k 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 99 k 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 86 k 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.0 M 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 169 k 2024-05-20T17:50:34.669 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.3 M 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 3.1 M 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-05-20T17:50:34.670 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 19 M 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 32 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 2.3 M 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 249 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 4.9 M 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 18 M 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2744.gd2b507c7.el9 ceph-noarch 16 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 25 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-20T17:50:34.671 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 158 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 497 k 2024-05-20T17:50:34.672 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 5.0 M 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-20T17:50:34.673 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 45 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:19.0.0-2744.gd2b507c7.el9 ceph 135 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-20T17:50:34.674 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-20T17:50:34.675 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-20T17:50:34.676 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-20T17:50:34.677 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-20T17:50:34.678 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout:======================================================================================= 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout:Install 148 Packages 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 11 Packages 2024-05-20T17:50:34.679 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:50:34.680 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 222 M 2024-05-20T17:50:34.680 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-05-20T17:50:35.259 INFO:teuthology.orchestra.run.smithi171.stdout:(4/159): ceph-mds-19.0.0-2744.gd2b507c7.el9.x86 3.2 MB/s | 2.3 MB 00:00 2024-05-20T17:50:35.542 INFO:teuthology.orchestra.run.smithi171.stdout:(5/159): ceph-base-19.0.0-2744.gd2b507c7.el9.x8 2.8 MB/s | 5.4 MB 00:01 2024-05-20T17:50:35.576 INFO:teuthology.orchestra.run.smithi171.stdout:(6/159): ceph-mgr-19.0.0-2744.gd2b507c7.el9.x86 4.7 MB/s | 1.5 MB 00:00 2024-05-20T17:50:36.020 INFO:teuthology.orchestra.run.smithi006.stdout:(1/159): ceph-19.0.0-2744.gd2b507c7.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-05-20T17:50:36.294 INFO:teuthology.orchestra.run.smithi171.stdout:(7/159): ceph-mon-19.0.0-2744.gd2b507c7.el9.x86 6.5 MB/s | 4.9 MB 00:00 2024-05-20T17:50:37.028 INFO:teuthology.orchestra.run.smithi006.stdout:(2/159): ceph-fuse-19.0.0-2744.gd2b507c7.el9.x8 856 kB/s | 863 kB 00:01 2024-05-20T17:50:37.228 INFO:teuthology.orchestra.run.smithi006.stdout:(3/159): ceph-immutable-object-cache-19.0.0-274 735 kB/s | 147 kB 00:00 2024-05-20T17:50:37.776 INFO:teuthology.orchestra.run.smithi171.stdout:(8/159): ceph-common-19.0.0-2744.gd2b507c7.el9. 4.7 MB/s | 19 MB 00:04 2024-05-20T17:50:37.893 INFO:teuthology.orchestra.run.smithi171.stdout:(9/159): ceph-radosgw-19.0.0-2744.gd2b507c7.el9 6.2 MB/s | 9.8 MB 00:01 2024-05-20T17:50:37.918 INFO:teuthology.orchestra.run.smithi171.stdout:(10/159): ceph-selinux-19.0.0-2744.gd2b507c7.el 177 kB/s | 25 kB 00:00 2024-05-20T17:50:38.027 INFO:teuthology.orchestra.run.smithi171.stdout:(11/159): cephfs-mirror-19.0.0-2744.gd2b507c7.e 2.0 MB/s | 221 kB 00:00 2024-05-20T17:50:38.127 INFO:teuthology.orchestra.run.smithi171.stdout:(12/159): cephfs-shell-19.0.0-2744.gd2b507c7.el 269 kB/s | 27 kB 00:00 2024-05-20T17:50:38.137 INFO:teuthology.orchestra.run.smithi006.stdout:(4/159): ceph-base-19.0.0-2744.gd2b507c7.el9.x8 2.1 MB/s | 5.4 MB 00:02 2024-05-20T17:50:38.186 INFO:teuthology.orchestra.run.smithi171.stdout:(13/159): libcephfs-devel-19.0.0-2744.gd2b507c7 544 kB/s | 32 kB 00:00 2024-05-20T17:50:38.420 INFO:teuthology.orchestra.run.smithi006.stdout:(5/159): ceph-mds-19.0.0-2744.gd2b507c7.el9.x86 1.9 MB/s | 2.3 MB 00:01 2024-05-20T17:50:38.504 INFO:teuthology.orchestra.run.smithi006.stdout:(6/159): ceph-mgr-19.0.0-2744.gd2b507c7.el9.x86 4.0 MB/s | 1.5 MB 00:00 2024-05-20T17:50:38.911 INFO:teuthology.orchestra.run.smithi171.stdout:(14/159): ceph-osd-19.0.0-2744.gd2b507c7.el9.x8 5.3 MB/s | 18 MB 00:03 2024-05-20T17:50:38.953 INFO:teuthology.orchestra.run.smithi171.stdout:(15/159): libcephfs2-19.0.0-2744.gd2b507c7.el9. 986 kB/s | 756 kB 00:00 2024-05-20T17:50:39.020 INFO:teuthology.orchestra.run.smithi171.stdout:(16/159): libcephsqlite-19.0.0-2744.gd2b507c7.e 1.4 MB/s | 158 kB 00:00 2024-05-20T17:50:39.062 INFO:teuthology.orchestra.run.smithi171.stdout:(17/159): librados-devel-19.0.0-2744.gd2b507c7. 1.1 MB/s | 127 kB 00:00 2024-05-20T17:50:39.387 INFO:teuthology.orchestra.run.smithi171.stdout:(18/159): libradosstriper1-19.0.0-2744.gd2b507c 1.3 MB/s | 497 kB 00:00 2024-05-20T17:50:39.471 INFO:teuthology.orchestra.run.smithi171.stdout:(19/159): python3-ceph-argparse-19.0.0-2744.gd2 541 kB/s | 45 kB 00:00 2024-05-20T17:50:39.572 INFO:teuthology.orchestra.run.smithi171.stdout:(20/159): python3-ceph-common-19.0.0-2744.gd2b5 1.3 MB/s | 135 kB 00:00 2024-05-20T17:50:39.663 INFO:teuthology.orchestra.run.smithi171.stdout:(21/159): python3-cephfs-19.0.0-2744.gd2b507c7. 1.7 MB/s | 161 kB 00:00 2024-05-20T17:50:39.830 INFO:teuthology.orchestra.run.smithi171.stdout:(22/159): python3-rados-19.0.0-2744.gd2b507c7.e 1.9 MB/s | 320 kB 00:00 2024-05-20T17:50:40.006 INFO:teuthology.orchestra.run.smithi171.stdout:(23/159): python3-rbd-19.0.0-2744.gd2b507c7.el9 1.7 MB/s | 299 kB 00:00 2024-05-20T17:50:40.072 INFO:teuthology.orchestra.run.smithi171.stdout:(24/159): python3-rgw-19.0.0-2744.gd2b507c7.el9 1.5 MB/s | 99 kB 00:00 2024-05-20T17:50:40.112 INFO:teuthology.orchestra.run.smithi006.stdout:(7/159): ceph-common-19.0.0-2744.gd2b507c7.el9. 4.3 MB/s | 19 MB 00:04 2024-05-20T17:50:40.140 INFO:teuthology.orchestra.run.smithi171.stdout:(25/159): rbd-fuse-19.0.0-2744.gd2b507c7.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-20T17:50:40.651 INFO:teuthology.orchestra.run.smithi171.stdout:(26/159): librgw2-19.0.0-2744.gd2b507c7.el9.x86 3.2 MB/s | 5.0 MB 00:01 2024-05-20T17:50:40.748 INFO:teuthology.orchestra.run.smithi171.stdout:(27/159): rbd-nbd-19.0.0-2744.gd2b507c7.el9.x86 1.7 MB/s | 169 kB 00:00 2024-05-20T17:50:40.832 INFO:teuthology.orchestra.run.smithi171.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2744.g 381 kB/s | 32 kB 00:00 2024-05-20T17:50:40.924 INFO:teuthology.orchestra.run.smithi171.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2744.gd2b507c 1.5 MB/s | 142 kB 00:00 2024-05-20T17:50:41.429 INFO:teuthology.orchestra.run.smithi006.stdout:(8/159): ceph-osd-19.0.0-2744.gd2b507c7.el9.x86 6.1 MB/s | 18 MB 00:02 2024-05-20T17:50:41.441 INFO:teuthology.orchestra.run.smithi171.stdout:(30/159): rbd-mirror-19.0.0-2744.gd2b507c7.el9. 2.3 MB/s | 3.0 MB 00:01 2024-05-20T17:50:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:(9/159): ceph-mon-19.0.0-2744.gd2b507c7.el9.x86 1.6 MB/s | 4.9 MB 00:03 2024-05-20T17:50:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:(10/159): ceph-selinux-19.0.0-2744.gd2b507c7.el 189 kB/s | 25 kB 00:00 2024-05-20T17:50:41.647 INFO:teuthology.orchestra.run.smithi006.stdout:(11/159): cephfs-mirror-19.0.0-2744.gd2b507c7.e 2.6 MB/s | 221 kB 00:00 2024-05-20T17:50:41.666 INFO:teuthology.orchestra.run.smithi171.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2744.gd2b50 4.7 MB/s | 3.5 MB 00:00 2024-05-20T17:50:41.705 INFO:teuthology.orchestra.run.smithi006.stdout:(12/159): cephfs-shell-19.0.0-2744.gd2b507c7.el 464 kB/s | 27 kB 00:00 2024-05-20T17:50:41.741 INFO:teuthology.orchestra.run.smithi171.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2744.gd2 3.2 MB/s | 249 kB 00:00 2024-05-20T17:50:41.792 INFO:teuthology.orchestra.run.smithi171.stdout:(33/159): ceph-mgr-rook-19.0.0-2744.gd2b507c7.e 989 kB/s | 49 kB 00:00 2024-05-20T17:50:41.822 INFO:teuthology.orchestra.run.smithi006.stdout:(13/159): ceph-radosgw-19.0.0-2744.gd2b507c7.el 5.8 MB/s | 9.8 MB 00:01 2024-05-20T17:50:41.848 INFO:teuthology.orchestra.run.smithi006.stdout:(14/159): libcephfs-devel-19.0.0-2744.gd2b507c7 223 kB/s | 32 kB 00:00 2024-05-20T17:50:41.850 INFO:teuthology.orchestra.run.smithi171.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2744.gd 281 kB/s | 16 kB 00:00 2024-05-20T17:50:41.906 INFO:teuthology.orchestra.run.smithi006.stdout:(15/159): libcephsqlite-19.0.0-2744.gd2b507c7.e 2.6 MB/s | 158 kB 00:00 2024-05-20T17:50:41.943 INFO:teuthology.orchestra.run.smithi171.stdout:(35/159): ceph-volume-19.0.0-2744.gd2b507c7.el9 2.8 MB/s | 264 kB 00:00 2024-05-20T17:50:41.948 INFO:teuthology.orchestra.run.smithi006.stdout:(16/159): libcephfs2-19.0.0-2744.gd2b507c7.el9. 5.9 MB/s | 756 kB 00:00 2024-05-20T17:50:41.990 INFO:teuthology.orchestra.run.smithi006.stdout:(17/159): librados-devel-19.0.0-2744.gd2b507c7. 1.5 MB/s | 127 kB 00:00 2024-05-20T17:50:42.099 INFO:teuthology.orchestra.run.smithi006.stdout:(18/159): libradosstriper1-19.0.0-2744.gd2b507c 3.2 MB/s | 497 kB 00:00 2024-05-20T17:50:42.143 INFO:teuthology.orchestra.run.smithi171.stdout:(36/159): cephadm-19.0.0-2744.gd2b507c7.el9.noa 3.7 MB/s | 763 kB 00:00 2024-05-20T17:50:42.182 INFO:teuthology.orchestra.run.smithi006.stdout:(19/159): python3-ceph-argparse-19.0.0-2744.gd2 541 kB/s | 45 kB 00:00 2024-05-20T17:50:42.227 INFO:teuthology.orchestra.run.smithi171.stdout:(37/159): cephfs-top-19.0.0-2744.gd2b507c7.el9. 218 kB/s | 18 kB 00:00 2024-05-20T17:50:42.258 INFO:teuthology.orchestra.run.smithi006.stdout:(20/159): python3-ceph-common-19.0.0-2744.gd2b5 1.8 MB/s | 135 kB 00:00 2024-05-20T17:50:42.333 INFO:teuthology.orchestra.run.smithi006.stdout:(21/159): python3-cephfs-19.0.0-2744.gd2b507c7. 2.1 MB/s | 161 kB 00:00 2024-05-20T17:50:42.425 INFO:teuthology.orchestra.run.smithi006.stdout:(22/159): python3-rados-19.0.0-2744.gd2b507c7.e 3.4 MB/s | 320 kB 00:00 2024-05-20T17:50:42.509 INFO:teuthology.orchestra.run.smithi006.stdout:(23/159): python3-rbd-19.0.0-2744.gd2b507c7.el9 3.5 MB/s | 299 kB 00:00 2024-05-20T17:50:42.577 INFO:teuthology.orchestra.run.smithi171.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 229 kB/s | 80 kB 00:00 2024-05-20T17:50:42.584 INFO:teuthology.orchestra.run.smithi006.stdout:(24/159): python3-rgw-19.0.0-2744.gd2b507c7.el9 1.3 MB/s | 99 kB 00:00 2024-05-20T17:50:42.659 INFO:teuthology.orchestra.run.smithi006.stdout:(25/159): rbd-fuse-19.0.0-2744.gd2b507c7.el9.x8 1.1 MB/s | 86 kB 00:00 2024-05-20T17:50:42.777 INFO:teuthology.orchestra.run.smithi006.stdout:(26/159): librgw2-19.0.0-2744.gd2b507c7.el9.x86 6.4 MB/s | 5.0 MB 00:00 2024-05-20T17:50:42.843 INFO:teuthology.orchestra.run.smithi006.stdout:(27/159): rbd-nbd-19.0.0-2744.gd2b507c7.el9.x86 2.5 MB/s | 169 kB 00:00 2024-05-20T17:50:42.910 INFO:teuthology.orchestra.run.smithi006.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2744.g 477 kB/s | 32 kB 00:00 2024-05-20T17:50:42.986 INFO:teuthology.orchestra.run.smithi006.stdout:(29/159): ceph-mgr-cephadm-19.0.0-2744.gd2b507c 1.9 MB/s | 142 kB 00:00 2024-05-20T17:50:43.153 INFO:teuthology.orchestra.run.smithi006.stdout:(30/159): rbd-mirror-19.0.0-2744.gd2b507c7.el9. 6.2 MB/s | 3.0 MB 00:00 2024-05-20T17:50:43.452 INFO:teuthology.orchestra.run.smithi171.stdout:(39/159): ceph-mgr-diskprediction-local-19.0.0- 3.7 MB/s | 7.4 MB 00:02 2024-05-20T17:50:43.486 INFO:teuthology.orchestra.run.smithi171.stdout:(40/159): libgfortran-11.4.1-3.el9.x86_64.rpm 884 kB/s | 803 kB 00:00 2024-05-20T17:50:43.620 INFO:teuthology.orchestra.run.smithi006.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2744.gd2b50 5.5 MB/s | 3.5 MB 00:00 2024-05-20T17:50:43.695 INFO:teuthology.orchestra.run.smithi006.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2744.gd2 3.2 MB/s | 249 kB 00:00 2024-05-20T17:50:43.753 INFO:teuthology.orchestra.run.smithi006.stdout:(33/159): ceph-mgr-rook-19.0.0-2744.gd2b507c7.e 847 kB/s | 49 kB 00:00 2024-05-20T17:50:43.761 INFO:teuthology.orchestra.run.smithi171.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 920 kB/s | 253 kB 00:00 2024-05-20T17:50:43.804 INFO:teuthology.orchestra.run.smithi006.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2744.gd 330 kB/s | 16 kB 00:00 2024-05-20T17:50:43.870 INFO:teuthology.orchestra.run.smithi006.stdout:(35/159): ceph-volume-19.0.0-2744.gd2b507c7.el9 3.9 MB/s | 264 kB 00:00 2024-05-20T17:50:43.961 INFO:teuthology.orchestra.run.smithi171.stdout:(42/159): libquadmath-11.4.1-3.el9.x86_64.rpm 384 kB/s | 195 kB 00:00 2024-05-20T17:50:43.987 INFO:teuthology.orchestra.run.smithi006.stdout:(36/159): cephadm-19.0.0-2744.gd2b507c7.el9.noa 6.4 MB/s | 763 kB 00:00 2024-05-20T17:50:44.070 INFO:teuthology.orchestra.run.smithi171.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2024-05-20T17:50:44.080 INFO:teuthology.orchestra.run.smithi006.stdout:(37/159): ceph-mgr-diskprediction-local-19.0.0- 8.0 MB/s | 7.4 MB 00:00 2024-05-20T17:50:44.105 INFO:teuthology.orchestra.run.smithi006.stdout:(38/159): cephfs-top-19.0.0-2744.gd2b507c7.el9. 156 kB/s | 18 kB 00:00 2024-05-20T17:50:44.164 INFO:teuthology.orchestra.run.smithi006.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 963 kB/s | 80 kB 00:00 2024-05-20T17:50:44.178 INFO:teuthology.orchestra.run.smithi171.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-20T17:50:44.214 INFO:teuthology.orchestra.run.smithi006.stdout:(40/159): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-05-20T17:50:44.256 INFO:teuthology.orchestra.run.smithi006.stdout:(41/159): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-20T17:50:44.304 INFO:teuthology.orchestra.run.smithi171.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 998 kB/s | 125 kB 00:00 2024-05-20T17:50:44.306 INFO:teuthology.orchestra.run.smithi006.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-05-20T17:50:44.374 INFO:teuthology.orchestra.run.smithi006.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-20T17:50:44.413 INFO:teuthology.orchestra.run.smithi171.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-20T17:50:44.432 INFO:teuthology.orchestra.run.smithi006.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-05-20T17:50:44.465 INFO:teuthology.orchestra.run.smithi006.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-05-20T17:50:44.507 INFO:teuthology.orchestra.run.smithi006.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-05-20T17:50:44.558 INFO:teuthology.orchestra.run.smithi006.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-05-20T17:50:44.571 INFO:teuthology.orchestra.run.smithi171.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 689 kB 00:00 2024-05-20T17:50:44.638 INFO:teuthology.orchestra.run.smithi171.stdout:(48/159): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-05-20T17:50:44.641 INFO:teuthology.orchestra.run.smithi006.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-05-20T17:50:44.680 INFO:teuthology.orchestra.run.smithi171.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-05-20T17:50:44.696 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:50:44.717 INFO:teuthology.orchestra.run.smithi006.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-05-20T17:50:44.742 INFO:teuthology.orchestra.run.smithi006.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-05-20T17:50:44.752 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:44.776 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:44.810 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:44.843 INFO:teuthology.orchestra.run.smithi006.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-05-20T17:50:44.901 INFO:teuthology.orchestra.run.smithi006.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-05-20T17:50:44.988 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:45.047 INFO:teuthology.orchestra.run.smithi171.stdout:(50/159): python3-cryptography-36.0.1-4.el9.x86 976 kB/s | 1.2 MB 00:01 2024-05-20T17:50:45.144 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:45.152 INFO:teuthology.orchestra.run.smithi006.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-05-20T17:50:45.194 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:45.202 INFO:teuthology.orchestra.run.smithi006.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-05-20T17:50:45.244 INFO:teuthology.orchestra.run.smithi006.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 277 kB/s | 11 kB 00:00 2024-05-20T17:50:45.306 INFO:teuthology.orchestra.run.smithi171.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-05-20T17:50:45.306 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:45.311 INFO:teuthology.orchestra.run.smithi006.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-05-20T17:50:45.324 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:45.361 INFO:teuthology.orchestra.run.smithi006.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-05-20T17:50:45.365 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:45.382 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:45.399 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 199.223.246.113) 2024-05-20T17:50:45.414 INFO:teuthology.orchestra.run.smithi171.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-05-20T17:50:45.424 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T17:50:45.470 INFO:teuthology.orchestra.run.smithi006.stdout:(58/159): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-20T17:50:45.470 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:45.566 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:45.595 INFO:teuthology.orchestra.run.smithi006.stdout:(59/159): libtool-2.4.6-45.el9.x86_64.rpm 4.6 MB/s | 582 kB 00:00 2024-05-20T17:50:45.637 INFO:teuthology.orchestra.run.smithi006.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 615 kB/s | 25 kB 00:00 2024-05-20T17:50:45.661 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:50:45.687 INFO:teuthology.orchestra.run.smithi006.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-05-20T17:50:45.804 INFO:teuthology.orchestra.run.smithi006.stdout:(62/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 292 kB 00:00 2024-05-20T17:50:45.805 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:50:45.871 INFO:teuthology.orchestra.run.smithi006.stdout:(63/159): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-05-20T17:50:45.896 INFO:teuthology.orchestra.run.smithi006.stdout:(64/159): elfutils-libelf-devel-0.191-4.el9.x86 18 kB/s | 22 kB 00:01 2024-05-20T17:50:45.938 INFO:teuthology.orchestra.run.smithi006.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 528 kB/s | 35 kB 00:00 2024-05-20T17:50:45.973 INFO:teuthology.orchestra.run.smithi171.stdout:(53/159): ceph-test-19.0.0-2744.gd2b507c7.el9.x 5.8 MB/s | 46 MB 00:08 2024-05-20T17:50:45.975 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 163.114.130.31) 2024-05-20T17:50:46.057 INFO:teuthology.orchestra.run.smithi171.stdout:(54/159): elfutils-libelf-devel-0.191-4.el9.x86 16 kB/s | 22 kB 00:01 2024-05-20T17:50:46.157 INFO:teuthology.orchestra.run.smithi171.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 100 kB/s | 18 kB 00:00 2024-05-20T17:50:46.266 INFO:teuthology.orchestra.run.smithi171.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 53 kB/s | 11 kB 00:00 2024-05-20T17:50:46.270 INFO:teuthology.orchestra.run.smithi006.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-05-20T17:50:46.339 INFO:teuthology.orchestra.run.smithi006.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-20T17:50:46.441 INFO:teuthology.orchestra.run.smithi171.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 565 kB/s | 160 kB 00:00 2024-05-20T17:50:46.448 INFO:teuthology.orchestra.run.smithi006.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 8.2 MB/s | 911 kB 00:00 2024-05-20T17:50:46.466 INFO:teuthology.orchestra.run.smithi171.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 226 kB/s | 45 kB 00:00 2024-05-20T17:50:46.498 INFO:teuthology.orchestra.run.smithi006.stdout:(69/159): postgresql-13.14-1.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-05-20T17:50:46.540 INFO:teuthology.orchestra.run.smithi006.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-05-20T17:50:46.665 INFO:teuthology.orchestra.run.smithi006.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-05-20T17:50:46.724 INFO:teuthology.orchestra.run.smithi006.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-20T17:50:46.725 INFO:teuthology.orchestra.run.smithi171.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-05-20T17:50:46.825 INFO:teuthology.orchestra.run.smithi171.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 255 kB/s | 25 kB 00:00 2024-05-20T17:50:46.866 INFO:teuthology.orchestra.run.smithi006.stdout:(73/159): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-05-20T17:50:46.885 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:50:46.934 INFO:teuthology.orchestra.run.smithi171.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-05-20T17:50:46.943 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:50:46.984 INFO:teuthology.orchestra.run.smithi171.stdout:(62/159): libtool-2.4.6-45.el9.x86_64.rpm 1.1 MB/s | 582 kB 00:00 2024-05-20T17:50:47.023 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:50:47.059 INFO:teuthology.orchestra.run.smithi171.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-05-20T17:50:47.091 INFO:teuthology.orchestra.run.smithi006.stdout:(74/159): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-05-20T17:50:47.093 INFO:teuthology.orchestra.run.smithi171.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-20T17:50:47.103 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:50:47.120 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T17:50:47.138 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:50:47.160 INFO:teuthology.orchestra.run.smithi171.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 351 kB/s | 35 kB 00:00 2024-05-20T17:50:47.166 INFO:teuthology.orchestra.run.smithi006.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-05-20T17:50:47.167 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:50:47.184 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:50:47.189 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T17:50:47.218 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T17:50:47.238 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:50:47.300 INFO:teuthology.orchestra.run.smithi006.stdout:(76/159): python3-colorama-0.4.6-3.el9.noarch.r 141 kB/s | 61 kB 00:00 2024-05-20T17:50:47.321 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:50:47.350 INFO:teuthology.orchestra.run.smithi006.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-05-20T17:50:47.401 INFO:teuthology.orchestra.run.smithi006.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-05-20T17:50:47.401 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:50:47.417 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T17:50:47.445 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:50:47.484 INFO:teuthology.orchestra.run.smithi006.stdout:(79/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-05-20T17:50:47.485 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:50:47.502 INFO:teuthology.orchestra.run.smithi171.stdout:(66/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.4 MB/s | 3.0 MB 00:02 2024-05-20T17:50:47.507 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T17:50:47.535 INFO:teuthology.orchestra.run.smithi006.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-05-20T17:50:47.535 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 206.82.17.213) 2024-05-20T17:50:47.618 INFO:teuthology.orchestra.run.smithi006.stdout:(81/159): python3-jinja2-2.11.3-6.el9.noarch.rp 549 kB/s | 248 kB 00:00 2024-05-20T17:50:47.694 INFO:teuthology.orchestra.run.smithi006.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-05-20T17:50:47.694 INFO:teuthology.orchestra.run.smithi171.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 7.9 MB/s | 4.7 MB 00:00 2024-05-20T17:50:47.778 INFO:teuthology.orchestra.run.smithi006.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-05-20T17:50:47.819 INFO:teuthology.orchestra.run.smithi171.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 7.1 MB/s | 911 kB 00:00 2024-05-20T17:50:47.869 INFO:teuthology.orchestra.run.smithi006.stdout:(84/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-05-20T17:50:47.920 INFO:teuthology.orchestra.run.smithi006.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 544 kB/s | 77 kB 00:00 2024-05-20T17:50:47.928 INFO:teuthology.orchestra.run.smithi171.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-05-20T17:50:47.945 INFO:teuthology.orchestra.run.smithi006.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 561 kB/s | 42 kB 00:00 2024-05-20T17:50:48.012 INFO:teuthology.orchestra.run.smithi006.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-05-20T17:50:48.037 INFO:teuthology.orchestra.run.smithi006.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-05-20T17:50:48.096 INFO:teuthology.orchestra.run.smithi006.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 875 kB/s | 51 kB 00:00 2024-05-20T17:50:48.121 INFO:teuthology.orchestra.run.smithi006.stdout:(90/159): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-05-20T17:50:48.153 INFO:teuthology.orchestra.run.smithi171.stdout:(70/159): postgresql-13.14-1.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2024-05-20T17:50:48.163 INFO:teuthology.orchestra.run.smithi006.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 803 kB/s | 54 kB 00:00 2024-05-20T17:50:48.213 INFO:teuthology.orchestra.run.smithi006.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-05-20T17:50:48.270 INFO:teuthology.orchestra.run.smithi171.stdout:(71/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-05-20T17:50:48.272 INFO:teuthology.orchestra.run.smithi006.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-05-20T17:50:48.389 INFO:teuthology.orchestra.run.smithi006.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-05-20T17:50:48.440 INFO:teuthology.orchestra.run.smithi006.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-05-20T17:50:48.462 INFO:teuthology.orchestra.run.smithi171.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 457 kB/s | 87 kB 00:00 2024-05-20T17:50:48.498 INFO:teuthology.orchestra.run.smithi006.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 815 kB/s | 47 kB 00:00 2024-05-20T17:50:48.590 INFO:teuthology.orchestra.run.smithi006.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 305 kB 00:00 2024-05-20T17:50:48.637 INFO:teuthology.orchestra.run.smithi171.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 2.1 MB/s | 1.0 MB 00:00 2024-05-20T17:50:48.717 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:50:48.734 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T17:50:48.765 INFO:teuthology.orchestra.run.smithi006.stdout:(98/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-05-20T17:50:48.791 INFO:teuthology.orchestra.run.smithi006.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 289 kB/s | 58 kB 00:00 2024-05-20T17:50:48.813 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:50:48.832 INFO:teuthology.orchestra.run.smithi006.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-05-20T17:50:48.842 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:50:48.858 INFO:teuthology.orchestra.run.smithi006.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-05-20T17:50:48.861 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:50:48.878 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:50:48.908 INFO:teuthology.orchestra.run.smithi006.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-05-20T17:50:48.933 INFO:teuthology.orchestra.run.smithi006.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-05-20T17:50:48.935 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:50:48.957 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T17:50:49.034 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-colorama-0.4.6-3.el9.noarch.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-colorama-0.4.6-3.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T17:50:49.284 INFO:teuthology.orchestra.run.smithi006.stdout:(104/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-05-20T17:50:49.317 INFO:teuthology.orchestra.run.smithi006.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-05-20T17:50:49.351 INFO:teuthology.orchestra.run.smithi006.stdout:(106/159): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-05-20T17:50:49.451 INFO:teuthology.orchestra.run.smithi006.stdout:(107/159): grpc-data-1.46.7-10.el9.noarch.rpm 145 kB/s | 19 kB 00:00 2024-05-20T17:50:49.462 INFO:teuthology.orchestra.run.smithi171.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 74 kB/s | 61 kB 00:00 2024-05-20T17:50:49.527 INFO:teuthology.orchestra.run.smithi006.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-05-20T17:50:49.593 INFO:teuthology.orchestra.run.smithi006.stdout:(109/159): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-20T17:50:49.660 INFO:teuthology.orchestra.run.smithi006.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-20T17:50:49.686 INFO:teuthology.orchestra.run.smithi006.stdout:(111/159): liboath-2.6.7-2.el9.x86_64.rpm 305 kB/s | 49 kB 00:00 2024-05-20T17:50:49.720 INFO:teuthology.orchestra.run.smithi006.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-20T17:50:49.737 INFO:teuthology.orchestra.run.smithi171.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 888 kB/s | 244 kB 00:00 2024-05-20T17:50:49.778 INFO:teuthology.orchestra.run.smithi006.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-05-20T17:50:49.828 INFO:teuthology.orchestra.run.smithi006.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 874 kB/s | 43 kB 00:00 2024-05-20T17:50:49.830 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:50:49.887 INFO:teuthology.orchestra.run.smithi006.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 552 kB/s | 32 kB 00:00 2024-05-20T17:50:49.912 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 140.211.166.134) 2024-05-20T17:50:49.929 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.siena.edu/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 199.223.246.113) 2024-05-20T17:50:49.929 INFO:teuthology.orchestra.run.smithi006.stdout:(116/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-05-20T17:50:49.948 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:50:49.954 INFO:teuthology.orchestra.run.smithi006.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-05-20T17:50:49.967 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 216.158.133.254) 2024-05-20T17:50:49.985 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:50:49.988 INFO:teuthology.orchestra.run.smithi006.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-05-20T17:50:50.030 INFO:teuthology.orchestra.run.smithi006.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-05-20T17:50:50.042 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 72.4.120.219) 2024-05-20T17:50:50.063 INFO:teuthology.orchestra.run.smithi006.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-20T17:50:50.064 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for http://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T17:50:50.089 INFO:teuthology.orchestra.run.smithi006.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-05-20T17:50:50.139 INFO:teuthology.orchestra.run.smithi006.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-05-20T17:50:50.145 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] python3-jinja2-2.11.3-6.el9.noarch.rpm: Status code: 404 for https://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.11.3-6.el9.noarch.rpm (IP: 163.114.130.31) 2024-05-20T17:50:50.206 INFO:teuthology.orchestra.run.smithi006.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-05-20T17:50:50.232 INFO:teuthology.orchestra.run.smithi006.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-05-20T17:50:50.265 INFO:teuthology.orchestra.run.smithi006.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2024-05-20T17:50:50.271 INFO:teuthology.orchestra.run.smithi171.stdout:(76/159): postgresql-server-13.14-1.el9.x86_64. 2.5 MB/s | 5.8 MB 00:02 2024-05-20T17:50:50.282 INFO:teuthology.orchestra.run.smithi006.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-05-20T17:50:50.316 INFO:teuthology.orchestra.run.smithi006.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-05-20T17:50:50.338 INFO:teuthology.orchestra.run.smithi171.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 413 kB/s | 248 kB 00:00 2024-05-20T17:50:50.341 INFO:teuthology.orchestra.run.smithi006.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-05-20T17:50:50.380 INFO:teuthology.orchestra.run.smithi171.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-05-20T17:50:50.391 INFO:teuthology.orchestra.run.smithi006.stdout:(129/159): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-05-20T17:50:50.408 INFO:teuthology.orchestra.run.smithi006.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 692 kB/s | 46 kB 00:00 2024-05-20T17:50:50.439 INFO:teuthology.orchestra.run.smithi171.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-05-20T17:50:50.442 INFO:teuthology.orchestra.run.smithi006.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-20T17:50:50.459 INFO:teuthology.orchestra.run.smithi006.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-20T17:50:50.501 INFO:teuthology.orchestra.run.smithi006.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-05-20T17:50:50.518 INFO:teuthology.orchestra.run.smithi006.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-05-20T17:50:50.547 INFO:teuthology.orchestra.run.smithi171.stdout:(80/159): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-05-20T17:50:50.560 INFO:teuthology.orchestra.run.smithi006.stdout:(135/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-20T17:50:50.581 INFO:teuthology.orchestra.run.smithi171.stdout:(81/159): python3-mako-1.1.4-6.el9.noarch.rpm 857 kB/s | 172 kB 00:00 2024-05-20T17:50:50.593 INFO:teuthology.orchestra.run.smithi006.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-05-20T17:50:50.627 INFO:teuthology.orchestra.run.smithi006.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-05-20T17:50:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:(138/159): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-05-20T17:50:50.686 INFO:teuthology.orchestra.run.smithi006.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-20T17:50:50.690 INFO:teuthology.orchestra.run.smithi171.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-20T17:50:50.720 INFO:teuthology.orchestra.run.smithi006.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 612 kB/s | 36 kB 00:00 2024-05-20T17:50:50.745 INFO:teuthology.orchestra.run.smithi006.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 869 kB/s | 51 kB 00:00 2024-05-20T17:50:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:(142/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-05-20T17:50:50.790 INFO:teuthology.orchestra.run.smithi171.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-05-20T17:50:50.812 INFO:teuthology.orchestra.run.smithi006.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-20T17:50:50.871 INFO:teuthology.orchestra.run.smithi006.stdout:(144/159): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-20T17:50:50.896 INFO:teuthology.orchestra.run.smithi006.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-05-20T17:50:50.898 INFO:teuthology.orchestra.run.smithi171.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 711 kB/s | 77 kB 00:00 2024-05-20T17:50:50.938 INFO:teuthology.orchestra.run.smithi006.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-05-20T17:50:50.988 INFO:teuthology.orchestra.run.smithi006.stdout:(147/159): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-05-20T17:50:50.999 INFO:teuthology.orchestra.run.smithi171.stdout:(85/159): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-05-20T17:50:51.112 INFO:teuthology.orchestra.run.smithi171.stdout:(86/159): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-05-20T17:50:51.225 INFO:teuthology.orchestra.run.smithi171.stdout:(87/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-05-20T17:50:51.272 INFO:teuthology.orchestra.run.smithi006.stdout:(148/159): librados2-19.0.0-2744.gd2b507c7.el9. 9.9 MB/s | 3.3 MB 00:00 2024-05-20T17:50:51.333 INFO:teuthology.orchestra.run.smithi171.stdout:(88/159): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-05-20T17:50:51.535 INFO:teuthology.orchestra.run.smithi006.stdout:(149/159): NetworkManager-1.47.90-1.el9.x86_64. 8.8 MB/s | 2.3 MB 00:00 2024-05-20T17:50:51.665 INFO:teuthology.orchestra.run.smithi006.stdout:(150/159): NetworkManager-libnm-1.47.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-05-20T17:50:51.667 INFO:teuthology.orchestra.run.smithi171.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 153 kB/s | 51 kB 00:00 2024-05-20T17:50:51.723 INFO:teuthology.orchestra.run.smithi006.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 715 kB/s | 41 kB 00:00 2024-05-20T17:50:51.776 INFO:teuthology.orchestra.run.smithi171.stdout:(90/159): python3-requests-oauthlib-1.3.0-12.el 494 kB/s | 54 kB 00:00 2024-05-20T17:50:51.798 INFO:teuthology.orchestra.run.smithi006.stdout:(152/159): NetworkManager-tui-1.47.90-1.el9.x86 3.2 MB/s | 248 kB 00:00 2024-05-20T17:50:51.815 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:51.873 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:51.892 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:51.949 INFO:teuthology.orchestra.run.smithi006.stdout:(153/159): librbd1-19.0.0-2744.gd2b507c7.el9.x8 3.2 MB/s | 3.1 MB 00:00 2024-05-20T17:50:51.949 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:51.987 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:50:52.007 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:52.012 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:50:52.025 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:52.044 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:52.070 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:52.092 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:50:52.128 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:50:52.171 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:52.591 INFO:teuthology.orchestra.run.smithi006.stdout:(154/159): ceph-test-19.0.0-2744.gd2b507c7.el9. 4.2 MB/s | 46 MB 00:11 2024-05-20T17:50:52.671 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:52.677 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:52.695 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:52.713 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:50:52.731 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.pilotfiber.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 216.158.133.254) 2024-05-20T17:50:52.780 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:50:52.812 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 206.82.17.213) 2024-05-20T17:50:52.865 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:52.892 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:52.949 INFO:teuthology.orchestra.run.smithi006.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 32 kB/s | 37 kB 00:01 2024-05-20T17:50:52.979 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:53.066 INFO:teuthology.orchestra.run.smithi006.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 582 kB/s | 260 kB 00:00 2024-05-20T17:50:53.067 INFO:teuthology.orchestra.run.smithi006.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:50:53.116 INFO:teuthology.orchestra.run.smithi006.stdout:(157/159): elfutils-libelf-0.191-4.el9.x86_64.r 177 kB/s | 207 kB 00:01 2024-05-20T17:50:53.408 INFO:teuthology.orchestra.run.smithi006.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 2.9 MB/s | 1.3 MB 00:00 2024-05-20T17:50:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.2 MB/s | 2.4 MB 00:00 2024-05-20T17:50:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:50:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:Total 12 MB/s | 222 MB 00:18 2024-05-20T17:50:54.936 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-05-20T17:50:55.115 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-05-20T17:50:55.115 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-05-20T17:50:55.509 INFO:teuthology.orchestra.run.smithi171.stdout:(91/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.4 MB/s | 16 MB 00:03 2024-05-20T17:50:55.618 INFO:teuthology.orchestra.run.smithi171.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 389 kB/s | 42 kB 00:00 2024-05-20T17:50:55.718 INFO:teuthology.orchestra.run.smithi171.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-05-20T17:50:55.826 INFO:teuthology.orchestra.run.smithi171.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-20T17:50:55.935 INFO:teuthology.orchestra.run.smithi171.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-05-20T17:50:56.044 INFO:teuthology.orchestra.run.smithi171.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-05-20T17:50:56.152 INFO:teuthology.orchestra.run.smithi171.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-05-20T17:50:56.261 INFO:teuthology.orchestra.run.smithi171.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-05-20T17:50:56.370 INFO:teuthology.orchestra.run.smithi171.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 865 kB/s | 94 kB 00:00 2024-05-20T17:50:56.470 INFO:teuthology.orchestra.run.smithi171.stdout:(100/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 637 kB/s | 64 kB 00:00 2024-05-20T17:50:56.670 INFO:teuthology.orchestra.run.smithi171.stdout:(101/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 224 kB/s | 45 kB 00:00 2024-05-20T17:50:56.837 INFO:teuthology.orchestra.run.smithi171.stdout:(102/159): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-05-20T17:50:56.996 INFO:teuthology.orchestra.run.smithi171.stdout:(103/159): python3-babel-2.9.1-2.el9.noarch.rpm 715 kB/s | 6.0 MB 00:08 2024-05-20T17:50:57.030 INFO:teuthology.orchestra.run.smithi171.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-05-20T17:50:57.432 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-05-20T17:50:57.432 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-05-20T17:50:57.596 INFO:teuthology.orchestra.run.smithi171.stdout:(105/159): python3-numpy-1.20.1-5.el9.x86_64.rp 740 kB/s | 5.1 MB 00:07 2024-05-20T17:50:57.621 INFO:teuthology.orchestra.run.smithi171.stdout:(106/159): gperftools-libs-2.9.1-2.el9.x86_64.r 522 kB/s | 309 kB 00:00 2024-05-20T17:50:57.647 INFO:teuthology.orchestra.run.smithi171.stdout:(107/159): abseil-cpp-20211102.0-3.el9.x86_64.r 842 kB/s | 548 kB 00:00 2024-05-20T17:50:57.756 INFO:teuthology.orchestra.run.smithi171.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-05-20T17:50:57.881 INFO:teuthology.orchestra.run.smithi171.stdout:(109/159): grpc-data-1.46.7-10.el9.noarch.rpm 68 kB/s | 19 kB 00:00 2024-05-20T17:50:57.906 INFO:teuthology.orchestra.run.smithi171.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 323 kB/s | 49 kB 00:00 2024-05-20T17:50:58.040 INFO:teuthology.orchestra.run.smithi171.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-05-20T17:50:58.107 INFO:teuthology.orchestra.run.smithi171.stdout:(112/159): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-05-20T17:50:58.132 INFO:teuthology.orchestra.run.smithi171.stdout:(113/159): libunwind-1.6.2-1.el9.x86_64.rpm 268 kB/s | 67 kB 00:00 2024-05-20T17:50:58.216 INFO:teuthology.orchestra.run.smithi171.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-05-20T17:50:58.241 INFO:teuthology.orchestra.run.smithi171.stdout:(115/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-05-20T17:50:58.266 INFO:teuthology.orchestra.run.smithi171.stdout:(116/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 325 kB/s | 43 kB 00:00 2024-05-20T17:50:58.333 INFO:teuthology.orchestra.run.smithi171.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 274 kB/s | 32 kB 00:00 2024-05-20T17:50:58.358 INFO:teuthology.orchestra.run.smithi171.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-05-20T17:50:58.442 INFO:teuthology.orchestra.run.smithi171.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-05-20T17:50:58.476 INFO:teuthology.orchestra.run.smithi171.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-05-20T17:50:58.501 INFO:teuthology.orchestra.run.smithi171.stdout:(121/159): python3-cheroot-8.6.0-4.el9.noarch.r 732 kB/s | 172 kB 00:00 2024-05-20T17:50:58.560 INFO:teuthology.orchestra.run.smithi171.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-05-20T17:50:58.618 INFO:teuthology.orchestra.run.smithi171.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-05-20T17:50:58.644 INFO:teuthology.orchestra.run.smithi171.stdout:(124/159): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-05-20T17:50:58.686 INFO:teuthology.orchestra.run.smithi171.stdout:(125/159): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-05-20T17:50:58.711 INFO:teuthology.orchestra.run.smithi171.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-05-20T17:50:58.744 INFO:teuthology.orchestra.run.smithi171.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-05-20T17:50:58.778 INFO:teuthology.orchestra.run.smithi171.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-05-20T17:50:58.803 INFO:teuthology.orchestra.run.smithi171.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-05-20T17:50:58.870 INFO:teuthology.orchestra.run.smithi171.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-05-20T17:50:58.904 INFO:teuthology.orchestra.run.smithi171.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 786 kB/s | 79 kB 00:00 2024-05-20T17:50:58.962 INFO:teuthology.orchestra.run.smithi171.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 628 kB/s | 58 kB 00:00 2024-05-20T17:50:59.021 INFO:teuthology.orchestra.run.smithi171.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-05-20T17:50:59.063 INFO:teuthology.orchestra.run.smithi171.stdout:(134/159): python3-kubernetes-26.1.0-2.el9.noar 3.2 MB/s | 1.0 MB 00:00 2024-05-20T17:50:59.088 INFO:teuthology.orchestra.run.smithi171.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 131 kB/s | 16 kB 00:00 2024-05-20T17:50:59.130 INFO:teuthology.orchestra.run.smithi171.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2024-05-20T17:50:59.197 INFO:teuthology.orchestra.run.smithi171.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 211 kB/s | 28 kB 00:00 2024-05-20T17:50:59.223 INFO:teuthology.orchestra.run.smithi171.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 230 kB/s | 31 kB 00:00 2024-05-20T17:50:59.248 INFO:teuthology.orchestra.run.smithi171.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-05-20T17:50:59.298 INFO:teuthology.orchestra.run.smithi171.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-05-20T17:50:59.340 INFO:teuthology.orchestra.run.smithi171.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 305 kB/s | 36 kB 00:00 2024-05-20T17:50:59.432 INFO:teuthology.orchestra.run.smithi171.stdout:(142/159): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-05-20T17:50:59.457 INFO:teuthology.orchestra.run.smithi171.stdout:(143/159): python3-typing-extensions-4.4.0-2.el 244 kB/s | 51 kB 00:00 2024-05-20T17:50:59.482 INFO:teuthology.orchestra.run.smithi171.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 631 kB/s | 90 kB 00:00 2024-05-20T17:50:59.574 INFO:teuthology.orchestra.run.smithi171.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-05-20T17:50:59.608 INFO:teuthology.orchestra.run.smithi171.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 132 kB/s | 20 kB 00:00 2024-05-20T17:50:59.634 INFO:teuthology.orchestra.run.smithi171.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-05-20T17:50:59.767 INFO:teuthology.orchestra.run.smithi171.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-05-20T17:51:00.018 INFO:teuthology.orchestra.run.smithi171.stdout:(149/159): librbd1-19.0.0-2744.gd2b507c7.el9.x8 8.0 MB/s | 3.1 MB 00:00 2024-05-20T17:51:00.134 INFO:teuthology.orchestra.run.smithi171.stdout:(150/159): librados2-19.0.0-2744.gd2b507c7.el9. 6.3 MB/s | 3.3 MB 00:00 2024-05-20T17:51:00.401 INFO:teuthology.orchestra.run.smithi171.stdout:(151/159): NetworkManager-team-1.47.90-1.el9.x8 156 kB/s | 41 kB 00:00 2024-05-20T17:51:00.668 INFO:teuthology.orchestra.run.smithi171.stdout:(152/159): NetworkManager-tui-1.47.90-1.el9.x86 930 kB/s | 248 kB 00:00 2024-05-20T17:51:00.735 INFO:teuthology.orchestra.run.smithi171.stdout:(153/159): NetworkManager-1.47.90-1.el9.x86_64. 2.4 MB/s | 2.3 MB 00:00 2024-05-20T17:51:00.748 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:51:00.815 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:51:00.902 INFO:teuthology.orchestra.run.smithi171.stdout:(154/159): NetworkManager-libnm-1.47.90-1.el9.x 2.0 MB/s | 1.8 MB 00:00 2024-05-20T17:51:01.118 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:51:01.139 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:51:01.194 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-debuginfod-client-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:51:01.197 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:51:01.216 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:51:01.277 INFO:teuthology.orchestra.run.smithi171.stdout:(155/159): elfutils-debuginfod-client-0.191-4.e 60 kB/s | 37 kB 00:00 2024-05-20T17:51:01.281 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:51:01.288 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libelf-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:51:01.377 INFO:teuthology.orchestra.run.smithi171.stdout:(156/159): elfutils-libelf-0.191-4.el9.x86_64.r 322 kB/s | 207 kB 00:00 2024-05-20T17:51:01.378 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 140.211.166.134) 2024-05-20T17:51:01.395 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for http://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:51:01.453 INFO:teuthology.orchestra.run.smithi171.stdout:[MIRROR] elfutils-libs-0.191-4.el9.x86_64.rpm: Status code: 404 for https://mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/elfutils-libs-0.191-4.el9.x86_64.rpm (IP: 72.4.120.219) 2024-05-20T17:51:01.520 INFO:teuthology.orchestra.run.smithi171.stdout:(157/159): elfutils-libs-0.191-4.el9.x86_64.rpm 439 kB/s | 260 kB 00:00 2024-05-20T17:51:01.970 INFO:teuthology.orchestra.run.smithi171.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.0 MB/s | 2.4 MB 00:00 2024-05-20T17:51:03.337 INFO:teuthology.orchestra.run.smithi171.stdout:(159/159): openssl-3.2.1-1.el9.x86_64.rpm 671 kB/s | 1.3 MB 00:02 2024-05-20T17:51:03.343 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-05-20T17:51:03.343 INFO:teuthology.orchestra.run.smithi171.stdout:Total 7.3 MB/s | 222 MB 00:30 2024-05-20T17:51:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-05-20T17:51:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-20T17:51:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-20T17:51:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-20T17:51:04.181 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-20T17:51:04.206 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-20T17:51:04.254 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-20T17:51:04.554 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-05-20T17:51:04.602 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-20T17:51:04.715 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-05-20T17:51:04.715 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-05-20T17:51:04.715 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:51:04.844 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:51:04.867 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:51:04.960 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:51:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:51:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-20T17:51:05.262 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-20T17:51:05.312 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-20T17:51:05.339 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:51:05.446 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:51:05.473 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:51:05.536 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:51:05.558 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:51:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:51:05.770 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:51:06.002 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:51:06.131 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:51:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:51:06.290 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:51:06.367 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:51:06.571 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:51:06.684 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-20T17:51:06.781 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-20T17:51:06.823 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-20T17:51:06.859 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-20T17:51:06.934 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-20T17:51:06.983 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-20T17:51:06.986 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-05-20T17:51:06.986 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-05-20T17:51:07.035 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-20T17:51:07.068 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-20T17:51:07.095 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-20T17:51:07.168 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-20T17:51:07.219 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-20T17:51:07.249 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-20T17:51:07.292 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-20T17:51:07.372 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-20T17:51:07.403 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 34/170 2024-05-20T17:51:07.446 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 35/170 2024-05-20T17:51:07.474 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 36/170 2024-05-20T17:51:07.559 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-20T17:51:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-20T17:51:07.705 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-20T17:51:07.858 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-20T17:51:07.919 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-20T17:51:08.486 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-20T17:51:08.575 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-20T17:51:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-20T17:51:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-20T17:51:08.694 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-20T17:51:08.732 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 47/170 2024-05-20T17:51:08.792 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-20T17:51:08.944 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-20T17:51:09.010 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-20T17:51:09.067 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-20T17:51:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-20T17:51:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-20T17:51:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-20T17:51:09.270 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-20T17:51:09.389 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-20T17:51:09.433 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-20T17:51:09.475 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-20T17:51:09.644 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-20T17:51:09.692 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-20T17:51:09.734 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-20T17:51:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-20T17:51:09.867 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-20T17:51:09.909 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-20T17:51:09.940 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-20T17:51:09.965 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-20T17:51:10.056 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-20T17:51:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-20T17:51:10.240 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-20T17:51:10.268 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-20T17:51:10.310 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-20T17:51:10.350 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-20T17:51:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-20T17:51:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-20T17:51:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-20T17:51:10.487 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-20T17:51:10.529 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-20T17:51:10.563 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-20T17:51:10.654 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-20T17:51:10.703 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-20T17:51:10.735 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-20T17:51:10.783 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-20T17:51:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-20T17:51:10.954 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-20T17:51:11.724 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-20T17:51:11.767 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-20T17:51:11.801 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-20T17:51:11.905 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-20T17:51:11.965 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-20T17:51:12.010 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-20T17:51:12.102 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-20T17:51:12.145 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-20T17:51:12.328 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-20T17:51:12.351 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-20T17:51:12.432 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-20T17:51:13.133 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-20T17:51:13.186 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-05-20T17:51:13.263 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-20T17:51:13.283 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-05-20T17:51:13.321 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-05-20T17:51:13.391 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-05-20T17:51:13.433 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-05-20T17:51:13.458 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-05-20T17:51:13.510 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-05-20T17:51:13.856 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-05-20T17:51:13.995 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:51:14.126 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:51:14.152 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:51:14.227 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:51:14.257 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:51:14.305 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-05-20T17:51:14.522 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-05-20T17:51:14.582 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-05-20T17:51:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-20T17:51:14.609 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:51:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-20T17:51:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-20T17:51:14.720 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:51:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-20T17:51:14.762 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:51:14.805 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 15/170 2024-05-20T17:51:14.827 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:51:14.852 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-05-20T17:51:15.038 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:51:15.079 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-20T17:51:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:51:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:51:15.216 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-05-20T17:51:15.234 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 104/170 2024-05-20T17:51:15.271 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-20T17:51:15.449 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:51:15.493 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 18/170 2024-05-20T17:51:15.609 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:51:15.694 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:51:15.773 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-20T17:51:15.798 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:51:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:51:15.896 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 19/170 2024-05-20T17:51:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 108/170 2024-05-20T17:51:16.008 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-05-20T17:51:16.102 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-05-20T17:51:16.141 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-05-20T17:51:16.175 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-05-20T17:51:16.239 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-05-20T17:51:16.284 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-05-20T17:51:16.326 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-05-20T17:51:16.360 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-05-20T17:51:16.387 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-05-20T17:51:16.455 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-05-20T17:51:16.509 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-05-20T17:51:16.540 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-05-20T17:51:16.575 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-05-20T17:51:16.651 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-05-20T17:51:16.686 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 34/170 2024-05-20T17:51:16.729 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 35/170 2024-05-20T17:51:16.758 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 36/170 2024-05-20T17:51:16.827 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-05-20T17:51:16.881 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-05-20T17:51:16.955 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-05-20T17:51:17.087 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-05-20T17:51:17.142 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-05-20T17:51:17.659 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-05-20T17:51:17.754 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-05-20T17:51:17.792 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-05-20T17:51:17.851 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-05-20T17:51:17.902 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-05-20T17:51:17.940 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 47/170 2024-05-20T17:51:17.984 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-05-20T17:51:18.133 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-05-20T17:51:18.187 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-05-20T17:51:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:51:18.241 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-05-20T17:51:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:51:18.330 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-05-20T17:51:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-05-20T17:51:18.398 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-05-20T17:51:18.444 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-05-20T17:51:18.481 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-05-20T17:51:18.532 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-05-20T17:51:18.574 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-05-20T17:51:18.709 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-05-20T17:51:18.760 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-05-20T17:51:18.801 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-05-20T17:51:18.836 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:51:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:51:18.894 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-05-20T17:51:18.934 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-05-20T17:51:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:51:18.956 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-20T17:51:18.956 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-20T17:51:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:18.976 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-05-20T17:51:18.993 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:51:19.008 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-05-20T17:51:19.033 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-05-20T17:51:19.118 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-05-20T17:51:19.243 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-05-20T17:51:19.282 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-05-20T17:51:19.310 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-05-20T17:51:19.348 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-05-20T17:51:19.392 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-05-20T17:51:19.423 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-05-20T17:51:19.453 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-05-20T17:51:19.488 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-05-20T17:51:19.521 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-05-20T17:51:19.562 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-05-20T17:51:19.597 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-05-20T17:51:19.684 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-05-20T17:51:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-05-20T17:51:19.767 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-05-20T17:51:19.813 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-05-20T17:51:19.914 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-05-20T17:51:19.960 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-05-20T17:51:20.682 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-05-20T17:51:20.731 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-05-20T17:51:20.765 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-05-20T17:51:20.863 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-05-20T17:51:20.912 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-05-20T17:51:20.956 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-05-20T17:51:21.043 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-05-20T17:51:21.093 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-05-20T17:51:21.269 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-05-20T17:51:21.299 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-05-20T17:51:21.377 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-05-20T17:51:22.035 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-05-20T17:51:22.154 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-05-20T17:51:23.390 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-05-20T17:51:23.468 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-05-20T17:51:23.496 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-05-20T17:51:23.529 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-05-20T17:51:23.849 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-05-20T17:51:23.892 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:51:23.975 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 103/170 2024-05-20T17:51:24.006 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 104/170 2024-05-20T17:51:24.042 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-05-20T17:51:24.517 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-05-20T17:51:24.545 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:51:24.599 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 107/170 2024-05-20T17:51:24.622 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 108/170 2024-05-20T17:51:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:51:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:51:27.417 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 109/170 2024-05-20T17:51:27.454 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:51:27.555 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 110/170 2024-05-20T17:51:27.555 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-20T17:51:27.555 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-20T17:51:27.555 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:27.589 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:51:31.273 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:51:31.274 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2024-05-20T17:51:31.274 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2024-05-20T17:51:31.274 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2024-05-20T17:51:31.274 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2024-05-20T17:51:31.274 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2024-05-20T17:51:31.274 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /root 2024-05-20T17:51:31.274 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2024-05-20T17:51:31.274 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:31.450 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:51:31.468 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:51:31.468 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:31.468 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-20T17:51:31.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:33.104 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:51:33.132 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:51:33.132 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:33.132 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-20T17:51:33.132 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:51:33.132 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:51:33.132 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:33.371 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:51:33.396 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:51:33.396 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:33.396 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-20T17:51:33.396 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:51:33.396 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:51:33.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:33.888 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:51:33.913 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:51:33.913 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:33.913 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-20T17:51:33.914 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:51:33.914 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:51:33.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:34.019 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-20T17:51:34.077 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-20T17:51:34.141 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-20T17:51:34.338 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-20T17:51:34.390 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-20T17:51:34.471 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-20T17:51:34.569 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-20T17:51:34.719 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-20T17:51:34.773 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-20T17:51:34.812 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-20T17:51:34.849 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-20T17:51:35.206 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:51:35.268 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:51:35.300 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 128/170 2024-05-20T17:51:35.364 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 129/170 2024-05-20T17:51:35.390 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:51:36.480 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:51:36.525 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:51:37.541 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:51:37.567 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:51:37.679 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:51:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 133/170 2024-05-20T17:51:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:51:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:51:37.904 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:37.904 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-20T17:51:37.904 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:51:37.904 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:51:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:37.954 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:51:37.965 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:51:38.067 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 136/170 2024-05-20T17:51:38.125 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 137/170 2024-05-20T17:51:39.069 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 111/170 2024-05-20T17:51:39.069 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-05-20T17:51:39.069 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-05-20T17:51:39.069 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-05-20T17:51:39.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-05-20T17:51:39.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-05-20T17:51:39.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-05-20T17:51:39.070 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-05-20T17:51:39.070 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:39.091 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-20T17:51:39.122 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:51:39.148 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:51:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-20T17:51:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:51:39.148 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:51:39.148 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:39.198 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:51:39.222 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:51:39.222 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:39.223 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-20T17:51:39.223 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:39.233 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:51:39.249 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 112/170 2024-05-20T17:51:39.249 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:39.249 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-20T17:51:39.250 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:39.274 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:51:39.299 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:51:39.299 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:39.299 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-20T17:51:39.299 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:51:39.299 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:51:39.299 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:39.624 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:51:39.649 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:51:39.650 INFO:teuthology.orchestra.run.smithi006.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:39.650 INFO:teuthology.orchestra.run.smithi006.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-20T17:51:39.650 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:51:39.650 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:51:39.650 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:40.854 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:51:40.881 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 113/170 2024-05-20T17:51:40.881 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:40.881 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-20T17:51:40.881 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:51:40.881 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-20T17:51:40.882 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:41.113 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:51:41.137 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 114/170 2024-05-20T17:51:41.137 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:41.137 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-20T17:51:41.137 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:51:41.137 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-20T17:51:41.137 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:41.606 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:51:41.629 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 115/170 2024-05-20T17:51:41.630 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:41.630 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-20T17:51:41.630 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:51:41.630 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-20T17:51:41.630 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:41.727 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-05-20T17:51:41.792 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-05-20T17:51:41.848 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-05-20T17:51:42.042 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-05-20T17:51:42.089 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-05-20T17:51:42.166 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-05-20T17:51:42.255 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-05-20T17:51:42.405 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-05-20T17:51:42.440 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-05-20T17:51:42.474 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-05-20T17:51:42.499 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-05-20T17:51:42.902 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:51:42.931 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 127/170 2024-05-20T17:51:42.962 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 128/170 2024-05-20T17:51:43.024 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 129/170 2024-05-20T17:51:43.054 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:51:44.079 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 130/170 2024-05-20T17:51:44.122 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:51:44.470 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 143/170 2024-05-20T17:51:44.512 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 144/170 2024-05-20T17:51:44.553 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 145/170 2024-05-20T17:51:44.584 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-20T17:51:44.611 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-20T17:51:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 148/170 2024-05-20T17:51:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-20T17:51:44.899 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 150/170 2024-05-20T17:51:44.939 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-20T17:51:44.968 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-20T17:51:45.006 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:51:45.083 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 131/170 2024-05-20T17:51:45.122 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:51:45.224 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 132/170 2024-05-20T17:51:45.396 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 133/170 2024-05-20T17:51:45.424 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:51:45.449 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 134/170 2024-05-20T17:51:45.449 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:45.449 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-20T17:51:45.449 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:51:45.449 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-20T17:51:45.449 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:45.500 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:51:45.512 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 135/170 2024-05-20T17:51:45.609 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 136/170 2024-05-20T17:51:45.645 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:51:45.662 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 137/170 2024-05-20T17:51:45.679 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:51:45.700 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:51:46.565 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-05-20T17:51:46.594 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:51:46.612 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 155/170 2024-05-20T17:51:46.617 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 139/170 2024-05-20T17:51:46.618 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:46.618 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-20T17:51:46.618 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:51:46.618 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-20T17:51:46.618 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:46.661 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:51:46.684 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 140/170 2024-05-20T17:51:46.684 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:46.684 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-20T17:51:46.684 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:46.708 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-20T17:51:46.728 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:51:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-20T17:51:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 141/170 2024-05-20T17:51:46.752 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:46.752 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-20T17:51:46.752 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:51:46.752 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-20T17:51:46.752 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-20T17:51:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-20T17:51:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:51:46.928 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-20T17:51:46.955 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-20T17:51:46.955 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:51:47.039 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:51:47.063 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:51:47.072 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-20T17:51:47.072 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:51:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 142/170 2024-05-20T17:51:47.086 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-20T17:51:47.086 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-20T17:51:47.086 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:51:47.086 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-20T17:51:47.086 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:51:47.174 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:51:47.198 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-20T17:51:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:51:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:51:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:51:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:51:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:51:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-20T17:51:47.562 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:51:51.642 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 143/170 2024-05-20T17:51:51.683 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 144/170 2024-05-20T17:51:51.724 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 145/170 2024-05-20T17:51:51.756 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-05-20T17:51:51.784 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-05-20T17:51:51.969 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 148/170 2024-05-20T17:51:52.015 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-05-20T17:51:52.057 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 150/170 2024-05-20T17:51:52.097 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-05-20T17:51:52.126 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 152/170 2024-05-20T17:51:52.173 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:51:52.750 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:51:52.789 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:51:52.810 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-05-20T17:51:53.380 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 1/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 3/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 4/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 5/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 6/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 7/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:51:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 11/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 12/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 13/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 15/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 16/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 17/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 18/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 19/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 20/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 21/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 22/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 23/170 2024-05-20T17:51:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 24/170 2024-05-20T17:51:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 25/170 2024-05-20T17:51:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 26/170 2024-05-20T17:51:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 27/170 2024-05-20T17:51:53.394 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 28/170 2024-05-20T17:51:53.394 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 29/170 2024-05-20T17:51:53.394 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 30/170 2024-05-20T17:51:53.394 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 31/170 2024-05-20T17:51:53.394 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 32/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 33/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 34/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 35/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 36/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 37/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 38/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 39/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-20T17:51:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-20T17:51:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-20T17:51:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-20T17:51:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-20T17:51:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-20T17:51:53.400 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-20T17:51:53.401 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-20T17:51:53.402 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-20T17:51:53.403 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 149/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 151/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-20T17:51:53.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-20T17:51:53.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-20T17:51:53.659 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 155/170 2024-05-20T17:51:53.756 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-05-20T17:51:53.798 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-05-20T17:51:53.890 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-05-20T17:51:53.919 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-05-20T17:51:53.944 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:51:53.970 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-05-20T17:51:54.021 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-05-20T17:51:54.021 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:51:54.098 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-05-20T17:51:54.139 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-05-20T17:51:54.139 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:51:54.290 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-05-20T17:51:54.315 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-05-20T17:51:54.320 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:51:54.321 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:51:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-05-20T17:51:54.501 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:51:54.569 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-05-20T17:51:54.602 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-05-20T17:51:54.667 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:51:55.989 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-20T17:51:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.2-8.el9.noarch 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.7.4-5.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.991 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.992 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.4-9.el9.x86_64 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-20T17:51:55.993 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-20T17:51:55.994 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-20T17:51:55.995 INFO:teuthology.orchestra.run.smithi006.stdout: lua-5.4.4-4.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-13.14-1.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-20T17:51:55.996 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-20T17:51:55.997 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-20T17:51:55.998 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-20T17:51:55.999 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ply-3.11-14.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-20T17:51:56.000 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-20T17:51:56.001 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: re2-1:20211101-3.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-20T17:51:56.002 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-20T17:51:56.003 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-20T17:51:56.003 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-20T17:51:56.003 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-20T17:51:56.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:51:56.003 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-05-20T17:51:56.431 DEBUG:teuthology.parallel:result is None 2024-05-20T17:52:00.610 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-05-20T17:52:00.610 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 1/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 3/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 4/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2744.gd2b50 5/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 6/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 7/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 8/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 9/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 10/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 11/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 12/170 2024-05-20T17:52:00.611 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 13/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 14/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_ 15/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 16/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 17/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_6 18/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86 19/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 20/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el 21/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9. 22/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_6 23/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 24/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 25/170 2024-05-20T17:52:00.612 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 26/170 2024-05-20T17:52:00.613 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 27/170 2024-05-20T17:52:00.613 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 28/170 2024-05-20T17:52:00.613 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 29/170 2024-05-20T17:52:00.624 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7. 30/170 2024-05-20T17:52:00.625 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noa 31/170 2024-05-20T17:52:00.625 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.n 32/170 2024-05-20T17:52:00.625 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b 33/170 2024-05-20T17:52:00.625 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el 34/170 2024-05-20T17:52:00.625 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 35/170 2024-05-20T17:52:00.625 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.e 36/170 2024-05-20T17:52:00.625 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 37/170 2024-05-20T17:52:00.625 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 38/170 2024-05-20T17:52:00.626 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 39/170 2024-05-20T17:52:00.626 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-05-20T17:52:00.626 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-05-20T17:52:00.626 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-05-20T17:52:00.626 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-05-20T17:52:00.626 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-05-20T17:52:00.627 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-05-20T17:52:00.628 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-05-20T17:52:00.629 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-05-20T17:52:00.630 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-05-20T17:52:00.631 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-05-20T17:52:00.632 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-05-20T17:52:00.633 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-05-20T17:52:00.634 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 149/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 151/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-05-20T17:52:00.635 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-05-20T17:52:00.636 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-05-20T17:52:00.636 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-05-20T17:52:00.636 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-05-20T17:52:00.636 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-05-20T17:52:00.636 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-05-20T17:52:00.636 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-05-20T17:52:00.636 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-05-20T17:52:00.636 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-05-20T17:52:03.221 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-05-20T17:52:03.221 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-20T17:52:03.222 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.223 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.224 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:19.0.0-2744.gd2b507c7.el9.noarch 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-20T17:52:03.225 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-20T17:52:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-5.el9.noarch 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-13.14-1.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-20T17:52:03.227 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-20T17:52:03.228 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-20T17:52:03.229 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-20T17:52:03.230 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-20T17:52:03.231 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-20T17:52:03.232 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.0.0-2744.gd2b507c7.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-3.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-20T17:52:03.233 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-20T17:52:03.234 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-20T17:52:03.234 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-20T17:52:03.234 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-20T17:52:03.234 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:03.234 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-05-20T17:52:03.669 DEBUG:teuthology.parallel:result is None 2024-05-20T17:52:03.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:52:03.810 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-20T17:52:03.838 INFO:teuthology.orchestra.run.smithi006.stdout:19.0.0-2744.gd2b507c7.el9 2024-05-20T17:52:03.838 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744.gd2b507c7.el9 2024-05-20T17:52:03.838 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744.gd2b507c7 is installed. 2024-05-20T17:52:03.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2b507c724ef6c8295ee0a35d185cdab167fd61d 2024-05-20T17:52:04.057 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-20T17:52:04.080 INFO:teuthology.orchestra.run.smithi171.stdout:19.0.0-2744.gd2b507c7.el9 2024-05-20T17:52:04.080 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2744.gd2b507c7.el9 2024-05-20T17:52:04.080 INFO:teuthology.task.install:The correct ceph version 19.0.0-2744.gd2b507c7 is installed. 2024-05-20T17:52:04.082 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-20T17:52:04.082 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:04.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T17:52:04.116 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:04.116 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-20T17:52:04.149 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-20T17:52:04.149 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:04.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T17:52:04.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T17:52:04.255 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:04.255 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-05-20T17:52:04.281 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-20T17:52:04.346 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-20T17:52:04.346 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:04.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T17:52:04.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T17:52:04.446 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:04.446 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-20T17:52:04.471 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-20T17:52:04.535 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-20T17:52:04.535 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:04.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T17:52:04.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T17:52:04.633 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:04.633 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-05-20T17:52:04.657 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-20T17:52:04.723 INFO:teuthology.run_tasks:Running task ceph... 2024-05-20T17:52:04.800 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-20T17:52:04.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2024-05-20T17:52:04.803 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-05-20T17:52:04.830 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-20T17:52:04.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-20T17:52:04.873 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-20T17:52:04.900 INFO:tasks.ceph:Creating extra log directories... 2024-05-20T17:52:04.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-20T17:52:04.942 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-20T17:52:04.975 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-20T17:52:04.975 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-20T17:52:04.975 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-20T17:52:04.975 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:04.975 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-20T17:52:05.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-20T17:52:05.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-20T17:52:05.171 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:05.171 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-20T17:52:05.186 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-20T17:52:05.295 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-20T17:52:05.325 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-20T17:52:05.325 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-20T17:52:05.326 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689', 'branch': 'wip-pdonnell-testing-20240517.203521-squid-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-limits}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7715689', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240517.203521-squid-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240517.203521-squid-debug', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9749, 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'sleep_before_teardown': 0, 'subset': '272/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240517.203521-squid-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d2b507c724ef6c8295ee0a35d185cdab167fd61d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPc68zrvEU8kzS/vnQlOBWhYLrhnpqrODQFn+QLCjkSZJUcEudZRYHz3ymoR4H3gzPjZZw/j90D07aY1MwT6s4g=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDfDV+gDCWfLSc4jLuTjCm5ER3ONgbXKO+UzTXRE0s9qwEx9nUucGbOym9zlAYM63J19wTC2+MxWSJF9qlTe7Mw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': 'd2b507c724ef6c8295ee0a35d185cdab167fd61d', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_limits']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a', 'timestamp': '2024-05-20_15:44:59', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-20T17:52:05.326 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-20T17:52:05.329 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-20T17:52:05.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2024-05-20T17:52:05.385 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-05-20T17:52:05.441 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:05.442 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T17:52:05.465 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T17:52:05.465 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-05-20T17:52:05.520 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T17:52:05.521 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:52:05.521 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-20T17:52:05.521 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:52:05.521 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:52:05.521 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 17:51:47.907104587 +0000 2024-05-20T17:52:05.521 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 17:49:30.000341295 +0000 2024-05-20T17:52:05.521 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 17:49:30.000341295 +0000 2024-05-20T17:52:05.521 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-05-20 17:49:30.000341295 +0000 2024-05-20T17:52:05.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T17:52:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-20T17:52:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-20T17:52:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000257027 s, 2.0 MB/s 2024-05-20T17:52:05.587 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T17:52:05.644 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-05-20T17:52:05.700 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T17:52:05.701 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:52:05.701 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-20T17:52:05.701 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:52:05.701 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:52:05.701 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 17:51:47.907104587 +0000 2024-05-20T17:52:05.701 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 17:49:30.353337169 +0000 2024-05-20T17:52:05.701 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 17:49:30.353337169 +0000 2024-05-20T17:52:05.701 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-05-20 17:49:30.353337169 +0000 2024-05-20T17:52:05.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T17:52:05.765 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-20T17:52:05.765 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-20T17:52:05.765 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000189732 s, 2.7 MB/s 2024-05-20T17:52:05.766 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T17:52:05.823 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-05-20T17:52:05.879 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T17:52:05.880 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:52:05.880 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-20T17:52:05.880 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:52:05.880 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:52:05.880 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 17:51:47.908104575 +0000 2024-05-20T17:52:05.880 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 17:49:30.698333138 +0000 2024-05-20T17:52:05.880 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 17:49:30.698333138 +0000 2024-05-20T17:52:05.880 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-05-20 17:49:30.698333138 +0000 2024-05-20T17:52:05.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T17:52:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-20T17:52:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-20T17:52:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000185769 s, 2.8 MB/s 2024-05-20T17:52:05.945 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T17:52:06.002 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-05-20T17:52:06.058 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T17:52:06.058 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:52:06.058 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-20T17:52:06.058 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:52:06.059 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:52:06.059 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-05-20 17:51:47.908104575 +0000 2024-05-20T17:52:06.059 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-05-20 17:49:31.050329024 +0000 2024-05-20T17:52:06.059 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-05-20 17:49:31.050329024 +0000 2024-05-20T17:52:06.059 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2024-05-20 17:49:31.050329024 +0000 2024-05-20T17:52:06.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T17:52:06.121 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-05-20T17:52:06.121 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-05-20T17:52:06.121 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000227055 s, 2.3 MB/s 2024-05-20T17:52:06.122 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T17:52:06.179 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:06.179 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:06.179 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-05-20T17:52:06.197 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-20T17:52:06.197 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-20 17:51:55.014040618 +0000 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-20 17:49:26.203765210 +0000 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-20 17:49:26.203765210 +0000 2024-05-20T17:52:06.254 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-05-20 17:49:26.203765210 +0000 2024-05-20T17:52:06.255 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-20T17:52:06.319 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-20T17:52:06.319 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-20T17:52:06.320 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000228725 s, 2.2 MB/s 2024-05-20T17:52:06.321 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-20T17:52:06.379 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-20 17:51:55.014040618 +0000 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-20 17:49:26.535758141 +0000 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-20 17:49:26.535758141 +0000 2024-05-20T17:52:06.438 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-05-20 17:49:26.535758141 +0000 2024-05-20T17:52:06.439 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-20T17:52:06.504 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-20T17:52:06.504 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-20T17:52:06.504 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000207586 s, 2.5 MB/s 2024-05-20T17:52:06.506 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-20T17:52:06.563 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-05-20T17:52:06.620 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-20T17:52:06.621 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:52:06.621 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-20T17:52:06.621 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:52:06.621 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:52:06.621 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-20 17:51:55.015040598 +0000 2024-05-20T17:52:06.621 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-20 17:49:26.876750880 +0000 2024-05-20T17:52:06.621 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-20 17:49:26.876750880 +0000 2024-05-20T17:52:06.621 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-05-20 17:49:26.876750880 +0000 2024-05-20T17:52:06.621 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-20T17:52:06.685 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-20T17:52:06.685 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-20T17:52:06.686 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000218898 s, 2.3 MB/s 2024-05-20T17:52:06.687 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-20T17:52:06.744 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-05-20T17:52:06.801 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-20T17:52:06.801 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-20T17:52:06.801 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-20T17:52:06.802 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-20T17:52:06.802 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-20T17:52:06.802 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-20 17:51:55.015040598 +0000 2024-05-20T17:52:06.802 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-20 17:49:27.230743343 +0000 2024-05-20T17:52:06.802 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-20 17:49:27.230743343 +0000 2024-05-20T17:52:06.802 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-05-20 17:49:27.230743343 +0000 2024-05-20T17:52:06.802 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-20T17:52:06.867 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-20T17:52:06.867 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-20T17:52:06.867 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000220994 s, 2.3 MB/s 2024-05-20T17:52:06.868 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-20T17:52:06.926 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:06.926 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-20T17:52:06.926 INFO:tasks.ceph:Generating config... 2024-05-20T17:52:06.927 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-20T17:52:06.928 INFO:tasks.ceph:[client] debug client = 20 2024-05-20T17:52:06.928 INFO:tasks.ceph:[client] debug ms = 1 2024-05-20T17:52:06.928 INFO:tasks.ceph:[client] pid file = 2024-05-20T17:52:06.928 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-20T17:52:06.928 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-20T17:52:06.928 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-20T17:52:06.928 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-20T17:52:06.928 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-20T17:52:06.928 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-20T17:52:06.928 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-20T17:52:06.928 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-20T17:52:06.928 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-20T17:52:06.928 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-20T17:52:06.928 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-20T17:52:06.929 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-20T17:52:06.929 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-20T17:52:06.929 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-20T17:52:06.929 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-20T17:52:06.929 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-20T17:52:06.929 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-20T17:52:06.930 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-20T17:52:06.930 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-20T17:52:06.930 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-20T17:52:06.930 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-20T17:52:06.930 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-20T17:52:06.930 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-20T17:52:06.930 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-20T17:52:06.930 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-20T17:52:06.930 INFO:tasks.ceph:Setting up mon.a... 2024-05-20T17:52:06.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-20T17:52:06.992 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2024-05-20T17:52:06.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-20T17:52:07.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-20T17:52:07.075 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.171'), ('mon.c', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]')] 2024-05-20T17:52:07.075 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-20T17:52:07.076 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:07.076 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-20T17:52:07.132 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.171 --addv c '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:07.230 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 08ecd7a5-bb84-4836-85d5-8cdd45e39724 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = quincy 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 08ecd7a5-bb84-4836-85d5-8cdd45e39724 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2024-05-20T17:52:07.232497+0000 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-05-20T17:52:07.232497+0000 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 17 (quincy) 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.c 2024-05-20T17:52:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-20T17:52:07.232 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-20T17:52:07.248 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 08ecd7a5-bb84-4836-85d5-8cdd45e39724... 2024-05-20T17:52:07.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-20T17:52:07.291 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-20T17:52:07.333 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-05-20T17:52:07.333 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2024-05-20T17:52:07.333 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.334 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2024-05-20T17:52:07.335 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2024-05-20T17:52:07.336 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on skipped message = False 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 08ecd7a5-bb84-4836-85d5-8cdd45e39724 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2024-05-20T17:52:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug trim objects = true 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2024-05-20T17:52:07.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 20 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 20 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 10 2024-05-20T17:52:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-05-20T17:52:07.340 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.341 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: mon down mkfs grace = 300 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2024-05-20T17:52:07.342 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2024-05-20T17:52:07.343 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2024-05-20T17:52:07.344 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2024-05-20T17:52:07.345 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2024-05-20T17:52:07.345 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-05-20T17:52:07.345 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-05-20T17:52:07.345 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-20T17:52:07.345 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-05-20T17:52:07.345 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.345 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-05-20T17:52:07.345 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-05-20T17:52:07.346 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.347 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.6,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on skipped message = False 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 08ecd7a5-bb84-4836-85d5-8cdd45e39724 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-05-20T17:52:07.348 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-05-20T17:52:07.349 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-05-20T17:52:07.350 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 20 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 20 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 10 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-05-20T17:52:07.351 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-05-20T17:52:07.352 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.353 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: mon down mkfs grace = 300 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: mon op complaint time = 120 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 600 2024-05-20T17:52:07.354 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds = 20 2024-05-20T17:52:07.355 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds balancer = 20 2024-05-20T17:52:07.356 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-05-20T17:52:07.356 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug frag = True 2024-05-20T17:52:07.356 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug scatterstat = True 2024-05-20T17:52:07.356 INFO:teuthology.orchestra.run.smithi171.stdout: mds op complaint time = 180 2024-05-20T17:52:07.356 INFO:teuthology.orchestra.run.smithi171.stdout: mds verify scatter = True 2024-05-20T17:52:07.356 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-05-20T17:52:07.356 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-05-20T17:52:07.356 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-05-20T17:52:07.357 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-20T17:52:07.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-20T17:52:07.462 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-20T17:52:07.463 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:07.463 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-20T17:52:07.479 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:07.479 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-20T17:52:07.534 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:52:07.534 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:07.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-20T17:52:07.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-20T17:52:07.610 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:07.610 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:07.667 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:52:07.667 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:07.667 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-20T17:52:07.667 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-20T17:52:07.707 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:07.707 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:07.765 INFO:tasks.ceph:Setting up mon nodes... 2024-05-20T17:52:07.765 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-20T17:52:07.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-20T17:52:07.827 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-20T17:52:07.830 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-20T17:52:07.907 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-20T17:52:07.911 INFO:tasks.ceph:Setting up mds nodes... 2024-05-20T17:52:07.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-20T17:52:07.973 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-20T17:52:07.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-20T17:52:08.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-20T17:52:08.104 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-20T17:52:08.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-20T17:52:08.133 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-20T17:52:08.198 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-20T17:52:08.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-20T17:52:08.226 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-20T17:52:08.329 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-20T17:52:08.332 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-20T17:52:08.357 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-20T17:52:08.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-20T17:52:08.409 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-20T17:52:08.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-20T17:52:08.478 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-20T17:52:08.492 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-20T17:52:08.543 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-20T17:52:08.556 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-20T17:52:08.606 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-20T17:52:08.619 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-20T17:52:08.619 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-20T17:52:08.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-20T17:52:08.646 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:08.646 INFO:tasks.ceph:role: osd.0 2024-05-20T17:52:08.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:52:08.646 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-20T17:52:08.718 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-20T17:52:08.718 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-20T17:52:08.719 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-20T17:52:08.719 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-20T17:52:08.719 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-20T17:52:08.719 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-05-20T17:52:08.719 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-20T17:52:08.719 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-20T17:52:08.719 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-20T17:52:08.719 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-20T17:52:09.233 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-05-20T17:52:09.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-05-20T17:52:09.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-20T17:52:09.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-20T17:52:09.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-20T17:52:09.481 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:09.482 INFO:tasks.ceph:role: osd.1 2024-05-20T17:52:09.482 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:52:09.482 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-20T17:52:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-20T17:52:10.008 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-05-20T17:52:10.010 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-05-20T17:52:10.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-20T17:52:10.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-20T17:52:10.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-20T17:52:10.206 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:10.206 INFO:tasks.ceph:role: osd.2 2024-05-20T17:52:10.206 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:52:10.206 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-20T17:52:10.282 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-20T17:52:10.773 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-05-20T17:52:10.775 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-05-20T17:52:10.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-20T17:52:10.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-20T17:52:10.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-20T17:52:11.028 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:11.028 INFO:tasks.ceph:role: osd.3 2024-05-20T17:52:11.028 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:52:11.028 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-20T17:52:11.116 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-20T17:52:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-20T17:52:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-20T17:52:11.143 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-20T17:52:11.144 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-20T17:52:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-05-20T17:52:11.144 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-20T17:52:11.144 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-20T17:52:11.144 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-20T17:52:11.144 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-20T17:52:11.603 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-05-20T17:52:11.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-05-20T17:52:11.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-20T17:52:11.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-20T17:52:11.783 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:11.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:11.909+0000 7fec4c69d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-20T17:52:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:11.910+0000 7fec4c69d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-20T17:52:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:11.910+0000 7fec4c69d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-20T17:52:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:11.910+0000 7fec4c69d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-20T17:52:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:11.910+0000 7fec4c69d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-20T17:52:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:11.910+0000 7fec4c69d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-20T17:52:14.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-20T17:52:14.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:14.898+0000 7fd244588640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-20T17:52:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:14.898+0000 7fd244588640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-20T17:52:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:14.898+0000 7fd244588640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-20T17:52:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:14.898+0000 7fd244588640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-20T17:52:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:14.898+0000 7fd244588640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-20T17:52:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:14.899+0000 7fd244588640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-20T17:52:17.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-20T17:52:17.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:17.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:17.890+0000 7fe892daf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-20T17:52:17.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:17.890+0000 7fe892daf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-20T17:52:17.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:17.890+0000 7fe892daf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-20T17:52:17.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:17.890+0000 7fe892daf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-20T17:52:17.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:17.890+0000 7fe892daf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-20T17:52:17.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:17.890+0000 7fe892daf640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-20T17:52:20.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-20T17:52:20.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:20.884+0000 7f7dd9b40640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-20T17:52:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:20.885+0000 7f7dd9b40640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-20T17:52:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:20.885+0000 7f7dd9b40640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-20T17:52:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:20.885+0000 7f7dd9b40640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-20T17:52:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:20.885+0000 7f7dd9b40640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-20T17:52:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:20.885+0000 7f7dd9b40640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-20T17:52:23.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-20T17:52:23.774 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-20T17:52:23.804 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:23.804 INFO:tasks.ceph:role: osd.4 2024-05-20T17:52:23.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:52:23.805 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-20T17:52:23.880 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-20T17:52:23.880 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-20T17:52:23.880 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-20T17:52:23.880 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-20T17:52:23.880 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-20T17:52:23.881 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-05-20T17:52:23.881 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-20T17:52:23.881 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-20T17:52:23.881 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-20T17:52:23.881 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-20T17:52:24.402 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-05-20T17:52:24.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-05-20T17:52:24.404 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-20T17:52:24.537 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-20T17:52:24.568 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-20T17:52:24.633 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:24.633 INFO:tasks.ceph:role: osd.5 2024-05-20T17:52:24.633 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:52:24.633 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-20T17:52:24.705 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-20T17:52:24.706 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-20T17:52:25.153 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-05-20T17:52:25.158 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-05-20T17:52:25.158 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-20T17:52:25.253 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-20T17:52:25.281 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-20T17:52:25.346 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:25.347 INFO:tasks.ceph:role: osd.6 2024-05-20T17:52:25.347 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:52:25.347 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-20T17:52:25.418 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-20T17:52:25.419 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-20T17:52:25.903 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-05-20T17:52:25.905 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-05-20T17:52:25.906 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-20T17:52:26.027 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-20T17:52:26.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-20T17:52:26.121 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-20T17:52:26.121 INFO:tasks.ceph:role: osd.7 2024-05-20T17:52:26.122 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:52:26.122 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-20T17:52:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-20T17:52:26.194 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-20T17:52:26.194 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-20T17:52:26.194 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-20T17:52:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-20T17:52:26.194 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-05-20T17:52:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-20T17:52:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-20T17:52:26.194 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-20T17:52:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-20T17:52:26.704 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-05-20T17:52:26.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-05-20T17:52:26.706 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-20T17:52:26.840 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-20T17:52:26.872 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:26.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:26.978+0000 7f4624286640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-20T17:52:26.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:26.978+0000 7f4624286640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-20T17:52:26.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:26.978+0000 7f4624286640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-20T17:52:26.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:26.978+0000 7f4624286640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-20T17:52:26.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:26.978+0000 7f4624286640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-20T17:52:26.978 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:26.980+0000 7f4624286640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-20T17:52:29.831 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-20T17:52:29.856 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:29.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:29.953+0000 7f0325c0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-20T17:52:29.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:29.954+0000 7f0325c0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-20T17:52:29.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:29.954+0000 7f0325c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-20T17:52:29.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:29.954+0000 7f0325c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-20T17:52:29.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:29.954+0000 7f0325c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-20T17:52:29.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:29.954+0000 7f0325c0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-20T17:52:32.815 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-20T17:52:32.843 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:32.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:32.945+0000 7f7cfc630640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-20T17:52:32.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:32.945+0000 7f7cfc630640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-20T17:52:32.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:32.945+0000 7f7cfc630640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-20T17:52:32.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:32.945+0000 7f7cfc630640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-20T17:52:32.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:32.946+0000 7f7cfc630640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-20T17:52:32.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:32.946+0000 7f7cfc630640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-20T17:52:35.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:52:35.333 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:52:35.797 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-20T17:52:35.823 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:35.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:35.921+0000 7f130893e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-20T17:52:35.920 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:35.921+0000 7f130893e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-20T17:52:35.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:35.921+0000 7f130893e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-20T17:52:35.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:35.921+0000 7f130893e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-20T17:52:35.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:35.921+0000 7f130893e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-20T17:52:35.921 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:35.922+0000 7f130893e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-20T17:52:38.772 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-20T17:52:38.801 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-20T17:52:38.801 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:38.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-20T17:52:38.832 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:38.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-20T17:52:38.903 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:38.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-20T17:52:38.972 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:38.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-20T17:52:39.041 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:39.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-20T17:52:39.110 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:39.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-20T17:52:39.179 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:39.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-20T17:52:39.247 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.248 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-20T17:52:39.277 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.278 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-20T17:52:39.348 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.348 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-20T17:52:39.416 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.416 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-20T17:52:39.483 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.484 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-20T17:52:39.550 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.550 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-20T17:52:39.617 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.617 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-20T17:52:39.682 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:39.682 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-20T17:52:39.701 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:39.701 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-20T17:52:39.762 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.762 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-20T17:52:39.778 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:39.778 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-20T17:52:39.833 INFO:tasks.ceph:Adding keys to all mons... 2024-05-20T17:52:39.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-20T17:52:39.836 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-20T17:52:39.877 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2024-05-20T17:52:39.877 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ== 2024-05-20T17:52:39.877 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2024-05-20T17:52:39.877 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA== 2024-05-20T17:52:39.877 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2024-05-20T17:52:39.877 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw== 2024-05-20T17:52:39.877 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w== 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw== 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ== 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg== 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA== 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ== 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2024-05-20T17:52:39.878 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w== 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA== 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg== 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA== 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ== 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ== 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2024-05-20T17:52:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg== 2024-05-20T17:52:39.880 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2024-05-20T17:52:39.880 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg== 2024-05-20T17:52:39.897 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-05-20T17:52:39.897 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ== 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA== 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw== 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w== 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw== 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ== 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg== 2024-05-20T17:52:39.898 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA== 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ== 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w== 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA== 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg== 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA== 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ== 2024-05-20T17:52:39.899 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-05-20T17:52:39.900 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T17:52:39.900 INFO:teuthology.orchestra.run.smithi171.stdout:[client.2] 2024-05-20T17:52:39.900 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ== 2024-05-20T17:52:39.900 INFO:teuthology.orchestra.run.smithi171.stdout:[client.1] 2024-05-20T17:52:39.900 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg== 2024-05-20T17:52:39.900 INFO:teuthology.orchestra.run.smithi171.stdout:[client.3] 2024-05-20T17:52:39.900 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg== 2024-05-20T17:52:39.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-20T17:52:39.923 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-20T17:52:40.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-20T17:52:40.005 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-20T17:52:40.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-20T17:52:40.073 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-20T17:52:40.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.139 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.203 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.264 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.266 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.329 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-20T17:52:40.393 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-20T17:52:40.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-20T17:52:40.455 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-20T17:52:40.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-20T17:52:40.522 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-20T17:52:40.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.589 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.653 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.716 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.779 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-20T17:52:40.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-20T17:52:40.842 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-20T17:52:40.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-20T17:52:40.909 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-20T17:52:40.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-20T17:52:40.975 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-20T17:52:41.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-20T17:52:41.041 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-20T17:52:41.105 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-20T17:52:41.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-20T17:52:41.131 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-20T17:52:41.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-20T17:52:41.264 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-20T17:52:41.289 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-20T17:52:41.395 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-20T17:52:41.419 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-20T17:52:41.484 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-20T17:52:41.591 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-20T17:52:41.616 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:41.618 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-20T17:52:41.671 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-20T17:52:41.671 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-20T17:52:41.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-20T17:52:41.674 INFO:tasks.ceph.mon.a:Started 2024-05-20T17:52:41.674 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-20T17:52:41.674 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-20T17:52:41.713 INFO:tasks.ceph.mon.b:Started 2024-05-20T17:52:41.713 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-20T17:52:41.713 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-20T17:52:41.715 INFO:tasks.ceph.mon.c:Started 2024-05-20T17:52:41.716 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-20T17:52:41.716 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-20T17:52:41.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-20T17:52:41.718 INFO:tasks.ceph.mgr.y:Started 2024-05-20T17:52:41.718 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-20T17:52:41.718 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-20T17:52:41.720 INFO:tasks.ceph.mgr.x:Started 2024-05-20T17:52:41.720 INFO:tasks.ceph:Setting crush tunables to default 2024-05-20T17:52:41.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2024-05-20T17:52:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.837+0000 7fadf85aa640 1 Processor -- start 2024-05-20T17:52:41.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.837+0000 7fadf85aa640 1 -- start start 2024-05-20T17:52:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf85aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 0x7fadf015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf85aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadf00b1700 0x7fadf00b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf85aa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 0x7fadf0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf85aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fadf00ce190 con 0x7fadf00b1700 2024-05-20T17:52:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf85aa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fadf00cd580 con 0x7fadf0070850 2024-05-20T17:52:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf85aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fadf00cd860 con 0x7fadf015d530 2024-05-20T17:52:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf5b45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadf00b1700 0x7fadf00b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf5b45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadf00b1700 0x7fadf00b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54278/0 (socket says 172.21.15.6:54278) 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.838+0000 7fadf5b45640 1 -- 172.21.15.6:0/634587914 learned_addr learned my addr 172.21.15.6:0/634587914 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6b47640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 0x7fadf0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6346640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 0x7fadf015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf5b45640 1 -- 172.21.15.6:0/634587914 >> v2:172.21.15.6:3300/0 conn(0x7fadf00b1700 msgr2=0x7fadf00b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf5b45640 1 -- 172.21.15.6:0/634587914 >> v2:172.21.15.6:3300/0 conn(0x7fadf00b1700 msgr2=0x7fadf00b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf5b45640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.6:3300/0 conn(0x7fadf00b1700 0x7fadf00b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf5b45640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.6:3300/0 conn(0x7fadf00b1700 0x7fadf00b1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6346640 1 -- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 msgr2=0x7fadf015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6346640 1 -- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 msgr2=0x7fadf015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6346640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 0x7fadf015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6b47640 1 -- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 msgr2=0x7fadf0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-20T17:52:41.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6b47640 1 -- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 msgr2=0x7fadf0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-20T17:52:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6346640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 0x7fadf015aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:52:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6b47640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 0x7fadf0070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-20T17:52:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:41.839+0000 7fadf6b47640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 0x7fadf0070c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-20T17:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.040+0000 7fadf5b45640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.6:3300/0 conn(0x7fadf00b1700 0x7fadf00b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.040+0000 7fadf6b47640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 0x7fadf0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.040+0000 7fadf6346640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 0x7fadf015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.040+0000 7fadf5b45640 1 -- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 msgr2=0x7fadf015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.040+0000 7fadf5b45640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 0x7fadf015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.040+0000 7fadf5b45640 1 -- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 msgr2=0x7fadf0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.040+0000 7fadf5b45640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 0x7fadf0070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.040+0000 7fadf5b45640 1 -- 172.21.15.6:0/634587914 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf00cdb40 con 0x7fadf00b1700 2024-05-20T17:52:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.041+0000 7fadf5b45640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 0x7fadf00b1b10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadf006c3d0 tx=0x7fade002a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5631d43469ff93b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.041+0000 7fadf5344640 1 -- 172.21.15.6:0/634587914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade000f040 con 0x7fadf00b1700 2024-05-20T17:52:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.041+0000 7fadf5344640 1 -- 172.21.15.6:0/634587914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade002f710 con 0x7fadf00b1700 2024-05-20T17:52:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.041+0000 7fadf5344640 1 -- 172.21.15.6:0/634587914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade002fb00 con 0x7fadf00b1700 2024-05-20T17:52:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.042+0000 7fadf85aa640 1 -- 172.21.15.6:0/634587914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 msgr2=0x7fadf00b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.042+0000 7fadf85aa640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 0x7fadf00b1b10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fadf006c3d0 tx=0x7fade002a490 comp rx=0 tx=0).stop 2024-05-20T17:52:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.042+0000 7fadf85aa640 1 -- 172.21.15.6:0/634587914 shutdown_connections 2024-05-20T17:52:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.042+0000 7fadf85aa640 1 --2- 172.21.15.6:0/634587914 >> v2:172.21.15.171:3300/0 conn(0x7fadf0070850 0x7fadf0070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.042+0000 7fadf85aa640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 0x7fadf00b1b10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.042+0000 7fadf85aa640 1 --2- 172.21.15.6:0/634587914 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf015d530 0x7fadf015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.042+0000 7fadf85aa640 1 -- 172.21.15.6:0/634587914 >> 172.21.15.6:0/634587914 conn(0x7fadf00d29d0 msgr2=0x7fadf00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.042+0000 7fadf85aa640 1 -- 172.21.15.6:0/634587914 shutdown_connections 2024-05-20T17:52:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.043+0000 7fadf85aa640 1 -- 172.21.15.6:0/634587914 wait complete. 2024-05-20T17:52:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.046+0000 7fadf85aa640 1 Processor -- start 2024-05-20T17:52:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.046+0000 7fadf85aa640 1 -- start start 2024-05-20T17:52:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf85aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf0070850 0x7fadf00c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf85aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 0x7fadf014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf85aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadf015d530 0x7fadf00ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf85aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00b2050 con 0x7fadf00b1700 2024-05-20T17:52:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf85aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00cd230 con 0x7fadf015d530 2024-05-20T17:52:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf85aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fadf00711a0 con 0x7fadf0070850 2024-05-20T17:52:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf5b45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 0x7fadf014fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf5b45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 0x7fadf014fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54306/0 (socket says 172.21.15.6:54306) 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf5b45640 1 -- 172.21.15.6:0/1996744872 learned_addr learned my addr 172.21.15.6:0/1996744872 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf6346640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf0070850 0x7fadf00c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.048+0000 7fadf6b47640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadf015d530 0x7fadf00ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fadf6b47640 1 -- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf0070850 msgr2=0x7fadf00c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fadf6b47640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf0070850 0x7fadf00c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fadf6b47640 1 -- 172.21.15.6:0/1996744872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 msgr2=0x7fadf014fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fadf6b47640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 0x7fadf014fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fadf6b47640 1 -- 172.21.15.6:0/1996744872 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf00c9e00 con 0x7fadf015d530 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fadf6b47640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadf015d530 0x7fadf00ca2e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fade8009610 tx=0x7fade8007700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fade6ffd640 1 -- 172.21.15.6:0/1996744872 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8014410 con 0x7fadf015d530 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fade6ffd640 1 -- 172.21.15.6:0/1996744872 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8019070 con 0x7fadf015d530 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf00c8e80 con 0x7fadf015d530 2024-05-20T17:52:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fade6ffd640 1 -- 172.21.15.6:0/1996744872 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8014850 con 0x7fadf015d530 2024-05-20T17:52:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf00c9440 con 0x7fadf015d530 2024-05-20T17:52:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fade6ffd640 1 -- 172.21.15.6:0/1996744872 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fade801d410 con 0x7fadf015d530 2024-05-20T17:52:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.049+0000 7fade6ffd640 1 -- 172.21.15.6:0/1996744872 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fade8008510 con 0x7fadf015d530 2024-05-20T17:52:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.050+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf0075b00 con 0x7fadf015d530 2024-05-20T17:52:42.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.053+0000 7fade6ffd640 1 -- 172.21.15.6:0/1996744872 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fade801d8e0 con 0x7fadf015d530 2024-05-20T17:52:42.108 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:42.108+0000 7fa54b814040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:52:42.110 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:42.111+0000 7fdc8fc38040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-20T17:52:42.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.119+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fadf00c8ba0 con 0x7fadf015d530 2024-05-20T17:52:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.125+0000 7fade6ffd640 1 -- 172.21.15.6:0/1996744872 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fade801dac0 con 0x7fadf015d530 2024-05-20T17:52:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-05-20T17:52:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadf015d530 msgr2=0x7fadf00ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadf015d530 0x7fadf00ca2e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fade8009610 tx=0x7fade8007700 comp rx=0 tx=0).stop 2024-05-20T17:52:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 shutdown_connections 2024-05-20T17:52:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadf015d530 0x7fadf00ca2e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadf00b1700 0x7fadf014fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 --2- 172.21.15.6:0/1996744872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadf0070850 0x7fadf00c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 >> 172.21.15.6:0/1996744872 conn(0x7fadf00d29d0 msgr2=0x7fadf00b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:42.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 shutdown_connections 2024-05-20T17:52:42.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:42.126+0000 7fadf85aa640 1 -- 172.21.15.6:0/1996744872 wait complete. 2024-05-20T17:52:42.137 INFO:tasks.ceph:check_enable_crimson: False 2024-05-20T17:52:42.137 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-20T17:52:42.137 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:42.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-20T17:52:42.163 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:42.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-20T17:52:42.229 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:42.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-20T17:52:42.266 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:42.267+0000 7fdc8fc38040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:52:42.267 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:42.268+0000 7fa54b814040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:52:42.292 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:52:42.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-20T17:52:42.319 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:42.320+0000 7fdc8fc38040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:52:42.324 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:42.324+0000 7fa54b814040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-20T17:52:42.349 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:42.349 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-20T17:52:42.375 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:42.375 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-20T17:52:42.440 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:42.440 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-20T17:52:42.505 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:52:42.505 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-20T17:52:42.571 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 915f317c-23cc-4e5f-9f78-2097fbed2b42 0 2024-05-20T17:52:42.575 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:42.577+0000 7fdc8fc38040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:52:42.591 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:42.591+0000 7fa54b814040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-20T17:52:42.624 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:42.625+0000 7fdc8fc38040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:52:42.638 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:42.639+0000 7fa54b814040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-20T17:52:42.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.688+0000 7f59e192f640 1 Processor -- start 2024-05-20T17:52:42.687 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.688+0000 7f59e192f640 1 -- start start 2024-05-20T17:52:42.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.689+0000 7f59e192f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59dc0b4010 0x7f59dc0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59e192f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc0d0370 con 0x7f59dc163a10 2024-05-20T17:52:42.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59e192f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc0d0650 con 0x7f59dc0d14b0 2024-05-20T17:52:42.689 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59e192f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f59dc0d3ca0 con 0x7f59dc0b4010 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59db7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f59dc0d14b0 0x7f59dc0d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:48890/0 (socket says 172.21.15.171:48890) 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59db7fe640 1 -- 172.21.15.171:0/4105394115 learned_addr learned my addr 172.21.15.171:0/4105394115 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59d3fff640 1 --2- 172.21.15.171:0/4105394115 >> v2:172.21.15.6:3300/0 conn(0x7f59dc0b4010 0x7f59dc0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59da7fc640 1 -- 172.21.15.171:0/4105394115 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168375782 0 0) 0x7f59dc0d0650 con 0x7f59dc0d14b0 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59da7fc640 1 -- 172.21.15.171:0/4105394115 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c8003520 con 0x7f59dc0d14b0 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59da7fc640 1 -- 172.21.15.171:0/4105394115 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667389737 0 0) 0x7f59dc0d0370 con 0x7f59dc163a10 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59da7fc640 1 -- 172.21.15.171:0/4105394115 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59dc0d0650 con 0x7f59dc163a10 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59da7fc640 1 -- 172.21.15.171:0/4105394115 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2602962853 0 0) 0x7f59c8003520 con 0x7f59dc0d14b0 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59d3fff640 1 -- 172.21.15.171:0/4105394115 >> v1:172.21.15.171:6789/0 conn(0x7f59dc0d14b0 legacy=0x7f59dc0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59d3fff640 1 -- 172.21.15.171:0/4105394115 >> v1:172.21.15.6:6789/0 conn(0x7f59dc163a10 legacy=0x7f59dc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.690 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.690+0000 7f59d3fff640 1 -- 172.21.15.171:0/4105394115 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0d3650 con 0x7f59dc0b4010 2024-05-20T17:52:42.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.691+0000 7f59d3fff640 1 --2- 172.21.15.171:0/4105394115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0b4010 0x7f59dc0d4130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009720 tx=0x7f59c402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19d62a340fa9f15 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:42.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.691+0000 7f59da7fc640 1 -- 172.21.15.171:0/4105394115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4037070 con 0x7f59dc0b4010 2024-05-20T17:52:42.691 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.691+0000 7f59da7fc640 1 -- 172.21.15.171:0/4105394115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c402ac60 con 0x7f59dc0b4010 2024-05-20T17:52:42.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.691+0000 7f59da7fc640 1 -- 172.21.15.171:0/4105394115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d40019f0 con 0x7f59dc0b4010 2024-05-20T17:52:42.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.692+0000 7f59e192f640 1 -- 172.21.15.171:0/4105394115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0b4010 msgr2=0x7f59dc0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.692+0000 7f59e192f640 1 --2- 172.21.15.171:0/4105394115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0b4010 0x7f59dc0d4130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009720 tx=0x7f59c402a150 comp rx=0 tx=0).stop 2024-05-20T17:52:42.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.692+0000 7f59e192f640 1 -- 172.21.15.171:0/4105394115 shutdown_connections 2024-05-20T17:52:42.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.692+0000 7f59e192f640 1 --2- 172.21.15.171:0/4105394115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0b4010 0x7f59dc0d4130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.692+0000 7f59e192f640 1 -- 172.21.15.171:0/4105394115 >> 172.21.15.171:0/4105394115 conn(0x7f59dc06d240 msgr2=0x7f59dc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:42.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.692+0000 7f59e192f640 1 -- 172.21.15.171:0/4105394115 shutdown_connections 2024-05-20T17:52:42.692 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.692+0000 7f59e192f640 1 -- 172.21.15.171:0/4105394115 wait complete. 2024-05-20T17:52:42.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.694+0000 7f59e192f640 1 Processor -- start 2024-05-20T17:52:42.693 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.694+0000 7f59e192f640 1 -- start start 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59e192f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59dc0b4010 0x7f59dc1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59e192f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0d14b0 0x7f59dc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59e192f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59dc163a10 0x7f59dc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59e192f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0b8390 con 0x7f59dc0d14b0 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59e192f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0b8210 con 0x7f59dc163a10 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59e192f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc0b8510 con 0x7f59dc0b4010 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59db7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59dc163a10 0x7f59dc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59db7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59dc163a10 0x7f59dc0b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47830/0 (socket says 172.21.15.171:47830) 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59db7fe640 1 -- 172.21.15.171:0/1878166549 learned_addr learned my addr 172.21.15.171:0/1878166549 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59daffd640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59dc0b4010 0x7f59dc1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.695+0000 7f59d3fff640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0d14b0 0x7f59dc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.696 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59db7fe640 1 -- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59dc0b4010 msgr2=0x7f59dc1580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59db7fe640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59dc0b4010 0x7f59dc1580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59db7fe640 1 -- 172.21.15.171:0/1878166549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0d14b0 msgr2=0x7f59dc0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59db7fe640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0d14b0 0x7f59dc0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59db7fe640 1 -- 172.21.15.171:0/1878166549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0ce800 con 0x7f59dc163a10 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59daffd640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59dc0b4010 0x7f59dc1580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59db7fe640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59dc163a10 0x7f59dc0b6130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c890 tx=0x7f59d400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59d8ff9640 1 -- 172.21.15.171:0/1878166549 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4018070 con 0x7f59dc163a10 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59d8ff9640 1 -- 172.21.15.171:0/1878166549 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d400a640 con 0x7f59dc163a10 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc15ae40 con 0x7f59dc163a10 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59d8ff9640 1 -- 172.21.15.171:0/1878166549 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d400a9f0 con 0x7f59dc163a10 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc0b6c70 con 0x7f59dc163a10 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59d8ff9640 1 -- 172.21.15.171:0/1878166549 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f59d401b070 con 0x7f59dc163a10 2024-05-20T17:52:42.697 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.696+0000 7f59d8ff9640 1 -- 172.21.15.171:0/1878166549 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f59d401d780 con 0x7f59dc163a10 2024-05-20T17:52:42.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.697+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc075b00 con 0x7f59dc163a10 2024-05-20T17:52:42.698 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.700+0000 7f59d8ff9640 1 -- 172.21.15.171:0/1878166549 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f59d4022020 con 0x7f59dc163a10 2024-05-20T17:52:42.771 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.772+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "915f317c-23cc-4e5f-9f78-2097fbed2b42", "id": 0} v 0) -- 0x7f59dc0d3050 con 0x7f59dc163a10 2024-05-20T17:52:42.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.778+0000 7f59d8ff9640 1 -- 172.21.15.171:0/1878166549 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "915f317c-23cc-4e5f-9f78-2097fbed2b42", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f59d400ac80 con 0x7f59dc163a10 2024-05-20T17:52:42.777 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-05-20T17:52:42.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59dc163a10 msgr2=0x7f59dc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59dc163a10 0x7f59dc0b6130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c890 tx=0x7f59d400cd50 comp rx=0 tx=0).stop 2024-05-20T17:52:42.778 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 shutdown_connections 2024-05-20T17:52:42.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f59dc163a10 0x7f59dc0b6130 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59dc0d14b0 0x7f59dc0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 --2- 172.21.15.171:0/1878166549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f59dc0b4010 0x7f59dc1580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 >> 172.21.15.171:0/1878166549 conn(0x7f59dc06d240 msgr2=0x7f59dc15ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:42.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 shutdown_connections 2024-05-20T17:52:42.779 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.779+0000 7f59e192f640 1 -- 172.21.15.171:0/1878166549 wait complete. 2024-05-20T17:52:42.789 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 863e9650-3913-4b12-9b45-96f971609e12 1 2024-05-20T17:52:42.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.901+0000 7f94179b7640 1 Processor -- start 2024-05-20T17:52:42.900 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.901+0000 7f94179b7640 1 -- start start 2024-05-20T17:52:42.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f94179b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9410160510 0x7f94100b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.902 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f94179b7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f94100cbf70 0x7f941006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f94179b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f941006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f94179b7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f941009ae70 con 0x7f9410160510 2024-05-20T17:52:42.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f94179b7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f941009b110 con 0x7f94100cbf70 2024-05-20T17:52:42.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f94179b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94100ce240 con 0x7f94100cc380 2024-05-20T17:52:42.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f9414f52640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f94100cbf70 0x7f941006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f9415f54640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f941006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.903 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f9415f54640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f941006cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40450/0 (socket says 172.21.15.171:40450) 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.902+0000 7f9414f52640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f94100cbf70 0x7f941006c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47844/0 (socket says 172.21.15.171:47844) 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9414f52640 1 -- 172.21.15.171:0/1127636129 learned_addr learned my addr 172.21.15.171:0/1127636129 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9415753640 1 --2- 172.21.15.171:0/1127636129 >> v2:172.21.15.6:3300/0 conn(0x7f9410160510 0x7f94100b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9415f54640 1 -- 172.21.15.171:0/1127636129 >> v2:172.21.15.171:3300/0 conn(0x7f94100cbf70 msgr2=0x7f941006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9415f54640 1 --2- 172.21.15.171:0/1127636129 >> v2:172.21.15.171:3300/0 conn(0x7f94100cbf70 0x7f941006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9415f54640 1 -- 172.21.15.171:0/1127636129 >> v2:172.21.15.6:3300/0 conn(0x7f9410160510 msgr2=0x7f94100b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9415f54640 1 --2- 172.21.15.171:0/1127636129 >> v2:172.21.15.6:3300/0 conn(0x7f9410160510 0x7f94100b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9415f54640 1 -- 172.21.15.171:0/1127636129 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94101609d0 con 0x7f94100cc380 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9414f52640 1 --2- 172.21.15.171:0/1127636129 >> v2:172.21.15.171:3300/0 conn(0x7f94100cbf70 0x7f941006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.903+0000 7f9415f54640 1 --2- 172.21.15.171:0/1127636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f941006cb70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9410072d10 tx=0x7f940802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e41856ea66fd1d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f9407fff640 1 -- 172.21.15.171:0/1127636129 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9408031600 con 0x7f94100cc380 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f9407fff640 1 -- 172.21.15.171:0/1127636129 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94080317a0 con 0x7f94100cc380 2024-05-20T17:52:42.904 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f9407fff640 1 -- 172.21.15.171:0/1127636129 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9408031b70 con 0x7f94100cc380 2024-05-20T17:52:42.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f94179b7640 1 -- 172.21.15.171:0/1127636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 msgr2=0x7f941006cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f94179b7640 1 --2- 172.21.15.171:0/1127636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f941006cb70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9410072d10 tx=0x7f940802a5d0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f94179b7640 1 -- 172.21.15.171:0/1127636129 shutdown_connections 2024-05-20T17:52:42.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f94179b7640 1 --2- 172.21.15.171:0/1127636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f941006cb70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f94179b7640 1 --2- 172.21.15.171:0/1127636129 >> v2:172.21.15.171:3300/0 conn(0x7f94100cbf70 0x7f941006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f94179b7640 1 --2- 172.21.15.171:0/1127636129 >> v2:172.21.15.6:3300/0 conn(0x7f9410160510 0x7f94100b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.904+0000 7f94179b7640 1 -- 172.21.15.171:0/1127636129 >> 172.21.15.171:0/1127636129 conn(0x7f94100b6620 msgr2=0x7f94100b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:42.906 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.905+0000 7f94179b7640 1 -- 172.21.15.171:0/1127636129 shutdown_connections 2024-05-20T17:52:42.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.905+0000 7f94179b7640 1 -- 172.21.15.171:0/1127636129 wait complete. 2024-05-20T17:52:42.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.906+0000 7f94179b7640 1 Processor -- start 2024-05-20T17:52:42.907 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.906+0000 7f94179b7640 1 -- start start 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f94179b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94100cbf70 0x7f94101526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f94179b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f94100d1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f94179b7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f941013e760 0x7f94100d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f94179b7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f941006d400 con 0x7f94100cbf70 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f94179b7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f941006d280 con 0x7f941013e760 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f94179b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94100ce760 con 0x7f94100cc380 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415f54640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f941013e760 0x7f94100d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9414f52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f94100d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9414f52640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f94100d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40460/0 (socket says 172.21.15.171:40460) 2024-05-20T17:52:42.909 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9414f52640 1 -- 172.21.15.171:0/1656476883 learned_addr learned my addr 172.21.15.171:0/1656476883 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415f54640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f941013e760 0x7f94100d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47860/0 (socket says 172.21.15.171:47860) 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415753640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94100cbf70 0x7f94101526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415f54640 1 -- 172.21.15.171:0/1656476883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 msgr2=0x7f94100d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415f54640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f94100d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415f54640 1 -- 172.21.15.171:0/1656476883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94100cbf70 msgr2=0x7f94101526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415f54640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94100cbf70 0x7f94101526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415f54640 1 -- 172.21.15.171:0/1656476883 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94101564a0 con 0x7f941013e760 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9414f52640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f94100d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9415f54640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f941013e760 0x7f94100d1ac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94100ce3c0 tx=0x7f9408004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9405ffb640 1 -- 172.21.15.171:0/1656476883 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940803b820 con 0x7f941013e760 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9405ffb640 1 -- 172.21.15.171:0/1656476883 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9408043070 con 0x7f941013e760 2024-05-20T17:52:42.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9410156780 con 0x7f941013e760 2024-05-20T17:52:42.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.908+0000 7f9405ffb640 1 -- 172.21.15.171:0/1656476883 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940803bbc0 con 0x7f941013e760 2024-05-20T17:52:42.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.909+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941013ec80 con 0x7f941013e760 2024-05-20T17:52:42.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.909+0000 7f9405ffb640 1 -- 172.21.15.171:0/1656476883 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9408048460 con 0x7f941013e760 2024-05-20T17:52:42.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.909+0000 7f9405ffb640 1 -- 172.21.15.171:0/1656476883 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9408047770 con 0x7f941013e760 2024-05-20T17:52:42.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.910+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9410075b00 con 0x7f941013e760 2024-05-20T17:52:42.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.912+0000 7f9405ffb640 1 -- 172.21.15.171:0/1656476883 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f94080479c0 con 0x7f941013e760 2024-05-20T17:52:42.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.985+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "863e9650-3913-4b12-9b45-96f971609e12", "id": 1} v 0) -- 0x7f9410159480 con 0x7f941013e760 2024-05-20T17:52:42.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.993+0000 7f9405ffb640 1 -- 172.21.15.171:0/1656476883 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "863e9650-3913-4b12-9b45-96f971609e12", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f9408047ba0 con 0x7f941013e760 2024-05-20T17:52:42.992 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T17:52:42.993 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f941013e760 msgr2=0x7f94100d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:42.993 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f941013e760 0x7f94100d1ac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94100ce3c0 tx=0x7f9408004a40 comp rx=0 tx=0).stop 2024-05-20T17:52:42.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 shutdown_connections 2024-05-20T17:52:42.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f941013e760 0x7f94100d1ac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94100cc380 0x7f94100d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 --2- 172.21.15.171:0/1656476883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94100cbf70 0x7f94101526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:42.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 >> 172.21.15.171:0/1656476883 conn(0x7f94100b6620 msgr2=0x7f94100b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:42.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 shutdown_connections 2024-05-20T17:52:42.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:42.994+0000 7f94179b7640 1 -- 172.21.15.171:0/1656476883 wait complete. 2024-05-20T17:52:43.005 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72 2 2024-05-20T17:52:43.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.116+0000 7f0a8e1d5640 1 Processor -- start 2024-05-20T17:52:43.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.116+0000 7f0a8e1d5640 1 -- start start 2024-05-20T17:52:43.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a8e1d5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a880b2bf0 0x7f0a88162f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a8e1d5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a880ae7b0 con 0x7f0a880b0440 2024-05-20T17:52:43.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a8e1d5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a880b3170 con 0x7f0a880b18a0 2024-05-20T17:52:43.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a8e1d5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0a880b0b70 con 0x7f0a880b2bf0 2024-05-20T17:52:43.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a877fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a880b2bf0 0x7f0a88162f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a877fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a880b2bf0 0x7f0a88162f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47862/0 (socket says 172.21.15.171:47862) 2024-05-20T17:52:43.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a877fe640 1 -- 172.21.15.171:0/2676381139 learned_addr learned my addr 172.21.15.171:0/2676381139 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a87fff640 1 --1- 172.21.15.171:0/2676381139 >> v1:172.21.15.171:6789/0 conn(0x7f0a880b18a0 0x7f0a880b1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:48902/0 (socket says 172.21.15.171:48902) 2024-05-20T17:52:43.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a877fe640 1 -- 172.21.15.171:0/2676381139 >> v1:172.21.15.171:6789/0 conn(0x7f0a880b18a0 legacy=0x7f0a880b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a877fe640 1 -- 172.21.15.171:0/2676381139 >> v1:172.21.15.6:6789/0 conn(0x7f0a880b0440 legacy=0x7f0a88163450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.118 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.118+0000 7f0a877fe640 1 -- 172.21.15.171:0/2676381139 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a880b0dc0 con 0x7f0a880b2bf0 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.119+0000 7f0a877fe640 1 --2- 172.21.15.171:0/2676381139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 0x7f0a88162f10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009870 tx=0x7f0a7802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb45d0997bf039de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.119+0000 7f0a86ffd640 1 -- 172.21.15.171:0/2676381139 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78037070 con 0x7f0a880b2bf0 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.119+0000 7f0a86ffd640 1 -- 172.21.15.171:0/2676381139 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7802ae50 con 0x7f0a880b2bf0 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.119+0000 7f0a86ffd640 1 -- 172.21.15.171:0/2676381139 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78032860 con 0x7f0a880b2bf0 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.120+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/2676381139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 msgr2=0x7f0a88162f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.120+0000 7f0a8e1d5640 1 --2- 172.21.15.171:0/2676381139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 0x7f0a88162f10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009870 tx=0x7f0a7802a300 comp rx=0 tx=0).stop 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.120+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/2676381139 shutdown_connections 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.120+0000 7f0a8e1d5640 1 --2- 172.21.15.171:0/2676381139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 0x7f0a88162f10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.120+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/2676381139 >> 172.21.15.171:0/2676381139 conn(0x7f0a880b6620 msgr2=0x7f0a880b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.120+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/2676381139 shutdown_connections 2024-05-20T17:52:43.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.120+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/2676381139 wait complete. 2024-05-20T17:52:43.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.122+0000 7f0a8e1d5640 1 Processor -- start 2024-05-20T17:52:43.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.122+0000 7f0a8e1d5640 1 -- start start 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a8e1d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a880b0440 0x7f0a88152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a8e1d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a880b18a0 0x7f0a880c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a8e1d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 0x7f0a880c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a8e1d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8806df70 con 0x7f0a880b0440 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a8e1d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880b1410 con 0x7f0a880b2bf0 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a8e1d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0a88163b60 con 0x7f0a880b18a0 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a87fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 0x7f0a880c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a7effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a880b18a0 0x7f0a880c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a7effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a880b18a0 0x7f0a880c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40468/0 (socket says 172.21.15.171:40468) 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a7effd640 1 -- 172.21.15.171:0/3257142522 learned_addr learned my addr 172.21.15.171:0/3257142522 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.123+0000 7f0a877fe640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a880b0440 0x7f0a88152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.124 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a87fff640 1 -- 172.21.15.171:0/3257142522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a880b18a0 msgr2=0x7f0a880c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a87fff640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a880b18a0 0x7f0a880c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a87fff640 1 -- 172.21.15.171:0/3257142522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a880b0440 msgr2=0x7f0a88152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a87fff640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a880b0440 0x7f0a88152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a87fff640 1 -- 172.21.15.171:0/3257142522 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a88160ca0 con 0x7f0a880b2bf0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a7effd640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a880b18a0 0x7f0a880c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a87fff640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 0x7f0a880c75f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a88163fd0 tx=0x7f0a8000cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a84ff9640 1 -- 172.21.15.171:0/3257142522 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80018070 con 0x7f0a880b2bf0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a84ff9640 1 -- 172.21.15.171:0/3257142522 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a80004d60 con 0x7f0a880b2bf0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a88160f80 con 0x7f0a880b2bf0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a84ff9640 1 -- 172.21.15.171:0/3257142522 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8000a860 con 0x7f0a880b2bf0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a880c68b0 con 0x7f0a880b2bf0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a84ff9640 1 -- 172.21.15.171:0/3257142522 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a8001b070 con 0x7f0a880b2bf0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.124+0000 7f0a84ff9640 1 -- 172.21.15.171:0/3257142522 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f0a80012440 con 0x7f0a880b2bf0 2024-05-20T17:52:43.125 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.125+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a88075b00 con 0x7f0a880b2bf0 2024-05-20T17:52:43.126 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.127+0000 7f0a84ff9640 1 -- 172.21.15.171:0/3257142522 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0a80007070 con 0x7f0a880b2bf0 2024-05-20T17:52:43.198 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.200+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72", "id": 2} v 0) -- 0x7f0a8809a6a0 con 0x7f0a880b2bf0 2024-05-20T17:52:43.204 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.206+0000 7f0a84ff9640 1 -- 172.21.15.171:0/3257142522 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f0a80007660 con 0x7f0a880b2bf0 2024-05-20T17:52:43.205 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-05-20T17:52:43.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 msgr2=0x7f0a880c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 0x7f0a880c75f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a88163fd0 tx=0x7f0a8000cb90 comp rx=0 tx=0).stop 2024-05-20T17:52:43.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 shutdown_connections 2024-05-20T17:52:43.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a880b2bf0 0x7f0a880c75f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a880b18a0 0x7f0a880c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 --2- 172.21.15.171:0/3257142522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a880b0440 0x7f0a88152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.206 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 >> 172.21.15.171:0/3257142522 conn(0x7f0a880b6620 msgr2=0x7f0a8815f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.207 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 shutdown_connections 2024-05-20T17:52:43.207 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.207+0000 7f0a8e1d5640 1 -- 172.21.15.171:0/3257142522 wait complete. 2024-05-20T17:52:43.216 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new ab635f53-4e80-4a6f-ae82-e692c74b395e 3 2024-05-20T17:52:43.326 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.327+0000 7f30ab1e3640 1 Processor -- start 2024-05-20T17:52:43.327 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.328+0000 7f30ab1e3640 1 -- start start 2024-05-20T17:52:43.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30ab1e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30a415f410 0x7f30a40ae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.328 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30ab1e3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f30a40ae860 0x7f30a4162f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30ab1e3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a415f820 con 0x7f30a4074b50 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30ab1e3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f30a40aec70 con 0x7f30a415f410 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30ab1e3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f30a406b520 con 0x7f30a40ae860 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30a9780640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f30a40ae860 0x7f30a4162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30a9780640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f30a40ae860 0x7f30a4162f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47888/0 (socket says 172.21.15.171:47888) 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30a9780640 1 -- 172.21.15.171:0/1229506210 learned_addr learned my addr 172.21.15.171:0/1229506210 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30a3fff640 1 --2- 172.21.15.171:0/1229506210 >> v2:172.21.15.6:3300/0 conn(0x7f30a415f410 0x7f30a40ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30a9780640 1 -- 172.21.15.171:0/1229506210 >> v2:172.21.15.6:3300/0 conn(0x7f30a415f410 msgr2=0x7f30a40ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30a9780640 1 --2- 172.21.15.171:0/1229506210 >> v2:172.21.15.6:3300/0 conn(0x7f30a415f410 0x7f30a40ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30a9780640 1 -- 172.21.15.171:0/1229506210 >> v1:172.21.15.6:6789/0 conn(0x7f30a4074b50 legacy=0x7f30a406c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.329 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.329+0000 7f30a9780640 1 -- 172.21.15.171:0/1229506210 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a406b800 con 0x7f30a40ae860 2024-05-20T17:52:43.330 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.330+0000 7f30a9780640 1 --2- 172.21.15.171:0/1229506210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a40ae860 0x7f30a4162f00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f30a4071430 tx=0x7f309c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf3e56e22eaab6d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.330+0000 7f30a37fe640 1 -- 172.21.15.171:0/1229506210 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c036070 con 0x7f30a40ae860 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.330+0000 7f30a37fe640 1 -- 172.21.15.171:0/1229506210 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c031600 con 0x7f30a40ae860 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.330+0000 7f30a37fe640 1 -- 172.21.15.171:0/1229506210 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0319d0 con 0x7f30a40ae860 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.331+0000 7f30ab1e3640 1 -- 172.21.15.171:0/1229506210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a40ae860 msgr2=0x7f30a4162f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.331+0000 7f30ab1e3640 1 --2- 172.21.15.171:0/1229506210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a40ae860 0x7f30a4162f00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f30a4071430 tx=0x7f309c02a730 comp rx=0 tx=0).stop 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.331+0000 7f30ab1e3640 1 -- 172.21.15.171:0/1229506210 shutdown_connections 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.331+0000 7f30ab1e3640 1 --2- 172.21.15.171:0/1229506210 >> v2:172.21.15.6:3300/0 conn(0x7f30a415f410 0x7f30a40ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.331+0000 7f30ab1e3640 1 --2- 172.21.15.171:0/1229506210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a40ae860 0x7f30a4162f00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.331+0000 7f30ab1e3640 1 -- 172.21.15.171:0/1229506210 >> 172.21.15.171:0/1229506210 conn(0x7f30a4072f30 msgr2=0x7f30a40b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.331+0000 7f30ab1e3640 1 -- 172.21.15.171:0/1229506210 shutdown_connections 2024-05-20T17:52:43.331 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.331+0000 7f30ab1e3640 1 -- 172.21.15.171:0/1229506210 wait complete. 2024-05-20T17:52:43.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.333+0000 7f30ab1e3640 1 Processor -- start 2024-05-20T17:52:43.332 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.333+0000 7f30ab1e3640 1 -- start start 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.334+0000 7f30ab1e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a4074b50 0x7f30a4162370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30ab1e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a40ae860 0x7f30a4152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30ab1e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a415f410 0x7f30a4158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30ab1e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f30a406ccd0 con 0x7f30a415f410 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30ab1e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30a406bdc0 con 0x7f30a4074b50 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30ab1e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f30a406ce50 con 0x7f30a40ae860 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a4074b50 0x7f30a4162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a3fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a40ae860 0x7f30a4152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a4074b50 0x7f30a4162370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47892/0 (socket says 172.21.15.171:47892) 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 -- 172.21.15.171:0/793215346 learned_addr learned my addr 172.21.15.171:0/793215346 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a9780640 1 --2- 172.21.15.171:0/793215346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a415f410 0x7f30a4158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 -- 172.21.15.171:0/793215346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a40ae860 msgr2=0x7f30a4152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.335 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 --2- 172.21.15.171:0/793215346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a40ae860 0x7f30a4152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 -- 172.21.15.171:0/793215346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a415f410 msgr2=0x7f30a4158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 --2- 172.21.15.171:0/793215346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a415f410 0x7f30a4158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 -- 172.21.15.171:0/793215346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a4156580 con 0x7f30a4074b50 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a8f7f640 1 --2- 172.21.15.171:0/793215346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a4074b50 0x7f30a4162370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f309400c3c0 tx=0x7f309400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a17fa640 1 -- 172.21.15.171:0/793215346 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30940052d0 con 0x7f30a4074b50 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a17fa640 1 -- 172.21.15.171:0/793215346 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3094005490 con 0x7f30a4074b50 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30a17fa640 1 -- 172.21.15.171:0/793215346 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094007260 con 0x7f30a4074b50 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.335+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a4158070 con 0x7f30a4074b50 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.336+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a41567f0 con 0x7f30a4074b50 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.336+0000 7f30a17fa640 1 -- 172.21.15.171:0/793215346 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3094007400 con 0x7f30a4074b50 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.336+0000 7f30a17fa640 1 -- 172.21.15.171:0/793215346 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3094011590 con 0x7f30a4074b50 2024-05-20T17:52:43.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.336+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a4075b00 con 0x7f30a4074b50 2024-05-20T17:52:43.339 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.340+0000 7f30a17fa640 1 -- 172.21.15.171:0/793215346 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f30a415f820 con 0x7f30a4074b50 2024-05-20T17:52:43.401 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:43.402+0000 7fdc8fc38040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:52:43.410 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.411+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab635f53-4e80-4a6f-ae82-e692c74b395e", "id": 3} v 0) -- 0x7f30a4073910 con 0x7f30a4074b50 2024-05-20T17:52:43.411 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:43.412+0000 7fa54b814040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-20T17:52:43.416 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.417+0000 7f30a17fa640 1 -- 172.21.15.171:0/793215346 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab635f53-4e80-4a6f-ae82-e692c74b395e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3094003a50 con 0x7f30a4074b50 2024-05-20T17:52:43.416 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.418+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a4074b50 msgr2=0x7f30a4162370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.418+0000 7f30ab1e3640 1 --2- 172.21.15.171:0/793215346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a4074b50 0x7f30a4162370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f309400c3c0 tx=0x7f309400c880 comp rx=0 tx=0).stop 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.419+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 shutdown_connections 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.419+0000 7f30ab1e3640 1 --2- 172.21.15.171:0/793215346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30a415f410 0x7f30a4158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.419+0000 7f30ab1e3640 1 --2- 172.21.15.171:0/793215346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30a40ae860 0x7f30a4152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.419+0000 7f30ab1e3640 1 --2- 172.21.15.171:0/793215346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a4074b50 0x7f30a4162370 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.419+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 >> 172.21.15.171:0/793215346 conn(0x7f30a4072f30 msgr2=0x7f30a406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.419+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 shutdown_connections 2024-05-20T17:52:43.418 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.419+0000 7f30ab1e3640 1 -- 172.21.15.171:0/793215346 wait complete. 2024-05-20T17:52:43.428 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new f931e244-af1d-46da-a74f-2b92254e5b4f 4 2024-05-20T17:52:43.496 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:43.497+0000 7fdc8fc38040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:52:43.503 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:43.503+0000 7fa54b814040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-20T17:52:43.538 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.539+0000 7f4f38b77640 1 Processor -- start 2024-05-20T17:52:43.538 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.539+0000 7f4f38b77640 1 -- start start 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.540+0000 7f4f38b77640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f34156690 0x7f4f3415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.540+0000 7f4f38b77640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4f340d1610 0x7f4f340d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.540+0000 7f4f38b77640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3406d890 con 0x7f4f3409a4f0 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.540+0000 7f4f38b77640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4f340b29b0 con 0x7f4f34156690 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.540+0000 7f4f38b77640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4f340b1910 con 0x7f4f340d1610 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.540+0000 7f4f31d9b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4f340d1610 0x7f4f340d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.540+0000 7f4f31d9b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4f340d1610 0x7f4f340d1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47898/0 (socket says 172.21.15.171:47898) 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.540+0000 7f4f31d9b640 1 -- 172.21.15.171:0/2341479193 learned_addr learned my addr 172.21.15.171:0/2341479193 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.541+0000 7f4f3259c640 1 --2- 172.21.15.171:0/2341479193 >> v2:172.21.15.6:3300/0 conn(0x7f4f34156690 0x7f4f3415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.541+0000 7f4f31d9b640 1 -- 172.21.15.171:0/2341479193 >> v2:172.21.15.6:3300/0 conn(0x7f4f34156690 msgr2=0x7f4f3415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.541+0000 7f4f31d9b640 1 --2- 172.21.15.171:0/2341479193 >> v2:172.21.15.6:3300/0 conn(0x7f4f34156690 0x7f4f3415cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.541+0000 7f4f31d9b640 1 -- 172.21.15.171:0/2341479193 >> v1:172.21.15.171:6789/0 conn(0x7f4f3409a4f0 legacy=0x7f4f3409a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.540 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.541+0000 7f4f31d9b640 1 -- 172.21.15.171:0/2341479193 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f340b1bf0 con 0x7f4f340d1610 2024-05-20T17:52:43.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.541+0000 7f4f31d9b640 1 --2- 172.21.15.171:0/2341479193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f340d1610 0x7f4f340d1a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f340726c0 tx=0x7f4f1c02c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d561df22c382fc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.542+0000 7f4f3159a640 1 -- 172.21.15.171:0/2341479193 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c039070 con 0x7f4f340d1610 2024-05-20T17:52:43.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.542+0000 7f4f3159a640 1 -- 172.21.15.171:0/2341479193 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1c004230 con 0x7f4f340d1610 2024-05-20T17:52:43.541 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.542+0000 7f4f3159a640 1 -- 172.21.15.171:0/2341479193 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c003610 con 0x7f4f340d1610 2024-05-20T17:52:43.542 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:43.542+0000 7fdc8fc38040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:52:43.542 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.542+0000 7f4f38b77640 1 -- 172.21.15.171:0/2341479193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f340d1610 msgr2=0x7f4f340d1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.542 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.542+0000 7f4f38b77640 1 --2- 172.21.15.171:0/2341479193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f340d1610 0x7f4f340d1a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f340726c0 tx=0x7f4f1c02c800 comp rx=0 tx=0).stop 2024-05-20T17:52:43.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.543+0000 7f4f38b77640 1 -- 172.21.15.171:0/2341479193 shutdown_connections 2024-05-20T17:52:43.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.543+0000 7f4f38b77640 1 --2- 172.21.15.171:0/2341479193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f340d1610 0x7f4f340d1a20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.543+0000 7f4f38b77640 1 --2- 172.21.15.171:0/2341479193 >> v2:172.21.15.6:3300/0 conn(0x7f4f34156690 0x7f4f3415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.543+0000 7f4f38b77640 1 -- 172.21.15.171:0/2341479193 >> 172.21.15.171:0/2341479193 conn(0x7f4f340b6670 msgr2=0x7f4f340b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.543+0000 7f4f38b77640 1 -- 172.21.15.171:0/2341479193 shutdown_connections 2024-05-20T17:52:43.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.543+0000 7f4f38b77640 1 -- 172.21.15.171:0/2341479193 wait complete. 2024-05-20T17:52:43.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.545+0000 7f4f38b77640 1 Processor -- start 2024-05-20T17:52:43.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.545+0000 7f4f38b77640 1 -- start start 2024-05-20T17:52:43.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f38b77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f3409a4f0 0x7f4f34154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f38b77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f340d1610 0x7f4f340cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f38b77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f34156690 0x7f4f341f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f38b77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4f340b2490 con 0x7f4f340d1610 2024-05-20T17:52:43.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f38b77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4f340b21b0 con 0x7f4f34156690 2024-05-20T17:52:43.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f38b77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f340d1f60 con 0x7f4f3409a4f0 2024-05-20T17:52:43.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f32d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f34156690 0x7f4f341f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.546 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f3259c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f3409a4f0 0x7f4f34154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f32d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f34156690 0x7f4f341f1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47906/0 (socket says 172.21.15.171:47906) 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f3259c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f3409a4f0 0x7f4f34154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40480/0 (socket says 172.21.15.171:40480) 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f32d9d640 1 -- 172.21.15.171:0/3807306894 learned_addr learned my addr 172.21.15.171:0/3807306894 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f31d9b640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f340d1610 0x7f4f340cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f3259c640 1 -- 172.21.15.171:0/3807306894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f34156690 msgr2=0x7f4f341f1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.546+0000 7f4f3259c640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f34156690 0x7f4f341f1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f3259c640 1 -- 172.21.15.171:0/3807306894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f340d1610 msgr2=0x7f4f340cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f3259c640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f340d1610 0x7f4f340cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f3259c640 1 -- 172.21.15.171:0/3807306894 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f34155140 con 0x7f4f3409a4f0 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f32d9d640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f34156690 0x7f4f341f1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f3259c640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f3409a4f0 0x7f4f34154c00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400e840 tx=0x7f4f2400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f2affd640 1 -- 172.21.15.171:0/3807306894 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24017070 con 0x7f4f3409a4f0 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f2affd640 1 -- 172.21.15.171:0/3807306894 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2400c730 con 0x7f4f3409a4f0 2024-05-20T17:52:43.547 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f340d1110 con 0x7f4f3409a4f0 2024-05-20T17:52:43.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f2affd640 1 -- 172.21.15.171:0/3807306894 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400cb20 con 0x7f4f3409a4f0 2024-05-20T17:52:43.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f340d0e30 con 0x7f4f3409a4f0 2024-05-20T17:52:43.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f2affd640 1 -- 172.21.15.171:0/3807306894 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f2401a070 con 0x7f4f3409a4f0 2024-05-20T17:52:43.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.547+0000 7f4f2affd640 1 -- 172.21.15.171:0/3807306894 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4f24013470 con 0x7f4f3409a4f0 2024-05-20T17:52:43.548 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:43.548+0000 7fa54b814040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-20T17:52:43.548 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.548+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f34075b00 con 0x7f4f3409a4f0 2024-05-20T17:52:43.549 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.551+0000 7f4f2affd640 1 -- 172.21.15.171:0/3807306894 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4f2400cd60 con 0x7f4f3409a4f0 2024-05-20T17:52:43.620 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.622+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f931e244-af1d-46da-a74f-2b92254e5b4f", "id": 4} v 0) -- 0x7f4f340b0fd0 con 0x7f4f3409a4f0 2024-05-20T17:52:43.626 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.627+0000 7f4f2affd640 1 -- 172.21.15.171:0/3807306894 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f931e244-af1d-46da-a74f-2b92254e5b4f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4f24004020 con 0x7f4f3409a4f0 2024-05-20T17:52:43.626 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f3409a4f0 msgr2=0x7f4f34154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f3409a4f0 0x7f4f34154c00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400e840 tx=0x7f4f2400ed00 comp rx=0 tx=0).stop 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 shutdown_connections 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f34156690 0x7f4f341f1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f340d1610 0x7f4f340cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 --2- 172.21.15.171:0/3807306894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f3409a4f0 0x7f4f34154c00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 >> 172.21.15.171:0/3807306894 conn(0x7f4f340b6670 msgr2=0x7f4f34070830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 shutdown_connections 2024-05-20T17:52:43.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.629+0000 7f4f38b77640 1 -- 172.21.15.171:0/3807306894 wait complete. 2024-05-20T17:52:43.642 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new ea4a7acf-d2e6-444c-970f-cb33606423ac 5 2024-05-20T17:52:43.722 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:43.722+0000 7fa54b814040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:52:43.722 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:43.723+0000 7fdc8fc38040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-20T17:52:43.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.754+0000 7f4f75fea640 1 Processor -- start 2024-05-20T17:52:43.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.754+0000 7f4f75fea640 1 -- start start 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f75fea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f7015bf50 0x7f4f7015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f75fea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4f7006d950 0x7f4f700af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f75fea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f700d18b0 0x7f4f700d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f75fea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4f701609d0 con 0x7f4f700d18b0 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f75fea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4f700af800 con 0x7f4f7006d950 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f75fea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f700d2200 con 0x7f4f7015bf50 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f6f7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f7015bf50 0x7f4f7015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f6effd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4f7006d950 0x7f4f700af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f6f7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f7015bf50 0x7f4f7015fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40486/0 (socket says 172.21.15.171:40486) 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f6f7fe640 1 -- 172.21.15.171:0/4235816352 learned_addr learned my addr 172.21.15.171:0/4235816352 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.756+0000 7f4f6ffff640 1 --2- 172.21.15.171:0/4235816352 >> v2:172.21.15.6:3300/0 conn(0x7f4f700d18b0 0x7f4f700d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6f7fe640 1 -- 172.21.15.171:0/4235816352 >> v2:172.21.15.171:3300/0 conn(0x7f4f7006d950 msgr2=0x7f4f700af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:43.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6f7fe640 1 --2- 172.21.15.171:0/4235816352 >> v2:172.21.15.171:3300/0 conn(0x7f4f7006d950 0x7f4f700af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6f7fe640 1 -- 172.21.15.171:0/4235816352 >> v2:172.21.15.6:3300/0 conn(0x7f4f700d18b0 msgr2=0x7f4f700d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:43.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6f7fe640 1 --2- 172.21.15.171:0/4235816352 >> v2:172.21.15.6:3300/0 conn(0x7f4f700d18b0 0x7f4f700d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6f7fe640 1 -- 172.21.15.171:0/4235816352 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f700b18f0 con 0x7f4f7015bf50 2024-05-20T17:52:43.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6effd640 1 --2- 172.21.15.171:0/4235816352 >> v2:172.21.15.171:3300/0 conn(0x7f4f7006d950 0x7f4f700af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:43.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6ffff640 1 --2- 172.21.15.171:0/4235816352 >> v2:172.21.15.6:3300/0 conn(0x7f4f700d18b0 0x7f4f700d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:52:43.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6f7fe640 1 --2- 172.21.15.171:0/4235816352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f7015bf50 0x7f4f7015fa00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4f7009b500 tx=0x7f4f6002c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e7a8d3c05b2e842 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6e7fc640 1 -- 172.21.15.171:0/4235816352 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60038070 con 0x7f4f7015bf50 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6e7fc640 1 -- 172.21.15.171:0/4235816352 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f60031710 con 0x7f4f7015bf50 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.757+0000 7f4f6e7fc640 1 -- 172.21.15.171:0/4235816352 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60031ae0 con 0x7f4f7015bf50 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 -- 172.21.15.171:0/4235816352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f7015bf50 msgr2=0x7f4f7015fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 --2- 172.21.15.171:0/4235816352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f7015bf50 0x7f4f7015fa00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4f7009b500 tx=0x7f4f6002c3f0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 -- 172.21.15.171:0/4235816352 shutdown_connections 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 --2- 172.21.15.171:0/4235816352 >> v2:172.21.15.6:3300/0 conn(0x7f4f700d18b0 0x7f4f700d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 --2- 172.21.15.171:0/4235816352 >> v2:172.21.15.171:3300/0 conn(0x7f4f7006d950 0x7f4f700af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 --2- 172.21.15.171:0/4235816352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f7015bf50 0x7f4f7015fa00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 -- 172.21.15.171:0/4235816352 >> 172.21.15.171:0/4235816352 conn(0x7f4f70073770 msgr2=0x7f4f700b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 -- 172.21.15.171:0/4235816352 shutdown_connections 2024-05-20T17:52:43.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.758+0000 7f4f75fea640 1 -- 172.21.15.171:0/4235816352 wait complete. 2024-05-20T17:52:43.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.760+0000 7f4f75fea640 1 Processor -- start 2024-05-20T17:52:43.760 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.760+0000 7f4f75fea640 1 -- start start 2024-05-20T17:52:43.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f75fea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7006d950 0x7f4f7015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f75fea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700d18b0 0x7f4f7006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.762 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f75fea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f7015bf50 0x7f4f70153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f75fea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4f701606f0 con 0x7f4f7015bf50 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f75fea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4f70160410 con 0x7f4f7006d950 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f75fea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7006dd60 con 0x7f4f700d18b0 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7006d950 0x7f4f7015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700d18b0 0x7f4f7006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7006d950 0x7f4f7015e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47918/0 (socket says 172.21.15.171:47918) 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700d18b0 0x7f4f7006fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40500/0 (socket says 172.21.15.171:40500) 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 -- 172.21.15.171:0/2983990786 learned_addr learned my addr 172.21.15.171:0/2983990786 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6ffff640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f7015bf50 0x7f4f70153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 -- 172.21.15.171:0/2983990786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700d18b0 msgr2=0x7f4f7006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700d18b0 0x7f4f7006fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 -- 172.21.15.171:0/2983990786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f7015bf50 msgr2=0x7f4f70153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f7015bf50 0x7f4f70153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 -- 172.21.15.171:0/2983990786 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7015eee0 con 0x7f4f7006d950 2024-05-20T17:52:43.763 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6effd640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700d18b0 0x7f4f7006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.762+0000 7f4f6f7fe640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7006d950 0x7f4f7015e5e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4f60000c00 tx=0x7f4f600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.763+0000 7f4f57fff640 1 -- 172.21.15.171:0/2983990786 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60038040 con 0x7f4f7006d950 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.763+0000 7f4f57fff640 1 -- 172.21.15.171:0/2983990786 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f60043070 con 0x7f4f7006d950 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.763+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7015f1c0 con 0x7f4f7006d950 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.763+0000 7f4f57fff640 1 -- 172.21.15.171:0/2983990786 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60033a70 con 0x7f4f7006d950 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.763+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f701580a0 con 0x7f4f7006d950 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.763+0000 7f4f57fff640 1 -- 172.21.15.171:0/2983990786 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f60033c10 con 0x7f4f7006d950 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.763+0000 7f4f57fff640 1 -- 172.21.15.171:0/2983990786 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f4f60048aa0 con 0x7f4f7006d950 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.764+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7015f6e0 con 0x7f4f7006d950 2024-05-20T17:52:43.764 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.766+0000 7f4f57fff640 1 -- 172.21.15.171:0/2983990786 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4f7015f6e0 con 0x7f4f7006d950 2024-05-20T17:52:43.777 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:43.777+0000 7fa54b814040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:52:43.778 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:43.779+0000 7fdc8fc38040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-20T17:52:43.831 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:43.833+0000 7fdc8fc38040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:52:43.832 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:43.832+0000 7fa54b814040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-20T17:52:43.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.836+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea4a7acf-d2e6-444c-970f-cb33606423ac", "id": 5} v 0) -- 0x7f4f70075b00 con 0x7f4f7006d950 2024-05-20T17:52:43.841 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.842+0000 7f4f57fff640 1 -- 172.21.15.171:0/2983990786 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea4a7acf-d2e6-444c-970f-cb33606423ac", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f4f60048460 con 0x7f4f7006d950 2024-05-20T17:52:43.841 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-05-20T17:52:43.842 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.843+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7006d950 msgr2=0x7f4f7015e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.843+0000 7f4f75fea640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7006d950 0x7f4f7015e5e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4f60000c00 tx=0x7f4f600046c0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.843+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 shutdown_connections 2024-05-20T17:52:43.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.843+0000 7f4f75fea640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f7015bf50 0x7f4f70153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.843+0000 7f4f75fea640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f700d18b0 0x7f4f7006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.843+0000 7f4f75fea640 1 --2- 172.21.15.171:0/2983990786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f7006d950 0x7f4f7015e5e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.843+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 >> 172.21.15.171:0/2983990786 conn(0x7f4f70073770 msgr2=0x7f4f700d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.843+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 shutdown_connections 2024-05-20T17:52:43.843 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.844+0000 7f4f75fea640 1 -- 172.21.15.171:0/2983990786 wait complete. 2024-05-20T17:52:43.853 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 86c9adf8-c087-4714-9db2-c51d697d3b83 6 2024-05-20T17:52:43.950 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:43.950+0000 7fa54b814040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:52:43.951 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:43.952+0000 7fdc8fc38040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-20T17:52:43.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.964+0000 7fb0aa910640 1 Processor -- start 2024-05-20T17:52:43.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.964+0000 7fb0aa910640 1 -- start start 2024-05-20T17:52:43.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0aa910640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb0a40af330 0x7fb0a406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0aa910640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a406cb70 0x7fb0a40d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0aa910640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a40d1ed0 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0aa910640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a40af740 con 0x7fb0a40af330 2024-05-20T17:52:43.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0aa910640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a415c880 con 0x7fb0a406cb70 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a37fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a406cb70 0x7fb0a40d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a3fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb0a40af330 0x7fb0a406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a37fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a406cb70 0x7fb0a40d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40512/0 (socket says 172.21.15.171:40512) 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a3fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb0a40af330 0x7fb0a406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47920/0 (socket says 172.21.15.171:47920) 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a37fe640 1 -- 172.21.15.171:0/3043966781 learned_addr learned my addr 172.21.15.171:0/3043966781 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a3fff640 1 -- 172.21.15.171:0/3043966781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a406cb70 msgr2=0x7fb0a40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a3fff640 1 --2- 172.21.15.171:0/3043966781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a406cb70 0x7fb0a40d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a3fff640 1 -- 172.21.15.171:0/3043966781 >> v1:172.21.15.171:6789/0 conn(0x7fb0a40d1ac0 legacy=0x7fb0a406d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a3fff640 1 -- 172.21.15.171:0/3043966781 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a415cb60 con 0x7fb0a40af330 2024-05-20T17:52:43.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.966+0000 7fb0a37fe640 1 --2- 172.21.15.171:0/3043966781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a406cb70 0x7fb0a40d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.967+0000 7fb0a3fff640 1 --2- 172.21.15.171:0/3043966781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a406c630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0940097a0 tx=0x7fb09402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4fea32e7f5a2bd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.967+0000 7fb0a2ffd640 1 -- 172.21.15.171:0/3043966781 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094037070 con 0x7fb0a40af330 2024-05-20T17:52:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.967+0000 7fb0a2ffd640 1 -- 172.21.15.171:0/3043966781 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb094032440 con 0x7fb0a40af330 2024-05-20T17:52:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.967+0000 7fb0a2ffd640 1 -- 172.21.15.171:0/3043966781 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb094032810 con 0x7fb0a40af330 2024-05-20T17:52:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.968+0000 7fb0aa910640 1 -- 172.21.15.171:0/3043966781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 msgr2=0x7fb0a406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.968+0000 7fb0aa910640 1 --2- 172.21.15.171:0/3043966781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a406c630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0940097a0 tx=0x7fb09402a180 comp rx=0 tx=0).stop 2024-05-20T17:52:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.968+0000 7fb0aa910640 1 -- 172.21.15.171:0/3043966781 shutdown_connections 2024-05-20T17:52:43.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.968+0000 7fb0aa910640 1 --2- 172.21.15.171:0/3043966781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a406cb70 0x7fb0a40d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.968+0000 7fb0aa910640 1 --2- 172.21.15.171:0/3043966781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a406c630 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.968+0000 7fb0aa910640 1 -- 172.21.15.171:0/3043966781 >> 172.21.15.171:0/3043966781 conn(0x7fb0a40b6620 msgr2=0x7fb0a40b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.968+0000 7fb0aa910640 1 -- 172.21.15.171:0/3043966781 shutdown_connections 2024-05-20T17:52:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.968+0000 7fb0aa910640 1 -- 172.21.15.171:0/3043966781 wait complete. 2024-05-20T17:52:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.970+0000 7fb0aa910640 1 Processor -- start 2024-05-20T17:52:43.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.970+0000 7fb0aa910640 1 -- start start 2024-05-20T17:52:43.971 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0aa910640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a406cb70 0x7fb0a4148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0aa910640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a4140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0aa910640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a40d1ac0 0x7fb0a41573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0aa910640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a415d400 con 0x7fb0a406cb70 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0aa910640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a415d120 con 0x7fb0a40af330 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0aa910640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a415c4a0 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0a8ead640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a40d1ac0 0x7fb0a41573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0a37fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a4140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.971+0000 7fb0a8ead640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a40d1ac0 0x7fb0a41573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40520/0 (socket says 172.21.15.171:40520) 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a37fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a4140f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:47922/0 (socket says 172.21.15.171:47922) 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a8ead640 1 -- 172.21.15.171:0/41330238 learned_addr learned my addr 172.21.15.171:0/41330238 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a3fff640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a406cb70 0x7fb0a4148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a8ead640 1 -- 172.21.15.171:0/41330238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 msgr2=0x7fb0a4140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a8ead640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a4140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a8ead640 1 -- 172.21.15.171:0/41330238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a406cb70 msgr2=0x7fb0a4148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a8ead640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a406cb70 0x7fb0a4148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a8ead640 1 -- 172.21.15.171:0/41330238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a415afd0 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a37fe640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a4140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a8ead640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a40d1ac0 0x7fb0a41573f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c6e0 tx=0x7fb09c00cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a0ff9640 1 -- 172.21.15.171:0/41330238 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c003b70 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a0ff9640 1 -- 172.21.15.171:0/41330238 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c003d30 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a415b2b0 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a0ff9640 1 -- 172.21.15.171:0/41330238 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c005310 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a415b870 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a0ff9640 1 -- 172.21.15.171:0/41330238 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb09c0054b0 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.972+0000 7fb0a0ff9640 1 -- 172.21.15.171:0/41330238 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb09c012ab0 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.973+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a4075b00 con 0x7fb0a40d1ac0 2024-05-20T17:52:43.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:43.977+0000 7fb0a0ff9640 1 -- 172.21.15.171:0/41330238 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb0a40d1ed0 con 0x7fb0a40d1ac0 2024-05-20T17:52:44.049 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.050+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "86c9adf8-c087-4714-9db2-c51d697d3b83", "id": 6} v 0) -- 0x7fb0a414b960 con 0x7fb0a40d1ac0 2024-05-20T17:52:44.055 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.057+0000 7fb0a0ff9640 1 -- 172.21.15.171:0/41330238 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86c9adf8-c087-4714-9db2-c51d697d3b83", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb09c012d90 con 0x7fb0a40d1ac0 2024-05-20T17:52:44.056 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a40d1ac0 msgr2=0x7fb0a41573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a40d1ac0 0x7fb0a41573f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c6e0 tx=0x7fb09c00cba0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 shutdown_connections 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0a40d1ac0 0x7fb0a41573f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0a40af330 0x7fb0a4140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 --2- 172.21.15.171:0/41330238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a406cb70 0x7fb0a4148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 >> 172.21.15.171:0/41330238 conn(0x7fb0a40b6620 msgr2=0x7fb0a41585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 shutdown_connections 2024-05-20T17:52:44.057 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.058+0000 7fb0aa910640 1 -- 172.21.15.171:0/41330238 wait complete. 2024-05-20T17:52:44.070 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new d2dfe8c6-2af6-4217-bc36-3d516d2c3d70 7 2024-05-20T17:52:44.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.181+0000 7f486ae6c640 1 Processor -- start 2024-05-20T17:52:44.180 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.181+0000 7f486ae6c640 1 -- start start 2024-05-20T17:52:44.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.182+0000 7f486ae6c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f486406b520 0x7f486406b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.182+0000 7f486ae6c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f48640b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.182+0000 7f486ae6c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486409ac70 con 0x7f486415bf00 2024-05-20T17:52:44.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.182+0000 7f486ae6c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f48640b0bb0 con 0x7f486406b520 2024-05-20T17:52:44.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.182+0000 7f486ae6c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48640b0370 con 0x7f48640b1600 2024-05-20T17:52:44.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.182+0000 7f4869409640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f48640b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.183+0000 7f4869409640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f48640b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40530/0 (socket says 172.21.15.171:40530) 2024-05-20T17:52:44.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.183+0000 7f4869409640 1 -- 172.21.15.171:0/719415066 learned_addr learned my addr 172.21.15.171:0/719415066 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:44.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.183+0000 7f4863fff640 1 --2- 172.21.15.171:0/719415066 >> v2:172.21.15.6:3300/0 conn(0x7f486406b520 0x7f486406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.183+0000 7f4869409640 1 -- 172.21.15.171:0/719415066 >> v2:172.21.15.6:3300/0 conn(0x7f486406b520 msgr2=0x7f486406b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:44.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.183+0000 7f4869409640 1 --2- 172.21.15.171:0/719415066 >> v2:172.21.15.6:3300/0 conn(0x7f486406b520 0x7f486406b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.183+0000 7f4869409640 1 -- 172.21.15.171:0/719415066 >> v1:172.21.15.6:6789/0 conn(0x7f486415bf00 legacy=0x7f486409a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.183+0000 7f4869409640 1 -- 172.21.15.171:0/719415066 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48640b0650 con 0x7f48640b1600 2024-05-20T17:52:44.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.184+0000 7f4869409640 1 --2- 172.21.15.171:0/719415066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f48640b1a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f485c00d150 tx=0x7f485c02c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cf6bd9682592d24 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:44.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.184+0000 7f48637fe640 1 -- 172.21.15.171:0/719415066 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c009600 con 0x7f48640b1600 2024-05-20T17:52:44.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.184+0000 7f48637fe640 1 -- 172.21.15.171:0/719415066 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485c037070 con 0x7f48640b1600 2024-05-20T17:52:44.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.184+0000 7f48637fe640 1 -- 172.21.15.171:0/719415066 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c0099c0 con 0x7f48640b1600 2024-05-20T17:52:44.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.185+0000 7f486ae6c640 1 -- 172.21.15.171:0/719415066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 msgr2=0x7f48640b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.185+0000 7f486ae6c640 1 --2- 172.21.15.171:0/719415066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f48640b1a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f485c00d150 tx=0x7f485c02c930 comp rx=0 tx=0).stop 2024-05-20T17:52:44.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.185+0000 7f486ae6c640 1 -- 172.21.15.171:0/719415066 shutdown_connections 2024-05-20T17:52:44.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.185+0000 7f486ae6c640 1 --2- 172.21.15.171:0/719415066 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f48640b1a10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.185+0000 7f486ae6c640 1 --2- 172.21.15.171:0/719415066 >> v2:172.21.15.6:3300/0 conn(0x7f486406b520 0x7f486406b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.185+0000 7f486ae6c640 1 -- 172.21.15.171:0/719415066 >> 172.21.15.171:0/719415066 conn(0x7f4864072f30 msgr2=0x7f48640b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:44.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.185+0000 7f486ae6c640 1 -- 172.21.15.171:0/719415066 shutdown_connections 2024-05-20T17:52:44.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.185+0000 7f486ae6c640 1 -- 172.21.15.171:0/719415066 wait complete. 2024-05-20T17:52:44.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.187+0000 7f486ae6c640 1 Processor -- start 2024-05-20T17:52:44.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.187+0000 7f486ae6c640 1 -- start start 2024-05-20T17:52:44.188 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f486ae6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486406b520 0x7f4864141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.188 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f486ae6c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f4864157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.188 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f486ae6c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f486415bf00 0x7f486415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f486ae6c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f486415c490 con 0x7f486406b520 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f486ae6c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f486415c310 con 0x7f486415bf00 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f486ae6c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48640afee0 con 0x7f48640b1600 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f4863fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f4864157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f4869409640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f486415bf00 0x7f486415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f4863fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f4864157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:40538/0 (socket says 172.21.15.171:40538) 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f4863fff640 1 -- 172.21.15.171:0/2010996461 learned_addr learned my addr 172.21.15.171:0/2010996461 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f4868c08640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486406b520 0x7f4864141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.188+0000 7f4863fff640 1 -- 172.21.15.171:0/2010996461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f486415bf00 msgr2=0x7f486415e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f4863fff640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f486415bf00 0x7f486415e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f4863fff640 1 -- 172.21.15.171:0/2010996461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486406b520 msgr2=0x7f4864141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f4863fff640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486406b520 0x7f4864141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f4863fff640 1 -- 172.21.15.171:0/2010996461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486413f6f0 con 0x7f48640b1600 2024-05-20T17:52:44.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f4869409640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f486415bf00 0x7f486415e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f4863fff640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f4864157340 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f485000e8a0 tx=0x7f485000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f48617fa640 1 -- 172.21.15.171:0/2010996461 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4850017070 con 0x7f48640b1600 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f48617fa640 1 -- 172.21.15.171:0/2010996461 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485000c940 con 0x7f48640b1600 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486413fbf0 con 0x7f48640b1600 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f48617fa640 1 -- 172.21.15.171:0/2010996461 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485000cd30 con 0x7f48640b1600 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f486415e1e0 con 0x7f48640b1600 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f48617fa640 1 -- 172.21.15.171:0/2010996461 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f485001a070 con 0x7f48640b1600 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.189+0000 7f48617fa640 1 -- 172.21.15.171:0/2010996461 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f4850013ad0 con 0x7f48640b1600 2024-05-20T17:52:44.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.190+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4864075b00 con 0x7f48640b1600 2024-05-20T17:52:44.191 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.192+0000 7f48617fa640 1 -- 172.21.15.171:0/2010996461 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4850013df0 con 0x7f48640b1600 2024-05-20T17:52:44.262 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.263+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d2dfe8c6-2af6-4217-bc36-3d516d2c3d70", "id": 7} v 0) -- 0x7f4864073910 con 0x7f48640b1600 2024-05-20T17:52:44.270 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.272+0000 7f48617fa640 1 -- 172.21.15.171:0/2010996461 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2dfe8c6-2af6-4217-bc36-3d516d2c3d70", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f4850006480 con 0x7f48640b1600 2024-05-20T17:52:44.271 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 msgr2=0x7f4864157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f4864157340 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f485000e8a0 tx=0x7f485000ed60 comp rx=0 tx=0).stop 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 shutdown_connections 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f486415bf00 0x7f486415e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48640b1600 0x7f4864157340 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 --2- 172.21.15.171:0/2010996461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486406b520 0x7f4864141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 >> 172.21.15.171:0/2010996461 conn(0x7f4864072f30 msgr2=0x7f48641591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 shutdown_connections 2024-05-20T17:52:44.272 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:52:44.273+0000 7f486ae6c640 1 -- 172.21.15.171:0/2010996461 wait complete. 2024-05-20T17:52:44.282 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-20T17:52:44.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-20T17:52:44.285 INFO:tasks.ceph.osd.0:Started 2024-05-20T17:52:44.285 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-20T17:52:44.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-20T17:52:44.287 INFO:tasks.ceph.osd.1:Started 2024-05-20T17:52:44.287 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-20T17:52:44.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-20T17:52:44.289 INFO:tasks.ceph.osd.2:Started 2024-05-20T17:52:44.289 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-20T17:52:44.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-20T17:52:44.291 INFO:tasks.ceph.osd.3:Started 2024-05-20T17:52:44.291 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-20T17:52:44.292 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-20T17:52:44.293 INFO:tasks.ceph.osd.4:Started 2024-05-20T17:52:44.294 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-20T17:52:44.294 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-20T17:52:44.297 INFO:tasks.ceph.osd.5:Started 2024-05-20T17:52:44.297 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-20T17:52:44.298 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-20T17:52:44.299 INFO:tasks.ceph.osd.6:Started 2024-05-20T17:52:44.300 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-20T17:52:44.300 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-20T17:52:44.302 INFO:tasks.ceph.osd.7:Started 2024-05-20T17:52:44.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:52:44.365 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:44.366+0000 7fdc8fc38040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:52:44.393 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:44.394+0000 7fa54b814040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-20T17:52:44.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.449+0000 7febd6ee2640 1 Processor -- start 2024-05-20T17:52:44.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.449+0000 7febd6ee2640 1 -- start start 2024-05-20T17:52:44.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.450+0000 7febd6ee2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7febd0159ca0 0x7febd00af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.450+0000 7febd6ee2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd00b1650 0x7febd00b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.450+0000 7febd6ee2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd009a740 con 0x7febd006c630 2024-05-20T17:52:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.450+0000 7febd6ee2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7febd009a4f0 con 0x7febd0159ca0 2024-05-20T17:52:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.450+0000 7febd6ee2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7febd009b350 con 0x7febd00b1650 2024-05-20T17:52:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febd547f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7febd006c630 0x7febd015c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51248/0 (socket says 172.21.15.6:51248) 2024-05-20T17:52:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febd547f640 1 -- 172.21.15.6:0/1179699556 learned_addr learned my addr 172.21.15.6:0/1179699556 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:52:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febd4c7e640 1 --2- 172.21.15.6:0/1179699556 >> v2:172.21.15.171:3300/0 conn(0x7febd0159ca0 0x7febd00af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febcffff640 1 --2- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd00b1650 0x7febd00b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febcf7fe640 1 -- 172.21.15.6:0/1179699556 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836794630 0 0) 0x7febd009a740 con 0x7febd006c630 2024-05-20T17:52:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febcf7fe640 1 -- 172.21.15.6:0/1179699556 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febc0003520 con 0x7febd006c630 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febd4c7e640 1 -- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd00b1650 msgr2=0x7febd00b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febd4c7e640 1 --2- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd00b1650 0x7febd00b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febd4c7e640 1 -- 172.21.15.6:0/1179699556 >> v1:172.21.15.6:6789/0 conn(0x7febd006c630 legacy=0x7febd015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febd4c7e640 1 -- 172.21.15.6:0/1179699556 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd009aa20 con 0x7febd0159ca0 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.451+0000 7febcffff640 1 --2- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd00b1650 0x7febd00b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.452+0000 7febd4c7e640 1 --2- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd0159ca0 0x7febd00af230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7febc40097a0 tx=0x7febc402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a3f6722c81b782a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.452+0000 7febcf7fe640 1 -- 172.21.15.6:0/1179699556 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4037070 con 0x7febd0159ca0 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.452+0000 7febcf7fe640 1 -- 172.21.15.6:0/1179699556 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc402ae40 con 0x7febd0159ca0 2024-05-20T17:52:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.452+0000 7febcf7fe640 1 -- 172.21.15.6:0/1179699556 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4032660 con 0x7febd0159ca0 2024-05-20T17:52:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.453+0000 7febd6ee2640 1 -- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd0159ca0 msgr2=0x7febd00af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.453+0000 7febd6ee2640 1 --2- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd0159ca0 0x7febd00af230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7febc40097a0 tx=0x7febc402a0f0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.453+0000 7febd6ee2640 1 -- 172.21.15.6:0/1179699556 shutdown_connections 2024-05-20T17:52:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.453+0000 7febd6ee2640 1 --2- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd00b1650 0x7febd00b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.453+0000 7febd6ee2640 1 --2- 172.21.15.6:0/1179699556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd0159ca0 0x7febd00af230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.453+0000 7febd6ee2640 1 -- 172.21.15.6:0/1179699556 >> 172.21.15.6:0/1179699556 conn(0x7febd00b6620 msgr2=0x7febd00b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.453+0000 7febd6ee2640 1 -- 172.21.15.6:0/1179699556 shutdown_connections 2024-05-20T17:52:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.453+0000 7febd6ee2640 1 -- 172.21.15.6:0/1179699556 wait complete. 2024-05-20T17:52:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.455+0000 7febd6ee2640 1 Processor -- start 2024-05-20T17:52:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.455+0000 7febd6ee2640 1 -- start start 2024-05-20T17:52:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.456+0000 7febd6ee2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd006c630 0x7febd0147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.456+0000 7febd6ee2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd00b1650 0x7febd0156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.456+0000 7febd6ee2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd0159ca0 0x7febd0156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.456+0000 7febd6ee2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7febd009afe0 con 0x7febd0159ca0 2024-05-20T17:52:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.456+0000 7febd6ee2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7febd00af770 con 0x7febd00b1650 2024-05-20T17:52:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.456+0000 7febd6ee2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7febd00b2220 con 0x7febd006c630 2024-05-20T17:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febd547f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd0159ca0 0x7febd0156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febd4c7e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd006c630 0x7febd0147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd00b1650 0x7febd0156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febd547f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd0159ca0 0x7febd0156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54362/0 (socket says 172.21.15.6:54362) 2024-05-20T17:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febd4c7e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd006c630 0x7febd0147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:35218/0 (socket says 172.21.15.6:35218) 2024-05-20T17:52:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febd547f640 1 -- 172.21.15.6:0/1178247887 learned_addr learned my addr 172.21.15.6:0/1178247887 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcffff640 1 -- 172.21.15.6:0/1178247887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd006c630 msgr2=0x7febd0147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcffff640 1 --2- 172.21.15.6:0/1178247887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd006c630 0x7febd0147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcffff640 1 -- 172.21.15.6:0/1178247887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd0159ca0 msgr2=0x7febd0156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcffff640 1 --2- 172.21.15.6:0/1178247887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd0159ca0 0x7febd0156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcffff640 1 -- 172.21.15.6:0/1178247887 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd01484a0 con 0x7febd00b1650 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febd547f640 1 --2- 172.21.15.6:0/1178247887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd0159ca0 0x7febd0156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcffff640 1 --2- 172.21.15.6:0/1178247887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd00b1650 0x7febd0156a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7febbc010bb0 tx=0x7febbc00b510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcd7fa640 1 -- 172.21.15.6:0/1178247887 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc01e070 con 0x7febd00b1650 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcd7fa640 1 -- 172.21.15.6:0/1178247887 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc00be30 con 0x7febd00b1650 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd01577c0 con 0x7febd00b1650 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febcd7fa640 1 -- 172.21.15.6:0/1178247887 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc019610 con 0x7febd00b1650 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.457+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd0157d80 con 0x7febd00b1650 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.458+0000 7febcd7fa640 1 -- 172.21.15.6:0/1178247887 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7febbc021070 con 0x7febd00b1650 2024-05-20T17:52:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.458+0000 7febcd7fa640 1 -- 172.21.15.6:0/1178247887 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7febbc009300 con 0x7febd00b1650 2024-05-20T17:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.459+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd0157fc0 con 0x7febd00b1650 2024-05-20T17:52:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.461+0000 7febcd7fa640 1 -- 172.21.15.6:0/1178247887 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7febd0157fc0 con 0x7febd00b1650 2024-05-20T17:52:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.523+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febd0157520 con 0x7febd00b1650 2024-05-20T17:52:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.524+0000 7febcd7fa640 1 -- 172.21.15.6:0/1178247887 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7febd0157520 con 0x7febd00b1650 2024-05-20T17:52:44.524 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:52:44.524 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:52:44.265143+0000","last_up_change":"0.000000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd00b1650 msgr2=0x7febd0156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 --2- 172.21.15.6:0/1178247887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd00b1650 0x7febd0156a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7febbc010bb0 tx=0x7febbc00b510 comp rx=0 tx=0).stop 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 shutdown_connections 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 --2- 172.21.15.6:0/1178247887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd0159ca0 0x7febd0156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 --2- 172.21.15.6:0/1178247887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7febd00b1650 0x7febd0156a20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 --2- 172.21.15.6:0/1178247887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7febd006c630 0x7febd0147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 >> 172.21.15.6:0/1178247887 conn(0x7febd00b6620 msgr2=0x7febd0070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 shutdown_connections 2024-05-20T17:52:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:44.525+0000 7febd6ee2640 1 -- 172.21.15.6:0/1178247887 wait complete. 2024-05-20T17:52:44.536 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-20T17:52:44.536 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-20T17:52:44.647 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:44.648+0000 7fdc8fc38040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:52:44.675 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:44.675+0000 7fa54b814040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-20T17:52:44.700 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:44.702+0000 7fdc8fc38040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:52:44.730 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:44.731+0000 7fa54b814040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-20T17:52:44.816 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:44.817+0000 7fdc8fc38040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:52:44.852 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:44.853+0000 7fa54b814040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-20T17:52:44.912 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-20T17:52:44.912+0000 7f100c22d640 -1 Falling back to public interface 2024-05-20T17:52:44.912 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-05-20T17:52:44.913+0000 7fb9784f0640 -1 Falling back to public interface 2024-05-20T17:52:44.916 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-05-20T17:52:44.917+0000 7f602ce2c640 -1 Falling back to public interface 2024-05-20T17:52:44.928 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-20T17:52:44.928+0000 7fb726a18640 -1 Falling back to public interface 2024-05-20T17:52:44.929 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-20T17:52:44.930+0000 7f4b06cf0640 -1 Falling back to public interface 2024-05-20T17:52:44.937 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-05-20T17:52:44.938+0000 7f3404411640 -1 Falling back to public interface 2024-05-20T17:52:44.937 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-05-20T17:52:44.938+0000 7f4048c19640 -1 Falling back to public interface 2024-05-20T17:52:44.949 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-20T17:52:44.950+0000 7fd8a5e20640 -1 Falling back to public interface 2024-05-20T17:52:45.117 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:45.119+0000 7fdc8fc38040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:52:45.164 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:45.165+0000 7fdc8fc38040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:52:45.165 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:45.165+0000 7fa54b814040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-20T17:52:45.214 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:45.215+0000 7fa54b814040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-20T17:52:45.322 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:45.323+0000 7fdc8fc38040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:52:45.341 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-20T17:52:45.379 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:45.380+0000 7fa54b814040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-20T17:52:45.447 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.448+0000 7f3a27061640 1 Processor -- start 2024-05-20T17:52:45.448 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.448+0000 7f3a27061640 1 -- start start 2024-05-20T17:52:45.450 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a27061640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a2015fc50 0x7f3a2006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a27061640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3a2015c8e0 0x7f3a2015e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a27061640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2006d6e0 con 0x7f3a2006d2d0 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a27061640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2015ccf0 con 0x7f3a2015fc50 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a27061640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2015da40 con 0x7f3a2015c8e0 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a24dfd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a2015fc50 0x7f3a2006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a1ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3a2006d2d0 0x7f3a2015c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51258/0 (socket says 172.21.15.6:51258) 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a1ffff640 1 -- 172.21.15.6:0/3808398532 learned_addr learned my addr 172.21.15.6:0/3808398532 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.450+0000 7f3a255fe640 1 --2- 172.21.15.6:0/3808398532 >> v2:172.21.15.171:3300/0 conn(0x7f3a2015c8e0 0x7f3a2015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.451+0000 7f3a24dfd640 1 -- 172.21.15.6:0/3808398532 >> v2:172.21.15.171:3300/0 conn(0x7f3a2015c8e0 msgr2=0x7f3a2015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.451+0000 7f3a24dfd640 1 --2- 172.21.15.6:0/3808398532 >> v2:172.21.15.171:3300/0 conn(0x7f3a2015c8e0 0x7f3a2015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.451+0000 7f3a24dfd640 1 -- 172.21.15.6:0/3808398532 >> v1:172.21.15.6:6789/0 conn(0x7f3a2006d2d0 legacy=0x7f3a2015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:45.451 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.451+0000 7f3a24dfd640 1 -- 172.21.15.6:0/3808398532 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2015cf50 con 0x7f3a2015fc50 2024-05-20T17:52:45.452 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.451+0000 7f3a1f7fe640 1 -- 172.21.15.6:0/3808398532 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2685860142 0 0) 0x7f3a0c001110 con 0x7f3a2006d2d0 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.451+0000 7f3a24dfd640 1 --2- 172.21.15.6:0/3808398532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2015fc50 0x7f3a2006cd90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3a20072130 tx=0x7f3a1402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399e424da3add2f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.452+0000 7f3a1f7fe640 1 -- 172.21.15.6:0/3808398532 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14037070 con 0x7f3a2015fc50 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.452+0000 7f3a1f7fe640 1 -- 172.21.15.6:0/3808398532 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14032440 con 0x7f3a2015fc50 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.452+0000 7f3a1f7fe640 1 -- 172.21.15.6:0/3808398532 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1402ae60 con 0x7f3a2015fc50 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.452+0000 7f3a27061640 1 -- 172.21.15.6:0/3808398532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2015fc50 msgr2=0x7f3a2006cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.452+0000 7f3a27061640 1 --2- 172.21.15.6:0/3808398532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2015fc50 0x7f3a2006cd90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3a20072130 tx=0x7f3a1402a110 comp rx=0 tx=0).stop 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.452+0000 7f3a27061640 1 -- 172.21.15.6:0/3808398532 shutdown_connections 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.452+0000 7f3a27061640 1 --2- 172.21.15.6:0/3808398532 >> v2:172.21.15.171:3300/0 conn(0x7f3a2015c8e0 0x7f3a2015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.453+0000 7f3a27061640 1 --2- 172.21.15.6:0/3808398532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2015fc50 0x7f3a2006cd90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.453+0000 7f3a27061640 1 -- 172.21.15.6:0/3808398532 >> 172.21.15.6:0/3808398532 conn(0x7f3a20072dd0 msgr2=0x7f3a200b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:45.453 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.453+0000 7f3a27061640 1 -- 172.21.15.6:0/3808398532 shutdown_connections 2024-05-20T17:52:45.454 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.453+0000 7f3a27061640 1 -- 172.21.15.6:0/3808398532 wait complete. 2024-05-20T17:52:45.455 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.455+0000 7f3a27061640 1 Processor -- start 2024-05-20T17:52:45.455 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.455+0000 7f3a27061640 1 -- start start 2024-05-20T17:52:45.456 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:45.457+0000 7fdc8fc38040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:52:45.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a27061640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2006d2d0 0x7f3a20148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:45.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a27061640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a2015c8e0 0x7f3a20150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:45.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a27061640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a2015fc50 0x7f3a20150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:45.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a27061640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2015e740 con 0x7f3a2006d2d0 2024-05-20T17:52:45.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a27061640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2015d510 con 0x7f3a2015c8e0 2024-05-20T17:52:45.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a27061640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2015e8c0 con 0x7f3a2015fc50 2024-05-20T17:52:45.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a24dfd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2006d2d0 0x7f3a20148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:45.459 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a24dfd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2006d2d0 0x7f3a20148a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54368/0 (socket says 172.21.15.6:54368) 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a24dfd640 1 -- 172.21.15.6:0/998566784 learned_addr learned my addr 172.21.15.6:0/998566784 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a1ffff640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a2015c8e0 0x7f3a20150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a255fe640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a2015fc50 0x7f3a20150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a24dfd640 1 -- 172.21.15.6:0/998566784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a2015fc50 msgr2=0x7f3a20150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a24dfd640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a2015fc50 0x7f3a20150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a24dfd640 1 -- 172.21.15.6:0/998566784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a2015c8e0 msgr2=0x7f3a20150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a24dfd640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a2015c8e0 0x7f3a20150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.458+0000 7f3a24dfd640 1 -- 172.21.15.6:0/998566784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a200b1020 con 0x7f3a2006d2d0 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.459+0000 7f3a24dfd640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2006d2d0 0x7f3a20148a20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3a14000c00 tx=0x7f3a140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:45.460 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.459+0000 7f3a1d7fa640 1 -- 172.21.15.6:0/998566784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14037040 con 0x7f3a2006d2d0 2024-05-20T17:52:45.461 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.459+0000 7f3a1d7fa640 1 -- 172.21.15.6:0/998566784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14042070 con 0x7f3a2006d2d0 2024-05-20T17:52:45.461 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.459+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a200b1300 con 0x7f3a2006d2d0 2024-05-20T17:52:45.461 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.459+0000 7f3a1d7fa640 1 -- 172.21.15.6:0/998566784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14030960 con 0x7f3a2006d2d0 2024-05-20T17:52:45.461 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.459+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a200b18c0 con 0x7f3a2006d2d0 2024-05-20T17:52:45.461 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.459+0000 7f3a1d7fa640 1 -- 172.21.15.6:0/998566784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a14030b00 con 0x7f3a2006d2d0 2024-05-20T17:52:45.461 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.459+0000 7f3a1d7fa640 1 -- 172.21.15.6:0/998566784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3a14047c30 con 0x7f3a2006d2d0 2024-05-20T17:52:45.462 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.460+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a20075980 con 0x7f3a2006d2d0 2024-05-20T17:52:45.464 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.464+0000 7f3a1d7fa640 1 -- 172.21.15.6:0/998566784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3a14047460 con 0x7f3a2006d2d0 2024-05-20T17:52:45.509 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:45.509+0000 7fdc8fc38040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:52:45.526 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.527+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a200734a0 con 0x7f3a2006d2d0 2024-05-20T17:52:45.527 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.528+0000 7f3a1d7fa640 1 -- 172.21.15.6:0/998566784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3a14047640 con 0x7f3a2006d2d0 2024-05-20T17:52:45.527 INFO:teuthology.misc.health.smithi006.stdout: 2024-05-20T17:52:45.527 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:52:44.265143+0000","last_up_change":"0.000000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:52:45.528 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.528+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2006d2d0 msgr2=0x7f3a20148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:45.528 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.528+0000 7f3a27061640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2006d2d0 0x7f3a20148a20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3a14000c00 tx=0x7f3a140046c0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.528 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.529+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 shutdown_connections 2024-05-20T17:52:45.529 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.529+0000 7f3a27061640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a2015fc50 0x7f3a20150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.529 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.529+0000 7f3a27061640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a2015c8e0 0x7f3a20150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.529 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.529+0000 7f3a27061640 1 --2- 172.21.15.6:0/998566784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2006d2d0 0x7f3a20148a20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:45.529 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.529+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 >> 172.21.15.6:0/998566784 conn(0x7f3a20072dd0 msgr2=0x7f3a2006c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:45.529 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.529+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 shutdown_connections 2024-05-20T17:52:45.529 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:45.529+0000 7f3a27061640 1 -- 172.21.15.6:0/998566784 wait complete. 2024-05-20T17:52:45.532 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:45.533+0000 7fa54b814040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-20T17:52:45.538 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-20T17:52:45.576 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:45.578+0000 7fdc8fc38040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:52:45.585 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:45.585+0000 7fa54b814040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-20T17:52:45.621 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:45.622+0000 7fdc8fc38040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:52:45.658 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:45.659+0000 7fa54b814040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-20T17:52:45.705 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:45.706+0000 7fa54b814040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-20T17:52:46.098 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:46.099+0000 7fdc8fc38040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:52:46.206 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:46.207+0000 7fa54b814040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-20T17:52:46.213 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:46.214+0000 7fdc8fc38040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:52:46.330 INFO:tasks.ceph.mgr.y.smithi006.stderr:2024-05-20T17:52:46.330+0000 7fa54b814040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-20T17:52:47.232 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:47.233+0000 7fdc2fe3c640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-20T17:52:47.233 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-05-20T17:52:47.234+0000 7fdc2fe3c640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-20T17:52:48.377 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-20T17:52:48.377+0000 7f100c22d640 -1 osd.0 0 log_to_monitors true 2024-05-20T17:52:48.378 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-05-20T17:52:48.379+0000 7fb9784f0640 -1 osd.5 0 log_to_monitors true 2024-05-20T17:52:48.423 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-05-20T17:52:48.424+0000 7f4048c19640 -1 osd.6 0 log_to_monitors true 2024-05-20T17:52:48.434 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-20T17:52:48.435+0000 7fb726a18640 -1 osd.2 0 log_to_monitors true 2024-05-20T17:52:48.439 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-20T17:52:48.440+0000 7f4b06cf0640 -1 osd.1 0 log_to_monitors true 2024-05-20T17:52:48.445 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-05-20T17:52:48.446+0000 7f602ce2c640 -1 osd.7 0 log_to_monitors true 2024-05-20T17:52:48.453 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-20T17:52:48.453+0000 7fd8a5e20640 -1 osd.3 0 log_to_monitors true 2024-05-20T17:52:48.454 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-05-20T17:52:48.455+0000 7f3404411640 -1 osd.4 0 log_to_monitors true 2024-05-20T17:52:52.345 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-20T17:52:52.416 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-05-20T17:52:52.416+0000 7f4044baf640 -1 osd.6 0 waiting for initial osdmap 2024-05-20T17:52:52.418 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-20T17:52:52.418+0000 7fb7223e7640 -1 osd.2 0 waiting for initial osdmap 2024-05-20T17:52:52.420 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-20T17:52:52.420+0000 7fd8a1f2b640 -1 osd.3 0 waiting for initial osdmap 2024-05-20T17:52:52.427 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-05-20T17:52:52.427+0000 7f6028380640 -1 osd.7 0 waiting for initial osdmap 2024-05-20T17:52:52.431 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-20T17:52:52.431+0000 7f1007807640 -1 osd.0 0 waiting for initial osdmap 2024-05-20T17:52:52.434 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-05-20T17:52:52.435+0000 7fb71a1e2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:52:52.434 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-05-20T17:52:52.435+0000 7f403c9aa640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:52:52.436 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-05-20T17:52:52.436+0000 7f3400507640 -1 osd.4 0 waiting for initial osdmap 2024-05-20T17:52:52.439 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-05-20T17:52:52.440+0000 7fd899512640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:52:52.441 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-05-20T17:52:52.442+0000 7f602018c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:52:52.444 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-20T17:52:52.445+0000 7f4b02c86640 -1 osd.1 0 waiting for initial osdmap 2024-05-20T17:52:52.447 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-05-20T17:52:52.448+0000 7f0fff602640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:52:52.453 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-05-20T17:52:52.454+0000 7f33f7aee640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:52:52.458 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-05-20T17:52:52.459+0000 7f4afaa81640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:52:52.469 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-05-20T17:52:52.467+0000 7fb974486640 -1 osd.5 0 waiting for initial osdmap 2024-05-20T17:52:52.483 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-05-20T17:52:52.483+0000 7fb96c281640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-20T17:52:52.494 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.495+0000 7f199bcca640 1 Processor -- start 2024-05-20T17:52:52.495 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.495+0000 7f199bcca640 1 -- start start 2024-05-20T17:52:52.496 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.496+0000 7f199bcca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19941618b0 0x7f19940b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:52.496 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.496+0000 7f199bcca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19940b4e00 con 0x7f19940b49f0 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.496+0000 7f199bcca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1994160e10 con 0x7f19940d1be0 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.496+0000 7f199bcca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f19940d2430 con 0x7f19941618b0 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.496+0000 7f1999a66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19941618b0 0x7f19940b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.496+0000 7f1999265640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f19940b49f0 0x7f19940d14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44810/0 (socket says 172.21.15.6:44810) 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.496+0000 7f1999265640 1 -- 172.21.15.6:0/2150376556 learned_addr learned my addr 172.21.15.6:0/2150376556 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.497+0000 7f1998a64640 1 -- 172.21.15.6:0/2150376556 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953919984 0 0) 0x7f1994160e10 con 0x7f19940d1be0 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.497+0000 7f1999a66640 1 -- 172.21.15.6:0/2150376556 >> v1:172.21.15.171:6789/0 conn(0x7f19940d1be0 legacy=0x7f19940b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.497+0000 7f1999a66640 1 -- 172.21.15.6:0/2150376556 >> v1:172.21.15.6:6789/0 conn(0x7f19940b49f0 legacy=0x7f19940d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:52.497 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.497+0000 7f1999a66640 1 -- 172.21.15.6:0/2150376556 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19940d2150 con 0x7f19941618b0 2024-05-20T17:52:52.498 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f1999a66640 1 --2- 172.21.15.6:0/2150376556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19940b44b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f19900097a0 tx=0x7f199002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7131d5a2b8bba4d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:52.498 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f1998a64640 1 -- 172.21.15.6:0/2150376556 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990037070 con 0x7f19941618b0 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f1998a64640 1 -- 172.21.15.6:0/2150376556 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199002adc0 con 0x7f19941618b0 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f1998a64640 1 -- 172.21.15.6:0/2150376556 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990032660 con 0x7f19941618b0 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f199bcca640 1 -- 172.21.15.6:0/2150376556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 msgr2=0x7f19940b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f199bcca640 1 --2- 172.21.15.6:0/2150376556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19940b44b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f19900097a0 tx=0x7f199002a130 comp rx=0 tx=0).stop 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f199bcca640 1 -- 172.21.15.6:0/2150376556 shutdown_connections 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f199bcca640 1 --2- 172.21.15.6:0/2150376556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19940b44b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f199bcca640 1 -- 172.21.15.6:0/2150376556 >> 172.21.15.6:0/2150376556 conn(0x7f19940cf4b0 msgr2=0x7f19940cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.498+0000 7f199bcca640 1 -- 172.21.15.6:0/2150376556 shutdown_connections 2024-05-20T17:52:52.499 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.499+0000 7f199bcca640 1 -- 172.21.15.6:0/2150376556 wait complete. 2024-05-20T17:52:52.500 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.500+0000 7f199bcca640 1 Processor -- start 2024-05-20T17:52:52.500 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.500+0000 7f199bcca640 1 -- start start 2024-05-20T17:52:52.502 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199bcca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19940b49f0 0x7f1994144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:52.502 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199bcca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19940d1be0 0x7f19940cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:52.503 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199bcca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19941429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:52.503 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199bcca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f19940b2090 con 0x7f19941618b0 2024-05-20T17:52:52.503 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199bcca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1994161390 con 0x7f19940b49f0 2024-05-20T17:52:52.503 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199bcca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f19940b2210 con 0x7f19940d1be0 2024-05-20T17:52:52.503 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19941429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:52.503 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19941429e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34394/0 (socket says 172.21.15.6:34394) 2024-05-20T17:52:52.503 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 -- 172.21.15.6:0/1940023802 learned_addr learned my addr 172.21.15.6:0/1940023802 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f1999a66640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19940b49f0 0x7f1994144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f1999265640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19940d1be0 0x7f19940cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 -- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19940d1be0 msgr2=0x7f19940cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19940d1be0 0x7f19940cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 -- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19940b49f0 msgr2=0x7f1994144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19940b49f0 0x7f1994144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 -- 172.21.15.6:0/1940023802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19941433c0 con 0x7f19941618b0 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f1999a66640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19940b49f0 0x7f1994144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199a267640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19941429e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f198c00c750 tx=0x7f198c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f198a7fc640 1 -- 172.21.15.6:0/1940023802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c003b70 con 0x7f19941618b0 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f198a7fc640 1 -- 172.21.15.6:0/1940023802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c003d30 con 0x7f19941618b0 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19941436a0 con 0x7f19941618b0 2024-05-20T17:52:52.504 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f198a7fc640 1 -- 172.21.15.6:0/1940023802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c005310 con 0x7f19941618b0 2024-05-20T17:52:52.505 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.502+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1994143c60 con 0x7f19941618b0 2024-05-20T17:52:52.505 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.504+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1994075980 con 0x7f19941618b0 2024-05-20T17:52:52.505 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.504+0000 7f198a7fc640 1 -- 172.21.15.6:0/1940023802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f198c0054b0 con 0x7f19941618b0 2024-05-20T17:52:52.505 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.504+0000 7f198a7fc640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f197806bdd0 0x7f197806e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:52.506 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.504+0000 7f198a7fc640 1 -- 172.21.15.6:0/1940023802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f198c089d40 con 0x7f19941618b0 2024-05-20T17:52:52.506 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.505+0000 7f1999a66640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f197806bdd0 0x7f197806e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:52.506 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.505+0000 7f1999a66640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f197806bdd0 0x7f197806e2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1990034000 tx=0x7f199002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:52.509 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.509+0000 7f198a7fc640 1 -- 172.21.15.6:0/1940023802 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f198c059560 con 0x7f19941618b0 2024-05-20T17:52:52.692 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.692+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19940d0da0 con 0x7f19941618b0 2024-05-20T17:52:52.692 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.693+0000 7f198a7fc640 1 -- 172.21.15.6:0/1940023802 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f198c058e60 con 0x7f19941618b0 2024-05-20T17:52:52.692 INFO:teuthology.misc.health.smithi006.stdout: 2024-05-20T17:52:52.692 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":12,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:52:50.232417+0000","last_up_change":"0.000000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:52:52.694 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f197806bdd0 msgr2=0x7f197806e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f197806bdd0 0x7f197806e2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1990034000 tx=0x7f199002e000 comp rx=0 tx=0).stop 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 msgr2=0x7f19941429e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19941429e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f198c00c750 tx=0x7f198c00cc10 comp rx=0 tx=0).stop 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 shutdown_connections 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f197806bdd0 0x7f197806e2e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19941618b0 0x7f19941429e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19940d1be0 0x7f19940cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 --2- 172.21.15.6:0/1940023802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19940b49f0 0x7f1994144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 >> 172.21.15.6:0/1940023802 conn(0x7f19940cf4b0 msgr2=0x7f19940b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 shutdown_connections 2024-05-20T17:52:52.695 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:52.695+0000 7f199bcca640 1 -- 172.21.15.6:0/1940023802 wait complete. 2024-05-20T17:52:52.704 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-20T17:52:59.511 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-20T17:52:59.633 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.631+0000 7f0282afe640 1 Processor -- start 2024-05-20T17:52:59.633 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.631+0000 7f0282afe640 1 -- start start 2024-05-20T17:52:59.635 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f0282afe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f027c15cf70 0x7f027c160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f0282afe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f027c0d36b0 0x7f027c0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f0282afe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027c0d0310 con 0x7f027c0cff00 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f0282afe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f027c0d3c70 con 0x7f027c0d36b0 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f0282afe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f027c0d3f50 con 0x7f027c15cf70 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f027c0d36b0 0x7f027c0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f028109b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f027c0cff00 0x7f027c162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55168/0 (socket says 172.21.15.6:55168) 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f028109b640 1 -- 172.21.15.6:0/1394493315 learned_addr learned my addr 172.21.15.6:0/1394493315 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f028089a640 1 --2- 172.21.15.6:0/1394493315 >> v2:172.21.15.171:3300/0 conn(0x7f027c15cf70 0x7f027c160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027bfff640 1 -- 172.21.15.6:0/1394493315 >> v2:172.21.15.171:3300/0 conn(0x7f027c15cf70 msgr2=0x7f027c160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027bfff640 1 --2- 172.21.15.6:0/1394493315 >> v2:172.21.15.171:3300/0 conn(0x7f027c15cf70 0x7f027c160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.636 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027bfff640 1 -- 172.21.15.6:0/1394493315 >> v1:172.21.15.6:6789/0 conn(0x7f027c0cff00 legacy=0x7f027c162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027b7fe640 1 -- 172.21.15.6:0/1394493315 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171123751 0 0) 0x7f0274001110 con 0x7f027c0cff00 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027bfff640 1 -- 172.21.15.6:0/1394493315 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c0d4230 con 0x7f027c0d36b0 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f028089a640 1 --2- 172.21.15.6:0/1394493315 >> v2:172.21.15.171:3300/0 conn(0x7f027c15cf70 0x7f027c160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027bfff640 1 --2- 172.21.15.6:0/1394493315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c0d36b0 0x7f027c0cf9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f027c0d5e10 tx=0x7f026402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5a6d3b6e0bd311 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027b7fe640 1 -- 172.21.15.6:0/1394493315 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264007740 con 0x7f027c0d36b0 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027b7fe640 1 -- 172.21.15.6:0/1394493315 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02640078e0 con 0x7f027c0d36b0 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.634+0000 7f027b7fe640 1 -- 172.21.15.6:0/1394493315 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264007cb0 con 0x7f027c0d36b0 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.636+0000 7f0282afe640 1 -- 172.21.15.6:0/1394493315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c0d36b0 msgr2=0x7f027c0cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.636+0000 7f0282afe640 1 --2- 172.21.15.6:0/1394493315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c0d36b0 0x7f027c0cf9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f027c0d5e10 tx=0x7f026402a5f0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.637 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.636+0000 7f0282afe640 1 -- 172.21.15.6:0/1394493315 shutdown_connections 2024-05-20T17:52:59.638 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.636+0000 7f0282afe640 1 --2- 172.21.15.6:0/1394493315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c0d36b0 0x7f027c0cf9c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.638 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.636+0000 7f0282afe640 1 --2- 172.21.15.6:0/1394493315 >> v2:172.21.15.171:3300/0 conn(0x7f027c15cf70 0x7f027c160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.638 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.636+0000 7f0282afe640 1 -- 172.21.15.6:0/1394493315 >> 172.21.15.6:0/1394493315 conn(0x7f027c0d4d10 msgr2=0x7f027c0d5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:59.638 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.636+0000 7f0282afe640 1 -- 172.21.15.6:0/1394493315 shutdown_connections 2024-05-20T17:52:59.638 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.636+0000 7f0282afe640 1 -- 172.21.15.6:0/1394493315 wait complete. 2024-05-20T17:52:59.640 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.638+0000 7f0282afe640 1 Processor -- start 2024-05-20T17:52:59.640 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.638+0000 7f0282afe640 1 -- start start 2024-05-20T17:52:59.640 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f0282afe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f027c0cff00 0x7f027c0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.640 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f0282afe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f027c0d36b0 0x7f027c0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f0282afe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c15cf70 0x7f027c1619b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f0282afe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f027c06ca70 con 0x7f027c15cf70 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f0282afe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f027c06c8f0 con 0x7f027c0d36b0 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f0282afe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f027c06cbf0 con 0x7f027c0cff00 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c15cf70 0x7f027c1619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c15cf70 0x7f027c1619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55100/0 (socket says 172.21.15.6:55100) 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 -- 172.21.15.6:0/1210207014 learned_addr learned my addr 172.21.15.6:0/1210207014 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f027bfff640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f027c0d36b0 0x7f027c0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028089a640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f027c0cff00 0x7f027c0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 -- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f027c0cff00 msgr2=0x7f027c0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f027c0cff00 0x7f027c0cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.641 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 -- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f027c0d36b0 msgr2=0x7f027c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f027c0d36b0 0x7f027c0ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 -- 172.21.15.6:0/1210207014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c0cd870 con 0x7f027c15cf70 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.640+0000 7f028109b640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c15cf70 0x7f027c1619b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f027400c3e0 tx=0x7f027400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.641+0000 7f02797fa640 1 -- 172.21.15.6:0/1210207014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02740074e0 con 0x7f027c15cf70 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.641+0000 7f02797fa640 1 -- 172.21.15.6:0/1210207014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02740047e0 con 0x7f027c15cf70 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.641+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c0cdb50 con 0x7f027c15cf70 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.641+0000 7f02797fa640 1 -- 172.21.15.6:0/1210207014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0274004bd0 con 0x7f027c15cf70 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.641+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c0ce110 con 0x7f027c15cf70 2024-05-20T17:52:59.642 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.642+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027c075980 con 0x7f027c15cf70 2024-05-20T17:52:59.643 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.642+0000 7f02797fa640 1 -- 172.21.15.6:0/1210207014 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0274011070 con 0x7f027c15cf70 2024-05-20T17:52:59.643 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.643+0000 7f02797fa640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f025c06be30 0x7f025c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.643 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.643+0000 7f02797fa640 1 -- 172.21.15.6:0/1210207014 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f027408a550 con 0x7f027c15cf70 2024-05-20T17:52:59.643 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.643+0000 7f028089a640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f025c06be30 0x7f025c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.643 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.644+0000 7f028089a640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f025c06be30 0x7f025c06e340 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f026c00aac0 tx=0x7f026c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:59.646 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.648+0000 7f02797fa640 1 -- 172.21.15.6:0/1210207014 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f027c0d0310 con 0x7f027c15cf70 2024-05-20T17:52:59.831 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.833+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f027c0cf9a0 con 0x7f027c15cf70 2024-05-20T17:52:59.832 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.834+0000 7f02797fa640 1 -- 172.21.15.6:0/1210207014 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7f0274058c00 con 0x7f027c15cf70 2024-05-20T17:52:59.832 INFO:teuthology.misc.health.smithi006.stdout: 2024-05-20T17:52:59.832 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":16,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:52:56.485615+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:52:59.834 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.835+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f025c06be30 msgr2=0x7f025c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.834 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.835+0000 7f0282afe640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f025c06be30 0x7f025c06e340 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f026c00aac0 tx=0x7f026c008040 comp rx=0 tx=0).stop 2024-05-20T17:52:59.835 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.835+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c15cf70 msgr2=0x7f027c1619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.835 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.835+0000 7f0282afe640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c15cf70 0x7f027c1619b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f027400c3e0 tx=0x7f027400c8a0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.835 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.836+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 shutdown_connections 2024-05-20T17:52:59.835 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.836+0000 7f0282afe640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f025c06be30 0x7f025c06e340 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.835 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.836+0000 7f0282afe640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f027c15cf70 0x7f027c1619b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.837 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.836+0000 7f0282afe640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f027c0d36b0 0x7f027c0ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.837 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.836+0000 7f0282afe640 1 --2- 172.21.15.6:0/1210207014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f027c0cff00 0x7f027c0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.837 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.836+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 >> 172.21.15.6:0/1210207014 conn(0x7f027c0d4d10 msgr2=0x7f027c15c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:59.837 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.836+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 shutdown_connections 2024-05-20T17:52:59.837 INFO:teuthology.misc.health.smithi006.stderr:2024-05-20T17:52:59.836+0000 7f0282afe640 1 -- 172.21.15.6:0/1210207014 wait complete. 2024-05-20T17:52:59.844 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-20T17:52:59.845 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-20T17:52:59.845 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T17:52:59.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T17:52:59.847 INFO:tasks.ceph.mds.a:Started 2024-05-20T17:52:59.847 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T17:52:59.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T17:52:59.849 INFO:tasks.ceph.mds.c:Started 2024-05-20T17:52:59.849 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T17:52:59.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T17:52:59.852 INFO:tasks.ceph.mds.b:Started 2024-05-20T17:52:59.852 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T17:52:59.852 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T17:52:59.854 INFO:tasks.ceph.mds.d:Started 2024-05-20T17:52:59.855 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-20T17:52:59.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:52:59.937 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:52:59.939 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:52:59.950 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T17:52:59.950 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T17:52:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.977+0000 7fc7e1b9d640 1 Processor -- start 2024-05-20T17:52:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.978+0000 7fc7e1b9d640 1 -- start start 2024-05-20T17:52:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e1b9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc7dc0b7f30 0x7fc7dc09ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e1b9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc09b1b0 0x7fc7dc0d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e1b9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7dc0d0c10 0x7fc7dc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e1b9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc7dc0d1560 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e1b9d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc7dc0cdf00 con 0x7fc7dc0b7f30 2024-05-20T17:52:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e139c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7dc0d0c10 0x7fc7dc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e139c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7dc0d0c10 0x7fc7dc0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55154/0 (socket says 172.21.15.6:55154) 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e139c640 1 -- 172.21.15.6:0/46659876 learned_addr learned my addr 172.21.15.6:0/46659876 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e1b9d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7dc0ce1e0 con 0x7fc7dc09b1b0 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e0b9b640 1 --2- 172.21.15.6:0/46659876 >> v2:172.21.15.171:3300/0 conn(0x7fc7dc0b7f30 0x7fc7dc09ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7dbfff640 1 --2- 172.21.15.6:0/46659876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc09b1b0 0x7fc7dc0d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e139c640 1 -- 172.21.15.6:0/46659876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc09b1b0 msgr2=0x7fc7dc0d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e139c640 1 --2- 172.21.15.6:0/46659876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc09b1b0 0x7fc7dc0d06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.979+0000 7fc7e139c640 1 -- 172.21.15.6:0/46659876 >> v2:172.21.15.171:3300/0 conn(0x7fc7dc0b7f30 msgr2=0x7fc7dc09ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.980+0000 7fc7e139c640 1 --2- 172.21.15.6:0/46659876 >> v2:172.21.15.171:3300/0 conn(0x7fc7dc0b7f30 0x7fc7dc09ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.980+0000 7fc7e139c640 1 -- 172.21.15.6:0/46659876 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc0ce4c0 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.980+0000 7fc7e139c640 1 --2- 172.21.15.6:0/46659876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0d1020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0735f0 tx=0x7fc7d402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c82e4a938dd4ed server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.980+0000 7fc7db7fe640 1 -- 172.21.15.6:0/46659876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4036070 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.980+0000 7fc7db7fe640 1 -- 172.21.15.6:0/46659876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d4031600 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.980+0000 7fc7db7fe640 1 -- 172.21.15.6:0/46659876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40319d0 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/46659876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 msgr2=0x7fc7dc0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/46659876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0d1020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0735f0 tx=0x7fc7d402a610 comp rx=0 tx=0).stop 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/46659876 shutdown_connections 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/46659876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0d1020 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/46659876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc09b1b0 0x7fc7dc0d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/46659876 >> v2:172.21.15.171:3300/0 conn(0x7fc7dc0b7f30 0x7fc7dc09ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/46659876 >> 172.21.15.6:0/46659876 conn(0x7fc7dc0b4350 msgr2=0x7fc7dc0b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/46659876 shutdown_connections 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.981+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/46659876 wait complete. 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.983+0000 7fc7e1b9d640 1 Processor -- start 2024-05-20T17:52:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.983+0000 7fc7e1b9d640 1 -- start start 2024-05-20T17:52:59.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e1b9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc09b1b0 0x7fc7dc1d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e1b9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc0b7f30 0x7fc7dc09f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e1b9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e1b9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc0b4090 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e1b9d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc0b3f10 con 0x7fc7dc09b1b0 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e1b9d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7dc0b37b0 con 0x7fc7dc0b7f30 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e0b9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc09b1b0 0x7fc7dc1d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55166/0 (socket says 172.21.15.6:55166) 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 -- 172.21.15.6:0/3899166977 learned_addr learned my addr 172.21.15.6:0/3899166977 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7dbfff640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc0b7f30 0x7fc7dc09f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 -- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc0b7f30 msgr2=0x7fc7dc09f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc0b7f30 0x7fc7dc09f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 -- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc09b1b0 msgr2=0x7fc7dc1d3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc09b1b0 0x7fc7dc1d3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 -- 172.21.15.6:0/3899166977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc09da20 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e0b9b640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc09b1b0 0x7fc7dc1d3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.985+0000 7fc7e139c640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0b68a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7d402ac00 tx=0x7fc7d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.986+0000 7fc7d97fa640 1 -- 172.21.15.6:0/3899166977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d403f020 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.986+0000 7fc7d97fa640 1 -- 172.21.15.6:0/3899166977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d4037040 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.986+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7dc09dd00 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.986+0000 7fc7d97fa640 1 -- 172.21.15.6:0/3899166977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4036070 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.986+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7dc09e2c0 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.987+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7dc075980 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.987+0000 7fc7d97fa640 1 -- 172.21.15.6:0/3899166977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7d4042020 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.988+0000 7fc7d97fa640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:52:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.988+0000 7fc7d97fa640 1 -- 172.21.15.6:0/3899166977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc7d40ab130 con 0x7fc7dc0d0c10 2024-05-20T17:52:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.988+0000 7fc7e0b9b640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:52:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.989+0000 7fc7e0b9b640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc06f890 tx=0x7fc7d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:52:59.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:52:59.993+0000 7fc7d97fa640 1 -- 172.21.15.6:0/3899166977 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc7d4049020 con 0x7fc7dc0d0c10 2024-05-20T17:53:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.175+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7dc09b700 con 0x7fc7dc0d0c10 2024-05-20T17:53:00.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.176+0000 7fc7d97fa640 1 -- 172.21.15.6:0/3899166977 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7fc7d4079750 con 0x7fc7dc0d0c10 2024-05-20T17:53:00.175 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:00.175 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:52:56.485615+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.178+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 msgr2=0x7fc7c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.178+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc06f890 tx=0x7fc7d0009190 comp rx=0 tx=0).stop 2024-05-20T17:53:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.178+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 msgr2=0x7fc7dc0b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.178+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0b68a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7d402ac00 tx=0x7fc7d4004a40 comp rx=0 tx=0).stop 2024-05-20T17:53:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.179+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 shutdown_connections 2024-05-20T17:53:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.179+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.179+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc0d0c10 0x7fc7dc0b68a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.179+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7dc0b7f30 0x7fc7dc09f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.179+0000 7fc7e1b9d640 1 --2- 172.21.15.6:0/3899166977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc09b1b0 0x7fc7dc1d3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.179+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 >> 172.21.15.6:0/3899166977 conn(0x7fc7dc0b4350 msgr2=0x7fc7dc071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.179+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 shutdown_connections 2024-05-20T17:53:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.179+0000 7fc7e1b9d640 1 -- 172.21.15.6:0/3899166977 wait complete. 2024-05-20T17:53:00.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:53:00.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:00.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.307+0000 7f0779eeb640 1 Processor -- start 2024-05-20T17:53:00.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.307+0000 7f0779eeb640 1 -- start start 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0779eeb640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f07740b4010 0x7f07740d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0779eeb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07740d14b0 0x7f07740d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0779eeb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07740d0370 con 0x7f0774163a10 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0779eeb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f07740d3ca0 con 0x7f07740d14b0 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0779eeb640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f07740d0650 con 0x7f07740b4010 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0773fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07740d14b0 0x7f07740d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0773fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07740d14b0 0x7f07740d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55168/0 (socket says 172.21.15.6:55168) 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f07737fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0774163a10 0x7f07740cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55198/0 (socket says 172.21.15.6:55198) 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0773fff640 1 -- 172.21.15.6:0/4264976820 learned_addr learned my addr 172.21.15.6:0/4264976820 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0772ffd640 1 --2- 172.21.15.6:0/4264976820 >> v2:172.21.15.171:3300/0 conn(0x7f07740b4010 0x7f07740d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0773fff640 1 -- 172.21.15.6:0/4264976820 >> v2:172.21.15.171:3300/0 conn(0x7f07740b4010 msgr2=0x7f07740d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0773fff640 1 --2- 172.21.15.6:0/4264976820 >> v2:172.21.15.171:3300/0 conn(0x7f07740b4010 0x7f07740d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0773fff640 1 -- 172.21.15.6:0/4264976820 >> v1:172.21.15.6:6789/0 conn(0x7f0774163a10 legacy=0x7f07740cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0773fff640 1 -- 172.21.15.6:0/4264976820 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07740d3650 con 0x7f07740d14b0 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f07727fc640 1 -- 172.21.15.6:0/4264976820 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099457948 0 0) 0x7f07740d0370 con 0x7f0774163a10 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.309+0000 7f0772ffd640 1 --2- 172.21.15.6:0/4264976820 >> v2:172.21.15.171:3300/0 conn(0x7f07740b4010 0x7f07740d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.310+0000 7f0773fff640 1 --2- 172.21.15.6:0/4264976820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07740d18c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07740b7f80 tx=0x7f076c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e23f9ec5f5797b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.310+0000 7f07727fc640 1 -- 172.21.15.6:0/4264976820 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c036070 con 0x7f07740d14b0 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.310+0000 7f07727fc640 1 -- 172.21.15.6:0/4264976820 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076c031600 con 0x7f07740d14b0 2024-05-20T17:53:00.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.310+0000 7f07727fc640 1 -- 172.21.15.6:0/4264976820 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c0319d0 con 0x7f07740d14b0 2024-05-20T17:53:00.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.311+0000 7f0779eeb640 1 -- 172.21.15.6:0/4264976820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 msgr2=0x7f07740d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.311+0000 7f0779eeb640 1 --2- 172.21.15.6:0/4264976820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07740d18c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07740b7f80 tx=0x7f076c02a730 comp rx=0 tx=0).stop 2024-05-20T17:53:00.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.311+0000 7f0779eeb640 1 -- 172.21.15.6:0/4264976820 shutdown_connections 2024-05-20T17:53:00.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.311+0000 7f0779eeb640 1 --2- 172.21.15.6:0/4264976820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07740d18c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.311+0000 7f0779eeb640 1 --2- 172.21.15.6:0/4264976820 >> v2:172.21.15.171:3300/0 conn(0x7f07740b4010 0x7f07740d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.311+0000 7f0779eeb640 1 -- 172.21.15.6:0/4264976820 >> 172.21.15.6:0/4264976820 conn(0x7f077406d240 msgr2=0x7f077406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:00.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.311+0000 7f0779eeb640 1 -- 172.21.15.6:0/4264976820 shutdown_connections 2024-05-20T17:53:00.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.311+0000 7f0779eeb640 1 -- 172.21.15.6:0/4264976820 wait complete. 2024-05-20T17:53:00.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.313+0000 7f0779eeb640 1 Processor -- start 2024-05-20T17:53:00.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.313+0000 7f0779eeb640 1 -- start start 2024-05-20T17:53:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0779eeb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07740b4010 0x7f0774158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0779eeb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07741f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0779eeb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0774163a10 0x7f07741f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0779eeb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07740b8210 con 0x7f07740d14b0 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0779eeb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f07740d1e00 con 0x7f0774163a10 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0779eeb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f07740b8390 con 0x7f07740b4010 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0772ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07741f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0772ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07741f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55174/0 (socket says 172.21.15.6:55174) 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.314+0000 7f0772ffd640 1 -- 172.21.15.6:0/1924936496 learned_addr learned my addr 172.21.15.6:0/1924936496 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f07737fe640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07740b4010 0x7f0774158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0773fff640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0774163a10 0x7f07741f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0772ffd640 1 -- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07740b4010 msgr2=0x7f0774158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0772ffd640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07740b4010 0x7f0774158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0772ffd640 1 -- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0774163a10 msgr2=0x7f07741f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0772ffd640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0774163a10 0x7f07741f9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0772ffd640 1 -- 172.21.15.6:0/1924936496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07741f5760 con 0x7f07740d14b0 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0772ffd640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07741f8d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f076800d800 tx=0x7f076800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f075bfff640 1 -- 172.21.15.6:0/1924936496 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0768004030 con 0x7f07740d14b0 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f075bfff640 1 -- 172.21.15.6:0/1924936496 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07680041d0 con 0x7f07740d14b0 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07741588a0 con 0x7f07740d14b0 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f075bfff640 1 -- 172.21.15.6:0/1924936496 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07680096a0 con 0x7f07740d14b0 2024-05-20T17:53:00.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.315+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07740b4830 con 0x7f07740d14b0 2024-05-20T17:53:00.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.316+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07740b4620 con 0x7f07740d14b0 2024-05-20T17:53:00.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.317+0000 7f075bfff640 1 -- 172.21.15.6:0/1924936496 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0768009840 con 0x7f07740d14b0 2024-05-20T17:53:00.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.317+0000 7f075bfff640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f076006be30 0x7f076006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.317+0000 7f075bfff640 1 -- 172.21.15.6:0/1924936496 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f076808ac50 con 0x7f07740d14b0 2024-05-20T17:53:00.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.317+0000 7f07737fe640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f076006be30 0x7f076006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.318+0000 7f07737fe640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f076006be30 0x7f076006e340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0764007fd0 tx=0x7f0764007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:00.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.322+0000 7f075bfff640 1 -- 172.21.15.6:0/1924936496 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0768090020 con 0x7f07740d14b0 2024-05-20T17:53:00.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.506+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0774158b40 con 0x7f07740d14b0 2024-05-20T17:53:00.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.507+0000 7f075bfff640 1 -- 172.21.15.6:0/1924936496 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f0768059300 con 0x7f07740d14b0 2024-05-20T17:53:00.505 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:00.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f076006be30 msgr2=0x7f076006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f076006be30 0x7f076006e340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0764007fd0 tx=0x7f0764007de0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 msgr2=0x7f07741f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07741f8d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f076800d800 tx=0x7f076800dcc0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 shutdown_connections 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f076006be30 0x7f076006e340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0774163a10 0x7f07741f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07740d14b0 0x7f07741f8d10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 --2- 172.21.15.6:0/1924936496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07740b4010 0x7f0774158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 >> 172.21.15.6:0/1924936496 conn(0x7f077406d240 msgr2=0x7f077415fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 shutdown_connections 2024-05-20T17:53:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.509+0000 7f0779eeb640 1 -- 172.21.15.6:0/1924936496 wait complete. 2024-05-20T17:53:00.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:53:00.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.634+0000 7f110be26640 1 Processor -- start 2024-05-20T17:53:00.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.634+0000 7f110be26640 1 -- start start 2024-05-20T17:53:00.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f110be26640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1104156690 0x7f110415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f110be26640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11040d1610 0x7f11040d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f110be26640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110406d890 con 0x7f110409a4f0 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f110be26640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f11040b29b0 con 0x7f11040d1610 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f110be26640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f11040b1910 con 0x7f1104156690 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f11093c1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11040d1610 0x7f11040d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f110a3c3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f110409a4f0 0x7f110409a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55206/0 (socket says 172.21.15.6:55206) 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f11093c1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f11040d1610 0x7f11040d1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55176/0 (socket says 172.21.15.6:55176) 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.635+0000 7f110a3c3640 1 -- 172.21.15.6:0/602459982 learned_addr learned my addr 172.21.15.6:0/602459982 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.636+0000 7f1109bc2640 1 --2- 172.21.15.6:0/602459982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1104156690 0x7f110415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.636+0000 7f11093c1640 1 -- 172.21.15.6:0/602459982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1104156690 msgr2=0x7f110415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.636+0000 7f11093c1640 1 --2- 172.21.15.6:0/602459982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1104156690 0x7f110415cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.636+0000 7f11093c1640 1 -- 172.21.15.6:0/602459982 >> v1:172.21.15.6:6789/0 conn(0x7f110409a4f0 legacy=0x7f110409a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.636+0000 7f11093c1640 1 -- 172.21.15.6:0/602459982 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11040b1bf0 con 0x7f11040d1610 2024-05-20T17:53:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.636+0000 7f1108bc0640 1 -- 172.21.15.6:0/602459982 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615441496 0 0) 0x7f110406d890 con 0x7f110409a4f0 2024-05-20T17:53:00.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f11093c1640 1 --2- 172.21.15.6:0/602459982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11040d1610 0x7f11040d1a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009790 tx=0x7f10f402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb48a04ecd1cccd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f1108bc0640 1 -- 172.21.15.6:0/602459982 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4037070 con 0x7f11040d1610 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f1108bc0640 1 -- 172.21.15.6:0/602459982 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f402adb0 con 0x7f11040d1610 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f1108bc0640 1 -- 172.21.15.6:0/602459982 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4032660 con 0x7f11040d1610 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f110be26640 1 -- 172.21.15.6:0/602459982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11040d1610 msgr2=0x7f11040d1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f110be26640 1 --2- 172.21.15.6:0/602459982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11040d1610 0x7f11040d1a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009790 tx=0x7f10f402a060 comp rx=0 tx=0).stop 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f110be26640 1 -- 172.21.15.6:0/602459982 shutdown_connections 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f110be26640 1 --2- 172.21.15.6:0/602459982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11040d1610 0x7f11040d1a20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f110be26640 1 --2- 172.21.15.6:0/602459982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1104156690 0x7f110415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.637+0000 7f110be26640 1 -- 172.21.15.6:0/602459982 >> 172.21.15.6:0/602459982 conn(0x7f11040b6670 msgr2=0x7f11040b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.638+0000 7f110be26640 1 -- 172.21.15.6:0/602459982 shutdown_connections 2024-05-20T17:53:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.638+0000 7f110be26640 1 -- 172.21.15.6:0/602459982 wait complete. 2024-05-20T17:53:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.639+0000 7f110be26640 1 Processor -- start 2024-05-20T17:53:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.639+0000 7f110be26640 1 -- start start 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f110be26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110409a4f0 0x7f1104148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f110be26640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11040d1610 0x7f110409c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f110be26640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1104156690 0x7f11041f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f110be26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f11040b2490 con 0x7f110409a4f0 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f110be26640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f11040b21b0 con 0x7f1104156690 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f110be26640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f11040d1f60 con 0x7f11040d1610 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110409a4f0 0x7f1104148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110409a4f0 0x7f1104148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55178/0 (socket says 172.21.15.6:55178) 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 -- 172.21.15.6:0/494456851 learned_addr learned my addr 172.21.15.6:0/494456851 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f11093c1640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11040d1610 0x7f110409c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 -- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11040d1610 msgr2=0x7f110409c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11040d1610 0x7f110409c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 -- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1104156690 msgr2=0x7f11041f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1104156690 0x7f11041f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 -- 172.21.15.6:0/494456851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110409ebb0 con 0x7f110409a4f0 2024-05-20T17:53:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f1109bc2640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110409a4f0 0x7f1104148f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f110000d5a0 tx=0x7f110000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.641+0000 7f10fa7fc640 1 -- 172.21.15.6:0/494456851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100004440 con 0x7f110409a4f0 2024-05-20T17:53:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.642+0000 7f10fa7fc640 1 -- 172.21.15.6:0/494456851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1100017070 con 0x7f110409a4f0 2024-05-20T17:53:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.642+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f110409be10 con 0x7f110409a4f0 2024-05-20T17:53:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.642+0000 7f10fa7fc640 1 -- 172.21.15.6:0/494456851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100003830 con 0x7f110409a4f0 2024-05-20T17:53:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.642+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f110409f130 con 0x7f110409a4f0 2024-05-20T17:53:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.643+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1104075b00 con 0x7f110409a4f0 2024-05-20T17:53:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.643+0000 7f10fa7fc640 1 -- 172.21.15.6:0/494456851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11000039d0 con 0x7f110409a4f0 2024-05-20T17:53:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.644+0000 7f10fa7fc640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10e806be30 0x7f10e806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.644+0000 7f10fa7fc640 1 -- 172.21.15.6:0/494456851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f110008cb20 con 0x7f110409a4f0 2024-05-20T17:53:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.644+0000 7f11093c1640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10e806be30 0x7f10e806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.644+0000 7f11093c1640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10e806be30 0x7f10e806e340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10f4034000 tx=0x7f10f402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:00.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.648+0000 7f10fa7fc640 1 -- 172.21.15.6:0/494456851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f110005b0c0 con 0x7f110409a4f0 2024-05-20T17:53:00.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.870+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11040b1160 con 0x7f110409a4f0 2024-05-20T17:53:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.870+0000 7f10fa7fc640 1 -- 172.21.15.6:0/494456851 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f110005f3c0 con 0x7f110409a4f0 2024-05-20T17:53:00.869 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:00.869 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-20T17:53:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10e806be30 msgr2=0x7f10e806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10e806be30 0x7f10e806e340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f10f4034000 tx=0x7f10f402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110409a4f0 msgr2=0x7f1104148f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110409a4f0 0x7f1104148f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f110000d5a0 tx=0x7f110000da60 comp rx=0 tx=0).stop 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 shutdown_connections 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10e806be30 0x7f10e806e340 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1104156690 0x7f11041f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11040d1610 0x7f110409c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 --2- 172.21.15.6:0/494456851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110409a4f0 0x7f1104148f00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 >> 172.21.15.6:0/494456851 conn(0x7f11040b6670 msgr2=0x7f11040702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 shutdown_connections 2024-05-20T17:53:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:00.872+0000 7f110be26640 1 -- 172.21.15.6:0/494456851 wait complete. 2024-05-20T17:53:02.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:53:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.014+0000 7f35f633e640 1 Processor -- start 2024-05-20T17:53:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.014+0000 7f35f633e640 1 -- start start 2024-05-20T17:53:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.015+0000 7f35f633e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35f00cfae0 0x7f35f016a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.015+0000 7f35f633e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f006d0f0 con 0x7f35f015f220 2024-05-20T17:53:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.015+0000 7f35f633e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f006d3d0 con 0x7f35f00cd680 2024-05-20T17:53:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.015+0000 7f35f633e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f35f00cda90 con 0x7f35f00cfae0 2024-05-20T17:53:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.015+0000 7f35f48db640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35f00cfae0 0x7f35f016a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.015+0000 7f35ef7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f35f015f220 0x7f35f00cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55214/0 (socket says 172.21.15.6:55214) 2024-05-20T17:53:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.015+0000 7f35ef7fe640 1 -- 172.21.15.6:0/934835671 learned_addr learned my addr 172.21.15.6:0/934835671 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.016+0000 7f35f48db640 1 -- 172.21.15.6:0/934835671 >> v1:172.21.15.171:6789/0 conn(0x7f35f00cd680 legacy=0x7f35f006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.016+0000 7f35f48db640 1 -- 172.21.15.6:0/934835671 >> v1:172.21.15.6:6789/0 conn(0x7f35f015f220 legacy=0x7f35f00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.016+0000 7f35f48db640 1 -- 172.21.15.6:0/934835671 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f006d6b0 con 0x7f35f00cfae0 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.016+0000 7f35f48db640 1 --2- 172.21.15.6:0/934835671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f00cfae0 0x7f35f016a210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009d90 tx=0x7f35e802a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc554927b519be00 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35eeffd640 1 -- 172.21.15.6:0/934835671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8007740 con 0x7f35f00cfae0 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35eeffd640 1 -- 172.21.15.6:0/934835671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e80078e0 con 0x7f35f00cfae0 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35eeffd640 1 -- 172.21.15.6:0/934835671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8007cb0 con 0x7f35f00cfae0 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35f633e640 1 -- 172.21.15.6:0/934835671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f00cfae0 msgr2=0x7f35f016a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35f633e640 1 --2- 172.21.15.6:0/934835671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f00cfae0 0x7f35f016a210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009d90 tx=0x7f35e802a580 comp rx=0 tx=0).stop 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35f633e640 1 -- 172.21.15.6:0/934835671 shutdown_connections 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35f633e640 1 --2- 172.21.15.6:0/934835671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f00cfae0 0x7f35f016a210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35f633e640 1 -- 172.21.15.6:0/934835671 >> 172.21.15.6:0/934835671 conn(0x7f35f00b44d0 msgr2=0x7f35f00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35f633e640 1 -- 172.21.15.6:0/934835671 shutdown_connections 2024-05-20T17:53:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.017+0000 7f35f633e640 1 -- 172.21.15.6:0/934835671 wait complete. 2024-05-20T17:53:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.019+0000 7f35f633e640 1 Processor -- start 2024-05-20T17:53:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.019+0000 7f35f633e640 1 -- start start 2024-05-20T17:53:03.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35f633e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35f00cd680 0x7f35f00b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35f633e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f015f220 0x7f35f00c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35f633e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35f00c85b0 0x7f35f015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35f633e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35f006cdd0 con 0x7f35f015f220 2024-05-20T17:53:03.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35f633e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35f006da10 con 0x7f35f00c85b0 2024-05-20T17:53:03.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35f633e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f35f015f630 con 0x7f35f00cd680 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f015f220 0x7f35f00c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f015f220 0x7f35f00c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55196/0 (socket says 172.21.15.6:55196) 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 -- 172.21.15.6:0/1780933668 learned_addr learned my addr 172.21.15.6:0/1780933668 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35f48db640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35f00c85b0 0x7f35f015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35effff640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35f00cd680 0x7f35f00b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 -- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35f00cd680 msgr2=0x7f35f00b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35f00cd680 0x7f35f00b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 -- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35f00c85b0 msgr2=0x7f35f015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35f00c85b0 0x7f35f015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 -- 172.21.15.6:0/1780933668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f01606a0 con 0x7f35f015f220 2024-05-20T17:53:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35effff640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35f00cd680 0x7f35f00b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:03.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35f48db640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35f00c85b0 0x7f35f015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:03.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.021+0000 7f35ef7fe640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f015f220 0x7f35f00c8070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c3f0 tx=0x7f35e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.022+0000 7f35ecff9640 1 -- 172.21.15.6:0/1780933668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4017070 con 0x7f35f015f220 2024-05-20T17:53:03.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.022+0000 7f35ecff9640 1 -- 172.21.15.6:0/1780933668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e4005ce0 con 0x7f35f015f220 2024-05-20T17:53:03.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.022+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f0160980 con 0x7f35f015f220 2024-05-20T17:53:03.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.022+0000 7f35ecff9640 1 -- 172.21.15.6:0/1780933668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e40072f0 con 0x7f35f015f220 2024-05-20T17:53:03.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.022+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f0160f40 con 0x7f35f015f220 2024-05-20T17:53:03.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.023+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f0075b00 con 0x7f35f015f220 2024-05-20T17:53:03.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.023+0000 7f35ecff9640 1 -- 172.21.15.6:0/1780933668 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35e401a070 con 0x7f35f015f220 2024-05-20T17:53:03.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.024+0000 7f35ecff9640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35dc06be30 0x7f35dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.024+0000 7f35ecff9640 1 -- 172.21.15.6:0/1780933668 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f35e4089f40 con 0x7f35f015f220 2024-05-20T17:53:03.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.024+0000 7f35effff640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35dc06be30 0x7f35dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.024+0000 7f35effff640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35dc06be30 0x7f35dc06e340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35f00b1cd0 tx=0x7f35e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.028+0000 7f35ecff9640 1 -- 172.21.15.6:0/1780933668 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f35e4058bb0 con 0x7f35f015f220 2024-05-20T17:53:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.254+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35f0068a90 con 0x7f35f015f220 2024-05-20T17:53:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.254+0000 7f35ecff9640 1 -- 172.21.15.6:0/1780933668 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3861 (secure 0 0 0) 0x7f35e40584b0 con 0x7f35f015f220 2024-05-20T17:53:03.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:03.253 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-20T17:53:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2024-05-20T17:53:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35dc06be30 msgr2=0x7f35dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35dc06be30 0x7f35dc06e340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35f00b1cd0 tx=0x7f35e0008040 comp rx=0 tx=0).stop 2024-05-20T17:53:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f015f220 msgr2=0x7f35f00c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f015f220 0x7f35f00c8070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c3f0 tx=0x7f35e400c8b0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 shutdown_connections 2024-05-20T17:53:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35dc06be30 0x7f35dc06e340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35f00c85b0 0x7f35f015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35f015f220 0x7f35f00c8070 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 --2- 172.21.15.6:0/1780933668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35f00cd680 0x7f35f00b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 >> 172.21.15.6:0/1780933668 conn(0x7f35f00b44d0 msgr2=0x7f35f00ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 shutdown_connections 2024-05-20T17:53:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.256+0000 7f35f633e640 1 -- 172.21.15.6:0/1780933668 wait complete. 2024-05-20T17:53:03.266 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:03.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.382+0000 7f7e8b437640 1 Processor -- start 2024-05-20T17:53:03.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.382+0000 7f7e8b437640 1 -- start start 2024-05-20T17:53:03.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e8b437640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e8415d5f0 0x7f7e841576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e8b437640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8406b900 con 0x7f7e8406c9a0 2024-05-20T17:53:03.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e8b437640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e8406bbe0 con 0x7f7e840cedd0 2024-05-20T17:53:03.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e8b437640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8406bec0 con 0x7f7e8415d5f0 2024-05-20T17:53:03.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e889d2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7e8406c9a0 0x7f7e840ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55222/0 (socket says 172.21.15.6:55222) 2024-05-20T17:53:03.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e889d2640 1 -- 172.21.15.6:0/941039085 learned_addr learned my addr 172.21.15.6:0/941039085 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e891d3640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e8415d5f0 0x7f7e841576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357531219 0 0) 0x7f7e8406b900 con 0x7f7e8406c9a0 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e70003520 con 0x7f7e8406c9a0 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3019975274 0 0) 0x7f7e70003520 con 0x7f7e8406c9a0 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e8415d5f0 msgr2=0x7f7e841576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e8415d5f0 0x7f7e841576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 >> v1:172.21.15.171:6789/0 conn(0x7f7e840cedd0 legacy=0x7f7e8406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8406c1a0 con 0x7f7e8406c9a0 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f7e74001670 con 0x7f7e8406c9a0 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 >> v1:172.21.15.6:6789/0 conn(0x7f7e8406c9a0 legacy=0x7f7e840ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e8415d5f0 0x7f7e700039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e70003f60 0x7f7e70004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e70005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8406bec0 con 0x7f7e70004d40 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7000bc00 con 0x7f7e70003f60 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7000be00 con 0x7f7e8415d5f0 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.384+0000 7f7e899d4640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e70005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.385+0000 7f7e891d3640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e8415d5f0 0x7f7e700039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.385+0000 7f7e889d2640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e70003f60 0x7f7e70004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.385+0000 7f7e899d4640 1 -- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e8415d5f0 msgr2=0x7f7e700039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.385+0000 7f7e899d4640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e8415d5f0 0x7f7e700039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.385+0000 7f7e899d4640 1 -- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e70003f60 msgr2=0x7f7e70004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.385+0000 7f7e899d4640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e70003f60 0x7f7e70004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.385+0000 7f7e899d4640 1 -- 172.21.15.6:0/941039085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e70003520 con 0x7f7e70004d40 2024-05-20T17:53:03.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e899d4640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e70005150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c001e20 tx=0x7f7e70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907b5b3a6359ae28 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c001a70 con 0x7f7e70004d40 2024-05-20T17:53:03.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7c02ae40 con 0x7f7e70004d40 2024-05-20T17:53:03.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e7bfff640 1 -- 172.21.15.6:0/941039085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c003bb0 con 0x7f7e70004d40 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e8b437640 1 -- 172.21.15.6:0/941039085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 msgr2=0x7f7e70005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e8b437640 1 --2- 172.21.15.6:0/941039085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e70005150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c001e20 tx=0x7f7e70005830 comp rx=0 tx=0).stop 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e899d4640 1 -- 172.21.15.6:0/941039085 reap_dead start 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e8b437640 1 -- 172.21.15.6:0/941039085 shutdown_connections 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.386+0000 7f7e8b437640 1 -- 172.21.15.6:0/941039085 >> 172.21.15.6:0/941039085 conn(0x7f7e840cd2a0 msgr2=0x7f7e840cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.387+0000 7f7e8b437640 1 -- 172.21.15.6:0/941039085 shutdown_connections 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.387+0000 7f7e8b437640 1 -- 172.21.15.6:0/941039085 wait complete. 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.388+0000 7f7e8b437640 1 Processor -- start 2024-05-20T17:53:03.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.388+0000 7f7e8b437640 1 -- start start 2024-05-20T17:53:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e8b437640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e840b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e8b437640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e84149e60 0x7f7e84151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e8b437640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e840aec70 0x7f7e840af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e8b437640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7e840cf1e0 con 0x7f7e70004d40 2024-05-20T17:53:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e8b437640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8406cdb0 con 0x7f7e84149e60 2024-05-20T17:53:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e8b437640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8406b520 con 0x7f7e840aec70 2024-05-20T17:53:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e840b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e840b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55226/0 (socket says 172.21.15.6:55226) 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 -- 172.21.15.6:0/3094673724 learned_addr learned my addr 172.21.15.6:0/3094673724 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 -- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e840aec70 msgr2=0x7f7e840af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e840aec70 0x7f7e840af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 -- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e84149e60 msgr2=0x7f7e84151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e889d2640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e84149e60 0x7f7e84151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e84149e60 0x7f7e84151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 -- 172.21.15.6:0/3094673724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e840af5c0 con 0x7f7e70004d40 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e891d3640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e840b4f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e80011890 tx=0x7f7e80011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e79ffb640 1 -- 172.21.15.6:0/3094673724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000f9d0 con 0x7f7e70004d40 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e79ffb640 1 -- 172.21.15.6:0/3094673724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8000fb70 con 0x7f7e70004d40 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8414a5d0 con 0x7f7e70004d40 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.390+0000 7f7e79ffb640 1 -- 172.21.15.6:0/3094673724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80014440 con 0x7f7e70004d40 2024-05-20T17:53:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.391+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8414ab90 con 0x7f7e70004d40 2024-05-20T17:53:03.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.392+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e84075b00 con 0x7f7e70004d40 2024-05-20T17:53:03.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.392+0000 7f7e79ffb640 1 -- 172.21.15.6:0/3094673724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e80012040 con 0x7f7e70004d40 2024-05-20T17:53:03.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.393+0000 7f7e79ffb640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e6806be60 0x7f7e6806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.393+0000 7f7e79ffb640 1 -- 172.21.15.6:0/3094673724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7e8008b050 con 0x7f7e70004d40 2024-05-20T17:53:03.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.393+0000 7f7e889d2640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e6806be60 0x7f7e6806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.393+0000 7f7e889d2640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e6806be60 0x7f7e6806e370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e8415c860 tx=0x7f7e74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.397+0000 7f7e79ffb640 1 -- 172.21.15.6:0/3094673724 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7e840af5c0 con 0x7f7e70004d40 2024-05-20T17:53:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.581+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e84152d10 con 0x7f7e70004d40 2024-05-20T17:53:03.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.582+0000 7f7e79ffb640 1 -- 172.21.15.6:0/3094673724 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7f7e80019030 con 0x7f7e70004d40 2024-05-20T17:53:03.581 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:03.581 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:52:56.485615+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e6806be60 msgr2=0x7f7e6806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e6806be60 0x7f7e6806e370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e8415c860 tx=0x7f7e74009040 comp rx=0 tx=0).stop 2024-05-20T17:53:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 msgr2=0x7f7e840b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e840b4f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e80011890 tx=0x7f7e80011d50 comp rx=0 tx=0).stop 2024-05-20T17:53:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 shutdown_connections 2024-05-20T17:53:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e6806be60 0x7f7e6806e370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e840aec70 0x7f7e840af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e84149e60 0x7f7e84151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 --2- 172.21.15.6:0/3094673724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e70004d40 0x7f7e840b4f70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 >> 172.21.15.6:0/3094673724 conn(0x7f7e840cd2a0 msgr2=0x7f7e840ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 shutdown_connections 2024-05-20T17:53:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.584+0000 7f7e8b437640 1 -- 172.21.15.6:0/3094673724 wait complete. 2024-05-20T17:53:03.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:53:03.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:03.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.713+0000 7fb603661640 1 Processor -- start 2024-05-20T17:53:03.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.713+0000 7fb603661640 1 -- start start 2024-05-20T17:53:03.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.714+0000 7fb603661640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5fc0d10e0 0x7fb5fc0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.714+0000 7fb603661640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb5fc0d14f0 0x7fb5fc0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.714+0000 7fb603661640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.714+0000 7fb603661640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb5fc0d1ac0 con 0x7fb5fc0d10e0 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.714+0000 7fb603661640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb5fc0d1da0 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.714+0000 7fb603661640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc0d2080 con 0x7fb5fc0cd4d0 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb6013fd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5fc0d10e0 0x7fb5fc0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb6013fd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5fc0d10e0 0x7fb5fc0cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55240/0 (socket says 172.21.15.6:55240) 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb6013fd640 1 -- 172.21.15.6:0/4061475249 learned_addr learned my addr 172.21.15.6:0/4061475249 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb601bfe640 1 --2- 172.21.15.6:0/4061475249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb600bfc640 1 --2- 172.21.15.6:0/4061475249 >> v2:172.21.15.171:3300/0 conn(0x7fb5fc0d14f0 0x7fb5fc0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb6013fd640 1 -- 172.21.15.6:0/4061475249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 msgr2=0x7fb5fc0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:03.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb6013fd640 1 --2- 172.21.15.6:0/4061475249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb6013fd640 1 -- 172.21.15.6:0/4061475249 >> v2:172.21.15.171:3300/0 conn(0x7fb5fc0d14f0 msgr2=0x7fb5fc0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:03.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb6013fd640 1 --2- 172.21.15.6:0/4061475249 >> v2:172.21.15.171:3300/0 conn(0x7fb5fc0d14f0 0x7fb5fc0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.715+0000 7fb6013fd640 1 -- 172.21.15.6:0/4061475249 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc0d2360 con 0x7fb5fc0d10e0 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.716+0000 7fb6013fd640 1 --2- 172.21.15.6:0/4061475249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d10e0 0x7fb5fc0cf140 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc08bee0 tx=0x7fb5f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b162d9fedf7e57 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.716+0000 7fb5f3fff640 1 -- 172.21.15.6:0/4061475249 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8037070 con 0x7fb5fc0d10e0 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.716+0000 7fb5f3fff640 1 -- 172.21.15.6:0/4061475249 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8032440 con 0x7fb5fc0d10e0 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.716+0000 7fb5f3fff640 1 -- 172.21.15.6:0/4061475249 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8032810 con 0x7fb5fc0d10e0 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 -- 172.21.15.6:0/4061475249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d10e0 msgr2=0x7fb5fc0cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 --2- 172.21.15.6:0/4061475249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d10e0 0x7fb5fc0cf140 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc08bee0 tx=0x7fb5f802a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 -- 172.21.15.6:0/4061475249 shutdown_connections 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 --2- 172.21.15.6:0/4061475249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 --2- 172.21.15.6:0/4061475249 >> v2:172.21.15.171:3300/0 conn(0x7fb5fc0d14f0 0x7fb5fc0cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 --2- 172.21.15.6:0/4061475249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d10e0 0x7fb5fc0cf140 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 -- 172.21.15.6:0/4061475249 >> 172.21.15.6:0/4061475249 conn(0x7fb5fc0b44d0 msgr2=0x7fb5fc0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 -- 172.21.15.6:0/4061475249 shutdown_connections 2024-05-20T17:53:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.717+0000 7fb603661640 1 -- 172.21.15.6:0/4061475249 wait complete. 2024-05-20T17:53:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.719+0000 7fb603661640 1 Processor -- start 2024-05-20T17:53:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.719+0000 7fb603661640 1 -- start start 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb603661640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb603661640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5fc0d10e0 0x7fb5fc1f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb603661640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d14f0 0x7fb5fc0c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb603661640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0b8440 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb603661640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc0b82c0 con 0x7fb5fc0d10e0 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb603661640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc0709f0 con 0x7fb5fc0cd4d0 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb601bfe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d14f0 0x7fb5fc0c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb601bfe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d14f0 0x7fb5fc0c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55254/0 (socket says 172.21.15.6:55254) 2024-05-20T17:53:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb601bfe640 1 -- 172.21.15.6:0/1805994756 learned_addr learned my addr 172.21.15.6:0/1805994756 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb6013fd640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb600bfc640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5fc0d10e0 0x7fb5fc1f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb601bfe640 1 -- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 msgr2=0x7fb5fc0cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb601bfe640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb601bfe640 1 -- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5fc0d10e0 msgr2=0x7fb5fc1f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb601bfe640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5fc0d10e0 0x7fb5fc1f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb601bfe640 1 -- 172.21.15.6:0/1805994756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc0cc6c0 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.720+0000 7fb6013fd640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.721+0000 7fb601bfe640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d14f0 0x7fb5fc0c88a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400efc0 tx=0x7fb5f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.721+0000 7fb5f1ffb640 1 -- 172.21.15.6:0/1805994756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4018020 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.721+0000 7fb5f1ffb640 1 -- 172.21.15.6:0/1805994756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f4014480 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.721+0000 7fb5f1ffb640 1 -- 172.21.15.6:0/1805994756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4009e60 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.721+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc1f7800 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.721+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc14b9f0 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.722+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5fc075b00 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.723+0000 7fb5f1ffb640 1 -- 172.21.15.6:0/1805994756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5f4005d10 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.723+0000 7fb5f1ffb640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5e006be60 0x7fb5e006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.723+0000 7fb5f1ffb640 1 -- 172.21.15.6:0/1805994756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb5f408b7d0 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.723+0000 7fb6013fd640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5e006be60 0x7fb5e006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.724+0000 7fb6013fd640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5e006be60 0x7fb5e006e370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8034000 tx=0x7fb5f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.728+0000 7fb5f1ffb640 1 -- 172.21.15.6:0/1805994756 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb5f4022030 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.913+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb5fc0b7230 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.914+0000 7fb5f1ffb640 1 -- 172.21.15.6:0/1805994756 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fb5fc0cc6c0 con 0x7fb5fc0d14f0 2024-05-20T17:53:03.912 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:03.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.915+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5e006be60 msgr2=0x7fb5e006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.915+0000 7fb603661640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5e006be60 0x7fb5e006e370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8034000 tx=0x7fb5f802e000 comp rx=0 tx=0).stop 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.915+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d14f0 msgr2=0x7fb5fc0c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.915+0000 7fb603661640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d14f0 0x7fb5fc0c88a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400efc0 tx=0x7fb5f400c490 comp rx=0 tx=0).stop 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.916+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 shutdown_connections 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.916+0000 7fb603661640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5e006be60 0x7fb5e006e370 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.916+0000 7fb603661640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5fc0d14f0 0x7fb5fc0c88a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.916+0000 7fb603661640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5fc0d10e0 0x7fb5fc1f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.916+0000 7fb603661640 1 --2- 172.21.15.6:0/1805994756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5fc0cd4d0 0x7fb5fc0cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.916+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 >> 172.21.15.6:0/1805994756 conn(0x7fb5fc0b44d0 msgr2=0x7fb5fc0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.916+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 shutdown_connections 2024-05-20T17:53:03.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:03.916+0000 7fb603661640 1 -- 172.21.15.6:0/1805994756 wait complete. 2024-05-20T17:53:03.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T17:53:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.041+0000 7fbcd9632640 1 Processor -- start 2024-05-20T17:53:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.041+0000 7fbcd9632640 1 -- start start 2024-05-20T17:53:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.042+0000 7fbcd9632640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbcd40d1bc0 0x7fbcd40d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.042+0000 7fbcd9632640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd40d0370 con 0x7fbcd4163a10 2024-05-20T17:53:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.042+0000 7fbcd9632640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd40d0650 con 0x7fbcd40b4010 2024-05-20T17:53:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.042+0000 7fbcd9632640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd40d3ca0 con 0x7fbcd40d1bc0 2024-05-20T17:53:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbcd4163a10 0x7fbcd40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55236/0 (socket says 172.21.15.6:55236) 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd2ffd640 1 -- 172.21.15.6:0/4181719850 learned_addr learned my addr 172.21.15.6:0/4181719850 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd37fe640 1 --2- 172.21.15.6:0/4181719850 >> v2:172.21.15.171:3300/0 conn(0x7fbcd40d1bc0 0x7fbcd40d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029384233 0 0) 0x7fbcd40d0370 con 0x7fbcd4163a10 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcbc003520 con 0x7fbcd4163a10 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2796428904 0 0) 0x7fbcbc003520 con 0x7fbcd4163a10 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 >> v2:172.21.15.171:3300/0 conn(0x7fbcd40d1bc0 msgr2=0x7fbcd40d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 --2- 172.21.15.6:0/4181719850 >> v2:172.21.15.171:3300/0 conn(0x7fbcd40d1bc0 0x7fbcd40d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 >> v1:172.21.15.171:6789/0 conn(0x7fbcd40b4010 legacy=0x7fbcd40d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd40d3650 con 0x7fbcd4163a10 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fbcc4001670 con 0x7fbcd4163a10 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 >> v1:172.21.15.6:6789/0 conn(0x7fbcd4163a10 legacy=0x7fbcd40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcbc0039b0 0x7fbcbc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc005150 0x7fbcbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40d3ca0 con 0x7fbcbc004800 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc00c0c0 con 0x7fbcbc0039b0 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbcbc00c2c0 con 0x7fbcbc005150 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd27fc640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.043+0000 7fbcd2ffd640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcbc0039b0 0x7fbcbc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.044+0000 7fbcd37fe640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc005150 0x7fbcbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.044+0000 7fbcd27fc640 1 -- 172.21.15.6:0/4181719850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc005150 msgr2=0x7fbcbc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.044+0000 7fbcd27fc640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc005150 0x7fbcbc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.044+0000 7fbcd27fc640 1 -- 172.21.15.6:0/4181719850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcbc0039b0 msgr2=0x7fbcbc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.044+0000 7fbcd27fc640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcbc0039b0 0x7fbcbc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.044+0000 7fbcd27fc640 1 -- 172.21.15.6:0/4181719850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc003520 con 0x7fbcbc004800 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.044+0000 7fbcd37fe640 1 -- 172.21.15.6:0/4181719850 reap_dead start 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.044+0000 7fbcd27fc640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8001860 tx=0x7fbcbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0e02b4d372e7e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.045+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8037070 con 0x7fbcbc004800 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.045+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc802abe0 con 0x7fbcbc004800 2024-05-20T17:53:04.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.045+0000 7fbcd1ffb640 1 -- 172.21.15.6:0/4181719850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8001430 con 0x7fbcbc004800 2024-05-20T17:53:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.045+0000 7fbcd9632640 1 -- 172.21.15.6:0/4181719850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcbc004800 msgr2=0x7fbcbc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.045+0000 7fbcd9632640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8001860 tx=0x7fbcbc005830 comp rx=0 tx=0).stop 2024-05-20T17:53:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.045+0000 7fbcd9632640 1 -- 172.21.15.6:0/4181719850 shutdown_connections 2024-05-20T17:53:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.045+0000 7fbcd9632640 1 --2- 172.21.15.6:0/4181719850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcbc004800 0x7fbcbc004c10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.045+0000 7fbcd9632640 1 -- 172.21.15.6:0/4181719850 >> 172.21.15.6:0/4181719850 conn(0x7fbcd406d240 msgr2=0x7fbcd406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.046+0000 7fbcd9632640 1 -- 172.21.15.6:0/4181719850 shutdown_connections 2024-05-20T17:53:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.046+0000 7fbcd9632640 1 -- 172.21.15.6:0/4181719850 wait complete. 2024-05-20T17:53:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.047+0000 7fbcd9632640 1 Processor -- start 2024-05-20T17:53:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.047+0000 7fbcd9632640 1 -- start start 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd9632640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc004800 0x7fbcd4157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd9632640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcd40b6560 0x7fbcd40b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd9632640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcd41f3f90 0x7fbcd41f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd9632640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40d42b0 con 0x7fbcd40b6560 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd9632640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40d4130 con 0x7fbcd41f3f90 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd9632640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd40d4430 con 0x7fbcbc004800 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcd40b6560 0x7fbcd40b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcd40b6560 0x7fbcd40b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55266/0 (socket says 172.21.15.6:55266) 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 -- 172.21.15.6:0/2838544009 learned_addr learned my addr 172.21.15.6:0/2838544009 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd37fe640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcd41f3f90 0x7fbcd41f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd2ffd640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc004800 0x7fbcd4157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 -- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc004800 msgr2=0x7fbcd4157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc004800 0x7fbcd4157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 -- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcd41f3f90 msgr2=0x7fbcd41f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcd41f3f90 0x7fbcd41f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 -- 172.21.15.6:0/2838544009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd41f5b10 con 0x7fbcd40b6560 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.049+0000 7fbcd27fc640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcd40b6560 0x7fbcd40b6970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcc802a670 tx=0x7fbcc8001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.050+0000 7fbcbb7fe640 1 -- 172.21.15.6:0/2838544009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8040020 con 0x7fbcd40b6560 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.050+0000 7fbcbb7fe640 1 -- 172.21.15.6:0/2838544009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc8038040 con 0x7fbcd40b6560 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.050+0000 7fbcbb7fe640 1 -- 172.21.15.6:0/2838544009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8037070 con 0x7fbcd40b6560 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.050+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd40b48f0 con 0x7fbcd40b6560 2024-05-20T17:53:04.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.050+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd40b4eb0 con 0x7fbcd40b6560 2024-05-20T17:53:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.051+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd4075b00 con 0x7fbcd40b6560 2024-05-20T17:53:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.051+0000 7fbcbb7fe640 1 -- 172.21.15.6:0/2838544009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcc8043020 con 0x7fbcd40b6560 2024-05-20T17:53:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.052+0000 7fbcbb7fe640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbcc006be30 0x7fbcc006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.052+0000 7fbcbb7fe640 1 -- 172.21.15.6:0/2838544009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fbcc80aa790 con 0x7fbcd40b6560 2024-05-20T17:53:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.052+0000 7fbcd2ffd640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbcc006be30 0x7fbcc006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.052+0000 7fbcd2ffd640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbcc006be30 0x7fbcc006e340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4001cf0 tx=0x7fbcc4001b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.056+0000 7fbcbb7fe640 1 -- 172.21.15.6:0/2838544009 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbcc804a070 con 0x7fbcd40b6560 2024-05-20T17:53:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.242+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbcd40008d0 con 0x7fbcd40b6560 2024-05-20T17:53:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.243+0000 7fbcbb7fe640 1 -- 172.21.15.6:0/2838544009 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fbcc8078e70 con 0x7fbcd40b6560 2024-05-20T17:53:04.241 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:04.241 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T17:53:04.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:53:04.242 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T17:53:04.242 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T17:53:04.242 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:53:04.242 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T17:53:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.244+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbcc006be30 msgr2=0x7fbcc006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.244+0000 7fbcd9632640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbcc006be30 0x7fbcc006e340 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4001cf0 tx=0x7fbcc4001b80 comp rx=0 tx=0).stop 2024-05-20T17:53:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcd40b6560 msgr2=0x7fbcd40b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcd40b6560 0x7fbcd40b6970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbcc802a670 tx=0x7fbcc8001230 comp rx=0 tx=0).stop 2024-05-20T17:53:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 shutdown_connections 2024-05-20T17:53:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbcc006be30 0x7fbcc006e340 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcd41f3f90 0x7fbcd41f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcd40b6560 0x7fbcd40b6970 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 --2- 172.21.15.6:0/2838544009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcbc004800 0x7fbcd4157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 >> 172.21.15.6:0/2838544009 conn(0x7fbcd406d240 msgr2=0x7fbcd415f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 shutdown_connections 2024-05-20T17:53:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.245+0000 7fbcd9632640 1 -- 172.21.15.6:0/2838544009 wait complete. 2024-05-20T17:53:04.254 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T17:53:04.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T17:53:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.375+0000 7f53a6679640 1 Processor -- start 2024-05-20T17:53:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.375+0000 7f53a6679640 1 -- start start 2024-05-20T17:53:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f53a6679640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f53a00d04a0 0x7f53a015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f53a6679640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a0162fb0 con 0x7f53a00b3850 2024-05-20T17:53:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f53a6679640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a0163290 con 0x7f53a00b6d50 2024-05-20T17:53:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f53a6679640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f53a0162d60 con 0x7f53a00d04a0 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f539ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f53a00b3850 0x7f53a00b6640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55244/0 (socket says 172.21.15.6:55244) 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f539ffff640 1 -- 172.21.15.6:0/1086394533 learned_addr learned my addr 172.21.15.6:0/1086394533 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f53a4c16640 1 --2- 172.21.15.6:0/1086394533 >> v2:172.21.15.171:3300/0 conn(0x7f53a00d04a0 0x7f53a015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f539effd640 1 -- 172.21.15.6:0/1086394533 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407807206 0 0) 0x7f53a0162fb0 con 0x7f53a00b3850 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.376+0000 7f539effd640 1 -- 172.21.15.6:0/1086394533 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5388003520 con 0x7f53a00b3850 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.377+0000 7f539effd640 1 -- 172.21.15.6:0/1086394533 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262086119 0 0) 0x7f53a0163290 con 0x7f53a00b6d50 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.377+0000 7f539effd640 1 -- 172.21.15.6:0/1086394533 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53a0162fb0 con 0x7f53a00b6d50 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.377+0000 7f53a4c16640 1 -- 172.21.15.6:0/1086394533 >> v1:172.21.15.171:6789/0 conn(0x7f53a00b6d50 legacy=0x7f53a00d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.377+0000 7f539effd640 1 -- 172.21.15.6:0/1086394533 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 496192985 0 0) 0x7f5388003520 con 0x7f53a00b3850 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.377+0000 7f53a4c16640 1 -- 172.21.15.6:0/1086394533 >> v1:172.21.15.6:6789/0 conn(0x7f53a00b3850 legacy=0x7f53a00b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.377+0000 7f53a4c16640 1 -- 172.21.15.6:0/1086394533 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a0163570 con 0x7f53a00d04a0 2024-05-20T17:53:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f53a4c16640 1 --2- 172.21.15.6:0/1086394533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00d04a0 0x7f53a015f2c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53a0162ee0 tx=0x7f539802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1faefd98b45afb61 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f539effd640 1 -- 172.21.15.6:0/1086394533 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390001670 con 0x7f53a00d04a0 2024-05-20T17:53:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f539effd640 1 -- 172.21.15.6:0/1086394533 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5398007540 con 0x7f53a00d04a0 2024-05-20T17:53:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f539effd640 1 -- 172.21.15.6:0/1086394533 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980078f0 con 0x7f53a00d04a0 2024-05-20T17:53:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f53a6679640 1 -- 172.21.15.6:0/1086394533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00d04a0 msgr2=0x7f53a015f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f53a6679640 1 --2- 172.21.15.6:0/1086394533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00d04a0 0x7f53a015f2c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53a0162ee0 tx=0x7f539802a5f0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f53a6679640 1 -- 172.21.15.6:0/1086394533 shutdown_connections 2024-05-20T17:53:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f53a6679640 1 --2- 172.21.15.6:0/1086394533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00d04a0 0x7f53a015f2c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.378+0000 7f53a6679640 1 -- 172.21.15.6:0/1086394533 >> 172.21.15.6:0/1086394533 conn(0x7f53a00d1820 msgr2=0x7f53a00d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.379+0000 7f53a6679640 1 -- 172.21.15.6:0/1086394533 shutdown_connections 2024-05-20T17:53:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.379+0000 7f53a6679640 1 -- 172.21.15.6:0/1086394533 wait complete. 2024-05-20T17:53:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.380+0000 7f53a6679640 1 Processor -- start 2024-05-20T17:53:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.380+0000 7f53a6679640 1 -- start start 2024-05-20T17:53:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f53a6679640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00b3850 0x7f53a014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f53a6679640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a00d04a0 0x7f53a00cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f53a6679640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53a014adb0 0x7f53a00b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f53a6679640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53a00b8300 con 0x7f53a00d04a0 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f53a6679640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f53a00b8180 con 0x7f53a00b3850 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f53a6679640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53a00b3da0 con 0x7f53a014adb0 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a00d04a0 0x7f53a00cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a00d04a0 0x7f53a00cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55282/0 (socket says 172.21.15.6:55282) 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 -- 172.21.15.6:0/3195008994 learned_addr learned my addr 172.21.15.6:0/3195008994 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539ffff640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00b3850 0x7f53a014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f53a4c16640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53a014adb0 0x7f53a00b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 -- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53a014adb0 msgr2=0x7f53a00b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53a014adb0 0x7f53a00b8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 -- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00b3850 msgr2=0x7f53a014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00b3850 0x7f53a014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 -- 172.21.15.6:0/3195008994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a00cc500 con 0x7f53a00d04a0 2024-05-20T17:53:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.382+0000 7f539f7fe640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a00d04a0 0x7f53a00cf5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f539400c460 tx=0x7f539400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.383+0000 7f539cff9640 1 -- 172.21.15.6:0/3195008994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53940052d0 con 0x7f53a00d04a0 2024-05-20T17:53:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.383+0000 7f539cff9640 1 -- 172.21.15.6:0/3195008994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5394005490 con 0x7f53a00d04a0 2024-05-20T17:53:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.383+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a00ce500 con 0x7f53a00d04a0 2024-05-20T17:53:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.383+0000 7f539cff9640 1 -- 172.21.15.6:0/3195008994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394012870 con 0x7f53a00d04a0 2024-05-20T17:53:04.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.383+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a00ceac0 con 0x7f53a00d04a0 2024-05-20T17:53:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.384+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a00690b0 con 0x7f53a00d04a0 2024-05-20T17:53:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.384+0000 7f539cff9640 1 -- 172.21.15.6:0/3195008994 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5394012a10 con 0x7f53a00d04a0 2024-05-20T17:53:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.385+0000 7f539cff9640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f538c06be30 0x7f538c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.385+0000 7f539cff9640 1 -- 172.21.15.6:0/3195008994 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f539408a5c0 con 0x7f53a00d04a0 2024-05-20T17:53:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.385+0000 7f539ffff640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f538c06be30 0x7f538c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.385+0000 7f539ffff640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f538c06be30 0x7f538c06e340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53900017e0 tx=0x7f5390001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.389+0000 7f539cff9640 1 -- 172.21.15.6:0/3195008994 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5394058c70 con 0x7f53a00d04a0 2024-05-20T17:53:04.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:04.577+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f53a00d3050 con 0x7f53a00d04a0 2024-05-20T17:53:05.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:53:05.414 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:53:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.542+0000 7f539cff9640 1 -- 172.21.15.6:0/3195008994 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f539405cf70 con 0x7f53a00d04a0 2024-05-20T17:53:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T17:53:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f538c06be30 msgr2=0x7f538c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f538c06be30 0x7f538c06e340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53900017e0 tx=0x7f5390001630 comp rx=0 tx=0).stop 2024-05-20T17:53:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a00d04a0 msgr2=0x7f53a00cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a00d04a0 0x7f53a00cf5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f539400c460 tx=0x7f539400c920 comp rx=0 tx=0).stop 2024-05-20T17:53:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 shutdown_connections 2024-05-20T17:53:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f538c06be30 0x7f538c06e340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53a014adb0 0x7f53a00b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53a00d04a0 0x7f53a00cf5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 --2- 172.21.15.6:0/3195008994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53a00b3850 0x7f53a014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 >> 172.21.15.6:0/3195008994 conn(0x7f53a00d1820 msgr2=0x7f53a00b8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.545+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 shutdown_connections 2024-05-20T17:53:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.546+0000 7f53a6679640 1 -- 172.21.15.6:0/3195008994 wait complete. 2024-05-20T17:53:05.563 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-20T17:53:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.692+0000 7f19ab94c640 1 Processor -- start 2024-05-20T17:53:05.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.692+0000 7f19ab94c640 1 -- start start 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19ab94c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a415e240 0x7f19a4157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19ab94c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19a40d1e70 0x7f19a406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19ab94c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19a406dfe0 con 0x7f19a406d2b0 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19ab94c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f19a406dd00 con 0x7f19a40d1e70 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19ab94c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f19a415d760 con 0x7f19a415e240 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19a9ee9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19a40d1e70 0x7f19a406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19a9ee9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f19a40d1e70 0x7f19a406d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55296/0 (socket says 172.21.15.6:55296) 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19a9ee9640 1 -- 172.21.15.6:0/1760938973 learned_addr learned my addr 172.21.15.6:0/1760938973 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19a96e8640 1 --2- 172.21.15.6:0/1760938973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a415e240 0x7f19a4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19a9ee9640 1 -- 172.21.15.6:0/1760938973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a415e240 msgr2=0x7f19a4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19a9ee9640 1 --2- 172.21.15.6:0/1760938973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a415e240 0x7f19a4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19a9ee9640 1 -- 172.21.15.6:0/1760938973 >> v1:172.21.15.171:6789/0 conn(0x7f19a406d2b0 legacy=0x7f19a40d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.694+0000 7f19a9ee9640 1 -- 172.21.15.6:0/1760938973 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a415da40 con 0x7f19a40d1e70 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.695+0000 7f19a9ee9640 1 --2- 172.21.15.6:0/1760938973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a40d1e70 0x7f19a406d6c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f199c009870 tx=0x7f199c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ee62248724cc17 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.695+0000 7f19a3fff640 1 -- 172.21.15.6:0/1760938973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c037070 con 0x7f19a40d1e70 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.695+0000 7f19a3fff640 1 -- 172.21.15.6:0/1760938973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199c032440 con 0x7f19a40d1e70 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.695+0000 7f19a3fff640 1 -- 172.21.15.6:0/1760938973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c032810 con 0x7f19a40d1e70 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.696+0000 7f19ab94c640 1 -- 172.21.15.6:0/1760938973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a40d1e70 msgr2=0x7f19a406d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.696+0000 7f19ab94c640 1 --2- 172.21.15.6:0/1760938973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a40d1e70 0x7f19a406d6c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f199c009870 tx=0x7f199c02a210 comp rx=0 tx=0).stop 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.696+0000 7f19ab94c640 1 -- 172.21.15.6:0/1760938973 shutdown_connections 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.696+0000 7f19ab94c640 1 --2- 172.21.15.6:0/1760938973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a40d1e70 0x7f19a406d6c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.696+0000 7f19ab94c640 1 --2- 172.21.15.6:0/1760938973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a415e240 0x7f19a4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.696+0000 7f19ab94c640 1 -- 172.21.15.6:0/1760938973 >> 172.21.15.6:0/1760938973 conn(0x7f19a40b6600 msgr2=0x7f19a40b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.696+0000 7f19ab94c640 1 -- 172.21.15.6:0/1760938973 shutdown_connections 2024-05-20T17:53:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.696+0000 7f19ab94c640 1 -- 172.21.15.6:0/1760938973 wait complete. 2024-05-20T17:53:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.698+0000 7f19ab94c640 1 Processor -- start 2024-05-20T17:53:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.698+0000 7f19ab94c640 1 -- start start 2024-05-20T17:53:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19ab94c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a406d2b0 0x7f19a409d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19ab94c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a415e240 0x7f19a409b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19ab94c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19a4146c00 0x7f19a4140220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19ab94c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40b0bb0 con 0x7f19a415e240 2024-05-20T17:53:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19ab94c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40b0a30 con 0x7f19a4146c00 2024-05-20T17:53:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19ab94c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f19a40b1220 con 0x7f19a406d2b0 2024-05-20T17:53:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a8ee7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a415e240 0x7f19a409b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a8ee7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a415e240 0x7f19a409b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55300/0 (socket says 172.21.15.6:55300) 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a8ee7640 1 -- 172.21.15.6:0/3228532718 learned_addr learned my addr 172.21.15.6:0/3228532718 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a96e8640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a406d2b0 0x7f19a409d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a9ee9640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19a4146c00 0x7f19a4140220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a8ee7640 1 -- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a406d2b0 msgr2=0x7f19a409d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a8ee7640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a406d2b0 0x7f19a409d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a8ee7640 1 -- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19a4146c00 msgr2=0x7f19a4140220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a8ee7640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19a4146c00 0x7f19a4140220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.699+0000 7f19a8ee7640 1 -- 172.21.15.6:0/3228532718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a409c230 con 0x7f19a415e240 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.700+0000 7f19a8ee7640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a415e240 0x7f19a409b850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f199800b420 tx=0x7f199800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.700+0000 7f19a1ffb640 1 -- 172.21.15.6:0/3228532718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998011830 con 0x7f19a415e240 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.700+0000 7f19a1ffb640 1 -- 172.21.15.6:0/3228532718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1998016070 con 0x7f19a415e240 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.700+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a409c510 con 0x7f19a415e240 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.700+0000 7f19a1ffb640 1 -- 172.21.15.6:0/3228532718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998011c10 con 0x7f19a415e240 2024-05-20T17:53:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.700+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a409cad0 con 0x7f19a415e240 2024-05-20T17:53:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.701+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a40690b0 con 0x7f19a415e240 2024-05-20T17:53:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.701+0000 7f19a1ffb640 1 -- 172.21.15.6:0/3228532718 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f199801b460 con 0x7f19a415e240 2024-05-20T17:53:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.702+0000 7f19a1ffb640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f199006be60 0x7f199006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.702+0000 7f19a1ffb640 1 -- 172.21.15.6:0/3228532718 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f199808a7f0 con 0x7f19a415e240 2024-05-20T17:53:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.702+0000 7f19a96e8640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f199006be60 0x7f199006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.703+0000 7f19a96e8640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f199006be60 0x7f199006e370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19a406d020 tx=0x7f1994003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.707+0000 7f19a1ffb640 1 -- 172.21.15.6:0/3228532718 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1998020020 con 0x7f19a415e240 2024-05-20T17:53:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:05.895+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f19a409bf80 con 0x7f19a415e240 2024-05-20T17:53:06.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.548+0000 7f19a1ffb640 1 -- 172.21.15.6:0/3228532718 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f19980592f0 con 0x7f19a415e240 2024-05-20T17:53:06.546 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T17:53:06.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f199006be60 msgr2=0x7f199006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:06.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f199006be60 0x7f199006e370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19a406d020 tx=0x7f1994003990 comp rx=0 tx=0).stop 2024-05-20T17:53:06.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a415e240 msgr2=0x7f19a409b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:06.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a415e240 0x7f19a409b850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f199800b420 tx=0x7f199800b8e0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 shutdown_connections 2024-05-20T17:53:06.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f199006be60 0x7f199006e370 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19a4146c00 0x7f19a4140220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19a415e240 0x7f19a409b850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 --2- 172.21.15.6:0/3228532718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19a406d2b0 0x7f19a409d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 >> 172.21.15.6:0/3228532718 conn(0x7f19a40b6600 msgr2=0x7f19a40b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:06.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.551+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 shutdown_connections 2024-05-20T17:53:06.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.552+0000 7f19ab94c640 1 -- 172.21.15.6:0/3228532718 wait complete. 2024-05-20T17:53:06.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T17:53:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.700+0000 7f56b96ca640 1 Processor -- start 2024-05-20T17:53:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.701+0000 7f56b96ca640 1 -- start start 2024-05-20T17:53:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b96ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56b40b6620 0x7f56b40ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b96ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 0x7f56b40d4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b96ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b40d4540 con 0x7f56b4162ce0 2024-05-20T17:53:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b96ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f56b40d3480 con 0x7f56b40b6620 2024-05-20T17:53:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b96ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56b41634a0 con 0x7f56b40d3bf0 2024-05-20T17:53:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56b40b6620 0x7f56b40ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56b40b6620 0x7f56b40ba3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55310/0 (socket says 172.21.15.6:55310) 2024-05-20T17:53:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b2ffd640 1 -- 172.21.15.6:0/3675658317 learned_addr learned my addr 172.21.15.6:0/3675658317 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b37fe640 1 --2- 172.21.15.6:0/3675658317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 0x7f56b40d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b2ffd640 1 -- 172.21.15.6:0/3675658317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 msgr2=0x7f56b40d4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b2ffd640 1 --2- 172.21.15.6:0/3675658317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 0x7f56b40d4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.702+0000 7f56b2ffd640 1 -- 172.21.15.6:0/3675658317 >> v1:172.21.15.171:6789/0 conn(0x7f56b4162ce0 legacy=0x7f56b40b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.703+0000 7f56b2ffd640 1 -- 172.21.15.6:0/3675658317 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b4163780 con 0x7f56b40b6620 2024-05-20T17:53:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.703+0000 7f56b2ffd640 1 --2- 172.21.15.6:0/3675658317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b40b6620 0x7f56b40ba3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009e50 tx=0x7f56a402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32502b3a914c2551 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.703+0000 7f56b1ffb640 1 -- 172.21.15.6:0/3675658317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4036070 con 0x7f56b40b6620 2024-05-20T17:53:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.703+0000 7f56b1ffb640 1 -- 172.21.15.6:0/3675658317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a4031600 con 0x7f56b40b6620 2024-05-20T17:53:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.703+0000 7f56b1ffb640 1 -- 172.21.15.6:0/3675658317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a40319d0 con 0x7f56b40b6620 2024-05-20T17:53:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.704+0000 7f56b96ca640 1 -- 172.21.15.6:0/3675658317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b40b6620 msgr2=0x7f56b40ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.704+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3675658317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b40b6620 0x7f56b40ba3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009e50 tx=0x7f56a402a710 comp rx=0 tx=0).stop 2024-05-20T17:53:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.704+0000 7f56b96ca640 1 -- 172.21.15.6:0/3675658317 shutdown_connections 2024-05-20T17:53:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.704+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3675658317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 0x7f56b40d4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.704+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3675658317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b40b6620 0x7f56b40ba3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.704+0000 7f56b96ca640 1 -- 172.21.15.6:0/3675658317 >> 172.21.15.6:0/3675658317 conn(0x7f56b406d240 msgr2=0x7f56b406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.704+0000 7f56b96ca640 1 -- 172.21.15.6:0/3675658317 shutdown_connections 2024-05-20T17:53:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.704+0000 7f56b96ca640 1 -- 172.21.15.6:0/3675658317 wait complete. 2024-05-20T17:53:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.706+0000 7f56b96ca640 1 Processor -- start 2024-05-20T17:53:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.706+0000 7f56b96ca640 1 -- start start 2024-05-20T17:53:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.707+0000 7f56b96ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56b40b6620 0x7f56b41f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.707+0000 7f56b96ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 0x7f56b41eae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.707+0000 7f56b96ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b4162ce0 0x7f56b41f9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b96ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41630f0 con 0x7f56b4162ce0 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b96ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f56b40d36d0 con 0x7f56b40b6620 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b96ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56b41f7320 con 0x7f56b40d3bf0 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b4162ce0 0x7f56b41f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b4162ce0 0x7f56b41f9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55316/0 (socket says 172.21.15.6:55316) 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 -- 172.21.15.6:0/3878255457 learned_addr learned my addr 172.21.15.6:0/3878255457 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b27fc640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 0x7f56b41eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b2ffd640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56b40b6620 0x7f56b41f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 -- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 msgr2=0x7f56b41eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 0x7f56b41eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 -- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56b40b6620 msgr2=0x7f56b41f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56b40b6620 0x7f56b41f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 -- 172.21.15.6:0/3878255457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b41e9d80 con 0x7f56b4162ce0 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b37fe640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b4162ce0 0x7f56b41f9420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00d4e0 tx=0x7f56ac00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f569b7fe640 1 -- 172.21.15.6:0/3878255457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0125f0 con 0x7f56b4162ce0 2024-05-20T17:53:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f569b7fe640 1 -- 172.21.15.6:0/3878255457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac019070 con 0x7f56b4162ce0 2024-05-20T17:53:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b41ea060 con 0x7f56b4162ce0 2024-05-20T17:53:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f569b7fe640 1 -- 172.21.15.6:0/3878255457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0129f0 con 0x7f56b4162ce0 2024-05-20T17:53:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.708+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b41ea620 con 0x7f56b4162ce0 2024-05-20T17:53:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.710+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b4075b00 con 0x7f56b4162ce0 2024-05-20T17:53:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.710+0000 7f569b7fe640 1 -- 172.21.15.6:0/3878255457 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56ac012b90 con 0x7f56b4162ce0 2024-05-20T17:53:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.711+0000 7f569b7fe640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56a006be30 0x7f56a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.711+0000 7f569b7fe640 1 -- 172.21.15.6:0/3878255457 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f56ac08b0b0 con 0x7f56b4162ce0 2024-05-20T17:53:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.711+0000 7f56b2ffd640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56a006be30 0x7f56a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.711+0000 7f56b2ffd640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56a006be30 0x7f56a006e340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56a4033000 tx=0x7f56a4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:06.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.716+0000 7f569b7fe640 1 -- 172.21.15.6:0/3878255457 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f56ac0593e0 con 0x7f56b4162ce0 2024-05-20T17:53:06.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:06.936+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f56b40d2fa0 con 0x7f56b4162ce0 2024-05-20T17:53:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.549+0000 7f569b7fe640 1 -- 172.21.15.6:0/3878255457 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f56ac05d6e0 con 0x7f56b4162ce0 2024-05-20T17:53:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56a006be30 msgr2=0x7f56a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56a006be30 0x7f56a006e340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56a4033000 tx=0x7f56a4009000 comp rx=0 tx=0).stop 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b4162ce0 msgr2=0x7f56b41f9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b4162ce0 0x7f56b41f9420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00d4e0 tx=0x7f56ac00d9a0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 shutdown_connections 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56a006be30 0x7f56a006e340 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b4162ce0 0x7f56b41f9420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56b40d3bf0 0x7f56b41eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 --2- 172.21.15.6:0/3878255457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56b40b6620 0x7f56b41f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 >> 172.21.15.6:0/3878255457 conn(0x7f56b406d240 msgr2=0x7f56b4160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 shutdown_connections 2024-05-20T17:53:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.553+0000 7f56b96ca640 1 -- 172.21.15.6:0/3878255457 wait complete. 2024-05-20T17:53:07.580 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-20T17:53:07.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-20T17:53:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.710+0000 7f17aaf85640 1 Processor -- start 2024-05-20T17:53:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.710+0000 7f17aaf85640 1 -- start start 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17aaf85640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f17a40b3850 0x7f17a415f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17aaf85640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17a40d04a0 0x7f17a40b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17aaf85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a408bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17aaf85640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f17a4162d60 con 0x7f17a40d04a0 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17aaf85640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f17a40b6f90 con 0x7f17a40b3850 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17aaf85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17a4162fb0 con 0x7f17a40b6b80 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17a40d04a0 0x7f17a40b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17a40d04a0 0x7f17a40b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44310/0 (socket says 172.21.15.6:44310) 2024-05-20T17:53:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a3fff640 1 -- 172.21.15.6:0/671190741 learned_addr learned my addr 172.21.15.6:0/671190741 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a8d21640 1 --2- 172.21.15.6:0/671190741 >> v2:172.21.15.171:3300/0 conn(0x7f17a40b3850 0x7f17a415f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a9522640 1 --2- 172.21.15.6:0/671190741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a408bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a3fff640 1 -- 172.21.15.6:0/671190741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 msgr2=0x7f17a408bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a3fff640 1 --2- 172.21.15.6:0/671190741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a408bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a3fff640 1 -- 172.21.15.6:0/671190741 >> v2:172.21.15.171:3300/0 conn(0x7f17a40b3850 msgr2=0x7f17a415f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a3fff640 1 --2- 172.21.15.6:0/671190741 >> v2:172.21.15.171:3300/0 conn(0x7f17a40b3850 0x7f17a415f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a3fff640 1 -- 172.21.15.6:0/671190741 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a4163290 con 0x7f17a40d04a0 2024-05-20T17:53:07.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.712+0000 7f17a9522640 1 --2- 172.21.15.6:0/671190741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a408bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.713+0000 7f17a3fff640 1 --2- 172.21.15.6:0/671190741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40d04a0 0x7f17a40b6640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f17a40b77b0 tx=0x7f179802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777ac3ef5bc1f488 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.713+0000 7f17a37fe640 1 -- 172.21.15.6:0/671190741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798037070 con 0x7f17a40d04a0 2024-05-20T17:53:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.713+0000 7f17a37fe640 1 -- 172.21.15.6:0/671190741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1798032440 con 0x7f17a40d04a0 2024-05-20T17:53:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.713+0000 7f17a37fe640 1 -- 172.21.15.6:0/671190741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798032810 con 0x7f17a40d04a0 2024-05-20T17:53:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 -- 172.21.15.6:0/671190741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40d04a0 msgr2=0x7f17a40b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 --2- 172.21.15.6:0/671190741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40d04a0 0x7f17a40b6640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f17a40b77b0 tx=0x7f179802a140 comp rx=0 tx=0).stop 2024-05-20T17:53:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 -- 172.21.15.6:0/671190741 shutdown_connections 2024-05-20T17:53:07.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 --2- 172.21.15.6:0/671190741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a408bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 --2- 172.21.15.6:0/671190741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40d04a0 0x7f17a40b6640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 --2- 172.21.15.6:0/671190741 >> v2:172.21.15.171:3300/0 conn(0x7f17a40b3850 0x7f17a415f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 -- 172.21.15.6:0/671190741 >> 172.21.15.6:0/671190741 conn(0x7f17a40d1820 msgr2=0x7f17a40d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 -- 172.21.15.6:0/671190741 shutdown_connections 2024-05-20T17:53:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.714+0000 7f17aaf85640 1 -- 172.21.15.6:0/671190741 wait complete. 2024-05-20T17:53:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.716+0000 7f17aaf85640 1 Processor -- start 2024-05-20T17:53:07.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.716+0000 7f17aaf85640 1 -- start start 2024-05-20T17:53:07.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17aaf85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40b3850 0x7f17a4149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:07.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17aaf85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a4149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17aaf85640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a40d04a0 0x7f17a4161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17aaf85640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f17a40b8180 con 0x7f17a40b3850 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17aaf85640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17a4163850 con 0x7f17a40d04a0 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17aaf85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17a40b8300 con 0x7f17a40b6b80 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17a8d21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40b3850 0x7f17a4149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17a8d21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40b3850 0x7f17a4149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44326/0 (socket says 172.21.15.6:44326) 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.717+0000 7f17a8d21640 1 -- 172.21.15.6:0/1184498034 learned_addr learned my addr 172.21.15.6:0/1184498034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a3fff640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a4149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a9522640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a40d04a0 0x7f17a4161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a8d21640 1 -- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 msgr2=0x7f17a4149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:07.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a8d21640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a4149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a8d21640 1 -- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a40d04a0 msgr2=0x7f17a4161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a8d21640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a40d04a0 0x7f17a4161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a8d21640 1 -- 172.21.15.6:0/1184498034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a41eb3c0 con 0x7f17a40b3850 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a8d21640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40b3850 0x7f17a4149730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f179400e840 tx=0x7f179400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a17fa640 1 -- 172.21.15.6:0/1184498034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794017070 con 0x7f17a40b3850 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a17fa640 1 -- 172.21.15.6:0/1184498034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179400c730 con 0x7f17a40b3850 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a41602b0 con 0x7f17a40b3850 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17a17fa640 1 -- 172.21.15.6:0/1184498034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179400cb00 con 0x7f17a40b3850 2024-05-20T17:53:07.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.718+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a4160870 con 0x7f17a40b3850 2024-05-20T17:53:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.719+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a40ba680 con 0x7f17a40b3850 2024-05-20T17:53:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.720+0000 7f17a17fa640 1 -- 172.21.15.6:0/1184498034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f179401a070 con 0x7f17a40b3850 2024-05-20T17:53:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.720+0000 7f17a17fa640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f179006be30 0x7f179006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.720+0000 7f17a17fa640 1 -- 172.21.15.6:0/1184498034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f179408ac30 con 0x7f17a40b3850 2024-05-20T17:53:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.721+0000 7f17a3fff640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f179006be30 0x7f179006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:07.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.721+0000 7f17a3fff640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f179006be30 0x7f179006e340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1798034000 tx=0x7f179802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:07.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.725+0000 7f17a17fa640 1 -- 172.21.15.6:0/1184498034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f17a40ba680 con 0x7f17a40b3850 2024-05-20T17:53:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:07.919+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f17a40690b0 con 0x7f17a40b3850 2024-05-20T17:53:08.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.551+0000 7f17a17fa640 1 -- 172.21.15.6:0/1184498034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f1794059670 con 0x7f17a40b3850 2024-05-20T17:53:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f179006be30 msgr2=0x7f179006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f179006be30 0x7f179006e340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1798034000 tx=0x7f179802e000 comp rx=0 tx=0).stop 2024-05-20T17:53:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40b3850 msgr2=0x7f17a4149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40b3850 0x7f17a4149730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f179400e840 tx=0x7f179400ed00 comp rx=0 tx=0).stop 2024-05-20T17:53:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 shutdown_connections 2024-05-20T17:53:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f179006be30 0x7f179006e340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a40d04a0 0x7f17a4161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a40b6b80 0x7f17a4149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 --2- 172.21.15.6:0/1184498034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a40b3850 0x7f17a4149730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 >> 172.21.15.6:0/1184498034 conn(0x7f17a40d1820 msgr2=0x7f17a408c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 shutdown_connections 2024-05-20T17:53:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.555+0000 7f17aaf85640 1 -- 172.21.15.6:0/1184498034 wait complete. 2024-05-20T17:53:08.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T17:53:08.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.698+0000 7f81d219d640 1 Processor -- start 2024-05-20T17:53:08.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.699+0000 7f81d219d640 1 -- start start 2024-05-20T17:53:08.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81d219d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc15cde0 0x7f81cc0d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:08.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81d219d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81cc15f7a0 0x7f81cc15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81d219d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81cc15d1f0 con 0x7f81cc0d4af0 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81d219d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f81cc0d3bc0 con 0x7f81cc15f7a0 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81d219d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81cc1602b0 con 0x7f81cc15cde0 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81caffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81cc15f7a0 0x7f81cc15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81caffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81cc15f7a0 0x7f81cc15fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44328/0 (socket says 172.21.15.6:44328) 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81caffd640 1 -- 172.21.15.6:0/3390125964 learned_addr learned my addr 172.21.15.6:0/3390125964 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81cb7fe640 1 --2- 172.21.15.6:0/3390125964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc15cde0 0x7f81cc0d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81caffd640 1 -- 172.21.15.6:0/3390125964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc15cde0 msgr2=0x7f81cc0d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81caffd640 1 --2- 172.21.15.6:0/3390125964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc15cde0 0x7f81cc0d4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81caffd640 1 -- 172.21.15.6:0/3390125964 >> v1:172.21.15.171:6789/0 conn(0x7f81cc0d4af0 legacy=0x7f81cc0d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.700+0000 7f81caffd640 1 -- 172.21.15.6:0/3390125964 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc160590 con 0x7f81cc15f7a0 2024-05-20T17:53:08.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.701+0000 7f81caffd640 1 --2- 172.21.15.6:0/3390125964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc15fbb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009870 tx=0x7f81c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8b23ef319f1576 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.701+0000 7f81ca7fc640 1 -- 172.21.15.6:0/3390125964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0037070 con 0x7f81cc15f7a0 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.701+0000 7f81ca7fc640 1 -- 172.21.15.6:0/3390125964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0032440 con 0x7f81cc15f7a0 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.701+0000 7f81ca7fc640 1 -- 172.21.15.6:0/3390125964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0032810 con 0x7f81cc15f7a0 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.702+0000 7f81d219d640 1 -- 172.21.15.6:0/3390125964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 msgr2=0x7f81cc15fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.702+0000 7f81d219d640 1 --2- 172.21.15.6:0/3390125964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc15fbb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009870 tx=0x7f81c002a270 comp rx=0 tx=0).stop 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.702+0000 7f81d219d640 1 -- 172.21.15.6:0/3390125964 shutdown_connections 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.702+0000 7f81d219d640 1 --2- 172.21.15.6:0/3390125964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc15fbb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.702+0000 7f81d219d640 1 --2- 172.21.15.6:0/3390125964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc15cde0 0x7f81cc0d4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.702+0000 7f81d219d640 1 -- 172.21.15.6:0/3390125964 >> 172.21.15.6:0/3390125964 conn(0x7f81cc06b520 msgr2=0x7f81cc06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:08.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.702+0000 7f81d219d640 1 -- 172.21.15.6:0/3390125964 shutdown_connections 2024-05-20T17:53:08.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.702+0000 7f81d219d640 1 -- 172.21.15.6:0/3390125964 wait complete. 2024-05-20T17:53:08.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.704+0000 7f81d219d640 1 Processor -- start 2024-05-20T17:53:08.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.704+0000 7f81d219d640 1 -- start start 2024-05-20T17:53:08.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.705+0000 7f81d219d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc0d4af0 0x7f81cc0ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:08.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.705+0000 7f81d219d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81cc15cde0 0x7f81cc0abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:08.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.705+0000 7f81d219d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc0ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:08.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.705+0000 7f81d219d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc0d4590 con 0x7f81cc15f7a0 2024-05-20T17:53:08.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.705+0000 7f81d219d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc0d31a0 con 0x7f81cc15cde0 2024-05-20T17:53:08.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.705+0000 7f81d219d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81cc0d4710 con 0x7f81cc0d4af0 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc0ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc0ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44344/0 (socket says 172.21.15.6:44344) 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 -- 172.21.15.6:0/1720253752 learned_addr learned my addr 172.21.15.6:0/1720253752 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cb7fe640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc0d4af0 0x7f81cc0ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81caffd640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81cc15cde0 0x7f81cc0abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 -- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc0d4af0 msgr2=0x7f81cc0ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc0d4af0 0x7f81cc0ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 -- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81cc15cde0 msgr2=0x7f81cc0abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81cc15cde0 0x7f81cc0abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 -- 172.21.15.6:0/1720253752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc0cabb0 con 0x7f81cc15f7a0 2024-05-20T17:53:08.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81cbfff640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc0ac020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c6b0 tx=0x7f81c400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:08.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81b3fff640 1 -- 172.21.15.6:0/1720253752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4003b70 con 0x7f81cc15f7a0 2024-05-20T17:53:08.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81b3fff640 1 -- 172.21.15.6:0/1720253752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c4003d30 con 0x7f81cc15f7a0 2024-05-20T17:53:08.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81b3fff640 1 -- 172.21.15.6:0/1720253752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4005310 con 0x7f81cc15f7a0 2024-05-20T17:53:08.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81cc0cae90 con 0x7f81cc15f7a0 2024-05-20T17:53:08.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.706+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81cc0ac8d0 con 0x7f81cc15f7a0 2024-05-20T17:53:08.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.708+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81cc0ca920 con 0x7f81cc15f7a0 2024-05-20T17:53:08.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.708+0000 7f81b3fff640 1 -- 172.21.15.6:0/1720253752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81c40054b0 con 0x7f81cc15f7a0 2024-05-20T17:53:08.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.708+0000 7f81b3fff640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81b806be30 0x7f81b806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:08.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.709+0000 7f81b3fff640 1 -- 172.21.15.6:0/1720253752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f81c408ace0 con 0x7f81cc15f7a0 2024-05-20T17:53:08.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.709+0000 7f81cb7fe640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81b806be30 0x7f81b806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:08.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.709+0000 7f81cb7fe640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81b806be30 0x7f81b806e340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009aa0 tx=0x7f81bc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.713+0000 7f81b3fff640 1 -- 172.21.15.6:0/1720253752 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f81c4058f10 con 0x7f81cc15f7a0 2024-05-20T17:53:08.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:08.898+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f81cc06b930 con 0x7f81cc15f7a0 2024-05-20T17:53:09.950 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-20T17:53:09.951+0000 7f3eac13b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:53:10.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.588+0000 7f81b3fff640 1 -- 172.21.15.6:0/1720253752 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f81cc06b930 con 0x7f81cc15f7a0 2024-05-20T17:53:10.587 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' created 2024-05-20T17:53:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.591+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81b806be30 msgr2=0x7f81b806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.591+0000 7f81d219d640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81b806be30 0x7f81b806e340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009aa0 tx=0x7f81bc009190 comp rx=0 tx=0).stop 2024-05-20T17:53:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.591+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 msgr2=0x7f81cc0ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.591+0000 7f81d219d640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc0ac020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c6b0 tx=0x7f81c400cb70 comp rx=0 tx=0).stop 2024-05-20T17:53:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.593+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 shutdown_connections 2024-05-20T17:53:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.593+0000 7f81d219d640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81b806be30 0x7f81b806e340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.593+0000 7f81d219d640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81cc15f7a0 0x7f81cc0ac020 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.593+0000 7f81d219d640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81cc15cde0 0x7f81cc0abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.593+0000 7f81d219d640 1 --2- 172.21.15.6:0/1720253752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81cc0d4af0 0x7f81cc0ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.593+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 >> 172.21.15.6:0/1720253752 conn(0x7f81cc06b520 msgr2=0x7f81cc0d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.594+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 shutdown_connections 2024-05-20T17:53:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.594+0000 7f81d219d640 1 -- 172.21.15.6:0/1720253752 wait complete. 2024-05-20T17:53:10.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-20T17:53:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.740+0000 7f48cb709640 1 Processor -- start 2024-05-20T17:53:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.741+0000 7f48cb709640 1 -- start start 2024-05-20T17:53:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48cb709640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f48c408c430 0x7f48c406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48cb709640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c40d0450 con 0x7f48c40d45f0 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48cb709640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c40d3b10 con 0x7f48c40b3860 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48cb709640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f48c40d3df0 con 0x7f48c408c430 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48c8ca4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f48c40d45f0 0x7f48c408bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50722/0 (socket says 172.21.15.6:50722) 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48c8ca4640 1 -- 172.21.15.6:0/247992723 learned_addr learned my addr 172.21.15.6:0/247992723 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48c9ca6640 1 --2- 172.21.15.6:0/247992723 >> v2:172.21.15.171:3300/0 conn(0x7f48c408c430 0x7f48c406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48c3fff640 1 -- 172.21.15.6:0/247992723 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292615098 0 0) 0x7f48c40d0450 con 0x7f48c40d45f0 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.742+0000 7f48c3fff640 1 -- 172.21.15.6:0/247992723 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48ac003520 con 0x7f48c40d45f0 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.743+0000 7f48c3fff640 1 -- 172.21.15.6:0/247992723 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521270173 0 0) 0x7f48c40d3b10 con 0x7f48c40b3860 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.743+0000 7f48c3fff640 1 -- 172.21.15.6:0/247992723 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c40d0450 con 0x7f48c40b3860 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.743+0000 7f48c3fff640 1 -- 172.21.15.6:0/247992723 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 811696880 0 0) 0x7f48ac003520 con 0x7f48c40d45f0 2024-05-20T17:53:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.743+0000 7f48c9ca6640 1 -- 172.21.15.6:0/247992723 >> v1:172.21.15.171:6789/0 conn(0x7f48c40b3860 legacy=0x7f48c415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.743+0000 7f48c9ca6640 1 -- 172.21.15.6:0/247992723 >> v1:172.21.15.6:6789/0 conn(0x7f48c40d45f0 legacy=0x7f48c408bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.743+0000 7f48c9ca6640 1 -- 172.21.15.6:0/247992723 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c40d40d0 con 0x7f48c408c430 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48c9ca6640 1 --2- 172.21.15.6:0/247992723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c408c430 0x7f48c406d870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097a0 tx=0x7f48bc02a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd999dc16a246e1b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48c3fff640 1 -- 172.21.15.6:0/247992723 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc037070 con 0x7f48c408c430 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48c3fff640 1 -- 172.21.15.6:0/247992723 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48bc02ab30 con 0x7f48c408c430 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48c3fff640 1 -- 172.21.15.6:0/247992723 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8001670 con 0x7f48c408c430 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48cb709640 1 -- 172.21.15.6:0/247992723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c408c430 msgr2=0x7f48c406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48cb709640 1 --2- 172.21.15.6:0/247992723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c408c430 0x7f48c406d870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097a0 tx=0x7f48bc02a0a0 comp rx=0 tx=0).stop 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48cb709640 1 -- 172.21.15.6:0/247992723 shutdown_connections 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48cb709640 1 --2- 172.21.15.6:0/247992723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c408c430 0x7f48c406d870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.744+0000 7f48cb709640 1 -- 172.21.15.6:0/247992723 >> 172.21.15.6:0/247992723 conn(0x7f48c40b6d10 msgr2=0x7f48c406d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.745+0000 7f48cb709640 1 -- 172.21.15.6:0/247992723 shutdown_connections 2024-05-20T17:53:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.745+0000 7f48cb709640 1 -- 172.21.15.6:0/247992723 wait complete. 2024-05-20T17:53:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.746+0000 7f48cb709640 1 Processor -- start 2024-05-20T17:53:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.746+0000 7f48cb709640 1 -- start start 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48cb709640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b3860 0x7f48c41520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48cb709640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d45f0 0x7f48c414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48cb709640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4149210 0x7f48c414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48cb709640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48c416a0f0 con 0x7f48c40d45f0 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48cb709640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48c4169f70 con 0x7f48c4149210 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48cb709640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48c416a270 con 0x7f48c40b3860 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d45f0 0x7f48c414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d45f0 0x7f48c414bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44350/0 (socket says 172.21.15.6:44350) 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 -- 172.21.15.6:0/4006123976 learned_addr learned my addr 172.21.15.6:0/4006123976 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c9ca6640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4149210 0x7f48c414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c94a5640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b3860 0x7f48c41520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 -- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b3860 msgr2=0x7f48c41520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b3860 0x7f48c41520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 -- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4149210 msgr2=0x7f48c414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4149210 0x7f48c414c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 -- 172.21.15.6:0/4006123976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c41547f0 con 0x7f48c40d45f0 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c8ca4640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d45f0 0x7f48c414bc60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c4d0 tx=0x7f48b800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c1ffb640 1 -- 172.21.15.6:0/4006123976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8017070 con 0x7f48c40d45f0 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c1ffb640 1 -- 172.21.15.6:0/4006123976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8005ce0 con 0x7f48c40d45f0 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48c1ffb640 1 -- 172.21.15.6:0/4006123976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b80072f0 con 0x7f48c40d45f0 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.748+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c414da40 con 0x7f48c40d45f0 2024-05-20T17:53:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.749+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c4151380 con 0x7f48c40d45f0 2024-05-20T17:53:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.750+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c414d830 con 0x7f48c40d45f0 2024-05-20T17:53:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.750+0000 7f48c1ffb640 1 -- 172.21.15.6:0/4006123976 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48b801a070 con 0x7f48c40d45f0 2024-05-20T17:53:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.751+0000 7f48c1ffb640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48b006be30 0x7f48b006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:10.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.751+0000 7f48c1ffb640 1 -- 172.21.15.6:0/4006123976 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f48b808a5b0 con 0x7f48c40d45f0 2024-05-20T17:53:10.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.751+0000 7f48c94a5640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48b006be30 0x7f48b006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:10.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.752+0000 7f48c94a5640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48b006be30 0x7f48b006e340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48b4001560 tx=0x7f48b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:10.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.756+0000 7f48c1ffb640 1 -- 172.21.15.6:0/4006123976 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f48b8058560 con 0x7f48c40d45f0 2024-05-20T17:53:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:10.939+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f48c40690b0 con 0x7f48c40d45f0 2024-05-20T17:53:11.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.593+0000 7f48c1ffb640 1 -- 172.21.15.6:0/4006123976 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f48b805c860 con 0x7f48c40d45f0 2024-05-20T17:53:11.592 INFO:teuthology.orchestra.run.smithi006.stderr:set pool 4 allow_ec_overwrites to true 2024-05-20T17:53:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.601+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48b006be30 msgr2=0x7f48b006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.601+0000 7f48cb709640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48b006be30 0x7f48b006e340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48b4001560 tx=0x7f48b4009040 comp rx=0 tx=0).stop 2024-05-20T17:53:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.601+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d45f0 msgr2=0x7f48c414bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.601+0000 7f48cb709640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d45f0 0x7f48c414bc60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c4d0 tx=0x7f48b800c8d0 comp rx=0 tx=0).stop 2024-05-20T17:53:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.608+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 shutdown_connections 2024-05-20T17:53:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.608+0000 7f48cb709640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48b006be30 0x7f48b006e340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.608+0000 7f48cb709640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4149210 0x7f48c414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.608+0000 7f48cb709640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40d45f0 0x7f48c414bc60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.608+0000 7f48cb709640 1 --2- 172.21.15.6:0/4006123976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b3860 0x7f48c41520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.608+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 >> 172.21.15.6:0/4006123976 conn(0x7f48c40b6d10 msgr2=0x7f48c415e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:11.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.615+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 shutdown_connections 2024-05-20T17:53:11.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.615+0000 7f48cb709640 1 -- 172.21.15.6:0/4006123976 wait complete. 2024-05-20T17:53:11.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-20T17:53:11.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.758+0000 7ff4e3821640 1 Processor -- start 2024-05-20T17:53:11.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.758+0000 7ff4e3821640 1 -- start start 2024-05-20T17:53:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e3821640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff4dc0b1650 0x7ff4dc0af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e3821640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4dc09a740 con 0x7ff4dc159ca0 2024-05-20T17:53:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e3821640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4dc09aa20 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e3821640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff4dc09a4f0 con 0x7ff4dc0b1650 2024-05-20T17:53:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e15bd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4dc159ca0 0x7ff4dc0b1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50726/0 (socket says 172.21.15.6:50726) 2024-05-20T17:53:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e15bd640 1 -- 172.21.15.6:0/1760442175 learned_addr learned my addr 172.21.15.6:0/1760442175 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:11.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e1dbe640 1 --2- 172.21.15.6:0/1760442175 >> v2:172.21.15.171:3300/0 conn(0x7ff4dc0b1650 0x7ff4dc0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1760442175 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631465916 0 0) 0x7ff4dc09a740 con 0x7ff4dc159ca0 2024-05-20T17:53:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1760442175 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c8003520 con 0x7ff4dc159ca0 2024-05-20T17:53:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e1dbe640 1 -- 172.21.15.6:0/1760442175 >> v1:172.21.15.171:6789/0 conn(0x7ff4dc0b23f0 legacy=0x7ff4dc15c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e1dbe640 1 -- 172.21.15.6:0/1760442175 >> v1:172.21.15.6:6789/0 conn(0x7ff4dc159ca0 legacy=0x7ff4dc0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.760+0000 7ff4e1dbe640 1 -- 172.21.15.6:0/1760442175 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc09ad00 con 0x7ff4dc0b1650 2024-05-20T17:53:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.761+0000 7ff4e1dbe640 1 --2- 172.21.15.6:0/1760442175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 0x7ff4dc0af230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009d90 tx=0x7ff4d402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2abec458799eba3a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.761+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1760442175 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4007740 con 0x7ff4dc0b1650 2024-05-20T17:53:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.761+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1760442175 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d40078e0 con 0x7ff4dc0b1650 2024-05-20T17:53:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.761+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1760442175 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4007cb0 con 0x7ff4dc0b1650 2024-05-20T17:53:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.762+0000 7ff4e3821640 1 -- 172.21.15.6:0/1760442175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 msgr2=0x7ff4dc0af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.762+0000 7ff4e3821640 1 --2- 172.21.15.6:0/1760442175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 0x7ff4dc0af230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009d90 tx=0x7ff4d402a660 comp rx=0 tx=0).stop 2024-05-20T17:53:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.762+0000 7ff4e3821640 1 -- 172.21.15.6:0/1760442175 shutdown_connections 2024-05-20T17:53:11.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.762+0000 7ff4e3821640 1 --2- 172.21.15.6:0/1760442175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 0x7ff4dc0af230 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:11.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.762+0000 7ff4e3821640 1 -- 172.21.15.6:0/1760442175 >> 172.21.15.6:0/1760442175 conn(0x7ff4dc0b6620 msgr2=0x7ff4dc0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:11.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.762+0000 7ff4e3821640 1 -- 172.21.15.6:0/1760442175 shutdown_connections 2024-05-20T17:53:11.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.762+0000 7ff4e3821640 1 -- 172.21.15.6:0/1760442175 wait complete. 2024-05-20T17:53:11.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.764+0000 7ff4e3821640 1 Processor -- start 2024-05-20T17:53:11.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.764+0000 7ff4e3821640 1 -- start start 2024-05-20T17:53:11.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e3821640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 0x7ff4dc158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e3821640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4dc0b23f0 0x7ff4dc14c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e3821640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4dc159ca0 0x7ff4dc06b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e3821640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc0af770 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e3821640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc09b350 con 0x7ff4dc0b1650 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e3821640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4dc06c630 con 0x7ff4dc159ca0 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4dc0b23f0 0x7ff4dc14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4dc0b23f0 0x7ff4dc14c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44362/0 (socket says 172.21.15.6:44362) 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 -- 172.21.15.6:0/575795265 learned_addr learned my addr 172.21.15.6:0/575795265 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e15bd640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 0x7ff4dc158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e1dbe640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4dc159ca0 0x7ff4dc06b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 -- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4dc159ca0 msgr2=0x7ff4dc06b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4dc159ca0 0x7ff4dc06b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 -- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 msgr2=0x7ff4dc158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 0x7ff4dc158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 -- 172.21.15.6:0/575795265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc159500 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e1dbe640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4dc159ca0 0x7ff4dc06b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e0dbc640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4dc0b23f0 0x7ff4dc14c940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c430 tx=0x7ff4cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4d1ffb640 1 -- 172.21.15.6:0/575795265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc017070 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4d1ffb640 1 -- 172.21.15.6:0/575795265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4cc0052d0 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4dc1538f0 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.766+0000 7ff4d1ffb640 1 -- 172.21.15.6:0/575795265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003830 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.767+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4dc15dd50 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.768+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4dc075b00 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.768+0000 7ff4d1ffb640 1 -- 172.21.15.6:0/575795265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4cc01a070 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.769+0000 7ff4d1ffb640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4c006be30 0x7ff4c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.769+0000 7ff4d1ffb640 1 -- 172.21.15.6:0/575795265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7ff4cc08a480 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.769+0000 7ff4e15bd640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4c006be30 0x7ff4c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:11.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.770+0000 7ff4e15bd640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4c006be30 0x7ff4c006e340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80011e0 tx=0x7ff4d8007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:11.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.773+0000 7ff4d1ffb640 1 -- 172.21.15.6:0/575795265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff4cc058420 con 0x7ff4dc0b23f0 2024-05-20T17:53:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:11.998+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ff4dc0b0990 con 0x7ff4dc0b23f0 2024-05-20T17:53:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.600+0000 7ff4d1ffb640 1 -- 172.21.15.6:0/575795265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7ff4cc05c720 con 0x7ff4dc0b23f0 2024-05-20T17:53:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:added data pool 4 to fsmap 2024-05-20T17:53:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4c006be30 msgr2=0x7ff4c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4c006be30 0x7ff4c006e340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80011e0 tx=0x7ff4d8007d30 comp rx=0 tx=0).stop 2024-05-20T17:53:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4dc0b23f0 msgr2=0x7ff4dc14c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4dc0b23f0 0x7ff4dc14c940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c430 tx=0x7ff4cc00c8f0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 shutdown_connections 2024-05-20T17:53:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4c006be30 0x7ff4c006e340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4dc159ca0 0x7ff4dc06b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4dc0b23f0 0x7ff4dc14c940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 --2- 172.21.15.6:0/575795265 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4dc0b1650 0x7ff4dc158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 >> 172.21.15.6:0/575795265 conn(0x7ff4dc0b6620 msgr2=0x7ff4dc0af920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 shutdown_connections 2024-05-20T17:53:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.603+0000 7ff4e3821640 1 -- 172.21.15.6:0/575795265 wait complete. 2024-05-20T17:53:12.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:53:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.738+0000 7f6959e08640 1 Processor -- start 2024-05-20T17:53:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.738+0000 7f6959e08640 1 -- start start 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.739+0000 7f6959e08640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69540d4400 0x7f695415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f6959e08640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695406cf00 0x7f695406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f6959e08640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f69540d2780 0x7f69540d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f6959e08640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f69540d3f70 con 0x7f69540d4400 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f6959e08640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f695408d2a0 con 0x7f69540d2780 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f6959e08640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f695406d850 con 0x7f695406cf00 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f69537fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69540d4400 0x7f695415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f69537fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69540d4400 0x7f695415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44378/0 (socket says 172.21.15.6:44378) 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f69537fe640 1 -- 172.21.15.6:0/683860573 learned_addr learned my addr 172.21.15.6:0/683860573 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f6953fff640 1 --2- 172.21.15.6:0/683860573 >> v2:172.21.15.171:3300/0 conn(0x7f69540d2780 0x7f69540d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f6952ffd640 1 --2- 172.21.15.6:0/683860573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695406cf00 0x7f695406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f69537fe640 1 -- 172.21.15.6:0/683860573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695406cf00 msgr2=0x7f695406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f69537fe640 1 --2- 172.21.15.6:0/683860573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695406cf00 0x7f695406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f69537fe640 1 -- 172.21.15.6:0/683860573 >> v2:172.21.15.171:3300/0 conn(0x7f69540d2780 msgr2=0x7f69540d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f69537fe640 1 --2- 172.21.15.6:0/683860573 >> v2:172.21.15.171:3300/0 conn(0x7f69540d2780 0x7f69540d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.740+0000 7f69537fe640 1 -- 172.21.15.6:0/683860573 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69540d30d0 con 0x7f69540d4400 2024-05-20T17:53:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.741+0000 7f69537fe640 1 --2- 172.21.15.6:0/683860573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69540d4400 0x7f695415f440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69540b7b90 tx=0x7f694402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb68d4637114f94 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.741+0000 7f69527fc640 1 -- 172.21.15.6:0/683860573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944037070 con 0x7f69540d4400 2024-05-20T17:53:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.741+0000 7f69527fc640 1 -- 172.21.15.6:0/683860573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6944032440 con 0x7f69540d4400 2024-05-20T17:53:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.741+0000 7f69527fc640 1 -- 172.21.15.6:0/683860573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944032810 con 0x7f69540d4400 2024-05-20T17:53:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 -- 172.21.15.6:0/683860573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69540d4400 msgr2=0x7f695415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 --2- 172.21.15.6:0/683860573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69540d4400 0x7f695415f440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69540b7b90 tx=0x7f694402a270 comp rx=0 tx=0).stop 2024-05-20T17:53:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 -- 172.21.15.6:0/683860573 shutdown_connections 2024-05-20T17:53:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 --2- 172.21.15.6:0/683860573 >> v2:172.21.15.171:3300/0 conn(0x7f69540d2780 0x7f69540d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 --2- 172.21.15.6:0/683860573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695406cf00 0x7f695406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 --2- 172.21.15.6:0/683860573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69540d4400 0x7f695415f440 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 -- 172.21.15.6:0/683860573 >> 172.21.15.6:0/683860573 conn(0x7f69540d4bb0 msgr2=0x7f69540d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 -- 172.21.15.6:0/683860573 shutdown_connections 2024-05-20T17:53:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.742+0000 7f6959e08640 1 -- 172.21.15.6:0/683860573 wait complete. 2024-05-20T17:53:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.744+0000 7f6959e08640 1 Processor -- start 2024-05-20T17:53:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.744+0000 7f6959e08640 1 -- start start 2024-05-20T17:53:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f6959e08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695406cf00 0x7f695414acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f6959e08640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540d2780 0x7f69541e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f6959e08640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69540d4400 0x7f69541e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f6959e08640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f69540d3920 con 0x7f695406cf00 2024-05-20T17:53:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f6959e08640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f69540d3640 con 0x7f69540d2780 2024-05-20T17:53:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f6959e08640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f69540d3c00 con 0x7f69540d4400 2024-05-20T17:53:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f69537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695406cf00 0x7f695414acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f69537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695406cf00 0x7f695414acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44384/0 (socket says 172.21.15.6:44384) 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f69537fe640 1 -- 172.21.15.6:0/3956823917 learned_addr learned my addr 172.21.15.6:0/3956823917 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f6952ffd640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540d2780 0x7f69541e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.745+0000 7f6953fff640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69540d4400 0x7f69541e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f69537fe640 1 -- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69540d4400 msgr2=0x7f69541e8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f69537fe640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69540d4400 0x7f69541e8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f69537fe640 1 -- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540d2780 msgr2=0x7f69541e89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f69537fe640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540d2780 0x7f69541e89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f69537fe640 1 -- 172.21.15.6:0/3956823917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69541e9750 con 0x7f695406cf00 2024-05-20T17:53:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f69537fe640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695406cf00 0x7f695414acf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f694402a2b0 tx=0x7f69440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f693bfff640 1 -- 172.21.15.6:0/3956823917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944041020 con 0x7f695406cf00 2024-05-20T17:53:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f693bfff640 1 -- 172.21.15.6:0/3956823917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69440306c0 con 0x7f695406cf00 2024-05-20T17:53:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f693bfff640 1 -- 172.21.15.6:0/3956823917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944037040 con 0x7f695406cf00 2024-05-20T17:53:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69541e9a30 con 0x7f695406cf00 2024-05-20T17:53:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.746+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69541e9ff0 con 0x7f695406cf00 2024-05-20T17:53:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.747+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69540735a0 con 0x7f695406cf00 2024-05-20T17:53:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.748+0000 7f693bfff640 1 -- 172.21.15.6:0/3956823917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6944044020 con 0x7f695406cf00 2024-05-20T17:53:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.748+0000 7f693bfff640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694006be60 0x7f694006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.748+0000 7f693bfff640 1 -- 172.21.15.6:0/3956823917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f69440ab9f0 con 0x7f695406cf00 2024-05-20T17:53:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.749+0000 7f6952ffd640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694006be60 0x7f694006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.749+0000 7f6952ffd640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694006be60 0x7f694006e370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f695415d230 tx=0x7f6948008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.753+0000 7f693bfff640 1 -- 172.21.15.6:0/3956823917 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f69540735a0 con 0x7f695406cf00 2024-05-20T17:53:12.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.977+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6954075b00 con 0x7f695406cf00 2024-05-20T17:53:12.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.978+0000 7f693bfff640 1 -- 172.21.15.6:0/3956823917 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5174 (secure 0 0 0) 0x7f694404b030 con 0x7f695406cf00 2024-05-20T17:53:12.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:12.977 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:11.999124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:53:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694006be60 msgr2=0x7f694006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694006be60 0x7f694006e370 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f695415d230 tx=0x7f6948008040 comp rx=0 tx=0).stop 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695406cf00 msgr2=0x7f695414acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695406cf00 0x7f695414acf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f694402a2b0 tx=0x7f69440046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 shutdown_connections 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694006be60 0x7f694006e370 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69540d4400 0x7f69541e8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540d2780 0x7f69541e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 --2- 172.21.15.6:0/3956823917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695406cf00 0x7f695414acf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 >> 172.21.15.6:0/3956823917 conn(0x7f69540d4bb0 msgr2=0x7f695415c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 shutdown_connections 2024-05-20T17:53:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:12.980+0000 7f6959e08640 1 -- 172.21.15.6:0/3956823917 wait complete. 2024-05-20T17:53:12.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.106+0000 7efd8dd2f640 1 Processor -- start 2024-05-20T17:53:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.106+0000 7efd8dd2f640 1 -- start start 2024-05-20T17:53:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.107+0000 7efd8dd2f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efd88162820 0x7efd880b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd8dd2f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd880d0630 con 0x7efd880b3e80 2024-05-20T17:53:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd8dd2f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd880d39c0 con 0x7efd8806dae0 2024-05-20T17:53:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd8dd2f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efd880d3ca0 con 0x7efd88162820 2024-05-20T17:53:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd86ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efd880b3e80 0x7efd8806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50728/0 (socket says 172.21.15.6:50728) 2024-05-20T17:53:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd86ffd640 1 -- 172.21.15.6:0/276681438 learned_addr learned my addr 172.21.15.6:0/276681438 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd877fe640 1 --2- 172.21.15.6:0/276681438 >> v2:172.21.15.171:3300/0 conn(0x7efd88162820 0x7efd880b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829618917 0 0) 0x7efd880d0630 con 0x7efd880b3e80 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd70003520 con 0x7efd880b3e80 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4042664838 0 0) 0x7efd70003520 con 0x7efd880b3e80 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 >> v2:172.21.15.171:3300/0 conn(0x7efd88162820 msgr2=0x7efd880b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 --2- 172.21.15.6:0/276681438 >> v2:172.21.15.171:3300/0 conn(0x7efd88162820 0x7efd880b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 >> v1:172.21.15.171:6789/0 conn(0x7efd8806dae0 legacy=0x7efd880b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd880d3f80 con 0x7efd880b3e80 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7efd7c001670 con 0x7efd880b3e80 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 >> v1:172.21.15.6:6789/0 conn(0x7efd880b3e80 legacy=0x7efd8806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd700039b0 0x7efd70003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd70004800 0x7efd70004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd700051c0 0x7efd7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd880d3ca0 con 0x7efd70004800 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efd7000c160 con 0x7efd700051c0 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.108+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd7000c360 con 0x7efd700039b0 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd86ffd640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd70004800 0x7efd70004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd877fe640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd700039b0 0x7efd70003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd87fff640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd700051c0 0x7efd7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd86ffd640 1 -- 172.21.15.6:0/276681438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd700039b0 msgr2=0x7efd70003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd86ffd640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd700039b0 0x7efd70003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd86ffd640 1 -- 172.21.15.6:0/276681438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd700051c0 msgr2=0x7efd7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd86ffd640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd700051c0 0x7efd7000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd87fff640 1 -- 172.21.15.6:0/276681438 reap_dead start 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.109+0000 7efd86ffd640 1 -- 172.21.15.6:0/276681438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd70003520 con 0x7efd70004800 2024-05-20T17:53:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd86ffd640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd70004800 0x7efd70004c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c240 tx=0x7efd70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afdf0695f6e2a65 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c007cf0 con 0x7efd70004800 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c0058d0 con 0x7efd70004800 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd867fc640 1 -- 172.21.15.6:0/276681438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c005ca0 con 0x7efd70004800 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd8dd2f640 1 -- 172.21.15.6:0/276681438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd70004800 msgr2=0x7efd70004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd8dd2f640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd70004800 0x7efd70004c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c240 tx=0x7efd70005830 comp rx=0 tx=0).stop 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd8dd2f640 1 -- 172.21.15.6:0/276681438 shutdown_connections 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd8dd2f640 1 --2- 172.21.15.6:0/276681438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd70004800 0x7efd70004c10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.110+0000 7efd8dd2f640 1 -- 172.21.15.6:0/276681438 >> 172.21.15.6:0/276681438 conn(0x7efd880d4bd0 msgr2=0x7efd880d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.111+0000 7efd8dd2f640 1 -- 172.21.15.6:0/276681438 shutdown_connections 2024-05-20T17:53:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.111+0000 7efd8dd2f640 1 -- 172.21.15.6:0/276681438 wait complete. 2024-05-20T17:53:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.112+0000 7efd8dd2f640 1 Processor -- start 2024-05-20T17:53:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.113+0000 7efd8dd2f640 1 -- start start 2024-05-20T17:53:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd8dd2f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd70004800 0x7efd880c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd8dd2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd880ac060 0x7efd8815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd8dd2f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd881f4f70 0x7efd881f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd8dd2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd880d4780 con 0x7efd880ac060 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd8dd2f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efd880d0300 con 0x7efd70004800 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd8dd2f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd880d4900 con 0x7efd881f4f70 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd880ac060 0x7efd8815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd880ac060 0x7efd8815da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44398/0 (socket says 172.21.15.6:44398) 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 -- 172.21.15.6:0/1508929802 learned_addr learned my addr 172.21.15.6:0/1508929802 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd87fff640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd881f4f70 0x7efd881f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd877fe640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd70004800 0x7efd880c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 -- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd881f4f70 msgr2=0x7efd881f5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd881f4f70 0x7efd881f5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 -- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd70004800 msgr2=0x7efd880c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd70004800 0x7efd880c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 -- 172.21.15.6:0/1508929802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd880ca8e0 con 0x7efd880ac060 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.114+0000 7efd86ffd640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd880ac060 0x7efd8815da90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c240 tx=0x7efd880d0800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.115+0000 7efd6ffff640 1 -- 172.21.15.6:0/1508929802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c040030 con 0x7efd880ac060 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.115+0000 7efd6ffff640 1 -- 172.21.15.6:0/1508929802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c0049f0 con 0x7efd880ac060 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.115+0000 7efd6ffff640 1 -- 172.21.15.6:0/1508929802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c001c30 con 0x7efd880ac060 2024-05-20T17:53:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.115+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd880cabc0 con 0x7efd880ac060 2024-05-20T17:53:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.115+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd880cb180 con 0x7efd880ac060 2024-05-20T17:53:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.116+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd880ca650 con 0x7efd880ac060 2024-05-20T17:53:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.116+0000 7efd6ffff640 1 -- 172.21.15.6:0/1508929802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd7c043070 con 0x7efd880ac060 2024-05-20T17:53:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.117+0000 7efd6ffff640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd7406be30 0x7efd7406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.117+0000 7efd6ffff640 1 -- 172.21.15.6:0/1508929802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efd7c038070 con 0x7efd880ac060 2024-05-20T17:53:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.117+0000 7efd877fe640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd7406be30 0x7efd7406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.117+0000 7efd877fe640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd7406be30 0x7efd7406e340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd78009c40 tx=0x7efd78009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.121+0000 7efd6ffff640 1 -- 172.21.15.6:0/1508929802 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd7c0791d0 con 0x7efd880ac060 2024-05-20T17:53:13.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.309+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd88075b00 con 0x7efd880ac060 2024-05-20T17:53:13.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.311+0000 7efd6ffff640 1 -- 172.21.15.6:0/1508929802 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7efd7c078ad0 con 0x7efd880ac060 2024-05-20T17:53:13.309 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:13.310 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:13.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd7406be30 msgr2=0x7efd7406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd7406be30 0x7efd7406e340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd78009c40 tx=0x7efd78009190 comp rx=0 tx=0).stop 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd880ac060 msgr2=0x7efd8815da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd880ac060 0x7efd8815da90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c240 tx=0x7efd880d0800 comp rx=0 tx=0).stop 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 shutdown_connections 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd7406be30 0x7efd7406e340 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd881f4f70 0x7efd881f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd880ac060 0x7efd8815da90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 --2- 172.21.15.6:0/1508929802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd70004800 0x7efd880c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 >> 172.21.15.6:0/1508929802 conn(0x7efd880d4bd0 msgr2=0x7efd88161bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 shutdown_connections 2024-05-20T17:53:13.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.313+0000 7efd8dd2f640 1 -- 172.21.15.6:0/1508929802 wait complete. 2024-05-20T17:53:13.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:13.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.439+0000 7f327d31d640 1 Processor -- start 2024-05-20T17:53:13.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.439+0000 7f327d31d640 1 -- start start 2024-05-20T17:53:13.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f327d31d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f327806dce0 0x7f32780d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f327d31d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32780d1d30 0x7f32780b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f327d31d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f327815dcd0 con 0x7f32781435f0 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f327d31d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f327815dfb0 con 0x7f32780d1d30 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f327d31d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f327815e290 con 0x7f327806dce0 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f32777fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32780d1d30 0x7f32780b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f3276ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f32781435f0 0x7f327815d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50742/0 (socket says 172.21.15.6:50742) 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f3276ffd640 1 -- 172.21.15.6:0/233211411 learned_addr learned my addr 172.21.15.6:0/233211411 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.440+0000 7f32767fc640 1 --2- 172.21.15.6:0/233211411 >> v2:172.21.15.171:3300/0 conn(0x7f327806dce0 0x7f32780d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.441+0000 7f32777fe640 1 -- 172.21.15.6:0/233211411 >> v2:172.21.15.171:3300/0 conn(0x7f327806dce0 msgr2=0x7f32780d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.441+0000 7f32777fe640 1 --2- 172.21.15.6:0/233211411 >> v2:172.21.15.171:3300/0 conn(0x7f327806dce0 0x7f32780d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.441+0000 7f32777fe640 1 -- 172.21.15.6:0/233211411 >> v1:172.21.15.6:6789/0 conn(0x7f32781435f0 legacy=0x7f327815d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.441+0000 7f32777fe640 1 -- 172.21.15.6:0/233211411 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32780b1390 con 0x7f32780d1d30 2024-05-20T17:53:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.441+0000 7f3275ffb640 1 -- 172.21.15.6:0/233211411 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642793521 0 0) 0x7f327815dcd0 con 0x7f32781435f0 2024-05-20T17:53:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.441+0000 7f32777fe640 1 --2- 172.21.15.6:0/233211411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32780d1d30 0x7f32780b18b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3278073320 tx=0x7f326802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82c663c552a01a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f3275ffb640 1 -- 172.21.15.6:0/233211411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268037070 con 0x7f32780d1d30 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f3275ffb640 1 -- 172.21.15.6:0/233211411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3268032440 con 0x7f32780d1d30 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f3275ffb640 1 -- 172.21.15.6:0/233211411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326802ae60 con 0x7f32780d1d30 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f327d31d640 1 -- 172.21.15.6:0/233211411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32780d1d30 msgr2=0x7f32780b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f327d31d640 1 --2- 172.21.15.6:0/233211411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32780d1d30 0x7f32780b18b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3278073320 tx=0x7f326802a110 comp rx=0 tx=0).stop 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f327d31d640 1 -- 172.21.15.6:0/233211411 shutdown_connections 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f327d31d640 1 --2- 172.21.15.6:0/233211411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32780d1d30 0x7f32780b18b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f327d31d640 1 --2- 172.21.15.6:0/233211411 >> v2:172.21.15.171:3300/0 conn(0x7f327806dce0 0x7f32780d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f327d31d640 1 -- 172.21.15.6:0/233211411 >> 172.21.15.6:0/233211411 conn(0x7f32780b6620 msgr2=0x7f32780b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f327d31d640 1 -- 172.21.15.6:0/233211411 shutdown_connections 2024-05-20T17:53:13.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.442+0000 7f327d31d640 1 -- 172.21.15.6:0/233211411 wait complete. 2024-05-20T17:53:13.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.444+0000 7f327d31d640 1 Processor -- start 2024-05-20T17:53:13.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.444+0000 7f327d31d640 1 -- start start 2024-05-20T17:53:13.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f327d31d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327806dce0 0x7f3278158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f327d31d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32780d1d30 0x7f3278140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f327d31d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32781589a0 0x7f3278158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f327d31d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f32780b1f70 con 0x7f327806dce0 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f327d31d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32780b1df0 con 0x7f32780d1d30 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f327d31d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32780b20f0 con 0x7f32781589a0 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327806dce0 0x7f3278158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327806dce0 0x7f3278158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44418/0 (socket says 172.21.15.6:44418) 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 -- 172.21.15.6:0/1371590800 learned_addr learned my addr 172.21.15.6:0/1371590800 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f32767fc640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32780d1d30 0x7f3278140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f32777fe640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32781589a0 0x7f3278158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 -- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32781589a0 msgr2=0x7f3278158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32781589a0 0x7f3278158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 -- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32780d1d30 msgr2=0x7f3278140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32780d1d30 0x7f3278140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 -- 172.21.15.6:0/1371590800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32781592f0 con 0x7f327806dce0 2024-05-20T17:53:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f32767fc640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32780d1d30 0x7f3278140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f32777fe640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32781589a0 0x7f3278158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f3276ffd640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327806dce0 0x7f3278158200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f327000c780 tx=0x7f327000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f326f7fe640 1 -- 172.21.15.6:0/1371590800 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270018070 con 0x7f327806dce0 2024-05-20T17:53:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f326f7fe640 1 -- 172.21.15.6:0/1371590800 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327000a640 con 0x7f327806dce0 2024-05-20T17:53:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327809f6f0 con 0x7f327806dce0 2024-05-20T17:53:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f326f7fe640 1 -- 172.21.15.6:0/1371590800 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327000aa30 con 0x7f327806dce0 2024-05-20T17:53:13.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.446+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327809c750 con 0x7f327806dce0 2024-05-20T17:53:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.448+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3278075b00 con 0x7f327806dce0 2024-05-20T17:53:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.448+0000 7f326f7fe640 1 -- 172.21.15.6:0/1371590800 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f327001b070 con 0x7f327806dce0 2024-05-20T17:53:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.449+0000 7f326f7fe640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f325806be30 0x7f325806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.449+0000 7f326f7fe640 1 -- 172.21.15.6:0/1371590800 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f327008a7d0 con 0x7f327806dce0 2024-05-20T17:53:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.449+0000 7f32767fc640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f325806be30 0x7f325806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.449+0000 7f32767fc640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f325806be30 0x7f325806e340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f327815c4a0 tx=0x7f3260008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.453+0000 7f326f7fe640 1 -- 172.21.15.6:0/1371590800 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f32781592f0 con 0x7f327806dce0 2024-05-20T17:53:13.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.643+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3278158740 con 0x7f327806dce0 2024-05-20T17:53:13.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.644+0000 7f326f7fe640 1 -- 172.21.15.6:0/1371590800 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f3270058e40 con 0x7f327806dce0 2024-05-20T17:53:13.643 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:13.643 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f325806be30 msgr2=0x7f325806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f325806be30 0x7f325806e340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f327815c4a0 tx=0x7f3260008040 comp rx=0 tx=0).stop 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327806dce0 msgr2=0x7f3278158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327806dce0 0x7f3278158200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f327000c780 tx=0x7f327000cc40 comp rx=0 tx=0).stop 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 shutdown_connections 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f325806be30 0x7f325806e340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32781589a0 0x7f3278158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32780d1d30 0x7f3278140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 --2- 172.21.15.6:0/1371590800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f327806dce0 0x7f3278158200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 >> 172.21.15.6:0/1371590800 conn(0x7f32780b6620 msgr2=0x7f327806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:13.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 shutdown_connections 2024-05-20T17:53:13.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.646+0000 7f327d31d640 1 -- 172.21.15.6:0/1371590800 wait complete. 2024-05-20T17:53:13.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:53:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.789+0000 7f64722fe640 1 Processor -- start 2024-05-20T17:53:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.789+0000 7f64722fe640 1 -- start start 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.790+0000 7f64722fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f646c0b4010 0x7f646c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.790+0000 7f64722fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0d14b0 0x7f646c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.790+0000 7f64722fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646c0d0370 con 0x7f646c163a10 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.790+0000 7f64722fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f646c0d3ca0 con 0x7f646c0b4010 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.790+0000 7f64722fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f646c0d0650 con 0x7f646c0d14b0 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f6463fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f646c0b4010 0x7f646c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f647089b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0d14b0 0x7f646c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f6463fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f646c0b4010 0x7f646c0d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:40676/0 (socket says 172.21.15.6:40676) 2024-05-20T17:53:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f6463fff640 1 -- 172.21.15.6:0/563314357 learned_addr learned my addr 172.21.15.6:0/563314357 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f6463fff640 1 -- 172.21.15.6:0/563314357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0d14b0 msgr2=0x7f646c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f6463fff640 1 --2- 172.21.15.6:0/563314357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0d14b0 0x7f646c0d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f6463fff640 1 -- 172.21.15.6:0/563314357 >> v1:172.21.15.171:6789/0 conn(0x7f646c163a10 legacy=0x7f646c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f6463fff640 1 -- 172.21.15.6:0/563314357 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c0d3650 con 0x7f646c0b4010 2024-05-20T17:53:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.791+0000 7f647089b640 1 --2- 172.21.15.6:0/563314357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0d14b0 0x7f646c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.792+0000 7f6463fff640 1 --2- 172.21.15.6:0/563314357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0b4010 0x7f646c0d4130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6454009870 tx=0x7f645402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52de474532ba448b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.792+0000 7f646b7fe640 1 -- 172.21.15.6:0/563314357 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454037070 con 0x7f646c0b4010 2024-05-20T17:53:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.792+0000 7f646b7fe640 1 -- 172.21.15.6:0/563314357 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454032440 con 0x7f646c0b4010 2024-05-20T17:53:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.792+0000 7f646b7fe640 1 -- 172.21.15.6:0/563314357 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454032810 con 0x7f646c0b4010 2024-05-20T17:53:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.793+0000 7f64722fe640 1 -- 172.21.15.6:0/563314357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0b4010 msgr2=0x7f646c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.793+0000 7f64722fe640 1 --2- 172.21.15.6:0/563314357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0b4010 0x7f646c0d4130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6454009870 tx=0x7f645402a270 comp rx=0 tx=0).stop 2024-05-20T17:53:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.793+0000 7f64722fe640 1 -- 172.21.15.6:0/563314357 shutdown_connections 2024-05-20T17:53:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.793+0000 7f64722fe640 1 --2- 172.21.15.6:0/563314357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0d14b0 0x7f646c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.793+0000 7f64722fe640 1 --2- 172.21.15.6:0/563314357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0b4010 0x7f646c0d4130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.793+0000 7f64722fe640 1 -- 172.21.15.6:0/563314357 >> 172.21.15.6:0/563314357 conn(0x7f646c06d240 msgr2=0x7f646c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.793+0000 7f64722fe640 1 -- 172.21.15.6:0/563314357 shutdown_connections 2024-05-20T17:53:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.793+0000 7f64722fe640 1 -- 172.21.15.6:0/563314357 wait complete. 2024-05-20T17:53:13.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.795+0000 7f64722fe640 1 Processor -- start 2024-05-20T17:53:13.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.795+0000 7f64722fe640 1 -- start start 2024-05-20T17:53:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f64722fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0b4010 0x7f646c160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f64722fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0d14b0 0x7f646c0ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f64722fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c163a10 0x7f646c1f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f64722fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f646c0b8210 con 0x7f646c163a10 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f64722fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f646c0d1e00 con 0x7f646c0d14b0 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f64722fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f646c0b8390 con 0x7f646c0b4010 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f647089b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c163a10 0x7f646c1f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f647089b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c163a10 0x7f646c1f8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44420/0 (socket says 172.21.15.6:44420) 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f647089b640 1 -- 172.21.15.6:0/4045844469 learned_addr learned my addr 172.21.15.6:0/4045844469 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f6463fff640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0d14b0 0x7f646c0ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.796+0000 7f646bfff640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0b4010 0x7f646c160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f6463fff640 1 -- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0b4010 msgr2=0x7f646c160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f6463fff640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0b4010 0x7f646c160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f6463fff640 1 -- 172.21.15.6:0/4045844469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c163a10 msgr2=0x7f646c1f8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f6463fff640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c163a10 0x7f646c1f8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f6463fff640 1 -- 172.21.15.6:0/4045844469 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c160b70 con 0x7f646c0d14b0 2024-05-20T17:53:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f647089b640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c163a10 0x7f646c1f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f6463fff640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0d14b0 0x7f646c0ab760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6454031000 tx=0x7f64540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f64697fa640 1 -- 172.21.15.6:0/4045844469 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454041020 con 0x7f646c0d14b0 2024-05-20T17:53:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f64697fa640 1 -- 172.21.15.6:0/4045844469 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454030640 con 0x7f646c0d14b0 2024-05-20T17:53:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646c160e50 con 0x7f646c0d14b0 2024-05-20T17:53:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f64697fa640 1 -- 172.21.15.6:0/4045844469 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454037040 con 0x7f646c0d14b0 2024-05-20T17:53:13.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.797+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646c161410 con 0x7f646c0d14b0 2024-05-20T17:53:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.798+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646c0d23e0 con 0x7f646c0d14b0 2024-05-20T17:53:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.799+0000 7f64697fa640 1 -- 172.21.15.6:0/4045844469 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6454044020 con 0x7f646c0d14b0 2024-05-20T17:53:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.799+0000 7f64697fa640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f644c06be30 0x7f644c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.799+0000 7f64697fa640 1 -- 172.21.15.6:0/4045844469 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f64540ab860 con 0x7f646c0d14b0 2024-05-20T17:53:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.800+0000 7f646bfff640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f644c06be30 0x7f644c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.800+0000 7f646bfff640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f644c06be30 0x7f644c06e340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f646c0d3020 tx=0x7f645c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:13.805+0000 7f64697fa640 1 -- 172.21.15.6:0/4045844469 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f646c0d23e0 con 0x7f646c0d14b0 2024-05-20T17:53:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.029+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f646c160900 con 0x7f646c0d14b0 2024-05-20T17:53:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.030+0000 7f64697fa640 1 -- 172.21.15.6:0/4045844469 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5174 (secure 0 0 0) 0x7f645404b030 con 0x7f646c0d14b0 2024-05-20T17:53:14.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:14.029 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:11.999124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:53:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2024-05-20T17:53:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f644c06be30 msgr2=0x7f644c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f644c06be30 0x7f644c06e340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f646c0d3020 tx=0x7f645c009040 comp rx=0 tx=0).stop 2024-05-20T17:53:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0d14b0 msgr2=0x7f646c0ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0d14b0 0x7f646c0ab760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6454031000 tx=0x7f64540046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 shutdown_connections 2024-05-20T17:53:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f644c06be30 0x7f644c06e340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f646c163a10 0x7f646c1f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f646c0d14b0 0x7f646c0ab760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 --2- 172.21.15.6:0/4045844469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f646c0b4010 0x7f646c160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 >> 172.21.15.6:0/4045844469 conn(0x7f646c06d240 msgr2=0x7f646c0b9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 shutdown_connections 2024-05-20T17:53:14.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.032+0000 7f64722fe640 1 -- 172.21.15.6:0/4045844469 wait complete. 2024-05-20T17:53:14.042 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.157+0000 7fa47662b640 1 Processor -- start 2024-05-20T17:53:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.157+0000 7fa47662b640 1 -- start start 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa47662b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa47015f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa47662b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa47006cf00 0x7fa47006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa47662b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa47008d2a0 con 0x7fa4700d2780 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa47662b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa4700d3f70 con 0x7fa47006cf00 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa47662b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa47006d850 con 0x7fa4700d4400 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa46f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa47006cf00 0x7fa47006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa474bc8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa4700d2780 0x7fa4700d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50748/0 (socket says 172.21.15.6:50748) 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa46f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa47006cf00 0x7fa47006d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44422/0 (socket says 172.21.15.6:44422) 2024-05-20T17:53:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa474bc8640 1 -- 172.21.15.6:0/993956278 learned_addr learned my addr 172.21.15.6:0/993956278 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa46ffff640 1 --2- 172.21.15.6:0/993956278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa47015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa46f7fe640 1 -- 172.21.15.6:0/993956278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 msgr2=0x7fa47015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa46f7fe640 1 --2- 172.21.15.6:0/993956278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa47015f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa46f7fe640 1 -- 172.21.15.6:0/993956278 >> v1:172.21.15.6:6789/0 conn(0x7fa4700d2780 legacy=0x7fa4700d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa46effd640 1 -- 172.21.15.6:0/993956278 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422342699 0 0) 0x7fa468001490 con 0x7fa4700d2780 2024-05-20T17:53:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.159+0000 7fa46f7fe640 1 -- 172.21.15.6:0/993956278 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4700d4810 con 0x7fa47006cf00 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.160+0000 7fa46f7fe640 1 --2- 172.21.15.6:0/993956278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47006cf00 0x7fa47006d310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4640097a0 tx=0x7fa46402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75380ae98fca647a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.160+0000 7fa46effd640 1 -- 172.21.15.6:0/993956278 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464037070 con 0x7fa47006cf00 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.160+0000 7fa46effd640 1 -- 172.21.15.6:0/993956278 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa464032440 con 0x7fa47006cf00 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.160+0000 7fa46effd640 1 -- 172.21.15.6:0/993956278 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464032810 con 0x7fa47006cf00 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.161+0000 7fa47662b640 1 -- 172.21.15.6:0/993956278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47006cf00 msgr2=0x7fa47006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.161+0000 7fa47662b640 1 --2- 172.21.15.6:0/993956278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47006cf00 0x7fa47006d310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4640097a0 tx=0x7fa46402a210 comp rx=0 tx=0).stop 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.161+0000 7fa47662b640 1 -- 172.21.15.6:0/993956278 shutdown_connections 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.161+0000 7fa47662b640 1 --2- 172.21.15.6:0/993956278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa47006cf00 0x7fa47006d310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.161+0000 7fa47662b640 1 --2- 172.21.15.6:0/993956278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa47015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.161+0000 7fa47662b640 1 -- 172.21.15.6:0/993956278 >> 172.21.15.6:0/993956278 conn(0x7fa4700d4bb0 msgr2=0x7fa4700d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.161+0000 7fa47662b640 1 -- 172.21.15.6:0/993956278 shutdown_connections 2024-05-20T17:53:14.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.161+0000 7fa47662b640 1 -- 172.21.15.6:0/993956278 wait complete. 2024-05-20T17:53:14.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.163+0000 7fa47662b640 1 Processor -- start 2024-05-20T17:53:14.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.163+0000 7fa47662b640 1 -- start start 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa47662b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa47006cf00 0x7fa4701479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa47662b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4700d2780 0x7fa470147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa47662b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa4701f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa47662b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa4700d3920 con 0x7fa4700d2780 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa47662b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa4700d3640 con 0x7fa47006cf00 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa47662b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa4700d3c00 con 0x7fa4700d4400 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa46f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4700d2780 0x7fa470147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa46f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4700d2780 0x7fa470147f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44424/0 (socket says 172.21.15.6:44424) 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.164+0000 7fa46f7fe640 1 -- 172.21.15.6:0/4000969977 learned_addr learned my addr 172.21.15.6:0/4000969977 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa474bc8640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa4701f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46ffff640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa47006cf00 0x7fa4701479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46f7fe640 1 -- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 msgr2=0x7fa4701f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46f7fe640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa4701f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46f7fe640 1 -- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa47006cf00 msgr2=0x7fa4701479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46f7fe640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa47006cf00 0x7fa4701479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46f7fe640 1 -- 172.21.15.6:0/4000969977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47015a350 con 0x7fa4700d2780 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46ffff640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa47006cf00 0x7fa4701479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa474bc8640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa4701f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46f7fe640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4700d2780 0x7fa470147f00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa464000c00 tx=0x7fa4640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46cff9640 1 -- 172.21.15.6:0/4000969977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464037040 con 0x7fa4700d2780 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46cff9640 1 -- 172.21.15.6:0/4000969977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa464042070 con 0x7fa4700d2780 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa46cff9640 1 -- 172.21.15.6:0/4000969977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464030940 con 0x7fa4700d2780 2024-05-20T17:53:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4701e8700 con 0x7fa4700d2780 2024-05-20T17:53:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.165+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4701e8cc0 con 0x7fa4700d2780 2024-05-20T17:53:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.166+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4700735a0 con 0x7fa4700d2780 2024-05-20T17:53:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.167+0000 7fa46cff9640 1 -- 172.21.15.6:0/4000969977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa464030ae0 con 0x7fa4700d2780 2024-05-20T17:53:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.167+0000 7fa46cff9640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa45c06be30 0x7fa45c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.168+0000 7fa46cff9640 1 -- 172.21.15.6:0/4000969977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa4640abaf0 con 0x7fa4700d2780 2024-05-20T17:53:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.168+0000 7fa46ffff640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa45c06be30 0x7fa45c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.168+0000 7fa46ffff640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa45c06be30 0x7fa45c06e340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa460009a20 tx=0x7fa460008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.172+0000 7fa46cff9640 1 -- 172.21.15.6:0/4000969977 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa4700735a0 con 0x7fa4700d2780 2024-05-20T17:53:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.359+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa470075b00 con 0x7fa4700d2780 2024-05-20T17:53:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.360+0000 7fa46cff9640 1 -- 172.21.15.6:0/4000969977 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fa47015a350 con 0x7fa4700d2780 2024-05-20T17:53:14.359 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:14.359 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa45c06be30 msgr2=0x7fa45c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa45c06be30 0x7fa45c06e340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa460009a20 tx=0x7fa460008040 comp rx=0 tx=0).stop 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4700d2780 msgr2=0x7fa470147f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4700d2780 0x7fa470147f00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa464000c00 tx=0x7fa4640046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 shutdown_connections 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa45c06be30 0x7fa45c06e340 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4700d4400 0x7fa4701f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4700d2780 0x7fa470147f00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 --2- 172.21.15.6:0/4000969977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa47006cf00 0x7fa4701479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 >> 172.21.15.6:0/4000969977 conn(0x7fa4700d4bb0 msgr2=0x7fa47015fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 shutdown_connections 2024-05-20T17:53:14.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.362+0000 7fa47662b640 1 -- 172.21.15.6:0/4000969977 wait complete. 2024-05-20T17:53:14.774 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T17:53:06.937522+0000', 'modified': '2024-05-20T17:53:11.999124+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6833/2802786337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 2802786337}, {'type': 'v1', 'addr': '172.21.15.6:6833', 'nonce': 2802786337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-05-20T17:53:14.774 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T17:53:14.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-20T17:53:14.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.897+0000 7fe707eaf640 1 Processor -- start 2024-05-20T17:53:14.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.897+0000 7fe707eaf640 1 -- start start 2024-05-20T17:53:14.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.898+0000 7fe707eaf640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe7000cd680 0x7fe70015f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.898+0000 7fe707eaf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe70006c6c0 0x7fe70006cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.898+0000 7fe707eaf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe7000cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.898+0000 7fe707eaf640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe7000cda90 con 0x7fe70006c6c0 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.898+0000 7fe707eaf640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe70015f760 con 0x7fe7000cd680 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.898+0000 7fe707eaf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe7000cfd20 con 0x7fe7000cf3d0 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.898+0000 7fe70544a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe70006c6c0 0x7fe70006cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe70544a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe70006c6c0 0x7fe70006cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44426/0 (socket says 172.21.15.6:44426) 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe70544a640 1 -- 172.21.15.6:0/3653119362 learned_addr learned my addr 172.21.15.6:0/3653119362 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe705c4b640 1 --2- 172.21.15.6:0/3653119362 >> v2:172.21.15.171:3300/0 conn(0x7fe7000cd680 0x7fe70015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe70644c640 1 --2- 172.21.15.6:0/3653119362 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe7000cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe70544a640 1 -- 172.21.15.6:0/3653119362 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 msgr2=0x7fe7000cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe70544a640 1 --2- 172.21.15.6:0/3653119362 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe7000cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe70544a640 1 -- 172.21.15.6:0/3653119362 >> v2:172.21.15.171:3300/0 conn(0x7fe7000cd680 msgr2=0x7fe70015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe70544a640 1 --2- 172.21.15.6:0/3653119362 >> v2:172.21.15.171:3300/0 conn(0x7fe7000cd680 0x7fe70015f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.899+0000 7fe70544a640 1 -- 172.21.15.6:0/3653119362 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70006d0f0 con 0x7fe70006c6c0 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe70544a640 1 --2- 172.21.15.6:0/3653119362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe70006c6c0 0x7fe70006cad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe70008baf0 tx=0x7fe6f002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8effb85a3143b63d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe704c49640 1 -- 172.21.15.6:0/3653119362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0037070 con 0x7fe70006c6c0 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe704c49640 1 -- 172.21.15.6:0/3653119362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f0032440 con 0x7fe70006c6c0 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe704c49640 1 -- 172.21.15.6:0/3653119362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0032810 con 0x7fe70006c6c0 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe707eaf640 1 -- 172.21.15.6:0/3653119362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe70006c6c0 msgr2=0x7fe70006cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe707eaf640 1 --2- 172.21.15.6:0/3653119362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe70006c6c0 0x7fe70006cad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe70008baf0 tx=0x7fe6f002a140 comp rx=0 tx=0).stop 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe707eaf640 1 -- 172.21.15.6:0/3653119362 shutdown_connections 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe707eaf640 1 --2- 172.21.15.6:0/3653119362 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe7000cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe707eaf640 1 --2- 172.21.15.6:0/3653119362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe70006c6c0 0x7fe70006cad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe707eaf640 1 --2- 172.21.15.6:0/3653119362 >> v2:172.21.15.171:3300/0 conn(0x7fe7000cd680 0x7fe70015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.900+0000 7fe707eaf640 1 -- 172.21.15.6:0/3653119362 >> 172.21.15.6:0/3653119362 conn(0x7fe7000b44d0 msgr2=0x7fe7000b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.901+0000 7fe707eaf640 1 -- 172.21.15.6:0/3653119362 shutdown_connections 2024-05-20T17:53:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.901+0000 7fe707eaf640 1 -- 172.21.15.6:0/3653119362 wait complete. 2024-05-20T17:53:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.902+0000 7fe707eaf640 1 Processor -- start 2024-05-20T17:53:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.902+0000 7fe707eaf640 1 -- start start 2024-05-20T17:53:14.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe707eaf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe70006c6c0 0x7fe7000c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe707eaf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000cd680 0x7fe700151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe707eaf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe70015f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe707eaf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe7000d0b40 con 0x7fe7000cd680 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe707eaf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe70006d450 con 0x7fe70006c6c0 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe707eaf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe70006d990 con 0x7fe7000cf3d0 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000cd680 0x7fe700151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000cd680 0x7fe700151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44438/0 (socket says 172.21.15.6:44438) 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 -- 172.21.15.6:0/2687977297 learned_addr learned my addr 172.21.15.6:0/2687977297 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70644c640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe70015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe705c4b640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe70006c6c0 0x7fe7000c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 -- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 msgr2=0x7fe70015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe70015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 -- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe70006c6c0 msgr2=0x7fe7000c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe70006c6c0 0x7fe7000c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 -- 172.21.15.6:0/2687977297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7000c7410 con 0x7fe7000cd680 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe705c4b640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe70006c6c0 0x7fe7000c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70644c640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe70015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe70544a640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000cd680 0x7fe700151f50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe6f002a180 tx=0x7fe6f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.904+0000 7fe6f67fc640 1 -- 172.21.15.6:0/2687977297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0041020 con 0x7fe7000cd680 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.905+0000 7fe6f67fc640 1 -- 172.21.15.6:0/2687977297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f00306c0 con 0x7fe7000cd680 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.905+0000 7fe707eaf640 1 -- 172.21.15.6:0/2687977297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7000c76f0 con 0x7fe7000cd680 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.905+0000 7fe6f67fc640 1 -- 172.21.15.6:0/2687977297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0037040 con 0x7fe7000cd680 2024-05-20T17:53:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.905+0000 7fe707eaf640 1 -- 172.21.15.6:0/2687977297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7000c7cb0 con 0x7fe7000cd680 2024-05-20T17:53:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.906+0000 7fe6f67fc640 1 -- 172.21.15.6:0/2687977297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6f0044020 con 0x7fe7000cd680 2024-05-20T17:53:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.907+0000 7fe6f67fc640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6e406be30 0x7fe6e406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.907+0000 7fe6f67fc640 1 -- 172.21.15.6:0/2687977297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe6f00ab9a0 con 0x7fe7000cd680 2024-05-20T17:53:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.907+0000 7fe705c4b640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6e406be30 0x7fe6e406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.908+0000 7fe705c4b640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6e406be30 0x7fe6e406e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc006fd0 tx=0x7fe6fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.908+0000 7fe70ee32740 1 Processor -- start 2024-05-20T17:53:14.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.908+0000 7fe70ee32740 1 -- start start 2024-05-20T17:53:14.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d89b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 0x56375d8980a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d871360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70ee32740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56375d7d44d0 con 0x56375d4af590 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70ee32740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56375d77c3e0 con 0x56375d4d0270 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70ee32740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x56375d7d0490 con 0x56375d4a73b0 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70644c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d871360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70644c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d871360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44450/0 (socket says 172.21.15.6:44450) 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70644c640 1 -- 172.21.15.6:0/602874488 learned_addr learned my addr 172.21.15.6:0/602874488 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe70544a640 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 0x56375d8980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.909+0000 7fe705c4b640 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d89b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe70644c640 1 -- 172.21.15.6:0/602874488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 msgr2=0x56375d8980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe70644c640 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 0x56375d8980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe70644c640 1 -- 172.21.15.6:0/602874488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 msgr2=0x56375d89b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe70644c640 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d89b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe70644c640 1 -- 172.21.15.6:0/602874488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375d4e82d0 con 0x56375d4af590 2024-05-20T17:53:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe70644c640 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d871360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80073e0 tx=0x7fe6f80078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bea41983148c057 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe6e37fe640 1 -- 172.21.15.6:0/602874488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80147e0 con 0x56375d4af590 2024-05-20T17:53:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe6e37fe640 1 -- 172.21.15.6:0/602874488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f801a070 con 0x56375d4af590 2024-05-20T17:53:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.910+0000 7fe6e37fe640 1 -- 172.21.15.6:0/602874488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8014bc0 con 0x56375d4af590 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 -- 172.21.15.6:0/602874488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 msgr2=0x56375d871360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d871360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80073e0 tx=0x7fe6f80078a0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 -- 172.21.15.6:0/602874488 shutdown_connections 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d871360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 0x56375d8980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 --2- 172.21.15.6:0/602874488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d89b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 -- 172.21.15.6:0/602874488 >> 172.21.15.6:0/602874488 conn(0x56375d4c43c0 msgr2=0x56375d870af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 -- 172.21.15.6:0/602874488 shutdown_connections 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.911+0000 7fe70ee32740 1 -- 172.21.15.6:0/602874488 wait complete. 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.912+0000 7fe70ee32740 1 -- start start 2024-05-20T17:53:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.912+0000 7fe70ee32740 1 Processor -- start 2024-05-20T17:53:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4a73b0 0x56375d8839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4af590 0x56375d899e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 0x56375d880260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe70ee32740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56375d78f8e0 con 0x56375d4a73b0 2024-05-20T17:53:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe70ee32740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56375d89e830 con 0x56375d4af590 2024-05-20T17:53:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe70ee32740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x56375d89a8b0 con 0x56375d4d0270 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe70ee32740 10 client.0 _ll_register_callbacks cb 0x56375d75c9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe705c4b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4a73b0 0x56375d8839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe705c4b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4a73b0 0x56375d8839d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44458/0 (socket says 172.21.15.6:44458) 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.913+0000 7fe705c4b640 1 -- 172.21.15.6:0/2029949146 learned_addr learned my addr 172.21.15.6:0/2029949146 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe705c4b640 1 -- 172.21.15.6:0/2029949146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 msgr2=0x56375d880260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe70644c640 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 0x56375d880260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe70544a640 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4af590 0x56375d899e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe705c4b640 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 0x56375d880260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe705c4b640 1 -- 172.21.15.6:0/2029949146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4af590 msgr2=0x56375d899e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe705c4b640 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4af590 0x56375d899e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe705c4b640 1 -- 172.21.15.6:0/2029949146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56375d5b26b0 con 0x56375d4a73b0 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe705c4b640 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4a73b0 0x56375d8839d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc014510 tx=0x7fe6fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f42badb0eea72cc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe6e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/2029949146 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc025070 con 0x56375d4a73b0 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/2029949146 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe6fc0159a0 con 0x56375d4a73b0 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe70ee32740 1 -- 172.21.15.6:0/2029949146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f801a070 con 0x56375d4a73b0 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/2029949146 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe6fc030050 con 0x56375d4a73b0 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe70ee32740 10 client.4443 fetch_fsmap learned FSMap version 7 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe70ee32740 1 -- 172.21.15.6:0/2029949146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x56375d883f10 con 0x56375d4a73b0 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/2029949146 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f801a070 con 0x56375d4a73b0 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/2029949146 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fe6fc033020 con 0x56375d4a73b0 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.914+0000 7fe70ee32740 10 client.4443 fetch_fsmap finished waiting for FSMap version 7 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.915+0000 7fe70ee32740 10 client.4443 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.915+0000 7fe70ee32740 20 client.4443 populate_metadata read hostname 'smithi006' 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.915+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56375d48ee40 0x56375d8c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.915+0000 7fe70ee32740 4 client.4443 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.915+0000 7fe70ee32740 1 -- 172.21.15.6:0/2029949146 --> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56375d7e1c00 con 0x56375d48ee40 2024-05-20T17:53:14.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.915+0000 7fe70544a640 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56375d48ee40 0x56375d8c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.915+0000 7fe6e0ff9640 10 client.4443 ms_handle_connect on v2:172.21.15.6:6832/2802786337 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.915+0000 7fe70544a640 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56375d48ee40 0x56375d8c8fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aaa6919890c2387 server_cookie=c7fededa3bb956a6 in_seq=0 out_seq=0 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/2029949146 <== mds.0 v2:172.21.15.6:6832/2802786337 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56375d7e1c00 con 0x56375d48ee40 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe6e0ff9640 10 client.4443 handle_command_reply: tid=0 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 client.4443 shutdown 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 -- 172.21.15.6:0/2029949146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4a73b0 msgr2=0x56375d8839d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4a73b0 0x56375d8839d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc014510 tx=0x7fe6fc0046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 -- 172.21.15.6:0/2029949146 shutdown_connections 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56375d48ee40 0x56375d8c8fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 0x56375d880260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4af590 0x56375d899e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe6e0ff9640 0 client.4443 ms_handle_reset on v2:172.21.15.6:6832/2802786337 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2029949146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4a73b0 0x56375d8839d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 -- 172.21.15.6:0/2029949146 >> 172.21.15.6:0/2029949146 conn(0x56375d4c43c0 msgr2=0x56375d86fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 -- 172.21.15.6:0/2029949146 shutdown_connections 2024-05-20T17:53:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 1 -- 172.21.15.6:0/2029949146 wait complete. 2024-05-20T17:53:14.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.916+0000 7fe70ee32740 20 client.4443 trim_cache size 0 max 16384 2024-05-20T17:53:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.935+0000 7fe70ee32740 1 Processor -- start 2024-05-20T17:53:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.935+0000 7fe70ee32740 1 -- start start 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4a73b0 0x56375d883570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d8b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 0x56375d8b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70ee32740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe700202360 con 0x56375d4af590 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70ee32740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe7002016f0 con 0x56375d4a73b0 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70ee32740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe700201d40 con 0x56375d4d0270 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d8b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d8b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44474/0 (socket says 172.21.15.6:44474) 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 -- 172.21.15.6:0/2454296437 learned_addr learned my addr 172.21.15.6:0/2454296437 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe705c4b640 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4a73b0 0x56375d883570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70644c640 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 0x56375d8b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 -- 172.21.15.6:0/2454296437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 msgr2=0x56375d8b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 0x56375d8b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 -- 172.21.15.6:0/2454296437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4a73b0 msgr2=0x56375d883570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4a73b0 0x56375d883570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 -- 172.21.15.6:0/2454296437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375d8b2d70 con 0x56375d4af590 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe70544a640 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d8b22f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00798a0 tx=0x7fe6f00a9a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a6f32b3eb1dfcf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe6e2ffd640 1 -- 172.21.15.6:0/2454296437 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f007dcc0 con 0x56375d4af590 2024-05-20T17:53:14.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe6e2ffd640 1 -- 172.21.15.6:0/2454296437 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f007ee50 con 0x56375d4af590 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.937+0000 7fe6e2ffd640 1 -- 172.21.15.6:0/2454296437 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f00824f0 con 0x56375d4af590 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 -- 172.21.15.6:0/2454296437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 msgr2=0x56375d8b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d8b22f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00798a0 tx=0x7fe6f00a9a60 comp rx=0 tx=0).stop 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 -- 172.21.15.6:0/2454296437 shutdown_connections 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4d0270 0x56375d8b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d8b22f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 --2- 172.21.15.6:0/2454296437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4a73b0 0x56375d883570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 -- 172.21.15.6:0/2454296437 >> 172.21.15.6:0/2454296437 conn(0x56375d4c43c0 msgr2=0x56375d86feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 -- 172.21.15.6:0/2454296437 shutdown_connections 2024-05-20T17:53:14.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.938+0000 7fe70ee32740 1 -- 172.21.15.6:0/2454296437 wait complete. 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.939+0000 7fe70ee32740 1 -- start start 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.939+0000 7fe70ee32740 1 Processor -- start 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.940+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 0x56375d89bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.940+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d86a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.940+0000 7fe70ee32740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d899cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.940+0000 7fe70ee32740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56375d8b6550 con 0x56375d4af590 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.940+0000 7fe70ee32740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56375d89e690 con 0x56375d4d0270 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.940+0000 7fe70ee32740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x56375d8b6b10 con 0x56375d4a73b0 2024-05-20T17:53:14.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.940+0000 7fe70ee32740 10 client.0 _ll_register_callbacks cb 0x7fe6fc003f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d86a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d86a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44490/0 (socket says 172.21.15.6:44490) 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 -- 172.21.15.6:0/1615487125 learned_addr learned my addr 172.21.15.6:0/1615487125 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70644c640 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d899cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe705c4b640 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 0x56375d89bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 -- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 msgr2=0x56375d89bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 0x56375d89bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 -- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 msgr2=0x56375d899cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d899cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 -- 172.21.15.6:0/1615487125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56375d8c8210 con 0x56375d4af590 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70644c640 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d899cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70544a640 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d86a420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00a9be0 tx=0x7fe6f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742edbd8100cd3db server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:14.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe6e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/1615487125 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0097070 con 0x56375d4af590 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/1615487125 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe6f00800b0 con 0x56375d4af590 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70ee32740 1 -- 172.21.15.6:0/1615487125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f007ee50 con 0x56375d4af590 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/1615487125 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe6f00a2050 con 0x56375d4af590 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70ee32740 10 client.4449 fetch_fsmap learned FSMap version 7 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe70ee32740 1 -- 172.21.15.6:0/1615487125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x56375d8c84f0 con 0x56375d4af590 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.941+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/1615487125 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f007ee50 con 0x56375d4af590 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/1615487125 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fe6f003a030 con 0x56375d4af590 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe70ee32740 10 client.4449 fetch_fsmap finished waiting for FSMap version 7 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe70ee32740 10 client.4449 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe70ee32740 20 client.4449 populate_metadata read hostname 'smithi006' 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe70ee32740 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56375d89a210 0x56375d8d8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:14.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe70ee32740 4 client.4449 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe70ee32740 1 -- 172.21.15.6:0/1615487125 --> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] -- command(tid 0: {"prefix": "status"}) -- 0x56375d7dbf50 con 0x56375d89a210 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe705c4b640 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56375d89a210 0x56375d8d8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe6e0ff9640 10 client.4449 ms_handle_connect on v2:172.21.15.6:6832/2802786337 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe705c4b640 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56375d89a210 0x56375d8d8e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f66b03967dc8dbe7 server_cookie=8d4fe29f3a113b74 in_seq=0 out_seq=0 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe6e0ff9640 1 -- 172.21.15.6:0/1615487125 <== mds.0 v2:172.21.15.6:6832/2802786337 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56375d7dbf50 con 0x56375d89a210 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe6e0ff9640 10 client.4449 handle_command_reply: tid=0 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.942+0000 7fe70ee32740 1 client.4449 shutdown 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 -- 172.21.15.6:0/1615487125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 msgr2=0x56375d86a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d86a420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00a9be0 tx=0x7fe6f0008040 comp rx=0 tx=0).stop 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 -- 172.21.15.6:0/1615487125 shutdown_connections 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56375d89a210 0x56375d8d8e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56375d4d0270 0x56375d899cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56375d4af590 0x56375d86a420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe6e0ff9640 0 client.4449 ms_handle_reset on v2:172.21.15.6:6832/2802786337 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 --2- 172.21.15.6:0/1615487125 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56375d4a73b0 0x56375d89bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 -- 172.21.15.6:0/1615487125 >> 172.21.15.6:0/1615487125 conn(0x56375d4c43c0 msgr2=0x56375d883600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 -- 172.21.15.6:0/1615487125 shutdown_connections 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 1 -- 172.21.15.6:0/1615487125 wait complete. 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe70ee32740 20 client.4449 trim_cache size 0 max 16384 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:53:14.947 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4290, 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 7.3927164909999998, 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 7, 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 24, 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 24, 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 15.002180916 2024-05-20T17:53:14.948 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:53:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 -- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6e406be30 msgr2=0x7fe6e406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6e406be30 0x7fe6e406e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc006fd0 tx=0x7fe6fc008040 comp rx=0 tx=0).stop 2024-05-20T17:53:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 -- 172.21.15.6:0/2687977297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000cd680 msgr2=0x7fe700151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000cd680 0x7fe700151f50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe6f002a180 tx=0x7fe6f00046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 -- 172.21.15.6:0/2687977297 shutdown_connections 2024-05-20T17:53:14.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6e406be30 0x7fe6e406e340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7000cf3d0 0x7fe70015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7000cd680 0x7fe700151f50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 --2- 172.21.15.6:0/2687977297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe70006c6c0 0x7fe7000c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 -- 172.21.15.6:0/2687977297 >> 172.21.15.6:0/2687977297 conn(0x7fe7000b44d0 msgr2=0x7fe7000b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.943+0000 7fe707eaf640 1 -- 172.21.15.6:0/2687977297 shutdown_connections 2024-05-20T17:53:14.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:14.944+0000 7fe707eaf640 1 -- 172.21.15.6:0/2687977297 wait complete. 2024-05-20T17:53:14.953 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-20T17:53:14.953 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:53:14.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:53:15.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.070+0000 7f5519861640 1 Processor -- start 2024-05-20T17:53:15.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.070+0000 7f5519861640 1 -- start start 2024-05-20T17:53:15.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.071+0000 7f5519861640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f551409a610 0x7f551415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.071+0000 7f5519861640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55140b1030 0x7f55140b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.071+0000 7f5519861640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f55140d1950 0x7f55140d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.071+0000 7f5519861640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f55140d22a0 con 0x7f55140b1030 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.071+0000 7f5519861640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f551409b400 con 0x7f55140d1950 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.071+0000 7f5519861640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f551409ae40 con 0x7f551409a610 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f550bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55140b1030 0x7f55140b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f550bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55140b1030 0x7f55140b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44492/0 (socket says 172.21.15.6:44492) 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f550bfff640 1 -- 172.21.15.6:0/1922611876 learned_addr learned my addr 172.21.15.6:0/1922611876 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f55137fe640 1 --2- 172.21.15.6:0/1922611876 >> v2:172.21.15.171:3300/0 conn(0x7f55140d1950 0x7f55140d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f5512ffd640 1 --2- 172.21.15.6:0/1922611876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f551409a610 0x7f551415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f550bfff640 1 -- 172.21.15.6:0/1922611876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f551409a610 msgr2=0x7f551415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f550bfff640 1 --2- 172.21.15.6:0/1922611876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f551409a610 0x7f551415cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f550bfff640 1 -- 172.21.15.6:0/1922611876 >> v2:172.21.15.171:3300/0 conn(0x7f55140d1950 msgr2=0x7f55140d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f550bfff640 1 --2- 172.21.15.6:0/1922611876 >> v2:172.21.15.171:3300/0 conn(0x7f55140d1950 0x7f55140d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.072+0000 7f550bfff640 1 -- 172.21.15.6:0/1922611876 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551409b120 con 0x7f55140b1030 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.073+0000 7f550bfff640 1 --2- 172.21.15.6:0/1922611876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140b1030 0x7f55140b1440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f55140b76c0 tx=0x7f54fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ff64f72e80fd51 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.073+0000 7f55127fc640 1 -- 172.21.15.6:0/1922611876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc037070 con 0x7f55140b1030 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.073+0000 7f55127fc640 1 -- 172.21.15.6:0/1922611876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54fc032440 con 0x7f55140b1030 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.073+0000 7f55127fc640 1 -- 172.21.15.6:0/1922611876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc032810 con 0x7f55140b1030 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 -- 172.21.15.6:0/1922611876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140b1030 msgr2=0x7f55140b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 --2- 172.21.15.6:0/1922611876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140b1030 0x7f55140b1440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f55140b76c0 tx=0x7f54fc02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 -- 172.21.15.6:0/1922611876 shutdown_connections 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 --2- 172.21.15.6:0/1922611876 >> v2:172.21.15.171:3300/0 conn(0x7f55140d1950 0x7f55140d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 --2- 172.21.15.6:0/1922611876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140b1030 0x7f55140b1440 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 --2- 172.21.15.6:0/1922611876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f551409a610 0x7f551415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 -- 172.21.15.6:0/1922611876 >> 172.21.15.6:0/1922611876 conn(0x7f55140b6660 msgr2=0x7f55140b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 -- 172.21.15.6:0/1922611876 shutdown_connections 2024-05-20T17:53:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.074+0000 7f5519861640 1 -- 172.21.15.6:0/1922611876 wait complete. 2024-05-20T17:53:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.075+0000 7f5519861640 1 Processor -- start 2024-05-20T17:53:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.075+0000 7f5519861640 1 -- start start 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f5519861640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f551409a610 0x7f551415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f5519861640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55140b1030 0x7f551415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f5519861640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140d1950 0x7f551406ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f5519861640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f551415d450 con 0x7f55140d1950 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f5519861640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f551415c9f0 con 0x7f551409a610 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f5519861640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f551409aa20 con 0x7f55140b1030 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140d1950 0x7f551406ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140d1950 0x7f551406ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44504/0 (socket says 172.21.15.6:44504) 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 -- 172.21.15.6:0/2863898652 learned_addr learned my addr 172.21.15.6:0/2863898652 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f550bfff640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55140b1030 0x7f551415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f5512ffd640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f551409a610 0x7f551415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 -- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55140b1030 msgr2=0x7f551415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55140b1030 0x7f551415b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 -- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f551409a610 msgr2=0x7f551415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f551409a610 0x7f551415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 -- 172.21.15.6:0/2863898652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551415a2c0 con 0x7f55140d1950 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f55137fe640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140d1950 0x7f551406ca50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f550c007d80 tx=0x7f550c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.077+0000 7f5510ff9640 1 -- 172.21.15.6:0/2863898652 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c014420 con 0x7f55140d1950 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.078+0000 7f5510ff9640 1 -- 172.21.15.6:0/2863898652 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c019070 con 0x7f55140d1950 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.078+0000 7f5510ff9640 1 -- 172.21.15.6:0/2863898652 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c014800 con 0x7f55140d1950 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.078+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551415a5a0 con 0x7f55140d1950 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.078+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551415ab60 con 0x7f55140d1950 2024-05-20T17:53:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.078+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5514075b00 con 0x7f55140d1950 2024-05-20T17:53:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.079+0000 7f5510ff9640 1 -- 172.21.15.6:0/2863898652 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f550c0149a0 con 0x7f55140d1950 2024-05-20T17:53:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.080+0000 7f5510ff9640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54f406be30 0x7f54f406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.080+0000 7f5510ff9640 1 -- 172.21.15.6:0/2863898652 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f550c08b9d0 con 0x7f55140d1950 2024-05-20T17:53:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.080+0000 7f5512ffd640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54f406be30 0x7f54f406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:15.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.080+0000 7f5512ffd640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54f406be30 0x7f54f406e340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f551406d8d0 tx=0x7f5504008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:15.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.085+0000 7f5510ff9640 1 -- 172.21.15.6:0/2863898652 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f550c059960 con 0x7f55140d1950 2024-05-20T17:53:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.308+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f55140d0160 con 0x7f55140d1950 2024-05-20T17:53:15.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.308+0000 7f5510ff9640 1 -- 172.21.15.6:0/2863898652 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f550c05dc60 con 0x7f55140d1950 2024-05-20T17:53:15.307 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54f406be30 msgr2=0x7f54f406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54f406be30 0x7f54f406e340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f551406d8d0 tx=0x7f5504008040 comp rx=0 tx=0).stop 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140d1950 msgr2=0x7f551406ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140d1950 0x7f551406ca50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f550c007d80 tx=0x7f550c00e4b0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 shutdown_connections 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54f406be30 0x7f54f406e340 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55140d1950 0x7f551406ca50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55140b1030 0x7f551415b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 --2- 172.21.15.6:0/2863898652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f551409a610 0x7f551415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:15.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 >> 172.21.15.6:0/2863898652 conn(0x7f55140b6660 msgr2=0x7f551406feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:15.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 shutdown_connections 2024-05-20T17:53:15.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15.310+0000 7f5519861640 1 -- 172.21.15.6:0/2863898652 wait complete. 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:53:15.320 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-20T17:53:15.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:15.321 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:53:15.336 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:15.337 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:15.338 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:53:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:53:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42719sec preferred_lft 42719sec 2024-05-20T17:53:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:53:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:15.339 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:15.339 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:53:15.340 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-20T17:53:15.340 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:15.340 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:15.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-05-20T17:53:15.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-05-20T17:53:15.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-05-20T17:53:15.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-20T17:53:15.340 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:15.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:15.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:15.534 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:53:15.560 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:53:15.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:15.562 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:53:15.624 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:53:15.624 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:53:15.624 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:53:15.624 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:53:15.624 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:53:15.624 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:15.624 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:15.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:53:15.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:53:15.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:53:15.625 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:15.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:15.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:15.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:15.927 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:53:15.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:15.943 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-05-20T17:53:15.998 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:15.998 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:15.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:53:15.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-20T17:53:15.998 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:16.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:16.119 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-20T17:53:16.119 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:16.119 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:16.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-20T17:53:16.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-20T17:53:16.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-20T17:53:16.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-20T17:53:16.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-20T17:53:16.119 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:16.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:16.251 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:16.251 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:16.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:53:16.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-05-20T17:53:16.251 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:16.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:16.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:16.330 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-20T17:53:16.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:16.331 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:53:16.346 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-20T17:53:16.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:16.346 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:53:16.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-20T17:53:16.468 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-20T17:53:16.525 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-20T17:53:16.525 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-20T17:53:16.525 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-20T17:53:16.525 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-20T17:53:16.526 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-20T17:53:16.527 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:53:16.528 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:53:16.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:16.528 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-20T17:53:16.581 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-20T17:53:16.581 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-20T17:53:16.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-05-20T17:53:16.650 DEBUG:teuthology.orchestra.run.smithi006:> cat /proc/self/mounts | awk '{print $2}' 2024-05-20T17:53:16.707 INFO:teuthology.orchestra.run.smithi006.stdout:/proc 2024-05-20T17:53:16.707 INFO:teuthology.orchestra.run.smithi006.stdout:/sys 2024-05-20T17:53:16.707 INFO:teuthology.orchestra.run.smithi006.stdout:/dev 2024-05-20T17:53:16.707 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/security 2024-05-20T17:53:16.707 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/shm 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/pts 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/run 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/cgroup 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/pstore 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/bpf 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/ 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/selinux 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/proc/sys/fs/binfmt_misc 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/mqueue 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/dev/hugepages 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/debug 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/tracing 2024-05-20T17:53:16.708 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/fs/fuse/connections 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/sys/kernel/config 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-sysctl.service 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/nfs/rpc_pipefs 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/run/user/1000 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-0 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-1 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-2 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/var/lib/ceph/osd/ceph-3 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:53:16.709 INFO:teuthology.orchestra.run.smithi006.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:53:16.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:16.710 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-05-20T17:53:16.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:2024-05-20T17:53:16.733+0000 7fb60d702480 -1 init, newargv = 0x5618ed4b7e40 newargc=15 2024-05-20T17:53:16.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[44951]: starting ceph client 2024-05-20T17:53:16.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[44951]: starting fuse 2024-05-20T17:53:16.748 INFO:teuthology.orchestra.run.smithi006.stdout:42 2024-05-20T17:53:16.748 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo stdin-killer -- python3 -c ' 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-20T17:53:16.749 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:53:16.750 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.admin")) 2024-05-20T17:53:16.751 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:53:16.869 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.admin.44951.asok 2024-05-20T17:53:16.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:16.880 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44951.asok 2024-05-20T17:53:16.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:16.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44951.asok status 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "d2b507c724ef6c8295ee0a35d185cdab167fd61d", 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 19.0.0-2744-gd2b507c7 (d2b507c724ef6c8295ee0a35d185cdab167fd61d) squid (dev)", 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "admin", 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "44951", 2024-05-20T17:53:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4461, 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4461 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-05-20T17:53:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1629857396 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1629857396 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4461 192.168.0.1:0/1629857396", 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/1629857396", 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 7, 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 24, 2024-05-20T17:53:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-05-20T17:53:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-05-20T17:53:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-05-20T17:53:17.032 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:53:17.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:17.037 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-05-20T17:53:17.038 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:53:17.054 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-05-20T17:53:17.054 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:53:17.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:17.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:53:17.120 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-20T17:53:17.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:17.229 INFO:teuthology.orchestra.run.smithi006.stdout:# file: . 2024-05-20T17:53:17.229 INFO:teuthology.orchestra.run.smithi006.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-20T17:53:17.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:17.236 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:53:17.236 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:17.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.408+0000 7f9e31d65640 1 Processor -- start 2024-05-20T17:53:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.408+0000 7f9e31d65640 1 -- start start 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e31d65640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e2c15d060 0x7f9e2c0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e31d65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c0b5720 0x7f9e2c06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e31d65640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e2c0b5b30 con 0x7f9e2c0b47b0 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e31d65640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9e2c0b39f0 con 0x7f9e2c15d060 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e31d65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c0b3cd0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e2c15d060 0x7f9e2c0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9e2c0b47b0 0x7f9e2c0afad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50762/0 (socket says 172.21.15.6:50762) 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e2c15d060 0x7f9e2c0b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44508/0 (socket says 172.21.15.6:44508) 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2b7fe640 1 -- 172.21.15.6:0/741550707 learned_addr learned my addr 172.21.15.6:0/741550707 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2bfff640 1 --2- 172.21.15.6:0/741550707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c0b5720 0x7f9e2c06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2affd640 1 -- 172.21.15.6:0/741550707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c0b5720 msgr2=0x7f9e2c06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2affd640 1 --2- 172.21.15.6:0/741550707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c0b5720 0x7f9e2c06f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2affd640 1 -- 172.21.15.6:0/741550707 >> v1:172.21.15.6:6789/0 conn(0x7f9e2c0b47b0 legacy=0x7f9e2c0afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2a7fc640 1 -- 172.21.15.6:0/741550707 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942972060 0 0) 0x7f9e1c001110 con 0x7f9e2c0b47b0 2024-05-20T17:53:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.410+0000 7f9e2affd640 1 -- 172.21.15.6:0/741550707 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c0b3fb0 con 0x7f9e2c15d060 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.411+0000 7f9e2affd640 1 --2- 172.21.15.6:0/741550707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c15d060 0x7f9e2c0b51e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000ba40 tx=0x7f9e2002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d65e256a2485f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.411+0000 7f9e2a7fc640 1 -- 172.21.15.6:0/741550707 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20032750 con 0x7f9e2c15d060 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.411+0000 7f9e2a7fc640 1 -- 172.21.15.6:0/741550707 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e20030050 con 0x7f9e2c15d060 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.411+0000 7f9e2a7fc640 1 -- 172.21.15.6:0/741550707 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20032b10 con 0x7f9e2c15d060 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.412+0000 7f9e31d65640 1 -- 172.21.15.6:0/741550707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c15d060 msgr2=0x7f9e2c0b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.412+0000 7f9e31d65640 1 --2- 172.21.15.6:0/741550707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c15d060 0x7f9e2c0b51e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000ba40 tx=0x7f9e2002c850 comp rx=0 tx=0).stop 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.412+0000 7f9e31d65640 1 -- 172.21.15.6:0/741550707 shutdown_connections 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.412+0000 7f9e31d65640 1 --2- 172.21.15.6:0/741550707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c0b5720 0x7f9e2c06f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.412+0000 7f9e31d65640 1 --2- 172.21.15.6:0/741550707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c15d060 0x7f9e2c0b51e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.412+0000 7f9e31d65640 1 -- 172.21.15.6:0/741550707 >> 172.21.15.6:0/741550707 conn(0x7f9e2c0cd2a0 msgr2=0x7f9e2c0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.412+0000 7f9e31d65640 1 -- 172.21.15.6:0/741550707 shutdown_connections 2024-05-20T17:53:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.412+0000 7f9e31d65640 1 -- 172.21.15.6:0/741550707 wait complete. 2024-05-20T17:53:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.414+0000 7f9e31d65640 1 Processor -- start 2024-05-20T17:53:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.414+0000 7f9e31d65640 1 -- start start 2024-05-20T17:53:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e31d65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0b5720 0x7f9e2c15e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e31d65640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2c15d060 0x7f9e2c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e31d65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c14aa00 0x7f9e2c14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e31d65640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c159de0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e31d65640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c159c60 con 0x7f9e2c15d060 2024-05-20T17:53:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e31d65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c06f910 con 0x7f9e2c14aa00 2024-05-20T17:53:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0b5720 0x7f9e2c15e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e2b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0b5720 0x7f9e2c15e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44522/0 (socket says 172.21.15.6:44522) 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.415+0000 7f9e2b7fe640 1 -- 172.21.15.6:0/3430502969 learned_addr learned my addr 172.21.15.6:0/3430502969 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e2bfff640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c14aa00 0x7f9e2c14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e2affd640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2c15d060 0x7f9e2c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e2b7fe640 1 -- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c14aa00 msgr2=0x7f9e2c14ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e2b7fe640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c14aa00 0x7f9e2c14ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e2b7fe640 1 -- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2c15d060 msgr2=0x7f9e2c14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e2b7fe640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2c15d060 0x7f9e2c14e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e2b7fe640 1 -- 172.21.15.6:0/3430502969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c14b350 con 0x7f9e2c0b5720 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e2b7fe640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0b5720 0x7f9e2c15e870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00c410 tx=0x7f9e1c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e13fff640 1 -- 172.21.15.6:0/3430502969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0074e0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e13fff640 1 -- 172.21.15.6:0/3430502969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1c0047e0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e13fff640 1 -- 172.21.15.6:0/3430502969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c004bd0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2c0affe0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.416+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2c0ae1a0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.417+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2c075b00 con 0x7f9e2c0b5720 2024-05-20T17:53:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.418+0000 7f9e13fff640 1 -- 172.21.15.6:0/3430502969 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e1c011070 con 0x7f9e2c0b5720 2024-05-20T17:53:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.418+0000 7f9e13fff640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e1806be60 0x7f9e1806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.418+0000 7f9e13fff640 1 -- 172.21.15.6:0/3430502969 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e1c08aeb0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.419+0000 7f9e2affd640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e1806be60 0x7f9e1806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.419+0000 7f9e2affd640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e1806be60 0x7f9e1806e370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e20037000 tx=0x7f9e20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:17.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.423+0000 7f9e13fff640 1 -- 172.21.15.6:0/3430502969 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9e2c14b350 con 0x7f9e2c0b5720 2024-05-20T17:53:17.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.609+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e2c0b4bc0 con 0x7f9e2c0b5720 2024-05-20T17:53:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.610+0000 7f9e13fff640 1 -- 172.21.15.6:0/3430502969 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f9e2c0b5b30 con 0x7f9e2c0b5720 2024-05-20T17:53:17.609 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:17.609 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e1806be60 msgr2=0x7f9e1806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e1806be60 0x7f9e1806e370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e20037000 tx=0x7f9e20008040 comp rx=0 tx=0).stop 2024-05-20T17:53:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0b5720 msgr2=0x7f9e2c15e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0b5720 0x7f9e2c15e870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00c410 tx=0x7f9e1c00c8d0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 shutdown_connections 2024-05-20T17:53:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e1806be60 0x7f9e1806e370 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e20037000 tx=0x7f9e20008040 comp rx=0 tx=0).stop 2024-05-20T17:53:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e2c14aa00 0x7f9e2c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e2c15d060 0x7f9e2c14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 --2- 172.21.15.6:0/3430502969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e2c0b5720 0x7f9e2c15e870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 >> 172.21.15.6:0/3430502969 conn(0x7f9e2c0cd2a0 msgr2=0x7f9e2c15a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 shutdown_connections 2024-05-20T17:53:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.613+0000 7f9e31d65640 1 -- 172.21.15.6:0/3430502969 wait complete. 2024-05-20T17:53:17.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:17.623 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:17.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.742+0000 7ff4f1538640 1 Processor -- start 2024-05-20T17:53:17.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.742+0000 7ff4f1538640 1 -- start start 2024-05-20T17:53:17.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4f1538640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec163a10 0x7ff4ec0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4f1538640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4ec0d14b0 0x7ff4ec0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4f1538640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4ec0d0370 con 0x7ff4ec0b4010 2024-05-20T17:53:17.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4f1538640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff4ec0d3ca0 con 0x7ff4ec0d14b0 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4f1538640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec0d0650 con 0x7ff4ec163a10 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4eb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4ec0d14b0 0x7ff4ec0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4e27fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4ec0b4010 0x7ff4ec0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60122/0 (socket says 172.21.15.6:60122) 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4e27fc640 1 -- 172.21.15.6:0/180833544 learned_addr learned my addr 172.21.15.6:0/180833544 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.743+0000 7ff4eaffd640 1 --2- 172.21.15.6:0/180833544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec163a10 0x7ff4ec0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.744+0000 7ff4eb7fe640 1 -- 172.21.15.6:0/180833544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec163a10 msgr2=0x7ff4ec0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.744+0000 7ff4eb7fe640 1 --2- 172.21.15.6:0/180833544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec163a10 0x7ff4ec0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.744+0000 7ff4eb7fe640 1 -- 172.21.15.6:0/180833544 >> v1:172.21.15.6:6789/0 conn(0x7ff4ec0b4010 legacy=0x7ff4ec0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.744+0000 7ff4ea7fc640 1 -- 172.21.15.6:0/180833544 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418763169 0 0) 0x7ff4ec0d0370 con 0x7ff4ec0b4010 2024-05-20T17:53:17.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.744+0000 7ff4eb7fe640 1 -- 172.21.15.6:0/180833544 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec0d3650 con 0x7ff4ec0d14b0 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.744+0000 7ff4eb7fe640 1 --2- 172.21.15.6:0/180833544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0d14b0 0x7ff4ec0d18c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009d90 tx=0x7ff4e402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705417bd00764f19 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.744+0000 7ff4ea7fc640 1 -- 172.21.15.6:0/180833544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4007740 con 0x7ff4ec0d14b0 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4ea7fc640 1 -- 172.21.15.6:0/180833544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e40078e0 con 0x7ff4ec0d14b0 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4ea7fc640 1 -- 172.21.15.6:0/180833544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4007cb0 con 0x7ff4ec0d14b0 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4f1538640 1 -- 172.21.15.6:0/180833544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0d14b0 msgr2=0x7ff4ec0d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4f1538640 1 --2- 172.21.15.6:0/180833544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0d14b0 0x7ff4ec0d18c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009d90 tx=0x7ff4e402a680 comp rx=0 tx=0).stop 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4f1538640 1 -- 172.21.15.6:0/180833544 shutdown_connections 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4f1538640 1 --2- 172.21.15.6:0/180833544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0d14b0 0x7ff4ec0d18c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4f1538640 1 --2- 172.21.15.6:0/180833544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec163a10 0x7ff4ec0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4f1538640 1 -- 172.21.15.6:0/180833544 >> 172.21.15.6:0/180833544 conn(0x7ff4ec06d240 msgr2=0x7ff4ec06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4f1538640 1 -- 172.21.15.6:0/180833544 shutdown_connections 2024-05-20T17:53:17.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.745+0000 7ff4f1538640 1 -- 172.21.15.6:0/180833544 wait complete. 2024-05-20T17:53:17.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.747+0000 7ff4f1538640 1 Processor -- start 2024-05-20T17:53:17.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.747+0000 7ff4f1538640 1 -- start start 2024-05-20T17:53:17.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4f1538640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0b4010 0x7ff4ec1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4f1538640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec0d14b0 0x7ff4ec0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4f1538640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ec163a10 0x7ff4ec159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4f1538640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec0b8210 con 0x7ff4ec0b4010 2024-05-20T17:53:17.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4f1538640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec0d1e00 con 0x7ff4ec163a10 2024-05-20T17:53:17.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4f1538640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec0b8390 con 0x7ff4ec0d14b0 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0b4010 0x7ff4ec1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0b4010 0x7ff4ec1570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47562/0 (socket says 172.21.15.6:47562) 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 -- 172.21.15.6:0/1013029298 learned_addr learned my addr 172.21.15.6:0/1013029298 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4e27fc640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec0d14b0 0x7ff4ec0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eb7fe640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ec163a10 0x7ff4ec159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 -- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec0d14b0 msgr2=0x7ff4ec0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec0d14b0 0x7ff4ec0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 -- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ec163a10 msgr2=0x7ff4ec159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ec163a10 0x7ff4ec159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 -- 172.21.15.6:0/1013029298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec0ce760 con 0x7ff4ec0b4010 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eb7fe640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ec163a10 0x7ff4ec159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4eaffd640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0b4010 0x7ff4ec1570f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00e840 tx=0x7ff4dc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4e3fff640 1 -- 172.21.15.6:0/1013029298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc017070 con 0x7ff4ec0b4010 2024-05-20T17:53:17.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4e3fff640 1 -- 172.21.15.6:0/1013029298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4dc00c940 con 0x7ff4ec0b4010 2024-05-20T17:53:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec155540 con 0x7ff4ec0b4010 2024-05-20T17:53:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.749+0000 7ff4e3fff640 1 -- 172.21.15.6:0/1013029298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00cd10 con 0x7ff4ec0b4010 2024-05-20T17:53:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.750+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec155ac0 con 0x7ff4ec0b4010 2024-05-20T17:53:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.750+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4ec157870 con 0x7ff4ec0b4010 2024-05-20T17:53:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.751+0000 7ff4e3fff640 1 -- 172.21.15.6:0/1013029298 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4dc01a070 con 0x7ff4ec0b4010 2024-05-20T17:53:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.752+0000 7ff4e3fff640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4cc06be30 0x7ff4cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.752+0000 7ff4e3fff640 1 -- 172.21.15.6:0/1013029298 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff4dc08b420 con 0x7ff4ec0b4010 2024-05-20T17:53:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.752+0000 7ff4e27fc640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4cc06be30 0x7ff4cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.752+0000 7ff4e27fc640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4cc06be30 0x7ff4cc06e340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec15c360 tx=0x7ff4d4007c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:17.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.756+0000 7ff4e3fff640 1 -- 172.21.15.6:0/1013029298 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff4ec0ce760 con 0x7ff4ec0b4010 2024-05-20T17:53:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.942+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff4ec075b00 con 0x7ff4ec0b4010 2024-05-20T17:53:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.942+0000 7ff4e3fff640 1 -- 172.21.15.6:0/1013029298 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7ff4dc059a00 con 0x7ff4ec0b4010 2024-05-20T17:53:17.941 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4cc06be30 msgr2=0x7ff4cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4cc06be30 0x7ff4cc06e340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec15c360 tx=0x7ff4d4007c20 comp rx=0 tx=0).stop 2024-05-20T17:53:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0b4010 msgr2=0x7ff4ec1570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0b4010 0x7ff4ec1570f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00e840 tx=0x7ff4dc00ed00 comp rx=0 tx=0).stop 2024-05-20T17:53:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 shutdown_connections 2024-05-20T17:53:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4cc06be30 0x7ff4cc06e340 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4ec163a10 0x7ff4ec159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4ec0d14b0 0x7ff4ec0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 --2- 172.21.15.6:0/1013029298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ec0b4010 0x7ff4ec1570f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:17.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 >> 172.21.15.6:0/1013029298 conn(0x7ff4ec06d240 msgr2=0x7ff4ec15c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:17.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 shutdown_connections 2024-05-20T17:53:17.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:17.944+0000 7ff4f1538640 1 -- 172.21.15.6:0/1013029298 wait complete. 2024-05-20T17:53:17.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.072+0000 7f8a20073640 1 Processor -- start 2024-05-20T17:53:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.073+0000 7f8a20073640 1 -- start start 2024-05-20T17:53:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a20073640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a180af030 0x7f8a180af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a20073640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8a1815f700 0x7f8a1815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a20073640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1809a4f0 0x7f8a1809a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a20073640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8a1806bcf0 con 0x7f8a180af030 2024-05-20T17:53:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a20073640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8a180af980 con 0x7f8a1815f700 2024-05-20T17:53:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a20073640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8a18160430 con 0x7f8a1809a4f0 2024-05-20T17:53:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a1de0f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a180af030 0x7f8a180af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a1de0f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a180af030 0x7f8a180af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47564/0 (socket says 172.21.15.6:47564) 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a1de0f640 1 -- 172.21.15.6:0/248786446 learned_addr learned my addr 172.21.15.6:0/248786446 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.074+0000 7f8a1d60e640 1 --2- 172.21.15.6:0/248786446 >> v2:172.21.15.171:3300/0 conn(0x7f8a1815f700 0x7f8a1815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1e610640 1 --2- 172.21.15.6:0/248786446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1809a4f0 0x7f8a1809a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1de0f640 1 -- 172.21.15.6:0/248786446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1809a4f0 msgr2=0x7f8a1809a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1de0f640 1 --2- 172.21.15.6:0/248786446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1809a4f0 0x7f8a1809a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1de0f640 1 -- 172.21.15.6:0/248786446 >> v2:172.21.15.171:3300/0 conn(0x7f8a1815f700 msgr2=0x7f8a1815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1de0f640 1 --2- 172.21.15.6:0/248786446 >> v2:172.21.15.171:3300/0 conn(0x7f8a1815f700 0x7f8a1815fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1de0f640 1 -- 172.21.15.6:0/248786446 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1806b6a0 con 0x7f8a180af030 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1d60e640 1 --2- 172.21.15.6:0/248786446 >> v2:172.21.15.171:3300/0 conn(0x7f8a1815f700 0x7f8a1815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1e610640 1 --2- 172.21.15.6:0/248786446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1809a4f0 0x7f8a1809a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1de0f640 1 --2- 172.21.15.6:0/248786446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a180af440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a180aea40 tx=0x7f8a0802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a7519d6d219640 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.075+0000 7f8a1ce0d640 1 -- 172.21.15.6:0/248786446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08036070 con 0x7f8a180af030 2024-05-20T17:53:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a1ce0d640 1 -- 172.21.15.6:0/248786446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a08031600 con 0x7f8a180af030 2024-05-20T17:53:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a1ce0d640 1 -- 172.21.15.6:0/248786446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a080319d0 con 0x7f8a180af030 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 -- 172.21.15.6:0/248786446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 msgr2=0x7f8a180af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 --2- 172.21.15.6:0/248786446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a180af440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a180aea40 tx=0x7f8a0802a6a0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 -- 172.21.15.6:0/248786446 shutdown_connections 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 --2- 172.21.15.6:0/248786446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1809a4f0 0x7f8a1809a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 --2- 172.21.15.6:0/248786446 >> v2:172.21.15.171:3300/0 conn(0x7f8a1815f700 0x7f8a1815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 --2- 172.21.15.6:0/248786446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a180af440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 -- 172.21.15.6:0/248786446 >> 172.21.15.6:0/248786446 conn(0x7f8a180b6620 msgr2=0x7f8a180b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 -- 172.21.15.6:0/248786446 shutdown_connections 2024-05-20T17:53:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.076+0000 7f8a20073640 1 -- 172.21.15.6:0/248786446 wait complete. 2024-05-20T17:53:18.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.078+0000 7f8a20073640 1 Processor -- start 2024-05-20T17:53:18.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.078+0000 7f8a20073640 1 -- start start 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.079+0000 7f8a20073640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a1809a4f0 0x7f8a1814c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.079+0000 7f8a20073640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a18155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.079+0000 7f8a20073640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1815f700 0x7f8a18157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.079+0000 7f8a20073640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18160050 con 0x7f8a180af030 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.079+0000 7f8a20073640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18159aa0 con 0x7f8a1809a4f0 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.079+0000 7f8a20073640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8a181601d0 con 0x7f8a1815f700 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a18155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a18155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47568/0 (socket says 172.21.15.6:47568) 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 -- 172.21.15.6:0/378765850 learned_addr learned my addr 172.21.15.6:0/378765850 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1de0f640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a1809a4f0 0x7f8a1814c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1e610640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1815f700 0x7f8a18157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 -- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1815f700 msgr2=0x7f8a18157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1815f700 0x7f8a18157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 -- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a1809a4f0 msgr2=0x7f8a1814c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a1809a4f0 0x7f8a1814c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 -- 172.21.15.6:0/378765850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a181550a0 con 0x7f8a180af030 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1e610640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1815f700 0x7f8a18157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a1d60e640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a18155900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00c820 tx=0x7f8a0c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a167fc640 1 -- 172.21.15.6:0/378765850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c015070 con 0x7f8a180af030 2024-05-20T17:53:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a167fc640 1 -- 172.21.15.6:0/378765850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a0c007a30 con 0x7f8a180af030 2024-05-20T17:53:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a18154490 con 0x7f8a180af030 2024-05-20T17:53:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a167fc640 1 -- 172.21.15.6:0/378765850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c007de0 con 0x7f8a180af030 2024-05-20T17:53:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.080+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a18154a50 con 0x7f8a180af030 2024-05-20T17:53:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.081+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a18075b00 con 0x7f8a180af030 2024-05-20T17:53:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.082+0000 7f8a167fc640 1 -- 172.21.15.6:0/378765850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a0c018070 con 0x7f8a180af030 2024-05-20T17:53:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.083+0000 7f8a167fc640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a0406be60 0x7f8a0406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.083+0000 7f8a167fc640 1 -- 172.21.15.6:0/378765850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a0c08af10 con 0x7f8a180af030 2024-05-20T17:53:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.083+0000 7f8a1de0f640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a0406be60 0x7f8a0406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.083+0000 7f8a1de0f640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a0406be60 0x7f8a0406e370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a08033000 tx=0x7f8a08009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.087+0000 7f8a167fc640 1 -- 172.21.15.6:0/378765850 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8a0c058f30 con 0x7f8a180af030 2024-05-20T17:53:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.270+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8a1815caa0 con 0x7f8a180af030 2024-05-20T17:53:18.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.270+0000 7f8a167fc640 1 -- 172.21.15.6:0/378765850 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f8a0c05d230 con 0x7f8a180af030 2024-05-20T17:53:18.271 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a0406be60 msgr2=0x7f8a0406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a0406be60 0x7f8a0406e370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a08033000 tx=0x7f8a08009000 comp rx=0 tx=0).stop 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 msgr2=0x7f8a18155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a18155900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00c820 tx=0x7f8a0c00cce0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 shutdown_connections 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a0406be60 0x7f8a0406e370 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8a1815f700 0x7f8a18157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a180af030 0x7f8a18155900 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 --2- 172.21.15.6:0/378765850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a1809a4f0 0x7f8a1814c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 >> 172.21.15.6:0/378765850 conn(0x7f8a180b6620 msgr2=0x7f8a180b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 shutdown_connections 2024-05-20T17:53:18.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.272+0000 7f8a20073640 1 -- 172.21.15.6:0/378765850 wait complete. 2024-05-20T17:53:18.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.401+0000 7f094c77e640 1 Processor -- start 2024-05-20T17:53:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.401+0000 7f094c77e640 1 -- start start 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f094c77e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0944168050 0x7f094416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f094c77e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09440d0630 con 0x7f0944162820 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f094c77e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09440d39c0 con 0x7f094406d3d0 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f094c77e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f09440d3ca0 con 0x7f0944168050 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f094a51a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0944162820 0x7f09440b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60124/0 (socket says 172.21.15.6:60124) 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f094a51a640 1 -- 172.21.15.6:0/1581819707 learned_addr learned my addr 172.21.15.6:0/1581819707 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f094ad1b640 1 --2- 172.21.15.6:0/1581819707 >> v2:172.21.15.171:3300/0 conn(0x7f0944168050 0x7f094416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f0949518640 1 -- 172.21.15.6:0/1581819707 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223725502 0 0) 0x7f09440d0630 con 0x7f0944162820 2024-05-20T17:53:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.403+0000 7f0949518640 1 -- 172.21.15.6:0/1581819707 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f092c003520 con 0x7f0944162820 2024-05-20T17:53:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.404+0000 7f0949518640 1 -- 172.21.15.6:0/1581819707 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 674307204 0 0) 0x7f092c003520 con 0x7f0944162820 2024-05-20T17:53:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.404+0000 7f094ad1b640 1 -- 172.21.15.6:0/1581819707 >> v1:172.21.15.171:6789/0 conn(0x7f094406d3d0 legacy=0x7f094406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.404+0000 7f094ad1b640 1 -- 172.21.15.6:0/1581819707 >> v1:172.21.15.6:6789/0 conn(0x7f0944162820 legacy=0x7f09440b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.404+0000 7f094ad1b640 1 -- 172.21.15.6:0/1581819707 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440d3f80 con 0x7f0944168050 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.404+0000 7f094ad1b640 1 --2- 172.21.15.6:0/1581819707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 0x7f094416a470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f093c0097a0 tx=0x7f093c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca95fd99505c643 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f0949518640 1 -- 172.21.15.6:0/1581819707 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c037070 con 0x7f0944168050 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f0949518640 1 -- 172.21.15.6:0/1581819707 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c02ac50 con 0x7f0944168050 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f0949518640 1 -- 172.21.15.6:0/1581819707 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09340019f0 con 0x7f0944168050 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f094c77e640 1 -- 172.21.15.6:0/1581819707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 msgr2=0x7f094416a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f094c77e640 1 --2- 172.21.15.6:0/1581819707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 0x7f094416a470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f093c0097a0 tx=0x7f093c02a1c0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f094c77e640 1 -- 172.21.15.6:0/1581819707 shutdown_connections 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f094c77e640 1 --2- 172.21.15.6:0/1581819707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 0x7f094416a470 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f094c77e640 1 -- 172.21.15.6:0/1581819707 >> 172.21.15.6:0/1581819707 conn(0x7f09440d4bd0 msgr2=0x7f09440d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.405+0000 7f094c77e640 1 -- 172.21.15.6:0/1581819707 shutdown_connections 2024-05-20T17:53:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.406+0000 7f094c77e640 1 -- 172.21.15.6:0/1581819707 wait complete. 2024-05-20T17:53:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.407+0000 7f094c77e640 1 Processor -- start 2024-05-20T17:53:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.407+0000 7f094c77e640 1 -- start start 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.408+0000 7f094c77e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094406d3d0 0x7f09440ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.408+0000 7f094c77e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0944162820 0x7f09441557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094c77e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 0x7f0944157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094c77e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f09440b91a0 con 0x7f094406d3d0 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094c77e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f09440d0300 con 0x7f0944168050 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094c77e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09440b4050 con 0x7f0944162820 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094406d3d0 0x7f09440ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094406d3d0 0x7f09440ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47570/0 (socket says 172.21.15.6:47570) 2024-05-20T17:53:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 -- 172.21.15.6:0/60361964 learned_addr learned my addr 172.21.15.6:0/60361964 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094ad1b640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 0x7f0944157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f0949d19640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0944162820 0x7f09441557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 -- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0944162820 msgr2=0x7f09441557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0944162820 0x7f09441557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 -- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 msgr2=0x7f0944157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 0x7f0944157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 -- 172.21.15.6:0/60361964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0944158dd0 con 0x7f094406d3d0 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094a51a640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094406d3d0 0x7f09440ce620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f093400ccc0 tx=0x7f093400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f0942ffd640 1 -- 172.21.15.6:0/60361964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934017070 con 0x7f094406d3d0 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f0942ffd640 1 -- 172.21.15.6:0/60361964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0934012400 con 0x7f094406d3d0 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f0942ffd640 1 -- 172.21.15.6:0/60361964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09340127f0 con 0x7f094406d3d0 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09441590b0 con 0x7f094406d3d0 2024-05-20T17:53:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.409+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0944155d00 con 0x7f094406d3d0 2024-05-20T17:53:18.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.410+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09440d4780 con 0x7f094406d3d0 2024-05-20T17:53:18.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.411+0000 7f0942ffd640 1 -- 172.21.15.6:0/60361964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f093401a070 con 0x7f094406d3d0 2024-05-20T17:53:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.411+0000 7f0942ffd640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f093006be60 0x7f093006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.412+0000 7f0942ffd640 1 -- 172.21.15.6:0/60361964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f093408aff0 con 0x7f094406d3d0 2024-05-20T17:53:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.412+0000 7f0949d19640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f093006be60 0x7f093006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.412+0000 7f0949d19640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f093006be60 0x7f093006e370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09440b72f0 tx=0x7f0938009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.416+0000 7f0942ffd640 1 -- 172.21.15.6:0/60361964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f09440d4780 con 0x7f094406d3d0 2024-05-20T17:53:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.597+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0944075b00 con 0x7f094406d3d0 2024-05-20T17:53:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.598+0000 7f0942ffd640 1 -- 172.21.15.6:0/60361964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f0934059010 con 0x7f094406d3d0 2024-05-20T17:53:18.596 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f093006be60 msgr2=0x7f093006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f093006be60 0x7f093006e370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09440b72f0 tx=0x7f0938009040 comp rx=0 tx=0).stop 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094406d3d0 msgr2=0x7f09440ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094406d3d0 0x7f09440ce620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f093400ccc0 tx=0x7f093400a430 comp rx=0 tx=0).stop 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 shutdown_connections 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f093006be60 0x7f093006e370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0944168050 0x7f0944157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0944162820 0x7f09441557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 --2- 172.21.15.6:0/60361964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094406d3d0 0x7f09440ce620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 >> 172.21.15.6:0/60361964 conn(0x7f09440d4bd0 msgr2=0x7f094415f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 shutdown_connections 2024-05-20T17:53:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.600+0000 7f094c77e640 1 -- 172.21.15.6:0/60361964 wait complete. 2024-05-20T17:53:18.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.728+0000 7fd86e77e640 1 Processor -- start 2024-05-20T17:53:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.728+0000 7fd86e77e640 1 -- start start 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86e77e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd868162820 0x7fd8680b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86e77e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd86806dae0 0x7fd8680b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86e77e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8680d0630 con 0x7fd8680b3e80 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86e77e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd8680d39c0 con 0x7fd86806dae0 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86e77e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd8680d3ca0 con 0x7fd868162820 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86cd1b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd86806dae0 0x7fd8680b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd8677fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd8680b3e80 0x7fd86806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60132/0 (socket says 172.21.15.6:60132) 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd8677fe640 1 -- 172.21.15.6:0/1499253113 learned_addr learned my addr 172.21.15.6:0/1499253113 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd867fff640 1 --2- 172.21.15.6:0/1499253113 >> v2:172.21.15.171:3300/0 conn(0x7fd868162820 0x7fd8680b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86cd1b640 1 -- 172.21.15.6:0/1499253113 >> v2:172.21.15.171:3300/0 conn(0x7fd868162820 msgr2=0x7fd8680b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86cd1b640 1 --2- 172.21.15.6:0/1499253113 >> v2:172.21.15.171:3300/0 conn(0x7fd868162820 0x7fd8680b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86cd1b640 1 -- 172.21.15.6:0/1499253113 >> v1:172.21.15.6:6789/0 conn(0x7fd8680b3e80 legacy=0x7fd86806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd86cd1b640 1 -- 172.21.15.6:0/1499253113 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8680d3f80 con 0x7fd86806dae0 2024-05-20T17:53:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.730+0000 7fd866ffd640 1 -- 172.21.15.6:0/1499253113 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416524712 0 0) 0x7fd8680d0630 con 0x7fd8680b3e80 2024-05-20T17:53:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.731+0000 7fd86cd1b640 1 --2- 172.21.15.6:0/1499253113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86806dae0 0x7fd8680b8190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8680b7740 tx=0x7fd86002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ddaeee8c9b02bc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.731+0000 7fd866ffd640 1 -- 172.21.15.6:0/1499253113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860007740 con 0x7fd86806dae0 2024-05-20T17:53:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.731+0000 7fd866ffd640 1 -- 172.21.15.6:0/1499253113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8600078e0 con 0x7fd86806dae0 2024-05-20T17:53:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.731+0000 7fd866ffd640 1 -- 172.21.15.6:0/1499253113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860007cb0 con 0x7fd86806dae0 2024-05-20T17:53:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.732+0000 7fd86e77e640 1 -- 172.21.15.6:0/1499253113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86806dae0 msgr2=0x7fd8680b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.732+0000 7fd86e77e640 1 --2- 172.21.15.6:0/1499253113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86806dae0 0x7fd8680b8190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8680b7740 tx=0x7fd86002a680 comp rx=0 tx=0).stop 2024-05-20T17:53:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.732+0000 7fd86e77e640 1 -- 172.21.15.6:0/1499253113 shutdown_connections 2024-05-20T17:53:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.732+0000 7fd86e77e640 1 --2- 172.21.15.6:0/1499253113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd86806dae0 0x7fd8680b8190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.732+0000 7fd86e77e640 1 --2- 172.21.15.6:0/1499253113 >> v2:172.21.15.171:3300/0 conn(0x7fd868162820 0x7fd8680b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.732+0000 7fd86e77e640 1 -- 172.21.15.6:0/1499253113 >> 172.21.15.6:0/1499253113 conn(0x7fd8680d4bd0 msgr2=0x7fd8680d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.732+0000 7fd86e77e640 1 -- 172.21.15.6:0/1499253113 shutdown_connections 2024-05-20T17:53:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.732+0000 7fd86e77e640 1 -- 172.21.15.6:0/1499253113 wait complete. 2024-05-20T17:53:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.734+0000 7fd86e77e640 1 Processor -- start 2024-05-20T17:53:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.734+0000 7fd86e77e640 1 -- start start 2024-05-20T17:53:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.735+0000 7fd86e77e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680b3e80 0x7fd8680b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.735+0000 7fd86e77e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd868162820 0x7fd8681584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.735+0000 7fd86e77e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8680b61e0 0x7fd8680b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.735+0000 7fd86e77e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8680d4780 con 0x7fd8680b3e80 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.735+0000 7fd86e77e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8680d0300 con 0x7fd8680b61e0 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.735+0000 7fd86e77e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd8680d4900 con 0x7fd868162820 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680b3e80 0x7fd8680b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680b3e80 0x7fd8680b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47584/0 (socket says 172.21.15.6:47584) 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 -- 172.21.15.6:0/501342073 learned_addr learned my addr 172.21.15.6:0/501342073 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd86cd1b640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8680b61e0 0x7fd8680b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd8677fe640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd868162820 0x7fd8681584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 -- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd868162820 msgr2=0x7fd8681584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd868162820 0x7fd8681584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 -- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8680b61e0 msgr2=0x7fd8680b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8680b61e0 0x7fd8680b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 -- 172.21.15.6:0/501342073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd868156a60 con 0x7fd8680b3e80 2024-05-20T17:53:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd8677fe640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd868162820 0x7fd8681584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd867fff640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680b3e80 0x7fd8680b5ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd85800d5f0 tx=0x7fd85800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd864ff9640 1 -- 172.21.15.6:0/501342073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8580125f0 con 0x7fd8680b3e80 2024-05-20T17:53:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd864ff9640 1 -- 172.21.15.6:0/501342073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd858019070 con 0x7fd8680b3e80 2024-05-20T17:53:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd868156d40 con 0x7fd8680b3e80 2024-05-20T17:53:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd864ff9640 1 -- 172.21.15.6:0/501342073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8580129d0 con 0x7fd8680b3e80 2024-05-20T17:53:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.736+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd868157300 con 0x7fd8680b3e80 2024-05-20T17:53:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.737+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd868075b00 con 0x7fd8680b3e80 2024-05-20T17:53:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.738+0000 7fd864ff9640 1 -- 172.21.15.6:0/501342073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd858012b70 con 0x7fd8680b3e80 2024-05-20T17:53:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.739+0000 7fd864ff9640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85406be30 0x7fd85406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.739+0000 7fd864ff9640 1 -- 172.21.15.6:0/501342073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd85808b550 con 0x7fd8680b3e80 2024-05-20T17:53:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.739+0000 7fd8677fe640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85406be30 0x7fd85406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.739+0000 7fd8677fe640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85406be30 0x7fd85406e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd86815ba80 tx=0x7fd85c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.743+0000 7fd864ff9640 1 -- 172.21.15.6:0/501342073 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd858059bc0 con 0x7fd8680b3e80 2024-05-20T17:53:18.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.927+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd8680b85a0 con 0x7fd8680b3e80 2024-05-20T17:53:18.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.928+0000 7fd864ff9640 1 -- 172.21.15.6:0/501342073 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fd8580594c0 con 0x7fd8680b3e80 2024-05-20T17:53:18.927 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85406be30 msgr2=0x7fd85406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85406be30 0x7fd85406e340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd86815ba80 tx=0x7fd85c009040 comp rx=0 tx=0).stop 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680b3e80 msgr2=0x7fd8680b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680b3e80 0x7fd8680b5ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd85800d5f0 tx=0x7fd85800dab0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 shutdown_connections 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85406be30 0x7fd85406e340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8680b61e0 0x7fd8680b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd868162820 0x7fd8681584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 --2- 172.21.15.6:0/501342073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8680b3e80 0x7fd8680b5ca0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 >> 172.21.15.6:0/501342073 conn(0x7fd8680d4bd0 msgr2=0x7fd86815f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 shutdown_connections 2024-05-20T17:53:18.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:18.930+0000 7fd86e77e640 1 -- 172.21.15.6:0/501342073 wait complete. 2024-05-20T17:53:18.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:53:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.057+0000 7f241d287640 1 Processor -- start 2024-05-20T17:53:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.057+0000 7f241d287640 1 -- start start 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.058+0000 7f241d287640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2418162820 0x7f24180b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.058+0000 7f241d287640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f241806dae0 0x7f24180b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.058+0000 7f241d287640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24180d0630 con 0x7f24180b3e80 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.058+0000 7f241d287640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f24180d39c0 con 0x7f241806dae0 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.058+0000 7f241d287640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f24180d3ca0 con 0x7f2418162820 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.059+0000 7f24177fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f241806dae0 0x7f24180b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.059+0000 7f24177fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f241806dae0 0x7f24180b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47588/0 (socket says 172.21.15.6:47588) 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.059+0000 7f24177fe640 1 -- 172.21.15.6:0/3251992351 learned_addr learned my addr 172.21.15.6:0/3251992351 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.059+0000 7f2416ffd640 1 --2- 172.21.15.6:0/3251992351 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2418162820 0x7f24180b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.059+0000 7f24177fe640 1 -- 172.21.15.6:0/3251992351 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2418162820 msgr2=0x7f24180b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.059+0000 7f24177fe640 1 --2- 172.21.15.6:0/3251992351 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2418162820 0x7f24180b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.059+0000 7f24177fe640 1 -- 172.21.15.6:0/3251992351 >> v1:172.21.15.171:6789/0 conn(0x7f24180b3e80 legacy=0x7f241806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.059+0000 7f24177fe640 1 -- 172.21.15.6:0/3251992351 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24180d3f80 con 0x7f241806dae0 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.060+0000 7f24177fe640 1 --2- 172.21.15.6:0/3251992351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241806dae0 0x7f24180b8190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2410009e50 tx=0x7f241002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c175db143b2fe6b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.060+0000 7f2415ffb640 1 -- 172.21.15.6:0/3251992351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410036070 con 0x7f241806dae0 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.060+0000 7f2415ffb640 1 -- 172.21.15.6:0/3251992351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2410031600 con 0x7f241806dae0 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.060+0000 7f2415ffb640 1 -- 172.21.15.6:0/3251992351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24100319d0 con 0x7f241806dae0 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.061+0000 7f241d287640 1 -- 172.21.15.6:0/3251992351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241806dae0 msgr2=0x7f24180b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.061+0000 7f241d287640 1 --2- 172.21.15.6:0/3251992351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241806dae0 0x7f24180b8190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2410009e50 tx=0x7f241002a710 comp rx=0 tx=0).stop 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.061+0000 7f241d287640 1 -- 172.21.15.6:0/3251992351 shutdown_connections 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.061+0000 7f241d287640 1 --2- 172.21.15.6:0/3251992351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f241806dae0 0x7f24180b8190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.061+0000 7f241d287640 1 --2- 172.21.15.6:0/3251992351 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2418162820 0x7f24180b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.061+0000 7f241d287640 1 -- 172.21.15.6:0/3251992351 >> 172.21.15.6:0/3251992351 conn(0x7f24180d4bd0 msgr2=0x7f24180d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.061+0000 7f241d287640 1 -- 172.21.15.6:0/3251992351 shutdown_connections 2024-05-20T17:53:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.061+0000 7f241d287640 1 -- 172.21.15.6:0/3251992351 wait complete. 2024-05-20T17:53:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.063+0000 7f241d287640 1 Processor -- start 2024-05-20T17:53:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.063+0000 7f241d287640 1 -- start start 2024-05-20T17:53:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f241d287640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24180b3e80 0x7f24180c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f241d287640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2418162820 0x7f24180caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f241d287640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24180c9250 0x7f2418155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f241d287640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f24180d4780 con 0x7f2418162820 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f241d287640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f24180d0300 con 0x7f24180c9250 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f241d287640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f24180d4900 con 0x7f24180b3e80 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24167fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2418162820 0x7f24180caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24167fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2418162820 0x7f24180caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47604/0 (socket says 172.21.15.6:47604) 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24167fc640 1 -- 172.21.15.6:0/2573554454 learned_addr learned my addr 172.21.15.6:0/2573554454 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24177fe640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24180c9250 0x7f2418155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f2416ffd640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24180b3e80 0x7f24180c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24167fc640 1 -- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24180b3e80 msgr2=0x7f24180c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24167fc640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24180b3e80 0x7f24180c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24167fc640 1 -- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24180c9250 msgr2=0x7f2418155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24167fc640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24180c9250 0x7f2418155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.064+0000 7f24167fc640 1 -- 172.21.15.6:0/2573554454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241815ee30 con 0x7f2418162820 2024-05-20T17:53:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.065+0000 7f24167fc640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2418162820 0x7f24180caea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c440 tx=0x7f240c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.065+0000 7f23ff7fe640 1 -- 172.21.15.6:0/2573554454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c0052d0 con 0x7f2418162820 2024-05-20T17:53:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.065+0000 7f23ff7fe640 1 -- 172.21.15.6:0/2573554454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c005470 con 0x7f2418162820 2024-05-20T17:53:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.065+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241815f110 con 0x7f2418162820 2024-05-20T17:53:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.065+0000 7f23ff7fe640 1 -- 172.21.15.6:0/2573554454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c007260 con 0x7f2418162820 2024-05-20T17:53:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.065+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f241815f6d0 con 0x7f2418162820 2024-05-20T17:53:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.066+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f241815eba0 con 0x7f2418162820 2024-05-20T17:53:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.067+0000 7f23ff7fe640 1 -- 172.21.15.6:0/2573554454 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f240c007400 con 0x7f2418162820 2024-05-20T17:53:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.067+0000 7f23ff7fe640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240406be60 0x7f240406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.067+0000 7f23ff7fe640 1 -- 172.21.15.6:0/2573554454 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f240c08a560 con 0x7f2418162820 2024-05-20T17:53:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.068+0000 7f2416ffd640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240406be60 0x7f240406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.068+0000 7f2416ffd640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240406be60 0x7f240406e370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2408009aa0 tx=0x7f2408009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.072+0000 7f23ff7fe640 1 -- 172.21.15.6:0/2573554454 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f240c058580 con 0x7f2418162820 2024-05-20T17:53:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.270+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f24180d5510 con 0x7f2418162820 2024-05-20T17:53:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.271+0000 7f23ff7fe640 1 -- 172.21.15.6:0/2573554454 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f24180d5510 con 0x7f2418162820 2024-05-20T17:53:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240406be60 msgr2=0x7f240406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240406be60 0x7f240406e370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2408009aa0 tx=0x7f2408009190 comp rx=0 tx=0).stop 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2418162820 msgr2=0x7f24180caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2418162820 0x7f24180caea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c440 tx=0x7f240c00c900 comp rx=0 tx=0).stop 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 shutdown_connections 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240406be60 0x7f240406e370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24180c9250 0x7f2418155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2418162820 0x7f24180caea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 --2- 172.21.15.6:0/2573554454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f24180b3e80 0x7f24180c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 >> 172.21.15.6:0/2573554454 conn(0x7f24180d4bd0 msgr2=0x7f2418161120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 shutdown_connections 2024-05-20T17:53:19.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.273+0000 7f241d287640 1 -- 172.21.15.6:0/2573554454 wait complete. 2024-05-20T17:53:19.282 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:53:19.283 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:19.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.456+0000 7fbc9f032640 1 Processor -- start 2024-05-20T17:53:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.456+0000 7fbc9f032640 1 -- start start 2024-05-20T17:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9f032640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc98163a10 0x7fbc980d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9f032640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbc980b4010 0x7fbc980cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9f032640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc980d14b0 0x7fbc980d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9f032640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbc980d3ca0 con 0x7fbc98163a10 2024-05-20T17:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9f032640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbc980d0370 con 0x7fbc980b4010 2024-05-20T17:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9f032640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbc980d0650 con 0x7fbc980d14b0 2024-05-20T17:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9cdce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc98163a10 0x7fbc980d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9cdce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc98163a10 0x7fbc980d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47620/0 (socket says 172.21.15.6:47620) 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9cdce640 1 -- 172.21.15.6:0/3180306490 learned_addr learned my addr 172.21.15.6:0/3180306490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9d5cf640 1 --2- 172.21.15.6:0/3180306490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc980d14b0 0x7fbc980d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc97fff640 1 --2- 172.21.15.6:0/3180306490 >> v2:172.21.15.171:3300/0 conn(0x7fbc980b4010 0x7fbc980cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9cdce640 1 -- 172.21.15.6:0/3180306490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc980d14b0 msgr2=0x7fbc980d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.457+0000 7fbc9cdce640 1 --2- 172.21.15.6:0/3180306490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc980d14b0 0x7fbc980d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc9cdce640 1 -- 172.21.15.6:0/3180306490 >> v2:172.21.15.171:3300/0 conn(0x7fbc980b4010 msgr2=0x7fbc980cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc9cdce640 1 --2- 172.21.15.6:0/3180306490 >> v2:172.21.15.171:3300/0 conn(0x7fbc980b4010 0x7fbc980cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc9cdce640 1 -- 172.21.15.6:0/3180306490 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc980d3650 con 0x7fbc98163a10 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc97fff640 1 --2- 172.21.15.6:0/3180306490 >> v2:172.21.15.171:3300/0 conn(0x7fbc980b4010 0x7fbc980cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc9d5cf640 1 --2- 172.21.15.6:0/3180306490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc980d14b0 0x7fbc980d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc9cdce640 1 --2- 172.21.15.6:0/3180306490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc98163a10 0x7fbc980d4130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbc980b7f80 tx=0x7fbc8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77137262df297c01 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc977fe640 1 -- 172.21.15.6:0/3180306490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80037070 con 0x7fbc98163a10 2024-05-20T17:53:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc977fe640 1 -- 172.21.15.6:0/3180306490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc80032440 con 0x7fbc98163a10 2024-05-20T17:53:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.458+0000 7fbc977fe640 1 -- 172.21.15.6:0/3180306490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80032810 con 0x7fbc98163a10 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 -- 172.21.15.6:0/3180306490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc98163a10 msgr2=0x7fbc980d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 --2- 172.21.15.6:0/3180306490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc98163a10 0x7fbc980d4130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbc980b7f80 tx=0x7fbc8002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 -- 172.21.15.6:0/3180306490 shutdown_connections 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 --2- 172.21.15.6:0/3180306490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc980d14b0 0x7fbc980d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 --2- 172.21.15.6:0/3180306490 >> v2:172.21.15.171:3300/0 conn(0x7fbc980b4010 0x7fbc980cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 --2- 172.21.15.6:0/3180306490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc98163a10 0x7fbc980d4130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 -- 172.21.15.6:0/3180306490 >> 172.21.15.6:0/3180306490 conn(0x7fbc9806d240 msgr2=0x7fbc9806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 -- 172.21.15.6:0/3180306490 shutdown_connections 2024-05-20T17:53:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.459+0000 7fbc9f032640 1 -- 172.21.15.6:0/3180306490 wait complete. 2024-05-20T17:53:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.461+0000 7fbc9f032640 1 Processor -- start 2024-05-20T17:53:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.461+0000 7fbc9f032640 1 -- start start 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.462+0000 7fbc9f032640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc980b4010 0x7fbc98159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.462+0000 7fbc9f032640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc980d14b0 0x7fbc98160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.462+0000 7fbc9f032640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc98163a10 0x7fbc981f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.462+0000 7fbc9f032640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980d1e00 con 0x7fbc980d14b0 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc9f032640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980d0040 con 0x7fbc980b4010 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc9f032640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbc980b8210 con 0x7fbc98163a10 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc980d14b0 0x7fbc98160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc980d14b0 0x7fbc98160840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47634/0 (socket says 172.21.15.6:47634) 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 -- 172.21.15.6:0/1738997947 learned_addr learned my addr 172.21.15.6:0/1738997947 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc9cdce640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc980b4010 0x7fbc98159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc9d5cf640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc98163a10 0x7fbc981f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 -- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc98163a10 msgr2=0x7fbc981f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc98163a10 0x7fbc981f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 -- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc980b4010 msgr2=0x7fbc98159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc980b4010 0x7fbc98159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 -- 172.21.15.6:0/1738997947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc98158a30 con 0x7fbc980d14b0 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc97fff640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc980d14b0 0x7fbc98160840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800ce60 tx=0x7fbc8800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc957fa640 1 -- 172.21.15.6:0/1738997947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800f890 con 0x7fbc980d14b0 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc957fa640 1 -- 172.21.15.6:0/1738997947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8800fa30 con 0x7fbc980d14b0 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc98158d10 con 0x7fbc980d14b0 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc957fa640 1 -- 172.21.15.6:0/1738997947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800fe20 con 0x7fbc980d14b0 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.463+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc981592d0 con 0x7fbc980d14b0 2024-05-20T17:53:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.464+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc98075b00 con 0x7fbc980d14b0 2024-05-20T17:53:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.465+0000 7fbc957fa640 1 -- 172.21.15.6:0/1738997947 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc88018400 con 0x7fbc980d14b0 2024-05-20T17:53:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.466+0000 7fbc957fa640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc7806be30 0x7fbc7806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.466+0000 7fbc957fa640 1 -- 172.21.15.6:0/1738997947 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbc8808bf30 con 0x7fbc980d14b0 2024-05-20T17:53:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.466+0000 7fbc9cdce640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc7806be30 0x7fbc7806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.466+0000 7fbc9cdce640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc7806be30 0x7fbc7806e340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc80034000 tx=0x7fbc8002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.470+0000 7fbc957fa640 1 -- 172.21.15.6:0/1738997947 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc88014030 con 0x7fbc980d14b0 2024-05-20T17:53:19.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.661+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc981587c0 con 0x7fbc980d14b0 2024-05-20T17:53:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.662+0000 7fbc957fa640 1 -- 172.21.15.6:0/1738997947 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fbc8800ae20 con 0x7fbc980d14b0 2024-05-20T17:53:19.661 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:19.661 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc7806be30 msgr2=0x7fbc7806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc7806be30 0x7fbc7806e340 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc80034000 tx=0x7fbc8002e000 comp rx=0 tx=0).stop 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc980d14b0 msgr2=0x7fbc98160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc980d14b0 0x7fbc98160840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800ce60 tx=0x7fbc8800a650 comp rx=0 tx=0).stop 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 shutdown_connections 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc7806be30 0x7fbc7806e340 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc98163a10 0x7fbc981f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc980d14b0 0x7fbc98160840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 --2- 172.21.15.6:0/1738997947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc980b4010 0x7fbc98159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 >> 172.21.15.6:0/1738997947 conn(0x7fbc9806d240 msgr2=0x7fbc980b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 shutdown_connections 2024-05-20T17:53:19.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.665+0000 7fbc9f032640 1 -- 172.21.15.6:0/1738997947 wait complete. 2024-05-20T17:53:19.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:19.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.795+0000 7f260563d640 1 Processor -- start 2024-05-20T17:53:19.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.795+0000 7f260563d640 1 -- start start 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f260563d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f26000af330 0x7f260006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f260563d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f260006cb70 0x7f26000d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f260563d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26000d1ed0 con 0x7f26000d1ac0 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f260563d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f26000af740 con 0x7f260006cb70 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f260563d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f260015c880 con 0x7f26000af330 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f25fe7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f260006cb70 0x7f26000d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f25ff7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f26000d1ac0 0x7f260006d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60144/0 (socket says 172.21.15.6:60144) 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f25fe7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f260006cb70 0x7f26000d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47636/0 (socket says 172.21.15.6:47636) 2024-05-20T17:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f25ff7fe640 1 -- 172.21.15.6:0/2306281662 learned_addr learned my addr 172.21.15.6:0/2306281662 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.796+0000 7f25feffd640 1 --2- 172.21.15.6:0/2306281662 >> v2:172.21.15.171:3300/0 conn(0x7f26000af330 0x7f260006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.797+0000 7f25fe7fc640 1 -- 172.21.15.6:0/2306281662 >> v2:172.21.15.171:3300/0 conn(0x7f26000af330 msgr2=0x7f260006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.797+0000 7f25fe7fc640 1 --2- 172.21.15.6:0/2306281662 >> v2:172.21.15.171:3300/0 conn(0x7f26000af330 0x7f260006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.797+0000 7f25fe7fc640 1 -- 172.21.15.6:0/2306281662 >> v1:172.21.15.6:6789/0 conn(0x7f26000d1ac0 legacy=0x7f260006d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.797+0000 7f25fe7fc640 1 -- 172.21.15.6:0/2306281662 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260015cb60 con 0x7f260006cb70 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.797+0000 7f25fdffb640 1 -- 172.21.15.6:0/2306281662 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183582651 0 0) 0x7f25f8001110 con 0x7f26000d1ac0 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.797+0000 7f25feffd640 1 --2- 172.21.15.6:0/2306281662 >> v2:172.21.15.171:3300/0 conn(0x7f26000af330 0x7f260006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.797+0000 7f25fe7fc640 1 --2- 172.21.15.6:0/2306281662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260006cb70 0x7f26000d1580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f26000b7660 tx=0x7f25e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760e449ded3e7103 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f25fdffb640 1 -- 172.21.15.6:0/2306281662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8037070 con 0x7f260006cb70 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f25fdffb640 1 -- 172.21.15.6:0/2306281662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e8032440 con 0x7f260006cb70 2024-05-20T17:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f25fdffb640 1 -- 172.21.15.6:0/2306281662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e802ae60 con 0x7f260006cb70 2024-05-20T17:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f260563d640 1 -- 172.21.15.6:0/2306281662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260006cb70 msgr2=0x7f26000d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f260563d640 1 --2- 172.21.15.6:0/2306281662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260006cb70 0x7f26000d1580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f26000b7660 tx=0x7f25e802a110 comp rx=0 tx=0).stop 2024-05-20T17:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f260563d640 1 -- 172.21.15.6:0/2306281662 shutdown_connections 2024-05-20T17:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f260563d640 1 --2- 172.21.15.6:0/2306281662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f260006cb70 0x7f26000d1580 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f260563d640 1 --2- 172.21.15.6:0/2306281662 >> v2:172.21.15.171:3300/0 conn(0x7f26000af330 0x7f260006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f260563d640 1 -- 172.21.15.6:0/2306281662 >> 172.21.15.6:0/2306281662 conn(0x7f26000b6620 msgr2=0x7f26000b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f260563d640 1 -- 172.21.15.6:0/2306281662 shutdown_connections 2024-05-20T17:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.798+0000 7f260563d640 1 -- 172.21.15.6:0/2306281662 wait complete. 2024-05-20T17:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.800+0000 7f260563d640 1 Processor -- start 2024-05-20T17:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.800+0000 7f260563d640 1 -- start start 2024-05-20T17:53:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f260563d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260006cb70 0x7f2600157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f260563d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26000af330 0x7f2600140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f260563d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26000d1ac0 0x7f26001e8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f260563d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f260015d400 con 0x7f26000af330 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f260563d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f260015d120 con 0x7f26000d1ac0 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f260563d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f260015c4a0 con 0x7f260006cb70 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26000af330 0x7f2600140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26000af330 0x7f2600140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47644/0 (socket says 172.21.15.6:47644) 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 -- 172.21.15.6:0/4292324745 learned_addr learned my addr 172.21.15.6:0/4292324745 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25feffd640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260006cb70 0x7f2600157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25ff7fe640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26000d1ac0 0x7f26001e8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 -- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260006cb70 msgr2=0x7f2600157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260006cb70 0x7f2600157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 -- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26000d1ac0 msgr2=0x7f26001e8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26000d1ac0 0x7f26001e8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 -- 172.21.15.6:0/4292324745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260015f3b0 con 0x7f26000af330 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.802+0000 7f25fe7fc640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26000af330 0x7f2600140bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f25e8000c00 tx=0x7f25e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.803+0000 7f25f77fe640 1 -- 172.21.15.6:0/4292324745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8037040 con 0x7f26000af330 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.803+0000 7f25f77fe640 1 -- 172.21.15.6:0/4292324745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e8042070 con 0x7f26000af330 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.803+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26001f8b80 con 0x7f26000af330 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.803+0000 7f25f77fe640 1 -- 172.21.15.6:0/4292324745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8030bd0 con 0x7f26000af330 2024-05-20T17:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.803+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26001f9140 con 0x7f26000af330 2024-05-20T17:53:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.804+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2600075b00 con 0x7f26000af330 2024-05-20T17:53:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.804+0000 7f25f77fe640 1 -- 172.21.15.6:0/4292324745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f25e8047460 con 0x7f26000af330 2024-05-20T17:53:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.805+0000 7f25f77fe640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f25e006be30 0x7f25e006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:19.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.805+0000 7f25f77fe640 1 -- 172.21.15.6:0/4292324745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f25e80abc90 con 0x7f26000af330 2024-05-20T17:53:19.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.807+0000 7f25feffd640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f25e006be30 0x7f25e006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.808+0000 7f25feffd640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f25e006be30 0x7f25e006e340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f26000b3170 tx=0x7f25f0009870 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:19.811+0000 7f25f77fe640 1 -- 172.21.15.6:0/4292324745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f25e8032e20 con 0x7f26000af330 2024-05-20T17:53:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.001+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2600154890 con 0x7f26000af330 2024-05-20T17:53:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.002+0000 7f25f77fe640 1 -- 172.21.15.6:0/4292324745 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f25e8079cb0 con 0x7f26000af330 2024-05-20T17:53:20.000 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f25e006be30 msgr2=0x7f25e006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f25e006be30 0x7f25e006e340 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f26000b3170 tx=0x7f25f0009870 comp rx=0 tx=0).stop 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26000af330 msgr2=0x7f2600140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26000af330 0x7f2600140bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f25e8000c00 tx=0x7f25e80046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 shutdown_connections 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f25e006be30 0x7f25e006e340 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26000d1ac0 0x7f26001e8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26000af330 0x7f2600140bc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 --2- 172.21.15.6:0/4292324745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f260006cb70 0x7f2600157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 >> 172.21.15.6:0/4292324745 conn(0x7f26000b6620 msgr2=0x7f260006f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 shutdown_connections 2024-05-20T17:53:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.004+0000 7f260563d640 1 -- 172.21.15.6:0/4292324745 wait complete. 2024-05-20T17:53:20.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.133+0000 7f450acf7640 1 Processor -- start 2024-05-20T17:53:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.133+0000 7f450acf7640 1 -- start start 2024-05-20T17:53:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.134+0000 7f450acf7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f45040d0ab0 0x7f45040b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.134+0000 7f450acf7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45040b49a0 0x7f45040cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.134+0000 7f450acf7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45040b4db0 con 0x7f450406c6b0 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.134+0000 7f450acf7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f450406cac0 con 0x7f45040b49a0 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.134+0000 7f450acf7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f45040d0ec0 con 0x7f45040d0ab0 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.134+0000 7f4509294640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45040b49a0 0x7f45040cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.134+0000 7f4508a93640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f450406c6b0 0x7f450415f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60160/0 (socket says 172.21.15.6:60160) 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.134+0000 7f4508a93640 1 -- 172.21.15.6:0/1205361406 learned_addr learned my addr 172.21.15.6:0/1205361406 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.135+0000 7f4503fff640 1 --2- 172.21.15.6:0/1205361406 >> v2:172.21.15.171:3300/0 conn(0x7f45040d0ab0 0x7f45040b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.135+0000 7f4509294640 1 -- 172.21.15.6:0/1205361406 >> v2:172.21.15.171:3300/0 conn(0x7f45040d0ab0 msgr2=0x7f45040b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.135+0000 7f4509294640 1 --2- 172.21.15.6:0/1205361406 >> v2:172.21.15.171:3300/0 conn(0x7f45040d0ab0 0x7f45040b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.135+0000 7f4509294640 1 -- 172.21.15.6:0/1205361406 >> v1:172.21.15.6:6789/0 conn(0x7f450406c6b0 legacy=0x7f450415f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.135+0000 7f4509294640 1 -- 172.21.15.6:0/1205361406 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4504163020 con 0x7f45040b49a0 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.135+0000 7f45037fe640 1 -- 172.21.15.6:0/1205361406 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197073582 0 0) 0x7f44fc001110 con 0x7f450406c6b0 2024-05-20T17:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.135+0000 7f4503fff640 1 --2- 172.21.15.6:0/1205361406 >> v2:172.21.15.171:3300/0 conn(0x7f45040d0ab0 0x7f45040b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.135+0000 7f4509294640 1 --2- 172.21.15.6:0/1205361406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45040b49a0 0x7f45040cd8a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0097a0 tx=0x7f44ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49ea65864ff2c23 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f45037fe640 1 -- 172.21.15.6:0/1205361406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec037070 con 0x7f45040b49a0 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f45037fe640 1 -- 172.21.15.6:0/1205361406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ec02ae50 con 0x7f45040b49a0 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f45037fe640 1 -- 172.21.15.6:0/1205361406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec032660 con 0x7f45040b49a0 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f450acf7640 1 -- 172.21.15.6:0/1205361406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45040b49a0 msgr2=0x7f45040cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f450acf7640 1 --2- 172.21.15.6:0/1205361406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45040b49a0 0x7f45040cd8a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0097a0 tx=0x7f44ec02a140 comp rx=0 tx=0).stop 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f450acf7640 1 -- 172.21.15.6:0/1205361406 shutdown_connections 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f450acf7640 1 --2- 172.21.15.6:0/1205361406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45040b49a0 0x7f45040cd8a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f450acf7640 1 --2- 172.21.15.6:0/1205361406 >> v2:172.21.15.171:3300/0 conn(0x7f45040d0ab0 0x7f45040b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f450acf7640 1 -- 172.21.15.6:0/1205361406 >> 172.21.15.6:0/1205361406 conn(0x7f45040cf460 msgr2=0x7f45040cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f450acf7640 1 -- 172.21.15.6:0/1205361406 shutdown_connections 2024-05-20T17:53:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.136+0000 7f450acf7640 1 -- 172.21.15.6:0/1205361406 wait complete. 2024-05-20T17:53:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.138+0000 7f450acf7640 1 Processor -- start 2024-05-20T17:53:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.138+0000 7f450acf7640 1 -- start start 2024-05-20T17:53:20.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f450acf7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450406c6b0 0x7f45040b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f450acf7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45040b49a0 0x7f4504160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f450acf7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040d0ab0 0x7f45041620c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f450acf7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f45041638c0 con 0x7f450406c6b0 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f450acf7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f45041635e0 con 0x7f45040b49a0 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f450acf7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4504163ba0 con 0x7f45040d0ab0 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450406c6b0 0x7f45040b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450406c6b0 0x7f45040b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47656/0 (socket says 172.21.15.6:47656) 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 -- 172.21.15.6:0/4264977771 learned_addr learned my addr 172.21.15.6:0/4264977771 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4503fff640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45040b49a0 0x7f4504160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4509294640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040d0ab0 0x7f45041620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 -- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040d0ab0 msgr2=0x7f45041620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040d0ab0 0x7f45041620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 -- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45040b49a0 msgr2=0x7f4504160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45040b49a0 0x7f4504160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 -- 172.21.15.6:0/4264977771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450415fba0 con 0x7f450406c6b0 2024-05-20T17:53:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.140+0000 7f4508a93640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450406c6b0 0x7f45040b81b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00c460 tx=0x7f44fc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.141+0000 7f45017fa640 1 -- 172.21.15.6:0/4264977771 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc018070 con 0x7f450406c6b0 2024-05-20T17:53:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.141+0000 7f45017fa640 1 -- 172.21.15.6:0/4264977771 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc007500 con 0x7f450406c6b0 2024-05-20T17:53:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.141+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450415fe80 con 0x7f450406c6b0 2024-05-20T17:53:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.141+0000 7f45017fa640 1 -- 172.21.15.6:0/4264977771 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc004a20 con 0x7f450406c6b0 2024-05-20T17:53:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.141+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45041f6a90 con 0x7f450406c6b0 2024-05-20T17:53:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.142+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45040cfc30 con 0x7f450406c6b0 2024-05-20T17:53:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.142+0000 7f45017fa640 1 -- 172.21.15.6:0/4264977771 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44fc01b070 con 0x7f450406c6b0 2024-05-20T17:53:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.143+0000 7f45017fa640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44e406be60 0x7f44e406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.143+0000 7f45017fa640 1 -- 172.21.15.6:0/4264977771 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f44fc08a4d0 con 0x7f450406c6b0 2024-05-20T17:53:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.143+0000 7f4503fff640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44e406be60 0x7f44e406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.143+0000 7f4503fff640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44e406be60 0x7f44e406e370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44f40070b0 tx=0x7f44f4007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.147+0000 7f45017fa640 1 -- 172.21.15.6:0/4264977771 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f45040cfc30 con 0x7f450406c6b0 2024-05-20T17:53:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.330+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f45040cf870 con 0x7f450406c6b0 2024-05-20T17:53:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.331+0000 7f45017fa640 1 -- 172.21.15.6:0/4264977771 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f45040cf870 con 0x7f450406c6b0 2024-05-20T17:53:20.330 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44e406be60 msgr2=0x7f44e406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44e406be60 0x7f44e406e370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44f40070b0 tx=0x7f44f4007040 comp rx=0 tx=0).stop 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450406c6b0 msgr2=0x7f45040b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450406c6b0 0x7f45040b81b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00c460 tx=0x7f44fc00c920 comp rx=0 tx=0).stop 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 shutdown_connections 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44e406be60 0x7f44e406e370 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040d0ab0 0x7f45041620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45040b49a0 0x7f4504160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 --2- 172.21.15.6:0/4264977771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f450406c6b0 0x7f45040b81b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 >> 172.21.15.6:0/4264977771 conn(0x7f45040cf460 msgr2=0x7f450415bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 shutdown_connections 2024-05-20T17:53:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.333+0000 7f450acf7640 1 -- 172.21.15.6:0/4264977771 wait complete. 2024-05-20T17:53:20.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.463+0000 7fd6b7337640 1 Processor -- start 2024-05-20T17:53:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.463+0000 7fd6b7337640 1 -- start start 2024-05-20T17:53:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.464+0000 7fd6b7337640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd6b00b6620 0x7fd6b00ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.464+0000 7fd6b7337640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6b0162ce0 0x7fd6b00b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.464+0000 7fd6b7337640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b01634a0 con 0x7fd6b00b85b0 2024-05-20T17:53:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.464+0000 7fd6b7337640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b00d3480 con 0x7fd6b0162ce0 2024-05-20T17:53:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.464+0000 7fd6b7337640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b0163780 con 0x7fd6b00b6620 2024-05-20T17:53:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.464+0000 7fd6b48d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6b0162ce0 0x7fd6b00b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.465+0000 7fd6b48d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6b0162ce0 0x7fd6b00b8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47658/0 (socket says 172.21.15.6:47658) 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.465+0000 7fd6b48d2640 1 -- 172.21.15.6:0/525007891 learned_addr learned my addr 172.21.15.6:0/525007891 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.465+0000 7fd6b50d3640 1 --2- 172.21.15.6:0/525007891 >> v2:172.21.15.171:3300/0 conn(0x7fd6b00b6620 0x7fd6b00ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.465+0000 7fd6b48d2640 1 -- 172.21.15.6:0/525007891 >> v2:172.21.15.171:3300/0 conn(0x7fd6b00b6620 msgr2=0x7fd6b00ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.465+0000 7fd6b48d2640 1 --2- 172.21.15.6:0/525007891 >> v2:172.21.15.171:3300/0 conn(0x7fd6b00b6620 0x7fd6b00ba3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.465+0000 7fd6b48d2640 1 -- 172.21.15.6:0/525007891 >> v1:172.21.15.171:6789/0 conn(0x7fd6b00b85b0 legacy=0x7fd6b00d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.465+0000 7fd6b48d2640 1 -- 172.21.15.6:0/525007891 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b0163a60 con 0x7fd6b0162ce0 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.465+0000 7fd6b50d3640 1 --2- 172.21.15.6:0/525007891 >> v2:172.21.15.171:3300/0 conn(0x7fd6b00b6620 0x7fd6b00ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.466+0000 7fd6b48d2640 1 --2- 172.21.15.6:0/525007891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00b8070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd6b008db90 tx=0x7fd6a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9507c1840dfd22 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.466+0000 7fd6a7fff640 1 -- 172.21.15.6:0/525007891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0037070 con 0x7fd6b0162ce0 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.466+0000 7fd6a7fff640 1 -- 172.21.15.6:0/525007891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a0032440 con 0x7fd6b0162ce0 2024-05-20T17:53:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.466+0000 7fd6a7fff640 1 -- 172.21.15.6:0/525007891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0032810 con 0x7fd6b0162ce0 2024-05-20T17:53:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.466+0000 7fd6b7337640 1 -- 172.21.15.6:0/525007891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 msgr2=0x7fd6b00b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.466+0000 7fd6b7337640 1 --2- 172.21.15.6:0/525007891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00b8070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd6b008db90 tx=0x7fd6a002a270 comp rx=0 tx=0).stop 2024-05-20T17:53:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.467+0000 7fd6b7337640 1 -- 172.21.15.6:0/525007891 shutdown_connections 2024-05-20T17:53:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.467+0000 7fd6b7337640 1 --2- 172.21.15.6:0/525007891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00b8070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.467+0000 7fd6b7337640 1 --2- 172.21.15.6:0/525007891 >> v2:172.21.15.171:3300/0 conn(0x7fd6b00b6620 0x7fd6b00ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.467+0000 7fd6b7337640 1 -- 172.21.15.6:0/525007891 >> 172.21.15.6:0/525007891 conn(0x7fd6b006d240 msgr2=0x7fd6b006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.467+0000 7fd6b7337640 1 -- 172.21.15.6:0/525007891 shutdown_connections 2024-05-20T17:53:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.467+0000 7fd6b7337640 1 -- 172.21.15.6:0/525007891 wait complete. 2024-05-20T17:53:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.468+0000 7fd6b7337640 1 Processor -- start 2024-05-20T17:53:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.468+0000 7fd6b7337640 1 -- start start 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b7337640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6b00b6620 0x7fd6b00cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b7337640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6b00b85b0 0x7fd6b00c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b7337640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b7337640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b01630f0 con 0x7fd6b0162ce0 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b7337640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b00d4300 con 0x7fd6b00b6620 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b7337640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b01f5b30 con 0x7fd6b00b85b0 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47660/0 (socket says 172.21.15.6:47660) 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 -- 172.21.15.6:0/2363000722 learned_addr learned my addr 172.21.15.6:0/2363000722 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b50d3640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6b00b6620 0x7fd6b00cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b48d2640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6b00b85b0 0x7fd6b00c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 -- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6b00b85b0 msgr2=0x7fd6b00c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6b00b85b0 0x7fd6b00c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 -- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6b00b6620 msgr2=0x7fd6b00cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6b00b6620 0x7fd6b00cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 -- 172.21.15.6:0/2363000722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b00cc590 con 0x7fd6b0162ce0 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b50d3640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6b00b6620 0x7fd6b00cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.470+0000 7fd6b58d4640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00c9a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c730 tx=0x7fd6a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.471+0000 7fd6a5ffb640 1 -- 172.21.15.6:0/2363000722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8003b70 con 0x7fd6b0162ce0 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.471+0000 7fd6a5ffb640 1 -- 172.21.15.6:0/2363000722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a8003d10 con 0x7fd6b0162ce0 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.471+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b00c8730 con 0x7fd6b0162ce0 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.471+0000 7fd6a5ffb640 1 -- 172.21.15.6:0/2363000722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8005310 con 0x7fd6b0162ce0 2024-05-20T17:53:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.471+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b00c8fd0 con 0x7fd6b0162ce0 2024-05-20T17:53:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.472+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b0075b00 con 0x7fd6b0162ce0 2024-05-20T17:53:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.473+0000 7fd6a5ffb640 1 -- 172.21.15.6:0/2363000722 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6a80056c0 con 0x7fd6b0162ce0 2024-05-20T17:53:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.473+0000 7fd6a5ffb640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd69406be30 0x7fd69406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.473+0000 7fd6a5ffb640 1 -- 172.21.15.6:0/2363000722 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd6a808b150 con 0x7fd6b0162ce0 2024-05-20T17:53:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.473+0000 7fd6b50d3640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd69406be30 0x7fd69406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.474+0000 7fd6b50d3640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd69406be30 0x7fd69406e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac006fd0 tx=0x7fd6ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.478+0000 7fd6a5ffb640 1 -- 172.21.15.6:0/2363000722 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd6a80597c0 con 0x7fd6b0162ce0 2024-05-20T17:53:20.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.664+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd6b00d2fa0 con 0x7fd6b0162ce0 2024-05-20T17:53:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.664+0000 7fd6a5ffb640 1 -- 172.21.15.6:0/2363000722 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fd6a80590c0 con 0x7fd6b0162ce0 2024-05-20T17:53:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:20.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd69406be30 msgr2=0x7fd69406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd69406be30 0x7fd69406e340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac006fd0 tx=0x7fd6ac008040 comp rx=0 tx=0).stop 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 msgr2=0x7fd6b00c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00c9a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c730 tx=0x7fd6a800cbf0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 shutdown_connections 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd69406be30 0x7fd69406e340 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6b0162ce0 0x7fd6b00c9a30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6b00b85b0 0x7fd6b00c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 --2- 172.21.15.6:0/2363000722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6b00b6620 0x7fd6b00cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 >> 172.21.15.6:0/2363000722 conn(0x7fd6b006d240 msgr2=0x7fd6b00cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 shutdown_connections 2024-05-20T17:53:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.667+0000 7fd6b7337640 1 -- 172.21.15.6:0/2363000722 wait complete. 2024-05-20T17:53:20.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.795+0000 7f2c18fc7640 1 Processor -- start 2024-05-20T17:53:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.795+0000 7f2c18fc7640 1 -- start start 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c18fc7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c14162820 0x7f2c140b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c18fc7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406dae0 0x7f2c140b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c18fc7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c140d0630 con 0x7f2c140b3e80 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c18fc7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f2c140d39c0 con 0x7f2c14162820 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c18fc7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140d3ca0 con 0x7f2c1406dae0 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c1259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c14162820 0x7f2c140b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c1259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2c14162820 0x7f2c140b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47668/0 (socket says 172.21.15.6:47668) 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c1259c640 1 -- 172.21.15.6:0/4085753128 learned_addr learned my addr 172.21.15.6:0/4085753128 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c12d9d640 1 --2- 172.21.15.6:0/4085753128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406dae0 0x7f2c140b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c1259c640 1 -- 172.21.15.6:0/4085753128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406dae0 msgr2=0x7f2c140b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c1259c640 1 --2- 172.21.15.6:0/4085753128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406dae0 0x7f2c140b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c1259c640 1 -- 172.21.15.6:0/4085753128 >> v1:172.21.15.171:6789/0 conn(0x7f2c140b3e80 legacy=0x7f2c1406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c1259c640 1 -- 172.21.15.6:0/4085753128 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c140d3f80 con 0x7f2c14162820 2024-05-20T17:53:20.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.797+0000 7f2c12d9d640 1 --2- 172.21.15.6:0/4085753128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406dae0 0x7f2c140b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.798+0000 7f2c1259c640 1 --2- 172.21.15.6:0/4085753128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140b3940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009e50 tx=0x7f2c0402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a84df78090013d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.798+0000 7f2c1159a640 1 -- 172.21.15.6:0/4085753128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04036070 con 0x7f2c14162820 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.798+0000 7f2c1159a640 1 -- 172.21.15.6:0/4085753128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04031600 con 0x7f2c14162820 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.798+0000 7f2c1159a640 1 -- 172.21.15.6:0/4085753128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c040319d0 con 0x7f2c14162820 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.799+0000 7f2c18fc7640 1 -- 172.21.15.6:0/4085753128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 msgr2=0x7f2c140b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.799+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/4085753128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140b3940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009e50 tx=0x7f2c0402a710 comp rx=0 tx=0).stop 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.799+0000 7f2c18fc7640 1 -- 172.21.15.6:0/4085753128 shutdown_connections 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.799+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/4085753128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406dae0 0x7f2c140b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.799+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/4085753128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140b3940 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.799+0000 7f2c18fc7640 1 -- 172.21.15.6:0/4085753128 >> 172.21.15.6:0/4085753128 conn(0x7f2c140d4bd0 msgr2=0x7f2c140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.799+0000 7f2c18fc7640 1 -- 172.21.15.6:0/4085753128 shutdown_connections 2024-05-20T17:53:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.799+0000 7f2c18fc7640 1 -- 172.21.15.6:0/4085753128 wait complete. 2024-05-20T17:53:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.801+0000 7f2c18fc7640 1 Processor -- start 2024-05-20T17:53:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.801+0000 7f2c18fc7640 1 -- start start 2024-05-20T17:53:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c18fc7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c140b3e80 0x7f2c141f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c18fc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c18fc7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c140cd4a0 0x7f2c140cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c18fc7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140d4780 con 0x7f2c14162820 2024-05-20T17:53:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c18fc7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140d0300 con 0x7f2c140b3e80 2024-05-20T17:53:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c18fc7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140d4900 con 0x7f2c140cd4a0 2024-05-20T17:53:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c11d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c11d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47672/0 (socket says 172.21.15.6:47672) 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.802+0000 7f2c11d9b640 1 -- 172.21.15.6:0/912656646 learned_addr learned my addr 172.21.15.6:0/912656646 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c1259c640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c140b3e80 0x7f2c141f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c12d9d640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c140cd4a0 0x7f2c140cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c11d9b640 1 -- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c140cd4a0 msgr2=0x7f2c140cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c11d9b640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c140cd4a0 0x7f2c140cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c11d9b640 1 -- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c140b3e80 msgr2=0x7f2c141f91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c11d9b640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c140b3e80 0x7f2c141f91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c11d9b640 1 -- 172.21.15.6:0/912656646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c141f9710 con 0x7f2c14162820 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c1259c640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c140b3e80 0x7f2c141f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c12d9d640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c140cd4a0 0x7f2c140cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c11d9b640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140ca270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00c3f0 tx=0x7f2bfc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c0affd640 1 -- 172.21.15.6:0/912656646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0052d0 con 0x7f2c14162820 2024-05-20T17:53:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c0affd640 1 -- 172.21.15.6:0/912656646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc005490 con 0x7f2c14162820 2024-05-20T17:53:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c0affd640 1 -- 172.21.15.6:0/912656646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc007260 con 0x7f2c14162820 2024-05-20T17:53:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c140ca7b0 con 0x7f2c14162820 2024-05-20T17:53:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.803+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c140cc290 con 0x7f2c14162820 2024-05-20T17:53:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.804+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c140cbd10 con 0x7f2c14162820 2024-05-20T17:53:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.805+0000 7f2c0affd640 1 -- 172.21.15.6:0/912656646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bfc007400 con 0x7f2c14162820 2024-05-20T17:53:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.805+0000 7f2c0affd640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.805+0000 7f2c0affd640 1 -- 172.21.15.6:0/912656646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2bfc08a710 con 0x7f2c14162820 2024-05-20T17:53:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.806+0000 7f2c1259c640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.806+0000 7f2c1259c640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c04033000 tx=0x7f2c04009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:20.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.810+0000 7f2c0affd640 1 -- 172.21.15.6:0/912656646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2c140cbd10 con 0x7f2c14162820 2024-05-20T17:53:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.993+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2c14075b00 con 0x7f2c14162820 2024-05-20T17:53:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.993+0000 7f2c0affd640 1 -- 172.21.15.6:0/912656646 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f2c141f9710 con 0x7f2c14162820 2024-05-20T17:53:20.992 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 msgr2=0x7f2bf406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c04033000 tx=0x7f2c04009000 comp rx=0 tx=0).stop 2024-05-20T17:53:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 msgr2=0x7f2c140ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140ca270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00c3f0 tx=0x7f2bfc00c8b0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 shutdown_connections 2024-05-20T17:53:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c140cd4a0 0x7f2c140cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c14162820 0x7f2c140ca270 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 --2- 172.21.15.6:0/912656646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c140b3e80 0x7f2c141f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 >> 172.21.15.6:0/912656646 conn(0x7f2c140d4bd0 msgr2=0x7f2c140b9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 shutdown_connections 2024-05-20T17:53:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:20.995+0000 7f2c18fc7640 1 -- 172.21.15.6:0/912656646 wait complete. 2024-05-20T17:53:21.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:53:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.123+0000 7f9ebbf96640 1 Processor -- start 2024-05-20T17:53:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.123+0000 7f9ebbf96640 1 -- start start 2024-05-20T17:53:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.124+0000 7f9ebbf96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9eb40b2bf0 0x7f9eb4162f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.124+0000 7f9ebbf96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb40b0440 0x7f9eb4163450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.124+0000 7f9ebbf96640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb40ae7b0 con 0x7f9eb4163990 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.124+0000 7f9ebbf96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb4163da0 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.124+0000 7f9ebbf96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb40b0b70 con 0x7f9eb40b0440 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.124+0000 7f9eb9d32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9eb40b2bf0 0x7f9eb4162f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.124+0000 7f9eb9d32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9eb40b2bf0 0x7f9eb4162f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47678/0 (socket says 172.21.15.6:47678) 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.124+0000 7f9eb9d32640 1 -- 172.21.15.6:0/1976933981 learned_addr learned my addr 172.21.15.6:0/1976933981 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.125+0000 7f9eb9531640 1 --2- 172.21.15.6:0/1976933981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb40b0440 0x7f9eb4163450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.125+0000 7f9eb9d32640 1 -- 172.21.15.6:0/1976933981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb40b0440 msgr2=0x7f9eb4163450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.125+0000 7f9eb9d32640 1 --2- 172.21.15.6:0/1976933981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb40b0440 0x7f9eb4163450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.125+0000 7f9eb9d32640 1 -- 172.21.15.6:0/1976933981 >> v1:172.21.15.171:6789/0 conn(0x7f9eb4163990 legacy=0x7f9eb40d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.125+0000 7f9eb9d32640 1 -- 172.21.15.6:0/1976933981 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb40b3170 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.126+0000 7f9eb9d32640 1 --2- 172.21.15.6:0/1976933981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb4162f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009870 tx=0x7f9eac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49836da301196c1f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.126+0000 7f9eb8d30640 1 -- 172.21.15.6:0/1976933981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac037070 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.126+0000 7f9eb8d30640 1 -- 172.21.15.6:0/1976933981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eac032440 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.126+0000 7f9eb8d30640 1 -- 172.21.15.6:0/1976933981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac032810 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.126+0000 7f9ebbf96640 1 -- 172.21.15.6:0/1976933981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 msgr2=0x7f9eb4162f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.126+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/1976933981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb4162f10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009870 tx=0x7f9eac02a270 comp rx=0 tx=0).stop 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.127+0000 7f9ebbf96640 1 -- 172.21.15.6:0/1976933981 shutdown_connections 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.127+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/1976933981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb40b0440 0x7f9eb4163450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.127+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/1976933981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb4162f10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.127+0000 7f9ebbf96640 1 -- 172.21.15.6:0/1976933981 >> 172.21.15.6:0/1976933981 conn(0x7f9eb40b6620 msgr2=0x7f9eb40b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.127+0000 7f9ebbf96640 1 -- 172.21.15.6:0/1976933981 shutdown_connections 2024-05-20T17:53:21.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.127+0000 7f9ebbf96640 1 -- 172.21.15.6:0/1976933981 wait complete. 2024-05-20T17:53:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.128+0000 7f9ebbf96640 1 Processor -- start 2024-05-20T17:53:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.128+0000 7f9ebbf96640 1 -- start start 2024-05-20T17:53:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9ebbf96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9eb40b0440 0x7f9eb415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9ebbf96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb41eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9ebbf96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb4163990 0x7f9eb41eb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9ebbf96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb40b10a0 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9ebbf96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb40b1410 con 0x7f9eb40b0440 2024-05-20T17:53:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9ebbf96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb406df70 con 0x7f9eb4163990 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb41eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb41eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47690/0 (socket says 172.21.15.6:47690) 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 -- 172.21.15.6:0/344894578 learned_addr learned my addr 172.21.15.6:0/344894578 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eba533640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb4163990 0x7f9eb41eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9d32640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9eb40b0440 0x7f9eb415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 -- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb4163990 msgr2=0x7f9eb41eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb4163990 0x7f9eb41eb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 -- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9eb40b0440 msgr2=0x7f9eb415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9eb40b0440 0x7f9eb415d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 -- 172.21.15.6:0/344894578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb40cd1b0 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.130+0000 7f9eb9531640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb41eaec0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d10 tx=0x7f9ea800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.131+0000 7f9eb27fc640 1 -- 172.21.15.6:0/344894578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8018020 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.131+0000 7f9eb27fc640 1 -- 172.21.15.6:0/344894578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea8014480 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.131+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb40cd490 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.131+0000 7f9eb27fc640 1 -- 172.21.15.6:0/344894578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8014830 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.131+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb40cda50 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.132+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb4075b00 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.132+0000 7f9eb27fc640 1 -- 172.21.15.6:0/344894578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ea801b020 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.133+0000 7f9eb27fc640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9ea006be30 0x7f9ea006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.133+0000 7f9eb27fc640 1 -- 172.21.15.6:0/344894578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9ea808bf50 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.133+0000 7f9eb9d32640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9ea006be30 0x7f9ea006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.133+0000 7f9eb9d32640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9ea006be30 0x7f9ea006e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9eac034000 tx=0x7f9eac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.137+0000 7f9eb27fc640 1 -- 172.21.15.6:0/344894578 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9ea8022020 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.332+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9eb409a6a0 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.332+0000 7f9eb27fc640 1 -- 172.21.15.6:0/344894578 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f9ea8010040 con 0x7f9eb40b2bf0 2024-05-20T17:53:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:53:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9ea006be30 msgr2=0x7f9ea006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9ea006be30 0x7f9ea006e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9eac034000 tx=0x7f9eac02e000 comp rx=0 tx=0).stop 2024-05-20T17:53:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 msgr2=0x7f9eb41eaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb41eaec0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d10 tx=0x7f9ea800c490 comp rx=0 tx=0).stop 2024-05-20T17:53:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 shutdown_connections 2024-05-20T17:53:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9ea006be30 0x7f9ea006e340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9eb4163990 0x7f9eb41eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eb40b2bf0 0x7f9eb41eaec0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 --2- 172.21.15.6:0/344894578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9eb40b0440 0x7f9eb415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 >> 172.21.15.6:0/344894578 conn(0x7f9eb40b6620 msgr2=0x7f9eb406d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 shutdown_connections 2024-05-20T17:53:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:21.334+0000 7f9ebbf96640 1 -- 172.21.15.6:0/344894578 wait complete. 2024-05-20T17:53:21.344 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-05-20T17:53:21.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:21.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-20T17:53:21.368 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[44951]: fuse finished with error 0 and tester_r 0 2024-05-20T17:53:21.370 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:53:27.472 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:53:27.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:27.473 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-20T17:53:27.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:27.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.681+0000 7fd4bb3b7640 1 Processor -- start 2024-05-20T17:53:27.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.681+0000 7fd4bb3b7640 1 -- start start 2024-05-20T17:53:27.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.682+0000 7fd4bb3b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4b40b4010 0x7fd4b40d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:27.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.682+0000 7fd4bb3b7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4b40d0370 con 0x7fd4b4163a10 2024-05-20T17:53:27.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.682+0000 7fd4bb3b7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4b40d0650 con 0x7fd4b40d14b0 2024-05-20T17:53:27.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.682+0000 7fd4bb3b7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b40d3ca0 con 0x7fd4b40b4010 2024-05-20T17:53:27.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.682+0000 7fd4b9153640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd4b4163a10 0x7fd4b40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60164/0 (socket says 172.21.15.6:60164) 2024-05-20T17:53:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.682+0000 7fd4b9153640 1 -- 172.21.15.6:0/2116531071 learned_addr learned my addr 172.21.15.6:0/2116531071 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.682+0000 7fd4b8952640 1 --2- 172.21.15.6:0/2116531071 >> v2:172.21.15.6:3300/0 conn(0x7fd4b40b4010 0x7fd4b40d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.683+0000 7fd4abfff640 1 -- 172.21.15.6:0/2116531071 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181425826 0 0) 0x7fd4b40d0370 con 0x7fd4b4163a10 2024-05-20T17:53:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.683+0000 7fd4abfff640 1 -- 172.21.15.6:0/2116531071 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4a0003520 con 0x7fd4b4163a10 2024-05-20T17:53:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.683+0000 7fd4b8952640 1 -- 172.21.15.6:0/2116531071 >> v1:172.21.15.171:6789/0 conn(0x7fd4b40d14b0 legacy=0x7fd4b40d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.683+0000 7fd4b8952640 1 -- 172.21.15.6:0/2116531071 >> v1:172.21.15.6:6789/0 conn(0x7fd4b4163a10 legacy=0x7fd4b40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.683+0000 7fd4b8952640 1 -- 172.21.15.6:0/2116531071 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b40d3650 con 0x7fd4b40b4010 2024-05-20T17:53:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4b8952640 1 --2- 172.21.15.6:0/2116531071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40d4130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40097a0 tx=0x7fd4a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5038cd6643f066 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4abfff640 1 -- 172.21.15.6:0/2116531071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4037070 con 0x7fd4b40b4010 2024-05-20T17:53:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4abfff640 1 -- 172.21.15.6:0/2116531071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a4032440 con 0x7fd4b40b4010 2024-05-20T17:53:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4abfff640 1 -- 172.21.15.6:0/2116531071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4032810 con 0x7fd4b40b4010 2024-05-20T17:53:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/2116531071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 msgr2=0x7fd4b40d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4bb3b7640 1 --2- 172.21.15.6:0/2116531071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40d4130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40097a0 tx=0x7fd4a402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/2116531071 shutdown_connections 2024-05-20T17:53:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4bb3b7640 1 --2- 172.21.15.6:0/2116531071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40d4130 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.684+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/2116531071 >> 172.21.15.6:0/2116531071 conn(0x7fd4b406d240 msgr2=0x7fd4b406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.685+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/2116531071 shutdown_connections 2024-05-20T17:53:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.685+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/2116531071 wait complete. 2024-05-20T17:53:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.686+0000 7fd4bb3b7640 1 Processor -- start 2024-05-20T17:53:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.686+0000 7fd4bb3b7640 1 -- start start 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4bb3b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4bb3b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4b40d14b0 0x7fd4b4153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4bb3b7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4b4163a10 0x7fd4b4154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4bb3b7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40b8390 con 0x7fd4b40b4010 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4bb3b7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40b8210 con 0x7fd4b4163a10 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4bb3b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b40b8510 con 0x7fd4b40d14b0 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9153640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9153640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47712/0 (socket says 172.21.15.6:47712) 2024-05-20T17:53:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9153640 1 -- 172.21.15.6:0/3375710694 learned_addr learned my addr 172.21.15.6:0/3375710694 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b8952640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4b40d14b0 0x7fd4b4153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9954640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4b4163a10 0x7fd4b4154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9153640 1 -- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4b40d14b0 msgr2=0x7fd4b4153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9153640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4b40d14b0 0x7fd4b4153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9153640 1 -- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4b4163a10 msgr2=0x7fd4b4154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9153640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4b4163a10 0x7fd4b4154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.688+0000 7fd4b9153640 1 -- 172.21.15.6:0/3375710694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b415aeb0 con 0x7fd4b40b4010 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.689+0000 7fd4b9153640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40b7120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0001eb0 tx=0x7fd4b000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.689+0000 7fd4a9ffb640 1 -- 172.21.15.6:0/3375710694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0017070 con 0x7fd4b40b4010 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.689+0000 7fd4a9ffb640 1 -- 172.21.15.6:0/3375710694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b0005d00 con 0x7fd4b40b4010 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.689+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b415b190 con 0x7fd4b40b4010 2024-05-20T17:53:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.689+0000 7fd4a9ffb640 1 -- 172.21.15.6:0/3375710694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0007310 con 0x7fd4b40b4010 2024-05-20T17:53:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.689+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b4155690 con 0x7fd4b40b4010 2024-05-20T17:53:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.690+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b41558f0 con 0x7fd4b40b4010 2024-05-20T17:53:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.691+0000 7fd4a9ffb640 1 -- 172.21.15.6:0/3375710694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4b001a070 con 0x7fd4b40b4010 2024-05-20T17:53:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.691+0000 7fd4a9ffb640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd49806be30 0x7fd49806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.691+0000 7fd4a9ffb640 1 -- 172.21.15.6:0/3375710694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd4b008a480 con 0x7fd4b40b4010 2024-05-20T17:53:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.692+0000 7fd4b8952640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd49806be30 0x7fd49806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.692+0000 7fd4b8952640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd49806be30 0x7fd49806e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4034000 tx=0x7fd4a402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.696+0000 7fd4a9ffb640 1 -- 172.21.15.6:0/3375710694 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd4b0058530 con 0x7fd4b40b4010 2024-05-20T17:53:27.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.881+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4b4075b00 con 0x7fd4b40b4010 2024-05-20T17:53:27.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.883+0000 7fd4a9ffb640 1 -- 172.21.15.6:0/3375710694 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fd4b005c830 con 0x7fd4b40b4010 2024-05-20T17:53:27.882 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:27.883 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:27.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd49806be30 msgr2=0x7fd49806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd49806be30 0x7fd49806e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4034000 tx=0x7fd4a402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 msgr2=0x7fd4b40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40b7120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0001eb0 tx=0x7fd4b000c820 comp rx=0 tx=0).stop 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 shutdown_connections 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd49806be30 0x7fd49806e340 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4b4163a10 0x7fd4b4154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4b40d14b0 0x7fd4b4153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 --2- 172.21.15.6:0/3375710694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4b40b4010 0x7fd4b40b7120 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 >> 172.21.15.6:0/3375710694 conn(0x7fd4b406d240 msgr2=0x7fd4b4160e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 shutdown_connections 2024-05-20T17:53:27.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:27.885+0000 7fd4bb3b7640 1 -- 172.21.15.6:0/3375710694 wait complete. 2024-05-20T17:53:27.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.011+0000 7f61efde3640 1 Processor -- start 2024-05-20T17:53:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.011+0000 7f61efde3640 1 -- start start 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61efde3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e806ca80 0x7f61e815f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61efde3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e80b1b80 con 0x7f61e80ae320 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61efde3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e80b12e0 con 0x7f61e80ae730 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61efde3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f61e806b750 con 0x7f61e806ca80 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61ed37e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f61e80ae320 0x7f61e806bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39556/0 (socket says 172.21.15.6:39556) 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61ed37e640 1 -- 172.21.15.6:0/2288704467 learned_addr learned my addr 172.21.15.6:0/2288704467 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61edb7f640 1 --2- 172.21.15.6:0/2288704467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e806ca80 0x7f61e815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61ecb7d640 1 -- 172.21.15.6:0/2288704467 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858998443 0 0) 0x7f61d8001110 con 0x7f61e80ae320 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61ecb7d640 1 -- 172.21.15.6:0/2288704467 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d4003520 con 0x7f61e80ae320 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61edb7f640 1 -- 172.21.15.6:0/2288704467 >> v1:172.21.15.171:6789/0 conn(0x7f61e80ae730 legacy=0x7f61e80d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61edb7f640 1 -- 172.21.15.6:0/2288704467 >> v1:172.21.15.6:6789/0 conn(0x7f61e80ae320 legacy=0x7f61e806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61ecb7d640 1 -- 172.21.15.6:0/2288704467 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268953932 0 0) 0x7f61e80b12e0 con 0x7f61e80ae730 2024-05-20T17:53:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.013+0000 7f61edb7f640 1 -- 172.21.15.6:0/2288704467 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e80b15c0 con 0x7f61e806ca80 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.014+0000 7f61edb7f640 1 --2- 172.21.15.6:0/2288704467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e806ca80 0x7f61e815f280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009dc0 tx=0x7f61e402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be4fbce2d0b79305 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.014+0000 7f61ecb7d640 1 -- 172.21.15.6:0/2288704467 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4007740 con 0x7f61e806ca80 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.014+0000 7f61ecb7d640 1 -- 172.21.15.6:0/2288704467 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e40078e0 con 0x7f61e806ca80 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.014+0000 7f61ecb7d640 1 -- 172.21.15.6:0/2288704467 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4007c90 con 0x7f61e806ca80 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.015+0000 7f61efde3640 1 -- 172.21.15.6:0/2288704467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e806ca80 msgr2=0x7f61e815f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.015+0000 7f61efde3640 1 --2- 172.21.15.6:0/2288704467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e806ca80 0x7f61e815f280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009dc0 tx=0x7f61e402a6d0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.015+0000 7f61efde3640 1 -- 172.21.15.6:0/2288704467 shutdown_connections 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.015+0000 7f61efde3640 1 --2- 172.21.15.6:0/2288704467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e806ca80 0x7f61e815f280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.015+0000 7f61efde3640 1 -- 172.21.15.6:0/2288704467 >> 172.21.15.6:0/2288704467 conn(0x7f61e8072ed0 msgr2=0x7f61e80b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.015+0000 7f61efde3640 1 -- 172.21.15.6:0/2288704467 shutdown_connections 2024-05-20T17:53:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.015+0000 7f61efde3640 1 -- 172.21.15.6:0/2288704467 wait complete. 2024-05-20T17:53:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.017+0000 7f61efde3640 1 Processor -- start 2024-05-20T17:53:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.017+0000 7f61efde3640 1 -- start start 2024-05-20T17:53:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61efde3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61e806ca80 0x7f61e80d1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61efde3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61e80ae320 0x7f61e81450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61efde3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e80ae730 0x7f61e81455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61efde3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f61e806c2f0 con 0x7f61e80ae320 2024-05-20T17:53:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61efde3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8074e00 con 0x7f61e806ca80 2024-05-20T17:53:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61efde3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f61e806c470 con 0x7f61e80ae730 2024-05-20T17:53:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61ed37e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61e80ae320 0x7f61e81450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61ed37e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61e80ae320 0x7f61e81450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46032/0 (socket says 172.21.15.6:46032) 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.018+0000 7f61ed37e640 1 -- 172.21.15.6:0/1900712545 learned_addr learned my addr 172.21.15.6:0/1900712545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61edb7f640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61e806ca80 0x7f61e80d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61ee380640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e80ae730 0x7f61e81455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61ed37e640 1 -- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e80ae730 msgr2=0x7f61e81455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61ed37e640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e80ae730 0x7f61e81455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61ed37e640 1 -- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61e806ca80 msgr2=0x7f61e80d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61ed37e640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61e806ca80 0x7f61e80d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61ed37e640 1 -- 172.21.15.6:0/1900712545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e81eaa80 con 0x7f61e80ae320 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61ed37e640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61e80ae320 0x7f61e81450b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c3c0 tx=0x7f61d800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61de7fc640 1 -- 172.21.15.6:0/1900712545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d8017070 con 0x7f61e80ae320 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61de7fc640 1 -- 172.21.15.6:0/1900712545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d8005ce0 con 0x7f61e80ae320 2024-05-20T17:53:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e81ea4c0 con 0x7f61e80ae320 2024-05-20T17:53:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61de7fc640 1 -- 172.21.15.6:0/1900712545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d80072f0 con 0x7f61e80ae320 2024-05-20T17:53:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.019+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e81448b0 con 0x7f61e80ae320 2024-05-20T17:53:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.020+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e8075b00 con 0x7f61e80ae320 2024-05-20T17:53:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.021+0000 7f61de7fc640 1 -- 172.21.15.6:0/1900712545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61d801a070 con 0x7f61e80ae320 2024-05-20T17:53:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.021+0000 7f61de7fc640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f61cc06be30 0x7f61cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.021+0000 7f61de7fc640 1 -- 172.21.15.6:0/1900712545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f61d808a690 con 0x7f61e80ae320 2024-05-20T17:53:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.022+0000 7f61edb7f640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f61cc06be30 0x7f61cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.022+0000 7f61edb7f640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f61cc06be30 0x7f61cc06e340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61e4034000 tx=0x7f61e402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.026+0000 7f61de7fc640 1 -- 172.21.15.6:0/1900712545 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f61e80b1b80 con 0x7f61e80ae320 2024-05-20T17:53:28.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.213+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61e80b0eb0 con 0x7f61e80ae320 2024-05-20T17:53:28.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.215+0000 7f61de7fc640 1 -- 172.21.15.6:0/1900712545 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f61d8058c60 con 0x7f61e80ae320 2024-05-20T17:53:28.214 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:28.215 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f61cc06be30 msgr2=0x7f61cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f61cc06be30 0x7f61cc06e340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61e4034000 tx=0x7f61e402f000 comp rx=0 tx=0).stop 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61e80ae320 msgr2=0x7f61e81450b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61e80ae320 0x7f61e81450b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c3c0 tx=0x7f61d800c7c0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 shutdown_connections 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f61cc06be30 0x7f61cc06e340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61e80ae730 0x7f61e81455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61e80ae320 0x7f61e81450b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 --2- 172.21.15.6:0/1900712545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61e806ca80 0x7f61e80d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 >> 172.21.15.6:0/1900712545 conn(0x7f61e8072ed0 msgr2=0x7f61e8070550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 shutdown_connections 2024-05-20T17:53:28.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.217+0000 7f61efde3640 1 -- 172.21.15.6:0/1900712545 wait complete. 2024-05-20T17:53:28.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T17:53:28.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.346+0000 7f4d54b38640 1 Processor -- start 2024-05-20T17:53:28.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.346+0000 7f4d54b38640 1 -- start start 2024-05-20T17:53:28.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d54b38640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d500d4400 0x7f4d5015f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d54b38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d5006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d54b38640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d5008d2a0 con 0x7f4d500d2780 2024-05-20T17:53:28.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d54b38640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4d500d3f70 con 0x7f4d500d4400 2024-05-20T17:53:28.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d54b38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5006d850 con 0x7f4d5006cf00 2024-05-20T17:53:28.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d500d4400 0x7f4d5015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4d500d2780 0x7f4d500d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39562/0 (socket says 172.21.15.6:39562) 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4ed9d640 1 -- 172.21.15.6:0/2233919849 learned_addr learned my addr 172.21.15.6:0/2233919849 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4dd9b640 1 --2- 172.21.15.6:0/2233919849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d5006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4e59c640 1 -- 172.21.15.6:0/2233919849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 msgr2=0x7f4d5006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4e59c640 1 --2- 172.21.15.6:0/2233919849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d5006d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4e59c640 1 -- 172.21.15.6:0/2233919849 >> v1:172.21.15.6:6789/0 conn(0x7f4d500d2780 legacy=0x7f4d500d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4e59c640 1 -- 172.21.15.6:0/2233919849 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d500d4810 con 0x7f4d500d4400 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4d59a640 1 -- 172.21.15.6:0/2233919849 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242297566 0 0) 0x7f4d40001110 con 0x7f4d500d2780 2024-05-20T17:53:28.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.348+0000 7f4d4dd9b640 1 --2- 172.21.15.6:0/2233919849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d5006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:28.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.349+0000 7f4d4e59c640 1 --2- 172.21.15.6:0/2233919849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d5015f440 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009dc0 tx=0x7f4d4802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263de178b84480db server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.349+0000 7f4d4d59a640 1 -- 172.21.15.6:0/2233919849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48007740 con 0x7f4d500d4400 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.349+0000 7f4d4d59a640 1 -- 172.21.15.6:0/2233919849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d480078e0 con 0x7f4d500d4400 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.349+0000 7f4d4d59a640 1 -- 172.21.15.6:0/2233919849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48007cb0 con 0x7f4d500d4400 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.350+0000 7f4d54b38640 1 -- 172.21.15.6:0/2233919849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 msgr2=0x7f4d5015f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.350+0000 7f4d54b38640 1 --2- 172.21.15.6:0/2233919849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d5015f440 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009dc0 tx=0x7f4d4802a710 comp rx=0 tx=0).stop 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.350+0000 7f4d54b38640 1 -- 172.21.15.6:0/2233919849 shutdown_connections 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.350+0000 7f4d54b38640 1 --2- 172.21.15.6:0/2233919849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d5006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.350+0000 7f4d54b38640 1 --2- 172.21.15.6:0/2233919849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d5015f440 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.350+0000 7f4d54b38640 1 -- 172.21.15.6:0/2233919849 >> 172.21.15.6:0/2233919849 conn(0x7f4d500d4bb0 msgr2=0x7f4d500d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.350+0000 7f4d54b38640 1 -- 172.21.15.6:0/2233919849 shutdown_connections 2024-05-20T17:53:28.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.350+0000 7f4d54b38640 1 -- 172.21.15.6:0/2233919849 wait complete. 2024-05-20T17:53:28.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.352+0000 7f4d54b38640 1 Processor -- start 2024-05-20T17:53:28.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.352+0000 7f4d54b38640 1 -- start start 2024-05-20T17:53:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.353+0000 7f4d54b38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d50146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.353+0000 7f4d54b38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d500d2780 0x7f4d50146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d54b38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d501e9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d54b38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500d3920 con 0x7f4d500d4400 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d54b38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500d3640 con 0x7f4d500d2780 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d54b38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4d500d3c00 con 0x7f4d5006cf00 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d501e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d501e9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46048/0 (socket says 172.21.15.6:46048) 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 -- 172.21.15.6:0/4195406751 learned_addr learned my addr 172.21.15.6:0/4195406751 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4e59c640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d50146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4dd9b640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d500d2780 0x7f4d50146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 -- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 msgr2=0x7f4d50146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d50146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 -- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d500d2780 msgr2=0x7f4d50146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d500d2780 0x7f4d50146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 -- 172.21.15.6:0/4195406751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d501ea020 con 0x7f4d500d4400 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d4ed9d640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d501e9250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c410 tx=0x7f4d4000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d46ffd640 1 -- 172.21.15.6:0/4195406751 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400074e0 con 0x7f4d500d4400 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d46ffd640 1 -- 172.21.15.6:0/4195406751 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d400047e0 con 0x7f4d500d4400 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d501ea300 con 0x7f4d500d4400 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d46ffd640 1 -- 172.21.15.6:0/4195406751 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004bd0 con 0x7f4d500d4400 2024-05-20T17:53:28.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.354+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d501ea8c0 con 0x7f4d500d4400 2024-05-20T17:53:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.355+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d500735a0 con 0x7f4d500d4400 2024-05-20T17:53:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.356+0000 7f4d46ffd640 1 -- 172.21.15.6:0/4195406751 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d40011070 con 0x7f4d500d4400 2024-05-20T17:53:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.357+0000 7f4d46ffd640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4d3006be60 0x7f4d3006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.357+0000 7f4d46ffd640 1 -- 172.21.15.6:0/4195406751 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4d4008abb0 con 0x7f4d500d4400 2024-05-20T17:53:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.357+0000 7f4d4e59c640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4d3006be60 0x7f4d3006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.358+0000 7f4d4e59c640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4d3006be60 0x7f4d3006e370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4d48034000 tx=0x7f4d4802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.362+0000 7f4d46ffd640 1 -- 172.21.15.6:0/4195406751 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4d500735a0 con 0x7f4d500d4400 2024-05-20T17:53:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.588+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4d500d0640 con 0x7f4d500d4400 2024-05-20T17:53:28.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.635+0000 7f4d46ffd640 1 -- 172.21.15.6:0/4195406751 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f4d5008d2a0 con 0x7f4d500d4400 2024-05-20T17:53:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4d3006be60 msgr2=0x7f4d3006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4d3006be60 0x7f4d3006e370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4d48034000 tx=0x7f4d4802f000 comp rx=0 tx=0).stop 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 msgr2=0x7f4d501e9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d501e9250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c410 tx=0x7f4d4000c8d0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 shutdown_connections 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4d3006be60 0x7f4d3006e370 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d500d4400 0x7f4d501e9250 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d500d2780 0x7f4d50146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 --2- 172.21.15.6:0/4195406751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d5006cf00 0x7f4d50146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 >> 172.21.15.6:0/4195406751 conn(0x7f4d500d4bb0 msgr2=0x7f4d5015fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 shutdown_connections 2024-05-20T17:53:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.637+0000 7f4d54b38640 1 -- 172.21.15.6:0/4195406751 wait complete. 2024-05-20T17:53:28.648 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-20T17:53:28.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T17:53:28.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.766+0000 7fc5f41ea640 1 Processor -- start 2024-05-20T17:53:28.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.766+0000 7fc5f41ea640 1 -- start start 2024-05-20T17:53:28.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f41ea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc5ec0ba3c0 0x7fc5ec0b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f41ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b85b0 0x7fc5ec0d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f41ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5ec1634a0 con 0x7fc5ec0b6620 2024-05-20T17:53:28.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f41ea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc5ec0d3480 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f41ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ec163780 con 0x7fc5ec0b85b0 2024-05-20T17:53:28.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f1785640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc5ec0ba3c0 0x7fc5ec0b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f1f86640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc5ec0b6620 0x7fc5ec162ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:49246/0 (socket says 172.21.15.6:49246) 2024-05-20T17:53:28.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f1f86640 1 -- 172.21.15.6:0/2073685439 learned_addr learned my addr 172.21.15.6:0/2073685439 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:28.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f2787640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b85b0 0x7fc5ec0d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f1785640 1 -- 172.21.15.6:0/2073685439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b85b0 msgr2=0x7fc5ec0d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:28.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.768+0000 7fc5f1785640 1 --2- 172.21.15.6:0/2073685439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b85b0 0x7fc5ec0d3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.769+0000 7fc5f1785640 1 -- 172.21.15.6:0/2073685439 >> v1:172.21.15.171:6789/0 conn(0x7fc5ec0b6620 legacy=0x7fc5ec162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.769+0000 7fc5f1785640 1 -- 172.21.15.6:0/2073685439 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec163a60 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.769+0000 7fc5f2787640 1 --2- 172.21.15.6:0/2073685439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b85b0 0x7fc5ec0d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:28.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.769+0000 7fc5f0f84640 1 -- 172.21.15.6:0/2073685439 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253899373 0 0) 0x7fc5ec1634a0 con 0x7fc5ec0b6620 2024-05-20T17:53:28.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.769+0000 7fc5f1785640 1 --2- 172.21.15.6:0/2073685439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec0b8070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0097a0 tx=0x7fc5dc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c82b58640ac616b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.769+0000 7fc5f0f84640 1 -- 172.21.15.6:0/2073685439 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc037070 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f0f84640 1 -- 172.21.15.6:0/2073685439 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc032440 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f0f84640 1 -- 172.21.15.6:0/2073685439 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc032810 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2073685439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0ba3c0 msgr2=0x7fc5ec0b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2073685439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec0b8070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0097a0 tx=0x7fc5dc02a180 comp rx=0 tx=0).stop 2024-05-20T17:53:28.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2073685439 shutdown_connections 2024-05-20T17:53:28.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2073685439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b85b0 0x7fc5ec0d3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2073685439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec0b8070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2073685439 >> 172.21.15.6:0/2073685439 conn(0x7fc5ec06d240 msgr2=0x7fc5ec06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:28.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2073685439 shutdown_connections 2024-05-20T17:53:28.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.770+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2073685439 wait complete. 2024-05-20T17:53:28.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.772+0000 7fc5f41ea640 1 Processor -- start 2024-05-20T17:53:28.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.772+0000 7fc5f41ea640 1 -- start start 2024-05-20T17:53:28.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.773+0000 7fc5f41ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b6620 0x7fc5ec0ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.773+0000 7fc5f41ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0b85b0 0x7fc5ec0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.773+0000 7fc5f41ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec1f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.773+0000 7fc5f41ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec0d42b0 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.773+0000 7fc5f41ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec0d4130 con 0x7fc5ec0b85b0 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.773+0000 7fc5f41ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ec0d4430 con 0x7fc5ec0b6620 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec1f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec1f8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46050/0 (socket says 172.21.15.6:46050) 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 -- 172.21.15.6:0/2002880884 learned_addr learned my addr 172.21.15.6:0/2002880884 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f1785640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0b85b0 0x7fc5ec0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f1f86640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b6620 0x7fc5ec0ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 -- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b6620 msgr2=0x7fc5ec0ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b6620 0x7fc5ec0ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 -- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0b85b0 msgr2=0x7fc5ec0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0b85b0 0x7fc5ec0ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 -- 172.21.15.6:0/2002880884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec0abdb0 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f1f86640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b6620 0x7fc5ec0ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:28.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f2787640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec1f8ce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400efc0 tx=0x7fc5e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5e27fc640 1 -- 172.21.15.6:0/2002880884 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4018020 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5e27fc640 1 -- 172.21.15.6:0/2002880884 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e4014480 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5ec0ac090 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5e27fc640 1 -- 172.21.15.6:0/2002880884 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4014870 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.774+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5ec0ac650 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.775+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5ec0abb20 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.776+0000 7fc5e27fc640 1 -- 172.21.15.6:0/2002880884 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5e4005d10 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.776+0000 7fc5e27fc640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5d006be30 0x7fc5d006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:28.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.776+0000 7fc5e27fc640 1 -- 172.21.15.6:0/2002880884 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc5e408bf50 con 0x7fc5ec0ba3c0 2024-05-20T17:53:28.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.777+0000 7fc5f1f86640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5d006be30 0x7fc5d006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:28.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.777+0000 7fc5f1f86640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5d006be30 0x7fc5d006e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8000f60 tx=0x7fc5e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:28.781+0000 7fc5e27fc640 1 -- 172.21.15.6:0/2002880884 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc5e4022030 con 0x7fc5ec0ba3c0 2024-05-20T17:53:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.003+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc5ec0d3bf0 con 0x7fc5ec0ba3c0 2024-05-20T17:53:29.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.642+0000 7fc5e27fc640 1 -- 172.21.15.6:0/2002880884 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fc5ec0d3bf0 con 0x7fc5ec0ba3c0 2024-05-20T17:53:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5d006be30 msgr2=0x7fc5d006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5d006be30 0x7fc5d006e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8000f60 tx=0x7fc5e8009040 comp rx=0 tx=0).stop 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ec0ba3c0 msgr2=0x7fc5ec1f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec1f8ce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc5e400efc0 tx=0x7fc5e400c490 comp rx=0 tx=0).stop 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 shutdown_connections 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5d006be30 0x7fc5d006e340 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5ec0ba3c0 0x7fc5ec1f8ce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5ec0b85b0 0x7fc5ec0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 --2- 172.21.15.6:0/2002880884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5ec0b6620 0x7fc5ec0ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 >> 172.21.15.6:0/2002880884 conn(0x7fc5ec06d240 msgr2=0x7fc5ec0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 shutdown_connections 2024-05-20T17:53:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.645+0000 7fc5f41ea640 1 -- 172.21.15.6:0/2002880884 wait complete. 2024-05-20T17:53:29.658 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T17:53:29.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:53:29.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.781+0000 7f7babe08640 1 Processor -- start 2024-05-20T17:53:29.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.781+0000 7f7babe08640 1 -- start start 2024-05-20T17:53:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.782+0000 7f7babe08640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ba406d3d0 0x7f7ba406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.782+0000 7f7babe08640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ba406dd20 con 0x7f7ba4162820 2024-05-20T17:53:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.782+0000 7f7babe08640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ba40d0630 con 0x7f7ba40b8190 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.782+0000 7f7babe08640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7ba40d39c0 con 0x7f7ba406d3d0 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.783+0000 7f7ba93a3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ba406d3d0 0x7f7ba406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.783+0000 7f7ba9ba4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7ba4162820 0x7f7ba40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39564/0 (socket says 172.21.15.6:39564) 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.783+0000 7f7ba93a3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ba406d3d0 0x7f7ba406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46062/0 (socket says 172.21.15.6:46062) 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.783+0000 7f7ba9ba4640 1 -- 172.21.15.6:0/2487216354 learned_addr learned my addr 172.21.15.6:0/2487216354 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.783+0000 7f7ba93a3640 1 -- 172.21.15.6:0/2487216354 >> v1:172.21.15.171:6789/0 conn(0x7f7ba40b8190 legacy=0x7f7ba40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.783+0000 7f7ba93a3640 1 -- 172.21.15.6:0/2487216354 >> v1:172.21.15.6:6789/0 conn(0x7f7ba4162820 legacy=0x7f7ba40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.783+0000 7f7ba93a3640 1 -- 172.21.15.6:0/2487216354 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba40d3ca0 con 0x7f7ba406d3d0 2024-05-20T17:53:29.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.783+0000 7f7ba8ba2640 1 -- 172.21.15.6:0/2487216354 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2301281444 0 0) 0x7f7ba0001110 con 0x7f7ba4162820 2024-05-20T17:53:29.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.784+0000 7f7ba93a3640 1 --2- 172.21.15.6:0/2487216354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba406d3d0 0x7f7ba406d7e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b940097a0 tx=0x7f7b9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c277242f2e000f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:29.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.784+0000 7f7ba8ba2640 1 -- 172.21.15.6:0/2487216354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94037070 con 0x7f7ba406d3d0 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.784+0000 7f7ba8ba2640 1 -- 172.21.15.6:0/2487216354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b94032440 con 0x7f7ba406d3d0 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.784+0000 7f7ba8ba2640 1 -- 172.21.15.6:0/2487216354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94032810 con 0x7f7ba406d3d0 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.785+0000 7f7babe08640 1 -- 172.21.15.6:0/2487216354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba406d3d0 msgr2=0x7f7ba406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.785+0000 7f7babe08640 1 --2- 172.21.15.6:0/2487216354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba406d3d0 0x7f7ba406d7e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b940097a0 tx=0x7f7b9402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.785+0000 7f7babe08640 1 -- 172.21.15.6:0/2487216354 shutdown_connections 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.785+0000 7f7babe08640 1 --2- 172.21.15.6:0/2487216354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba406d3d0 0x7f7ba406d7e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.785+0000 7f7babe08640 1 -- 172.21.15.6:0/2487216354 >> 172.21.15.6:0/2487216354 conn(0x7f7ba40d4bd0 msgr2=0x7f7ba40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.785+0000 7f7babe08640 1 -- 172.21.15.6:0/2487216354 shutdown_connections 2024-05-20T17:53:29.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.785+0000 7f7babe08640 1 -- 172.21.15.6:0/2487216354 wait complete. 2024-05-20T17:53:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.787+0000 7f7babe08640 1 Processor -- start 2024-05-20T17:53:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.787+0000 7f7babe08640 1 -- start start 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7babe08640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba406d3d0 0x7f7ba41f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7babe08640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba40b8190 0x7f7ba40b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7babe08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba4162820 0x7f7ba40b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7babe08640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba40d0300 con 0x7f7ba4162820 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7babe08640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba40d42e0 con 0x7f7ba406d3d0 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7babe08640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba40b4050 con 0x7f7ba40b8190 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7baa3a5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba4162820 0x7f7ba40b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7baa3a5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba4162820 0x7f7ba40b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46072/0 (socket says 172.21.15.6:46072) 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7baa3a5640 1 -- 172.21.15.6:0/80696566 learned_addr learned my addr 172.21.15.6:0/80696566 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7ba93a3640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba40b8190 0x7f7ba40b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.788+0000 7f7ba9ba4640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba406d3d0 0x7f7ba41f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7baa3a5640 1 -- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba40b8190 msgr2=0x7f7ba40b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7baa3a5640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba40b8190 0x7f7ba40b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7baa3a5640 1 -- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba406d3d0 msgr2=0x7f7ba41f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7baa3a5640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba406d3d0 0x7f7ba41f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7baa3a5640 1 -- 172.21.15.6:0/80696566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba4158f30 con 0x7f7ba4162820 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7ba9ba4640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba406d3d0 0x7f7ba41f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7baa3a5640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba4162820 0x7f7ba40b5d60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00b9a0 tx=0x7f7b9c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7b9a7fc640 1 -- 172.21.15.6:0/80696566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c019070 con 0x7f7ba4162820 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7b9a7fc640 1 -- 172.21.15.6:0/80696566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c00cba0 con 0x7f7ba4162820 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7b9a7fc640 1 -- 172.21.15.6:0/80696566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c014440 con 0x7f7ba4162820 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba4159430 con 0x7f7ba4162820 2024-05-20T17:53:29.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.789+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba41599f0 con 0x7f7ba4162820 2024-05-20T17:53:29.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.790+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba4075b00 con 0x7f7ba4162820 2024-05-20T17:53:29.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.791+0000 7f7b9a7fc640 1 -- 172.21.15.6:0/80696566 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b9c01c070 con 0x7f7ba4162820 2024-05-20T17:53:29.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.791+0000 7f7b9a7fc640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b8806be30 0x7f7b8806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:29.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.791+0000 7f7b9a7fc640 1 -- 172.21.15.6:0/80696566 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7b9c08ace0 con 0x7f7ba4162820 2024-05-20T17:53:29.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.791+0000 7f7ba9ba4640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b8806be30 0x7f7b8806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:29.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.792+0000 7f7ba9ba4640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b8806be30 0x7f7b8806e340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0000f60 tx=0x7f7ba0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:29.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:29.796+0000 7f7b9a7fc640 1 -- 172.21.15.6:0/80696566 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7b9c058d00 con 0x7f7ba4162820 2024-05-20T17:53:30.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.018+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ba41591c0 con 0x7f7ba4162820 2024-05-20T17:53:30.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.018+0000 7f7b9a7fc640 1 -- 172.21.15.6:0/80696566 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f7b9c05d000 con 0x7f7ba4162820 2024-05-20T17:53:30.018 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:30.018 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:29.005012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:53:30.019 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:53:30.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b8806be30 msgr2=0x7f7b8806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b8806be30 0x7f7b8806e340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0000f60 tx=0x7f7ba0009040 comp rx=0 tx=0).stop 2024-05-20T17:53:30.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba4162820 msgr2=0x7f7ba40b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba4162820 0x7f7ba40b5d60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00b9a0 tx=0x7f7b9c00be60 comp rx=0 tx=0).stop 2024-05-20T17:53:30.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 shutdown_connections 2024-05-20T17:53:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b8806be30 0x7f7b8806e340 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba4162820 0x7f7ba40b5d60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba40b8190 0x7f7ba40b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 --2- 172.21.15.6:0/80696566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba406d3d0 0x7f7ba41f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.020+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 >> 172.21.15.6:0/80696566 conn(0x7f7ba40d4bd0 msgr2=0x7f7ba40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.021+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 shutdown_connections 2024-05-20T17:53:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.021+0000 7f7babe08640 1 -- 172.21.15.6:0/80696566 wait complete. 2024-05-20T17:53:30.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:30.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.147+0000 7f8630061640 1 Processor -- start 2024-05-20T17:53:30.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.147+0000 7f8630061640 1 -- start start 2024-05-20T17:53:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.148+0000 7f8630061640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f862815b790 0x7f86280b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.148+0000 7f8630061640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86280d1630 0x7f86280aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.148+0000 7f8630061640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86280b2110 con 0x7f86280b1d00 2024-05-20T17:53:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.148+0000 7f8630061640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8628160310 con 0x7f862815b790 2024-05-20T17:53:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.148+0000 7f8630061640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f86280d1a40 con 0x7f86280d1630 2024-05-20T17:53:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.148+0000 7f862ddfd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f862815b790 0x7f86280b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.148+0000 7f862ddfd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f862815b790 0x7f86280b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46082/0 (socket says 172.21.15.6:46082) 2024-05-20T17:53:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.148+0000 7f862ddfd640 1 -- 172.21.15.6:0/478897770 learned_addr learned my addr 172.21.15.6:0/478897770 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.149+0000 7f862e5fe640 1 --2- 172.21.15.6:0/478897770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86280d1630 0x7f86280aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.149+0000 7f862ddfd640 1 -- 172.21.15.6:0/478897770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86280d1630 msgr2=0x7f86280aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.149+0000 7f862ddfd640 1 --2- 172.21.15.6:0/478897770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86280d1630 0x7f86280aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.149+0000 7f862ddfd640 1 -- 172.21.15.6:0/478897770 >> v1:172.21.15.171:6789/0 conn(0x7f86280b1d00 legacy=0x7f86280d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.149+0000 7f862ddfd640 1 -- 172.21.15.6:0/478897770 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862815f550 con 0x7f862815b790 2024-05-20T17:53:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.150+0000 7f862ddfd640 1 --2- 172.21.15.6:0/478897770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862815b790 0x7f86280b17c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8624009870 tx=0x7f862402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607996069aec5c95 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.150+0000 7f862cdfb640 1 -- 172.21.15.6:0/478897770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624037070 con 0x7f862815b790 2024-05-20T17:53:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.150+0000 7f862cdfb640 1 -- 172.21.15.6:0/478897770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8624032440 con 0x7f862815b790 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.150+0000 7f862cdfb640 1 -- 172.21.15.6:0/478897770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624032810 con 0x7f862815b790 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.151+0000 7f8630061640 1 -- 172.21.15.6:0/478897770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862815b790 msgr2=0x7f86280b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.151+0000 7f8630061640 1 --2- 172.21.15.6:0/478897770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862815b790 0x7f86280b17c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8624009870 tx=0x7f862402a1c0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.151+0000 7f8630061640 1 -- 172.21.15.6:0/478897770 shutdown_connections 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.151+0000 7f8630061640 1 --2- 172.21.15.6:0/478897770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86280d1630 0x7f86280aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.151+0000 7f8630061640 1 --2- 172.21.15.6:0/478897770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862815b790 0x7f86280b17c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.151+0000 7f8630061640 1 -- 172.21.15.6:0/478897770 >> 172.21.15.6:0/478897770 conn(0x7f8628072f30 msgr2=0x7f86280b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.151+0000 7f8630061640 1 -- 172.21.15.6:0/478897770 shutdown_connections 2024-05-20T17:53:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.151+0000 7f8630061640 1 -- 172.21.15.6:0/478897770 wait complete. 2024-05-20T17:53:30.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.152+0000 7f8630061640 1 Processor -- start 2024-05-20T17:53:30.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.153+0000 7f8630061640 1 -- start start 2024-05-20T17:53:30.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f8630061640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86280b1d00 0x7f862814ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f8630061640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86280d1630 0x7f8628157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f8630061640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f862815b790 0x7f8628157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f8630061640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f862815bba0 con 0x7f86280d1630 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f8630061640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f862815fb10 con 0x7f86280b1d00 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f8630061640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f86281f4370 con 0x7f862815b790 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86280d1630 0x7f8628157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86280d1630 0x7f8628157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46086/0 (socket says 172.21.15.6:46086) 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 -- 172.21.15.6:0/570588524 learned_addr learned my addr 172.21.15.6:0/570588524 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862ddfd640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86280b1d00 0x7f862814ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862e5fe640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f862815b790 0x7f8628157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 -- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f862815b790 msgr2=0x7f8628157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f862815b790 0x7f8628157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 -- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86280b1d00 msgr2=0x7f862814ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86280b1d00 0x7f862814ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 -- 172.21.15.6:0/570588524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8628156070 con 0x7f86280d1630 2024-05-20T17:53:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.154+0000 7f862d5fc640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86280d1630 0x7f8628157110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f861800c3c0 tx=0x7f861800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.155+0000 7f861e7fc640 1 -- 172.21.15.6:0/570588524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86180052d0 con 0x7f86280d1630 2024-05-20T17:53:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.155+0000 7f861e7fc640 1 -- 172.21.15.6:0/570588524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8618005490 con 0x7f86280d1630 2024-05-20T17:53:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.155+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8628156350 con 0x7f86280d1630 2024-05-20T17:53:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.155+0000 7f861e7fc640 1 -- 172.21.15.6:0/570588524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618007260 con 0x7f86280d1630 2024-05-20T17:53:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.155+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8628156910 con 0x7f86280d1630 2024-05-20T17:53:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.156+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8628155de0 con 0x7f86280d1630 2024-05-20T17:53:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.156+0000 7f861e7fc640 1 -- 172.21.15.6:0/570588524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8618007400 con 0x7f86280d1630 2024-05-20T17:53:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.157+0000 7f861e7fc640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f860c06be60 0x7f860c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.157+0000 7f861e7fc640 1 -- 172.21.15.6:0/570588524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f861808a610 con 0x7f86280d1630 2024-05-20T17:53:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.157+0000 7f862ddfd640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f860c06be60 0x7f860c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.157+0000 7f862ddfd640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f860c06be60 0x7f860c06e370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8624034000 tx=0x7f862402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.161+0000 7f861e7fc640 1 -- 172.21.15.6:0/570588524 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f86280b2110 con 0x7f86280d1630 2024-05-20T17:53:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.345+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8628075b00 con 0x7f86280d1630 2024-05-20T17:53:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.347+0000 7f861e7fc640 1 -- 172.21.15.6:0/570588524 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f8618058630 con 0x7f86280d1630 2024-05-20T17:53:30.347 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:30.347 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f860c06be60 msgr2=0x7f860c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f860c06be60 0x7f860c06e370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8624034000 tx=0x7f862402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86280d1630 msgr2=0x7f8628157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86280d1630 0x7f8628157110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f861800c3c0 tx=0x7f861800c7c0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 shutdown_connections 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f860c06be60 0x7f860c06e370 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f862815b790 0x7f8628157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86280d1630 0x7f8628157110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 --2- 172.21.15.6:0/570588524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86280b1d00 0x7f862814ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 >> 172.21.15.6:0/570588524 conn(0x7f8628072f30 msgr2=0x7f86280b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 shutdown_connections 2024-05-20T17:53:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.349+0000 7f8630061640 1 -- 172.21.15.6:0/570588524 wait complete. 2024-05-20T17:53:30.360 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T17:53:30.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:53:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.475+0000 7f40e208b640 1 Processor -- start 2024-05-20T17:53:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.475+0000 7f40e208b640 1 -- start start 2024-05-20T17:53:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40e208b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40dc06ca80 0x7f40dc15f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40e208b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc0ae320 0x7f40dc06bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40e208b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f40dc0ae730 0x7f40dc06c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40e208b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f40dc06b750 con 0x7f40dc06ca80 2024-05-20T17:53:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40e208b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f40dc0b1b80 con 0x7f40dc0ae730 2024-05-20T17:53:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40e208b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40dc0b12e0 con 0x7f40dc0ae320 2024-05-20T17:53:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40db7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40dc06ca80 0x7f40dc15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40db7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40dc06ca80 0x7f40dc15f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46096/0 (socket says 172.21.15.6:46096) 2024-05-20T17:53:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40db7fe640 1 -- 172.21.15.6:0/149702495 learned_addr learned my addr 172.21.15.6:0/149702495 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40dbfff640 1 --2- 172.21.15.6:0/149702495 >> v2:172.21.15.171:3300/0 conn(0x7f40dc0ae730 0x7f40dc06c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40daffd640 1 --2- 172.21.15.6:0/149702495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc0ae320 0x7f40dc06bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40db7fe640 1 -- 172.21.15.6:0/149702495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc0ae320 msgr2=0x7f40dc06bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40db7fe640 1 --2- 172.21.15.6:0/149702495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc0ae320 0x7f40dc06bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40db7fe640 1 -- 172.21.15.6:0/149702495 >> v2:172.21.15.171:3300/0 conn(0x7f40dc0ae730 msgr2=0x7f40dc06c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40db7fe640 1 --2- 172.21.15.6:0/149702495 >> v2:172.21.15.171:3300/0 conn(0x7f40dc0ae730 0x7f40dc06c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.477+0000 7f40db7fe640 1 -- 172.21.15.6:0/149702495 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40dc0b15c0 con 0x7f40dc06ca80 2024-05-20T17:53:30.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.478+0000 7f40db7fe640 1 --2- 172.21.15.6:0/149702495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc06ca80 0x7f40dc15f280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0b2de0 tx=0x7f40cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bac0fefac1af5b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.478+0000 7f40da7fc640 1 -- 172.21.15.6:0/149702495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc037070 con 0x7f40dc06ca80 2024-05-20T17:53:30.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.478+0000 7f40da7fc640 1 -- 172.21.15.6:0/149702495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40cc032440 con 0x7f40dc06ca80 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.478+0000 7f40da7fc640 1 -- 172.21.15.6:0/149702495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc032810 con 0x7f40dc06ca80 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 -- 172.21.15.6:0/149702495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc06ca80 msgr2=0x7f40dc15f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 --2- 172.21.15.6:0/149702495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc06ca80 0x7f40dc15f280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0b2de0 tx=0x7f40cc02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 -- 172.21.15.6:0/149702495 shutdown_connections 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 --2- 172.21.15.6:0/149702495 >> v2:172.21.15.171:3300/0 conn(0x7f40dc0ae730 0x7f40dc06c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 --2- 172.21.15.6:0/149702495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc0ae320 0x7f40dc06bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 --2- 172.21.15.6:0/149702495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc06ca80 0x7f40dc15f280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 -- 172.21.15.6:0/149702495 >> 172.21.15.6:0/149702495 conn(0x7f40dc072ed0 msgr2=0x7f40dc0b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 -- 172.21.15.6:0/149702495 shutdown_connections 2024-05-20T17:53:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.479+0000 7f40e208b640 1 -- 172.21.15.6:0/149702495 wait complete. 2024-05-20T17:53:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.481+0000 7f40e208b640 1 Processor -- start 2024-05-20T17:53:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.481+0000 7f40e208b640 1 -- start start 2024-05-20T17:53:30.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40e208b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc06ca80 0x7f40dc1423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40e208b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc0ae320 0x7f40dc143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40e208b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40dc0ae730 0x7f40dc144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40e208b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc06c660 con 0x7f40dc0ae320 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40e208b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc074e00 con 0x7f40dc0ae730 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40e208b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40dc06c7e0 con 0x7f40dc06ca80 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc0ae320 0x7f40dc143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc0ae320 0x7f40dc143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46110/0 (socket says 172.21.15.6:46110) 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 -- 172.21.15.6:0/359547723 learned_addr learned my addr 172.21.15.6:0/359547723 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40db7fe640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc06ca80 0x7f40dc1423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40dbfff640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40dc0ae730 0x7f40dc144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 -- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc06ca80 msgr2=0x7f40dc1423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc06ca80 0x7f40dc1423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 -- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40dc0ae730 msgr2=0x7f40dc144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40dc0ae730 0x7f40dc144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 -- 172.21.15.6:0/359547723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40dc142f20 con 0x7f40dc0ae320 2024-05-20T17:53:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40dbfff640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40dc0ae730 0x7f40dc144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40daffd640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc0ae320 0x7f40dc143ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f40d000d5f0 tx=0x7f40d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40c3fff640 1 -- 172.21.15.6:0/359547723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00125f0 con 0x7f40dc0ae320 2024-05-20T17:53:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40c3fff640 1 -- 172.21.15.6:0/359547723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d0019070 con 0x7f40dc0ae320 2024-05-20T17:53:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.483+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40dc143200 con 0x7f40dc0ae320 2024-05-20T17:53:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.484+0000 7f40c3fff640 1 -- 172.21.15.6:0/359547723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00129d0 con 0x7f40dc0ae320 2024-05-20T17:53:30.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.484+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40dc142930 con 0x7f40dc0ae320 2024-05-20T17:53:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.485+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40dc162900 con 0x7f40dc0ae320 2024-05-20T17:53:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.485+0000 7f40c3fff640 1 -- 172.21.15.6:0/359547723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40d0012b70 con 0x7f40dc0ae320 2024-05-20T17:53:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.486+0000 7f40c3fff640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.486+0000 7f40c3fff640 1 -- 172.21.15.6:0/359547723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f40d008b580 con 0x7f40dc0ae320 2024-05-20T17:53:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.486+0000 7f40db7fe640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.486+0000 7f40db7fe640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f40cc034000 tx=0x7f40cc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.490+0000 7f40c3fff640 1 -- 172.21.15.6:0/359547723 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f40d0059b60 con 0x7f40dc0ae320 2024-05-20T17:53:30.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.674+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40dc142cd0 con 0x7f40c806be30 2024-05-20T17:53:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.684+0000 7f40c3fff640 1 -- 172.21.15.6:0/359547723 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f40dc142cd0 con 0x7f40c806be30 2024-05-20T17:53:30.687 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:53:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 msgr2=0x7f40c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f40cc034000 tx=0x7f40cc02e000 comp rx=0 tx=0).stop 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc0ae320 msgr2=0x7f40dc143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc0ae320 0x7f40dc143ce0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f40d000d5f0 tx=0x7f40d000dab0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 shutdown_connections 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40dc0ae730 0x7f40dc144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40dc0ae320 0x7f40dc143ce0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 --2- 172.21.15.6:0/359547723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40dc06ca80 0x7f40dc1423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 >> 172.21.15.6:0/359547723 conn(0x7f40dc072ed0 msgr2=0x7f40dc0b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 shutdown_connections 2024-05-20T17:53:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.687+0000 7f40e208b640 1 -- 172.21.15.6:0/359547723 wait complete. 2024-05-20T17:53:30.699 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-05-20T17:53:30.236116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219360,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755360,"statfs":{"total":773094113280,"available":772869488640,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003432"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244003+0000","last_change":"2024-05-20T17:53:06.574155+0000","last_active":"2024-05-20T17:53:14.244003+0000","last_peered":"2024-05-20T17:53:14.244003+0000","last_clean":"2024-05-20T17:53:14.244003+0000","last_became_active":"2024-05-20T17:53:06.573561+0000","last_became_peered":"2024-05-20T17:53:06.573561+0000","last_unstale":"2024-05-20T17:53:14.244003+0000","last_undegraded":"2024-05-20T17:53:14.244003+0000","last_fullsized":"2024-05-20T17:53:14.244003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:22:58.179989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598752+0000","last_change":"2024-05-20T17:53:07.588500+0000","last_active":"2024-05-20T17:53:12.598752+0000","last_peered":"2024-05-20T17:53:12.598752+0000","last_clean":"2024-05-20T17:53:12.598752+0000","last_became_active":"2024-05-20T17:53:07.588137+0000","last_became_peered":"2024-05-20T17:53:07.588137+0000","last_unstale":"2024-05-20T17:53:12.598752+0000","last_undegraded":"2024-05-20T17:53:12.598752+0000","last_fullsized":"2024-05-20T17:53:12.598752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597759+0000","last_change":"2024-05-20T17:53:11.755635+0000","last_active":"2024-05-20T17:53:12.597759+0000","last_peered":"2024-05-20T17:53:12.597759+0000","last_clean":"2024-05-20T17:53:12.597759+0000","last_became_active":"2024-05-20T17:53:11.755186+0000","last_became_peered":"2024-05-20T17:53:11.755186+0000","last_unstale":"2024-05-20T17:53:12.597759+0000","last_undegraded":"2024-05-20T17:53:12.597759+0000","last_fullsized":"2024-05-20T17:53:12.597759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:41.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599124+0000","last_change":"2024-05-20T17:53:06.565749+0000","last_active":"2024-05-20T17:53:12.599124+0000","last_peered":"2024-05-20T17:53:12.599124+0000","last_clean":"2024-05-20T17:53:12.599124+0000","last_became_active":"2024-05-20T17:53:06.565249+0000","last_became_peered":"2024-05-20T17:53:06.565249+0000","last_unstale":"2024-05-20T17:53:12.599124+0000","last_undegraded":"2024-05-20T17:53:12.599124+0000","last_fullsized":"2024-05-20T17:53:12.599124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243589+0000","last_change":"2024-05-20T17:53:07.573440+0000","last_active":"2024-05-20T17:53:14.243589+0000","last_peered":"2024-05-20T17:53:14.243589+0000","last_clean":"2024-05-20T17:53:14.243589+0000","last_became_active":"2024-05-20T17:53:07.572075+0000","last_became_peered":"2024-05-20T17:53:07.572075+0000","last_unstale":"2024-05-20T17:53:14.243589+0000","last_undegraded":"2024-05-20T17:53:14.243589+0000","last_fullsized":"2024-05-20T17:53:14.243589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598429+0000","last_change":"2024-05-20T17:53:11.615875+0000","last_active":"2024-05-20T17:53:12.598429+0000","last_peered":"2024-05-20T17:53:12.598429+0000","last_clean":"2024-05-20T17:53:12.598429+0000","last_became_active":"2024-05-20T17:53:11.614378+0000","last_became_peered":"2024-05-20T17:53:11.614378+0000","last_unstale":"2024-05-20T17:53:12.598429+0000","last_undegraded":"2024-05-20T17:53:12.598429+0000","last_fullsized":"2024-05-20T17:53:12.598429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:44.041188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654652+0000","last_change":"2024-05-20T17:53:06.577931+0000","last_active":"2024-05-20T17:53:13.654652+0000","last_peered":"2024-05-20T17:53:13.654652+0000","last_clean":"2024-05-20T17:53:13.654652+0000","last_became_active":"2024-05-20T17:53:06.577611+0000","last_became_peered":"2024-05-20T17:53:06.577611+0000","last_unstale":"2024-05-20T17:53:13.654652+0000","last_undegraded":"2024-05-20T17:53:13.654652+0000","last_fullsized":"2024-05-20T17:53:13.654652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:30.496240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245106+0000","last_change":"2024-05-20T17:53:07.558806+0000","last_active":"2024-05-20T17:53:14.245106+0000","last_peered":"2024-05-20T17:53:14.245106+0000","last_clean":"2024-05-20T17:53:14.245106+0000","last_became_active":"2024-05-20T17:53:07.558446+0000","last_became_peered":"2024-05-20T17:53:07.558446+0000","last_unstale":"2024-05-20T17:53:14.245106+0000","last_undegraded":"2024-05-20T17:53:14.245106+0000","last_fullsized":"2024-05-20T17:53:14.245106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:14:58.555617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598909+0000","last_change":"2024-05-20T17:53:11.615219+0000","last_active":"2024-05-20T17:53:12.598909+0000","last_peered":"2024-05-20T17:53:12.598909+0000","last_clean":"2024-05-20T17:53:12.598909+0000","last_became_active":"2024-05-20T17:53:11.614707+0000","last_became_peered":"2024-05-20T17:53:11.614707+0000","last_unstale":"2024-05-20T17:53:12.598909+0000","last_undegraded":"2024-05-20T17:53:12.598909+0000","last_fullsized":"2024-05-20T17:53:12.598909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:43:01.628287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654386+0000","last_change":"2024-05-20T17:53:06.572513+0000","last_active":"2024-05-20T17:53:13.654386+0000","last_peered":"2024-05-20T17:53:13.654386+0000","last_clean":"2024-05-20T17:53:13.654386+0000","last_became_active":"2024-05-20T17:53:06.572112+0000","last_became_peered":"2024-05-20T17:53:06.572112+0000","last_unstale":"2024-05-20T17:53:13.654386+0000","last_undegraded":"2024-05-20T17:53:13.654386+0000","last_fullsized":"2024-05-20T17:53:13.654386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245406+0000","last_change":"2024-05-20T17:53:07.559015+0000","last_active":"2024-05-20T17:53:14.245406+0000","last_peered":"2024-05-20T17:53:14.245406+0000","last_clean":"2024-05-20T17:53:14.245406+0000","last_became_active":"2024-05-20T17:53:07.558369+0000","last_became_peered":"2024-05-20T17:53:07.558369+0000","last_unstale":"2024-05-20T17:53:14.245406+0000","last_undegraded":"2024-05-20T17:53:14.245406+0000","last_fullsized":"2024-05-20T17:53:14.245406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598644+0000","last_change":"2024-05-20T17:53:11.618079+0000","last_active":"2024-05-20T17:53:12.598644+0000","last_peered":"2024-05-20T17:53:12.598644+0000","last_clean":"2024-05-20T17:53:12.598644+0000","last_became_active":"2024-05-20T17:53:11.617572+0000","last_became_peered":"2024-05-20T17:53:11.617572+0000","last_unstale":"2024-05-20T17:53:12.598644+0000","last_undegraded":"2024-05-20T17:53:12.598644+0000","last_fullsized":"2024-05-20T17:53:12.598644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:23.513112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244311+0000","last_change":"2024-05-20T17:53:07.572220+0000","last_active":"2024-05-20T17:53:14.244311+0000","last_peered":"2024-05-20T17:53:14.244311+0000","last_clean":"2024-05-20T17:53:14.244311+0000","last_became_active":"2024-05-20T17:53:07.571759+0000","last_became_peered":"2024-05-20T17:53:07.571759+0000","last_unstale":"2024-05-20T17:53:14.244311+0000","last_undegraded":"2024-05-20T17:53:14.244311+0000","last_fullsized":"2024-05-20T17:53:14.244311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654495+0000","last_change":"2024-05-20T17:53:06.573537+0000","last_active":"2024-05-20T17:53:13.654495+0000","last_peered":"2024-05-20T17:53:13.654495+0000","last_clean":"2024-05-20T17:53:13.654495+0000","last_became_active":"2024-05-20T17:53:06.573236+0000","last_became_peered":"2024-05-20T17:53:06.573236+0000","last_unstale":"2024-05-20T17:53:13.654495+0000","last_undegraded":"2024-05-20T17:53:13.654495+0000","last_fullsized":"2024-05-20T17:53:13.654495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:00:16.154534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598961+0000","last_change":"2024-05-20T17:53:11.618293+0000","last_active":"2024-05-20T17:53:12.598961+0000","last_peered":"2024-05-20T17:53:12.598961+0000","last_clean":"2024-05-20T17:53:12.598961+0000","last_became_active":"2024-05-20T17:53:11.617707+0000","last_became_peered":"2024-05-20T17:53:11.617707+0000","last_unstale":"2024-05-20T17:53:12.598961+0000","last_undegraded":"2024-05-20T17:53:12.598961+0000","last_fullsized":"2024-05-20T17:53:12.598961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:24.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598222+0000","last_change":"2024-05-20T17:53:07.585094+0000","last_active":"2024-05-20T17:53:12.598222+0000","last_peered":"2024-05-20T17:53:12.598222+0000","last_clean":"2024-05-20T17:53:12.598222+0000","last_became_active":"2024-05-20T17:53:07.584666+0000","last_became_peered":"2024-05-20T17:53:07.584666+0000","last_unstale":"2024-05-20T17:53:12.598222+0000","last_undegraded":"2024-05-20T17:53:12.598222+0000","last_fullsized":"2024-05-20T17:53:12.598222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244302+0000","last_change":"2024-05-20T17:53:06.569733+0000","last_active":"2024-05-20T17:53:14.244302+0000","last_peered":"2024-05-20T17:53:14.244302+0000","last_clean":"2024-05-20T17:53:14.244302+0000","last_became_active":"2024-05-20T17:53:06.569177+0000","last_became_peered":"2024-05-20T17:53:06.569177+0000","last_unstale":"2024-05-20T17:53:14.244302+0000","last_undegraded":"2024-05-20T17:53:14.244302+0000","last_fullsized":"2024-05-20T17:53:14.244302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599068+0000","last_change":"2024-05-20T17:53:11.614905+0000","last_active":"2024-05-20T17:53:12.599068+0000","last_peered":"2024-05-20T17:53:12.599068+0000","last_clean":"2024-05-20T17:53:12.599068+0000","last_became_active":"2024-05-20T17:53:11.614264+0000","last_became_peered":"2024-05-20T17:53:11.614264+0000","last_unstale":"2024-05-20T17:53:12.599068+0000","last_undegraded":"2024-05-20T17:53:12.599068+0000","last_fullsized":"2024-05-20T17:53:12.599068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:44.269036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598007+0000","last_change":"2024-05-20T17:53:07.589843+0000","last_active":"2024-05-20T17:53:12.598007+0000","last_peered":"2024-05-20T17:53:12.598007+0000","last_clean":"2024-05-20T17:53:12.598007+0000","last_became_active":"2024-05-20T17:53:07.589565+0000","last_became_peered":"2024-05-20T17:53:07.589565+0000","last_unstale":"2024-05-20T17:53:12.598007+0000","last_undegraded":"2024-05-20T17:53:12.598007+0000","last_fullsized":"2024-05-20T17:53:12.598007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243854+0000","last_change":"2024-05-20T17:53:06.570609+0000","last_active":"2024-05-20T17:53:14.243854+0000","last_peered":"2024-05-20T17:53:14.243854+0000","last_clean":"2024-05-20T17:53:14.243854+0000","last_became_active":"2024-05-20T17:53:06.570253+0000","last_became_peered":"2024-05-20T17:53:06.570253+0000","last_unstale":"2024-05-20T17:53:14.243854+0000","last_undegraded":"2024-05-20T17:53:14.243854+0000","last_fullsized":"2024-05-20T17:53:14.243854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245197+0000","last_change":"2024-05-20T17:53:11.756398+0000","last_active":"2024-05-20T17:53:14.245197+0000","last_peered":"2024-05-20T17:53:14.245197+0000","last_clean":"2024-05-20T17:53:14.245197+0000","last_became_active":"2024-05-20T17:53:11.755995+0000","last_became_peered":"2024-05-20T17:53:11.755995+0000","last_unstale":"2024-05-20T17:53:14.245197+0000","last_undegraded":"2024-05-20T17:53:14.245197+0000","last_fullsized":"2024-05-20T17:53:14.245197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:50.812964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599504+0000","last_change":"2024-05-20T17:53:07.569595+0000","last_active":"2024-05-20T17:53:12.599504+0000","last_peered":"2024-05-20T17:53:12.599504+0000","last_clean":"2024-05-20T17:53:12.599504+0000","last_became_active":"2024-05-20T17:53:07.569291+0000","last_became_peered":"2024-05-20T17:53:07.569291+0000","last_unstale":"2024-05-20T17:53:12.599504+0000","last_undegraded":"2024-05-20T17:53:12.599504+0000","last_fullsized":"2024-05-20T17:53:12.599504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:32.671797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654037+0000","last_change":"2024-05-20T17:53:06.576258+0000","last_active":"2024-05-20T17:53:13.654037+0000","last_peered":"2024-05-20T17:53:13.654037+0000","last_clean":"2024-05-20T17:53:13.654037+0000","last_became_active":"2024-05-20T17:53:06.575933+0000","last_became_peered":"2024-05-20T17:53:06.575933+0000","last_unstale":"2024-05-20T17:53:13.654037+0000","last_undegraded":"2024-05-20T17:53:13.654037+0000","last_fullsized":"2024-05-20T17:53:13.654037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599393+0000","last_change":"2024-05-20T17:53:11.615738+0000","last_active":"2024-05-20T17:53:12.599393+0000","last_peered":"2024-05-20T17:53:12.599393+0000","last_clean":"2024-05-20T17:53:12.599393+0000","last_became_active":"2024-05-20T17:53:11.614228+0000","last_became_peered":"2024-05-20T17:53:11.614228+0000","last_unstale":"2024-05-20T17:53:12.599393+0000","last_undegraded":"2024-05-20T17:53:12.599393+0000","last_fullsized":"2024-05-20T17:53:12.599393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:02.595103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244147+0000","last_change":"2024-05-20T17:53:07.569138+0000","last_active":"2024-05-20T17:53:14.244147+0000","last_peered":"2024-05-20T17:53:14.244147+0000","last_clean":"2024-05-20T17:53:14.244147+0000","last_became_active":"2024-05-20T17:53:07.568036+0000","last_became_peered":"2024-05-20T17:53:07.568036+0000","last_unstale":"2024-05-20T17:53:14.244147+0000","last_undegraded":"2024-05-20T17:53:14.244147+0000","last_fullsized":"2024-05-20T17:53:14.244147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245354+0000","last_change":"2024-05-20T17:53:06.575386+0000","last_active":"2024-05-20T17:53:14.245354+0000","last_peered":"2024-05-20T17:53:14.245354+0000","last_clean":"2024-05-20T17:53:14.245354+0000","last_became_active":"2024-05-20T17:53:06.574851+0000","last_became_peered":"2024-05-20T17:53:06.574851+0000","last_unstale":"2024-05-20T17:53:14.245354+0000","last_undegraded":"2024-05-20T17:53:14.245354+0000","last_fullsized":"2024-05-20T17:53:14.245354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598416+0000","last_change":"2024-05-20T17:53:11.751984+0000","last_active":"2024-05-20T17:53:12.598416+0000","last_peered":"2024-05-20T17:53:12.598416+0000","last_clean":"2024-05-20T17:53:12.598416+0000","last_became_active":"2024-05-20T17:53:11.751452+0000","last_became_peered":"2024-05-20T17:53:11.751452+0000","last_unstale":"2024-05-20T17:53:12.598416+0000","last_undegraded":"2024-05-20T17:53:12.598416+0000","last_fullsized":"2024-05-20T17:53:12.598416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:44.794916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599614+0000","last_change":"2024-05-20T17:53:07.586262+0000","last_active":"2024-05-20T17:53:12.599614+0000","last_peered":"2024-05-20T17:53:12.599614+0000","last_clean":"2024-05-20T17:53:12.599614+0000","last_became_active":"2024-05-20T17:53:07.584798+0000","last_became_peered":"2024-05-20T17:53:07.584798+0000","last_unstale":"2024-05-20T17:53:12.599614+0000","last_undegraded":"2024-05-20T17:53:12.599614+0000","last_fullsized":"2024-05-20T17:53:12.599614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245096+0000","last_change":"2024-05-20T17:53:06.572334+0000","last_active":"2024-05-20T17:53:14.245096+0000","last_peered":"2024-05-20T17:53:14.245096+0000","last_clean":"2024-05-20T17:53:14.245096+0000","last_became_active":"2024-05-20T17:53:06.571243+0000","last_became_peered":"2024-05-20T17:53:06.571243+0000","last_unstale":"2024-05-20T17:53:14.245096+0000","last_undegraded":"2024-05-20T17:53:14.245096+0000","last_fullsized":"2024-05-20T17:53:14.245096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:00:16.154534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597655+0000","last_change":"2024-05-20T17:53:11.751914+0000","last_active":"2024-05-20T17:53:12.597655+0000","last_peered":"2024-05-20T17:53:12.597655+0000","last_clean":"2024-05-20T17:53:12.597655+0000","last_became_active":"2024-05-20T17:53:11.751472+0000","last_became_peered":"2024-05-20T17:53:11.751472+0000","last_unstale":"2024-05-20T17:53:12.597655+0000","last_undegraded":"2024-05-20T17:53:12.597655+0000","last_fullsized":"2024-05-20T17:53:12.597655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:52.250807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244812+0000","last_change":"2024-05-20T17:53:07.569467+0000","last_active":"2024-05-20T17:53:14.244812+0000","last_peered":"2024-05-20T17:53:14.244812+0000","last_clean":"2024-05-20T17:53:14.244812+0000","last_became_active":"2024-05-20T17:53:07.569123+0000","last_became_peered":"2024-05-20T17:53:07.569123+0000","last_unstale":"2024-05-20T17:53:14.244812+0000","last_undegraded":"2024-05-20T17:53:14.244812+0000","last_fullsized":"2024-05-20T17:53:14.244812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654806+0000","last_change":"2024-05-20T17:53:06.577309+0000","last_active":"2024-05-20T17:53:13.654806+0000","last_peered":"2024-05-20T17:53:13.654806+0000","last_clean":"2024-05-20T17:53:13.654806+0000","last_became_active":"2024-05-20T17:53:06.576898+0000","last_became_peered":"2024-05-20T17:53:06.576898+0000","last_unstale":"2024-05-20T17:53:13.654806+0000","last_undegraded":"2024-05-20T17:53:13.654806+0000","last_fullsized":"2024-05-20T17:53:13.654806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:25.034377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244489+0000","last_change":"2024-05-20T17:53:11.751909+0000","last_active":"2024-05-20T17:53:14.244489+0000","last_peered":"2024-05-20T17:53:14.244489+0000","last_clean":"2024-05-20T17:53:14.244489+0000","last_became_active":"2024-05-20T17:53:11.751479+0000","last_became_peered":"2024-05-20T17:53:11.751479+0000","last_unstale":"2024-05-20T17:53:14.244489+0000","last_undegraded":"2024-05-20T17:53:14.244489+0000","last_fullsized":"2024-05-20T17:53:14.244489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:55.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245485+0000","last_change":"2024-05-20T17:53:07.585138+0000","last_active":"2024-05-20T17:53:14.245485+0000","last_peered":"2024-05-20T17:53:14.245485+0000","last_clean":"2024-05-20T17:53:14.245485+0000","last_became_active":"2024-05-20T17:53:07.584803+0000","last_became_peered":"2024-05-20T17:53:07.584803+0000","last_unstale":"2024-05-20T17:53:14.245485+0000","last_undegraded":"2024-05-20T17:53:14.245485+0000","last_fullsized":"2024-05-20T17:53:14.245485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244812+0000","last_change":"2024-05-20T17:53:06.567245+0000","last_active":"2024-05-20T17:53:14.244812+0000","last_peered":"2024-05-20T17:53:14.244812+0000","last_clean":"2024-05-20T17:53:14.244812+0000","last_became_active":"2024-05-20T17:53:06.566920+0000","last_became_peered":"2024-05-20T17:53:06.566920+0000","last_unstale":"2024-05-20T17:53:14.244812+0000","last_undegraded":"2024-05-20T17:53:14.244812+0000","last_fullsized":"2024-05-20T17:53:14.244812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243827+0000","last_change":"2024-05-20T17:53:11.623254+0000","last_active":"2024-05-20T17:53:14.243827+0000","last_peered":"2024-05-20T17:53:14.243827+0000","last_clean":"2024-05-20T17:53:14.243827+0000","last_became_active":"2024-05-20T17:53:11.621995+0000","last_became_peered":"2024-05-20T17:53:11.621995+0000","last_unstale":"2024-05-20T17:53:14.243827+0000","last_undegraded":"2024-05-20T17:53:14.243827+0000","last_fullsized":"2024-05-20T17:53:14.243827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:49.533751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599455+0000","last_change":"2024-05-20T17:53:07.568413+0000","last_active":"2024-05-20T17:53:12.599455+0000","last_peered":"2024-05-20T17:53:12.599455+0000","last_clean":"2024-05-20T17:53:12.599455+0000","last_became_active":"2024-05-20T17:53:07.567292+0000","last_became_peered":"2024-05-20T17:53:07.567292+0000","last_unstale":"2024-05-20T17:53:12.599455+0000","last_undegraded":"2024-05-20T17:53:12.599455+0000","last_fullsized":"2024-05-20T17:53:12.599455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:26.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244479+0000","last_change":"2024-05-20T17:53:06.567819+0000","last_active":"2024-05-20T17:53:14.244479+0000","last_peered":"2024-05-20T17:53:14.244479+0000","last_clean":"2024-05-20T17:53:14.244479+0000","last_became_active":"2024-05-20T17:53:06.567485+0000","last_became_peered":"2024-05-20T17:53:06.567485+0000","last_unstale":"2024-05-20T17:53:14.244479+0000","last_undegraded":"2024-05-20T17:53:14.244479+0000","last_fullsized":"2024-05-20T17:53:14.244479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244638+0000","last_change":"2024-05-20T17:53:11.621878+0000","last_active":"2024-05-20T17:53:14.244638+0000","last_peered":"2024-05-20T17:53:14.244638+0000","last_clean":"2024-05-20T17:53:14.244638+0000","last_became_active":"2024-05-20T17:53:11.621430+0000","last_became_peered":"2024-05-20T17:53:11.621430+0000","last_unstale":"2024-05-20T17:53:14.244638+0000","last_undegraded":"2024-05-20T17:53:14.244638+0000","last_fullsized":"2024-05-20T17:53:14.244638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:55.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243483+0000","last_change":"2024-05-20T17:53:07.569646+0000","last_active":"2024-05-20T17:53:14.243483+0000","last_peered":"2024-05-20T17:53:14.243483+0000","last_clean":"2024-05-20T17:53:14.243483+0000","last_became_active":"2024-05-20T17:53:07.569255+0000","last_became_peered":"2024-05-20T17:53:07.569255+0000","last_unstale":"2024-05-20T17:53:14.243483+0000","last_undegraded":"2024-05-20T17:53:14.243483+0000","last_fullsized":"2024-05-20T17:53:14.243483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598624+0000","last_change":"2024-05-20T17:53:06.568915+0000","last_active":"2024-05-20T17:53:12.598624+0000","last_peered":"2024-05-20T17:53:12.598624+0000","last_clean":"2024-05-20T17:53:12.598624+0000","last_became_active":"2024-05-20T17:53:06.568597+0000","last_became_peered":"2024-05-20T17:53:06.568597+0000","last_unstale":"2024-05-20T17:53:12.598624+0000","last_undegraded":"2024-05-20T17:53:12.598624+0000","last_fullsized":"2024-05-20T17:53:12.598624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245241+0000","last_change":"2024-05-20T17:53:11.622481+0000","last_active":"2024-05-20T17:53:14.245241+0000","last_peered":"2024-05-20T17:53:14.245241+0000","last_clean":"2024-05-20T17:53:14.245241+0000","last_became_active":"2024-05-20T17:53:11.622026+0000","last_became_peered":"2024-05-20T17:53:11.622026+0000","last_unstale":"2024-05-20T17:53:14.245241+0000","last_undegraded":"2024-05-20T17:53:14.245241+0000","last_fullsized":"2024-05-20T17:53:14.245241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:15.654843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243451+0000","last_change":"2024-05-20T17:53:07.563580+0000","last_active":"2024-05-20T17:53:14.243451+0000","last_peered":"2024-05-20T17:53:14.243451+0000","last_clean":"2024-05-20T17:53:14.243451+0000","last_became_active":"2024-05-20T17:53:07.563226+0000","last_became_peered":"2024-05-20T17:53:07.563226+0000","last_unstale":"2024-05-20T17:53:14.243451+0000","last_undegraded":"2024-05-20T17:53:14.243451+0000","last_fullsized":"2024-05-20T17:53:14.243451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:22.334918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654094+0000","last_change":"2024-05-20T17:53:06.570658+0000","last_active":"2024-05-20T17:53:13.654094+0000","last_peered":"2024-05-20T17:53:13.654094+0000","last_clean":"2024-05-20T17:53:13.654094+0000","last_became_active":"2024-05-20T17:53:06.569975+0000","last_became_peered":"2024-05-20T17:53:06.569975+0000","last_unstale":"2024-05-20T17:53:13.654094+0000","last_undegraded":"2024-05-20T17:53:13.654094+0000","last_fullsized":"2024-05-20T17:53:13.654094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244022+0000","last_change":"2024-05-20T17:53:11.752185+0000","last_active":"2024-05-20T17:53:14.244022+0000","last_peered":"2024-05-20T17:53:14.244022+0000","last_clean":"2024-05-20T17:53:14.244022+0000","last_became_active":"2024-05-20T17:53:11.751761+0000","last_became_peered":"2024-05-20T17:53:11.751761+0000","last_unstale":"2024-05-20T17:53:14.244022+0000","last_undegraded":"2024-05-20T17:53:14.244022+0000","last_fullsized":"2024-05-20T17:53:14.244022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:28.849402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597975+0000","last_change":"2024-05-20T17:53:07.585881+0000","last_active":"2024-05-20T17:53:12.597975+0000","last_peered":"2024-05-20T17:53:12.597975+0000","last_clean":"2024-05-20T17:53:12.597975+0000","last_became_active":"2024-05-20T17:53:07.584882+0000","last_became_peered":"2024-05-20T17:53:07.584882+0000","last_unstale":"2024-05-20T17:53:12.597975+0000","last_undegraded":"2024-05-20T17:53:12.597975+0000","last_fullsized":"2024-05-20T17:53:12.597975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244548+0000","last_change":"2024-05-20T17:53:06.568683+0000","last_active":"2024-05-20T17:53:14.244548+0000","last_peered":"2024-05-20T17:53:14.244548+0000","last_clean":"2024-05-20T17:53:14.244548+0000","last_became_active":"2024-05-20T17:53:06.568335+0000","last_became_peered":"2024-05-20T17:53:06.568335+0000","last_unstale":"2024-05-20T17:53:14.244548+0000","last_undegraded":"2024-05-20T17:53:14.244548+0000","last_fullsized":"2024-05-20T17:53:14.244548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654203+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:53:13.654203+0000","last_peered":"2024-05-20T17:53:13.654203+0000","last_clean":"2024-05-20T17:53:13.654203+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:53:13.654203+0000","last_undegraded":"2024-05-20T17:53:13.654203+0000","last_fullsized":"2024-05-20T17:53:13.654203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244914+0000","last_change":"2024-05-20T17:53:11.755628+0000","last_active":"2024-05-20T17:53:14.244914+0000","last_peered":"2024-05-20T17:53:14.244914+0000","last_clean":"2024-05-20T17:53:14.244914+0000","last_became_active":"2024-05-20T17:53:11.755136+0000","last_became_peered":"2024-05-20T17:53:11.755136+0000","last_unstale":"2024-05-20T17:53:14.244914+0000","last_undegraded":"2024-05-20T17:53:14.244914+0000","last_fullsized":"2024-05-20T17:53:14.244914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:21.092223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654502+0000","last_change":"2024-05-20T17:53:07.570752+0000","last_active":"2024-05-20T17:53:13.654502+0000","last_peered":"2024-05-20T17:53:13.654502+0000","last_clean":"2024-05-20T17:53:13.654502+0000","last_became_active":"2024-05-20T17:53:07.570340+0000","last_became_peered":"2024-05-20T17:53:07.570340+0000","last_unstale":"2024-05-20T17:53:13.654502+0000","last_undegraded":"2024-05-20T17:53:13.654502+0000","last_fullsized":"2024-05-20T17:53:13.654502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599144+0000","last_change":"2024-05-20T17:53:06.574013+0000","last_active":"2024-05-20T17:53:12.599144+0000","last_peered":"2024-05-20T17:53:12.599144+0000","last_clean":"2024-05-20T17:53:12.599144+0000","last_became_active":"2024-05-20T17:53:06.573642+0000","last_became_peered":"2024-05-20T17:53:06.573642+0000","last_unstale":"2024-05-20T17:53:12.599144+0000","last_undegraded":"2024-05-20T17:53:12.599144+0000","last_fullsized":"2024-05-20T17:53:12.599144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244226+0000","last_change":"2024-05-20T17:53:11.753062+0000","last_active":"2024-05-20T17:53:14.244226+0000","last_peered":"2024-05-20T17:53:14.244226+0000","last_clean":"2024-05-20T17:53:14.244226+0000","last_became_active":"2024-05-20T17:53:11.751556+0000","last_became_peered":"2024-05-20T17:53:11.751556+0000","last_unstale":"2024-05-20T17:53:14.244226+0000","last_undegraded":"2024-05-20T17:53:14.244226+0000","last_fullsized":"2024-05-20T17:53:14.244226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:24.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245151+0000","last_change":"2024-05-20T17:53:07.588441+0000","last_active":"2024-05-20T17:53:14.245151+0000","last_peered":"2024-05-20T17:53:14.245151+0000","last_clean":"2024-05-20T17:53:14.245151+0000","last_became_active":"2024-05-20T17:53:07.588133+0000","last_became_peered":"2024-05-20T17:53:07.588133+0000","last_unstale":"2024-05-20T17:53:14.245151+0000","last_undegraded":"2024-05-20T17:53:14.245151+0000","last_fullsized":"2024-05-20T17:53:14.245151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:24.809917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244797+0000","last_change":"2024-05-20T17:53:06.573392+0000","last_active":"2024-05-20T17:53:14.244797+0000","last_peered":"2024-05-20T17:53:14.244797+0000","last_clean":"2024-05-20T17:53:14.244797+0000","last_became_active":"2024-05-20T17:53:06.573074+0000","last_became_peered":"2024-05-20T17:53:06.573074+0000","last_unstale":"2024-05-20T17:53:14.244797+0000","last_undegraded":"2024-05-20T17:53:14.244797+0000","last_fullsized":"2024-05-20T17:53:14.244797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:25.034377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244807+0000","last_change":"2024-05-20T17:53:11.616708+0000","last_active":"2024-05-20T17:53:14.244807+0000","last_peered":"2024-05-20T17:53:14.244807+0000","last_clean":"2024-05-20T17:53:14.244807+0000","last_became_active":"2024-05-20T17:53:11.616224+0000","last_became_peered":"2024-05-20T17:53:11.616224+0000","last_unstale":"2024-05-20T17:53:14.244807+0000","last_undegraded":"2024-05-20T17:53:14.244807+0000","last_fullsized":"2024-05-20T17:53:14.244807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:50.812964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654899+0000","last_change":"2024-05-20T17:53:07.572037+0000","last_active":"2024-05-20T17:53:13.654899+0000","last_peered":"2024-05-20T17:53:13.654899+0000","last_clean":"2024-05-20T17:53:13.654899+0000","last_became_active":"2024-05-20T17:53:07.571604+0000","last_became_peered":"2024-05-20T17:53:07.571604+0000","last_unstale":"2024-05-20T17:53:13.654899+0000","last_undegraded":"2024-05-20T17:53:13.654899+0000","last_fullsized":"2024-05-20T17:53:13.654899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:14:58.555617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599665+0000","last_change":"2024-05-20T17:53:06.569716+0000","last_active":"2024-05-20T17:53:12.599665+0000","last_peered":"2024-05-20T17:53:12.599665+0000","last_clean":"2024-05-20T17:53:12.599665+0000","last_became_active":"2024-05-20T17:53:06.569388+0000","last_became_peered":"2024-05-20T17:53:06.569388+0000","last_unstale":"2024-05-20T17:53:12.599665+0000","last_undegraded":"2024-05-20T17:53:12.599665+0000","last_fullsized":"2024-05-20T17:53:12.599665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243806+0000","last_change":"2024-05-20T17:53:11.755708+0000","last_active":"2024-05-20T17:53:14.243806+0000","last_peered":"2024-05-20T17:53:14.243806+0000","last_clean":"2024-05-20T17:53:14.243806+0000","last_became_active":"2024-05-20T17:53:11.755172+0000","last_became_peered":"2024-05-20T17:53:11.755172+0000","last_unstale":"2024-05-20T17:53:14.243806+0000","last_undegraded":"2024-05-20T17:53:14.243806+0000","last_fullsized":"2024-05-20T17:53:14.243806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:52.250807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654824+0000","last_change":"2024-05-20T17:53:07.572990+0000","last_active":"2024-05-20T17:53:13.654824+0000","last_peered":"2024-05-20T17:53:13.654824+0000","last_clean":"2024-05-20T17:53:13.654824+0000","last_became_active":"2024-05-20T17:53:07.572659+0000","last_became_peered":"2024-05-20T17:53:07.572659+0000","last_unstale":"2024-05-20T17:53:13.654824+0000","last_undegraded":"2024-05-20T17:53:13.654824+0000","last_fullsized":"2024-05-20T17:53:13.654824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599512+0000","last_change":"2024-05-20T17:53:06.566523+0000","last_active":"2024-05-20T17:53:12.599512+0000","last_peered":"2024-05-20T17:53:12.599512+0000","last_clean":"2024-05-20T17:53:12.599512+0000","last_became_active":"2024-05-20T17:53:06.566228+0000","last_became_peered":"2024-05-20T17:53:06.566228+0000","last_unstale":"2024-05-20T17:53:12.599512+0000","last_undegraded":"2024-05-20T17:53:12.599512+0000","last_fullsized":"2024-05-20T17:53:12.599512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:53:10.800947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598417+0000","last_change":"2024-05-20T17:53:11.616204+0000","last_active":"2024-05-20T17:53:12.598417+0000","last_peered":"2024-05-20T17:53:12.598417+0000","last_clean":"2024-05-20T17:53:12.598417+0000","last_became_active":"2024-05-20T17:53:11.614496+0000","last_became_peered":"2024-05-20T17:53:11.614496+0000","last_unstale":"2024-05-20T17:53:12.598417+0000","last_undegraded":"2024-05-20T17:53:12.598417+0000","last_fullsized":"2024-05-20T17:53:12.598417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:35.749353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654214+0000","last_change":"2024-05-20T17:53:07.571233+0000","last_active":"2024-05-20T17:53:13.654214+0000","last_peered":"2024-05-20T17:53:13.654214+0000","last_clean":"2024-05-20T17:53:13.654214+0000","last_became_active":"2024-05-20T17:53:07.570934+0000","last_became_peered":"2024-05-20T17:53:07.570934+0000","last_unstale":"2024-05-20T17:53:13.654214+0000","last_undegraded":"2024-05-20T17:53:13.654214+0000","last_fullsized":"2024-05-20T17:53:13.654214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:17.052738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598410+0000","last_change":"2024-05-20T17:53:06.567186+0000","last_active":"2024-05-20T17:53:12.598410+0000","last_peered":"2024-05-20T17:53:12.598410+0000","last_clean":"2024-05-20T17:53:12.598410+0000","last_became_active":"2024-05-20T17:53:06.566859+0000","last_became_peered":"2024-05-20T17:53:06.566859+0000","last_unstale":"2024-05-20T17:53:12.598410+0000","last_undegraded":"2024-05-20T17:53:12.598410+0000","last_fullsized":"2024-05-20T17:53:12.598410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243852+0000","last_change":"2024-05-20T17:53:11.621010+0000","last_active":"2024-05-20T17:53:14.243852+0000","last_peered":"2024-05-20T17:53:14.243852+0000","last_clean":"2024-05-20T17:53:14.243852+0000","last_became_active":"2024-05-20T17:53:11.620499+0000","last_became_peered":"2024-05-20T17:53:11.620499+0000","last_unstale":"2024-05-20T17:53:14.243852+0000","last_undegraded":"2024-05-20T17:53:14.243852+0000","last_fullsized":"2024-05-20T17:53:14.243852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:49.533751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243897+0000","last_change":"2024-05-20T17:53:07.570895+0000","last_active":"2024-05-20T17:53:14.243897+0000","last_peered":"2024-05-20T17:53:14.243897+0000","last_clean":"2024-05-20T17:53:14.243897+0000","last_became_active":"2024-05-20T17:53:07.570591+0000","last_became_peered":"2024-05-20T17:53:07.570591+0000","last_unstale":"2024-05-20T17:53:14.243897+0000","last_undegraded":"2024-05-20T17:53:14.243897+0000","last_fullsized":"2024-05-20T17:53:14.243897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244112+0000","last_change":"2024-05-20T17:53:06.571154+0000","last_active":"2024-05-20T17:53:14.244112+0000","last_peered":"2024-05-20T17:53:14.244112+0000","last_clean":"2024-05-20T17:53:14.244112+0000","last_became_active":"2024-05-20T17:53:06.570383+0000","last_became_peered":"2024-05-20T17:53:06.570383+0000","last_unstale":"2024-05-20T17:53:14.244112+0000","last_undegraded":"2024-05-20T17:53:14.244112+0000","last_fullsized":"2024-05-20T17:53:14.244112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599410+0000","last_change":"2024-05-20T17:53:11.755366+0000","last_active":"2024-05-20T17:53:12.599410+0000","last_peered":"2024-05-20T17:53:12.599410+0000","last_clean":"2024-05-20T17:53:12.599410+0000","last_became_active":"2024-05-20T17:53:11.754922+0000","last_became_peered":"2024-05-20T17:53:11.754922+0000","last_unstale":"2024-05-20T17:53:12.599410+0000","last_undegraded":"2024-05-20T17:53:12.599410+0000","last_fullsized":"2024-05-20T17:53:12.599410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:54:01.281535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654387+0000","last_change":"2024-05-20T17:53:07.571300+0000","last_active":"2024-05-20T17:53:13.654387+0000","last_peered":"2024-05-20T17:53:13.654387+0000","last_clean":"2024-05-20T17:53:13.654387+0000","last_became_active":"2024-05-20T17:53:07.570991+0000","last_became_peered":"2024-05-20T17:53:07.570991+0000","last_unstale":"2024-05-20T17:53:13.654387+0000","last_undegraded":"2024-05-20T17:53:13.654387+0000","last_fullsized":"2024-05-20T17:53:13.654387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:51.199335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244361+0000","last_change":"2024-05-20T17:53:06.576427+0000","last_active":"2024-05-20T17:53:14.244361+0000","last_peered":"2024-05-20T17:53:14.244361+0000","last_clean":"2024-05-20T17:53:14.244361+0000","last_became_active":"2024-05-20T17:53:06.576041+0000","last_became_peered":"2024-05-20T17:53:06.576041+0000","last_unstale":"2024-05-20T17:53:14.244361+0000","last_undegraded":"2024-05-20T17:53:14.244361+0000","last_fullsized":"2024-05-20T17:53:14.244361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599381+0000","last_change":"2024-05-20T17:53:11.752114+0000","last_active":"2024-05-20T17:53:12.599381+0000","last_peered":"2024-05-20T17:53:12.599381+0000","last_clean":"2024-05-20T17:53:12.599381+0000","last_became_active":"2024-05-20T17:53:11.751659+0000","last_became_peered":"2024-05-20T17:53:11.751659+0000","last_unstale":"2024-05-20T17:53:12.599381+0000","last_undegraded":"2024-05-20T17:53:12.599381+0000","last_fullsized":"2024-05-20T17:53:12.599381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:33:17.210775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244151+0000","last_change":"2024-05-20T17:53:07.570656+0000","last_active":"2024-05-20T17:53:14.244151+0000","last_peered":"2024-05-20T17:53:14.244151+0000","last_clean":"2024-05-20T17:53:14.244151+0000","last_became_active":"2024-05-20T17:53:07.570296+0000","last_became_peered":"2024-05-20T17:53:07.570296+0000","last_unstale":"2024-05-20T17:53:14.244151+0000","last_undegraded":"2024-05-20T17:53:14.244151+0000","last_fullsized":"2024-05-20T17:53:14.244151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:12:35.547087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244993+0000","last_change":"2024-05-20T17:53:06.567626+0000","last_active":"2024-05-20T17:53:14.244993+0000","last_peered":"2024-05-20T17:53:14.244993+0000","last_clean":"2024-05-20T17:53:14.244993+0000","last_became_active":"2024-05-20T17:53:06.565665+0000","last_became_peered":"2024-05-20T17:53:06.565665+0000","last_unstale":"2024-05-20T17:53:14.244993+0000","last_undegraded":"2024-05-20T17:53:14.244993+0000","last_fullsized":"2024-05-20T17:53:14.244993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:13.293451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245434+0000","last_change":"2024-05-20T17:53:11.752662+0000","last_active":"2024-05-20T17:53:14.245434+0000","last_peered":"2024-05-20T17:53:14.245434+0000","last_clean":"2024-05-20T17:53:14.245434+0000","last_became_active":"2024-05-20T17:53:11.752188+0000","last_became_peered":"2024-05-20T17:53:11.752188+0000","last_unstale":"2024-05-20T17:53:14.245434+0000","last_undegraded":"2024-05-20T17:53:14.245434+0000","last_fullsized":"2024-05-20T17:53:14.245434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:41.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654449+0000","last_change":"2024-05-20T17:53:07.588530+0000","last_active":"2024-05-20T17:53:13.654449+0000","last_peered":"2024-05-20T17:53:13.654449+0000","last_clean":"2024-05-20T17:53:13.654449+0000","last_became_active":"2024-05-20T17:53:07.587985+0000","last_became_peered":"2024-05-20T17:53:07.587985+0000","last_unstale":"2024-05-20T17:53:13.654449+0000","last_undegraded":"2024-05-20T17:53:13.654449+0000","last_fullsized":"2024-05-20T17:53:13.654449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:17.229454+0000","last_change":"2024-05-20T17:53:06.574794+0000","last_active":"2024-05-20T17:53:17.229454+0000","last_peered":"2024-05-20T17:53:17.229454+0000","last_clean":"2024-05-20T17:53:17.229454+0000","last_became_active":"2024-05-20T17:53:06.574430+0000","last_became_peered":"2024-05-20T17:53:06.574430+0000","last_unstale":"2024-05-20T17:53:17.229454+0000","last_undegraded":"2024-05-20T17:53:17.229454+0000","last_fullsized":"2024-05-20T17:53:17.229454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244161+0000","last_change":"2024-05-20T17:53:11.620987+0000","last_active":"2024-05-20T17:53:14.244161+0000","last_peered":"2024-05-20T17:53:14.244161+0000","last_clean":"2024-05-20T17:53:14.244161+0000","last_became_active":"2024-05-20T17:53:11.620506+0000","last_became_peered":"2024-05-20T17:53:11.620506+0000","last_unstale":"2024-05-20T17:53:14.244161+0000","last_undegraded":"2024-05-20T17:53:14.244161+0000","last_fullsized":"2024-05-20T17:53:14.244161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:28.849402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599507+0000","last_change":"2024-05-20T17:53:07.565183+0000","last_active":"2024-05-20T17:53:12.599507+0000","last_peered":"2024-05-20T17:53:12.599507+0000","last_clean":"2024-05-20T17:53:12.599507+0000","last_became_active":"2024-05-20T17:53:07.564852+0000","last_became_peered":"2024-05-20T17:53:07.564852+0000","last_unstale":"2024-05-20T17:53:12.599507+0000","last_undegraded":"2024-05-20T17:53:12.599507+0000","last_fullsized":"2024-05-20T17:53:12.599507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:31.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244673+0000","last_change":"2024-05-20T17:53:06.574319+0000","last_active":"2024-05-20T17:53:14.244673+0000","last_peered":"2024-05-20T17:53:14.244673+0000","last_clean":"2024-05-20T17:53:14.244673+0000","last_became_active":"2024-05-20T17:53:06.573970+0000","last_became_peered":"2024-05-20T17:53:06.573970+0000","last_unstale":"2024-05-20T17:53:14.244673+0000","last_undegraded":"2024-05-20T17:53:14.244673+0000","last_fullsized":"2024-05-20T17:53:14.244673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:30.496240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599198+0000","last_change":"2024-05-20T17:53:11.616154+0000","last_active":"2024-05-20T17:53:12.599198+0000","last_peered":"2024-05-20T17:53:12.599198+0000","last_clean":"2024-05-20T17:53:12.599198+0000","last_became_active":"2024-05-20T17:53:11.614731+0000","last_became_peered":"2024-05-20T17:53:11.614731+0000","last_unstale":"2024-05-20T17:53:12.599198+0000","last_undegraded":"2024-05-20T17:53:12.599198+0000","last_fullsized":"2024-05-20T17:53:12.599198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:21.092223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243803+0000","last_change":"2024-05-20T17:53:07.573718+0000","last_active":"2024-05-20T17:53:14.243803+0000","last_peered":"2024-05-20T17:53:14.243803+0000","last_clean":"2024-05-20T17:53:14.243803+0000","last_became_active":"2024-05-20T17:53:07.573368+0000","last_became_peered":"2024-05-20T17:53:07.573368+0000","last_unstale":"2024-05-20T17:53:14.243803+0000","last_undegraded":"2024-05-20T17:53:14.243803+0000","last_fullsized":"2024-05-20T17:53:14.243803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244725+0000","last_change":"2024-05-20T17:53:06.572461+0000","last_active":"2024-05-20T17:53:14.244725+0000","last_peered":"2024-05-20T17:53:14.244725+0000","last_clean":"2024-05-20T17:53:14.244725+0000","last_became_active":"2024-05-20T17:53:06.572097+0000","last_became_peered":"2024-05-20T17:53:06.572097+0000","last_unstale":"2024-05-20T17:53:14.244725+0000","last_undegraded":"2024-05-20T17:53:14.244725+0000","last_fullsized":"2024-05-20T17:53:14.244725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597910+0000","last_change":"2024-05-20T17:53:11.612607+0000","last_active":"2024-05-20T17:53:12.597910+0000","last_peered":"2024-05-20T17:53:12.597910+0000","last_clean":"2024-05-20T17:53:12.597910+0000","last_became_active":"2024-05-20T17:53:11.612147+0000","last_became_peered":"2024-05-20T17:53:11.612147+0000","last_unstale":"2024-05-20T17:53:12.597910+0000","last_undegraded":"2024-05-20T17:53:12.597910+0000","last_fullsized":"2024-05-20T17:53:12.597910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:57.596450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244594+0000","last_change":"2024-05-20T17:53:07.565265+0000","last_active":"2024-05-20T17:53:14.244594+0000","last_peered":"2024-05-20T17:53:14.244594+0000","last_clean":"2024-05-20T17:53:14.244594+0000","last_became_active":"2024-05-20T17:53:07.564958+0000","last_became_peered":"2024-05-20T17:53:07.564958+0000","last_unstale":"2024-05-20T17:53:14.244594+0000","last_undegraded":"2024-05-20T17:53:14.244594+0000","last_fullsized":"2024-05-20T17:53:14.244594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244837+0000","last_change":"2024-05-20T17:53:06.575493+0000","last_active":"2024-05-20T17:53:14.244837+0000","last_peered":"2024-05-20T17:53:14.244837+0000","last_clean":"2024-05-20T17:53:14.244837+0000","last_became_active":"2024-05-20T17:53:06.575211+0000","last_became_peered":"2024-05-20T17:53:06.575211+0000","last_unstale":"2024-05-20T17:53:14.244837+0000","last_undegraded":"2024-05-20T17:53:14.244837+0000","last_fullsized":"2024-05-20T17:53:14.244837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599643+0000","last_change":"2024-05-20T17:53:11.755641+0000","last_active":"2024-05-20T17:53:12.599643+0000","last_peered":"2024-05-20T17:53:12.599643+0000","last_clean":"2024-05-20T17:53:12.599643+0000","last_became_active":"2024-05-20T17:53:11.755179+0000","last_became_peered":"2024-05-20T17:53:11.755179+0000","last_unstale":"2024-05-20T17:53:12.599643+0000","last_undegraded":"2024-05-20T17:53:12.599643+0000","last_fullsized":"2024-05-20T17:53:12.599643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:08.214732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243667+0000","last_change":"2024-05-20T17:53:11.755526+0000","last_active":"2024-05-20T17:53:14.243667+0000","last_peered":"2024-05-20T17:53:14.243667+0000","last_clean":"2024-05-20T17:53:14.243667+0000","last_became_active":"2024-05-20T17:53:11.755114+0000","last_became_peered":"2024-05-20T17:53:11.755114+0000","last_unstale":"2024-05-20T17:53:14.243667+0000","last_undegraded":"2024-05-20T17:53:14.243667+0000","last_fullsized":"2024-05-20T17:53:14.243667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:02.595103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243648+0000","last_change":"2024-05-20T17:53:07.589463+0000","last_active":"2024-05-20T17:53:14.243648+0000","last_peered":"2024-05-20T17:53:14.243648+0000","last_clean":"2024-05-20T17:53:14.243648+0000","last_became_active":"2024-05-20T17:53:07.589109+0000","last_became_peered":"2024-05-20T17:53:07.589109+0000","last_unstale":"2024-05-20T17:53:14.243648+0000","last_undegraded":"2024-05-20T17:53:14.243648+0000","last_fullsized":"2024-05-20T17:53:14.243648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243937+0000","last_change":"2024-05-20T17:53:06.573947+0000","last_active":"2024-05-20T17:53:14.243937+0000","last_peered":"2024-05-20T17:53:14.243937+0000","last_clean":"2024-05-20T17:53:14.243937+0000","last_became_active":"2024-05-20T17:53:06.572617+0000","last_became_peered":"2024-05-20T17:53:06.572617+0000","last_unstale":"2024-05-20T17:53:14.243937+0000","last_undegraded":"2024-05-20T17:53:14.243937+0000","last_fullsized":"2024-05-20T17:53:14.243937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244417+0000","last_change":"2024-05-20T17:53:11.617273+0000","last_active":"2024-05-20T17:53:14.244417+0000","last_peered":"2024-05-20T17:53:14.244417+0000","last_clean":"2024-05-20T17:53:14.244417+0000","last_became_active":"2024-05-20T17:53:11.616538+0000","last_became_peered":"2024-05-20T17:53:11.616538+0000","last_unstale":"2024-05-20T17:53:14.244417+0000","last_undegraded":"2024-05-20T17:53:14.244417+0000","last_fullsized":"2024-05-20T17:53:14.244417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:44.269036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597869+0000","last_change":"2024-05-20T17:53:07.585370+0000","last_active":"2024-05-20T17:53:12.597869+0000","last_peered":"2024-05-20T17:53:12.597869+0000","last_clean":"2024-05-20T17:53:12.597869+0000","last_became_active":"2024-05-20T17:53:07.584558+0000","last_became_peered":"2024-05-20T17:53:07.584558+0000","last_unstale":"2024-05-20T17:53:12.597869+0000","last_undegraded":"2024-05-20T17:53:12.597869+0000","last_fullsized":"2024-05-20T17:53:12.597869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598324+0000","last_change":"2024-05-20T17:53:06.575726+0000","last_active":"2024-05-20T17:53:12.598324+0000","last_peered":"2024-05-20T17:53:12.598324+0000","last_clean":"2024-05-20T17:53:12.598324+0000","last_became_active":"2024-05-20T17:53:06.575405+0000","last_became_peered":"2024-05-20T17:53:06.575405+0000","last_unstale":"2024-05-20T17:53:12.598324+0000","last_undegraded":"2024-05-20T17:53:12.598324+0000","last_fullsized":"2024-05-20T17:53:12.598324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244557+0000","last_change":"2024-05-20T17:53:06.570392+0000","last_active":"2024-05-20T17:53:14.244557+0000","last_peered":"2024-05-20T17:53:14.244557+0000","last_clean":"2024-05-20T17:53:14.244557+0000","last_became_active":"2024-05-20T17:53:06.569729+0000","last_became_peered":"2024-05-20T17:53:06.569729+0000","last_unstale":"2024-05-20T17:53:14.244557+0000","last_undegraded":"2024-05-20T17:53:14.244557+0000","last_fullsized":"2024-05-20T17:53:14.244557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244969+0000","last_change":"2024-05-20T17:53:07.563453+0000","last_active":"2024-05-20T17:53:14.244969+0000","last_peered":"2024-05-20T17:53:14.244969+0000","last_clean":"2024-05-20T17:53:14.244969+0000","last_became_active":"2024-05-20T17:53:07.563081+0000","last_became_peered":"2024-05-20T17:53:07.563081+0000","last_unstale":"2024-05-20T17:53:14.244969+0000","last_undegraded":"2024-05-20T17:53:14.244969+0000","last_fullsized":"2024-05-20T17:53:14.244969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598694+0000","last_change":"2024-05-20T17:53:11.615867+0000","last_active":"2024-05-20T17:53:12.598694+0000","last_peered":"2024-05-20T17:53:12.598694+0000","last_clean":"2024-05-20T17:53:12.598694+0000","last_became_active":"2024-05-20T17:53:11.615414+0000","last_became_peered":"2024-05-20T17:53:11.615414+0000","last_unstale":"2024-05-20T17:53:12.598694+0000","last_undegraded":"2024-05-20T17:53:12.598694+0000","last_fullsized":"2024-05-20T17:53:12.598694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:26.374404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598758+0000","last_change":"2024-05-20T17:53:06.566530+0000","last_active":"2024-05-20T17:53:12.598758+0000","last_peered":"2024-05-20T17:53:12.598758+0000","last_clean":"2024-05-20T17:53:12.598758+0000","last_became_active":"2024-05-20T17:53:06.566164+0000","last_became_peered":"2024-05-20T17:53:06.566164+0000","last_unstale":"2024-05-20T17:53:12.598758+0000","last_undegraded":"2024-05-20T17:53:12.598758+0000","last_fullsized":"2024-05-20T17:53:12.598758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:22:58.179989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598733+0000","last_change":"2024-05-20T17:53:07.566366+0000","last_active":"2024-05-20T17:53:12.598733+0000","last_peered":"2024-05-20T17:53:12.598733+0000","last_clean":"2024-05-20T17:53:12.598733+0000","last_became_active":"2024-05-20T17:53:07.564572+0000","last_became_peered":"2024-05-20T17:53:07.564572+0000","last_unstale":"2024-05-20T17:53:12.598733+0000","last_undegraded":"2024-05-20T17:53:12.598733+0000","last_fullsized":"2024-05-20T17:53:12.598733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:07.981032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599855+0000","last_change":"2024-05-20T17:53:11.611213+0000","last_active":"2024-05-20T17:53:12.599855+0000","last_peered":"2024-05-20T17:53:12.599855+0000","last_clean":"2024-05-20T17:53:12.599855+0000","last_became_active":"2024-05-20T17:53:11.610761+0000","last_became_peered":"2024-05-20T17:53:11.610761+0000","last_unstale":"2024-05-20T17:53:12.599855+0000","last_undegraded":"2024-05-20T17:53:12.599855+0000","last_fullsized":"2024-05-20T17:53:12.599855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:10.351145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243764+0000","last_change":"2024-05-20T17:53:07.571745+0000","last_active":"2024-05-20T17:53:14.243764+0000","last_peered":"2024-05-20T17:53:14.243764+0000","last_clean":"2024-05-20T17:53:14.243764+0000","last_became_active":"2024-05-20T17:53:07.571440+0000","last_became_peered":"2024-05-20T17:53:07.571440+0000","last_unstale":"2024-05-20T17:53:14.243764+0000","last_undegraded":"2024-05-20T17:53:14.243764+0000","last_fullsized":"2024-05-20T17:53:14.243764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:50.625084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598579+0000","last_change":"2024-05-20T17:53:07.578996+0000","last_active":"2024-05-20T17:53:12.598579+0000","last_peered":"2024-05-20T17:53:12.598579+0000","last_clean":"2024-05-20T17:53:12.598579+0000","last_became_active":"2024-05-20T17:53:07.578650+0000","last_became_peered":"2024-05-20T17:53:07.578650+0000","last_unstale":"2024-05-20T17:53:12.598579+0000","last_undegraded":"2024-05-20T17:53:12.598579+0000","last_fullsized":"2024-05-20T17:53:12.598579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:26.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244224+0000","last_change":"2024-05-20T17:53:07.585434+0000","last_active":"2024-05-20T17:53:14.244224+0000","last_peered":"2024-05-20T17:53:14.244224+0000","last_clean":"2024-05-20T17:53:14.244224+0000","last_became_active":"2024-05-20T17:53:07.584703+0000","last_became_peered":"2024-05-20T17:53:07.584703+0000","last_unstale":"2024-05-20T17:53:14.244224+0000","last_undegraded":"2024-05-20T17:53:14.244224+0000","last_fullsized":"2024-05-20T17:53:14.244224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:45.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244874+0000","last_change":"2024-05-20T17:53:07.587018+0000","last_active":"2024-05-20T17:53:14.244874+0000","last_peered":"2024-05-20T17:53:14.244874+0000","last_clean":"2024-05-20T17:53:14.244874+0000","last_became_active":"2024-05-20T17:53:07.586608+0000","last_became_peered":"2024-05-20T17:53:07.586608+0000","last_unstale":"2024-05-20T17:53:14.244874+0000","last_undegraded":"2024-05-20T17:53:14.244874+0000","last_fullsized":"2024-05-20T17:53:14.244874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599158+0000","last_change":"2024-05-20T17:53:07.588014+0000","last_active":"2024-05-20T17:53:12.599158+0000","last_peered":"2024-05-20T17:53:12.599158+0000","last_clean":"2024-05-20T17:53:12.599158+0000","last_became_active":"2024-05-20T17:53:07.587708+0000","last_became_peered":"2024-05-20T17:53:07.587708+0000","last_unstale":"2024-05-20T17:53:12.599158+0000","last_undegraded":"2024-05-20T17:53:12.599158+0000","last_fullsized":"2024-05-20T17:53:12.599158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244467+0000","last_change":"2024-05-20T17:53:07.588057+0000","last_active":"2024-05-20T17:53:14.244467+0000","last_peered":"2024-05-20T17:53:14.244467+0000","last_clean":"2024-05-20T17:53:14.244467+0000","last_became_active":"2024-05-20T17:53:07.587720+0000","last_became_peered":"2024-05-20T17:53:07.587720+0000","last_unstale":"2024-05-20T17:53:14.244467+0000","last_undegraded":"2024-05-20T17:53:14.244467+0000","last_fullsized":"2024-05-20T17:53:14.244467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244725+0000","last_change":"2024-05-20T17:53:07.572982+0000","last_active":"2024-05-20T17:53:14.244725+0000","last_peered":"2024-05-20T17:53:14.244725+0000","last_clean":"2024-05-20T17:53:14.244725+0000","last_became_active":"2024-05-20T17:53:07.572341+0000","last_became_peered":"2024-05-20T17:53:07.572341+0000","last_unstale":"2024-05-20T17:53:14.244725+0000","last_undegraded":"2024-05-20T17:53:14.244725+0000","last_fullsized":"2024-05-20T17:53:14.244725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599485+0000","last_change":"2024-05-20T17:53:07.586892+0000","last_active":"2024-05-20T17:53:12.599485+0000","last_peered":"2024-05-20T17:53:12.599485+0000","last_clean":"2024-05-20T17:53:12.599485+0000","last_became_active":"2024-05-20T17:53:07.586592+0000","last_became_peered":"2024-05-20T17:53:07.586592+0000","last_unstale":"2024-05-20T17:53:12.599485+0000","last_undegraded":"2024-05-20T17:53:12.599485+0000","last_fullsized":"2024-05-20T17:53:12.599485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243849+0000","last_change":"2024-05-20T17:53:07.585135+0000","last_active":"2024-05-20T17:53:14.243849+0000","last_peered":"2024-05-20T17:53:14.243849+0000","last_clean":"2024-05-20T17:53:14.243849+0000","last_became_active":"2024-05-20T17:53:07.584770+0000","last_became_peered":"2024-05-20T17:53:07.584770+0000","last_unstale":"2024-05-20T17:53:14.243849+0000","last_undegraded":"2024-05-20T17:53:14.243849+0000","last_fullsized":"2024-05-20T17:53:14.243849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598173+0000","last_change":"2024-05-20T17:53:07.587589+0000","last_active":"2024-05-20T17:53:12.598173+0000","last_peered":"2024-05-20T17:53:12.598173+0000","last_clean":"2024-05-20T17:53:12.598173+0000","last_became_active":"2024-05-20T17:53:07.587199+0000","last_became_peered":"2024-05-20T17:53:07.587199+0000","last_unstale":"2024-05-20T17:53:12.598173+0000","last_undegraded":"2024-05-20T17:53:12.598173+0000","last_fullsized":"2024-05-20T17:53:12.598173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244099+0000","last_change":"2024-05-20T17:53:07.564879+0000","last_active":"2024-05-20T17:53:14.244099+0000","last_peered":"2024-05-20T17:53:14.244099+0000","last_clean":"2024-05-20T17:53:14.244099+0000","last_became_active":"2024-05-20T17:53:07.564533+0000","last_became_peered":"2024-05-20T17:53:07.564533+0000","last_unstale":"2024-05-20T17:53:14.244099+0000","last_undegraded":"2024-05-20T17:53:14.244099+0000","last_fullsized":"2024-05-20T17:53:14.244099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:40.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244554+0000","last_change":"2024-05-20T17:53:07.573683+0000","last_active":"2024-05-20T17:53:14.244554+0000","last_peered":"2024-05-20T17:53:14.244554+0000","last_clean":"2024-05-20T17:53:14.244554+0000","last_became_active":"2024-05-20T17:53:07.571046+0000","last_became_peered":"2024-05-20T17:53:07.571046+0000","last_unstale":"2024-05-20T17:53:14.244554+0000","last_undegraded":"2024-05-20T17:53:14.244554+0000","last_fullsized":"2024-05-20T17:53:14.244554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244334+0000","last_change":"2024-05-20T17:53:07.574629+0000","last_active":"2024-05-20T17:53:14.244334+0000","last_peered":"2024-05-20T17:53:14.244334+0000","last_clean":"2024-05-20T17:53:14.244334+0000","last_became_active":"2024-05-20T17:53:07.574286+0000","last_became_peered":"2024-05-20T17:53:07.574286+0000","last_unstale":"2024-05-20T17:53:14.244334+0000","last_undegraded":"2024-05-20T17:53:14.244334+0000","last_fullsized":"2024-05-20T17:53:14.244334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654699+0000","last_change":"2024-05-20T17:53:07.575422+0000","last_active":"2024-05-20T17:53:13.654699+0000","last_peered":"2024-05-20T17:53:13.654699+0000","last_clean":"2024-05-20T17:53:13.654699+0000","last_became_active":"2024-05-20T17:53:07.575017+0000","last_became_peered":"2024-05-20T17:53:07.575017+0000","last_unstale":"2024-05-20T17:53:13.654699+0000","last_undegraded":"2024-05-20T17:53:13.654699+0000","last_fullsized":"2024-05-20T17:53:13.654699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:45.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599534+0000","last_change":"2024-05-20T17:53:07.568400+0000","last_active":"2024-05-20T17:53:12.599534+0000","last_peered":"2024-05-20T17:53:12.599534+0000","last_clean":"2024-05-20T17:53:12.599534+0000","last_became_active":"2024-05-20T17:53:07.568013+0000","last_became_peered":"2024-05-20T17:53:07.568013+0000","last_unstale":"2024-05-20T17:53:12.599534+0000","last_undegraded":"2024-05-20T17:53:12.599534+0000","last_fullsized":"2024-05-20T17:53:12.599534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:31.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245277+0000","last_change":"2024-05-20T17:53:07.564289+0000","last_active":"2024-05-20T17:53:14.245277+0000","last_peered":"2024-05-20T17:53:14.245277+0000","last_clean":"2024-05-20T17:53:14.245277+0000","last_became_active":"2024-05-20T17:53:07.563973+0000","last_became_peered":"2024-05-20T17:53:07.563973+0000","last_unstale":"2024-05-20T17:53:14.245277+0000","last_undegraded":"2024-05-20T17:53:14.245277+0000","last_fullsized":"2024-05-20T17:53:14.245277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243731+0000","last_change":"2024-05-20T17:53:07.560898+0000","last_active":"2024-05-20T17:53:14.243731+0000","last_peered":"2024-05-20T17:53:14.243731+0000","last_clean":"2024-05-20T17:53:14.243731+0000","last_became_active":"2024-05-20T17:53:07.560518+0000","last_became_peered":"2024-05-20T17:53:07.560518+0000","last_unstale":"2024-05-20T17:53:14.243731+0000","last_undegraded":"2024-05-20T17:53:14.243731+0000","last_fullsized":"2024-05-20T17:53:14.243731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243753+0000","last_change":"2024-05-20T17:53:07.569983+0000","last_active":"2024-05-20T17:53:14.243753+0000","last_peered":"2024-05-20T17:53:14.243753+0000","last_clean":"2024-05-20T17:53:14.243753+0000","last_became_active":"2024-05-20T17:53:07.569663+0000","last_became_peered":"2024-05-20T17:53:07.569663+0000","last_unstale":"2024-05-20T17:53:14.243753+0000","last_undegraded":"2024-05-20T17:53:14.243753+0000","last_fullsized":"2024-05-20T17:53:14.243753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244095+0000","last_change":"2024-05-20T17:53:07.566018+0000","last_active":"2024-05-20T17:53:14.244095+0000","last_peered":"2024-05-20T17:53:14.244095+0000","last_clean":"2024-05-20T17:53:14.244095+0000","last_became_active":"2024-05-20T17:53:07.565527+0000","last_became_peered":"2024-05-20T17:53:07.565527+0000","last_unstale":"2024-05-20T17:53:14.244095+0000","last_undegraded":"2024-05-20T17:53:14.244095+0000","last_fullsized":"2024-05-20T17:53:14.244095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:21:17.680092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598017+0000","last_change":"2024-05-20T17:53:07.585449+0000","last_active":"2024-05-20T17:53:12.598017+0000","last_peered":"2024-05-20T17:53:12.598017+0000","last_clean":"2024-05-20T17:53:12.598017+0000","last_became_active":"2024-05-20T17:53:07.585089+0000","last_became_peered":"2024-05-20T17:53:07.585089+0000","last_unstale":"2024-05-20T17:53:12.598017+0000","last_undegraded":"2024-05-20T17:53:12.598017+0000","last_fullsized":"2024-05-20T17:53:12.598017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598876+0000","last_change":"2024-05-20T17:53:07.567630+0000","last_active":"2024-05-20T17:53:12.598876+0000","last_peered":"2024-05-20T17:53:12.598876+0000","last_clean":"2024-05-20T17:53:12.598876+0000","last_became_active":"2024-05-20T17:53:07.565841+0000","last_became_peered":"2024-05-20T17:53:07.565841+0000","last_unstale":"2024-05-20T17:53:12.598876+0000","last_undegraded":"2024-05-20T17:53:12.598876+0000","last_fullsized":"2024-05-20T17:53:12.598876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:28.255939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244959+0000","last_change":"2024-05-20T17:53:07.577572+0000","last_active":"2024-05-20T17:53:14.244959+0000","last_peered":"2024-05-20T17:53:14.244959+0000","last_clean":"2024-05-20T17:53:14.244959+0000","last_became_active":"2024-05-20T17:53:07.577248+0000","last_became_peered":"2024-05-20T17:53:07.577248+0000","last_unstale":"2024-05-20T17:53:14.244959+0000","last_undegraded":"2024-05-20T17:53:14.244959+0000","last_fullsized":"2024-05-20T17:53:14.244959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244594+0000","last_change":"2024-05-20T17:53:07.580278+0000","last_active":"2024-05-20T17:53:14.244594+0000","last_peered":"2024-05-20T17:53:14.244594+0000","last_clean":"2024-05-20T17:53:14.244594+0000","last_became_active":"2024-05-20T17:53:07.579918+0000","last_became_peered":"2024-05-20T17:53:07.579918+0000","last_unstale":"2024-05-20T17:53:14.244594+0000","last_undegraded":"2024-05-20T17:53:14.244594+0000","last_fullsized":"2024-05-20T17:53:14.244594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654876+0000","last_change":"2024-05-20T17:53:07.571649+0000","last_active":"2024-05-20T17:53:13.654876+0000","last_peered":"2024-05-20T17:53:13.654876+0000","last_clean":"2024-05-20T17:53:13.654876+0000","last_became_active":"2024-05-20T17:53:07.570372+0000","last_became_peered":"2024-05-20T17:53:07.570372+0000","last_unstale":"2024-05-20T17:53:13.654876+0000","last_undegraded":"2024-05-20T17:53:13.654876+0000","last_fullsized":"2024-05-20T17:53:13.654876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597720+0000","last_change":"2024-05-20T17:53:07.584911+0000","last_active":"2024-05-20T17:53:12.597720+0000","last_peered":"2024-05-20T17:53:12.597720+0000","last_clean":"2024-05-20T17:53:12.597720+0000","last_became_active":"2024-05-20T17:53:07.584544+0000","last_became_peered":"2024-05-20T17:53:07.584544+0000","last_unstale":"2024-05-20T17:53:12.597720+0000","last_undegraded":"2024-05-20T17:53:12.597720+0000","last_fullsized":"2024-05-20T17:53:12.597720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654120+0000","last_change":"2024-05-20T17:53:07.580955+0000","last_active":"2024-05-20T17:53:13.654120+0000","last_peered":"2024-05-20T17:53:13.654120+0000","last_clean":"2024-05-20T17:53:13.654120+0000","last_became_active":"2024-05-20T17:53:07.580587+0000","last_became_peered":"2024-05-20T17:53:07.580587+0000","last_unstale":"2024-05-20T17:53:13.654120+0000","last_undegraded":"2024-05-20T17:53:13.654120+0000","last_fullsized":"2024-05-20T17:53:13.654120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:40.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243911+0000","last_change":"2024-05-20T17:53:07.570792+0000","last_active":"2024-05-20T17:53:14.243911+0000","last_peered":"2024-05-20T17:53:14.243911+0000","last_clean":"2024-05-20T17:53:14.243911+0000","last_became_active":"2024-05-20T17:53:07.570501+0000","last_became_peered":"2024-05-20T17:53:07.570501+0000","last_unstale":"2024-05-20T17:53:14.243911+0000","last_undegraded":"2024-05-20T17:53:14.243911+0000","last_fullsized":"2024-05-20T17:53:14.243911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654229+0000","last_change":"2024-05-20T17:53:07.573875+0000","last_active":"2024-05-20T17:53:13.654229+0000","last_peered":"2024-05-20T17:53:13.654229+0000","last_clean":"2024-05-20T17:53:13.654229+0000","last_became_active":"2024-05-20T17:53:07.573520+0000","last_became_peered":"2024-05-20T17:53:07.573520+0000","last_unstale":"2024-05-20T17:53:13.654229+0000","last_undegraded":"2024-05-20T17:53:13.654229+0000","last_fullsized":"2024-05-20T17:53:13.654229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:24.809917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244998+0000","last_change":"2024-05-20T17:53:07.588340+0000","last_active":"2024-05-20T17:53:14.244998+0000","last_peered":"2024-05-20T17:53:14.244998+0000","last_clean":"2024-05-20T17:53:14.244998+0000","last_became_active":"2024-05-20T17:53:07.588012+0000","last_became_peered":"2024-05-20T17:53:07.588012+0000","last_unstale":"2024-05-20T17:53:14.244998+0000","last_undegraded":"2024-05-20T17:53:14.244998+0000","last_fullsized":"2024-05-20T17:53:14.244998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:17.052738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244499+0000","last_change":"2024-05-20T17:53:07.570831+0000","last_active":"2024-05-20T17:53:14.244499+0000","last_peered":"2024-05-20T17:53:14.244499+0000","last_clean":"2024-05-20T17:53:14.244499+0000","last_became_active":"2024-05-20T17:53:07.570499+0000","last_became_peered":"2024-05-20T17:53:07.570499+0000","last_unstale":"2024-05-20T17:53:14.244499+0000","last_undegraded":"2024-05-20T17:53:14.244499+0000","last_fullsized":"2024-05-20T17:53:14.244499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:50.625084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245012+0000","last_change":"2024-05-20T17:53:07.580456+0000","last_active":"2024-05-20T17:53:14.245012+0000","last_peered":"2024-05-20T17:53:14.245012+0000","last_clean":"2024-05-20T17:53:14.245012+0000","last_became_active":"2024-05-20T17:53:07.580093+0000","last_became_peered":"2024-05-20T17:53:07.580093+0000","last_unstale":"2024-05-20T17:53:14.245012+0000","last_undegraded":"2024-05-20T17:53:14.245012+0000","last_fullsized":"2024-05-20T17:53:14.245012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654731+0000","last_change":"2024-05-20T17:53:07.571268+0000","last_active":"2024-05-20T17:53:13.654731+0000","last_peered":"2024-05-20T17:53:13.654731+0000","last_clean":"2024-05-20T17:53:13.654731+0000","last_became_active":"2024-05-20T17:53:07.570549+0000","last_became_peered":"2024-05-20T17:53:07.570549+0000","last_unstale":"2024-05-20T17:53:13.654731+0000","last_undegraded":"2024-05-20T17:53:13.654731+0000","last_fullsized":"2024-05-20T17:53:13.654731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:53:30.705 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:53:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.855+0000 7fc7e514c640 1 Processor -- start 2024-05-20T17:53:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.855+0000 7fc7e514c640 1 -- start start 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.856+0000 7fc7e514c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e00b6620 0x7fc7e00ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.856+0000 7fc7e514c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7e0162ce0 0x7fc7e00b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.856+0000 7fc7e514c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7e01634a0 con 0x7fc7e00b85b0 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.856+0000 7fc7e514c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e00d3480 con 0x7fc7e0162ce0 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.856+0000 7fc7e514c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e0163780 con 0x7fc7e00b6620 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7d7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7e0162ce0 0x7fc7e00b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7d7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7e0162ce0 0x7fc7e00b8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46118/0 (socket says 172.21.15.6:46118) 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7d7fff640 1 -- 172.21.15.6:0/1663100873 learned_addr learned my addr 172.21.15.6:0/1663100873 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7ded9d640 1 --2- 172.21.15.6:0/1663100873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e00b6620 0x7fc7e00ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7d7fff640 1 -- 172.21.15.6:0/1663100873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e00b6620 msgr2=0x7fc7e00ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7d7fff640 1 --2- 172.21.15.6:0/1663100873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e00b6620 0x7fc7e00ba3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7d7fff640 1 -- 172.21.15.6:0/1663100873 >> v1:172.21.15.171:6789/0 conn(0x7fc7e00b85b0 legacy=0x7fc7e00d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7d7fff640 1 -- 172.21.15.6:0/1663100873 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e0163a60 con 0x7fc7e0162ce0 2024-05-20T17:53:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.857+0000 7fc7ded9d640 1 --2- 172.21.15.6:0/1663100873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e00b6620 0x7fc7e00ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.858+0000 7fc7d7fff640 1 --2- 172.21.15.6:0/1663100873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0162ce0 0x7fc7e00b8070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009870 tx=0x7fc7c802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594bf861301112e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.858+0000 7fc7de59c640 1 -- 172.21.15.6:0/1663100873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8037070 con 0x7fc7e0162ce0 2024-05-20T17:53:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.858+0000 7fc7de59c640 1 -- 172.21.15.6:0/1663100873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c8032440 con 0x7fc7e0162ce0 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.858+0000 7fc7de59c640 1 -- 172.21.15.6:0/1663100873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8032810 con 0x7fc7e0162ce0 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.859+0000 7fc7e514c640 1 -- 172.21.15.6:0/1663100873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0162ce0 msgr2=0x7fc7e00b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.859+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1663100873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0162ce0 0x7fc7e00b8070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009870 tx=0x7fc7c802a210 comp rx=0 tx=0).stop 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.859+0000 7fc7e514c640 1 -- 172.21.15.6:0/1663100873 shutdown_connections 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.859+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1663100873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0162ce0 0x7fc7e00b8070 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.859+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1663100873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e00b6620 0x7fc7e00ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.859+0000 7fc7e514c640 1 -- 172.21.15.6:0/1663100873 >> 172.21.15.6:0/1663100873 conn(0x7fc7e006d240 msgr2=0x7fc7e006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.859+0000 7fc7e514c640 1 -- 172.21.15.6:0/1663100873 shutdown_connections 2024-05-20T17:53:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.859+0000 7fc7e514c640 1 -- 172.21.15.6:0/1663100873 wait complete. 2024-05-20T17:53:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.861+0000 7fc7e514c640 1 Processor -- start 2024-05-20T17:53:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.861+0000 7fc7e514c640 1 -- start start 2024-05-20T17:53:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7e514c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7e00b6620 0x7fc7e00abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7e514c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e00b85b0 0x7fc7e00aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7e514c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e0162ce0 0x7fc7e01516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7e514c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e01630f0 con 0x7fc7e00b85b0 2024-05-20T17:53:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7e514c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e00d4300 con 0x7fc7e00b6620 2024-05-20T17:53:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7e514c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e014eda0 con 0x7fc7e0162ce0 2024-05-20T17:53:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e00b85b0 0x7fc7e00aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e00b85b0 0x7fc7e00aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46128/0 (socket says 172.21.15.6:46128) 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7d7fff640 1 -- 172.21.15.6:0/1448150223 learned_addr learned my addr 172.21.15.6:0/1448150223 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7ded9d640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7e00b6620 0x7fc7e00abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.862+0000 7fc7df59e640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e0162ce0 0x7fc7e01516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d7fff640 1 -- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e0162ce0 msgr2=0x7fc7e01516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d7fff640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e0162ce0 0x7fc7e01516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d7fff640 1 -- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7e00b6620 msgr2=0x7fc7e00abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d7fff640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7e00b6620 0x7fc7e00abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d7fff640 1 -- 172.21.15.6:0/1448150223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e014eb90 con 0x7fc7e00b85b0 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d7fff640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e00b85b0 0x7fc7e00aeb20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80090b0 tx=0x7fc7c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d77fe640 1 -- 172.21.15.6:0/1448150223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8041020 con 0x7fc7e00b85b0 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d77fe640 1 -- 172.21.15.6:0/1448150223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c8030990 con 0x7fc7e00b85b0 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e00ac4a0 con 0x7fc7e00b85b0 2024-05-20T17:53:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7d77fe640 1 -- 172.21.15.6:0/1448150223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8037040 con 0x7fc7e00b85b0 2024-05-20T17:53:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.863+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e00aca60 con 0x7fc7e00b85b0 2024-05-20T17:53:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.864+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e0075b00 con 0x7fc7e00b85b0 2024-05-20T17:53:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.865+0000 7fc7d77fe640 1 -- 172.21.15.6:0/1448150223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7c8044020 con 0x7fc7e00b85b0 2024-05-20T17:53:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.865+0000 7fc7d77fe640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.865+0000 7fc7d77fe640 1 -- 172.21.15.6:0/1448150223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc7c80ab7b0 con 0x7fc7e00b85b0 2024-05-20T17:53:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.866+0000 7fc7ded9d640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.866+0000 7fc7ded9d640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000aac0 tx=0x7fc7d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:30.870+0000 7fc7d77fe640 1 -- 172.21.15.6:0/1448150223 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc7c804b070 con 0x7fc7e00b85b0 2024-05-20T17:53:31.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.049+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7e0151c30 con 0x7fc7c006be30 2024-05-20T17:53:31.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.058+0000 7fc7d77fe640 1 -- 172.21.15.6:0/1448150223 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fc7e0151c30 con 0x7fc7c006be30 2024-05-20T17:53:31.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:53:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 msgr2=0x7fc7c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000aac0 tx=0x7fc7d0008040 comp rx=0 tx=0).stop 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e00b85b0 msgr2=0x7fc7e00aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e00b85b0 0x7fc7e00aeb20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80090b0 tx=0x7fc7c80046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 shutdown_connections 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7c006be30 0x7fc7c006e340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7e0162ce0 0x7fc7e01516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e00b85b0 0x7fc7e00aeb20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 --2- 172.21.15.6:0/1448150223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7e00b6620 0x7fc7e00abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 >> 172.21.15.6:0/1448150223 conn(0x7fc7e006d240 msgr2=0x7fc7e00d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.061+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 shutdown_connections 2024-05-20T17:53:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.062+0000 7fc7e514c640 1 -- 172.21.15.6:0/1448150223 wait complete. 2024-05-20T17:53:31.072 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-05-20T17:53:30.236116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219360,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755360,"statfs":{"total":773094113280,"available":772869488640,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003432"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244003+0000","last_change":"2024-05-20T17:53:06.574155+0000","last_active":"2024-05-20T17:53:14.244003+0000","last_peered":"2024-05-20T17:53:14.244003+0000","last_clean":"2024-05-20T17:53:14.244003+0000","last_became_active":"2024-05-20T17:53:06.573561+0000","last_became_peered":"2024-05-20T17:53:06.573561+0000","last_unstale":"2024-05-20T17:53:14.244003+0000","last_undegraded":"2024-05-20T17:53:14.244003+0000","last_fullsized":"2024-05-20T17:53:14.244003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:22:58.179989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598752+0000","last_change":"2024-05-20T17:53:07.588500+0000","last_active":"2024-05-20T17:53:12.598752+0000","last_peered":"2024-05-20T17:53:12.598752+0000","last_clean":"2024-05-20T17:53:12.598752+0000","last_became_active":"2024-05-20T17:53:07.588137+0000","last_became_peered":"2024-05-20T17:53:07.588137+0000","last_unstale":"2024-05-20T17:53:12.598752+0000","last_undegraded":"2024-05-20T17:53:12.598752+0000","last_fullsized":"2024-05-20T17:53:12.598752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597759+0000","last_change":"2024-05-20T17:53:11.755635+0000","last_active":"2024-05-20T17:53:12.597759+0000","last_peered":"2024-05-20T17:53:12.597759+0000","last_clean":"2024-05-20T17:53:12.597759+0000","last_became_active":"2024-05-20T17:53:11.755186+0000","last_became_peered":"2024-05-20T17:53:11.755186+0000","last_unstale":"2024-05-20T17:53:12.597759+0000","last_undegraded":"2024-05-20T17:53:12.597759+0000","last_fullsized":"2024-05-20T17:53:12.597759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:41.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599124+0000","last_change":"2024-05-20T17:53:06.565749+0000","last_active":"2024-05-20T17:53:12.599124+0000","last_peered":"2024-05-20T17:53:12.599124+0000","last_clean":"2024-05-20T17:53:12.599124+0000","last_became_active":"2024-05-20T17:53:06.565249+0000","last_became_peered":"2024-05-20T17:53:06.565249+0000","last_unstale":"2024-05-20T17:53:12.599124+0000","last_undegraded":"2024-05-20T17:53:12.599124+0000","last_fullsized":"2024-05-20T17:53:12.599124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243589+0000","last_change":"2024-05-20T17:53:07.573440+0000","last_active":"2024-05-20T17:53:14.243589+0000","last_peered":"2024-05-20T17:53:14.243589+0000","last_clean":"2024-05-20T17:53:14.243589+0000","last_became_active":"2024-05-20T17:53:07.572075+0000","last_became_peered":"2024-05-20T17:53:07.572075+0000","last_unstale":"2024-05-20T17:53:14.243589+0000","last_undegraded":"2024-05-20T17:53:14.243589+0000","last_fullsized":"2024-05-20T17:53:14.243589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598429+0000","last_change":"2024-05-20T17:53:11.615875+0000","last_active":"2024-05-20T17:53:12.598429+0000","last_peered":"2024-05-20T17:53:12.598429+0000","last_clean":"2024-05-20T17:53:12.598429+0000","last_became_active":"2024-05-20T17:53:11.614378+0000","last_became_peered":"2024-05-20T17:53:11.614378+0000","last_unstale":"2024-05-20T17:53:12.598429+0000","last_undegraded":"2024-05-20T17:53:12.598429+0000","last_fullsized":"2024-05-20T17:53:12.598429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:44.041188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654652+0000","last_change":"2024-05-20T17:53:06.577931+0000","last_active":"2024-05-20T17:53:13.654652+0000","last_peered":"2024-05-20T17:53:13.654652+0000","last_clean":"2024-05-20T17:53:13.654652+0000","last_became_active":"2024-05-20T17:53:06.577611+0000","last_became_peered":"2024-05-20T17:53:06.577611+0000","last_unstale":"2024-05-20T17:53:13.654652+0000","last_undegraded":"2024-05-20T17:53:13.654652+0000","last_fullsized":"2024-05-20T17:53:13.654652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:30.496240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245106+0000","last_change":"2024-05-20T17:53:07.558806+0000","last_active":"2024-05-20T17:53:14.245106+0000","last_peered":"2024-05-20T17:53:14.245106+0000","last_clean":"2024-05-20T17:53:14.245106+0000","last_became_active":"2024-05-20T17:53:07.558446+0000","last_became_peered":"2024-05-20T17:53:07.558446+0000","last_unstale":"2024-05-20T17:53:14.245106+0000","last_undegraded":"2024-05-20T17:53:14.245106+0000","last_fullsized":"2024-05-20T17:53:14.245106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:14:58.555617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598909+0000","last_change":"2024-05-20T17:53:11.615219+0000","last_active":"2024-05-20T17:53:12.598909+0000","last_peered":"2024-05-20T17:53:12.598909+0000","last_clean":"2024-05-20T17:53:12.598909+0000","last_became_active":"2024-05-20T17:53:11.614707+0000","last_became_peered":"2024-05-20T17:53:11.614707+0000","last_unstale":"2024-05-20T17:53:12.598909+0000","last_undegraded":"2024-05-20T17:53:12.598909+0000","last_fullsized":"2024-05-20T17:53:12.598909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:43:01.628287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654386+0000","last_change":"2024-05-20T17:53:06.572513+0000","last_active":"2024-05-20T17:53:13.654386+0000","last_peered":"2024-05-20T17:53:13.654386+0000","last_clean":"2024-05-20T17:53:13.654386+0000","last_became_active":"2024-05-20T17:53:06.572112+0000","last_became_peered":"2024-05-20T17:53:06.572112+0000","last_unstale":"2024-05-20T17:53:13.654386+0000","last_undegraded":"2024-05-20T17:53:13.654386+0000","last_fullsized":"2024-05-20T17:53:13.654386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245406+0000","last_change":"2024-05-20T17:53:07.559015+0000","last_active":"2024-05-20T17:53:14.245406+0000","last_peered":"2024-05-20T17:53:14.245406+0000","last_clean":"2024-05-20T17:53:14.245406+0000","last_became_active":"2024-05-20T17:53:07.558369+0000","last_became_peered":"2024-05-20T17:53:07.558369+0000","last_unstale":"2024-05-20T17:53:14.245406+0000","last_undegraded":"2024-05-20T17:53:14.245406+0000","last_fullsized":"2024-05-20T17:53:14.245406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598644+0000","last_change":"2024-05-20T17:53:11.618079+0000","last_active":"2024-05-20T17:53:12.598644+0000","last_peered":"2024-05-20T17:53:12.598644+0000","last_clean":"2024-05-20T17:53:12.598644+0000","last_became_active":"2024-05-20T17:53:11.617572+0000","last_became_peered":"2024-05-20T17:53:11.617572+0000","last_unstale":"2024-05-20T17:53:12.598644+0000","last_undegraded":"2024-05-20T17:53:12.598644+0000","last_fullsized":"2024-05-20T17:53:12.598644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:23.513112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244311+0000","last_change":"2024-05-20T17:53:07.572220+0000","last_active":"2024-05-20T17:53:14.244311+0000","last_peered":"2024-05-20T17:53:14.244311+0000","last_clean":"2024-05-20T17:53:14.244311+0000","last_became_active":"2024-05-20T17:53:07.571759+0000","last_became_peered":"2024-05-20T17:53:07.571759+0000","last_unstale":"2024-05-20T17:53:14.244311+0000","last_undegraded":"2024-05-20T17:53:14.244311+0000","last_fullsized":"2024-05-20T17:53:14.244311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654495+0000","last_change":"2024-05-20T17:53:06.573537+0000","last_active":"2024-05-20T17:53:13.654495+0000","last_peered":"2024-05-20T17:53:13.654495+0000","last_clean":"2024-05-20T17:53:13.654495+0000","last_became_active":"2024-05-20T17:53:06.573236+0000","last_became_peered":"2024-05-20T17:53:06.573236+0000","last_unstale":"2024-05-20T17:53:13.654495+0000","last_undegraded":"2024-05-20T17:53:13.654495+0000","last_fullsized":"2024-05-20T17:53:13.654495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:00:16.154534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598961+0000","last_change":"2024-05-20T17:53:11.618293+0000","last_active":"2024-05-20T17:53:12.598961+0000","last_peered":"2024-05-20T17:53:12.598961+0000","last_clean":"2024-05-20T17:53:12.598961+0000","last_became_active":"2024-05-20T17:53:11.617707+0000","last_became_peered":"2024-05-20T17:53:11.617707+0000","last_unstale":"2024-05-20T17:53:12.598961+0000","last_undegraded":"2024-05-20T17:53:12.598961+0000","last_fullsized":"2024-05-20T17:53:12.598961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:24.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598222+0000","last_change":"2024-05-20T17:53:07.585094+0000","last_active":"2024-05-20T17:53:12.598222+0000","last_peered":"2024-05-20T17:53:12.598222+0000","last_clean":"2024-05-20T17:53:12.598222+0000","last_became_active":"2024-05-20T17:53:07.584666+0000","last_became_peered":"2024-05-20T17:53:07.584666+0000","last_unstale":"2024-05-20T17:53:12.598222+0000","last_undegraded":"2024-05-20T17:53:12.598222+0000","last_fullsized":"2024-05-20T17:53:12.598222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244302+0000","last_change":"2024-05-20T17:53:06.569733+0000","last_active":"2024-05-20T17:53:14.244302+0000","last_peered":"2024-05-20T17:53:14.244302+0000","last_clean":"2024-05-20T17:53:14.244302+0000","last_became_active":"2024-05-20T17:53:06.569177+0000","last_became_peered":"2024-05-20T17:53:06.569177+0000","last_unstale":"2024-05-20T17:53:14.244302+0000","last_undegraded":"2024-05-20T17:53:14.244302+0000","last_fullsized":"2024-05-20T17:53:14.244302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599068+0000","last_change":"2024-05-20T17:53:11.614905+0000","last_active":"2024-05-20T17:53:12.599068+0000","last_peered":"2024-05-20T17:53:12.599068+0000","last_clean":"2024-05-20T17:53:12.599068+0000","last_became_active":"2024-05-20T17:53:11.614264+0000","last_became_peered":"2024-05-20T17:53:11.614264+0000","last_unstale":"2024-05-20T17:53:12.599068+0000","last_undegraded":"2024-05-20T17:53:12.599068+0000","last_fullsized":"2024-05-20T17:53:12.599068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:44.269036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598007+0000","last_change":"2024-05-20T17:53:07.589843+0000","last_active":"2024-05-20T17:53:12.598007+0000","last_peered":"2024-05-20T17:53:12.598007+0000","last_clean":"2024-05-20T17:53:12.598007+0000","last_became_active":"2024-05-20T17:53:07.589565+0000","last_became_peered":"2024-05-20T17:53:07.589565+0000","last_unstale":"2024-05-20T17:53:12.598007+0000","last_undegraded":"2024-05-20T17:53:12.598007+0000","last_fullsized":"2024-05-20T17:53:12.598007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243854+0000","last_change":"2024-05-20T17:53:06.570609+0000","last_active":"2024-05-20T17:53:14.243854+0000","last_peered":"2024-05-20T17:53:14.243854+0000","last_clean":"2024-05-20T17:53:14.243854+0000","last_became_active":"2024-05-20T17:53:06.570253+0000","last_became_peered":"2024-05-20T17:53:06.570253+0000","last_unstale":"2024-05-20T17:53:14.243854+0000","last_undegraded":"2024-05-20T17:53:14.243854+0000","last_fullsized":"2024-05-20T17:53:14.243854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245197+0000","last_change":"2024-05-20T17:53:11.756398+0000","last_active":"2024-05-20T17:53:14.245197+0000","last_peered":"2024-05-20T17:53:14.245197+0000","last_clean":"2024-05-20T17:53:14.245197+0000","last_became_active":"2024-05-20T17:53:11.755995+0000","last_became_peered":"2024-05-20T17:53:11.755995+0000","last_unstale":"2024-05-20T17:53:14.245197+0000","last_undegraded":"2024-05-20T17:53:14.245197+0000","last_fullsized":"2024-05-20T17:53:14.245197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:50.812964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599504+0000","last_change":"2024-05-20T17:53:07.569595+0000","last_active":"2024-05-20T17:53:12.599504+0000","last_peered":"2024-05-20T17:53:12.599504+0000","last_clean":"2024-05-20T17:53:12.599504+0000","last_became_active":"2024-05-20T17:53:07.569291+0000","last_became_peered":"2024-05-20T17:53:07.569291+0000","last_unstale":"2024-05-20T17:53:12.599504+0000","last_undegraded":"2024-05-20T17:53:12.599504+0000","last_fullsized":"2024-05-20T17:53:12.599504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:32.671797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654037+0000","last_change":"2024-05-20T17:53:06.576258+0000","last_active":"2024-05-20T17:53:13.654037+0000","last_peered":"2024-05-20T17:53:13.654037+0000","last_clean":"2024-05-20T17:53:13.654037+0000","last_became_active":"2024-05-20T17:53:06.575933+0000","last_became_peered":"2024-05-20T17:53:06.575933+0000","last_unstale":"2024-05-20T17:53:13.654037+0000","last_undegraded":"2024-05-20T17:53:13.654037+0000","last_fullsized":"2024-05-20T17:53:13.654037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599393+0000","last_change":"2024-05-20T17:53:11.615738+0000","last_active":"2024-05-20T17:53:12.599393+0000","last_peered":"2024-05-20T17:53:12.599393+0000","last_clean":"2024-05-20T17:53:12.599393+0000","last_became_active":"2024-05-20T17:53:11.614228+0000","last_became_peered":"2024-05-20T17:53:11.614228+0000","last_unstale":"2024-05-20T17:53:12.599393+0000","last_undegraded":"2024-05-20T17:53:12.599393+0000","last_fullsized":"2024-05-20T17:53:12.599393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:02.595103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244147+0000","last_change":"2024-05-20T17:53:07.569138+0000","last_active":"2024-05-20T17:53:14.244147+0000","last_peered":"2024-05-20T17:53:14.244147+0000","last_clean":"2024-05-20T17:53:14.244147+0000","last_became_active":"2024-05-20T17:53:07.568036+0000","last_became_peered":"2024-05-20T17:53:07.568036+0000","last_unstale":"2024-05-20T17:53:14.244147+0000","last_undegraded":"2024-05-20T17:53:14.244147+0000","last_fullsized":"2024-05-20T17:53:14.244147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245354+0000","last_change":"2024-05-20T17:53:06.575386+0000","last_active":"2024-05-20T17:53:14.245354+0000","last_peered":"2024-05-20T17:53:14.245354+0000","last_clean":"2024-05-20T17:53:14.245354+0000","last_became_active":"2024-05-20T17:53:06.574851+0000","last_became_peered":"2024-05-20T17:53:06.574851+0000","last_unstale":"2024-05-20T17:53:14.245354+0000","last_undegraded":"2024-05-20T17:53:14.245354+0000","last_fullsized":"2024-05-20T17:53:14.245354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598416+0000","last_change":"2024-05-20T17:53:11.751984+0000","last_active":"2024-05-20T17:53:12.598416+0000","last_peered":"2024-05-20T17:53:12.598416+0000","last_clean":"2024-05-20T17:53:12.598416+0000","last_became_active":"2024-05-20T17:53:11.751452+0000","last_became_peered":"2024-05-20T17:53:11.751452+0000","last_unstale":"2024-05-20T17:53:12.598416+0000","last_undegraded":"2024-05-20T17:53:12.598416+0000","last_fullsized":"2024-05-20T17:53:12.598416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:44.794916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599614+0000","last_change":"2024-05-20T17:53:07.586262+0000","last_active":"2024-05-20T17:53:12.599614+0000","last_peered":"2024-05-20T17:53:12.599614+0000","last_clean":"2024-05-20T17:53:12.599614+0000","last_became_active":"2024-05-20T17:53:07.584798+0000","last_became_peered":"2024-05-20T17:53:07.584798+0000","last_unstale":"2024-05-20T17:53:12.599614+0000","last_undegraded":"2024-05-20T17:53:12.599614+0000","last_fullsized":"2024-05-20T17:53:12.599614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245096+0000","last_change":"2024-05-20T17:53:06.572334+0000","last_active":"2024-05-20T17:53:14.245096+0000","last_peered":"2024-05-20T17:53:14.245096+0000","last_clean":"2024-05-20T17:53:14.245096+0000","last_became_active":"2024-05-20T17:53:06.571243+0000","last_became_peered":"2024-05-20T17:53:06.571243+0000","last_unstale":"2024-05-20T17:53:14.245096+0000","last_undegraded":"2024-05-20T17:53:14.245096+0000","last_fullsized":"2024-05-20T17:53:14.245096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:00:16.154534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597655+0000","last_change":"2024-05-20T17:53:11.751914+0000","last_active":"2024-05-20T17:53:12.597655+0000","last_peered":"2024-05-20T17:53:12.597655+0000","last_clean":"2024-05-20T17:53:12.597655+0000","last_became_active":"2024-05-20T17:53:11.751472+0000","last_became_peered":"2024-05-20T17:53:11.751472+0000","last_unstale":"2024-05-20T17:53:12.597655+0000","last_undegraded":"2024-05-20T17:53:12.597655+0000","last_fullsized":"2024-05-20T17:53:12.597655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:52.250807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244812+0000","last_change":"2024-05-20T17:53:07.569467+0000","last_active":"2024-05-20T17:53:14.244812+0000","last_peered":"2024-05-20T17:53:14.244812+0000","last_clean":"2024-05-20T17:53:14.244812+0000","last_became_active":"2024-05-20T17:53:07.569123+0000","last_became_peered":"2024-05-20T17:53:07.569123+0000","last_unstale":"2024-05-20T17:53:14.244812+0000","last_undegraded":"2024-05-20T17:53:14.244812+0000","last_fullsized":"2024-05-20T17:53:14.244812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654806+0000","last_change":"2024-05-20T17:53:06.577309+0000","last_active":"2024-05-20T17:53:13.654806+0000","last_peered":"2024-05-20T17:53:13.654806+0000","last_clean":"2024-05-20T17:53:13.654806+0000","last_became_active":"2024-05-20T17:53:06.576898+0000","last_became_peered":"2024-05-20T17:53:06.576898+0000","last_unstale":"2024-05-20T17:53:13.654806+0000","last_undegraded":"2024-05-20T17:53:13.654806+0000","last_fullsized":"2024-05-20T17:53:13.654806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:25.034377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244489+0000","last_change":"2024-05-20T17:53:11.751909+0000","last_active":"2024-05-20T17:53:14.244489+0000","last_peered":"2024-05-20T17:53:14.244489+0000","last_clean":"2024-05-20T17:53:14.244489+0000","last_became_active":"2024-05-20T17:53:11.751479+0000","last_became_peered":"2024-05-20T17:53:11.751479+0000","last_unstale":"2024-05-20T17:53:14.244489+0000","last_undegraded":"2024-05-20T17:53:14.244489+0000","last_fullsized":"2024-05-20T17:53:14.244489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:55.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245485+0000","last_change":"2024-05-20T17:53:07.585138+0000","last_active":"2024-05-20T17:53:14.245485+0000","last_peered":"2024-05-20T17:53:14.245485+0000","last_clean":"2024-05-20T17:53:14.245485+0000","last_became_active":"2024-05-20T17:53:07.584803+0000","last_became_peered":"2024-05-20T17:53:07.584803+0000","last_unstale":"2024-05-20T17:53:14.245485+0000","last_undegraded":"2024-05-20T17:53:14.245485+0000","last_fullsized":"2024-05-20T17:53:14.245485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244812+0000","last_change":"2024-05-20T17:53:06.567245+0000","last_active":"2024-05-20T17:53:14.244812+0000","last_peered":"2024-05-20T17:53:14.244812+0000","last_clean":"2024-05-20T17:53:14.244812+0000","last_became_active":"2024-05-20T17:53:06.566920+0000","last_became_peered":"2024-05-20T17:53:06.566920+0000","last_unstale":"2024-05-20T17:53:14.244812+0000","last_undegraded":"2024-05-20T17:53:14.244812+0000","last_fullsized":"2024-05-20T17:53:14.244812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243827+0000","last_change":"2024-05-20T17:53:11.623254+0000","last_active":"2024-05-20T17:53:14.243827+0000","last_peered":"2024-05-20T17:53:14.243827+0000","last_clean":"2024-05-20T17:53:14.243827+0000","last_became_active":"2024-05-20T17:53:11.621995+0000","last_became_peered":"2024-05-20T17:53:11.621995+0000","last_unstale":"2024-05-20T17:53:14.243827+0000","last_undegraded":"2024-05-20T17:53:14.243827+0000","last_fullsized":"2024-05-20T17:53:14.243827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:49.533751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599455+0000","last_change":"2024-05-20T17:53:07.568413+0000","last_active":"2024-05-20T17:53:12.599455+0000","last_peered":"2024-05-20T17:53:12.599455+0000","last_clean":"2024-05-20T17:53:12.599455+0000","last_became_active":"2024-05-20T17:53:07.567292+0000","last_became_peered":"2024-05-20T17:53:07.567292+0000","last_unstale":"2024-05-20T17:53:12.599455+0000","last_undegraded":"2024-05-20T17:53:12.599455+0000","last_fullsized":"2024-05-20T17:53:12.599455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:26.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244479+0000","last_change":"2024-05-20T17:53:06.567819+0000","last_active":"2024-05-20T17:53:14.244479+0000","last_peered":"2024-05-20T17:53:14.244479+0000","last_clean":"2024-05-20T17:53:14.244479+0000","last_became_active":"2024-05-20T17:53:06.567485+0000","last_became_peered":"2024-05-20T17:53:06.567485+0000","last_unstale":"2024-05-20T17:53:14.244479+0000","last_undegraded":"2024-05-20T17:53:14.244479+0000","last_fullsized":"2024-05-20T17:53:14.244479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244638+0000","last_change":"2024-05-20T17:53:11.621878+0000","last_active":"2024-05-20T17:53:14.244638+0000","last_peered":"2024-05-20T17:53:14.244638+0000","last_clean":"2024-05-20T17:53:14.244638+0000","last_became_active":"2024-05-20T17:53:11.621430+0000","last_became_peered":"2024-05-20T17:53:11.621430+0000","last_unstale":"2024-05-20T17:53:14.244638+0000","last_undegraded":"2024-05-20T17:53:14.244638+0000","last_fullsized":"2024-05-20T17:53:14.244638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:55.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243483+0000","last_change":"2024-05-20T17:53:07.569646+0000","last_active":"2024-05-20T17:53:14.243483+0000","last_peered":"2024-05-20T17:53:14.243483+0000","last_clean":"2024-05-20T17:53:14.243483+0000","last_became_active":"2024-05-20T17:53:07.569255+0000","last_became_peered":"2024-05-20T17:53:07.569255+0000","last_unstale":"2024-05-20T17:53:14.243483+0000","last_undegraded":"2024-05-20T17:53:14.243483+0000","last_fullsized":"2024-05-20T17:53:14.243483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598624+0000","last_change":"2024-05-20T17:53:06.568915+0000","last_active":"2024-05-20T17:53:12.598624+0000","last_peered":"2024-05-20T17:53:12.598624+0000","last_clean":"2024-05-20T17:53:12.598624+0000","last_became_active":"2024-05-20T17:53:06.568597+0000","last_became_peered":"2024-05-20T17:53:06.568597+0000","last_unstale":"2024-05-20T17:53:12.598624+0000","last_undegraded":"2024-05-20T17:53:12.598624+0000","last_fullsized":"2024-05-20T17:53:12.598624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245241+0000","last_change":"2024-05-20T17:53:11.622481+0000","last_active":"2024-05-20T17:53:14.245241+0000","last_peered":"2024-05-20T17:53:14.245241+0000","last_clean":"2024-05-20T17:53:14.245241+0000","last_became_active":"2024-05-20T17:53:11.622026+0000","last_became_peered":"2024-05-20T17:53:11.622026+0000","last_unstale":"2024-05-20T17:53:14.245241+0000","last_undegraded":"2024-05-20T17:53:14.245241+0000","last_fullsized":"2024-05-20T17:53:14.245241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:15.654843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243451+0000","last_change":"2024-05-20T17:53:07.563580+0000","last_active":"2024-05-20T17:53:14.243451+0000","last_peered":"2024-05-20T17:53:14.243451+0000","last_clean":"2024-05-20T17:53:14.243451+0000","last_became_active":"2024-05-20T17:53:07.563226+0000","last_became_peered":"2024-05-20T17:53:07.563226+0000","last_unstale":"2024-05-20T17:53:14.243451+0000","last_undegraded":"2024-05-20T17:53:14.243451+0000","last_fullsized":"2024-05-20T17:53:14.243451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:22.334918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654094+0000","last_change":"2024-05-20T17:53:06.570658+0000","last_active":"2024-05-20T17:53:13.654094+0000","last_peered":"2024-05-20T17:53:13.654094+0000","last_clean":"2024-05-20T17:53:13.654094+0000","last_became_active":"2024-05-20T17:53:06.569975+0000","last_became_peered":"2024-05-20T17:53:06.569975+0000","last_unstale":"2024-05-20T17:53:13.654094+0000","last_undegraded":"2024-05-20T17:53:13.654094+0000","last_fullsized":"2024-05-20T17:53:13.654094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244022+0000","last_change":"2024-05-20T17:53:11.752185+0000","last_active":"2024-05-20T17:53:14.244022+0000","last_peered":"2024-05-20T17:53:14.244022+0000","last_clean":"2024-05-20T17:53:14.244022+0000","last_became_active":"2024-05-20T17:53:11.751761+0000","last_became_peered":"2024-05-20T17:53:11.751761+0000","last_unstale":"2024-05-20T17:53:14.244022+0000","last_undegraded":"2024-05-20T17:53:14.244022+0000","last_fullsized":"2024-05-20T17:53:14.244022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:28.849402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597975+0000","last_change":"2024-05-20T17:53:07.585881+0000","last_active":"2024-05-20T17:53:12.597975+0000","last_peered":"2024-05-20T17:53:12.597975+0000","last_clean":"2024-05-20T17:53:12.597975+0000","last_became_active":"2024-05-20T17:53:07.584882+0000","last_became_peered":"2024-05-20T17:53:07.584882+0000","last_unstale":"2024-05-20T17:53:12.597975+0000","last_undegraded":"2024-05-20T17:53:12.597975+0000","last_fullsized":"2024-05-20T17:53:12.597975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244548+0000","last_change":"2024-05-20T17:53:06.568683+0000","last_active":"2024-05-20T17:53:14.244548+0000","last_peered":"2024-05-20T17:53:14.244548+0000","last_clean":"2024-05-20T17:53:14.244548+0000","last_became_active":"2024-05-20T17:53:06.568335+0000","last_became_peered":"2024-05-20T17:53:06.568335+0000","last_unstale":"2024-05-20T17:53:14.244548+0000","last_undegraded":"2024-05-20T17:53:14.244548+0000","last_fullsized":"2024-05-20T17:53:14.244548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654203+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:53:13.654203+0000","last_peered":"2024-05-20T17:53:13.654203+0000","last_clean":"2024-05-20T17:53:13.654203+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:53:13.654203+0000","last_undegraded":"2024-05-20T17:53:13.654203+0000","last_fullsized":"2024-05-20T17:53:13.654203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244914+0000","last_change":"2024-05-20T17:53:11.755628+0000","last_active":"2024-05-20T17:53:14.244914+0000","last_peered":"2024-05-20T17:53:14.244914+0000","last_clean":"2024-05-20T17:53:14.244914+0000","last_became_active":"2024-05-20T17:53:11.755136+0000","last_became_peered":"2024-05-20T17:53:11.755136+0000","last_unstale":"2024-05-20T17:53:14.244914+0000","last_undegraded":"2024-05-20T17:53:14.244914+0000","last_fullsized":"2024-05-20T17:53:14.244914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:21.092223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654502+0000","last_change":"2024-05-20T17:53:07.570752+0000","last_active":"2024-05-20T17:53:13.654502+0000","last_peered":"2024-05-20T17:53:13.654502+0000","last_clean":"2024-05-20T17:53:13.654502+0000","last_became_active":"2024-05-20T17:53:07.570340+0000","last_became_peered":"2024-05-20T17:53:07.570340+0000","last_unstale":"2024-05-20T17:53:13.654502+0000","last_undegraded":"2024-05-20T17:53:13.654502+0000","last_fullsized":"2024-05-20T17:53:13.654502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599144+0000","last_change":"2024-05-20T17:53:06.574013+0000","last_active":"2024-05-20T17:53:12.599144+0000","last_peered":"2024-05-20T17:53:12.599144+0000","last_clean":"2024-05-20T17:53:12.599144+0000","last_became_active":"2024-05-20T17:53:06.573642+0000","last_became_peered":"2024-05-20T17:53:06.573642+0000","last_unstale":"2024-05-20T17:53:12.599144+0000","last_undegraded":"2024-05-20T17:53:12.599144+0000","last_fullsized":"2024-05-20T17:53:12.599144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244226+0000","last_change":"2024-05-20T17:53:11.753062+0000","last_active":"2024-05-20T17:53:14.244226+0000","last_peered":"2024-05-20T17:53:14.244226+0000","last_clean":"2024-05-20T17:53:14.244226+0000","last_became_active":"2024-05-20T17:53:11.751556+0000","last_became_peered":"2024-05-20T17:53:11.751556+0000","last_unstale":"2024-05-20T17:53:14.244226+0000","last_undegraded":"2024-05-20T17:53:14.244226+0000","last_fullsized":"2024-05-20T17:53:14.244226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:24.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245151+0000","last_change":"2024-05-20T17:53:07.588441+0000","last_active":"2024-05-20T17:53:14.245151+0000","last_peered":"2024-05-20T17:53:14.245151+0000","last_clean":"2024-05-20T17:53:14.245151+0000","last_became_active":"2024-05-20T17:53:07.588133+0000","last_became_peered":"2024-05-20T17:53:07.588133+0000","last_unstale":"2024-05-20T17:53:14.245151+0000","last_undegraded":"2024-05-20T17:53:14.245151+0000","last_fullsized":"2024-05-20T17:53:14.245151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:24.809917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244797+0000","last_change":"2024-05-20T17:53:06.573392+0000","last_active":"2024-05-20T17:53:14.244797+0000","last_peered":"2024-05-20T17:53:14.244797+0000","last_clean":"2024-05-20T17:53:14.244797+0000","last_became_active":"2024-05-20T17:53:06.573074+0000","last_became_peered":"2024-05-20T17:53:06.573074+0000","last_unstale":"2024-05-20T17:53:14.244797+0000","last_undegraded":"2024-05-20T17:53:14.244797+0000","last_fullsized":"2024-05-20T17:53:14.244797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:25.034377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244807+0000","last_change":"2024-05-20T17:53:11.616708+0000","last_active":"2024-05-20T17:53:14.244807+0000","last_peered":"2024-05-20T17:53:14.244807+0000","last_clean":"2024-05-20T17:53:14.244807+0000","last_became_active":"2024-05-20T17:53:11.616224+0000","last_became_peered":"2024-05-20T17:53:11.616224+0000","last_unstale":"2024-05-20T17:53:14.244807+0000","last_undegraded":"2024-05-20T17:53:14.244807+0000","last_fullsized":"2024-05-20T17:53:14.244807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:50.812964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654899+0000","last_change":"2024-05-20T17:53:07.572037+0000","last_active":"2024-05-20T17:53:13.654899+0000","last_peered":"2024-05-20T17:53:13.654899+0000","last_clean":"2024-05-20T17:53:13.654899+0000","last_became_active":"2024-05-20T17:53:07.571604+0000","last_became_peered":"2024-05-20T17:53:07.571604+0000","last_unstale":"2024-05-20T17:53:13.654899+0000","last_undegraded":"2024-05-20T17:53:13.654899+0000","last_fullsized":"2024-05-20T17:53:13.654899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:14:58.555617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599665+0000","last_change":"2024-05-20T17:53:06.569716+0000","last_active":"2024-05-20T17:53:12.599665+0000","last_peered":"2024-05-20T17:53:12.599665+0000","last_clean":"2024-05-20T17:53:12.599665+0000","last_became_active":"2024-05-20T17:53:06.569388+0000","last_became_peered":"2024-05-20T17:53:06.569388+0000","last_unstale":"2024-05-20T17:53:12.599665+0000","last_undegraded":"2024-05-20T17:53:12.599665+0000","last_fullsized":"2024-05-20T17:53:12.599665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243806+0000","last_change":"2024-05-20T17:53:11.755708+0000","last_active":"2024-05-20T17:53:14.243806+0000","last_peered":"2024-05-20T17:53:14.243806+0000","last_clean":"2024-05-20T17:53:14.243806+0000","last_became_active":"2024-05-20T17:53:11.755172+0000","last_became_peered":"2024-05-20T17:53:11.755172+0000","last_unstale":"2024-05-20T17:53:14.243806+0000","last_undegraded":"2024-05-20T17:53:14.243806+0000","last_fullsized":"2024-05-20T17:53:14.243806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:52.250807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654824+0000","last_change":"2024-05-20T17:53:07.572990+0000","last_active":"2024-05-20T17:53:13.654824+0000","last_peered":"2024-05-20T17:53:13.654824+0000","last_clean":"2024-05-20T17:53:13.654824+0000","last_became_active":"2024-05-20T17:53:07.572659+0000","last_became_peered":"2024-05-20T17:53:07.572659+0000","last_unstale":"2024-05-20T17:53:13.654824+0000","last_undegraded":"2024-05-20T17:53:13.654824+0000","last_fullsized":"2024-05-20T17:53:13.654824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599512+0000","last_change":"2024-05-20T17:53:06.566523+0000","last_active":"2024-05-20T17:53:12.599512+0000","last_peered":"2024-05-20T17:53:12.599512+0000","last_clean":"2024-05-20T17:53:12.599512+0000","last_became_active":"2024-05-20T17:53:06.566228+0000","last_became_peered":"2024-05-20T17:53:06.566228+0000","last_unstale":"2024-05-20T17:53:12.599512+0000","last_undegraded":"2024-05-20T17:53:12.599512+0000","last_fullsized":"2024-05-20T17:53:12.599512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:53:10.800947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598417+0000","last_change":"2024-05-20T17:53:11.616204+0000","last_active":"2024-05-20T17:53:12.598417+0000","last_peered":"2024-05-20T17:53:12.598417+0000","last_clean":"2024-05-20T17:53:12.598417+0000","last_became_active":"2024-05-20T17:53:11.614496+0000","last_became_peered":"2024-05-20T17:53:11.614496+0000","last_unstale":"2024-05-20T17:53:12.598417+0000","last_undegraded":"2024-05-20T17:53:12.598417+0000","last_fullsized":"2024-05-20T17:53:12.598417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:35.749353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654214+0000","last_change":"2024-05-20T17:53:07.571233+0000","last_active":"2024-05-20T17:53:13.654214+0000","last_peered":"2024-05-20T17:53:13.654214+0000","last_clean":"2024-05-20T17:53:13.654214+0000","last_became_active":"2024-05-20T17:53:07.570934+0000","last_became_peered":"2024-05-20T17:53:07.570934+0000","last_unstale":"2024-05-20T17:53:13.654214+0000","last_undegraded":"2024-05-20T17:53:13.654214+0000","last_fullsized":"2024-05-20T17:53:13.654214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:17.052738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598410+0000","last_change":"2024-05-20T17:53:06.567186+0000","last_active":"2024-05-20T17:53:12.598410+0000","last_peered":"2024-05-20T17:53:12.598410+0000","last_clean":"2024-05-20T17:53:12.598410+0000","last_became_active":"2024-05-20T17:53:06.566859+0000","last_became_peered":"2024-05-20T17:53:06.566859+0000","last_unstale":"2024-05-20T17:53:12.598410+0000","last_undegraded":"2024-05-20T17:53:12.598410+0000","last_fullsized":"2024-05-20T17:53:12.598410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243852+0000","last_change":"2024-05-20T17:53:11.621010+0000","last_active":"2024-05-20T17:53:14.243852+0000","last_peered":"2024-05-20T17:53:14.243852+0000","last_clean":"2024-05-20T17:53:14.243852+0000","last_became_active":"2024-05-20T17:53:11.620499+0000","last_became_peered":"2024-05-20T17:53:11.620499+0000","last_unstale":"2024-05-20T17:53:14.243852+0000","last_undegraded":"2024-05-20T17:53:14.243852+0000","last_fullsized":"2024-05-20T17:53:14.243852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:49.533751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243897+0000","last_change":"2024-05-20T17:53:07.570895+0000","last_active":"2024-05-20T17:53:14.243897+0000","last_peered":"2024-05-20T17:53:14.243897+0000","last_clean":"2024-05-20T17:53:14.243897+0000","last_became_active":"2024-05-20T17:53:07.570591+0000","last_became_peered":"2024-05-20T17:53:07.570591+0000","last_unstale":"2024-05-20T17:53:14.243897+0000","last_undegraded":"2024-05-20T17:53:14.243897+0000","last_fullsized":"2024-05-20T17:53:14.243897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244112+0000","last_change":"2024-05-20T17:53:06.571154+0000","last_active":"2024-05-20T17:53:14.244112+0000","last_peered":"2024-05-20T17:53:14.244112+0000","last_clean":"2024-05-20T17:53:14.244112+0000","last_became_active":"2024-05-20T17:53:06.570383+0000","last_became_peered":"2024-05-20T17:53:06.570383+0000","last_unstale":"2024-05-20T17:53:14.244112+0000","last_undegraded":"2024-05-20T17:53:14.244112+0000","last_fullsized":"2024-05-20T17:53:14.244112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599410+0000","last_change":"2024-05-20T17:53:11.755366+0000","last_active":"2024-05-20T17:53:12.599410+0000","last_peered":"2024-05-20T17:53:12.599410+0000","last_clean":"2024-05-20T17:53:12.599410+0000","last_became_active":"2024-05-20T17:53:11.754922+0000","last_became_peered":"2024-05-20T17:53:11.754922+0000","last_unstale":"2024-05-20T17:53:12.599410+0000","last_undegraded":"2024-05-20T17:53:12.599410+0000","last_fullsized":"2024-05-20T17:53:12.599410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:54:01.281535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654387+0000","last_change":"2024-05-20T17:53:07.571300+0000","last_active":"2024-05-20T17:53:13.654387+0000","last_peered":"2024-05-20T17:53:13.654387+0000","last_clean":"2024-05-20T17:53:13.654387+0000","last_became_active":"2024-05-20T17:53:07.570991+0000","last_became_peered":"2024-05-20T17:53:07.570991+0000","last_unstale":"2024-05-20T17:53:13.654387+0000","last_undegraded":"2024-05-20T17:53:13.654387+0000","last_fullsized":"2024-05-20T17:53:13.654387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:51.199335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244361+0000","last_change":"2024-05-20T17:53:06.576427+0000","last_active":"2024-05-20T17:53:14.244361+0000","last_peered":"2024-05-20T17:53:14.244361+0000","last_clean":"2024-05-20T17:53:14.244361+0000","last_became_active":"2024-05-20T17:53:06.576041+0000","last_became_peered":"2024-05-20T17:53:06.576041+0000","last_unstale":"2024-05-20T17:53:14.244361+0000","last_undegraded":"2024-05-20T17:53:14.244361+0000","last_fullsized":"2024-05-20T17:53:14.244361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599381+0000","last_change":"2024-05-20T17:53:11.752114+0000","last_active":"2024-05-20T17:53:12.599381+0000","last_peered":"2024-05-20T17:53:12.599381+0000","last_clean":"2024-05-20T17:53:12.599381+0000","last_became_active":"2024-05-20T17:53:11.751659+0000","last_became_peered":"2024-05-20T17:53:11.751659+0000","last_unstale":"2024-05-20T17:53:12.599381+0000","last_undegraded":"2024-05-20T17:53:12.599381+0000","last_fullsized":"2024-05-20T17:53:12.599381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:33:17.210775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244151+0000","last_change":"2024-05-20T17:53:07.570656+0000","last_active":"2024-05-20T17:53:14.244151+0000","last_peered":"2024-05-20T17:53:14.244151+0000","last_clean":"2024-05-20T17:53:14.244151+0000","last_became_active":"2024-05-20T17:53:07.570296+0000","last_became_peered":"2024-05-20T17:53:07.570296+0000","last_unstale":"2024-05-20T17:53:14.244151+0000","last_undegraded":"2024-05-20T17:53:14.244151+0000","last_fullsized":"2024-05-20T17:53:14.244151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:12:35.547087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244993+0000","last_change":"2024-05-20T17:53:06.567626+0000","last_active":"2024-05-20T17:53:14.244993+0000","last_peered":"2024-05-20T17:53:14.244993+0000","last_clean":"2024-05-20T17:53:14.244993+0000","last_became_active":"2024-05-20T17:53:06.565665+0000","last_became_peered":"2024-05-20T17:53:06.565665+0000","last_unstale":"2024-05-20T17:53:14.244993+0000","last_undegraded":"2024-05-20T17:53:14.244993+0000","last_fullsized":"2024-05-20T17:53:14.244993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:13.293451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245434+0000","last_change":"2024-05-20T17:53:11.752662+0000","last_active":"2024-05-20T17:53:14.245434+0000","last_peered":"2024-05-20T17:53:14.245434+0000","last_clean":"2024-05-20T17:53:14.245434+0000","last_became_active":"2024-05-20T17:53:11.752188+0000","last_became_peered":"2024-05-20T17:53:11.752188+0000","last_unstale":"2024-05-20T17:53:14.245434+0000","last_undegraded":"2024-05-20T17:53:14.245434+0000","last_fullsized":"2024-05-20T17:53:14.245434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:41.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654449+0000","last_change":"2024-05-20T17:53:07.588530+0000","last_active":"2024-05-20T17:53:13.654449+0000","last_peered":"2024-05-20T17:53:13.654449+0000","last_clean":"2024-05-20T17:53:13.654449+0000","last_became_active":"2024-05-20T17:53:07.587985+0000","last_became_peered":"2024-05-20T17:53:07.587985+0000","last_unstale":"2024-05-20T17:53:13.654449+0000","last_undegraded":"2024-05-20T17:53:13.654449+0000","last_fullsized":"2024-05-20T17:53:13.654449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:17.229454+0000","last_change":"2024-05-20T17:53:06.574794+0000","last_active":"2024-05-20T17:53:17.229454+0000","last_peered":"2024-05-20T17:53:17.229454+0000","last_clean":"2024-05-20T17:53:17.229454+0000","last_became_active":"2024-05-20T17:53:06.574430+0000","last_became_peered":"2024-05-20T17:53:06.574430+0000","last_unstale":"2024-05-20T17:53:17.229454+0000","last_undegraded":"2024-05-20T17:53:17.229454+0000","last_fullsized":"2024-05-20T17:53:17.229454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244161+0000","last_change":"2024-05-20T17:53:11.620987+0000","last_active":"2024-05-20T17:53:14.244161+0000","last_peered":"2024-05-20T17:53:14.244161+0000","last_clean":"2024-05-20T17:53:14.244161+0000","last_became_active":"2024-05-20T17:53:11.620506+0000","last_became_peered":"2024-05-20T17:53:11.620506+0000","last_unstale":"2024-05-20T17:53:14.244161+0000","last_undegraded":"2024-05-20T17:53:14.244161+0000","last_fullsized":"2024-05-20T17:53:14.244161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:28.849402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599507+0000","last_change":"2024-05-20T17:53:07.565183+0000","last_active":"2024-05-20T17:53:12.599507+0000","last_peered":"2024-05-20T17:53:12.599507+0000","last_clean":"2024-05-20T17:53:12.599507+0000","last_became_active":"2024-05-20T17:53:07.564852+0000","last_became_peered":"2024-05-20T17:53:07.564852+0000","last_unstale":"2024-05-20T17:53:12.599507+0000","last_undegraded":"2024-05-20T17:53:12.599507+0000","last_fullsized":"2024-05-20T17:53:12.599507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:31.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244673+0000","last_change":"2024-05-20T17:53:06.574319+0000","last_active":"2024-05-20T17:53:14.244673+0000","last_peered":"2024-05-20T17:53:14.244673+0000","last_clean":"2024-05-20T17:53:14.244673+0000","last_became_active":"2024-05-20T17:53:06.573970+0000","last_became_peered":"2024-05-20T17:53:06.573970+0000","last_unstale":"2024-05-20T17:53:14.244673+0000","last_undegraded":"2024-05-20T17:53:14.244673+0000","last_fullsized":"2024-05-20T17:53:14.244673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:30.496240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599198+0000","last_change":"2024-05-20T17:53:11.616154+0000","last_active":"2024-05-20T17:53:12.599198+0000","last_peered":"2024-05-20T17:53:12.599198+0000","last_clean":"2024-05-20T17:53:12.599198+0000","last_became_active":"2024-05-20T17:53:11.614731+0000","last_became_peered":"2024-05-20T17:53:11.614731+0000","last_unstale":"2024-05-20T17:53:12.599198+0000","last_undegraded":"2024-05-20T17:53:12.599198+0000","last_fullsized":"2024-05-20T17:53:12.599198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:21.092223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243803+0000","last_change":"2024-05-20T17:53:07.573718+0000","last_active":"2024-05-20T17:53:14.243803+0000","last_peered":"2024-05-20T17:53:14.243803+0000","last_clean":"2024-05-20T17:53:14.243803+0000","last_became_active":"2024-05-20T17:53:07.573368+0000","last_became_peered":"2024-05-20T17:53:07.573368+0000","last_unstale":"2024-05-20T17:53:14.243803+0000","last_undegraded":"2024-05-20T17:53:14.243803+0000","last_fullsized":"2024-05-20T17:53:14.243803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244725+0000","last_change":"2024-05-20T17:53:06.572461+0000","last_active":"2024-05-20T17:53:14.244725+0000","last_peered":"2024-05-20T17:53:14.244725+0000","last_clean":"2024-05-20T17:53:14.244725+0000","last_became_active":"2024-05-20T17:53:06.572097+0000","last_became_peered":"2024-05-20T17:53:06.572097+0000","last_unstale":"2024-05-20T17:53:14.244725+0000","last_undegraded":"2024-05-20T17:53:14.244725+0000","last_fullsized":"2024-05-20T17:53:14.244725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597910+0000","last_change":"2024-05-20T17:53:11.612607+0000","last_active":"2024-05-20T17:53:12.597910+0000","last_peered":"2024-05-20T17:53:12.597910+0000","last_clean":"2024-05-20T17:53:12.597910+0000","last_became_active":"2024-05-20T17:53:11.612147+0000","last_became_peered":"2024-05-20T17:53:11.612147+0000","last_unstale":"2024-05-20T17:53:12.597910+0000","last_undegraded":"2024-05-20T17:53:12.597910+0000","last_fullsized":"2024-05-20T17:53:12.597910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:57.596450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244594+0000","last_change":"2024-05-20T17:53:07.565265+0000","last_active":"2024-05-20T17:53:14.244594+0000","last_peered":"2024-05-20T17:53:14.244594+0000","last_clean":"2024-05-20T17:53:14.244594+0000","last_became_active":"2024-05-20T17:53:07.564958+0000","last_became_peered":"2024-05-20T17:53:07.564958+0000","last_unstale":"2024-05-20T17:53:14.244594+0000","last_undegraded":"2024-05-20T17:53:14.244594+0000","last_fullsized":"2024-05-20T17:53:14.244594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244837+0000","last_change":"2024-05-20T17:53:06.575493+0000","last_active":"2024-05-20T17:53:14.244837+0000","last_peered":"2024-05-20T17:53:14.244837+0000","last_clean":"2024-05-20T17:53:14.244837+0000","last_became_active":"2024-05-20T17:53:06.575211+0000","last_became_peered":"2024-05-20T17:53:06.575211+0000","last_unstale":"2024-05-20T17:53:14.244837+0000","last_undegraded":"2024-05-20T17:53:14.244837+0000","last_fullsized":"2024-05-20T17:53:14.244837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599643+0000","last_change":"2024-05-20T17:53:11.755641+0000","last_active":"2024-05-20T17:53:12.599643+0000","last_peered":"2024-05-20T17:53:12.599643+0000","last_clean":"2024-05-20T17:53:12.599643+0000","last_became_active":"2024-05-20T17:53:11.755179+0000","last_became_peered":"2024-05-20T17:53:11.755179+0000","last_unstale":"2024-05-20T17:53:12.599643+0000","last_undegraded":"2024-05-20T17:53:12.599643+0000","last_fullsized":"2024-05-20T17:53:12.599643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:08.214732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243667+0000","last_change":"2024-05-20T17:53:11.755526+0000","last_active":"2024-05-20T17:53:14.243667+0000","last_peered":"2024-05-20T17:53:14.243667+0000","last_clean":"2024-05-20T17:53:14.243667+0000","last_became_active":"2024-05-20T17:53:11.755114+0000","last_became_peered":"2024-05-20T17:53:11.755114+0000","last_unstale":"2024-05-20T17:53:14.243667+0000","last_undegraded":"2024-05-20T17:53:14.243667+0000","last_fullsized":"2024-05-20T17:53:14.243667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:02.595103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243648+0000","last_change":"2024-05-20T17:53:07.589463+0000","last_active":"2024-05-20T17:53:14.243648+0000","last_peered":"2024-05-20T17:53:14.243648+0000","last_clean":"2024-05-20T17:53:14.243648+0000","last_became_active":"2024-05-20T17:53:07.589109+0000","last_became_peered":"2024-05-20T17:53:07.589109+0000","last_unstale":"2024-05-20T17:53:14.243648+0000","last_undegraded":"2024-05-20T17:53:14.243648+0000","last_fullsized":"2024-05-20T17:53:14.243648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243937+0000","last_change":"2024-05-20T17:53:06.573947+0000","last_active":"2024-05-20T17:53:14.243937+0000","last_peered":"2024-05-20T17:53:14.243937+0000","last_clean":"2024-05-20T17:53:14.243937+0000","last_became_active":"2024-05-20T17:53:06.572617+0000","last_became_peered":"2024-05-20T17:53:06.572617+0000","last_unstale":"2024-05-20T17:53:14.243937+0000","last_undegraded":"2024-05-20T17:53:14.243937+0000","last_fullsized":"2024-05-20T17:53:14.243937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244417+0000","last_change":"2024-05-20T17:53:11.617273+0000","last_active":"2024-05-20T17:53:14.244417+0000","last_peered":"2024-05-20T17:53:14.244417+0000","last_clean":"2024-05-20T17:53:14.244417+0000","last_became_active":"2024-05-20T17:53:11.616538+0000","last_became_peered":"2024-05-20T17:53:11.616538+0000","last_unstale":"2024-05-20T17:53:14.244417+0000","last_undegraded":"2024-05-20T17:53:14.244417+0000","last_fullsized":"2024-05-20T17:53:14.244417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:44.269036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597869+0000","last_change":"2024-05-20T17:53:07.585370+0000","last_active":"2024-05-20T17:53:12.597869+0000","last_peered":"2024-05-20T17:53:12.597869+0000","last_clean":"2024-05-20T17:53:12.597869+0000","last_became_active":"2024-05-20T17:53:07.584558+0000","last_became_peered":"2024-05-20T17:53:07.584558+0000","last_unstale":"2024-05-20T17:53:12.597869+0000","last_undegraded":"2024-05-20T17:53:12.597869+0000","last_fullsized":"2024-05-20T17:53:12.597869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598324+0000","last_change":"2024-05-20T17:53:06.575726+0000","last_active":"2024-05-20T17:53:12.598324+0000","last_peered":"2024-05-20T17:53:12.598324+0000","last_clean":"2024-05-20T17:53:12.598324+0000","last_became_active":"2024-05-20T17:53:06.575405+0000","last_became_peered":"2024-05-20T17:53:06.575405+0000","last_unstale":"2024-05-20T17:53:12.598324+0000","last_undegraded":"2024-05-20T17:53:12.598324+0000","last_fullsized":"2024-05-20T17:53:12.598324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244557+0000","last_change":"2024-05-20T17:53:06.570392+0000","last_active":"2024-05-20T17:53:14.244557+0000","last_peered":"2024-05-20T17:53:14.244557+0000","last_clean":"2024-05-20T17:53:14.244557+0000","last_became_active":"2024-05-20T17:53:06.569729+0000","last_became_peered":"2024-05-20T17:53:06.569729+0000","last_unstale":"2024-05-20T17:53:14.244557+0000","last_undegraded":"2024-05-20T17:53:14.244557+0000","last_fullsized":"2024-05-20T17:53:14.244557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244969+0000","last_change":"2024-05-20T17:53:07.563453+0000","last_active":"2024-05-20T17:53:14.244969+0000","last_peered":"2024-05-20T17:53:14.244969+0000","last_clean":"2024-05-20T17:53:14.244969+0000","last_became_active":"2024-05-20T17:53:07.563081+0000","last_became_peered":"2024-05-20T17:53:07.563081+0000","last_unstale":"2024-05-20T17:53:14.244969+0000","last_undegraded":"2024-05-20T17:53:14.244969+0000","last_fullsized":"2024-05-20T17:53:14.244969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598694+0000","last_change":"2024-05-20T17:53:11.615867+0000","last_active":"2024-05-20T17:53:12.598694+0000","last_peered":"2024-05-20T17:53:12.598694+0000","last_clean":"2024-05-20T17:53:12.598694+0000","last_became_active":"2024-05-20T17:53:11.615414+0000","last_became_peered":"2024-05-20T17:53:11.615414+0000","last_unstale":"2024-05-20T17:53:12.598694+0000","last_undegraded":"2024-05-20T17:53:12.598694+0000","last_fullsized":"2024-05-20T17:53:12.598694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:26.374404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598758+0000","last_change":"2024-05-20T17:53:06.566530+0000","last_active":"2024-05-20T17:53:12.598758+0000","last_peered":"2024-05-20T17:53:12.598758+0000","last_clean":"2024-05-20T17:53:12.598758+0000","last_became_active":"2024-05-20T17:53:06.566164+0000","last_became_peered":"2024-05-20T17:53:06.566164+0000","last_unstale":"2024-05-20T17:53:12.598758+0000","last_undegraded":"2024-05-20T17:53:12.598758+0000","last_fullsized":"2024-05-20T17:53:12.598758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:22:58.179989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598733+0000","last_change":"2024-05-20T17:53:07.566366+0000","last_active":"2024-05-20T17:53:12.598733+0000","last_peered":"2024-05-20T17:53:12.598733+0000","last_clean":"2024-05-20T17:53:12.598733+0000","last_became_active":"2024-05-20T17:53:07.564572+0000","last_became_peered":"2024-05-20T17:53:07.564572+0000","last_unstale":"2024-05-20T17:53:12.598733+0000","last_undegraded":"2024-05-20T17:53:12.598733+0000","last_fullsized":"2024-05-20T17:53:12.598733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:07.981032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599855+0000","last_change":"2024-05-20T17:53:11.611213+0000","last_active":"2024-05-20T17:53:12.599855+0000","last_peered":"2024-05-20T17:53:12.599855+0000","last_clean":"2024-05-20T17:53:12.599855+0000","last_became_active":"2024-05-20T17:53:11.610761+0000","last_became_peered":"2024-05-20T17:53:11.610761+0000","last_unstale":"2024-05-20T17:53:12.599855+0000","last_undegraded":"2024-05-20T17:53:12.599855+0000","last_fullsized":"2024-05-20T17:53:12.599855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:10.351145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243764+0000","last_change":"2024-05-20T17:53:07.571745+0000","last_active":"2024-05-20T17:53:14.243764+0000","last_peered":"2024-05-20T17:53:14.243764+0000","last_clean":"2024-05-20T17:53:14.243764+0000","last_became_active":"2024-05-20T17:53:07.571440+0000","last_became_peered":"2024-05-20T17:53:07.571440+0000","last_unstale":"2024-05-20T17:53:14.243764+0000","last_undegraded":"2024-05-20T17:53:14.243764+0000","last_fullsized":"2024-05-20T17:53:14.243764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:50.625084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598579+0000","last_change":"2024-05-20T17:53:07.578996+0000","last_active":"2024-05-20T17:53:12.598579+0000","last_peered":"2024-05-20T17:53:12.598579+0000","last_clean":"2024-05-20T17:53:12.598579+0000","last_became_active":"2024-05-20T17:53:07.578650+0000","last_became_peered":"2024-05-20T17:53:07.578650+0000","last_unstale":"2024-05-20T17:53:12.598579+0000","last_undegraded":"2024-05-20T17:53:12.598579+0000","last_fullsized":"2024-05-20T17:53:12.598579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:26.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244224+0000","last_change":"2024-05-20T17:53:07.585434+0000","last_active":"2024-05-20T17:53:14.244224+0000","last_peered":"2024-05-20T17:53:14.244224+0000","last_clean":"2024-05-20T17:53:14.244224+0000","last_became_active":"2024-05-20T17:53:07.584703+0000","last_became_peered":"2024-05-20T17:53:07.584703+0000","last_unstale":"2024-05-20T17:53:14.244224+0000","last_undegraded":"2024-05-20T17:53:14.244224+0000","last_fullsized":"2024-05-20T17:53:14.244224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:45.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244874+0000","last_change":"2024-05-20T17:53:07.587018+0000","last_active":"2024-05-20T17:53:14.244874+0000","last_peered":"2024-05-20T17:53:14.244874+0000","last_clean":"2024-05-20T17:53:14.244874+0000","last_became_active":"2024-05-20T17:53:07.586608+0000","last_became_peered":"2024-05-20T17:53:07.586608+0000","last_unstale":"2024-05-20T17:53:14.244874+0000","last_undegraded":"2024-05-20T17:53:14.244874+0000","last_fullsized":"2024-05-20T17:53:14.244874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599158+0000","last_change":"2024-05-20T17:53:07.588014+0000","last_active":"2024-05-20T17:53:12.599158+0000","last_peered":"2024-05-20T17:53:12.599158+0000","last_clean":"2024-05-20T17:53:12.599158+0000","last_became_active":"2024-05-20T17:53:07.587708+0000","last_became_peered":"2024-05-20T17:53:07.587708+0000","last_unstale":"2024-05-20T17:53:12.599158+0000","last_undegraded":"2024-05-20T17:53:12.599158+0000","last_fullsized":"2024-05-20T17:53:12.599158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244467+0000","last_change":"2024-05-20T17:53:07.588057+0000","last_active":"2024-05-20T17:53:14.244467+0000","last_peered":"2024-05-20T17:53:14.244467+0000","last_clean":"2024-05-20T17:53:14.244467+0000","last_became_active":"2024-05-20T17:53:07.587720+0000","last_became_peered":"2024-05-20T17:53:07.587720+0000","last_unstale":"2024-05-20T17:53:14.244467+0000","last_undegraded":"2024-05-20T17:53:14.244467+0000","last_fullsized":"2024-05-20T17:53:14.244467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244725+0000","last_change":"2024-05-20T17:53:07.572982+0000","last_active":"2024-05-20T17:53:14.244725+0000","last_peered":"2024-05-20T17:53:14.244725+0000","last_clean":"2024-05-20T17:53:14.244725+0000","last_became_active":"2024-05-20T17:53:07.572341+0000","last_became_peered":"2024-05-20T17:53:07.572341+0000","last_unstale":"2024-05-20T17:53:14.244725+0000","last_undegraded":"2024-05-20T17:53:14.244725+0000","last_fullsized":"2024-05-20T17:53:14.244725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599485+0000","last_change":"2024-05-20T17:53:07.586892+0000","last_active":"2024-05-20T17:53:12.599485+0000","last_peered":"2024-05-20T17:53:12.599485+0000","last_clean":"2024-05-20T17:53:12.599485+0000","last_became_active":"2024-05-20T17:53:07.586592+0000","last_became_peered":"2024-05-20T17:53:07.586592+0000","last_unstale":"2024-05-20T17:53:12.599485+0000","last_undegraded":"2024-05-20T17:53:12.599485+0000","last_fullsized":"2024-05-20T17:53:12.599485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243849+0000","last_change":"2024-05-20T17:53:07.585135+0000","last_active":"2024-05-20T17:53:14.243849+0000","last_peered":"2024-05-20T17:53:14.243849+0000","last_clean":"2024-05-20T17:53:14.243849+0000","last_became_active":"2024-05-20T17:53:07.584770+0000","last_became_peered":"2024-05-20T17:53:07.584770+0000","last_unstale":"2024-05-20T17:53:14.243849+0000","last_undegraded":"2024-05-20T17:53:14.243849+0000","last_fullsized":"2024-05-20T17:53:14.243849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598173+0000","last_change":"2024-05-20T17:53:07.587589+0000","last_active":"2024-05-20T17:53:12.598173+0000","last_peered":"2024-05-20T17:53:12.598173+0000","last_clean":"2024-05-20T17:53:12.598173+0000","last_became_active":"2024-05-20T17:53:07.587199+0000","last_became_peered":"2024-05-20T17:53:07.587199+0000","last_unstale":"2024-05-20T17:53:12.598173+0000","last_undegraded":"2024-05-20T17:53:12.598173+0000","last_fullsized":"2024-05-20T17:53:12.598173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244099+0000","last_change":"2024-05-20T17:53:07.564879+0000","last_active":"2024-05-20T17:53:14.244099+0000","last_peered":"2024-05-20T17:53:14.244099+0000","last_clean":"2024-05-20T17:53:14.244099+0000","last_became_active":"2024-05-20T17:53:07.564533+0000","last_became_peered":"2024-05-20T17:53:07.564533+0000","last_unstale":"2024-05-20T17:53:14.244099+0000","last_undegraded":"2024-05-20T17:53:14.244099+0000","last_fullsized":"2024-05-20T17:53:14.244099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:40.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244554+0000","last_change":"2024-05-20T17:53:07.573683+0000","last_active":"2024-05-20T17:53:14.244554+0000","last_peered":"2024-05-20T17:53:14.244554+0000","last_clean":"2024-05-20T17:53:14.244554+0000","last_became_active":"2024-05-20T17:53:07.571046+0000","last_became_peered":"2024-05-20T17:53:07.571046+0000","last_unstale":"2024-05-20T17:53:14.244554+0000","last_undegraded":"2024-05-20T17:53:14.244554+0000","last_fullsized":"2024-05-20T17:53:14.244554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244334+0000","last_change":"2024-05-20T17:53:07.574629+0000","last_active":"2024-05-20T17:53:14.244334+0000","last_peered":"2024-05-20T17:53:14.244334+0000","last_clean":"2024-05-20T17:53:14.244334+0000","last_became_active":"2024-05-20T17:53:07.574286+0000","last_became_peered":"2024-05-20T17:53:07.574286+0000","last_unstale":"2024-05-20T17:53:14.244334+0000","last_undegraded":"2024-05-20T17:53:14.244334+0000","last_fullsized":"2024-05-20T17:53:14.244334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654699+0000","last_change":"2024-05-20T17:53:07.575422+0000","last_active":"2024-05-20T17:53:13.654699+0000","last_peered":"2024-05-20T17:53:13.654699+0000","last_clean":"2024-05-20T17:53:13.654699+0000","last_became_active":"2024-05-20T17:53:07.575017+0000","last_became_peered":"2024-05-20T17:53:07.575017+0000","last_unstale":"2024-05-20T17:53:13.654699+0000","last_undegraded":"2024-05-20T17:53:13.654699+0000","last_fullsized":"2024-05-20T17:53:13.654699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:45.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599534+0000","last_change":"2024-05-20T17:53:07.568400+0000","last_active":"2024-05-20T17:53:12.599534+0000","last_peered":"2024-05-20T17:53:12.599534+0000","last_clean":"2024-05-20T17:53:12.599534+0000","last_became_active":"2024-05-20T17:53:07.568013+0000","last_became_peered":"2024-05-20T17:53:07.568013+0000","last_unstale":"2024-05-20T17:53:12.599534+0000","last_undegraded":"2024-05-20T17:53:12.599534+0000","last_fullsized":"2024-05-20T17:53:12.599534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:31.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245277+0000","last_change":"2024-05-20T17:53:07.564289+0000","last_active":"2024-05-20T17:53:14.245277+0000","last_peered":"2024-05-20T17:53:14.245277+0000","last_clean":"2024-05-20T17:53:14.245277+0000","last_became_active":"2024-05-20T17:53:07.563973+0000","last_became_peered":"2024-05-20T17:53:07.563973+0000","last_unstale":"2024-05-20T17:53:14.245277+0000","last_undegraded":"2024-05-20T17:53:14.245277+0000","last_fullsized":"2024-05-20T17:53:14.245277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243731+0000","last_change":"2024-05-20T17:53:07.560898+0000","last_active":"2024-05-20T17:53:14.243731+0000","last_peered":"2024-05-20T17:53:14.243731+0000","last_clean":"2024-05-20T17:53:14.243731+0000","last_became_active":"2024-05-20T17:53:07.560518+0000","last_became_peered":"2024-05-20T17:53:07.560518+0000","last_unstale":"2024-05-20T17:53:14.243731+0000","last_undegraded":"2024-05-20T17:53:14.243731+0000","last_fullsized":"2024-05-20T17:53:14.243731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243753+0000","last_change":"2024-05-20T17:53:07.569983+0000","last_active":"2024-05-20T17:53:14.243753+0000","last_peered":"2024-05-20T17:53:14.243753+0000","last_clean":"2024-05-20T17:53:14.243753+0000","last_became_active":"2024-05-20T17:53:07.569663+0000","last_became_peered":"2024-05-20T17:53:07.569663+0000","last_unstale":"2024-05-20T17:53:14.243753+0000","last_undegraded":"2024-05-20T17:53:14.243753+0000","last_fullsized":"2024-05-20T17:53:14.243753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244095+0000","last_change":"2024-05-20T17:53:07.566018+0000","last_active":"2024-05-20T17:53:14.244095+0000","last_peered":"2024-05-20T17:53:14.244095+0000","last_clean":"2024-05-20T17:53:14.244095+0000","last_became_active":"2024-05-20T17:53:07.565527+0000","last_became_peered":"2024-05-20T17:53:07.565527+0000","last_unstale":"2024-05-20T17:53:14.244095+0000","last_undegraded":"2024-05-20T17:53:14.244095+0000","last_fullsized":"2024-05-20T17:53:14.244095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:21:17.680092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598017+0000","last_change":"2024-05-20T17:53:07.585449+0000","last_active":"2024-05-20T17:53:12.598017+0000","last_peered":"2024-05-20T17:53:12.598017+0000","last_clean":"2024-05-20T17:53:12.598017+0000","last_became_active":"2024-05-20T17:53:07.585089+0000","last_became_peered":"2024-05-20T17:53:07.585089+0000","last_unstale":"2024-05-20T17:53:12.598017+0000","last_undegraded":"2024-05-20T17:53:12.598017+0000","last_fullsized":"2024-05-20T17:53:12.598017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598876+0000","last_change":"2024-05-20T17:53:07.567630+0000","last_active":"2024-05-20T17:53:12.598876+0000","last_peered":"2024-05-20T17:53:12.598876+0000","last_clean":"2024-05-20T17:53:12.598876+0000","last_became_active":"2024-05-20T17:53:07.565841+0000","last_became_peered":"2024-05-20T17:53:07.565841+0000","last_unstale":"2024-05-20T17:53:12.598876+0000","last_undegraded":"2024-05-20T17:53:12.598876+0000","last_fullsized":"2024-05-20T17:53:12.598876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:28.255939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244959+0000","last_change":"2024-05-20T17:53:07.577572+0000","last_active":"2024-05-20T17:53:14.244959+0000","last_peered":"2024-05-20T17:53:14.244959+0000","last_clean":"2024-05-20T17:53:14.244959+0000","last_became_active":"2024-05-20T17:53:07.577248+0000","last_became_peered":"2024-05-20T17:53:07.577248+0000","last_unstale":"2024-05-20T17:53:14.244959+0000","last_undegraded":"2024-05-20T17:53:14.244959+0000","last_fullsized":"2024-05-20T17:53:14.244959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244594+0000","last_change":"2024-05-20T17:53:07.580278+0000","last_active":"2024-05-20T17:53:14.244594+0000","last_peered":"2024-05-20T17:53:14.244594+0000","last_clean":"2024-05-20T17:53:14.244594+0000","last_became_active":"2024-05-20T17:53:07.579918+0000","last_became_peered":"2024-05-20T17:53:07.579918+0000","last_unstale":"2024-05-20T17:53:14.244594+0000","last_undegraded":"2024-05-20T17:53:14.244594+0000","last_fullsized":"2024-05-20T17:53:14.244594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654876+0000","last_change":"2024-05-20T17:53:07.571649+0000","last_active":"2024-05-20T17:53:13.654876+0000","last_peered":"2024-05-20T17:53:13.654876+0000","last_clean":"2024-05-20T17:53:13.654876+0000","last_became_active":"2024-05-20T17:53:07.570372+0000","last_became_peered":"2024-05-20T17:53:07.570372+0000","last_unstale":"2024-05-20T17:53:13.654876+0000","last_undegraded":"2024-05-20T17:53:13.654876+0000","last_fullsized":"2024-05-20T17:53:13.654876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597720+0000","last_change":"2024-05-20T17:53:07.584911+0000","last_active":"2024-05-20T17:53:12.597720+0000","last_peered":"2024-05-20T17:53:12.597720+0000","last_clean":"2024-05-20T17:53:12.597720+0000","last_became_active":"2024-05-20T17:53:07.584544+0000","last_became_peered":"2024-05-20T17:53:07.584544+0000","last_unstale":"2024-05-20T17:53:12.597720+0000","last_undegraded":"2024-05-20T17:53:12.597720+0000","last_fullsized":"2024-05-20T17:53:12.597720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654120+0000","last_change":"2024-05-20T17:53:07.580955+0000","last_active":"2024-05-20T17:53:13.654120+0000","last_peered":"2024-05-20T17:53:13.654120+0000","last_clean":"2024-05-20T17:53:13.654120+0000","last_became_active":"2024-05-20T17:53:07.580587+0000","last_became_peered":"2024-05-20T17:53:07.580587+0000","last_unstale":"2024-05-20T17:53:13.654120+0000","last_undegraded":"2024-05-20T17:53:13.654120+0000","last_fullsized":"2024-05-20T17:53:13.654120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:40.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243911+0000","last_change":"2024-05-20T17:53:07.570792+0000","last_active":"2024-05-20T17:53:14.243911+0000","last_peered":"2024-05-20T17:53:14.243911+0000","last_clean":"2024-05-20T17:53:14.243911+0000","last_became_active":"2024-05-20T17:53:07.570501+0000","last_became_peered":"2024-05-20T17:53:07.570501+0000","last_unstale":"2024-05-20T17:53:14.243911+0000","last_undegraded":"2024-05-20T17:53:14.243911+0000","last_fullsized":"2024-05-20T17:53:14.243911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654229+0000","last_change":"2024-05-20T17:53:07.573875+0000","last_active":"2024-05-20T17:53:13.654229+0000","last_peered":"2024-05-20T17:53:13.654229+0000","last_clean":"2024-05-20T17:53:13.654229+0000","last_became_active":"2024-05-20T17:53:07.573520+0000","last_became_peered":"2024-05-20T17:53:07.573520+0000","last_unstale":"2024-05-20T17:53:13.654229+0000","last_undegraded":"2024-05-20T17:53:13.654229+0000","last_fullsized":"2024-05-20T17:53:13.654229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:24.809917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244998+0000","last_change":"2024-05-20T17:53:07.588340+0000","last_active":"2024-05-20T17:53:14.244998+0000","last_peered":"2024-05-20T17:53:14.244998+0000","last_clean":"2024-05-20T17:53:14.244998+0000","last_became_active":"2024-05-20T17:53:07.588012+0000","last_became_peered":"2024-05-20T17:53:07.588012+0000","last_unstale":"2024-05-20T17:53:14.244998+0000","last_undegraded":"2024-05-20T17:53:14.244998+0000","last_fullsized":"2024-05-20T17:53:14.244998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:17.052738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244499+0000","last_change":"2024-05-20T17:53:07.570831+0000","last_active":"2024-05-20T17:53:14.244499+0000","last_peered":"2024-05-20T17:53:14.244499+0000","last_clean":"2024-05-20T17:53:14.244499+0000","last_became_active":"2024-05-20T17:53:07.570499+0000","last_became_peered":"2024-05-20T17:53:07.570499+0000","last_unstale":"2024-05-20T17:53:14.244499+0000","last_undegraded":"2024-05-20T17:53:14.244499+0000","last_fullsized":"2024-05-20T17:53:14.244499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:50.625084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245012+0000","last_change":"2024-05-20T17:53:07.580456+0000","last_active":"2024-05-20T17:53:14.245012+0000","last_peered":"2024-05-20T17:53:14.245012+0000","last_clean":"2024-05-20T17:53:14.245012+0000","last_became_active":"2024-05-20T17:53:07.580093+0000","last_became_peered":"2024-05-20T17:53:07.580093+0000","last_unstale":"2024-05-20T17:53:14.245012+0000","last_undegraded":"2024-05-20T17:53:14.245012+0000","last_fullsized":"2024-05-20T17:53:14.245012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654731+0000","last_change":"2024-05-20T17:53:07.571268+0000","last_active":"2024-05-20T17:53:13.654731+0000","last_peered":"2024-05-20T17:53:13.654731+0000","last_clean":"2024-05-20T17:53:13.654731+0000","last_became_active":"2024-05-20T17:53:07.570549+0000","last_became_peered":"2024-05-20T17:53:07.570549+0000","last_unstale":"2024-05-20T17:53:13.654731+0000","last_undegraded":"2024-05-20T17:53:13.654731+0000","last_fullsized":"2024-05-20T17:53:13.654731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:53:31.077 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T17:53:31.077 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-20T17:53:31.078 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-20T17:53:31.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-20T17:53:31.078 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-20T17:53:31.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.227+0000 7f2fca136640 1 Processor -- start 2024-05-20T17:53:31.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.227+0000 7f2fca136640 1 -- start start 2024-05-20T17:53:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.228+0000 7f2fca136640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc40d4400 0x7f2fc415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.228+0000 7f2fca136640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2fc406cf00 0x7f2fc406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.228+0000 7f2fca136640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc408d2a0 con 0x7f2fc40d2780 2024-05-20T17:53:31.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.228+0000 7f2fca136640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc40d3f70 con 0x7f2fc406cf00 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.228+0000 7f2fca136640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc406d850 con 0x7f2fc40d4400 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2fc40d2780 0x7f2fc40d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39574/0 (socket says 172.21.15.6:39574) 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc3fff640 1 -- 172.21.15.6:0/686116801 learned_addr learned my addr 172.21.15.6:0/686116801 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc37fe640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc40d4400 0x7f2fc415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/686116801 >> v2:172.21.15.171:3300/0 conn(0x7f2fc406cf00 0x7f2fc406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946537055 0 0) 0x7f2fbc001490 con 0x7f2fc40d2780 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fac003520 con 0x7f2fc40d2780 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3893582043 0 0) 0x7f2fac003520 con 0x7f2fc40d2780 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc40d4400 msgr2=0x7f2fc415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc40d4400 0x7f2fc415f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 >> v2:172.21.15.171:3300/0 conn(0x7f2fc406cf00 msgr2=0x7f2fc406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 --2- 172.21.15.6:0/686116801 >> v2:172.21.15.171:3300/0 conn(0x7f2fc406cf00 0x7f2fc406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc40d4810 con 0x7f2fc40d2780 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f2fbc001bc0 con 0x7f2fc40d2780 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 >> v1:172.21.15.6:6789/0 conn(0x7f2fc40d2780 legacy=0x7f2fc40d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fac0039b0 0x7f2fac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fac004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fac005150 0x7f2fac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc40d3f70 con 0x7f2fac004800 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc406d850 con 0x7f2fac005150 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2fac00bf50 con 0x7f2fac0039b0 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/686116801 >> v2:172.21.15.171:3300/0 conn(0x7f2fc406cf00 0x7f2fc406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc37fe640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc40d4400 0x7f2fc415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fac004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.229+0000 7f2fc3fff640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fac005150 0x7f2fac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.230+0000 7f2fc37fe640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fac0039b0 0x7f2fac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.230+0000 7f2fc2ffd640 1 -- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fac0039b0 msgr2=0x7f2fac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.230+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fac0039b0 0x7f2fac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.230+0000 7f2fc2ffd640 1 -- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fac005150 msgr2=0x7f2fac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.230+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fac005150 0x7f2fac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.230+0000 7f2fc2ffd640 1 -- 172.21.15.6:0/686116801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fac003520 con 0x7f2fac004800 2024-05-20T17:53:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.230+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fac004c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009c40 tx=0x7f2fac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83de0b7a3e111212 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8009840 con 0x7f2fac004800 2024-05-20T17:53:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb8004020 con 0x7f2fac004800 2024-05-20T17:53:31.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fc27fc640 1 -- 172.21.15.6:0/686116801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80043d0 con 0x7f2fac004800 2024-05-20T17:53:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fca136640 1 -- 172.21.15.6:0/686116801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 msgr2=0x7f2fac004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fca136640 1 --2- 172.21.15.6:0/686116801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fac004c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009c40 tx=0x7f2fac005830 comp rx=0 tx=0).stop 2024-05-20T17:53:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fc3fff640 1 -- 172.21.15.6:0/686116801 reap_dead start 2024-05-20T17:53:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fca136640 1 -- 172.21.15.6:0/686116801 shutdown_connections 2024-05-20T17:53:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fca136640 1 -- 172.21.15.6:0/686116801 >> 172.21.15.6:0/686116801 conn(0x7f2fc40d4bb0 msgr2=0x7f2fc40d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fca136640 1 -- 172.21.15.6:0/686116801 shutdown_connections 2024-05-20T17:53:31.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.231+0000 7f2fca136640 1 -- 172.21.15.6:0/686116801 wait complete. 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.233+0000 7f2fca136640 1 Processor -- start 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.233+0000 7f2fca136640 1 -- start start 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fca136640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fc41e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fca136640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc414de20 0x7f2fc41616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fca136640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4161be0 0x7f2fc41f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fca136640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc40d3920 con 0x7f2fac004800 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fca136640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc40d3640 con 0x7f2fc4161be0 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fca136640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc40d3c00 con 0x7f2fc414de20 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fc41e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fc41e7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46150/0 (socket says 172.21.15.6:46150) 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 -- 172.21.15.6:0/319869115 learned_addr learned my addr 172.21.15.6:0/319869115 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc3fff640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4161be0 0x7f2fc41f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc414de20 0x7f2fc41616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 -- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc414de20 msgr2=0x7f2fc41616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc414de20 0x7f2fc41616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 -- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4161be0 msgr2=0x7f2fc41f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4161be0 0x7f2fc41f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 -- 172.21.15.6:0/319869115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc4161ff0 con 0x7f2fac004800 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc3fff640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4161be0 0x7f2fc41f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fc37fe640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fc41e7c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40119d0 tx=0x7f2fb4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.235+0000 7f2fabfff640 1 -- 172.21.15.6:0/319869115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400fbb0 con 0x7f2fac004800 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.236+0000 7f2fabfff640 1 -- 172.21.15.6:0/319869115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb400fd50 con 0x7f2fac004800 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.236+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc415d520 con 0x7f2fac004800 2024-05-20T17:53:31.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.236+0000 7f2fabfff640 1 -- 172.21.15.6:0/319869115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4014660 con 0x7f2fac004800 2024-05-20T17:53:31.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.236+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc415dae0 con 0x7f2fac004800 2024-05-20T17:53:31.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.236+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc40735a0 con 0x7f2fac004800 2024-05-20T17:53:31.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.237+0000 7f2fabfff640 1 -- 172.21.15.6:0/319869115 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fb4012040 con 0x7f2fac004800 2024-05-20T17:53:31.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.238+0000 7f2fabfff640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fb006be30 0x7f2fb006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.238+0000 7f2fabfff640 1 -- 172.21.15.6:0/319869115 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2fb408b9d0 con 0x7f2fac004800 2024-05-20T17:53:31.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.238+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fb006be30 0x7f2fb006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.239+0000 7f2fc2ffd640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fb006be30 0x7f2fb006e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8032000 tx=0x7f2fb8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.242+0000 7f2fabfff640 1 -- 172.21.15.6:0/319869115 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2fc40735a0 con 0x7f2fac004800 2024-05-20T17:53:31.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.478+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2fc4075b00 con 0x7f2fac004800 2024-05-20T17:53:31.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.481+0000 7f2fabfff640 1 -- 172.21.15.6:0/319869115 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172945 (secure 0 0 0) 0x7f2fc4161ff0 con 0x7f2fac004800 2024-05-20T17:53:31.483 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:31.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fb006be30 msgr2=0x7f2fb006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fb006be30 0x7f2fb006e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8032000 tx=0x7f2fb8008030 comp rx=0 tx=0).stop 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 msgr2=0x7f2fc41e7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fc41e7c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40119d0 tx=0x7f2fb4011e90 comp rx=0 tx=0).stop 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 shutdown_connections 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fb006be30 0x7f2fb006e340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4161be0 0x7f2fc41f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fc414de20 0x7f2fc41616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 --2- 172.21.15.6:0/319869115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fac004800 0x7f2fc41e7c50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.484+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 >> 172.21.15.6:0/319869115 conn(0x7f2fc40d4bb0 msgr2=0x7f2fc40d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.485+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 shutdown_connections 2024-05-20T17:53:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.485+0000 7f2fca136640 1 -- 172.21.15.6:0/319869115 wait complete. 2024-05-20T17:53:31.495 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1002457044},{"type":"v1","addr":"172.21.15.171:6833","nonce":1002457044}]},"active_addr":"172.21.15.171:6833/1002457044","active_change":"2024-05-20T17:52:46.217502+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":392200378}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":1890215266}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":1951436367}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":4079731106}]}]} 2024-05-20T17:53:31.498 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-20T17:53:31.498 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-20T17:53:31.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.615+0000 7fbff40fe640 1 Processor -- start 2024-05-20T17:53:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.615+0000 7fbff40fe640 1 -- start start 2024-05-20T17:53:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.616+0000 7fbff40fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbfec06d3d0 0x7fbfec06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.616+0000 7fbff40fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfec0b8190 0x7fbfec0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.616+0000 7fbff40fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec06dd20 con 0x7fbfec162820 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.616+0000 7fbff40fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbfec0d0630 con 0x7fbfec0b8190 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.616+0000 7fbff40fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbfec0d39c0 con 0x7fbfec06d3d0 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff269b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfec0b8190 0x7fbfec0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff269b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfec0b8190 0x7fbfec0b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46158/0 (socket says 172.21.15.6:46158) 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff269b640 1 -- 172.21.15.6:0/1538794781 learned_addr learned my addr 172.21.15.6:0/1538794781 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff1699640 1 --2- 172.21.15.6:0/1538794781 >> v2:172.21.15.171:3300/0 conn(0x7fbfec06d3d0 0x7fbfec06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff269b640 1 -- 172.21.15.6:0/1538794781 >> v2:172.21.15.171:3300/0 conn(0x7fbfec06d3d0 msgr2=0x7fbfec06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff269b640 1 --2- 172.21.15.6:0/1538794781 >> v2:172.21.15.171:3300/0 conn(0x7fbfec06d3d0 0x7fbfec06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff269b640 1 -- 172.21.15.6:0/1538794781 >> v1:172.21.15.171:6789/0 conn(0x7fbfec162820 legacy=0x7fbfec0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff269b640 1 -- 172.21.15.6:0/1538794781 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec0d3ca0 con 0x7fbfec0b8190 2024-05-20T17:53:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.617+0000 7fbff1699640 1 --2- 172.21.15.6:0/1538794781 >> v2:172.21.15.171:3300/0 conn(0x7fbfec06d3d0 0x7fbfec06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.618+0000 7fbff269b640 1 --2- 172.21.15.6:0/1538794781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec0b85a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0d1230 tx=0x7fbfe402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13043e8aab701c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.618+0000 7fbff0e98640 1 -- 172.21.15.6:0/1538794781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4036070 con 0x7fbfec0b8190 2024-05-20T17:53:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.618+0000 7fbff0e98640 1 -- 172.21.15.6:0/1538794781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe4031600 con 0x7fbfec0b8190 2024-05-20T17:53:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.618+0000 7fbff0e98640 1 -- 172.21.15.6:0/1538794781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40319d0 con 0x7fbfec0b8190 2024-05-20T17:53:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.618+0000 7fbff40fe640 1 -- 172.21.15.6:0/1538794781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 msgr2=0x7fbfec0b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.618+0000 7fbff40fe640 1 --2- 172.21.15.6:0/1538794781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec0b85a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0d1230 tx=0x7fbfe402a6f0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.619+0000 7fbff40fe640 1 -- 172.21.15.6:0/1538794781 shutdown_connections 2024-05-20T17:53:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.619+0000 7fbff40fe640 1 --2- 172.21.15.6:0/1538794781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec0b85a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.619+0000 7fbff40fe640 1 --2- 172.21.15.6:0/1538794781 >> v2:172.21.15.171:3300/0 conn(0x7fbfec06d3d0 0x7fbfec06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.619+0000 7fbff40fe640 1 -- 172.21.15.6:0/1538794781 >> 172.21.15.6:0/1538794781 conn(0x7fbfec0d4bd0 msgr2=0x7fbfec0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.619+0000 7fbff40fe640 1 -- 172.21.15.6:0/1538794781 shutdown_connections 2024-05-20T17:53:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.619+0000 7fbff40fe640 1 -- 172.21.15.6:0/1538794781 wait complete. 2024-05-20T17:53:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.620+0000 7fbff40fe640 1 Processor -- start 2024-05-20T17:53:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.620+0000 7fbff40fe640 1 -- start start 2024-05-20T17:53:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff40fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfec06d3d0 0x7fbfec147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff40fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff40fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfec162820 0x7fbfec1f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff40fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec0d0300 con 0x7fbfec0b8190 2024-05-20T17:53:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff40fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec0d4260 con 0x7fbfec06d3d0 2024-05-20T17:53:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff40fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbfec0b4050 con 0x7fbfec162820 2024-05-20T17:53:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46168/0 (socket says 172.21.15.6:46168) 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 -- 172.21.15.6:0/474659438 learned_addr learned my addr 172.21.15.6:0/474659438 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1e9a640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfec06d3d0 0x7fbfec147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff269b640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfec162820 0x7fbfec1f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 -- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfec162820 msgr2=0x7fbfec1f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfec162820 0x7fbfec1f84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 -- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfec06d3d0 msgr2=0x7fbfec147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfec06d3d0 0x7fbfec147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 -- 172.21.15.6:0/474659438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec1566d0 con 0x7fbfec0b8190 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1e9a640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfec06d3d0 0x7fbfec147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.622+0000 7fbff1699640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec15ae20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c7f0 tx=0x7fbfdc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.623+0000 7fbfe27fc640 1 -- 172.21.15.6:0/474659438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc015070 con 0x7fbfec0b8190 2024-05-20T17:53:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.623+0000 7fbfe27fc640 1 -- 172.21.15.6:0/474659438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc007820 con 0x7fbfec0b8190 2024-05-20T17:53:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.623+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfec154c60 con 0x7fbfec0b8190 2024-05-20T17:53:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.623+0000 7fbfe27fc640 1 -- 172.21.15.6:0/474659438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc007bd0 con 0x7fbfec0b8190 2024-05-20T17:53:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.623+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfec156950 con 0x7fbfec0b8190 2024-05-20T17:53:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.624+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfec075b00 con 0x7fbfec0b8190 2024-05-20T17:53:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.624+0000 7fbfe27fc640 1 -- 172.21.15.6:0/474659438 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfdc018070 con 0x7fbfec0b8190 2024-05-20T17:53:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.625+0000 7fbfe27fc640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfd006be30 0x7fbfd006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.625+0000 7fbfe27fc640 1 -- 172.21.15.6:0/474659438 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbfdc08b190 con 0x7fbfec0b8190 2024-05-20T17:53:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.625+0000 7fbff1e9a640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfd006be30 0x7fbfd006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.626+0000 7fbff1e9a640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfd006be30 0x7fbfd006e340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006fd0 tx=0x7fbfe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.630+0000 7fbfe27fc640 1 -- 172.21.15.6:0/474659438 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbfec1566d0 con 0x7fbfec0b8190 2024-05-20T17:53:31.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.814+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfec06c530 con 0x7fbfec0b8190 2024-05-20T17:53:31.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.815+0000 7fbfe27fc640 1 -- 172.21.15.6:0/474659438 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fbfdc059770 con 0x7fbfec0b8190 2024-05-20T17:53:31.815 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:31.815 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfd006be30 msgr2=0x7fbfd006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfd006be30 0x7fbfd006e340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006fd0 tx=0x7fbfe8008040 comp rx=0 tx=0).stop 2024-05-20T17:53:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 msgr2=0x7fbfec15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec15ae20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c7f0 tx=0x7fbfdc00ccb0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 shutdown_connections 2024-05-20T17:53:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfd006be30 0x7fbfd006e340 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfec162820 0x7fbfec1f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfec0b8190 0x7fbfec15ae20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 --2- 172.21.15.6:0/474659438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfec06d3d0 0x7fbfec147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 >> 172.21.15.6:0/474659438 conn(0x7fbfec0d4bd0 msgr2=0x7fbfec15e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 shutdown_connections 2024-05-20T17:53:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.817+0000 7fbff40fe640 1 -- 172.21.15.6:0/474659438 wait complete. 2024-05-20T17:53:31.828 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-20T17:53:31.829 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:31.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.944+0000 7fef4d784640 1 Processor -- start 2024-05-20T17:53:31.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.945+0000 7fef4d784640 1 -- start start 2024-05-20T17:53:31.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef4d784640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fef48168050 0x7fef4816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef4d784640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef480d0630 con 0x7fef48162820 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef4d784640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef480d39c0 con 0x7fef4806d3d0 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef4d784640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fef480d3ca0 con 0x7fef48168050 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef46ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef48162820 0x7fef480b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39588/0 (socket says 172.21.15.6:39588) 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef46ffd640 1 -- 172.21.15.6:0/2061865457 learned_addr learned my addr 172.21.15.6:0/2061865457 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef477fe640 1 --2- 172.21.15.6:0/2061865457 >> v2:172.21.15.171:3300/0 conn(0x7fef48168050 0x7fef4816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3140486256 0 0) 0x7fef480d0630 con 0x7fef48162820 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.946+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef34003520 con 0x7fef48162820 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 475633402 0 0) 0x7fef34003520 con 0x7fef48162820 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 >> v2:172.21.15.171:3300/0 conn(0x7fef48168050 msgr2=0x7fef4816a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 --2- 172.21.15.6:0/2061865457 >> v2:172.21.15.171:3300/0 conn(0x7fef48168050 0x7fef4816a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 >> v1:172.21.15.171:6789/0 conn(0x7fef4806d3d0 legacy=0x7fef4806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480d3f80 con 0x7fef48162820 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fef38001670 con 0x7fef48162820 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 >> v1:172.21.15.6:6789/0 conn(0x7fef48162820 legacy=0x7fef480b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef340039b0 0x7fef34003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34004800 0x7fef34004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef340051c0 0x7fef3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fef480d3ca0 con 0x7fef34004800 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef3400c160 con 0x7fef340039b0 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef3400c360 con 0x7fef340051c0 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef467fc640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34004800 0x7fef34004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef46ffd640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef340039b0 0x7fef34003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef477fe640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef340051c0 0x7fef3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef467fc640 1 -- 172.21.15.6:0/2061865457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef340051c0 msgr2=0x7fef3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef467fc640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef340051c0 0x7fef3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef467fc640 1 -- 172.21.15.6:0/2061865457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef340039b0 msgr2=0x7fef34003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef467fc640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef340039b0 0x7fef34003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef467fc640 1 -- 172.21.15.6:0/2061865457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef34003520 con 0x7fef34004800 2024-05-20T17:53:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.947+0000 7fef477fe640 1 -- 172.21.15.6:0/2061865457 reap_dead start 2024-05-20T17:53:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.948+0000 7fef467fc640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34004800 0x7fef34004c10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef30001750 tx=0x7fef34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2002008e478427 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.948+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30001370 con 0x7fef34004800 2024-05-20T17:53:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.948+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef300052d0 con 0x7fef34004800 2024-05-20T17:53:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.948+0000 7fef45ffb640 1 -- 172.21.15.6:0/2061865457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3002abc0 con 0x7fef34004800 2024-05-20T17:53:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.949+0000 7fef4d784640 1 -- 172.21.15.6:0/2061865457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34004800 msgr2=0x7fef34004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.949+0000 7fef4d784640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34004800 0x7fef34004c10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef30001750 tx=0x7fef34005830 comp rx=0 tx=0).stop 2024-05-20T17:53:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.949+0000 7fef4d784640 1 -- 172.21.15.6:0/2061865457 shutdown_connections 2024-05-20T17:53:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.949+0000 7fef4d784640 1 --2- 172.21.15.6:0/2061865457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef34004800 0x7fef34004c10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.949+0000 7fef4d784640 1 -- 172.21.15.6:0/2061865457 >> 172.21.15.6:0/2061865457 conn(0x7fef480d4bd0 msgr2=0x7fef480d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.949+0000 7fef4d784640 1 -- 172.21.15.6:0/2061865457 shutdown_connections 2024-05-20T17:53:31.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.949+0000 7fef4d784640 1 -- 172.21.15.6:0/2061865457 wait complete. 2024-05-20T17:53:31.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.951+0000 7fef4d784640 1 Processor -- start 2024-05-20T17:53:31.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.951+0000 7fef4d784640 1 -- start start 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef4d784640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef34004800 0x7fef480c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef4d784640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef481573f0 0x7fef480ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef4d784640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef480cd420 0x7fef4815de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef4d784640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fef480d4780 con 0x7fef481573f0 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef4d784640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef480d0300 con 0x7fef480cd420 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef4d784640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef480d4900 con 0x7fef34004800 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef467fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef481573f0 0x7fef480ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef467fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef481573f0 0x7fef480ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46176/0 (socket says 172.21.15.6:46176) 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef467fc640 1 -- 172.21.15.6:0/914103257 learned_addr learned my addr 172.21.15.6:0/914103257 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef46ffd640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef34004800 0x7fef480c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.952+0000 7fef477fe640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef480cd420 0x7fef4815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef467fc640 1 -- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef34004800 msgr2=0x7fef480c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef467fc640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef34004800 0x7fef480c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef467fc640 1 -- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef480cd420 msgr2=0x7fef4815de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef467fc640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef480cd420 0x7fef4815de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef467fc640 1 -- 172.21.15.6:0/914103257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480cde80 con 0x7fef481573f0 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef477fe640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef480cd420 0x7fef4815de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef467fc640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef481573f0 0x7fef480ccee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fef30000c00 tx=0x7fef30001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef3f7fe640 1 -- 172.21.15.6:0/914103257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30037040 con 0x7fef481573f0 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef3f7fe640 1 -- 172.21.15.6:0/914103257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef30005480 con 0x7fef481573f0 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef480ce160 con 0x7fef481573f0 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef3f7fe640 1 -- 172.21.15.6:0/914103257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30001370 con 0x7fef481573f0 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.953+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef480c9e40 con 0x7fef481573f0 2024-05-20T17:53:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.954+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef480ce680 con 0x7fef481573f0 2024-05-20T17:53:31.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.955+0000 7fef3f7fe640 1 -- 172.21.15.6:0/914103257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef30043020 con 0x7fef481573f0 2024-05-20T17:53:31.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.955+0000 7fef3f7fe640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef2806be60 0x7fef2806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:31.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.955+0000 7fef3f7fe640 1 -- 172.21.15.6:0/914103257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fef300aa640 con 0x7fef481573f0 2024-05-20T17:53:31.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.956+0000 7fef46ffd640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef2806be60 0x7fef2806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:31.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.956+0000 7fef46ffd640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef2806be60 0x7fef2806e370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef38001050 tx=0x7fef380078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:31.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:31.960+0000 7fef3f7fe640 1 -- 172.21.15.6:0/914103257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fef480ce680 con 0x7fef481573f0 2024-05-20T17:53:32.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.148+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef48075b00 con 0x7fef481573f0 2024-05-20T17:53:32.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.149+0000 7fef3f7fe640 1 -- 172.21.15.6:0/914103257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fef3004a020 con 0x7fef481573f0 2024-05-20T17:53:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:32.149 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef2806be60 msgr2=0x7fef2806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef2806be60 0x7fef2806e370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef38001050 tx=0x7fef380078f0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef481573f0 msgr2=0x7fef480ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef481573f0 0x7fef480ccee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fef30000c00 tx=0x7fef30001120 comp rx=0 tx=0).stop 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 shutdown_connections 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef2806be60 0x7fef2806e370 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef480cd420 0x7fef4815de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef481573f0 0x7fef480ccee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 --2- 172.21.15.6:0/914103257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef34004800 0x7fef480c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 >> 172.21.15.6:0/914103257 conn(0x7fef480d4bd0 msgr2=0x7fef480b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 shutdown_connections 2024-05-20T17:53:32.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.151+0000 7fef4d784640 1 -- 172.21.15.6:0/914103257 wait complete. 2024-05-20T17:53:32.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-20T17:53:32.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-20T17:53:32.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-20T17:53:32.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-20T17:53:32.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-20T17:53:32.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-20T17:53:32.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-20T17:53:32.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-20T17:53:32.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.392+0000 7f77cbfff640 1 Processor -- start 2024-05-20T17:53:32.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.392+0000 7f77cbfff640 1 -- start start 2024-05-20T17:53:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7fa737440640 1 Processor -- start 2024-05-20T17:53:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7f1382738640 1 Processor -- start 2024-05-20T17:53:32.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7fa737440640 1 -- start start 2024-05-20T17:53:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7f77cbfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77c4052fb0 0x7f77c404f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7f77cbfff640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c40e8230 con 0x7f77c4034180 2024-05-20T17:53:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7f77cbfff640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c4006280 con 0x7f77c4007320 2024-05-20T17:53:32.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7f77cbfff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f77c40533c0 con 0x7f77c4052fb0 2024-05-20T17:53:32.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7f1382738640 1 -- start start 2024-05-20T17:53:32.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.395+0000 7f77cb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f77c4034180 0x7f77c4038340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39600/0 (socket says 172.21.15.6:39600) 2024-05-20T17:53:32.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.395+0000 7f77cb7fe640 1 -- 172.21.15.6:0/2526262995 learned_addr learned my addr 172.21.15.6:0/2526262995 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:32.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.394+0000 7f5d315e3640 1 Processor -- start 2024-05-20T17:53:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.395+0000 7f77caffd640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77c4052fb0 0x7f77c404f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.395+0000 7f5d315e3640 1 -- start start 2024-05-20T17:53:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635808033 0 0) 0x7f77c4006280 con 0x7f77c4007320 2024-05-20T17:53:32.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b4003520 con 0x7f77c4007320 2024-05-20T17:53:32.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f1382738640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f13740386d0 0x7f1374006b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f1382738640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1374057940 con 0x7f13740e47f0 2024-05-20T17:53:32.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7fa73643e640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa7280e4110 0x7fa728050d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:49326/0 (socket says 172.21.15.6:49326) 2024-05-20T17:53:32.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7fa73643e640 1 -- 172.21.15.6:0/4115261546 learned_addr learned my addr 172.21.15.6:0/4115261546 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:32.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7fa737440640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 0x7fa7280553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7faa66c67640 1 Processor -- start 2024-05-20T17:53:32.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f1382738640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1374057c20 con 0x7f13740382c0 2024-05-20T17:53:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f1382738640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f137403c1c0 con 0x7f13740386d0 2024-05-20T17:53:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f137bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f13740e47f0 0x7f1374037bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39612/0 (socket says 172.21.15.6:39612) 2024-05-20T17:53:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f137bfff640 1 -- 172.21.15.6:0/2479709722 learned_addr learned my addr 172.21.15.6:0/2479709722 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7fe0e1948640 1 Processor -- start 2024-05-20T17:53:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7fa737440640 1 -- 172.21.15.6:0/4115261546 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7280e5000 con 0x7fa728051450 2024-05-20T17:53:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7fa737440640 1 -- 172.21.15.6:0/4115261546 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7280e4760 con 0x7fa7280e4110 2024-05-20T17:53:32.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7fa737440640 1 -- 172.21.15.6:0/4115261546 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa7280e4520 con 0x7fa728009490 2024-05-20T17:53:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780236928 0 0) 0x7f1374057940 con 0x7f13740e47f0 2024-05-20T17:53:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f136c003520 con 0x7f13740e47f0 2024-05-20T17:53:32.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7fa736c3f640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 0x7fa7280553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f5d315e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24052fe0 0x7f5d2404f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661700720 0 0) 0x7fa7280e5000 con 0x7fa728051450 2024-05-20T17:53:32.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598214139 0 0) 0x7f1374057c20 con 0x7f13740382c0 2024-05-20T17:53:32.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa71c003520 con 0x7fa728051450 2024-05-20T17:53:32.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596316640 0 0) 0x7fa7280e4760 con 0x7fa7280e4110 2024-05-20T17:53:32.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7280e5000 con 0x7fa7280e4110 2024-05-20T17:53:32.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1374057940 con 0x7f13740382c0 2024-05-20T17:53:32.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7fe0e1948640 1 -- start start 2024-05-20T17:53:32.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f1380cd5640 1 --2- 172.21.15.6:0/2479709722 >> v2:172.21.15.171:3300/0 conn(0x7f13740386d0 0x7f1374006b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960787040 0 0) 0x7f77c40e8230 con 0x7f77c4034180 2024-05-20T17:53:32.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7faa66c67640 1 -- start start 2024-05-20T17:53:32.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1742181075 0 0) 0x7fa7280e5000 con 0x7fa7280e4110 2024-05-20T17:53:32.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b4003880 con 0x7f77c4034180 2024-05-20T17:53:32.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3554466493 0 0) 0x7f77b4003880 con 0x7f77c4034180 2024-05-20T17:53:32.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77c4052fb0 msgr2=0x7f77c404f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f77c9ffb640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77c4052fb0 0x7f77c404f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.396+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 >> v1:172.21.15.171:6789/0 conn(0x7f77c4007320 legacy=0x7f77c4033a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c4006560 con 0x7f77c4034180 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f77c0001650 con 0x7f77c4034180 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 >> v1:172.21.15.6:6789/0 conn(0x7f77c4034180 legacy=0x7f77c4038340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b4003dc0 0x7f77b4004250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b4004870 0x7f77b4004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b40099b0 0x7f77b400bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f77c40533c0 con 0x7f77b4004870 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77b401d510 con 0x7f77b4003dc0 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f77b401d710 con 0x7f77b40099b0 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77ca7fc640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b4004870 0x7f77b4004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 msgr2=0x7fa7280553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 27568720 0 0) 0x7f1374057940 con 0x7f13740382c0 2024-05-20T17:53:32.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 0x7fa7280553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 >> v2:172.21.15.171:3300/0 conn(0x7f13740386d0 msgr2=0x7f1374006b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 >> v1:172.21.15.6:6789/0 conn(0x7fa728051450 legacy=0x7fa7280e05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 --2- 172.21.15.6:0/2479709722 >> v2:172.21.15.171:3300/0 conn(0x7f13740386d0 0x7f1374006b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 >> v1:172.21.15.6:6789/0 conn(0x7f13740e47f0 legacy=0x7f1374037bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7280e4a40 con 0x7fa7280e4110 2024-05-20T17:53:32.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1374057f00 con 0x7f13740382c0 2024-05-20T17:53:32.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f1368001690 con 0x7f13740382c0 2024-05-20T17:53:32.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7fa736c3f640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 0x7fa7280553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:32.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7feede523640 1 Processor -- start 2024-05-20T17:53:32.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7feede523640 1 -- start start 2024-05-20T17:53:32.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 >> v1:172.21.15.171:6789/0 conn(0x7f13740382c0 legacy=0x7f1374006420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137affd640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f136c003b40 0x7f136c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fa72c001670 con 0x7fa7280e4110 2024-05-20T17:53:32.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137affd640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f136c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137affd640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f136c0053f0 0x7f136c00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 >> v1:172.21.15.171:6789/0 conn(0x7fa7280e4110 legacy=0x7fa728050d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f137403c1c0 con 0x7f136c0053f0 2024-05-20T17:53:32.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f136c00c360 con 0x7f136c003b40 2024-05-20T17:53:32.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f136c00c560 con 0x7f136c004800 2024-05-20T17:53:32.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73543c640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa71c004ba0 0x7fa71c004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137b7fe640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f136c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137bfff640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f136c003b40 0x7f136c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73543c640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c0037a0 0x7fa71c003bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137b7fe640 1 -- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f136c003b40 msgr2=0x7f136c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137b7fe640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f136c003b40 0x7f136c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137b7fe640 1 -- 172.21.15.6:0/2479709722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f136c0053f0 msgr2=0x7f136c00ba80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:53:32.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137b7fe640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f136c0053f0 0x7f136c00ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f137b7fe640 1 -- 172.21.15.6:0/2479709722 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1374057940 con 0x7f136c004800 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73643e640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa71c004ba0 0x7fa71c004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73543c640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 0x7fa71c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7280e4520 con 0x7fa71c004ba0 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c0044f0 con 0x7fa71c0037a0 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c00e110 con 0x7fa728009490 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7fa735c3d640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c0037a0 0x7fa71c003bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fa736c3f640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 0x7fa71c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fa73643e640 1 -- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 msgr2=0x7fa71c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fa73643e640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 0x7fa71c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fa73643e640 1 -- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c0037a0 msgr2=0x7fa71c003bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fa73643e640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c0037a0 0x7fa71c003bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fa73643e640 1 -- 172.21.15.6:0/4115261546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7280e5000 con 0x7fa71c004ba0 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fa736c3f640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728009490 0x7fa71c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f5d315e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d240341b0 0x7f5d24038370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f5d315e3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d240e8260 con 0x7f5d24007350 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f5d315e3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5d240533f0 con 0x7f5d240341b0 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f5d315e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5d240062b0 con 0x7f5d24052fe0 2024-05-20T17:53:32.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f5d2affd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24052fe0 0x7f5d2404f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f5d2affd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24052fe0 0x7f5d2404f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49746/0 (socket says 172.21.15.6:49746) 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f5d2affd640 1 -- 172.21.15.6:0/3255439076 learned_addr learned my addr 172.21.15.6:0/3255439076 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f5d2b7fe640 1 --2- 172.21.15.6:0/3255439076 >> v2:172.21.15.6:3300/0 conn(0x7f5d240341b0 0x7f5d24038370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f5d2affd640 1 -- 172.21.15.6:0/3255439076 >> v2:172.21.15.6:3300/0 conn(0x7f5d240341b0 msgr2=0x7f5d24038370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f5d2affd640 1 --2- 172.21.15.6:0/3255439076 >> v2:172.21.15.6:3300/0 conn(0x7f5d240341b0 0x7f5d24038370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f5d2affd640 1 -- 172.21.15.6:0/3255439076 >> v1:172.21.15.6:6789/0 conn(0x7f5d24007350 legacy=0x7f5d24033aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.399+0000 7f5d2affd640 1 -- 172.21.15.6:0/3255439076 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d24006590 con 0x7f5d24052fe0 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7f5d2affd640 1 --2- 172.21.15.6:0/3255439076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24052fe0 0x7f5d2404f370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c000b60 tx=0x7f5d2c0a5fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=624abef4a953fd3e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7f5d29ffb640 1 -- 172.21.15.6:0/3255439076 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0b3070 con 0x7f5d24052fe0 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7f5d29ffb640 1 -- 172.21.15.6:0/3255439076 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d2c0a6bd0 con 0x7f5d24052fe0 2024-05-20T17:53:32.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7f5d29ffb640 1 -- 172.21.15.6:0/3255439076 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0ae640 con 0x7f5d24052fe0 2024-05-20T17:53:32.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fe0e1948640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0d4054240 0x7fe0d40eb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7f1380cd5640 1 -- 172.21.15.6:0/2479709722 reap_dead start 2024-05-20T17:53:32.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fe0e1948640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0d40ebc90 0x7fe0d40ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7f137b7fe640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f136c004c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1368007f90 tx=0x7f136c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ee73c6502c0ee9c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7fe0e1948640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe0d4057690 0x7fe0d4057aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7faa66c67640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa600d0110 0x7faa6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7faa66c67640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6015f7f0 0x7faa6015fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7faa66c67640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faa600ced60 0x7faa600cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7faa66c67640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7faa6006fbd0 con 0x7faa600d0110 2024-05-20T17:53:32.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7faa66c67640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7faa60160140 con 0x7faa600ced60 2024-05-20T17:53:32.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.400+0000 7faa66c67640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa60162b60 con 0x7faa6015f7f0 2024-05-20T17:53:32.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368036070 con 0x7f136c004800 2024-05-20T17:53:32.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1368031600 con 0x7f136c004800 2024-05-20T17:53:32.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7fe0e1948640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d4006af0 con 0x7fe0d40ebc90 2024-05-20T17:53:32.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7fe0e1948640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d4006dd0 con 0x7fe0d4057690 2024-05-20T17:53:32.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7fe0dbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0d40ebc90 0x7fe0d40ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7f137affd640 1 -- 172.21.15.6:0/2479709722 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368007be0 con 0x7f136c004800 2024-05-20T17:53:32.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7feede523640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7feed8170180 0x7feed806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7fe0e1948640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d40070b0 con 0x7fe0d4054240 2024-05-20T17:53:32.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7fe0dbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0d40ebc90 0x7fe0d40ec0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46230/0 (socket says 172.21.15.6:46230) 2024-05-20T17:53:32.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7fe0dbfff640 1 -- 172.21.15.6:0/44223252 learned_addr learned my addr 172.21.15.6:0/44223252 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7fe0e0946640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0d4054240 0x7fe0d40eb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77cb7fe640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b40099b0 0x7f77b400bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.397+0000 7f77caffd640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b4003dc0 0x7f77b4004250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f77cb7fe640 1 -- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b4003dc0 msgr2=0x7f77b4004250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f77cb7fe640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b4003dc0 0x7f77b4004250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f77cb7fe640 1 -- 172.21.15.6:0/2526262995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b4004870 msgr2=0x7f77b4004d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f77cb7fe640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b4004870 0x7f77b4004d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f77cb7fe640 1 -- 172.21.15.6:0/2526262995 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c4006560 con 0x7f77b40099b0 2024-05-20T17:53:32.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.398+0000 7f77ca7fc640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77b4004870 0x7f77b4004d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7feede523640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feed8170590 con 0x7feed806c530 2024-05-20T17:53:32.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7feedd521640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7feed8170180 0x7feed806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7fe0e1147640 1 --2- 172.21.15.6:0/44223252 >> v2:172.21.15.171:3300/0 conn(0x7fe0d4057690 0x7fe0d4057aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7feedd521640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7feed8170180 0x7feed806f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54068/0 (socket says 172.21.15.6:54068) 2024-05-20T17:53:32.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7feedd521640 1 -- 172.21.15.6:0/1852918062 learned_addr learned my addr 172.21.15.6:0/1852918062 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7feede523640 1 -- 172.21.15.6:0/1852918062 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feed806e350 con 0x7feed806f930 2024-05-20T17:53:32.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7feede523640 1 -- 172.21.15.6:0/1852918062 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7feed806e100 con 0x7feed8170180 2024-05-20T17:53:32.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fa73643e640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa71c004ba0 0x7fa71c004fd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa72c004f80 tx=0x7fa71c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4e4aef5cfc028f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7feecffff640 1 -- 172.21.15.6:0/1852918062 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888357508 0 0) 0x7feed806e350 con 0x7feed806f930 2024-05-20T17:53:32.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7feecffff640 1 -- 172.21.15.6:0/1852918062 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feec4003520 con 0x7feed806f930 2024-05-20T17:53:32.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7feedd521640 1 -- 172.21.15.6:0/1852918062 >> v1:172.21.15.171:6789/0 conn(0x7feed806f930 legacy=0x7feed80b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7feedd521640 1 -- 172.21.15.6:0/1852918062 >> v1:172.21.15.6:6789/0 conn(0x7feed806c530 legacy=0x7feed806c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7feedd521640 1 -- 172.21.15.6:0/1852918062 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed806e630 con 0x7feed8170180 2024-05-20T17:53:32.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c004b80 con 0x7fa71c004ba0 2024-05-20T17:53:32.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f1382738640 1 -- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 msgr2=0x7f136c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f1382738640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f136c004c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1368007f90 tx=0x7f136c005830 comp rx=0 tx=0).stop 2024-05-20T17:53:32.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c02f030 con 0x7fa71c004ba0 2024-05-20T17:53:32.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fa73543c640 1 -- 172.21.15.6:0/4115261546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c005d10 con 0x7fa71c004ba0 2024-05-20T17:53:32.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f5d315e3640 1 -- 172.21.15.6:0/3255439076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24052fe0 msgr2=0x7f5d2404f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f5d315e3640 1 --2- 172.21.15.6:0/3255439076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24052fe0 0x7f5d2404f370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c000b60 tx=0x7f5d2c0a5fd0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f1382738640 1 -- 172.21.15.6:0/2479709722 shutdown_connections 2024-05-20T17:53:32.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f1382738640 1 --2- 172.21.15.6:0/2479709722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f136c004c10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f1382738640 1 -- 172.21.15.6:0/2479709722 >> 172.21.15.6:0/2479709722 conn(0x7f1374059140 msgr2=0x7f1374059550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f5d315e3640 1 -- 172.21.15.6:0/3255439076 shutdown_connections 2024-05-20T17:53:32.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f5d315e3640 1 --2- 172.21.15.6:0/3255439076 >> v2:172.21.15.6:3300/0 conn(0x7f5d240341b0 0x7f5d24038370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f5d315e3640 1 --2- 172.21.15.6:0/3255439076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24052fe0 0x7f5d2404f370 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f5d315e3640 1 -- 172.21.15.6:0/3255439076 >> 172.21.15.6:0/3255439076 conn(0x7f5d24054d20 msgr2=0x7f5d24055130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f1382738640 1 -- 172.21.15.6:0/2479709722 shutdown_connections 2024-05-20T17:53:32.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7f77cb7fe640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b40099b0 0x7f77b400bdd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77c4055b10 tx=0x7f77b4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c56399f706e11d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c0007d50 con 0x7f77b40099b0 2024-05-20T17:53:32.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fe0e1147640 1 -- 172.21.15.6:0/44223252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0d4054240 msgr2=0x7fe0d40eb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fe0e1147640 1 --2- 172.21.15.6:0/44223252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0d4054240 0x7fe0d40eb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fe0e1147640 1 -- 172.21.15.6:0/44223252 >> v2:172.21.15.6:3300/0 conn(0x7fe0d40ebc90 msgr2=0x7fe0d40ec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7faa64a03640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa600d0110 0x7faa6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7faa64a03640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa600d0110 0x7faa6006e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46246/0 (socket says 172.21.15.6:46246) 2024-05-20T17:53:32.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7faa64a03640 1 -- 172.21.15.6:0/2465397545 learned_addr learned my addr 172.21.15.6:0/2465397545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fe0e1147640 1 --2- 172.21.15.6:0/44223252 >> v2:172.21.15.6:3300/0 conn(0x7fe0d40ebc90 0x7fe0d40ec0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7fe0e1147640 1 -- 172.21.15.6:0/44223252 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d4007390 con 0x7fe0d4057690 2024-05-20T17:53:32.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7faa64a03640 1 -- 172.21.15.6:0/2465397545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6015f7f0 msgr2=0x7faa6015fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.401+0000 7faa5ffff640 1 --2- 172.21.15.6:0/2465397545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6015f7f0 0x7faa6015fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7faa64a03640 1 --2- 172.21.15.6:0/2465397545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6015f7f0 0x7faa6015fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7faa64a03640 1 -- 172.21.15.6:0/2465397545 >> v2:172.21.15.171:3300/0 conn(0x7faa600ced60 msgr2=0x7faa600cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.402+0000 7faa65204640 1 --2- 172.21.15.6:0/2465397545 >> v2:172.21.15.171:3300/0 conn(0x7faa600ced60 0x7faa600cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7faa64a03640 1 --2- 172.21.15.6:0/2465397545 >> v2:172.21.15.171:3300/0 conn(0x7faa600ced60 0x7faa600cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7faa64a03640 1 -- 172.21.15.6:0/2465397545 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6006efc0 con 0x7faa600d0110 2024-05-20T17:53:32.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c0005ad0 con 0x7f77b40099b0 2024-05-20T17:53:32.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7f77c9ffb640 1 -- 172.21.15.6:0/2526262995 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c0007d50 con 0x7f77b40099b0 2024-05-20T17:53:32.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7f5d315e3640 1 -- 172.21.15.6:0/3255439076 shutdown_connections 2024-05-20T17:53:32.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7fe0e1147640 1 --2- 172.21.15.6:0/44223252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4057690 0x7fe0d4057aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0504d0 tx=0x7fe0dc0a6040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adbd76da2c99af1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7f1382738640 1 -- 172.21.15.6:0/2479709722 wait complete. 2024-05-20T17:53:32.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7feedd521640 1 --2- 172.21.15.6:0/1852918062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8170180 0x7feed806f3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feed4009870 tx=0x7feed402a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e5c217e2bc62d55 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7f48c3fff640 1 Processor -- start 2024-05-20T17:53:32.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7feecffff640 1 -- 172.21.15.6:0/1852918062 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4037070 con 0x7feed8170180 2024-05-20T17:53:32.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7feecffff640 1 -- 172.21.15.6:0/1852918062 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed4032440 con 0x7feed8170180 2024-05-20T17:53:32.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7feecffff640 1 -- 172.21.15.6:0/1852918062 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4032810 con 0x7feed8170180 2024-05-20T17:53:32.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7fe0db7fe640 1 -- 172.21.15.6:0/44223252 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0b3070 con 0x7fe0d4057690 2024-05-20T17:53:32.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7fe0db7fe640 1 -- 172.21.15.6:0/44223252 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0a6c40 con 0x7fe0d4057690 2024-05-20T17:53:32.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7fe0db7fe640 1 -- 172.21.15.6:0/44223252 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0ae640 con 0x7fe0d4057690 2024-05-20T17:53:32.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7fa737440640 1 -- 172.21.15.6:0/4115261546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa71c004ba0 msgr2=0x7fa71c004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7f5d315e3640 1 -- 172.21.15.6:0/3255439076 wait complete. 2024-05-20T17:53:32.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7fa737440640 1 --2- 172.21.15.6:0/4115261546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa71c004ba0 0x7fa71c004fd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa72c004f80 tx=0x7fa71c005830 comp rx=0 tx=0).stop 2024-05-20T17:53:32.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7fa736c3f640 1 -- 172.21.15.6:0/4115261546 reap_dead start 2024-05-20T17:53:32.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7f77cbfff640 1 -- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b40099b0 msgr2=0x7f77b400bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7fa737440640 1 -- 172.21.15.6:0/4115261546 shutdown_connections 2024-05-20T17:53:32.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7fa737440640 1 -- 172.21.15.6:0/4115261546 >> 172.21.15.6:0/4115261546 conn(0x7fa728055e00 msgr2=0x7fa728056210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7f77cbfff640 1 --2- 172.21.15.6:0/2526262995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b40099b0 0x7f77b400bdd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77c4055b10 tx=0x7f77b4005830 comp rx=0 tx=0).stop 2024-05-20T17:53:32.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7faa5ffff640 1 --2- 172.21.15.6:0/2465397545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6015f7f0 0x7faa6015fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:32.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7faa64a03640 1 --2- 172.21.15.6:0/2465397545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa600d0110 0x7faa6006e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faa600b0260 tx=0x7faa4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d727ed63a00ddc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7fa737440640 1 -- 172.21.15.6:0/4115261546 shutdown_connections 2024-05-20T17:53:32.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7f77cb7fe640 1 -- 172.21.15.6:0/2526262995 reap_dead start 2024-05-20T17:53:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7f77cbfff640 1 -- 172.21.15.6:0/2526262995 shutdown_connections 2024-05-20T17:53:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7fa737440640 1 -- 172.21.15.6:0/4115261546 wait complete. 2024-05-20T17:53:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7fe0e1948640 1 -- 172.21.15.6:0/44223252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4057690 msgr2=0x7fe0d4057aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7fe0e1948640 1 --2- 172.21.15.6:0/44223252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4057690 0x7fe0d4057aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0504d0 tx=0x7fe0dc0a6040 comp rx=0 tx=0).stop 2024-05-20T17:53:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7f77cbfff640 1 -- 172.21.15.6:0/2526262995 >> 172.21.15.6:0/2526262995 conn(0x7f77c4054cf0 msgr2=0x7f77c4055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7feede523640 1 -- 172.21.15.6:0/1852918062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8170180 msgr2=0x7feed806f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7feede523640 1 --2- 172.21.15.6:0/1852918062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8170180 0x7feed806f3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feed4009870 tx=0x7feed402a2a0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7faa5f7fe640 1 -- 172.21.15.6:0/2465397545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c037070 con 0x7faa600d0110 2024-05-20T17:53:32.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.403+0000 7f48c3fff640 1 -- start start 2024-05-20T17:53:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7f77cbfff640 1 -- 172.21.15.6:0/2526262995 shutdown_connections 2024-05-20T17:53:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.404+0000 7faa5f7fe640 1 -- 172.21.15.6:0/2465397545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4c032440 con 0x7faa600d0110 2024-05-20T17:53:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7faa5f7fe640 1 -- 172.21.15.6:0/2465397545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c032810 con 0x7faa600d0110 2024-05-20T17:53:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7faa66c67640 1 -- 172.21.15.6:0/2465397545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa600d0110 msgr2=0x7faa6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7faa66c67640 1 --2- 172.21.15.6:0/2465397545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa600d0110 0x7faa6006e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faa600b0260 tx=0x7faa4c02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7f77cbfff640 1 -- 172.21.15.6:0/2526262995 wait complete. 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7feede523640 1 -- 172.21.15.6:0/1852918062 shutdown_connections 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7feede523640 1 --2- 172.21.15.6:0/1852918062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed8170180 0x7feed806f3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7feede523640 1 -- 172.21.15.6:0/1852918062 >> 172.21.15.6:0/1852918062 conn(0x7feed80721d0 msgr2=0x7feed80725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7fe0e1948640 1 -- 172.21.15.6:0/44223252 shutdown_connections 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7fe0e1948640 1 --2- 172.21.15.6:0/44223252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4057690 0x7fe0d4057aa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7fe0e1948640 1 --2- 172.21.15.6:0/44223252 >> v2:172.21.15.6:3300/0 conn(0x7fe0d40ebc90 0x7fe0d40ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7fe0e1948640 1 --2- 172.21.15.6:0/44223252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0d4054240 0x7fe0d40eb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7fe0e1948640 1 -- 172.21.15.6:0/44223252 >> 172.21.15.6:0/44223252 conn(0x7fe0d403ac60 msgr2=0x7fe0d403b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7fe0e1948640 1 -- 172.21.15.6:0/44223252 shutdown_connections 2024-05-20T17:53:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.405+0000 7fe0e1948640 1 -- 172.21.15.6:0/44223252 wait complete. 2024-05-20T17:53:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7faa66c67640 1 -- 172.21.15.6:0/2465397545 shutdown_connections 2024-05-20T17:53:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7faa66c67640 1 --2- 172.21.15.6:0/2465397545 >> v2:172.21.15.171:3300/0 conn(0x7faa600ced60 0x7faa600cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7faa66c67640 1 --2- 172.21.15.6:0/2465397545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6015f7f0 0x7faa6015fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7faa66c67640 1 --2- 172.21.15.6:0/2465397545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa600d0110 0x7faa6006e770 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faa600b0260 tx=0x7faa4c02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7faa66c67640 1 -- 172.21.15.6:0/2465397545 >> 172.21.15.6:0/2465397545 conn(0x7faa600d0650 msgr2=0x7faa600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7f1382738640 1 Processor -- start 2024-05-20T17:53:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7feede523640 1 -- 172.21.15.6:0/1852918062 shutdown_connections 2024-05-20T17:53:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7feede523640 1 -- 172.21.15.6:0/1852918062 wait complete. 2024-05-20T17:53:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7f5d315e3640 1 Processor -- start 2024-05-20T17:53:32.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.406+0000 7f1382738640 1 -- start start 2024-05-20T17:53:32.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f5d315e3640 1 -- start start 2024-05-20T17:53:32.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7faa66c67640 1 -- 172.21.15.6:0/2465397545 shutdown_connections 2024-05-20T17:53:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f48c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c40cebf0 0x7f48c415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f48c3fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f48c40b2b40 0x7f48c40b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f48c3fff640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c40b6e40 con 0x7f48c40b6a30 2024-05-20T17:53:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f48c3fff640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f48c40ce720 con 0x7f48c40cebf0 2024-05-20T17:53:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f48c3fff640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f48c40cf540 con 0x7f48c40b2b40 2024-05-20T17:53:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7fa737440640 1 Processor -- start 2024-05-20T17:53:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7faa66c67640 1 -- 172.21.15.6:0/2465397545 wait complete. 2024-05-20T17:53:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f48c2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c40cebf0 0x7f48c415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f48c2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c40cebf0 0x7f48c415c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46254/0 (socket says 172.21.15.6:46254) 2024-05-20T17:53:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7f48c2ffd640 1 -- 172.21.15.6:0/2890180830 learned_addr learned my addr 172.21.15.6:0/2890180830 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.407+0000 7fa737440640 1 -- start start 2024-05-20T17:53:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.408+0000 7fe0e1948640 1 Processor -- start 2024-05-20T17:53:32.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.408+0000 7fe0e1948640 1 -- start start 2024-05-20T17:53:32.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f5d315e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24007350 0x7f5d240e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f5d315e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d24052fe0 0x7f5d240df790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f1382738640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f13740d9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.408+0000 7f48c2ffd640 1 -- 172.21.15.6:0/2890180830 >> v2:172.21.15.171:3300/0 conn(0x7f48c40b2b40 msgr2=0x7f48c40b64f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:53:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.408+0000 7f48c2ffd640 1 --2- 172.21.15.6:0/2890180830 >> v2:172.21.15.171:3300/0 conn(0x7f48c40b2b40 0x7f48c40b64f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.408+0000 7f48c2ffd640 1 -- 172.21.15.6:0/2890180830 >> v1:172.21.15.171:6789/0 conn(0x7f48c40b6a30 legacy=0x7f48c40cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.408+0000 7f48c2ffd640 1 -- 172.21.15.6:0/2890180830 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c40d2070 con 0x7f48c40cebf0 2024-05-20T17:53:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f5d315e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d240dff90 0x7f5d2416d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f5d315e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24006e30 con 0x7f5d240dff90 2024-05-20T17:53:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f1382738640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13740529e0 0x7f137403b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f5d315e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24006b50 con 0x7f5d24052fe0 2024-05-20T17:53:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f5d315e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5d24007760 con 0x7f5d24007350 2024-05-20T17:53:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f137b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13740529e0 0x7f137403b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7feede523640 1 Processor -- start 2024-05-20T17:53:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f77cbfff640 1 Processor -- start 2024-05-20T17:53:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7feede523640 1 -- start start 2024-05-20T17:53:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f48c2ffd640 1 --2- 172.21.15.6:0/2890180830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40cebf0 0x7f48c415c010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f48c415f9e0 tx=0x7f48b402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f70d4b5b378bba4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f77cbfff640 1 -- start start 2024-05-20T17:53:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24007350 0x7f5d240e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24007350 0x7f5d240e35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49800/0 (socket says 172.21.15.6:49800) 2024-05-20T17:53:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 -- 172.21.15.6:0/706107132 learned_addr learned my addr 172.21.15.6:0/706107132 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2a7fc640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d24052fe0 0x7f5d240df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f137bfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f13740d9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f137b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13740529e0 0x7f137403b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46280/0 (socket says 172.21.15.6:46280) 2024-05-20T17:53:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f48c1ffb640 1 -- 172.21.15.6:0/2890180830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b40325f0 con 0x7f48c40cebf0 2024-05-20T17:53:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f137bfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f13740d9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49796/0 (socket says 172.21.15.6:49796) 2024-05-20T17:53:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f48c1ffb640 1 -- 172.21.15.6:0/2890180830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b4032790 con 0x7f48c40cebf0 2024-05-20T17:53:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 -- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d24052fe0 msgr2=0x7f5d240df790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d24052fe0 0x7f5d240df790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 -- 172.21.15.6:0/706107132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d240dff90 msgr2=0x7f5d2416d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d240dff90 0x7f5d2416d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 -- 172.21.15.6:0/706107132 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d240dfcd0 con 0x7f5d24007350 2024-05-20T17:53:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2a7fc640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d24052fe0 0x7f5d240df790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.409+0000 7f137b7fe640 1 -- 172.21.15.6:0/1950633145 learned_addr learned my addr 172.21.15.6:0/1950633145 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7fa737440640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c004ba0 0x7fa728175fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f1382738640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f137403b6a0 0x7f137404cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f1382738640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f13740e4c00 con 0x7f13740529e0 2024-05-20T17:53:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f1382738640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f13740584c0 con 0x7f137403b6a0 2024-05-20T17:53:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f1382738640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f137404dd40 con 0x7f136c004800 2024-05-20T17:53:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f5d2affd640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24007350 0x7f5d240e35c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c02d830 tx=0x7f5d2c074640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7f1380cd5640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f137403b6a0 0x7f137404cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7fa737440640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa728174ea0 0x7fa728178df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.410+0000 7fa73643e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c004ba0 0x7fa728175fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7fa73643e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c004ba0 0x7fa728175fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54106/0 (socket says 172.21.15.6:54106) 2024-05-20T17:53:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7fa73643e640 1 -- 172.21.15.6:0/199551274 learned_addr learned my addr 172.21.15.6:0/199551274 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0bd070 con 0x7f5d24007350 2024-05-20T17:53:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d2c0b8660 con 0x7f5d24007350 2024-05-20T17:53:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0b3040 con 0x7f5d24007350 2024-05-20T17:53:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d241716a0 con 0x7f5d24007350 2024-05-20T17:53:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7fa737440640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa72804bd30 0x7fa7280d2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7faa66c67640 1 Processor -- start 2024-05-20T17:53:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d24171c60 con 0x7f5d24007350 2024-05-20T17:53:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7fa735c3d640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa728174ea0 0x7fa728178df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7faa66c67640 1 -- start start 2024-05-20T17:53:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7fe0e1948640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4054240 0x7fe0d40e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f137b7fe640 1 -- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 msgr2=0x7f13740d9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f137b7fe640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f13740d9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f137b7fe640 1 -- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f137403b6a0 msgr2=0x7f137404cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f137b7fe640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f137403b6a0 0x7f137404cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f137b7fe640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137403bab0 con 0x7f13740529e0 2024-05-20T17:53:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7fe0e1948640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d4057690 0x7fe0d40e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f48c3fff640 1 -- 172.21.15.6:0/2890180830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40cebf0 msgr2=0x7f48c415c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.411+0000 7f48c3fff640 1 --2- 172.21.15.6:0/2890180830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40cebf0 0x7f48c415c010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f48c415f9e0 tx=0x7f48b402a780 comp rx=0 tx=0).stop 2024-05-20T17:53:32.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fe0e0946640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4054240 0x7fe0d40e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa736c3f640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa72804bd30 0x7fa7280d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7280553f0 con 0x7fa728174ea0 2024-05-20T17:53:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f48c3fff640 1 -- 172.21.15.6:0/2890180830 shutdown_connections 2024-05-20T17:53:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f48c3fff640 1 --2- 172.21.15.6:0/2890180830 >> v2:172.21.15.171:3300/0 conn(0x7f48c40b2b40 0x7f48c40b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f48c3fff640 1 --2- 172.21.15.6:0/2890180830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40cebf0 0x7f48c415c010 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f48c3fff640 1 -- 172.21.15.6:0/2890180830 >> 172.21.15.6:0/2890180830 conn(0x7f48c409a4f0 msgr2=0x7f48c409a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa728007f60 con 0x7fa71c004ba0 2024-05-20T17:53:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c40d6260 0x7f77c40e0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7feede523640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed806c530 0x7feed8161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa728055570 con 0x7fa72804bd30 2024-05-20T17:53:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77cbfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77c40e0e80 0x7f77c4175530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77cbfff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77c4175a70 0x7f77c404ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77cbfff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4006e00 con 0x7f77c40d6260 2024-05-20T17:53:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7feedd521640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed806c530 0x7feed8161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7feedd521640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed806c530 0x7feed8161b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46300/0 (socket says 172.21.15.6:46300) 2024-05-20T17:53:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7feedd521640 1 -- 172.21.15.6:0/4246253806 learned_addr learned my addr 172.21.15.6:0/4246253806 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7feede523640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed806f930 0x7feed81697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77cbfff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4006b20 con 0x7f77c40e0e80 2024-05-20T17:53:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77cbfff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f77c4007730 con 0x7f77c4175a70 2024-05-20T17:53:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f137bfff640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f136c004800 0x7f13740d9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f137b7fe640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13740529e0 0x7f137403b160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1368034040 tx=0x7f13740e3d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77caffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c40d6260 0x7f77c40e0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77caffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c40d6260 0x7f77c40e0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46290/0 (socket says 172.21.15.6:46290) 2024-05-20T17:53:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f77caffd640 1 -- 172.21.15.6:0/4240648997 learned_addr learned my addr 172.21.15.6:0/4240648997 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7feede523640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feed8170180 0x7feed8169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d24171450 con 0x7f5d24007350 2024-05-20T17:53:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7feedcd20640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed806f930 0x7feed81697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368036040 con 0x7f13740529e0 2024-05-20T17:53:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa73643e640 1 -- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa72804bd30 msgr2=0x7fa7280d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa73643e640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa72804bd30 0x7fa7280d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa73643e640 1 -- 172.21.15.6:0/199551274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa728174ea0 msgr2=0x7fa728178df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa73643e640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa728174ea0 0x7fa728178df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fa73643e640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa728179330 con 0x7fa71c004ba0 2024-05-20T17:53:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7feede523640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feed806eed0 con 0x7feed806c530 2024-05-20T17:53:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7feeddd22640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feed8170180 0x7feed8169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7feede523640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feed806ebf0 con 0x7feed806f930 2024-05-20T17:53:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7feede523640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feed80b5560 con 0x7feed8170180 2024-05-20T17:53:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f48c3fff640 1 -- 172.21.15.6:0/2890180830 shutdown_connections 2024-05-20T17:53:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fe0e1948640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0d40ebc90 0x7fe0d417d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fe0e1948640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d40ec5e0 con 0x7fe0d4057690 2024-05-20T17:53:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fe0e1948640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4007950 con 0x7fe0d4054240 2024-05-20T17:53:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fe0e1948640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d4057fe0 con 0x7fe0d40ebc90 2024-05-20T17:53:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.412+0000 7fe0e0946640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4054240 0x7fe0d40e3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54120/0 (socket says 172.21.15.6:54120) 2024-05-20T17:53:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7fe0e0946640 1 -- 172.21.15.6:0/3812909291 learned_addr learned my addr 172.21.15.6:0/3812909291 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7fe0dbfff640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d4057690 0x7fe0d40e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7fa73643e640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c004ba0 0x7fa728175fd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0050a0 tx=0x7fa728007e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f77cb7fe640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77c4175a70 0x7f77c404ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7fe0e0946640 1 -- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0d40ebc90 msgr2=0x7fe0d417d530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:53:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7fe0e0946640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0d40ebc90 0x7fe0d417d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7fe0e0946640 1 -- 172.21.15.6:0/3812909291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d4057690 msgr2=0x7fe0d40e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1368031be0 con 0x7f13740529e0 2024-05-20T17:53:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f77caffd640 1 -- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77c4175a70 msgr2=0x7f77c404ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f77caffd640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77c4175a70 0x7f77c404ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f77caffd640 1 -- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77c40e0e80 msgr2=0x7f77c4175530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:53:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f77caffd640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77c40e0e80 0x7f77c4175530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f77caffd640 1 -- 172.21.15.6:0/4240648997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c40e1290 con 0x7f77c40d6260 2024-05-20T17:53:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7fe0e0946640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0d4057690 0x7fe0d40e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7fe0e0946640 1 -- 172.21.15.6:0/3812909291 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d40e5f50 con 0x7fe0d4054240 2024-05-20T17:53:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f1382738640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13740e6d30 con 0x7f13740529e0 2024-05-20T17:53:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f48c3fff640 1 -- 172.21.15.6:0/2890180830 wait complete. 2024-05-20T17:53:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.413+0000 7f1382738640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13740517a0 con 0x7f13740529e0 2024-05-20T17:53:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368001c50 con 0x7f13740529e0 2024-05-20T17:53:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7fe0e0946640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4054240 0x7fe0d40e3a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000e8a0 tx=0x7fe0d000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d2c0c0070 con 0x7f5d24007350 2024-05-20T17:53:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7feedcd20640 1 -- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feed8170180 msgr2=0x7feed8169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7feedcd20640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feed8170180 0x7feed8169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7feedcd20640 1 -- 172.21.15.6:0/4246253806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed806c530 msgr2=0x7feed8161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7feedcd20640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feed806c530 0x7feed8161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7feedcd20640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed8171da0 con 0x7feed806f930 2024-05-20T17:53:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7feeddd22640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feed8170180 0x7feed8169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0017070 con 0x7fe0d4054240 2024-05-20T17:53:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d000ee90 con 0x7fe0d4054240 2024-05-20T17:53:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7feedcd20640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed806f930 0x7feed81697a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feec800c390 tx=0x7feec8001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7faa66c67640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa600ced60 0x7faa60161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7faa66c67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6015f7f0 0x7faa60145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.414+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8017070 con 0x7feed806f930 2024-05-20T17:53:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7f5d137fe640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d1806be80 0x7f5d1806e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec80052d0 con 0x7feed806f930 2024-05-20T17:53:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa66c67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa60162080 0x7faa60145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa64a03640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa600ced60 0x7faa60161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7feede523640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed8172080 con 0x7feed806f930 2024-05-20T17:53:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa64a03640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa600ced60 0x7faa60161b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49828/0 (socket says 172.21.15.6:49828) 2024-05-20T17:53:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa64a03640 1 -- 172.21.15.6:0/132613492 learned_addr learned my addr 172.21.15.6:0/132613492 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa5ffff640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6015f7f0 0x7faa60145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c004b80 con 0x7fa71c004ba0 2024-05-20T17:53:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c005cc0 con 0x7fa71c004ba0 2024-05-20T17:53:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c008230 con 0x7fa71c004ba0 2024-05-20T17:53:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa6006f860 con 0x7faa6015f7f0 2024-05-20T17:53:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa6006f580 con 0x7faa60162080 2024-05-20T17:53:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa6006ecb0 con 0x7faa600ced60 2024-05-20T17:53:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7faa65204640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa60162080 0x7faa60145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0017070 con 0x7fe0d4054240 2024-05-20T17:53:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa728175810 con 0x7fa71c004ba0 2024-05-20T17:53:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7280d1f80 con 0x7fa71c004ba0 2024-05-20T17:53:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5d2c1257a0 con 0x7f5d24007350 2024-05-20T17:53:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7f5d137fe640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7f5d180755d0 0x7f5d18077a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 --> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d2c0a7e50 con 0x7f5d180755d0 2024-05-20T17:53:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.415+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d40e6230 con 0x7fe0d4054240 2024-05-20T17:53:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d40e67f0 con 0x7fe0d4054240 2024-05-20T17:53:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5d2c0f16d0 con 0x7f5d24007350 2024-05-20T17:53:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7faa5ffff640 1 -- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa600ced60 msgr2=0x7faa60161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7faa5ffff640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa600ced60 0x7faa60161b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7faa5ffff640 1 -- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa60162080 msgr2=0x7faa60145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7faa5ffff640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa60162080 0x7faa60145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7faa5ffff640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6015b4b0 con 0x7faa6015f7f0 2024-05-20T17:53:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8003830 con 0x7feed806f930 2024-05-20T17:53:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7feede523640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed8172640 con 0x7feed806f930 2024-05-20T17:53:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7f77caffd640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c40d6260 0x7f77c40e0940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f77cc02d830 tx=0x7f77cc068b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1374005920 con 0x7f13740529e0 2024-05-20T17:53:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc09b070 con 0x7f77c40d6260 2024-05-20T17:53:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7f48c3fff640 1 Processor -- start 2024-05-20T17:53:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.416+0000 7f48c3fff640 1 -- start start 2024-05-20T17:53:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77cc06c6a0 con 0x7f77c40d6260 2024-05-20T17:53:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7280d2360 con 0x7fa71c004ba0 2024-05-20T17:53:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7f5d2a7fc640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d1806be80 0x7f5d1806e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7f5d2b7fe640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7f5d180755d0 0x7f5d18077a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc06ca70 con 0x7f77c40d6260 2024-05-20T17:53:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1368003610 con 0x7f13740529e0 2024-05-20T17:53:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c41762b0 con 0x7f77c40d6260 2024-05-20T17:53:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c40d70f0 con 0x7f77c40d6260 2024-05-20T17:53:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7feede523640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feed8075980 con 0x7feed806f930 2024-05-20T17:53:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.418+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feec801a070 con 0x7feed806f930 2024-05-20T17:53:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.418+0000 7f1378ff9640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f136006be30 0x7f136006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.418+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f13680abb90 con 0x7f13740529e0 2024-05-20T17:53:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.418+0000 7f5d2a7fc640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d1806be80 0x7f5d1806e390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c006fd0 tx=0x7f5d1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77ac001030 con 0x7f77c40d6260 2024-05-20T17:53:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.418+0000 7f1378ff9640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7f13600755f0 0x7f1360077a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f136800bf30 con 0x7f13600755f0 2024-05-20T17:53:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f13680b02a0 con 0x7f13740529e0 2024-05-20T17:53:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7feecdffb640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7feebc06bf30 0x7feebc06e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feec808a560 con 0x7feed806f930 2024-05-20T17:53:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f5d2b7fe640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7f5d180755d0 0x7f5d18077a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f1380cd5640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7f13600755f0 0x7f1360077a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2b40 0x7f48c41634b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b6a30 0x7f48c41f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4164550 0x7f48c40b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c3fff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48c40b30d0 con 0x7f48c40b2b40 2024-05-20T17:53:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c3fff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48c40b2f50 con 0x7f48c4164550 2024-05-20T17:53:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c3fff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48c40d00e0 con 0x7f48c40b6a30 2024-05-20T17:53:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4164550 0x7f48c40b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c27fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b6a30 0x7f48c41f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c37fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4164550 0x7f48c40b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54156/0 (socket says 172.21.15.6:54156) 2024-05-20T17:53:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c37fe640 1 -- 172.21.15.6:0/2023788618 learned_addr learned my addr 172.21.15.6:0/2023788618 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7feedd521640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7feebc06bf30 0x7feebc06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7feecdffb640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7feebc075700 0x7feebc077b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feec8004ec0 con 0x7feebc075700 2024-05-20T17:53:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c37fe640 1 -- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b6a30 msgr2=0x7f48c41f90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c37fe640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48c40b6a30 0x7f48c41f90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.417+0000 7faa5ffff640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6015f7f0 0x7faa60145930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faa5400c610 tx=0x7faa5400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.418+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54015070 con 0x7faa6015f7f0 2024-05-20T17:53:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.418+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa54011800 con 0x7faa6015f7f0 2024-05-20T17:53:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54011bd0 con 0x7faa6015f7f0 2024-05-20T17:53:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6015eeb0 con 0x7faa6015f7f0 2024-05-20T17:53:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6015cce0 con 0x7faa6015f7f0 2024-05-20T17:53:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c37fe640 1 -- 172.21.15.6:0/2023788618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2b40 msgr2=0x7f48c41634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7f48c37fe640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c40b2b40 0x7f48c41634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7f48c37fe640 1 -- 172.21.15.6:0/2023788618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c414bb40 con 0x7f48c4164550 2024-05-20T17:53:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0d40054a0 con 0x7fe0d4054240 2024-05-20T17:53:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.419+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feec8091050 con 0x7feed806f930 2024-05-20T17:53:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa72c03f070 con 0x7fa71c004ba0 2024-05-20T17:53:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7f1380cd5640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7f13600755f0 0x7f1360077a80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7f137bfff640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f136006be30 0x7f136006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa60075980 con 0x7faa6015f7f0 2024-05-20T17:53:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 <== osd.5 v2:172.21.15.171:6800/569633911 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d2c0a7e50 con 0x7f5d180755d0 2024-05-20T17:53:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7f48c37fe640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4164550 0x7f48c40b0020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00c3c0 tx=0x7f48bc00c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7feeddd22640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7feebc075700 0x7feebc077b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7feedd521640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7feebc06bf30 0x7feebc06e440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feed4009630 tx=0x7feed402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.420+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc017070 con 0x7f48c4164550 2024-05-20T17:53:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7f48c3fff640 1 -- 172.21.15.6:0/2023788618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c414be20 con 0x7f48c4164550 2024-05-20T17:53:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48bc0052d0 con 0x7f48c4164550 2024-05-20T17:53:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc017070 con 0x7f48c4164550 2024-05-20T17:53:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7f48c3fff640 1 -- 172.21.15.6:0/2023788618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c414c3e0 con 0x7f48c4164550 2024-05-20T17:53:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7fa726ffd640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71406bf00 0x7fa71406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa72c0ab5c0 con 0x7fa71c004ba0 2024-05-20T17:53:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7fa726ffd640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fa7140756c0 0x7fa714077b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa714078220 con 0x7fa7140756c0 2024-05-20T17:53:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa72c0b2050 con 0x7fa71c004ba0 2024-05-20T17:53:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 <== osd.1 v2:172.21.15.6:6814/3797721472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f136800bf30 con 0x7f13600755f0 2024-05-20T17:53:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77cc09e070 con 0x7f77c40d6260 2024-05-20T17:53:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0d001a070 con 0x7fe0d4054240 2024-05-20T17:53:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7fe0d97fa640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0c006c230 0x7fe0c006e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7f77b37fe640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f77b806bf00 0x7f77b806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f77cc106700 con 0x7f77c40d6260 2024-05-20T17:53:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7feeddd22640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7feebc075700 0x7feebc077b90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48c4075980 con 0x7f48c4164550 2024-05-20T17:53:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe0d000f040 con 0x7fe0d4054240 2024-05-20T17:53:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7fe0dbfff640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0c006c230 0x7fe0c006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7fe0d97fa640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7fe0c0075880 0x7fe0c0077d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 --> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0c00783e0 con 0x7fe0c0075880 2024-05-20T17:53:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe0d0091050 con 0x7fe0d4054240 2024-05-20T17:53:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7f137bfff640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f136006be30 0x7f136006e340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1370007fd0 tx=0x7f1370007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa54018070 con 0x7faa6015f7f0 2024-05-20T17:53:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7f77b37fe640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f77b80756c0 0x7f77b8077b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7f77cb7fe640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f77b80756c0 0x7f77b8077b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.421+0000 7fa735c3d640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71406bf00 0x7fa71406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7fa736c3f640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fa7140756c0 0x7fa714077b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.422+0000 7fe0e1147640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7fe0c0075880 0x7fe0c0077d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7f77ca7fc640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f77b806bf00 0x7f77b806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 --> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77cc0a1ec0 con 0x7f77b80756c0 2024-05-20T17:53:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7faa5d7fa640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa4406be80 0x7faa4406e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faa5408af20 con 0x7faa6015f7f0 2024-05-20T17:53:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7faa64a03640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa4406be80 0x7faa4406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7faa5d7fa640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7faa44075650 0x7faa44077ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa5401be50 con 0x7faa44075650 2024-05-20T17:53:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faa5408d610 con 0x7faa6015f7f0 2024-05-20T17:53:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7faa65204640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7faa44075650 0x7faa44077ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7f77cb7fe640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f77b80756c0 0x7f77b8077b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7f77ca7fc640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f77b806bf00 0x7f77b806e410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f77c403a1b0 tx=0x7f77bc007bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48bc01a070 con 0x7f48c4164550 2024-05-20T17:53:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 <== osd.4 v2:172.21.15.171:6816/2946312774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feec8004ec0 con 0x7feebc075700 2024-05-20T17:53:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f77cc10d050 con 0x7f77c40d6260 2024-05-20T17:53:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.423+0000 7fa736c3f640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fa7140756c0 0x7fa714077b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7fa735c3d640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71406bf00 0x7fa71406e410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa720007fd0 tx=0x7fa720009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7faa64a03640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa4406be80 0x7faa4406e390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009630 tx=0x7faa4c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 <== osd.7 v2:172.21.15.171:6808/3357029460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa714078220 con 0x7fa7140756c0 2024-05-20T17:53:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7faa65204640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7faa44075650 0x7faa44077ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7fe0dbfff640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0c006c230 0x7fe0c006e740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe0d404fca0 tx=0x7fe0c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7fe0e1147640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7fe0c0075880 0x7fe0c0077d10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 <== osd.2 v2:172.21.15.6:6808/1176387809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77cc0a1ec0 con 0x7f77b80756c0 2024-05-20T17:53:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7f48bb7fe640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a406c030 0x7f48a406e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.424+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f48bc08a070 con 0x7f48c4164550 2024-05-20T17:53:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.425+0000 7f48bb7fe640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f48a4075700 0x7f48a4077b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.425+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 --> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48bc009e50 con 0x7f48a4075700 2024-05-20T17:53:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.425+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f48bc091050 con 0x7f48c4164550 2024-05-20T17:53:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.425+0000 7f48c2ffd640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a406c030 0x7f48a406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.425+0000 7f48c27fc640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f48a4075700 0x7f48a4077b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.425+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 <== osd.6 v2:172.21.15.171:6817/2330779284 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0c00783e0 con 0x7fe0c0075880 2024-05-20T17:53:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.425+0000 7f48c27fc640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f48a4075700 0x7f48a4077b90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.427+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 <== osd.3 v2:172.21.15.6:6824/3198189897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48bc009e50 con 0x7f48a4075700 2024-05-20T17:53:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.426+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 <== osd.0 v2:172.21.15.6:6800/3479934487 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa5401be50 con 0x7faa44075650 2024-05-20T17:53:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.427+0000 7f48c2ffd640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a406c030 0x7f48a406e540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f48b4033000 tx=0x7f48b402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.454+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 --> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d240054d0 con 0x7f5d180755d0 2024-05-20T17:53:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.455+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 --> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1374051270 con 0x7f13600755f0 2024-05-20T17:53:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.455+0000 7f5d137fe640 1 -- 172.21.15.6:0/706107132 <== osd.5 v2:172.21.15.171:6800/569633911 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5d240054d0 con 0x7f5d180755d0 2024-05-20T17:53:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7f5d180755d0 msgr2=0x7f5d18077a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d315e3640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7f5d180755d0 0x7f5d18077a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d1806be80 msgr2=0x7f5d1806e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d315e3640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d1806be80 0x7f5d1806e390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c006fd0 tx=0x7f5d1c008040 comp rx=0 tx=0).stop 2024-05-20T17:53:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24007350 msgr2=0x7f5d240e35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d315e3640 1 --2- 172.21.15.6:0/706107132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d24007350 0x7f5d240e35c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c02d830 tx=0x7f5d2c074640 comp rx=0 tx=0).stop 2024-05-20T17:53:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d2b7fe640 1 -- 172.21.15.6:0/706107132 reap_dead start 2024-05-20T17:53:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f1378ff9640 1 -- 172.21.15.6:0/1950633145 <== osd.1 v2:172.21.15.6:6814/3797721472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1374051270 con 0x7f13600755f0 2024-05-20T17:53:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 shutdown_connections 2024-05-20T17:53:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.456+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 >> 172.21.15.6:0/706107132 conn(0x7f5d24054d20 msgr2=0x7f5d24039f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.457+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 shutdown_connections 2024-05-20T17:53:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.457+0000 7f5d315e3640 1 -- 172.21.15.6:0/706107132 wait complete. 2024-05-20T17:53:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.457+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7f13600755f0 msgr2=0x7f1360077a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.457+0000 7f13667fc640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7f13600755f0 0x7f1360077a80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.457+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f136006be30 msgr2=0x7f136006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.457+0000 7f13667fc640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f136006be30 0x7f136006e340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1370007fd0 tx=0x7f1370007d70 comp rx=0 tx=0).stop 2024-05-20T17:53:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.457+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13740529e0 msgr2=0x7f137403b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7f13667fc640 1 --2- 172.21.15.6:0/1950633145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13740529e0 0x7f137403b160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1368034040 tx=0x7f13740e3d70 comp rx=0 tx=0).stop 2024-05-20T17:53:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7f1380cd5640 1 -- 172.21.15.6:0/1950633145 reap_dead start 2024-05-20T17:53:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 shutdown_connections 2024-05-20T17:53:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 >> 172.21.15.6:0/1950633145 conn(0x7f1374059140 msgr2=0x7f137403a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 --> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7280d1d70 con 0x7fa7140756c0 2024-05-20T17:53:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7feede523640 1 -- 172.21.15.6:0/4246253806 --> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feed816a270 con 0x7feebc075700 2024-05-20T17:53:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 shutdown_connections 2024-05-20T17:53:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7f13667fc640 1 -- 172.21.15.6:0/1950633145 wait complete. 2024-05-20T17:53:32.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7fa726ffd640 1 -- 172.21.15.6:0/199551274 <== osd.7 v2:172.21.15.171:6808/3357029460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa7280d1d70 con 0x7fa7140756c0 2024-05-20T17:53:32.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.458+0000 7feecdffb640 1 -- 172.21.15.6:0/4246253806 <== osd.4 v2:172.21.15.171:6816/2946312774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feed816a270 con 0x7feebc075700 2024-05-20T17:53:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7feec37fe640 1 -- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7feebc075700 msgr2=0x7feebc077b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7feec37fe640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7feebc075700 0x7feebc077b90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 --> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe0d40e1e20 con 0x7fe0c0075880 2024-05-20T17:53:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fa7140756c0 msgr2=0x7fa714077b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7fa737440640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fa7140756c0 0x7fa714077b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 --> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa6015d2a0 con 0x7faa44075650 2024-05-20T17:53:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7feec37fe640 1 -- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7feebc06bf30 msgr2=0x7feebc06e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7feec37fe640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7feebc06bf30 0x7feebc06e440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feed4009630 tx=0x7feed402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7feec37fe640 1 -- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed806f930 msgr2=0x7feed81697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7feec37fe640 1 --2- 172.21.15.6:0/4246253806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feed806f930 0x7feed81697a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feec800c390 tx=0x7feec8001e70 comp rx=0 tx=0).stop 2024-05-20T17:53:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7feeddd22640 1 -- 172.21.15.6:0/4246253806 reap_dead start 2024-05-20T17:53:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71406bf00 msgr2=0x7fa71406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7fa737440640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71406bf00 0x7fa71406e410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa720007fd0 tx=0x7fa720009040 comp rx=0 tx=0).stop 2024-05-20T17:53:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c004ba0 msgr2=0x7fa728175fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7fa737440640 1 --2- 172.21.15.6:0/199551274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa71c004ba0 0x7fa728175fd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0050a0 tx=0x7fa728007e50 comp rx=0 tx=0).stop 2024-05-20T17:53:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.459+0000 7fa736c3f640 1 -- 172.21.15.6:0/199551274 reap_dead start 2024-05-20T17:53:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 shutdown_connections 2024-05-20T17:53:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 >> 172.21.15.6:0/199551274 conn(0x7fa728055e00 msgr2=0x7fa7280505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7fe0d97fa640 1 -- 172.21.15.6:0/3812909291 <== osd.6 v2:172.21.15.171:6817/2330779284 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe0d40e1e20 con 0x7fe0c0075880 2024-05-20T17:53:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7faa5d7fa640 1 -- 172.21.15.6:0/132613492 <== osd.0 v2:172.21.15.6:6800/3479934487 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faa6015d2a0 con 0x7faa44075650 2024-05-20T17:53:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 --> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77ac002dd0 con 0x7f77b80756c0 2024-05-20T17:53:32.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 shutdown_connections 2024-05-20T17:53:32.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7fa737440640 1 -- 172.21.15.6:0/199551274 wait complete. 2024-05-20T17:53:32.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7faa44075650 msgr2=0x7faa44077ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7f77b37fe640 1 -- 172.21.15.6:0/4240648997 <== osd.2 v2:172.21.15.6:6808/1176387809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f77ac002dd0 con 0x7f77b80756c0 2024-05-20T17:53:32.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa66c67640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7faa44075650 0x7faa44077ae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 --> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f48c4163a50 con 0x7f48a4075700 2024-05-20T17:53:32.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7fe0c0075880 msgr2=0x7fe0c0077d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa4406be80 msgr2=0x7faa4406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa66c67640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa4406be80 0x7faa4406e390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009630 tx=0x7faa4c02e000 comp rx=0 tx=0).stop 2024-05-20T17:53:32.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6015f7f0 msgr2=0x7faa60145930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa66c67640 1 --2- 172.21.15.6:0/132613492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6015f7f0 0x7faa60145930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faa5400c610 tx=0x7faa5400cad0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa65204640 1 -- 172.21.15.6:0/132613492 reap_dead start 2024-05-20T17:53:32.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f77b80756c0 msgr2=0x7f77b8077b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7f77cbfff640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f77b80756c0 0x7f77b8077b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7f48bb7fe640 1 -- 172.21.15.6:0/2023788618 <== osd.3 v2:172.21.15.6:6824/3198189897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f48c4163a50 con 0x7f48a4075700 2024-05-20T17:53:32.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f77b806bf00 msgr2=0x7f77b806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7feec37fe640 1 -- 172.21.15.6:0/4246253806 shutdown_connections 2024-05-20T17:53:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7feec37fe640 1 -- 172.21.15.6:0/4246253806 >> 172.21.15.6:0/4246253806 conn(0x7feed80721d0 msgr2=0x7feed80b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7feec37fe640 1 -- 172.21.15.6:0/4246253806 shutdown_connections 2024-05-20T17:53:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7feec37fe640 1 -- 172.21.15.6:0/4246253806 wait complete. 2024-05-20T17:53:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.460+0000 7fe0e1948640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7fe0c0075880 0x7fe0c0077d10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0c006c230 msgr2=0x7fe0c006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1948640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0c006c230 0x7fe0c006e740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe0d404fca0 tx=0x7fe0c8008040 comp rx=0 tx=0).stop 2024-05-20T17:53:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4054240 msgr2=0x7fe0d40e3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1948640 1 --2- 172.21.15.6:0/3812909291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0d4054240 0x7fe0d40e3a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000e8a0 tx=0x7fe0d000ed60 comp rx=0 tx=0).stop 2024-05-20T17:53:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1147640 1 -- 172.21.15.6:0/3812909291 reap_dead start 2024-05-20T17:53:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 shutdown_connections 2024-05-20T17:53:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 >> 172.21.15.6:0/3812909291 conn(0x7fe0d403ac60 msgr2=0x7fe0d403ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7f77cbfff640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f77b806bf00 0x7f77b806e410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f77c403a1b0 tx=0x7f77bc007bf0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c40d6260 msgr2=0x7f77c40e0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7f77cbfff640 1 --2- 172.21.15.6:0/4240648997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77c40d6260 0x7f77c40e0940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f77cc02d830 tx=0x7f77cc068b40 comp rx=0 tx=0).stop 2024-05-20T17:53:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7f77cb7fe640 1 -- 172.21.15.6:0/4240648997 reap_dead start 2024-05-20T17:53:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 shutdown_connections 2024-05-20T17:53:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 >> 172.21.15.6:0/4240648997 conn(0x7f77c4054cf0 msgr2=0x7f77c4049f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 shutdown_connections 2024-05-20T17:53:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 >> 172.21.15.6:0/132613492 conn(0x7faa600d0650 msgr2=0x7faa600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 shutdown_connections 2024-05-20T17:53:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 shutdown_connections 2024-05-20T17:53:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7faa66c67640 1 -- 172.21.15.6:0/132613492 wait complete. 2024-05-20T17:53:32.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7f77cbfff640 1 -- 172.21.15.6:0/4240648997 wait complete. 2024-05-20T17:53:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f48a4075700 msgr2=0x7f48a4077b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.462+0000 7f48b97fa640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f48a4075700 0x7f48a4077b90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 shutdown_connections 2024-05-20T17:53:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.463+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a406c030 msgr2=0x7f48a406e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.463+0000 7f48b97fa640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a406c030 0x7f48a406e540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f48b4033000 tx=0x7f48b402c000 comp rx=0 tx=0).stop 2024-05-20T17:53:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.463+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4164550 msgr2=0x7f48c40b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.463+0000 7f48b97fa640 1 --2- 172.21.15.6:0/2023788618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48c4164550 0x7f48c40b0020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00c3c0 tx=0x7f48bc00c7c0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.461+0000 7fe0e1948640 1 -- 172.21.15.6:0/3812909291 wait complete. 2024-05-20T17:53:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.464+0000 7f48c37fe640 1 -- 172.21.15.6:0/2023788618 reap_dead start 2024-05-20T17:53:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.464+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 shutdown_connections 2024-05-20T17:53:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.464+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 >> 172.21.15.6:0/2023788618 conn(0x7f48c409a4f0 msgr2=0x7f48c406fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.464+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 shutdown_connections 2024-05-20T17:53:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.464+0000 7f48b97fa640 1 -- 172.21.15.6:0/2023788618 wait complete. 2024-05-20T17:53:32.526 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2024-05-20T17:53:32.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-20T17:53:32.527 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:32.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-20T17:53:32.528 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2024-05-20T17:53:32.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-20T17:53:32.529 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:32.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-20T17:53:32.530 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2024-05-20T17:53:32.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-20T17:53:32.531 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:32.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-20T17:53:32.532 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2024-05-20T17:53:32.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-20T17:53:32.533 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:32.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-20T17:53:32.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.794+0000 7f94c1689640 1 Processor -- start 2024-05-20T17:53:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.794+0000 7f94c1689640 1 -- start start 2024-05-20T17:53:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.795+0000 7f88a6011640 1 Processor -- start 2024-05-20T17:53:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.795+0000 7f6b114bb640 1 Processor -- start 2024-05-20T17:53:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.795+0000 7f88a6011640 1 -- start start 2024-05-20T17:53:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.796+0000 7f6b114bb640 1 -- start start 2024-05-20T17:53:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.796+0000 7f879f302640 1 Processor -- start 2024-05-20T17:53:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.796+0000 7f879f302640 1 -- start start 2024-05-20T17:53:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.796+0000 7f8514bd5640 1 Processor -- start 2024-05-20T17:53:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.796+0000 7f8514bd5640 1 -- start start 2024-05-20T17:53:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.797+0000 7fc9cfcca640 1 Processor -- start 2024-05-20T17:53:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.797+0000 7f94c1689640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94bc0cfe10 0x7f94bc163600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.797+0000 7f94c1689640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc06cc40 0x7f94bc06e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.797+0000 7f94c1689640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc0b48e0 con 0x7f94bc167b90 2024-05-20T17:53:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.797+0000 7f94c1689640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f94bc0b54f0 con 0x7f94bc0cfe10 2024-05-20T17:53:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.797+0000 7f94c1689640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc0b4bc0 con 0x7f94bc06cc40 2024-05-20T17:53:32.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.797+0000 7fc9cfcca640 1 -- start start 2024-05-20T17:53:32.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7fde75a1e640 1 Processor -- start 2024-05-20T17:53:32.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f6b114bb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0403a510 0x7f6b040e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f6b114bb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b04038c20 0x7f6b040064c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f6b114bb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b04050930 con 0x7f6b04034140 2024-05-20T17:53:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a6011640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88980e7f20 0x7f8898053140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a6011640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8898049520 0x7f8898035bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a6011640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8898054b00 con 0x7f8898054570 2024-05-20T17:53:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a6011640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8898055710 con 0x7f8898049520 2024-05-20T17:53:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a6011640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8898054de0 con 0x7f88980e7f20 2024-05-20T17:53:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f94c0e88640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc06cc40 0x7f94bc06e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f94c0e88640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc06cc40 0x7f94bc06e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49850/0 (socket says 172.21.15.6:49850) 2024-05-20T17:53:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f94c0e88640 1 -- 172.21.15.6:0/787057634 learned_addr learned my addr 172.21.15.6:0/787057634 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f6b114bb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6b04034550 con 0x7f6b04038c20 2024-05-20T17:53:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f6b114bb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0403aaa0 con 0x7f6b0403a510 2024-05-20T17:53:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a5810640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8898049520 0x7f8898035bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a5810640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8898049520 0x7f8898035bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46338/0 (socket says 172.21.15.6:46338) 2024-05-20T17:53:32.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a480e640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8898054570 0x7f8898048e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:49378/0 (socket says 172.21.15.6:49378) 2024-05-20T17:53:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a5810640 1 -- 172.21.15.6:0/3818849441 learned_addr learned my addr 172.21.15.6:0/3818849441 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f94bbfff640 1 --2- 172.21.15.6:0/787057634 >> v2:172.21.15.6:3300/0 conn(0x7f94bc0cfe10 0x7f94bc163600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.798+0000 7f88a500f640 1 --2- 172.21.15.6:0/3818849441 >> v2:172.21.15.171:3300/0 conn(0x7f88980e7f20 0x7f8898053140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f8514bd5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f85080ddff0 0x7f85080e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f8514bd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8508006410 0x7f8508054130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f8514bd5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8508054a80 con 0x7f8508054670 2024-05-20T17:53:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f8514bd5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8508006c60 con 0x7f85080ddff0 2024-05-20T17:53:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f8514bd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8508006f40 con 0x7f8508006410 2024-05-20T17:53:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f850f7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f85080ddff0 0x7f85080e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f850ffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8508054670 0x7f85080e7410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:49388/0 (socket says 172.21.15.6:49388) 2024-05-20T17:53:32.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f850ffff640 1 -- 172.21.15.6:0/591157598 learned_addr learned my addr 172.21.15.6:0/591157598 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:32.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f879f302640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f87980d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f850effd640 1 --2- 172.21.15.6:0/591157598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8508006410 0x7f8508054130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f94baffd640 1 -- 172.21.15.6:0/787057634 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179421784 0 0) 0x7f94bc0b48e0 con 0x7f94bc167b90 2024-05-20T17:53:32.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f94bbfff640 1 -- 172.21.15.6:0/787057634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc06cc40 msgr2=0x7f94bc06e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f879f302640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f879815f900 0x7f879815fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f6b0b7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f6b04034140 0x7f6b04038510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:49380/0 (socket says 172.21.15.6:49380) 2024-05-20T17:53:32.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f6b0b7fe640 1 -- 172.21.15.6:0/2480589382 learned_addr learned my addr 172.21.15.6:0/2480589382 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:32.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f6b0bfff640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0403a510 0x7f6b040e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f6b10cba640 1 --2- 172.21.15.6:0/2480589382 >> v2:172.21.15.6:3300/0 conn(0x7f6b04038c20 0x7f6b040064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270129547 0 0) 0x7f6b00001110 con 0x7f6b04034140 2024-05-20T17:53:32.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6afc003520 con 0x7f6b04034140 2024-05-20T17:53:32.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7fde75a1e640 1 -- start start 2024-05-20T17:53:32.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.799+0000 7f94bbfff640 1 --2- 172.21.15.6:0/787057634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc06cc40 0x7f94bc06e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f94bbfff640 1 -- 172.21.15.6:0/787057634 >> v1:172.21.15.6:6789/0 conn(0x7f94bc167b90 legacy=0x7f94bc06c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f850e7fc640 1 -- 172.21.15.6:0/591157598 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128286637 0 0) 0x7f851004fc90 con 0x7f8508054670 2024-05-20T17:53:32.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f850e7fc640 1 -- 172.21.15.6:0/591157598 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8500003520 con 0x7f8508054670 2024-05-20T17:53:32.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f94bbfff640 1 -- 172.21.15.6:0/787057634 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc0b4ea0 con 0x7f94bc0cfe10 2024-05-20T17:53:32.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f879d09e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f87980d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f879d09e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f87980d1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49880/0 (socket says 172.21.15.6:49880) 2024-05-20T17:53:32.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f879c89d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f879815f900 0x7f879815fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f879c89d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f879815f900 0x7f879815fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54166/0 (socket says 172.21.15.6:54166) 2024-05-20T17:53:32.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f879d09e640 1 -- 172.21.15.6:0/1206469819 learned_addr learned my addr 172.21.15.6:0/1206469819 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f879f302640 1 -- 172.21.15.6:0/1206469819 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8798160250 con 0x7f87980c76d0 2024-05-20T17:53:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f88a500f640 1 -- 172.21.15.6:0/3818849441 >> v2:172.21.15.6:3300/0 conn(0x7f8898049520 msgr2=0x7f8898035bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f88a500f640 1 --2- 172.21.15.6:0/3818849441 >> v2:172.21.15.6:3300/0 conn(0x7f8898049520 0x7f8898035bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f88a500f640 1 -- 172.21.15.6:0/3818849441 >> v1:172.21.15.171:6789/0 conn(0x7f8898054570 legacy=0x7f8898048e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f88a500f640 1 -- 172.21.15.6:0/3818849441 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88980550c0 con 0x7f88980e7f20 2024-05-20T17:53:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7fc9cfcca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9c00e47c0 0x7fc9c0037b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7fc9cfcca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9c00380c0 0x7fc9c00384d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7fc9cfcca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c0057910 con 0x7fc9c00e7330 2024-05-20T17:53:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7fc9cfcca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c003c190 con 0x7fc9c00380c0 2024-05-20T17:53:32.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7fc9cfcca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c0057bf0 con 0x7fc9c00e47c0 2024-05-20T17:53:32.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f879f302640 1 -- 172.21.15.6:0/1206469819 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f87980b3340 con 0x7f879815f900 2024-05-20T17:53:32.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f879f302640 1 -- 172.21.15.6:0/1206469819 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f87980b3620 con 0x7f87980b2c50 2024-05-20T17:53:32.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f878ffff640 1 -- 172.21.15.6:0/1206469819 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157452581 0 0) 0x7f87900014c0 con 0x7f87980c76d0 2024-05-20T17:53:32.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f878ffff640 1 -- 172.21.15.6:0/1206469819 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8784003520 con 0x7f87980c76d0 2024-05-20T17:53:32.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7fc9cda66640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9c00e47c0 0x7fc9c0037b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7fc9cda66640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9c00e47c0 0x7fc9c0037b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54178/0 (socket says 172.21.15.6:54178) 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7fc9cda66640 1 -- 172.21.15.6:0/2259381288 learned_addr learned my addr 172.21.15.6:0/2259381288 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7fc9cd265640 1 --2- 172.21.15.6:0/2259381288 >> v2:172.21.15.6:3300/0 conn(0x7fc9c00380c0 0x7fc9c00384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3977550508 0 0) 0x7f6afc003520 con 0x7f6b04034140 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0403a510 msgr2=0x7f6b040e16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0403a510 0x7f6b040e16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 >> v2:172.21.15.6:3300/0 conn(0x7f6b04038c20 msgr2=0x7f6b040064c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 --2- 172.21.15.6:0/2480589382 >> v2:172.21.15.6:3300/0 conn(0x7f6b04038c20 0x7f6b040064c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b04050bb0 con 0x7f6b04034140 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f6b00001840 con 0x7f6b04034140 2024-05-20T17:53:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 >> v1:172.21.15.171:6789/0 conn(0x7f6b04034140 legacy=0x7f6b04038510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6afc0039b0 0x7f6afc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc004800 0x7f6afc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6afc0051c0 0x7f6afc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6b04034550 con 0x7f6afc0051c0 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0403aaa0 con 0x7f6afc004800 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6afc00c1c0 con 0x7f6afc0039b0 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f6b10cba640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6afc0051c0 0x7f6afc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f6b10cba640 1 -- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6afc0039b0 msgr2=0x7f6afc003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f6b10cba640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6afc0039b0 0x7f6afc003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f6b10cba640 1 -- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc004800 msgr2=0x7f6afc004c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:53:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f6b10cba640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc004800 0x7f6afc004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f75b9148640 1 Processor -- start 2024-05-20T17:53:32.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7fde75a1e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fde700cfe10 0x7fde70163600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7fde75a1e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde7006cc40 0x7fde7006e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7fde75a1e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde700b48e0 con 0x7fde70167b90 2024-05-20T17:53:32.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7fde75a1e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fde700b54f0 con 0x7fde7006cc40 2024-05-20T17:53:32.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7fde75a1e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fde700b4bc0 con 0x7fde700cfe10 2024-05-20T17:53:32.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f850f7fe640 1 -- 172.21.15.6:0/591157598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8508006410 msgr2=0x7f8508054130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f850f7fe640 1 --2- 172.21.15.6:0/591157598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8508006410 0x7f8508054130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f850f7fe640 1 -- 172.21.15.6:0/591157598 >> v1:172.21.15.171:6789/0 conn(0x7f8508054670 legacy=0x7f85080e7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.800+0000 7f850f7fe640 1 -- 172.21.15.6:0/591157598 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8508007220 con 0x7f85080ddff0 2024-05-20T17:53:32.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f6b10cba640 1 -- 172.21.15.6:0/2480589382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b04050bb0 con 0x7f6afc0051c0 2024-05-20T17:53:32.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f88a500f640 1 --2- 172.21.15.6:0/3818849441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88980e7f20 0x7f8898053140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f889800b250 tx=0x7f889002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31eac37e0fe6b2ec server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f94bbfff640 1 --2- 172.21.15.6:0/787057634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 0x7f94bc163600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009d90 tx=0x7f94b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5244240d26266dbd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7fc9cd265640 1 -- 172.21.15.6:0/2259381288 >> v2:172.21.15.171:3300/0 conn(0x7fc9c00e47c0 msgr2=0x7fc9c0037b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f879d09e640 1 -- 172.21.15.6:0/1206469819 >> v2:172.21.15.171:3300/0 conn(0x7f879815f900 msgr2=0x7f879815fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f879d09e640 1 --2- 172.21.15.6:0/1206469819 >> v2:172.21.15.171:3300/0 conn(0x7f879815f900 0x7f879815fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f879d09e640 1 -- 172.21.15.6:0/1206469819 >> v1:172.21.15.171:6789/0 conn(0x7f87980c76d0 legacy=0x7f87980c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f879d09e640 1 -- 172.21.15.6:0/1206469819 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87980b3900 con 0x7f87980b2c50 2024-05-20T17:53:32.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f879c89d640 1 --2- 172.21.15.6:0/1206469819 >> v2:172.21.15.171:3300/0 conn(0x7f879815f900 0x7f879815fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:32.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fc9cd265640 1 --2- 172.21.15.6:0/2259381288 >> v2:172.21.15.171:3300/0 conn(0x7fc9c00e47c0 0x7fc9c0037b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fc9cd265640 1 -- 172.21.15.6:0/2259381288 >> v1:172.21.15.171:6789/0 conn(0x7fc9c00e7330 legacy=0x7fc9c00e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f850f7fe640 1 --2- 172.21.15.6:0/591157598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85080ddff0 0x7f85080e3e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f85040097a0 tx=0x7f850402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bd6a07b002a04d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fc9cd265640 1 -- 172.21.15.6:0/2259381288 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c0057ed0 con 0x7fc9c00380c0 2024-05-20T17:53:32.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fde74a1c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fde700cfe10 0x7fde70163600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fde74a1c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fde700cfe10 0x7fde70163600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54210/0 (socket says 172.21.15.6:54210) 2024-05-20T17:53:32.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fde74a1c640 1 -- 172.21.15.6:0/748186056 learned_addr learned my addr 172.21.15.6:0/748186056 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7f8897fff640 1 -- 172.21.15.6:0/3818849441 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890037070 con 0x7f88980e7f20 2024-05-20T17:53:32.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fc9cda66640 1 --2- 172.21.15.6:0/2259381288 >> v2:172.21.15.171:3300/0 conn(0x7fc9c00e47c0 0x7fc9c0037b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7f850e7fc640 1 -- 172.21.15.6:0/591157598 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504037070 con 0x7f85080ddff0 2024-05-20T17:53:32.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7f850e7fc640 1 -- 172.21.15.6:0/591157598 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504032440 con 0x7f85080ddff0 2024-05-20T17:53:32.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7f850e7fc640 1 -- 172.21.15.6:0/591157598 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850402ae60 con 0x7f85080ddff0 2024-05-20T17:53:32.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7f8897fff640 1 -- 172.21.15.6:0/3818849441 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8890032440 con 0x7f88980e7f20 2024-05-20T17:53:32.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7f8897fff640 1 -- 172.21.15.6:0/3818849441 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890032850 con 0x7f88980e7f20 2024-05-20T17:53:32.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7f879d09e640 1 --2- 172.21.15.6:0/1206469819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f87980d1ef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8794009870 tx=0x7f879402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89f42a93525fe08a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fde74a1c640 1 -- 172.21.15.6:0/748186056 >> v2:172.21.15.6:3300/0 conn(0x7fde7006cc40 msgr2=0x7fde7006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fde74a1c640 1 --2- 172.21.15.6:0/748186056 >> v2:172.21.15.6:3300/0 conn(0x7fde7006cc40 0x7fde7006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fde74a1c640 1 -- 172.21.15.6:0/748186056 >> v1:172.21.15.6:6789/0 conn(0x7fde70167b90 legacy=0x7fde7006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.802+0000 7fde74a1c640 1 -- 172.21.15.6:0/748186056 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde700b4ea0 con 0x7fde700cfe10 2024-05-20T17:53:32.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f94baffd640 1 -- 172.21.15.6:0/787057634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4007740 con 0x7f94bc0cfe10 2024-05-20T17:53:32.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f94baffd640 1 -- 172.21.15.6:0/787057634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b40078e0 con 0x7f94bc0cfe10 2024-05-20T17:53:32.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f878ffff640 1 -- 172.21.15.6:0/1206469819 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794037070 con 0x7f87980b2c50 2024-05-20T17:53:32.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f878ffff640 1 -- 172.21.15.6:0/1206469819 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8794032440 con 0x7f87980b2c50 2024-05-20T17:53:32.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f878ffff640 1 -- 172.21.15.6:0/1206469819 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794032810 con 0x7f87980b2c50 2024-05-20T17:53:32.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7fc9cd265640 1 --2- 172.21.15.6:0/2259381288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00384d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9c003c310 tx=0x7fc9b802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627454acfcf6ae3e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f6b10cba640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6afc0051c0 0x7f6afc00b9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c069ea0 tx=0x7f6afc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4897b1db1bddcb5d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7fc9cca64640 1 -- 172.21.15.6:0/2259381288 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8037070 con 0x7fc9c00380c0 2024-05-20T17:53:32.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7fc9cca64640 1 -- 172.21.15.6:0/2259381288 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b802adc0 con 0x7fc9c00380c0 2024-05-20T17:53:32.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f8514bd5640 1 -- 172.21.15.6:0/591157598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85080ddff0 msgr2=0x7f85080e3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f8514bd5640 1 --2- 172.21.15.6:0/591157598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85080ddff0 0x7f85080e3e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f85040097a0 tx=0x7f850402a110 comp rx=0 tx=0).stop 2024-05-20T17:53:32.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7fc9cca64640 1 -- 172.21.15.6:0/2259381288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8032660 con 0x7fc9c00380c0 2024-05-20T17:53:32.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f94baffd640 1 -- 172.21.15.6:0/787057634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4007cb0 con 0x7f94bc0cfe10 2024-05-20T17:53:32.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f8514bd5640 1 -- 172.21.15.6:0/591157598 shutdown_connections 2024-05-20T17:53:32.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f8514bd5640 1 --2- 172.21.15.6:0/591157598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8508006410 0x7f8508054130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f8514bd5640 1 --2- 172.21.15.6:0/591157598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85080ddff0 0x7f85080e3e20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f8514bd5640 1 -- 172.21.15.6:0/591157598 >> 172.21.15.6:0/591157598 conn(0x7f8508056400 msgr2=0x7f8508059210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f88a6011640 1 -- 172.21.15.6:0/3818849441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88980e7f20 msgr2=0x7f8898053140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f88a6011640 1 --2- 172.21.15.6:0/3818849441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88980e7f20 0x7f8898053140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f889800b250 tx=0x7f889002a1c0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0b3070 con 0x7f6afc0051c0 2024-05-20T17:53:32.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f88a6011640 1 -- 172.21.15.6:0/3818849441 shutdown_connections 2024-05-20T17:53:32.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f88a6011640 1 --2- 172.21.15.6:0/3818849441 >> v2:172.21.15.6:3300/0 conn(0x7f8898049520 0x7f8898035bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f88a6011640 1 --2- 172.21.15.6:0/3818849441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88980e7f20 0x7f8898053140 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f88a6011640 1 -- 172.21.15.6:0/3818849441 >> 172.21.15.6:0/3818849441 conn(0x7f889801f1a0 msgr2=0x7f889803ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.801+0000 7f75b9148640 1 -- start start 2024-05-20T17:53:32.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7fde74a1c640 1 --2- 172.21.15.6:0/748186056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde700cfe10 0x7fde70163600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fde7006e040 tx=0x7fde6402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db77adfbaea3b074 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0c074750 con 0x7f6afc0051c0 2024-05-20T17:53:32.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.803+0000 7f6b0affd640 1 -- 172.21.15.6:0/2480589382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0a6ba0 con 0x7f6afc0051c0 2024-05-20T17:53:32.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f8514bd5640 1 -- 172.21.15.6:0/591157598 shutdown_connections 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f94c1689640 1 -- 172.21.15.6:0/787057634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 msgr2=0x7f94bc163600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f94c1689640 1 --2- 172.21.15.6:0/787057634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 0x7f94bc163600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009d90 tx=0x7f94b402a660 comp rx=0 tx=0).stop 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f94c1689640 1 -- 172.21.15.6:0/787057634 shutdown_connections 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f94c1689640 1 --2- 172.21.15.6:0/787057634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc06cc40 0x7f94bc06e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f94c1689640 1 --2- 172.21.15.6:0/787057634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 0x7f94bc163600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f94c1689640 1 -- 172.21.15.6:0/787057634 >> 172.21.15.6:0/787057634 conn(0x7f94bc0721d0 msgr2=0x7f94bc0725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7fde6f7fe640 1 -- 172.21.15.6:0/748186056 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64037070 con 0x7fde700cfe10 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7fde6f7fe640 1 -- 172.21.15.6:0/748186056 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde64032440 con 0x7fde700cfe10 2024-05-20T17:53:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7fde6f7fe640 1 -- 172.21.15.6:0/748186056 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64032810 con 0x7fde700cfe10 2024-05-20T17:53:32.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b9148640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75b406cc40 0x7f75b416e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f879f302640 1 -- 172.21.15.6:0/1206469819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 msgr2=0x7f87980d1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f879f302640 1 --2- 172.21.15.6:0/1206469819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f87980d1ef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8794009870 tx=0x7f879402a250 comp rx=0 tx=0).stop 2024-05-20T17:53:32.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f879f302640 1 -- 172.21.15.6:0/1206469819 shutdown_connections 2024-05-20T17:53:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b9148640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b4163a10 con 0x7f75b4163600 2024-05-20T17:53:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b9148640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b406f110 con 0x7f75b40cfe10 2024-05-20T17:53:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b9148640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f75b40b54f0 con 0x7f75b406cc40 2024-05-20T17:53:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b3fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f75b40cfe10 0x7f75b4167b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:49412/0 (socket says 172.21.15.6:49412) 2024-05-20T17:53:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b3fff640 1 -- 172.21.15.6:0/189834536 learned_addr learned my addr 172.21.15.6:0/189834536 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b8947640 1 --2- 172.21.15.6:0/189834536 >> v2:172.21.15.6:3300/0 conn(0x7f75b406cc40 0x7f75b416e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f879f302640 1 --2- 172.21.15.6:0/1206469819 >> v2:172.21.15.171:3300/0 conn(0x7f879815f900 0x7f879815fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f879f302640 1 --2- 172.21.15.6:0/1206469819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f87980d1ef0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f8514bd5640 1 -- 172.21.15.6:0/591157598 wait complete. 2024-05-20T17:53:32.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f879f302640 1 -- 172.21.15.6:0/1206469819 >> 172.21.15.6:0/1206469819 conn(0x7f87980b65f0 msgr2=0x7f87980b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f6b114bb640 1 -- 172.21.15.6:0/2480589382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6afc0051c0 msgr2=0x7f6afc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f6b114bb640 1 --2- 172.21.15.6:0/2480589382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6afc0051c0 0x7f6afc00b9c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c069ea0 tx=0x7f6afc005830 comp rx=0 tx=0).stop 2024-05-20T17:53:32.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f6b10cba640 1 -- 172.21.15.6:0/2480589382 reap_dead start 2024-05-20T17:53:32.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f879f302640 1 -- 172.21.15.6:0/1206469819 shutdown_connections 2024-05-20T17:53:32.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fc9cfcca640 1 -- 172.21.15.6:0/2259381288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 msgr2=0x7fc9c00384d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f879f302640 1 -- 172.21.15.6:0/1206469819 wait complete. 2024-05-20T17:53:32.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107569107 0 0) 0x7f75b406f110 con 0x7f75b40cfe10 2024-05-20T17:53:32.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f88a6011640 1 -- 172.21.15.6:0/3818849441 shutdown_connections 2024-05-20T17:53:32.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f6b114bb640 1 -- 172.21.15.6:0/2480589382 shutdown_connections 2024-05-20T17:53:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f6b114bb640 1 -- 172.21.15.6:0/2480589382 >> 172.21.15.6:0/2480589382 conn(0x7f6b04054cf0 msgr2=0x7f6b04055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/2259381288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00384d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9c003c310 tx=0x7fc9b802a0b0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.804+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f759c003520 con 0x7f75b40cfe10 2024-05-20T17:53:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fc9cfcca640 1 -- 172.21.15.6:0/2259381288 shutdown_connections 2024-05-20T17:53:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/2259381288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00384d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/2259381288 >> v2:172.21.15.171:3300/0 conn(0x7fc9c00e47c0 0x7fc9c0037b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fc9cfcca640 1 -- 172.21.15.6:0/2259381288 >> 172.21.15.6:0/2259381288 conn(0x7fc9c0059110 msgr2=0x7fc9c0059520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fde75a1e640 1 -- 172.21.15.6:0/748186056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde700cfe10 msgr2=0x7fde70163600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fde75a1e640 1 --2- 172.21.15.6:0/748186056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde700cfe10 0x7fde70163600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fde7006e040 tx=0x7fde6402a230 comp rx=0 tx=0).stop 2024-05-20T17:53:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f6b114bb640 1 -- 172.21.15.6:0/2480589382 shutdown_connections 2024-05-20T17:53:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f6b114bb640 1 -- 172.21.15.6:0/2480589382 wait complete. 2024-05-20T17:53:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f94c1689640 1 -- 172.21.15.6:0/787057634 shutdown_connections 2024-05-20T17:53:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f94c1689640 1 -- 172.21.15.6:0/787057634 wait complete. 2024-05-20T17:53:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fde75a1e640 1 -- 172.21.15.6:0/748186056 shutdown_connections 2024-05-20T17:53:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fde75a1e640 1 --2- 172.21.15.6:0/748186056 >> v2:172.21.15.6:3300/0 conn(0x7fde7006cc40 0x7fde7006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fde75a1e640 1 --2- 172.21.15.6:0/748186056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde700cfe10 0x7fde70163600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7fde75a1e640 1 -- 172.21.15.6:0/748186056 >> 172.21.15.6:0/748186056 conn(0x7fde700721d0 msgr2=0x7fde700725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7fc9cfcca640 1 -- 172.21.15.6:0/2259381288 shutdown_connections 2024-05-20T17:53:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3147382062 0 0) 0x7f759c003520 con 0x7f75b40cfe10 2024-05-20T17:53:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 >> v2:172.21.15.6:3300/0 conn(0x7f75b406cc40 msgr2=0x7f75b416e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f75b2ffd640 1 --2- 172.21.15.6:0/189834536 >> v2:172.21.15.6:3300/0 conn(0x7f75b406cc40 0x7f75b416e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 >> v1:172.21.15.6:6789/0 conn(0x7f75b4163600 legacy=0x7f75b406c530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:53:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b40b48e0 con 0x7f75b40cfe10 2024-05-20T17:53:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.805+0000 7f88a6011640 1 -- 172.21.15.6:0/3818849441 wait complete. 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f75a4001670 con 0x7f75b40cfe10 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 >> v1:172.21.15.171:6789/0 conn(0x7f75b40cfe10 legacy=0x7f75b4167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f759c0039b0 0x7f759c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c004800 0x7f759c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f759c0051c0 0x7f759c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f75b40b54f0 con 0x7f759c0039b0 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f759c00c160 con 0x7f759c004800 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f759c00c360 con 0x7f759c0051c0 2024-05-20T17:53:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b8947640 1 --2- 172.21.15.6:0/189834536 >> v2:172.21.15.6:3300/0 conn(0x7f75b406cc40 0x7f75b416e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7fde75a1e640 1 -- 172.21.15.6:0/748186056 shutdown_connections 2024-05-20T17:53:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7fde75a1e640 1 -- 172.21.15.6:0/748186056 wait complete. 2024-05-20T17:53:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.806+0000 7f75b3fff640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f759c0039b0 0x7f759c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.808+0000 7f8514bd5640 1 Processor -- start 2024-05-20T17:53:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.808+0000 7fc9cfcca640 1 -- 172.21.15.6:0/2259381288 wait complete. 2024-05-20T17:53:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.808+0000 7f8514bd5640 1 -- start start 2024-05-20T17:53:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.808+0000 7f879f302640 1 Processor -- start 2024-05-20T17:53:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.808+0000 7f6b114bb640 1 Processor -- start 2024-05-20T17:53:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.808+0000 7f879f302640 1 -- start start 2024-05-20T17:53:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7f94c1689640 1 Processor -- start 2024-05-20T17:53:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7f88a6011640 1 Processor -- start 2024-05-20T17:53:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7f88a6011640 1 -- start start 2024-05-20T17:53:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7f94c1689640 1 -- start start 2024-05-20T17:53:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7fde75a1e640 1 Processor -- start 2024-05-20T17:53:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7fde75a1e640 1 -- start start 2024-05-20T17:53:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b8947640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f759c0051c0 0x7f759c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b3fff640 1 -- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f759c0051c0 msgr2=0x7f759c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b3fff640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f759c0051c0 0x7f759c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b3fff640 1 -- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c004800 msgr2=0x7f759c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b37fe640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c004800 0x7f759c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b3fff640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c004800 0x7f759c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b8947640 1 -- 172.21.15.6:0/189834536 reap_dead start 2024-05-20T17:53:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7f6b114bb640 1 -- start start 2024-05-20T17:53:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b114bb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc0051c0 0x7f6b040d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b3fff640 1 -- 172.21.15.6:0/189834536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b40b48e0 con 0x7f759c0039b0 2024-05-20T17:53:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.807+0000 7f75b37fe640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c004800 0x7f759c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b114bb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0404db30 0x7f6b0404df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.808+0000 7f75b3fff640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f759c0039b0 0x7f759c003e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f75b40b03b0 tx=0x7f759c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368ce6715ea76c90 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f8514bd5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8508006410 0x7f85080dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4007d30 con 0x7f759c0039b0 2024-05-20T17:53:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f8514bd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8508054670 0x7f8508179920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b0bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc0051c0 0x7f6b040d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b0bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc0051c0 0x7f6b040d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54226/0 (socket says 172.21.15.6:54226) 2024-05-20T17:53:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b0bfff640 1 -- 172.21.15.6:0/4193761525 learned_addr learned my addr 172.21.15.6:0/4193761525 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f8514bd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85080ddff0 0x7f850803b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f879f302640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f879814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7fc9cfcca640 1 Processor -- start 2024-05-20T17:53:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7fc9cfcca640 1 -- start start 2024-05-20T17:53:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b114bb640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0404c5a0 0x7f6b0404c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b0b7fe640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0404db30 0x7f6b0404df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f879f302640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980c76d0 0x7f879814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f8514bd5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8508007d00 con 0x7f8508054670 2024-05-20T17:53:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6b04033f30 con 0x7f6b0404c5a0 2024-05-20T17:53:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f88a6011640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8898054570 0x7f88980e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f8514bd5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f85080077e0 con 0x7f8508006410 2024-05-20T17:53:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6b04033db0 con 0x7f6afc0051c0 2024-05-20T17:53:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f8514bd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8508058570 con 0x7f85080ddff0 2024-05-20T17:53:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f879f302640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f879815f900 0x7f87981f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6b040e16a0 con 0x7f6b0404db30 2024-05-20T17:53:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f88a6011640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88980e7f20 0x7f88980e5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.811+0000 7f94c1689640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 0x7f94bc09d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f88a6011640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88980de660 0x7f88981819e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a4034070 con 0x7f759c0039b0 2024-05-20T17:53:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.809+0000 7f75b2ffd640 1 -- 172.21.15.6:0/189834536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4007d30 con 0x7f759c0039b0 2024-05-20T17:53:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.810+0000 7f75b9148640 1 -- 172.21.15.6:0/189834536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f759c0039b0 msgr2=0x7f759c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.810+0000 7f75b9148640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f759c0039b0 0x7f759c003e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f75b40b03b0 tx=0x7f759c005830 comp rx=0 tx=0).stop 2024-05-20T17:53:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94c1689640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94bc167b90 0x7f94bc153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f75b9148640 1 -- 172.21.15.6:0/189834536 shutdown_connections 2024-05-20T17:53:32.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f75b9148640 1 --2- 172.21.15.6:0/189834536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f759c0039b0 0x7f759c003e20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f75b9148640 1 -- 172.21.15.6:0/189834536 >> 172.21.15.6:0/189834536 conn(0x7f75b40721d0 msgr2=0x7f75b40725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:32.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f879c89d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980c76d0 0x7f879814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f6b10cba640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0404c5a0 0x7f6b0404c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94c1689640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc0b1e70 0x7f94bc09ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94bb7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94bc167b90 0x7f94bc153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f75b9148640 1 -- 172.21.15.6:0/189834536 shutdown_connections 2024-05-20T17:53:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7fde75a1e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde70167b90 0x7fde7009e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7fde75a1e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700c6050 0x7fde701574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f850ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85080ddff0 0x7f850803b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f850f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8508006410 0x7f85080dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f850ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85080ddff0 0x7f850803b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49914/0 (socket says 172.21.15.6:49914) 2024-05-20T17:53:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f850ffff640 1 -- 172.21.15.6:0/3230640111 learned_addr learned my addr 172.21.15.6:0/3230640111 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f879c89d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980c76d0 0x7f879814f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54230/0 (socket says 172.21.15.6:54230) 2024-05-20T17:53:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7fde75a1e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde70155190 0x7fde701555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f850effd640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8508054670 0x7f8508179920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94bb7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94bc167b90 0x7f94bc153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54262/0 (socket says 172.21.15.6:54262) 2024-05-20T17:53:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 0x7f94bc09d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 0x7f94bc09d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46430/0 (socket says 172.21.15.6:46430) 2024-05-20T17:53:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94c1689640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc167fa0 con 0x7f94bc0cfe10 2024-05-20T17:53:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94c1689640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc0b5980 con 0x7f94bc167b90 2024-05-20T17:53:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94c1689640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc168120 con 0x7f94bc0b1e70 2024-05-20T17:53:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f879d09e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f879814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f879d09e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f879814fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49942/0 (socket says 172.21.15.6:49942) 2024-05-20T17:53:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f6b0bfff640 1 -- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0404db30 msgr2=0x7f6b0404df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f6b0bfff640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0404db30 0x7f6b0404df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f6b0bfff640 1 -- 172.21.15.6:0/4193761525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0404c5a0 msgr2=0x7f6b0404c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f6b0bfff640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0404c5a0 0x7f6b0404c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f6b0bfff640 1 -- 172.21.15.6:0/4193761525 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b040d38d0 con 0x7f6afc0051c0 2024-05-20T17:53:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f94bb7fe640 1 -- 172.21.15.6:0/1755720260 learned_addr learned my addr 172.21.15.6:0/1755720260 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7fde7521d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde70155190 0x7fde701555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fde7521d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde70155190 0x7fde701555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46436/0 (socket says 172.21.15.6:46436) 2024-05-20T17:53:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f879d89f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f879815f900 0x7f87981f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f6b0bfff640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc0051c0 0x7f6b040d25a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6af800e7a0 tx=0x7f6af800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fde6ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700c6050 0x7fde701574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f94c0e88640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc0b1e70 0x7f94bc09ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fde6ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700c6050 0x7fde701574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49950/0 (socket says 172.21.15.6:49950) 2024-05-20T17:53:32.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fde7521d640 1 -- 172.21.15.6:0/799034085 learned_addr learned my addr 172.21.15.6:0/799034085 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f879d89f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f879815f900 0x7f87981f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46410/0 (socket says 172.21.15.6:46410) 2024-05-20T17:53:32.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fde70167fa0 con 0x7fde70155190 2024-05-20T17:53:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f850ffff640 1 -- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8508006410 msgr2=0x7f85080dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f850ffff640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8508006410 0x7f85080dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f850ffff640 1 -- 172.21.15.6:0/3230640111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8508054670 msgr2=0x7f8508179920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f850ffff640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8508054670 0x7f8508179920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f850ffff640 1 -- 172.21.15.6:0/3230640111 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850817d860 con 0x7f85080ddff0 2024-05-20T17:53:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde700b5980 con 0x7fde70167b90 2024-05-20T17:53:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f850f7fe640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8508006410 0x7f85080dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f879f302640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f87980c81f0 con 0x7f879815f900 2024-05-20T17:53:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f879f302640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f87980b3060 con 0x7f87980c76d0 2024-05-20T17:53:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f850effd640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8508054670 0x7f8508179920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f94bb7fe640 1 -- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc0b1e70 msgr2=0x7f94bc09ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f94bb7fe640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc0b1e70 0x7f94bc09ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f94bb7fe640 1 -- 172.21.15.6:0/1755720260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 msgr2=0x7f94bc09d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f94bb7fe640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 0x7f94bc09d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f94bb7fe640 1 -- 172.21.15.6:0/1755720260 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc09e890 con 0x7f94bc167b90 2024-05-20T17:53:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f879f302640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f87980c8370 con 0x7f87980b2c50 2024-05-20T17:53:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fde70168120 con 0x7fde700c6050 2024-05-20T17:53:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fc9cfcca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00de570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fc9cfcca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9c00e47c0 0x7fc9c018aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f879c89d640 1 -- 172.21.15.6:0/3705706188 learned_addr learned my addr 172.21.15.6:0/3705706188 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fc9cfcca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9c00e7330 0x7fc9c018afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fc9cfcca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00e4bd0 con 0x7fc9c00380c0 2024-05-20T17:53:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fc9cfcca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0058490 con 0x7fc9c00e7330 2024-05-20T17:53:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fc9cfcca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c004f1a0 con 0x7fc9c00e47c0 2024-05-20T17:53:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7fde74a1c640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde70167b90 0x7fde7009e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f850ffff640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85080ddff0 0x7f850803b050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8510000b60 tx=0x7f8510074f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f88a500f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8898054570 0x7f88980e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f88a480e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88980e7f20 0x7f88980e5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f6b08ff9640 1 -- 172.21.15.6:0/4193761525 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8017070 con 0x7f6afc0051c0 2024-05-20T17:53:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f6b08ff9640 1 -- 172.21.15.6:0/4193761525 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af800c6b0 con 0x7f6afc0051c0 2024-05-20T17:53:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f88a480e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88980e7f20 0x7f88980e5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:49926/0 (socket says 172.21.15.6:49926) 2024-05-20T17:53:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f88a500f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8898054570 0x7f88980e4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54248/0 (socket says 172.21.15.6:54248) 2024-05-20T17:53:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f88a6011640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8898036100 con 0x7f88980de660 2024-05-20T17:53:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f88a6011640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8898053680 con 0x7f8898054570 2024-05-20T17:53:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f88a6011640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8898036280 con 0x7f88980e7f20 2024-05-20T17:53:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.812+0000 7f75b9148640 1 -- 172.21.15.6:0/189834536 wait complete. 2024-05-20T17:53:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.813+0000 7f88a480e640 1 -- 172.21.15.6:0/2654901735 learned_addr learned my addr 172.21.15.6:0/2654901735 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b04036fd0 con 0x7f6afc0051c0 2024-05-20T17:53:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9cda66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00de570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9cda66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00de570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46438/0 (socket says 172.21.15.6:46438) 2024-05-20T17:53:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9cd265640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9c00e47c0 0x7fc9c018aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9cda66640 1 -- 172.21.15.6:0/3225938447 learned_addr learned my addr 172.21.15.6:0/3225938447 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b04037590 con 0x7f6afc0051c0 2024-05-20T17:53:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9ce267640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9c00e7330 0x7fc9c018afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fde7521d640 1 -- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700c6050 msgr2=0x7fde701574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fde7521d640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700c6050 0x7fde701574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fde7521d640 1 -- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde70167b90 msgr2=0x7fde7009e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fde7521d640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde70167b90 0x7fde7009e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fde7521d640 1 -- 172.21.15.6:0/799034085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7009d060 con 0x7fde70155190 2024-05-20T17:53:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f88a5810640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88980de660 0x7f88981819e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f94bb7fe640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94bc167b90 0x7f94bc153600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c3f0 tx=0x7f94b000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f879d09e640 1 -- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980c76d0 msgr2=0x7f879814f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f879d09e640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980c76d0 0x7f879814f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f879d09e640 1 -- 172.21.15.6:0/3705706188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f879815f900 msgr2=0x7f87981f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f879d09e640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f879815f900 0x7f87981f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f879d09e640 1 -- 172.21.15.6:0/3705706188 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87980cbef0 con 0x7f87980b2c50 2024-05-20T17:53:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f84fbfff640 1 -- 172.21.15.6:0/3230640111 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851006b520 con 0x7f85080ddff0 2024-05-20T17:53:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f879c89d640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980c76d0 0x7f879814f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f879d09e640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f879814fa70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f87980730d0 tx=0x7f87940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9cda66640 1 -- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9c00e47c0 msgr2=0x7fc9c018aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9cda66640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9c00e47c0 0x7fc9c018aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9cda66640 1 -- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9c00e7330 msgr2=0x7fc9c018afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7fc9cda66640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9c00e7330 0x7fc9c018afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7fc9cda66640 1 -- 172.21.15.6:0/3225938447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c004d9a0 con 0x7fc9c00380c0 2024-05-20T17:53:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f88a480e640 1 -- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8898054570 msgr2=0x7f88980e4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f88a480e640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8898054570 0x7f88980e4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f88a480e640 1 -- 172.21.15.6:0/2654901735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88980de660 msgr2=0x7f88981819e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f88a480e640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88980de660 0x7f88981819e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f88a480e640 1 -- 172.21.15.6:0/2654901735 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8898035460 con 0x7f88980e7f20 2024-05-20T17:53:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f94b8ff9640 1 -- 172.21.15.6:0/1755720260 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0017070 con 0x7f94bc167b90 2024-05-20T17:53:32.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7fc9cd265640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9c00e47c0 0x7fc9c018aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:32.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f878dffb640 1 -- 172.21.15.6:0/3705706188 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794041070 con 0x7f87980b2c50 2024-05-20T17:53:32.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7fde7521d640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde70155190 0x7fde701555a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fde6800ba10 tx=0x7fde6800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f94b8ff9640 1 -- 172.21.15.6:0/1755720260 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b00035f0 con 0x7f94bc167b90 2024-05-20T17:53:32.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f94b8ff9640 1 -- 172.21.15.6:0/1755720260 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b00039e0 con 0x7f94bc167b90 2024-05-20T17:53:32.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.814+0000 7f6b08ff9640 1 -- 172.21.15.6:0/4193761525 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af800ca80 con 0x7f6afc0051c0 2024-05-20T17:53:32.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc09dff0 con 0x7f94bc167b90 2024-05-20T17:53:32.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7fc9cda66640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00de570 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80504d0 tx=0x7fc9c8068b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f75b9148640 1 Processor -- start 2024-05-20T17:53:32.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f88a480e640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88980e7f20 0x7f88980e5190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f88a0064fc0 tx=0x7f88a0074f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879815eee0 con 0x7f87980b2c50 2024-05-20T17:53:32.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f879815f1c0 con 0x7f87980b2c50 2024-05-20T17:53:32.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc09e5b0 con 0x7f94bc167b90 2024-05-20T17:53:32.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f878dffb640 1 -- 172.21.15.6:0/3705706188 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8794030a80 con 0x7f87980b2c50 2024-05-20T17:53:32.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.816+0000 7fc9be7fc640 1 -- 172.21.15.6:0/3225938447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c806c6a0 con 0x7fc9c00380c0 2024-05-20T17:53:32.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.816+0000 7fc9be7fc640 1 -- 172.21.15.6:0/3225938447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c806c840 con 0x7fc9c00380c0 2024-05-20T17:53:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.816+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c00df2e0 con 0x7fc9c00380c0 2024-05-20T17:53:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f8514bd5640 1 -- 172.21.15.6:0/3230640111 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850817db40 con 0x7f85080ddff0 2024-05-20T17:53:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f8514bd5640 1 -- 172.21.15.6:0/3230640111 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f850817e100 con 0x7f85080ddff0 2024-05-20T17:53:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.816+0000 7f84fbfff640 1 -- 172.21.15.6:0/3230640111 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f851006b6e0 con 0x7f85080ddff0 2024-05-20T17:53:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.815+0000 7f6af67fc640 1 -- 172.21.15.6:0/4193761525 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae4005290 con 0x7f6afc0051c0 2024-05-20T17:53:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.816+0000 7f8895ffb640 1 -- 172.21.15.6:0/2654901735 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a008be10 con 0x7f88980e7f20 2024-05-20T17:53:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.816+0000 7f8895ffb640 1 -- 172.21.15.6:0/2654901735 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a008f020 con 0x7f88980e7f20 2024-05-20T17:53:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.816+0000 7f8895ffb640 1 -- 172.21.15.6:0/2654901735 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a006b720 con 0x7f88980e7f20 2024-05-20T17:53:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7f84fbfff640 1 -- 172.21.15.6:0/3230640111 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851006bb10 con 0x7f85080ddff0 2024-05-20T17:53:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7f878dffb640 1 -- 172.21.15.6:0/3705706188 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8794037040 con 0x7f87980b2c50 2024-05-20T17:53:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7fde6d7fa640 1 -- 172.21.15.6:0/799034085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68019070 con 0x7fde70155190 2024-05-20T17:53:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7fde6d7fa640 1 -- 172.21.15.6:0/799034085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde6800cb60 con 0x7fde70155190 2024-05-20T17:53:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde7009d340 con 0x7fde70155190 2024-05-20T17:53:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c00df8a0 con 0x7fc9c00380c0 2024-05-20T17:53:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7fc9be7fc640 1 -- 172.21.15.6:0/3225938447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c806cc10 con 0x7fc9c00380c0 2024-05-20T17:53:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7fde6d7fa640 1 -- 172.21.15.6:0/799034085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68014440 con 0x7fde70155190 2024-05-20T17:53:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde7009d900 con 0x7fde70155190 2024-05-20T17:53:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.817+0000 7f6b08ff9640 1 -- 172.21.15.6:0/4193761525 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6af801a070 con 0x7f6afc0051c0 2024-05-20T17:53:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.816+0000 7f75b9148640 1 -- start start 2024-05-20T17:53:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.818+0000 7f75b9148640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c0039b0 0x7f75b409b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.818+0000 7f6b08ff9640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6af006beb0 0x7f6af006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.818+0000 7f6b08ff9640 1 -- 172.21.15.6:0/4193761525 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6af808b1c0 con 0x7f6afc0051c0 2024-05-20T17:53:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f84fbfff640 1 -- 172.21.15.6:0/3230640111 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f851006bcb0 con 0x7f85080ddff0 2024-05-20T17:53:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88980e56d0 con 0x7f88980e7f20 2024-05-20T17:53:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f8514bd5640 1 -- 172.21.15.6:0/3230640111 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f0005290 con 0x7f85080ddff0 2024-05-20T17:53:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f6b0b7fe640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6af006beb0 0x7f6af006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88980ea720 con 0x7f88980e7f20 2024-05-20T17:53:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7006fe20 con 0x7fde70155190 2024-05-20T17:53:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f75b9148640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75b409e2e0 0x7f75b414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f75b9148640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b4165db0 0x7f75b41661c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f75b9148640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f75b40b5180 con 0x7f75b4165db0 2024-05-20T17:53:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f75b3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c0039b0 0x7f75b409b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f75b9148640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f75b40b4ea0 con 0x7f759c0039b0 2024-05-20T17:53:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f75b3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c0039b0 0x7f75b409b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54284/0 (socket says 172.21.15.6:54284) 2024-05-20T17:53:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b9148640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f75b40b5980 con 0x7f75b409e2e0 2024-05-20T17:53:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b3fff640 1 -- 172.21.15.6:0/390780635 learned_addr learned my addr 172.21.15.6:0/390780635 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7f84fbfff640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f406bf30 0x7f84f406e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f84fbfff640 1 -- 172.21.15.6:0/3230640111 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8510106380 con 0x7f85080ddff0 2024-05-20T17:53:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f94b8ff9640 1 -- 172.21.15.6:0/1755720260 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94b001a070 con 0x7f94bc167b90 2024-05-20T17:53:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.819+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b0005290 con 0x7fc9c00380c0 2024-05-20T17:53:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc075980 con 0x7f94bc167b90 2024-05-20T17:53:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b37fe640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75b409e2e0 0x7f75b414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b8947640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b4165db0 0x7f75b41661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f850f7fe640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f406bf30 0x7f84f406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b3fff640 1 -- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75b409e2e0 msgr2=0x7f75b414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b3fff640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75b409e2e0 0x7f75b414fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b3fff640 1 -- 172.21.15.6:0/390780635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b4165db0 msgr2=0x7f75b41661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b3fff640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b4165db0 0x7f75b41661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f75b3fff640 1 -- 172.21.15.6:0/390780635 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b4166700 con 0x7f759c0039b0 2024-05-20T17:53:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f6b0b7fe640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6af006beb0 0x7f6af006e3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b000019b0 tx=0x7f6b00001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.820+0000 7f94b8ff9640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f94a806bf00 0x7f94a806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8778005290 con 0x7f87980b2c50 2024-05-20T17:53:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7f94b8ff9640 1 -- 172.21.15.6:0/1755720260 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f94b008a490 con 0x7f94bc167b90 2024-05-20T17:53:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7f94bbfff640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f94a806bf00 0x7f94a806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7f75b3fff640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c0039b0 0x7f75b409b130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f75a402afb0 tx=0x7f75a402d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7fc9be7fc640 1 -- 172.21.15.6:0/3225938447 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9c8095460 con 0x7fc9c00380c0 2024-05-20T17:53:32.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7fde6d7fa640 1 -- 172.21.15.6:0/799034085 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde6801c070 con 0x7fde70155190 2024-05-20T17:53:32.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88980058f0 con 0x7f88980e7f20 2024-05-20T17:53:32.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7fde6d7fa640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde5406bf00 0x7fde5406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7f878dffb640 1 -- 172.21.15.6:0/3705706188 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f879403b5f0 con 0x7f87980b2c50 2024-05-20T17:53:32.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7f850f7fe640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f406bf30 0x7f84f406e440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8504034000 tx=0x7f850402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.821+0000 7fde6d7fa640 1 -- 172.21.15.6:0/799034085 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fde6808adf0 con 0x7fde70155190 2024-05-20T17:53:32.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7fde74a1c640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde5406bf00 0x7fde5406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7fc9be7fc640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9ac06bf00 0x7fc9ac06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7f94bbfff640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f94a806bf00 0x7f94a806e410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94b4034000 tx=0x7f94b402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7fc9be7fc640 1 -- 172.21.15.6:0/3225938447 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc9c8105eb0 con 0x7fc9c00380c0 2024-05-20T17:53:32.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7f6b08ff9640 1 -- 172.21.15.6:0/4193761525 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6af8059250 con 0x7f6afc0051c0 2024-05-20T17:53:32.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7f8895ffb640 1 -- 172.21.15.6:0/2654901735 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88a006b8c0 con 0x7f88980e7f20 2024-05-20T17:53:32.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7fc9cd265640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9ac06bf00 0x7fc9ac06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7f878dffb640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f877c06be80 0x7f877c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.822+0000 7fde74a1c640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde5406bf00 0x7fde5406e410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fde64034000 tx=0x7fde6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.823+0000 7f879c89d640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f877c06be80 0x7f877c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.823+0000 7f878dffb640 1 -- 172.21.15.6:0/3705706188 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f87940af550 con 0x7f87980b2c50 2024-05-20T17:53:32.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.823+0000 7fc9cd265640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9ac06bf00 0x7fc9ac06e410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8034000 tx=0x7fc9b802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.823+0000 7f8895ffb640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888406beb0 0x7f888406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.823+0000 7f8895ffb640 1 -- 172.21.15.6:0/2654901735 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f88a0105ed0 con 0x7f88980e7f20 2024-05-20T17:53:32.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.823+0000 7f88a500f640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888406beb0 0x7f888406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.823+0000 7f879c89d640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f877c06be80 0x7f877c06e390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f878800d2c0 tx=0x7f8788008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.824+0000 7f88a500f640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888406beb0 0x7f888406e3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8890034000 tx=0x7f889002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.825+0000 7f84fbfff640 1 -- 172.21.15.6:0/3230640111 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8508054a80 con 0x7f85080ddff0 2024-05-20T17:53:32.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.827+0000 7fc9be7fc640 1 -- 172.21.15.6:0/3225938447 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc9c004d9a0 con 0x7fc9c00380c0 2024-05-20T17:53:32.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.827+0000 7f94b8ff9640 1 -- 172.21.15.6:0/1755720260 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f94b0058520 con 0x7f94bc167b90 2024-05-20T17:53:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.827+0000 7f75b0ff9640 1 -- 172.21.15.6:0/390780635 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4007d30 con 0x7f759c0039b0 2024-05-20T17:53:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.828+0000 7f75b0ff9640 1 -- 172.21.15.6:0/390780635 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a403f030 con 0x7f759c0039b0 2024-05-20T17:53:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.828+0000 7f75b0ff9640 1 -- 172.21.15.6:0/390780635 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4005e60 con 0x7f759c0039b0 2024-05-20T17:53:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.828+0000 7f75b9148640 1 -- 172.21.15.6:0/390780635 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b4150210 con 0x7f759c0039b0 2024-05-20T17:53:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.828+0000 7f75b9148640 1 -- 172.21.15.6:0/390780635 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b41507f0 con 0x7f759c0039b0 2024-05-20T17:53:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.830+0000 7f759a7fc640 1 -- 172.21.15.6:0/390780635 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758c005290 con 0x7f759c0039b0 2024-05-20T17:53:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.830+0000 7f878dffb640 1 -- 172.21.15.6:0/3705706188 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f879407d550 con 0x7f87980b2c50 2024-05-20T17:53:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.831+0000 7f75b0ff9640 1 -- 172.21.15.6:0/390780635 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75a40049e0 con 0x7f759c0039b0 2024-05-20T17:53:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.832+0000 7f75b0ff9640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f75a006bf00 0x7f75a006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.832+0000 7f75b0ff9640 1 -- 172.21.15.6:0/390780635 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f75a40abb60 con 0x7f759c0039b0 2024-05-20T17:53:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.833+0000 7f75b37fe640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f75a006bf00 0x7f75a006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.833+0000 7f75b37fe640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f75a006bf00 0x7f75a006e410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75b4160590 tx=0x7f75a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:32.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.835+0000 7f8895ffb640 1 -- 172.21.15.6:0/2654901735 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f88a0099030 con 0x7f88980e7f20 2024-05-20T17:53:32.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.836+0000 7f75b0ff9640 1 -- 172.21.15.6:0/390780635 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f75b4166700 con 0x7f759c0039b0 2024-05-20T17:53:32.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:32.836+0000 7fde6d7fa640 1 -- 172.21.15.6:0/799034085 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fde7006fe20 con 0x7fde70155190 2024-05-20T17:53:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.247+0000 7f6af67fc640 1 -- 172.21.15.6:0/4193761525 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6ae4005850 con 0x7f6afc0051c0 2024-05-20T17:53:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.248+0000 7f6b08ff9640 1 -- 172.21.15.6:0/4193761525 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6af805d550 con 0x7f6afc0051c0 2024-05-20T17:53:33.247 INFO:teuthology.orchestra.run.smithi006.stdout:55834574857 2024-05-20T17:53:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.251+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6af006beb0 msgr2=0x7f6af006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6af006beb0 0x7f6af006e3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b000019b0 tx=0x7f6b00001680 comp rx=0 tx=0).stop 2024-05-20T17:53:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc0051c0 msgr2=0x7f6b040d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc0051c0 0x7f6b040d25a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6af800e7a0 tx=0x7f6af800ec60 comp rx=0 tx=0).stop 2024-05-20T17:53:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 shutdown_connections 2024-05-20T17:53:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6af006beb0 0x7f6af006e3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b0404c5a0 0x7f6b0404c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0404db30 0x7f6b0404df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 --2- 172.21.15.6:0/4193761525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6afc0051c0 0x7f6b040d25a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 >> 172.21.15.6:0/4193761525 conn(0x7f6b04054cf0 msgr2=0x7f6b04034fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.252+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 shutdown_connections 2024-05-20T17:53:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.253+0000 7f6b114bb640 1 -- 172.21.15.6:0/4193761525 wait complete. 2024-05-20T17:53:33.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.255+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f94bc0afea0 con 0x7f94bc167b90 2024-05-20T17:53:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.256+0000 7f94b8ff9640 1 -- 172.21.15.6:0/1755720260 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f94b005c820 con 0x7f94bc167b90 2024-05-20T17:53:33.255 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2024-05-20T17:53:33.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.257+0000 7f8514bd5640 1 -- 172.21.15.6:0/3230640111 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f84f0005580 con 0x7f85080ddff0 2024-05-20T17:53:33.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.257+0000 7f84fbfff640 1 -- 172.21.15.6:0/3230640111 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85100d4380 con 0x7f85080ddff0 2024-05-20T17:53:33.257 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:33.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.259+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f94a806bf00 msgr2=0x7f94a806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.259+0000 7f94c1689640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f94a806bf00 0x7f94a806e410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94b4034000 tx=0x7f94b402f000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.260+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94bc167b90 msgr2=0x7f94bc153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.260+0000 7f94c1689640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94bc167b90 0x7f94bc153600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c3f0 tx=0x7f94b000c8b0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.260+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 shutdown_connections 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.260+0000 7f94c1689640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f94a806bf00 0x7f94a806e410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.260+0000 7f94c1689640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94bc0b1e70 0x7f94bc09ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.260+0000 7f94c1689640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94bc167b90 0x7f94bc153600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.260+0000 7f94c1689640 1 --2- 172.21.15.6:0/1755720260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94bc0cfe10 0x7f94bc09d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.260+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 >> 172.21.15.6:0/1755720260 conn(0x7f94bc0721d0 msgr2=0x7f94bc0ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:33.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 shutdown_connections 2024-05-20T17:53:33.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f94c1689640 1 -- 172.21.15.6:0/1755720260 wait complete. 2024-05-20T17:53:33.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 -- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f406bf30 msgr2=0x7f84f406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f406bf30 0x7f84f406e440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8504034000 tx=0x7f850402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 -- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85080ddff0 msgr2=0x7f850803b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85080ddff0 0x7f850803b050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8510000b60 tx=0x7f8510074f20 comp rx=0 tx=0).stop 2024-05-20T17:53:33.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 -- 172.21.15.6:0/3230640111 shutdown_connections 2024-05-20T17:53:33.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f406bf30 0x7f84f406e440 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8504034000 tx=0x7f850402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85080ddff0 0x7f850803b050 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8508054670 0x7f8508179920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 --2- 172.21.15.6:0/3230640111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8508006410 0x7f85080dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.261+0000 7f84f9ffb640 1 -- 172.21.15.6:0/3230640111 >> 172.21.15.6:0/3230640111 conn(0x7f8508056400 msgr2=0x7f850803dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.262+0000 7f84f9ffb640 1 -- 172.21.15.6:0/3230640111 shutdown_connections 2024-05-20T17:53:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.264+0000 7f84f9ffb640 1 -- 172.21.15.6:0/3230640111 wait complete. 2024-05-20T17:53:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.264+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc9b0005580 con 0x7fc9c00380c0 2024-05-20T17:53:33.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.265+0000 7fc9be7fc640 1 -- 172.21.15.6:0/3225938447 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9c80d3e20 con 0x7fc9c00380c0 2024-05-20T17:53:33.264 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2024-05-20T17:53:33.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.266+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8778005580 con 0x7f87980b2c50 2024-05-20T17:53:33.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.266+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8898036940 con 0x7f88980e7f20 2024-05-20T17:53:33.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.267+0000 7f878dffb640 1 -- 172.21.15.6:0/3705706188 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8794081850 con 0x7f87980b2c50 2024-05-20T17:53:33.266 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:33.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.267+0000 7f8895ffb640 1 -- 172.21.15.6:0/2654901735 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f88a0105030 con 0x7f88980e7f20 2024-05-20T17:53:33.267 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2024-05-20T17:53:33.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f877c06be80 msgr2=0x7f877c06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f877c06be80 0x7f877c06e390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f878800d2c0 tx=0x7f8788008040 comp rx=0 tx=0).stop 2024-05-20T17:53:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 msgr2=0x7f879814fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9ac06bf00 msgr2=0x7fc9ac06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9ac06bf00 0x7fc9ac06e410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8034000 tx=0x7fc9b802e000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 msgr2=0x7fc9c00de570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00de570 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80504d0 tx=0x7fc9c8068b40 comp rx=0 tx=0).stop 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f879814fa70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f87980730d0 tx=0x7f87940046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 shutdown_connections 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f877c06be80 0x7f877c06e390 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f878800d2c0 tx=0x7f8788008040 comp rx=0 tx=0).stop 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f879815f900 0x7f87981f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87980c76d0 0x7f879814f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 --2- 172.21.15.6:0/3705706188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87980b2c50 0x7f879814fa70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 >> 172.21.15.6:0/3705706188 conn(0x7f87980b65f0 msgr2=0x7f879806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 shutdown_connections 2024-05-20T17:53:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9ac06bf00 0x7fc9ac06e410 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8034000 tx=0x7fc9b802e000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9c00e7330 0x7fc9c018afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9c00e47c0 0x7fc9c018aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 --2- 172.21.15.6:0/3225938447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c00380c0 0x7fc9c00de570 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 >> 172.21.15.6:0/3225938447 conn(0x7fc9c0059110 msgr2=0x7fc9c00e27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888406beb0 msgr2=0x7f888406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f88a6011640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888406beb0 0x7f888406e3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8890034000 tx=0x7f889002e000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88980e7f20 msgr2=0x7f88980e5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.270+0000 7f88a6011640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88980e7f20 0x7f88980e5190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f88a0064fc0 tx=0x7f88a0074f20 comp rx=0 tx=0).stop 2024-05-20T17:53:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 shutdown_connections 2024-05-20T17:53:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7fc9cfcca640 1 -- 172.21.15.6:0/3225938447 wait complete. 2024-05-20T17:53:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 shutdown_connections 2024-05-20T17:53:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f88a6011640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888406beb0 0x7f888406e3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f88a6011640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88980de660 0x7f88981819e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f88a6011640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88980e7f20 0x7f88980e5190 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f88a6011640 1 --2- 172.21.15.6:0/2654901735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8898054570 0x7f88980e4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 >> 172.21.15.6:0/2654901735 conn(0x7f889801f1a0 msgr2=0x7f8898048e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f759a7fc640 1 -- 172.21.15.6:0/390780635 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f758c005580 con 0x7f759c0039b0 2024-05-20T17:53:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 shutdown_connections 2024-05-20T17:53:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f88a6011640 1 -- 172.21.15.6:0/2654901735 wait complete. 2024-05-20T17:53:33.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-05-20T17:53:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fde70075980 con 0x7fde70155190 2024-05-20T17:53:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.271+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 shutdown_connections 2024-05-20T17:53:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.272+0000 7f879f302640 1 -- 172.21.15.6:0/3705706188 wait complete. 2024-05-20T17:53:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.272+0000 7fde6d7fa640 1 -- 172.21.15.6:0/799034085 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde68058df0 con 0x7fde70155190 2024-05-20T17:53:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.272+0000 7f75b0ff9640 1 -- 172.21.15.6:0/390780635 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f75a4079ad0 con 0x7f759c0039b0 2024-05-20T17:53:33.276 INFO:teuthology.orchestra.run.smithi006.stdout:55834574857 2024-05-20T17:53:33.277 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2024-05-20T17:53:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde5406bf00 msgr2=0x7fde5406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 -- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f75a006bf00 msgr2=0x7f75a006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde5406bf00 0x7fde5406e410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fde64034000 tx=0x7fde6402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde70155190 msgr2=0x7fde701555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde70155190 0x7fde701555a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fde6800ba10 tx=0x7fde6800bed0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f75a006bf00 0x7f75a006e410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75b4160590 tx=0x7f75a8009040 comp rx=0 tx=0).stop 2024-05-20T17:53:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 shutdown_connections 2024-05-20T17:53:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde5406bf00 0x7fde5406e410 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fde64034000 tx=0x7fde6402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde70155190 0x7fde701555a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde700c6050 0x7fde701574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7fde75a1e640 1 --2- 172.21.15.6:0/799034085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde70167b90 0x7fde7009e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.277+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 >> 172.21.15.6:0/799034085 conn(0x7fde700721d0 msgr2=0x7fde70162aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 -- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c0039b0 msgr2=0x7f75b409b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c0039b0 0x7f75b409b130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f75a402afb0 tx=0x7f75a402d000 comp rx=0 tx=0).stop 2024-05-20T17:53:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 -- 172.21.15.6:0/390780635 shutdown_connections 2024-05-20T17:53:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f75a006bf00 0x7f75a006e410 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75b4160590 tx=0x7f75a8009040 comp rx=0 tx=0).stop 2024-05-20T17:53:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.277+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 shutdown_connections 2024-05-20T17:53:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.277+0000 7fde75a1e640 1 -- 172.21.15.6:0/799034085 wait complete. 2024-05-20T17:53:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b4165db0 0x7f75b41661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75b409e2e0 0x7f75b414fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 --2- 172.21.15.6:0/390780635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f759c0039b0 0x7f75b409b130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.276+0000 7f759a7fc640 1 -- 172.21.15.6:0/390780635 >> 172.21.15.6:0/390780635 conn(0x7f75b40721d0 msgr2=0x7f75b40ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.277+0000 7f759a7fc640 1 -- 172.21.15.6:0/390780635 shutdown_connections 2024-05-20T17:53:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:33.277+0000 7f759a7fc640 1 -- 172.21.15.6:0/390780635 wait complete. 2024-05-20T17:53:33.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-05-20T17:53:33.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2024-05-20T17:53:33.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2024-05-20T17:53:33.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-05-20T17:53:33.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-05-20T17:53:33.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-05-20T17:53:33.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-05-20T17:53:34.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-20T17:53:34.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-20T17:53:34.291 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-20T17:53:34.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-20T17:53:34.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-20T17:53:34.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-20T17:53:34.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-20T17:53:34.297 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-20T17:53:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.484+0000 7f6569bab640 1 Processor -- start 2024-05-20T17:53:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.484+0000 7f6569bab640 1 -- start start 2024-05-20T17:53:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.487+0000 7f6569bab640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656415c010 0x7f65640ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.487+0000 7f6569bab640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f656406c530 0x7f656406c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.487+0000 7f6569bab640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f656406ce80 con 0x7f65641517c0 2024-05-20T17:53:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.487+0000 7f6569bab640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6564070070 con 0x7f656406c530 2024-05-20T17:53:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.487+0000 7f6569bab640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f65640cf090 con 0x7f656415c010 2024-05-20T17:53:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.487+0000 7f6563fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f656406c530 0x7f656406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.487+0000 7f6563fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f656406c530 0x7f656406c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46476/0 (socket says 172.21.15.6:46476) 2024-05-20T17:53:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.487+0000 7f6563fff640 1 -- 172.21.15.6:0/2605415904 learned_addr learned my addr 172.21.15.6:0/2605415904 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.488+0000 7f6563fff640 1 -- 172.21.15.6:0/2605415904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656415c010 msgr2=0x7f65640ccb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:53:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.488+0000 7f6568ba9640 1 --2- 172.21.15.6:0/2605415904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656415c010 0x7f65640ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.488+0000 7f6563fff640 1 --2- 172.21.15.6:0/2605415904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656415c010 0x7f65640ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.489+0000 7f6563fff640 1 -- 172.21.15.6:0/2605415904 >> v1:172.21.15.171:6789/0 conn(0x7f65641517c0 legacy=0x7f6564151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.489+0000 7f6563fff640 1 -- 172.21.15.6:0/2605415904 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656406f110 con 0x7f656406c530 2024-05-20T17:53:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.490+0000 7f6563fff640 1 --2- 172.21.15.6:0/2605415904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f656406c530 0x7f656406c940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f655c008870 tx=0x7f655c02c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ed1a2ab8f0b694 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.491+0000 7f6568ba9640 1 --2- 172.21.15.6:0/2605415904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656415c010 0x7f65640ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.491+0000 7f65637fe640 1 -- 172.21.15.6:0/2605415904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c03a070 con 0x7f656406c530 2024-05-20T17:53:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.491+0000 7f65637fe640 1 -- 172.21.15.6:0/2605415904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655c032480 con 0x7f656406c530 2024-05-20T17:53:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.492+0000 7f6569bab640 1 -- 172.21.15.6:0/2605415904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f656406c530 msgr2=0x7f656406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.492+0000 7f6569bab640 1 --2- 172.21.15.6:0/2605415904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f656406c530 0x7f656406c940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f655c008870 tx=0x7f655c02c730 comp rx=0 tx=0).stop 2024-05-20T17:53:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.493+0000 7f6569bab640 1 -- 172.21.15.6:0/2605415904 shutdown_connections 2024-05-20T17:53:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.493+0000 7f6569bab640 1 --2- 172.21.15.6:0/2605415904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f656406c530 0x7f656406c940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.493+0000 7f6569bab640 1 --2- 172.21.15.6:0/2605415904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656415c010 0x7f65640ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.493+0000 7f6569bab640 1 -- 172.21.15.6:0/2605415904 >> 172.21.15.6:0/2605415904 conn(0x7f65640721d0 msgr2=0x7f65640725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.494+0000 7f6569bab640 1 -- 172.21.15.6:0/2605415904 shutdown_connections 2024-05-20T17:53:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.494+0000 7f6569bab640 1 -- 172.21.15.6:0/2605415904 wait complete. 2024-05-20T17:53:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.497+0000 7f6569bab640 1 Processor -- start 2024-05-20T17:53:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.497+0000 7f6569bab640 1 -- start start 2024-05-20T17:53:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.500+0000 7f6569bab640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656406c530 0x7f6564205e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.500+0000 7f6569bab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65641517c0 0x7f6564158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.501+0000 7f6563fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65641517c0 0x7f6564158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.501+0000 7f6563fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65641517c0 0x7f6564158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46486/0 (socket says 172.21.15.6:46486) 2024-05-20T17:53:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.501+0000 7f6563fff640 1 -- 172.21.15.6:0/2180789513 learned_addr learned my addr 172.21.15.6:0/2180789513 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.501+0000 7f6569bab640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f656415c010 0x7f65641e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.501+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f65640ced20 con 0x7f65641517c0 2024-05-20T17:53:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.501+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65640cea40 con 0x7f656415c010 2024-05-20T17:53:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.501+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f65640b0150 con 0x7f656406c530 2024-05-20T17:53:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.502+0000 7f65693aa640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f656415c010 0x7f65641e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.502+0000 7f6563fff640 1 -- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656406c530 msgr2=0x7f6564205e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-20T17:53:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.503+0000 7f6563fff640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656406c530 0x7f6564205e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.503+0000 7f6563fff640 1 -- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f656415c010 msgr2=0x7f65641e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.503+0000 7f6563fff640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f656415c010 0x7f65641e8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.503+0000 7f6563fff640 1 -- 172.21.15.6:0/2180789513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6564202de0 con 0x7f65641517c0 2024-05-20T17:53:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.503+0000 7f6563fff640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65641517c0 0x7f6564158910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f655c008990 tx=0x7f655c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.504+0000 7f65617fa640 1 -- 172.21.15.6:0/2180789513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c043070 con 0x7f65641517c0 2024-05-20T17:53:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.504+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6564206340 con 0x7f65641517c0 2024-05-20T17:53:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.507+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6564202540 con 0x7f65641517c0 2024-05-20T17:53:34.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.509+0000 7f65617fa640 1 -- 172.21.15.6:0/2180789513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f655c035840 con 0x7f65641517c0 2024-05-20T17:53:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.510+0000 7f65617fa640 1 -- 172.21.15.6:0/2180789513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655c03a070 con 0x7f65641517c0 2024-05-20T17:53:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.511+0000 7f654affd640 1 -- 172.21.15.6:0/2180789513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6544005290 con 0x7f65641517c0 2024-05-20T17:53:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.521+0000 7f65617fa640 1 -- 172.21.15.6:0/2180789513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f655c046070 con 0x7f65641517c0 2024-05-20T17:53:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.522+0000 7f65617fa640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f654c06c070 0x7f654c06e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.522+0000 7f65617fa640 1 -- 172.21.15.6:0/2180789513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f655c0ab4b0 con 0x7f65641517c0 2024-05-20T17:53:34.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.523+0000 7f65617fa640 1 -- 172.21.15.6:0/2180789513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f656406ce80 con 0x7f65641517c0 2024-05-20T17:53:34.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.528+0000 7f6568ba9640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f654c06c070 0x7f654c06e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.535+0000 7f6568ba9640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f654c06c070 0x7f654c06e580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65640cffb0 tx=0x7f6558008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.546+0000 7f2185988640 1 Processor -- start 2024-05-20T17:53:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.546+0000 7f2185988640 1 -- start start 2024-05-20T17:53:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.548+0000 7f2185988640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800cfcf0 0x7f2180163500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.548+0000 7f2185988640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21800b4800 con 0x7f218006cc40 2024-05-20T17:53:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.548+0000 7f2185988640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21800b4aa0 con 0x7f21800b5580 2024-05-20T17:53:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.548+0000 7f2185988640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21800b50f0 con 0x7f21800cfcf0 2024-05-20T17:53:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.549+0000 7f2185187640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f218006cc40 0x7f218006e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39680/0 (socket says 172.21.15.6:39680) 2024-05-20T17:53:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.549+0000 7f2185187640 1 -- 172.21.15.6:0/577532118 learned_addr learned my addr 172.21.15.6:0/577532118 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.549+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782694134 0 0) 0x7f21800b4800 con 0x7f218006cc40 2024-05-20T17:53:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.549+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2168003520 con 0x7f218006cc40 2024-05-20T17:53:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.549+0000 7f29100e9640 1 Processor -- start 2024-05-20T17:53:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f2184986640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800cfcf0 0x7f2180163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f29100e9640 1 -- start start 2024-05-20T17:53:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7fde5dcfc640 1 Processor -- start 2024-05-20T17:53:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7fde5dcfc640 1 -- start start 2024-05-20T17:53:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3543073266 0 0) 0x7f2168003520 con 0x7f218006cc40 2024-05-20T17:53:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800cfcf0 msgr2=0x7f2180163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800cfcf0 0x7f2180163500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 >> v1:172.21.15.171:6789/0 conn(0x7f21800b5580 legacy=0x7f218006c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21800b4d80 con 0x7f218006cc40 2024-05-20T17:53:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f21780019f0 con 0x7f218006cc40 2024-05-20T17:53:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 >> v1:172.21.15.6:6789/0 conn(0x7f218006cc40 legacy=0x7f218006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21680039e0 0x7f2168003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168004800 0x7f2168004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.550+0000 7f217f7fe640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2168005350 0x7f216800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f21800b50f0 con 0x7f2168004800 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f216800c1e0 con 0x7f21680039e0 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f216800c3e0 con 0x7f2168005350 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f2185187640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2168005350 0x7f216800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f217ffff640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168004800 0x7f2168004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f2185187640 1 -- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21680039e0 msgr2=0x7f2168003e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f2185187640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f21680039e0 0x7f2168003e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f2185187640 1 -- 172.21.15.6:0/577532118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168004800 msgr2=0x7f2168004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f2185187640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168004800 0x7f2168004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.551+0000 7f2185187640 1 -- 172.21.15.6:0/577532118 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2168003520 con 0x7f2168005350 2024-05-20T17:53:34.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7fde5dcfc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde500e1670 0x7fde50038c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7fde5dcfc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fde50007ba0 0x7fde50007fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7fde5dcfc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5003b880 con 0x7fde50009450 2024-05-20T17:53:34.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7fde5dcfc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fde50007150 con 0x7fde500e1670 2024-05-20T17:53:34.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7fde5dcfc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fde500e5f50 con 0x7fde50007ba0 2024-05-20T17:53:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7f29100e9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f29000540c0 0x7f29000e3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7f29100e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f2900006910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7f29100e9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2900050210 con 0x7f2900054590 2024-05-20T17:53:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7f29100e9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f29000504f0 con 0x7f29000540c0 2024-05-20T17:53:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7f29100e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f29000507d0 con 0x7f2900052fe0 2024-05-20T17:53:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7f43c2f85640 1 Processor -- start 2024-05-20T17:53:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7f43c2f85640 1 -- start start 2024-05-20T17:53:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7fde5d4fb640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fde50007ba0 0x7fde50007fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7f290d684640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f29000540c0 0x7f29000e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7f2185187640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2168005350 0x7f216800b9c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f217800a780 tx=0x7f2168005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526978e94b5dcb21 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7fdfc359e640 1 Processor -- start 2024-05-20T17:53:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.552+0000 7fdfc359e640 1 -- start start 2024-05-20T17:53:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7f290d684640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f29000540c0 0x7f29000e3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54320/0 (socket says 172.21.15.6:54320) 2024-05-20T17:53:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7f290d684640 1 -- 172.21.15.6:0/568350241 learned_addr learned my addr 172.21.15.6:0/568350241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7fde5ccfa640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fde50009450 0x7fde50050450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39694/0 (socket says 172.21.15.6:39694) 2024-05-20T17:53:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7fde5ccfa640 1 -- 172.21.15.6:0/1061769634 learned_addr learned my addr 172.21.15.6:0/1061769634 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:34.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217800a3d0 con 0x7f2168005350 2024-05-20T17:53:34.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217802f070 con 0x7f2168005350 2024-05-20T17:53:34.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7fde57fff640 1 --2- 172.21.15.6:0/1061769634 >> v2:172.21.15.6:3300/0 conn(0x7fde500e1670 0x7fde50038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.553+0000 7f217f7fe640 1 -- 172.21.15.6:0/577532118 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217802bc40 con 0x7f2168005350 2024-05-20T17:53:34.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7f290e686640 1 --2- 172.21.15.6:0/568350241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f2900006910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7f290d684640 1 -- 172.21.15.6:0/568350241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 msgr2=0x7f2900006910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7f290d684640 1 --2- 172.21.15.6:0/568350241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f2900006910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7f290d684640 1 -- 172.21.15.6:0/568350241 >> v1:172.21.15.6:6789/0 conn(0x7f2900054590 legacy=0x7f29000539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7f290d684640 1 -- 172.21.15.6:0/568350241 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2900006110 con 0x7f29000540c0 2024-05-20T17:53:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7fde57fff640 1 -- 172.21.15.6:0/1061769634 >> v2:172.21.15.171:3300/0 conn(0x7fde50007ba0 msgr2=0x7fde50007fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7fde57fff640 1 --2- 172.21.15.6:0/1061769634 >> v2:172.21.15.171:3300/0 conn(0x7fde50007ba0 0x7fde50007fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7fde57fff640 1 -- 172.21.15.6:0/1061769634 >> v1:172.21.15.6:6789/0 conn(0x7fde50009450 legacy=0x7fde50050450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.554+0000 7fde577fe640 1 -- 172.21.15.6:0/1061769634 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540892419 0 0) 0x7fde5003b880 con 0x7fde50009450 2024-05-20T17:53:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fde57fff640 1 -- 172.21.15.6:0/1061769634 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde500073a0 con 0x7fde500e1670 2024-05-20T17:53:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c2f85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc070500 0x7f43bc0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fbb455c2640 1 Processor -- start 2024-05-20T17:53:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f2185988640 1 -- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2168005350 msgr2=0x7f216800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f2185988640 1 --2- 172.21.15.6:0/577532118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2168005350 0x7f216800b9c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f217800a780 tx=0x7f2168005830 comp rx=0 tx=0).stop 2024-05-20T17:53:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c2f85640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43bc06c6e0 0x7f43bc165970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c2f85640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43bc15b6d0 con 0x7f43bc0aff50 2024-05-20T17:53:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c2f85640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f43bc0b5af0 con 0x7f43bc06c6e0 2024-05-20T17:53:34.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c2f85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc0b4b50 con 0x7f43bc070500 2024-05-20T17:53:34.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f2185187640 1 -- 172.21.15.6:0/577532118 reap_dead start 2024-05-20T17:53:34.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc359e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdfbc0567b0 0x7fdfbc036220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfbc038980 0x7fdfbc038d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc359e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc054a40 0x7fdfbc054e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc359e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdfbc03abb0 con 0x7fdfbc038980 2024-05-20T17:53:34.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc359e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdfbc0392d0 con 0x7fdfbc0567b0 2024-05-20T17:53:34.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc359e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc0528f0 con 0x7fdfbc054a40 2024-05-20T17:53:34.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c0d21640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc070500 0x7f43bc0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c0d21640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc070500 0x7f43bc0cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:50034/0 (socket says 172.21.15.6:50034) 2024-05-20T17:53:34.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43bbfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f43bc0aff50 0x7f43bc0cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:49434/0 (socket says 172.21.15.6:49434) 2024-05-20T17:53:34.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c0d21640 1 -- 172.21.15.6:0/2237157067 learned_addr learned my addr 172.21.15.6:0/2237157067 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f2185988640 1 -- 172.21.15.6:0/577532118 shutdown_connections 2024-05-20T17:53:34.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f2185988640 1 -- 172.21.15.6:0/577532118 >> 172.21.15.6:0/577532118 conn(0x7f21800721d0 msgr2=0x7f21800725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fd7cd1b7640 1 Processor -- start 2024-05-20T17:53:34.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7f43c1522640 1 --2- 172.21.15.6:0/2237157067 >> v2:172.21.15.6:3300/0 conn(0x7f43bc06c6e0 0x7f43bc165970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc2d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc054a40 0x7fdfbc054e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc2d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc054a40 0x7fdfbc054e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:50038/0 (socket says 172.21.15.6:50038) 2024-05-20T17:53:34.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fdfc2d9d640 1 -- 172.21.15.6:0/1875793010 learned_addr learned my addr 172.21.15.6:0/1875793010 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fd7cd1b7640 1 -- start start 2024-05-20T17:53:34.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7f2185988640 1 -- 172.21.15.6:0/577532118 shutdown_connections 2024-05-20T17:53:34.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7f2185988640 1 -- 172.21.15.6:0/577532118 wait complete. 2024-05-20T17:53:34.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7f43c0d21640 1 -- 172.21.15.6:0/2237157067 >> v2:172.21.15.6:3300/0 conn(0x7f43bc06c6e0 msgr2=0x7f43bc165970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7f43c0d21640 1 --2- 172.21.15.6:0/2237157067 >> v2:172.21.15.6:3300/0 conn(0x7f43bc06c6e0 0x7f43bc165970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7fde57fff640 1 --2- 172.21.15.6:0/1061769634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde50038c50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde50049900 tx=0x7fde4c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896fef5001d375a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7f43c0d21640 1 -- 172.21.15.6:0/2237157067 >> v1:172.21.15.171:6789/0 conn(0x7f43bc0aff50 legacy=0x7f43bc0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7f43c0d21640 1 -- 172.21.15.6:0/2237157067 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc0b4e30 con 0x7f43bc070500 2024-05-20T17:53:34.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7f43c1522640 1 --2- 172.21.15.6:0/2237157067 >> v2:172.21.15.6:3300/0 conn(0x7f43bc06c6e0 0x7f43bc165970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:34.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7fde577fe640 1 -- 172.21.15.6:0/1061769634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c037070 con 0x7fde500e1670 2024-05-20T17:53:34.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7f43bb7fe640 1 -- 172.21.15.6:0/2237157067 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008628998 0 0) 0x7f43bc15b6d0 con 0x7f43bc0aff50 2024-05-20T17:53:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7fdfc1d9b640 1 --2- 172.21.15.6:0/1875793010 >> v2:172.21.15.6:3300/0 conn(0x7fdfbc038980 0x7fdfbc038d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7fdfc1d9b640 1 -- 172.21.15.6:0/1875793010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc054a40 msgr2=0x7fdfbc054e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7fdfc1d9b640 1 --2- 172.21.15.6:0/1875793010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc054a40 0x7fdfbc054e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7fdfc1d9b640 1 -- 172.21.15.6:0/1875793010 >> v2:172.21.15.171:3300/0 conn(0x7fdfbc0567b0 msgr2=0x7fdfbc036220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-20T17:53:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7fdfc1d9b640 1 --2- 172.21.15.6:0/1875793010 >> v2:172.21.15.171:3300/0 conn(0x7fdfbc0567b0 0x7fdfbc036220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7f43c0d21640 1 --2- 172.21.15.6:0/2237157067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc070500 0x7f43bc0cef00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f43a4008120 tx=0x7f43a402a500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=253dbeaedc6d1370 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7fdfc1d9b640 1 -- 172.21.15.6:0/1875793010 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc03a840 con 0x7fdfbc038980 2024-05-20T17:53:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.556+0000 7fde577fe640 1 -- 172.21.15.6:0/1061769634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4c032440 con 0x7fde500e1670 2024-05-20T17:53:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.555+0000 7fbb455c2640 1 -- start start 2024-05-20T17:53:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7fde577fe640 1 -- 172.21.15.6:0/1061769634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c037070 con 0x7fde500e1670 2024-05-20T17:53:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7f43bb7fe640 1 -- 172.21.15.6:0/2237157067 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4036070 con 0x7f43bc070500 2024-05-20T17:53:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.557+0000 7f43bb7fe640 1 -- 172.21.15.6:0/2237157067 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a4004230 con 0x7f43bc070500 2024-05-20T17:53:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fde5dcfc640 1 -- 172.21.15.6:0/1061769634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 msgr2=0x7fde50038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7f290d684640 1 --2- 172.21.15.6:0/568350241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29000540c0 0x7f29000e3980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2908000b60 tx=0x7f29080a5ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe52352994fbb326 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7cd1b7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd7c80ba590 0x7fd7c80b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/1061769634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde50038c50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde50049900 tx=0x7fde4c02a1c0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7f43bb7fe640 1 -- 172.21.15.6:0/2237157067 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a400b040 con 0x7f43bc070500 2024-05-20T17:53:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7cd1b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7c80d08e0 0x7fd7c80d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fde5dcfc640 1 -- 172.21.15.6:0/1061769634 shutdown_connections 2024-05-20T17:53:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7cd1b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80cf250 0x7fd7c80cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7cd1b7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c80d1230 con 0x7fd7c80d08e0 2024-05-20T17:53:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7cd1b7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c80ba160 con 0x7fd7c80ba590 2024-05-20T17:53:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7cd1b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c808d680 con 0x7fd7c80cf250 2024-05-20T17:53:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/1061769634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde50038c50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/1061769634 >> v2:172.21.15.171:3300/0 conn(0x7fde50007ba0 0x7fde50007fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fde5dcfc640 1 -- 172.21.15.6:0/1061769634 >> 172.21.15.6:0/1061769634 conn(0x7fde50055e00 msgr2=0x7fde50056210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fdfc1d9b640 1 --2- 172.21.15.6:0/1875793010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 0x7fdfbc038d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00f8e0 tx=0x7fdfb802a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e7f771d2b049e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fde5dcfc640 1 -- 172.21.15.6:0/1061769634 shutdown_connections 2024-05-20T17:53:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fbb455c2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb400d08e0 0x7fbb400d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fbb455c2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbb400d27d0 0x7fbb400d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7c659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7c80d08e0 0x7fd7c80d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7c659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7c80d08e0 0x7fd7c80d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46552/0 (socket says 172.21.15.6:46552) 2024-05-20T17:53:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fd7c659c640 1 -- 172.21.15.6:0/571496446 learned_addr learned my addr 172.21.15.6:0/571496446 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7f2185988640 1 Processor -- start 2024-05-20T17:53:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fde5dcfc640 1 -- 172.21.15.6:0/1061769634 wait complete. 2024-05-20T17:53:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fdfc159a640 1 -- 172.21.15.6:0/1875793010 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8037070 con 0x7fdfbc038980 2024-05-20T17:53:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7f43c2f85640 1 -- 172.21.15.6:0/2237157067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc070500 msgr2=0x7f43bc0cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2237157067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc070500 0x7f43bc0cef00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f43a4008120 tx=0x7f43a402a500 comp rx=0 tx=0).stop 2024-05-20T17:53:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fdfc159a640 1 -- 172.21.15.6:0/1875793010 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb802ade0 con 0x7fdfbc038980 2024-05-20T17:53:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7f43c2f85640 1 -- 172.21.15.6:0/2237157067 shutdown_connections 2024-05-20T17:53:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2237157067 >> v2:172.21.15.6:3300/0 conn(0x7f43bc06c6e0 0x7f43bc165970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2237157067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc070500 0x7f43bc0cef00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7f43c2f85640 1 -- 172.21.15.6:0/2237157067 >> 172.21.15.6:0/2237157067 conn(0x7f43bc0cd2a0 msgr2=0x7f43bc0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7f2185988640 1 -- start start 2024-05-20T17:53:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fd7c659c640 1 -- 172.21.15.6:0/571496446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80cf250 msgr2=0x7fd7c80cf660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:53:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fd7c659c640 1 --2- 172.21.15.6:0/571496446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80cf250 0x7fd7c80cf660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fd7c659c640 1 -- 172.21.15.6:0/571496446 >> v2:172.21.15.171:3300/0 conn(0x7fd7c80ba590 msgr2=0x7fd7c80b3d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:53:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fd7c659c640 1 --2- 172.21.15.6:0/571496446 >> v2:172.21.15.171:3300/0 conn(0x7fd7c80ba590 0x7fd7c80b3d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fd7c659c640 1 -- 172.21.15.6:0/571496446 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c808dc00 con 0x7fd7c80d08e0 2024-05-20T17:53:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7f43c2f85640 1 -- 172.21.15.6:0/2237157067 shutdown_connections 2024-05-20T17:53:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fbb3e7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb400d08e0 0x7fbb400d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.558+0000 7fbb3e7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb400d08e0 0x7fbb400d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46542/0 (socket says 172.21.15.6:46542) 2024-05-20T17:53:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fbb455c2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb400d1230 con 0x7fbb400ba590 2024-05-20T17:53:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fbb455c2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbb400ba160 con 0x7fbb400d08e0 2024-05-20T17:53:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fbb455c2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4008d680 con 0x7fbb400d27d0 2024-05-20T17:53:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fdfc159a640 1 -- 172.21.15.6:0/1875793010 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8032660 con 0x7fdfbc038980 2024-05-20T17:53:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fbb3effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb400ba590 0x7fbb400b3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39714/0 (socket says 172.21.15.6:39714) 2024-05-20T17:53:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7fbb3effd640 1 -- 172.21.15.6:0/854012973 learned_addr learned my addr 172.21.15.6:0/854012973 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.559+0000 7f43c2f85640 1 -- 172.21.15.6:0/2237157067 wait complete. 2024-05-20T17:53:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fdfc359e640 1 -- 172.21.15.6:0/1875793010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 msgr2=0x7fdfbc038d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fdfc359e640 1 --2- 172.21.15.6:0/1875793010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 0x7fdfbc038d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00f8e0 tx=0x7fdfb802a090 comp rx=0 tx=0).stop 2024-05-20T17:53:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7f290ce83640 1 -- 172.21.15.6:0/568350241 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080b3070 con 0x7f29000540c0 2024-05-20T17:53:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7f290ce83640 1 -- 172.21.15.6:0/568350241 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29080a6b30 con 0x7f29000540c0 2024-05-20T17:53:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7f290ce83640 1 -- 172.21.15.6:0/568350241 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080ae440 con 0x7f29000540c0 2024-05-20T17:53:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fdfc359e640 1 -- 172.21.15.6:0/1875793010 shutdown_connections 2024-05-20T17:53:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fdfc359e640 1 --2- 172.21.15.6:0/1875793010 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc054a40 0x7fdfbc054e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fdfc359e640 1 --2- 172.21.15.6:0/1875793010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 0x7fdfbc038d90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fdfc359e640 1 --2- 172.21.15.6:0/1875793010 >> v2:172.21.15.171:3300/0 conn(0x7fdfbc0567b0 0x7fdfbc036220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fbb3f7fe640 1 --2- 172.21.15.6:0/854012973 >> v2:172.21.15.171:3300/0 conn(0x7fbb400d27d0 0x7fbb400d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fbb3e7fc640 1 -- 172.21.15.6:0/854012973 >> v2:172.21.15.171:3300/0 conn(0x7fbb400d27d0 msgr2=0x7fbb400d2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fbb3e7fc640 1 --2- 172.21.15.6:0/854012973 >> v2:172.21.15.171:3300/0 conn(0x7fbb400d27d0 0x7fbb400d2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fbb3e7fc640 1 -- 172.21.15.6:0/854012973 >> v1:172.21.15.6:6789/0 conn(0x7fbb400ba590 legacy=0x7fbb400b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fdfc359e640 1 -- 172.21.15.6:0/1875793010 >> 172.21.15.6:0/1875793010 conn(0x7fdfbc00a020 msgr2=0x7fdfbc00a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fdfc359e640 1 -- 172.21.15.6:0/1875793010 shutdown_connections 2024-05-20T17:53:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7fdfc359e640 1 -- 172.21.15.6:0/1875793010 wait complete. 2024-05-20T17:53:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.560+0000 7fbb3e7fc640 1 -- 172.21.15.6:0/854012973 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4008dc00 con 0x7fbb400d08e0 2024-05-20T17:53:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2185988640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168005350 0x7f21801ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2185988640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f218009a7d0 0x7f21801517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2185988640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800b0610 0x7f21800b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2185988640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f21800d0320 con 0x7f2168005350 2024-05-20T17:53:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2185988640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f21800b5990 con 0x7f218009a7d0 2024-05-20T17:53:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2185988640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21800d04a0 con 0x7f21800b0610 2024-05-20T17:53:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f217ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f218009a7d0 0x7f21801517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f43c2f85640 1 Processor -- start 2024-05-20T17:53:34.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7fde5dcfc640 1 Processor -- start 2024-05-20T17:53:34.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2184986640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168005350 0x7f21801ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f29100e9640 1 -- 172.21.15.6:0/568350241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29000540c0 msgr2=0x7f29000e3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f29100e9640 1 --2- 172.21.15.6:0/568350241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29000540c0 0x7f29000e3980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2908000b60 tx=0x7f29080a5ff0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f29100e9640 1 -- 172.21.15.6:0/568350241 shutdown_connections 2024-05-20T17:53:34.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f29100e9640 1 --2- 172.21.15.6:0/568350241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f2900006910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f29100e9640 1 --2- 172.21.15.6:0/568350241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29000540c0 0x7f29000e3980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f29100e9640 1 -- 172.21.15.6:0/568350241 >> 172.21.15.6:0/568350241 conn(0x7f2900054d20 msgr2=0x7f2900055130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f43c2f85640 1 -- start start 2024-05-20T17:53:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2184986640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168005350 0x7f21801ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46556/0 (socket says 172.21.15.6:46556) 2024-05-20T17:53:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.561+0000 7f2184986640 1 -- 172.21.15.6:0/3790931664 learned_addr learned my addr 172.21.15.6:0/3790931664 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f2185187640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800b0610 0x7f21800b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7fde5dcfc640 1 -- start start 2024-05-20T17:53:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f2184986640 1 -- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800b0610 msgr2=0x7f21800b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f2184986640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800b0610 0x7f21800b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f2184986640 1 -- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f218009a7d0 msgr2=0x7f21801517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f2184986640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f218009a7d0 0x7f21801517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f29100e9640 1 -- 172.21.15.6:0/568350241 shutdown_connections 2024-05-20T17:53:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f29100e9640 1 -- 172.21.15.6:0/568350241 wait complete. 2024-05-20T17:53:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7fbb3e7fc640 1 --2- 172.21.15.6:0/854012973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400d08e0 0x7fbb400d0cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbb340097a0 tx=0x7fbb3402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f58a76f6d6567a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f2184986640 1 -- 172.21.15.6:0/3790931664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21800b0f60 con 0x7f2168005350 2024-05-20T17:53:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7f2184986640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168005350 0x7f21801ecda0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2174007fd0 tx=0x7f217400d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7f2185187640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800b0610 0x7f21800b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.562+0000 7fd7c659c640 1 --2- 172.21.15.6:0/571496446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 0x7fd7c80d0cf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009e50 tx=0x7fd7b802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580e5f60cef795f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7fd7c5d9b640 1 -- 172.21.15.6:0/571496446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8036070 con 0x7fd7c80d08e0 2024-05-20T17:53:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7f217d7fa640 1 -- 172.21.15.6:0/3790931664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21740125f0 con 0x7f2168005350 2024-05-20T17:53:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21801ed5f0 con 0x7f2168005350 2024-05-20T17:53:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21801edbb0 con 0x7f2168005350 2024-05-20T17:53:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7f217d7fa640 1 -- 172.21.15.6:0/3790931664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2174018070 con 0x7f2168005350 2024-05-20T17:53:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7f217d7fa640 1 -- 172.21.15.6:0/3790931664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21740125f0 con 0x7f2168005350 2024-05-20T17:53:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7fd7c5d9b640 1 -- 172.21.15.6:0/571496446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b8031600 con 0x7fd7c80d08e0 2024-05-20T17:53:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7fd7c5d9b640 1 -- 172.21.15.6:0/571496446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b80319d0 con 0x7fd7c80d08e0 2024-05-20T17:53:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7fbb3dffb640 1 -- 172.21.15.6:0/854012973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34037070 con 0x7fbb400d08e0 2024-05-20T17:53:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7fbb3dffb640 1 -- 172.21.15.6:0/854012973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3402ae50 con 0x7fbb400d08e0 2024-05-20T17:53:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.563+0000 7fbb3dffb640 1 -- 172.21.15.6:0/854012973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34037070 con 0x7fbb400d08e0 2024-05-20T17:53:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7f43c2f85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc06c6e0 0x7f43bc14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7f43c2f85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc070500 0x7f43bc1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7f43c2f85640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc0aff50 0x7f43bc157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fdfc359e640 1 Processor -- start 2024-05-20T17:53:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/571496446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 msgr2=0x7fd7c80d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/571496446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 0x7fd7c80d0cf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009e50 tx=0x7fd7b802a710 comp rx=0 tx=0).stop 2024-05-20T17:53:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fde5dcfc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50007ba0 0x7fde500387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fde5dcfc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50009450 0x7fde500df450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fde5dcfc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde500e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fde5dcfc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fde50008670 con 0x7fde500e1670 2024-05-20T17:53:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fde5dcfc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde500084f0 con 0x7fde50009450 2024-05-20T17:53:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fde5dcfc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fde500e5160 con 0x7fde50007ba0 2024-05-20T17:53:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.564+0000 7fdfc359e640 1 -- start start 2024-05-20T17:53:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7f29100e9640 1 Processor -- start 2024-05-20T17:53:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde5d4fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde500e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde5d4fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde500e3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46578/0 (socket says 172.21.15.6:46578) 2024-05-20T17:53:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde5d4fb640 1 -- 172.21.15.6:0/2029241827 learned_addr learned my addr 172.21.15.6:0/2029241827 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7f43c2f85640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0b5800 con 0x7f43bc070500 2024-05-20T17:53:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7f43c2f85640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0b5680 con 0x7f43bc0aff50 2024-05-20T17:53:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7f43c2f85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc0ce8c0 con 0x7f43bc06c6e0 2024-05-20T17:53:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde57fff640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50009450 0x7fde500df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fbb455c2640 1 -- 172.21.15.6:0/854012973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400d08e0 msgr2=0x7fbb400d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fbb455c2640 1 --2- 172.21.15.6:0/854012973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400d08e0 0x7fbb400d0cf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbb340097a0 tx=0x7fbb3402a140 comp rx=0 tx=0).stop 2024-05-20T17:53:34.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde5d4fb640 1 -- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50007ba0 msgr2=0x7fde500387f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:53:34.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde5d4fb640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50007ba0 0x7fde500387f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde5d4fb640 1 -- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50009450 msgr2=0x7fde500df450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde5d4fb640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50009450 0x7fde500df450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7fde5d4fb640 1 -- 172.21.15.6:0/2029241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde500d6ff0 con 0x7fde500e1670 2024-05-20T17:53:34.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.565+0000 7f29100e9640 1 -- start start 2024-05-20T17:53:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fde57fff640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50009450 0x7fde500df450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7f43bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc070500 0x7f43bc1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7f43bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc070500 0x7f43bc1572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46566/0 (socket says 172.21.15.6:46566) 2024-05-20T17:53:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7f43bbfff640 1 -- 172.21.15.6:0/2313593026 learned_addr learned my addr 172.21.15.6:0/2313593026 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7f43c0d21640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc06c6e0 0x7f43bc14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7f43c1522640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc0aff50 0x7f43bc157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2160005290 con 0x7f2168005350 2024-05-20T17:53:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/571496446 shutdown_connections 2024-05-20T17:53:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/571496446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80cf250 0x7fd7c80cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/571496446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 0x7fd7c80d0cf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/571496446 >> v2:172.21.15.171:3300/0 conn(0x7fd7c80ba590 0x7fd7c80b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/571496446 >> 172.21.15.6:0/571496446 conn(0x7fd7c80d4c00 msgr2=0x7fd7c80d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fde5d4fb640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde500e3bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde4400d5a0 tx=0x7fde4400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7fde557fa640 1 -- 172.21.15.6:0/2029241827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440125f0 con 0x7fde500e1670 2024-05-20T17:53:34.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde500d6a30 con 0x7fde500e1670 2024-05-20T17:53:34.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7fde557fa640 1 -- 172.21.15.6:0/2029241827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde44019070 con 0x7fde500e1670 2024-05-20T17:53:34.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde500e33b0 con 0x7fde500e1670 2024-05-20T17:53:34.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7fdfc359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 0x7fdfbc04a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fbb455c2640 1 -- 172.21.15.6:0/854012973 shutdown_connections 2024-05-20T17:53:34.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fbb455c2640 1 --2- 172.21.15.6:0/854012973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400d08e0 0x7fbb400d0cf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fbb455c2640 1 --2- 172.21.15.6:0/854012973 >> v2:172.21.15.171:3300/0 conn(0x7fbb400d27d0 0x7fbb400d2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fbb455c2640 1 -- 172.21.15.6:0/854012973 >> 172.21.15.6:0/854012973 conn(0x7fbb400d4c00 msgr2=0x7fbb400d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fbb455c2640 1 -- 172.21.15.6:0/854012973 shutdown_connections 2024-05-20T17:53:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fbb455c2640 1 -- 172.21.15.6:0/854012973 wait complete. 2024-05-20T17:53:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/571496446 shutdown_connections 2024-05-20T17:53:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7fdfc359e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfbc054a40 0x7fdfbc04d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7f217d7fa640 1 -- 172.21.15.6:0/3790931664 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2174012790 con 0x7f2168005350 2024-05-20T17:53:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7fdfc359e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc0567b0 0x7fdfbc16c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7fdfc1d9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfbc054a40 0x7fdfbc04d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7f29100e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f29000e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7f29100e9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2900054590 0x7f29000d8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7f29100e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29000e5fb0 0x7f290017e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7f29100e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f290004fd80 con 0x7f29000e5fb0 2024-05-20T17:53:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7f29100e9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2900038370 con 0x7f2900054590 2024-05-20T17:53:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.567+0000 7f29100e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f290004ff00 con 0x7f2900052fe0 2024-05-20T17:53:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f290de85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f29000e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f290de85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f29000e4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:50088/0 (socket says 172.21.15.6:50088) 2024-05-20T17:53:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7fdfc1d9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfbc054a40 0x7fdfbc04d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:54376/0 (socket says 172.21.15.6:54376) 2024-05-20T17:53:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f290de85640 1 -- 172.21.15.6:0/3682024187 learned_addr learned my addr 172.21.15.6:0/3682024187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7fde557fa640 1 -- 172.21.15.6:0/2029241827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440125f0 con 0x7fde500e1670 2024-05-20T17:53:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7fdfc1d9b640 1 -- 172.21.15.6:0/4110744505 learned_addr learned my addr 172.21.15.6:0/4110744505 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc056400 con 0x7fdfbc038980 2024-05-20T17:53:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7fdfc2d9d640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc0567b0 0x7fdfbc16c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f43c0d21640 1 -- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc0aff50 msgr2=0x7f43bc157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f43c0d21640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc0aff50 0x7f43bc157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f43c0d21640 1 -- 172.21.15.6:0/2313593026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc070500 msgr2=0x7f43bc1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f43c0d21640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc070500 0x7f43bc1572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f43c0d21640 1 -- 172.21.15.6:0/2313593026 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc156830 con 0x7f43bc06c6e0 2024-05-20T17:53:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f217d7fa640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f216c06c230 0x7f216c06e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.568+0000 7f217d7fa640 1 -- 172.21.15.6:0/3790931664 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f217400f040 con 0x7f2168005350 2024-05-20T17:53:34.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc056280 con 0x7fdfbc054a40 2024-05-20T17:53:34.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc055e90 con 0x7fdfbc0567b0 2024-05-20T17:53:34.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f290d684640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2900054590 0x7f29000d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f217ffff640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f216c06c230 0x7f216c06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f43c0d21640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc06c6e0 0x7f43bc14ab70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43a4004000 tx=0x7f43a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde500d67a0 con 0x7fde500e1670 2024-05-20T17:53:34.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f290e686640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29000e5fb0 0x7f290017e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f290de85640 1 -- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2900054590 msgr2=0x7f29000d8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f290de85640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2900054590 0x7f29000d8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f290de85640 1 -- 172.21.15.6:0/3682024187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29000e5fb0 msgr2=0x7f290017e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f290de85640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29000e5fb0 0x7f290017e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f290de85640 1 -- 172.21.15.6:0/3682024187 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29000d8e50 con 0x7f2900052fe0 2024-05-20T17:53:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f290e686640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29000e5fb0 0x7f290017e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.566+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/571496446 wait complete. 2024-05-20T17:53:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7fdfc259c640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 0x7fdfbc04a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f43b97fa640 1 -- 172.21.15.6:0/2313593026 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4041020 con 0x7f43bc06c6e0 2024-05-20T17:53:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f43b97fa640 1 -- 172.21.15.6:0/2313593026 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a4037040 con 0x7f43bc06c6e0 2024-05-20T17:53:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f43b97fa640 1 -- 172.21.15.6:0/2313593026 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4036070 con 0x7f43bc06c6e0 2024-05-20T17:53:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43bc154da0 con 0x7f43bc06c6e0 2024-05-20T17:53:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7fbb455c2640 1 Processor -- start 2024-05-20T17:53:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.569+0000 7fbb455c2640 1 -- start start 2024-05-20T17:53:34.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43bc156db0 con 0x7f43bc06c6e0 2024-05-20T17:53:34.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7f290de85640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f29000e4b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f290400c550 tx=0x7f290400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7fd7cd1b7640 1 Processor -- start 2024-05-20T17:53:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7fdfc259c640 1 -- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc0567b0 msgr2=0x7fdfbc16c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7fdfc259c640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc0567b0 0x7fdfbc16c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7fdfc259c640 1 -- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfbc054a40 msgr2=0x7fdfbc04d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7fdfc259c640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfbc054a40 0x7fdfbc04d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7fdfc259c640 1 -- 172.21.15.6:0/4110744505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc16b070 con 0x7fdfbc038980 2024-05-20T17:53:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.571+0000 7fdfc259c640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 0x7fdfbc04a9a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4068e20 tx=0x7fdfc4074f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.571+0000 7fdfc1d9b640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfbc054a40 0x7fdfbc04d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.571+0000 7f217ffff640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f216c06c230 0x7f216c06e740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f21801fcb60 tx=0x7f2170009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.571+0000 7fdfc2d9d640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc0567b0 0x7fdfbc16c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.570+0000 7fd7cd1b7640 1 -- start start 2024-05-20T17:53:34.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.571+0000 7f28fe7fc640 1 -- 172.21.15.6:0/3682024187 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2904017070 con 0x7f2900052fe0 2024-05-20T17:53:34.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.571+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43bc155080 con 0x7f43bc06c6e0 2024-05-20T17:53:34.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29000e3ab0 con 0x7f2900052fe0 2024-05-20T17:53:34.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb455c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400ba590 0x7fbb4015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb455c2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb400d08e0 0x7fbb401fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb455c2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb400d27d0 0x7fbb401fd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7cd1b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80ba590 0x7fd7c81f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb455c2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbb400b9c40 con 0x7fbb400ba590 2024-05-20T17:53:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb455c2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbb400b9960 con 0x7fbb400d27d0 2024-05-20T17:53:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb455c2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbb400ba9a0 con 0x7fbb400d08e0 2024-05-20T17:53:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7cd1b7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80cf250 0x7fd7c81ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb3effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400ba590 0x7fbb4015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb3effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400ba590 0x7fbb4015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46602/0 (socket says 172.21.15.6:46602) 2024-05-20T17:53:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb3effd640 1 -- 172.21.15.6:0/2241819829 learned_addr learned my addr 172.21.15.6:0/2241819829 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7f28fe7fc640 1 -- 172.21.15.6:0/3682024187 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29040035f0 con 0x7f2900052fe0 2024-05-20T17:53:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fbb3f7fe640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb400d27d0 0x7fbb401fd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7cd1b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 0x7fd7c8072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7cd1b7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80b9c40 con 0x7fd7c80d08e0 2024-05-20T17:53:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7cd1b7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80b9960 con 0x7fd7c80cf250 2024-05-20T17:53:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7cd1b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c80b42a0 con 0x7fd7c80ba590 2024-05-20T17:53:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7c6d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80ba590 0x7fd7c81f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7c6d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80ba590 0x7fd7c81f96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:50098/0 (socket says 172.21.15.6:50098) 2024-05-20T17:53:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7fd7c6d9d640 1 -- 172.21.15.6:0/982562014 learned_addr learned my addr 172.21.15.6:0/982562014 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7f28fe7fc640 1 -- 172.21.15.6:0/3682024187 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29040039e0 con 0x7f2900052fe0 2024-05-20T17:53:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fbb3effd640 1 -- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb400d08e0 msgr2=0x7fbb401fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fbb3effd640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb400d08e0 0x7fbb401fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fbb3effd640 1 -- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb400d27d0 msgr2=0x7fbb401fd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fbb3effd640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb400d27d0 0x7fbb401fd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fbb3effd640 1 -- 172.21.15.6:0/2241819829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb40160030 con 0x7fbb400ba590 2024-05-20T17:53:34.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7f43b97fa640 1 -- 172.21.15.6:0/2313593026 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43a4044020 con 0x7f43bc06c6e0 2024-05-20T17:53:34.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fbb3f7fe640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb400d27d0 0x7fbb401fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:34.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fd7c659c640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80cf250 0x7fd7c81ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.572+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29000e4070 con 0x7f2900052fe0 2024-05-20T17:53:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fd7c759e640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 0x7fd7c8072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fbb3effd640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400ba590 0x7fbb4015f570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000c440 tx=0x7fbb3000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fd7c6d9d640 1 -- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80cf250 msgr2=0x7fd7c81ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fd7c6d9d640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80cf250 0x7fd7c81ecef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fd7c6d9d640 1 -- 172.21.15.6:0/982562014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 msgr2=0x7fd7c8072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fd7c6d9d640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 0x7fd7c8072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fd7c6d9d640 1 -- 172.21.15.6:0/982562014 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c81ed840 con 0x7fd7c80ba590 2024-05-20T17:53:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7fd7c659c640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80cf250 0x7fd7c81ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7f43b97fa640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06bf00 0x7f439c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.574+0000 7f43b97fa640 1 -- 172.21.15.6:0/2313593026 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f43a40ab9c0 con 0x7f43bc06c6e0 2024-05-20T17:53:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.574+0000 7fd7c6d9d640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80ba590 0x7fd7c81f96f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000b3c0 tx=0x7fd7b000b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.573+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29000054d0 con 0x7f2900052fe0 2024-05-20T17:53:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.574+0000 7f43bbfff640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06bf00 0x7f439c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.574+0000 7f28fe7fc640 1 -- 172.21.15.6:0/3682024187 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f290401a070 con 0x7f2900052fe0 2024-05-20T17:53:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.574+0000 7f43bbfff640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06bf00 0x7f439c06e410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f43ac007f60 tx=0x7f43ac007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.575+0000 7f28fe7fc640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28ec06be30 0x7f28ec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.575+0000 7f28fe7fc640 1 -- 172.21.15.6:0/3682024187 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f290408a720 con 0x7f2900052fe0 2024-05-20T17:53:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.575+0000 7f290d684640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28ec06be30 0x7f28ec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.576+0000 7f290d684640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28ec06be30 0x7f28ec06e340 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f290000bf80 tx=0x7f29080b0040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.576+0000 7f217d7fa640 1 -- 172.21.15.6:0/3790931664 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2174022020 con 0x7f2168005350 2024-05-20T17:53:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.577+0000 7fdfb2ffd640 1 -- 172.21.15.6:0/4110744505 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc408bd50 con 0x7fdfbc038980 2024-05-20T17:53:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.577+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc16b350 con 0x7fdfbc038980 2024-05-20T17:53:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.577+0000 7fbb277fe640 1 -- 172.21.15.6:0/2241819829 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30017070 con 0x7fbb400ba590 2024-05-20T17:53:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.577+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc16b910 con 0x7fdfbc038980 2024-05-20T17:53:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.577+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb40160310 con 0x7fbb400ba590 2024-05-20T17:53:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.577+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb401608d0 con 0x7fbb400ba590 2024-05-20T17:53:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.578+0000 7fdfb2ffd640 1 -- 172.21.15.6:0/4110744505 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc408f020 con 0x7fdfbc038980 2024-05-20T17:53:34.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.578+0000 7fdfb2ffd640 1 -- 172.21.15.6:0/4110744505 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc406c8c0 con 0x7fdfbc038980 2024-05-20T17:53:34.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.578+0000 7fbb277fe640 1 -- 172.21.15.6:0/2241819829 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb30005ce0 con 0x7fbb400ba590 2024-05-20T17:53:34.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.578+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb40075b00 con 0x7fbb400ba590 2024-05-20T17:53:34.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.578+0000 7fde557fa640 1 -- 172.21.15.6:0/2029241827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde44012790 con 0x7fde500e1670 2024-05-20T17:53:34.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.578+0000 7fbb277fe640 1 -- 172.21.15.6:0/2241819829 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb300072f0 con 0x7fbb400ba590 2024-05-20T17:53:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.579+0000 7f43b97fa640 1 -- 172.21.15.6:0/2313593026 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f43bc155080 con 0x7f43bc06c6e0 2024-05-20T17:53:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.578+0000 7fd7bf7fe640 1 -- 172.21.15.6:0/982562014 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0015020 con 0x7fd7c80ba590 2024-05-20T17:53:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.579+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c81edb20 con 0x7fd7c80ba590 2024-05-20T17:53:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.579+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c814e6e0 con 0x7fd7c80ba590 2024-05-20T17:53:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.579+0000 7fde557fa640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde3c06c060 0x7fde3c06e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.579+0000 7fde557fa640 1 -- 172.21.15.6:0/2029241827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fde4408bd60 con 0x7fde500e1670 2024-05-20T17:53:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.579+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa8005290 con 0x7fdfbc038980 2024-05-20T17:53:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.580+0000 7fde5ccfa640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde3c06c060 0x7fde3c06e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.580+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c8075b00 con 0x7fd7c80ba590 2024-05-20T17:53:34.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.580+0000 7fde5ccfa640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde3c06c060 0x7fde3c06e570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde58069ea0 tx=0x7fde58069510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.583+0000 7fd7bf7fe640 1 -- 172.21.15.6:0/982562014 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b0011830 con 0x7fd7c80ba590 2024-05-20T17:53:34.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.583+0000 7fd7bf7fe640 1 -- 172.21.15.6:0/982562014 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0011c80 con 0x7fd7c80ba590 2024-05-20T17:53:34.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.584+0000 7f28fe7fc640 1 -- 172.21.15.6:0/3682024187 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2904058c70 con 0x7f2900052fe0 2024-05-20T17:53:34.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.587+0000 7fde557fa640 1 -- 172.21.15.6:0/2029241827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fde4405a340 con 0x7fde500e1670 2024-05-20T17:53:34.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.587+0000 7fd7bf7fe640 1 -- 172.21.15.6:0/982562014 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7b0018020 con 0x7fd7c80ba590 2024-05-20T17:53:34.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.587+0000 7fd7bf7fe640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.587+0000 7fd7bf7fe640 1 -- 172.21.15.6:0/982562014 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd7b008b6f0 con 0x7fd7c80ba590 2024-05-20T17:53:34.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.588+0000 7fd7c659c640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.589+0000 7fd7bf7fe640 1 -- 172.21.15.6:0/982562014 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd7b001f020 con 0x7fd7c80ba590 2024-05-20T17:53:34.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.589+0000 7fdfb2ffd640 1 -- 172.21.15.6:0/4110744505 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfc406ca60 con 0x7fdfbc038980 2024-05-20T17:53:34.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.590+0000 7fdfb2ffd640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfa406be60 0x7fdfa406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.592+0000 7fdfc1d9b640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfa406be60 0x7fdfa406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.593+0000 7fdfb2ffd640 1 -- 172.21.15.6:0/4110744505 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdfc409ede0 con 0x7fdfbc038980 2024-05-20T17:53:34.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.593+0000 7fbb277fe640 1 -- 172.21.15.6:0/2241819829 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb3001a070 con 0x7fbb400ba590 2024-05-20T17:53:34.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.593+0000 7fbb277fe640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb2c06be30 0x7fbb2c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:34.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.593+0000 7fbb277fe640 1 -- 172.21.15.6:0/2241819829 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbb3008aa20 con 0x7fbb400ba590 2024-05-20T17:53:34.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.594+0000 7fbb3e7fc640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb2c06be30 0x7fbb2c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:34.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.594+0000 7fd7c659c640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8033000 tx=0x7fd7b8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.595+0000 7fbb3e7fc640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb2c06be30 0x7fbb2c06e340 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb34034000 tx=0x7fbb3402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.595+0000 7fdfc1d9b640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfa406be60 0x7fdfa406e370 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfb802a0d0 tx=0x7fdfb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:34.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.599+0000 7fdfb2ffd640 1 -- 172.21.15.6:0/4110744505 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdfc4099030 con 0x7fdfbc038980 2024-05-20T17:53:34.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.609+0000 7fbb277fe640 1 -- 172.21.15.6:0/2241819829 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbb30021020 con 0x7fbb400ba590 2024-05-20T17:53:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.940+0000 7f654affd640 1 -- 172.21.15.6:0/2180789513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6544005580 con 0x7f65641517c0 2024-05-20T17:53:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.941+0000 7f65617fa640 1 -- 172.21.15.6:0/2180789513 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f655c079510 con 0x7f65641517c0 2024-05-20T17:53:34.940 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2024-05-20T17:53:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.944+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f654c06c070 msgr2=0x7f654c06e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.944+0000 7f6569bab640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f654c06c070 0x7f654c06e580 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65640cffb0 tx=0x7f6558008040 comp rx=0 tx=0).stop 2024-05-20T17:53:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.944+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65641517c0 msgr2=0x7f6564158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.944+0000 7f6569bab640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65641517c0 0x7f6564158910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f655c008990 tx=0x7f655c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.945+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 shutdown_connections 2024-05-20T17:53:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.945+0000 7f6569bab640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f654c06c070 0x7f654c06e580 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.945+0000 7f6569bab640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f656415c010 0x7f65641e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.945+0000 7f6569bab640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65641517c0 0x7f6564158910 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.945+0000 7f6569bab640 1 --2- 172.21.15.6:0/2180789513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f656406c530 0x7f6564205e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.945+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 >> 172.21.15.6:0/2180789513 conn(0x7f65640721d0 msgr2=0x7f65640b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.946+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 shutdown_connections 2024-05-20T17:53:34.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.946+0000 7f6569bab640 1 -- 172.21.15.6:0/2180789513 wait complete. 2024-05-20T17:53:34.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-05-20T17:53:34.963 DEBUG:teuthology.parallel:result is None 2024-05-20T17:53:34.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.983+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fde500e4ed0 con 0x7fde500e1670 2024-05-20T17:53:34.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.983+0000 7fde557fa640 1 -- 172.21.15.6:0/2029241827 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde4401ce40 con 0x7fde500e1670 2024-05-20T17:53:34.983 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde3c06c060 msgr2=0x7fde3c06e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde3c06c060 0x7fde3c06e570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde58069ea0 tx=0x7fde58069510 comp rx=0 tx=0).stop 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 msgr2=0x7fde500e3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde500e3bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde4400d5a0 tx=0x7fde4400da60 comp rx=0 tx=0).stop 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 shutdown_connections 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde3c06c060 0x7fde3c06e570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde500e1670 0x7fde500e3bb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50009450 0x7fde500df450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 --2- 172.21.15.6:0/2029241827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50007ba0 0x7fde500387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 >> 172.21.15.6:0/2029241827 conn(0x7fde50055e00 msgr2=0x7fde50053f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:34.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 shutdown_connections 2024-05-20T17:53:34.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:34.986+0000 7fde5dcfc640 1 -- 172.21.15.6:0/2029241827 wait complete. 2024-05-20T17:53:34.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-05-20T17:53:34.998 DEBUG:teuthology.parallel:result is None 2024-05-20T17:53:35.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.009+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f43bc075b00 con 0x7f43bc06c6e0 2024-05-20T17:53:35.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.010+0000 7f43b97fa640 1 -- 172.21.15.6:0/2313593026 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43a400a030 con 0x7f43bc06c6e0 2024-05-20T17:53:35.009 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2900037c90 con 0x7f2900052fe0 2024-05-20T17:53:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06bf00 msgr2=0x7f439c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06bf00 0x7f439c06e410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f43ac007f60 tx=0x7f43ac007eb0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc06c6e0 msgr2=0x7f43bc14ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc06c6e0 0x7f43bc14ab70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43a4004000 tx=0x7f43a40046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f28fe7fc640 1 -- 172.21.15.6:0/3682024187 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29040011d0 con 0x7f2900052fe0 2024-05-20T17:53:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 shutdown_connections 2024-05-20T17:53:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06bf00 0x7f439c06e410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc0aff50 0x7f43bc157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc070500 0x7f43bc1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 --2- 172.21.15.6:0/2313593026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc06c6e0 0x7f43bc14ab70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 >> 172.21.15.6:0/2313593026 conn(0x7f43bc0cd2a0 msgr2=0x7f43bc1528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.014 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2024-05-20T17:53:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 shutdown_connections 2024-05-20T17:53:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.013+0000 7f43c2f85640 1 -- 172.21.15.6:0/2313593026 wait complete. 2024-05-20T17:53:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.016+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28ec06be30 msgr2=0x7f28ec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.016+0000 7f29100e9640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28ec06be30 0x7f28ec06e340 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f290000bf80 tx=0x7f29080b0040 comp rx=0 tx=0).stop 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.016+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 msgr2=0x7f29000e4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.016+0000 7f29100e9640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f29000e4b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f290400c550 tx=0x7f290400ca10 comp rx=0 tx=0).stop 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.016+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 shutdown_connections 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.016+0000 7f29100e9640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28ec06be30 0x7f28ec06e340 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.016+0000 7f29100e9640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29000e5fb0 0x7f290017e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.017+0000 7f29100e9640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2900054590 0x7f29000d8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.017+0000 7f29100e9640 1 --2- 172.21.15.6:0/3682024187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2900052fe0 0x7f29000e4b50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.017+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 >> 172.21.15.6:0/3682024187 conn(0x7f2900054d20 msgr2=0x7f29000e1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.017+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 shutdown_connections 2024-05-20T17:53:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.017+0000 7f29100e9640 1 -- 172.21.15.6:0/3682024187 wait complete. 2024-05-20T17:53:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.021+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2160005580 con 0x7f2168005350 2024-05-20T17:53:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.022+0000 7f217d7fa640 1 -- 172.21.15.6:0/3790931664 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f21800b0f60 con 0x7f2168005350 2024-05-20T17:53:35.021 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f216c06c230 msgr2=0x7f216c06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f216c06c230 0x7f216c06e740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f21801fcb60 tx=0x7f2170009040 comp rx=0 tx=0).stop 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168005350 msgr2=0x7f21801ecda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168005350 0x7f21801ecda0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2174007fd0 tx=0x7f217400d8a0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 shutdown_connections 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f216c06c230 0x7f216c06e740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21800b0610 0x7f21800b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f218009a7d0 0x7f21801517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 --2- 172.21.15.6:0/3790931664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2168005350 0x7f21801ecda0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 >> 172.21.15.6:0/3790931664 conn(0x7f21800721d0 msgr2=0x7f21800b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.024+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 shutdown_connections 2024-05-20T17:53:35.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.025+0000 7f2185988640 1 -- 172.21.15.6:0/3790931664 wait complete. 2024-05-20T17:53:35.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.025+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd7c80b3ed0 con 0x7fd7c80ba590 2024-05-20T17:53:35.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.026+0000 7fd7bf7fe640 1 -- 172.21.15.6:0/982562014 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd7b000f2e0 con 0x7fd7c80ba590 2024-05-20T17:53:35.025 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2024-05-20T17:53:35.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.029+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 msgr2=0x7fd7a806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.029+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8033000 tx=0x7fd7b8009000 comp rx=0 tx=0).stop 2024-05-20T17:53:35.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.029+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80ba590 msgr2=0x7fd7c81f96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.029+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80ba590 0x7fd7c81f96f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000b3c0 tx=0x7fd7b000b880 comp rx=0 tx=0).stop 2024-05-20T17:53:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.031+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 shutdown_connections 2024-05-20T17:53:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.031+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.031+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7c80d08e0 0x7fd7c8072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.031+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80cf250 0x7fd7c81ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.031+0000 7fd7cd1b7640 1 --2- 172.21.15.6:0/982562014 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80ba590 0x7fd7c81f96f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.031+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 >> 172.21.15.6:0/982562014 conn(0x7fd7c80d4c00 msgr2=0x7fd7c8166af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.031+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 shutdown_connections 2024-05-20T17:53:35.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.031+0000 7fd7cd1b7640 1 -- 172.21.15.6:0/982562014 wait complete. 2024-05-20T17:53:35.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-05-20T17:53:35.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.032+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdfa8005850 con 0x7fdfbc038980 2024-05-20T17:53:35.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.032+0000 7fdfb2ffd640 1 -- 172.21.15.6:0/4110744505 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdfc40d49c0 con 0x7fdfbc038980 2024-05-20T17:53:35.032 DEBUG:teuthology.parallel:result is None 2024-05-20T17:53:35.032 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2024-05-20T17:53:35.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.034+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbb4006f990 con 0x7fbb400ba590 2024-05-20T17:53:35.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.034+0000 7fbb277fe640 1 -- 172.21.15.6:0/2241819829 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb400d1230 con 0x7fbb400ba590 2024-05-20T17:53:35.034 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2024-05-20T17:53:35.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2024-05-20T17:53:35.035 DEBUG:teuthology.parallel:result is None 2024-05-20T17:53:35.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfa406be60 msgr2=0x7fdfa406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfa406be60 0x7fdfa406e370 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfb802a0d0 tx=0x7fdfb802e000 comp rx=0 tx=0).stop 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 msgr2=0x7fdfbc04a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 0x7fdfbc04a9a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4068e20 tx=0x7fdfc4074f20 comp rx=0 tx=0).stop 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 shutdown_connections 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfa406be60 0x7fdfa406e370 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfbc0567b0 0x7fdfbc16c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfbc054a40 0x7fdfbc04d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 --2- 172.21.15.6:0/4110744505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfbc038980 0x7fdfbc04a9a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 >> 172.21.15.6:0/4110744505 conn(0x7fdfbc00a020 msgr2=0x7fdfbc0367f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 shutdown_connections 2024-05-20T17:53:35.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.035+0000 7fdfc359e640 1 -- 172.21.15.6:0/4110744505 wait complete. 2024-05-20T17:53:35.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb2c06be30 msgr2=0x7fbb2c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb2c06be30 0x7fbb2c06e340 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb34034000 tx=0x7fbb3402c000 comp rx=0 tx=0).stop 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400ba590 msgr2=0x7fbb4015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400ba590 0x7fbb4015f570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000c440 tx=0x7fbb3000c900 comp rx=0 tx=0).stop 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 shutdown_connections 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb2c06be30 0x7fbb2c06e340 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb400d27d0 0x7fbb401fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb400d08e0 0x7fbb401fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 --2- 172.21.15.6:0/2241819829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb400ba590 0x7fbb4015f570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 >> 172.21.15.6:0/2241819829 conn(0x7fbb400d4c00 msgr2=0x7fbb400b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 shutdown_connections 2024-05-20T17:53:35.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.038+0000 7fbb455c2640 1 -- 172.21.15.6:0/2241819829 wait complete. 2024-05-20T17:53:35.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-05-20T17:53:35.041 DEBUG:teuthology.parallel:result is None 2024-05-20T17:53:35.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-05-20T17:53:35.047 DEBUG:teuthology.parallel:result is None 2024-05-20T17:53:35.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2024-05-20T17:53:35.052 DEBUG:teuthology.parallel:result is None 2024-05-20T17:53:35.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-05-20T17:53:35.054 DEBUG:teuthology.parallel:result is None 2024-05-20T17:53:35.054 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-20T17:53:35.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:53:35.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.209+0000 7f11540bc640 1 Processor -- start 2024-05-20T17:53:35.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.209+0000 7f11540bc640 1 -- start start 2024-05-20T17:53:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f11540bc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f114c163a10 0x7f114c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f11540bc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114c0d0370 con 0x7f114c0b4010 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f11540bc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114c0d0650 con 0x7f114c0d14b0 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f11540bc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f114c0d3ca0 con 0x7f114c163a10 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f1151e58640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f114c163a10 0x7f114c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f1151657640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f114c0b4010 0x7f114c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39716/0 (socket says 172.21.15.6:39716) 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f1151657640 1 -- 172.21.15.6:0/981489541 learned_addr learned my addr 172.21.15.6:0/981489541 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f1151e58640 1 -- 172.21.15.6:0/981489541 >> v1:172.21.15.171:6789/0 conn(0x7f114c0d14b0 legacy=0x7f114c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f1151e58640 1 -- 172.21.15.6:0/981489541 >> v1:172.21.15.6:6789/0 conn(0x7f114c0b4010 legacy=0x7f114c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f1151e58640 1 -- 172.21.15.6:0/981489541 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114c0d3650 con 0x7f114c163a10 2024-05-20T17:53:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.211+0000 7f1150e56640 1 -- 172.21.15.6:0/981489541 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684940545 0 0) 0x7f114c0d0370 con 0x7f114c0b4010 2024-05-20T17:53:35.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.212+0000 7f1151e58640 1 --2- 172.21.15.6:0/981489541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c163a10 0x7f114c0d4130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f11440097a0 tx=0x7f114402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825d360ee19d5cf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.212+0000 7f1150e56640 1 -- 172.21.15.6:0/981489541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144037070 con 0x7f114c163a10 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.212+0000 7f1150e56640 1 -- 172.21.15.6:0/981489541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1144032440 con 0x7f114c163a10 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.212+0000 7f1150e56640 1 -- 172.21.15.6:0/981489541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144032810 con 0x7f114c163a10 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.213+0000 7f11540bc640 1 -- 172.21.15.6:0/981489541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c163a10 msgr2=0x7f114c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.213+0000 7f11540bc640 1 --2- 172.21.15.6:0/981489541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c163a10 0x7f114c0d4130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f11440097a0 tx=0x7f114402a230 comp rx=0 tx=0).stop 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.213+0000 7f11540bc640 1 -- 172.21.15.6:0/981489541 shutdown_connections 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.213+0000 7f11540bc640 1 --2- 172.21.15.6:0/981489541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c163a10 0x7f114c0d4130 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.213+0000 7f11540bc640 1 -- 172.21.15.6:0/981489541 >> 172.21.15.6:0/981489541 conn(0x7f114c06d240 msgr2=0x7f114c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.213+0000 7f11540bc640 1 -- 172.21.15.6:0/981489541 shutdown_connections 2024-05-20T17:53:35.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.213+0000 7f11540bc640 1 -- 172.21.15.6:0/981489541 wait complete. 2024-05-20T17:53:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.215+0000 7f11540bc640 1 Processor -- start 2024-05-20T17:53:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.215+0000 7f11540bc640 1 -- start start 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f11540bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c0b4010 0x7f114c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f11540bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f114c0d14b0 0x7f114c154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f11540bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f114c163a10 0x7f114c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f11540bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f114c0b8390 con 0x7f114c0b4010 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f11540bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f114c0b8210 con 0x7f114c0d14b0 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f11540bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f114c0b8510 con 0x7f114c163a10 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151e58640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c0b4010 0x7f114c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151e58640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c0b4010 0x7f114c156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46648/0 (socket says 172.21.15.6:46648) 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151e58640 1 -- 172.21.15.6:0/697348816 learned_addr learned my addr 172.21.15.6:0/697348816 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151657640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f114c0d14b0 0x7f114c154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1152659640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f114c163a10 0x7f114c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151e58640 1 -- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f114c163a10 msgr2=0x7f114c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151e58640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f114c163a10 0x7f114c157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151e58640 1 -- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f114c0d14b0 msgr2=0x7f114c154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151e58640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f114c0d14b0 0x7f114c154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1151e58640 1 -- 172.21.15.6:0/697348816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114c1554f0 con 0x7f114c0b4010 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.216+0000 7f1152659640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f114c163a10 0x7f114c157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.217+0000 7f1151e58640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c0b4010 0x7f114c156530 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f11440097a0 tx=0x7f11440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.217+0000 7f114a7fc640 1 -- 172.21.15.6:0/697348816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144037050 con 0x7f114c0b4010 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.217+0000 7f114a7fc640 1 -- 172.21.15.6:0/697348816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1144038040 con 0x7f114c0b4010 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.217+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114c154550 con 0x7f114c0b4010 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.217+0000 7f114a7fc640 1 -- 172.21.15.6:0/697348816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1144004490 con 0x7f114c0b4010 2024-05-20T17:53:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.217+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114c155a50 con 0x7f114c0b4010 2024-05-20T17:53:35.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.218+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114c075b00 con 0x7f114c0b4010 2024-05-20T17:53:35.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.219+0000 7f114a7fc640 1 -- 172.21.15.6:0/697348816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1144030900 con 0x7f114c0b4010 2024-05-20T17:53:35.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.219+0000 7f114a7fc640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113806be30 0x7f113806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.219+0000 7f114a7fc640 1 -- 172.21.15.6:0/697348816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f11440abc70 con 0x7f114c0b4010 2024-05-20T17:53:35.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.220+0000 7f1151657640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113806be30 0x7f113806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.220+0000 7f1151657640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113806be30 0x7f113806e340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f114c15ecf0 tx=0x7f1140007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.224+0000 7f114a7fc640 1 -- 172.21.15.6:0/697348816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f114c154550 con 0x7f114c0b4010 2024-05-20T17:53:35.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.406+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f114c0d3050 con 0x7f113806be30 2024-05-20T17:53:35.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.415+0000 7f114a7fc640 1 -- 172.21.15.6:0/697348816 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f114c0d3050 con 0x7f113806be30 2024-05-20T17:53:35.418 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:35.419 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:53:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113806be30 msgr2=0x7f113806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113806be30 0x7f113806e340 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f114c15ecf0 tx=0x7f1140007e40 comp rx=0 tx=0).stop 2024-05-20T17:53:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c0b4010 msgr2=0x7f114c156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c0b4010 0x7f114c156530 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f11440097a0 tx=0x7f11440046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 shutdown_connections 2024-05-20T17:53:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113806be30 0x7f113806e340 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f114c163a10 0x7f114c157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f114c0d14b0 0x7f114c154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 --2- 172.21.15.6:0/697348816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f114c0b4010 0x7f114c156530 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 >> 172.21.15.6:0/697348816 conn(0x7f114c06d240 msgr2=0x7f114c0b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 shutdown_connections 2024-05-20T17:53:35.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.418+0000 7f11540bc640 1 -- 172.21.15.6:0/697348816 wait complete. 2024-05-20T17:53:35.429 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-05-20T17:53:34.237344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219360,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755360,"statfs":{"total":773094113280,"available":772869488640,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003350"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244003+0000","last_change":"2024-05-20T17:53:06.574155+0000","last_active":"2024-05-20T17:53:14.244003+0000","last_peered":"2024-05-20T17:53:14.244003+0000","last_clean":"2024-05-20T17:53:14.244003+0000","last_became_active":"2024-05-20T17:53:06.573561+0000","last_became_peered":"2024-05-20T17:53:06.573561+0000","last_unstale":"2024-05-20T17:53:14.244003+0000","last_undegraded":"2024-05-20T17:53:14.244003+0000","last_fullsized":"2024-05-20T17:53:14.244003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:22:58.179989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598752+0000","last_change":"2024-05-20T17:53:07.588500+0000","last_active":"2024-05-20T17:53:12.598752+0000","last_peered":"2024-05-20T17:53:12.598752+0000","last_clean":"2024-05-20T17:53:12.598752+0000","last_became_active":"2024-05-20T17:53:07.588137+0000","last_became_peered":"2024-05-20T17:53:07.588137+0000","last_unstale":"2024-05-20T17:53:12.598752+0000","last_undegraded":"2024-05-20T17:53:12.598752+0000","last_fullsized":"2024-05-20T17:53:12.598752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597759+0000","last_change":"2024-05-20T17:53:11.755635+0000","last_active":"2024-05-20T17:53:12.597759+0000","last_peered":"2024-05-20T17:53:12.597759+0000","last_clean":"2024-05-20T17:53:12.597759+0000","last_became_active":"2024-05-20T17:53:11.755186+0000","last_became_peered":"2024-05-20T17:53:11.755186+0000","last_unstale":"2024-05-20T17:53:12.597759+0000","last_undegraded":"2024-05-20T17:53:12.597759+0000","last_fullsized":"2024-05-20T17:53:12.597759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:41.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599124+0000","last_change":"2024-05-20T17:53:06.565749+0000","last_active":"2024-05-20T17:53:12.599124+0000","last_peered":"2024-05-20T17:53:12.599124+0000","last_clean":"2024-05-20T17:53:12.599124+0000","last_became_active":"2024-05-20T17:53:06.565249+0000","last_became_peered":"2024-05-20T17:53:06.565249+0000","last_unstale":"2024-05-20T17:53:12.599124+0000","last_undegraded":"2024-05-20T17:53:12.599124+0000","last_fullsized":"2024-05-20T17:53:12.599124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243589+0000","last_change":"2024-05-20T17:53:07.573440+0000","last_active":"2024-05-20T17:53:14.243589+0000","last_peered":"2024-05-20T17:53:14.243589+0000","last_clean":"2024-05-20T17:53:14.243589+0000","last_became_active":"2024-05-20T17:53:07.572075+0000","last_became_peered":"2024-05-20T17:53:07.572075+0000","last_unstale":"2024-05-20T17:53:14.243589+0000","last_undegraded":"2024-05-20T17:53:14.243589+0000","last_fullsized":"2024-05-20T17:53:14.243589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598429+0000","last_change":"2024-05-20T17:53:11.615875+0000","last_active":"2024-05-20T17:53:12.598429+0000","last_peered":"2024-05-20T17:53:12.598429+0000","last_clean":"2024-05-20T17:53:12.598429+0000","last_became_active":"2024-05-20T17:53:11.614378+0000","last_became_peered":"2024-05-20T17:53:11.614378+0000","last_unstale":"2024-05-20T17:53:12.598429+0000","last_undegraded":"2024-05-20T17:53:12.598429+0000","last_fullsized":"2024-05-20T17:53:12.598429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:44.041188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654652+0000","last_change":"2024-05-20T17:53:06.577931+0000","last_active":"2024-05-20T17:53:13.654652+0000","last_peered":"2024-05-20T17:53:13.654652+0000","last_clean":"2024-05-20T17:53:13.654652+0000","last_became_active":"2024-05-20T17:53:06.577611+0000","last_became_peered":"2024-05-20T17:53:06.577611+0000","last_unstale":"2024-05-20T17:53:13.654652+0000","last_undegraded":"2024-05-20T17:53:13.654652+0000","last_fullsized":"2024-05-20T17:53:13.654652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:30.496240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245106+0000","last_change":"2024-05-20T17:53:07.558806+0000","last_active":"2024-05-20T17:53:14.245106+0000","last_peered":"2024-05-20T17:53:14.245106+0000","last_clean":"2024-05-20T17:53:14.245106+0000","last_became_active":"2024-05-20T17:53:07.558446+0000","last_became_peered":"2024-05-20T17:53:07.558446+0000","last_unstale":"2024-05-20T17:53:14.245106+0000","last_undegraded":"2024-05-20T17:53:14.245106+0000","last_fullsized":"2024-05-20T17:53:14.245106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:14:58.555617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598909+0000","last_change":"2024-05-20T17:53:11.615219+0000","last_active":"2024-05-20T17:53:12.598909+0000","last_peered":"2024-05-20T17:53:12.598909+0000","last_clean":"2024-05-20T17:53:12.598909+0000","last_became_active":"2024-05-20T17:53:11.614707+0000","last_became_peered":"2024-05-20T17:53:11.614707+0000","last_unstale":"2024-05-20T17:53:12.598909+0000","last_undegraded":"2024-05-20T17:53:12.598909+0000","last_fullsized":"2024-05-20T17:53:12.598909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:43:01.628287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654386+0000","last_change":"2024-05-20T17:53:06.572513+0000","last_active":"2024-05-20T17:53:13.654386+0000","last_peered":"2024-05-20T17:53:13.654386+0000","last_clean":"2024-05-20T17:53:13.654386+0000","last_became_active":"2024-05-20T17:53:06.572112+0000","last_became_peered":"2024-05-20T17:53:06.572112+0000","last_unstale":"2024-05-20T17:53:13.654386+0000","last_undegraded":"2024-05-20T17:53:13.654386+0000","last_fullsized":"2024-05-20T17:53:13.654386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245406+0000","last_change":"2024-05-20T17:53:07.559015+0000","last_active":"2024-05-20T17:53:14.245406+0000","last_peered":"2024-05-20T17:53:14.245406+0000","last_clean":"2024-05-20T17:53:14.245406+0000","last_became_active":"2024-05-20T17:53:07.558369+0000","last_became_peered":"2024-05-20T17:53:07.558369+0000","last_unstale":"2024-05-20T17:53:14.245406+0000","last_undegraded":"2024-05-20T17:53:14.245406+0000","last_fullsized":"2024-05-20T17:53:14.245406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598644+0000","last_change":"2024-05-20T17:53:11.618079+0000","last_active":"2024-05-20T17:53:12.598644+0000","last_peered":"2024-05-20T17:53:12.598644+0000","last_clean":"2024-05-20T17:53:12.598644+0000","last_became_active":"2024-05-20T17:53:11.617572+0000","last_became_peered":"2024-05-20T17:53:11.617572+0000","last_unstale":"2024-05-20T17:53:12.598644+0000","last_undegraded":"2024-05-20T17:53:12.598644+0000","last_fullsized":"2024-05-20T17:53:12.598644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:23.513112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244311+0000","last_change":"2024-05-20T17:53:07.572220+0000","last_active":"2024-05-20T17:53:14.244311+0000","last_peered":"2024-05-20T17:53:14.244311+0000","last_clean":"2024-05-20T17:53:14.244311+0000","last_became_active":"2024-05-20T17:53:07.571759+0000","last_became_peered":"2024-05-20T17:53:07.571759+0000","last_unstale":"2024-05-20T17:53:14.244311+0000","last_undegraded":"2024-05-20T17:53:14.244311+0000","last_fullsized":"2024-05-20T17:53:14.244311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654495+0000","last_change":"2024-05-20T17:53:06.573537+0000","last_active":"2024-05-20T17:53:13.654495+0000","last_peered":"2024-05-20T17:53:13.654495+0000","last_clean":"2024-05-20T17:53:13.654495+0000","last_became_active":"2024-05-20T17:53:06.573236+0000","last_became_peered":"2024-05-20T17:53:06.573236+0000","last_unstale":"2024-05-20T17:53:13.654495+0000","last_undegraded":"2024-05-20T17:53:13.654495+0000","last_fullsized":"2024-05-20T17:53:13.654495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:00:16.154534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598961+0000","last_change":"2024-05-20T17:53:11.618293+0000","last_active":"2024-05-20T17:53:12.598961+0000","last_peered":"2024-05-20T17:53:12.598961+0000","last_clean":"2024-05-20T17:53:12.598961+0000","last_became_active":"2024-05-20T17:53:11.617707+0000","last_became_peered":"2024-05-20T17:53:11.617707+0000","last_unstale":"2024-05-20T17:53:12.598961+0000","last_undegraded":"2024-05-20T17:53:12.598961+0000","last_fullsized":"2024-05-20T17:53:12.598961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:24.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598222+0000","last_change":"2024-05-20T17:53:07.585094+0000","last_active":"2024-05-20T17:53:12.598222+0000","last_peered":"2024-05-20T17:53:12.598222+0000","last_clean":"2024-05-20T17:53:12.598222+0000","last_became_active":"2024-05-20T17:53:07.584666+0000","last_became_peered":"2024-05-20T17:53:07.584666+0000","last_unstale":"2024-05-20T17:53:12.598222+0000","last_undegraded":"2024-05-20T17:53:12.598222+0000","last_fullsized":"2024-05-20T17:53:12.598222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244302+0000","last_change":"2024-05-20T17:53:06.569733+0000","last_active":"2024-05-20T17:53:14.244302+0000","last_peered":"2024-05-20T17:53:14.244302+0000","last_clean":"2024-05-20T17:53:14.244302+0000","last_became_active":"2024-05-20T17:53:06.569177+0000","last_became_peered":"2024-05-20T17:53:06.569177+0000","last_unstale":"2024-05-20T17:53:14.244302+0000","last_undegraded":"2024-05-20T17:53:14.244302+0000","last_fullsized":"2024-05-20T17:53:14.244302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599068+0000","last_change":"2024-05-20T17:53:11.614905+0000","last_active":"2024-05-20T17:53:12.599068+0000","last_peered":"2024-05-20T17:53:12.599068+0000","last_clean":"2024-05-20T17:53:12.599068+0000","last_became_active":"2024-05-20T17:53:11.614264+0000","last_became_peered":"2024-05-20T17:53:11.614264+0000","last_unstale":"2024-05-20T17:53:12.599068+0000","last_undegraded":"2024-05-20T17:53:12.599068+0000","last_fullsized":"2024-05-20T17:53:12.599068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:44.269036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598007+0000","last_change":"2024-05-20T17:53:07.589843+0000","last_active":"2024-05-20T17:53:12.598007+0000","last_peered":"2024-05-20T17:53:12.598007+0000","last_clean":"2024-05-20T17:53:12.598007+0000","last_became_active":"2024-05-20T17:53:07.589565+0000","last_became_peered":"2024-05-20T17:53:07.589565+0000","last_unstale":"2024-05-20T17:53:12.598007+0000","last_undegraded":"2024-05-20T17:53:12.598007+0000","last_fullsized":"2024-05-20T17:53:12.598007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243854+0000","last_change":"2024-05-20T17:53:06.570609+0000","last_active":"2024-05-20T17:53:14.243854+0000","last_peered":"2024-05-20T17:53:14.243854+0000","last_clean":"2024-05-20T17:53:14.243854+0000","last_became_active":"2024-05-20T17:53:06.570253+0000","last_became_peered":"2024-05-20T17:53:06.570253+0000","last_unstale":"2024-05-20T17:53:14.243854+0000","last_undegraded":"2024-05-20T17:53:14.243854+0000","last_fullsized":"2024-05-20T17:53:14.243854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245197+0000","last_change":"2024-05-20T17:53:11.756398+0000","last_active":"2024-05-20T17:53:14.245197+0000","last_peered":"2024-05-20T17:53:14.245197+0000","last_clean":"2024-05-20T17:53:14.245197+0000","last_became_active":"2024-05-20T17:53:11.755995+0000","last_became_peered":"2024-05-20T17:53:11.755995+0000","last_unstale":"2024-05-20T17:53:14.245197+0000","last_undegraded":"2024-05-20T17:53:14.245197+0000","last_fullsized":"2024-05-20T17:53:14.245197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:50.812964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599504+0000","last_change":"2024-05-20T17:53:07.569595+0000","last_active":"2024-05-20T17:53:12.599504+0000","last_peered":"2024-05-20T17:53:12.599504+0000","last_clean":"2024-05-20T17:53:12.599504+0000","last_became_active":"2024-05-20T17:53:07.569291+0000","last_became_peered":"2024-05-20T17:53:07.569291+0000","last_unstale":"2024-05-20T17:53:12.599504+0000","last_undegraded":"2024-05-20T17:53:12.599504+0000","last_fullsized":"2024-05-20T17:53:12.599504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:32.671797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654037+0000","last_change":"2024-05-20T17:53:06.576258+0000","last_active":"2024-05-20T17:53:13.654037+0000","last_peered":"2024-05-20T17:53:13.654037+0000","last_clean":"2024-05-20T17:53:13.654037+0000","last_became_active":"2024-05-20T17:53:06.575933+0000","last_became_peered":"2024-05-20T17:53:06.575933+0000","last_unstale":"2024-05-20T17:53:13.654037+0000","last_undegraded":"2024-05-20T17:53:13.654037+0000","last_fullsized":"2024-05-20T17:53:13.654037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599393+0000","last_change":"2024-05-20T17:53:11.615738+0000","last_active":"2024-05-20T17:53:12.599393+0000","last_peered":"2024-05-20T17:53:12.599393+0000","last_clean":"2024-05-20T17:53:12.599393+0000","last_became_active":"2024-05-20T17:53:11.614228+0000","last_became_peered":"2024-05-20T17:53:11.614228+0000","last_unstale":"2024-05-20T17:53:12.599393+0000","last_undegraded":"2024-05-20T17:53:12.599393+0000","last_fullsized":"2024-05-20T17:53:12.599393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:02.595103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244147+0000","last_change":"2024-05-20T17:53:07.569138+0000","last_active":"2024-05-20T17:53:14.244147+0000","last_peered":"2024-05-20T17:53:14.244147+0000","last_clean":"2024-05-20T17:53:14.244147+0000","last_became_active":"2024-05-20T17:53:07.568036+0000","last_became_peered":"2024-05-20T17:53:07.568036+0000","last_unstale":"2024-05-20T17:53:14.244147+0000","last_undegraded":"2024-05-20T17:53:14.244147+0000","last_fullsized":"2024-05-20T17:53:14.244147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245354+0000","last_change":"2024-05-20T17:53:06.575386+0000","last_active":"2024-05-20T17:53:14.245354+0000","last_peered":"2024-05-20T17:53:14.245354+0000","last_clean":"2024-05-20T17:53:14.245354+0000","last_became_active":"2024-05-20T17:53:06.574851+0000","last_became_peered":"2024-05-20T17:53:06.574851+0000","last_unstale":"2024-05-20T17:53:14.245354+0000","last_undegraded":"2024-05-20T17:53:14.245354+0000","last_fullsized":"2024-05-20T17:53:14.245354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598416+0000","last_change":"2024-05-20T17:53:11.751984+0000","last_active":"2024-05-20T17:53:12.598416+0000","last_peered":"2024-05-20T17:53:12.598416+0000","last_clean":"2024-05-20T17:53:12.598416+0000","last_became_active":"2024-05-20T17:53:11.751452+0000","last_became_peered":"2024-05-20T17:53:11.751452+0000","last_unstale":"2024-05-20T17:53:12.598416+0000","last_undegraded":"2024-05-20T17:53:12.598416+0000","last_fullsized":"2024-05-20T17:53:12.598416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:44.794916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599614+0000","last_change":"2024-05-20T17:53:07.586262+0000","last_active":"2024-05-20T17:53:12.599614+0000","last_peered":"2024-05-20T17:53:12.599614+0000","last_clean":"2024-05-20T17:53:12.599614+0000","last_became_active":"2024-05-20T17:53:07.584798+0000","last_became_peered":"2024-05-20T17:53:07.584798+0000","last_unstale":"2024-05-20T17:53:12.599614+0000","last_undegraded":"2024-05-20T17:53:12.599614+0000","last_fullsized":"2024-05-20T17:53:12.599614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245096+0000","last_change":"2024-05-20T17:53:06.572334+0000","last_active":"2024-05-20T17:53:14.245096+0000","last_peered":"2024-05-20T17:53:14.245096+0000","last_clean":"2024-05-20T17:53:14.245096+0000","last_became_active":"2024-05-20T17:53:06.571243+0000","last_became_peered":"2024-05-20T17:53:06.571243+0000","last_unstale":"2024-05-20T17:53:14.245096+0000","last_undegraded":"2024-05-20T17:53:14.245096+0000","last_fullsized":"2024-05-20T17:53:14.245096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:00:16.154534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597655+0000","last_change":"2024-05-20T17:53:11.751914+0000","last_active":"2024-05-20T17:53:12.597655+0000","last_peered":"2024-05-20T17:53:12.597655+0000","last_clean":"2024-05-20T17:53:12.597655+0000","last_became_active":"2024-05-20T17:53:11.751472+0000","last_became_peered":"2024-05-20T17:53:11.751472+0000","last_unstale":"2024-05-20T17:53:12.597655+0000","last_undegraded":"2024-05-20T17:53:12.597655+0000","last_fullsized":"2024-05-20T17:53:12.597655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:52.250807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244812+0000","last_change":"2024-05-20T17:53:07.569467+0000","last_active":"2024-05-20T17:53:14.244812+0000","last_peered":"2024-05-20T17:53:14.244812+0000","last_clean":"2024-05-20T17:53:14.244812+0000","last_became_active":"2024-05-20T17:53:07.569123+0000","last_became_peered":"2024-05-20T17:53:07.569123+0000","last_unstale":"2024-05-20T17:53:14.244812+0000","last_undegraded":"2024-05-20T17:53:14.244812+0000","last_fullsized":"2024-05-20T17:53:14.244812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654806+0000","last_change":"2024-05-20T17:53:06.577309+0000","last_active":"2024-05-20T17:53:13.654806+0000","last_peered":"2024-05-20T17:53:13.654806+0000","last_clean":"2024-05-20T17:53:13.654806+0000","last_became_active":"2024-05-20T17:53:06.576898+0000","last_became_peered":"2024-05-20T17:53:06.576898+0000","last_unstale":"2024-05-20T17:53:13.654806+0000","last_undegraded":"2024-05-20T17:53:13.654806+0000","last_fullsized":"2024-05-20T17:53:13.654806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:25.034377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244489+0000","last_change":"2024-05-20T17:53:11.751909+0000","last_active":"2024-05-20T17:53:14.244489+0000","last_peered":"2024-05-20T17:53:14.244489+0000","last_clean":"2024-05-20T17:53:14.244489+0000","last_became_active":"2024-05-20T17:53:11.751479+0000","last_became_peered":"2024-05-20T17:53:11.751479+0000","last_unstale":"2024-05-20T17:53:14.244489+0000","last_undegraded":"2024-05-20T17:53:14.244489+0000","last_fullsized":"2024-05-20T17:53:14.244489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:55.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245485+0000","last_change":"2024-05-20T17:53:07.585138+0000","last_active":"2024-05-20T17:53:14.245485+0000","last_peered":"2024-05-20T17:53:14.245485+0000","last_clean":"2024-05-20T17:53:14.245485+0000","last_became_active":"2024-05-20T17:53:07.584803+0000","last_became_peered":"2024-05-20T17:53:07.584803+0000","last_unstale":"2024-05-20T17:53:14.245485+0000","last_undegraded":"2024-05-20T17:53:14.245485+0000","last_fullsized":"2024-05-20T17:53:14.245485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244812+0000","last_change":"2024-05-20T17:53:06.567245+0000","last_active":"2024-05-20T17:53:14.244812+0000","last_peered":"2024-05-20T17:53:14.244812+0000","last_clean":"2024-05-20T17:53:14.244812+0000","last_became_active":"2024-05-20T17:53:06.566920+0000","last_became_peered":"2024-05-20T17:53:06.566920+0000","last_unstale":"2024-05-20T17:53:14.244812+0000","last_undegraded":"2024-05-20T17:53:14.244812+0000","last_fullsized":"2024-05-20T17:53:14.244812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243827+0000","last_change":"2024-05-20T17:53:11.623254+0000","last_active":"2024-05-20T17:53:14.243827+0000","last_peered":"2024-05-20T17:53:14.243827+0000","last_clean":"2024-05-20T17:53:14.243827+0000","last_became_active":"2024-05-20T17:53:11.621995+0000","last_became_peered":"2024-05-20T17:53:11.621995+0000","last_unstale":"2024-05-20T17:53:14.243827+0000","last_undegraded":"2024-05-20T17:53:14.243827+0000","last_fullsized":"2024-05-20T17:53:14.243827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:49.533751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599455+0000","last_change":"2024-05-20T17:53:07.568413+0000","last_active":"2024-05-20T17:53:12.599455+0000","last_peered":"2024-05-20T17:53:12.599455+0000","last_clean":"2024-05-20T17:53:12.599455+0000","last_became_active":"2024-05-20T17:53:07.567292+0000","last_became_peered":"2024-05-20T17:53:07.567292+0000","last_unstale":"2024-05-20T17:53:12.599455+0000","last_undegraded":"2024-05-20T17:53:12.599455+0000","last_fullsized":"2024-05-20T17:53:12.599455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:26.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244479+0000","last_change":"2024-05-20T17:53:06.567819+0000","last_active":"2024-05-20T17:53:14.244479+0000","last_peered":"2024-05-20T17:53:14.244479+0000","last_clean":"2024-05-20T17:53:14.244479+0000","last_became_active":"2024-05-20T17:53:06.567485+0000","last_became_peered":"2024-05-20T17:53:06.567485+0000","last_unstale":"2024-05-20T17:53:14.244479+0000","last_undegraded":"2024-05-20T17:53:14.244479+0000","last_fullsized":"2024-05-20T17:53:14.244479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244638+0000","last_change":"2024-05-20T17:53:11.621878+0000","last_active":"2024-05-20T17:53:14.244638+0000","last_peered":"2024-05-20T17:53:14.244638+0000","last_clean":"2024-05-20T17:53:14.244638+0000","last_became_active":"2024-05-20T17:53:11.621430+0000","last_became_peered":"2024-05-20T17:53:11.621430+0000","last_unstale":"2024-05-20T17:53:14.244638+0000","last_undegraded":"2024-05-20T17:53:14.244638+0000","last_fullsized":"2024-05-20T17:53:14.244638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:55.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243483+0000","last_change":"2024-05-20T17:53:07.569646+0000","last_active":"2024-05-20T17:53:14.243483+0000","last_peered":"2024-05-20T17:53:14.243483+0000","last_clean":"2024-05-20T17:53:14.243483+0000","last_became_active":"2024-05-20T17:53:07.569255+0000","last_became_peered":"2024-05-20T17:53:07.569255+0000","last_unstale":"2024-05-20T17:53:14.243483+0000","last_undegraded":"2024-05-20T17:53:14.243483+0000","last_fullsized":"2024-05-20T17:53:14.243483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598624+0000","last_change":"2024-05-20T17:53:06.568915+0000","last_active":"2024-05-20T17:53:12.598624+0000","last_peered":"2024-05-20T17:53:12.598624+0000","last_clean":"2024-05-20T17:53:12.598624+0000","last_became_active":"2024-05-20T17:53:06.568597+0000","last_became_peered":"2024-05-20T17:53:06.568597+0000","last_unstale":"2024-05-20T17:53:12.598624+0000","last_undegraded":"2024-05-20T17:53:12.598624+0000","last_fullsized":"2024-05-20T17:53:12.598624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245241+0000","last_change":"2024-05-20T17:53:11.622481+0000","last_active":"2024-05-20T17:53:14.245241+0000","last_peered":"2024-05-20T17:53:14.245241+0000","last_clean":"2024-05-20T17:53:14.245241+0000","last_became_active":"2024-05-20T17:53:11.622026+0000","last_became_peered":"2024-05-20T17:53:11.622026+0000","last_unstale":"2024-05-20T17:53:14.245241+0000","last_undegraded":"2024-05-20T17:53:14.245241+0000","last_fullsized":"2024-05-20T17:53:14.245241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:15.654843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243451+0000","last_change":"2024-05-20T17:53:07.563580+0000","last_active":"2024-05-20T17:53:14.243451+0000","last_peered":"2024-05-20T17:53:14.243451+0000","last_clean":"2024-05-20T17:53:14.243451+0000","last_became_active":"2024-05-20T17:53:07.563226+0000","last_became_peered":"2024-05-20T17:53:07.563226+0000","last_unstale":"2024-05-20T17:53:14.243451+0000","last_undegraded":"2024-05-20T17:53:14.243451+0000","last_fullsized":"2024-05-20T17:53:14.243451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:22.334918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654094+0000","last_change":"2024-05-20T17:53:06.570658+0000","last_active":"2024-05-20T17:53:13.654094+0000","last_peered":"2024-05-20T17:53:13.654094+0000","last_clean":"2024-05-20T17:53:13.654094+0000","last_became_active":"2024-05-20T17:53:06.569975+0000","last_became_peered":"2024-05-20T17:53:06.569975+0000","last_unstale":"2024-05-20T17:53:13.654094+0000","last_undegraded":"2024-05-20T17:53:13.654094+0000","last_fullsized":"2024-05-20T17:53:13.654094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244022+0000","last_change":"2024-05-20T17:53:11.752185+0000","last_active":"2024-05-20T17:53:14.244022+0000","last_peered":"2024-05-20T17:53:14.244022+0000","last_clean":"2024-05-20T17:53:14.244022+0000","last_became_active":"2024-05-20T17:53:11.751761+0000","last_became_peered":"2024-05-20T17:53:11.751761+0000","last_unstale":"2024-05-20T17:53:14.244022+0000","last_undegraded":"2024-05-20T17:53:14.244022+0000","last_fullsized":"2024-05-20T17:53:14.244022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:28.849402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597975+0000","last_change":"2024-05-20T17:53:07.585881+0000","last_active":"2024-05-20T17:53:12.597975+0000","last_peered":"2024-05-20T17:53:12.597975+0000","last_clean":"2024-05-20T17:53:12.597975+0000","last_became_active":"2024-05-20T17:53:07.584882+0000","last_became_peered":"2024-05-20T17:53:07.584882+0000","last_unstale":"2024-05-20T17:53:12.597975+0000","last_undegraded":"2024-05-20T17:53:12.597975+0000","last_fullsized":"2024-05-20T17:53:12.597975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244548+0000","last_change":"2024-05-20T17:53:06.568683+0000","last_active":"2024-05-20T17:53:14.244548+0000","last_peered":"2024-05-20T17:53:14.244548+0000","last_clean":"2024-05-20T17:53:14.244548+0000","last_became_active":"2024-05-20T17:53:06.568335+0000","last_became_peered":"2024-05-20T17:53:06.568335+0000","last_unstale":"2024-05-20T17:53:14.244548+0000","last_undegraded":"2024-05-20T17:53:14.244548+0000","last_fullsized":"2024-05-20T17:53:14.244548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654203+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:53:13.654203+0000","last_peered":"2024-05-20T17:53:13.654203+0000","last_clean":"2024-05-20T17:53:13.654203+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:53:13.654203+0000","last_undegraded":"2024-05-20T17:53:13.654203+0000","last_fullsized":"2024-05-20T17:53:13.654203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244914+0000","last_change":"2024-05-20T17:53:11.755628+0000","last_active":"2024-05-20T17:53:14.244914+0000","last_peered":"2024-05-20T17:53:14.244914+0000","last_clean":"2024-05-20T17:53:14.244914+0000","last_became_active":"2024-05-20T17:53:11.755136+0000","last_became_peered":"2024-05-20T17:53:11.755136+0000","last_unstale":"2024-05-20T17:53:14.244914+0000","last_undegraded":"2024-05-20T17:53:14.244914+0000","last_fullsized":"2024-05-20T17:53:14.244914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:21.092223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654502+0000","last_change":"2024-05-20T17:53:07.570752+0000","last_active":"2024-05-20T17:53:13.654502+0000","last_peered":"2024-05-20T17:53:13.654502+0000","last_clean":"2024-05-20T17:53:13.654502+0000","last_became_active":"2024-05-20T17:53:07.570340+0000","last_became_peered":"2024-05-20T17:53:07.570340+0000","last_unstale":"2024-05-20T17:53:13.654502+0000","last_undegraded":"2024-05-20T17:53:13.654502+0000","last_fullsized":"2024-05-20T17:53:13.654502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599144+0000","last_change":"2024-05-20T17:53:06.574013+0000","last_active":"2024-05-20T17:53:12.599144+0000","last_peered":"2024-05-20T17:53:12.599144+0000","last_clean":"2024-05-20T17:53:12.599144+0000","last_became_active":"2024-05-20T17:53:06.573642+0000","last_became_peered":"2024-05-20T17:53:06.573642+0000","last_unstale":"2024-05-20T17:53:12.599144+0000","last_undegraded":"2024-05-20T17:53:12.599144+0000","last_fullsized":"2024-05-20T17:53:12.599144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244226+0000","last_change":"2024-05-20T17:53:11.753062+0000","last_active":"2024-05-20T17:53:14.244226+0000","last_peered":"2024-05-20T17:53:14.244226+0000","last_clean":"2024-05-20T17:53:14.244226+0000","last_became_active":"2024-05-20T17:53:11.751556+0000","last_became_peered":"2024-05-20T17:53:11.751556+0000","last_unstale":"2024-05-20T17:53:14.244226+0000","last_undegraded":"2024-05-20T17:53:14.244226+0000","last_fullsized":"2024-05-20T17:53:14.244226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:24.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245151+0000","last_change":"2024-05-20T17:53:07.588441+0000","last_active":"2024-05-20T17:53:14.245151+0000","last_peered":"2024-05-20T17:53:14.245151+0000","last_clean":"2024-05-20T17:53:14.245151+0000","last_became_active":"2024-05-20T17:53:07.588133+0000","last_became_peered":"2024-05-20T17:53:07.588133+0000","last_unstale":"2024-05-20T17:53:14.245151+0000","last_undegraded":"2024-05-20T17:53:14.245151+0000","last_fullsized":"2024-05-20T17:53:14.245151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:24.809917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244797+0000","last_change":"2024-05-20T17:53:06.573392+0000","last_active":"2024-05-20T17:53:14.244797+0000","last_peered":"2024-05-20T17:53:14.244797+0000","last_clean":"2024-05-20T17:53:14.244797+0000","last_became_active":"2024-05-20T17:53:06.573074+0000","last_became_peered":"2024-05-20T17:53:06.573074+0000","last_unstale":"2024-05-20T17:53:14.244797+0000","last_undegraded":"2024-05-20T17:53:14.244797+0000","last_fullsized":"2024-05-20T17:53:14.244797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:25.034377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244807+0000","last_change":"2024-05-20T17:53:11.616708+0000","last_active":"2024-05-20T17:53:14.244807+0000","last_peered":"2024-05-20T17:53:14.244807+0000","last_clean":"2024-05-20T17:53:14.244807+0000","last_became_active":"2024-05-20T17:53:11.616224+0000","last_became_peered":"2024-05-20T17:53:11.616224+0000","last_unstale":"2024-05-20T17:53:14.244807+0000","last_undegraded":"2024-05-20T17:53:14.244807+0000","last_fullsized":"2024-05-20T17:53:14.244807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:50.812964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654899+0000","last_change":"2024-05-20T17:53:07.572037+0000","last_active":"2024-05-20T17:53:13.654899+0000","last_peered":"2024-05-20T17:53:13.654899+0000","last_clean":"2024-05-20T17:53:13.654899+0000","last_became_active":"2024-05-20T17:53:07.571604+0000","last_became_peered":"2024-05-20T17:53:07.571604+0000","last_unstale":"2024-05-20T17:53:13.654899+0000","last_undegraded":"2024-05-20T17:53:13.654899+0000","last_fullsized":"2024-05-20T17:53:13.654899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:14:58.555617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599665+0000","last_change":"2024-05-20T17:53:06.569716+0000","last_active":"2024-05-20T17:53:12.599665+0000","last_peered":"2024-05-20T17:53:12.599665+0000","last_clean":"2024-05-20T17:53:12.599665+0000","last_became_active":"2024-05-20T17:53:06.569388+0000","last_became_peered":"2024-05-20T17:53:06.569388+0000","last_unstale":"2024-05-20T17:53:12.599665+0000","last_undegraded":"2024-05-20T17:53:12.599665+0000","last_fullsized":"2024-05-20T17:53:12.599665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243806+0000","last_change":"2024-05-20T17:53:11.755708+0000","last_active":"2024-05-20T17:53:14.243806+0000","last_peered":"2024-05-20T17:53:14.243806+0000","last_clean":"2024-05-20T17:53:14.243806+0000","last_became_active":"2024-05-20T17:53:11.755172+0000","last_became_peered":"2024-05-20T17:53:11.755172+0000","last_unstale":"2024-05-20T17:53:14.243806+0000","last_undegraded":"2024-05-20T17:53:14.243806+0000","last_fullsized":"2024-05-20T17:53:14.243806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:52.250807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654824+0000","last_change":"2024-05-20T17:53:07.572990+0000","last_active":"2024-05-20T17:53:13.654824+0000","last_peered":"2024-05-20T17:53:13.654824+0000","last_clean":"2024-05-20T17:53:13.654824+0000","last_became_active":"2024-05-20T17:53:07.572659+0000","last_became_peered":"2024-05-20T17:53:07.572659+0000","last_unstale":"2024-05-20T17:53:13.654824+0000","last_undegraded":"2024-05-20T17:53:13.654824+0000","last_fullsized":"2024-05-20T17:53:13.654824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599512+0000","last_change":"2024-05-20T17:53:06.566523+0000","last_active":"2024-05-20T17:53:12.599512+0000","last_peered":"2024-05-20T17:53:12.599512+0000","last_clean":"2024-05-20T17:53:12.599512+0000","last_became_active":"2024-05-20T17:53:06.566228+0000","last_became_peered":"2024-05-20T17:53:06.566228+0000","last_unstale":"2024-05-20T17:53:12.599512+0000","last_undegraded":"2024-05-20T17:53:12.599512+0000","last_fullsized":"2024-05-20T17:53:12.599512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:53:10.800947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598417+0000","last_change":"2024-05-20T17:53:11.616204+0000","last_active":"2024-05-20T17:53:12.598417+0000","last_peered":"2024-05-20T17:53:12.598417+0000","last_clean":"2024-05-20T17:53:12.598417+0000","last_became_active":"2024-05-20T17:53:11.614496+0000","last_became_peered":"2024-05-20T17:53:11.614496+0000","last_unstale":"2024-05-20T17:53:12.598417+0000","last_undegraded":"2024-05-20T17:53:12.598417+0000","last_fullsized":"2024-05-20T17:53:12.598417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:35.749353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654214+0000","last_change":"2024-05-20T17:53:07.571233+0000","last_active":"2024-05-20T17:53:13.654214+0000","last_peered":"2024-05-20T17:53:13.654214+0000","last_clean":"2024-05-20T17:53:13.654214+0000","last_became_active":"2024-05-20T17:53:07.570934+0000","last_became_peered":"2024-05-20T17:53:07.570934+0000","last_unstale":"2024-05-20T17:53:13.654214+0000","last_undegraded":"2024-05-20T17:53:13.654214+0000","last_fullsized":"2024-05-20T17:53:13.654214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:17.052738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598410+0000","last_change":"2024-05-20T17:53:06.567186+0000","last_active":"2024-05-20T17:53:12.598410+0000","last_peered":"2024-05-20T17:53:12.598410+0000","last_clean":"2024-05-20T17:53:12.598410+0000","last_became_active":"2024-05-20T17:53:06.566859+0000","last_became_peered":"2024-05-20T17:53:06.566859+0000","last_unstale":"2024-05-20T17:53:12.598410+0000","last_undegraded":"2024-05-20T17:53:12.598410+0000","last_fullsized":"2024-05-20T17:53:12.598410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243852+0000","last_change":"2024-05-20T17:53:11.621010+0000","last_active":"2024-05-20T17:53:14.243852+0000","last_peered":"2024-05-20T17:53:14.243852+0000","last_clean":"2024-05-20T17:53:14.243852+0000","last_became_active":"2024-05-20T17:53:11.620499+0000","last_became_peered":"2024-05-20T17:53:11.620499+0000","last_unstale":"2024-05-20T17:53:14.243852+0000","last_undegraded":"2024-05-20T17:53:14.243852+0000","last_fullsized":"2024-05-20T17:53:14.243852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:49.533751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243897+0000","last_change":"2024-05-20T17:53:07.570895+0000","last_active":"2024-05-20T17:53:14.243897+0000","last_peered":"2024-05-20T17:53:14.243897+0000","last_clean":"2024-05-20T17:53:14.243897+0000","last_became_active":"2024-05-20T17:53:07.570591+0000","last_became_peered":"2024-05-20T17:53:07.570591+0000","last_unstale":"2024-05-20T17:53:14.243897+0000","last_undegraded":"2024-05-20T17:53:14.243897+0000","last_fullsized":"2024-05-20T17:53:14.243897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244112+0000","last_change":"2024-05-20T17:53:06.571154+0000","last_active":"2024-05-20T17:53:14.244112+0000","last_peered":"2024-05-20T17:53:14.244112+0000","last_clean":"2024-05-20T17:53:14.244112+0000","last_became_active":"2024-05-20T17:53:06.570383+0000","last_became_peered":"2024-05-20T17:53:06.570383+0000","last_unstale":"2024-05-20T17:53:14.244112+0000","last_undegraded":"2024-05-20T17:53:14.244112+0000","last_fullsized":"2024-05-20T17:53:14.244112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599410+0000","last_change":"2024-05-20T17:53:11.755366+0000","last_active":"2024-05-20T17:53:12.599410+0000","last_peered":"2024-05-20T17:53:12.599410+0000","last_clean":"2024-05-20T17:53:12.599410+0000","last_became_active":"2024-05-20T17:53:11.754922+0000","last_became_peered":"2024-05-20T17:53:11.754922+0000","last_unstale":"2024-05-20T17:53:12.599410+0000","last_undegraded":"2024-05-20T17:53:12.599410+0000","last_fullsized":"2024-05-20T17:53:12.599410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:54:01.281535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654387+0000","last_change":"2024-05-20T17:53:07.571300+0000","last_active":"2024-05-20T17:53:13.654387+0000","last_peered":"2024-05-20T17:53:13.654387+0000","last_clean":"2024-05-20T17:53:13.654387+0000","last_became_active":"2024-05-20T17:53:07.570991+0000","last_became_peered":"2024-05-20T17:53:07.570991+0000","last_unstale":"2024-05-20T17:53:13.654387+0000","last_undegraded":"2024-05-20T17:53:13.654387+0000","last_fullsized":"2024-05-20T17:53:13.654387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:51.199335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244361+0000","last_change":"2024-05-20T17:53:06.576427+0000","last_active":"2024-05-20T17:53:14.244361+0000","last_peered":"2024-05-20T17:53:14.244361+0000","last_clean":"2024-05-20T17:53:14.244361+0000","last_became_active":"2024-05-20T17:53:06.576041+0000","last_became_peered":"2024-05-20T17:53:06.576041+0000","last_unstale":"2024-05-20T17:53:14.244361+0000","last_undegraded":"2024-05-20T17:53:14.244361+0000","last_fullsized":"2024-05-20T17:53:14.244361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599381+0000","last_change":"2024-05-20T17:53:11.752114+0000","last_active":"2024-05-20T17:53:12.599381+0000","last_peered":"2024-05-20T17:53:12.599381+0000","last_clean":"2024-05-20T17:53:12.599381+0000","last_became_active":"2024-05-20T17:53:11.751659+0000","last_became_peered":"2024-05-20T17:53:11.751659+0000","last_unstale":"2024-05-20T17:53:12.599381+0000","last_undegraded":"2024-05-20T17:53:12.599381+0000","last_fullsized":"2024-05-20T17:53:12.599381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:33:17.210775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244151+0000","last_change":"2024-05-20T17:53:07.570656+0000","last_active":"2024-05-20T17:53:14.244151+0000","last_peered":"2024-05-20T17:53:14.244151+0000","last_clean":"2024-05-20T17:53:14.244151+0000","last_became_active":"2024-05-20T17:53:07.570296+0000","last_became_peered":"2024-05-20T17:53:07.570296+0000","last_unstale":"2024-05-20T17:53:14.244151+0000","last_undegraded":"2024-05-20T17:53:14.244151+0000","last_fullsized":"2024-05-20T17:53:14.244151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:12:35.547087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244993+0000","last_change":"2024-05-20T17:53:06.567626+0000","last_active":"2024-05-20T17:53:14.244993+0000","last_peered":"2024-05-20T17:53:14.244993+0000","last_clean":"2024-05-20T17:53:14.244993+0000","last_became_active":"2024-05-20T17:53:06.565665+0000","last_became_peered":"2024-05-20T17:53:06.565665+0000","last_unstale":"2024-05-20T17:53:14.244993+0000","last_undegraded":"2024-05-20T17:53:14.244993+0000","last_fullsized":"2024-05-20T17:53:14.244993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:13.293451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245434+0000","last_change":"2024-05-20T17:53:11.752662+0000","last_active":"2024-05-20T17:53:14.245434+0000","last_peered":"2024-05-20T17:53:14.245434+0000","last_clean":"2024-05-20T17:53:14.245434+0000","last_became_active":"2024-05-20T17:53:11.752188+0000","last_became_peered":"2024-05-20T17:53:11.752188+0000","last_unstale":"2024-05-20T17:53:14.245434+0000","last_undegraded":"2024-05-20T17:53:14.245434+0000","last_fullsized":"2024-05-20T17:53:14.245434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:41.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654449+0000","last_change":"2024-05-20T17:53:07.588530+0000","last_active":"2024-05-20T17:53:13.654449+0000","last_peered":"2024-05-20T17:53:13.654449+0000","last_clean":"2024-05-20T17:53:13.654449+0000","last_became_active":"2024-05-20T17:53:07.587985+0000","last_became_peered":"2024-05-20T17:53:07.587985+0000","last_unstale":"2024-05-20T17:53:13.654449+0000","last_undegraded":"2024-05-20T17:53:13.654449+0000","last_fullsized":"2024-05-20T17:53:13.654449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:17.229454+0000","last_change":"2024-05-20T17:53:06.574794+0000","last_active":"2024-05-20T17:53:17.229454+0000","last_peered":"2024-05-20T17:53:17.229454+0000","last_clean":"2024-05-20T17:53:17.229454+0000","last_became_active":"2024-05-20T17:53:06.574430+0000","last_became_peered":"2024-05-20T17:53:06.574430+0000","last_unstale":"2024-05-20T17:53:17.229454+0000","last_undegraded":"2024-05-20T17:53:17.229454+0000","last_fullsized":"2024-05-20T17:53:17.229454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244161+0000","last_change":"2024-05-20T17:53:11.620987+0000","last_active":"2024-05-20T17:53:14.244161+0000","last_peered":"2024-05-20T17:53:14.244161+0000","last_clean":"2024-05-20T17:53:14.244161+0000","last_became_active":"2024-05-20T17:53:11.620506+0000","last_became_peered":"2024-05-20T17:53:11.620506+0000","last_unstale":"2024-05-20T17:53:14.244161+0000","last_undegraded":"2024-05-20T17:53:14.244161+0000","last_fullsized":"2024-05-20T17:53:14.244161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:28.849402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599507+0000","last_change":"2024-05-20T17:53:07.565183+0000","last_active":"2024-05-20T17:53:12.599507+0000","last_peered":"2024-05-20T17:53:12.599507+0000","last_clean":"2024-05-20T17:53:12.599507+0000","last_became_active":"2024-05-20T17:53:07.564852+0000","last_became_peered":"2024-05-20T17:53:07.564852+0000","last_unstale":"2024-05-20T17:53:12.599507+0000","last_undegraded":"2024-05-20T17:53:12.599507+0000","last_fullsized":"2024-05-20T17:53:12.599507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:31.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244673+0000","last_change":"2024-05-20T17:53:06.574319+0000","last_active":"2024-05-20T17:53:14.244673+0000","last_peered":"2024-05-20T17:53:14.244673+0000","last_clean":"2024-05-20T17:53:14.244673+0000","last_became_active":"2024-05-20T17:53:06.573970+0000","last_became_peered":"2024-05-20T17:53:06.573970+0000","last_unstale":"2024-05-20T17:53:14.244673+0000","last_undegraded":"2024-05-20T17:53:14.244673+0000","last_fullsized":"2024-05-20T17:53:14.244673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:30.496240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599198+0000","last_change":"2024-05-20T17:53:11.616154+0000","last_active":"2024-05-20T17:53:12.599198+0000","last_peered":"2024-05-20T17:53:12.599198+0000","last_clean":"2024-05-20T17:53:12.599198+0000","last_became_active":"2024-05-20T17:53:11.614731+0000","last_became_peered":"2024-05-20T17:53:11.614731+0000","last_unstale":"2024-05-20T17:53:12.599198+0000","last_undegraded":"2024-05-20T17:53:12.599198+0000","last_fullsized":"2024-05-20T17:53:12.599198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:21.092223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243803+0000","last_change":"2024-05-20T17:53:07.573718+0000","last_active":"2024-05-20T17:53:14.243803+0000","last_peered":"2024-05-20T17:53:14.243803+0000","last_clean":"2024-05-20T17:53:14.243803+0000","last_became_active":"2024-05-20T17:53:07.573368+0000","last_became_peered":"2024-05-20T17:53:07.573368+0000","last_unstale":"2024-05-20T17:53:14.243803+0000","last_undegraded":"2024-05-20T17:53:14.243803+0000","last_fullsized":"2024-05-20T17:53:14.243803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244725+0000","last_change":"2024-05-20T17:53:06.572461+0000","last_active":"2024-05-20T17:53:14.244725+0000","last_peered":"2024-05-20T17:53:14.244725+0000","last_clean":"2024-05-20T17:53:14.244725+0000","last_became_active":"2024-05-20T17:53:06.572097+0000","last_became_peered":"2024-05-20T17:53:06.572097+0000","last_unstale":"2024-05-20T17:53:14.244725+0000","last_undegraded":"2024-05-20T17:53:14.244725+0000","last_fullsized":"2024-05-20T17:53:14.244725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597910+0000","last_change":"2024-05-20T17:53:11.612607+0000","last_active":"2024-05-20T17:53:12.597910+0000","last_peered":"2024-05-20T17:53:12.597910+0000","last_clean":"2024-05-20T17:53:12.597910+0000","last_became_active":"2024-05-20T17:53:11.612147+0000","last_became_peered":"2024-05-20T17:53:11.612147+0000","last_unstale":"2024-05-20T17:53:12.597910+0000","last_undegraded":"2024-05-20T17:53:12.597910+0000","last_fullsized":"2024-05-20T17:53:12.597910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:57.596450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244594+0000","last_change":"2024-05-20T17:53:07.565265+0000","last_active":"2024-05-20T17:53:14.244594+0000","last_peered":"2024-05-20T17:53:14.244594+0000","last_clean":"2024-05-20T17:53:14.244594+0000","last_became_active":"2024-05-20T17:53:07.564958+0000","last_became_peered":"2024-05-20T17:53:07.564958+0000","last_unstale":"2024-05-20T17:53:14.244594+0000","last_undegraded":"2024-05-20T17:53:14.244594+0000","last_fullsized":"2024-05-20T17:53:14.244594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244837+0000","last_change":"2024-05-20T17:53:06.575493+0000","last_active":"2024-05-20T17:53:14.244837+0000","last_peered":"2024-05-20T17:53:14.244837+0000","last_clean":"2024-05-20T17:53:14.244837+0000","last_became_active":"2024-05-20T17:53:06.575211+0000","last_became_peered":"2024-05-20T17:53:06.575211+0000","last_unstale":"2024-05-20T17:53:14.244837+0000","last_undegraded":"2024-05-20T17:53:14.244837+0000","last_fullsized":"2024-05-20T17:53:14.244837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599643+0000","last_change":"2024-05-20T17:53:11.755641+0000","last_active":"2024-05-20T17:53:12.599643+0000","last_peered":"2024-05-20T17:53:12.599643+0000","last_clean":"2024-05-20T17:53:12.599643+0000","last_became_active":"2024-05-20T17:53:11.755179+0000","last_became_peered":"2024-05-20T17:53:11.755179+0000","last_unstale":"2024-05-20T17:53:12.599643+0000","last_undegraded":"2024-05-20T17:53:12.599643+0000","last_fullsized":"2024-05-20T17:53:12.599643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:08.214732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243667+0000","last_change":"2024-05-20T17:53:11.755526+0000","last_active":"2024-05-20T17:53:14.243667+0000","last_peered":"2024-05-20T17:53:14.243667+0000","last_clean":"2024-05-20T17:53:14.243667+0000","last_became_active":"2024-05-20T17:53:11.755114+0000","last_became_peered":"2024-05-20T17:53:11.755114+0000","last_unstale":"2024-05-20T17:53:14.243667+0000","last_undegraded":"2024-05-20T17:53:14.243667+0000","last_fullsized":"2024-05-20T17:53:14.243667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:02.595103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243648+0000","last_change":"2024-05-20T17:53:07.589463+0000","last_active":"2024-05-20T17:53:14.243648+0000","last_peered":"2024-05-20T17:53:14.243648+0000","last_clean":"2024-05-20T17:53:14.243648+0000","last_became_active":"2024-05-20T17:53:07.589109+0000","last_became_peered":"2024-05-20T17:53:07.589109+0000","last_unstale":"2024-05-20T17:53:14.243648+0000","last_undegraded":"2024-05-20T17:53:14.243648+0000","last_fullsized":"2024-05-20T17:53:14.243648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243937+0000","last_change":"2024-05-20T17:53:06.573947+0000","last_active":"2024-05-20T17:53:14.243937+0000","last_peered":"2024-05-20T17:53:14.243937+0000","last_clean":"2024-05-20T17:53:14.243937+0000","last_became_active":"2024-05-20T17:53:06.572617+0000","last_became_peered":"2024-05-20T17:53:06.572617+0000","last_unstale":"2024-05-20T17:53:14.243937+0000","last_undegraded":"2024-05-20T17:53:14.243937+0000","last_fullsized":"2024-05-20T17:53:14.243937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244417+0000","last_change":"2024-05-20T17:53:11.617273+0000","last_active":"2024-05-20T17:53:14.244417+0000","last_peered":"2024-05-20T17:53:14.244417+0000","last_clean":"2024-05-20T17:53:14.244417+0000","last_became_active":"2024-05-20T17:53:11.616538+0000","last_became_peered":"2024-05-20T17:53:11.616538+0000","last_unstale":"2024-05-20T17:53:14.244417+0000","last_undegraded":"2024-05-20T17:53:14.244417+0000","last_fullsized":"2024-05-20T17:53:14.244417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:44.269036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597869+0000","last_change":"2024-05-20T17:53:07.585370+0000","last_active":"2024-05-20T17:53:12.597869+0000","last_peered":"2024-05-20T17:53:12.597869+0000","last_clean":"2024-05-20T17:53:12.597869+0000","last_became_active":"2024-05-20T17:53:07.584558+0000","last_became_peered":"2024-05-20T17:53:07.584558+0000","last_unstale":"2024-05-20T17:53:12.597869+0000","last_undegraded":"2024-05-20T17:53:12.597869+0000","last_fullsized":"2024-05-20T17:53:12.597869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598324+0000","last_change":"2024-05-20T17:53:06.575726+0000","last_active":"2024-05-20T17:53:12.598324+0000","last_peered":"2024-05-20T17:53:12.598324+0000","last_clean":"2024-05-20T17:53:12.598324+0000","last_became_active":"2024-05-20T17:53:06.575405+0000","last_became_peered":"2024-05-20T17:53:06.575405+0000","last_unstale":"2024-05-20T17:53:12.598324+0000","last_undegraded":"2024-05-20T17:53:12.598324+0000","last_fullsized":"2024-05-20T17:53:12.598324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244557+0000","last_change":"2024-05-20T17:53:06.570392+0000","last_active":"2024-05-20T17:53:14.244557+0000","last_peered":"2024-05-20T17:53:14.244557+0000","last_clean":"2024-05-20T17:53:14.244557+0000","last_became_active":"2024-05-20T17:53:06.569729+0000","last_became_peered":"2024-05-20T17:53:06.569729+0000","last_unstale":"2024-05-20T17:53:14.244557+0000","last_undegraded":"2024-05-20T17:53:14.244557+0000","last_fullsized":"2024-05-20T17:53:14.244557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244969+0000","last_change":"2024-05-20T17:53:07.563453+0000","last_active":"2024-05-20T17:53:14.244969+0000","last_peered":"2024-05-20T17:53:14.244969+0000","last_clean":"2024-05-20T17:53:14.244969+0000","last_became_active":"2024-05-20T17:53:07.563081+0000","last_became_peered":"2024-05-20T17:53:07.563081+0000","last_unstale":"2024-05-20T17:53:14.244969+0000","last_undegraded":"2024-05-20T17:53:14.244969+0000","last_fullsized":"2024-05-20T17:53:14.244969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598694+0000","last_change":"2024-05-20T17:53:11.615867+0000","last_active":"2024-05-20T17:53:12.598694+0000","last_peered":"2024-05-20T17:53:12.598694+0000","last_clean":"2024-05-20T17:53:12.598694+0000","last_became_active":"2024-05-20T17:53:11.615414+0000","last_became_peered":"2024-05-20T17:53:11.615414+0000","last_unstale":"2024-05-20T17:53:12.598694+0000","last_undegraded":"2024-05-20T17:53:12.598694+0000","last_fullsized":"2024-05-20T17:53:12.598694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:26.374404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598758+0000","last_change":"2024-05-20T17:53:06.566530+0000","last_active":"2024-05-20T17:53:12.598758+0000","last_peered":"2024-05-20T17:53:12.598758+0000","last_clean":"2024-05-20T17:53:12.598758+0000","last_became_active":"2024-05-20T17:53:06.566164+0000","last_became_peered":"2024-05-20T17:53:06.566164+0000","last_unstale":"2024-05-20T17:53:12.598758+0000","last_undegraded":"2024-05-20T17:53:12.598758+0000","last_fullsized":"2024-05-20T17:53:12.598758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:22:58.179989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598733+0000","last_change":"2024-05-20T17:53:07.566366+0000","last_active":"2024-05-20T17:53:12.598733+0000","last_peered":"2024-05-20T17:53:12.598733+0000","last_clean":"2024-05-20T17:53:12.598733+0000","last_became_active":"2024-05-20T17:53:07.564572+0000","last_became_peered":"2024-05-20T17:53:07.564572+0000","last_unstale":"2024-05-20T17:53:12.598733+0000","last_undegraded":"2024-05-20T17:53:12.598733+0000","last_fullsized":"2024-05-20T17:53:12.598733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:07.981032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599855+0000","last_change":"2024-05-20T17:53:11.611213+0000","last_active":"2024-05-20T17:53:12.599855+0000","last_peered":"2024-05-20T17:53:12.599855+0000","last_clean":"2024-05-20T17:53:12.599855+0000","last_became_active":"2024-05-20T17:53:11.610761+0000","last_became_peered":"2024-05-20T17:53:11.610761+0000","last_unstale":"2024-05-20T17:53:12.599855+0000","last_undegraded":"2024-05-20T17:53:12.599855+0000","last_fullsized":"2024-05-20T17:53:12.599855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:10.351145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243764+0000","last_change":"2024-05-20T17:53:07.571745+0000","last_active":"2024-05-20T17:53:14.243764+0000","last_peered":"2024-05-20T17:53:14.243764+0000","last_clean":"2024-05-20T17:53:14.243764+0000","last_became_active":"2024-05-20T17:53:07.571440+0000","last_became_peered":"2024-05-20T17:53:07.571440+0000","last_unstale":"2024-05-20T17:53:14.243764+0000","last_undegraded":"2024-05-20T17:53:14.243764+0000","last_fullsized":"2024-05-20T17:53:14.243764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:50.625084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598579+0000","last_change":"2024-05-20T17:53:07.578996+0000","last_active":"2024-05-20T17:53:12.598579+0000","last_peered":"2024-05-20T17:53:12.598579+0000","last_clean":"2024-05-20T17:53:12.598579+0000","last_became_active":"2024-05-20T17:53:07.578650+0000","last_became_peered":"2024-05-20T17:53:07.578650+0000","last_unstale":"2024-05-20T17:53:12.598579+0000","last_undegraded":"2024-05-20T17:53:12.598579+0000","last_fullsized":"2024-05-20T17:53:12.598579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:26.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244224+0000","last_change":"2024-05-20T17:53:07.585434+0000","last_active":"2024-05-20T17:53:14.244224+0000","last_peered":"2024-05-20T17:53:14.244224+0000","last_clean":"2024-05-20T17:53:14.244224+0000","last_became_active":"2024-05-20T17:53:07.584703+0000","last_became_peered":"2024-05-20T17:53:07.584703+0000","last_unstale":"2024-05-20T17:53:14.244224+0000","last_undegraded":"2024-05-20T17:53:14.244224+0000","last_fullsized":"2024-05-20T17:53:14.244224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:45.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244874+0000","last_change":"2024-05-20T17:53:07.587018+0000","last_active":"2024-05-20T17:53:14.244874+0000","last_peered":"2024-05-20T17:53:14.244874+0000","last_clean":"2024-05-20T17:53:14.244874+0000","last_became_active":"2024-05-20T17:53:07.586608+0000","last_became_peered":"2024-05-20T17:53:07.586608+0000","last_unstale":"2024-05-20T17:53:14.244874+0000","last_undegraded":"2024-05-20T17:53:14.244874+0000","last_fullsized":"2024-05-20T17:53:14.244874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599158+0000","last_change":"2024-05-20T17:53:07.588014+0000","last_active":"2024-05-20T17:53:12.599158+0000","last_peered":"2024-05-20T17:53:12.599158+0000","last_clean":"2024-05-20T17:53:12.599158+0000","last_became_active":"2024-05-20T17:53:07.587708+0000","last_became_peered":"2024-05-20T17:53:07.587708+0000","last_unstale":"2024-05-20T17:53:12.599158+0000","last_undegraded":"2024-05-20T17:53:12.599158+0000","last_fullsized":"2024-05-20T17:53:12.599158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244467+0000","last_change":"2024-05-20T17:53:07.588057+0000","last_active":"2024-05-20T17:53:14.244467+0000","last_peered":"2024-05-20T17:53:14.244467+0000","last_clean":"2024-05-20T17:53:14.244467+0000","last_became_active":"2024-05-20T17:53:07.587720+0000","last_became_peered":"2024-05-20T17:53:07.587720+0000","last_unstale":"2024-05-20T17:53:14.244467+0000","last_undegraded":"2024-05-20T17:53:14.244467+0000","last_fullsized":"2024-05-20T17:53:14.244467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244725+0000","last_change":"2024-05-20T17:53:07.572982+0000","last_active":"2024-05-20T17:53:14.244725+0000","last_peered":"2024-05-20T17:53:14.244725+0000","last_clean":"2024-05-20T17:53:14.244725+0000","last_became_active":"2024-05-20T17:53:07.572341+0000","last_became_peered":"2024-05-20T17:53:07.572341+0000","last_unstale":"2024-05-20T17:53:14.244725+0000","last_undegraded":"2024-05-20T17:53:14.244725+0000","last_fullsized":"2024-05-20T17:53:14.244725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599485+0000","last_change":"2024-05-20T17:53:07.586892+0000","last_active":"2024-05-20T17:53:12.599485+0000","last_peered":"2024-05-20T17:53:12.599485+0000","last_clean":"2024-05-20T17:53:12.599485+0000","last_became_active":"2024-05-20T17:53:07.586592+0000","last_became_peered":"2024-05-20T17:53:07.586592+0000","last_unstale":"2024-05-20T17:53:12.599485+0000","last_undegraded":"2024-05-20T17:53:12.599485+0000","last_fullsized":"2024-05-20T17:53:12.599485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243849+0000","last_change":"2024-05-20T17:53:07.585135+0000","last_active":"2024-05-20T17:53:14.243849+0000","last_peered":"2024-05-20T17:53:14.243849+0000","last_clean":"2024-05-20T17:53:14.243849+0000","last_became_active":"2024-05-20T17:53:07.584770+0000","last_became_peered":"2024-05-20T17:53:07.584770+0000","last_unstale":"2024-05-20T17:53:14.243849+0000","last_undegraded":"2024-05-20T17:53:14.243849+0000","last_fullsized":"2024-05-20T17:53:14.243849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598173+0000","last_change":"2024-05-20T17:53:07.587589+0000","last_active":"2024-05-20T17:53:12.598173+0000","last_peered":"2024-05-20T17:53:12.598173+0000","last_clean":"2024-05-20T17:53:12.598173+0000","last_became_active":"2024-05-20T17:53:07.587199+0000","last_became_peered":"2024-05-20T17:53:07.587199+0000","last_unstale":"2024-05-20T17:53:12.598173+0000","last_undegraded":"2024-05-20T17:53:12.598173+0000","last_fullsized":"2024-05-20T17:53:12.598173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244099+0000","last_change":"2024-05-20T17:53:07.564879+0000","last_active":"2024-05-20T17:53:14.244099+0000","last_peered":"2024-05-20T17:53:14.244099+0000","last_clean":"2024-05-20T17:53:14.244099+0000","last_became_active":"2024-05-20T17:53:07.564533+0000","last_became_peered":"2024-05-20T17:53:07.564533+0000","last_unstale":"2024-05-20T17:53:14.244099+0000","last_undegraded":"2024-05-20T17:53:14.244099+0000","last_fullsized":"2024-05-20T17:53:14.244099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:40.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244554+0000","last_change":"2024-05-20T17:53:07.573683+0000","last_active":"2024-05-20T17:53:14.244554+0000","last_peered":"2024-05-20T17:53:14.244554+0000","last_clean":"2024-05-20T17:53:14.244554+0000","last_became_active":"2024-05-20T17:53:07.571046+0000","last_became_peered":"2024-05-20T17:53:07.571046+0000","last_unstale":"2024-05-20T17:53:14.244554+0000","last_undegraded":"2024-05-20T17:53:14.244554+0000","last_fullsized":"2024-05-20T17:53:14.244554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244334+0000","last_change":"2024-05-20T17:53:07.574629+0000","last_active":"2024-05-20T17:53:14.244334+0000","last_peered":"2024-05-20T17:53:14.244334+0000","last_clean":"2024-05-20T17:53:14.244334+0000","last_became_active":"2024-05-20T17:53:07.574286+0000","last_became_peered":"2024-05-20T17:53:07.574286+0000","last_unstale":"2024-05-20T17:53:14.244334+0000","last_undegraded":"2024-05-20T17:53:14.244334+0000","last_fullsized":"2024-05-20T17:53:14.244334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654699+0000","last_change":"2024-05-20T17:53:07.575422+0000","last_active":"2024-05-20T17:53:13.654699+0000","last_peered":"2024-05-20T17:53:13.654699+0000","last_clean":"2024-05-20T17:53:13.654699+0000","last_became_active":"2024-05-20T17:53:07.575017+0000","last_became_peered":"2024-05-20T17:53:07.575017+0000","last_unstale":"2024-05-20T17:53:13.654699+0000","last_undegraded":"2024-05-20T17:53:13.654699+0000","last_fullsized":"2024-05-20T17:53:13.654699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:45.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599534+0000","last_change":"2024-05-20T17:53:07.568400+0000","last_active":"2024-05-20T17:53:12.599534+0000","last_peered":"2024-05-20T17:53:12.599534+0000","last_clean":"2024-05-20T17:53:12.599534+0000","last_became_active":"2024-05-20T17:53:07.568013+0000","last_became_peered":"2024-05-20T17:53:07.568013+0000","last_unstale":"2024-05-20T17:53:12.599534+0000","last_undegraded":"2024-05-20T17:53:12.599534+0000","last_fullsized":"2024-05-20T17:53:12.599534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:31.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245277+0000","last_change":"2024-05-20T17:53:07.564289+0000","last_active":"2024-05-20T17:53:14.245277+0000","last_peered":"2024-05-20T17:53:14.245277+0000","last_clean":"2024-05-20T17:53:14.245277+0000","last_became_active":"2024-05-20T17:53:07.563973+0000","last_became_peered":"2024-05-20T17:53:07.563973+0000","last_unstale":"2024-05-20T17:53:14.245277+0000","last_undegraded":"2024-05-20T17:53:14.245277+0000","last_fullsized":"2024-05-20T17:53:14.245277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243731+0000","last_change":"2024-05-20T17:53:07.560898+0000","last_active":"2024-05-20T17:53:14.243731+0000","last_peered":"2024-05-20T17:53:14.243731+0000","last_clean":"2024-05-20T17:53:14.243731+0000","last_became_active":"2024-05-20T17:53:07.560518+0000","last_became_peered":"2024-05-20T17:53:07.560518+0000","last_unstale":"2024-05-20T17:53:14.243731+0000","last_undegraded":"2024-05-20T17:53:14.243731+0000","last_fullsized":"2024-05-20T17:53:14.243731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243753+0000","last_change":"2024-05-20T17:53:07.569983+0000","last_active":"2024-05-20T17:53:14.243753+0000","last_peered":"2024-05-20T17:53:14.243753+0000","last_clean":"2024-05-20T17:53:14.243753+0000","last_became_active":"2024-05-20T17:53:07.569663+0000","last_became_peered":"2024-05-20T17:53:07.569663+0000","last_unstale":"2024-05-20T17:53:14.243753+0000","last_undegraded":"2024-05-20T17:53:14.243753+0000","last_fullsized":"2024-05-20T17:53:14.243753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244095+0000","last_change":"2024-05-20T17:53:07.566018+0000","last_active":"2024-05-20T17:53:14.244095+0000","last_peered":"2024-05-20T17:53:14.244095+0000","last_clean":"2024-05-20T17:53:14.244095+0000","last_became_active":"2024-05-20T17:53:07.565527+0000","last_became_peered":"2024-05-20T17:53:07.565527+0000","last_unstale":"2024-05-20T17:53:14.244095+0000","last_undegraded":"2024-05-20T17:53:14.244095+0000","last_fullsized":"2024-05-20T17:53:14.244095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:21:17.680092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598017+0000","last_change":"2024-05-20T17:53:07.585449+0000","last_active":"2024-05-20T17:53:12.598017+0000","last_peered":"2024-05-20T17:53:12.598017+0000","last_clean":"2024-05-20T17:53:12.598017+0000","last_became_active":"2024-05-20T17:53:07.585089+0000","last_became_peered":"2024-05-20T17:53:07.585089+0000","last_unstale":"2024-05-20T17:53:12.598017+0000","last_undegraded":"2024-05-20T17:53:12.598017+0000","last_fullsized":"2024-05-20T17:53:12.598017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598876+0000","last_change":"2024-05-20T17:53:07.567630+0000","last_active":"2024-05-20T17:53:12.598876+0000","last_peered":"2024-05-20T17:53:12.598876+0000","last_clean":"2024-05-20T17:53:12.598876+0000","last_became_active":"2024-05-20T17:53:07.565841+0000","last_became_peered":"2024-05-20T17:53:07.565841+0000","last_unstale":"2024-05-20T17:53:12.598876+0000","last_undegraded":"2024-05-20T17:53:12.598876+0000","last_fullsized":"2024-05-20T17:53:12.598876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:28.255939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244959+0000","last_change":"2024-05-20T17:53:07.577572+0000","last_active":"2024-05-20T17:53:14.244959+0000","last_peered":"2024-05-20T17:53:14.244959+0000","last_clean":"2024-05-20T17:53:14.244959+0000","last_became_active":"2024-05-20T17:53:07.577248+0000","last_became_peered":"2024-05-20T17:53:07.577248+0000","last_unstale":"2024-05-20T17:53:14.244959+0000","last_undegraded":"2024-05-20T17:53:14.244959+0000","last_fullsized":"2024-05-20T17:53:14.244959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244594+0000","last_change":"2024-05-20T17:53:07.580278+0000","last_active":"2024-05-20T17:53:14.244594+0000","last_peered":"2024-05-20T17:53:14.244594+0000","last_clean":"2024-05-20T17:53:14.244594+0000","last_became_active":"2024-05-20T17:53:07.579918+0000","last_became_peered":"2024-05-20T17:53:07.579918+0000","last_unstale":"2024-05-20T17:53:14.244594+0000","last_undegraded":"2024-05-20T17:53:14.244594+0000","last_fullsized":"2024-05-20T17:53:14.244594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654876+0000","last_change":"2024-05-20T17:53:07.571649+0000","last_active":"2024-05-20T17:53:13.654876+0000","last_peered":"2024-05-20T17:53:13.654876+0000","last_clean":"2024-05-20T17:53:13.654876+0000","last_became_active":"2024-05-20T17:53:07.570372+0000","last_became_peered":"2024-05-20T17:53:07.570372+0000","last_unstale":"2024-05-20T17:53:13.654876+0000","last_undegraded":"2024-05-20T17:53:13.654876+0000","last_fullsized":"2024-05-20T17:53:13.654876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597720+0000","last_change":"2024-05-20T17:53:07.584911+0000","last_active":"2024-05-20T17:53:12.597720+0000","last_peered":"2024-05-20T17:53:12.597720+0000","last_clean":"2024-05-20T17:53:12.597720+0000","last_became_active":"2024-05-20T17:53:07.584544+0000","last_became_peered":"2024-05-20T17:53:07.584544+0000","last_unstale":"2024-05-20T17:53:12.597720+0000","last_undegraded":"2024-05-20T17:53:12.597720+0000","last_fullsized":"2024-05-20T17:53:12.597720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654120+0000","last_change":"2024-05-20T17:53:07.580955+0000","last_active":"2024-05-20T17:53:13.654120+0000","last_peered":"2024-05-20T17:53:13.654120+0000","last_clean":"2024-05-20T17:53:13.654120+0000","last_became_active":"2024-05-20T17:53:07.580587+0000","last_became_peered":"2024-05-20T17:53:07.580587+0000","last_unstale":"2024-05-20T17:53:13.654120+0000","last_undegraded":"2024-05-20T17:53:13.654120+0000","last_fullsized":"2024-05-20T17:53:13.654120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:40.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243911+0000","last_change":"2024-05-20T17:53:07.570792+0000","last_active":"2024-05-20T17:53:14.243911+0000","last_peered":"2024-05-20T17:53:14.243911+0000","last_clean":"2024-05-20T17:53:14.243911+0000","last_became_active":"2024-05-20T17:53:07.570501+0000","last_became_peered":"2024-05-20T17:53:07.570501+0000","last_unstale":"2024-05-20T17:53:14.243911+0000","last_undegraded":"2024-05-20T17:53:14.243911+0000","last_fullsized":"2024-05-20T17:53:14.243911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654229+0000","last_change":"2024-05-20T17:53:07.573875+0000","last_active":"2024-05-20T17:53:13.654229+0000","last_peered":"2024-05-20T17:53:13.654229+0000","last_clean":"2024-05-20T17:53:13.654229+0000","last_became_active":"2024-05-20T17:53:07.573520+0000","last_became_peered":"2024-05-20T17:53:07.573520+0000","last_unstale":"2024-05-20T17:53:13.654229+0000","last_undegraded":"2024-05-20T17:53:13.654229+0000","last_fullsized":"2024-05-20T17:53:13.654229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:24.809917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244998+0000","last_change":"2024-05-20T17:53:07.588340+0000","last_active":"2024-05-20T17:53:14.244998+0000","last_peered":"2024-05-20T17:53:14.244998+0000","last_clean":"2024-05-20T17:53:14.244998+0000","last_became_active":"2024-05-20T17:53:07.588012+0000","last_became_peered":"2024-05-20T17:53:07.588012+0000","last_unstale":"2024-05-20T17:53:14.244998+0000","last_undegraded":"2024-05-20T17:53:14.244998+0000","last_fullsized":"2024-05-20T17:53:14.244998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:17.052738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244499+0000","last_change":"2024-05-20T17:53:07.570831+0000","last_active":"2024-05-20T17:53:14.244499+0000","last_peered":"2024-05-20T17:53:14.244499+0000","last_clean":"2024-05-20T17:53:14.244499+0000","last_became_active":"2024-05-20T17:53:07.570499+0000","last_became_peered":"2024-05-20T17:53:07.570499+0000","last_unstale":"2024-05-20T17:53:14.244499+0000","last_undegraded":"2024-05-20T17:53:14.244499+0000","last_fullsized":"2024-05-20T17:53:14.244499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:50.625084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245012+0000","last_change":"2024-05-20T17:53:07.580456+0000","last_active":"2024-05-20T17:53:14.245012+0000","last_peered":"2024-05-20T17:53:14.245012+0000","last_clean":"2024-05-20T17:53:14.245012+0000","last_became_active":"2024-05-20T17:53:07.580093+0000","last_became_peered":"2024-05-20T17:53:07.580093+0000","last_unstale":"2024-05-20T17:53:14.245012+0000","last_undegraded":"2024-05-20T17:53:14.245012+0000","last_fullsized":"2024-05-20T17:53:14.245012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654731+0000","last_change":"2024-05-20T17:53:07.571268+0000","last_active":"2024-05-20T17:53:13.654731+0000","last_peered":"2024-05-20T17:53:13.654731+0000","last_clean":"2024-05-20T17:53:13.654731+0000","last_became_active":"2024-05-20T17:53:07.570549+0000","last_became_peered":"2024-05-20T17:53:07.570549+0000","last_unstale":"2024-05-20T17:53:13.654731+0000","last_undegraded":"2024-05-20T17:53:13.654731+0000","last_fullsized":"2024-05-20T17:53:13.654731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:53:35.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:53:35.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:53:35.515 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:53:35.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.587+0000 7fac94bfe640 1 Processor -- start 2024-05-20T17:53:35.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.588+0000 7fac94bfe640 1 -- start start 2024-05-20T17:53:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.589+0000 7fac94bfe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 0x7fac900d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.589+0000 7fac94bfe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fac900d14b0 0x7fac900d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.589+0000 7fac94bfe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac900d0370 con 0x7fac90163a10 2024-05-20T17:53:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.589+0000 7fac94bfe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fac900d3ca0 con 0x7fac900d14b0 2024-05-20T17:53:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.589+0000 7fac94bfe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac900d0650 con 0x7fac900b4010 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.589+0000 7fac8e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac90163a10 0x7fac900cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39732/0 (socket says 172.21.15.6:39732) 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.589+0000 7fac8e59c640 1 -- 172.21.15.6:0/2157881686 learned_addr learned my addr 172.21.15.6:0/2157881686 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.589+0000 7fac8ed9d640 1 --2- 172.21.15.6:0/2157881686 >> v2:172.21.15.171:3300/0 conn(0x7fac900d14b0 0x7fac900d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.590+0000 7fac8dd9b640 1 --2- 172.21.15.6:0/2157881686 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 0x7fac900d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.590+0000 7fac8d59a640 1 -- 172.21.15.6:0/2157881686 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628721865 0 0) 0x7fac900d0370 con 0x7fac90163a10 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.590+0000 7fac8d59a640 1 -- 172.21.15.6:0/2157881686 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac78003520 con 0x7fac90163a10 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.590+0000 7fac8ed9d640 1 -- 172.21.15.6:0/2157881686 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 msgr2=0x7fac900d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.590+0000 7fac8ed9d640 1 --2- 172.21.15.6:0/2157881686 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 0x7fac900d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.590+0000 7fac8ed9d640 1 -- 172.21.15.6:0/2157881686 >> v1:172.21.15.6:6789/0 conn(0x7fac90163a10 legacy=0x7fac900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.590+0000 7fac8ed9d640 1 -- 172.21.15.6:0/2157881686 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac900d3650 con 0x7fac900d14b0 2024-05-20T17:53:35.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.591+0000 7fac8ed9d640 1 --2- 172.21.15.6:0/2157881686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac900d14b0 0x7fac900d18c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac88009d90 tx=0x7fac8802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a7703b56d4f4c8a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.591+0000 7fac8d59a640 1 -- 172.21.15.6:0/2157881686 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88007740 con 0x7fac900d14b0 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.591+0000 7fac8d59a640 1 -- 172.21.15.6:0/2157881686 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac880078e0 con 0x7fac900d14b0 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.591+0000 7fac8d59a640 1 -- 172.21.15.6:0/2157881686 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88007cb0 con 0x7fac900d14b0 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.592+0000 7fac94bfe640 1 -- 172.21.15.6:0/2157881686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac900d14b0 msgr2=0x7fac900d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.592+0000 7fac94bfe640 1 --2- 172.21.15.6:0/2157881686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac900d14b0 0x7fac900d18c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac88009d90 tx=0x7fac8802a660 comp rx=0 tx=0).stop 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.592+0000 7fac94bfe640 1 -- 172.21.15.6:0/2157881686 shutdown_connections 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.592+0000 7fac94bfe640 1 --2- 172.21.15.6:0/2157881686 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 0x7fac900d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.592+0000 7fac94bfe640 1 --2- 172.21.15.6:0/2157881686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac900d14b0 0x7fac900d18c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.592+0000 7fac94bfe640 1 -- 172.21.15.6:0/2157881686 >> 172.21.15.6:0/2157881686 conn(0x7fac9006d240 msgr2=0x7fac9006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.592+0000 7fac94bfe640 1 -- 172.21.15.6:0/2157881686 shutdown_connections 2024-05-20T17:53:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.592+0000 7fac94bfe640 1 -- 172.21.15.6:0/2157881686 wait complete. 2024-05-20T17:53:35.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.594+0000 7fac94bfe640 1 Processor -- start 2024-05-20T17:53:35.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.594+0000 7fac94bfe640 1 -- start start 2024-05-20T17:53:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.595+0000 7fac94bfe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 0x7fac9014c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.595+0000 7fac94bfe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac900d14b0 0x7fac9014aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.595+0000 7fac94bfe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac90163a10 0x7fac900ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.595+0000 7fac94bfe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac900b8210 con 0x7fac900d14b0 2024-05-20T17:53:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac94bfe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fac900d1e00 con 0x7fac90163a10 2024-05-20T17:53:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac94bfe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac900b8390 con 0x7fac900b4010 2024-05-20T17:53:35.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac900d14b0 0x7fac9014aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac900d14b0 0x7fac9014aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46654/0 (socket says 172.21.15.6:46654) 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 -- 172.21.15.6:0/1316416957 learned_addr learned my addr 172.21.15.6:0/1316416957 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8e59c640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 0x7fac9014c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8ed9d640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac90163a10 0x7fac900ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 -- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 msgr2=0x7fac9014c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 0x7fac9014c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 -- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac90163a10 msgr2=0x7fac900ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac90163a10 0x7fac900ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 -- 172.21.15.6:0/1316416957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9014afd0 con 0x7fac900d14b0 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac8dd9b640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac900d14b0 0x7fac9014aa90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac8400e870 tx=0x7fac8400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac7effd640 1 -- 172.21.15.6:0/1316416957 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84017070 con 0x7fac900d14b0 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9014b450 con 0x7fac900d14b0 2024-05-20T17:53:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac7effd640 1 -- 172.21.15.6:0/1316416957 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8400c940 con 0x7fac900d14b0 2024-05-20T17:53:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.596+0000 7fac7effd640 1 -- 172.21.15.6:0/1316416957 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8400cd30 con 0x7fac900d14b0 2024-05-20T17:53:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.597+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac9014ba10 con 0x7fac900d14b0 2024-05-20T17:53:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.598+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac9014b1a0 con 0x7fac900d14b0 2024-05-20T17:53:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.599+0000 7fac7effd640 1 -- 172.21.15.6:0/1316416957 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac8401a070 con 0x7fac900d14b0 2024-05-20T17:53:35.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.599+0000 7fac7effd640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac7006be30 0x7fac7006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.599+0000 7fac7effd640 1 -- 172.21.15.6:0/1316416957 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fac8408b3c0 con 0x7fac900d14b0 2024-05-20T17:53:35.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.600+0000 7fac8e59c640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac7006be30 0x7fac7006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.600+0000 7fac8e59c640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac7006be30 0x7fac7006e340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac80005880 tx=0x7fac80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.604+0000 7fac7effd640 1 -- 172.21.15.6:0/1316416957 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fac84059360 con 0x7fac900d14b0 2024-05-20T17:53:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.791+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac90075b00 con 0x7fac7006be30 2024-05-20T17:53:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.800+0000 7fac7effd640 1 -- 172.21.15.6:0/1316416957 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7fac90075b00 con 0x7fac7006be30 2024-05-20T17:53:35.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:35.804 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:53:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac7006be30 msgr2=0x7fac7006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac7006be30 0x7fac7006e340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac80005880 tx=0x7fac80009040 comp rx=0 tx=0).stop 2024-05-20T17:53:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac900d14b0 msgr2=0x7fac9014aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac900d14b0 0x7fac9014aa90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac8400e870 tx=0x7fac8400ed30 comp rx=0 tx=0).stop 2024-05-20T17:53:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 shutdown_connections 2024-05-20T17:53:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac7006be30 0x7fac7006e340 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac90163a10 0x7fac900ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac900d14b0 0x7fac9014aa90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.803+0000 7fac94bfe640 1 --2- 172.21.15.6:0/1316416957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac900b4010 0x7fac9014c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.804+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 >> 172.21.15.6:0/1316416957 conn(0x7fac9006d240 msgr2=0x7fac900d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.804+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 shutdown_connections 2024-05-20T17:53:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.804+0000 7fac94bfe640 1 -- 172.21.15.6:0/1316416957 wait complete. 2024-05-20T17:53:35.815 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-05-20T17:53:34.237344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219360,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755360,"statfs":{"total":773094113280,"available":772869488640,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003350"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244003+0000","last_change":"2024-05-20T17:53:06.574155+0000","last_active":"2024-05-20T17:53:14.244003+0000","last_peered":"2024-05-20T17:53:14.244003+0000","last_clean":"2024-05-20T17:53:14.244003+0000","last_became_active":"2024-05-20T17:53:06.573561+0000","last_became_peered":"2024-05-20T17:53:06.573561+0000","last_unstale":"2024-05-20T17:53:14.244003+0000","last_undegraded":"2024-05-20T17:53:14.244003+0000","last_fullsized":"2024-05-20T17:53:14.244003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:22:58.179989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598752+0000","last_change":"2024-05-20T17:53:07.588500+0000","last_active":"2024-05-20T17:53:12.598752+0000","last_peered":"2024-05-20T17:53:12.598752+0000","last_clean":"2024-05-20T17:53:12.598752+0000","last_became_active":"2024-05-20T17:53:07.588137+0000","last_became_peered":"2024-05-20T17:53:07.588137+0000","last_unstale":"2024-05-20T17:53:12.598752+0000","last_undegraded":"2024-05-20T17:53:12.598752+0000","last_fullsized":"2024-05-20T17:53:12.598752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597759+0000","last_change":"2024-05-20T17:53:11.755635+0000","last_active":"2024-05-20T17:53:12.597759+0000","last_peered":"2024-05-20T17:53:12.597759+0000","last_clean":"2024-05-20T17:53:12.597759+0000","last_became_active":"2024-05-20T17:53:11.755186+0000","last_became_peered":"2024-05-20T17:53:11.755186+0000","last_unstale":"2024-05-20T17:53:12.597759+0000","last_undegraded":"2024-05-20T17:53:12.597759+0000","last_fullsized":"2024-05-20T17:53:12.597759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:41.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599124+0000","last_change":"2024-05-20T17:53:06.565749+0000","last_active":"2024-05-20T17:53:12.599124+0000","last_peered":"2024-05-20T17:53:12.599124+0000","last_clean":"2024-05-20T17:53:12.599124+0000","last_became_active":"2024-05-20T17:53:06.565249+0000","last_became_peered":"2024-05-20T17:53:06.565249+0000","last_unstale":"2024-05-20T17:53:12.599124+0000","last_undegraded":"2024-05-20T17:53:12.599124+0000","last_fullsized":"2024-05-20T17:53:12.599124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243589+0000","last_change":"2024-05-20T17:53:07.573440+0000","last_active":"2024-05-20T17:53:14.243589+0000","last_peered":"2024-05-20T17:53:14.243589+0000","last_clean":"2024-05-20T17:53:14.243589+0000","last_became_active":"2024-05-20T17:53:07.572075+0000","last_became_peered":"2024-05-20T17:53:07.572075+0000","last_unstale":"2024-05-20T17:53:14.243589+0000","last_undegraded":"2024-05-20T17:53:14.243589+0000","last_fullsized":"2024-05-20T17:53:14.243589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598429+0000","last_change":"2024-05-20T17:53:11.615875+0000","last_active":"2024-05-20T17:53:12.598429+0000","last_peered":"2024-05-20T17:53:12.598429+0000","last_clean":"2024-05-20T17:53:12.598429+0000","last_became_active":"2024-05-20T17:53:11.614378+0000","last_became_peered":"2024-05-20T17:53:11.614378+0000","last_unstale":"2024-05-20T17:53:12.598429+0000","last_undegraded":"2024-05-20T17:53:12.598429+0000","last_fullsized":"2024-05-20T17:53:12.598429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:44.041188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654652+0000","last_change":"2024-05-20T17:53:06.577931+0000","last_active":"2024-05-20T17:53:13.654652+0000","last_peered":"2024-05-20T17:53:13.654652+0000","last_clean":"2024-05-20T17:53:13.654652+0000","last_became_active":"2024-05-20T17:53:06.577611+0000","last_became_peered":"2024-05-20T17:53:06.577611+0000","last_unstale":"2024-05-20T17:53:13.654652+0000","last_undegraded":"2024-05-20T17:53:13.654652+0000","last_fullsized":"2024-05-20T17:53:13.654652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:30.496240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245106+0000","last_change":"2024-05-20T17:53:07.558806+0000","last_active":"2024-05-20T17:53:14.245106+0000","last_peered":"2024-05-20T17:53:14.245106+0000","last_clean":"2024-05-20T17:53:14.245106+0000","last_became_active":"2024-05-20T17:53:07.558446+0000","last_became_peered":"2024-05-20T17:53:07.558446+0000","last_unstale":"2024-05-20T17:53:14.245106+0000","last_undegraded":"2024-05-20T17:53:14.245106+0000","last_fullsized":"2024-05-20T17:53:14.245106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:14:58.555617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598909+0000","last_change":"2024-05-20T17:53:11.615219+0000","last_active":"2024-05-20T17:53:12.598909+0000","last_peered":"2024-05-20T17:53:12.598909+0000","last_clean":"2024-05-20T17:53:12.598909+0000","last_became_active":"2024-05-20T17:53:11.614707+0000","last_became_peered":"2024-05-20T17:53:11.614707+0000","last_unstale":"2024-05-20T17:53:12.598909+0000","last_undegraded":"2024-05-20T17:53:12.598909+0000","last_fullsized":"2024-05-20T17:53:12.598909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:43:01.628287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654386+0000","last_change":"2024-05-20T17:53:06.572513+0000","last_active":"2024-05-20T17:53:13.654386+0000","last_peered":"2024-05-20T17:53:13.654386+0000","last_clean":"2024-05-20T17:53:13.654386+0000","last_became_active":"2024-05-20T17:53:06.572112+0000","last_became_peered":"2024-05-20T17:53:06.572112+0000","last_unstale":"2024-05-20T17:53:13.654386+0000","last_undegraded":"2024-05-20T17:53:13.654386+0000","last_fullsized":"2024-05-20T17:53:13.654386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245406+0000","last_change":"2024-05-20T17:53:07.559015+0000","last_active":"2024-05-20T17:53:14.245406+0000","last_peered":"2024-05-20T17:53:14.245406+0000","last_clean":"2024-05-20T17:53:14.245406+0000","last_became_active":"2024-05-20T17:53:07.558369+0000","last_became_peered":"2024-05-20T17:53:07.558369+0000","last_unstale":"2024-05-20T17:53:14.245406+0000","last_undegraded":"2024-05-20T17:53:14.245406+0000","last_fullsized":"2024-05-20T17:53:14.245406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598644+0000","last_change":"2024-05-20T17:53:11.618079+0000","last_active":"2024-05-20T17:53:12.598644+0000","last_peered":"2024-05-20T17:53:12.598644+0000","last_clean":"2024-05-20T17:53:12.598644+0000","last_became_active":"2024-05-20T17:53:11.617572+0000","last_became_peered":"2024-05-20T17:53:11.617572+0000","last_unstale":"2024-05-20T17:53:12.598644+0000","last_undegraded":"2024-05-20T17:53:12.598644+0000","last_fullsized":"2024-05-20T17:53:12.598644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:23.513112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244311+0000","last_change":"2024-05-20T17:53:07.572220+0000","last_active":"2024-05-20T17:53:14.244311+0000","last_peered":"2024-05-20T17:53:14.244311+0000","last_clean":"2024-05-20T17:53:14.244311+0000","last_became_active":"2024-05-20T17:53:07.571759+0000","last_became_peered":"2024-05-20T17:53:07.571759+0000","last_unstale":"2024-05-20T17:53:14.244311+0000","last_undegraded":"2024-05-20T17:53:14.244311+0000","last_fullsized":"2024-05-20T17:53:14.244311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654495+0000","last_change":"2024-05-20T17:53:06.573537+0000","last_active":"2024-05-20T17:53:13.654495+0000","last_peered":"2024-05-20T17:53:13.654495+0000","last_clean":"2024-05-20T17:53:13.654495+0000","last_became_active":"2024-05-20T17:53:06.573236+0000","last_became_peered":"2024-05-20T17:53:06.573236+0000","last_unstale":"2024-05-20T17:53:13.654495+0000","last_undegraded":"2024-05-20T17:53:13.654495+0000","last_fullsized":"2024-05-20T17:53:13.654495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:00:16.154534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598961+0000","last_change":"2024-05-20T17:53:11.618293+0000","last_active":"2024-05-20T17:53:12.598961+0000","last_peered":"2024-05-20T17:53:12.598961+0000","last_clean":"2024-05-20T17:53:12.598961+0000","last_became_active":"2024-05-20T17:53:11.617707+0000","last_became_peered":"2024-05-20T17:53:11.617707+0000","last_unstale":"2024-05-20T17:53:12.598961+0000","last_undegraded":"2024-05-20T17:53:12.598961+0000","last_fullsized":"2024-05-20T17:53:12.598961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:24.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598222+0000","last_change":"2024-05-20T17:53:07.585094+0000","last_active":"2024-05-20T17:53:12.598222+0000","last_peered":"2024-05-20T17:53:12.598222+0000","last_clean":"2024-05-20T17:53:12.598222+0000","last_became_active":"2024-05-20T17:53:07.584666+0000","last_became_peered":"2024-05-20T17:53:07.584666+0000","last_unstale":"2024-05-20T17:53:12.598222+0000","last_undegraded":"2024-05-20T17:53:12.598222+0000","last_fullsized":"2024-05-20T17:53:12.598222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244302+0000","last_change":"2024-05-20T17:53:06.569733+0000","last_active":"2024-05-20T17:53:14.244302+0000","last_peered":"2024-05-20T17:53:14.244302+0000","last_clean":"2024-05-20T17:53:14.244302+0000","last_became_active":"2024-05-20T17:53:06.569177+0000","last_became_peered":"2024-05-20T17:53:06.569177+0000","last_unstale":"2024-05-20T17:53:14.244302+0000","last_undegraded":"2024-05-20T17:53:14.244302+0000","last_fullsized":"2024-05-20T17:53:14.244302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599068+0000","last_change":"2024-05-20T17:53:11.614905+0000","last_active":"2024-05-20T17:53:12.599068+0000","last_peered":"2024-05-20T17:53:12.599068+0000","last_clean":"2024-05-20T17:53:12.599068+0000","last_became_active":"2024-05-20T17:53:11.614264+0000","last_became_peered":"2024-05-20T17:53:11.614264+0000","last_unstale":"2024-05-20T17:53:12.599068+0000","last_undegraded":"2024-05-20T17:53:12.599068+0000","last_fullsized":"2024-05-20T17:53:12.599068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:44.269036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598007+0000","last_change":"2024-05-20T17:53:07.589843+0000","last_active":"2024-05-20T17:53:12.598007+0000","last_peered":"2024-05-20T17:53:12.598007+0000","last_clean":"2024-05-20T17:53:12.598007+0000","last_became_active":"2024-05-20T17:53:07.589565+0000","last_became_peered":"2024-05-20T17:53:07.589565+0000","last_unstale":"2024-05-20T17:53:12.598007+0000","last_undegraded":"2024-05-20T17:53:12.598007+0000","last_fullsized":"2024-05-20T17:53:12.598007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243854+0000","last_change":"2024-05-20T17:53:06.570609+0000","last_active":"2024-05-20T17:53:14.243854+0000","last_peered":"2024-05-20T17:53:14.243854+0000","last_clean":"2024-05-20T17:53:14.243854+0000","last_became_active":"2024-05-20T17:53:06.570253+0000","last_became_peered":"2024-05-20T17:53:06.570253+0000","last_unstale":"2024-05-20T17:53:14.243854+0000","last_undegraded":"2024-05-20T17:53:14.243854+0000","last_fullsized":"2024-05-20T17:53:14.243854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245197+0000","last_change":"2024-05-20T17:53:11.756398+0000","last_active":"2024-05-20T17:53:14.245197+0000","last_peered":"2024-05-20T17:53:14.245197+0000","last_clean":"2024-05-20T17:53:14.245197+0000","last_became_active":"2024-05-20T17:53:11.755995+0000","last_became_peered":"2024-05-20T17:53:11.755995+0000","last_unstale":"2024-05-20T17:53:14.245197+0000","last_undegraded":"2024-05-20T17:53:14.245197+0000","last_fullsized":"2024-05-20T17:53:14.245197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:50.812964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599504+0000","last_change":"2024-05-20T17:53:07.569595+0000","last_active":"2024-05-20T17:53:12.599504+0000","last_peered":"2024-05-20T17:53:12.599504+0000","last_clean":"2024-05-20T17:53:12.599504+0000","last_became_active":"2024-05-20T17:53:07.569291+0000","last_became_peered":"2024-05-20T17:53:07.569291+0000","last_unstale":"2024-05-20T17:53:12.599504+0000","last_undegraded":"2024-05-20T17:53:12.599504+0000","last_fullsized":"2024-05-20T17:53:12.599504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:32.671797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654037+0000","last_change":"2024-05-20T17:53:06.576258+0000","last_active":"2024-05-20T17:53:13.654037+0000","last_peered":"2024-05-20T17:53:13.654037+0000","last_clean":"2024-05-20T17:53:13.654037+0000","last_became_active":"2024-05-20T17:53:06.575933+0000","last_became_peered":"2024-05-20T17:53:06.575933+0000","last_unstale":"2024-05-20T17:53:13.654037+0000","last_undegraded":"2024-05-20T17:53:13.654037+0000","last_fullsized":"2024-05-20T17:53:13.654037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599393+0000","last_change":"2024-05-20T17:53:11.615738+0000","last_active":"2024-05-20T17:53:12.599393+0000","last_peered":"2024-05-20T17:53:12.599393+0000","last_clean":"2024-05-20T17:53:12.599393+0000","last_became_active":"2024-05-20T17:53:11.614228+0000","last_became_peered":"2024-05-20T17:53:11.614228+0000","last_unstale":"2024-05-20T17:53:12.599393+0000","last_undegraded":"2024-05-20T17:53:12.599393+0000","last_fullsized":"2024-05-20T17:53:12.599393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:02.595103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244147+0000","last_change":"2024-05-20T17:53:07.569138+0000","last_active":"2024-05-20T17:53:14.244147+0000","last_peered":"2024-05-20T17:53:14.244147+0000","last_clean":"2024-05-20T17:53:14.244147+0000","last_became_active":"2024-05-20T17:53:07.568036+0000","last_became_peered":"2024-05-20T17:53:07.568036+0000","last_unstale":"2024-05-20T17:53:14.244147+0000","last_undegraded":"2024-05-20T17:53:14.244147+0000","last_fullsized":"2024-05-20T17:53:14.244147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245354+0000","last_change":"2024-05-20T17:53:06.575386+0000","last_active":"2024-05-20T17:53:14.245354+0000","last_peered":"2024-05-20T17:53:14.245354+0000","last_clean":"2024-05-20T17:53:14.245354+0000","last_became_active":"2024-05-20T17:53:06.574851+0000","last_became_peered":"2024-05-20T17:53:06.574851+0000","last_unstale":"2024-05-20T17:53:14.245354+0000","last_undegraded":"2024-05-20T17:53:14.245354+0000","last_fullsized":"2024-05-20T17:53:14.245354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598416+0000","last_change":"2024-05-20T17:53:11.751984+0000","last_active":"2024-05-20T17:53:12.598416+0000","last_peered":"2024-05-20T17:53:12.598416+0000","last_clean":"2024-05-20T17:53:12.598416+0000","last_became_active":"2024-05-20T17:53:11.751452+0000","last_became_peered":"2024-05-20T17:53:11.751452+0000","last_unstale":"2024-05-20T17:53:12.598416+0000","last_undegraded":"2024-05-20T17:53:12.598416+0000","last_fullsized":"2024-05-20T17:53:12.598416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:44.794916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599614+0000","last_change":"2024-05-20T17:53:07.586262+0000","last_active":"2024-05-20T17:53:12.599614+0000","last_peered":"2024-05-20T17:53:12.599614+0000","last_clean":"2024-05-20T17:53:12.599614+0000","last_became_active":"2024-05-20T17:53:07.584798+0000","last_became_peered":"2024-05-20T17:53:07.584798+0000","last_unstale":"2024-05-20T17:53:12.599614+0000","last_undegraded":"2024-05-20T17:53:12.599614+0000","last_fullsized":"2024-05-20T17:53:12.599614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245096+0000","last_change":"2024-05-20T17:53:06.572334+0000","last_active":"2024-05-20T17:53:14.245096+0000","last_peered":"2024-05-20T17:53:14.245096+0000","last_clean":"2024-05-20T17:53:14.245096+0000","last_became_active":"2024-05-20T17:53:06.571243+0000","last_became_peered":"2024-05-20T17:53:06.571243+0000","last_unstale":"2024-05-20T17:53:14.245096+0000","last_undegraded":"2024-05-20T17:53:14.245096+0000","last_fullsized":"2024-05-20T17:53:14.245096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:00:16.154534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597655+0000","last_change":"2024-05-20T17:53:11.751914+0000","last_active":"2024-05-20T17:53:12.597655+0000","last_peered":"2024-05-20T17:53:12.597655+0000","last_clean":"2024-05-20T17:53:12.597655+0000","last_became_active":"2024-05-20T17:53:11.751472+0000","last_became_peered":"2024-05-20T17:53:11.751472+0000","last_unstale":"2024-05-20T17:53:12.597655+0000","last_undegraded":"2024-05-20T17:53:12.597655+0000","last_fullsized":"2024-05-20T17:53:12.597655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:52.250807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244812+0000","last_change":"2024-05-20T17:53:07.569467+0000","last_active":"2024-05-20T17:53:14.244812+0000","last_peered":"2024-05-20T17:53:14.244812+0000","last_clean":"2024-05-20T17:53:14.244812+0000","last_became_active":"2024-05-20T17:53:07.569123+0000","last_became_peered":"2024-05-20T17:53:07.569123+0000","last_unstale":"2024-05-20T17:53:14.244812+0000","last_undegraded":"2024-05-20T17:53:14.244812+0000","last_fullsized":"2024-05-20T17:53:14.244812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654806+0000","last_change":"2024-05-20T17:53:06.577309+0000","last_active":"2024-05-20T17:53:13.654806+0000","last_peered":"2024-05-20T17:53:13.654806+0000","last_clean":"2024-05-20T17:53:13.654806+0000","last_became_active":"2024-05-20T17:53:06.576898+0000","last_became_peered":"2024-05-20T17:53:06.576898+0000","last_unstale":"2024-05-20T17:53:13.654806+0000","last_undegraded":"2024-05-20T17:53:13.654806+0000","last_fullsized":"2024-05-20T17:53:13.654806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:25.034377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244489+0000","last_change":"2024-05-20T17:53:11.751909+0000","last_active":"2024-05-20T17:53:14.244489+0000","last_peered":"2024-05-20T17:53:14.244489+0000","last_clean":"2024-05-20T17:53:14.244489+0000","last_became_active":"2024-05-20T17:53:11.751479+0000","last_became_peered":"2024-05-20T17:53:11.751479+0000","last_unstale":"2024-05-20T17:53:14.244489+0000","last_undegraded":"2024-05-20T17:53:14.244489+0000","last_fullsized":"2024-05-20T17:53:14.244489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:55.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245485+0000","last_change":"2024-05-20T17:53:07.585138+0000","last_active":"2024-05-20T17:53:14.245485+0000","last_peered":"2024-05-20T17:53:14.245485+0000","last_clean":"2024-05-20T17:53:14.245485+0000","last_became_active":"2024-05-20T17:53:07.584803+0000","last_became_peered":"2024-05-20T17:53:07.584803+0000","last_unstale":"2024-05-20T17:53:14.245485+0000","last_undegraded":"2024-05-20T17:53:14.245485+0000","last_fullsized":"2024-05-20T17:53:14.245485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244812+0000","last_change":"2024-05-20T17:53:06.567245+0000","last_active":"2024-05-20T17:53:14.244812+0000","last_peered":"2024-05-20T17:53:14.244812+0000","last_clean":"2024-05-20T17:53:14.244812+0000","last_became_active":"2024-05-20T17:53:06.566920+0000","last_became_peered":"2024-05-20T17:53:06.566920+0000","last_unstale":"2024-05-20T17:53:14.244812+0000","last_undegraded":"2024-05-20T17:53:14.244812+0000","last_fullsized":"2024-05-20T17:53:14.244812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243827+0000","last_change":"2024-05-20T17:53:11.623254+0000","last_active":"2024-05-20T17:53:14.243827+0000","last_peered":"2024-05-20T17:53:14.243827+0000","last_clean":"2024-05-20T17:53:14.243827+0000","last_became_active":"2024-05-20T17:53:11.621995+0000","last_became_peered":"2024-05-20T17:53:11.621995+0000","last_unstale":"2024-05-20T17:53:14.243827+0000","last_undegraded":"2024-05-20T17:53:14.243827+0000","last_fullsized":"2024-05-20T17:53:14.243827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:49.533751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599455+0000","last_change":"2024-05-20T17:53:07.568413+0000","last_active":"2024-05-20T17:53:12.599455+0000","last_peered":"2024-05-20T17:53:12.599455+0000","last_clean":"2024-05-20T17:53:12.599455+0000","last_became_active":"2024-05-20T17:53:07.567292+0000","last_became_peered":"2024-05-20T17:53:07.567292+0000","last_unstale":"2024-05-20T17:53:12.599455+0000","last_undegraded":"2024-05-20T17:53:12.599455+0000","last_fullsized":"2024-05-20T17:53:12.599455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:26.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244479+0000","last_change":"2024-05-20T17:53:06.567819+0000","last_active":"2024-05-20T17:53:14.244479+0000","last_peered":"2024-05-20T17:53:14.244479+0000","last_clean":"2024-05-20T17:53:14.244479+0000","last_became_active":"2024-05-20T17:53:06.567485+0000","last_became_peered":"2024-05-20T17:53:06.567485+0000","last_unstale":"2024-05-20T17:53:14.244479+0000","last_undegraded":"2024-05-20T17:53:14.244479+0000","last_fullsized":"2024-05-20T17:53:14.244479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:27.248981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244638+0000","last_change":"2024-05-20T17:53:11.621878+0000","last_active":"2024-05-20T17:53:14.244638+0000","last_peered":"2024-05-20T17:53:14.244638+0000","last_clean":"2024-05-20T17:53:14.244638+0000","last_became_active":"2024-05-20T17:53:11.621430+0000","last_became_peered":"2024-05-20T17:53:11.621430+0000","last_unstale":"2024-05-20T17:53:14.244638+0000","last_undegraded":"2024-05-20T17:53:14.244638+0000","last_fullsized":"2024-05-20T17:53:14.244638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:55.238820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243483+0000","last_change":"2024-05-20T17:53:07.569646+0000","last_active":"2024-05-20T17:53:14.243483+0000","last_peered":"2024-05-20T17:53:14.243483+0000","last_clean":"2024-05-20T17:53:14.243483+0000","last_became_active":"2024-05-20T17:53:07.569255+0000","last_became_peered":"2024-05-20T17:53:07.569255+0000","last_unstale":"2024-05-20T17:53:14.243483+0000","last_undegraded":"2024-05-20T17:53:14.243483+0000","last_fullsized":"2024-05-20T17:53:14.243483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598624+0000","last_change":"2024-05-20T17:53:06.568915+0000","last_active":"2024-05-20T17:53:12.598624+0000","last_peered":"2024-05-20T17:53:12.598624+0000","last_clean":"2024-05-20T17:53:12.598624+0000","last_became_active":"2024-05-20T17:53:06.568597+0000","last_became_peered":"2024-05-20T17:53:06.568597+0000","last_unstale":"2024-05-20T17:53:12.598624+0000","last_undegraded":"2024-05-20T17:53:12.598624+0000","last_fullsized":"2024-05-20T17:53:12.598624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245241+0000","last_change":"2024-05-20T17:53:11.622481+0000","last_active":"2024-05-20T17:53:14.245241+0000","last_peered":"2024-05-20T17:53:14.245241+0000","last_clean":"2024-05-20T17:53:14.245241+0000","last_became_active":"2024-05-20T17:53:11.622026+0000","last_became_peered":"2024-05-20T17:53:11.622026+0000","last_unstale":"2024-05-20T17:53:14.245241+0000","last_undegraded":"2024-05-20T17:53:14.245241+0000","last_fullsized":"2024-05-20T17:53:14.245241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:15.654843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243451+0000","last_change":"2024-05-20T17:53:07.563580+0000","last_active":"2024-05-20T17:53:14.243451+0000","last_peered":"2024-05-20T17:53:14.243451+0000","last_clean":"2024-05-20T17:53:14.243451+0000","last_became_active":"2024-05-20T17:53:07.563226+0000","last_became_peered":"2024-05-20T17:53:07.563226+0000","last_unstale":"2024-05-20T17:53:14.243451+0000","last_undegraded":"2024-05-20T17:53:14.243451+0000","last_fullsized":"2024-05-20T17:53:14.243451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:22.334918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654094+0000","last_change":"2024-05-20T17:53:06.570658+0000","last_active":"2024-05-20T17:53:13.654094+0000","last_peered":"2024-05-20T17:53:13.654094+0000","last_clean":"2024-05-20T17:53:13.654094+0000","last_became_active":"2024-05-20T17:53:06.569975+0000","last_became_peered":"2024-05-20T17:53:06.569975+0000","last_unstale":"2024-05-20T17:53:13.654094+0000","last_undegraded":"2024-05-20T17:53:13.654094+0000","last_fullsized":"2024-05-20T17:53:13.654094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244022+0000","last_change":"2024-05-20T17:53:11.752185+0000","last_active":"2024-05-20T17:53:14.244022+0000","last_peered":"2024-05-20T17:53:14.244022+0000","last_clean":"2024-05-20T17:53:14.244022+0000","last_became_active":"2024-05-20T17:53:11.751761+0000","last_became_peered":"2024-05-20T17:53:11.751761+0000","last_unstale":"2024-05-20T17:53:14.244022+0000","last_undegraded":"2024-05-20T17:53:14.244022+0000","last_fullsized":"2024-05-20T17:53:14.244022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:28.849402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597975+0000","last_change":"2024-05-20T17:53:07.585881+0000","last_active":"2024-05-20T17:53:12.597975+0000","last_peered":"2024-05-20T17:53:12.597975+0000","last_clean":"2024-05-20T17:53:12.597975+0000","last_became_active":"2024-05-20T17:53:07.584882+0000","last_became_peered":"2024-05-20T17:53:07.584882+0000","last_unstale":"2024-05-20T17:53:12.597975+0000","last_undegraded":"2024-05-20T17:53:12.597975+0000","last_fullsized":"2024-05-20T17:53:12.597975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244548+0000","last_change":"2024-05-20T17:53:06.568683+0000","last_active":"2024-05-20T17:53:14.244548+0000","last_peered":"2024-05-20T17:53:14.244548+0000","last_clean":"2024-05-20T17:53:14.244548+0000","last_became_active":"2024-05-20T17:53:06.568335+0000","last_became_peered":"2024-05-20T17:53:06.568335+0000","last_unstale":"2024-05-20T17:53:14.244548+0000","last_undegraded":"2024-05-20T17:53:14.244548+0000","last_fullsized":"2024-05-20T17:53:14.244548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.341693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654203+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:53:13.654203+0000","last_peered":"2024-05-20T17:53:13.654203+0000","last_clean":"2024-05-20T17:53:13.654203+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:53:13.654203+0000","last_undegraded":"2024-05-20T17:53:13.654203+0000","last_fullsized":"2024-05-20T17:53:13.654203+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244914+0000","last_change":"2024-05-20T17:53:11.755628+0000","last_active":"2024-05-20T17:53:14.244914+0000","last_peered":"2024-05-20T17:53:14.244914+0000","last_clean":"2024-05-20T17:53:14.244914+0000","last_became_active":"2024-05-20T17:53:11.755136+0000","last_became_peered":"2024-05-20T17:53:11.755136+0000","last_unstale":"2024-05-20T17:53:14.244914+0000","last_undegraded":"2024-05-20T17:53:14.244914+0000","last_fullsized":"2024-05-20T17:53:14.244914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:21.092223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654502+0000","last_change":"2024-05-20T17:53:07.570752+0000","last_active":"2024-05-20T17:53:13.654502+0000","last_peered":"2024-05-20T17:53:13.654502+0000","last_clean":"2024-05-20T17:53:13.654502+0000","last_became_active":"2024-05-20T17:53:07.570340+0000","last_became_peered":"2024-05-20T17:53:07.570340+0000","last_unstale":"2024-05-20T17:53:13.654502+0000","last_undegraded":"2024-05-20T17:53:13.654502+0000","last_fullsized":"2024-05-20T17:53:13.654502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599144+0000","last_change":"2024-05-20T17:53:06.574013+0000","last_active":"2024-05-20T17:53:12.599144+0000","last_peered":"2024-05-20T17:53:12.599144+0000","last_clean":"2024-05-20T17:53:12.599144+0000","last_became_active":"2024-05-20T17:53:06.573642+0000","last_became_peered":"2024-05-20T17:53:06.573642+0000","last_unstale":"2024-05-20T17:53:12.599144+0000","last_undegraded":"2024-05-20T17:53:12.599144+0000","last_fullsized":"2024-05-20T17:53:12.599144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244226+0000","last_change":"2024-05-20T17:53:11.753062+0000","last_active":"2024-05-20T17:53:14.244226+0000","last_peered":"2024-05-20T17:53:14.244226+0000","last_clean":"2024-05-20T17:53:14.244226+0000","last_became_active":"2024-05-20T17:53:11.751556+0000","last_became_peered":"2024-05-20T17:53:11.751556+0000","last_unstale":"2024-05-20T17:53:14.244226+0000","last_undegraded":"2024-05-20T17:53:14.244226+0000","last_fullsized":"2024-05-20T17:53:14.244226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:24.317098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245151+0000","last_change":"2024-05-20T17:53:07.588441+0000","last_active":"2024-05-20T17:53:14.245151+0000","last_peered":"2024-05-20T17:53:14.245151+0000","last_clean":"2024-05-20T17:53:14.245151+0000","last_became_active":"2024-05-20T17:53:07.588133+0000","last_became_peered":"2024-05-20T17:53:07.588133+0000","last_unstale":"2024-05-20T17:53:14.245151+0000","last_undegraded":"2024-05-20T17:53:14.245151+0000","last_fullsized":"2024-05-20T17:53:14.245151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:24.809917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244797+0000","last_change":"2024-05-20T17:53:06.573392+0000","last_active":"2024-05-20T17:53:14.244797+0000","last_peered":"2024-05-20T17:53:14.244797+0000","last_clean":"2024-05-20T17:53:14.244797+0000","last_became_active":"2024-05-20T17:53:06.573074+0000","last_became_peered":"2024-05-20T17:53:06.573074+0000","last_unstale":"2024-05-20T17:53:14.244797+0000","last_undegraded":"2024-05-20T17:53:14.244797+0000","last_fullsized":"2024-05-20T17:53:14.244797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:25.034377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244807+0000","last_change":"2024-05-20T17:53:11.616708+0000","last_active":"2024-05-20T17:53:14.244807+0000","last_peered":"2024-05-20T17:53:14.244807+0000","last_clean":"2024-05-20T17:53:14.244807+0000","last_became_active":"2024-05-20T17:53:11.616224+0000","last_became_peered":"2024-05-20T17:53:11.616224+0000","last_unstale":"2024-05-20T17:53:14.244807+0000","last_undegraded":"2024-05-20T17:53:14.244807+0000","last_fullsized":"2024-05-20T17:53:14.244807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:43:50.812964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654899+0000","last_change":"2024-05-20T17:53:07.572037+0000","last_active":"2024-05-20T17:53:13.654899+0000","last_peered":"2024-05-20T17:53:13.654899+0000","last_clean":"2024-05-20T17:53:13.654899+0000","last_became_active":"2024-05-20T17:53:07.571604+0000","last_became_peered":"2024-05-20T17:53:07.571604+0000","last_unstale":"2024-05-20T17:53:13.654899+0000","last_undegraded":"2024-05-20T17:53:13.654899+0000","last_fullsized":"2024-05-20T17:53:13.654899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:14:58.555617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599665+0000","last_change":"2024-05-20T17:53:06.569716+0000","last_active":"2024-05-20T17:53:12.599665+0000","last_peered":"2024-05-20T17:53:12.599665+0000","last_clean":"2024-05-20T17:53:12.599665+0000","last_became_active":"2024-05-20T17:53:06.569388+0000","last_became_peered":"2024-05-20T17:53:06.569388+0000","last_unstale":"2024-05-20T17:53:12.599665+0000","last_undegraded":"2024-05-20T17:53:12.599665+0000","last_fullsized":"2024-05-20T17:53:12.599665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243806+0000","last_change":"2024-05-20T17:53:11.755708+0000","last_active":"2024-05-20T17:53:14.243806+0000","last_peered":"2024-05-20T17:53:14.243806+0000","last_clean":"2024-05-20T17:53:14.243806+0000","last_became_active":"2024-05-20T17:53:11.755172+0000","last_became_peered":"2024-05-20T17:53:11.755172+0000","last_unstale":"2024-05-20T17:53:14.243806+0000","last_undegraded":"2024-05-20T17:53:14.243806+0000","last_fullsized":"2024-05-20T17:53:14.243806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:52.250807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654824+0000","last_change":"2024-05-20T17:53:07.572990+0000","last_active":"2024-05-20T17:53:13.654824+0000","last_peered":"2024-05-20T17:53:13.654824+0000","last_clean":"2024-05-20T17:53:13.654824+0000","last_became_active":"2024-05-20T17:53:07.572659+0000","last_became_peered":"2024-05-20T17:53:07.572659+0000","last_unstale":"2024-05-20T17:53:13.654824+0000","last_undegraded":"2024-05-20T17:53:13.654824+0000","last_fullsized":"2024-05-20T17:53:13.654824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599512+0000","last_change":"2024-05-20T17:53:06.566523+0000","last_active":"2024-05-20T17:53:12.599512+0000","last_peered":"2024-05-20T17:53:12.599512+0000","last_clean":"2024-05-20T17:53:12.599512+0000","last_became_active":"2024-05-20T17:53:06.566228+0000","last_became_peered":"2024-05-20T17:53:06.566228+0000","last_unstale":"2024-05-20T17:53:12.599512+0000","last_undegraded":"2024-05-20T17:53:12.599512+0000","last_fullsized":"2024-05-20T17:53:12.599512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:53:10.800947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598417+0000","last_change":"2024-05-20T17:53:11.616204+0000","last_active":"2024-05-20T17:53:12.598417+0000","last_peered":"2024-05-20T17:53:12.598417+0000","last_clean":"2024-05-20T17:53:12.598417+0000","last_became_active":"2024-05-20T17:53:11.614496+0000","last_became_peered":"2024-05-20T17:53:11.614496+0000","last_unstale":"2024-05-20T17:53:12.598417+0000","last_undegraded":"2024-05-20T17:53:12.598417+0000","last_fullsized":"2024-05-20T17:53:12.598417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:35.749353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654214+0000","last_change":"2024-05-20T17:53:07.571233+0000","last_active":"2024-05-20T17:53:13.654214+0000","last_peered":"2024-05-20T17:53:13.654214+0000","last_clean":"2024-05-20T17:53:13.654214+0000","last_became_active":"2024-05-20T17:53:07.570934+0000","last_became_peered":"2024-05-20T17:53:07.570934+0000","last_unstale":"2024-05-20T17:53:13.654214+0000","last_undegraded":"2024-05-20T17:53:13.654214+0000","last_fullsized":"2024-05-20T17:53:13.654214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:17.052738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598410+0000","last_change":"2024-05-20T17:53:06.567186+0000","last_active":"2024-05-20T17:53:12.598410+0000","last_peered":"2024-05-20T17:53:12.598410+0000","last_clean":"2024-05-20T17:53:12.598410+0000","last_became_active":"2024-05-20T17:53:06.566859+0000","last_became_peered":"2024-05-20T17:53:06.566859+0000","last_unstale":"2024-05-20T17:53:12.598410+0000","last_undegraded":"2024-05-20T17:53:12.598410+0000","last_fullsized":"2024-05-20T17:53:12.598410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243852+0000","last_change":"2024-05-20T17:53:11.621010+0000","last_active":"2024-05-20T17:53:14.243852+0000","last_peered":"2024-05-20T17:53:14.243852+0000","last_clean":"2024-05-20T17:53:14.243852+0000","last_became_active":"2024-05-20T17:53:11.620499+0000","last_became_peered":"2024-05-20T17:53:11.620499+0000","last_unstale":"2024-05-20T17:53:14.243852+0000","last_undegraded":"2024-05-20T17:53:14.243852+0000","last_fullsized":"2024-05-20T17:53:14.243852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:49.533751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243897+0000","last_change":"2024-05-20T17:53:07.570895+0000","last_active":"2024-05-20T17:53:14.243897+0000","last_peered":"2024-05-20T17:53:14.243897+0000","last_clean":"2024-05-20T17:53:14.243897+0000","last_became_active":"2024-05-20T17:53:07.570591+0000","last_became_peered":"2024-05-20T17:53:07.570591+0000","last_unstale":"2024-05-20T17:53:14.243897+0000","last_undegraded":"2024-05-20T17:53:14.243897+0000","last_fullsized":"2024-05-20T17:53:14.243897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244112+0000","last_change":"2024-05-20T17:53:06.571154+0000","last_active":"2024-05-20T17:53:14.244112+0000","last_peered":"2024-05-20T17:53:14.244112+0000","last_clean":"2024-05-20T17:53:14.244112+0000","last_became_active":"2024-05-20T17:53:06.570383+0000","last_became_peered":"2024-05-20T17:53:06.570383+0000","last_unstale":"2024-05-20T17:53:14.244112+0000","last_undegraded":"2024-05-20T17:53:14.244112+0000","last_fullsized":"2024-05-20T17:53:14.244112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599410+0000","last_change":"2024-05-20T17:53:11.755366+0000","last_active":"2024-05-20T17:53:12.599410+0000","last_peered":"2024-05-20T17:53:12.599410+0000","last_clean":"2024-05-20T17:53:12.599410+0000","last_became_active":"2024-05-20T17:53:11.754922+0000","last_became_peered":"2024-05-20T17:53:11.754922+0000","last_unstale":"2024-05-20T17:53:12.599410+0000","last_undegraded":"2024-05-20T17:53:12.599410+0000","last_fullsized":"2024-05-20T17:53:12.599410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:54:01.281535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654387+0000","last_change":"2024-05-20T17:53:07.571300+0000","last_active":"2024-05-20T17:53:13.654387+0000","last_peered":"2024-05-20T17:53:13.654387+0000","last_clean":"2024-05-20T17:53:13.654387+0000","last_became_active":"2024-05-20T17:53:07.570991+0000","last_became_peered":"2024-05-20T17:53:07.570991+0000","last_unstale":"2024-05-20T17:53:13.654387+0000","last_undegraded":"2024-05-20T17:53:13.654387+0000","last_fullsized":"2024-05-20T17:53:13.654387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:51.199335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244361+0000","last_change":"2024-05-20T17:53:06.576427+0000","last_active":"2024-05-20T17:53:14.244361+0000","last_peered":"2024-05-20T17:53:14.244361+0000","last_clean":"2024-05-20T17:53:14.244361+0000","last_became_active":"2024-05-20T17:53:06.576041+0000","last_became_peered":"2024-05-20T17:53:06.576041+0000","last_unstale":"2024-05-20T17:53:14.244361+0000","last_undegraded":"2024-05-20T17:53:14.244361+0000","last_fullsized":"2024-05-20T17:53:14.244361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599381+0000","last_change":"2024-05-20T17:53:11.752114+0000","last_active":"2024-05-20T17:53:12.599381+0000","last_peered":"2024-05-20T17:53:12.599381+0000","last_clean":"2024-05-20T17:53:12.599381+0000","last_became_active":"2024-05-20T17:53:11.751659+0000","last_became_peered":"2024-05-20T17:53:11.751659+0000","last_unstale":"2024-05-20T17:53:12.599381+0000","last_undegraded":"2024-05-20T17:53:12.599381+0000","last_fullsized":"2024-05-20T17:53:12.599381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:33:17.210775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244151+0000","last_change":"2024-05-20T17:53:07.570656+0000","last_active":"2024-05-20T17:53:14.244151+0000","last_peered":"2024-05-20T17:53:14.244151+0000","last_clean":"2024-05-20T17:53:14.244151+0000","last_became_active":"2024-05-20T17:53:07.570296+0000","last_became_peered":"2024-05-20T17:53:07.570296+0000","last_unstale":"2024-05-20T17:53:14.244151+0000","last_undegraded":"2024-05-20T17:53:14.244151+0000","last_fullsized":"2024-05-20T17:53:14.244151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:12:35.547087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244993+0000","last_change":"2024-05-20T17:53:06.567626+0000","last_active":"2024-05-20T17:53:14.244993+0000","last_peered":"2024-05-20T17:53:14.244993+0000","last_clean":"2024-05-20T17:53:14.244993+0000","last_became_active":"2024-05-20T17:53:06.565665+0000","last_became_peered":"2024-05-20T17:53:06.565665+0000","last_unstale":"2024-05-20T17:53:14.244993+0000","last_undegraded":"2024-05-20T17:53:14.244993+0000","last_fullsized":"2024-05-20T17:53:14.244993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:23:13.293451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245434+0000","last_change":"2024-05-20T17:53:11.752662+0000","last_active":"2024-05-20T17:53:14.245434+0000","last_peered":"2024-05-20T17:53:14.245434+0000","last_clean":"2024-05-20T17:53:14.245434+0000","last_became_active":"2024-05-20T17:53:11.752188+0000","last_became_peered":"2024-05-20T17:53:11.752188+0000","last_unstale":"2024-05-20T17:53:14.245434+0000","last_undegraded":"2024-05-20T17:53:14.245434+0000","last_fullsized":"2024-05-20T17:53:14.245434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:51:41.783430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654449+0000","last_change":"2024-05-20T17:53:07.588530+0000","last_active":"2024-05-20T17:53:13.654449+0000","last_peered":"2024-05-20T17:53:13.654449+0000","last_clean":"2024-05-20T17:53:13.654449+0000","last_became_active":"2024-05-20T17:53:07.587985+0000","last_became_peered":"2024-05-20T17:53:07.587985+0000","last_unstale":"2024-05-20T17:53:13.654449+0000","last_undegraded":"2024-05-20T17:53:13.654449+0000","last_fullsized":"2024-05-20T17:53:13.654449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:17.229454+0000","last_change":"2024-05-20T17:53:06.574794+0000","last_active":"2024-05-20T17:53:17.229454+0000","last_peered":"2024-05-20T17:53:17.229454+0000","last_clean":"2024-05-20T17:53:17.229454+0000","last_became_active":"2024-05-20T17:53:06.574430+0000","last_became_peered":"2024-05-20T17:53:06.574430+0000","last_unstale":"2024-05-20T17:53:17.229454+0000","last_undegraded":"2024-05-20T17:53:17.229454+0000","last_fullsized":"2024-05-20T17:53:17.229454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244161+0000","last_change":"2024-05-20T17:53:11.620987+0000","last_active":"2024-05-20T17:53:14.244161+0000","last_peered":"2024-05-20T17:53:14.244161+0000","last_clean":"2024-05-20T17:53:14.244161+0000","last_became_active":"2024-05-20T17:53:11.620506+0000","last_became_peered":"2024-05-20T17:53:11.620506+0000","last_unstale":"2024-05-20T17:53:14.244161+0000","last_undegraded":"2024-05-20T17:53:14.244161+0000","last_fullsized":"2024-05-20T17:53:14.244161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:28.849402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599507+0000","last_change":"2024-05-20T17:53:07.565183+0000","last_active":"2024-05-20T17:53:12.599507+0000","last_peered":"2024-05-20T17:53:12.599507+0000","last_clean":"2024-05-20T17:53:12.599507+0000","last_became_active":"2024-05-20T17:53:07.564852+0000","last_became_peered":"2024-05-20T17:53:07.564852+0000","last_unstale":"2024-05-20T17:53:12.599507+0000","last_undegraded":"2024-05-20T17:53:12.599507+0000","last_fullsized":"2024-05-20T17:53:12.599507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:31.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244673+0000","last_change":"2024-05-20T17:53:06.574319+0000","last_active":"2024-05-20T17:53:14.244673+0000","last_peered":"2024-05-20T17:53:14.244673+0000","last_clean":"2024-05-20T17:53:14.244673+0000","last_became_active":"2024-05-20T17:53:06.573970+0000","last_became_peered":"2024-05-20T17:53:06.573970+0000","last_unstale":"2024-05-20T17:53:14.244673+0000","last_undegraded":"2024-05-20T17:53:14.244673+0000","last_fullsized":"2024-05-20T17:53:14.244673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:30.496240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599198+0000","last_change":"2024-05-20T17:53:11.616154+0000","last_active":"2024-05-20T17:53:12.599198+0000","last_peered":"2024-05-20T17:53:12.599198+0000","last_clean":"2024-05-20T17:53:12.599198+0000","last_became_active":"2024-05-20T17:53:11.614731+0000","last_became_peered":"2024-05-20T17:53:11.614731+0000","last_unstale":"2024-05-20T17:53:12.599198+0000","last_undegraded":"2024-05-20T17:53:12.599198+0000","last_fullsized":"2024-05-20T17:53:12.599198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:21.092223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243803+0000","last_change":"2024-05-20T17:53:07.573718+0000","last_active":"2024-05-20T17:53:14.243803+0000","last_peered":"2024-05-20T17:53:14.243803+0000","last_clean":"2024-05-20T17:53:14.243803+0000","last_became_active":"2024-05-20T17:53:07.573368+0000","last_became_peered":"2024-05-20T17:53:07.573368+0000","last_unstale":"2024-05-20T17:53:14.243803+0000","last_undegraded":"2024-05-20T17:53:14.243803+0000","last_fullsized":"2024-05-20T17:53:14.243803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244725+0000","last_change":"2024-05-20T17:53:06.572461+0000","last_active":"2024-05-20T17:53:14.244725+0000","last_peered":"2024-05-20T17:53:14.244725+0000","last_clean":"2024-05-20T17:53:14.244725+0000","last_became_active":"2024-05-20T17:53:06.572097+0000","last_became_peered":"2024-05-20T17:53:06.572097+0000","last_unstale":"2024-05-20T17:53:14.244725+0000","last_undegraded":"2024-05-20T17:53:14.244725+0000","last_fullsized":"2024-05-20T17:53:14.244725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:06.974074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597910+0000","last_change":"2024-05-20T17:53:11.612607+0000","last_active":"2024-05-20T17:53:12.597910+0000","last_peered":"2024-05-20T17:53:12.597910+0000","last_clean":"2024-05-20T17:53:12.597910+0000","last_became_active":"2024-05-20T17:53:11.612147+0000","last_became_peered":"2024-05-20T17:53:11.612147+0000","last_unstale":"2024-05-20T17:53:12.597910+0000","last_undegraded":"2024-05-20T17:53:12.597910+0000","last_fullsized":"2024-05-20T17:53:12.597910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:57.596450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244594+0000","last_change":"2024-05-20T17:53:07.565265+0000","last_active":"2024-05-20T17:53:14.244594+0000","last_peered":"2024-05-20T17:53:14.244594+0000","last_clean":"2024-05-20T17:53:14.244594+0000","last_became_active":"2024-05-20T17:53:07.564958+0000","last_became_peered":"2024-05-20T17:53:07.564958+0000","last_unstale":"2024-05-20T17:53:14.244594+0000","last_undegraded":"2024-05-20T17:53:14.244594+0000","last_fullsized":"2024-05-20T17:53:14.244594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244837+0000","last_change":"2024-05-20T17:53:06.575493+0000","last_active":"2024-05-20T17:53:14.244837+0000","last_peered":"2024-05-20T17:53:14.244837+0000","last_clean":"2024-05-20T17:53:14.244837+0000","last_became_active":"2024-05-20T17:53:06.575211+0000","last_became_peered":"2024-05-20T17:53:06.575211+0000","last_unstale":"2024-05-20T17:53:14.244837+0000","last_undegraded":"2024-05-20T17:53:14.244837+0000","last_fullsized":"2024-05-20T17:53:14.244837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599643+0000","last_change":"2024-05-20T17:53:11.755641+0000","last_active":"2024-05-20T17:53:12.599643+0000","last_peered":"2024-05-20T17:53:12.599643+0000","last_clean":"2024-05-20T17:53:12.599643+0000","last_became_active":"2024-05-20T17:53:11.755179+0000","last_became_peered":"2024-05-20T17:53:11.755179+0000","last_unstale":"2024-05-20T17:53:12.599643+0000","last_undegraded":"2024-05-20T17:53:12.599643+0000","last_fullsized":"2024-05-20T17:53:12.599643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:08.214732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243667+0000","last_change":"2024-05-20T17:53:11.755526+0000","last_active":"2024-05-20T17:53:14.243667+0000","last_peered":"2024-05-20T17:53:14.243667+0000","last_clean":"2024-05-20T17:53:14.243667+0000","last_became_active":"2024-05-20T17:53:11.755114+0000","last_became_peered":"2024-05-20T17:53:11.755114+0000","last_unstale":"2024-05-20T17:53:14.243667+0000","last_undegraded":"2024-05-20T17:53:14.243667+0000","last_fullsized":"2024-05-20T17:53:14.243667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:02.595103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243648+0000","last_change":"2024-05-20T17:53:07.589463+0000","last_active":"2024-05-20T17:53:14.243648+0000","last_peered":"2024-05-20T17:53:14.243648+0000","last_clean":"2024-05-20T17:53:14.243648+0000","last_became_active":"2024-05-20T17:53:07.589109+0000","last_became_peered":"2024-05-20T17:53:07.589109+0000","last_unstale":"2024-05-20T17:53:14.243648+0000","last_undegraded":"2024-05-20T17:53:14.243648+0000","last_fullsized":"2024-05-20T17:53:14.243648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243937+0000","last_change":"2024-05-20T17:53:06.573947+0000","last_active":"2024-05-20T17:53:14.243937+0000","last_peered":"2024-05-20T17:53:14.243937+0000","last_clean":"2024-05-20T17:53:14.243937+0000","last_became_active":"2024-05-20T17:53:06.572617+0000","last_became_peered":"2024-05-20T17:53:06.572617+0000","last_unstale":"2024-05-20T17:53:14.243937+0000","last_undegraded":"2024-05-20T17:53:14.243937+0000","last_fullsized":"2024-05-20T17:53:14.243937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:24:46.181152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244417+0000","last_change":"2024-05-20T17:53:11.617273+0000","last_active":"2024-05-20T17:53:14.244417+0000","last_peered":"2024-05-20T17:53:14.244417+0000","last_clean":"2024-05-20T17:53:14.244417+0000","last_became_active":"2024-05-20T17:53:11.616538+0000","last_became_peered":"2024-05-20T17:53:11.616538+0000","last_unstale":"2024-05-20T17:53:14.244417+0000","last_undegraded":"2024-05-20T17:53:14.244417+0000","last_fullsized":"2024-05-20T17:53:14.244417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:44.269036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597869+0000","last_change":"2024-05-20T17:53:07.585370+0000","last_active":"2024-05-20T17:53:12.597869+0000","last_peered":"2024-05-20T17:53:12.597869+0000","last_clean":"2024-05-20T17:53:12.597869+0000","last_became_active":"2024-05-20T17:53:07.584558+0000","last_became_peered":"2024-05-20T17:53:07.584558+0000","last_unstale":"2024-05-20T17:53:12.597869+0000","last_undegraded":"2024-05-20T17:53:12.597869+0000","last_fullsized":"2024-05-20T17:53:12.597869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:03.853848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598324+0000","last_change":"2024-05-20T17:53:06.575726+0000","last_active":"2024-05-20T17:53:12.598324+0000","last_peered":"2024-05-20T17:53:12.598324+0000","last_clean":"2024-05-20T17:53:12.598324+0000","last_became_active":"2024-05-20T17:53:06.575405+0000","last_became_peered":"2024-05-20T17:53:06.575405+0000","last_unstale":"2024-05-20T17:53:12.598324+0000","last_undegraded":"2024-05-20T17:53:12.598324+0000","last_fullsized":"2024-05-20T17:53:12.598324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:25:06.815465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244557+0000","last_change":"2024-05-20T17:53:06.570392+0000","last_active":"2024-05-20T17:53:14.244557+0000","last_peered":"2024-05-20T17:53:14.244557+0000","last_clean":"2024-05-20T17:53:14.244557+0000","last_became_active":"2024-05-20T17:53:06.569729+0000","last_became_peered":"2024-05-20T17:53:06.569729+0000","last_unstale":"2024-05-20T17:53:14.244557+0000","last_undegraded":"2024-05-20T17:53:14.244557+0000","last_fullsized":"2024-05-20T17:53:14.244557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:52:31.664838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244969+0000","last_change":"2024-05-20T17:53:07.563453+0000","last_active":"2024-05-20T17:53:14.244969+0000","last_peered":"2024-05-20T17:53:14.244969+0000","last_clean":"2024-05-20T17:53:14.244969+0000","last_became_active":"2024-05-20T17:53:07.563081+0000","last_became_peered":"2024-05-20T17:53:07.563081+0000","last_unstale":"2024-05-20T17:53:14.244969+0000","last_undegraded":"2024-05-20T17:53:14.244969+0000","last_fullsized":"2024-05-20T17:53:14.244969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598694+0000","last_change":"2024-05-20T17:53:11.615867+0000","last_active":"2024-05-20T17:53:12.598694+0000","last_peered":"2024-05-20T17:53:12.598694+0000","last_clean":"2024-05-20T17:53:12.598694+0000","last_became_active":"2024-05-20T17:53:11.615414+0000","last_became_peered":"2024-05-20T17:53:11.615414+0000","last_unstale":"2024-05-20T17:53:12.598694+0000","last_undegraded":"2024-05-20T17:53:12.598694+0000","last_fullsized":"2024-05-20T17:53:12.598694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:26.374404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598758+0000","last_change":"2024-05-20T17:53:06.566530+0000","last_active":"2024-05-20T17:53:12.598758+0000","last_peered":"2024-05-20T17:53:12.598758+0000","last_clean":"2024-05-20T17:53:12.598758+0000","last_became_active":"2024-05-20T17:53:06.566164+0000","last_became_peered":"2024-05-20T17:53:06.566164+0000","last_unstale":"2024-05-20T17:53:12.598758+0000","last_undegraded":"2024-05-20T17:53:12.598758+0000","last_fullsized":"2024-05-20T17:53:12.598758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:05.536252+0000","last_clean_scrub_stamp":"2024-05-20T17:53:05.536252+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:22:58.179989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598733+0000","last_change":"2024-05-20T17:53:07.566366+0000","last_active":"2024-05-20T17:53:12.598733+0000","last_peered":"2024-05-20T17:53:12.598733+0000","last_clean":"2024-05-20T17:53:12.598733+0000","last_became_active":"2024-05-20T17:53:07.564572+0000","last_became_peered":"2024-05-20T17:53:07.564572+0000","last_unstale":"2024-05-20T17:53:12.598733+0000","last_undegraded":"2024-05-20T17:53:12.598733+0000","last_fullsized":"2024-05-20T17:53:12.598733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:07.981032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599855+0000","last_change":"2024-05-20T17:53:11.611213+0000","last_active":"2024-05-20T17:53:12.599855+0000","last_peered":"2024-05-20T17:53:12.599855+0000","last_clean":"2024-05-20T17:53:12.599855+0000","last_became_active":"2024-05-20T17:53:11.610761+0000","last_became_peered":"2024-05-20T17:53:11.610761+0000","last_unstale":"2024-05-20T17:53:12.599855+0000","last_undegraded":"2024-05-20T17:53:12.599855+0000","last_fullsized":"2024-05-20T17:53:12.599855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:10.582695+0000","last_clean_scrub_stamp":"2024-05-20T17:53:10.582695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:10.351145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243764+0000","last_change":"2024-05-20T17:53:07.571745+0000","last_active":"2024-05-20T17:53:14.243764+0000","last_peered":"2024-05-20T17:53:14.243764+0000","last_clean":"2024-05-20T17:53:14.243764+0000","last_became_active":"2024-05-20T17:53:07.571440+0000","last_became_peered":"2024-05-20T17:53:07.571440+0000","last_unstale":"2024-05-20T17:53:14.243764+0000","last_undegraded":"2024-05-20T17:53:14.243764+0000","last_fullsized":"2024-05-20T17:53:14.243764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:50.625084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598579+0000","last_change":"2024-05-20T17:53:07.578996+0000","last_active":"2024-05-20T17:53:12.598579+0000","last_peered":"2024-05-20T17:53:12.598579+0000","last_clean":"2024-05-20T17:53:12.598579+0000","last_became_active":"2024-05-20T17:53:07.578650+0000","last_became_peered":"2024-05-20T17:53:07.578650+0000","last_unstale":"2024-05-20T17:53:12.598579+0000","last_undegraded":"2024-05-20T17:53:12.598579+0000","last_fullsized":"2024-05-20T17:53:12.598579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:26.041335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244224+0000","last_change":"2024-05-20T17:53:07.585434+0000","last_active":"2024-05-20T17:53:14.244224+0000","last_peered":"2024-05-20T17:53:14.244224+0000","last_clean":"2024-05-20T17:53:14.244224+0000","last_became_active":"2024-05-20T17:53:07.584703+0000","last_became_peered":"2024-05-20T17:53:07.584703+0000","last_unstale":"2024-05-20T17:53:14.244224+0000","last_undegraded":"2024-05-20T17:53:14.244224+0000","last_fullsized":"2024-05-20T17:53:14.244224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:45.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244874+0000","last_change":"2024-05-20T17:53:07.587018+0000","last_active":"2024-05-20T17:53:14.244874+0000","last_peered":"2024-05-20T17:53:14.244874+0000","last_clean":"2024-05-20T17:53:14.244874+0000","last_became_active":"2024-05-20T17:53:07.586608+0000","last_became_peered":"2024-05-20T17:53:07.586608+0000","last_unstale":"2024-05-20T17:53:14.244874+0000","last_undegraded":"2024-05-20T17:53:14.244874+0000","last_fullsized":"2024-05-20T17:53:14.244874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599158+0000","last_change":"2024-05-20T17:53:07.588014+0000","last_active":"2024-05-20T17:53:12.599158+0000","last_peered":"2024-05-20T17:53:12.599158+0000","last_clean":"2024-05-20T17:53:12.599158+0000","last_became_active":"2024-05-20T17:53:07.587708+0000","last_became_peered":"2024-05-20T17:53:07.587708+0000","last_unstale":"2024-05-20T17:53:12.599158+0000","last_undegraded":"2024-05-20T17:53:12.599158+0000","last_fullsized":"2024-05-20T17:53:12.599158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244467+0000","last_change":"2024-05-20T17:53:07.588057+0000","last_active":"2024-05-20T17:53:14.244467+0000","last_peered":"2024-05-20T17:53:14.244467+0000","last_clean":"2024-05-20T17:53:14.244467+0000","last_became_active":"2024-05-20T17:53:07.587720+0000","last_became_peered":"2024-05-20T17:53:07.587720+0000","last_unstale":"2024-05-20T17:53:14.244467+0000","last_undegraded":"2024-05-20T17:53:14.244467+0000","last_fullsized":"2024-05-20T17:53:14.244467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244725+0000","last_change":"2024-05-20T17:53:07.572982+0000","last_active":"2024-05-20T17:53:14.244725+0000","last_peered":"2024-05-20T17:53:14.244725+0000","last_clean":"2024-05-20T17:53:14.244725+0000","last_became_active":"2024-05-20T17:53:07.572341+0000","last_became_peered":"2024-05-20T17:53:07.572341+0000","last_unstale":"2024-05-20T17:53:14.244725+0000","last_undegraded":"2024-05-20T17:53:14.244725+0000","last_fullsized":"2024-05-20T17:53:14.244725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599485+0000","last_change":"2024-05-20T17:53:07.586892+0000","last_active":"2024-05-20T17:53:12.599485+0000","last_peered":"2024-05-20T17:53:12.599485+0000","last_clean":"2024-05-20T17:53:12.599485+0000","last_became_active":"2024-05-20T17:53:07.586592+0000","last_became_peered":"2024-05-20T17:53:07.586592+0000","last_unstale":"2024-05-20T17:53:12.599485+0000","last_undegraded":"2024-05-20T17:53:12.599485+0000","last_fullsized":"2024-05-20T17:53:12.599485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243849+0000","last_change":"2024-05-20T17:53:07.585135+0000","last_active":"2024-05-20T17:53:14.243849+0000","last_peered":"2024-05-20T17:53:14.243849+0000","last_clean":"2024-05-20T17:53:14.243849+0000","last_became_active":"2024-05-20T17:53:07.584770+0000","last_became_peered":"2024-05-20T17:53:07.584770+0000","last_unstale":"2024-05-20T17:53:14.243849+0000","last_undegraded":"2024-05-20T17:53:14.243849+0000","last_fullsized":"2024-05-20T17:53:14.243849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:30:19.473626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598173+0000","last_change":"2024-05-20T17:53:07.587589+0000","last_active":"2024-05-20T17:53:12.598173+0000","last_peered":"2024-05-20T17:53:12.598173+0000","last_clean":"2024-05-20T17:53:12.598173+0000","last_became_active":"2024-05-20T17:53:07.587199+0000","last_became_peered":"2024-05-20T17:53:07.587199+0000","last_unstale":"2024-05-20T17:53:12.598173+0000","last_undegraded":"2024-05-20T17:53:12.598173+0000","last_fullsized":"2024-05-20T17:53:12.598173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:42.594009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244099+0000","last_change":"2024-05-20T17:53:07.564879+0000","last_active":"2024-05-20T17:53:14.244099+0000","last_peered":"2024-05-20T17:53:14.244099+0000","last_clean":"2024-05-20T17:53:14.244099+0000","last_became_active":"2024-05-20T17:53:07.564533+0000","last_became_peered":"2024-05-20T17:53:07.564533+0000","last_unstale":"2024-05-20T17:53:14.244099+0000","last_undegraded":"2024-05-20T17:53:14.244099+0000","last_fullsized":"2024-05-20T17:53:14.244099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:40.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244554+0000","last_change":"2024-05-20T17:53:07.573683+0000","last_active":"2024-05-20T17:53:14.244554+0000","last_peered":"2024-05-20T17:53:14.244554+0000","last_clean":"2024-05-20T17:53:14.244554+0000","last_became_active":"2024-05-20T17:53:07.571046+0000","last_became_peered":"2024-05-20T17:53:07.571046+0000","last_unstale":"2024-05-20T17:53:14.244554+0000","last_undegraded":"2024-05-20T17:53:14.244554+0000","last_fullsized":"2024-05-20T17:53:14.244554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244334+0000","last_change":"2024-05-20T17:53:07.574629+0000","last_active":"2024-05-20T17:53:14.244334+0000","last_peered":"2024-05-20T17:53:14.244334+0000","last_clean":"2024-05-20T17:53:14.244334+0000","last_became_active":"2024-05-20T17:53:07.574286+0000","last_became_peered":"2024-05-20T17:53:07.574286+0000","last_unstale":"2024-05-20T17:53:14.244334+0000","last_undegraded":"2024-05-20T17:53:14.244334+0000","last_fullsized":"2024-05-20T17:53:14.244334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:07:29.361856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654699+0000","last_change":"2024-05-20T17:53:07.575422+0000","last_active":"2024-05-20T17:53:13.654699+0000","last_peered":"2024-05-20T17:53:13.654699+0000","last_clean":"2024-05-20T17:53:13.654699+0000","last_became_active":"2024-05-20T17:53:07.575017+0000","last_became_peered":"2024-05-20T17:53:07.575017+0000","last_unstale":"2024-05-20T17:53:13.654699+0000","last_undegraded":"2024-05-20T17:53:13.654699+0000","last_fullsized":"2024-05-20T17:53:13.654699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:45.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.599534+0000","last_change":"2024-05-20T17:53:07.568400+0000","last_active":"2024-05-20T17:53:12.599534+0000","last_peered":"2024-05-20T17:53:12.599534+0000","last_clean":"2024-05-20T17:53:12.599534+0000","last_became_active":"2024-05-20T17:53:07.568013+0000","last_became_peered":"2024-05-20T17:53:07.568013+0000","last_unstale":"2024-05-20T17:53:12.599534+0000","last_undegraded":"2024-05-20T17:53:12.599534+0000","last_fullsized":"2024-05-20T17:53:12.599534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:29:31.503198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245277+0000","last_change":"2024-05-20T17:53:07.564289+0000","last_active":"2024-05-20T17:53:14.245277+0000","last_peered":"2024-05-20T17:53:14.245277+0000","last_clean":"2024-05-20T17:53:14.245277+0000","last_became_active":"2024-05-20T17:53:07.563973+0000","last_became_peered":"2024-05-20T17:53:07.563973+0000","last_unstale":"2024-05-20T17:53:14.245277+0000","last_undegraded":"2024-05-20T17:53:14.245277+0000","last_fullsized":"2024-05-20T17:53:14.245277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243731+0000","last_change":"2024-05-20T17:53:07.560898+0000","last_active":"2024-05-20T17:53:14.243731+0000","last_peered":"2024-05-20T17:53:14.243731+0000","last_clean":"2024-05-20T17:53:14.243731+0000","last_became_active":"2024-05-20T17:53:07.560518+0000","last_became_peered":"2024-05-20T17:53:07.560518+0000","last_unstale":"2024-05-20T17:53:14.243731+0000","last_undegraded":"2024-05-20T17:53:14.243731+0000","last_fullsized":"2024-05-20T17:53:14.243731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:40.001702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243753+0000","last_change":"2024-05-20T17:53:07.569983+0000","last_active":"2024-05-20T17:53:14.243753+0000","last_peered":"2024-05-20T17:53:14.243753+0000","last_clean":"2024-05-20T17:53:14.243753+0000","last_became_active":"2024-05-20T17:53:07.569663+0000","last_became_peered":"2024-05-20T17:53:07.569663+0000","last_unstale":"2024-05-20T17:53:14.243753+0000","last_undegraded":"2024-05-20T17:53:14.243753+0000","last_fullsized":"2024-05-20T17:53:14.243753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244095+0000","last_change":"2024-05-20T17:53:07.566018+0000","last_active":"2024-05-20T17:53:14.244095+0000","last_peered":"2024-05-20T17:53:14.244095+0000","last_clean":"2024-05-20T17:53:14.244095+0000","last_became_active":"2024-05-20T17:53:07.565527+0000","last_became_peered":"2024-05-20T17:53:07.565527+0000","last_unstale":"2024-05-20T17:53:14.244095+0000","last_undegraded":"2024-05-20T17:53:14.244095+0000","last_fullsized":"2024-05-20T17:53:14.244095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:21:17.680092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598017+0000","last_change":"2024-05-20T17:53:07.585449+0000","last_active":"2024-05-20T17:53:12.598017+0000","last_peered":"2024-05-20T17:53:12.598017+0000","last_clean":"2024-05-20T17:53:12.598017+0000","last_became_active":"2024-05-20T17:53:07.585089+0000","last_became_peered":"2024-05-20T17:53:07.585089+0000","last_unstale":"2024-05-20T17:53:12.598017+0000","last_undegraded":"2024-05-20T17:53:12.598017+0000","last_fullsized":"2024-05-20T17:53:12.598017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.598876+0000","last_change":"2024-05-20T17:53:07.567630+0000","last_active":"2024-05-20T17:53:12.598876+0000","last_peered":"2024-05-20T17:53:12.598876+0000","last_clean":"2024-05-20T17:53:12.598876+0000","last_became_active":"2024-05-20T17:53:07.565841+0000","last_became_peered":"2024-05-20T17:53:07.565841+0000","last_unstale":"2024-05-20T17:53:12.598876+0000","last_undegraded":"2024-05-20T17:53:12.598876+0000","last_fullsized":"2024-05-20T17:53:12.598876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:28.255939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244959+0000","last_change":"2024-05-20T17:53:07.577572+0000","last_active":"2024-05-20T17:53:14.244959+0000","last_peered":"2024-05-20T17:53:14.244959+0000","last_clean":"2024-05-20T17:53:14.244959+0000","last_became_active":"2024-05-20T17:53:07.577248+0000","last_became_peered":"2024-05-20T17:53:07.577248+0000","last_unstale":"2024-05-20T17:53:14.244959+0000","last_undegraded":"2024-05-20T17:53:14.244959+0000","last_fullsized":"2024-05-20T17:53:14.244959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:31.709868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244594+0000","last_change":"2024-05-20T17:53:07.580278+0000","last_active":"2024-05-20T17:53:14.244594+0000","last_peered":"2024-05-20T17:53:14.244594+0000","last_clean":"2024-05-20T17:53:14.244594+0000","last_became_active":"2024-05-20T17:53:07.579918+0000","last_became_peered":"2024-05-20T17:53:07.579918+0000","last_unstale":"2024-05-20T17:53:14.244594+0000","last_undegraded":"2024-05-20T17:53:14.244594+0000","last_fullsized":"2024-05-20T17:53:14.244594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:07.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654876+0000","last_change":"2024-05-20T17:53:07.571649+0000","last_active":"2024-05-20T17:53:13.654876+0000","last_peered":"2024-05-20T17:53:13.654876+0000","last_clean":"2024-05-20T17:53:13.654876+0000","last_became_active":"2024-05-20T17:53:07.570372+0000","last_became_peered":"2024-05-20T17:53:07.570372+0000","last_unstale":"2024-05-20T17:53:13.654876+0000","last_undegraded":"2024-05-20T17:53:13.654876+0000","last_fullsized":"2024-05-20T17:53:13.654876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:14:20.277613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:12.597720+0000","last_change":"2024-05-20T17:53:07.584911+0000","last_active":"2024-05-20T17:53:12.597720+0000","last_peered":"2024-05-20T17:53:12.597720+0000","last_clean":"2024-05-20T17:53:12.597720+0000","last_became_active":"2024-05-20T17:53:07.584544+0000","last_became_peered":"2024-05-20T17:53:07.584544+0000","last_unstale":"2024-05-20T17:53:12.597720+0000","last_undegraded":"2024-05-20T17:53:12.597720+0000","last_fullsized":"2024-05-20T17:53:12.597720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:15:52.666016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654120+0000","last_change":"2024-05-20T17:53:07.580955+0000","last_active":"2024-05-20T17:53:13.654120+0000","last_peered":"2024-05-20T17:53:13.654120+0000","last_clean":"2024-05-20T17:53:13.654120+0000","last_became_active":"2024-05-20T17:53:07.580587+0000","last_became_peered":"2024-05-20T17:53:07.580587+0000","last_unstale":"2024-05-20T17:53:13.654120+0000","last_undegraded":"2024-05-20T17:53:13.654120+0000","last_fullsized":"2024-05-20T17:53:13.654120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:40.229551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.243911+0000","last_change":"2024-05-20T17:53:07.570792+0000","last_active":"2024-05-20T17:53:14.243911+0000","last_peered":"2024-05-20T17:53:14.243911+0000","last_clean":"2024-05-20T17:53:14.243911+0000","last_became_active":"2024-05-20T17:53:07.570501+0000","last_became_peered":"2024-05-20T17:53:07.570501+0000","last_unstale":"2024-05-20T17:53:14.243911+0000","last_undegraded":"2024-05-20T17:53:14.243911+0000","last_fullsized":"2024-05-20T17:53:14.243911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654229+0000","last_change":"2024-05-20T17:53:07.573875+0000","last_active":"2024-05-20T17:53:13.654229+0000","last_peered":"2024-05-20T17:53:13.654229+0000","last_clean":"2024-05-20T17:53:13.654229+0000","last_became_active":"2024-05-20T17:53:07.573520+0000","last_became_peered":"2024-05-20T17:53:07.573520+0000","last_unstale":"2024-05-20T17:53:13.654229+0000","last_undegraded":"2024-05-20T17:53:13.654229+0000","last_fullsized":"2024-05-20T17:53:13.654229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:44:24.809917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244998+0000","last_change":"2024-05-20T17:53:07.588340+0000","last_active":"2024-05-20T17:53:14.244998+0000","last_peered":"2024-05-20T17:53:14.244998+0000","last_clean":"2024-05-20T17:53:14.244998+0000","last_became_active":"2024-05-20T17:53:07.588012+0000","last_became_peered":"2024-05-20T17:53:07.588012+0000","last_unstale":"2024-05-20T17:53:14.244998+0000","last_undegraded":"2024-05-20T17:53:14.244998+0000","last_fullsized":"2024-05-20T17:53:14.244998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:17.052738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.244499+0000","last_change":"2024-05-20T17:53:07.570831+0000","last_active":"2024-05-20T17:53:14.244499+0000","last_peered":"2024-05-20T17:53:14.244499+0000","last_clean":"2024-05-20T17:53:14.244499+0000","last_became_active":"2024-05-20T17:53:07.570499+0000","last_became_peered":"2024-05-20T17:53:07.570499+0000","last_unstale":"2024-05-20T17:53:14.244499+0000","last_undegraded":"2024-05-20T17:53:14.244499+0000","last_fullsized":"2024-05-20T17:53:14.244499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:50.625084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:14.245012+0000","last_change":"2024-05-20T17:53:07.580456+0000","last_active":"2024-05-20T17:53:14.245012+0000","last_peered":"2024-05-20T17:53:14.245012+0000","last_clean":"2024-05-20T17:53:14.245012+0000","last_became_active":"2024-05-20T17:53:07.580093+0000","last_became_peered":"2024-05-20T17:53:07.580093+0000","last_unstale":"2024-05-20T17:53:14.245012+0000","last_undegraded":"2024-05-20T17:53:14.245012+0000","last_fullsized":"2024-05-20T17:53:14.245012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:40.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-20T17:53:13.654731+0000","last_change":"2024-05-20T17:53:07.571268+0000","last_active":"2024-05-20T17:53:13.654731+0000","last_peered":"2024-05-20T17:53:13.654731+0000","last_clean":"2024-05-20T17:53:13.654731+0000","last_became_active":"2024-05-20T17:53:07.570549+0000","last_became_peered":"2024-05-20T17:53:07.570549+0000","last_unstale":"2024-05-20T17:53:13.654731+0000","last_undegraded":"2024-05-20T17:53:13.654731+0000","last_fullsized":"2024-05-20T17:53:13.654731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:53:06.543210+0000","last_clean_scrub_stamp":"2024-05-20T17:53:06.543210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:42:57.588801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:53:35.820 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-20T17:53:35.820 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-20T17:53:35.820 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-20T17:53:35.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:53:35.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.971+0000 7f5e114fe640 1 Processor -- start 2024-05-20T17:53:35.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.971+0000 7f5e114fe640 1 -- start start 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e114fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e0c0b4b70 0x7f5e0c0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e114fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5e0c0cf7a0 0x7f5e0c0b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e114fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e0c15c340 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e114fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5e0c0b46e0 con 0x7f5e0c0b4b70 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e114fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5e0c06f900 con 0x7f5e0c0cf7a0 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e0affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e0c0b4b70 0x7f5e0c0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e0affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e0c0b4b70 0x7f5e0c0b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46658/0 (socket says 172.21.15.6:46658) 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e0affd640 1 -- 172.21.15.6:0/1648143311 learned_addr learned my addr 172.21.15.6:0/1648143311 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e0b7fe640 1 --2- 172.21.15.6:0/1648143311 >> v2:172.21.15.171:3300/0 conn(0x7f5e0c0cf7a0 0x7f5e0c0b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e0affd640 1 -- 172.21.15.6:0/1648143311 >> v2:172.21.15.171:3300/0 conn(0x7f5e0c0cf7a0 msgr2=0x7f5e0c0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:35.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e0affd640 1 --2- 172.21.15.6:0/1648143311 >> v2:172.21.15.171:3300/0 conn(0x7f5e0c0cf7a0 0x7f5e0c0b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e0affd640 1 -- 172.21.15.6:0/1648143311 >> v1:172.21.15.171:6789/0 conn(0x7f5e0c0b3d90 legacy=0x7f5e0c15fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.973+0000 7f5e0affd640 1 -- 172.21.15.6:0/1648143311 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c06fbe0 con 0x7f5e0c0b4b70 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.974+0000 7f5e0affd640 1 --2- 172.21.15.6:0/1648143311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b4b70 0x7f5e0c0b3850 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0cdf90 tx=0x7f5dfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84085eae72e0fceb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.974+0000 7f5e0a7fc640 1 -- 172.21.15.6:0/1648143311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc037070 con 0x7f5e0c0b4b70 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.974+0000 7f5e0a7fc640 1 -- 172.21.15.6:0/1648143311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc032440 con 0x7f5e0c0b4b70 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.974+0000 7f5e0a7fc640 1 -- 172.21.15.6:0/1648143311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc032810 con 0x7f5e0c0b4b70 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.975+0000 7f5e114fe640 1 -- 172.21.15.6:0/1648143311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b4b70 msgr2=0x7f5e0c0b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.975+0000 7f5e114fe640 1 --2- 172.21.15.6:0/1648143311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b4b70 0x7f5e0c0b3850 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0cdf90 tx=0x7f5dfc02a270 comp rx=0 tx=0).stop 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.975+0000 7f5e114fe640 1 -- 172.21.15.6:0/1648143311 shutdown_connections 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.975+0000 7f5e114fe640 1 --2- 172.21.15.6:0/1648143311 >> v2:172.21.15.171:3300/0 conn(0x7f5e0c0cf7a0 0x7f5e0c0b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.975+0000 7f5e114fe640 1 --2- 172.21.15.6:0/1648143311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b4b70 0x7f5e0c0b3850 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.975+0000 7f5e114fe640 1 -- 172.21.15.6:0/1648143311 >> 172.21.15.6:0/1648143311 conn(0x7f5e0c0cd2a0 msgr2=0x7f5e0c0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:35.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.975+0000 7f5e114fe640 1 -- 172.21.15.6:0/1648143311 shutdown_connections 2024-05-20T17:53:35.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.975+0000 7f5e114fe640 1 -- 172.21.15.6:0/1648143311 wait complete. 2024-05-20T17:53:35.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.977+0000 7f5e114fe640 1 Processor -- start 2024-05-20T17:53:35.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.977+0000 7f5e114fe640 1 -- start start 2024-05-20T17:53:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.978+0000 7f5e114fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b3d90 0x7f5e0c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.978+0000 7f5e114fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e0c0b4b70 0x7f5e0c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.978+0000 7f5e114fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e0c0cf7a0 0x7f5e0c1f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.978+0000 7f5e114fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c070480 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.978+0000 7f5e114fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c0701a0 con 0x7f5e0c0b4b70 2024-05-20T17:53:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.978+0000 7f5e114fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5e0c06f4b0 con 0x7f5e0c0cf7a0 2024-05-20T17:53:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b3d90 0x7f5e0c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b3d90 0x7f5e0c15c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46666/0 (socket says 172.21.15.6:46666) 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 -- 172.21.15.6:0/2047130330 learned_addr learned my addr 172.21.15.6:0/2047130330 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e03fff640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e0c0b4b70 0x7f5e0c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0b7fe640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e0c0cf7a0 0x7f5e0c1f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 -- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e0c0cf7a0 msgr2=0x7f5e0c1f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e0c0cf7a0 0x7f5e0c1f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 -- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e0c0b4b70 msgr2=0x7f5e0c1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e0c0b4b70 0x7f5e0c1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 -- 172.21.15.6:0/2047130330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c15ca50 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e0affd640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b3d90 0x7f5e0c15c510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc02a2b0 tx=0x7f5dfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e037fe640 1 -- 172.21.15.6:0/2047130330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc037040 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e037fe640 1 -- 172.21.15.6:0/2047130330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc042070 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c157e00 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.979+0000 7f5e037fe640 1 -- 172.21.15.6:0/2047130330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc030880 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.980+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c1e7ef0 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.981+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0c0690b0 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.981+0000 7f5e037fe640 1 -- 172.21.15.6:0/2047130330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dfc030a20 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.982+0000 7f5e037fe640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dec06be30 0x7f5dec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.982+0000 7f5e037fe640 1 -- 172.21.15.6:0/2047130330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5dfc0ab950 con 0x7f5e0c0b3d90 2024-05-20T17:53:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.982+0000 7f5e03fff640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dec06be30 0x7f5dec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.982+0000 7f5e03fff640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dec06be30 0x7f5dec06e340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0b5990 tx=0x7f5df4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:35.986+0000 7f5e037fe640 1 -- 172.21.15.6:0/2047130330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5dfc0798e0 con 0x7f5e0c0b3d90 2024-05-20T17:53:36.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.230+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5e0c0b48f0 con 0x7f5e0c0b3d90 2024-05-20T17:53:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.230+0000 7f5e037fe640 1 -- 172.21.15.6:0/2047130330 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5dfc07dbe0 con 0x7f5e0c0b3d90 2024-05-20T17:53:36.230 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:36.230 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-20T17:53:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dec06be30 msgr2=0x7f5dec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dec06be30 0x7f5dec06e340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0b5990 tx=0x7f5df4009040 comp rx=0 tx=0).stop 2024-05-20T17:53:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b3d90 msgr2=0x7f5e0c15c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b3d90 0x7f5e0c15c510 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc02a2b0 tx=0x7f5dfc0046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 shutdown_connections 2024-05-20T17:53:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dec06be30 0x7f5dec06e340 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e0c0cf7a0 0x7f5e0c1f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e0c0b4b70 0x7f5e0c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 --2- 172.21.15.6:0/2047130330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e0c0b3d90 0x7f5e0c15c510 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 >> 172.21.15.6:0/2047130330 conn(0x7f5e0c0cd2a0 msgr2=0x7f5e0c15a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 shutdown_connections 2024-05-20T17:53:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.232+0000 7f5e114fe640 1 -- 172.21.15.6:0/2047130330 wait complete. 2024-05-20T17:53:36.243 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-20T17:53:36.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.358+0000 7f6647475640 1 Processor -- start 2024-05-20T17:53:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.359+0000 7f6647475640 1 -- start start 2024-05-20T17:53:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6647475640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f664015d530 0x7f664015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6647475640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66400b1700 0x7f66400b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6647475640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66400cd580 con 0x7f6640070850 2024-05-20T17:53:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6647475640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f66400ce190 con 0x7f664015d530 2024-05-20T17:53:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6647475640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66400cd860 con 0x7f66400b1700 2024-05-20T17:53:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6645211640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f664015d530 0x7f664015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6645211640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f664015d530 0x7f664015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46670/0 (socket says 172.21.15.6:46670) 2024-05-20T17:53:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6645211640 1 -- 172.21.15.6:0/581025954 learned_addr learned my addr 172.21.15.6:0/581025954 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:36.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.360+0000 7f6644a10640 1 --2- 172.21.15.6:0/581025954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66400b1700 0x7f66400b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.361+0000 7f6645211640 1 -- 172.21.15.6:0/581025954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66400b1700 msgr2=0x7f66400b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:36.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.361+0000 7f6645211640 1 --2- 172.21.15.6:0/581025954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66400b1700 0x7f66400b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.361+0000 7f6645211640 1 -- 172.21.15.6:0/581025954 >> v1:172.21.15.171:6789/0 conn(0x7f6640070850 legacy=0x7f6640070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.361+0000 7f6645211640 1 -- 172.21.15.6:0/581025954 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66400cdb40 con 0x7f664015d530 2024-05-20T17:53:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.361+0000 7f6645211640 1 --2- 172.21.15.6:0/581025954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664015d530 0x7f664015aaa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f663c009870 tx=0x7f663c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ce172b776fa7cc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.361+0000 7f6633fff640 1 -- 172.21.15.6:0/581025954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c037070 con 0x7f664015d530 2024-05-20T17:53:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6633fff640 1 -- 172.21.15.6:0/581025954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663c032440 con 0x7f664015d530 2024-05-20T17:53:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6633fff640 1 -- 172.21.15.6:0/581025954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c032810 con 0x7f664015d530 2024-05-20T17:53:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6647475640 1 -- 172.21.15.6:0/581025954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664015d530 msgr2=0x7f664015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6647475640 1 --2- 172.21.15.6:0/581025954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664015d530 0x7f664015aaa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f663c009870 tx=0x7f663c02a270 comp rx=0 tx=0).stop 2024-05-20T17:53:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6647475640 1 -- 172.21.15.6:0/581025954 shutdown_connections 2024-05-20T17:53:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6647475640 1 --2- 172.21.15.6:0/581025954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66400b1700 0x7f66400b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6647475640 1 --2- 172.21.15.6:0/581025954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664015d530 0x7f664015aaa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6647475640 1 -- 172.21.15.6:0/581025954 >> 172.21.15.6:0/581025954 conn(0x7f66400d29d0 msgr2=0x7f66400d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6647475640 1 -- 172.21.15.6:0/581025954 shutdown_connections 2024-05-20T17:53:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.362+0000 7f6647475640 1 -- 172.21.15.6:0/581025954 wait complete. 2024-05-20T17:53:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.364+0000 7f6647475640 1 Processor -- start 2024-05-20T17:53:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.364+0000 7f6647475640 1 -- start start 2024-05-20T17:53:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.365+0000 7f6647475640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640070850 0x7f664006c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.365+0000 7f6647475640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66400b1700 0x7f66400cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.365+0000 7f6647475640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664015d530 0x7f66400ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.365+0000 7f6647475640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66400b2050 con 0x7f6640070850 2024-05-20T17:53:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.365+0000 7f6647475640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66400cd230 con 0x7f66400b1700 2024-05-20T17:53:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.365+0000 7f6647475640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6640071370 con 0x7f664015d530 2024-05-20T17:53:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640070850 0x7f664006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640070850 0x7f664006c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46672/0 (socket says 172.21.15.6:46672) 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 -- 172.21.15.6:0/3116806293 learned_addr learned my addr 172.21.15.6:0/3116806293 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6644a10640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66400b1700 0x7f66400cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645a12640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664015d530 0x7f66400ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 -- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664015d530 msgr2=0x7f66400ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664015d530 0x7f66400ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 -- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66400b1700 msgr2=0x7f66400cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66400b1700 0x7f66400cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 -- 172.21.15.6:0/3116806293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664006d4f0 con 0x7f6640070850 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6645211640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640070850 0x7f664006c630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f663c000c00 tx=0x7f663c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6631ffb640 1 -- 172.21.15.6:0/3116806293 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c037040 con 0x7f6640070850 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6631ffb640 1 -- 172.21.15.6:0/3116806293 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663c042070 con 0x7f6640070850 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664006cf30 con 0x7f6640070850 2024-05-20T17:53:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.366+0000 7f6631ffb640 1 -- 172.21.15.6:0/3116806293 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c030880 con 0x7f6640070850 2024-05-20T17:53:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.367+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66400c9b20 con 0x7f6640070850 2024-05-20T17:53:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.368+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66400c9f60 con 0x7f6640070850 2024-05-20T17:53:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.369+0000 7f6631ffb640 1 -- 172.21.15.6:0/3116806293 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f663c030a20 con 0x7f6640070850 2024-05-20T17:53:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.370+0000 7f6631ffb640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f662406be30 0x7f662406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.370+0000 7f6631ffb640 1 -- 172.21.15.6:0/3116806293 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f663c0ab910 con 0x7f6640070850 2024-05-20T17:53:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.370+0000 7f6644a10640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f662406be30 0x7f662406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.371+0000 7f6644a10640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f662406be30 0x7f662406e340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f664015cb20 tx=0x7f6634009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:36.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.374+0000 7f6631ffb640 1 -- 172.21.15.6:0/3116806293 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f663c079930 con 0x7f6640070850 2024-05-20T17:53:36.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.560+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6640075b00 con 0x7f6640070850 2024-05-20T17:53:36.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.562+0000 7f6631ffb640 1 -- 172.21.15.6:0/3116806293 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f663c07dc30 con 0x7f6640070850 2024-05-20T17:53:36.561 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:36.561 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f662406be30 msgr2=0x7f662406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f662406be30 0x7f662406e340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f664015cb20 tx=0x7f6634009190 comp rx=0 tx=0).stop 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640070850 msgr2=0x7f664006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640070850 0x7f664006c630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f663c000c00 tx=0x7f663c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 shutdown_connections 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f662406be30 0x7f662406e340 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664015d530 0x7f66400ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66400b1700 0x7f66400cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 --2- 172.21.15.6:0/3116806293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6640070850 0x7f664006c630 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 >> 172.21.15.6:0/3116806293 conn(0x7f66400d29d0 msgr2=0x7f664015f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:36.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 shutdown_connections 2024-05-20T17:53:36.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.564+0000 7f6647475640 1 -- 172.21.15.6:0/3116806293 wait complete. 2024-05-20T17:53:36.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:36.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.696+0000 7fc84a58f640 1 Processor -- start 2024-05-20T17:53:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.696+0000 7fc84a58f640 1 -- start start 2024-05-20T17:53:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.697+0000 7fc84a58f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc844159ca0 0x7fc8440af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.697+0000 7fc84a58f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8440b1650 0x7fc8440b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.697+0000 7fc84a58f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc84406c630 0x7fc8440b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.697+0000 7fc84a58f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc84409a4f0 con 0x7fc84406c630 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.697+0000 7fc84a58f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc84409b350 con 0x7fc844159ca0 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.697+0000 7fc84a58f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc8440af770 con 0x7fc8440b1650 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.697+0000 7fc848b2c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc84406c630 0x7fc8440b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc848b2c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc84406c630 0x7fc8440b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46676/0 (socket says 172.21.15.6:46676) 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc848b2c640 1 -- 172.21.15.6:0/1459913549 learned_addr learned my addr 172.21.15.6:0/1459913549 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc843fff640 1 --2- 172.21.15.6:0/1459913549 >> v2:172.21.15.171:3300/0 conn(0x7fc844159ca0 0x7fc8440af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc83bfff640 1 --2- 172.21.15.6:0/1459913549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8440b1650 0x7fc8440b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc848b2c640 1 -- 172.21.15.6:0/1459913549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8440b1650 msgr2=0x7fc8440b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc848b2c640 1 --2- 172.21.15.6:0/1459913549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8440b1650 0x7fc8440b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc848b2c640 1 -- 172.21.15.6:0/1459913549 >> v2:172.21.15.171:3300/0 conn(0x7fc844159ca0 msgr2=0x7fc8440af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc848b2c640 1 --2- 172.21.15.6:0/1459913549 >> v2:172.21.15.171:3300/0 conn(0x7fc844159ca0 0x7fc8440af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.698+0000 7fc848b2c640 1 -- 172.21.15.6:0/1459913549 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84409a740 con 0x7fc84406c630 2024-05-20T17:53:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.699+0000 7fc848b2c640 1 --2- 172.21.15.6:0/1459913549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84406c630 0x7fc8440b2220 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc8440af8f0 tx=0x7fc83c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91382131b3384d4f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.699+0000 7fc8437fe640 1 -- 172.21.15.6:0/1459913549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c036070 con 0x7fc84406c630 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.699+0000 7fc8437fe640 1 -- 172.21.15.6:0/1459913549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c031600 con 0x7fc84406c630 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.699+0000 7fc8437fe640 1 -- 172.21.15.6:0/1459913549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0319d0 con 0x7fc84406c630 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 -- 172.21.15.6:0/1459913549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84406c630 msgr2=0x7fc8440b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 --2- 172.21.15.6:0/1459913549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84406c630 0x7fc8440b2220 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc8440af8f0 tx=0x7fc83c02a5f0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 -- 172.21.15.6:0/1459913549 shutdown_connections 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 --2- 172.21.15.6:0/1459913549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc84406c630 0x7fc8440b2220 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 --2- 172.21.15.6:0/1459913549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8440b1650 0x7fc8440b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 --2- 172.21.15.6:0/1459913549 >> v2:172.21.15.171:3300/0 conn(0x7fc844159ca0 0x7fc8440af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 -- 172.21.15.6:0/1459913549 >> 172.21.15.6:0/1459913549 conn(0x7fc8440b6620 msgr2=0x7fc8440b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 -- 172.21.15.6:0/1459913549 shutdown_connections 2024-05-20T17:53:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.700+0000 7fc84a58f640 1 -- 172.21.15.6:0/1459913549 wait complete. 2024-05-20T17:53:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.702+0000 7fc84a58f640 1 Processor -- start 2024-05-20T17:53:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.702+0000 7fc84a58f640 1 -- start start 2024-05-20T17:53:36.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc84a58f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc84406c630 0x7fc844151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc84a58f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8440b1650 0x7fc844152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc84a58f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc844159ca0 0x7fc84414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc84a58f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc84409afe0 con 0x7fc844159ca0 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc84a58f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc84409ad00 con 0x7fc8440b1650 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc84a58f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc84415c760 con 0x7fc84406c630 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc848b2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc844159ca0 0x7fc84414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc848b2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc844159ca0 0x7fc84414f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46692/0 (socket says 172.21.15.6:46692) 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc848b2c640 1 -- 172.21.15.6:0/794175931 learned_addr learned my addr 172.21.15.6:0/794175931 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc83bfff640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8440b1650 0x7fc844152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc843fff640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc84406c630 0x7fc844151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc848b2c640 1 -- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc84406c630 msgr2=0x7fc844151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc848b2c640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc84406c630 0x7fc844151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc848b2c640 1 -- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8440b1650 msgr2=0x7fc844152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc848b2c640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8440b1650 0x7fc844152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc848b2c640 1 -- 172.21.15.6:0/794175931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84415e680 con 0x7fc844159ca0 2024-05-20T17:53:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.703+0000 7fc843fff640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc84406c630 0x7fc844151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.704+0000 7fc848b2c640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc844159ca0 0x7fc84414f1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc83c02abe0 tx=0x7fc83c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.704+0000 7fc8417fa640 1 -- 172.21.15.6:0/794175931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c036050 con 0x7fc844159ca0 2024-05-20T17:53:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.704+0000 7fc8417fa640 1 -- 172.21.15.6:0/794175931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c042070 con 0x7fc844159ca0 2024-05-20T17:53:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.704+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84415e960 con 0x7fc844159ca0 2024-05-20T17:53:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.704+0000 7fc8417fa640 1 -- 172.21.15.6:0/794175931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c009510 con 0x7fc844159ca0 2024-05-20T17:53:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.704+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84415ef20 con 0x7fc844159ca0 2024-05-20T17:53:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.705+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84415e3f0 con 0x7fc844159ca0 2024-05-20T17:53:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.706+0000 7fc8417fa640 1 -- 172.21.15.6:0/794175931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc83c007bd0 con 0x7fc844159ca0 2024-05-20T17:53:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.706+0000 7fc8417fa640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc82406be30 0x7fc82406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.706+0000 7fc8417fa640 1 -- 172.21.15.6:0/794175931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc83c0abfc0 con 0x7fc844159ca0 2024-05-20T17:53:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.707+0000 7fc843fff640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc82406be30 0x7fc82406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.707+0000 7fc843fff640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc82406be30 0x7fc82406e340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc834006fd0 tx=0x7fc834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.711+0000 7fc8417fa640 1 -- 172.21.15.6:0/794175931 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc83c07a630 con 0x7fc844159ca0 2024-05-20T17:53:36.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.894+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc844075b00 con 0x7fc844159ca0 2024-05-20T17:53:36.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.894+0000 7fc8417fa640 1 -- 172.21.15.6:0/794175931 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fc83c079f30 con 0x7fc844159ca0 2024-05-20T17:53:36.894 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:36.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc82406be30 msgr2=0x7fc82406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc82406be30 0x7fc82406e340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc834006fd0 tx=0x7fc834008040 comp rx=0 tx=0).stop 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc844159ca0 msgr2=0x7fc84414f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc844159ca0 0x7fc84414f1d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc83c02abe0 tx=0x7fc83c004a40 comp rx=0 tx=0).stop 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 shutdown_connections 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc82406be30 0x7fc82406e340 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc844159ca0 0x7fc84414f1d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc8440b1650 0x7fc844152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 --2- 172.21.15.6:0/794175931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc84406c630 0x7fc844151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 >> 172.21.15.6:0/794175931 conn(0x7fc8440b6620 msgr2=0x7fc844070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 shutdown_connections 2024-05-20T17:53:36.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:36.897+0000 7fc84a58f640 1 -- 172.21.15.6:0/794175931 wait complete. 2024-05-20T17:53:36.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.026+0000 7f2ff5510640 1 Processor -- start 2024-05-20T17:53:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.026+0000 7f2ff5510640 1 -- start start 2024-05-20T17:53:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2ff5510640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff006d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2ff5510640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff006c840 con 0x7f2ff00af740 2024-05-20T17:53:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2ff5510640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff00d20d0 con 0x7f2ff00af330 2024-05-20T17:53:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2ff5510640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff00afb50 con 0x7f2ff00b2560 2024-05-20T17:53:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2fee7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2ff00af740 0x7f2ff00b1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39740/0 (socket says 172.21.15.6:39740) 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2fee7fc640 1 -- 172.21.15.6:0/2605160451 learned_addr learned my addr 172.21.15.6:0/2605160451 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2fef7fe640 1 --2- 172.21.15.6:0/2605160451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff006d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2fedffb640 1 -- 172.21.15.6:0/2605160451 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392967908 0 0) 0x7f2ff006c840 con 0x7f2ff00af740 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.027+0000 7f2fedffb640 1 -- 172.21.15.6:0/2605160451 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd8003520 con 0x7f2ff00af740 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.028+0000 7f2fedffb640 1 -- 172.21.15.6:0/2605160451 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413909061 0 0) 0x7f2ff00d20d0 con 0x7f2ff00af330 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.028+0000 7f2fedffb640 1 -- 172.21.15.6:0/2605160451 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff006c840 con 0x7f2ff00af330 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.028+0000 7f2fef7fe640 1 -- 172.21.15.6:0/2605160451 >> v1:172.21.15.171:6789/0 conn(0x7f2ff00af330 legacy=0x7f2ff00d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.028+0000 7f2fef7fe640 1 -- 172.21.15.6:0/2605160451 >> v1:172.21.15.6:6789/0 conn(0x7f2ff00af740 legacy=0x7f2ff00b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.028+0000 7f2fef7fe640 1 -- 172.21.15.6:0/2605160451 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff006cae0 con 0x7f2ff00b2560 2024-05-20T17:53:37.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.028+0000 7f2fef7fe640 1 --2- 172.21.15.6:0/2605160451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff006d5c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80097d0 tx=0x7f2fe802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dcf5de2fafd0f51 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2fedffb640 1 -- 172.21.15.6:0/2605160451 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8037070 con 0x7f2ff00b2560 2024-05-20T17:53:37.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2fedffb640 1 -- 172.21.15.6:0/2605160451 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8032440 con 0x7f2ff00b2560 2024-05-20T17:53:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2fedffb640 1 -- 172.21.15.6:0/2605160451 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8032810 con 0x7f2ff00b2560 2024-05-20T17:53:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2ff5510640 1 -- 172.21.15.6:0/2605160451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 msgr2=0x7f2ff006d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2ff5510640 1 --2- 172.21.15.6:0/2605160451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff006d5c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80097d0 tx=0x7f2fe802a210 comp rx=0 tx=0).stop 2024-05-20T17:53:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2ff5510640 1 -- 172.21.15.6:0/2605160451 shutdown_connections 2024-05-20T17:53:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2ff5510640 1 --2- 172.21.15.6:0/2605160451 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff006d5c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2ff5510640 1 -- 172.21.15.6:0/2605160451 >> 172.21.15.6:0/2605160451 conn(0x7f2ff00b6670 msgr2=0x7f2ff00b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2ff5510640 1 -- 172.21.15.6:0/2605160451 shutdown_connections 2024-05-20T17:53:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.029+0000 7f2ff5510640 1 -- 172.21.15.6:0/2605160451 wait complete. 2024-05-20T17:53:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.031+0000 7f2ff5510640 1 Processor -- start 2024-05-20T17:53:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.031+0000 7f2ff5510640 1 -- start start 2024-05-20T17:53:37.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2ff5510640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff00af330 0x7f2ff00cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2ff5510640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00af740 0x7f2ff0154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2ff5510640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff0155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2ff5510640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff015d350 con 0x7f2ff00af740 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2ff5510640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff006d0a0 con 0x7f2ff00af330 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2ff5510640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff00d1d20 con 0x7f2ff00b2560 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00af740 0x7f2ff0154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00af740 0x7f2ff0154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46698/0 (socket says 172.21.15.6:46698) 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 -- 172.21.15.6:0/3465036251 learned_addr learned my addr 172.21.15.6:0/3465036251 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2feeffd640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff00af330 0x7f2ff00cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fef7fe640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff0155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 -- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 msgr2=0x7f2ff0155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff0155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 -- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff00af330 msgr2=0x7f2ff00cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff00af330 0x7f2ff00cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 -- 172.21.15.6:0/3465036251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff00cbbd0 con 0x7f2ff00af740 2024-05-20T17:53:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.033+0000 7f2fee7fc640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00af740 0x7f2ff0154e40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c400 tx=0x7f2fe400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.034+0000 7f2fd77fe640 1 -- 172.21.15.6:0/3465036251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4017070 con 0x7f2ff00af740 2024-05-20T17:53:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.034+0000 7f2fd77fe640 1 -- 172.21.15.6:0/3465036251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe4005ce0 con 0x7f2ff00af740 2024-05-20T17:53:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.034+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff00cbeb0 con 0x7f2ff00af740 2024-05-20T17:53:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.034+0000 7f2fd77fe640 1 -- 172.21.15.6:0/3465036251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40072d0 con 0x7f2ff00af740 2024-05-20T17:53:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.034+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff00cc470 con 0x7f2ff00af740 2024-05-20T17:53:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.035+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff00cb940 con 0x7f2ff00af740 2024-05-20T17:53:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.035+0000 7f2fd77fe640 1 -- 172.21.15.6:0/3465036251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fe401a070 con 0x7f2ff00af740 2024-05-20T17:53:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.036+0000 7f2fd77fe640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fdc06be60 0x7f2fdc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.036+0000 7f2fd77fe640 1 -- 172.21.15.6:0/3465036251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2fe408a470 con 0x7f2ff00af740 2024-05-20T17:53:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.036+0000 7f2feeffd640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fdc06be60 0x7f2fdc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.037+0000 7f2feeffd640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fdc06be60 0x7f2fdc06e370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00af0a0 tx=0x7f2fe0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.040+0000 7f2fd77fe640 1 -- 172.21.15.6:0/3465036251 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2fe4058410 con 0x7f2ff00af740 2024-05-20T17:53:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.223+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2ff0075b00 con 0x7f2ff00af740 2024-05-20T17:53:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.224+0000 7f2fd77fe640 1 -- 172.21.15.6:0/3465036251 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f2fe405c710 con 0x7f2ff00af740 2024-05-20T17:53:37.223 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fdc06be60 msgr2=0x7f2fdc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fdc06be60 0x7f2fdc06e370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00af0a0 tx=0x7f2fe0009040 comp rx=0 tx=0).stop 2024-05-20T17:53:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00af740 msgr2=0x7f2ff0154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00af740 0x7f2ff0154e40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c400 tx=0x7f2fe400c8c0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 shutdown_connections 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2fdc06be60 0x7f2fdc06e370 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ff00b2560 0x7f2ff0155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ff00af740 0x7f2ff0154e40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 --2- 172.21.15.6:0/3465036251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ff00af330 0x7f2ff00cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 >> 172.21.15.6:0/3465036251 conn(0x7f2ff00b6670 msgr2=0x7f2ff00b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 shutdown_connections 2024-05-20T17:53:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.226+0000 7f2ff5510640 1 -- 172.21.15.6:0/3465036251 wait complete. 2024-05-20T17:53:37.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:37.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.355+0000 7f6e615cc640 1 Processor -- start 2024-05-20T17:53:37.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.355+0000 7f6e615cc640 1 -- start start 2024-05-20T17:53:37.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.356+0000 7f6e615cc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6e5c163a10 0x7f6e5c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e615cc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e5c0b4010 0x7f6e5c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e615cc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5c0d0370 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e615cc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c0d3ca0 con 0x7f6e5c0b4010 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e615cc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c0d0650 con 0x7f6e5c163a10 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e5a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e5c0b4010 0x7f6e5c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e5a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e5c0b4010 0x7f6e5c0cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46712/0 (socket says 172.21.15.6:46712) 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e5a7fc640 1 -- 172.21.15.6:0/2742033876 learned_addr learned my addr 172.21.15.6:0/2742033876 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e5affd640 1 --2- 172.21.15.6:0/2742033876 >> v2:172.21.15.171:3300/0 conn(0x7f6e5c163a10 0x7f6e5c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e5a7fc640 1 -- 172.21.15.6:0/2742033876 >> v2:172.21.15.171:3300/0 conn(0x7f6e5c163a10 msgr2=0x7f6e5c0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e5a7fc640 1 --2- 172.21.15.6:0/2742033876 >> v2:172.21.15.171:3300/0 conn(0x7f6e5c163a10 0x7f6e5c0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e5a7fc640 1 -- 172.21.15.6:0/2742033876 >> v1:172.21.15.171:6789/0 conn(0x7f6e5c0d14b0 legacy=0x7f6e5c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.357+0000 7f6e5a7fc640 1 -- 172.21.15.6:0/2742033876 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0d3650 con 0x7f6e5c0b4010 2024-05-20T17:53:37.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.358+0000 7f6e5a7fc640 1 --2- 172.21.15.6:0/2742033876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0b4010 0x7f6e5c0cfb00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0cf1c0 tx=0x7f6e5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddedf3b36a80c085 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.358+0000 7f6e59ffb640 1 -- 172.21.15.6:0/2742033876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50037070 con 0x7f6e5c0b4010 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.358+0000 7f6e59ffb640 1 -- 172.21.15.6:0/2742033876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e50032440 con 0x7f6e5c0b4010 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.358+0000 7f6e59ffb640 1 -- 172.21.15.6:0/2742033876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50032810 con 0x7f6e5c0b4010 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.359+0000 7f6e615cc640 1 -- 172.21.15.6:0/2742033876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0b4010 msgr2=0x7f6e5c0cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.359+0000 7f6e615cc640 1 --2- 172.21.15.6:0/2742033876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0b4010 0x7f6e5c0cfb00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0cf1c0 tx=0x7f6e5002a270 comp rx=0 tx=0).stop 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.359+0000 7f6e615cc640 1 -- 172.21.15.6:0/2742033876 shutdown_connections 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.359+0000 7f6e615cc640 1 --2- 172.21.15.6:0/2742033876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0b4010 0x7f6e5c0cfb00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.359+0000 7f6e615cc640 1 --2- 172.21.15.6:0/2742033876 >> v2:172.21.15.171:3300/0 conn(0x7f6e5c163a10 0x7f6e5c0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.359+0000 7f6e615cc640 1 -- 172.21.15.6:0/2742033876 >> 172.21.15.6:0/2742033876 conn(0x7f6e5c06d240 msgr2=0x7f6e5c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.359+0000 7f6e615cc640 1 -- 172.21.15.6:0/2742033876 shutdown_connections 2024-05-20T17:53:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.359+0000 7f6e615cc640 1 -- 172.21.15.6:0/2742033876 wait complete. 2024-05-20T17:53:37.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.361+0000 7f6e615cc640 1 Processor -- start 2024-05-20T17:53:37.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.361+0000 7f6e615cc640 1 -- start start 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e615cc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c0b4010 0x7f6e5c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e615cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0d14b0 0x7f6e5c1f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e615cc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c163a10 0x7f6e5c1f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e615cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0b8210 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e615cc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0d0040 con 0x7f6e5c163a10 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e615cc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c0b8390 con 0x7f6e5c0b4010 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e5a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0d14b0 0x7f6e5c1f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e5a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0d14b0 0x7f6e5c1f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46714/0 (socket says 172.21.15.6:46714) 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e5a7fc640 1 -- 172.21.15.6:0/1693554067 learned_addr learned my addr 172.21.15.6:0/1693554067 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.362+0000 7f6e5affd640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c0b4010 0x7f6e5c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5b7fe640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c163a10 0x7f6e5c1f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5a7fc640 1 -- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c0b4010 msgr2=0x7f6e5c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5a7fc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c0b4010 0x7f6e5c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5a7fc640 1 -- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c163a10 msgr2=0x7f6e5c1f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5a7fc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c163a10 0x7f6e5c1f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5a7fc640 1 -- 172.21.15.6:0/1693554067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c147b60 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5b7fe640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c163a10 0x7f6e5c1f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5affd640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c0b4010 0x7f6e5c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e5a7fc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0d14b0 0x7f6e5c1f8a30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e50000c00 tx=0x7f6e500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e437fe640 1 -- 172.21.15.6:0/1693554067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50041020 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e437fe640 1 -- 172.21.15.6:0/1693554067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e500306c0 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c1ea460 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e437fe640 1 -- 172.21.15.6:0/1693554067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e50037040 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.363+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c1581b0 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.364+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c075b00 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.365+0000 7f6e437fe640 1 -- 172.21.15.6:0/1693554067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e50044020 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.365+0000 7f6e437fe640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4806be30 0x7f6e4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.365+0000 7f6e437fe640 1 -- 172.21.15.6:0/1693554067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6e500aba30 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.365+0000 7f6e5affd640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4806be30 0x7f6e4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.366+0000 7f6e5affd640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4806be30 0x7f6e4806e340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c006fd0 tx=0x7f6e4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.370+0000 7f6e437fe640 1 -- 172.21.15.6:0/1693554067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6e5004b030 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.552+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e5c0d3050 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.553+0000 7f6e437fe640 1 -- 172.21.15.6:0/1693554067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f6e5007a0a0 con 0x7f6e5c0d14b0 2024-05-20T17:53:37.552 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4806be30 msgr2=0x7f6e4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4806be30 0x7f6e4806e340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c006fd0 tx=0x7f6e4c008040 comp rx=0 tx=0).stop 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0d14b0 msgr2=0x7f6e5c1f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0d14b0 0x7f6e5c1f8a30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e50000c00 tx=0x7f6e500046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 shutdown_connections 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4806be30 0x7f6e4806e340 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c163a10 0x7f6e5c1f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0d14b0 0x7f6e5c1f8a30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 --2- 172.21.15.6:0/1693554067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c0b4010 0x7f6e5c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 >> 172.21.15.6:0/1693554067 conn(0x7f6e5c06d240 msgr2=0x7f6e5c0b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 shutdown_connections 2024-05-20T17:53:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.555+0000 7f6e615cc640 1 -- 172.21.15.6:0/1693554067 wait complete. 2024-05-20T17:53:37.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:37.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.684+0000 7f15d1de3640 1 Processor -- start 2024-05-20T17:53:37.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.684+0000 7f15d1de3640 1 -- start start 2024-05-20T17:53:37.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.685+0000 7f15d1de3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc159ca0 0x7f15cc0af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.685+0000 7f15d1de3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f15cc0b1650 0x7f15cc0b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.685+0000 7f15d1de3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15cc06c630 0x7f15cc0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.685+0000 7f15d1de3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc09a4f0 con 0x7f15cc06c630 2024-05-20T17:53:37.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.685+0000 7f15d1de3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc09b350 con 0x7f15cc0b1650 2024-05-20T17:53:37.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.685+0000 7f15d1de3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc0af770 con 0x7f15cc159ca0 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15cc06c630 0x7f15cc0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15cc06c630 0x7f15cc0b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46728/0 (socket says 172.21.15.6:46728) 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cbfff640 1 -- 172.21.15.6:0/4293501683 learned_addr learned my addr 172.21.15.6:0/4293501683 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15caffd640 1 --2- 172.21.15.6:0/4293501683 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0b1650 0x7f15cc0b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cb7fe640 1 --2- 172.21.15.6:0/4293501683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc159ca0 0x7f15cc0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cbfff640 1 -- 172.21.15.6:0/4293501683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc159ca0 msgr2=0x7f15cc0af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cbfff640 1 --2- 172.21.15.6:0/4293501683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc159ca0 0x7f15cc0af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cbfff640 1 -- 172.21.15.6:0/4293501683 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0b1650 msgr2=0x7f15cc0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cbfff640 1 --2- 172.21.15.6:0/4293501683 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0b1650 0x7f15cc0b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cbfff640 1 -- 172.21.15.6:0/4293501683 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc09a740 con 0x7f15cc06c630 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15cb7fe640 1 --2- 172.21.15.6:0/4293501683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc159ca0 0x7f15cc0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.686+0000 7f15caffd640 1 --2- 172.21.15.6:0/4293501683 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0b1650 0x7f15cc0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.687+0000 7f15cbfff640 1 --2- 172.21.15.6:0/4293501683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc06c630 0x7f15cc0b2220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0af8f0 tx=0x7f15c402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6897fba001dd1c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.687+0000 7f15ca7fc640 1 -- 172.21.15.6:0/4293501683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4036070 con 0x7f15cc06c630 2024-05-20T17:53:37.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.687+0000 7f15ca7fc640 1 -- 172.21.15.6:0/4293501683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c4031600 con 0x7f15cc06c630 2024-05-20T17:53:37.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.687+0000 7f15ca7fc640 1 -- 172.21.15.6:0/4293501683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40319d0 con 0x7f15cc06c630 2024-05-20T17:53:37.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.687+0000 7f15d1de3640 1 -- 172.21.15.6:0/4293501683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc06c630 msgr2=0x7f15cc0b2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.687+0000 7f15d1de3640 1 --2- 172.21.15.6:0/4293501683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc06c630 0x7f15cc0b2220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0af8f0 tx=0x7f15c402a5f0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.688+0000 7f15d1de3640 1 -- 172.21.15.6:0/4293501683 shutdown_connections 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.688+0000 7f15d1de3640 1 --2- 172.21.15.6:0/4293501683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc06c630 0x7f15cc0b2220 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.688+0000 7f15d1de3640 1 --2- 172.21.15.6:0/4293501683 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0b1650 0x7f15cc0b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.688+0000 7f15d1de3640 1 --2- 172.21.15.6:0/4293501683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc159ca0 0x7f15cc0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.688+0000 7f15d1de3640 1 -- 172.21.15.6:0/4293501683 >> 172.21.15.6:0/4293501683 conn(0x7f15cc0b6620 msgr2=0x7f15cc0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.688+0000 7f15d1de3640 1 -- 172.21.15.6:0/4293501683 shutdown_connections 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.688+0000 7f15d1de3640 1 -- 172.21.15.6:0/4293501683 wait complete. 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.689+0000 7f15d1de3640 1 Processor -- start 2024-05-20T17:53:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.690+0000 7f15d1de3640 1 -- start start 2024-05-20T17:53:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15d1de3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc06c630 0x7f15cc157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15d1de3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0b1650 0x7f15cc1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15d1de3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc159ca0 0x7f15cc148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15d1de3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc09afe0 con 0x7f15cc159ca0 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15d1de3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc09ad00 con 0x7f15cc0b1650 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15d1de3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc15c760 con 0x7f15cc06c630 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc159ca0 0x7f15cc148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc159ca0 0x7f15cc148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46730/0 (socket says 172.21.15.6:46730) 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cbfff640 1 -- 172.21.15.6:0/1037857034 learned_addr learned my addr 172.21.15.6:0/1037857034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cb7fe640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc06c630 0x7f15cc157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15caffd640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0b1650 0x7f15cc1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cbfff640 1 -- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc06c630 msgr2=0x7f15cc157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cbfff640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc06c630 0x7f15cc157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cbfff640 1 -- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0b1650 msgr2=0x7f15cc1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cbfff640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0b1650 0x7f15cc1484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.691+0000 7f15cbfff640 1 -- 172.21.15.6:0/1037857034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc157c70 con 0x7f15cc159ca0 2024-05-20T17:53:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.692+0000 7f15cbfff640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc159ca0 0x7f15cc148a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f15c402abe0 tx=0x7f15c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.692+0000 7f15b3fff640 1 -- 172.21.15.6:0/1037857034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c403f020 con 0x7f15cc159ca0 2024-05-20T17:53:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.692+0000 7f15b3fff640 1 -- 172.21.15.6:0/1037857034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c4037040 con 0x7f15cc159ca0 2024-05-20T17:53:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.692+0000 7f15b3fff640 1 -- 172.21.15.6:0/1037857034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4036070 con 0x7f15cc159ca0 2024-05-20T17:53:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.692+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc1580f0 con 0x7f15cc159ca0 2024-05-20T17:53:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.692+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15cc147cc0 con 0x7f15cc159ca0 2024-05-20T17:53:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.693+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc0b2f30 con 0x7f15cc159ca0 2024-05-20T17:53:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.694+0000 7f15b3fff640 1 -- 172.21.15.6:0/1037857034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15c4042020 con 0x7f15cc159ca0 2024-05-20T17:53:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.694+0000 7f15b3fff640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b806be30 0x7f15b806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.694+0000 7f15b3fff640 1 -- 172.21.15.6:0/1037857034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f15c40ab640 con 0x7f15cc159ca0 2024-05-20T17:53:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.694+0000 7f15cb7fe640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b806be30 0x7f15b806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.695+0000 7f15cb7fe640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b806be30 0x7f15b806e340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00aac0 tx=0x7f15bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:37.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.699+0000 7f15b3fff640 1 -- 172.21.15.6:0/1037857034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f15cc0b2f30 con 0x7f15cc159ca0 2024-05-20T17:53:37.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.881+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f15cc075b00 con 0x7f15cc159ca0 2024-05-20T17:53:37.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.881+0000 7f15b3fff640 1 -- 172.21.15.6:0/1037857034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f15c4049030 con 0x7f15cc159ca0 2024-05-20T17:53:37.881 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b806be30 msgr2=0x7f15b806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b806be30 0x7f15b806e340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00aac0 tx=0x7f15bc008040 comp rx=0 tx=0).stop 2024-05-20T17:53:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc159ca0 msgr2=0x7f15cc148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc159ca0 0x7f15cc148a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f15c402abe0 tx=0x7f15c4004a40 comp rx=0 tx=0).stop 2024-05-20T17:53:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 shutdown_connections 2024-05-20T17:53:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b806be30 0x7f15b806e340 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc159ca0 0x7f15cc148a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0b1650 0x7f15cc1484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 --2- 172.21.15.6:0/1037857034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc06c630 0x7f15cc157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 >> 172.21.15.6:0/1037857034 conn(0x7f15cc0b6620 msgr2=0x7f15cc0b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 shutdown_connections 2024-05-20T17:53:37.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:37.883+0000 7f15d1de3640 1 -- 172.21.15.6:0/1037857034 wait complete. 2024-05-20T17:53:37.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:53:38.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.009+0000 7f3991509640 1 Processor -- start 2024-05-20T17:53:38.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.010+0000 7f3991509640 1 -- start start 2024-05-20T17:53:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f3991509640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c15f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f3991509640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398c06cf00 0x7f398c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f3991509640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c08d2a0 con 0x7f398c0d2780 2024-05-20T17:53:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f3991509640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f398c0d3f70 con 0x7f398c06cf00 2024-05-20T17:53:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f3991509640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f398c06d850 con 0x7f398c0d4400 2024-05-20T17:53:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f398a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398c06cf00 0x7f398c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f398b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f398c0d2780 0x7f398c0d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40700/0 (socket says 172.21.15.6:40700) 2024-05-20T17:53:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f398b7fe640 1 -- 172.21.15.6:0/9377415 learned_addr learned my addr 172.21.15.6:0/9377415 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f398affd640 1 --2- 172.21.15.6:0/9377415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f398a7fc640 1 -- 172.21.15.6:0/9377415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 msgr2=0x7f398c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f398a7fc640 1 --2- 172.21.15.6:0/9377415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c15f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f398a7fc640 1 -- 172.21.15.6:0/9377415 >> v1:172.21.15.6:6789/0 conn(0x7f398c0d2780 legacy=0x7f398c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f398a7fc640 1 -- 172.21.15.6:0/9377415 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c0d4810 con 0x7f398c06cf00 2024-05-20T17:53:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.011+0000 7f3989ffb640 1 -- 172.21.15.6:0/9377415 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133143776 0 0) 0x7f397c001490 con 0x7f398c0d2780 2024-05-20T17:53:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.012+0000 7f398a7fc640 1 --2- 172.21.15.6:0/9377415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c06d310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39740097a0 tx=0x7f397402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe2bee67f3ced8d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.012+0000 7f3989ffb640 1 -- 172.21.15.6:0/9377415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974037070 con 0x7f398c06cf00 2024-05-20T17:53:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.012+0000 7f3989ffb640 1 -- 172.21.15.6:0/9377415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3974032440 con 0x7f398c06cf00 2024-05-20T17:53:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.012+0000 7f3989ffb640 1 -- 172.21.15.6:0/9377415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974032810 con 0x7f398c06cf00 2024-05-20T17:53:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.013+0000 7f3991509640 1 -- 172.21.15.6:0/9377415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 msgr2=0x7f398c06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.013+0000 7f3991509640 1 --2- 172.21.15.6:0/9377415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c06d310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39740097a0 tx=0x7f397402a210 comp rx=0 tx=0).stop 2024-05-20T17:53:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.013+0000 7f3991509640 1 -- 172.21.15.6:0/9377415 shutdown_connections 2024-05-20T17:53:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.013+0000 7f3991509640 1 --2- 172.21.15.6:0/9377415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c06d310 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.013+0000 7f3991509640 1 --2- 172.21.15.6:0/9377415 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c15f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.013+0000 7f3991509640 1 -- 172.21.15.6:0/9377415 >> 172.21.15.6:0/9377415 conn(0x7f398c0d4bb0 msgr2=0x7f398c0d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.013+0000 7f3991509640 1 -- 172.21.15.6:0/9377415 shutdown_connections 2024-05-20T17:53:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.013+0000 7f3991509640 1 -- 172.21.15.6:0/9377415 wait complete. 2024-05-20T17:53:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.015+0000 7f3991509640 1 Processor -- start 2024-05-20T17:53:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.015+0000 7f3991509640 1 -- start start 2024-05-20T17:53:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.016+0000 7f3991509640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.016+0000 7f3991509640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398c0d2780 0x7f398c1f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.016+0000 7f3991509640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c1f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.016+0000 7f3991509640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f398c0d3920 con 0x7f398c06cf00 2024-05-20T17:53:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.016+0000 7f3991509640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f398c0d3640 con 0x7f398c0d2780 2024-05-20T17:53:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.016+0000 7f3991509640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f398c0d3c00 con 0x7f398c0d4400 2024-05-20T17:53:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.016+0000 7f398affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.016+0000 7f398affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c15d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52232/0 (socket says 172.21.15.6:52232) 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398affd640 1 -- 172.21.15.6:0/1942194793 learned_addr learned my addr 172.21.15.6:0/1942194793 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398a7fc640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398c0d2780 0x7f398c1f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398b7fe640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c1f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398affd640 1 -- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 msgr2=0x7f398c1f9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398affd640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c1f9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398affd640 1 -- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398c0d2780 msgr2=0x7f398c1f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398affd640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398c0d2780 0x7f398c1f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398affd640 1 -- 172.21.15.6:0/1942194793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c15dbb0 con 0x7f398c06cf00 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398a7fc640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398c0d2780 0x7f398c1f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398b7fe640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c1f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f398affd640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c15d670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f398400d5d0 tx=0x7f398400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f39837fe640 1 -- 172.21.15.6:0/1942194793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39840125f0 con 0x7f398c06cf00 2024-05-20T17:53:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f39837fe640 1 -- 172.21.15.6:0/1942194793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3984019070 con 0x7f398c06cf00 2024-05-20T17:53:38.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c15e050 con 0x7f398c06cf00 2024-05-20T17:53:38.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f39837fe640 1 -- 172.21.15.6:0/1942194793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39840129f0 con 0x7f398c06cf00 2024-05-20T17:53:38.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.017+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c15e610 con 0x7f398c06cf00 2024-05-20T17:53:38.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.019+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398c08cf70 con 0x7f398c06cf00 2024-05-20T17:53:38.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.019+0000 7f39837fe640 1 -- 172.21.15.6:0/1942194793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3984012b90 con 0x7f398c06cf00 2024-05-20T17:53:38.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.019+0000 7f39837fe640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396c06be30 0x7f396c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.019+0000 7f39837fe640 1 -- 172.21.15.6:0/1942194793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f398408b730 con 0x7f398c06cf00 2024-05-20T17:53:38.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.020+0000 7f398a7fc640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396c06be30 0x7f396c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.020+0000 7f398a7fc640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396c06be30 0x7f396c06e340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3974034000 tx=0x7f397402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.024+0000 7f39837fe640 1 -- 172.21.15.6:0/1942194793 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f398c08cf70 con 0x7f398c06cf00 2024-05-20T17:53:38.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.246+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f398c0735a0 con 0x7f398c06cf00 2024-05-20T17:53:38.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.246+0000 7f39837fe640 1 -- 172.21.15.6:0/1942194793 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f398c0735a0 con 0x7f398c06cf00 2024-05-20T17:53:38.246 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:38.246 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:29.005012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:53:38.246 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396c06be30 msgr2=0x7f396c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396c06be30 0x7f396c06e340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3974034000 tx=0x7f397402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 msgr2=0x7f398c15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c15d670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f398400d5d0 tx=0x7f398400da90 comp rx=0 tx=0).stop 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 shutdown_connections 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396c06be30 0x7f396c06e340 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f398c0d4400 0x7f398c1f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f398c0d2780 0x7f398c1f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 --2- 172.21.15.6:0/1942194793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c06cf00 0x7f398c15d670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 >> 172.21.15.6:0/1942194793 conn(0x7f398c0d4bb0 msgr2=0x7f398c15fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:38.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 shutdown_connections 2024-05-20T17:53:38.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.248+0000 7f3991509640 1 -- 172.21.15.6:0/1942194793 wait complete. 2024-05-20T17:53:38.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.374+0000 7fc00a6bc640 1 Processor -- start 2024-05-20T17:53:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.374+0000 7fc00a6bc640 1 -- start start 2024-05-20T17:53:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc00a6bc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc004168050 0x7fc00416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc00a6bc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0040d0630 con 0x7fc004162820 2024-05-20T17:53:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc00a6bc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0040d39c0 con 0x7fc00406d3d0 2024-05-20T17:53:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc00a6bc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc0040d3ca0 con 0x7fc004168050 2024-05-20T17:53:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc008c59640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc004168050 0x7fc00416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc003fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc004162820 0x7fc0040b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40714/0 (socket says 172.21.15.6:40714) 2024-05-20T17:53:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc008c59640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc004168050 0x7fc00416a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52234/0 (socket says 172.21.15.6:52234) 2024-05-20T17:53:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc003fff640 1 -- 172.21.15.6:0/3481803181 learned_addr learned my addr 172.21.15.6:0/3481803181 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc008c59640 1 -- 172.21.15.6:0/3481803181 >> v1:172.21.15.171:6789/0 conn(0x7fc00406d3d0 legacy=0x7fc00406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc008c59640 1 -- 172.21.15.6:0/3481803181 >> v1:172.21.15.6:6789/0 conn(0x7fc004162820 legacy=0x7fc0040b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.376+0000 7fc008c59640 1 -- 172.21.15.6:0/3481803181 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0040d3f80 con 0x7fc004168050 2024-05-20T17:53:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.377+0000 7fc008c59640 1 --2- 172.21.15.6:0/3481803181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc004168050 0x7fc00416a470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009d90 tx=0x7fbffc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b80cdac3cb915c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.377+0000 7fc002ffd640 1 -- 172.21.15.6:0/3481803181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc007740 con 0x7fc004168050 2024-05-20T17:53:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.377+0000 7fc002ffd640 1 -- 172.21.15.6:0/3481803181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc0078e0 con 0x7fc004168050 2024-05-20T17:53:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.377+0000 7fc002ffd640 1 -- 172.21.15.6:0/3481803181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc007cb0 con 0x7fc004168050 2024-05-20T17:53:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.378+0000 7fc00a6bc640 1 -- 172.21.15.6:0/3481803181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc004168050 msgr2=0x7fc00416a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.378+0000 7fc00a6bc640 1 --2- 172.21.15.6:0/3481803181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc004168050 0x7fc00416a470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbffc009d90 tx=0x7fbffc02a6f0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.378+0000 7fc00a6bc640 1 -- 172.21.15.6:0/3481803181 shutdown_connections 2024-05-20T17:53:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.378+0000 7fc00a6bc640 1 --2- 172.21.15.6:0/3481803181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc004168050 0x7fc00416a470 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.378+0000 7fc00a6bc640 1 -- 172.21.15.6:0/3481803181 >> 172.21.15.6:0/3481803181 conn(0x7fc0040d4bd0 msgr2=0x7fc0040d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.378+0000 7fc00a6bc640 1 -- 172.21.15.6:0/3481803181 shutdown_connections 2024-05-20T17:53:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.378+0000 7fc00a6bc640 1 -- 172.21.15.6:0/3481803181 wait complete. 2024-05-20T17:53:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.380+0000 7fc00a6bc640 1 Processor -- start 2024-05-20T17:53:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.380+0000 7fc00a6bc640 1 -- start start 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc00a6bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00406d3d0 0x7fc004159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc00a6bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc004162820 0x7fc0040b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc00a6bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc004168050 0x7fc0040b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc00a6bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc0040b91a0 con 0x7fc00406d3d0 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc00a6bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc0040d0300 con 0x7fc004168050 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc00a6bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc0040b4050 con 0x7fc004162820 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc003fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00406d3d0 0x7fc004159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc003fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00406d3d0 0x7fc004159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52244/0 (socket says 172.21.15.6:52244) 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc003fff640 1 -- 172.21.15.6:0/2860303753 learned_addr learned my addr 172.21.15.6:0/2860303753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc008c59640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc004168050 0x7fc0040b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc0037fe640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc004162820 0x7fc0040b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc003fff640 1 -- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc004162820 msgr2=0x7fc0040b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc003fff640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc004162820 0x7fc0040b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc003fff640 1 -- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc004168050 msgr2=0x7fc0040b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.381+0000 7fc003fff640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc004168050 0x7fc0040b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc003fff640 1 -- 172.21.15.6:0/2860303753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0040b5160 con 0x7fc00406d3d0 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc008c59640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc004168050 0x7fc0040b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc0037fe640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc004162820 0x7fc0040b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc003fff640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00406d3d0 0x7fc004159ce0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c480 tx=0x7fbff400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc000ff9640 1 -- 172.21.15.6:0/2860303753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4017070 con 0x7fc00406d3d0 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc000ff9640 1 -- 172.21.15.6:0/2860303753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff4005ce0 con 0x7fc00406d3d0 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0040b5440 con 0x7fc00406d3d0 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc000ff9640 1 -- 172.21.15.6:0/2860303753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff40072f0 con 0x7fc00406d3d0 2024-05-20T17:53:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.382+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0040b5a00 con 0x7fc00406d3d0 2024-05-20T17:53:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.383+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0040b5e40 con 0x7fc00406d3d0 2024-05-20T17:53:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.384+0000 7fc000ff9640 1 -- 172.21.15.6:0/2860303753 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbff401a070 con 0x7fc00406d3d0 2024-05-20T17:53:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.384+0000 7fc000ff9640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff006be30 0x7fbff006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.384+0000 7fc000ff9640 1 -- 172.21.15.6:0/2860303753 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbff408a4a0 con 0x7fc00406d3d0 2024-05-20T17:53:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.384+0000 7fc0037fe640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff006be30 0x7fbff006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.385+0000 7fc0037fe640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff006be30 0x7fbff006e340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc00415a780 tx=0x7fbff8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.389+0000 7fc000ff9640 1 -- 172.21.15.6:0/2860303753 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbff40584d0 con 0x7fc00406d3d0 2024-05-20T17:53:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.574+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc004075b00 con 0x7fc00406d3d0 2024-05-20T17:53:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.576+0000 7fc000ff9640 1 -- 172.21.15.6:0/2860303753 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7fbff405c7d0 con 0x7fc00406d3d0 2024-05-20T17:53:38.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:38.576 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff006be30 msgr2=0x7fbff006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff006be30 0x7fbff006e340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc00415a780 tx=0x7fbff8009040 comp rx=0 tx=0).stop 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00406d3d0 msgr2=0x7fc004159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00406d3d0 0x7fc004159ce0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbff400c480 tx=0x7fbff400c940 comp rx=0 tx=0).stop 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 shutdown_connections 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff006be30 0x7fbff006e340 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc004168050 0x7fc0040b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc004162820 0x7fc0040b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 --2- 172.21.15.6:0/2860303753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc00406d3d0 0x7fc004159ce0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 >> 172.21.15.6:0/2860303753 conn(0x7fc0040d4bd0 msgr2=0x7fc0041619b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 shutdown_connections 2024-05-20T17:53:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.578+0000 7fc00a6bc640 1 -- 172.21.15.6:0/2860303753 wait complete. 2024-05-20T17:53:38.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:38.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:38.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.708+0000 7fdbe61b5640 1 Processor -- start 2024-05-20T17:53:38.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.708+0000 7fdbe61b5640 1 -- start start 2024-05-20T17:53:38.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.709+0000 7fdbe61b5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbe00b6620 0x7fdbe00ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.709+0000 7fdbe61b5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdbe0162ce0 0x7fdbe00b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.709+0000 7fdbe61b5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe01634a0 con 0x7fdbe00b85b0 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.709+0000 7fdbe61b5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe00d3480 con 0x7fdbe00b6620 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.709+0000 7fdbe61b5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe0163780 con 0x7fdbe0162ce0 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbe00b6620 0x7fdbe00ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdbe00b85b0 0x7fdbe00d3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40724/0 (socket says 172.21.15.6:40724) 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdffff640 1 -- 172.21.15.6:0/775627743 learned_addr learned my addr 172.21.15.6:0/775627743 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdeffd640 1 --2- 172.21.15.6:0/775627743 >> v2:172.21.15.171:3300/0 conn(0x7fdbe0162ce0 0x7fdbe00b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdf7fe640 1 -- 172.21.15.6:0/775627743 >> v2:172.21.15.171:3300/0 conn(0x7fdbe0162ce0 msgr2=0x7fdbe00b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdf7fe640 1 --2- 172.21.15.6:0/775627743 >> v2:172.21.15.171:3300/0 conn(0x7fdbe0162ce0 0x7fdbe00b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdf7fe640 1 -- 172.21.15.6:0/775627743 >> v1:172.21.15.6:6789/0 conn(0x7fdbe00b85b0 legacy=0x7fdbe00d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdf7fe640 1 -- 172.21.15.6:0/775627743 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe0163a60 con 0x7fdbe00b6620 2024-05-20T17:53:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbde7fc640 1 -- 172.21.15.6:0/775627743 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576434564 0 0) 0x7fdbe01634a0 con 0x7fdbe00b85b0 2024-05-20T17:53:38.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.710+0000 7fdbdeffd640 1 --2- 172.21.15.6:0/775627743 >> v2:172.21.15.171:3300/0 conn(0x7fdbe0162ce0 0x7fdbe00b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.711+0000 7fdbdf7fe640 1 --2- 172.21.15.6:0/775627743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe00ba3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00b7790 tx=0x7fdbd002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cddee69294c548 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.711+0000 7fdbde7fc640 1 -- 172.21.15.6:0/775627743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0037070 con 0x7fdbe00b6620 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.711+0000 7fdbde7fc640 1 -- 172.21.15.6:0/775627743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd0032440 con 0x7fdbe00b6620 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.711+0000 7fdbde7fc640 1 -- 172.21.15.6:0/775627743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0032810 con 0x7fdbe00b6620 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.712+0000 7fdbe61b5640 1 -- 172.21.15.6:0/775627743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 msgr2=0x7fdbe00ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.712+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/775627743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe00ba3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00b7790 tx=0x7fdbd002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.712+0000 7fdbe61b5640 1 -- 172.21.15.6:0/775627743 shutdown_connections 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.712+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/775627743 >> v2:172.21.15.171:3300/0 conn(0x7fdbe0162ce0 0x7fdbe00b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.712+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/775627743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe00ba3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.712+0000 7fdbe61b5640 1 -- 172.21.15.6:0/775627743 >> 172.21.15.6:0/775627743 conn(0x7fdbe006d240 msgr2=0x7fdbe006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.712+0000 7fdbe61b5640 1 -- 172.21.15.6:0/775627743 shutdown_connections 2024-05-20T17:53:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.712+0000 7fdbe61b5640 1 -- 172.21.15.6:0/775627743 wait complete. 2024-05-20T17:53:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.713+0000 7fdbe61b5640 1 Processor -- start 2024-05-20T17:53:38.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.714+0000 7fdbe61b5640 1 -- start start 2024-05-20T17:53:38.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbe61b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe01f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbe61b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe00b85b0 0x7fdbe0156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbe61b5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe0162ce0 0x7fdbe01f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbe61b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01630f0 con 0x7fdbe00b6620 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbe61b5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe00d4300 con 0x7fdbe0162ce0 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbe61b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe00ca350 con 0x7fdbe00b85b0 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe01f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe01f94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52266/0 (socket says 172.21.15.6:52266) 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdf7fe640 1 -- 172.21.15.6:0/3978156612 learned_addr learned my addr 172.21.15.6:0/3978156612 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdffff640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe0162ce0 0x7fdbe01f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdeffd640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe00b85b0 0x7fdbe0156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdf7fe640 1 -- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe00b85b0 msgr2=0x7fdbe0156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdf7fe640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe00b85b0 0x7fdbe0156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdf7fe640 1 -- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe0162ce0 msgr2=0x7fdbe01f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdf7fe640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe0162ce0 0x7fdbe01f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.715+0000 7fdbdf7fe640 1 -- 172.21.15.6:0/3978156612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe01f5f50 con 0x7fdbe00b6620 2024-05-20T17:53:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.716+0000 7fdbdf7fe640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe01f94d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0000c00 tx=0x7fdbd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.716+0000 7fdbc7fff640 1 -- 172.21.15.6:0/3978156612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0037040 con 0x7fdbe00b6620 2024-05-20T17:53:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.716+0000 7fdbc7fff640 1 -- 172.21.15.6:0/3978156612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd0042070 con 0x7fdbe00b6620 2024-05-20T17:53:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.716+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe01f6230 con 0x7fdbe00b6620 2024-05-20T17:53:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.716+0000 7fdbc7fff640 1 -- 172.21.15.6:0/3978156612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0030bd0 con 0x7fdbe00b6620 2024-05-20T17:53:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.716+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe01f8fb0 con 0x7fdbe00b6620 2024-05-20T17:53:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.717+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe0075b00 con 0x7fdbe00b6620 2024-05-20T17:53:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.718+0000 7fdbc7fff640 1 -- 172.21.15.6:0/3978156612 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbd0047460 con 0x7fdbe00b6620 2024-05-20T17:53:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.718+0000 7fdbc7fff640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbcc06be30 0x7fdbcc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.718+0000 7fdbc7fff640 1 -- 172.21.15.6:0/3978156612 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdbd00abed0 con 0x7fdbe00b6620 2024-05-20T17:53:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.718+0000 7fdbdeffd640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbcc06be30 0x7fdbcc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.719+0000 7fdbdeffd640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbcc06be30 0x7fdbcc06e340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdbe015cf60 tx=0x7fdbd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:38.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.723+0000 7fdbc7fff640 1 -- 172.21.15.6:0/3978156612 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdbd0032e20 con 0x7fdbe00b6620 2024-05-20T17:53:38.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.908+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdbe00d2ba0 con 0x7fdbe00b6620 2024-05-20T17:53:38.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.908+0000 7fdbc7fff640 1 -- 172.21.15.6:0/3978156612 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fdbd0045360 con 0x7fdbe00b6620 2024-05-20T17:53:38.908 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:38.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbcc06be30 msgr2=0x7fdbcc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbcc06be30 0x7fdbcc06e340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdbe015cf60 tx=0x7fdbd4008040 comp rx=0 tx=0).stop 2024-05-20T17:53:38.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 msgr2=0x7fdbe01f94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:38.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe01f94d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0000c00 tx=0x7fdbd00046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 shutdown_connections 2024-05-20T17:53:38.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbcc06be30 0x7fdbcc06e340 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe0162ce0 0x7fdbe01f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe00b85b0 0x7fdbe0156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 --2- 172.21.15.6:0/3978156612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe00b6620 0x7fdbe01f94d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:38.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 >> 172.21.15.6:0/3978156612 conn(0x7fdbe006d240 msgr2=0x7fdbe00c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:38.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 shutdown_connections 2024-05-20T17:53:38.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:38.910+0000 7fdbe61b5640 1 -- 172.21.15.6:0/3978156612 wait complete. 2024-05-20T17:53:38.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.040+0000 7ff9f5dc7640 1 Processor -- start 2024-05-20T17:53:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.040+0000 7ff9f5dc7640 1 -- start start 2024-05-20T17:53:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9f5dc7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f0162820 0x7ff9f00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9f5dc7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9f00b3e80 0x7ff9f006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9f5dc7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f006dd20 con 0x7ff9f006d910 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9f5dc7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f00d0630 con 0x7ff9f00b3e80 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9f5dc7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f00d39c0 con 0x7ff9f0162820 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9eeffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9f00b3e80 0x7ff9f006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9eeffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff9f00b3e80 0x7ff9f006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52274/0 (socket says 172.21.15.6:52274) 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9eeffd640 1 -- 172.21.15.6:0/3825767957 learned_addr learned my addr 172.21.15.6:0/3825767957 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.041+0000 7ff9effff640 1 --1- 172.21.15.6:0/3825767957 >> v1:172.21.15.6:6789/0 conn(0x7ff9f006d910 0x7ff9f00d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40738/0 (socket says 172.21.15.6:40738) 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.042+0000 7ff9ef7fe640 1 --2- 172.21.15.6:0/3825767957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f0162820 0x7ff9f00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.042+0000 7ff9eeffd640 1 -- 172.21.15.6:0/3825767957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f0162820 msgr2=0x7ff9f00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.042+0000 7ff9eeffd640 1 --2- 172.21.15.6:0/3825767957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f0162820 0x7ff9f00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.042+0000 7ff9eeffd640 1 -- 172.21.15.6:0/3825767957 >> v1:172.21.15.6:6789/0 conn(0x7ff9f006d910 legacy=0x7ff9f00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.042+0000 7ff9eeffd640 1 -- 172.21.15.6:0/3825767957 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00d3ca0 con 0x7ff9f00b3e80 2024-05-20T17:53:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.042+0000 7ff9ee7fc640 1 -- 172.21.15.6:0/3825767957 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863662799 0 0) 0x7ff9e8001490 con 0x7ff9f006d910 2024-05-20T17:53:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.042+0000 7ff9ef7fe640 1 --2- 172.21.15.6:0/3825767957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f0162820 0x7ff9f00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9eeffd640 1 --2- 172.21.15.6:0/3825767957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f006d3d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009870 tx=0x7ff9e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e273918c990b9ff server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9ee7fc640 1 -- 172.21.15.6:0/3825767957 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4037070 con 0x7ff9f00b3e80 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9ee7fc640 1 -- 172.21.15.6:0/3825767957 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e4032440 con 0x7ff9f00b3e80 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9ee7fc640 1 -- 172.21.15.6:0/3825767957 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4032810 con 0x7ff9f00b3e80 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/3825767957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 msgr2=0x7ff9f006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/3825767957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f006d3d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009870 tx=0x7ff9e402a270 comp rx=0 tx=0).stop 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/3825767957 shutdown_connections 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/3825767957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f006d3d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.043+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/3825767957 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f0162820 0x7ff9f00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.044+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/3825767957 >> 172.21.15.6:0/3825767957 conn(0x7ff9f00d4bd0 msgr2=0x7ff9f00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.044+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/3825767957 shutdown_connections 2024-05-20T17:53:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.044+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/3825767957 wait complete. 2024-05-20T17:53:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.045+0000 7ff9f5dc7640 1 Processor -- start 2024-05-20T17:53:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.046+0000 7ff9f5dc7640 1 -- start start 2024-05-20T17:53:39.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9f5dc7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f006d910 0x7ff9f014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9f5dc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f00cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9f5dc7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9f0162820 0x7ff9f014eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9f5dc7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00d0300 con 0x7ff9f00b3e80 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9f5dc7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00d4260 con 0x7ff9f0162820 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9f5dc7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f00b91a0 con 0x7ff9f006d910 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f00cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f00cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52282/0 (socket says 172.21.15.6:52282) 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 -- 172.21.15.6:0/2655075358 learned_addr learned my addr 172.21.15.6:0/2655075358 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9ef7fe640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f006d910 0x7ff9f014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9effff640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9f0162820 0x7ff9f014eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 -- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f006d910 msgr2=0x7ff9f014e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f006d910 0x7ff9f014e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 -- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9f0162820 msgr2=0x7ff9f014eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9f0162820 0x7ff9f014eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 -- 172.21.15.6:0/2655075358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00ccbb0 con 0x7ff9f00b3e80 2024-05-20T17:53:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.047+0000 7ff9eeffd640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f00cbe40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4000c00 tx=0x7ff9e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.048+0000 7ff9d7fff640 1 -- 172.21.15.6:0/2655075358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4041020 con 0x7ff9f00b3e80 2024-05-20T17:53:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.048+0000 7ff9d7fff640 1 -- 172.21.15.6:0/2655075358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e40306c0 con 0x7ff9f00b3e80 2024-05-20T17:53:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.048+0000 7ff9d7fff640 1 -- 172.21.15.6:0/2655075358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4037040 con 0x7ff9f00b3e80 2024-05-20T17:53:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.048+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f00cce90 con 0x7ff9f00b3e80 2024-05-20T17:53:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.048+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f00cd450 con 0x7ff9f00b3e80 2024-05-20T17:53:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.049+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f00cc920 con 0x7ff9f00b3e80 2024-05-20T17:53:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.049+0000 7ff9d7fff640 1 -- 172.21.15.6:0/2655075358 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9e4044020 con 0x7ff9f00b3e80 2024-05-20T17:53:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.050+0000 7ff9d7fff640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff9dc06be30 0x7ff9dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.050+0000 7ff9d7fff640 1 -- 172.21.15.6:0/2655075358 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff9e40abac0 con 0x7ff9f00b3e80 2024-05-20T17:53:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.050+0000 7ff9ef7fe640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff9dc06be30 0x7ff9dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.051+0000 7ff9ef7fe640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff9dc06be30 0x7ff9dc06e340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0006fd0 tx=0x7ff9e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.055+0000 7ff9d7fff640 1 -- 172.21.15.6:0/2655075358 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff9e404b030 con 0x7ff9f00b3e80 2024-05-20T17:53:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.237+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff9f0162050 con 0x7ff9f00b3e80 2024-05-20T17:53:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.238+0000 7ff9d7fff640 1 -- 172.21.15.6:0/2655075358 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7ff9f0162050 con 0x7ff9f00b3e80 2024-05-20T17:53:39.237 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.239+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff9dc06be30 msgr2=0x7ff9dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.239+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff9dc06be30 0x7ff9dc06e340 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0006fd0 tx=0x7ff9e0008040 comp rx=0 tx=0).stop 2024-05-20T17:53:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.239+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 msgr2=0x7ff9f00cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f00cbe40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4000c00 tx=0x7ff9e40046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 shutdown_connections 2024-05-20T17:53:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff9dc06be30 0x7ff9dc06e340 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9f0162820 0x7ff9f014eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9f00b3e80 0x7ff9f00cbe40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 --2- 172.21.15.6:0/2655075358 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9f006d910 0x7ff9f014e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 >> 172.21.15.6:0/2655075358 conn(0x7ff9f00d4bd0 msgr2=0x7ff9f00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 shutdown_connections 2024-05-20T17:53:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.240+0000 7ff9f5dc7640 1 -- 172.21.15.6:0/2655075358 wait complete. 2024-05-20T17:53:39.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.368+0000 7f5548c14640 1 Processor -- start 2024-05-20T17:53:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.368+0000 7f5548c14640 1 -- start start 2024-05-20T17:53:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.370+0000 7f5548c14640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440d4400 0x7f554415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.370+0000 7f5548c14640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554408d2a0 con 0x7f55440d2780 2024-05-20T17:53:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.370+0000 7f5548c14640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55440d4810 con 0x7f554406cf00 2024-05-20T17:53:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.370+0000 7f5548c14640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f55440d3f70 con 0x7f55440d4400 2024-05-20T17:53:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.370+0000 7f5542d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f55440d2780 0x7f55440d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40746/0 (socket says 172.21.15.6:40746) 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.370+0000 7f5542d9d640 1 -- 172.21.15.6:0/418713178 learned_addr learned my addr 172.21.15.6:0/418713178 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.370+0000 7f554259c640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440d4400 0x7f554415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.370+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966182585 0 0) 0x7f5534001490 con 0x7f55440d2780 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5530003520 con 0x7f55440d2780 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 640289349 0 0) 0x7f5530003520 con 0x7f55440d2780 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440d4400 msgr2=0x7f554415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440d4400 0x7f554415f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 >> v1:172.21.15.171:6789/0 conn(0x7f554406cf00 legacy=0x7f554406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55440d3360 con 0x7f55440d2780 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5534001bc0 con 0x7f55440d2780 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 >> v1:172.21.15.6:6789/0 conn(0x7f55440d2780 legacy=0x7f55440d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440d4400 0x7f55300039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5530004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530004d40 0x7f5530005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55440d3f70 con 0x7f5530003f40 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f553000bad0 con 0x7f5530004d40 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f553000bcd0 con 0x7f55440d4400 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f554259c640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440d4400 0x7f55300039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f5541d9b640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5530004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f5542d9d640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530004d40 0x7f5530005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f5541d9b640 1 -- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440d4400 msgr2=0x7f55300039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f5541d9b640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440d4400 0x7f55300039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f5541d9b640 1 -- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530004d40 msgr2=0x7f5530005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f5541d9b640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530004d40 0x7f5530005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.371+0000 7f5541d9b640 1 -- 172.21.15.6:0/418713178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5530003520 con 0x7f5530003f40 2024-05-20T17:53:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.372+0000 7f5541d9b640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5530004800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f552c001830 tx=0x7f5530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c85aa7aa4e3ecf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.372+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c037070 con 0x7f5530003f40 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.372+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c02abe0 con 0x7f5530003f40 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.372+0000 7f554159a640 1 -- 172.21.15.6:0/418713178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c001430 con 0x7f5530003f40 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.373+0000 7f5548c14640 1 -- 172.21.15.6:0/418713178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 msgr2=0x7f5530004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.373+0000 7f5548c14640 1 --2- 172.21.15.6:0/418713178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5530004800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f552c001830 tx=0x7f5530005830 comp rx=0 tx=0).stop 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.373+0000 7f5542d9d640 1 -- 172.21.15.6:0/418713178 reap_dead start 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.373+0000 7f5548c14640 1 -- 172.21.15.6:0/418713178 shutdown_connections 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.373+0000 7f5548c14640 1 -- 172.21.15.6:0/418713178 >> 172.21.15.6:0/418713178 conn(0x7f55440d4bb0 msgr2=0x7f55440d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.373+0000 7f5548c14640 1 -- 172.21.15.6:0/418713178 shutdown_connections 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.373+0000 7f5548c14640 1 -- 172.21.15.6:0/418713178 wait complete. 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.375+0000 7f5548c14640 1 Processor -- start 2024-05-20T17:53:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.375+0000 7f5548c14640 1 -- start start 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.376+0000 7f5548c14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5544158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.376+0000 7f5548c14640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440cb2d0 0x7f5544158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.376+0000 7f5548c14640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5544155cd0 0x7f55441566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.376+0000 7f5548c14640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55440d3c00 con 0x7f5530003f40 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.376+0000 7f5548c14640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f55440d3920 con 0x7f55440cb2d0 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.376+0000 7f5548c14640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f554415f440 con 0x7f5544155cd0 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5544158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5544158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52300/0 (socket says 172.21.15.6:52300) 2024-05-20T17:53:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 -- 172.21.15.6:0/130937148 learned_addr learned my addr 172.21.15.6:0/130937148 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f5542d9d640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5544155cd0 0x7f55441566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f5541d9b640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440cb2d0 0x7f5544158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 -- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5544155cd0 msgr2=0x7f55441566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5544155cd0 0x7f55441566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 -- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440cb2d0 msgr2=0x7f5544158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440cb2d0 0x7f5544158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 -- 172.21.15.6:0/130937148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55441564b0 con 0x7f5530003f40 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f5542d9d640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5544155cd0 0x7f55441566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f554259c640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5544158100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f553c0119d0 tx=0x7f553c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f553affd640 1 -- 172.21.15.6:0/130937148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c00faf0 con 0x7f5530003f40 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f553affd640 1 -- 172.21.15.6:0/130937148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c00fc90 con 0x7f5530003f40 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f553affd640 1 -- 172.21.15.6:0/130937148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c014440 con 0x7f5530003f40 2024-05-20T17:53:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55440c97f0 con 0x7f5530003f40 2024-05-20T17:53:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.377+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55440c9db0 con 0x7f5530003f40 2024-05-20T17:53:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.379+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55440735a0 con 0x7f5530003f40 2024-05-20T17:53:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.379+0000 7f553affd640 1 -- 172.21.15.6:0/130937148 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f553c012040 con 0x7f5530003f40 2024-05-20T17:53:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.379+0000 7f553affd640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f552406be30 0x7f552406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.380+0000 7f553affd640 1 -- 172.21.15.6:0/130937148 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f553c08b780 con 0x7f5530003f40 2024-05-20T17:53:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.380+0000 7f5541d9b640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f552406be30 0x7f552406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.380+0000 7f5541d9b640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f552406be30 0x7f552406e340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f552c034000 tx=0x7f552c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.384+0000 7f553affd640 1 -- 172.21.15.6:0/130937148 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f55440735a0 con 0x7f5530003f40 2024-05-20T17:53:39.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.567+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5544075b00 con 0x7f5530003f40 2024-05-20T17:53:39.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.568+0000 7f553affd640 1 -- 172.21.15.6:0/130937148 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f553c019030 con 0x7f5530003f40 2024-05-20T17:53:39.567 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f552406be30 msgr2=0x7f552406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f552406be30 0x7f552406e340 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f552c034000 tx=0x7f552c009030 comp rx=0 tx=0).stop 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 msgr2=0x7f5544158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5544158100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f553c0119d0 tx=0x7f553c011e90 comp rx=0 tx=0).stop 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 shutdown_connections 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f552406be30 0x7f552406e340 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5544155cd0 0x7f55441566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55440cb2d0 0x7f5544158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 --2- 172.21.15.6:0/130937148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5530003f40 0x7f5544158100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 >> 172.21.15.6:0/130937148 conn(0x7f55440d4bb0 msgr2=0x7f55440cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:39.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 shutdown_connections 2024-05-20T17:53:39.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.570+0000 7f5548c14640 1 -- 172.21.15.6:0/130937148 wait complete. 2024-05-20T17:53:39.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.700+0000 7fc81f5c3640 1 Processor -- start 2024-05-20T17:53:39.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.700+0000 7fc81f5c3640 1 -- start start 2024-05-20T17:53:39.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81f5c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc818162820 0x7fc8180b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81f5c3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc81806dae0 0x7fc8180b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81f5c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8180d0630 con 0x7fc8180b3e80 2024-05-20T17:53:39.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81f5c3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc8180d39c0 con 0x7fc81806dae0 2024-05-20T17:53:39.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81f5c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc8180d3ca0 con 0x7fc818162820 2024-05-20T17:53:39.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81db60640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc81806dae0 0x7fc8180b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81d35f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc818162820 0x7fc8180b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81cb5e640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc8180b3e80 0x7fc81806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:45802/0 (socket says 172.21.15.6:45802) 2024-05-20T17:53:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81cb5e640 1 -- 172.21.15.6:0/2659519792 learned_addr learned my addr 172.21.15.6:0/2659519792 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81db60640 1 -- 172.21.15.6:0/2659519792 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc818162820 msgr2=0x7fc8180b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.702+0000 7fc81db60640 1 --2- 172.21.15.6:0/2659519792 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc818162820 0x7fc8180b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.703+0000 7fc81db60640 1 -- 172.21.15.6:0/2659519792 >> v1:172.21.15.171:6789/0 conn(0x7fc8180b3e80 legacy=0x7fc81806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.703+0000 7fc80ffff640 1 -- 172.21.15.6:0/2659519792 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914330872 0 0) 0x7fc8180d0630 con 0x7fc8180b3e80 2024-05-20T17:53:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.703+0000 7fc81db60640 1 -- 172.21.15.6:0/2659519792 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8180d3f80 con 0x7fc81806dae0 2024-05-20T17:53:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.703+0000 7fc81d35f640 1 --2- 172.21.15.6:0/2659519792 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc818162820 0x7fc8180b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:39.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.703+0000 7fc81db60640 1 --2- 172.21.15.6:0/2659519792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc81806dae0 0x7fc8180b8190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8100097a0 tx=0x7fc81002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ce0efba73f1b38 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc80ffff640 1 -- 172.21.15.6:0/2659519792 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810037070 con 0x7fc81806dae0 2024-05-20T17:53:39.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc80ffff640 1 -- 172.21.15.6:0/2659519792 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc810032440 con 0x7fc81806dae0 2024-05-20T17:53:39.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc80ffff640 1 -- 172.21.15.6:0/2659519792 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810032810 con 0x7fc81806dae0 2024-05-20T17:53:39.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc81f5c3640 1 -- 172.21.15.6:0/2659519792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc81806dae0 msgr2=0x7fc8180b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/2659519792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc81806dae0 0x7fc8180b8190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8100097a0 tx=0x7fc81002a180 comp rx=0 tx=0).stop 2024-05-20T17:53:39.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc81f5c3640 1 -- 172.21.15.6:0/2659519792 shutdown_connections 2024-05-20T17:53:39.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/2659519792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc81806dae0 0x7fc8180b8190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/2659519792 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc818162820 0x7fc8180b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc81f5c3640 1 -- 172.21.15.6:0/2659519792 >> 172.21.15.6:0/2659519792 conn(0x7fc8180d4bd0 msgr2=0x7fc8180d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc81f5c3640 1 -- 172.21.15.6:0/2659519792 shutdown_connections 2024-05-20T17:53:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.704+0000 7fc81f5c3640 1 -- 172.21.15.6:0/2659519792 wait complete. 2024-05-20T17:53:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.706+0000 7fc81f5c3640 1 Processor -- start 2024-05-20T17:53:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.706+0000 7fc81f5c3640 1 -- start start 2024-05-20T17:53:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81f5c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8180b3e80 0x7fc8181f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81f5c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc818162820 0x7fc8180ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81f5c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8180c8fa0 0x7fc8180cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81f5c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180d4780 con 0x7fc8180c8fa0 2024-05-20T17:53:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81f5c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180d0300 con 0x7fc818162820 2024-05-20T17:53:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81f5c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc8180d4900 con 0x7fc8180b3e80 2024-05-20T17:53:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8180c8fa0 0x7fc8180cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8180c8fa0 0x7fc8180cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52310/0 (socket says 172.21.15.6:52310) 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 -- 172.21.15.6:0/1684906692 learned_addr learned my addr 172.21.15.6:0/1684906692 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81cb5e640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc818162820 0x7fc8180ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81d35f640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8180b3e80 0x7fc8181f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 -- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8180b3e80 msgr2=0x7fc8181f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8180b3e80 0x7fc8181f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 -- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc818162820 msgr2=0x7fc8180ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc818162820 0x7fc8180ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 -- 172.21.15.6:0/1684906692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8180cc030 con 0x7fc8180c8fa0 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81d35f640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8180b3e80 0x7fc8181f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.708+0000 7fc81db60640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8180c8fa0 0x7fc8180cd0d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc8100097a0 tx=0x7fc8100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.709+0000 7fc80dffb640 1 -- 172.21.15.6:0/1684906692 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810037050 con 0x7fc8180c8fa0 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.709+0000 7fc80dffb640 1 -- 172.21.15.6:0/1684906692 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc810038040 con 0x7fc8180c8fa0 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.709+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8180cc310 con 0x7fc8180c8fa0 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.709+0000 7fc80dffb640 1 -- 172.21.15.6:0/1684906692 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810004450 con 0x7fc8180c8fa0 2024-05-20T17:53:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.709+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8180cc8d0 con 0x7fc8180c8fa0 2024-05-20T17:53:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.710+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc81815d660 con 0x7fc8180c8fa0 2024-05-20T17:53:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.710+0000 7fc80dffb640 1 -- 172.21.15.6:0/1684906692 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc81003c6d0 con 0x7fc8180c8fa0 2024-05-20T17:53:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.711+0000 7fc80dffb640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7fc06be30 0x7fc7fc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.711+0000 7fc80dffb640 1 -- 172.21.15.6:0/1684906692 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc8100abca0 con 0x7fc8180c8fa0 2024-05-20T17:53:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.711+0000 7fc81d35f640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7fc06be30 0x7fc7fc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.712+0000 7fc81d35f640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7fc06be30 0x7fc7fc06e340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc814009fd0 tx=0x7fc81400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.715+0000 7fc80dffb640 1 -- 172.21.15.6:0/1684906692 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc81815d660 con 0x7fc8180c8fa0 2024-05-20T17:53:39.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.901+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc818075b00 con 0x7fc8180c8fa0 2024-05-20T17:53:39.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.901+0000 7fc80dffb640 1 -- 172.21.15.6:0/1684906692 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fc81007a200 con 0x7fc8180c8fa0 2024-05-20T17:53:39.901 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:39.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.903+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7fc06be30 msgr2=0x7fc7fc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.903+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7fc06be30 0x7fc7fc06e340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc814009fd0 tx=0x7fc81400b040 comp rx=0 tx=0).stop 2024-05-20T17:53:39.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.903+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8180c8fa0 msgr2=0x7fc8180cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:39.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.903+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8180c8fa0 0x7fc8180cd0d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc8100097a0 tx=0x7fc8100046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.904+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 shutdown_connections 2024-05-20T17:53:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.904+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc7fc06be30 0x7fc7fc06e340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.904+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8180c8fa0 0x7fc8180cd0d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.904+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc818162820 0x7fc8180ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.904+0000 7fc81f5c3640 1 --2- 172.21.15.6:0/1684906692 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8180b3e80 0x7fc8181f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.904+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 >> 172.21.15.6:0/1684906692 conn(0x7fc8180d4bd0 msgr2=0x7fc818161100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.904+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 shutdown_connections 2024-05-20T17:53:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:39.904+0000 7fc81f5c3640 1 -- 172.21.15.6:0/1684906692 wait complete. 2024-05-20T17:53:39.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:53:40.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.030+0000 7f770b5c3640 1 Processor -- start 2024-05-20T17:53:40.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.030+0000 7f770b5c3640 1 -- start start 2024-05-20T17:53:40.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f770b5c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f770415f220 0x7f77040cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f770b5c3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77040cfd20 con 0x7f77040cf910 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f770b5c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770406d0f0 con 0x7f77040cd680 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f770b5c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f77040cda90 con 0x7f770415f220 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f7708b5e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f770415f220 0x7f77040cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f7708b5e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f770415f220 0x7f77040cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52316/0 (socket says 172.21.15.6:52316) 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f7709b60640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f77040cf910 0x7f77040d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40748/0 (socket says 172.21.15.6:40748) 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f7708b5e640 1 -- 172.21.15.6:0/1545910472 learned_addr learned my addr 172.21.15.6:0/1545910472 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f7708b5e640 1 -- 172.21.15.6:0/1545910472 >> v1:172.21.15.171:6789/0 conn(0x7f77040cd680 legacy=0x7f770406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f7708b5e640 1 -- 172.21.15.6:0/1545910472 >> v1:172.21.15.6:6789/0 conn(0x7f77040cf910 legacy=0x7f77040d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.032+0000 7f7708b5e640 1 -- 172.21.15.6:0/1545910472 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770406d3d0 con 0x7f770415f220 2024-05-20T17:53:40.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.033+0000 7f7708b5e640 1 --2- 172.21.15.6:0/1545910472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040cf3d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009870 tx=0x7f76f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc08454995dbb375 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.033+0000 7f76f7fff640 1 -- 172.21.15.6:0/1545910472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8037070 con 0x7f770415f220 2024-05-20T17:53:40.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.033+0000 7f76f7fff640 1 -- 172.21.15.6:0/1545910472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f8032440 con 0x7f770415f220 2024-05-20T17:53:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.033+0000 7f76f7fff640 1 -- 172.21.15.6:0/1545910472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8032810 con 0x7f770415f220 2024-05-20T17:53:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.034+0000 7f770b5c3640 1 -- 172.21.15.6:0/1545910472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 msgr2=0x7f77040cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.034+0000 7f770b5c3640 1 --2- 172.21.15.6:0/1545910472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040cf3d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009870 tx=0x7f76f802a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.034+0000 7f770b5c3640 1 -- 172.21.15.6:0/1545910472 shutdown_connections 2024-05-20T17:53:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.034+0000 7f770b5c3640 1 --2- 172.21.15.6:0/1545910472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040cf3d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.034+0000 7f770b5c3640 1 -- 172.21.15.6:0/1545910472 >> 172.21.15.6:0/1545910472 conn(0x7f77040b44d0 msgr2=0x7f77040b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.034+0000 7f770b5c3640 1 -- 172.21.15.6:0/1545910472 shutdown_connections 2024-05-20T17:53:40.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.034+0000 7f770b5c3640 1 -- 172.21.15.6:0/1545910472 wait complete. 2024-05-20T17:53:40.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.036+0000 7f770b5c3640 1 Processor -- start 2024-05-20T17:53:40.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.036+0000 7f770b5c3640 1 -- start start 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f770b5c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77040cd680 0x7f7704157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f770b5c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77040cf910 0x7f770415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f770b5c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f770b5c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f770406cdd0 con 0x7f770415f220 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f770b5c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f770406d990 con 0x7f77040cf910 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f770b5c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f770415f630 con 0x7f77040cd680 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f7709b60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f7709b60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52326/0 (socket says 172.21.15.6:52326) 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f7709b60640 1 -- 172.21.15.6:0/2031854672 learned_addr learned my addr 172.21.15.6:0/2031854672 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:40.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f7708b5e640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77040cf910 0x7f770415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.037+0000 7f770935f640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77040cd680 0x7f7704157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f7709b60640 1 -- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77040cd680 msgr2=0x7f7704157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f7709b60640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77040cd680 0x7f7704157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f7709b60640 1 -- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77040cf910 msgr2=0x7f770415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f7709b60640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77040cf910 0x7f770415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f7709b60640 1 -- 172.21.15.6:0/2031854672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770415e3b0 con 0x7f770415f220 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f770935f640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77040cd680 0x7f7704157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f7709b60640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040c64b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c730 tx=0x7f76fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f76f5ffb640 1 -- 172.21.15.6:0/2031854672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc017070 con 0x7f770415f220 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f76f5ffb640 1 -- 172.21.15.6:0/2031854672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76fc00ce40 con 0x7f770415f220 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77040cadb0 con 0x7f770415f220 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f76f5ffb640 1 -- 172.21.15.6:0/2031854672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc00a840 con 0x7f770415f220 2024-05-20T17:53:40.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.038+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77040cb370 con 0x7f770415f220 2024-05-20T17:53:40.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.039+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7704075b00 con 0x7f770415f220 2024-05-20T17:53:40.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.040+0000 7f76f5ffb640 1 -- 172.21.15.6:0/2031854672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76fc01a070 con 0x7f770415f220 2024-05-20T17:53:40.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.040+0000 7f76f5ffb640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76e806be60 0x7f76e806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.040+0000 7f76f5ffb640 1 -- 172.21.15.6:0/2031854672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f76fc08a660 con 0x7f770415f220 2024-05-20T17:53:40.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.040+0000 7f770935f640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76e806be60 0x7f76e806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.041+0000 7f770935f640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76e806be60 0x7f76e806e370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f77040b1cd0 tx=0x7f7700009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.045+0000 7f76f5ffb640 1 -- 172.21.15.6:0/2031854672 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f77040cfd20 con 0x7f770415f220 2024-05-20T17:53:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.267+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77040b8940 con 0x7f770415f220 2024-05-20T17:53:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.267+0000 7f76f5ffb640 1 -- 172.21.15.6:0/2031854672 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f76fc058680 con 0x7f770415f220 2024-05-20T17:53:40.267 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:40.267 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:29.005012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:53:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76e806be60 msgr2=0x7f76e806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76e806be60 0x7f76e806e370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f77040b1cd0 tx=0x7f7700009040 comp rx=0 tx=0).stop 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 msgr2=0x7f77040c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040c64b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c730 tx=0x7f76fc00cbf0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 shutdown_connections 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76e806be60 0x7f76e806e370 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f770415f220 0x7f77040c64b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77040cf910 0x7f770415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 --2- 172.21.15.6:0/2031854672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77040cd680 0x7f7704157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 >> 172.21.15.6:0/2031854672 conn(0x7f77040b44d0 msgr2=0x7f77040d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 shutdown_connections 2024-05-20T17:53:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.269+0000 7f770b5c3640 1 -- 172.21.15.6:0/2031854672 wait complete. 2024-05-20T17:53:40.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:40.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.395+0000 7f2b53d02640 1 Processor -- start 2024-05-20T17:53:40.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.395+0000 7f2b53d02640 1 -- start start 2024-05-20T17:53:40.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b53d02640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b53d02640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2b4c0d2780 0x7f2b4c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b53d02640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b4c08d2a0 con 0x7f2b4c0d4400 2024-05-20T17:53:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b53d02640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2b4c0d3f70 con 0x7f2b4c0d2780 2024-05-20T17:53:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b53d02640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4c06d850 con 0x7f2b4c06cf00 2024-05-20T17:53:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b5129d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b5229f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2b4c0d2780 0x7f2b4c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b5129d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c06d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:40984/0 (socket says 172.21.15.6:40984) 2024-05-20T17:53:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b51a9e640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2b4c0d4400 0x7f2b4c15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:45822/0 (socket says 172.21.15.6:45822) 2024-05-20T17:53:40.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b5129d640 1 -- 172.21.15.6:0/2650206817 learned_addr learned my addr 172.21.15.6:0/2650206817 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b5229f640 1 -- 172.21.15.6:0/2650206817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 msgr2=0x7f2b4c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b5229f640 1 --2- 172.21.15.6:0/2650206817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c06d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b5229f640 1 -- 172.21.15.6:0/2650206817 >> v1:172.21.15.171:6789/0 conn(0x7f2b4c0d4400 legacy=0x7f2b4c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b50a9c640 1 -- 172.21.15.6:0/2650206817 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 759481193 0 0) 0x7f2b3c001490 con 0x7f2b4c0d4400 2024-05-20T17:53:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.397+0000 7f2b5229f640 1 -- 172.21.15.6:0/2650206817 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4c0d30d0 con 0x7f2b4c0d2780 2024-05-20T17:53:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.398+0000 7f2b5229f640 1 --2- 172.21.15.6:0/2650206817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c0d2b90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b440097a0 tx=0x7f2b4402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bffb19b2fcdb0e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.398+0000 7f2b50a9c640 1 -- 172.21.15.6:0/2650206817 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44037070 con 0x7f2b4c0d2780 2024-05-20T17:53:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.398+0000 7f2b50a9c640 1 -- 172.21.15.6:0/2650206817 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b44032440 con 0x7f2b4c0d2780 2024-05-20T17:53:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.398+0000 7f2b50a9c640 1 -- 172.21.15.6:0/2650206817 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44032810 con 0x7f2b4c0d2780 2024-05-20T17:53:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.399+0000 7f2b53d02640 1 -- 172.21.15.6:0/2650206817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d2780 msgr2=0x7f2b4c0d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.399+0000 7f2b53d02640 1 --2- 172.21.15.6:0/2650206817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c0d2b90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b440097a0 tx=0x7f2b4402a210 comp rx=0 tx=0).stop 2024-05-20T17:53:40.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.399+0000 7f2b53d02640 1 -- 172.21.15.6:0/2650206817 shutdown_connections 2024-05-20T17:53:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.399+0000 7f2b53d02640 1 --2- 172.21.15.6:0/2650206817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c0d2b90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.399+0000 7f2b53d02640 1 --2- 172.21.15.6:0/2650206817 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.399+0000 7f2b53d02640 1 -- 172.21.15.6:0/2650206817 >> 172.21.15.6:0/2650206817 conn(0x7f2b4c0d4bb0 msgr2=0x7f2b4c0d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.399+0000 7f2b53d02640 1 -- 172.21.15.6:0/2650206817 shutdown_connections 2024-05-20T17:53:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.399+0000 7f2b53d02640 1 -- 172.21.15.6:0/2650206817 wait complete. 2024-05-20T17:53:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.401+0000 7f2b53d02640 1 Processor -- start 2024-05-20T17:53:40.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.401+0000 7f2b53d02640 1 -- start start 2024-05-20T17:53:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.402+0000 7f2b53d02640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.402+0000 7f2b53d02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c1f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.402+0000 7f2b53d02640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d4400 0x7f2b4c1f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.402+0000 7f2b53d02640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4c0d3640 con 0x7f2b4c0d2780 2024-05-20T17:53:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.402+0000 7f2b53d02640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4c0d3360 con 0x7f2b4c0d4400 2024-05-20T17:53:40.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.402+0000 7f2b53d02640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2b4c0d3920 con 0x7f2b4c06cf00 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.402+0000 7f2b5129d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c1f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5129d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c1f90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52334/0 (socket says 172.21.15.6:52334) 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5129d640 1 -- 172.21.15.6:0/1140528396 learned_addr learned my addr 172.21.15.6:0/1140528396 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5229f640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d4400 0x7f2b4c1f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b51a9e640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5129d640 1 -- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 msgr2=0x7f2b4c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5129d640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5129d640 1 -- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d4400 msgr2=0x7f2b4c1f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5129d640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d4400 0x7f2b4c1f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5129d640 1 -- 172.21.15.6:0/1140528396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4c1ea810 con 0x7f2b4c0d2780 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b5129d640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c1f90a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000e840 tx=0x7f2b4000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b4a7fc640 1 -- 172.21.15.6:0/1140528396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40017070 con 0x7f2b4c0d2780 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b4a7fc640 1 -- 172.21.15.6:0/1140528396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4000c8e0 con 0x7f2b4c0d2780 2024-05-20T17:53:40.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4c1eaaf0 con 0x7f2b4c0d2780 2024-05-20T17:53:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b4a7fc640 1 -- 172.21.15.6:0/1140528396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000ccd0 con 0x7f2b4c0d2780 2024-05-20T17:53:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.403+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4c153670 con 0x7f2b4c0d2780 2024-05-20T17:53:40.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.404+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b4c0735a0 con 0x7f2b4c0d2780 2024-05-20T17:53:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.405+0000 7f2b4a7fc640 1 -- 172.21.15.6:0/1140528396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b4001a070 con 0x7f2b4c0d2780 2024-05-20T17:53:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.405+0000 7f2b4a7fc640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b3806be60 0x7f2b3806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.406+0000 7f2b4a7fc640 1 -- 172.21.15.6:0/1140528396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b4008b340 con 0x7f2b4c0d2780 2024-05-20T17:53:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.406+0000 7f2b51a9e640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b3806be60 0x7f2b3806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.406+0000 7f2b51a9e640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b3806be60 0x7f2b3806e370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0012e0 tx=0x7f2b3c001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.410+0000 7f2b4a7fc640 1 -- 172.21.15.6:0/1140528396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2b4c0735a0 con 0x7f2b4c0d2780 2024-05-20T17:53:40.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.593+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b4c075b00 con 0x7f2b4c0d2780 2024-05-20T17:53:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.594+0000 7f2b4a7fc640 1 -- 172.21.15.6:0/1140528396 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18466 (secure 0 0 0) 0x7f2b40059360 con 0x7f2b4c0d2780 2024-05-20T17:53:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:40.594 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:11.998947+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b3806be60 msgr2=0x7f2b3806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b3806be60 0x7f2b3806e370 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0012e0 tx=0x7f2b3c001630 comp rx=0 tx=0).stop 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b4c0d2780 msgr2=0x7f2b4c1f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c1f90a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000e840 tx=0x7f2b4000ed00 comp rx=0 tx=0).stop 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 shutdown_connections 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b3806be60 0x7f2b3806e370 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b4c0d4400 0x7f2b4c1f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b4c0d2780 0x7f2b4c1f90a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 --2- 172.21.15.6:0/1140528396 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b4c06cf00 0x7f2b4c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 >> 172.21.15.6:0/1140528396 conn(0x7f2b4c0d4bb0 msgr2=0x7f2b4c0d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:40.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 shutdown_connections 2024-05-20T17:53:40.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.596+0000 7f2b53d02640 1 -- 172.21.15.6:0/1140528396 wait complete. 2024-05-20T17:53:40.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:53:40.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.722+0000 7ffa8519d640 1 Processor -- start 2024-05-20T17:53:40.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.722+0000 7ffa8519d640 1 -- start start 2024-05-20T17:53:40.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.723+0000 7ffa8519d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8015d530 0x7ffa8015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.723+0000 7ffa8519d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa800cd580 con 0x7ffa800b1700 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.723+0000 7ffa8519d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa800cd860 con 0x7ffa80070850 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.723+0000 7ffa8519d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa800ce190 con 0x7ffa8015d530 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.723+0000 7ffa77fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffa800b1700 0x7ffa800b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40764/0 (socket says 172.21.15.6:40764) 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa77fff640 1 -- 172.21.15.6:0/3480742557 learned_addr learned my addr 172.21.15.6:0/3480742557 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7ed9d640 1 --2- 172.21.15.6:0/3480742557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8015d530 0x7ffa8015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7e59c640 1 -- 172.21.15.6:0/3480742557 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689062954 0 0) 0x7ffa800cd580 con 0x7ffa800b1700 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7e59c640 1 -- 172.21.15.6:0/3480742557 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa6c003520 con 0x7ffa800b1700 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7e59c640 1 -- 172.21.15.6:0/3480742557 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908467495 0 0) 0x7ffa800cd860 con 0x7ffa80070850 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7e59c640 1 -- 172.21.15.6:0/3480742557 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa800cd580 con 0x7ffa80070850 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7e59c640 1 -- 172.21.15.6:0/3480742557 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2593996519 0 0) 0x7ffa6c003520 con 0x7ffa800b1700 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7ed9d640 1 -- 172.21.15.6:0/3480742557 >> v1:172.21.15.171:6789/0 conn(0x7ffa80070850 legacy=0x7ffa80070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7ed9d640 1 -- 172.21.15.6:0/3480742557 >> v1:172.21.15.6:6789/0 conn(0x7ffa800b1700 legacy=0x7ffa800b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.724+0000 7ffa7ed9d640 1 -- 172.21.15.6:0/3480742557 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa800cdb40 con 0x7ffa8015d530 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.725+0000 7ffa7ed9d640 1 --2- 172.21.15.6:0/3480742557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8015d530 0x7ffa8015aaa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097d0 tx=0x7ffa7002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f4404c3d81b14f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.725+0000 7ffa7e59c640 1 -- 172.21.15.6:0/3480742557 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70037070 con 0x7ffa8015d530 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.725+0000 7ffa7e59c640 1 -- 172.21.15.6:0/3480742557 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7002ac30 con 0x7ffa8015d530 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.725+0000 7ffa7e59c640 1 -- 172.21.15.6:0/3480742557 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68001670 con 0x7ffa8015d530 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.726+0000 7ffa8519d640 1 -- 172.21.15.6:0/3480742557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8015d530 msgr2=0x7ffa8015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.726+0000 7ffa8519d640 1 --2- 172.21.15.6:0/3480742557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8015d530 0x7ffa8015aaa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097d0 tx=0x7ffa7002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.726+0000 7ffa8519d640 1 -- 172.21.15.6:0/3480742557 shutdown_connections 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.726+0000 7ffa8519d640 1 --2- 172.21.15.6:0/3480742557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa8015d530 0x7ffa8015aaa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.726+0000 7ffa8519d640 1 -- 172.21.15.6:0/3480742557 >> 172.21.15.6:0/3480742557 conn(0x7ffa800d29d0 msgr2=0x7ffa800d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.726+0000 7ffa8519d640 1 -- 172.21.15.6:0/3480742557 shutdown_connections 2024-05-20T17:53:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.726+0000 7ffa8519d640 1 -- 172.21.15.6:0/3480742557 wait complete. 2024-05-20T17:53:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.728+0000 7ffa8519d640 1 Processor -- start 2024-05-20T17:53:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.728+0000 7ffa8519d640 1 -- start start 2024-05-20T17:53:40.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa8519d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa80070850 0x7ffa8015c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa8519d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800b1700 0x7ffa8015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa8519d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8015d530 0x7ffa8015b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa8519d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80071370 con 0x7ffa800b1700 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa8519d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa800cd230 con 0x7ffa8015d530 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa8519d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa800714f0 con 0x7ffa80070850 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa77fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800b1700 0x7ffa8015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa77fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800b1700 0x7ffa8015b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52348/0 (socket says 172.21.15.6:52348) 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa77fff640 1 -- 172.21.15.6:0/4183921493 learned_addr learned my addr 172.21.15.6:0/4183921493 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa7ed9d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa80070850 0x7ffa8015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.729+0000 7ffa7f59e640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8015d530 0x7ffa8015b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa77fff640 1 -- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa80070850 msgr2=0x7ffa8015c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa77fff640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa80070850 0x7ffa8015c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa77fff640 1 -- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8015d530 msgr2=0x7ffa8015b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa77fff640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8015d530 0x7ffa8015b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa77fff640 1 -- 172.21.15.6:0/4183921493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa800c6fa0 con 0x7ffa800b1700 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa77fff640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800b1700 0x7ffa8015b040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa6800c4e0 tx=0x7ffa6800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa777fe640 1 -- 172.21.15.6:0/4183921493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68017070 con 0x7ffa800b1700 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa777fe640 1 -- 172.21.15.6:0/4183921493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa68005ce0 con 0x7ffa800b1700 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa777fe640 1 -- 172.21.15.6:0/4183921493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68007270 con 0x7ffa800b1700 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa800c7280 con 0x7ffa800b1700 2024-05-20T17:53:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.730+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa800caa20 con 0x7ffa800b1700 2024-05-20T17:53:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.731+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa80075b00 con 0x7ffa800b1700 2024-05-20T17:53:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.732+0000 7ffa777fe640 1 -- 172.21.15.6:0/4183921493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa6801a070 con 0x7ffa800b1700 2024-05-20T17:53:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.732+0000 7ffa777fe640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa6006be30 0x7ffa6006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.732+0000 7ffa777fe640 1 -- 172.21.15.6:0/4183921493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffa6808a480 con 0x7ffa800b1700 2024-05-20T17:53:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.733+0000 7ffa7ed9d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa6006be30 0x7ffa6006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.733+0000 7ffa7ed9d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa6006be30 0x7ffa6006e340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa70034000 tx=0x7ffa7002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.737+0000 7ffa777fe640 1 -- 172.21.15.6:0/4183921493 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffa680584a0 con 0x7ffa800b1700 2024-05-20T17:53:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.957+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa800d1f80 con 0x7ffa800b1700 2024-05-20T17:53:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.958+0000 7ffa777fe640 1 -- 172.21.15.6:0/4183921493 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7ffa6805c7a0 con 0x7ffa800b1700 2024-05-20T17:53:40.957 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:40.958 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:29.005012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:53:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:53:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa6006be30 msgr2=0x7ffa6006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa6006be30 0x7ffa6006e340 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa70034000 tx=0x7ffa7002e000 comp rx=0 tx=0).stop 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800b1700 msgr2=0x7ffa8015b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800b1700 0x7ffa8015b040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa6800c4e0 tx=0x7ffa6800c9a0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 shutdown_connections 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa6006be30 0x7ffa6006e340 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8015d530 0x7ffa8015b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800b1700 0x7ffa8015b040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 --2- 172.21.15.6:0/4183921493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa80070850 0x7ffa8015c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 >> 172.21.15.6:0/4183921493 conn(0x7ffa800d29d0 msgr2=0x7ffa8015e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 shutdown_connections 2024-05-20T17:53:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:40.960+0000 7ffa8519d640 1 -- 172.21.15.6:0/4183921493 wait complete. 2024-05-20T17:53:41.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T17:53:06.937522+0000', 'modified': '2024-05-20T17:53:29.005012+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6833/2802786337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 2802786337}, {'type': 'v1', 'addr': '172.21.15.6:6833', 'nonce': 2802786337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-05-20T17:53:41.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T17:53:41.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-20T17:53:41.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.494+0000 7f4bbeb09640 1 Processor -- start 2024-05-20T17:53:41.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.494+0000 7f4bbeb09640 1 -- start start 2024-05-20T17:53:41.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.495+0000 7f4bbeb09640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb815d530 0x7f4bb815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.495+0000 7f4bbeb09640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bb80b1700 0x7f4bb80b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.495+0000 7f4bbeb09640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb80cd580 con 0x7f4bb8070850 2024-05-20T17:53:41.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.495+0000 7f4bbeb09640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb80ce190 con 0x7f4bb80b1700 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.495+0000 7f4bbeb09640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb80cd860 con 0x7f4bb815d530 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.495+0000 7f4baffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bb80b1700 0x7f4bb80b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4baffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bb80b1700 0x7f4bb80b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52364/0 (socket says 172.21.15.6:52364) 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4baffff640 1 -- 172.21.15.6:0/2907283164 learned_addr learned my addr 172.21.15.6:0/2907283164 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4bbd0a6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4bb8070850 0x7f4bb8070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40778/0 (socket says 172.21.15.6:40778) 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/2907283164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb815d530 0x7f4bb815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4baffff640 1 -- 172.21.15.6:0/2907283164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb815d530 msgr2=0x7f4bb815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4baffff640 1 --2- 172.21.15.6:0/2907283164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb815d530 0x7f4bb815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4baffff640 1 -- 172.21.15.6:0/2907283164 >> v1:172.21.15.6:6789/0 conn(0x7f4bb8070850 legacy=0x7f4bb8070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4baffff640 1 -- 172.21.15.6:0/2907283164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb80cdb40 con 0x7f4bb80b1700 2024-05-20T17:53:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.496+0000 7f4baf7fe640 1 -- 172.21.15.6:0/2907283164 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2073070479 0 0) 0x7f4bb80cd580 con 0x7f4bb8070850 2024-05-20T17:53:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.497+0000 7f4baffff640 1 --2- 172.21.15.6:0/2907283164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb80b1b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009870 tx=0x7f4ba802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95698d94b3f890e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.497+0000 7f4baf7fe640 1 -- 172.21.15.6:0/2907283164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8037070 con 0x7f4bb80b1700 2024-05-20T17:53:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.497+0000 7f4baf7fe640 1 -- 172.21.15.6:0/2907283164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8032440 con 0x7f4bb80b1700 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.497+0000 7f4baf7fe640 1 -- 172.21.15.6:0/2907283164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8032810 con 0x7f4bb80b1700 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.497+0000 7f4bbeb09640 1 -- 172.21.15.6:0/2907283164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 msgr2=0x7f4bb80b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.497+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/2907283164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb80b1b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009870 tx=0x7f4ba802a270 comp rx=0 tx=0).stop 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.498+0000 7f4bbeb09640 1 -- 172.21.15.6:0/2907283164 shutdown_connections 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.498+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/2907283164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb80b1b10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.498+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/2907283164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb815d530 0x7f4bb815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.498+0000 7f4bbeb09640 1 -- 172.21.15.6:0/2907283164 >> 172.21.15.6:0/2907283164 conn(0x7f4bb80d29d0 msgr2=0x7f4bb80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.498+0000 7f4bbeb09640 1 -- 172.21.15.6:0/2907283164 shutdown_connections 2024-05-20T17:53:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.498+0000 7f4bbeb09640 1 -- 172.21.15.6:0/2907283164 wait complete. 2024-05-20T17:53:41.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.499+0000 7f4bbeb09640 1 Processor -- start 2024-05-20T17:53:41.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.499+0000 7f4bbeb09640 1 -- start start 2024-05-20T17:53:41.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4bbeb09640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb8070850 0x7f4bb80c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4bbeb09640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb8148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4bbeb09640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bb815d530 0x7f4bb81592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4bbeb09640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb80b2050 con 0x7f4bb80b1700 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4bbeb09640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb80cd230 con 0x7f4bb815d530 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4bbeb09640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb8071370 con 0x7f4bb8070850 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4baffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb8148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4baffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb8148a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52372/0 (socket says 172.21.15.6:52372) 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4baffff640 1 -- 172.21.15.6:0/4144256555 learned_addr learned my addr 172.21.15.6:0/4144256555 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb8070850 0x7f4bb80c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bb815d530 0x7f4bb81592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4baffff640 1 -- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb8070850 msgr2=0x7f4bb80c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4baffff640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb8070850 0x7f4bb80c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4baffff640 1 -- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bb815d530 msgr2=0x7f4bb81592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4baffff640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bb815d530 0x7f4bb81592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.501+0000 7f4baffff640 1 -- 172.21.15.6:0/4144256555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb80c8230 con 0x7f4bb80b1700 2024-05-20T17:53:41.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.502+0000 7f4baffff640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb8148a80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8000c00 tx=0x7f4ba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:41.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.502+0000 7f4bad7fa640 1 -- 172.21.15.6:0/4144256555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8041020 con 0x7f4bb80b1700 2024-05-20T17:53:41.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.502+0000 7f4bad7fa640 1 -- 172.21.15.6:0/4144256555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba80306c0 con 0x7f4bb80b1700 2024-05-20T17:53:41.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.502+0000 7f4bbeb09640 1 -- 172.21.15.6:0/4144256555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb81f6670 con 0x7f4bb80b1700 2024-05-20T17:53:41.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.502+0000 7f4bad7fa640 1 -- 172.21.15.6:0/4144256555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8037040 con 0x7f4bb80b1700 2024-05-20T17:53:41.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.502+0000 7f4bbeb09640 1 -- 172.21.15.6:0/4144256555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb81f6c30 con 0x7f4bb80b1700 2024-05-20T17:53:41.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.504+0000 7f4bad7fa640 1 -- 172.21.15.6:0/4144256555 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ba8044020 con 0x7f4bb80b1700 2024-05-20T17:53:41.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.504+0000 7f4bad7fa640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ba406be60 0x7f4ba406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.504+0000 7f4bad7fa640 1 -- 172.21.15.6:0/4144256555 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4ba80ab9d0 con 0x7f4bb80b1700 2024-05-20T17:53:41.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.504+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ba406be60 0x7f4ba406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.505+0000 7f4bc59b3740 1 Processor -- start 2024-05-20T17:53:41.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.505+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ba406be60 0x7f4ba406e370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80d29a0 tx=0x7f4bb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:41.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.505+0000 7f4bc59b3740 1 -- start start 2024-05-20T17:53:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a2a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a270a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198263e590 0x561982a00360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5619829634d0 con 0x5619826363b0 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56198290b3e0 con 0x56198263e590 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x56198295f490 con 0x56198265f270 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4baffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4baffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a270a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52386/0 (socket says 172.21.15.6:52386) 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4baffff640 1 -- 172.21.15.6:0/1373851298 learned_addr learned my addr 172.21.15.6:0/1373851298 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a2a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.506+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198263e590 0x561982a00360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4baffff640 1 -- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 msgr2=0x561982a2a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4baffff640 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a2a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4baffff640 1 -- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198263e590 msgr2=0x561982a00360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4baffff640 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198263e590 0x561982a00360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4baffff640 1 -- 172.21.15.6:0/1373851298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619826772d0 con 0x5619826363b0 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198263e590 0x561982a00360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:41.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4baffff640 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a270a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80a9b60 tx=0x7f4ba80797e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733cb5fce0aed095 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4b9e7fc640 1 -- 172.21.15.6:0/1373851298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8077be0 con 0x5619826363b0 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4b9e7fc640 1 -- 172.21.15.6:0/1373851298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8075f50 con 0x5619826363b0 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.507+0000 7f4b9e7fc640 1 -- 172.21.15.6:0/1373851298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8082210 con 0x5619826363b0 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 -- 172.21.15.6:0/1373851298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 msgr2=0x561982a270a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a270a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80a9b60 tx=0x7f4ba80797e0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 -- 172.21.15.6:0/1373851298 shutdown_connections 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198263e590 0x561982a00360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a270a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/1373851298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a2a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 -- 172.21.15.6:0/1373851298 >> 172.21.15.6:0/1373851298 conn(0x5619826533c0 msgr2=0x5619829ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 -- 172.21.15.6:0/1373851298 shutdown_connections 2024-05-20T17:53:41.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.508+0000 7f4bc59b3740 1 -- 172.21.15.6:0/1373851298 wait complete. 2024-05-20T17:53:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.509+0000 7f4bc59b3740 1 -- start start 2024-05-20T17:53:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.509+0000 7f4bc59b3740 1 Processor -- start 2024-05-20T17:53:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a3c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a17550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198265f270 0x561982a17a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5619829634d0 con 0x5619826363b0 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56198291e8e0 con 0x56198265f270 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x561982a43c00 con 0x56198263e590 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bc59b3740 10 client.0 _ll_register_callbacks cb 0x5619828eb9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bbc8a5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a3c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bbc8a5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a3c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52388/0 (socket says 172.21.15.6:52388) 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.510+0000 7f4bbc8a5640 1 -- 172.21.15.6:0/4266505961 learned_addr learned my addr 172.21.15.6:0/4266505961 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4baffff640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a17550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198265f270 0x561982a17a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bbc8a5640 1 -- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 msgr2=0x561982a17550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a17550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bbc8a5640 1 -- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198265f270 msgr2=0x561982a17a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198265f270 0x561982a17a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bbc8a5640 1 -- 172.21.15.6:0/4266505961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619827416b0 con 0x5619826363b0 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198265f270 0x561982a17a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4baffff640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a17550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a3c2b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4016780 tx=0x7f4bb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daafccd02ca35694 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4b977fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4b977fe640 1 -- 172.21.15.6:0/4266505961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4026070 con 0x5619826363b0 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4b977fe640 1 -- 172.21.15.6:0/4266505961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4bb40149b0 con 0x5619826363b0 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bc59b3740 1 -- 172.21.15.6:0/4266505961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba8075f50 con 0x5619826363b0 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4b977fe640 1 -- 172.21.15.6:0/4266505961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4bb4031050 con 0x5619826363b0 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bc59b3740 10 client.4881 fetch_fsmap learned FSMap version 9 2024-05-20T17:53:41.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4bc59b3740 1 -- 172.21.15.6:0/4266505961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561982a18310 con 0x5619826363b0 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.511+0000 7f4b977fe640 1 -- 172.21.15.6:0/4266505961 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8075f50 con 0x5619826363b0 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4b977fe640 1 -- 172.21.15.6:0/4266505961 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f4bb4034020 con 0x5619826363b0 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4bc59b3740 10 client.4881 fetch_fsmap finished waiting for FSMap version 9 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4bc59b3740 10 client.4881 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4bc59b3740 20 client.4881 populate_metadata read hostname 'smithi006' 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56198261de40 0x561982a2cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4bc59b3740 4 client.4881 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4bc59b3740 1 -- 172.21.15.6:0/4266505961 --> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561982970c00 con 0x56198261de40 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4baffff640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56198261de40 0x561982a2cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4b977fe640 10 client.4881 ms_handle_connect on v2:172.21.15.6:6832/2802786337 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.512+0000 7f4baffff640 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56198261de40 0x561982a2cc10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f975547526265c7c server_cookie=76859bf1216d287b in_seq=0 out_seq=0 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4b977fe640 1 -- 172.21.15.6:0/4266505961 <== mds.0 v2:172.21.15.6:6832/2802786337 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561982970c00 con 0x56198261de40 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4b977fe640 10 client.4881 handle_command_reply: tid=0 2024-05-20T17:53:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 client.4881 shutdown 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 -- 172.21.15.6:0/4266505961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 msgr2=0x561982a3c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a3c2b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4016780 tx=0x7f4bb40046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 -- 172.21.15.6:0/4266505961 shutdown_connections 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x56198261de40 0x561982a2cc10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56198265f270 0x561982a17a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a17550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4b977fe640 0 client.4881 ms_handle_reset on v2:172.21.15.6:6832/2802786337 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/4266505961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619826363b0 0x561982a3c2b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 -- 172.21.15.6:0/4266505961 >> 172.21.15.6:0/4266505961 conn(0x5619826533c0 msgr2=0x5619829ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 -- 172.21.15.6:0/4266505961 shutdown_connections 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 1 -- 172.21.15.6:0/4266505961 wait complete. 2024-05-20T17:53:41.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.513+0000 7f4bc59b3740 20 client.4881 trim_cache size 0 max 16384 2024-05-20T17:53:41.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.532+0000 7f4bc59b3740 1 Processor -- start 2024-05-20T17:53:41.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.532+0000 7f4bc59b3740 1 -- start start 2024-05-20T17:53:41.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198263e590 0x561982a48210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a48750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb8200070 con 0x56198263e590 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb81ff400 con 0x5619826363b0 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb81ffa50 con 0x56198265f270 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198263e590 0x561982a48210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198263e590 0x561982a48210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52392/0 (socket says 172.21.15.6:52392) 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 -- 172.21.15.6:0/2944046461 learned_addr learned my addr 172.21.15.6:0/2944046461 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a48750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 -- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 msgr2=0x561982a48750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a48750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 -- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 msgr2=0x561982a2a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 -- 172.21.15.6:0/2944046461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619829f4ec0 con 0x56198263e590 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a48750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4baffff640 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198263e590 0x561982a48210 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80abcf0 tx=0x7f4ba80ab000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31bc46d7b8e9ba8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4b9dffb640 1 -- 172.21.15.6:0/2944046461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8075f50 con 0x56198263e590 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4b9dffb640 1 -- 172.21.15.6:0/2944046461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8082010 con 0x56198263e590 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.534+0000 7f4b9dffb640 1 -- 172.21.15.6:0/2944046461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba807ab60 con 0x56198263e590 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 -- 172.21.15.6:0/2944046461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198263e590 msgr2=0x561982a48210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198263e590 0x561982a48210 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80abcf0 tx=0x7f4ba80ab000 comp rx=0 tx=0).stop 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 -- 172.21.15.6:0/2944046461 shutdown_connections 2024-05-20T17:53:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198265f270 0x561982a48750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198263e590 0x561982a48210 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/2944046461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 -- 172.21.15.6:0/2944046461 >> 172.21.15.6:0/2944046461 conn(0x5619826533c0 msgr2=0x5619829fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 -- 172.21.15.6:0/2944046461 shutdown_connections 2024-05-20T17:53:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.535+0000 7f4bc59b3740 1 -- 172.21.15.6:0/2944046461 wait complete. 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.536+0000 7f4bc59b3740 1 -- start start 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.536+0000 7f4bc59b3740 1 Processor -- start 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a2b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bc59b3740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198265f270 0x561982a2cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x561982a435a0 con 0x56198265f270 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561982a3c850 con 0x5619826363b0 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bc59b3740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x561982a42870 con 0x56198263e590 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bc59b3740 10 client.0 _ll_register_callbacks cb 0x7f4bb40076b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198265f270 0x561982a2cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198265f270 0x561982a2cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52406/0 (socket says 172.21.15.6:52406) 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 -- 172.21.15.6:0/927315801 learned_addr learned my addr 172.21.15.6:0/927315801 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4baffff640 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a2b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 -- 172.21.15.6:0/927315801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 msgr2=0x561982a2b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a2b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 -- 172.21.15.6:0/927315801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 msgr2=0x561982a2b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 -- 172.21.15.6:0/927315801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561982ac15a0 con 0x56198265f270 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bbd0a6640 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198265f270 0x561982a2cb70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00072c0 tx=0x7f4bb0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75a830b513b8d17 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4b977fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4b977fe640 1 -- 172.21.15.6:0/927315801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb00139d0 con 0x56198265f270 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4b977fe640 1 -- 172.21.15.6:0/927315801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4bb0013b70 con 0x56198265f270 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.538+0000 7f4bc59b3740 1 -- 172.21.15.6:0/927315801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba8082010 con 0x56198265f270 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4b977fe640 1 -- 172.21.15.6:0/927315801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4bb0023050 con 0x56198265f270 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bc59b3740 10 client.4887 fetch_fsmap learned FSMap version 9 2024-05-20T17:53:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bc59b3740 1 -- 172.21.15.6:0/927315801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561982a2c1d0 con 0x56198265f270 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4b977fe640 1 -- 172.21.15.6:0/927315801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8082010 con 0x56198265f270 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4b977fe640 1 -- 172.21.15.6:0/927315801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f4bb0026020 con 0x56198265f270 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bc59b3740 10 client.4887 fetch_fsmap finished waiting for FSMap version 9 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bc59b3740 10 client.4887 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bc59b3740 20 client.4887 populate_metadata read hostname 'smithi006' 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x561982a3ae10 0x561982a2d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bc59b3740 4 client.4887 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bc59b3740 1 -- 172.21.15.6:0/927315801 --> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] -- command(tid 0: {"prefix": "status"}) -- 0x5619829fad50 con 0x561982a3ae10 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.539+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x561982a3ae10 0x561982a2d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4b977fe640 10 client.4887 ms_handle_connect on v2:172.21.15.6:6832/2802786337 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bbc8a5640 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x561982a3ae10 0x561982a2d0b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64a9009e942cf8d0 server_cookie=b914c60c215c7027 in_seq=0 out_seq=0 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4b977fe640 1 -- 172.21.15.6:0/927315801 <== mds.0 v2:172.21.15.6:6832/2802786337 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5619829fad50 con 0x561982a3ae10 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4b977fe640 10 client.4887 handle_command_reply: tid=0 2024-05-20T17:53:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 client.4887 shutdown 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 -- 172.21.15.6:0/927315801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198265f270 msgr2=0x561982a2cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198265f270 0x561982a2cb70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00072c0 tx=0x7f4bb0007780 comp rx=0 tx=0).stop 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 -- 172.21.15.6:0/927315801 shutdown_connections 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.6:6832/2802786337,v1:172.21.15.6:6833/2802786337] conn(0x561982a3ae10 0x561982a2d0b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198265f270 0x561982a2cb70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x56198263e590 0x561982a2b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 --2- 172.21.15.6:0/927315801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619826363b0 0x561982a2b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4b977fe640 0 client.4887 ms_handle_reset on v2:172.21.15.6:6832/2802786337 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 -- 172.21.15.6:0/927315801 >> 172.21.15.6:0/927315801 conn(0x5619826533c0 msgr2=0x561982a2a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 -- 172.21.15.6:0/927315801 shutdown_connections 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 1 -- 172.21.15.6:0/927315801 wait complete. 2024-05-20T17:53:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.540+0000 7f4bc59b3740 20 client.4887 trim_cache size 0 max 16384 2024-05-20T17:53:41.545 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:53:41.545 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T17:53:41.545 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:53:41.545 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4290, 2024-05-20T17:53:41.545 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:53:41.545 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:53:41.545 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:53:41.545 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 33.991068159999998, 2024-05-20T17:53:41.546 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 9, 2024-05-20T17:53:41.546 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 24, 2024-05-20T17:53:41.546 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 24, 2024-05-20T17:53:41.546 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 41.600533822999999 2024-05-20T17:53:41.546 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 -- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ba406be60 msgr2=0x7f4ba406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ba406be60 0x7f4ba406e370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80d29a0 tx=0x7f4bb4008040 comp rx=0 tx=0).stop 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 -- 172.21.15.6:0/4144256555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 msgr2=0x7f4bb8148a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb8148a80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8000c00 tx=0x7f4ba80046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 -- 172.21.15.6:0/4144256555 shutdown_connections 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ba406be60 0x7f4ba406e370 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4bb815d530 0x7f4bb81592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb80b1700 0x7f4bb8148a80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 --2- 172.21.15.6:0/4144256555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4bb8070850 0x7f4bb80c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:41.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 -- 172.21.15.6:0/4144256555 >> 172.21.15.6:0/4144256555 conn(0x7f4bb80d29d0 msgr2=0x7f4bb80b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:41.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 -- 172.21.15.6:0/4144256555 shutdown_connections 2024-05-20T17:53:41.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:41.541+0000 7f4bbeb09640 1 -- 172.21.15.6:0/4144256555 wait complete. 2024-05-20T17:53:41.552 INFO:teuthology.run_tasks:Running task sequential... 2024-05-20T17:53:41.566 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-20T17:53:41.566 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-20T17:53:41.567 INFO:teuthology.task.print:Enabling mgr modules 2024-05-20T17:53:41.567 INFO:teuthology.run_tasks:Running task kclient... 2024-05-20T17:53:41.597 INFO:tasks.kclient:Mounting kernel clients... 2024-05-20T17:53:41.597 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-20T17:53:41.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:41.598 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:53:41.614 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-20T17:53:41.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:41.615 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-20T17:53:41.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:41.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-05-20T17:53:41.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:41.773 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:53:41.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:41.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-05-20T17:53:41.858 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2024-05-20T17:53:41.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:53:41.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:41.859 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:53:41.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:41.880 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-05-20T17:53:41.951 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-05-20T17:53:41.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:53:41.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:41.953 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:53:42.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:42.011 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-05-20T17:53:42.078 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-05-20T17:53:42.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T17:53:42.080 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-20T17:53:42.080 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-20T17:53:42.080 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:53:42.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:53:42.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.198+0000 7f9567226640 1 Processor -- start 2024-05-20T17:53:42.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.198+0000 7f9567226640 1 -- start start 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f9567226640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f956006c4c0 0x7f956015fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f9567226640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95600b51c0 con 0x7f956015ca00 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f9567226640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956015bf20 con 0x7f95600b0020 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f9567226640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f956015c200 con 0x7f956006c4c0 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f955ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f956006c4c0 0x7f956015fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f95657c3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f956015ca00 0x7f95600b3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40790/0 (socket says 172.21.15.6:40790) 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f95657c3640 1 -- 172.21.15.6:0/476543426 learned_addr learned my addr 172.21.15.6:0/476543426 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f955ffff640 1 -- 172.21.15.6:0/476543426 >> v1:172.21.15.171:6789/0 conn(0x7f95600b0020 legacy=0x7f956006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f955ffff640 1 -- 172.21.15.6:0/476543426 >> v1:172.21.15.6:6789/0 conn(0x7f956015ca00 legacy=0x7f95600b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f955f7fe640 1 -- 172.21.15.6:0/476543426 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029783354 0 0) 0x7f95600b51c0 con 0x7f956015ca00 2024-05-20T17:53:42.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.200+0000 7f955ffff640 1 -- 172.21.15.6:0/476543426 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956015c4e0 con 0x7f956006c4c0 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.201+0000 7f955ffff640 1 --2- 172.21.15.6:0/476543426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f956006c4c0 0x7f956015fd80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f95540097a0 tx=0x7f955402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de555a99f20c7310 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.201+0000 7f955f7fe640 1 -- 172.21.15.6:0/476543426 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554037070 con 0x7f956006c4c0 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.201+0000 7f955f7fe640 1 -- 172.21.15.6:0/476543426 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9554032440 con 0x7f956006c4c0 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.201+0000 7f955f7fe640 1 -- 172.21.15.6:0/476543426 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554032810 con 0x7f956006c4c0 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.202+0000 7f9567226640 1 -- 172.21.15.6:0/476543426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f956006c4c0 msgr2=0x7f956015fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.202+0000 7f9567226640 1 --2- 172.21.15.6:0/476543426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f956006c4c0 0x7f956015fd80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f95540097a0 tx=0x7f955402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.202+0000 7f9567226640 1 -- 172.21.15.6:0/476543426 shutdown_connections 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.202+0000 7f9567226640 1 --2- 172.21.15.6:0/476543426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f956006c4c0 0x7f956015fd80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.202+0000 7f9567226640 1 -- 172.21.15.6:0/476543426 >> 172.21.15.6:0/476543426 conn(0x7f95600cd2a0 msgr2=0x7f95600cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.202+0000 7f9567226640 1 -- 172.21.15.6:0/476543426 shutdown_connections 2024-05-20T17:53:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.202+0000 7f9567226640 1 -- 172.21.15.6:0/476543426 wait complete. 2024-05-20T17:53:42.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.204+0000 7f9567226640 1 Processor -- start 2024-05-20T17:53:42.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.204+0000 7f9567226640 1 -- start start 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9567226640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95600b0020 0x7f95600b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9567226640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f956015ca00 0x7f95600af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9567226640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f956009b7e0 0x7f956014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9567226640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f95600b4c00 con 0x7f95600b0020 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9567226640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f95600b54a0 con 0x7f956015ca00 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9567226640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f95600b4d80 con 0x7f956009b7e0 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9564fc2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95600b0020 0x7f95600b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9564fc2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95600b0020 0x7f95600b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52428/0 (socket says 172.21.15.6:52428) 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f9564fc2640 1 -- 172.21.15.6:0/353536723 learned_addr learned my addr 172.21.15.6:0/353536723 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.205+0000 7f955ffff640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f956015ca00 0x7f95600af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f95657c3640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f956009b7e0 0x7f956014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:42.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f9564fc2640 1 -- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f956009b7e0 msgr2=0x7f956014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f9564fc2640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f956009b7e0 0x7f956014d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f9564fc2640 1 -- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f956015ca00 msgr2=0x7f95600af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f9564fc2640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f956015ca00 0x7f95600af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f9564fc2640 1 -- 172.21.15.6:0/353536723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95600aeb50 con 0x7f95600b0020 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f9564fc2640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95600b0020 0x7f95600b41a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f955000c430 tx=0x7f955000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f955d7fa640 1 -- 172.21.15.6:0/353536723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550017070 con 0x7f95600b0020 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f955d7fa640 1 -- 172.21.15.6:0/353536723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95500052d0 con 0x7f95600b0020 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956009bfc0 con 0x7f95600b0020 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f955d7fa640 1 -- 172.21.15.6:0/353536723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550003830 con 0x7f95600b0020 2024-05-20T17:53:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.206+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956014dc30 con 0x7f95600b0020 2024-05-20T17:53:42.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.207+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9560075b00 con 0x7f95600b0020 2024-05-20T17:53:42.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.208+0000 7f955d7fa640 1 -- 172.21.15.6:0/353536723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f955001a070 con 0x7f95600b0020 2024-05-20T17:53:42.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.208+0000 7f955d7fa640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f954c06be60 0x7f954c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:42.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.208+0000 7f955d7fa640 1 -- 172.21.15.6:0/353536723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f955008a500 con 0x7f95600b0020 2024-05-20T17:53:42.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.209+0000 7f955ffff640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f954c06be60 0x7f954c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:42.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.209+0000 7f955ffff640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f954c06be60 0x7f954c06e370 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9554034000 tx=0x7f955402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.213+0000 7f955d7fa640 1 -- 172.21.15.6:0/353536723 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9550058480 con 0x7f95600b0020 2024-05-20T17:53:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.435+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f956009c4e0 con 0x7f95600b0020 2024-05-20T17:53:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.435+0000 7f955d7fa640 1 -- 172.21.15.6:0/353536723 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f955005c780 con 0x7f95600b0020 2024-05-20T17:53:42.435 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-20T17:53:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f954c06be60 msgr2=0x7f954c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f954c06be60 0x7f954c06e370 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9554034000 tx=0x7f955402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95600b0020 msgr2=0x7f95600b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95600b0020 0x7f95600b41a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f955000c430 tx=0x7f955000c8f0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 shutdown_connections 2024-05-20T17:53:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f954c06be60 0x7f954c06e370 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f956009b7e0 0x7f956014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f956015ca00 0x7f95600af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 --2- 172.21.15.6:0/353536723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95600b0020 0x7f95600b41a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 >> 172.21.15.6:0/353536723 conn(0x7f95600cd2a0 msgr2=0x7f956006b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 shutdown_connections 2024-05-20T17:53:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42.437+0000 7f9567226640 1 -- 172.21.15.6:0/353536723 wait complete. 2024-05-20T17:53:42.448 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-20T17:53:42.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:53:42.448 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:53:42.448 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T17:53:42.448 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:53:42.448 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-20T17:53:42.448 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-20T17:53:42.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:53:42.449 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:53:42.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:42.449 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42692sec preferred_lft 42692sec 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:53:42.468 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-20T17:53:42.468 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:42.468 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:42.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-05-20T17:53:42.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-05-20T17:53:42.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-05-20T17:53:42.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-20T17:53:42.468 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:42.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:42.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:42.609 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:53:42.633 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:53:42.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:42.635 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:53:42.692 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:53:42.692 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:53:42.692 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:53:42.692 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:53:42.692 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:53:42.692 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:42.693 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:42.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:53:42.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:53:42.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:53:42.693 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:42.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:42.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:42.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:42.822 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:53:42.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:42.839 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-05-20T17:53:42.894 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:42.895 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:42.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:53:42.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-20T17:53:42.895 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:42.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:43.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:43.015 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-20T17:53:43.016 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:43.016 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:43.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-20T17:53:43.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-20T17:53:43.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-20T17:53:43.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-20T17:53:43.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-20T17:53:43.016 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:43.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:43.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:43.134 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:43.134 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:43.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:53:43.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-05-20T17:53:43.134 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:43.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:43.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:43.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:43.214 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T17:53:43.230 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:53:43.230 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:43.230 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:53:43.285 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T17:53:43.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:43.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:43.381 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:43.381 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:53:43.505 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:43.505 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:53:43.505 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:53:43.505 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:53:43.505 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:53:43.506 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T17:53:43.506 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:53:43.506 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:53:43.506 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:53:43.506 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:53:43.508 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:53:43.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:43.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:53:43.534 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:43.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:43.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:43.633 INFO:teuthology.orchestra.run.smithi006.stdout:client4762 2024-05-20T17:53:43.633 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:53:43.634 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:43.650 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:43.747 INFO:teuthology.orchestra.run.smithi006.stdout:client4762 2024-05-20T17:53:43.747 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:43.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:43.806 INFO:teuthology.orchestra.run.smithi006.stdout:client4762 2024-05-20T17:53:43.806 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/08ecd7a5-bb84-4836-85d5-8cdd45e39724.client4762/status') 2024-05-20T17:53:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:43.866 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.4762 (3)172.21.15.6:0/2978992034 2024-05-20T17:53:43.866 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2024-05-20T17:53:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2024-05-20T17:53:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2024-05-20T17:53:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:69 bytes copied, 2.4264e-05 s, 2.8 MB/s 2024-05-20T17:53:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:43.874 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-20T17:53:43.874 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-20T17:53:43.874 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-20T17:53:43.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:53:43.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.989+0000 7fda6ebc3640 1 Processor -- start 2024-05-20T17:53:43.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.989+0000 7fda6ebc3640 1 -- start start 2024-05-20T17:53:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.990+0000 7fda6ebc3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fda680cfae0 0x7fda68162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.990+0000 7fda6ebc3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6806c8c0 con 0x7fda6806d6b0 2024-05-20T17:53:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.990+0000 7fda6ebc3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6806dac0 con 0x7fda680cd710 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.990+0000 7fda6ebc3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fda680d0ba0 con 0x7fda680cfae0 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.991+0000 7fda6d160640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fda6806d6b0 0x7fda680d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40802/0 (socket says 172.21.15.6:40802) 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.991+0000 7fda6d160640 1 -- 172.21.15.6:0/2279712360 learned_addr learned my addr 172.21.15.6:0/2279712360 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.991+0000 7fda67fff640 1 --2- 172.21.15.6:0/2279712360 >> v2:172.21.15.171:3300/0 conn(0x7fda680cfae0 0x7fda68162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.991+0000 7fda677fe640 1 -- 172.21.15.6:0/2279712360 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1290227447 0 0) 0x7fda6806c8c0 con 0x7fda6806d6b0 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.991+0000 7fda677fe640 1 -- 172.21.15.6:0/2279712360 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda58003520 con 0x7fda6806d6b0 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.991+0000 7fda67fff640 1 -- 172.21.15.6:0/2279712360 >> v1:172.21.15.171:6789/0 conn(0x7fda680cd710 legacy=0x7fda680cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.991+0000 7fda67fff640 1 -- 172.21.15.6:0/2279712360 >> v1:172.21.15.6:6789/0 conn(0x7fda6806d6b0 legacy=0x7fda680d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.991+0000 7fda67fff640 1 -- 172.21.15.6:0/2279712360 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda681633e0 con 0x7fda680cfae0 2024-05-20T17:53:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.992+0000 7fda67fff640 1 --2- 172.21.15.6:0/2279712360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda680cfae0 0x7fda68162e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda680d0d20 tx=0x7fda5402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8674de632b974714 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.992+0000 7fda677fe640 1 -- 172.21.15.6:0/2279712360 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54037070 con 0x7fda680cfae0 2024-05-20T17:53:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.992+0000 7fda677fe640 1 -- 172.21.15.6:0/2279712360 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda54032440 con 0x7fda680cfae0 2024-05-20T17:53:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.992+0000 7fda677fe640 1 -- 172.21.15.6:0/2279712360 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54032810 con 0x7fda680cfae0 2024-05-20T17:53:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.993+0000 7fda6ebc3640 1 -- 172.21.15.6:0/2279712360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda680cfae0 msgr2=0x7fda68162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.993+0000 7fda6ebc3640 1 --2- 172.21.15.6:0/2279712360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda680cfae0 0x7fda68162e00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda680d0d20 tx=0x7fda5402a210 comp rx=0 tx=0).stop 2024-05-20T17:53:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.993+0000 7fda6ebc3640 1 -- 172.21.15.6:0/2279712360 shutdown_connections 2024-05-20T17:53:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.993+0000 7fda6ebc3640 1 --2- 172.21.15.6:0/2279712360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda680cfae0 0x7fda68162e00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.993+0000 7fda6ebc3640 1 -- 172.21.15.6:0/2279712360 >> 172.21.15.6:0/2279712360 conn(0x7fda680b44d0 msgr2=0x7fda680b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.993+0000 7fda6ebc3640 1 -- 172.21.15.6:0/2279712360 shutdown_connections 2024-05-20T17:53:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.993+0000 7fda6ebc3640 1 -- 172.21.15.6:0/2279712360 wait complete. 2024-05-20T17:53:43.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.995+0000 7fda6ebc3640 1 Processor -- start 2024-05-20T17:53:43.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.995+0000 7fda6ebc3640 1 -- start start 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.996+0000 7fda6ebc3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda6806d6b0 0x7fda680cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.996+0000 7fda6ebc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd710 0x7fda681595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.996+0000 7fda6ebc3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda680c7690 0x7fda68161650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.996+0000 7fda6ebc3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fda68163c80 con 0x7fda680cd710 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.996+0000 7fda6ebc3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fda68163a60 con 0x7fda6806d6b0 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.996+0000 7fda6ebc3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fda6815f2b0 con 0x7fda680c7690 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.996+0000 7fda67fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd710 0x7fda681595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.996+0000 7fda67fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd710 0x7fda681595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52440/0 (socket says 172.21.15.6:52440) 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda67fff640 1 -- 172.21.15.6:0/1207594 learned_addr learned my addr 172.21.15.6:0/1207594 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda6c95f640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda6806d6b0 0x7fda680cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda6d160640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda680c7690 0x7fda68161650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda67fff640 1 -- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda680c7690 msgr2=0x7fda68161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda67fff640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda680c7690 0x7fda68161650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda67fff640 1 -- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda6806d6b0 msgr2=0x7fda680cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda67fff640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda6806d6b0 0x7fda680cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda67fff640 1 -- 172.21.15.6:0/1207594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68159ae0 con 0x7fda680cd710 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda67fff640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd710 0x7fda681595a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda54000c00 tx=0x7fda540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda657fa640 1 -- 172.21.15.6:0/1207594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54037040 con 0x7fda680cd710 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda657fa640 1 -- 172.21.15.6:0/1207594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda54042070 con 0x7fda680cd710 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda657fa640 1 -- 172.21.15.6:0/1207594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54030900 con 0x7fda680cd710 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda680cb400 con 0x7fda680cd710 2024-05-20T17:53:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.997+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda680cb9c0 con 0x7fda680cd710 2024-05-20T17:53:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.998+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda68075b00 con 0x7fda680cd710 2024-05-20T17:53:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:43.999+0000 7fda657fa640 1 -- 172.21.15.6:0/1207594 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda54030aa0 con 0x7fda680cd710 2024-05-20T17:53:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.000+0000 7fda657fa640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda4c06be30 0x7fda4c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.000+0000 7fda657fa640 1 -- 172.21.15.6:0/1207594 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda540ab970 con 0x7fda680cd710 2024-05-20T17:53:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.000+0000 7fda6c95f640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda4c06be30 0x7fda4c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.000+0000 7fda6c95f640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda4c06be30 0x7fda4c06e340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda68162d60 tx=0x7fda5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.004+0000 7fda657fa640 1 -- 172.21.15.6:0/1207594 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fda54079990 con 0x7fda680cd710 2024-05-20T17:53:44.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.231+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fda680b8940 con 0x7fda680cd710 2024-05-20T17:53:44.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.232+0000 7fda657fa640 1 -- 172.21.15.6:0/1207594 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fda5407ee20 con 0x7fda680cd710 2024-05-20T17:53:44.231 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-20T17:53:44.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda4c06be30 msgr2=0x7fda4c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda4c06be30 0x7fda4c06e340 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda68162d60 tx=0x7fda5c009040 comp rx=0 tx=0).stop 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd710 msgr2=0x7fda681595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd710 0x7fda681595a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda54000c00 tx=0x7fda540046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 shutdown_connections 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda4c06be30 0x7fda4c06e340 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda680c7690 0x7fda68161650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda680cd710 0x7fda681595a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 --2- 172.21.15.6:0/1207594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda6806d6b0 0x7fda680cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 >> 172.21.15.6:0/1207594 conn(0x7fda680b44d0 msgr2=0x7fda680b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 shutdown_connections 2024-05-20T17:53:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44.234+0000 7fda6ebc3640 1 -- 172.21.15.6:0/1207594 wait complete. 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:53:44.245 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-20T17:53:44.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:44.246 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:53:44.262 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42690sec preferred_lft 42690sec 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link tentative 2024-05-20T17:53:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.264 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:53:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:53:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T17:53:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:44.264 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:53:44.327 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:53:44.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:44.328 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:53:44.385 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:53:44.385 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:53:44.385 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:53:44.385 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:53:44.385 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:53:44.385 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:44.385 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:44.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:53:44.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:53:44.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:53:44.386 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:44.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:44.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:44.515 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:53:44.531 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T17:53:44.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:44.532 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-05-20T17:53:44.587 INFO:teuthology.orchestra.run.smithi006.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-20T17:53:44.587 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:44.588 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:44.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T17:53:44.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-20T17:53:44.588 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:44.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:44.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:44.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-20T17:53:44.733 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:44.733 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether a6:c7:08:22:de:40 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a4c7:8ff:fe22:de40/64 scope link 2024-05-20T17:53:44.734 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:44.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-20T17:53:44.801 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.802 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:53:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether a6:c7:08:22:de:40 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-20T17:53:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-20T17:53:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a4c7:8ff:fe22:de40/64 scope link 2024-05-20T17:53:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:44.803 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-20T17:53:44.803 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:44.803 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:44.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-20T17:53:44.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-20T17:53:44.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-20T17:53:44.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-20T17:53:44.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-20T17:53:44.804 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:44.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:44.961 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:44.961 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:53:44.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.1 up 2024-05-20T17:53:44.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.1 master ceph-brx 2024-05-20T17:53:44.961 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:53:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:45.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:45.041 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-20T17:53:45.064 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-20T17:53:45.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:45.065 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-20T17:53:45.121 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-20T17:53:45.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:45.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:45.218 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:45.218 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:53:45.229 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:45.229 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:53:45.230 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:53:45.230 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 2@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:53:45.230 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:53:45.230 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-20T17:53:45.230 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:53:45.230 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:53:45.230 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:53:45.230 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:53:45.235 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:53:45.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:45.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-20T17:53:45.261 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:45.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:45.359 INFO:teuthology.orchestra.run.smithi006.stdout:client4905 2024-05-20T17:53:45.359 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:53:45.359 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:45.376 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:45.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:45.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:client4905 2024-05-20T17:53:45.475 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:45.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:45.533 INFO:teuthology.orchestra.run.smithi006.stdout:client4905 2024-05-20T17:53:45.533 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/08ecd7a5-bb84-4836-85d5-8cdd45e39724.client4905/status') 2024-05-20T17:53:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:45.594 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.4905 (3)192.168.0.2:0/3544773187 2024-05-20T17:53:45.594 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2024-05-20T17:53:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2024-05-20T17:53:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2024-05-20T17:53:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:69 bytes copied, 2.4117e-05 s, 2.9 MB/s 2024-05-20T17:53:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:45.603 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-20T17:53:45.603 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-20T17:53:45.603 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T17:53:45.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:53:45.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.718+0000 7f700d757640 1 Processor -- start 2024-05-20T17:53:45.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.718+0000 7f700d757640 1 -- start start 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f700d757640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7008162820 0x7f70080b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f700d757640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70080b3e80 0x7f700806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f700d757640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700806dd20 con 0x7f700806d910 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f700d757640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f70080d0630 con 0x7f7008162820 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f700d757640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f70080d39c0 con 0x7f70080b3e80 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f7006ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7008162820 0x7f70080b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f70077fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f700806d910 0x7f70080d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40812/0 (socket says 172.21.15.6:40812) 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f70077fe640 1 -- 172.21.15.6:0/4167812677 learned_addr learned my addr 172.21.15.6:0/4167812677 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f70067fc640 1 --2- 172.21.15.6:0/4167812677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70080b3e80 0x7f700806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f7006ffd640 1 -- 172.21.15.6:0/4167812677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70080b3e80 msgr2=0x7f700806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f7006ffd640 1 --2- 172.21.15.6:0/4167812677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70080b3e80 0x7f700806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f7006ffd640 1 -- 172.21.15.6:0/4167812677 >> v1:172.21.15.6:6789/0 conn(0x7f700806d910 legacy=0x7f70080d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:45.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f7005ffb640 1 -- 172.21.15.6:0/4167812677 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600324688 0 0) 0x7f7000001490 con 0x7f700806d910 2024-05-20T17:53:45.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.720+0000 7f7006ffd640 1 -- 172.21.15.6:0/4167812677 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70080d3ca0 con 0x7f7008162820 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.721+0000 7f7006ffd640 1 --2- 172.21.15.6:0/4167812677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7008162820 0x7f70080b3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80097a0 tx=0x7f6ff802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f8ea51c3dc6d64 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.721+0000 7f7005ffb640 1 -- 172.21.15.6:0/4167812677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8037070 con 0x7f7008162820 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.721+0000 7f7005ffb640 1 -- 172.21.15.6:0/4167812677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff8032440 con 0x7f7008162820 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.721+0000 7f7005ffb640 1 -- 172.21.15.6:0/4167812677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8032810 con 0x7f7008162820 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.722+0000 7f700d757640 1 -- 172.21.15.6:0/4167812677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7008162820 msgr2=0x7f70080b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.722+0000 7f700d757640 1 --2- 172.21.15.6:0/4167812677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7008162820 0x7f70080b3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80097a0 tx=0x7f6ff802a180 comp rx=0 tx=0).stop 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.722+0000 7f700d757640 1 -- 172.21.15.6:0/4167812677 shutdown_connections 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.722+0000 7f700d757640 1 --2- 172.21.15.6:0/4167812677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f70080b3e80 0x7f700806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.722+0000 7f700d757640 1 --2- 172.21.15.6:0/4167812677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7008162820 0x7f70080b3940 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.722+0000 7f700d757640 1 -- 172.21.15.6:0/4167812677 >> 172.21.15.6:0/4167812677 conn(0x7f70080d4bd0 msgr2=0x7f70080d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.722+0000 7f700d757640 1 -- 172.21.15.6:0/4167812677 shutdown_connections 2024-05-20T17:53:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.722+0000 7f700d757640 1 -- 172.21.15.6:0/4167812677 wait complete. 2024-05-20T17:53:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.724+0000 7f700d757640 1 Processor -- start 2024-05-20T17:53:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.724+0000 7f700d757640 1 -- start start 2024-05-20T17:53:45.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f700d757640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f700806d910 0x7f70080b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f700d757640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70080b3e80 0x7f70080b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f700d757640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7008162820 0x7f70080b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f700d757640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f70080d0300 con 0x7f70080b3e80 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f700d757640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f70080d4260 con 0x7f7008162820 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f700d757640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f70080b91a0 con 0x7f700806d910 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f70067fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70080b3e80 0x7f70080b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f70067fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70080b3e80 0x7f70080b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52454/0 (socket says 172.21.15.6:52454) 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.725+0000 7f70067fc640 1 -- 172.21.15.6:0/2880785767 learned_addr learned my addr 172.21.15.6:0/2880785767 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f7006ffd640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f700806d910 0x7f70080b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:45.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f70077fe640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7008162820 0x7f70080b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f70067fc640 1 -- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f700806d910 msgr2=0x7f70080b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f70067fc640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f700806d910 0x7f70080b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f70067fc640 1 -- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7008162820 msgr2=0x7f70080b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f70067fc640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7008162820 0x7f70080b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f70067fc640 1 -- 172.21.15.6:0/2880785767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70080cd780 con 0x7f70080b3e80 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f70067fc640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70080b3e80 0x7f70080b6920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000d650 tx=0x7f6ff000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f6fff7fe640 1 -- 172.21.15.6:0/2880785767 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000b660 con 0x7f70080b3e80 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f6fff7fe640 1 -- 172.21.15.6:0/2880785767 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff0019070 con 0x7f70080b3e80 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70080cda60 con 0x7f70080b3e80 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f6fff7fe640 1 -- 172.21.15.6:0/2880785767 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000ba40 con 0x7f70080b3e80 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.726+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70080ce540 con 0x7f70080b3e80 2024-05-20T17:53:45.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.727+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7008075b00 con 0x7f70080b3e80 2024-05-20T17:53:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.728+0000 7f6fff7fe640 1 -- 172.21.15.6:0/2880785767 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ff000bbe0 con 0x7f70080b3e80 2024-05-20T17:53:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.728+0000 7f6fff7fe640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe806be60 0x7f6fe806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.729+0000 7f6fff7fe640 1 -- 172.21.15.6:0/2880785767 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6ff008b690 con 0x7f70080b3e80 2024-05-20T17:53:45.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.729+0000 7f7006ffd640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe806be60 0x7f6fe806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:45.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.729+0000 7f7006ffd640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe806be60 0x7f6fe806e370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8034000 tx=0x7f6ff802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:45.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.733+0000 7f6fff7fe640 1 -- 172.21.15.6:0/2880785767 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6ff0059b50 con 0x7f70080b3e80 2024-05-20T17:53:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.956+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f70080b3620 con 0x7f70080b3e80 2024-05-20T17:53:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.956+0000 7f6fff7fe640 1 -- 172.21.15.6:0/2880785767 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f6ff0059450 con 0x7f70080b3e80 2024-05-20T17:53:45.956 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-20T17:53:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe806be60 msgr2=0x7f6fe806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe806be60 0x7f6fe806e370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8034000 tx=0x7f6ff802e000 comp rx=0 tx=0).stop 2024-05-20T17:53:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70080b3e80 msgr2=0x7f70080b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70080b3e80 0x7f70080b6920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000d650 tx=0x7f6ff000db10 comp rx=0 tx=0).stop 2024-05-20T17:53:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 shutdown_connections 2024-05-20T17:53:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe806be60 0x7f6fe806e370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7008162820 0x7f70080b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70080b3e80 0x7f70080b6920 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 --2- 172.21.15.6:0/2880785767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f700806d910 0x7f70080b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 >> 172.21.15.6:0/2880785767 conn(0x7f70080d4bd0 msgr2=0x7f70080b9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 shutdown_connections 2024-05-20T17:53:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:45.958+0000 7f700d757640 1 -- 172.21.15.6:0/2880785767 wait complete. 2024-05-20T17:53:45.969 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-20T17:53:45.969 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:53:45.969 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T17:53:45.969 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T17:53:45.970 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T17:53:45.970 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-20T17:53:45.970 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-20T17:53:45.970 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:53:45.970 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:53:45.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:45.970 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T17:53:45.990 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:45.991 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42699sec preferred_lft 42699sec 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T17:53:45.992 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:45.993 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-20T17:53:45.993 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:45.993 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:45.993 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add name ceph-brx type bridge 2024-05-20T17:53:45.993 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr flush dev ceph-brx 2024-05-20T17:53:45.993 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set ceph-brx up 2024-05-20T17:53:45.993 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-20T17:53:45.993 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:46.087 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:46.210 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:46.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:46.216 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:53:46.244 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T17:53:46.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:46.245 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T17:53:46.318 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T17:53:46.318 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:53:46.318 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T17:53:46.318 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T17:53:46.318 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:53:46.319 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:46.319 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:46.319 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T17:53:46.319 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T17:53:46.319 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T17:53:46.319 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:46.408 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:46.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:46.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:46.609 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:53:46.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:46.625 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2024-05-20T17:53:46.680 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:46.680 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:46.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T17:53:46.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-20T17:53:46.680 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:46.773 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:46.808 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:46.815 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-20T17:53:46.815 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:46.816 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:46.816 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-20T17:53:46.816 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-20T17:53:46.816 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-20T17:53:46.816 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-20T17:53:46.816 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-20T17:53:46.816 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:46.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:46.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:46.949 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:46.950 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:46.950 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T17:53:46.950 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.0 master ceph-brx 2024-05-20T17:53:46.950 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:46.999 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:47.023 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:47.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:47.029 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T17:53:47.043 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:53:47.044 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:47.044 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:53:47.098 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T17:53:47.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:47.099 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:47.203 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:47.203 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:53:47.319 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:47.319 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:53:47.319 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:53:47.319 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:53:47.320 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:53:47.320 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T17:53:47.320 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:53:47.320 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:53:47.321 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:53:47.321 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:53:47.322 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:53:47.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:47.322 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:53:47.347 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:47.437 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:47.439 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:47.445 INFO:teuthology.orchestra.run.smithi171.stdout:client4625 2024-05-20T17:53:47.445 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:53:47.445 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:47.461 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:47.550 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:47.552 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:47.557 INFO:teuthology.orchestra.run.smithi171.stdout:client4625 2024-05-20T17:53:47.558 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:47.611 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:47.612 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:47.619 INFO:teuthology.orchestra.run.smithi171.stdout:client4625 2024-05-20T17:53:47.619 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/08ecd7a5-bb84-4836-85d5-8cdd45e39724.client4625/status') 2024-05-20T17:53:47.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:47.678 INFO:teuthology.orchestra.run.smithi171.stdout:instance: client.4625 (3)192.168.0.1:0/3169052572 2024-05-20T17:53:47.678 INFO:teuthology.orchestra.run.smithi171.stdout:blocklisted: false 2024-05-20T17:53:47.678 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records in 2024-05-20T17:53:47.678 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records out 2024-05-20T17:53:47.678 INFO:teuthology.orchestra.run.smithi171.stderr:69 bytes copied, 3.8702e-05 s, 1.8 MB/s 2024-05-20T17:53:47.679 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:47.685 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-20T17:53:47.685 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-20T17:53:47.685 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-20T17:53:47.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:53:47.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.822+0000 7f27c7051640 1 Processor -- start 2024-05-20T17:53:47.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.822+0000 7f27c7051640 1 -- start start 2024-05-20T17:53:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.823+0000 7f27c7051640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f27c0163a10 0x7f27c00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.823+0000 7f27c7051640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f27c00b4010 0x7f27c00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.823+0000 7f27c7051640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c00d0370 con 0x7f27c00d14b0 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.823+0000 7f27c7051640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f27c00d3ca0 con 0x7f27c0163a10 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.823+0000 7f27c7051640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f27c00d0650 con 0x7f27c00b4010 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27c4ded640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f27c0163a10 0x7f27c00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27c55ee640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f27c00d14b0 0x7f27c00d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52784/0 (socket says 172.21.15.6:52784) 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27c55ee640 1 -- 172.21.15.6:0/3858091941 learned_addr learned my addr 172.21.15.6:0/3858091941 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27bffff640 1 --2- 172.21.15.6:0/3858091941 >> v2:172.21.15.171:3300/0 conn(0x7f27c00b4010 0x7f27c00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27c4ded640 1 -- 172.21.15.6:0/3858091941 >> v2:172.21.15.171:3300/0 conn(0x7f27c00b4010 msgr2=0x7f27c00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27c4ded640 1 --2- 172.21.15.6:0/3858091941 >> v2:172.21.15.171:3300/0 conn(0x7f27c00b4010 0x7f27c00cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27c4ded640 1 -- 172.21.15.6:0/3858091941 >> v1:172.21.15.6:6789/0 conn(0x7f27c00d14b0 legacy=0x7f27c00d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27bf7fe640 1 -- 172.21.15.6:0/3858091941 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425518064 0 0) 0x7f27c00d0370 con 0x7f27c00d14b0 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27c4ded640 1 -- 172.21.15.6:0/3858091941 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c00d3650 con 0x7f27c0163a10 2024-05-20T17:53:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.824+0000 7f27bffff640 1 --2- 172.21.15.6:0/3858091941 >> v2:172.21.15.171:3300/0 conn(0x7f27c00b4010 0x7f27c00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.825+0000 7f27c4ded640 1 --2- 172.21.15.6:0/3858091941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c00d4130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f27c00b7f80 tx=0x7f27b402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5657d5a367b7caed server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.825+0000 7f27bf7fe640 1 -- 172.21.15.6:0/3858091941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4037070 con 0x7f27c0163a10 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.825+0000 7f27bf7fe640 1 -- 172.21.15.6:0/3858091941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b4032440 con 0x7f27c0163a10 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.825+0000 7f27bf7fe640 1 -- 172.21.15.6:0/3858091941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4032810 con 0x7f27c0163a10 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.826+0000 7f27c7051640 1 -- 172.21.15.6:0/3858091941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 msgr2=0x7f27c00d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.826+0000 7f27c7051640 1 --2- 172.21.15.6:0/3858091941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c00d4130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f27c00b7f80 tx=0x7f27b402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.826+0000 7f27c7051640 1 -- 172.21.15.6:0/3858091941 shutdown_connections 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.826+0000 7f27c7051640 1 --2- 172.21.15.6:0/3858091941 >> v2:172.21.15.171:3300/0 conn(0x7f27c00b4010 0x7f27c00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.826+0000 7f27c7051640 1 --2- 172.21.15.6:0/3858091941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c00d4130 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.826+0000 7f27c7051640 1 -- 172.21.15.6:0/3858091941 >> 172.21.15.6:0/3858091941 conn(0x7f27c006d240 msgr2=0x7f27c006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.826+0000 7f27c7051640 1 -- 172.21.15.6:0/3858091941 shutdown_connections 2024-05-20T17:53:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.826+0000 7f27c7051640 1 -- 172.21.15.6:0/3858091941 wait complete. 2024-05-20T17:53:47.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.828+0000 7f27c7051640 1 Processor -- start 2024-05-20T17:53:47.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.828+0000 7f27c7051640 1 -- start start 2024-05-20T17:53:47.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c7051640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f27c00b4010 0x7f27c00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c7051640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27c00d14b0 0x7f27c00b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c7051640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c01f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c7051640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00b8210 con 0x7f27c0163a10 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c7051640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00d0040 con 0x7f27c00d14b0 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c7051640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f27c00b8390 con 0x7f27c00b4010 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c55ee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c01f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c55ee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c01f8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34886/0 (socket says 172.21.15.6:34886) 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c55ee640 1 -- 172.21.15.6:0/2394325812 learned_addr learned my addr 172.21.15.6:0/2394325812 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27c4ded640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f27c00b4010 0x7f27c00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.829+0000 7f27bffff640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27c00d14b0 0x7f27c00b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27c55ee640 1 -- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f27c00b4010 msgr2=0x7f27c00ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:47.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27c55ee640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f27c00b4010 0x7f27c00ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27c55ee640 1 -- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27c00d14b0 msgr2=0x7f27c00b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27c55ee640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27c00d14b0 0x7f27c00b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27c55ee640 1 -- 172.21.15.6:0/2394325812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c00ab860 con 0x7f27c0163a10 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27bffff640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27c00d14b0 0x7f27c00b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27c55ee640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c01f8870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c760 tx=0x7f27b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27bd7fa640 1 -- 172.21.15.6:0/2394325812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8018070 con 0x7f27c0163a10 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27bd7fa640 1 -- 172.21.15.6:0/2394325812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b800a640 con 0x7f27c0163a10 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c00abb40 con 0x7f27c0163a10 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27bd7fa640 1 -- 172.21.15.6:0/2394325812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b800aa30 con 0x7f27c0163a10 2024-05-20T17:53:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.830+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c00ac100 con 0x7f27c0163a10 2024-05-20T17:53:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.831+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c0075b00 con 0x7f27c0163a10 2024-05-20T17:53:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.832+0000 7f27bd7fa640 1 -- 172.21.15.6:0/2394325812 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27b801b070 con 0x7f27c0163a10 2024-05-20T17:53:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.832+0000 7f27bd7fa640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27a406be60 0x7f27a406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.833+0000 7f27bd7fa640 1 -- 172.21.15.6:0/2394325812 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f27b808a790 con 0x7f27c0163a10 2024-05-20T17:53:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.833+0000 7f27c4ded640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27a406be60 0x7f27a406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.833+0000 7f27c4ded640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27a406be60 0x7f27a406e370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f27b4034000 tx=0x7f27b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:47.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:47.837+0000 7f27bd7fa640 1 -- 172.21.15.6:0/2394325812 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f27b80586b0 con 0x7f27c0163a10 2024-05-20T17:53:48.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.061+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27c015d6e0 con 0x7f27c0163a10 2024-05-20T17:53:48.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.061+0000 7f27bd7fa640 1 -- 172.21.15.6:0/2394325812 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f27b805c9b0 con 0x7f27c0163a10 2024-05-20T17:53:48.060 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-20T17:53:48.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27a406be60 msgr2=0x7f27a406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:48.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27a406be60 0x7f27a406e370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f27b4034000 tx=0x7f27b402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 msgr2=0x7f27c01f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c01f8870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c760 tx=0x7f27b800cc20 comp rx=0 tx=0).stop 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 shutdown_connections 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27a406be60 0x7f27a406e370 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c0163a10 0x7f27c01f8870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27c00d14b0 0x7f27c00b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 --2- 172.21.15.6:0/2394325812 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f27c00b4010 0x7f27c00ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 >> 172.21.15.6:0/2394325812 conn(0x7f27c006d240 msgr2=0x7f27c00ba480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 shutdown_connections 2024-05-20T17:53:48.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:48.063+0000 7f27c7051640 1 -- 172.21.15.6:0/2394325812 wait complete. 2024-05-20T17:53:48.073 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-20T17:53:48.074 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:53:48.074 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T17:53:48.074 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-20T17:53:48.074 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-20T17:53:48.074 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-20T17:53:48.074 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-20T17:53:48.074 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:53:48.074 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-20T17:53:48.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:48.074 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T17:53:48.091 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:48.091 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:48.091 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:48.092 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42697sec preferred_lft 42697sec 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link tentative 2024-05-20T17:53:48.093 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:48.094 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:53:48.156 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T17:53:48.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:48.157 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T17:53:48.214 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T17:53:48.214 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:53:48.214 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T17:53:48.214 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T17:53:48.214 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:53:48.215 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:48.215 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:48.215 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T17:53:48.215 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T17:53:48.215 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T17:53:48.215 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:48.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:48.336 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:48.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:48.342 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:53:48.358 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T17:53:48.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:48.359 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2024-05-20T17:53:48.413 INFO:teuthology.orchestra.run.smithi171.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-20T17:53:48.414 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:48.414 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:48.414 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T17:53:48.414 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-20T17:53:48.414 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:48.504 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:48.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:48.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:48.533 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-20T17:53:48.557 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 76:b7:6f:82:1a:75 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::74b7:6fff:fe82:1a75/64 scope link 2024-05-20T17:53:48.558 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:48.559 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-20T17:53:48.624 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:53:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:53:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:53:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:53:48.625 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.625 INFO:teuthology.orchestra.run.smithi171.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:53:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 76:b7:6f:82:1a:75 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-20T17:53:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-20T17:53:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::74b7:6fff:fe82:1a75/64 scope link 2024-05-20T17:53:48.626 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:53:48.628 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-20T17:53:48.628 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:48.628 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:48.628 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-20T17:53:48.629 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-20T17:53:48.629 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-20T17:53:48.629 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-20T17:53:48.629 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-20T17:53:48.629 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:48.717 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:48.777 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:48.784 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:53:48.784 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:53:48.784 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.1 up 2024-05-20T17:53:48.784 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.1 master ceph-brx 2024-05-20T17:53:48.784 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:53:48.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:48.854 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:48.861 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:48.861 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-20T17:53:48.876 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-20T17:53:48.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:53:48.877 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-20T17:53:48.931 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-20T17:53:48.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:48.931 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:49.025 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:49.025 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:53:49.034 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:53:49.034 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:53:49.035 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:53:49.035 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 3@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:53:49.035 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:53:49.035 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-20T17:53:49.035 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:53:49.035 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:53:49.036 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:53:49.036 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:53:49.037 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:53:49.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:53:49.037 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-20T17:53:49.062 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:49.150 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:49.152 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:49.158 INFO:teuthology.orchestra.run.smithi171.stdout:client4631 2024-05-20T17:53:49.158 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:53:49.158 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:49.174 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:49.264 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:49.266 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:49.272 INFO:teuthology.orchestra.run.smithi171.stdout:client4631 2024-05-20T17:53:49.272 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:53:49.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:53:49.322 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:49.327 INFO:teuthology.orchestra.run.smithi171.stdout:client4631 2024-05-20T17:53:49.327 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/08ecd7a5-bb84-4836-85d5-8cdd45e39724.client4631/status') 2024-05-20T17:53:49.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:53:49.386 INFO:teuthology.orchestra.run.smithi171.stdout:instance: client.4631 (3)192.168.0.2:0/2926101222 2024-05-20T17:53:49.386 INFO:teuthology.orchestra.run.smithi171.stdout:blocklisted: false 2024-05-20T17:53:49.386 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records in 2024-05-20T17:53:49.387 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records out 2024-05-20T17:53:49.387 INFO:teuthology.orchestra.run.smithi171.stderr:69 bytes copied, 2.3278e-05 s, 3.0 MB/s 2024-05-20T17:53:49.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:53:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:53:49.393 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-20T17:53:49.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.540+0000 7f2bc784a640 1 Processor -- start 2024-05-20T17:53:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.540+0000 7f2bc784a640 1 -- start start 2024-05-20T17:53:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.541+0000 7f2bc784a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2bc0163870 0x7f2bc006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.541+0000 7f2bc784a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bc0070f60 0x7f2bc00d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc784a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc006d400 con 0x7f2bc006ced0 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc784a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc006d6e0 con 0x7f2bc0070f60 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc784a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc006d9c0 con 0x7f2bc0163870 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc5de7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bc0070f60 0x7f2bc00d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc5de7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bc0070f60 0x7f2bc00d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34892/0 (socket says 172.21.15.6:34892) 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc5de7640 1 -- 172.21.15.6:0/3633292393 learned_addr learned my addr 172.21.15.6:0/3633292393 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc55e6640 1 --2- 172.21.15.6:0/3633292393 >> v2:172.21.15.171:3300/0 conn(0x7f2bc0163870 0x7f2bc006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc5de7640 1 -- 172.21.15.6:0/3633292393 >> v2:172.21.15.171:3300/0 conn(0x7f2bc0163870 msgr2=0x7f2bc006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc5de7640 1 --2- 172.21.15.6:0/3633292393 >> v2:172.21.15.171:3300/0 conn(0x7f2bc0163870 0x7f2bc006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc5de7640 1 -- 172.21.15.6:0/3633292393 >> v1:172.21.15.171:6789/0 conn(0x7f2bc006ced0 legacy=0x7f2bc0070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.542+0000 7f2bc5de7640 1 -- 172.21.15.6:0/3633292393 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc006dca0 con 0x7f2bc0070f60 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.543+0000 7f2bc5de7640 1 --2- 172.21.15.6:0/3633292393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc0070f60 0x7f2bc00d05a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2bc004f720 tx=0x7f2bb802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a9673330ca4c0f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.543+0000 7f2bb7fff640 1 -- 172.21.15.6:0/3633292393 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8036070 con 0x7f2bc0070f60 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.543+0000 7f2bb7fff640 1 -- 172.21.15.6:0/3633292393 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb8031600 con 0x7f2bc0070f60 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.543+0000 7f2bb7fff640 1 -- 172.21.15.6:0/3633292393 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb80319f0 con 0x7f2bc0070f60 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.544+0000 7f2bc784a640 1 -- 172.21.15.6:0/3633292393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc0070f60 msgr2=0x7f2bc00d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.544+0000 7f2bc784a640 1 --2- 172.21.15.6:0/3633292393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc0070f60 0x7f2bc00d05a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2bc004f720 tx=0x7f2bb802a7c0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.544+0000 7f2bc784a640 1 -- 172.21.15.6:0/3633292393 shutdown_connections 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.544+0000 7f2bc784a640 1 --2- 172.21.15.6:0/3633292393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc0070f60 0x7f2bc00d05a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.544+0000 7f2bc784a640 1 --2- 172.21.15.6:0/3633292393 >> v2:172.21.15.171:3300/0 conn(0x7f2bc0163870 0x7f2bc006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.544+0000 7f2bc784a640 1 -- 172.21.15.6:0/3633292393 >> 172.21.15.6:0/3633292393 conn(0x7f2bc00d29d0 msgr2=0x7f2bc00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.544+0000 7f2bc784a640 1 -- 172.21.15.6:0/3633292393 shutdown_connections 2024-05-20T17:53:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.544+0000 7f2bc784a640 1 -- 172.21.15.6:0/3633292393 wait complete. 2024-05-20T17:53:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.546+0000 7f2bc784a640 1 Processor -- start 2024-05-20T17:53:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.546+0000 7f2bc784a640 1 -- start start 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc784a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc006ced0 0x7f2bc015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc784a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bc0163870 0x7f2bc015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc784a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bc015b1b0 0x7f2bc0150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc784a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0071780 con 0x7f2bc006ced0 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc784a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc006e4a0 con 0x7f2bc015b1b0 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc784a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc0071900 con 0x7f2bc0163870 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc55e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc006ced0 0x7f2bc015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc55e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc006ced0 0x7f2bc015ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34898/0 (socket says 172.21.15.6:34898) 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc55e6640 1 -- 172.21.15.6:0/1617593646 learned_addr learned my addr 172.21.15.6:0/1617593646 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc4de5640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bc0163870 0x7f2bc015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.547+0000 7f2bc5de7640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bc015b1b0 0x7f2bc0150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc55e6640 1 -- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bc0163870 msgr2=0x7f2bc015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc55e6640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bc0163870 0x7f2bc015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc55e6640 1 -- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bc015b1b0 msgr2=0x7f2bc0150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc55e6640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bc015b1b0 0x7f2bc0150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc55e6640 1 -- 172.21.15.6:0/1617593646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc015d920 con 0x7f2bc006ced0 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc4de5640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bc0163870 0x7f2bc015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc55e6640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc006ced0 0x7f2bc015ba60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00e8a0 tx=0x7f2bbc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bb5ffb640 1 -- 172.21.15.6:0/1617593646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc017070 con 0x7f2bc006ced0 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bb5ffb640 1 -- 172.21.15.6:0/1617593646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc00c940 con 0x7f2bc006ced0 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc0150eb0 con 0x7f2bc006ced0 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bb5ffb640 1 -- 172.21.15.6:0/1617593646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc00cd30 con 0x7f2bc006ced0 2024-05-20T17:53:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.548+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc015c620 con 0x7f2bc006ced0 2024-05-20T17:53:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.550+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc0075b00 con 0x7f2bc006ced0 2024-05-20T17:53:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.550+0000 7f2bb5ffb640 1 -- 172.21.15.6:0/1617593646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bbc01a070 con 0x7f2bc006ced0 2024-05-20T17:53:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.551+0000 7f2bb5ffb640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ba406be30 0x7f2ba406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.551+0000 7f2bb5ffb640 1 -- 172.21.15.6:0/1617593646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f2bbc08b140 con 0x7f2bc006ced0 2024-05-20T17:53:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.551+0000 7f2bc4de5640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ba406be30 0x7f2ba406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.551+0000 7f2bc4de5640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ba406be30 0x7f2ba406e340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0151760 tx=0x7f2bb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:49.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.555+0000 7f2bb5ffb640 1 -- 172.21.15.6:0/1617593646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2bbc058fd0 con 0x7f2bc006ced0 2024-05-20T17:53:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.743+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bc0067dc0 con 0x7f2bc006ced0 2024-05-20T17:53:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.745+0000 7f2bb5ffb640 1 -- 172.21.15.6:0/1617593646 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f2bbc05d2d0 con 0x7f2bc006ced0 2024-05-20T17:53:49.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:49.745 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ba406be30 msgr2=0x7f2ba406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ba406be30 0x7f2ba406e340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0151760 tx=0x7f2bb0009040 comp rx=0 tx=0).stop 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc006ced0 msgr2=0x7f2bc015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc006ced0 0x7f2bc015ba60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00e8a0 tx=0x7f2bbc00ed60 comp rx=0 tx=0).stop 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 shutdown_connections 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ba406be30 0x7f2ba406e340 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bc015b1b0 0x7f2bc0150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bc0163870 0x7f2bc015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 --2- 172.21.15.6:0/1617593646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bc006ced0 0x7f2bc015ba60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 >> 172.21.15.6:0/1617593646 conn(0x7f2bc00d29d0 msgr2=0x7f2bc00cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 shutdown_connections 2024-05-20T17:53:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.747+0000 7f2bc784a640 1 -- 172.21.15.6:0/1617593646 wait complete. 2024-05-20T17:53:49.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:49.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.877+0000 7f6888f16640 1 Processor -- start 2024-05-20T17:53:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.877+0000 7f6888f16640 1 -- start start 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.878+0000 7f6888f16640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688415d530 0x7f688415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.878+0000 7f6888f16640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68840cd580 con 0x7f68840b1700 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.878+0000 7f6888f16640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68840cd860 con 0x7f6884070850 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.878+0000 7f6888f16640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68840ce190 con 0x7f688415d530 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.878+0000 7f6881d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f68840b1700 0x7f68840b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52798/0 (socket says 172.21.15.6:52798) 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.878+0000 7f6881d9b640 1 -- 172.21.15.6:0/1737381008 learned_addr learned my addr 172.21.15.6:0/1737381008 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.878+0000 7f688259c640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688415d530 0x7f688415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375637043 0 0) 0x7f68840cd580 con 0x7f68840b1700 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6870003520 con 0x7f68840b1700 2024-05-20T17:53:49.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1903602615 0 0) 0x7f6870003520 con 0x7f68840b1700 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688415d530 msgr2=0x7f688415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688415d530 0x7f688415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 >> v1:172.21.15.171:6789/0 conn(0x7f6884070850 legacy=0x7f6884070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68840cdb40 con 0x7f68840b1700 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f686c001670 con 0x7f68840b1700 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 >> v1:172.21.15.6:6789/0 conn(0x7f68840b1700 legacy=0x7f68840b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700039e0 0x7f6870003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f6870004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688415d530 0x7f6870005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f68840ce190 con 0x7f6870004800 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f687000ba70 con 0x7f68700039e0 2024-05-20T17:53:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f687000bc70 con 0x7f688415d530 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f6881d9b640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f6870004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f688259c640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700039e0 0x7f6870003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f6882d9d640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688415d530 0x7f6870005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f6881d9b640 1 -- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688415d530 msgr2=0x7f6870005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.879+0000 7f6881d9b640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688415d530 0x7f6870005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.880+0000 7f6881d9b640 1 -- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700039e0 msgr2=0x7f6870003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.880+0000 7f6881d9b640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68700039e0 0x7f6870003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.880+0000 7f6881d9b640 1 -- 172.21.15.6:0/1737381008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6870003520 con 0x7f6870004800 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.880+0000 7f6881d9b640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f6870004c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f68840d3ad0 tx=0x7f6870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a6305354c5c322 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.880+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c007d30 con 0x7f6870004800 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.880+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686c005af0 con 0x7f6870004800 2024-05-20T17:53:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.880+0000 7f688159a640 1 -- 172.21.15.6:0/1737381008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c007070 con 0x7f6870004800 2024-05-20T17:53:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.881+0000 7f6888f16640 1 -- 172.21.15.6:0/1737381008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 msgr2=0x7f6870004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.881+0000 7f6888f16640 1 --2- 172.21.15.6:0/1737381008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f6870004c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f68840d3ad0 tx=0x7f6870005830 comp rx=0 tx=0).stop 2024-05-20T17:53:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.881+0000 7f6882d9d640 1 -- 172.21.15.6:0/1737381008 reap_dead start 2024-05-20T17:53:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.881+0000 7f6888f16640 1 -- 172.21.15.6:0/1737381008 shutdown_connections 2024-05-20T17:53:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.881+0000 7f6888f16640 1 -- 172.21.15.6:0/1737381008 >> 172.21.15.6:0/1737381008 conn(0x7f68840d29d0 msgr2=0x7f68840d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.881+0000 7f6888f16640 1 -- 172.21.15.6:0/1737381008 shutdown_connections 2024-05-20T17:53:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.881+0000 7f6888f16640 1 -- 172.21.15.6:0/1737381008 wait complete. 2024-05-20T17:53:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.883+0000 7f6888f16640 1 Processor -- start 2024-05-20T17:53:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.883+0000 7f6888f16640 1 -- start start 2024-05-20T17:53:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6888f16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f68840c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6888f16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6884145d50 0x7f688415c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6888f16640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68840cc520 0x7f68840cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6888f16640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6884071370 con 0x7f6870004800 2024-05-20T17:53:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6888f16640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f68840cd230 con 0x7f6884145d50 2024-05-20T17:53:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6888f16640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68840714f0 con 0x7f68840cc520 2024-05-20T17:53:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f68840c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f68840c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34916/0 (socket says 172.21.15.6:34916) 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 -- 172.21.15.6:0/3847731644 learned_addr learned my addr 172.21.15.6:0/3847731644 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6882d9d640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68840cc520 0x7f68840cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6881d9b640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6884145d50 0x7f688415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 -- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68840cc520 msgr2=0x7f68840cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68840cc520 0x7f68840cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 -- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6884145d50 msgr2=0x7f688415c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6884145d50 0x7f688415c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 -- 172.21.15.6:0/3847731644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68840cb7a0 con 0x7f6870004800 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f688259c640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f68840c8f40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f687c009f20 tx=0x7f687c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f687affd640 1 -- 172.21.15.6:0/3847731644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c00fea0 con 0x7f6870004800 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f687affd640 1 -- 172.21.15.6:0/3847731644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c015630 con 0x7f6870004800 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f687affd640 1 -- 172.21.15.6:0/3847731644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c015a00 con 0x7f6870004800 2024-05-20T17:53:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.885+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68840ca060 con 0x7f6870004800 2024-05-20T17:53:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.886+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68840cbd20 con 0x7f6870004800 2024-05-20T17:53:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.887+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6884075b00 con 0x7f6870004800 2024-05-20T17:53:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.887+0000 7f687affd640 1 -- 172.21.15.6:0/3847731644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f687c015ba0 con 0x7f6870004800 2024-05-20T17:53:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.888+0000 7f687affd640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be30 0x7f686406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:49.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.888+0000 7f687affd640 1 -- 172.21.15.6:0/3847731644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f687c08c490 con 0x7f6870004800 2024-05-20T17:53:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.888+0000 7f6881d9b640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be30 0x7f686406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:49.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.888+0000 7f6881d9b640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be30 0x7f686406e340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68840d3ad0 tx=0x7f686c02d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:49.892+0000 7f687affd640 1 -- 172.21.15.6:0/3847731644 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f687c019030 con 0x7f6870004800 2024-05-20T17:53:50.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.074+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f688415de70 con 0x7f6870004800 2024-05-20T17:53:50.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.075+0000 7f687affd640 1 -- 172.21.15.6:0/3847731644 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f687c010040 con 0x7f6870004800 2024-05-20T17:53:50.075 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:50.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be30 msgr2=0x7f686406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be30 0x7f686406e340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68840d3ad0 tx=0x7f686c02d000 comp rx=0 tx=0).stop 2024-05-20T17:53:50.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 msgr2=0x7f68840c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f68840c8f40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f687c009f20 tx=0x7f687c00f580 comp rx=0 tx=0).stop 2024-05-20T17:53:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 shutdown_connections 2024-05-20T17:53:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be30 0x7f686406e340 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68840cc520 0x7f68840cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6884145d50 0x7f688415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 --2- 172.21.15.6:0/3847731644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6870004800 0x7f68840c8f40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 >> 172.21.15.6:0/3847731644 conn(0x7f68840d29d0 msgr2=0x7f68840d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 shutdown_connections 2024-05-20T17:53:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.077+0000 7f6888f16640 1 -- 172.21.15.6:0/3847731644 wait complete. 2024-05-20T17:53:50.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:50.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.206+0000 7f38beb79640 1 Processor -- start 2024-05-20T17:53:50.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.206+0000 7f38beb79640 1 -- start start 2024-05-20T17:53:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.207+0000 7f38beb79640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38b806d3d0 0x7f38b806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.207+0000 7f38beb79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b80b8190 0x7f38b80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.207+0000 7f38beb79640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b806dd20 con 0x7f38b8162820 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.207+0000 7f38beb79640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f38b80d0630 con 0x7f38b806d3d0 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.207+0000 7f38beb79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f38b80d39c0 con 0x7f38b80b8190 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38b7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38b806d3d0 0x7f38b806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38bc915640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f38b8162820 0x7f38b80b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52802/0 (socket says 172.21.15.6:52802) 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38bc915640 1 -- 172.21.15.6:0/3318763004 learned_addr learned my addr 172.21.15.6:0/3318763004 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38bd116640 1 --2- 172.21.15.6:0/3318763004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b80b8190 0x7f38b80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38b7fff640 1 -- 172.21.15.6:0/3318763004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b80b8190 msgr2=0x7f38b80b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38b7fff640 1 --2- 172.21.15.6:0/3318763004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b80b8190 0x7f38b80b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38b7fff640 1 -- 172.21.15.6:0/3318763004 >> v1:172.21.15.6:6789/0 conn(0x7f38b8162820 legacy=0x7f38b80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38b77fe640 1 -- 172.21.15.6:0/3318763004 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314438917 0 0) 0x7f38a8001110 con 0x7f38b8162820 2024-05-20T17:53:50.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38b7fff640 1 -- 172.21.15.6:0/3318763004 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b80d3ca0 con 0x7f38b806d3d0 2024-05-20T17:53:50.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.208+0000 7f38bd116640 1 --2- 172.21.15.6:0/3318763004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b80b8190 0x7f38b80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.209+0000 7f38b7fff640 1 --2- 172.21.15.6:0/3318763004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b806d3d0 0x7f38b806d7e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0097a0 tx=0x7f38ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60237003eccf620 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.209+0000 7f38b77fe640 1 -- 172.21.15.6:0/3318763004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac037070 con 0x7f38b806d3d0 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.209+0000 7f38b77fe640 1 -- 172.21.15.6:0/3318763004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac032440 con 0x7f38b806d3d0 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.209+0000 7f38b77fe640 1 -- 172.21.15.6:0/3318763004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac032810 con 0x7f38b806d3d0 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.209+0000 7f38beb79640 1 -- 172.21.15.6:0/3318763004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b806d3d0 msgr2=0x7f38b806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.209+0000 7f38beb79640 1 --2- 172.21.15.6:0/3318763004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b806d3d0 0x7f38b806d7e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0097a0 tx=0x7f38ac02a180 comp rx=0 tx=0).stop 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.210+0000 7f38beb79640 1 -- 172.21.15.6:0/3318763004 shutdown_connections 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.210+0000 7f38beb79640 1 --2- 172.21.15.6:0/3318763004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b80b8190 0x7f38b80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.210+0000 7f38beb79640 1 --2- 172.21.15.6:0/3318763004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b806d3d0 0x7f38b806d7e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.210+0000 7f38beb79640 1 -- 172.21.15.6:0/3318763004 >> 172.21.15.6:0/3318763004 conn(0x7f38b80d4bd0 msgr2=0x7f38b80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:50.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.210+0000 7f38beb79640 1 -- 172.21.15.6:0/3318763004 shutdown_connections 2024-05-20T17:53:50.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.210+0000 7f38beb79640 1 -- 172.21.15.6:0/3318763004 wait complete. 2024-05-20T17:53:50.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.211+0000 7f38beb79640 1 Processor -- start 2024-05-20T17:53:50.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.211+0000 7f38beb79640 1 -- start start 2024-05-20T17:53:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38beb79640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38b806d3d0 0x7f38b80cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38beb79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b80b8190 0x7f38b814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38beb79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b8162820 0x7f38b81f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38beb79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f38b80d0300 con 0x7f38b80b8190 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38beb79640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38b80d4260 con 0x7f38b806d3d0 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38beb79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f38b80b4050 con 0x7f38b8162820 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b80b8190 0x7f38b814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b80b8190 0x7f38b814ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34922/0 (socket says 172.21.15.6:34922) 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38b7fff640 1 -- 172.21.15.6:0/2919652037 learned_addr learned my addr 172.21.15.6:0/2919652037 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38bd116640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b8162820 0x7f38b81f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38bc915640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38b806d3d0 0x7f38b80cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38b7fff640 1 -- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b8162820 msgr2=0x7f38b81f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38b7fff640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b8162820 0x7f38b81f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38b7fff640 1 -- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38b806d3d0 msgr2=0x7f38b80cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38b7fff640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38b806d3d0 0x7f38b80cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.213+0000 7f38b7fff640 1 -- 172.21.15.6:0/2919652037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b80c9a50 con 0x7f38b80b8190 2024-05-20T17:53:50.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.214+0000 7f38b7fff640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b80b8190 0x7f38b814ae10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38ac000c00 tx=0x7f38ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.214+0000 7f38b57fa640 1 -- 172.21.15.6:0/2919652037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac037040 con 0x7f38b80b8190 2024-05-20T17:53:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.214+0000 7f38b57fa640 1 -- 172.21.15.6:0/2919652037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac042070 con 0x7f38b80b8190 2024-05-20T17:53:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.214+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b80cedf0 con 0x7f38b80b8190 2024-05-20T17:53:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.214+0000 7f38b57fa640 1 -- 172.21.15.6:0/2919652037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac030a70 con 0x7f38b80b8190 2024-05-20T17:53:50.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.214+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b80cf3b0 con 0x7f38b80b8190 2024-05-20T17:53:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.215+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b8075b00 con 0x7f38b80b8190 2024-05-20T17:53:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.216+0000 7f38b57fa640 1 -- 172.21.15.6:0/2919652037 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38ac030c10 con 0x7f38b80b8190 2024-05-20T17:53:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.216+0000 7f38b57fa640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f38a406be30 0x7f38a406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.216+0000 7f38b57fa640 1 -- 172.21.15.6:0/2919652037 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f38ac0aba40 con 0x7f38b80b8190 2024-05-20T17:53:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.216+0000 7f38bc915640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f38a406be30 0x7f38a406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.217+0000 7f38bc915640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f38a406be30 0x7f38a406e340 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38a8007fd0 tx=0x7f38a8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.221+0000 7f38b57fa640 1 -- 172.21.15.6:0/2919652037 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f38ac079960 con 0x7f38b80b8190 2024-05-20T17:53:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.404+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f38b80ceb80 con 0x7f38b80b8190 2024-05-20T17:53:50.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.404+0000 7f38b57fa640 1 -- 172.21.15.6:0/2919652037 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f38ac07dc60 con 0x7f38b80b8190 2024-05-20T17:53:50.404 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.406+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f38a406be30 msgr2=0x7f38a406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.406+0000 7f38beb79640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f38a406be30 0x7f38a406e340 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38a8007fd0 tx=0x7f38a8007de0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.406+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b80b8190 msgr2=0x7f38b814ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.406+0000 7f38beb79640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b80b8190 0x7f38b814ae10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f38ac000c00 tx=0x7f38ac0046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.406+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 shutdown_connections 2024-05-20T17:53:50.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.407+0000 7f38beb79640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f38a406be30 0x7f38a406e340 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.407+0000 7f38beb79640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b8162820 0x7f38b81f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.407+0000 7f38beb79640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b80b8190 0x7f38b814ae10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.407+0000 7f38beb79640 1 --2- 172.21.15.6:0/2919652037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38b806d3d0 0x7f38b80cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.407+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 >> 172.21.15.6:0/2919652037 conn(0x7f38b80d4bd0 msgr2=0x7f38b815c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.407+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 shutdown_connections 2024-05-20T17:53:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.407+0000 7f38beb79640 1 -- 172.21.15.6:0/2919652037 wait complete. 2024-05-20T17:53:50.417 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:50.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.536+0000 7fdaafe22640 1 Processor -- start 2024-05-20T17:53:50.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.536+0000 7fdaafe22640 1 -- start start 2024-05-20T17:53:50.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.537+0000 7fdaafe22640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80af330 0x7fdaa80af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.537+0000 7fdaafe22640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa806c840 con 0x7fdaa80b2560 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.537+0000 7fdaafe22640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa80d20d0 con 0x7fdaa80d1610 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.537+0000 7fdaafe22640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa806cae0 con 0x7fdaa80af330 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaae3bf640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdaa80b2560 0x7fdaa806d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52814/0 (socket says 172.21.15.6:52814) 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaae3bf640 1 -- 172.21.15.6:0/2559940144 learned_addr learned my addr 172.21.15.6:0/2559940144 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaadbbe640 1 --2- 172.21.15.6:0/2559940144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80af330 0x7fdaa80af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaacbbc640 1 -- 172.21.15.6:0/2559940144 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117794628 0 0) 0x7fdaa806c840 con 0x7fdaa80b2560 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaacbbc640 1 -- 172.21.15.6:0/2559940144 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda94003520 con 0x7fdaa80b2560 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaacbbc640 1 -- 172.21.15.6:0/2559940144 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337701505 0 0) 0x7fdaa80d20d0 con 0x7fdaa80d1610 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaacbbc640 1 -- 172.21.15.6:0/2559940144 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa806c840 con 0x7fdaa80d1610 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaacbbc640 1 -- 172.21.15.6:0/2559940144 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2907271389 0 0) 0x7fda94003520 con 0x7fdaa80b2560 2024-05-20T17:53:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaadbbe640 1 -- 172.21.15.6:0/2559940144 >> v1:172.21.15.171:6789/0 conn(0x7fdaa80d1610 legacy=0x7fdaa80b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaadbbe640 1 -- 172.21.15.6:0/2559940144 >> v1:172.21.15.6:6789/0 conn(0x7fdaa80b2560 legacy=0x7fdaa806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.538+0000 7fdaadbbe640 1 -- 172.21.15.6:0/2559940144 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa806cdc0 con 0x7fdaa80af330 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.539+0000 7fdaadbbe640 1 --2- 172.21.15.6:0/2559940144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80af330 0x7fdaa80af740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40097d0 tx=0x7fdaa402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc5d2232bb9e8e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.539+0000 7fdaacbbc640 1 -- 172.21.15.6:0/2559940144 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4037070 con 0x7fdaa80af330 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.539+0000 7fdaacbbc640 1 -- 172.21.15.6:0/2559940144 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa402ab90 con 0x7fdaa80af330 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.539+0000 7fdaacbbc640 1 -- 172.21.15.6:0/2559940144 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0001a10 con 0x7fdaa80af330 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.540+0000 7fdaafe22640 1 -- 172.21.15.6:0/2559940144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80af330 msgr2=0x7fdaa80af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.540+0000 7fdaafe22640 1 --2- 172.21.15.6:0/2559940144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80af330 0x7fdaa80af740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40097d0 tx=0x7fdaa402a100 comp rx=0 tx=0).stop 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.540+0000 7fdaafe22640 1 -- 172.21.15.6:0/2559940144 shutdown_connections 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.540+0000 7fdaafe22640 1 --2- 172.21.15.6:0/2559940144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80af330 0x7fdaa80af740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.540+0000 7fdaafe22640 1 -- 172.21.15.6:0/2559940144 >> 172.21.15.6:0/2559940144 conn(0x7fdaa80b6670 msgr2=0x7fdaa80b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.540+0000 7fdaafe22640 1 -- 172.21.15.6:0/2559940144 shutdown_connections 2024-05-20T17:53:50.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.540+0000 7fdaafe22640 1 -- 172.21.15.6:0/2559940144 wait complete. 2024-05-20T17:53:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.542+0000 7fdaafe22640 1 Processor -- start 2024-05-20T17:53:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.542+0000 7fdaafe22640 1 -- start start 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaafe22640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaa80af330 0x7fdaa8147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaafe22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaa80b2560 0x7fdaa8146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaafe22640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80d1610 0x7fdaa80ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaafe22640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa8159d30 con 0x7fdaa80b2560 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaafe22640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa815d350 con 0x7fdaa80af330 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaafe22640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa8159eb0 con 0x7fdaa80d1610 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaad3bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaa80b2560 0x7fdaa8146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaad3bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaa80b2560 0x7fdaa8146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34924/0 (socket says 172.21.15.6:34924) 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaad3bd640 1 -- 172.21.15.6:0/466937251 learned_addr learned my addr 172.21.15.6:0/466937251 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaadbbe640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaa80af330 0x7fdaa8147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.543+0000 7fdaae3bf640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80d1610 0x7fdaa80ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fdaad3bd640 1 -- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80d1610 msgr2=0x7fdaa80ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fdaad3bd640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80d1610 0x7fdaa80ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fdaad3bd640 1 -- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaa80af330 msgr2=0x7fdaa8147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fdaad3bd640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaa80af330 0x7fdaa8147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fdaad3bd640 1 -- 172.21.15.6:0/466937251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa81f6f50 con 0x7fdaa80b2560 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fdaad3bd640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaa80b2560 0x7fdaa8146620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c430 tx=0x7fda9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fda9e7fc640 1 -- 172.21.15.6:0/466937251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98017070 con 0x7fdaa80b2560 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fda9e7fc640 1 -- 172.21.15.6:0/466937251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda980052f0 con 0x7fdaa80b2560 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa81f7230 con 0x7fdaa80b2560 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fda9e7fc640 1 -- 172.21.15.6:0/466937251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98003830 con 0x7fdaa80b2560 2024-05-20T17:53:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.544+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa81f77f0 con 0x7fdaa80b2560 2024-05-20T17:53:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.545+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa8075b00 con 0x7fdaa80b2560 2024-05-20T17:53:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.546+0000 7fda9e7fc640 1 -- 172.21.15.6:0/466937251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda9801a070 con 0x7fdaa80b2560 2024-05-20T17:53:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.546+0000 7fda9e7fc640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda8c06be30 0x7fda8c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.546+0000 7fda9e7fc640 1 -- 172.21.15.6:0/466937251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fda9808a6e0 con 0x7fdaa80b2560 2024-05-20T17:53:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.547+0000 7fdaadbbe640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda8c06be30 0x7fda8c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.547+0000 7fdaadbbe640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda8c06be30 0x7fda8c06e340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4034000 tx=0x7fdaa402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.551+0000 7fda9e7fc640 1 -- 172.21.15.6:0/466937251 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fda98058570 con 0x7fdaa80b2560 2024-05-20T17:53:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.736+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdaa8071370 con 0x7fdaa80b2560 2024-05-20T17:53:50.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.739+0000 7fda9e7fc640 1 -- 172.21.15.6:0/466937251 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fda9805c870 con 0x7fdaa80b2560 2024-05-20T17:53:50.739 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda8c06be30 msgr2=0x7fda8c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda8c06be30 0x7fda8c06e340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4034000 tx=0x7fdaa402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaa80b2560 msgr2=0x7fdaa8146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaa80b2560 0x7fdaa8146620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c430 tx=0x7fda9800c8f0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 shutdown_connections 2024-05-20T17:53:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda8c06be30 0x7fda8c06e340 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaa80d1610 0x7fdaa80ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaa80b2560 0x7fdaa8146620 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 --2- 172.21.15.6:0/466937251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaa80af330 0x7fdaa8147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 >> 172.21.15.6:0/466937251 conn(0x7fdaa80b6670 msgr2=0x7fdaa806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 shutdown_connections 2024-05-20T17:53:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.741+0000 7fdaafe22640 1 -- 172.21.15.6:0/466937251 wait complete. 2024-05-20T17:53:50.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.870+0000 7fd286357640 1 Processor -- start 2024-05-20T17:53:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.870+0000 7fd286357640 1 -- start start 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.871+0000 7fd286357640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2800b00b0 0x7fd2800b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.871+0000 7fd286357640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd28015fd80 0x7fd28006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.871+0000 7fd286357640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28006c700 con 0x7fd28006c2f0 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.871+0000 7fd286357640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd28015c690 con 0x7fd2800b00b0 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.871+0000 7fd286357640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd2800b4860 con 0x7fd28015fd80 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2800b00b0 0x7fd2800b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd2848f4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd28006c2f0 0x7fd2800ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52816/0 (socket says 172.21.15.6:52816) 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd2848f4640 1 -- 172.21.15.6:0/113568208 learned_addr learned my addr 172.21.15.6:0/113568208 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2800b00b0 0x7fd2800b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34928/0 (socket says 172.21.15.6:34928) 2024-05-20T17:53:50.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27f7fe640 1 --2- 172.21.15.6:0/113568208 >> v2:172.21.15.171:3300/0 conn(0x7fd28015fd80 0x7fd28006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27ffff640 1 -- 172.21.15.6:0/113568208 >> v2:172.21.15.171:3300/0 conn(0x7fd28015fd80 msgr2=0x7fd28006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27ffff640 1 --2- 172.21.15.6:0/113568208 >> v2:172.21.15.171:3300/0 conn(0x7fd28015fd80 0x7fd28006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27ffff640 1 -- 172.21.15.6:0/113568208 >> v1:172.21.15.6:6789/0 conn(0x7fd28006c2f0 legacy=0x7fd2800ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27ffff640 1 -- 172.21.15.6:0/113568208 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2800b52e0 con 0x7fd2800b00b0 2024-05-20T17:53:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27effd640 1 -- 172.21.15.6:0/113568208 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234935131 0 0) 0x7fd278001490 con 0x7fd28006c2f0 2024-05-20T17:53:50.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.872+0000 7fd27f7fe640 1 --2- 172.21.15.6:0/113568208 >> v2:172.21.15.171:3300/0 conn(0x7fd28015fd80 0x7fd28006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:50.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.873+0000 7fd27ffff640 1 --2- 172.21.15.6:0/113568208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2800b00b0 0x7fd2800b4c00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd2800b34f0 tx=0x7fd27002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d45cde82ec1355 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.873+0000 7fd27effd640 1 -- 172.21.15.6:0/113568208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270037070 con 0x7fd2800b00b0 2024-05-20T17:53:50.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.873+0000 7fd27effd640 1 -- 172.21.15.6:0/113568208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd270032440 con 0x7fd2800b00b0 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.873+0000 7fd27effd640 1 -- 172.21.15.6:0/113568208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27002ae60 con 0x7fd2800b00b0 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.874+0000 7fd286357640 1 -- 172.21.15.6:0/113568208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2800b00b0 msgr2=0x7fd2800b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.874+0000 7fd286357640 1 --2- 172.21.15.6:0/113568208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2800b00b0 0x7fd2800b4c00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd2800b34f0 tx=0x7fd27002a110 comp rx=0 tx=0).stop 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.874+0000 7fd286357640 1 -- 172.21.15.6:0/113568208 shutdown_connections 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.874+0000 7fd286357640 1 --2- 172.21.15.6:0/113568208 >> v2:172.21.15.171:3300/0 conn(0x7fd28015fd80 0x7fd28006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.874+0000 7fd286357640 1 --2- 172.21.15.6:0/113568208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2800b00b0 0x7fd2800b4c00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.874+0000 7fd286357640 1 -- 172.21.15.6:0/113568208 >> 172.21.15.6:0/113568208 conn(0x7fd2800cd2a0 msgr2=0x7fd2800cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.874+0000 7fd286357640 1 -- 172.21.15.6:0/113568208 shutdown_connections 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.874+0000 7fd286357640 1 -- 172.21.15.6:0/113568208 wait complete. 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.875+0000 7fd286357640 1 Processor -- start 2024-05-20T17:53:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.876+0000 7fd286357640 1 -- start start 2024-05-20T17:53:50.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd286357640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006c2f0 0x7fd28015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd286357640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2800b00b0 0x7fd280151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd286357640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd28015fd80 0x7fd2800ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd286357640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd280160190 con 0x7fd28006c2f0 2024-05-20T17:53:50.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd286357640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd28015c320 con 0x7fd28015fd80 2024-05-20T17:53:50.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd286357640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd28015bc30 con 0x7fd2800b00b0 2024-05-20T17:53:50.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006c2f0 0x7fd28015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006c2f0 0x7fd28015af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34944/0 (socket says 172.21.15.6:34944) 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27ffff640 1 -- 172.21.15.6:0/2375843292 learned_addr learned my addr 172.21.15.6:0/2375843292 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd2848f4640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd28015fd80 0x7fd2800ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27f7fe640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2800b00b0 0x7fd280151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27ffff640 1 -- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2800b00b0 msgr2=0x7fd280151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27ffff640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2800b00b0 0x7fd280151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27ffff640 1 -- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd28015fd80 msgr2=0x7fd2800ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27ffff640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd28015fd80 0x7fd2800ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.877+0000 7fd27ffff640 1 -- 172.21.15.6:0/2375843292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd280151770 con 0x7fd28006c2f0 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.878+0000 7fd27ffff640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006c2f0 0x7fd28015af80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd270035040 tx=0x7fd2700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.878+0000 7fd27cff9640 1 -- 172.21.15.6:0/2375843292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270037050 con 0x7fd28006c2f0 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.878+0000 7fd27cff9640 1 -- 172.21.15.6:0/2375843292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd270038040 con 0x7fd28006c2f0 2024-05-20T17:53:50.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.878+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2800cc2b0 con 0x7fd28006c2f0 2024-05-20T17:53:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.878+0000 7fd27cff9640 1 -- 172.21.15.6:0/2375843292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270004450 con 0x7fd28006c2f0 2024-05-20T17:53:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.878+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd280154d00 con 0x7fd28006c2f0 2024-05-20T17:53:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.879+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd280075b00 con 0x7fd28006c2f0 2024-05-20T17:53:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.879+0000 7fd27cff9640 1 -- 172.21.15.6:0/2375843292 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd270030980 con 0x7fd28006c2f0 2024-05-20T17:53:50.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.880+0000 7fd27cff9640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd26c06be60 0x7fd26c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.880+0000 7fd27cff9640 1 -- 172.21.15.6:0/2375843292 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fd2700abc30 con 0x7fd28006c2f0 2024-05-20T17:53:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.880+0000 7fd27f7fe640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd26c06be60 0x7fd26c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:50.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.881+0000 7fd27f7fe640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd26c06be60 0x7fd26c06e370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd28016aa00 tx=0x7fd274008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:50.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:50.884+0000 7fd27cff9640 1 -- 172.21.15.6:0/2375843292 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd27004c020 con 0x7fd28006c2f0 2024-05-20T17:53:51.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.068+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd28006cd30 con 0x7fd28006c2f0 2024-05-20T17:53:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.068+0000 7fd27cff9640 1 -- 172.21.15.6:0/2375843292 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fd280151770 con 0x7fd28006c2f0 2024-05-20T17:53:51.068 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd26c06be60 msgr2=0x7fd26c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd26c06be60 0x7fd26c06e370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd28016aa00 tx=0x7fd274008040 comp rx=0 tx=0).stop 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006c2f0 msgr2=0x7fd28015af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006c2f0 0x7fd28015af80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd270035040 tx=0x7fd2700046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 shutdown_connections 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd26c06be60 0x7fd26c06e370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd28015fd80 0x7fd2800ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2800b00b0 0x7fd280151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 --2- 172.21.15.6:0/2375843292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd28006c2f0 0x7fd28015af80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 >> 172.21.15.6:0/2375843292 conn(0x7fd2800cd2a0 msgr2=0x7fd28006b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 shutdown_connections 2024-05-20T17:53:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.070+0000 7fd286357640 1 -- 172.21.15.6:0/2375843292 wait complete. 2024-05-20T17:53:51.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.196+0000 7fd32ac1b640 1 Processor -- start 2024-05-20T17:53:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.196+0000 7fd32ac1b640 1 -- start start 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd32ac1b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd324162820 0x7fd3240b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd32ac1b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd3240b3e80 0x7fd32406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd32ac1b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32406dd20 con 0x7fd32406d910 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd32ac1b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd3240d0630 con 0x7fd324162820 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd32ac1b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd3240d39c0 con 0x7fd3240b3e80 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3289b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd324162820 0x7fd3240b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3289b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd324162820 0x7fd3240b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34956/0 (socket says 172.21.15.6:34956) 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3291b8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd32406d910 0x7fd3240d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52826/0 (socket says 172.21.15.6:52826) 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3289b7640 1 -- 172.21.15.6:0/1519203274 learned_addr learned my addr 172.21.15.6:0/1519203274 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd323fff640 1 --2- 172.21.15.6:0/1519203274 >> v2:172.21.15.171:3300/0 conn(0x7fd3240b3e80 0x7fd32406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3289b7640 1 -- 172.21.15.6:0/1519203274 >> v2:172.21.15.171:3300/0 conn(0x7fd3240b3e80 msgr2=0x7fd32406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3289b7640 1 --2- 172.21.15.6:0/1519203274 >> v2:172.21.15.171:3300/0 conn(0x7fd3240b3e80 0x7fd32406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3289b7640 1 -- 172.21.15.6:0/1519203274 >> v1:172.21.15.6:6789/0 conn(0x7fd32406d910 legacy=0x7fd3240d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3289b7640 1 -- 172.21.15.6:0/1519203274 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3240d3ca0 con 0x7fd324162820 2024-05-20T17:53:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.198+0000 7fd3237fe640 1 -- 172.21.15.6:0/1519203274 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517520940 0 0) 0x7fd31c001490 con 0x7fd32406d910 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.199+0000 7fd3289b7640 1 --2- 172.21.15.6:0/1519203274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd324162820 0x7fd3240b3940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3240d1230 tx=0x7fd31402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f65d96ad1ecbf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.199+0000 7fd3237fe640 1 -- 172.21.15.6:0/1519203274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314037070 con 0x7fd324162820 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.199+0000 7fd3237fe640 1 -- 172.21.15.6:0/1519203274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd314032440 con 0x7fd324162820 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.199+0000 7fd3237fe640 1 -- 172.21.15.6:0/1519203274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314032810 con 0x7fd324162820 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.200+0000 7fd32ac1b640 1 -- 172.21.15.6:0/1519203274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd324162820 msgr2=0x7fd3240b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.200+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/1519203274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd324162820 0x7fd3240b3940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd3240d1230 tx=0x7fd31402a270 comp rx=0 tx=0).stop 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.200+0000 7fd32ac1b640 1 -- 172.21.15.6:0/1519203274 shutdown_connections 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.200+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/1519203274 >> v2:172.21.15.171:3300/0 conn(0x7fd3240b3e80 0x7fd32406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.200+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/1519203274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd324162820 0x7fd3240b3940 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.200+0000 7fd32ac1b640 1 -- 172.21.15.6:0/1519203274 >> 172.21.15.6:0/1519203274 conn(0x7fd3240d4bd0 msgr2=0x7fd3240d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.200+0000 7fd32ac1b640 1 -- 172.21.15.6:0/1519203274 shutdown_connections 2024-05-20T17:53:51.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.200+0000 7fd32ac1b640 1 -- 172.21.15.6:0/1519203274 wait complete. 2024-05-20T17:53:51.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.202+0000 7fd32ac1b640 1 Processor -- start 2024-05-20T17:53:51.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.202+0000 7fd32ac1b640 1 -- start start 2024-05-20T17:53:51.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.203+0000 7fd32ac1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd32406d910 0x7fd32414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.203+0000 7fd32ac1b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3240b3e80 0x7fd3241f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.203+0000 7fd32ac1b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd324162820 0x7fd3240b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.203+0000 7fd32ac1b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd3240d0300 con 0x7fd32406d910 2024-05-20T17:53:51.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.203+0000 7fd32ac1b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3240d4260 con 0x7fd324162820 2024-05-20T17:53:51.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.203+0000 7fd32ac1b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd3240b91a0 con 0x7fd3240b3e80 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.203+0000 7fd3289b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd32406d910 0x7fd32414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3289b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd32406d910 0x7fd32414d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34962/0 (socket says 172.21.15.6:34962) 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3289b7640 1 -- 172.21.15.6:0/3382102116 learned_addr learned my addr 172.21.15.6:0/3382102116 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd323fff640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3240b3e80 0x7fd3241f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3289b7640 1 -- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3240b3e80 msgr2=0x7fd3241f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3289b7640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3240b3e80 0x7fd3241f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3291b8640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd324162820 0x7fd3240b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3289b7640 1 -- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd324162820 msgr2=0x7fd3240b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3289b7640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd324162820 0x7fd3240b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3289b7640 1 -- 172.21.15.6:0/3382102116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3241f9930 con 0x7fd32406d910 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd323fff640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3240b3e80 0x7fd3241f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3289b7640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd32406d910 0x7fd32414d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd31402a2b0 tx=0x7fd3140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3217fa640 1 -- 172.21.15.6:0/3382102116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314041020 con 0x7fd32406d910 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3217fa640 1 -- 172.21.15.6:0/3382102116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3140306c0 con 0x7fd32406d910 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32414d920 con 0x7fd32406d910 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd3217fa640 1 -- 172.21.15.6:0/3382102116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314037040 con 0x7fd32406d910 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.204+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32414dee0 con 0x7fd32406d910 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.205+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3240ba390 con 0x7fd32406d910 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.206+0000 7fd3217fa640 1 -- 172.21.15.6:0/3382102116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd314044020 con 0x7fd32406d910 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.206+0000 7fd3217fa640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd31006be60 0x7fd31006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.207+0000 7fd3217fa640 1 -- 172.21.15.6:0/3382102116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fd3140aba60 con 0x7fd32406d910 2024-05-20T17:53:51.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.207+0000 7fd323fff640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd31006be60 0x7fd31006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.207+0000 7fd323fff640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd31006be60 0x7fd31006e370 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd318006fd0 tx=0x7fd318008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.211+0000 7fd3217fa640 1 -- 172.21.15.6:0/3382102116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd3240ba390 con 0x7fd32406d910 2024-05-20T17:53:51.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.396+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd324075b00 con 0x7fd32406d910 2024-05-20T17:53:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.398+0000 7fd3217fa640 1 -- 172.21.15.6:0/3382102116 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7fd31404b030 con 0x7fd32406d910 2024-05-20T17:53:51.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:51.397 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd31006be60 msgr2=0x7fd31006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd31006be60 0x7fd31006e370 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd318006fd0 tx=0x7fd318008040 comp rx=0 tx=0).stop 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd32406d910 msgr2=0x7fd32414d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd32406d910 0x7fd32414d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd31402a2b0 tx=0x7fd3140046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 shutdown_connections 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd31006be60 0x7fd31006e370 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd324162820 0x7fd3240b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3240b3e80 0x7fd3241f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 --2- 172.21.15.6:0/3382102116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd32406d910 0x7fd32414d0f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 >> 172.21.15.6:0/3382102116 conn(0x7fd3240d4bd0 msgr2=0x7fd324160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 shutdown_connections 2024-05-20T17:53:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.400+0000 7fd32ac1b640 1 -- 172.21.15.6:0/3382102116 wait complete. 2024-05-20T17:53:51.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:51.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:51.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.530+0000 7f4617d85640 1 Processor -- start 2024-05-20T17:53:51.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.530+0000 7f4617d85640 1 -- start start 2024-05-20T17:53:51.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.531+0000 7f4617d85640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f46100afad0 0x7f46100b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.531+0000 7f4617d85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f461015d160 0x7f46100b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.531+0000 7f4617d85640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46100b3aa0 con 0x7f46100afee0 2024-05-20T17:53:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.531+0000 7f4617d85640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f46100b3850 con 0x7f46100afad0 2024-05-20T17:53:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.531+0000 7f4617d85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f46100703e0 con 0x7f461015d160 2024-05-20T17:53:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.532+0000 7f4615b21640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f46100afad0 0x7f46100b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.532+0000 7f4616322640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f461015d160 0x7f46100b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.532+0000 7f4615320640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f46100afee0 0x7f461015ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:46226/0 (socket says 172.21.15.6:46226) 2024-05-20T17:53:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.532+0000 7f4615320640 1 -- 172.21.15.6:0/3880827768 learned_addr learned my addr 172.21.15.6:0/3880827768 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.532+0000 7f4615b21640 1 -- 172.21.15.6:0/3880827768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f461015d160 msgr2=0x7f46100b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.532+0000 7f4615b21640 1 --2- 172.21.15.6:0/3880827768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f461015d160 0x7f46100b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.532+0000 7f4615b21640 1 -- 172.21.15.6:0/3880827768 >> v1:172.21.15.171:6789/0 conn(0x7f46100afee0 legacy=0x7f461015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.532+0000 7f4615b21640 1 -- 172.21.15.6:0/3880827768 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46100b3d80 con 0x7f46100afad0 2024-05-20T17:53:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.533+0000 7f4615b21640 1 --2- 172.21.15.6:0/3880827768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46100afad0 0x7f46100b51e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f460c0097a0 tx=0x7f460c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ed736df6b4b9293 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.533+0000 7f4614b1f640 1 -- 172.21.15.6:0/3880827768 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c037070 con 0x7f46100afad0 2024-05-20T17:53:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.533+0000 7f4614b1f640 1 -- 172.21.15.6:0/3880827768 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c02ae50 con 0x7f46100afad0 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.533+0000 7f4614b1f640 1 -- 172.21.15.6:0/3880827768 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c032660 con 0x7f46100afad0 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.534+0000 7f4617d85640 1 -- 172.21.15.6:0/3880827768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46100afad0 msgr2=0x7f46100b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.534+0000 7f4617d85640 1 --2- 172.21.15.6:0/3880827768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46100afad0 0x7f46100b51e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f460c0097a0 tx=0x7f460c02a100 comp rx=0 tx=0).stop 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.534+0000 7f4617d85640 1 -- 172.21.15.6:0/3880827768 shutdown_connections 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.534+0000 7f4617d85640 1 --2- 172.21.15.6:0/3880827768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f461015d160 0x7f46100b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.534+0000 7f4617d85640 1 --2- 172.21.15.6:0/3880827768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46100afad0 0x7f46100b51e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.534+0000 7f4617d85640 1 -- 172.21.15.6:0/3880827768 >> 172.21.15.6:0/3880827768 conn(0x7f46100cd2a0 msgr2=0x7f46100cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.534+0000 7f4617d85640 1 -- 172.21.15.6:0/3880827768 shutdown_connections 2024-05-20T17:53:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.534+0000 7f4617d85640 1 -- 172.21.15.6:0/3880827768 wait complete. 2024-05-20T17:53:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.536+0000 7f4617d85640 1 Processor -- start 2024-05-20T17:53:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.536+0000 7f4617d85640 1 -- start start 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4617d85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46100afad0 0x7f46101604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4617d85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46100afee0 0x7f46101462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4617d85640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f461015d160 0x7f461014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4617d85640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f46100b4860 con 0x7f46100afad0 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4617d85640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f46100b4340 con 0x7f461015d160 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4617d85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f461014ba90 con 0x7f46100afee0 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4615b21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46100afad0 0x7f46101604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4615b21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46100afad0 0x7f46101604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34964/0 (socket says 172.21.15.6:34964) 2024-05-20T17:53:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4615b21640 1 -- 172.21.15.6:0/1575897394 learned_addr learned my addr 172.21.15.6:0/1575897394 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4615320640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46100afee0 0x7f46101462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.537+0000 7f4616322640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f461015d160 0x7f461014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4615b21640 1 -- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46100afee0 msgr2=0x7f46101462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4615b21640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46100afee0 0x7f46101462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4615b21640 1 -- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f461015d160 msgr2=0x7f461014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4615b21640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f461015d160 0x7f461014c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4615b21640 1 -- 172.21.15.6:0/1575897394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461015e6d0 con 0x7f46100afad0 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4615320640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46100afee0 0x7f46101462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4616322640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f461015d160 0x7f461014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4615b21640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46100afad0 0x7f46101604c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f460c0098c0 tx=0x7f460c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f46067fc640 1 -- 172.21.15.6:0/1575897394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c041030 con 0x7f46100afad0 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f46067fc640 1 -- 172.21.15.6:0/1575897394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c02ac50 con 0x7f46100afad0 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461015e9b0 con 0x7f46100afad0 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f46067fc640 1 -- 172.21.15.6:0/1575897394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c037040 con 0x7f46100afad0 2024-05-20T17:53:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.538+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461014b7d0 con 0x7f46100afad0 2024-05-20T17:53:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.539+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4610075b00 con 0x7f46100afad0 2024-05-20T17:53:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.540+0000 7f46067fc640 1 -- 172.21.15.6:0/1575897394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f460c044070 con 0x7f46100afad0 2024-05-20T17:53:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.540+0000 7f46067fc640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45f406be60 0x7f45f406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.540+0000 7f46067fc640 1 -- 172.21.15.6:0/1575897394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f460c0ab580 con 0x7f46100afad0 2024-05-20T17:53:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.541+0000 7f4615320640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45f406be60 0x7f45f406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.541+0000 7f4615320640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45f406be60 0x7f45f406e370 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f461006c520 tx=0x7f4600009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.545+0000 7f46067fc640 1 -- 172.21.15.6:0/1575897394 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f460c044e40 con 0x7f46100afad0 2024-05-20T17:53:51.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.734+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f46100cccf0 con 0x7f46100afad0 2024-05-20T17:53:51.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.734+0000 7f46067fc640 1 -- 172.21.15.6:0/1575897394 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f460c079b80 con 0x7f46100afad0 2024-05-20T17:53:51.734 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45f406be60 msgr2=0x7f45f406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45f406be60 0x7f45f406e370 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f461006c520 tx=0x7f4600009040 comp rx=0 tx=0).stop 2024-05-20T17:53:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46100afad0 msgr2=0x7f46101604c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46100afad0 0x7f46101604c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f460c0098c0 tx=0x7f460c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 shutdown_connections 2024-05-20T17:53:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45f406be60 0x7f45f406e370 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f461015d160 0x7f461014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46100afee0 0x7f46101462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 --2- 172.21.15.6:0/1575897394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46100afad0 0x7f46101604c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 >> 172.21.15.6:0/1575897394 conn(0x7f46100cd2a0 msgr2=0x7f46100ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 shutdown_connections 2024-05-20T17:53:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.736+0000 7f4617d85640 1 -- 172.21.15.6:0/1575897394 wait complete. 2024-05-20T17:53:51.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.867+0000 7f7073214640 1 Processor -- start 2024-05-20T17:53:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.867+0000 7f7073214640 1 -- start start 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7073214640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f706c162820 0x7f706c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7073214640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f706c0b3e80 0x7f706c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7073214640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706c06dd20 con 0x7f706c06d910 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7073214640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f706c0d0630 con 0x7f706c162820 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7073214640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f706c0d39c0 con 0x7f706c0b3e80 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7070fb0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f706c162820 0x7f706c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f70717b1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f706c06d910 0x7f706c0d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52838/0 (socket says 172.21.15.6:52838) 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f70717b1640 1 -- 172.21.15.6:0/471419661 learned_addr learned my addr 172.21.15.6:0/471419661 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f706bfff640 1 --2- 172.21.15.6:0/471419661 >> v2:172.21.15.171:3300/0 conn(0x7f706c0b3e80 0x7f706c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7070fb0640 1 -- 172.21.15.6:0/471419661 >> v2:172.21.15.171:3300/0 conn(0x7f706c0b3e80 msgr2=0x7f706c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7070fb0640 1 --2- 172.21.15.6:0/471419661 >> v2:172.21.15.171:3300/0 conn(0x7f706c0b3e80 0x7f706c06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7070fb0640 1 -- 172.21.15.6:0/471419661 >> v1:172.21.15.6:6789/0 conn(0x7f706c06d910 legacy=0x7f706c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f706b7fe640 1 -- 172.21.15.6:0/471419661 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 793116242 0 0) 0x7f7064001490 con 0x7f706c06d910 2024-05-20T17:53:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.869+0000 7f7070fb0640 1 -- 172.21.15.6:0/471419661 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c0d3ca0 con 0x7f706c162820 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.870+0000 7f7070fb0640 1 --2- 172.21.15.6:0/471419661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c162820 0x7f706c0b3940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f706c0d1230 tx=0x7f705c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1c752bd0301344 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.870+0000 7f706b7fe640 1 -- 172.21.15.6:0/471419661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c037070 con 0x7f706c162820 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.870+0000 7f706b7fe640 1 -- 172.21.15.6:0/471419661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f705c032440 con 0x7f706c162820 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.870+0000 7f706b7fe640 1 -- 172.21.15.6:0/471419661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c032810 con 0x7f706c162820 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.871+0000 7f7073214640 1 -- 172.21.15.6:0/471419661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c162820 msgr2=0x7f706c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.871+0000 7f7073214640 1 --2- 172.21.15.6:0/471419661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c162820 0x7f706c0b3940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f706c0d1230 tx=0x7f705c02a1a0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.871+0000 7f7073214640 1 -- 172.21.15.6:0/471419661 shutdown_connections 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.871+0000 7f7073214640 1 --2- 172.21.15.6:0/471419661 >> v2:172.21.15.171:3300/0 conn(0x7f706c0b3e80 0x7f706c06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.871+0000 7f7073214640 1 --2- 172.21.15.6:0/471419661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c162820 0x7f706c0b3940 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.871+0000 7f7073214640 1 -- 172.21.15.6:0/471419661 >> 172.21.15.6:0/471419661 conn(0x7f706c0d4bd0 msgr2=0x7f706c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.871+0000 7f7073214640 1 -- 172.21.15.6:0/471419661 shutdown_connections 2024-05-20T17:53:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.871+0000 7f7073214640 1 -- 172.21.15.6:0/471419661 wait complete. 2024-05-20T17:53:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.873+0000 7f7073214640 1 Processor -- start 2024-05-20T17:53:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.873+0000 7f7073214640 1 -- start start 2024-05-20T17:53:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.874+0000 7f7073214640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c06d910 0x7f706c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.874+0000 7f7073214640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f706c0b3e80 0x7f706c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.874+0000 7f7073214640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706c162820 0x7f706c15e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.874+0000 7f7073214640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f706c0d0300 con 0x7f706c06d910 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.874+0000 7f7073214640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f706c0d4260 con 0x7f706c162820 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.874+0000 7f7073214640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f706c0b91a0 con 0x7f706c0b3e80 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.874+0000 7f7070fb0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c06d910 0x7f706c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7070fb0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c06d910 0x7f706c1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34988/0 (socket says 172.21.15.6:34988) 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7070fb0640 1 -- 172.21.15.6:0/3419463383 learned_addr learned my addr 172.21.15.6:0/3419463383 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f706bfff640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f706c0b3e80 0x7f706c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f70717b1640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706c162820 0x7f706c15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7070fb0640 1 -- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f706c0b3e80 msgr2=0x7f706c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7070fb0640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f706c0b3e80 0x7f706c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7070fb0640 1 -- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706c162820 msgr2=0x7f706c15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7070fb0640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706c162820 0x7f706c15e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7070fb0640 1 -- 172.21.15.6:0/3419463383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c1f5260 con 0x7f706c06d910 2024-05-20T17:53:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f706bfff640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f706c0b3e80 0x7f706c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7070fb0640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c06d910 0x7f706c1571a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f705c035040 tx=0x7f705c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f70697fa640 1 -- 172.21.15.6:0/3419463383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c037050 con 0x7f706c06d910 2024-05-20T17:53:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f70697fa640 1 -- 172.21.15.6:0/3419463383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f705c038040 con 0x7f706c06d910 2024-05-20T17:53:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706c1f5540 con 0x7f706c06d910 2024-05-20T17:53:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f70697fa640 1 -- 172.21.15.6:0/3419463383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c004470 con 0x7f706c06d910 2024-05-20T17:53:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.875+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706c1f5b00 con 0x7f706c06d910 2024-05-20T17:53:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.876+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706c075b00 con 0x7f706c06d910 2024-05-20T17:53:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.877+0000 7f70697fa640 1 -- 172.21.15.6:0/3419463383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f705c030900 con 0x7f706c06d910 2024-05-20T17:53:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.878+0000 7f70697fa640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f705806be30 0x7f705806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.878+0000 7f70697fa640 1 -- 172.21.15.6:0/3419463383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f705c0abd90 con 0x7f706c06d910 2024-05-20T17:53:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.878+0000 7f706bfff640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f705806be30 0x7f705806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.879+0000 7f706bfff640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f705806be30 0x7f705806e340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7060006fd0 tx=0x7f7060008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:51.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:51.883+0000 7f70697fa640 1 -- 172.21.15.6:0/3419463383 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f705c04c020 con 0x7f706c06d910 2024-05-20T17:53:52.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.066+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f706c0b9540 con 0x7f706c06d910 2024-05-20T17:53:52.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.066+0000 7f70697fa640 1 -- 172.21.15.6:0/3419463383 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f705c07a270 con 0x7f706c06d910 2024-05-20T17:53:52.066 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:52.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f705806be30 msgr2=0x7f705806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f705806be30 0x7f705806e340 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7060006fd0 tx=0x7f7060008040 comp rx=0 tx=0).stop 2024-05-20T17:53:52.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c06d910 msgr2=0x7f706c1571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c06d910 0x7f706c1571a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f705c035040 tx=0x7f705c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 shutdown_connections 2024-05-20T17:53:52.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f705806be30 0x7f705806e340 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706c162820 0x7f706c15e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f706c0b3e80 0x7f706c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 --2- 172.21.15.6:0/3419463383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f706c06d910 0x7f706c1571a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.068+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 >> 172.21.15.6:0/3419463383 conn(0x7f706c0d4bd0 msgr2=0x7f706c0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.069+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 shutdown_connections 2024-05-20T17:53:52.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.069+0000 7f7073214640 1 -- 172.21.15.6:0/3419463383 wait complete. 2024-05-20T17:53:52.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.198+0000 7ff7acb38640 1 Processor -- start 2024-05-20T17:53:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.198+0000 7ff7acb38640 1 -- start start 2024-05-20T17:53:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.199+0000 7ff7acb38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80cf250 0x7ff7a815f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.199+0000 7ff7acb38640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7a80d3220 0x7ff7a80d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.199+0000 7ff7acb38640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7a80d0550 con 0x7ff7a80b6680 2024-05-20T17:53:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.199+0000 7ff7acb38640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a815f9a0 con 0x7ff7a80d3220 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.199+0000 7ff7acb38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a80d0b10 con 0x7ff7a80cf250 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.199+0000 7ff7a6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7a80d3220 0x7ff7a80d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.199+0000 7ff79dd9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff7a80b6680 0x7ff7a80b6a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52844/0 (socket says 172.21.15.6:52844) 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.199+0000 7ff79dd9b640 1 -- 172.21.15.6:0/2027446564 learned_addr learned my addr 172.21.15.6:0/2027446564 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.200+0000 7ff7a659c640 1 --2- 172.21.15.6:0/2027446564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80cf250 0x7ff7a815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.200+0000 7ff7a6d9d640 1 -- 172.21.15.6:0/2027446564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80cf250 msgr2=0x7ff7a815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.200+0000 7ff7a6d9d640 1 --2- 172.21.15.6:0/2027446564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80cf250 0x7ff7a815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.200+0000 7ff7a6d9d640 1 -- 172.21.15.6:0/2027446564 >> v1:172.21.15.6:6789/0 conn(0x7ff7a80b6680 legacy=0x7ff7a80b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.200+0000 7ff7a6d9d640 1 -- 172.21.15.6:0/2027446564 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a80d0830 con 0x7ff7a80d3220 2024-05-20T17:53:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.200+0000 7ff7a5d9b640 1 -- 172.21.15.6:0/2027446564 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854006759 0 0) 0x7ff7a80d0550 con 0x7ff7a80b6680 2024-05-20T17:53:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.200+0000 7ff7a6d9d640 1 --2- 172.21.15.6:0/2027446564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a80d3630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009d90 tx=0x7ff7a002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8357ef83f6fe5c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7a5d9b640 1 -- 172.21.15.6:0/2027446564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0031600 con 0x7ff7a80d3220 2024-05-20T17:53:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7a5d9b640 1 -- 172.21.15.6:0/2027446564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a00317a0 con 0x7ff7a80d3220 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7a5d9b640 1 -- 172.21.15.6:0/2027446564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0031b70 con 0x7ff7a80d3220 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7acb38640 1 -- 172.21.15.6:0/2027446564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 msgr2=0x7ff7a80d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7acb38640 1 --2- 172.21.15.6:0/2027446564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a80d3630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009d90 tx=0x7ff7a002a5d0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7acb38640 1 -- 172.21.15.6:0/2027446564 shutdown_connections 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7acb38640 1 --2- 172.21.15.6:0/2027446564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a80d3630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7acb38640 1 --2- 172.21.15.6:0/2027446564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80cf250 0x7ff7a815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7acb38640 1 -- 172.21.15.6:0/2027446564 >> 172.21.15.6:0/2027446564 conn(0x7ff7a80d1860 msgr2=0x7ff7a80d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7acb38640 1 -- 172.21.15.6:0/2027446564 shutdown_connections 2024-05-20T17:53:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.201+0000 7ff7acb38640 1 -- 172.21.15.6:0/2027446564 wait complete. 2024-05-20T17:53:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.203+0000 7ff7acb38640 1 Processor -- start 2024-05-20T17:53:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.204+0000 7ff7acb38640 1 -- start start 2024-05-20T17:53:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7acb38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80b6680 0x7ff7a81f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7acb38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7a80cf250 0x7ff7a81604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7acb38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a8160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7acb38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a80d2d00 con 0x7ff7a80d3220 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7acb38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a80d27d0 con 0x7ff7a80cf250 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7acb38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a80d0140 con 0x7ff7a80b6680 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a8160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a8160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35004/0 (socket says 172.21.15.6:35004) 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a6d9d640 1 -- 172.21.15.6:0/1435334774 learned_addr learned my addr 172.21.15.6:0/1435334774 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a659c640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80b6680 0x7ff7a81f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff79dd9b640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7a80cf250 0x7ff7a81604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a6d9d640 1 -- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80b6680 msgr2=0x7ff7a81f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a6d9d640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80b6680 0x7ff7a81f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a6d9d640 1 -- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7a80cf250 msgr2=0x7ff7a81604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a6d9d640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7a80cf250 0x7ff7a81604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.205+0000 7ff7a6d9d640 1 -- 172.21.15.6:0/1435334774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a81ea1f0 con 0x7ff7a80d3220 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.206+0000 7ff7a6d9d640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a8160a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009eb0 tx=0x7ff7a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.206+0000 7ff79f7fe640 1 -- 172.21.15.6:0/1435334774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a003f070 con 0x7ff7a80d3220 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.206+0000 7ff79f7fe640 1 -- 172.21.15.6:0/1435334774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a0030b60 con 0x7ff7a80d3220 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.206+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a81ea4d0 con 0x7ff7a80d3220 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.206+0000 7ff79f7fe640 1 -- 172.21.15.6:0/1435334774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0009450 con 0x7ff7a80d3220 2024-05-20T17:53:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.206+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a815ffa0 con 0x7ff7a80d3220 2024-05-20T17:53:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.207+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a81e9f60 con 0x7ff7a80d3220 2024-05-20T17:53:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.207+0000 7ff79f7fe640 1 -- 172.21.15.6:0/1435334774 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7a003b410 con 0x7ff7a80d3220 2024-05-20T17:53:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.208+0000 7ff79f7fe640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff78806be30 0x7ff78806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.208+0000 7ff79f7fe640 1 -- 172.21.15.6:0/1435334774 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7ff7a00ac860 con 0x7ff7a80d3220 2024-05-20T17:53:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.208+0000 7ff7a659c640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff78806be30 0x7ff78806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.209+0000 7ff7a659c640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff78806be30 0x7ff78806e340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7980079a0 tx=0x7ff798008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.213+0000 7ff79f7fe640 1 -- 172.21.15.6:0/1435334774 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff7a007a6f0 con 0x7ff7a80d3220 2024-05-20T17:53:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.397+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff7a8075b00 con 0x7ff7a80d3220 2024-05-20T17:53:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.397+0000 7ff79f7fe640 1 -- 172.21.15.6:0/1435334774 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7ff7a007e9f0 con 0x7ff7a80d3220 2024-05-20T17:53:52.397 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff78806be30 msgr2=0x7ff78806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff78806be30 0x7ff78806e340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7980079a0 tx=0x7ff798008040 comp rx=0 tx=0).stop 2024-05-20T17:53:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 msgr2=0x7ff7a8160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a8160a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009eb0 tx=0x7ff7a0004a40 comp rx=0 tx=0).stop 2024-05-20T17:53:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 shutdown_connections 2024-05-20T17:53:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff78806be30 0x7ff78806e340 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7a80d3220 0x7ff7a8160a00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7a80cf250 0x7ff7a81604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 --2- 172.21.15.6:0/1435334774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7a80b6680 0x7ff7a81f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.399+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 >> 172.21.15.6:0/1435334774 conn(0x7ff7a80d1860 msgr2=0x7ff7a8159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.400+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 shutdown_connections 2024-05-20T17:53:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.400+0000 7ff7acb38640 1 -- 172.21.15.6:0/1435334774 wait complete. 2024-05-20T17:53:52.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:52.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.529+0000 7fe3152a2640 1 Processor -- start 2024-05-20T17:53:52.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.529+0000 7fe3152a2640 1 -- start start 2024-05-20T17:53:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.530+0000 7fe3152a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3100b6620 0x7fe3100ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.530+0000 7fe3152a2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe310162ce0 0x7fe3100b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.530+0000 7fe3152a2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3101634a0 con 0x7fe3100b85b0 2024-05-20T17:53:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.530+0000 7fe3152a2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe3100d3480 con 0x7fe3100b6620 2024-05-20T17:53:52.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.530+0000 7fe3152a2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe310163780 con 0x7fe310162ce0 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.530+0000 7fe30f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3100b85b0 0x7fe3100d3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52854/0 (socket says 172.21.15.6:52854) 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3100b6620 0x7fe3100ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30f7fe640 1 -- 172.21.15.6:0/2570660087 learned_addr learned my addr 172.21.15.6:0/2570660087 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30e7fc640 1 --2- 172.21.15.6:0/2570660087 >> v2:172.21.15.171:3300/0 conn(0x7fe310162ce0 0x7fe3100b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30dffb640 1 -- 172.21.15.6:0/2570660087 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683585791 0 0) 0x7fe3101634a0 con 0x7fe3100b85b0 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30dffb640 1 -- 172.21.15.6:0/2570660087 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f8003520 con 0x7fe3100b85b0 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30effd640 1 -- 172.21.15.6:0/2570660087 >> v2:172.21.15.171:3300/0 conn(0x7fe310162ce0 msgr2=0x7fe3100b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30effd640 1 --2- 172.21.15.6:0/2570660087 >> v2:172.21.15.171:3300/0 conn(0x7fe310162ce0 0x7fe3100b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30effd640 1 -- 172.21.15.6:0/2570660087 >> v1:172.21.15.6:6789/0 conn(0x7fe3100b85b0 legacy=0x7fe3100d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.531+0000 7fe30effd640 1 -- 172.21.15.6:0/2570660087 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe310163a60 con 0x7fe3100b6620 2024-05-20T17:53:52.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.532+0000 7fe30effd640 1 --2- 172.21.15.6:0/2570660087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3100ba3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe3100b7790 tx=0x7fe30002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68db31c2f9d4df2b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.532+0000 7fe30dffb640 1 -- 172.21.15.6:0/2570660087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300037070 con 0x7fe3100b6620 2024-05-20T17:53:52.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.532+0000 7fe30dffb640 1 -- 172.21.15.6:0/2570660087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe300032440 con 0x7fe3100b6620 2024-05-20T17:53:52.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.532+0000 7fe30dffb640 1 -- 172.21.15.6:0/2570660087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300032810 con 0x7fe3100b6620 2024-05-20T17:53:52.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.533+0000 7fe3152a2640 1 -- 172.21.15.6:0/2570660087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 msgr2=0x7fe3100ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.533+0000 7fe3152a2640 1 --2- 172.21.15.6:0/2570660087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3100ba3c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe3100b7790 tx=0x7fe30002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.533+0000 7fe3152a2640 1 -- 172.21.15.6:0/2570660087 shutdown_connections 2024-05-20T17:53:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.533+0000 7fe3152a2640 1 --2- 172.21.15.6:0/2570660087 >> v2:172.21.15.171:3300/0 conn(0x7fe310162ce0 0x7fe3100b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.533+0000 7fe3152a2640 1 --2- 172.21.15.6:0/2570660087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3100ba3c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.533+0000 7fe3152a2640 1 -- 172.21.15.6:0/2570660087 >> 172.21.15.6:0/2570660087 conn(0x7fe31006d240 msgr2=0x7fe31006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.533+0000 7fe3152a2640 1 -- 172.21.15.6:0/2570660087 shutdown_connections 2024-05-20T17:53:52.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.533+0000 7fe3152a2640 1 -- 172.21.15.6:0/2570660087 wait complete. 2024-05-20T17:53:52.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.535+0000 7fe3152a2640 1 Processor -- start 2024-05-20T17:53:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.535+0000 7fe3152a2640 1 -- start start 2024-05-20T17:53:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe3152a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3101571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe3152a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3100b85b0 0x7fe31015d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe3152a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe310162ce0 0x7fe3101592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe3152a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe3101630f0 con 0x7fe3100b6620 2024-05-20T17:53:52.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe3152a2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe3100d4300 con 0x7fe3100b85b0 2024-05-20T17:53:52.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe3152a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe31015dd30 con 0x7fe310162ce0 2024-05-20T17:53:52.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3101571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3101571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35016/0 (socket says 172.21.15.6:35016) 2024-05-20T17:53:52.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30effd640 1 -- 172.21.15.6:0/3045078688 learned_addr learned my addr 172.21.15.6:0/3045078688 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:52.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30e7fc640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3100b85b0 0x7fe31015d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30f7fe640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe310162ce0 0x7fe3101592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30effd640 1 -- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe310162ce0 msgr2=0x7fe3101592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30effd640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe310162ce0 0x7fe3101592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30effd640 1 -- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3100b85b0 msgr2=0x7fe31015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30effd640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3100b85b0 0x7fe31015d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30effd640 1 -- 172.21.15.6:0/3045078688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31015d550 con 0x7fe3100b6620 2024-05-20T17:53:52.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.536+0000 7fe30f7fe640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe310162ce0 0x7fe3101592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:52.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.537+0000 7fe30effd640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3101571f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe300000c00 tx=0x7fe3000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.537+0000 7fe2f77fe640 1 -- 172.21.15.6:0/3045078688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300041020 con 0x7fe3100b6620 2024-05-20T17:53:52.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.537+0000 7fe2f77fe640 1 -- 172.21.15.6:0/3045078688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30003d700 con 0x7fe3100b6620 2024-05-20T17:53:52.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.537+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31015df80 con 0x7fe3100b6620 2024-05-20T17:53:52.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.537+0000 7fe2f77fe640 1 -- 172.21.15.6:0/3045078688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300037040 con 0x7fe3100b6620 2024-05-20T17:53:52.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.537+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3101f90f0 con 0x7fe3100b6620 2024-05-20T17:53:52.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.538+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31015e260 con 0x7fe3100b6620 2024-05-20T17:53:52.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.538+0000 7fe2f77fe640 1 -- 172.21.15.6:0/3045078688 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe300044020 con 0x7fe3100b6620 2024-05-20T17:53:52.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.539+0000 7fe2f77fe640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2fc06be30 0x7fe2fc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.539+0000 7fe2f77fe640 1 -- 172.21.15.6:0/3045078688 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fe3000aba50 con 0x7fe3100b6620 2024-05-20T17:53:52.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.539+0000 7fe30e7fc640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2fc06be30 0x7fe2fc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.540+0000 7fe30e7fc640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2fc06be30 0x7fe2fc06e340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe3101eb910 tx=0x7fe304009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.543+0000 7fe2f77fe640 1 -- 172.21.15.6:0/3045078688 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe30004b030 con 0x7fe3100b6620 2024-05-20T17:53:52.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.728+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe310075b00 con 0x7fe3100b6620 2024-05-20T17:53:52.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.728+0000 7fe2f77fe640 1 -- 172.21.15.6:0/3045078688 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fe300079ea0 con 0x7fe3100b6620 2024-05-20T17:53:52.728 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:52.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2fc06be30 msgr2=0x7fe2fc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2fc06be30 0x7fe2fc06e340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe3101eb910 tx=0x7fe304009190 comp rx=0 tx=0).stop 2024-05-20T17:53:52.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 msgr2=0x7fe3101571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3101571f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe300000c00 tx=0x7fe3000046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 shutdown_connections 2024-05-20T17:53:52.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2fc06be30 0x7fe2fc06e340 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe310162ce0 0x7fe3101592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3100b85b0 0x7fe31015d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 --2- 172.21.15.6:0/3045078688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100b6620 0x7fe3101571f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 >> 172.21.15.6:0/3045078688 conn(0x7fe31006d240 msgr2=0x7fe3100676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:52.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.730+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 shutdown_connections 2024-05-20T17:53:52.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.731+0000 7fe3152a2640 1 -- 172.21.15.6:0/3045078688 wait complete. 2024-05-20T17:53:52.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:52.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.857+0000 7f6533f5e640 1 Processor -- start 2024-05-20T17:53:52.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.857+0000 7f6533f5e640 1 -- start start 2024-05-20T17:53:52.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6533f5e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652c0b6620 0x7f652c0ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6533f5e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f652c0d3bf0 0x7f652c0d4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6533f5e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c0d4540 con 0x7f652c162ce0 2024-05-20T17:53:52.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6533f5e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f652c0d3480 con 0x7f652c0d3bf0 2024-05-20T17:53:52.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6533f5e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f652c1634a0 con 0x7f652c0b6620 2024-05-20T17:53:52.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f65314f9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f652c162ce0 0x7f652c0b8070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52858/0 (socket says 172.21.15.6:52858) 2024-05-20T17:53:52.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f65314f9640 1 -- 172.21.15.6:0/3337445843 learned_addr learned my addr 172.21.15.6:0/3337445843 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:52.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6531cfa640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652c0b6620 0x7f652c0ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f65324fb640 1 --2- 172.21.15.6:0/3337445843 >> v2:172.21.15.171:3300/0 conn(0x7f652c0d3bf0 0x7f652c0d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578215387 0 0) 0x7f6520001110 con 0x7f652c162ce0 2024-05-20T17:53:52.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6514003520 con 0x7f652c162ce0 2024-05-20T17:53:52.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1002342463 0 0) 0x7f6514003520 con 0x7f652c162ce0 2024-05-20T17:53:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652c0b6620 msgr2=0x7f652c0ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652c0b6620 0x7f652c0ba3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 >> v2:172.21.15.171:3300/0 conn(0x7f652c0d3bf0 msgr2=0x7f652c0d4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 --2- 172.21.15.6:0/3337445843 >> v2:172.21.15.171:3300/0 conn(0x7f652c0d3bf0 0x7f652c0d4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c163780 con 0x7f652c162ce0 2024-05-20T17:53:52.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.859+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f6520001840 con 0x7f652c162ce0 2024-05-20T17:53:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 >> v1:172.21.15.6:6789/0 conn(0x7f652c162ce0 legacy=0x7f652c0b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f6530cf8640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652c0b6620 0x7f65140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f6530cf8640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6514003f30 0x7f6514004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f6530cf8640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514004d40 0x7f6514005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f652c0d3480 con 0x7f6514004d40 2024-05-20T17:53:52.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f652c1634a0 con 0x7f6514003f30 2024-05-20T17:53:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f651400ba10 con 0x7f652c0b6620 2024-05-20T17:53:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f65324fb640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514004d40 0x7f6514005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f6531cfa640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652c0b6620 0x7f65140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f65314f9640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6514003f30 0x7f6514004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f65324fb640 1 -- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652c0b6620 msgr2=0x7f65140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:52.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f65324fb640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f652c0b6620 0x7f65140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f65324fb640 1 -- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6514003f30 msgr2=0x7f6514004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f65324fb640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6514003f30 0x7f6514004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.860+0000 7f65324fb640 1 -- 172.21.15.6:0/3337445843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6514003520 con 0x7f6514004d40 2024-05-20T17:53:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.861+0000 7f65324fb640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514004d40 0x7f6514005150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f652c08def0 tx=0x7f6514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b066a6fe0523018e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.861+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524036070 con 0x7f6514004d40 2024-05-20T17:53:52.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.861+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6524031400 con 0x7f6514004d40 2024-05-20T17:53:52.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.861+0000 7f6530cf8640 1 -- 172.21.15.6:0/3337445843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524009690 con 0x7f6514004d40 2024-05-20T17:53:52.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.862+0000 7f6533f5e640 1 -- 172.21.15.6:0/3337445843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514004d40 msgr2=0x7f6514005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.862+0000 7f6533f5e640 1 --2- 172.21.15.6:0/3337445843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6514004d40 0x7f6514005150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f652c08def0 tx=0x7f6514005830 comp rx=0 tx=0).stop 2024-05-20T17:53:52.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.862+0000 7f65324fb640 1 -- 172.21.15.6:0/3337445843 reap_dead start 2024-05-20T17:53:52.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.862+0000 7f6533f5e640 1 -- 172.21.15.6:0/3337445843 shutdown_connections 2024-05-20T17:53:52.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.862+0000 7f6533f5e640 1 -- 172.21.15.6:0/3337445843 >> 172.21.15.6:0/3337445843 conn(0x7f652c06d240 msgr2=0x7f652c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:52.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.862+0000 7f6533f5e640 1 -- 172.21.15.6:0/3337445843 shutdown_connections 2024-05-20T17:53:52.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.862+0000 7f6533f5e640 1 -- 172.21.15.6:0/3337445843 wait complete. 2024-05-20T17:53:52.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.864+0000 7f6533f5e640 1 Processor -- start 2024-05-20T17:53:52.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.864+0000 7f6533f5e640 1 -- start start 2024-05-20T17:53:52.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f6533f5e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6514004d40 0x7f652c1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f6533f5e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652c14dc80 0x7f652c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f6533f5e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f652c0cfbf0 0x7f652c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f6533f5e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f652c1630f0 con 0x7f652c0cfbf0 2024-05-20T17:53:52.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f6533f5e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f652c0d36d0 con 0x7f652c14dc80 2024-05-20T17:53:52.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f6533f5e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f652c159a60 con 0x7f6514004d40 2024-05-20T17:53:52.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f65324fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f652c0cfbf0 0x7f652c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f65324fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f652c0cfbf0 0x7f652c1556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35036/0 (socket says 172.21.15.6:35036) 2024-05-20T17:53:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f65324fb640 1 -- 172.21.15.6:0/1997191513 learned_addr learned my addr 172.21.15.6:0/1997191513 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f6531cfa640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6514004d40 0x7f652c1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.865+0000 7f65314f9640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652c14dc80 0x7f652c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f65324fb640 1 -- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6514004d40 msgr2=0x7f652c1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f65324fb640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6514004d40 0x7f652c1574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f65324fb640 1 -- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652c14dc80 msgr2=0x7f652c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f65324fb640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652c14dc80 0x7f652c0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f65324fb640 1 -- 172.21.15.6:0/1997191513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c0d0000 con 0x7f652c0cfbf0 2024-05-20T17:53:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f65324fb640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f652c0cfbf0 0x7f652c1556d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f652402ab50 tx=0x7f6524004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f652a7fc640 1 -- 172.21.15.6:0/1997191513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524036040 con 0x7f652c0cfbf0 2024-05-20T17:53:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f652a7fc640 1 -- 172.21.15.6:0/1997191513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6524041070 con 0x7f652c0cfbf0 2024-05-20T17:53:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f652a7fc640 1 -- 172.21.15.6:0/1997191513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524009690 con 0x7f652c0cfbf0 2024-05-20T17:53:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c150d70 con 0x7f652c0cfbf0 2024-05-20T17:53:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.866+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c157f20 con 0x7f652c0cfbf0 2024-05-20T17:53:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.867+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652c075b00 con 0x7f652c0cfbf0 2024-05-20T17:53:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.868+0000 7f652a7fc640 1 -- 172.21.15.6:0/1997191513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6524039070 con 0x7f652c0cfbf0 2024-05-20T17:53:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.868+0000 7f652a7fc640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f651806be30 0x7f651806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.868+0000 7f652a7fc640 1 -- 172.21.15.6:0/1997191513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f65240aab10 con 0x7f652c0cfbf0 2024-05-20T17:53:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.869+0000 7f6531cfa640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f651806be30 0x7f651806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.869+0000 7f6531cfa640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f651806be30 0x7f651806e340 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f651c014510 tx=0x7f651c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:52.873+0000 7f652a7fc640 1 -- 172.21.15.6:0/1997191513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f652404a020 con 0x7f652c0cfbf0 2024-05-20T17:53:53.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.060+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f652c157c40 con 0x7f652c0cfbf0 2024-05-20T17:53:53.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.061+0000 7f652a7fc640 1 -- 172.21.15.6:0/1997191513 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f652c0d0000 con 0x7f652c0cfbf0 2024-05-20T17:53:53.060 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:53.061 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:53.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f651806be30 msgr2=0x7f651806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f651806be30 0x7f651806e340 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f651c014510 tx=0x7f651c00b040 comp rx=0 tx=0).stop 2024-05-20T17:53:53.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f652c0cfbf0 msgr2=0x7f652c1556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f652c0cfbf0 0x7f652c1556d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f652402ab50 tx=0x7f6524004730 comp rx=0 tx=0).stop 2024-05-20T17:53:53.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 shutdown_connections 2024-05-20T17:53:53.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f651806be30 0x7f651806e340 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f652c0cfbf0 0x7f652c1556d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f652c14dc80 0x7f652c0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 --2- 172.21.15.6:0/1997191513 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6514004d40 0x7f652c1574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 >> 172.21.15.6:0/1997191513 conn(0x7f652c06d240 msgr2=0x7f652c0b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:53.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 shutdown_connections 2024-05-20T17:53:53.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.063+0000 7f6533f5e640 1 -- 172.21.15.6:0/1997191513 wait complete. 2024-05-20T17:53:53.074 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:53.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.193+0000 7fd68ef38640 1 Processor -- start 2024-05-20T17:53:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.193+0000 7fd68ef38640 1 -- start start 2024-05-20T17:53:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd68ef38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd68806d3d0 0x7fd68806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd68ef38640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68806dd20 con 0x7fd688162820 2024-05-20T17:53:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd68ef38640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6880d0630 con 0x7fd6880b8190 2024-05-20T17:53:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd68ef38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd6880d39c0 con 0x7fd68806d3d0 2024-05-20T17:53:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd68ccd4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd688162820 0x7fd6880b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52862/0 (socket says 172.21.15.6:52862) 2024-05-20T17:53:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd68ccd4640 1 -- 172.21.15.6:0/261119563 learned_addr learned my addr 172.21.15.6:0/261119563 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd687fff640 1 --2- 172.21.15.6:0/261119563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd68806d3d0 0x7fd68806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd6877fe640 1 -- 172.21.15.6:0/261119563 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459575294 0 0) 0x7fd680001110 con 0x7fd688162820 2024-05-20T17:53:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.194+0000 7fd6877fe640 1 -- 172.21.15.6:0/261119563 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd674003520 con 0x7fd688162820 2024-05-20T17:53:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.195+0000 7fd687fff640 1 -- 172.21.15.6:0/261119563 >> v1:172.21.15.171:6789/0 conn(0x7fd6880b8190 legacy=0x7fd6880b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.195+0000 7fd6877fe640 1 -- 172.21.15.6:0/261119563 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 783254394 0 0) 0x7fd674003520 con 0x7fd688162820 2024-05-20T17:53:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.195+0000 7fd687fff640 1 -- 172.21.15.6:0/261119563 >> v1:172.21.15.6:6789/0 conn(0x7fd688162820 legacy=0x7fd6880b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.195+0000 7fd687fff640 1 -- 172.21.15.6:0/261119563 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6880d3ca0 con 0x7fd68806d3d0 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd687fff640 1 --2- 172.21.15.6:0/261119563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd68806d3d0 0x7fd68806d7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd678009dc0 tx=0x7fd67802a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=787ccf24321551e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd6877fe640 1 -- 172.21.15.6:0/261119563 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678035020 con 0x7fd68806d3d0 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd6877fe640 1 -- 172.21.15.6:0/261119563 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd678007540 con 0x7fd68806d3d0 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd6877fe640 1 -- 172.21.15.6:0/261119563 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680001840 con 0x7fd68806d3d0 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd68ef38640 1 -- 172.21.15.6:0/261119563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd68806d3d0 msgr2=0x7fd68806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd68ef38640 1 --2- 172.21.15.6:0/261119563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd68806d3d0 0x7fd68806d7e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd678009dc0 tx=0x7fd67802a580 comp rx=0 tx=0).stop 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd68ef38640 1 -- 172.21.15.6:0/261119563 shutdown_connections 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd68ef38640 1 --2- 172.21.15.6:0/261119563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd68806d3d0 0x7fd68806d7e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.196+0000 7fd68ef38640 1 -- 172.21.15.6:0/261119563 >> 172.21.15.6:0/261119563 conn(0x7fd6880d4bd0 msgr2=0x7fd6880d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.197+0000 7fd68ef38640 1 -- 172.21.15.6:0/261119563 shutdown_connections 2024-05-20T17:53:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.197+0000 7fd68ef38640 1 -- 172.21.15.6:0/261119563 wait complete. 2024-05-20T17:53:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.198+0000 7fd68ef38640 1 Processor -- start 2024-05-20T17:53:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.198+0000 7fd68ef38640 1 -- start start 2024-05-20T17:53:53.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ef38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68806d3d0 0x7fd6881e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ef38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6880b8190 0x7fd6880cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ef38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd688162820 0x7fd6880cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ef38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd6880d0300 con 0x7fd68806d3d0 2024-05-20T17:53:53.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ef38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd6880d4260 con 0x7fd6880b8190 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ef38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd6880b4050 con 0x7fd688162820 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68806d3d0 0x7fd6881e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68806d3d0 0x7fd6881e93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35042/0 (socket says 172.21.15.6:35042) 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 -- 172.21.15.6:0/4291551394 learned_addr learned my addr 172.21.15.6:0/4291551394 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd687fff640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6880b8190 0x7fd6880cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68d4d5640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd688162820 0x7fd6880cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 -- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd688162820 msgr2=0x7fd6880cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd688162820 0x7fd6880cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 -- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6880b8190 msgr2=0x7fd6880cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6880b8190 0x7fd6880cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 -- 172.21.15.6:0/4291551394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6881ea160 con 0x7fd68806d3d0 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.200+0000 7fd68ccd4640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68806d3d0 0x7fd6881e93f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd68000c480 tx=0x7fd68000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.201+0000 7fd6857fa640 1 -- 172.21.15.6:0/4291551394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680018070 con 0x7fd68806d3d0 2024-05-20T17:53:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.201+0000 7fd6857fa640 1 -- 172.21.15.6:0/4291551394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6800074e0 con 0x7fd68806d3d0 2024-05-20T17:53:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.201+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6881ea440 con 0x7fd68806d3d0 2024-05-20T17:53:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.201+0000 7fd6857fa640 1 -- 172.21.15.6:0/4291551394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680004a20 con 0x7fd68806d3d0 2024-05-20T17:53:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.201+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6881eaa00 con 0x7fd68806d3d0 2024-05-20T17:53:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.202+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd688075b00 con 0x7fd68806d3d0 2024-05-20T17:53:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.202+0000 7fd6857fa640 1 -- 172.21.15.6:0/4291551394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd680004bc0 con 0x7fd68806d3d0 2024-05-20T17:53:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.203+0000 7fd6857fa640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd66806be30 0x7fd66806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.203+0000 7fd6857fa640 1 -- 172.21.15.6:0/4291551394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fd68008a620 con 0x7fd68806d3d0 2024-05-20T17:53:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.203+0000 7fd687fff640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd66806be30 0x7fd66806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.204+0000 7fd687fff640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd66806be30 0x7fd66806e340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd678033000 tx=0x7fd67802f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.208+0000 7fd6857fa640 1 -- 172.21.15.6:0/4291551394 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd68806dd20 con 0x7fd68806d3d0 2024-05-20T17:53:53.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.390+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd68815d330 con 0x7fd68806d3d0 2024-05-20T17:53:53.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.391+0000 7fd6857fa640 1 -- 172.21.15.6:0/4291551394 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fd6800584c0 con 0x7fd68806d3d0 2024-05-20T17:53:53.390 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd66806be30 msgr2=0x7fd66806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd66806be30 0x7fd66806e340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd678033000 tx=0x7fd67802f000 comp rx=0 tx=0).stop 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68806d3d0 msgr2=0x7fd6881e93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68806d3d0 0x7fd6881e93f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd68000c480 tx=0x7fd68000c940 comp rx=0 tx=0).stop 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 shutdown_connections 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd66806be30 0x7fd66806e340 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd688162820 0x7fd6880cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6880b8190 0x7fd6880cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 --2- 172.21.15.6:0/4291551394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68806d3d0 0x7fd6881e93f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 >> 172.21.15.6:0/4291551394 conn(0x7fd6880d4bd0 msgr2=0x7fd68815ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 shutdown_connections 2024-05-20T17:53:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.393+0000 7fd68ef38640 1 -- 172.21.15.6:0/4291551394 wait complete. 2024-05-20T17:53:53.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.522+0000 7f2ac49d5640 1 Processor -- start 2024-05-20T17:53:53.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.522+0000 7f2ac49d5640 1 -- start start 2024-05-20T17:53:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2ac49d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ac006d3d0 0x7f2ac006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2ac49d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac00b8190 0x7f2ac00b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2ac49d5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac006dd20 con 0x7f2ac0162820 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2ac49d5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac00d0630 con 0x7f2ac006d3d0 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2ac49d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac00d39c0 con 0x7f2ac00b8190 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2abdd9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ac006d3d0 0x7f2ac006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2abdd9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2ac006d3d0 0x7f2ac006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35056/0 (socket says 172.21.15.6:35056) 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2abdd9b640 1 -- 172.21.15.6:0/3490509832 learned_addr learned my addr 172.21.15.6:0/3490509832 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2abed9d640 1 --2- 172.21.15.6:0/3490509832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac00b8190 0x7f2ac00b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2abdd9b640 1 -- 172.21.15.6:0/3490509832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac00b8190 msgr2=0x7f2ac00b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2abdd9b640 1 --2- 172.21.15.6:0/3490509832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac00b8190 0x7f2ac00b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2abdd9b640 1 -- 172.21.15.6:0/3490509832 >> v1:172.21.15.171:6789/0 conn(0x7f2ac0162820 legacy=0x7f2ac00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.524+0000 7f2abdd9b640 1 -- 172.21.15.6:0/3490509832 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac00d3ca0 con 0x7f2ac006d3d0 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.525+0000 7f2abdd9b640 1 --2- 172.21.15.6:0/3490509832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac006d3d0 0x7f2ac006d7e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9461c25ced964c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.525+0000 7f2abd59a640 1 -- 172.21.15.6:0/3490509832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8037070 con 0x7f2ac006d3d0 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.525+0000 7f2abd59a640 1 -- 172.21.15.6:0/3490509832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa8032440 con 0x7f2ac006d3d0 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.525+0000 7f2abd59a640 1 -- 172.21.15.6:0/3490509832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8032810 con 0x7f2ac006d3d0 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.526+0000 7f2ac49d5640 1 -- 172.21.15.6:0/3490509832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac006d3d0 msgr2=0x7f2ac006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.526+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/3490509832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac006d3d0 0x7f2ac006d7e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa802a270 comp rx=0 tx=0).stop 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.526+0000 7f2ac49d5640 1 -- 172.21.15.6:0/3490509832 shutdown_connections 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.526+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/3490509832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac00b8190 0x7f2ac00b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.526+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/3490509832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac006d3d0 0x7f2ac006d7e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.526+0000 7f2ac49d5640 1 -- 172.21.15.6:0/3490509832 >> 172.21.15.6:0/3490509832 conn(0x7f2ac00d4bd0 msgr2=0x7f2ac00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.526+0000 7f2ac49d5640 1 -- 172.21.15.6:0/3490509832 shutdown_connections 2024-05-20T17:53:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.526+0000 7f2ac49d5640 1 -- 172.21.15.6:0/3490509832 wait complete. 2024-05-20T17:53:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.528+0000 7f2ac49d5640 1 Processor -- start 2024-05-20T17:53:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.528+0000 7f2ac49d5640 1 -- start start 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2ac49d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac006d3d0 0x7f2ac014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2ac49d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac00b8190 0x7f2ac00cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2ac49d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ac0162820 0x7f2ac01f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2ac49d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac00d0300 con 0x7f2ac00b8190 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2ac49d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac00d4260 con 0x7f2ac0162820 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2ac49d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac00b4050 con 0x7f2ac006d3d0 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2abdd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac00b8190 0x7f2ac00cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2abdd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac00b8190 0x7f2ac00cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35068/0 (socket says 172.21.15.6:35068) 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.529+0000 7f2abdd9b640 1 -- 172.21.15.6:0/2075489986 learned_addr learned my addr 172.21.15.6:0/2075489986 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abe59c640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac006d3d0 0x7f2ac014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abed9d640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ac0162820 0x7f2ac01f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abdd9b640 1 -- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac006d3d0 msgr2=0x7f2ac014a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abdd9b640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac006d3d0 0x7f2ac014a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abdd9b640 1 -- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ac0162820 msgr2=0x7f2ac01f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abdd9b640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ac0162820 0x7f2ac01f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abdd9b640 1 -- 172.21.15.6:0/2075489986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac014ac20 con 0x7f2ac00b8190 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abed9d640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ac0162820 0x7f2ac01f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2abdd9b640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac00b8190 0x7f2ac00cbc80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000c00 tx=0x7f2aa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2ab6ffd640 1 -- 172.21.15.6:0/2075489986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8037040 con 0x7f2ac00b8190 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2ab6ffd640 1 -- 172.21.15.6:0/2075489986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa8042070 con 0x7f2ac00b8190 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac00ca290 con 0x7f2ac00b8190 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2ab6ffd640 1 -- 172.21.15.6:0/2075489986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8030860 con 0x7f2ac00b8190 2024-05-20T17:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.530+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac00ca850 con 0x7f2ac00b8190 2024-05-20T17:53:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.531+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac0075b00 con 0x7f2ac00b8190 2024-05-20T17:53:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.532+0000 7f2ab6ffd640 1 -- 172.21.15.6:0/2075489986 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2aa8030a00 con 0x7f2ac00b8190 2024-05-20T17:53:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.532+0000 7f2ab6ffd640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2aa006be30 0x7f2aa006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.532+0000 7f2ab6ffd640 1 -- 172.21.15.6:0/2075489986 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f2aa80abd30 con 0x7f2ac00b8190 2024-05-20T17:53:53.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.533+0000 7f2abe59c640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2aa006be30 0x7f2aa006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.533+0000 7f2abe59c640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2aa006be30 0x7f2aa006e340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8007fd0 tx=0x7f2ab8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.537+0000 7f2ab6ffd640 1 -- 172.21.15.6:0/2075489986 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2aa8045360 con 0x7f2ac00b8190 2024-05-20T17:53:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.722+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2ac006c530 con 0x7f2ac00b8190 2024-05-20T17:53:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.722+0000 7f2ab6ffd640 1 -- 172.21.15.6:0/2075489986 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2aa807a0f0 con 0x7f2ac00b8190 2024-05-20T17:53:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2aa006be30 msgr2=0x7f2aa006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2aa006be30 0x7f2aa006e340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8007fd0 tx=0x7f2ab8009040 comp rx=0 tx=0).stop 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac00b8190 msgr2=0x7f2ac00cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac00b8190 0x7f2ac00cbc80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000c00 tx=0x7f2aa80046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 shutdown_connections 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2aa006be30 0x7f2aa006e340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ac0162820 0x7f2ac01f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ac00b8190 0x7f2ac00cbc80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 --2- 172.21.15.6:0/2075489986 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ac006d3d0 0x7f2ac014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 >> 172.21.15.6:0/2075489986 conn(0x7f2ac00d4bd0 msgr2=0x7f2ac0160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 shutdown_connections 2024-05-20T17:53:53.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.724+0000 7f2ac49d5640 1 -- 172.21.15.6:0/2075489986 wait complete. 2024-05-20T17:53:53.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.854+0000 7f82d9f4c640 1 Processor -- start 2024-05-20T17:53:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.854+0000 7f82d9f4c640 1 -- start start 2024-05-20T17:53:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d9f4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d4163a10 0x7f82d40d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d9f4c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82d40b4010 0x7f82d40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d9f4c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f82d40d14b0 0x7f82d40d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d9f4c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f82d40d3ca0 con 0x7f82d40b4010 2024-05-20T17:53:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d9f4c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f82d40d0370 con 0x7f82d40d14b0 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d9f4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f82d40d0650 con 0x7f82d4163a10 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82d40b4010 0x7f82d40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82d40b4010 0x7f82d40cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35082/0 (socket says 172.21.15.6:35082) 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.855+0000 7f82d2ffd640 1 -- 172.21.15.6:0/3755332913 learned_addr learned my addr 172.21.15.6:0/3755332913 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d37fe640 1 --2- 172.21.15.6:0/3755332913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d4163a10 0x7f82d40d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d3fff640 1 --2- 172.21.15.6:0/3755332913 >> v2:172.21.15.171:3300/0 conn(0x7f82d40d14b0 0x7f82d40d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d2ffd640 1 -- 172.21.15.6:0/3755332913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d4163a10 msgr2=0x7f82d40d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d2ffd640 1 --2- 172.21.15.6:0/3755332913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d4163a10 0x7f82d40d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d2ffd640 1 -- 172.21.15.6:0/3755332913 >> v2:172.21.15.171:3300/0 conn(0x7f82d40d14b0 msgr2=0x7f82d40d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d2ffd640 1 --2- 172.21.15.6:0/3755332913 >> v2:172.21.15.171:3300/0 conn(0x7f82d40d14b0 0x7f82d40d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d2ffd640 1 -- 172.21.15.6:0/3755332913 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d40d3650 con 0x7f82d40b4010 2024-05-20T17:53:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d37fe640 1 --2- 172.21.15.6:0/3755332913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d4163a10 0x7f82d40d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d3fff640 1 --2- 172.21.15.6:0/3755332913 >> v2:172.21.15.171:3300/0 conn(0x7f82d40d14b0 0x7f82d40d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.856+0000 7f82d2ffd640 1 --2- 172.21.15.6:0/3755332913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d40b4010 0x7f82d40cfb00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f82d40b4590 tx=0x7f82c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec915704c192540 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d27fc640 1 -- 172.21.15.6:0/3755332913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8037070 con 0x7f82d40b4010 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d27fc640 1 -- 172.21.15.6:0/3755332913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c8032440 con 0x7f82d40b4010 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d27fc640 1 -- 172.21.15.6:0/3755332913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8032810 con 0x7f82d40b4010 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 -- 172.21.15.6:0/3755332913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d40b4010 msgr2=0x7f82d40cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/3755332913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d40b4010 0x7f82d40cfb00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f82d40b4590 tx=0x7f82c802a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 -- 172.21.15.6:0/3755332913 shutdown_connections 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/3755332913 >> v2:172.21.15.171:3300/0 conn(0x7f82d40d14b0 0x7f82d40d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/3755332913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d40b4010 0x7f82d40cfb00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/3755332913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d4163a10 0x7f82d40d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 -- 172.21.15.6:0/3755332913 >> 172.21.15.6:0/3755332913 conn(0x7f82d406d240 msgr2=0x7f82d406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 -- 172.21.15.6:0/3755332913 shutdown_connections 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.857+0000 7f82d9f4c640 1 -- 172.21.15.6:0/3755332913 wait complete. 2024-05-20T17:53:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.859+0000 7f82d9f4c640 1 Processor -- start 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.859+0000 7f82d9f4c640 1 -- start start 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d9f4c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82d40b4010 0x7f82d40ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d9f4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d40d14b0 0x7f82d40ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d9f4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d4163a10 0x7f82d41f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d9f4c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f82d40d1e00 con 0x7f82d4163a10 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d9f4c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82d40d0040 con 0x7f82d40b4010 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d9f4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f82d40b8210 con 0x7f82d40d14b0 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d4163a10 0x7f82d41f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d4163a10 0x7f82d41f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35092/0 (socket says 172.21.15.6:35092) 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 -- 172.21.15.6:0/1261201102 learned_addr learned my addr 172.21.15.6:0/1261201102 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d37fe640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82d40b4010 0x7f82d40ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d2ffd640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d40d14b0 0x7f82d40ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 -- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d40d14b0 msgr2=0x7f82d40ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d40d14b0 0x7f82d40ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 -- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82d40b4010 msgr2=0x7f82d40ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82d40b4010 0x7f82d40ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 -- 172.21.15.6:0/1261201102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d40b2e80 con 0x7f82d4163a10 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.861+0000 7f82d3fff640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d4163a10 0x7f82d41f5480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00cd10 tx=0x7f82cc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.862+0000 7f82bbfff640 1 -- 172.21.15.6:0/1261201102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00f680 con 0x7f82d4163a10 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.862+0000 7f82bbfff640 1 -- 172.21.15.6:0/1261201102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc00f840 con 0x7f82d4163a10 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.862+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d40b3160 con 0x7f82d4163a10 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.862+0000 7f82bbfff640 1 -- 172.21.15.6:0/1261201102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00fc30 con 0x7f82d4163a10 2024-05-20T17:53:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.862+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d40b3440 con 0x7f82d4163a10 2024-05-20T17:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.863+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d415ace0 con 0x7f82d4163a10 2024-05-20T17:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.863+0000 7f82bbfff640 1 -- 172.21.15.6:0/1261201102 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82cc0213f0 con 0x7f82d4163a10 2024-05-20T17:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.864+0000 7f82bbfff640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82c006be30 0x7f82c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.864+0000 7f82bbfff640 1 -- 172.21.15.6:0/1261201102 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f82cc08be10 con 0x7f82d4163a10 2024-05-20T17:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.864+0000 7f82d37fe640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82c006be30 0x7f82c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.865+0000 7f82d37fe640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82c006be30 0x7f82c006e340 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82d40d3020 tx=0x7f82c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:53.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:53.868+0000 7f82bbfff640 1 -- 172.21.15.6:0/1261201102 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f82cc014030 con 0x7f82d4163a10 2024-05-20T17:53:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.054+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f82d4075b00 con 0x7f82d4163a10 2024-05-20T17:53:54.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.055+0000 7f82bbfff640 1 -- 172.21.15.6:0/1261201102 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f82cc059dc0 con 0x7f82d4163a10 2024-05-20T17:53:54.054 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:54.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82c006be30 msgr2=0x7f82c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82c006be30 0x7f82c006e340 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82d40d3020 tx=0x7f82c4008040 comp rx=0 tx=0).stop 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d4163a10 msgr2=0x7f82d41f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d4163a10 0x7f82d41f5480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00cd10 tx=0x7f82cc00a650 comp rx=0 tx=0).stop 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 shutdown_connections 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82c006be30 0x7f82c006e340 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82d4163a10 0x7f82d41f5480 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82d40d14b0 0x7f82d40ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 --2- 172.21.15.6:0/1261201102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82d40b4010 0x7f82d40ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 >> 172.21.15.6:0/1261201102 conn(0x7f82d406d240 msgr2=0x7f82d415f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 shutdown_connections 2024-05-20T17:53:54.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.057+0000 7f82d9f4c640 1 -- 172.21.15.6:0/1261201102 wait complete. 2024-05-20T17:53:54.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.186+0000 7fce187ea640 1 Processor -- start 2024-05-20T17:53:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.186+0000 7fce187ea640 1 -- start start 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce187ea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce1006d3d0 0x7fce1006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce187ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce100b8190 0x7fce100b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce187ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce1006dd20 con 0x7fce10162820 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce187ea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fce100d0630 con 0x7fce1006d3d0 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce187ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fce100d39c0 con 0x7fce100b8190 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce15d85640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce1006d3d0 0x7fce1006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce15d85640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce1006d3d0 0x7fce1006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35106/0 (socket says 172.21.15.6:35106) 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce15d85640 1 -- 172.21.15.6:0/1454821517 learned_addr learned my addr 172.21.15.6:0/1454821517 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce16d87640 1 --2- 172.21.15.6:0/1454821517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce100b8190 0x7fce100b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce15d85640 1 -- 172.21.15.6:0/1454821517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce100b8190 msgr2=0x7fce100b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce15d85640 1 --2- 172.21.15.6:0/1454821517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce100b8190 0x7fce100b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce15d85640 1 -- 172.21.15.6:0/1454821517 >> v1:172.21.15.171:6789/0 conn(0x7fce10162820 legacy=0x7fce100b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.188+0000 7fce15d85640 1 -- 172.21.15.6:0/1454821517 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100d3ca0 con 0x7fce1006d3d0 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.189+0000 7fce15d85640 1 --2- 172.21.15.6:0/1454821517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce1006d7e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce00009870 tx=0x7fce0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178862bf97f4e3a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.189+0000 7fce15584640 1 -- 172.21.15.6:0/1454821517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00037070 con 0x7fce1006d3d0 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.189+0000 7fce15584640 1 -- 172.21.15.6:0/1454821517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce00032440 con 0x7fce1006d3d0 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.189+0000 7fce15584640 1 -- 172.21.15.6:0/1454821517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00032810 con 0x7fce1006d3d0 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.190+0000 7fce187ea640 1 -- 172.21.15.6:0/1454821517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 msgr2=0x7fce1006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.190+0000 7fce187ea640 1 --2- 172.21.15.6:0/1454821517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce1006d7e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce00009870 tx=0x7fce0002a270 comp rx=0 tx=0).stop 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.190+0000 7fce187ea640 1 -- 172.21.15.6:0/1454821517 shutdown_connections 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.190+0000 7fce187ea640 1 --2- 172.21.15.6:0/1454821517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce100b8190 0x7fce100b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.190+0000 7fce187ea640 1 --2- 172.21.15.6:0/1454821517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce1006d7e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.190+0000 7fce187ea640 1 -- 172.21.15.6:0/1454821517 >> 172.21.15.6:0/1454821517 conn(0x7fce100d4bd0 msgr2=0x7fce100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.190+0000 7fce187ea640 1 -- 172.21.15.6:0/1454821517 shutdown_connections 2024-05-20T17:53:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.190+0000 7fce187ea640 1 -- 172.21.15.6:0/1454821517 wait complete. 2024-05-20T17:53:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.192+0000 7fce187ea640 1 Processor -- start 2024-05-20T17:53:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.192+0000 7fce187ea640 1 -- start start 2024-05-20T17:53:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce187ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce101f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce187ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce100b8190 0x7fce101583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce187ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 0x7fce1015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce187ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fce100d0300 con 0x7fce1006d3d0 2024-05-20T17:53:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce187ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fce100d4260 con 0x7fce100b8190 2024-05-20T17:53:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce187ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fce100b4050 con 0x7fce10162820 2024-05-20T17:53:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce16586640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce101f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce16586640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce101f9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35110/0 (socket says 172.21.15.6:35110) 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.193+0000 7fce16586640 1 -- 172.21.15.6:0/3865072764 learned_addr learned my addr 172.21.15.6:0/3865072764 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce16d87640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 0x7fce1015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce15d85640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce100b8190 0x7fce101583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce16586640 1 -- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 msgr2=0x7fce1015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce16586640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 0x7fce1015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce16586640 1 -- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce100b8190 msgr2=0x7fce101583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce16586640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce100b8190 0x7fce101583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce16586640 1 -- 172.21.15.6:0/3865072764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100cb670 con 0x7fce1006d3d0 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce16586640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce101f9960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00c760 tx=0x7fce0c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce06ffd640 1 -- 172.21.15.6:0/3865072764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c016020 con 0x7fce1006d3d0 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce06ffd640 1 -- 172.21.15.6:0/3865072764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c006d50 con 0x7fce1006d3d0 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce10158b80 con 0x7fce1006d3d0 2024-05-20T17:53:54.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce06ffd640 1 -- 172.21.15.6:0/3865072764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c003bb0 con 0x7fce1006d3d0 2024-05-20T17:53:54.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.194+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce10159390 con 0x7fce1006d3d0 2024-05-20T17:53:54.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.195+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce10075b00 con 0x7fce1006d3d0 2024-05-20T17:53:54.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.196+0000 7fce06ffd640 1 -- 172.21.15.6:0/3865072764 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce0c00a850 con 0x7fce1006d3d0 2024-05-20T17:53:54.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.196+0000 7fce06ffd640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf406be30 0x7fcdf406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.196+0000 7fce06ffd640 1 -- 172.21.15.6:0/3865072764 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fce0c08aeb0 con 0x7fce1006d3d0 2024-05-20T17:53:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.196+0000 7fce15d85640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf406be30 0x7fcdf406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.197+0000 7fce15d85640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf406be30 0x7fcdf406e340 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fce00034000 tx=0x7fce0002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.201+0000 7fce06ffd640 1 -- 172.21.15.6:0/3865072764 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fce0c020020 con 0x7fce1006d3d0 2024-05-20T17:53:54.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.384+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fce100b3620 con 0x7fce1006d3d0 2024-05-20T17:53:54.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.385+0000 7fce06ffd640 1 -- 172.21.15.6:0/3865072764 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fce100cb670 con 0x7fce1006d3d0 2024-05-20T17:53:54.384 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:54.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf406be30 msgr2=0x7fcdf406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf406be30 0x7fcdf406e340 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fce00034000 tx=0x7fce0002e000 comp rx=0 tx=0).stop 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 msgr2=0x7fce101f9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce101f9960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00c760 tx=0x7fce0c00cc20 comp rx=0 tx=0).stop 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 shutdown_connections 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf406be30 0x7fcdf406e340 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 0x7fce1015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce100b8190 0x7fce101583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 --2- 172.21.15.6:0/3865072764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce101f9960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 >> 172.21.15.6:0/3865072764 conn(0x7fce100d4bd0 msgr2=0x7fce100b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 shutdown_connections 2024-05-20T17:53:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.387+0000 7fce187ea640 1 -- 172.21.15.6:0/3865072764 wait complete. 2024-05-20T17:53:54.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.513+0000 7f44917ce640 1 Processor -- start 2024-05-20T17:53:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.513+0000 7f44917ce640 1 -- start start 2024-05-20T17:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.514+0000 7f44917ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c06d3d0 0x7f448c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.514+0000 7f44917ce640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f448c0b8190 0x7f448c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.514+0000 7f44917ce640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448c06dd20 con 0x7f448c162820 2024-05-20T17:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.514+0000 7f44917ce640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f448c0d0630 con 0x7f448c0b8190 2024-05-20T17:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.514+0000 7f44917ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f448c0d39c0 con 0x7f448c06d3d0 2024-05-20T17:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448a7fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c06d3d0 0x7f448c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448b7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f448c0b8190 0x7f448c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448affd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f448c162820 0x7f448c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:46264/0 (socket says 172.21.15.6:46264) 2024-05-20T17:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448affd640 1 -- 172.21.15.6:0/1993908789 learned_addr learned my addr 172.21.15.6:0/1993908789 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448a7fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c06d3d0 0x7f448c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:48688/0 (socket says 172.21.15.6:48688) 2024-05-20T17:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f4489ffb640 1 -- 172.21.15.6:0/1993908789 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456647525 0 0) 0x7f447c001110 con 0x7f448c162820 2024-05-20T17:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448a7fc640 1 -- 172.21.15.6:0/1993908789 >> v2:172.21.15.171:3300/0 conn(0x7f448c0b8190 msgr2=0x7f448c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448a7fc640 1 --2- 172.21.15.6:0/1993908789 >> v2:172.21.15.171:3300/0 conn(0x7f448c0b8190 0x7f448c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448a7fc640 1 -- 172.21.15.6:0/1993908789 >> v1:172.21.15.171:6789/0 conn(0x7f448c162820 legacy=0x7f448c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448a7fc640 1 -- 172.21.15.6:0/1993908789 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c0d3ca0 con 0x7f448c06d3d0 2024-05-20T17:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.515+0000 7f448b7fe640 1 --2- 172.21.15.6:0/1993908789 >> v2:172.21.15.171:3300/0 conn(0x7f448c0b8190 0x7f448c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.516+0000 7f448a7fc640 1 --2- 172.21.15.6:0/1993908789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c06d3d0 0x7f448c06d7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44800097a0 tx=0x7f448002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=486bb4330c5980a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.516+0000 7f4489ffb640 1 -- 172.21.15.6:0/1993908789 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480037070 con 0x7f448c06d3d0 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.516+0000 7f4489ffb640 1 -- 172.21.15.6:0/1993908789 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4480032440 con 0x7f448c06d3d0 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.516+0000 7f4489ffb640 1 -- 172.21.15.6:0/1993908789 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480032810 con 0x7f448c06d3d0 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.517+0000 7f44917ce640 1 -- 172.21.15.6:0/1993908789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c06d3d0 msgr2=0x7f448c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.517+0000 7f44917ce640 1 --2- 172.21.15.6:0/1993908789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c06d3d0 0x7f448c06d7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44800097a0 tx=0x7f448002a180 comp rx=0 tx=0).stop 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.517+0000 7f44917ce640 1 -- 172.21.15.6:0/1993908789 shutdown_connections 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.517+0000 7f44917ce640 1 --2- 172.21.15.6:0/1993908789 >> v2:172.21.15.171:3300/0 conn(0x7f448c0b8190 0x7f448c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.517+0000 7f44917ce640 1 --2- 172.21.15.6:0/1993908789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c06d3d0 0x7f448c06d7e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.517+0000 7f44917ce640 1 -- 172.21.15.6:0/1993908789 >> 172.21.15.6:0/1993908789 conn(0x7f448c0d4bd0 msgr2=0x7f448c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.517+0000 7f44917ce640 1 -- 172.21.15.6:0/1993908789 shutdown_connections 2024-05-20T17:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.517+0000 7f44917ce640 1 -- 172.21.15.6:0/1993908789 wait complete. 2024-05-20T17:53:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.519+0000 7f44917ce640 1 Processor -- start 2024-05-20T17:53:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.519+0000 7f44917ce640 1 -- start start 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.520+0000 7f44917ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448c06d3d0 0x7f448c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.520+0000 7f44917ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c0b8190 0x7f448c1f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.520+0000 7f44917ce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448c162820 0x7f448c0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.520+0000 7f44917ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f448c0d0300 con 0x7f448c06d3d0 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.520+0000 7f44917ce640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f448c0d4260 con 0x7f448c162820 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.520+0000 7f44917ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f448c0b4050 con 0x7f448c0b8190 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448c06d3d0 0x7f448c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448c06d3d0 0x7f448c15c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35112/0 (socket says 172.21.15.6:35112) 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 -- 172.21.15.6:0/3019837885 learned_addr learned my addr 172.21.15.6:0/3019837885 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448b7fe640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448c162820 0x7f448c0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448a7fc640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c0b8190 0x7f448c1f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 -- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c0b8190 msgr2=0x7f448c1f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c0b8190 0x7f448c1f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 -- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448c162820 msgr2=0x7f448c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448c162820 0x7f448c0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 -- 172.21.15.6:0/3019837885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c1f54f0 con 0x7f448c06d3d0 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f448affd640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448c06d3d0 0x7f448c15c9c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c460 tx=0x7f447c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f44737fe640 1 -- 172.21.15.6:0/3019837885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c018070 con 0x7f448c06d3d0 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f44737fe640 1 -- 172.21.15.6:0/3019837885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c007500 con 0x7f448c06d3d0 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448c0ca3d0 con 0x7f448c06d3d0 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f44737fe640 1 -- 172.21.15.6:0/3019837885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c004a20 con 0x7f448c06d3d0 2024-05-20T17:53:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.521+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448c1e84d0 con 0x7f448c06d3d0 2024-05-20T17:53:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.522+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448c075b00 con 0x7f448c06d3d0 2024-05-20T17:53:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.523+0000 7f44737fe640 1 -- 172.21.15.6:0/3019837885 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f447c01b070 con 0x7f448c06d3d0 2024-05-20T17:53:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.524+0000 7f44737fe640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f447806be60 0x7f447806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.524+0000 7f44737fe640 1 -- 172.21.15.6:0/3019837885 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f447c08a390 con 0x7f448c06d3d0 2024-05-20T17:53:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.524+0000 7f448a7fc640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f447806be60 0x7f447806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.525+0000 7f448a7fc640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f447806be60 0x7f447806e370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4480034000 tx=0x7f448002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.528+0000 7f44737fe640 1 -- 172.21.15.6:0/3019837885 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f448c06dd20 con 0x7f448c06d3d0 2024-05-20T17:53:54.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.713+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f448c0cb2a0 con 0x7f448c06d3d0 2024-05-20T17:53:54.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.714+0000 7f44737fe640 1 -- 172.21.15.6:0/3019837885 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f447c058340 con 0x7f448c06d3d0 2024-05-20T17:53:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:54.715 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f447806be60 msgr2=0x7f447806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f447806be60 0x7f447806e370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4480034000 tx=0x7f448002e000 comp rx=0 tx=0).stop 2024-05-20T17:53:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448c06d3d0 msgr2=0x7f448c15c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448c06d3d0 0x7f448c15c9c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c460 tx=0x7f447c00c920 comp rx=0 tx=0).stop 2024-05-20T17:53:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 shutdown_connections 2024-05-20T17:53:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f447806be60 0x7f447806e370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f448c162820 0x7f448c0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f448c0b8190 0x7f448c1f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 --2- 172.21.15.6:0/3019837885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448c06d3d0 0x7f448c15c9c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 >> 172.21.15.6:0/3019837885 conn(0x7f448c0d4bd0 msgr2=0x7f448c15e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:54.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 shutdown_connections 2024-05-20T17:53:54.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.716+0000 7f44917ce640 1 -- 172.21.15.6:0/3019837885 wait complete. 2024-05-20T17:53:54.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:54.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.847+0000 7f8d8dd57640 1 Processor -- start 2024-05-20T17:53:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.847+0000 7f8d8dd57640 1 -- start start 2024-05-20T17:53:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.848+0000 7f8d8dd57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d4400 0x7f8d8815f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.848+0000 7f8d8dd57640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8d8806cf00 0x7f8d8806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.848+0000 7f8d8dd57640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d880d2780 0x7f8d880d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.848+0000 7f8d8dd57640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8d880d3f70 con 0x7f8d880d2780 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.848+0000 7f8d8dd57640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8d8808d2a0 con 0x7f8d8806cf00 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.848+0000 7f8d8dd57640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8806d850 con 0x7f8d880d4400 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d87fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d880d2780 0x7f8d880d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d87fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d880d2780 0x7f8d880d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35116/0 (socket says 172.21.15.6:35116) 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d87fff640 1 -- 172.21.15.6:0/837494015 learned_addr learned my addr 172.21.15.6:0/837494015 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d877fe640 1 --2- 172.21.15.6:0/837494015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d4400 0x7f8d8815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d86ffd640 1 --2- 172.21.15.6:0/837494015 >> v2:172.21.15.171:3300/0 conn(0x7f8d8806cf00 0x7f8d8806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d87fff640 1 -- 172.21.15.6:0/837494015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d4400 msgr2=0x7f8d8815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d87fff640 1 --2- 172.21.15.6:0/837494015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d4400 0x7f8d8815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d87fff640 1 -- 172.21.15.6:0/837494015 >> v2:172.21.15.171:3300/0 conn(0x7f8d8806cf00 msgr2=0x7f8d8806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d87fff640 1 --2- 172.21.15.6:0/837494015 >> v2:172.21.15.171:3300/0 conn(0x7f8d8806cf00 0x7f8d8806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d87fff640 1 -- 172.21.15.6:0/837494015 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d880d30d0 con 0x7f8d880d2780 2024-05-20T17:53:54.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.849+0000 7f8d877fe640 1 --2- 172.21.15.6:0/837494015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d4400 0x7f8d8815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.850+0000 7f8d87fff640 1 --2- 172.21.15.6:0/837494015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d2780 0x7f8d880d2b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d880b77a0 tx=0x7f8d8002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53382f464e7019d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.850+0000 7f8d867fc640 1 -- 172.21.15.6:0/837494015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80036070 con 0x7f8d880d2780 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.850+0000 7f8d867fc640 1 -- 172.21.15.6:0/837494015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d80031600 con 0x7f8d880d2780 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.850+0000 7f8d867fc640 1 -- 172.21.15.6:0/837494015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d800319d0 con 0x7f8d880d2780 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 -- 172.21.15.6:0/837494015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d2780 msgr2=0x7f8d880d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/837494015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d2780 0x7f8d880d2b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8d880b77a0 tx=0x7f8d8002a730 comp rx=0 tx=0).stop 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 -- 172.21.15.6:0/837494015 shutdown_connections 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/837494015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d2780 0x7f8d880d2b90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/837494015 >> v2:172.21.15.171:3300/0 conn(0x7f8d8806cf00 0x7f8d8806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/837494015 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d4400 0x7f8d8815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 -- 172.21.15.6:0/837494015 >> 172.21.15.6:0/837494015 conn(0x7f8d880d4bb0 msgr2=0x7f8d880d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 -- 172.21.15.6:0/837494015 shutdown_connections 2024-05-20T17:53:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.851+0000 7f8d8dd57640 1 -- 172.21.15.6:0/837494015 wait complete. 2024-05-20T17:53:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.852+0000 7f8d8dd57640 1 Processor -- start 2024-05-20T17:53:54.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.853+0000 7f8d8dd57640 1 -- start start 2024-05-20T17:53:54.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d8dd57640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d8806cf00 0x7f8d88157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d8dd57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d2780 0x7f8d88155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d8dd57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d4400 0x7f8d880b9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d8dd57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d880d3640 con 0x7f8d880d4400 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d8dd57640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d880d4840 con 0x7f8d8806cf00 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d8dd57640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d880d3920 con 0x7f8d880d2780 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d87fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d4400 0x7f8d880b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d87fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d4400 0x7f8d880b9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35128/0 (socket says 172.21.15.6:35128) 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d87fff640 1 -- 172.21.15.6:0/1661445874 learned_addr learned my addr 172.21.15.6:0/1661445874 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d86ffd640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d2780 0x7f8d88155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d877fe640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d8806cf00 0x7f8d88157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d87fff640 1 -- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d2780 msgr2=0x7f8d88155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d87fff640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d2780 0x7f8d88155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d87fff640 1 -- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d8806cf00 msgr2=0x7f8d88157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d87fff640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d8806cf00 0x7f8d88157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.854+0000 7f8d87fff640 1 -- 172.21.15.6:0/1661445874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d88155a50 con 0x7f8d880d4400 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.855+0000 7f8d87fff640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d4400 0x7f8d880b9310 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009f40 tx=0x7f8d80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.855+0000 7f8d6ffff640 1 -- 172.21.15.6:0/1661445874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80036050 con 0x7f8d880d4400 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.855+0000 7f8d6ffff640 1 -- 172.21.15.6:0/1661445874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d80042070 con 0x7f8d880d4400 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.855+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d881e8d20 con 0x7f8d880d4400 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.855+0000 7f8d6ffff640 1 -- 172.21.15.6:0/1661445874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80009510 con 0x7f8d880d4400 2024-05-20T17:53:54.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.855+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d881e92e0 con 0x7f8d880d4400 2024-05-20T17:53:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.856+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d880735a0 con 0x7f8d880d4400 2024-05-20T17:53:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.857+0000 7f8d6ffff640 1 -- 172.21.15.6:0/1661445874 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d80007bf0 con 0x7f8d880d4400 2024-05-20T17:53:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.857+0000 7f8d6ffff640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d7406be30 0x7f8d7406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.857+0000 7f8d6ffff640 1 -- 172.21.15.6:0/1661445874 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f8d800abef0 con 0x7f8d880d4400 2024-05-20T17:53:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.857+0000 7f8d877fe640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d7406be30 0x7f8d7406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:54.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.858+0000 7f8d877fe640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d7406be30 0x7f8d7406e340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8d78006fd0 tx=0x7f8d78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:54.862+0000 7f8d6ffff640 1 -- 172.21.15.6:0/1661445874 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8d880735a0 con 0x7f8d880d4400 2024-05-20T17:53:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.051+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d8806dc90 con 0x7f8d880d4400 2024-05-20T17:53:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.051+0000 7f8d6ffff640 1 -- 172.21.15.6:0/1661445874 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f8d88155a50 con 0x7f8d880d4400 2024-05-20T17:53:55.051 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d7406be30 msgr2=0x7f8d7406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d7406be30 0x7f8d7406e340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8d78006fd0 tx=0x7f8d78008040 comp rx=0 tx=0).stop 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d4400 msgr2=0x7f8d880b9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d4400 0x7f8d880b9310 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009f40 tx=0x7f8d80004a40 comp rx=0 tx=0).stop 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 shutdown_connections 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d7406be30 0x7f8d7406e340 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d880d4400 0x7f8d880b9310 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d880d2780 0x7f8d88155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 --2- 172.21.15.6:0/1661445874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d8806cf00 0x7f8d88157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 >> 172.21.15.6:0/1661445874 conn(0x7f8d880d4bb0 msgr2=0x7f8d8815bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 shutdown_connections 2024-05-20T17:53:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.053+0000 7f8d8dd57640 1 -- 172.21.15.6:0/1661445874 wait complete. 2024-05-20T17:53:55.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:55.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.188+0000 7f4cc16a2640 1 Processor -- start 2024-05-20T17:53:55.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.188+0000 7f4cc16a2640 1 -- start start 2024-05-20T17:53:55.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.189+0000 7f4cc16a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc162820 0x7f4cbc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.189+0000 7f4cc16a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cbc06dae0 0x7f4cbc0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.189+0000 7f4cc16a2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc0d0630 con 0x7f4cbc0b3e80 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.189+0000 7f4cc16a2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4cbc0d39c0 con 0x7f4cbc06dae0 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.189+0000 7f4cc16a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0d3ca0 con 0x7f4cbc162820 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.189+0000 7f4cbb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cbc06dae0 0x7f4cbc0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.190+0000 7f4cbb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cbc06dae0 0x7f4cbc0b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35130/0 (socket says 172.21.15.6:35130) 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.190+0000 7f4cbb7fe640 1 -- 172.21.15.6:0/2479089689 learned_addr learned my addr 172.21.15.6:0/2479089689 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.190+0000 7f4cbaffd640 1 --2- 172.21.15.6:0/2479089689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc162820 0x7f4cbc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.190+0000 7f4cbb7fe640 1 -- 172.21.15.6:0/2479089689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc162820 msgr2=0x7f4cbc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.190+0000 7f4cbb7fe640 1 --2- 172.21.15.6:0/2479089689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc162820 0x7f4cbc0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.190+0000 7f4cbb7fe640 1 -- 172.21.15.6:0/2479089689 >> v1:172.21.15.171:6789/0 conn(0x7f4cbc0b3e80 legacy=0x7f4cbc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.190+0000 7f4cbb7fe640 1 -- 172.21.15.6:0/2479089689 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc0d3f80 con 0x7f4cbc06dae0 2024-05-20T17:53:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.191+0000 7f4cbb7fe640 1 --2- 172.21.15.6:0/2479089689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc06dae0 0x7f4cbc0b8190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009e50 tx=0x7f4cb402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4f1dd2b5225a2e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.191+0000 7f4cb9ffb640 1 -- 172.21.15.6:0/2479089689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4036070 con 0x7f4cbc06dae0 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.191+0000 7f4cb9ffb640 1 -- 172.21.15.6:0/2479089689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4031600 con 0x7f4cbc06dae0 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.191+0000 7f4cb9ffb640 1 -- 172.21.15.6:0/2479089689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40319d0 con 0x7f4cbc06dae0 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.191+0000 7f4cc16a2640 1 -- 172.21.15.6:0/2479089689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc06dae0 msgr2=0x7f4cbc0b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.191+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/2479089689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc06dae0 0x7f4cbc0b8190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009e50 tx=0x7f4cb402a710 comp rx=0 tx=0).stop 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.192+0000 7f4cc16a2640 1 -- 172.21.15.6:0/2479089689 shutdown_connections 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.192+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/2479089689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc06dae0 0x7f4cbc0b8190 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.192+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/2479089689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc162820 0x7f4cbc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.192+0000 7f4cc16a2640 1 -- 172.21.15.6:0/2479089689 >> 172.21.15.6:0/2479089689 conn(0x7f4cbc0d4bd0 msgr2=0x7f4cbc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.192+0000 7f4cc16a2640 1 -- 172.21.15.6:0/2479089689 shutdown_connections 2024-05-20T17:53:55.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.192+0000 7f4cc16a2640 1 -- 172.21.15.6:0/2479089689 wait complete. 2024-05-20T17:53:55.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.194+0000 7f4cc16a2640 1 Processor -- start 2024-05-20T17:53:55.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.194+0000 7f4cc16a2640 1 -- start start 2024-05-20T17:53:55.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cc16a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc0b3e80 0x7f4cbc0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cc16a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cbc162820 0x7f4cbc0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cc16a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc0c9250 0x7f4cbc155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cc16a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0d4780 con 0x7f4cbc0c9250 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cc16a2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0d0300 con 0x7f4cbc162820 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cc16a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0d4900 con 0x7f4cbc0b3e80 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc0c9250 0x7f4cbc155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc0c9250 0x7f4cbc155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35132/0 (socket says 172.21.15.6:35132) 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbb7fe640 1 -- 172.21.15.6:0/3642173241 learned_addr learned my addr 172.21.15.6:0/3642173241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbaffd640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc0b3e80 0x7f4cbc0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cba7fc640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cbc162820 0x7f4cbc0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbb7fe640 1 -- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc0b3e80 msgr2=0x7f4cbc0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbb7fe640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc0b3e80 0x7f4cbc0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbb7fe640 1 -- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cbc162820 msgr2=0x7f4cbc0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbb7fe640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cbc162820 0x7f4cbc0caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.195+0000 7f4cbb7fe640 1 -- 172.21.15.6:0/3642173241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc15ee30 con 0x7f4cbc0c9250 2024-05-20T17:53:55.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.196+0000 7f4cbb7fe640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc0c9250 0x7f4cbc155790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4034040 tx=0x7f4cb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.196+0000 7f4ca37fe640 1 -- 172.21.15.6:0/3642173241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4036050 con 0x7f4cbc0c9250 2024-05-20T17:53:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.196+0000 7f4ca37fe640 1 -- 172.21.15.6:0/3642173241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4042070 con 0x7f4cbc0c9250 2024-05-20T17:53:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.196+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc15f110 con 0x7f4cbc0c9250 2024-05-20T17:53:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.196+0000 7f4ca37fe640 1 -- 172.21.15.6:0/3642173241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4009510 con 0x7f4cbc0c9250 2024-05-20T17:53:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.196+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc15f6d0 con 0x7f4cbc0c9250 2024-05-20T17:53:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.197+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc15eba0 con 0x7f4cbc0c9250 2024-05-20T17:53:55.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.197+0000 7f4ca37fe640 1 -- 172.21.15.6:0/3642173241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cb4007bd0 con 0x7f4cbc0c9250 2024-05-20T17:53:55.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.198+0000 7f4ca37fe640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca806be60 0x7f4ca806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.198+0000 7f4ca37fe640 1 -- 172.21.15.6:0/3642173241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f4cb40ac040 con 0x7f4cbc0c9250 2024-05-20T17:53:55.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.198+0000 7f4cbaffd640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca806be60 0x7f4ca806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.199+0000 7f4cbaffd640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca806be60 0x7f4ca806e370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0079a0 tx=0x7f4cac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.203+0000 7f4ca37fe640 1 -- 172.21.15.6:0/3642173241 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4cb4079f60 con 0x7f4cbc0c9250 2024-05-20T17:53:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.385+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4cbc0d5510 con 0x7f4cbc0c9250 2024-05-20T17:53:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.386+0000 7f4ca37fe640 1 -- 172.21.15.6:0/3642173241 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f4cbc0d5510 con 0x7f4cbc0c9250 2024-05-20T17:53:55.386 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca806be60 msgr2=0x7f4ca806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca806be60 0x7f4ca806e370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0079a0 tx=0x7f4cac008040 comp rx=0 tx=0).stop 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc0c9250 msgr2=0x7f4cbc155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc0c9250 0x7f4cbc155790 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4034040 tx=0x7f4cb4004a40 comp rx=0 tx=0).stop 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 shutdown_connections 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca806be60 0x7f4ca806e370 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cbc0c9250 0x7f4cbc155790 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cbc162820 0x7f4cbc0caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 --2- 172.21.15.6:0/3642173241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cbc0b3e80 0x7f4cbc0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 >> 172.21.15.6:0/3642173241 conn(0x7f4cbc0d4bd0 msgr2=0x7f4cbc161120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 shutdown_connections 2024-05-20T17:53:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.388+0000 7f4cc16a2640 1 -- 172.21.15.6:0/3642173241 wait complete. 2024-05-20T17:53:55.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.517+0000 7fdfcebe3640 1 Processor -- start 2024-05-20T17:53:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.517+0000 7fdfcebe3640 1 -- start start 2024-05-20T17:53:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcebe3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdfc80cf3d0 0x7fdfc80cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcebe3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfc80ce7e0 0x7fdfc80cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcebe3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc80cfd20 con 0x7fdfc815f220 2024-05-20T17:53:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcebe3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc80cf130 con 0x7fdfc80ce7e0 2024-05-20T17:53:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcebe3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc80cda20 con 0x7fdfc80cf3d0 2024-05-20T17:53:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcd180640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdfc80ce7e0 0x7fdfc80cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcc97f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdfc815f220 0x7fdfc80d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52872/0 (socket says 172.21.15.6:52872) 2024-05-20T17:53:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcc97f640 1 -- 172.21.15.6:0/1057317331 learned_addr learned my addr 172.21.15.6:0/1057317331 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfc7fff640 1 --2- 172.21.15.6:0/1057317331 >> v2:172.21.15.171:3300/0 conn(0x7fdfc80cf3d0 0x7fdfc80cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcd180640 1 -- 172.21.15.6:0/1057317331 >> v2:172.21.15.171:3300/0 conn(0x7fdfc80cf3d0 msgr2=0x7fdfc80cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcd180640 1 --2- 172.21.15.6:0/1057317331 >> v2:172.21.15.171:3300/0 conn(0x7fdfc80cf3d0 0x7fdfc80cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcd180640 1 -- 172.21.15.6:0/1057317331 >> v1:172.21.15.6:6789/0 conn(0x7fdfc815f220 legacy=0x7fdfc80d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfc77fe640 1 -- 172.21.15.6:0/1057317331 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682716835 0 0) 0x7fdfb8001110 con 0x7fdfc815f220 2024-05-20T17:53:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfcd180640 1 -- 172.21.15.6:0/1057317331 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc80cdd00 con 0x7fdfc80ce7e0 2024-05-20T17:53:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.519+0000 7fdfc7fff640 1 --2- 172.21.15.6:0/1057317331 >> v2:172.21.15.171:3300/0 conn(0x7fdfc80cf3d0 0x7fdfc80cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.520+0000 7fdfcd180640 1 --2- 172.21.15.6:0/1057317331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc80ce7e0 0x7fdfc80cebf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8068350 tx=0x7fdfc002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32ec5bcdab7f6af server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.520+0000 7fdfc77fe640 1 -- 172.21.15.6:0/1057317331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0007740 con 0x7fdfc80ce7e0 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.520+0000 7fdfc77fe640 1 -- 172.21.15.6:0/1057317331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc00078e0 con 0x7fdfc80ce7e0 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.520+0000 7fdfc77fe640 1 -- 172.21.15.6:0/1057317331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0007cb0 con 0x7fdfc80ce7e0 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.521+0000 7fdfcebe3640 1 -- 172.21.15.6:0/1057317331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc80ce7e0 msgr2=0x7fdfc80cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.521+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/1057317331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc80ce7e0 0x7fdfc80cebf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8068350 tx=0x7fdfc002a5f0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.521+0000 7fdfcebe3640 1 -- 172.21.15.6:0/1057317331 shutdown_connections 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.521+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/1057317331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc80ce7e0 0x7fdfc80cebf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.521+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/1057317331 >> v2:172.21.15.171:3300/0 conn(0x7fdfc80cf3d0 0x7fdfc80cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.521+0000 7fdfcebe3640 1 -- 172.21.15.6:0/1057317331 >> 172.21.15.6:0/1057317331 conn(0x7fdfc80b44d0 msgr2=0x7fdfc80b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.521+0000 7fdfcebe3640 1 -- 172.21.15.6:0/1057317331 shutdown_connections 2024-05-20T17:53:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.521+0000 7fdfcebe3640 1 -- 172.21.15.6:0/1057317331 wait complete. 2024-05-20T17:53:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.523+0000 7fdfcebe3640 1 Processor -- start 2024-05-20T17:53:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.523+0000 7fdfcebe3640 1 -- start start 2024-05-20T17:53:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcebe3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfc80ce7e0 0x7fdfc80b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcebe3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc80cf3d0 0x7fdfc80c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcebe3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc815f220 0x7fdfc8151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcebe3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80d0fd0 con 0x7fdfc815f220 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcebe3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80ce2c0 con 0x7fdfc80cf3d0 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcebe3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc80cd680 con 0x7fdfc80ce7e0 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcd180640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc815f220 0x7fdfc8151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcd180640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc815f220 0x7fdfc8151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35156/0 (socket says 172.21.15.6:35156) 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.524+0000 7fdfcd180640 1 -- 172.21.15.6:0/2140170126 learned_addr learned my addr 172.21.15.6:0/2140170126 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfc7fff640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc80cf3d0 0x7fdfc80c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcc97f640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfc80ce7e0 0x7fdfc80b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcd180640 1 -- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfc80ce7e0 msgr2=0x7fdfc80b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcd180640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfc80ce7e0 0x7fdfc80b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcd180640 1 -- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc80cf3d0 msgr2=0x7fdfc80c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcd180640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc80cf3d0 0x7fdfc80c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcd180640 1 -- 172.21.15.6:0/2140170126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc80ca050 con 0x7fdfc815f220 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcc97f640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfc80ce7e0 0x7fdfc80b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcd180640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc815f220 0x7fdfc8151d30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009e50 tx=0x7fdfc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfc57fa640 1 -- 172.21.15.6:0/2140170126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0040070 con 0x7fdfc815f220 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfc57fa640 1 -- 172.21.15.6:0/2140170126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc0031bf0 con 0x7fdfc815f220 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc80cc1b0 con 0x7fdfc815f220 2024-05-20T17:53:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfc57fa640 1 -- 172.21.15.6:0/2140170126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0045460 con 0x7fdfc815f220 2024-05-20T17:53:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.525+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc80cc770 con 0x7fdfc815f220 2024-05-20T17:53:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.526+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc806e580 con 0x7fdfc815f220 2024-05-20T17:53:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.527+0000 7fdfc57fa640 1 -- 172.21.15.6:0/2140170126 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfc0039040 con 0x7fdfc815f220 2024-05-20T17:53:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.527+0000 7fdfc57fa640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfb406be60 0x7fdfb406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.527+0000 7fdfc57fa640 1 -- 172.21.15.6:0/2140170126 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fdfc00acc50 con 0x7fdfc815f220 2024-05-20T17:53:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.528+0000 7fdfcc97f640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfb406be60 0x7fdfb406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.528+0000 7fdfcc97f640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfb406be60 0x7fdfb406e370 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8000f60 tx=0x7fdfb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.532+0000 7fdfc57fa640 1 -- 172.21.15.6:0/2140170126 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdfc806e580 con 0x7fdfc815f220 2024-05-20T17:53:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.717+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdfc8075b00 con 0x7fdfc815f220 2024-05-20T17:53:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.718+0000 7fdfc57fa640 1 -- 172.21.15.6:0/2140170126 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fdfc007b090 con 0x7fdfc815f220 2024-05-20T17:53:55.717 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfb406be60 msgr2=0x7fdfb406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfb406be60 0x7fdfb406e370 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8000f60 tx=0x7fdfb8009040 comp rx=0 tx=0).stop 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc815f220 msgr2=0x7fdfc8151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc815f220 0x7fdfc8151d30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009e50 tx=0x7fdfc0004a40 comp rx=0 tx=0).stop 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 shutdown_connections 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdfb406be60 0x7fdfb406e370 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfc815f220 0x7fdfc8151d30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfc80cf3d0 0x7fdfc80c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 --2- 172.21.15.6:0/2140170126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfc80ce7e0 0x7fdfc80b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 >> 172.21.15.6:0/2140170126 conn(0x7fdfc80b44d0 msgr2=0x7fdfc80d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 shutdown_connections 2024-05-20T17:53:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.720+0000 7fdfcebe3640 1 -- 172.21.15.6:0/2140170126 wait complete. 2024-05-20T17:53:55.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:55.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.849+0000 7fa8f779d640 1 Processor -- start 2024-05-20T17:53:55.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.850+0000 7fa8f779d640 1 -- start start 2024-05-20T17:53:55.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.851+0000 7fa8f779d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.851+0000 7fa8f779d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa8f00b3e80 0x7fa8f006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.851+0000 7fa8f779d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f006dd20 con 0x7fa8f006d910 2024-05-20T17:53:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.851+0000 7fa8f779d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f00d0630 con 0x7fa8f00b3e80 2024-05-20T17:53:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.851+0000 7fa8f779d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f00d39c0 con 0x7fa8f0162820 2024-05-20T17:53:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.851+0000 7fa8f4d38640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa8f00b3e80 0x7fa8f006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.851+0000 7fa8f5539640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f4d38640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa8f00b3e80 0x7fa8f006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:52452/0 (socket says 172.21.15.6:52452) 2024-05-20T17:53:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f5539640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:48768/0 (socket says 172.21.15.6:48768) 2024-05-20T17:53:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f4d38640 1 -- 172.21.15.6:0/3290143723 learned_addr learned my addr 172.21.15.6:0/3290143723 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f5d3a640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa8f006d910 0x7fa8f00d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:46270/0 (socket says 172.21.15.6:46270) 2024-05-20T17:53:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f4d38640 1 -- 172.21.15.6:0/3290143723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 msgr2=0x7fa8f00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f4d38640 1 --2- 172.21.15.6:0/3290143723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f4d38640 1 -- 172.21.15.6:0/3290143723 >> v1:172.21.15.171:6789/0 conn(0x7fa8f006d910 legacy=0x7fa8f00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f4d38640 1 -- 172.21.15.6:0/3290143723 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f00d3ca0 con 0x7fa8f00b3e80 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8effff640 1 -- 172.21.15.6:0/3290143723 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187201847 0 0) 0x7fa8e0001490 con 0x7fa8f006d910 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.852+0000 7fa8f5539640 1 --2- 172.21.15.6:0/3290143723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.853+0000 7fa8f4d38640 1 --2- 172.21.15.6:0/3290143723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 0x7fa8f006d3d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009870 tx=0x7fa8e402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db39fe8e0c09b068 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.853+0000 7fa8effff640 1 -- 172.21.15.6:0/3290143723 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4037070 con 0x7fa8f00b3e80 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.853+0000 7fa8effff640 1 -- 172.21.15.6:0/3290143723 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4032440 con 0x7fa8f00b3e80 2024-05-20T17:53:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.853+0000 7fa8effff640 1 -- 172.21.15.6:0/3290143723 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4032810 con 0x7fa8f00b3e80 2024-05-20T17:53:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.854+0000 7fa8f779d640 1 -- 172.21.15.6:0/3290143723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 msgr2=0x7fa8f006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.854+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3290143723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 0x7fa8f006d3d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009870 tx=0x7fa8e402a250 comp rx=0 tx=0).stop 2024-05-20T17:53:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.854+0000 7fa8f779d640 1 -- 172.21.15.6:0/3290143723 shutdown_connections 2024-05-20T17:53:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.854+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3290143723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 0x7fa8f006d3d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.854+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3290143723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.854+0000 7fa8f779d640 1 -- 172.21.15.6:0/3290143723 >> 172.21.15.6:0/3290143723 conn(0x7fa8f00d4bd0 msgr2=0x7fa8f00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.854+0000 7fa8f779d640 1 -- 172.21.15.6:0/3290143723 shutdown_connections 2024-05-20T17:53:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.854+0000 7fa8f779d640 1 -- 172.21.15.6:0/3290143723 wait complete. 2024-05-20T17:53:55.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.856+0000 7fa8f779d640 1 Processor -- start 2024-05-20T17:53:55.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.856+0000 7fa8f779d640 1 -- start start 2024-05-20T17:53:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f779d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f006d910 0x7fa8f014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f779d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 0x7fa8f00cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f779d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f014eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f779d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f00d0300 con 0x7fa8f006d910 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f779d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f00d4260 con 0x7fa8f00b3e80 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f779d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f00b91a0 con 0x7fa8f0162820 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5539640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f006d910 0x7fa8f014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5539640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f006d910 0x7fa8f014e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35160/0 (socket says 172.21.15.6:35160) 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5539640 1 -- 172.21.15.6:0/3904377147 learned_addr learned my addr 172.21.15.6:0/3904377147 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f4d38640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 0x7fa8f00cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5d3a640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f014eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5539640 1 -- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 msgr2=0x7fa8f014eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5539640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f014eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5539640 1 -- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 msgr2=0x7fa8f00cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5539640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 0x7fa8f00cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.857+0000 7fa8f5539640 1 -- 172.21.15.6:0/3904377147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f00ccbb0 con 0x7fa8f006d910 2024-05-20T17:53:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.858+0000 7fa8f5539640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f006d910 0x7fa8f014e070 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800e960 tx=0x7fa8e800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.858+0000 7fa8edffb640 1 -- 172.21.15.6:0/3904377147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8017070 con 0x7fa8f006d910 2024-05-20T17:53:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.858+0000 7fa8edffb640 1 -- 172.21.15.6:0/3904377147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e800ca00 con 0x7fa8f006d910 2024-05-20T17:53:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.858+0000 7fa8edffb640 1 -- 172.21.15.6:0/3904377147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800cdd0 con 0x7fa8f006d910 2024-05-20T17:53:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.858+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f00cce90 con 0x7fa8f006d910 2024-05-20T17:53:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.858+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f00cd450 con 0x7fa8f006d910 2024-05-20T17:53:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.859+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f0162050 con 0x7fa8f006d910 2024-05-20T17:53:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.860+0000 7fa8edffb640 1 -- 172.21.15.6:0/3904377147 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8e801a070 con 0x7fa8f006d910 2024-05-20T17:53:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.860+0000 7fa8edffb640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8dc06be30 0x7fa8dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.860+0000 7fa8edffb640 1 -- 172.21.15.6:0/3904377147 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fa8e808b5b0 con 0x7fa8f006d910 2024-05-20T17:53:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.861+0000 7fa8f4d38640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8dc06be30 0x7fa8dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.861+0000 7fa8f4d38640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8dc06be30 0x7fa8dc06e340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4034000 tx=0x7fa8e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:55.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:55.865+0000 7fa8edffb640 1 -- 172.21.15.6:0/3904377147 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa8f0162050 con 0x7fa8f006d910 2024-05-20T17:53:56.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.049+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa8f0075b00 con 0x7fa8f006d910 2024-05-20T17:53:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.050+0000 7fa8edffb640 1 -- 172.21.15.6:0/3904377147 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fa8e80593c0 con 0x7fa8f006d910 2024-05-20T17:53:56.049 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.051+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8dc06be30 msgr2=0x7fa8dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.051+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8dc06be30 0x7fa8dc06e340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4034000 tx=0x7fa8e402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.051+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f006d910 msgr2=0x7fa8f014e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.051+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f006d910 0x7fa8f014e070 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800e960 tx=0x7fa8e800ee20 comp rx=0 tx=0).stop 2024-05-20T17:53:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.052+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 shutdown_connections 2024-05-20T17:53:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.052+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8dc06be30 0x7fa8dc06e340 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.052+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8f0162820 0x7fa8f014eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.052+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8f00b3e80 0x7fa8f00cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.052+0000 7fa8f779d640 1 --2- 172.21.15.6:0/3904377147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8f006d910 0x7fa8f014e070 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.052+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 >> 172.21.15.6:0/3904377147 conn(0x7fa8f00d4bd0 msgr2=0x7fa8f00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.052+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 shutdown_connections 2024-05-20T17:53:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.052+0000 7fa8f779d640 1 -- 172.21.15.6:0/3904377147 wait complete. 2024-05-20T17:53:56.085 INFO:tasks.cephfs_test_runner:Starting test: test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) Mostly readdir acquires caps faster than the mds recalls, so the cap 2024-05-20T17:53:56.085 INFO:tasks.cephfs_test_runner:test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T17:53:56.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:56.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.201+0000 7f1697f57640 1 Processor -- start 2024-05-20T17:53:56.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.201+0000 7f1697f57640 1 -- start start 2024-05-20T17:53:56.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.202+0000 7f1697f57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 0x7f16900d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.202+0000 7f1697f57640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f16900b4010 0x7f16900cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.202+0000 7f1697f57640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16900d14b0 0x7f16900d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.202+0000 7f1697f57640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f16900d3ca0 con 0x7f16900d14b0 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.202+0000 7f1697f57640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f16900d0370 con 0x7f16900b4010 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.202+0000 7f1697f57640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16900d0650 con 0x7f1690163a10 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.202+0000 7f16964f4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16900d14b0 0x7f16900d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.202+0000 7f16964f4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16900d14b0 0x7f16900d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35174/0 (socket says 172.21.15.6:35174) 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f16964f4640 1 -- 172.21.15.6:0/45844043 learned_addr learned my addr 172.21.15.6:0/45844043 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f1695cf3640 1 --2- 172.21.15.6:0/45844043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 0x7f16900d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f16954f2640 1 --2- 172.21.15.6:0/45844043 >> v2:172.21.15.171:3300/0 conn(0x7f16900b4010 0x7f16900cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f16964f4640 1 -- 172.21.15.6:0/45844043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 msgr2=0x7f16900d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f16964f4640 1 --2- 172.21.15.6:0/45844043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 0x7f16900d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f16964f4640 1 -- 172.21.15.6:0/45844043 >> v2:172.21.15.171:3300/0 conn(0x7f16900b4010 msgr2=0x7f16900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f16964f4640 1 --2- 172.21.15.6:0/45844043 >> v2:172.21.15.171:3300/0 conn(0x7f16900b4010 0x7f16900cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f16964f4640 1 -- 172.21.15.6:0/45844043 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16900d3650 con 0x7f16900d14b0 2024-05-20T17:53:56.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.203+0000 7f16964f4640 1 --2- 172.21.15.6:0/45844043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f16900d18c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f16900b7710 tx=0x7f168802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1de568db09337a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1694cf1640 1 -- 172.21.15.6:0/45844043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688036070 con 0x7f16900d14b0 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1694cf1640 1 -- 172.21.15.6:0/45844043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1688031600 con 0x7f16900d14b0 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1694cf1640 1 -- 172.21.15.6:0/45844043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16880319d0 con 0x7f16900d14b0 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1697f57640 1 -- 172.21.15.6:0/45844043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 msgr2=0x7f16900d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1697f57640 1 --2- 172.21.15.6:0/45844043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f16900d18c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f16900b7710 tx=0x7f168802a6a0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1697f57640 1 -- 172.21.15.6:0/45844043 shutdown_connections 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1697f57640 1 --2- 172.21.15.6:0/45844043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f16900d18c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1697f57640 1 --2- 172.21.15.6:0/45844043 >> v2:172.21.15.171:3300/0 conn(0x7f16900b4010 0x7f16900cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1697f57640 1 --2- 172.21.15.6:0/45844043 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 0x7f16900d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.204+0000 7f1697f57640 1 -- 172.21.15.6:0/45844043 >> 172.21.15.6:0/45844043 conn(0x7f169006d240 msgr2=0x7f169006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.205+0000 7f1697f57640 1 -- 172.21.15.6:0/45844043 shutdown_connections 2024-05-20T17:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.205+0000 7f1697f57640 1 -- 172.21.15.6:0/45844043 wait complete. 2024-05-20T17:53:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.206+0000 7f1697f57640 1 Processor -- start 2024-05-20T17:53:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.206+0000 7f1697f57640 1 -- start start 2024-05-20T17:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f1697f57640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16900b4010 0x7f1690155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f1697f57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f169015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f1697f57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 0x7f169015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f1697f57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f16900d1e00 con 0x7f16900d14b0 2024-05-20T17:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f1697f57640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16900d0040 con 0x7f16900b4010 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f1697f57640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16900b8210 con 0x7f1690163a10 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f169015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f169015a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35176/0 (socket says 172.21.15.6:35176) 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 -- 172.21.15.6:0/270867778 learned_addr learned my addr 172.21.15.6:0/270867778 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16964f4640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 0x7f169015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f1695cf3640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16900b4010 0x7f1690155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 -- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 msgr2=0x7f169015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 0x7f169015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 -- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16900b4010 msgr2=0x7f1690155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16900b4010 0x7f1690155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 -- 172.21.15.6:0/270867778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1690156910 con 0x7f16900d14b0 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16954f2640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f169015a480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f168000d550 tx=0x7f168000da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.208+0000 7f16867fc640 1 -- 172.21.15.6:0/270867778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680018020 con 0x7f16900d14b0 2024-05-20T17:53:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.209+0000 7f16867fc640 1 -- 172.21.15.6:0/270867778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1680014620 con 0x7f16900d14b0 2024-05-20T17:53:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.209+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1690156bf0 con 0x7f16900d14b0 2024-05-20T17:53:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.209+0000 7f16867fc640 1 -- 172.21.15.6:0/270867778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680014a10 con 0x7f16900d14b0 2024-05-20T17:53:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.209+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16901571b0 con 0x7f16900d14b0 2024-05-20T17:53:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.209+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1690075b00 con 0x7f16900d14b0 2024-05-20T17:53:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.210+0000 7f16867fc640 1 -- 172.21.15.6:0/270867778 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f168001b020 con 0x7f16900d14b0 2024-05-20T17:53:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.211+0000 7f16867fc640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f167406be60 0x7f167406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.211+0000 7f16867fc640 1 -- 172.21.15.6:0/270867778 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f168008b6a0 con 0x7f16900d14b0 2024-05-20T17:53:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.211+0000 7f1695cf3640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f167406be60 0x7f167406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.212+0000 7f1695cf3640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f167406be60 0x7f167406e370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f168c006fd0 tx=0x7f168c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.216+0000 7f16867fc640 1 -- 172.21.15.6:0/270867778 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1680022020 con 0x7f16900d14b0 2024-05-20T17:53:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.403+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16900d3050 con 0x7f16900d14b0 2024-05-20T17:53:56.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.404+0000 7f16867fc640 1 -- 172.21.15.6:0/270867778 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f1680059b90 con 0x7f16900d14b0 2024-05-20T17:53:56.404 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:56.404 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f167406be60 msgr2=0x7f167406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f167406be60 0x7f167406e370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f168c006fd0 tx=0x7f168c008040 comp rx=0 tx=0).stop 2024-05-20T17:53:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 msgr2=0x7f169015a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f169015a480 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f168000d550 tx=0x7f168000da10 comp rx=0 tx=0).stop 2024-05-20T17:53:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 shutdown_connections 2024-05-20T17:53:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f167406be60 0x7f167406e370 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1690163a10 0x7f169015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16900d14b0 0x7f169015a480 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 --2- 172.21.15.6:0/270867778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16900b4010 0x7f1690155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 >> 172.21.15.6:0/270867778 conn(0x7f169006d240 msgr2=0x7f169015dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 shutdown_connections 2024-05-20T17:53:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.407+0000 7f1697f57640 1 -- 172.21.15.6:0/270867778 wait complete. 2024-05-20T17:53:56.418 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:56.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:56.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.536+0000 7faa76336640 1 Processor -- start 2024-05-20T17:53:56.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.536+0000 7faa76336640 1 -- start start 2024-05-20T17:53:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa76336640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faa7006d3d0 0x7faa7006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa76336640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa7006dd20 con 0x7faa700b8190 2024-05-20T17:53:56.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa76336640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa700d0630 con 0x7faa70162820 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa76336640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7faa700d39c0 con 0x7faa7006d3d0 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa748d3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faa700b8190 0x7faa700b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52874/0 (socket says 172.21.15.6:52874) 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa748d3640 1 -- 172.21.15.6:0/1300166020 learned_addr learned my addr 172.21.15.6:0/1300166020 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189836138 0 0) 0x7faa68001490 con 0x7faa700b8190 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6f7fe640 1 --2- 172.21.15.6:0/1300166020 >> v2:172.21.15.171:3300/0 conn(0x7faa7006d3d0 0x7faa7006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa58003520 con 0x7faa700b8190 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 951524781 0 0) 0x7faa58003520 con 0x7faa700b8190 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 >> v2:172.21.15.171:3300/0 conn(0x7faa7006d3d0 msgr2=0x7faa7006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6effd640 1 --2- 172.21.15.6:0/1300166020 >> v2:172.21.15.171:3300/0 conn(0x7faa7006d3d0 0x7faa7006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 >> v1:172.21.15.171:6789/0 conn(0x7faa70162820 legacy=0x7faa700b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa700d3ca0 con 0x7faa700b8190 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.538+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7faa68001bc0 con 0x7faa700b8190 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 >> v1:172.21.15.6:6789/0 conn(0x7faa700b8190 legacy=0x7faa700b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6effd640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa580039b0 0x7faa58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6effd640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa58004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6effd640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa580051c0 0x7faa5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa700d39c0 con 0x7faa58004800 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa5800c160 con 0x7faa580051c0 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa5800c360 con 0x7faa580039b0 2024-05-20T17:53:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6f7fe640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa58004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6ffff640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa580039b0 0x7faa58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa748d3640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa580051c0 0x7faa5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6f7fe640 1 -- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa580039b0 msgr2=0x7faa58003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6f7fe640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa580039b0 0x7faa58003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6f7fe640 1 -- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa580051c0 msgr2=0x7faa5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6f7fe640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa580051c0 0x7faa5800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6f7fe640 1 -- 172.21.15.6:0/1300166020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa58003520 con 0x7faa58004800 2024-05-20T17:53:56.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa748d3640 1 -- 172.21.15.6:0/1300166020 reap_dead start 2024-05-20T17:53:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.539+0000 7faa6ffff640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa580039b0 0x7faa58003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.540+0000 7faa6f7fe640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa58004c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faa64009ac0 tx=0x7faa58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798b24c4d60b34dd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.540+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64036070 con 0x7faa58004800 2024-05-20T17:53:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.540+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa64031400 con 0x7faa58004800 2024-05-20T17:53:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.540+0000 7faa6effd640 1 -- 172.21.15.6:0/1300166020 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64009690 con 0x7faa58004800 2024-05-20T17:53:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.541+0000 7faa76336640 1 -- 172.21.15.6:0/1300166020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 msgr2=0x7faa58004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.541+0000 7faa76336640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa58004c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faa64009ac0 tx=0x7faa58005830 comp rx=0 tx=0).stop 2024-05-20T17:53:56.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.541+0000 7faa76336640 1 -- 172.21.15.6:0/1300166020 shutdown_connections 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.541+0000 7faa76336640 1 --2- 172.21.15.6:0/1300166020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa58004c10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.541+0000 7faa76336640 1 -- 172.21.15.6:0/1300166020 >> 172.21.15.6:0/1300166020 conn(0x7faa700d4bd0 msgr2=0x7faa700d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.541+0000 7faa76336640 1 -- 172.21.15.6:0/1300166020 shutdown_connections 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.541+0000 7faa76336640 1 -- 172.21.15.6:0/1300166020 wait complete. 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.542+0000 7faa76336640 1 Processor -- start 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.543+0000 7faa76336640 1 -- start start 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa76336640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa700c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa76336640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa700c8ed0 0x7faa70158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa76336640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa700c9890 0x7faa70158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa76336640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa700d0300 con 0x7faa58004800 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa76336640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa700d4260 con 0x7faa700c8ed0 2024-05-20T17:53:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa76336640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa700d4780 con 0x7faa700c9890 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa700c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa700c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35192/0 (socket says 172.21.15.6:35192) 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6ffff640 1 -- 172.21.15.6:0/3636825179 learned_addr learned my addr 172.21.15.6:0/3636825179 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa748d3640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa700c9890 0x7faa70158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6f7fe640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa700c8ed0 0x7faa70158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6ffff640 1 -- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa700c9890 msgr2=0x7faa70158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6ffff640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa700c9890 0x7faa70158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6ffff640 1 -- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa700c8ed0 msgr2=0x7faa70158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6ffff640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa700c8ed0 0x7faa70158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.544+0000 7faa6ffff640 1 -- 172.21.15.6:0/3636825179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7015a610 con 0x7faa58004800 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.545+0000 7faa6ffff640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa700c9350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faa6000e480 tx=0x7faa6000e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.545+0000 7faa6cff9640 1 -- 172.21.15.6:0/3636825179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60019070 con 0x7faa58004800 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.545+0000 7faa6cff9640 1 -- 172.21.15.6:0/3636825179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa600052e0 con 0x7faa58004800 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.545+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa70159850 con 0x7faa58004800 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.545+0000 7faa6cff9640 1 -- 172.21.15.6:0/3636825179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60003830 con 0x7faa58004800 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.545+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa70159e10 con 0x7faa58004800 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.546+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa70075b00 con 0x7faa58004800 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.546+0000 7faa6cff9640 1 -- 172.21.15.6:0/3636825179 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa6001c070 con 0x7faa58004800 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.547+0000 7faa6cff9640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa5c06be30 0x7faa5c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.547+0000 7faa6cff9640 1 -- 172.21.15.6:0/3636825179 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7faa6008a770 con 0x7faa58004800 2024-05-20T17:53:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.547+0000 7faa6f7fe640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa5c06be30 0x7faa5c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.548+0000 7faa6f7fe640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa5c06be30 0x7faa5c06e340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa64033000 tx=0x7faa64008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.552+0000 7faa6cff9640 1 -- 172.21.15.6:0/3636825179 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faa60058690 con 0x7faa58004800 2024-05-20T17:53:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.734+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa7015ebd0 con 0x7faa58004800 2024-05-20T17:53:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.735+0000 7faa6cff9640 1 -- 172.21.15.6:0/3636825179 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7faa6005c990 con 0x7faa58004800 2024-05-20T17:53:56.734 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:53:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa5c06be30 msgr2=0x7faa5c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa5c06be30 0x7faa5c06e340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa64033000 tx=0x7faa64008030 comp rx=0 tx=0).stop 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 msgr2=0x7faa700c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa700c9350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faa6000e480 tx=0x7faa6000e880 comp rx=0 tx=0).stop 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 shutdown_connections 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa5c06be30 0x7faa5c06e340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa700c9890 0x7faa70158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa700c8ed0 0x7faa70158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 --2- 172.21.15.6:0/3636825179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa58004800 0x7faa700c9350 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 >> 172.21.15.6:0/3636825179 conn(0x7faa700d4bd0 msgr2=0x7faa700b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 shutdown_connections 2024-05-20T17:53:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.737+0000 7faa76336640 1 -- 172.21.15.6:0/3636825179 wait complete. 2024-05-20T17:53:56.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:53:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.866+0000 7f3d225bc640 1 Processor -- start 2024-05-20T17:53:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.866+0000 7f3d225bc640 1 -- start start 2024-05-20T17:53:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.867+0000 7f3d225bc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d1c06d3d0 0x7f3d1c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.867+0000 7f3d225bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c0b8190 0x7f3d1c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.867+0000 7f3d225bc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1c06dd20 con 0x7f3d1c162820 2024-05-20T17:53:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.867+0000 7f3d225bc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3d1c0d0630 con 0x7f3d1c06d3d0 2024-05-20T17:53:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d225bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1c0d39c0 con 0x7f3d1c0b8190 2024-05-20T17:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d1b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d1c06d3d0 0x7f3d1c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d1b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d1c06d3d0 0x7f3d1c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35198/0 (socket says 172.21.15.6:35198) 2024-05-20T17:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d1b7fe640 1 -- 172.21.15.6:0/4142603969 learned_addr learned my addr 172.21.15.6:0/4142603969 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d20b59640 1 --2- 172.21.15.6:0/4142603969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c0b8190 0x7f3d1c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d1b7fe640 1 -- 172.21.15.6:0/4142603969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c0b8190 msgr2=0x7f3d1c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d1b7fe640 1 --2- 172.21.15.6:0/4142603969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c0b8190 0x7f3d1c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d1b7fe640 1 -- 172.21.15.6:0/4142603969 >> v1:172.21.15.171:6789/0 conn(0x7f3d1c162820 legacy=0x7f3d1c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.868+0000 7f3d1b7fe640 1 -- 172.21.15.6:0/4142603969 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c0d3ca0 con 0x7f3d1c06d3d0 2024-05-20T17:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.869+0000 7f3d1b7fe640 1 --2- 172.21.15.6:0/4142603969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c06d3d0 0x7f3d1c06d7e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009870 tx=0x7f3d1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c7e1c95c520ee7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.869+0000 7f3d1affd640 1 -- 172.21.15.6:0/4142603969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10037070 con 0x7f3d1c06d3d0 2024-05-20T17:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.869+0000 7f3d1affd640 1 -- 172.21.15.6:0/4142603969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10032440 con 0x7f3d1c06d3d0 2024-05-20T17:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.869+0000 7f3d1affd640 1 -- 172.21.15.6:0/4142603969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10032810 con 0x7f3d1c06d3d0 2024-05-20T17:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.870+0000 7f3d225bc640 1 -- 172.21.15.6:0/4142603969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c06d3d0 msgr2=0x7f3d1c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.870+0000 7f3d225bc640 1 --2- 172.21.15.6:0/4142603969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c06d3d0 0x7f3d1c06d7e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009870 tx=0x7f3d1002a270 comp rx=0 tx=0).stop 2024-05-20T17:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.870+0000 7f3d225bc640 1 -- 172.21.15.6:0/4142603969 shutdown_connections 2024-05-20T17:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.870+0000 7f3d225bc640 1 --2- 172.21.15.6:0/4142603969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c0b8190 0x7f3d1c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.870+0000 7f3d225bc640 1 --2- 172.21.15.6:0/4142603969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c06d3d0 0x7f3d1c06d7e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.870+0000 7f3d225bc640 1 -- 172.21.15.6:0/4142603969 >> 172.21.15.6:0/4142603969 conn(0x7f3d1c0d4bd0 msgr2=0x7f3d1c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.870+0000 7f3d225bc640 1 -- 172.21.15.6:0/4142603969 shutdown_connections 2024-05-20T17:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.870+0000 7f3d225bc640 1 -- 172.21.15.6:0/4142603969 wait complete. 2024-05-20T17:53:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.872+0000 7f3d225bc640 1 Processor -- start 2024-05-20T17:53:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.872+0000 7f3d225bc640 1 -- start start 2024-05-20T17:53:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d225bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d1c06d3d0 0x7f3d1c1f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d225bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c0b8190 0x7f3d1c1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d225bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c162820 0x7f3d1c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d225bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c0d0300 con 0x7f3d1c0b8190 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d225bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c0d4260 con 0x7f3d1c06d3d0 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d225bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1c0b4050 con 0x7f3d1c162820 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d1b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c0b8190 0x7f3d1c1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d1b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c0b8190 0x7f3d1c1583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35206/0 (socket says 172.21.15.6:35206) 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d1b7fe640 1 -- 172.21.15.6:0/1359321257 learned_addr learned my addr 172.21.15.6:0/1359321257 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d20b59640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c162820 0x7f3d1c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.873+0000 7f3d1bfff640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d1c06d3d0 0x7f3d1c1f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d1b7fe640 1 -- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c162820 msgr2=0x7f3d1c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d1b7fe640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c162820 0x7f3d1c15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d1b7fe640 1 -- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d1c06d3d0 msgr2=0x7f3d1c1f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d1b7fe640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d1c06d3d0 0x7f3d1c1f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d1b7fe640 1 -- 172.21.15.6:0/1359321257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c0cb670 con 0x7f3d1c0b8190 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d1bfff640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d1c06d3d0 0x7f3d1c1f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d1b7fe640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c0b8190 0x7f3d1c1583a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3d1002a2b0 tx=0x7f3d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d18ff9640 1 -- 172.21.15.6:0/1359321257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10037040 con 0x7f3d1c0b8190 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1c158b80 con 0x7f3d1c0b8190 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d18ff9640 1 -- 172.21.15.6:0/1359321257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10042070 con 0x7f3d1c0b8190 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d18ff9640 1 -- 172.21.15.6:0/1359321257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10030880 con 0x7f3d1c0b8190 2024-05-20T17:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.874+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1c159390 con 0x7f3d1c0b8190 2024-05-20T17:53:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.875+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d1c158e20 con 0x7f3d1c0b8190 2024-05-20T17:53:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.876+0000 7f3d18ff9640 1 -- 172.21.15.6:0/1359321257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d10030a20 con 0x7f3d1c0b8190 2024-05-20T17:53:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.876+0000 7f3d18ff9640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0806be30 0x7f3d0806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.876+0000 7f3d18ff9640 1 -- 172.21.15.6:0/1359321257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f3d100abad0 con 0x7f3d1c0b8190 2024-05-20T17:53:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.877+0000 7f3d1bfff640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0806be30 0x7f3d0806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.877+0000 7f3d1bfff640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0806be30 0x7f3d0806e340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c001660 tx=0x7f3d0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:56.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:56.881+0000 7f3d18ff9640 1 -- 172.21.15.6:0/1359321257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3d1c0cb670 con 0x7f3d1c0b8190 2024-05-20T17:53:57.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.064+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3d1c159d90 con 0x7f3d1c0b8190 2024-05-20T17:53:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.065+0000 7f3d18ff9640 1 -- 172.21.15.6:0/1359321257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f3d10079fb0 con 0x7f3d1c0b8190 2024-05-20T17:53:57.064 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0806be30 msgr2=0x7f3d0806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0806be30 0x7f3d0806e340 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c001660 tx=0x7f3d0c009040 comp rx=0 tx=0).stop 2024-05-20T17:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c0b8190 msgr2=0x7f3d1c1583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c0b8190 0x7f3d1c1583a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3d1002a2b0 tx=0x7f3d100046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 shutdown_connections 2024-05-20T17:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0806be30 0x7f3d0806e340 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d1c162820 0x7f3d1c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d1c0b8190 0x7f3d1c1583a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.066+0000 7f3d225bc640 1 --2- 172.21.15.6:0/1359321257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d1c06d3d0 0x7f3d1c1f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.067+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 >> 172.21.15.6:0/1359321257 conn(0x7f3d1c0d4bd0 msgr2=0x7f3d1c0b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.067+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 shutdown_connections 2024-05-20T17:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.067+0000 7f3d225bc640 1 -- 172.21.15.6:0/1359321257 wait complete. 2024-05-20T17:53:57.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:53:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.195+0000 7fa5a9d2f640 1 Processor -- start 2024-05-20T17:53:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.195+0000 7fa5a9d2f640 1 -- start start 2024-05-20T17:53:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.196+0000 7fa5a9d2f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a4162820 0x7fa5a40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a9d2f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a40d0630 con 0x7fa5a406dae0 2024-05-20T17:53:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a9d2f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a40d39c0 con 0x7fa5a40b3e80 2024-05-20T17:53:57.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a9d2f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a40d3ca0 con 0x7fa5a4162820 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa5a406dae0 0x7fa5a40b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52886/0 (socket says 172.21.15.6:52886) 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a3fff640 1 -- 172.21.15.6:0/2126105936 learned_addr learned my addr 172.21.15.6:0/2126105936 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054027506 0 0) 0x7fa5a40d0630 con 0x7fa5a406dae0 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa58c003520 con 0x7fa5a406dae0 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a4162820 0x7fa5a40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2315568518 0 0) 0x7fa58c003520 con 0x7fa5a406dae0 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a4162820 msgr2=0x7fa5a40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a4162820 0x7fa5a40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 >> v1:172.21.15.171:6789/0 conn(0x7fa5a40b3e80 legacy=0x7fa5a406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a40d3f80 con 0x7fa5a406dae0 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fa59c0019f0 con 0x7fa5a406dae0 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 >> v1:172.21.15.6:6789/0 conn(0x7fa5a406dae0 legacy=0x7fa5a40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa58c0039e0 0x7fa58c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c004800 0x7fa58c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c005270 0x7fa58c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a40d3ca0 con 0x7fa58c0039e0 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c00c160 con 0x7fa58c005270 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c00c360 con 0x7fa58c004800 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.197+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5a4162820 0x7fa5a40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a3fff640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c005270 0x7fa58c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a2ffd640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c004800 0x7fa58c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa58c0039e0 0x7fa58c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a37fe640 1 -- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c004800 msgr2=0x7fa58c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c004800 0x7fa58c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a37fe640 1 -- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c005270 msgr2=0x7fa58c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c005270 0x7fa58c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a37fe640 1 -- 172.21.15.6:0/2126105936 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c003520 con 0x7fa58c0039e0 2024-05-20T17:53:57.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.198+0000 7fa5a3fff640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c005270 0x7fa58c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:53:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.199+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa58c0039e0 0x7fa58c003e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa594006fd0 tx=0x7fa58c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bf9ab8f5932247 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.199+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594037070 con 0x7fa58c0039e0 2024-05-20T17:53:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.199+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59402aae0 con 0x7fa58c0039e0 2024-05-20T17:53:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.199+0000 7fa5a27fc640 1 -- 172.21.15.6:0/2126105936 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59400f040 con 0x7fa58c0039e0 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.200+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/2126105936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa58c0039e0 msgr2=0x7fa58c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.200+0000 7fa5a9d2f640 1 --2- 172.21.15.6:0/2126105936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa58c0039e0 0x7fa58c003e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa594006fd0 tx=0x7fa58c005830 comp rx=0 tx=0).stop 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.200+0000 7fa5a3fff640 1 -- 172.21.15.6:0/2126105936 reap_dead start 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.200+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/2126105936 shutdown_connections 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.200+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/2126105936 >> 172.21.15.6:0/2126105936 conn(0x7fa5a40d4bd0 msgr2=0x7fa5a40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.200+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/2126105936 shutdown_connections 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.200+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/2126105936 wait complete. 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.202+0000 7fa5a9d2f640 1 Processor -- start 2024-05-20T17:53:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.202+0000 7fa5a9d2f640 1 -- start start 2024-05-20T17:53:57.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a9d2f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c0039e0 0x7fa5a40cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a9d2f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a40b6ba0 0x7fa5a40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a9d2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a4146b10 0x7fa5a4146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a9d2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a40d4780 con 0x7fa5a4146b10 2024-05-20T17:53:57.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a9d2f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a40d0300 con 0x7fa5a40b6ba0 2024-05-20T17:53:57.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a9d2f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a40d4900 con 0x7fa58c0039e0 2024-05-20T17:53:57.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a4146b10 0x7fa5a4146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a4146b10 0x7fa5a4146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35226/0 (socket says 172.21.15.6:35226) 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a3fff640 1 -- 172.21.15.6:0/506805012 learned_addr learned my addr 172.21.15.6:0/506805012 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c0039e0 0x7fa5a40cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a2ffd640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a40b6ba0 0x7fa5a40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a3fff640 1 -- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c0039e0 msgr2=0x7fa5a40cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a3fff640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c0039e0 0x7fa5a40cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a3fff640 1 -- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a40b6ba0 msgr2=0x7fa5a40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a3fff640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a40b6ba0 0x7fa5a40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a3fff640 1 -- 172.21.15.6:0/506805012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a40cb080 con 0x7fa5a4146b10 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.203+0000 7fa5a2ffd640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a40b6ba0 0x7fa5a40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.204+0000 7fa5a3fff640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a4146b10 0x7fa5a4146f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40cf670 tx=0x7fa59c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.204+0000 7fa58bfff640 1 -- 172.21.15.6:0/506805012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00a460 con 0x7fa5a4146b10 2024-05-20T17:53:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.204+0000 7fa58bfff640 1 -- 172.21.15.6:0/506805012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59c019070 con 0x7fa5a4146b10 2024-05-20T17:53:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.204+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a4147460 con 0x7fa5a4146b10 2024-05-20T17:53:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.204+0000 7fa58bfff640 1 -- 172.21.15.6:0/506805012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0133f0 con 0x7fa5a4146b10 2024-05-20T17:53:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.204+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a40c9d80 con 0x7fa5a4146b10 2024-05-20T17:53:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.205+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a4075b00 con 0x7fa5a4146b10 2024-05-20T17:53:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.206+0000 7fa58bfff640 1 -- 172.21.15.6:0/506805012 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa59c013590 con 0x7fa5a4146b10 2024-05-20T17:53:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.206+0000 7fa58bfff640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa59006be30 0x7fa59006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.206+0000 7fa58bfff640 1 -- 172.21.15.6:0/506805012 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fa59c08b6a0 con 0x7fa5a4146b10 2024-05-20T17:53:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.206+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa59006be30 0x7fa59006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.207+0000 7fa5a37fe640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa59006be30 0x7fa59006e340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa594034000 tx=0x7fa59402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.211+0000 7fa58bfff640 1 -- 172.21.15.6:0/506805012 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa59c059c10 con 0x7fa5a4146b10 2024-05-20T17:53:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.391+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa5a41e89c0 con 0x7fa5a4146b10 2024-05-20T17:53:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.392+0000 7fa58bfff640 1 -- 172.21.15.6:0/506805012 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fa59c059510 con 0x7fa5a4146b10 2024-05-20T17:53:57.391 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:53:57.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa59006be30 msgr2=0x7fa59006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa59006be30 0x7fa59006e340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa594034000 tx=0x7fa59402e000 comp rx=0 tx=0).stop 2024-05-20T17:53:57.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a4146b10 msgr2=0x7fa5a4146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a4146b10 0x7fa5a4146f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40cf670 tx=0x7fa59c007430 comp rx=0 tx=0).stop 2024-05-20T17:53:57.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 shutdown_connections 2024-05-20T17:53:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa59006be30 0x7fa59006e340 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5a4146b10 0x7fa5a4146f20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5a40b6ba0 0x7fa5a40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 --2- 172.21.15.6:0/506805012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c0039e0 0x7fa5a40cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 >> 172.21.15.6:0/506805012 conn(0x7fa5a40d4bd0 msgr2=0x7fa5a40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 shutdown_connections 2024-05-20T17:53:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.394+0000 7fa5a9d2f640 1 -- 172.21.15.6:0/506805012 wait complete. 2024-05-20T17:53:57.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:53:57.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.523+0000 7faf05856640 1 Processor -- start 2024-05-20T17:53:57.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.523+0000 7faf05856640 1 -- start start 2024-05-20T17:53:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faf05856640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faf000cf250 0x7faf0015f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faf05856640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf000b6680 0x7faf000b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faf05856640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf000b6fd0 con 0x7faf00163020 2024-05-20T17:53:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faf05856640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7faf0015f9a0 con 0x7faf000b6680 2024-05-20T17:53:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faf05856640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7faf000d0b10 con 0x7faf000cf250 2024-05-20T17:53:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faefe7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf000b6680 0x7faf000b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faefe7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf000b6680 0x7faf000b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35232/0 (socket says 172.21.15.6:35232) 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faefe7fc640 1 -- 172.21.15.6:0/2641386471 learned_addr learned my addr 172.21.15.6:0/2641386471 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.524+0000 7faefeffd640 1 --2- 172.21.15.6:0/2641386471 >> v2:172.21.15.171:3300/0 conn(0x7faf000cf250 0x7faf0015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.525+0000 7faefe7fc640 1 -- 172.21.15.6:0/2641386471 >> v2:172.21.15.171:3300/0 conn(0x7faf000cf250 msgr2=0x7faf0015f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.525+0000 7faefe7fc640 1 --2- 172.21.15.6:0/2641386471 >> v2:172.21.15.171:3300/0 conn(0x7faf000cf250 0x7faf0015f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.525+0000 7faefe7fc640 1 -- 172.21.15.6:0/2641386471 >> v1:172.21.15.171:6789/0 conn(0x7faf00163020 legacy=0x7faf00163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.525+0000 7faefe7fc640 1 -- 172.21.15.6:0/2641386471 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf000d0550 con 0x7faf000b6680 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.525+0000 7faefeffd640 1 --2- 172.21.15.6:0/2641386471 >> v2:172.21.15.171:3300/0 conn(0x7faf000cf250 0x7faf0015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.525+0000 7faefe7fc640 1 --2- 172.21.15.6:0/2641386471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000b6680 0x7faf000b6a90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faf0008c360 tx=0x7faeec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b4fd23f9dbe57b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.525+0000 7faefdffb640 1 -- 172.21.15.6:0/2641386471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec037070 con 0x7faf000b6680 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.525+0000 7faefdffb640 1 -- 172.21.15.6:0/2641386471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec032440 con 0x7faf000b6680 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faefdffb640 1 -- 172.21.15.6:0/2641386471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec032810 con 0x7faf000b6680 2024-05-20T17:53:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faf05856640 1 -- 172.21.15.6:0/2641386471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000b6680 msgr2=0x7faf000b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faf05856640 1 --2- 172.21.15.6:0/2641386471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000b6680 0x7faf000b6a90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faf0008c360 tx=0x7faeec02a270 comp rx=0 tx=0).stop 2024-05-20T17:53:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faf05856640 1 -- 172.21.15.6:0/2641386471 shutdown_connections 2024-05-20T17:53:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faf05856640 1 --2- 172.21.15.6:0/2641386471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000b6680 0x7faf000b6a90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faf05856640 1 --2- 172.21.15.6:0/2641386471 >> v2:172.21.15.171:3300/0 conn(0x7faf000cf250 0x7faf0015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faf05856640 1 -- 172.21.15.6:0/2641386471 >> 172.21.15.6:0/2641386471 conn(0x7faf000d1860 msgr2=0x7faf000d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faf05856640 1 -- 172.21.15.6:0/2641386471 shutdown_connections 2024-05-20T17:53:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.526+0000 7faf05856640 1 -- 172.21.15.6:0/2641386471 wait complete. 2024-05-20T17:53:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.528+0000 7faf05856640 1 Processor -- start 2024-05-20T17:53:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.528+0000 7faf05856640 1 -- start start 2024-05-20T17:53:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.529+0000 7faf05856640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf000b6680 0x7faf000c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.529+0000 7faf05856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000cf250 0x7faf001f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.529+0000 7faf05856640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf00163020 0x7faf0014d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faf05856640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faf000d2a20 con 0x7faf000cf250 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faf05856640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faf000d27d0 con 0x7faf00163020 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faf05856640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf000d2d00 con 0x7faf000b6680 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000cf250 0x7faf001f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000cf250 0x7faf001f5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35240/0 (socket says 172.21.15.6:35240) 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 -- 172.21.15.6:0/4188336456 learned_addr learned my addr 172.21.15.6:0/4188336456 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefeffd640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf000b6680 0x7faf000c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faeff7fe640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf00163020 0x7faf0014d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 -- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf000b6680 msgr2=0x7faf000c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf000b6680 0x7faf000c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 -- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf00163020 msgr2=0x7faf0014d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf00163020 0x7faf0014d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 -- 172.21.15.6:0/4188336456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0014c1e0 con 0x7faf000cf250 2024-05-20T17:53:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefeffd640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf000b6680 0x7faf000c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faefe7fc640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000cf250 0x7faf001f5280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faeec000c00 tx=0x7faeec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faef7fff640 1 -- 172.21.15.6:0/4188336456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec041020 con 0x7faf000cf250 2024-05-20T17:53:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faef7fff640 1 -- 172.21.15.6:0/4188336456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec0306c0 con 0x7faf000cf250 2024-05-20T17:53:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0014c480 con 0x7faf000cf250 2024-05-20T17:53:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.530+0000 7faef7fff640 1 -- 172.21.15.6:0/4188336456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec037040 con 0x7faf000cf250 2024-05-20T17:53:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.531+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0014ca40 con 0x7faf000cf250 2024-05-20T17:53:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.531+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf00075b00 con 0x7faf000cf250 2024-05-20T17:53:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.532+0000 7faef7fff640 1 -- 172.21.15.6:0/4188336456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faeec044020 con 0x7faf000cf250 2024-05-20T17:53:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.533+0000 7faef7fff640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faee806be30 0x7faee806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.533+0000 7faef7fff640 1 -- 172.21.15.6:0/4188336456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7faeec0abb30 con 0x7faf000cf250 2024-05-20T17:53:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.533+0000 7faefeffd640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faee806be30 0x7faee806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.533+0000 7faefeffd640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faee806be30 0x7faee806e340 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faef0006fd0 tx=0x7faef0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.537+0000 7faef7fff640 1 -- 172.21.15.6:0/4188336456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faeec04b030 con 0x7faf000cf250 2024-05-20T17:53:57.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.720+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7faf000b7440 con 0x7faf000cf250 2024-05-20T17:53:57.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.720+0000 7faef7fff640 1 -- 172.21.15.6:0/4188336456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7faf0014c1e0 con 0x7faf000cf250 2024-05-20T17:53:57.720 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faee806be30 msgr2=0x7faee806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faee806be30 0x7faee806e340 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faef0006fd0 tx=0x7faef0008040 comp rx=0 tx=0).stop 2024-05-20T17:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000cf250 msgr2=0x7faf001f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000cf250 0x7faf001f5280 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faeec000c00 tx=0x7faeec0046c0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 shutdown_connections 2024-05-20T17:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faee806be30 0x7faee806e340 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf00163020 0x7faf0014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf000cf250 0x7faf001f5280 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.722+0000 7faf05856640 1 --2- 172.21.15.6:0/4188336456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf000b6680 0x7faf000c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.723+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 >> 172.21.15.6:0/4188336456 conn(0x7faf000d1860 msgr2=0x7faf000678a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.723+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 shutdown_connections 2024-05-20T17:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.723+0000 7faf05856640 1 -- 172.21.15.6:0/4188336456 wait complete. 2024-05-20T17:53:57.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2024-05-20T17:53:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.849+0000 7f33a356b640 1 Processor -- start 2024-05-20T17:53:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.850+0000 7f33a356b640 1 -- start start 2024-05-20T17:53:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a356b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c162820 0x7f339c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a356b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f339c06dae0 0x7f339c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a356b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f339c0d0630 con 0x7f339c0b3e80 2024-05-20T17:53:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a356b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f339c0d39c0 con 0x7f339c06dae0 2024-05-20T17:53:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a356b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f339c0d3ca0 con 0x7f339c162820 2024-05-20T17:53:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a1b08640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f339c06dae0 0x7f339c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a0b06640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f339c0b3e80 0x7f339c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36798/0 (socket says 172.21.15.6:36798) 2024-05-20T17:53:57.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a0b06640 1 -- 172.21.15.6:0/2889617788 learned_addr learned my addr 172.21.15.6:0/2889617788 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:57.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a1307640 1 --2- 172.21.15.6:0/2889617788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c162820 0x7f339c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a1b08640 1 -- 172.21.15.6:0/2889617788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c162820 msgr2=0x7f339c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:57.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a1b08640 1 --2- 172.21.15.6:0/2889617788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c162820 0x7f339c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a1b08640 1 -- 172.21.15.6:0/2889617788 >> v1:172.21.15.6:6789/0 conn(0x7f339c0b3e80 legacy=0x7f339c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f338ffff640 1 -- 172.21.15.6:0/2889617788 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082401058 0 0) 0x7f339c0d0630 con 0x7f339c0b3e80 2024-05-20T17:53:57.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.851+0000 7f33a1b08640 1 -- 172.21.15.6:0/2889617788 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c0d3f80 con 0x7f339c06dae0 2024-05-20T17:53:57.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.852+0000 7f33a1b08640 1 --2- 172.21.15.6:0/2889617788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c06dae0 0x7f339c0b8190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3394009d90 tx=0x7f339402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9a36bbae987286 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.852+0000 7f338ffff640 1 -- 172.21.15.6:0/2889617788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394007740 con 0x7f339c06dae0 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.852+0000 7f338ffff640 1 -- 172.21.15.6:0/2889617788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33940078e0 con 0x7f339c06dae0 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.852+0000 7f338ffff640 1 -- 172.21.15.6:0/2889617788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394007cb0 con 0x7f339c06dae0 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.853+0000 7f33a356b640 1 -- 172.21.15.6:0/2889617788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c06dae0 msgr2=0x7f339c0b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.853+0000 7f33a356b640 1 --2- 172.21.15.6:0/2889617788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c06dae0 0x7f339c0b8190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3394009d90 tx=0x7f339402a660 comp rx=0 tx=0).stop 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.853+0000 7f33a356b640 1 -- 172.21.15.6:0/2889617788 shutdown_connections 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.853+0000 7f33a356b640 1 --2- 172.21.15.6:0/2889617788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c06dae0 0x7f339c0b8190 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.853+0000 7f33a356b640 1 --2- 172.21.15.6:0/2889617788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c162820 0x7f339c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.853+0000 7f33a356b640 1 -- 172.21.15.6:0/2889617788 >> 172.21.15.6:0/2889617788 conn(0x7f339c0d4bd0 msgr2=0x7f339c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.853+0000 7f33a356b640 1 -- 172.21.15.6:0/2889617788 shutdown_connections 2024-05-20T17:53:57.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.853+0000 7f33a356b640 1 -- 172.21.15.6:0/2889617788 wait complete. 2024-05-20T17:53:57.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.855+0000 7f33a356b640 1 Processor -- start 2024-05-20T17:53:57.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.855+0000 7f33a356b640 1 -- start start 2024-05-20T17:53:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.856+0000 7f33a356b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c0b3e80 0x7f339c0b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.856+0000 7f33a356b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c162820 0x7f339c1f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.856+0000 7f33a356b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c1f8b60 0x7f339c155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.856+0000 7f33a356b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f339c0d4780 con 0x7f339c1f8b60 2024-05-20T17:53:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.856+0000 7f33a356b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f339c0d0300 con 0x7f339c162820 2024-05-20T17:53:57.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.856+0000 7f33a356b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f339c0d4900 con 0x7f339c0b3e80 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c1f8b60 0x7f339c155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c1f8b60 0x7f339c155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54728/0 (socket says 172.21.15.6:54728) 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 -- 172.21.15.6:0/2199643443 learned_addr learned my addr 172.21.15.6:0/2199643443 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1307640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c0b3e80 0x7f339c0b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a0b06640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c162820 0x7f339c1f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 -- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c0b3e80 msgr2=0x7f339c0b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c0b3e80 0x7f339c0b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 -- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c162820 msgr2=0x7f339c1f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c162820 0x7f339c1f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 -- 172.21.15.6:0/2199643443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c1f8f70 con 0x7f339c1f8b60 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a1b08640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c1f8b60 0x7f339c155a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3394009d90 tx=0x7f3394004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f338dffb640 1 -- 172.21.15.6:0/2199643443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339403f070 con 0x7f339c1f8b60 2024-05-20T17:53:57.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f338dffb640 1 -- 172.21.15.6:0/2199643443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3394031bc0 con 0x7f339c1f8b60 2024-05-20T17:53:57.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339c0c8700 con 0x7f339c1f8b60 2024-05-20T17:53:57.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.857+0000 7f338dffb640 1 -- 172.21.15.6:0/2199643443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394043410 con 0x7f339c1f8b60 2024-05-20T17:53:57.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.858+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339c0cce20 con 0x7f339c1f8b60 2024-05-20T17:53:57.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.859+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339c0c88d0 con 0x7f339c1f8b60 2024-05-20T17:53:57.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.859+0000 7f338dffb640 1 -- 172.21.15.6:0/2199643443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3394007790 con 0x7f339c1f8b60 2024-05-20T17:53:57.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.860+0000 7f338dffb640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f338006be30 0x7f338006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:57.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.860+0000 7f338dffb640 1 -- 172.21.15.6:0/2199643443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f33940ac6f0 con 0x7f339c1f8b60 2024-05-20T17:53:57.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.860+0000 7f33a1307640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f338006be30 0x7f338006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:57.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.861+0000 7f33a1307640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f338006be30 0x7f338006e340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f33900079a0 tx=0x7f3390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:57.864+0000 7f338dffb640 1 -- 172.21.15.6:0/2199643443 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f339c1f8f70 con 0x7f339c1f8b60 2024-05-20T17:53:58.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.117+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) -- 0x7f339c075b00 con 0x7f339c1f8b60 2024-05-20T17:53:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.768+0000 7f338dffb640 1 -- 172.21.15.6:0/2199643443 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v72) ==== 168+0+0 (secure 0 0 0) 0x7f339407a580 con 0x7f339c1f8b60 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f338006be30 msgr2=0x7f338006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f338006be30 0x7f338006e340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f33900079a0 tx=0x7f3390008040 comp rx=0 tx=0).stop 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c1f8b60 msgr2=0x7f339c155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c1f8b60 0x7f339c155a40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3394009d90 tx=0x7f3394004a40 comp rx=0 tx=0).stop 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 shutdown_connections 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f338006be30 0x7f338006e340 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c1f8b60 0x7f339c155a40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c162820 0x7f339c1f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 --2- 172.21.15.6:0/2199643443 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c0b3e80 0x7f339c0b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 >> 172.21.15.6:0/2199643443 conn(0x7f339c0d4bd0 msgr2=0x7f339c161bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:58.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 shutdown_connections 2024-05-20T17:53:58.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.771+0000 7f33a356b640 1 -- 172.21.15.6:0/2199643443 wait complete. 2024-05-20T17:53:58.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T17:53:58.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.911+0000 7fb1ccd77640 1 Processor -- start 2024-05-20T17:53:58.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.911+0000 7fb1ccd77640 1 -- start start 2024-05-20T17:53:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.912+0000 7fb1ccd77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 0x7fb1c815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.912+0000 7fb1ccd77640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c80cd580 con 0x7fb1c815d530 2024-05-20T17:53:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.912+0000 7fb1ccd77640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c80cd860 con 0x7fb1c8070850 2024-05-20T17:53:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.912+0000 7fb1ccd77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c80ce190 con 0x7fb1c80b1e10 2024-05-20T17:53:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.912+0000 7fb1c659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1c815d530 0x7fb1c80b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36802/0 (socket says 172.21.15.6:36802) 2024-05-20T17:53:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.912+0000 7fb1c659c640 1 -- 172.21.15.6:0/2697375743 learned_addr learned my addr 172.21.15.6:0/2697375743 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283949472 0 0) 0x7fb1c80cd580 con 0x7fb1c815d530 2024-05-20T17:53:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c5d9b640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 0x7fb1c815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1b4003520 con 0x7fb1c815d530 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3098779915 0 0) 0x7fb1b4003520 con 0x7fb1c815d530 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 msgr2=0x7fb1c815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 0x7fb1c815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 >> v1:172.21.15.171:6789/0 conn(0x7fb1c8070850 legacy=0x7fb1c8070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c80cdb40 con 0x7fb1c815d530 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fb1b8001670 con 0x7fb1c815d530 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 >> v1:172.21.15.6:6789/0 conn(0x7fb1c815d530 legacy=0x7fb1c80b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 0x7fb1b40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b4004d40 0x7fb1b4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c80ce190 con 0x7fb1b4003f40 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b400bad0 con 0x7fb1b4004d40 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b400bcd0 con 0x7fb1c80b1e10 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c5d9b640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c6d9d640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b4004d40 0x7fb1b4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.913+0000 7fb1c659c640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 0x7fb1b40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.914+0000 7fb1c5d9b640 1 -- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 msgr2=0x7fb1b40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.914+0000 7fb1c5d9b640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 0x7fb1b40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.914+0000 7fb1c5d9b640 1 -- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b4004d40 msgr2=0x7fb1b4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.914+0000 7fb1c5d9b640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b4004d40 0x7fb1b4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.914+0000 7fb1c5d9b640 1 -- 172.21.15.6:0/2697375743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b4003520 con 0x7fb1b4003f40 2024-05-20T17:53:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.914+0000 7fb1c659c640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c80b1e10 0x7fb1b40039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:53:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.914+0000 7fb1c5d9b640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1b4004800 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009ac0 tx=0x7fb1b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88c9eb4addffe59 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.914+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0036070 con 0x7fb1b4003f40 2024-05-20T17:53:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b0031400 con 0x7fb1b4003f40 2024-05-20T17:53:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1c559a640 1 -- 172.21.15.6:0/2697375743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0009690 con 0x7fb1b4003f40 2024-05-20T17:53:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2697375743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 msgr2=0x7fb1b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1ccd77640 1 --2- 172.21.15.6:0/2697375743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1b4004800 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009ac0 tx=0x7fb1b4005830 comp rx=0 tx=0).stop 2024-05-20T17:53:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1c6d9d640 1 -- 172.21.15.6:0/2697375743 reap_dead start 2024-05-20T17:53:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2697375743 shutdown_connections 2024-05-20T17:53:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2697375743 >> 172.21.15.6:0/2697375743 conn(0x7fb1c80d29d0 msgr2=0x7fb1c80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2697375743 shutdown_connections 2024-05-20T17:53:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.915+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2697375743 wait complete. 2024-05-20T17:53:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.917+0000 7fb1ccd77640 1 Processor -- start 2024-05-20T17:53:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.918+0000 7fb1ccd77640 1 -- start start 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1ccd77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1c814deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1ccd77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1c80b7bd0 0x7fb1c806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1ccd77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c814e870 0x7fb1c80b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1ccd77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c8071370 con 0x7fb1b4003f40 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1ccd77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c80cd230 con 0x7fb1c80b7bd0 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1ccd77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c80714f0 con 0x7fb1c814e870 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1c814deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1c814deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54754/0 (socket says 172.21.15.6:54754) 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c659c640 1 -- 172.21.15.6:0/2370319826 learned_addr learned my addr 172.21.15.6:0/2370319826 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c5d9b640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1c80b7bd0 0x7fb1c806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c6d9d640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c814e870 0x7fb1c80b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c659c640 1 -- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c814e870 msgr2=0x7fb1c80b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c659c640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c814e870 0x7fb1c80b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c659c640 1 -- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1c80b7bd0 msgr2=0x7fb1c806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c659c640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1c80b7bd0 0x7fb1c806dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.919+0000 7fb1c659c640 1 -- 172.21.15.6:0/2370319826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c806cca0 con 0x7fb1b4003f40 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.920+0000 7fb1c659c640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1c814deb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800e810 tx=0x7fb1b800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.920+0000 7fb1beffd640 1 -- 172.21.15.6:0/2370319826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800c6c0 con 0x7fb1b4003f40 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.920+0000 7fb1beffd640 1 -- 172.21.15.6:0/2370319826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b8018070 con 0x7fb1b4003f40 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.920+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c806cf80 con 0x7fb1b4003f40 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.920+0000 7fb1beffd640 1 -- 172.21.15.6:0/2370319826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800ca60 con 0x7fb1b4003f40 2024-05-20T17:53:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.920+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c806d540 con 0x7fb1b4003f40 2024-05-20T17:53:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.921+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c8075b00 con 0x7fb1b4003f40 2024-05-20T17:53:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.922+0000 7fb1beffd640 1 -- 172.21.15.6:0/2370319826 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1b800cc00 con 0x7fb1b4003f40 2024-05-20T17:53:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.922+0000 7fb1beffd640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb1a806be30 0x7fb1a806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.922+0000 7fb1beffd640 1 -- 172.21.15.6:0/2370319826 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fb1b808aff0 con 0x7fb1b4003f40 2024-05-20T17:53:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.922+0000 7fb1c5d9b640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb1a806be30 0x7fb1a806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.923+0000 7fb1c5d9b640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb1a806be30 0x7fb1a806e340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0033000 tx=0x7fb1b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:58.927+0000 7fb1beffd640 1 -- 172.21.15.6:0/2370319826 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb1b8058e80 con 0x7fb1b4003f40 2024-05-20T17:53:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.109+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb1c8070d00 con 0x7fb1b4003f40 2024-05-20T17:53:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.113+0000 7fb1beffd640 1 -- 172.21.15.6:0/2370319826 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fb1b805d180 con 0x7fb1b4003f40 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb1a806be30 msgr2=0x7fb1a806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb1a806be30 0x7fb1a806e340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0033000 tx=0x7fb1b0008030 comp rx=0 tx=0).stop 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 msgr2=0x7fb1c814deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1c814deb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800e810 tx=0x7fb1b800ecd0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 shutdown_connections 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb1a806be30 0x7fb1a806e340 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c814e870 0x7fb1c80b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1c80b7bd0 0x7fb1c806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 --2- 172.21.15.6:0/2370319826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b4003f40 0x7fb1c814deb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 >> 172.21.15.6:0/2370319826 conn(0x7fb1c80d29d0 msgr2=0x7fb1c815ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 shutdown_connections 2024-05-20T17:53:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.115+0000 7fb1ccd77640 1 -- 172.21.15.6:0/2370319826 wait complete. 2024-05-20T17:53:59.126 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:53:59.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:53:59.164 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:53:59.210 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:53:59.210 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:53:59.210 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:59.227 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:53:59.227 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:59.283 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:53:59.283 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:53:59.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:53:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.495+0000 7fdee8067640 1 Processor -- start 2024-05-20T17:53:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.495+0000 7fdee8067640 1 -- start start 2024-05-20T17:53:59.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.496+0000 7fdee8067640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdee00b47b0 0x7fdee00afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.496+0000 7fdee8067640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee00b39f0 con 0x7fdee015d060 2024-05-20T17:53:59.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.496+0000 7fdee8067640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee00b3cd0 con 0x7fdee00b58f0 2024-05-20T17:53:59.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.496+0000 7fdee8067640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdee00b3fb0 con 0x7fdee00b47b0 2024-05-20T17:53:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.497+0000 7fdee6604640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fdee00b58f0 0x7fdee006f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:51230/0 (socket says 172.21.15.6:51230) 2024-05-20T17:53:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.497+0000 7fdee5e03640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdee00b47b0 0x7fdee00afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.497+0000 7fdee5602640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdee015d060 0x7fdee00b51e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36814/0 (socket says 172.21.15.6:36814) 2024-05-20T17:53:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.497+0000 7fdee6604640 1 -- 172.21.15.6:0/3100035214 learned_addr learned my addr 172.21.15.6:0/3100035214 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:53:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.497+0000 7fdee5e03640 1 -- 172.21.15.6:0/3100035214 >> v1:172.21.15.171:6789/0 conn(0x7fdee00b58f0 legacy=0x7fdee006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.497+0000 7fdee5e03640 1 -- 172.21.15.6:0/3100035214 >> v1:172.21.15.6:6789/0 conn(0x7fdee015d060 legacy=0x7fdee00b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.497+0000 7fdee5e03640 1 -- 172.21.15.6:0/3100035214 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee00b4290 con 0x7fdee00b47b0 2024-05-20T17:53:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.497+0000 7fdee4e01640 1 -- 172.21.15.6:0/3100035214 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592351424 0 0) 0x7fdee00b39f0 con 0x7fdee015d060 2024-05-20T17:53:59.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.498+0000 7fdee5e03640 1 --2- 172.21.15.6:0/3100035214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00b47b0 0x7fdee00afad0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009dc0 tx=0x7fdedc02a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f27406ab758486 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.498+0000 7fdee4e01640 1 -- 172.21.15.6:0/3100035214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc007740 con 0x7fdee00b47b0 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.498+0000 7fdee4e01640 1 -- 172.21.15.6:0/3100035214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc0078e0 con 0x7fdee00b47b0 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.498+0000 7fdee4e01640 1 -- 172.21.15.6:0/3100035214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc007cb0 con 0x7fdee00b47b0 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.499+0000 7fdee8067640 1 -- 172.21.15.6:0/3100035214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00b47b0 msgr2=0x7fdee00afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.499+0000 7fdee8067640 1 --2- 172.21.15.6:0/3100035214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00b47b0 0x7fdee00afad0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009dc0 tx=0x7fdedc02a5b0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.499+0000 7fdee8067640 1 -- 172.21.15.6:0/3100035214 shutdown_connections 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.499+0000 7fdee8067640 1 --2- 172.21.15.6:0/3100035214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00b47b0 0x7fdee00afad0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.499+0000 7fdee8067640 1 -- 172.21.15.6:0/3100035214 >> 172.21.15.6:0/3100035214 conn(0x7fdee00cd2a0 msgr2=0x7fdee00cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.499+0000 7fdee8067640 1 -- 172.21.15.6:0/3100035214 shutdown_connections 2024-05-20T17:53:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.499+0000 7fdee8067640 1 -- 172.21.15.6:0/3100035214 wait complete. 2024-05-20T17:53:59.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.501+0000 7fdee8067640 1 Processor -- start 2024-05-20T17:53:59.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.501+0000 7fdee8067640 1 -- start start 2024-05-20T17:53:59.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee8067640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdee015d060 0x7fdee015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee8067640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee015ec80 0x7fdee00aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee8067640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00af3f0 0x7fdee01e8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee8067640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0159de0 con 0x7fdee00af3f0 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee8067640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0159c60 con 0x7fdee015ec80 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee8067640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdee006fae0 con 0x7fdee015d060 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee6604640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00af3f0 0x7fdee01e8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee6604640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00af3f0 0x7fdee01e8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54774/0 (socket says 172.21.15.6:54774) 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee6604640 1 -- 172.21.15.6:0/2912715724 learned_addr learned my addr 172.21.15.6:0/2912715724 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee5e03640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdee015d060 0x7fdee015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.502+0000 7fdee5602640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee015ec80 0x7fdee00aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fdee6604640 1 -- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdee015d060 msgr2=0x7fdee015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fdee6604640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdee015d060 0x7fdee015fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fdee6604640 1 -- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee015ec80 msgr2=0x7fdee00aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fdee6604640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee015ec80 0x7fdee00aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fdee6604640 1 -- 172.21.15.6:0/2912715724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee0160160 con 0x7fdee00af3f0 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fdee6604640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00af3f0 0x7fdee01e8830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fded800c500 tx=0x7fded800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fded67fc640 1 -- 172.21.15.6:0/2912715724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8018070 con 0x7fdee00af3f0 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fded67fc640 1 -- 172.21.15.6:0/2912715724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded8007560 con 0x7fdee00af3f0 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fded67fc640 1 -- 172.21.15.6:0/2912715724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded80049e0 con 0x7fdee00af3f0 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee00af800 con 0x7fdee00af3f0 2024-05-20T17:53:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.503+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee015da00 con 0x7fdee00af3f0 2024-05-20T17:53:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.504+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee0075b00 con 0x7fdee00af3f0 2024-05-20T17:53:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.505+0000 7fded67fc640 1 -- 172.21.15.6:0/2912715724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fded8004b80 con 0x7fdee00af3f0 2024-05-20T17:53:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.505+0000 7fded67fc640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdec406be60 0x7fdec406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.505+0000 7fded67fc640 1 -- 172.21.15.6:0/2912715724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fded808a510 con 0x7fdee00af3f0 2024-05-20T17:53:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.506+0000 7fdee5e03640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdec406be60 0x7fdec406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.506+0000 7fdee5e03640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdec406be60 0x7fdec406e370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdedc034000 tx=0x7fdedc02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:59.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.510+0000 7fded67fc640 1 -- 172.21.15.6:0/2912715724 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fded804e3e0 con 0x7fdee00af3f0 2024-05-20T17:53:59.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.697+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdee006cba0 con 0x7fdee00af3f0 2024-05-20T17:53:59.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.698+0000 7fded67fc640 1 -- 172.21.15.6:0/2912715724 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7fdee00af800 con 0x7fdee00af3f0 2024-05-20T17:53:59.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:53:59.698 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:53:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdec406be60 msgr2=0x7fdec406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdec406be60 0x7fdec406e370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdedc034000 tx=0x7fdedc02f000 comp rx=0 tx=0).stop 2024-05-20T17:53:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00af3f0 msgr2=0x7fdee01e8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00af3f0 0x7fdee01e8830 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fded800c500 tx=0x7fded800c9c0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 shutdown_connections 2024-05-20T17:53:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdec406be60 0x7fdec406e370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdee00af3f0 0x7fdee01e8830 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee015ec80 0x7fdee00aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 --2- 172.21.15.6:0/2912715724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdee015d060 0x7fdee015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 >> 172.21.15.6:0/2912715724 conn(0x7fdee00cd2a0 msgr2=0x7fdee015b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 shutdown_connections 2024-05-20T17:53:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.700+0000 7fdee8067640 1 -- 172.21.15.6:0/2912715724 wait complete. 2024-05-20T17:53:59.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:53:59.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:53:59.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.832+0000 7f82c635e640 1 Processor -- start 2024-05-20T17:53:59.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.832+0000 7f82c635e640 1 -- start start 2024-05-20T17:53:59.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82c635e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82c0162820 0x7f82c00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82c635e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f82c00b3e80 0x7f82c006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82c635e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c006d910 0x7f82c00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82c635e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f82c006dd20 con 0x7f82c0162820 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82c635e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f82c00d0630 con 0x7f82c00b3e80 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82c635e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f82c00d39c0 con 0x7f82c006d910 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82c0162820 0x7f82c00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82c0162820 0x7f82c00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54776/0 (socket says 172.21.15.6:54776) 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bffff640 1 -- 172.21.15.6:0/3748944788 learned_addr learned my addr 172.21.15.6:0/3748944788 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82c48fb640 1 --2- 172.21.15.6:0/3748944788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c006d910 0x7f82c00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bf7fe640 1 --2- 172.21.15.6:0/3748944788 >> v2:172.21.15.171:3300/0 conn(0x7f82c00b3e80 0x7f82c006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bffff640 1 -- 172.21.15.6:0/3748944788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c006d910 msgr2=0x7f82c00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:59.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bffff640 1 --2- 172.21.15.6:0/3748944788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c006d910 0x7f82c00d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bffff640 1 -- 172.21.15.6:0/3748944788 >> v2:172.21.15.171:3300/0 conn(0x7f82c00b3e80 msgr2=0x7f82c006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:53:59.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bffff640 1 --2- 172.21.15.6:0/3748944788 >> v2:172.21.15.171:3300/0 conn(0x7f82c00b3e80 0x7f82c006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.834+0000 7f82bffff640 1 -- 172.21.15.6:0/3748944788 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c00d3ca0 con 0x7f82c0162820 2024-05-20T17:53:59.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.835+0000 7f82bffff640 1 --2- 172.21.15.6:0/3748944788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c00b3940 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f82c00d1230 tx=0x7f82b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229c571a01c42251 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:59.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.835+0000 7f82beffd640 1 -- 172.21.15.6:0/3748944788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0037070 con 0x7f82c0162820 2024-05-20T17:53:59.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.835+0000 7f82beffd640 1 -- 172.21.15.6:0/3748944788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b0032440 con 0x7f82c0162820 2024-05-20T17:53:59.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.835+0000 7f82beffd640 1 -- 172.21.15.6:0/3748944788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0032810 con 0x7f82c0162820 2024-05-20T17:53:59.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 -- 172.21.15.6:0/3748944788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 msgr2=0x7f82c00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 --2- 172.21.15.6:0/3748944788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c00b3940 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f82c00d1230 tx=0x7f82b002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 -- 172.21.15.6:0/3748944788 shutdown_connections 2024-05-20T17:53:59.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 --2- 172.21.15.6:0/3748944788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c006d910 0x7f82c00d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 --2- 172.21.15.6:0/3748944788 >> v2:172.21.15.171:3300/0 conn(0x7f82c00b3e80 0x7f82c006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 --2- 172.21.15.6:0/3748944788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c00b3940 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 -- 172.21.15.6:0/3748944788 >> 172.21.15.6:0/3748944788 conn(0x7f82c00d4bd0 msgr2=0x7f82c00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:53:59.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 -- 172.21.15.6:0/3748944788 shutdown_connections 2024-05-20T17:53:59.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.836+0000 7f82c635e640 1 -- 172.21.15.6:0/3748944788 wait complete. 2024-05-20T17:53:59.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.838+0000 7f82c635e640 1 Processor -- start 2024-05-20T17:53:59.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.838+0000 7f82c635e640 1 -- start start 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c635e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c006d910 0x7f82c00ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c635e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00b3e80 0x7f82c01f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c635e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c01f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c635e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00d0300 con 0x7f82c0162820 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c635e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00d4260 con 0x7f82c006d910 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c635e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f82c00d4780 con 0x7f82c00b3e80 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c48fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c01f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c48fb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c01f91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54782/0 (socket says 172.21.15.6:54782) 2024-05-20T17:53:59.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.839+0000 7f82c48fb640 1 -- 172.21.15.6:0/4127467538 learned_addr learned my addr 172.21.15.6:0/4127467538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82bf7fe640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00b3e80 0x7f82c01f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82bffff640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c006d910 0x7f82c00ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82c48fb640 1 -- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00b3e80 msgr2=0x7f82c01f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82c48fb640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00b3e80 0x7f82c01f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82c48fb640 1 -- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c006d910 msgr2=0x7f82c00ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82c48fb640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c006d910 0x7f82c00ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82c48fb640 1 -- 172.21.15.6:0/4127467538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c00b6180 con 0x7f82c0162820 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82c48fb640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c01f91e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f82b8007cc0 tx=0x7f82b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82bcff9640 1 -- 172.21.15.6:0/4127467538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8014420 con 0x7f82c0162820 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82bcff9640 1 -- 172.21.15.6:0/4127467538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b8019070 con 0x7f82c0162820 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82bcff9640 1 -- 172.21.15.6:0/4127467538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8014800 con 0x7f82c0162820 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c00b6460 con 0x7f82c0162820 2024-05-20T17:53:59.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.840+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c00b6a20 con 0x7f82c0162820 2024-05-20T17:53:59.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.841+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c00b5ef0 con 0x7f82c0162820 2024-05-20T17:53:59.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.842+0000 7f82bcff9640 1 -- 172.21.15.6:0/4127467538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82b80149a0 con 0x7f82c0162820 2024-05-20T17:53:59.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.842+0000 7f82bcff9640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82ac06be60 0x7f82ac06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:53:59.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.842+0000 7f82bcff9640 1 -- 172.21.15.6:0/4127467538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f82b808b900 con 0x7f82c0162820 2024-05-20T17:53:59.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.842+0000 7f82bffff640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82ac06be60 0x7f82ac06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:53:59.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.843+0000 7f82bffff640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82ac06be60 0x7f82ac06e370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f82b0034000 tx=0x7f82b002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:53:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:53:59.847+0000 7f82bcff9640 1 -- 172.21.15.6:0/4127467538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f82b80597a0 con 0x7f82c0162820 2024-05-20T17:54:00.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.030+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82c0075b00 con 0x7f82c0162820 2024-05-20T17:54:00.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.031+0000 7f82bcff9640 1 -- 172.21.15.6:0/4127467538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f82b805daa0 con 0x7f82c0162820 2024-05-20T17:54:00.030 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:54:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82ac06be60 msgr2=0x7f82ac06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82ac06be60 0x7f82ac06e370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f82b0034000 tx=0x7f82b002e000 comp rx=0 tx=0).stop 2024-05-20T17:54:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 msgr2=0x7f82c01f91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c01f91e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f82b8007cc0 tx=0x7f82b800e4b0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 shutdown_connections 2024-05-20T17:54:00.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f82ac06be60 0x7f82ac06e370 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82c0162820 0x7f82c01f91e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82c00b3e80 0x7f82c01f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.032+0000 7f82c635e640 1 --2- 172.21.15.6:0/4127467538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82c006d910 0x7f82c00ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.033+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 >> 172.21.15.6:0/4127467538 conn(0x7f82c00d4bd0 msgr2=0x7f82c00cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.033+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 shutdown_connections 2024-05-20T17:54:00.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.033+0000 7f82c635e640 1 -- 172.21.15.6:0/4127467538 wait complete. 2024-05-20T17:54:00.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:54:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.162+0000 7f4441702640 1 Processor -- start 2024-05-20T17:54:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.162+0000 7f4441702640 1 -- start start 2024-05-20T17:54:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.163+0000 7f4441702640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c070f60 0x7f443c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.163+0000 7f4441702640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443c0ce2b0 con 0x7f443c0cd1b0 2024-05-20T17:54:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.163+0000 7f4441702640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f443c06cce0 con 0x7f443c071630 2024-05-20T17:54:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.163+0000 7f4441702640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f443c15f790 con 0x7f443c070f60 2024-05-20T17:54:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.163+0000 7f44327fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f443c0cd1b0 0x7f443c070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36830/0 (socket says 172.21.15.6:36830) 2024-05-20T17:54:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.163+0000 7f44327fc640 1 -- 172.21.15.6:0/3138725193 learned_addr learned my addr 172.21.15.6:0/3138725193 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.163+0000 7f443b7fe640 1 --2- 172.21.15.6:0/3138725193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c070f60 0x7f443c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.164+0000 7f443a7fc640 1 -- 172.21.15.6:0/3138725193 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352621628 0 0) 0x7f443c0ce2b0 con 0x7f443c0cd1b0 2024-05-20T17:54:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.164+0000 7f443a7fc640 1 -- 172.21.15.6:0/3138725193 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4428003520 con 0x7f443c0cd1b0 2024-05-20T17:54:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.164+0000 7f443a7fc640 1 -- 172.21.15.6:0/3138725193 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757284781 0 0) 0x7f443c06cce0 con 0x7f443c071630 2024-05-20T17:54:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.164+0000 7f443b7fe640 1 -- 172.21.15.6:0/3138725193 >> v1:172.21.15.171:6789/0 conn(0x7f443c071630 legacy=0x7f443c06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.164+0000 7f443b7fe640 1 -- 172.21.15.6:0/3138725193 >> v1:172.21.15.6:6789/0 conn(0x7f443c0cd1b0 legacy=0x7f443c070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.164+0000 7f443b7fe640 1 -- 172.21.15.6:0/3138725193 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443c06cfc0 con 0x7f443c070f60 2024-05-20T17:54:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.165+0000 7f443b7fe640 1 --2- 172.21.15.6:0/3138725193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c070f60 0x7f443c15f250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4434009dc0 tx=0x7f443402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a58f86e04da7340 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.165+0000 7f443a7fc640 1 -- 172.21.15.6:0/3138725193 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443402ae60 con 0x7f443c070f60 2024-05-20T17:54:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.165+0000 7f443a7fc640 1 -- 172.21.15.6:0/3138725193 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4434007740 con 0x7f443c070f60 2024-05-20T17:54:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.165+0000 7f443a7fc640 1 -- 172.21.15.6:0/3138725193 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434007af0 con 0x7f443c070f60 2024-05-20T17:54:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.166+0000 7f4441702640 1 -- 172.21.15.6:0/3138725193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c070f60 msgr2=0x7f443c15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.166+0000 7f4441702640 1 --2- 172.21.15.6:0/3138725193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c070f60 0x7f443c15f250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4434009dc0 tx=0x7f443402a640 comp rx=0 tx=0).stop 2024-05-20T17:54:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.166+0000 7f4441702640 1 -- 172.21.15.6:0/3138725193 shutdown_connections 2024-05-20T17:54:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.166+0000 7f4441702640 1 --2- 172.21.15.6:0/3138725193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c070f60 0x7f443c15f250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.166+0000 7f4441702640 1 -- 172.21.15.6:0/3138725193 >> 172.21.15.6:0/3138725193 conn(0x7f443c0d29d0 msgr2=0x7f443c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.166+0000 7f4441702640 1 -- 172.21.15.6:0/3138725193 shutdown_connections 2024-05-20T17:54:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.166+0000 7f4441702640 1 -- 172.21.15.6:0/3138725193 wait complete. 2024-05-20T17:54:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.167+0000 7f4441702640 1 Processor -- start 2024-05-20T17:54:00.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.168+0000 7f4441702640 1 -- start start 2024-05-20T17:54:00.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f4441702640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f443c071630 0x7f443c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f4441702640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c0cd1b0 0x7f443c162730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f4441702640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f443c0b3090 0x7f443c156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f4441702640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f443c06ded0 con 0x7f443c0b3090 2024-05-20T17:54:00.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f4441702640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f443c06c990 con 0x7f443c071630 2024-05-20T17:54:00.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f4441702640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f443c1f6d20 con 0x7f443c0cd1b0 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f443c0b3090 0x7f443c156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f443c0b3090 0x7f443c156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54788/0 (socket says 172.21.15.6:54788) 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443b7fe640 1 -- 172.21.15.6:0/1012789558 learned_addr learned my addr 172.21.15.6:0/1012789558 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443affd640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f443c071630 0x7f443c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f44327fc640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c0cd1b0 0x7f443c162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443b7fe640 1 -- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c0cd1b0 msgr2=0x7f443c162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443b7fe640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c0cd1b0 0x7f443c162730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443b7fe640 1 -- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f443c071630 msgr2=0x7f443c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443b7fe640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f443c071630 0x7f443c158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.169+0000 7f443b7fe640 1 -- 172.21.15.6:0/1012789558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443c0b34a0 con 0x7f443c0b3090 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.170+0000 7f443b7fe640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f443c0b3090 0x7f443c156b20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4434009eb0 tx=0x7f4434004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.170+0000 7f4433fff640 1 -- 172.21.15.6:0/1012789558 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434009450 con 0x7f443c0b3090 2024-05-20T17:54:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.170+0000 7f4433fff640 1 -- 172.21.15.6:0/1012789558 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4434004250 con 0x7f443c0b3090 2024-05-20T17:54:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.170+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443c158900 con 0x7f443c0b3090 2024-05-20T17:54:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.170+0000 7f4433fff640 1 -- 172.21.15.6:0/1012789558 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434004420 con 0x7f443c0b3090 2024-05-20T17:54:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.170+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f443c158ec0 con 0x7f443c0b3090 2024-05-20T17:54:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.171+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443c075b00 con 0x7f443c0b3090 2024-05-20T17:54:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.172+0000 7f4433fff640 1 -- 172.21.15.6:0/1012789558 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44340045c0 con 0x7f443c0b3090 2024-05-20T17:54:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.172+0000 7f4433fff640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441c06be30 0x7f441c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.172+0000 7f4433fff640 1 -- 172.21.15.6:0/1012789558 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f44340ac670 con 0x7f443c0b3090 2024-05-20T17:54:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.172+0000 7f443affd640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441c06be30 0x7f441c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.173+0000 7f443affd640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441c06be30 0x7f441c06e340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f442c000f60 tx=0x7f442c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.177+0000 7f4433fff640 1 -- 172.21.15.6:0/1012789558 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f443403f030 con 0x7f443c0b3090 2024-05-20T17:54:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.360+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f443c158690 con 0x7f443c0b3090 2024-05-20T17:54:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.360+0000 7f4433fff640 1 -- 172.21.15.6:0/1012789558 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f443407a500 con 0x7f443c0b3090 2024-05-20T17:54:00.360 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441c06be30 msgr2=0x7f441c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441c06be30 0x7f441c06e340 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f442c000f60 tx=0x7f442c009040 comp rx=0 tx=0).stop 2024-05-20T17:54:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f443c0b3090 msgr2=0x7f443c156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f443c0b3090 0x7f443c156b20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4434009eb0 tx=0x7f4434004a40 comp rx=0 tx=0).stop 2024-05-20T17:54:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 shutdown_connections 2024-05-20T17:54:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441c06be30 0x7f441c06e340 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f443c0b3090 0x7f443c156b20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443c0cd1b0 0x7f443c162730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 --2- 172.21.15.6:0/1012789558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f443c071630 0x7f443c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.362+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 >> 172.21.15.6:0/1012789558 conn(0x7f443c0d29d0 msgr2=0x7f443c0d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.363+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 shutdown_connections 2024-05-20T17:54:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.363+0000 7f4441702640 1 -- 172.21.15.6:0/1012789558 wait complete. 2024-05-20T17:54:00.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:54:00.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.492+0000 7f838e0bc640 1 Processor -- start 2024-05-20T17:54:00.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.492+0000 7f838e0bc640 1 -- start start 2024-05-20T17:54:00.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.493+0000 7f838e0bc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f83880b1e10 0x7f838815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.493+0000 7f838e0bc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8388070850 0x7f8388070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.493+0000 7f838e0bc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83880cd580 con 0x7f838815d530 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.493+0000 7f838e0bc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f83880ce190 con 0x7f8388070850 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.493+0000 7f838e0bc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f83880cd860 con 0x7f83880b1e10 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.493+0000 7f8387fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8388070850 0x7f8388070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.493+0000 7f83877fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f838815d530 0x7f83880b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36838/0 (socket says 172.21.15.6:36838) 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.493+0000 7f83877fe640 1 -- 172.21.15.6:0/4199832945 learned_addr learned my addr 172.21.15.6:0/4199832945 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.494+0000 7f837ffff640 1 --2- 172.21.15.6:0/4199832945 >> v2:172.21.15.171:3300/0 conn(0x7f83880b1e10 0x7f838815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.494+0000 7f8387fff640 1 -- 172.21.15.6:0/4199832945 >> v2:172.21.15.171:3300/0 conn(0x7f83880b1e10 msgr2=0x7f838815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.494+0000 7f8387fff640 1 --2- 172.21.15.6:0/4199832945 >> v2:172.21.15.171:3300/0 conn(0x7f83880b1e10 0x7f838815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.494+0000 7f8387fff640 1 -- 172.21.15.6:0/4199832945 >> v1:172.21.15.6:6789/0 conn(0x7f838815d530 legacy=0x7f83880b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.494+0000 7f8387fff640 1 -- 172.21.15.6:0/4199832945 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880cdb40 con 0x7f8388070850 2024-05-20T17:54:00.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.494+0000 7f837ffff640 1 --2- 172.21.15.6:0/4199832945 >> v2:172.21.15.171:3300/0 conn(0x7f83880b1e10 0x7f838815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:00.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.495+0000 7f8387fff640 1 --2- 172.21.15.6:0/4199832945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8388070850 0x7f8388070c60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f83880d3ad0 tx=0x7f838002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd06cc233e704de9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.495+0000 7f8386ffd640 1 -- 172.21.15.6:0/4199832945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380007740 con 0x7f8388070850 2024-05-20T17:54:00.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.495+0000 7f8386ffd640 1 -- 172.21.15.6:0/4199832945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800078e0 con 0x7f8388070850 2024-05-20T17:54:00.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.495+0000 7f8386ffd640 1 -- 172.21.15.6:0/4199832945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380007cb0 con 0x7f8388070850 2024-05-20T17:54:00.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.495+0000 7f838e0bc640 1 -- 172.21.15.6:0/4199832945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8388070850 msgr2=0x7f8388070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.495+0000 7f838e0bc640 1 --2- 172.21.15.6:0/4199832945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8388070850 0x7f8388070c60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f83880d3ad0 tx=0x7f838002a680 comp rx=0 tx=0).stop 2024-05-20T17:54:00.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.496+0000 7f838e0bc640 1 -- 172.21.15.6:0/4199832945 shutdown_connections 2024-05-20T17:54:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.496+0000 7f838e0bc640 1 --2- 172.21.15.6:0/4199832945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8388070850 0x7f8388070c60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.496+0000 7f838e0bc640 1 --2- 172.21.15.6:0/4199832945 >> v2:172.21.15.171:3300/0 conn(0x7f83880b1e10 0x7f838815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.496+0000 7f838e0bc640 1 -- 172.21.15.6:0/4199832945 >> 172.21.15.6:0/4199832945 conn(0x7f83880d29d0 msgr2=0x7f83880d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.496+0000 7f838e0bc640 1 -- 172.21.15.6:0/4199832945 shutdown_connections 2024-05-20T17:54:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.496+0000 7f838e0bc640 1 -- 172.21.15.6:0/4199832945 wait complete. 2024-05-20T17:54:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.497+0000 7f838e0bc640 1 Processor -- start 2024-05-20T17:54:00.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.497+0000 7f838e0bc640 1 -- start start 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f838e0bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8388070850 0x7f838814f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f838e0bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83880b1e10 0x7f83881f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f838e0bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f838815d530 0x7f83880b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f838e0bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83880711a0 con 0x7f83880b1e10 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f838e0bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f83880cd230 con 0x7f8388070850 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f838e0bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8388071320 con 0x7f838815d530 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83880b1e10 0x7f83881f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83880b1e10 0x7f83881f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54796/0 (socket says 172.21.15.6:54796) 2024-05-20T17:54:00.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 -- 172.21.15.6:0/3279632057 learned_addr learned my addr 172.21.15.6:0/3279632057 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f83877fe640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8388070850 0x7f838814f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f8387fff640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f838815d530 0x7f83880b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 -- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f838815d530 msgr2=0x7f83880b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f838815d530 0x7f83880b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 -- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8388070850 msgr2=0x7f838814f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8388070850 0x7f838814f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 -- 172.21.15.6:0/3279632057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880cb340 con 0x7f83880b1e10 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f837ffff640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83880b1e10 0x7f83881f5070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f837000d7d0 tx=0x7f837000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.499+0000 7f8384ff9640 1 -- 172.21.15.6:0/3279632057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370004030 con 0x7f83880b1e10 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.500+0000 7f8384ff9640 1 -- 172.21.15.6:0/3279632057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83700041d0 con 0x7f83880b1e10 2024-05-20T17:54:00.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.500+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83880cb620 con 0x7f83880b1e10 2024-05-20T17:54:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.500+0000 7f8384ff9640 1 -- 172.21.15.6:0/3279632057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83700096a0 con 0x7f83880b1e10 2024-05-20T17:54:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.500+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83880cbbe0 con 0x7f83880b1e10 2024-05-20T17:54:00.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.500+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8388075b00 con 0x7f83880b1e10 2024-05-20T17:54:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.501+0000 7f8384ff9640 1 -- 172.21.15.6:0/3279632057 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8370009840 con 0x7f83880b1e10 2024-05-20T17:54:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.502+0000 7f8384ff9640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f836806be60 0x7f836806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.502+0000 7f8384ff9640 1 -- 172.21.15.6:0/3279632057 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f837008b6c0 con 0x7f83880b1e10 2024-05-20T17:54:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.502+0000 7f83877fe640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f836806be60 0x7f836806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.502+0000 7f83877fe640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f836806be60 0x7f836806e370 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8378000f60 tx=0x7f8378009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.506+0000 7f8384ff9640 1 -- 172.21.15.6:0/3279632057 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8370059b00 con 0x7f83880b1e10 2024-05-20T17:54:00.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.688+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f83880c9760 con 0x7f83880b1e10 2024-05-20T17:54:00.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.689+0000 7f8384ff9640 1 -- 172.21.15.6:0/3279632057 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f8370059400 con 0x7f83880b1e10 2024-05-20T17:54:00.688 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:54:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.690+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f836806be60 msgr2=0x7f836806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f836806be60 0x7f836806e370 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8378000f60 tx=0x7f8378009040 comp rx=0 tx=0).stop 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83880b1e10 msgr2=0x7f83881f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83880b1e10 0x7f83881f5070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f837000d7d0 tx=0x7f837000dc90 comp rx=0 tx=0).stop 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 shutdown_connections 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f836806be60 0x7f836806e370 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f838815d530 0x7f83880b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83880b1e10 0x7f83881f5070 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 --2- 172.21.15.6:0/3279632057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8388070850 0x7f838814f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 >> 172.21.15.6:0/3279632057 conn(0x7f83880d29d0 msgr2=0x7f83880d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 shutdown_connections 2024-05-20T17:54:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.691+0000 7f838e0bc640 1 -- 172.21.15.6:0/3279632057 wait complete. 2024-05-20T17:54:00.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:54:00.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.821+0000 7f97ee109640 1 Processor -- start 2024-05-20T17:54:00.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.821+0000 7f97ee109640 1 -- start start 2024-05-20T17:54:00.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97ee109640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e815f700 0x7f97e815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97ee109640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97e806c180 0x7f97e806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97ee109640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e8160430 con 0x7f97e80af030 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97ee109640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f97e806bcf0 con 0x7f97e806c180 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97ee109640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f97e806b6a0 con 0x7f97e815f700 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97e806c180 0x7f97e806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f97e80af030 0x7f97e80af440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36854/0 (socket says 172.21.15.6:36854) 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e77fe640 1 -- 172.21.15.6:0/1237110562 learned_addr learned my addr 172.21.15.6:0/1237110562 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e6ffd640 1 --2- 172.21.15.6:0/1237110562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e815f700 0x7f97e815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e7fff640 1 -- 172.21.15.6:0/1237110562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e815f700 msgr2=0x7f97e815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e7fff640 1 --2- 172.21.15.6:0/1237110562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e815f700 0x7f97e815fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e7fff640 1 -- 172.21.15.6:0/1237110562 >> v1:172.21.15.6:6789/0 conn(0x7f97e80af030 legacy=0x7f97e80af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e7fff640 1 -- 172.21.15.6:0/1237110562 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e806b980 con 0x7f97e806c180 2024-05-20T17:54:00.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.823+0000 7f97e67fc640 1 -- 172.21.15.6:0/1237110562 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838209751 0 0) 0x7f97e8160430 con 0x7f97e80af030 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.824+0000 7f97e7fff640 1 --2- 172.21.15.6:0/1237110562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e806c590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009d90 tx=0x7f97e002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fce9b434b4f9f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.824+0000 7f97e67fc640 1 -- 172.21.15.6:0/1237110562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0007740 con 0x7f97e806c180 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.824+0000 7f97e67fc640 1 -- 172.21.15.6:0/1237110562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e00078e0 con 0x7f97e806c180 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.824+0000 7f97e67fc640 1 -- 172.21.15.6:0/1237110562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0007cb0 con 0x7f97e806c180 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.825+0000 7f97ee109640 1 -- 172.21.15.6:0/1237110562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 msgr2=0x7f97e806c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.825+0000 7f97ee109640 1 --2- 172.21.15.6:0/1237110562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e806c590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009d90 tx=0x7f97e002a660 comp rx=0 tx=0).stop 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.825+0000 7f97ee109640 1 -- 172.21.15.6:0/1237110562 shutdown_connections 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.825+0000 7f97ee109640 1 --2- 172.21.15.6:0/1237110562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e806c590 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.825+0000 7f97ee109640 1 --2- 172.21.15.6:0/1237110562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e815f700 0x7f97e815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.825+0000 7f97ee109640 1 -- 172.21.15.6:0/1237110562 >> 172.21.15.6:0/1237110562 conn(0x7f97e80b6620 msgr2=0x7f97e80b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.825+0000 7f97ee109640 1 -- 172.21.15.6:0/1237110562 shutdown_connections 2024-05-20T17:54:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.825+0000 7f97ee109640 1 -- 172.21.15.6:0/1237110562 wait complete. 2024-05-20T17:54:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.827+0000 7f97ee109640 1 Processor -- start 2024-05-20T17:54:00.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.827+0000 7f97ee109640 1 -- start start 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97ee109640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97ee109640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e80af030 0x7f97e8151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97ee109640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97e815f700 0x7f97e815c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97ee109640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f97e81601d0 con 0x7f97e806c180 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97ee109640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f97e8160050 con 0x7f97e815f700 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97ee109640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f97e806cad0 con 0x7f97e80af030 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97e77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97e77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e815a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54816/0 (socket says 172.21.15.6:54816) 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97e77fe640 1 -- 172.21.15.6:0/3781257916 learned_addr learned my addr 172.21.15.6:0/3781257916 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:00.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.828+0000 7f97e6ffd640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e80af030 0x7f97e8151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97e7fff640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97e815f700 0x7f97e815c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97e77fe640 1 -- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e80af030 msgr2=0x7f97e8151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97e77fe640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e80af030 0x7f97e8151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97e77fe640 1 -- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97e815f700 msgr2=0x7f97e815c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97e77fe640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97e815f700 0x7f97e815c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97e77fe640 1 -- 172.21.15.6:0/3781257916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e815dd60 con 0x7f97e806c180 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97e77fe640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e815a6c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c410 tx=0x7f97d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97cffff640 1 -- 172.21.15.6:0/3781257916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80074e0 con 0x7f97e806c180 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97cffff640 1 -- 172.21.15.6:0/3781257916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d80047e0 con 0x7f97e806c180 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e815aca0 con 0x7f97e806c180 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97cffff640 1 -- 172.21.15.6:0/3781257916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8004bd0 con 0x7f97e806c180 2024-05-20T17:54:00.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.829+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e815e320 con 0x7f97e806c180 2024-05-20T17:54:00.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.830+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e8075b00 con 0x7f97e806c180 2024-05-20T17:54:00.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.831+0000 7f97cffff640 1 -- 172.21.15.6:0/3781257916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97d8011070 con 0x7f97e806c180 2024-05-20T17:54:00.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.831+0000 7f97cffff640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f97d406be30 0x7f97d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.831+0000 7f97cffff640 1 -- 172.21.15.6:0/3781257916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f97d808aef0 con 0x7f97e806c180 2024-05-20T17:54:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.831+0000 7f97e6ffd640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f97d406be30 0x7f97d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:00.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.832+0000 7f97e6ffd640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f97d406be30 0x7f97d406e340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97dc006fd0 tx=0x7f97dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:00.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:00.836+0000 7f97cffff640 1 -- 172.21.15.6:0/3781257916 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f97d800e280 con 0x7f97e806c180 2024-05-20T17:54:01.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.020+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f97e815fe30 con 0x7f97e806c180 2024-05-20T17:54:01.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.020+0000 7f97cffff640 1 -- 172.21.15.6:0/3781257916 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f97d8059460 con 0x7f97e806c180 2024-05-20T17:54:01.019 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:01.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f97d406be30 msgr2=0x7f97d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f97d406be30 0x7f97d406e340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97dc006fd0 tx=0x7f97dc008040 comp rx=0 tx=0).stop 2024-05-20T17:54:01.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 msgr2=0x7f97e815a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e815a6c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c410 tx=0x7f97d800c8d0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 shutdown_connections 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f97d406be30 0x7f97d406e340 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97e815f700 0x7f97e815c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97e80af030 0x7f97e8151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 --2- 172.21.15.6:0/3781257916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97e806c180 0x7f97e815a6c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 >> 172.21.15.6:0/3781257916 conn(0x7f97e80b6620 msgr2=0x7f97e80b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 shutdown_connections 2024-05-20T17:54:01.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.022+0000 7f97ee109640 1 -- 172.21.15.6:0/3781257916 wait complete. 2024-05-20T17:54:01.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:54:01.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.149+0000 7f72b7be3640 1 Processor -- start 2024-05-20T17:54:01.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.149+0000 7f72b7be3640 1 -- start start 2024-05-20T17:54:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b7be3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72b006d3d0 0x7f72b006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b7be3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 0x7f72b00b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b7be3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b006dd20 con 0x7f72b0162820 2024-05-20T17:54:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b7be3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f72b00d0630 con 0x7f72b006d3d0 2024-05-20T17:54:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b7be3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f72b00d39c0 con 0x7f72b00b8190 2024-05-20T17:54:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b597f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72b0162820 0x7f72b00b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36868/0 (socket says 172.21.15.6:36868) 2024-05-20T17:54:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b517e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72b006d3d0 0x7f72b006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b597f640 1 -- 172.21.15.6:0/648834212 learned_addr learned my addr 172.21.15.6:0/648834212 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b6180640 1 --2- 172.21.15.6:0/648834212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 0x7f72b00b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b517e640 1 -- 172.21.15.6:0/648834212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 msgr2=0x7f72b00b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b517e640 1 --2- 172.21.15.6:0/648834212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 0x7f72b00b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b517e640 1 -- 172.21.15.6:0/648834212 >> v1:172.21.15.6:6789/0 conn(0x7f72b0162820 legacy=0x7f72b00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b497d640 1 -- 172.21.15.6:0/648834212 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731356610 0 0) 0x7f72ac001110 con 0x7f72b0162820 2024-05-20T17:54:01.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.151+0000 7f72b517e640 1 -- 172.21.15.6:0/648834212 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b00d3ca0 con 0x7f72b006d3d0 2024-05-20T17:54:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.152+0000 7f72b517e640 1 --2- 172.21.15.6:0/648834212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b006d3d0 0x7f72b006d7e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f72a00097a0 tx=0x7f72a002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fba5a97083a187e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:01.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.152+0000 7f72b497d640 1 -- 172.21.15.6:0/648834212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0037070 con 0x7f72b006d3d0 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.152+0000 7f72b497d640 1 -- 172.21.15.6:0/648834212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a0032440 con 0x7f72b006d3d0 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.152+0000 7f72b497d640 1 -- 172.21.15.6:0/648834212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0032810 con 0x7f72b006d3d0 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.153+0000 7f72b7be3640 1 -- 172.21.15.6:0/648834212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b006d3d0 msgr2=0x7f72b006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.153+0000 7f72b7be3640 1 --2- 172.21.15.6:0/648834212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b006d3d0 0x7f72b006d7e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f72a00097a0 tx=0x7f72a002a180 comp rx=0 tx=0).stop 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.153+0000 7f72b7be3640 1 -- 172.21.15.6:0/648834212 shutdown_connections 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.153+0000 7f72b7be3640 1 --2- 172.21.15.6:0/648834212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 0x7f72b00b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.153+0000 7f72b7be3640 1 --2- 172.21.15.6:0/648834212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b006d3d0 0x7f72b006d7e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.153+0000 7f72b7be3640 1 -- 172.21.15.6:0/648834212 >> 172.21.15.6:0/648834212 conn(0x7f72b00d4bd0 msgr2=0x7f72b00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.153+0000 7f72b7be3640 1 -- 172.21.15.6:0/648834212 shutdown_connections 2024-05-20T17:54:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.153+0000 7f72b7be3640 1 -- 172.21.15.6:0/648834212 wait complete. 2024-05-20T17:54:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.155+0000 7f72b7be3640 1 Processor -- start 2024-05-20T17:54:01.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.155+0000 7f72b7be3640 1 -- start start 2024-05-20T17:54:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b7be3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72b006d3d0 0x7f72b00ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b7be3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 0x7f72b01f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b7be3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b0162820 0x7f72b015fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b7be3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00d0300 con 0x7f72b0162820 2024-05-20T17:54:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b7be3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00d4260 con 0x7f72b006d3d0 2024-05-20T17:54:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b7be3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f72b00b4050 con 0x7f72b00b8190 2024-05-20T17:54:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b6180640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b0162820 0x7f72b015fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b6180640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b0162820 0x7f72b015fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54828/0 (socket says 172.21.15.6:54828) 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b6180640 1 -- 172.21.15.6:0/2739735087 learned_addr learned my addr 172.21.15.6:0/2739735087 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b517e640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 0x7f72b01f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.156+0000 7f72b597f640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72b006d3d0 0x7f72b00ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72b6180640 1 -- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 msgr2=0x7f72b01f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72b6180640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 0x7f72b01f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72b6180640 1 -- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72b006d3d0 msgr2=0x7f72b00ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72b6180640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72b006d3d0 0x7f72b00ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72b6180640 1 -- 172.21.15.6:0/2739735087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b00cbe20 con 0x7f72b0162820 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72b6180640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b0162820 0x7f72b015fcd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f72a8007d40 tx=0x7f72a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72a67fc640 1 -- 172.21.15.6:0/2739735087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8014420 con 0x7f72b0162820 2024-05-20T17:54:01.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72a67fc640 1 -- 172.21.15.6:0/2739735087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a8019070 con 0x7f72b0162820 2024-05-20T17:54:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b00cb1f0 con 0x7f72b0162820 2024-05-20T17:54:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72a67fc640 1 -- 172.21.15.6:0/2739735087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8014820 con 0x7f72b0162820 2024-05-20T17:54:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.157+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b00cb7b0 con 0x7f72b0162820 2024-05-20T17:54:01.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.158+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b0075b00 con 0x7f72b0162820 2024-05-20T17:54:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.159+0000 7f72a67fc640 1 -- 172.21.15.6:0/2739735087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72a80149c0 con 0x7f72b0162820 2024-05-20T17:54:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.160+0000 7f72a67fc640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f729406be30 0x7f729406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.160+0000 7f72a67fc640 1 -- 172.21.15.6:0/2739735087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f72a808ba40 con 0x7f72b0162820 2024-05-20T17:54:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.160+0000 7f72b597f640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f729406be30 0x7f729406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.160+0000 7f72b597f640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f729406be30 0x7f729406e340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72ac000f60 tx=0x7f72ac007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:01.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.164+0000 7f72a67fc640 1 -- 172.21.15.6:0/2739735087 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f72a8059fb0 con 0x7f72b0162820 2024-05-20T17:54:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.359+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f72b00caf80 con 0x7f72b0162820 2024-05-20T17:54:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.360+0000 7f72a67fc640 1 -- 172.21.15.6:0/2739735087 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f72a80598b0 con 0x7f72b0162820 2024-05-20T17:54:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:54:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f729406be30 msgr2=0x7f729406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f729406be30 0x7f729406e340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72ac000f60 tx=0x7f72ac007c00 comp rx=0 tx=0).stop 2024-05-20T17:54:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b0162820 msgr2=0x7f72b015fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b0162820 0x7f72b015fcd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f72a8007d40 tx=0x7f72a800e4b0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 shutdown_connections 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f729406be30 0x7f729406e340 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72b0162820 0x7f72b015fcd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72b00b8190 0x7f72b01f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 --2- 172.21.15.6:0/2739735087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72b006d3d0 0x7f72b00ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 >> 172.21.15.6:0/2739735087 conn(0x7f72b00d4bd0 msgr2=0x7f72b015f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 shutdown_connections 2024-05-20T17:54:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.362+0000 7f72b7be3640 1 -- 172.21.15.6:0/2739735087 wait complete. 2024-05-20T17:54:01.372 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T17:54:01.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:01.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-20T17:54:01.400 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:54:01.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:01.400 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T17:54:01.456 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:54:01.457 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:01.476 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:54:01.476 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:01.535 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:54:01.535 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:01.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:01.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.710+0000 7f308b52f640 1 Processor -- start 2024-05-20T17:54:01.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.710+0000 7f308b52f640 1 -- start start 2024-05-20T17:54:01.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f308b52f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f308415d530 0x7f308415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f308b52f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3084070850 0x7f3084070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f308b52f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30840cd580 con 0x7f30840b1700 2024-05-20T17:54:01.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f308b52f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f30840ce190 con 0x7f308415d530 2024-05-20T17:54:01.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f308b52f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f30840cd860 con 0x7f3084070850 2024-05-20T17:54:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f30892cb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f308415d530 0x7f308415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f30892cb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f308415d530 0x7f308415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54832/0 (socket says 172.21.15.6:54832) 2024-05-20T17:54:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f30892cb640 1 -- 172.21.15.6:0/725089925 learned_addr learned my addr 172.21.15.6:0/725089925 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.711+0000 7f3089acc640 1 --2- 172.21.15.6:0/725089925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3084070850 0x7f3084070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.712+0000 7f30892cb640 1 -- 172.21.15.6:0/725089925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3084070850 msgr2=0x7f3084070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.712+0000 7f30892cb640 1 --2- 172.21.15.6:0/725089925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3084070850 0x7f3084070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.712+0000 7f30892cb640 1 -- 172.21.15.6:0/725089925 >> v1:172.21.15.171:6789/0 conn(0x7f30840b1700 legacy=0x7f30840b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.712+0000 7f30892cb640 1 -- 172.21.15.6:0/725089925 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30840cdb40 con 0x7f308415d530 2024-05-20T17:54:01.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.712+0000 7f30892cb640 1 --2- 172.21.15.6:0/725089925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f308415aaa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3074009e50 tx=0x7f307402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312e317b5aad35f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:01.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f3083fff640 1 -- 172.21.15.6:0/725089925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074036070 con 0x7f308415d530 2024-05-20T17:54:01.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f3083fff640 1 -- 172.21.15.6:0/725089925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074031600 con 0x7f308415d530 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f3083fff640 1 -- 172.21.15.6:0/725089925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30740319d0 con 0x7f308415d530 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f308b52f640 1 -- 172.21.15.6:0/725089925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 msgr2=0x7f308415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f308b52f640 1 --2- 172.21.15.6:0/725089925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f308415aaa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3074009e50 tx=0x7f307402a710 comp rx=0 tx=0).stop 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f308b52f640 1 -- 172.21.15.6:0/725089925 shutdown_connections 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f308b52f640 1 --2- 172.21.15.6:0/725089925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3084070850 0x7f3084070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f308b52f640 1 --2- 172.21.15.6:0/725089925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f308415aaa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f308b52f640 1 -- 172.21.15.6:0/725089925 >> 172.21.15.6:0/725089925 conn(0x7f30840d29d0 msgr2=0x7f30840d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f308b52f640 1 -- 172.21.15.6:0/725089925 shutdown_connections 2024-05-20T17:54:01.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.713+0000 7f308b52f640 1 -- 172.21.15.6:0/725089925 wait complete. 2024-05-20T17:54:01.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.715+0000 7f308b52f640 1 Processor -- start 2024-05-20T17:54:01.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.715+0000 7f308b52f640 1 -- start start 2024-05-20T17:54:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.716+0000 7f308b52f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3084070850 0x7f3084159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.716+0000 7f308b52f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30840b1700 0x7f30840c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.716+0000 7f308b52f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f30840c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.716+0000 7f308b52f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f30840711a0 con 0x7f308415d530 2024-05-20T17:54:01.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.716+0000 7f308b52f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30840cd230 con 0x7f3084070850 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.716+0000 7f308b52f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3084071320 con 0x7f30840b1700 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f30840c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f30840c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54846/0 (socket says 172.21.15.6:54846) 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 -- 172.21.15.6:0/1860505847 learned_addr learned my addr 172.21.15.6:0/1860505847 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3088aca640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30840b1700 0x7f30840c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f30892cb640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3084070850 0x7f3084159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 -- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30840b1700 msgr2=0x7f30840c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30840b1700 0x7f30840c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 -- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3084070850 msgr2=0x7f3084159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3084070850 0x7f3084159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 -- 172.21.15.6:0/1860505847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30840c6a50 con 0x7f308415d530 2024-05-20T17:54:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3088aca640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30840b1700 0x7f30840c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:01.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3089acc640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f30840c8ec0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f307c00e7c0 tx=0x7f307c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:01.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3081ffb640 1 -- 172.21.15.6:0/1860505847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c017070 con 0x7f308415d530 2024-05-20T17:54:01.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3081ffb640 1 -- 172.21.15.6:0/1860505847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307c00c730 con 0x7f308415d530 2024-05-20T17:54:01.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30840c5d80 con 0x7f308415d530 2024-05-20T17:54:01.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.717+0000 7f3081ffb640 1 -- 172.21.15.6:0/1860505847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c00cb20 con 0x7f308415d530 2024-05-20T17:54:01.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.718+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30841f6bb0 con 0x7f308415d530 2024-05-20T17:54:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.719+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30841f6e10 con 0x7f308415d530 2024-05-20T17:54:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.719+0000 7f3081ffb640 1 -- 172.21.15.6:0/1860505847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f307c01a070 con 0x7f308415d530 2024-05-20T17:54:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.720+0000 7f3081ffb640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f307006be30 0x7f307006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.720+0000 7f3081ffb640 1 -- 172.21.15.6:0/1860505847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f307c08b590 con 0x7f308415d530 2024-05-20T17:54:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.720+0000 7f30892cb640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f307006be30 0x7f307006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:01.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.721+0000 7f30892cb640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f307006be30 0x7f307006e340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3074033000 tx=0x7f3074009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:01.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.724+0000 7f3081ffb640 1 -- 172.21.15.6:0/1860505847 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f307c0599d0 con 0x7f308415d530 2024-05-20T17:54:01.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.910+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3084075b00 con 0x7f308415d530 2024-05-20T17:54:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.912+0000 7f3081ffb640 1 -- 172.21.15.6:0/1860505847 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f307c0592d0 con 0x7f308415d530 2024-05-20T17:54:01.911 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:01.911 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f307006be30 msgr2=0x7f307006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f307006be30 0x7f307006e340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3074033000 tx=0x7f3074009000 comp rx=0 tx=0).stop 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 msgr2=0x7f30840c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f30840c8ec0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f307c00e7c0 tx=0x7f307c00ec80 comp rx=0 tx=0).stop 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 shutdown_connections 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f307006be30 0x7f307006e340 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f308415d530 0x7f30840c8ec0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30840b1700 0x7f30840c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 --2- 172.21.15.6:0/1860505847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3084070850 0x7f3084159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 >> 172.21.15.6:0/1860505847 conn(0x7f30840d29d0 msgr2=0x7f30840d1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 shutdown_connections 2024-05-20T17:54:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:01.914+0000 7f308b52f640 1 -- 172.21.15.6:0/1860505847 wait complete. 2024-05-20T17:54:01.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:54:01.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:54:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.044+0000 7fad12f2c640 1 Processor -- start 2024-05-20T17:54:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.044+0000 7fad12f2c640 1 -- start start 2024-05-20T17:54:02.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.045+0000 7fad12f2c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c15f460 0x7fad0c0d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.045+0000 7fad12f2c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0c0d0550 con 0x7fad0c0b6d90 2024-05-20T17:54:02.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.045+0000 7fad12f2c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0c0d0830 con 0x7fad0c0cf250 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.045+0000 7fad12f2c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c0d0b10 con 0x7fad0c15f460 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.045+0000 7fad03fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fad0c0b6d90 0x7fad0c0d3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36874/0 (socket says 172.21.15.6:36874) 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.045+0000 7fad03fff640 1 -- 172.21.15.6:0/3864340328 learned_addr learned my addr 172.21.15.6:0/3864340328 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad114c9640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c15f460 0x7fad0c0d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2591955190 0 0) 0x7fad0c0d0550 con 0x7fad0c0b6d90 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf4003520 con 0x7fad0c0b6d90 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 896462813 0 0) 0x7facf4003520 con 0x7fad0c0b6d90 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c15f460 msgr2=0x7fad0c0d3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c15f460 0x7fad0c0d3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 >> v1:172.21.15.171:6789/0 conn(0x7fad0c0cf250 legacy=0x7fad0c0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c0d2a20 con 0x7fad0c0b6d90 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7facfc001670 con 0x7fad0c0b6d90 2024-05-20T17:54:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 >> v1:172.21.15.6:6789/0 conn(0x7fad0c0b6d90 legacy=0x7fad0c0d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c15f460 0x7facf40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4003f60 0x7facf4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4004d40 0x7facf4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7facf400bb50 con 0x7facf4003f60 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7facf400bcd0 con 0x7facf4004d40 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.046+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7facf400bed0 con 0x7fad0c15f460 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.047+0000 7fad03fff640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4003f60 0x7facf4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.047+0000 7fad114c9640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4004d40 0x7facf4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.047+0000 7fad10cc8640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c15f460 0x7facf40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.047+0000 7fad03fff640 1 -- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c15f460 msgr2=0x7facf40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.047+0000 7fad03fff640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c15f460 0x7facf40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.047+0000 7fad03fff640 1 -- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4004d40 msgr2=0x7facf4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.047+0000 7fad03fff640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4004d40 0x7facf4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.047+0000 7fad03fff640 1 -- 172.21.15.6:0/3864340328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf4003520 con 0x7facf4003f60 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.048+0000 7fad03fff640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4003f60 0x7facf4004800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c1e0 tx=0x7facf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83ccb879dbc99f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.048+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc007cc0 con 0x7facf4003f60 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.048+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc005ad0 con 0x7facf4003f60 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.048+0000 7fad037fe640 1 -- 172.21.15.6:0/3864340328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc007070 con 0x7facf4003f60 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.049+0000 7fad12f2c640 1 -- 172.21.15.6:0/3864340328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4003f60 msgr2=0x7facf4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.049+0000 7fad12f2c640 1 --2- 172.21.15.6:0/3864340328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facf4003f60 0x7facf4004800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c1e0 tx=0x7facf4005830 comp rx=0 tx=0).stop 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.049+0000 7fad114c9640 1 -- 172.21.15.6:0/3864340328 reap_dead start 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.049+0000 7fad12f2c640 1 -- 172.21.15.6:0/3864340328 shutdown_connections 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.049+0000 7fad12f2c640 1 -- 172.21.15.6:0/3864340328 >> 172.21.15.6:0/3864340328 conn(0x7fad0c0d1860 msgr2=0x7fad0c0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.049+0000 7fad12f2c640 1 -- 172.21.15.6:0/3864340328 shutdown_connections 2024-05-20T17:54:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.049+0000 7fad12f2c640 1 -- 172.21.15.6:0/3864340328 wait complete. 2024-05-20T17:54:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.050+0000 7fad12f2c640 1 Processor -- start 2024-05-20T17:54:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.050+0000 7fad12f2c640 1 -- start start 2024-05-20T17:54:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad12f2c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4003f60 0x7fad0c161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad12f2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad0c0cea00 0x7fad0c1622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad12f2c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c1f51e0 0x7fad0c1f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad12f2c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c15f870 con 0x7fad0c0cea00 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad12f2c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c0d27d0 con 0x7facf4003f60 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad12f2c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c0d0140 con 0x7fad0c1f51e0 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad03fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad0c0cea00 0x7fad0c1622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad03fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad0c0cea00 0x7fad0c1622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54862/0 (socket says 172.21.15.6:54862) 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad03fff640 1 -- 172.21.15.6:0/736338679 learned_addr learned my addr 172.21.15.6:0/736338679 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad10cc8640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4003f60 0x7fad0c161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad114c9640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c1f51e0 0x7fad0c1f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad03fff640 1 -- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c1f51e0 msgr2=0x7fad0c1f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad03fff640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c1f51e0 0x7fad0c1f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad03fff640 1 -- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4003f60 msgr2=0x7fad0c161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad03fff640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4003f60 0x7fad0c161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.052+0000 7fad03fff640 1 -- 172.21.15.6:0/736338679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c1605f0 con 0x7fad0c0cea00 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.053+0000 7fad03fff640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad0c0cea00 0x7fad0c1622f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7facfc02ad60 tx=0x7fad0c0d2bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.053+0000 7fad017fa640 1 -- 172.21.15.6:0/736338679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc001630 con 0x7fad0c0cea00 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.053+0000 7fad017fa640 1 -- 172.21.15.6:0/736338679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc042070 con 0x7fad0c0cea00 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.053+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c1608d0 con 0x7fad0c0cea00 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.053+0000 7fad017fa640 1 -- 172.21.15.6:0/736338679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc007270 con 0x7fad0c0cea00 2024-05-20T17:54:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.053+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c160e90 con 0x7fad0c0cea00 2024-05-20T17:54:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.054+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0c162a40 con 0x7fad0c0cea00 2024-05-20T17:54:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.054+0000 7fad017fa640 1 -- 172.21.15.6:0/736338679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facfc007410 con 0x7fad0c0cea00 2024-05-20T17:54:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.055+0000 7fad017fa640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7facf806be30 0x7facf806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.055+0000 7fad017fa640 1 -- 172.21.15.6:0/736338679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7facfc0ab4d0 con 0x7fad0c0cea00 2024-05-20T17:54:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.055+0000 7fad10cc8640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7facf806be30 0x7facf806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.056+0000 7fad10cc8640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7facf806be30 0x7facf806e340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad080017e0 tx=0x7fad08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.060+0000 7fad017fa640 1 -- 172.21.15.6:0/736338679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7facfc005aa0 con 0x7fad0c0cea00 2024-05-20T17:54:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.243+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fad0c075b00 con 0x7fad0c0cea00 2024-05-20T17:54:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.243+0000 7fad017fa640 1 -- 172.21.15.6:0/736338679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7facfc079360 con 0x7fad0c0cea00 2024-05-20T17:54:02.243 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:54:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.245+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7facf806be30 msgr2=0x7facf806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.245+0000 7fad12f2c640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7facf806be30 0x7facf806e340 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad080017e0 tx=0x7fad08009040 comp rx=0 tx=0).stop 2024-05-20T17:54:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.245+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad0c0cea00 msgr2=0x7fad0c1622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.245+0000 7fad12f2c640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad0c0cea00 0x7fad0c1622f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7facfc02ad60 tx=0x7fad0c0d2bf0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.246+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 shutdown_connections 2024-05-20T17:54:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.246+0000 7fad12f2c640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7facf806be30 0x7facf806e340 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.246+0000 7fad12f2c640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad0c1f51e0 0x7fad0c1f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.246+0000 7fad12f2c640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad0c0cea00 0x7fad0c1622f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.246+0000 7fad12f2c640 1 --2- 172.21.15.6:0/736338679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facf4003f60 0x7fad0c161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.246+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 >> 172.21.15.6:0/736338679 conn(0x7fad0c0d1860 msgr2=0x7fad0c15a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.246+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 shutdown_connections 2024-05-20T17:54:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.246+0000 7fad12f2c640 1 -- 172.21.15.6:0/736338679 wait complete. 2024-05-20T17:54:02.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:54:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.376+0000 7efd9e27a640 1 Processor -- start 2024-05-20T17:54:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.376+0000 7efd9e27a640 1 -- start start 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd9e27a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efd98162820 0x7efd980b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd9e27a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 0x7efd9806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd9e27a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9806dd20 con 0x7efd9806d910 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd9e27a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7efd980d0630 con 0x7efd98162820 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd9e27a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd980d39c0 con 0x7efd980b3e80 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd97fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efd98162820 0x7efd980b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd9c817640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efd9806d910 0x7efd980d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36876/0 (socket says 172.21.15.6:36876) 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd9c817640 1 -- 172.21.15.6:0/3678318341 learned_addr learned my addr 172.21.15.6:0/3678318341 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd977fe640 1 --2- 172.21.15.6:0/3678318341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 0x7efd9806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd97fff640 1 -- 172.21.15.6:0/3678318341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 msgr2=0x7efd9806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd97fff640 1 --2- 172.21.15.6:0/3678318341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 0x7efd9806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd97fff640 1 -- 172.21.15.6:0/3678318341 >> v1:172.21.15.6:6789/0 conn(0x7efd9806d910 legacy=0x7efd980d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd96ffd640 1 -- 172.21.15.6:0/3678318341 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133937889 0 0) 0x7efd90001490 con 0x7efd9806d910 2024-05-20T17:54:02.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.378+0000 7efd97fff640 1 -- 172.21.15.6:0/3678318341 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd980d3ca0 con 0x7efd98162820 2024-05-20T17:54:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.379+0000 7efd97fff640 1 --2- 172.21.15.6:0/3678318341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd98162820 0x7efd980b3940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efd880097a0 tx=0x7efd8802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48d751c33d48832 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.379+0000 7efd96ffd640 1 -- 172.21.15.6:0/3678318341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88037070 con 0x7efd98162820 2024-05-20T17:54:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.379+0000 7efd96ffd640 1 -- 172.21.15.6:0/3678318341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd88032440 con 0x7efd98162820 2024-05-20T17:54:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.379+0000 7efd96ffd640 1 -- 172.21.15.6:0/3678318341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88032810 con 0x7efd98162820 2024-05-20T17:54:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.380+0000 7efd9e27a640 1 -- 172.21.15.6:0/3678318341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd98162820 msgr2=0x7efd980b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.380+0000 7efd9e27a640 1 --2- 172.21.15.6:0/3678318341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd98162820 0x7efd980b3940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efd880097a0 tx=0x7efd8802a180 comp rx=0 tx=0).stop 2024-05-20T17:54:02.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.380+0000 7efd9e27a640 1 -- 172.21.15.6:0/3678318341 shutdown_connections 2024-05-20T17:54:02.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.380+0000 7efd9e27a640 1 --2- 172.21.15.6:0/3678318341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 0x7efd9806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.380+0000 7efd9e27a640 1 --2- 172.21.15.6:0/3678318341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd98162820 0x7efd980b3940 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.380+0000 7efd9e27a640 1 -- 172.21.15.6:0/3678318341 >> 172.21.15.6:0/3678318341 conn(0x7efd980d4bd0 msgr2=0x7efd980d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:02.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.380+0000 7efd9e27a640 1 -- 172.21.15.6:0/3678318341 shutdown_connections 2024-05-20T17:54:02.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.380+0000 7efd9e27a640 1 -- 172.21.15.6:0/3678318341 wait complete. 2024-05-20T17:54:02.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.382+0000 7efd9e27a640 1 Processor -- start 2024-05-20T17:54:02.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.382+0000 7efd9e27a640 1 -- start start 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd9e27a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd9806d910 0x7efd9815f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd9e27a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 0x7efd980cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd9e27a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd98162820 0x7efd980ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd9e27a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd980d0300 con 0x7efd9806d910 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd9e27a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efd980d4260 con 0x7efd98162820 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd9e27a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd980b91a0 con 0x7efd980b3e80 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd97fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd9806d910 0x7efd9815f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd97fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd9806d910 0x7efd9815f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54878/0 (socket says 172.21.15.6:54878) 2024-05-20T17:54:02.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd97fff640 1 -- 172.21.15.6:0/1880221918 learned_addr learned my addr 172.21.15.6:0/1880221918 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd977fe640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 0x7efd980cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.383+0000 7efd9c817640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd98162820 0x7efd980ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd97fff640 1 -- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 msgr2=0x7efd980cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd97fff640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 0x7efd980cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd97fff640 1 -- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd98162820 msgr2=0x7efd980ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd97fff640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd98162820 0x7efd980ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd97fff640 1 -- 172.21.15.6:0/1880221918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd98160270 con 0x7efd9806d910 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd97fff640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd9806d910 0x7efd9815f990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efd88035040 tx=0x7efd880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd94ff9640 1 -- 172.21.15.6:0/1880221918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88037050 con 0x7efd9806d910 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd94ff9640 1 -- 172.21.15.6:0/1880221918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd88038040 con 0x7efd9806d910 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd98160550 con 0x7efd9806d910 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd94ff9640 1 -- 172.21.15.6:0/1880221918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88004490 con 0x7efd9806d910 2024-05-20T17:54:02.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.384+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd980c8b60 con 0x7efd9806d910 2024-05-20T17:54:02.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.385+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd98075b00 con 0x7efd9806d910 2024-05-20T17:54:02.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.386+0000 7efd94ff9640 1 -- 172.21.15.6:0/1880221918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd88030900 con 0x7efd9806d910 2024-05-20T17:54:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.386+0000 7efd94ff9640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd8406be60 0x7efd8406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.386+0000 7efd94ff9640 1 -- 172.21.15.6:0/1880221918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7efd880aba70 con 0x7efd9806d910 2024-05-20T17:54:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.387+0000 7efd977fe640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd8406be60 0x7efd8406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.387+0000 7efd977fe640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd8406be60 0x7efd8406e370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efd980baa80 tx=0x7efd8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.391+0000 7efd94ff9640 1 -- 172.21.15.6:0/1880221918 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd8804c020 con 0x7efd9806d910 2024-05-20T17:54:02.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.574+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efd98160720 con 0x7efd9806d910 2024-05-20T17:54:02.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.574+0000 7efd94ff9640 1 -- 172.21.15.6:0/1880221918 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7efd88079b40 con 0x7efd9806d910 2024-05-20T17:54:02.574 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.576+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd8406be60 msgr2=0x7efd8406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd8406be60 0x7efd8406e370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efd980baa80 tx=0x7efd8c008040 comp rx=0 tx=0).stop 2024-05-20T17:54:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd9806d910 msgr2=0x7efd9815f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd9806d910 0x7efd9815f990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efd88035040 tx=0x7efd880046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 shutdown_connections 2024-05-20T17:54:02.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd8406be60 0x7efd8406e370 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd98162820 0x7efd980ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd980b3e80 0x7efd980cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 --2- 172.21.15.6:0/1880221918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd9806d910 0x7efd9815f990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 >> 172.21.15.6:0/1880221918 conn(0x7efd980d4bd0 msgr2=0x7efd980b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:02.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 shutdown_connections 2024-05-20T17:54:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.577+0000 7efd9e27a640 1 -- 172.21.15.6:0/1880221918 wait complete. 2024-05-20T17:54:02.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:54:02.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.705+0000 7effa60eb640 1 Processor -- start 2024-05-20T17:54:02.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.705+0000 7effa60eb640 1 -- start start 2024-05-20T17:54:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7effa60eb640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7effa0168050 0x7effa016a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7effa60eb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00d0630 con 0x7effa006d3d0 2024-05-20T17:54:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7effa60eb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00d39c0 con 0x7effa0162820 2024-05-20T17:54:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7effa60eb640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7effa00d3ca0 con 0x7effa0168050 2024-05-20T17:54:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7eff9effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7effa006d3d0 0x7effa006d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36890/0 (socket says 172.21.15.6:36890) 2024-05-20T17:54:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7eff9effd640 1 -- 172.21.15.6:0/3510338517 learned_addr learned my addr 172.21.15.6:0/3510338517 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7eff9ffff640 1 --2- 172.21.15.6:0/3510338517 >> v2:172.21.15.171:3300/0 conn(0x7effa0168050 0x7effa016a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844914674 0 0) 0x7effa00d0630 con 0x7effa006d3d0 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.707+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff88003520 con 0x7effa006d3d0 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1704942117 0 0) 0x7eff88003520 con 0x7effa006d3d0 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 >> v2:172.21.15.171:3300/0 conn(0x7effa0168050 msgr2=0x7effa016a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 --2- 172.21.15.6:0/3510338517 >> v2:172.21.15.171:3300/0 conn(0x7effa0168050 0x7effa016a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 >> v1:172.21.15.171:6789/0 conn(0x7effa0162820 legacy=0x7effa00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa00d3f80 con 0x7effa006d3d0 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7eff94001670 con 0x7effa006d3d0 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 >> v1:172.21.15.6:6789/0 conn(0x7effa006d3d0 legacy=0x7effa006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff880039b0 0x7eff88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff88004800 0x7eff88004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff880051c0 0x7eff8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effa00d3ca0 con 0x7eff88004800 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff8800c160 con 0x7eff880039b0 2024-05-20T17:54:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7eff8800c360 con 0x7eff880051c0 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9effd640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff88004800 0x7eff88004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9f7fe640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff880039b0 0x7eff88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9ffff640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff880051c0 0x7eff8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9effd640 1 -- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff880051c0 msgr2=0x7eff8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9effd640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff880051c0 0x7eff8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9effd640 1 -- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff880039b0 msgr2=0x7eff88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9effd640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff880039b0 0x7eff88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9effd640 1 -- 172.21.15.6:0/3510338517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff88003520 con 0x7eff88004800 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9ffff640 1 -- 172.21.15.6:0/3510338517 reap_dead start 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.708+0000 7eff9f7fe640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff880039b0 0x7eff88003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.709+0000 7eff9effd640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff88004800 0x7eff88004c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c240 tx=0x7eff88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ddb353dadadddf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.709+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94007cf0 con 0x7eff88004800 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.709+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94005af0 con 0x7eff88004800 2024-05-20T17:54:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.709+0000 7eff9e7fc640 1 -- 172.21.15.6:0/3510338517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94007070 con 0x7eff88004800 2024-05-20T17:54:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.710+0000 7effa60eb640 1 -- 172.21.15.6:0/3510338517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff88004800 msgr2=0x7eff88004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.710+0000 7effa60eb640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff88004800 0x7eff88004c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c240 tx=0x7eff88005830 comp rx=0 tx=0).stop 2024-05-20T17:54:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.710+0000 7effa60eb640 1 -- 172.21.15.6:0/3510338517 shutdown_connections 2024-05-20T17:54:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.710+0000 7effa60eb640 1 --2- 172.21.15.6:0/3510338517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff88004800 0x7eff88004c10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.710+0000 7effa60eb640 1 -- 172.21.15.6:0/3510338517 >> 172.21.15.6:0/3510338517 conn(0x7effa00d4bd0 msgr2=0x7effa00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.710+0000 7effa60eb640 1 -- 172.21.15.6:0/3510338517 shutdown_connections 2024-05-20T17:54:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.710+0000 7effa60eb640 1 -- 172.21.15.6:0/3510338517 wait complete. 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.712+0000 7effa60eb640 1 Processor -- start 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.712+0000 7effa60eb640 1 -- start start 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7effa60eb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff88004800 0x7effa00cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7effa60eb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa0153d10 0x7effa01535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7effa60eb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa0159690 0x7effa0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7effa60eb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effa00d4780 con 0x7effa0159690 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7effa60eb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7effa00d0300 con 0x7effa0153d10 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7effa60eb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7effa00d4900 con 0x7eff88004800 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa0159690 0x7effa0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa0159690 0x7effa0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54896/0 (socket says 172.21.15.6:54896) 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7eff9ffff640 1 -- 172.21.15.6:0/3426024347 learned_addr learned my addr 172.21.15.6:0/3426024347 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7eff9f7fe640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff88004800 0x7effa00cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.713+0000 7eff9effd640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa0153d10 0x7effa01535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff9ffff640 1 -- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff88004800 msgr2=0x7effa00cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff9ffff640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff88004800 0x7effa00cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff9ffff640 1 -- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa0153d10 msgr2=0x7effa01535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff9ffff640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa0153d10 0x7effa01535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff9ffff640 1 -- 172.21.15.6:0/3426024347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa0153ae0 con 0x7effa0159690 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff9ffff640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa0159690 0x7effa0159aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7effa008d5e0 tx=0x7eff9800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff87fff640 1 -- 172.21.15.6:0/3426024347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9800fdb0 con 0x7effa0159690 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff87fff640 1 -- 172.21.15.6:0/3426024347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9801d070 con 0x7effa0159690 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7eff87fff640 1 -- 172.21.15.6:0/3426024347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98015670 con 0x7effa0159690 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa015c430 con 0x7effa0159690 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.714+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa00ca680 con 0x7effa0159690 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.715+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa015c1a0 con 0x7effa0159690 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.716+0000 7eff87fff640 1 -- 172.21.15.6:0/3426024347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff98015810 con 0x7effa0159690 2024-05-20T17:54:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.716+0000 7eff87fff640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff8c06be30 0x7eff8c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:02.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.717+0000 7eff87fff640 1 -- 172.21.15.6:0/3426024347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7eff9808bca0 con 0x7effa0159690 2024-05-20T17:54:02.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.717+0000 7eff9f7fe640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff8c06be30 0x7eff8c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:02.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.717+0000 7eff9f7fe640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff8c06be30 0x7eff8c06e340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff90000c00 tx=0x7eff90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:02.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.721+0000 7eff87fff640 1 -- 172.21.15.6:0/3426024347 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7eff98010040 con 0x7effa0159690 2024-05-20T17:54:02.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.905+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7effa00ca190 con 0x7effa0159690 2024-05-20T17:54:02.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.906+0000 7eff87fff640 1 -- 172.21.15.6:0/3426024347 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7eff9808b030 con 0x7effa0159690 2024-05-20T17:54:02.905 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:54:02.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff8c06be30 msgr2=0x7eff8c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff8c06be30 0x7eff8c06e340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7eff90000c00 tx=0x7eff90009040 comp rx=0 tx=0).stop 2024-05-20T17:54:02.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa0159690 msgr2=0x7effa0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa0159690 0x7effa0159aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7effa008d5e0 tx=0x7eff9800f580 comp rx=0 tx=0).stop 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 shutdown_connections 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff8c06be30 0x7eff8c06e340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa0159690 0x7effa0159aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa0153d10 0x7effa01535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 --2- 172.21.15.6:0/3426024347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff88004800 0x7effa00cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 >> 172.21.15.6:0/3426024347 conn(0x7effa00d4bd0 msgr2=0x7effa006d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 shutdown_connections 2024-05-20T17:54:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:02.908+0000 7effa60eb640 1 -- 172.21.15.6:0/3426024347 wait complete. 2024-05-20T17:54:02.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:54:03.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.036+0000 7f9538ed7640 1 Processor -- start 2024-05-20T17:54:03.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.037+0000 7f9538ed7640 1 -- start start 2024-05-20T17:54:03.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.038+0000 7f9538ed7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953406b520 0x7f953406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.038+0000 7f9538ed7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f953406eab0 0x7f953415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.038+0000 7f9538ed7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f953406ba20 con 0x7f9534157770 2024-05-20T17:54:03.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.038+0000 7f9538ed7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f953406c630 con 0x7f953406eab0 2024-05-20T17:54:03.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.038+0000 7f9538ed7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f953406bd00 con 0x7f953406b520 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.038+0000 7f9532d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f953406eab0 0x7f953415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.038+0000 7f9532d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f953406eab0 0x7f953415d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54900/0 (socket says 172.21.15.6:54900) 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.038+0000 7f9532d9d640 1 -- 172.21.15.6:0/691339192 learned_addr learned my addr 172.21.15.6:0/691339192 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.039+0000 7f953259c640 1 --2- 172.21.15.6:0/691339192 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953406b520 0x7f953406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.039+0000 7f9532d9d640 1 -- 172.21.15.6:0/691339192 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953406b520 msgr2=0x7f953406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.039+0000 7f9532d9d640 1 --2- 172.21.15.6:0/691339192 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953406b520 0x7f953406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.039+0000 7f9532d9d640 1 -- 172.21.15.6:0/691339192 >> v1:172.21.15.171:6789/0 conn(0x7f9534157770 legacy=0x7f953406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.039+0000 7f9532d9d640 1 -- 172.21.15.6:0/691339192 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953406bfe0 con 0x7f953406eab0 2024-05-20T17:54:03.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.039+0000 7f953259c640 1 --2- 172.21.15.6:0/691339192 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953406b520 0x7f953406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:03.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.039+0000 7f9532d9d640 1 --2- 172.21.15.6:0/691339192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953406eab0 0x7f953415d5f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f952c009870 tx=0x7f952c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d07395c76734671 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:03.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f953159a640 1 -- 172.21.15.6:0/691339192 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c037070 con 0x7f953406eab0 2024-05-20T17:54:03.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f953159a640 1 -- 172.21.15.6:0/691339192 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952c032440 con 0x7f953406eab0 2024-05-20T17:54:03.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f953159a640 1 -- 172.21.15.6:0/691339192 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c032810 con 0x7f953406eab0 2024-05-20T17:54:03.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f9538ed7640 1 -- 172.21.15.6:0/691339192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953406eab0 msgr2=0x7f953415d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f9538ed7640 1 --2- 172.21.15.6:0/691339192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953406eab0 0x7f953415d5f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f952c009870 tx=0x7f952c02a210 comp rx=0 tx=0).stop 2024-05-20T17:54:03.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f9538ed7640 1 -- 172.21.15.6:0/691339192 shutdown_connections 2024-05-20T17:54:03.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f9538ed7640 1 --2- 172.21.15.6:0/691339192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f953406eab0 0x7f953415d5f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f9538ed7640 1 --2- 172.21.15.6:0/691339192 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953406b520 0x7f953406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f9538ed7640 1 -- 172.21.15.6:0/691339192 >> 172.21.15.6:0/691339192 conn(0x7f95340cd2a0 msgr2=0x7f95340cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:03.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f9538ed7640 1 -- 172.21.15.6:0/691339192 shutdown_connections 2024-05-20T17:54:03.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.040+0000 7f9538ed7640 1 -- 172.21.15.6:0/691339192 wait complete. 2024-05-20T17:54:03.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.042+0000 7f9538ed7640 1 Processor -- start 2024-05-20T17:54:03.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.042+0000 7f9538ed7640 1 -- start start 2024-05-20T17:54:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9538ed7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f953406b520 0x7f953414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9538ed7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9534157770 0x7f953414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9538ed7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953415a220 0x7f953415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9538ed7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f953406f0c0 con 0x7f9534157770 2024-05-20T17:54:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9538ed7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f953406ef40 con 0x7f953406b520 2024-05-20T17:54:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9538ed7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f95340ce6c0 con 0x7f953415a220 2024-05-20T17:54:03.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9534157770 0x7f953414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9534157770 0x7f953414e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54904/0 (socket says 172.21.15.6:54904) 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 -- 172.21.15.6:0/347051873 learned_addr learned my addr 172.21.15.6:0/347051873 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f953259c640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f953406b520 0x7f953414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9532d9d640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953415a220 0x7f953415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 -- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953415a220 msgr2=0x7f953415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953415a220 0x7f953415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 -- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f953406b520 msgr2=0x7f953414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f953406b520 0x7f953414dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 -- 172.21.15.6:0/347051873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953414e900 con 0x7f9534157770 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9532d9d640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953415a220 0x7f953415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.044+0000 7f9531d9b640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9534157770 0x7f953414e3c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f951c00b420 tx=0x7f951c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.045+0000 7f952affd640 1 -- 172.21.15.6:0/347051873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c011830 con 0x7f9534157770 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.045+0000 7f952affd640 1 -- 172.21.15.6:0/347051873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951c016070 con 0x7f9534157770 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.045+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953415ab70 con 0x7f9534157770 2024-05-20T17:54:03.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.045+0000 7f952affd640 1 -- 172.21.15.6:0/347051873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c011c10 con 0x7f9534157770 2024-05-20T17:54:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.045+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9534158ee0 con 0x7f9534157770 2024-05-20T17:54:03.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.046+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9534075b00 con 0x7f9534157770 2024-05-20T17:54:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.046+0000 7f952affd640 1 -- 172.21.15.6:0/347051873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f951c01b460 con 0x7f9534157770 2024-05-20T17:54:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.047+0000 7f952affd640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f951406be60 0x7f951406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.047+0000 7f952affd640 1 -- 172.21.15.6:0/347051873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f951c08adb0 con 0x7f9534157770 2024-05-20T17:54:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.047+0000 7f953259c640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f951406be60 0x7f951406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.048+0000 7f953259c640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f951406be60 0x7f951406e370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f95240070b0 tx=0x7f9524007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:03.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.051+0000 7f952affd640 1 -- 172.21.15.6:0/347051873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f951c020020 con 0x7f9534157770 2024-05-20T17:54:03.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.238+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f953415a000 con 0x7f9534157770 2024-05-20T17:54:03.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.239+0000 7f952affd640 1 -- 172.21.15.6:0/347051873 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f953415ab70 con 0x7f9534157770 2024-05-20T17:54:03.238 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f951406be60 msgr2=0x7f951406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f951406be60 0x7f951406e370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f95240070b0 tx=0x7f9524007040 comp rx=0 tx=0).stop 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9534157770 msgr2=0x7f953414e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9534157770 0x7f953414e3c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f951c00b420 tx=0x7f951c00b8e0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 shutdown_connections 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f951406be60 0x7f951406e370 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f953415a220 0x7f953415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9534157770 0x7f953414e3c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 --2- 172.21.15.6:0/347051873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f953406b520 0x7f953414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 >> 172.21.15.6:0/347051873 conn(0x7f95340cd2a0 msgr2=0x7f9534155c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 shutdown_connections 2024-05-20T17:54:03.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.241+0000 7f9538ed7640 1 -- 172.21.15.6:0/347051873 wait complete. 2024-05-20T17:54:03.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:54:03.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.368+0000 7fbf00585640 1 Processor -- start 2024-05-20T17:54:03.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.369+0000 7fbf00585640 1 -- start start 2024-05-20T17:54:03.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbf00585640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806d3d0 0x7fbef806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbf00585640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbef80b8190 0x7fbef80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbf00585640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef806dd20 con 0x7fbef8162820 2024-05-20T17:54:03.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbf00585640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbef80d0630 con 0x7fbef80b8190 2024-05-20T17:54:03.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbf00585640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbef80d39c0 con 0x7fbef806d3d0 2024-05-20T17:54:03.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbefe321640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbef8162820 0x7fbef80b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36896/0 (socket says 172.21.15.6:36896) 2024-05-20T17:54:03.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbefe321640 1 -- 172.21.15.6:0/593059717 learned_addr learned my addr 172.21.15.6:0/593059717 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbefdb20640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806d3d0 0x7fbef806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019658765 0 0) 0x7fbee8001490 con 0x7fbef8162820 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbefeb22640 1 --2- 172.21.15.6:0/593059717 >> v2:172.21.15.171:3300/0 conn(0x7fbef80b8190 0x7fbef80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.370+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbee0003520 con 0x7fbef8162820 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1168978345 0 0) 0x7fbee0003520 con 0x7fbef8162820 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806d3d0 msgr2=0x7fbef806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806d3d0 0x7fbef806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 >> v2:172.21.15.171:3300/0 conn(0x7fbef80b8190 msgr2=0x7fbef80b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 --2- 172.21.15.6:0/593059717 >> v2:172.21.15.171:3300/0 conn(0x7fbef80b8190 0x7fbef80b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef80d3ca0 con 0x7fbef8162820 2024-05-20T17:54:03.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fbee8001bc0 con 0x7fbef8162820 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 >> v1:172.21.15.6:6789/0 conn(0x7fbef8162820 legacy=0x7fbef80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee00039b0 0x7fbee0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806d3d0 0x7fbee0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee0004d40 0x7fbee0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80d0630 con 0x7fbee00039b0 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80d39c0 con 0x7fbee0004d40 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbee000b9c0 con 0x7fbef806d3d0 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefe321640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee00039b0 0x7fbee0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefdb20640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806d3d0 0x7fbee0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefeb22640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee0004d40 0x7fbee0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefe321640 1 -- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806d3d0 msgr2=0x7fbee0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefe321640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef806d3d0 0x7fbee0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefe321640 1 -- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee0004d40 msgr2=0x7fbee0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefe321640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee0004d40 0x7fbee0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.371+0000 7fbefe321640 1 -- 172.21.15.6:0/593059717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee0003520 con 0x7fbee00039b0 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.372+0000 7fbefe321640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee00039b0 0x7fbee0003e20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbee800aa50 tx=0x7fbee0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceed81a15a273ae server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.372+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee800a670 con 0x7fbee00039b0 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.372+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee802f070 con 0x7fbee00039b0 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.372+0000 7fbefd31f640 1 -- 172.21.15.6:0/593059717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8034470 con 0x7fbee00039b0 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.373+0000 7fbf00585640 1 -- 172.21.15.6:0/593059717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee00039b0 msgr2=0x7fbee0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.373+0000 7fbf00585640 1 --2- 172.21.15.6:0/593059717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbee00039b0 0x7fbee0003e20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbee800aa50 tx=0x7fbee0005830 comp rx=0 tx=0).stop 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.373+0000 7fbefeb22640 1 -- 172.21.15.6:0/593059717 reap_dead start 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.373+0000 7fbf00585640 1 -- 172.21.15.6:0/593059717 shutdown_connections 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.373+0000 7fbf00585640 1 -- 172.21.15.6:0/593059717 >> 172.21.15.6:0/593059717 conn(0x7fbef80d4bd0 msgr2=0x7fbef80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.373+0000 7fbf00585640 1 -- 172.21.15.6:0/593059717 shutdown_connections 2024-05-20T17:54:03.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.373+0000 7fbf00585640 1 -- 172.21.15.6:0/593059717 wait complete. 2024-05-20T17:54:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.375+0000 7fbf00585640 1 Processor -- start 2024-05-20T17:54:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.375+0000 7fbf00585640 1 -- start start 2024-05-20T17:54:03.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbf00585640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee00039b0 0x7fbef8151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbf00585640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef81f8ca0 0x7fbef815f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbf00585640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef8153620 0x7fbef815f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbf00585640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80d0300 con 0x7fbef8153620 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbf00585640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80d4260 con 0x7fbee00039b0 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbf00585640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbef80b4050 con 0x7fbef81f8ca0 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbefeb22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef8153620 0x7fbef815f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbefeb22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef8153620 0x7fbef815f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54930/0 (socket says 172.21.15.6:54930) 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.376+0000 7fbefeb22640 1 -- 172.21.15.6:0/4222394621 learned_addr learned my addr 172.21.15.6:0/4222394621 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbefdb20640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef81f8ca0 0x7fbef815f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbefe321640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee00039b0 0x7fbef8151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbefeb22640 1 -- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef81f8ca0 msgr2=0x7fbef815f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbefeb22640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef81f8ca0 0x7fbef815f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbefeb22640 1 -- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee00039b0 msgr2=0x7fbef8151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbefeb22640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee00039b0 0x7fbef8151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbefeb22640 1 -- 172.21.15.6:0/4222394621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef8151e70 con 0x7fbef8153620 2024-05-20T17:54:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbefeb22640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef8153620 0x7fbef815f600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbef808e090 tx=0x7fbef0011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbef6ffd640 1 -- 172.21.15.6:0/4222394621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0004030 con 0x7fbef8153620 2024-05-20T17:54:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbef6ffd640 1 -- 172.21.15.6:0/4222394621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef001b070 con 0x7fbef8153620 2024-05-20T17:54:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef81f9480 con 0x7fbef8153620 2024-05-20T17:54:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbef6ffd640 1 -- 172.21.15.6:0/4222394621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0004430 con 0x7fbef8153620 2024-05-20T17:54:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.377+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81f9a40 con 0x7fbef8153620 2024-05-20T17:54:03.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.378+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef81520c0 con 0x7fbef8153620 2024-05-20T17:54:03.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.379+0000 7fbef6ffd640 1 -- 172.21.15.6:0/4222394621 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbef0012040 con 0x7fbef8153620 2024-05-20T17:54:03.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.380+0000 7fbef6ffd640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbee406be60 0x7fbee406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.380+0000 7fbef6ffd640 1 -- 172.21.15.6:0/4222394621 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fbef008ae50 con 0x7fbef8153620 2024-05-20T17:54:03.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.380+0000 7fbefe321640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbee406be60 0x7fbee406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.380+0000 7fbefe321640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbee406be60 0x7fbee406e370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbee8033000 tx=0x7fbee8007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:03.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.384+0000 7fbef6ffd640 1 -- 172.21.15.6:0/4222394621 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbef00593c0 con 0x7fbef8153620 2024-05-20T17:54:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.584+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbef81f9210 con 0x7fbef8153620 2024-05-20T17:54:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.585+0000 7fbef6ffd640 1 -- 172.21.15.6:0/4222394621 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fbef0058cc0 con 0x7fbef8153620 2024-05-20T17:54:03.584 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:54:03.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbee406be60 msgr2=0x7fbee406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbee406be60 0x7fbee406e370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbee8033000 tx=0x7fbee8007000 comp rx=0 tx=0).stop 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef8153620 msgr2=0x7fbef815f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef8153620 0x7fbef815f600 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbef808e090 tx=0x7fbef0011c30 comp rx=0 tx=0).stop 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 shutdown_connections 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbee406be60 0x7fbee406e370 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef8153620 0x7fbef815f600 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbef81f8ca0 0x7fbef815f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 --2- 172.21.15.6:0/4222394621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbee00039b0 0x7fbef8151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 >> 172.21.15.6:0/4222394621 conn(0x7fbef80d4bd0 msgr2=0x7fbef8160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 shutdown_connections 2024-05-20T17:54:03.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.587+0000 7fbf00585640 1 -- 172.21.15.6:0/4222394621 wait complete. 2024-05-20T17:54:03.598 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T17:54:03.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:03.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-20T17:54:03.631 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:54:03.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:03.632 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T17:54:03.706 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:03.706 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:03.723 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:03.723 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:03.780 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:03.780 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:03.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.992+0000 7f21358de640 1 Processor -- start 2024-05-20T17:54:03.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.992+0000 7f21358de640 1 -- start start 2024-05-20T17:54:03.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.993+0000 7f21358de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 0x7f21300d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.993+0000 7f21358de640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f213015d940 0x7f213015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:03.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.993+0000 7f21358de640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f213015e6b0 con 0x7f213006d290 2024-05-20T17:54:03.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.993+0000 7f21358de640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f21300d2400 con 0x7f213015d940 2024-05-20T17:54:03.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.993+0000 7f21358de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21300d1a30 con 0x7f21300b2f10 2024-05-20T17:54:03.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.994+0000 7f212f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f213015d940 0x7f213015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.994+0000 7f212f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f213015d940 0x7f213015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54932/0 (socket says 172.21.15.6:54932) 2024-05-20T17:54:03.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.994+0000 7f212f7fe640 1 -- 172.21.15.6:0/372143615 learned_addr learned my addr 172.21.15.6:0/372143615 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:03.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.994+0000 7f212effd640 1 --2- 172.21.15.6:0/372143615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 0x7f21300d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:03.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.994+0000 7f212f7fe640 1 -- 172.21.15.6:0/372143615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 msgr2=0x7f21300d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:03.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.994+0000 7f212f7fe640 1 --2- 172.21.15.6:0/372143615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 0x7f21300d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.994+0000 7f212f7fe640 1 -- 172.21.15.6:0/372143615 >> v1:172.21.15.171:6789/0 conn(0x7f213006d290 legacy=0x7f213006d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.994+0000 7f212f7fe640 1 -- 172.21.15.6:0/372143615 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21300d1100 con 0x7f213015d940 2024-05-20T17:54:03.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.995+0000 7f212f7fe640 1 --2- 172.21.15.6:0/372143615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f213015dd50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2128009e50 tx=0x7f212802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac37de865f10ddf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:03.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.995+0000 7f212e7fc640 1 -- 172.21.15.6:0/372143615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128036070 con 0x7f213015d940 2024-05-20T17:54:03.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.995+0000 7f212e7fc640 1 -- 172.21.15.6:0/372143615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2128031600 con 0x7f213015d940 2024-05-20T17:54:03.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.995+0000 7f212e7fc640 1 -- 172.21.15.6:0/372143615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280319d0 con 0x7f213015d940 2024-05-20T17:54:03.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.996+0000 7f21358de640 1 -- 172.21.15.6:0/372143615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 msgr2=0x7f213015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:03.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.996+0000 7f21358de640 1 --2- 172.21.15.6:0/372143615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f213015dd50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2128009e50 tx=0x7f212802a680 comp rx=0 tx=0).stop 2024-05-20T17:54:03.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.996+0000 7f21358de640 1 -- 172.21.15.6:0/372143615 shutdown_connections 2024-05-20T17:54:03.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.996+0000 7f21358de640 1 --2- 172.21.15.6:0/372143615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f213015dd50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.996+0000 7f21358de640 1 --2- 172.21.15.6:0/372143615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 0x7f21300d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:03.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.996+0000 7f21358de640 1 -- 172.21.15.6:0/372143615 >> 172.21.15.6:0/372143615 conn(0x7f21300b6670 msgr2=0x7f21300b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:03.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.996+0000 7f21358de640 1 -- 172.21.15.6:0/372143615 shutdown_connections 2024-05-20T17:54:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.996+0000 7f21358de640 1 -- 172.21.15.6:0/372143615 wait complete. 2024-05-20T17:54:04.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.997+0000 7f21358de640 1 Processor -- start 2024-05-20T17:54:04.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.998+0000 7f21358de640 1 -- start start 2024-05-20T17:54:04.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f21358de640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f213006d290 0x7f213009f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f21358de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 0x7f2130152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f21358de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f21301f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f21358de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f21300d16c0 con 0x7f213015d940 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f21358de640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f21300b3320 con 0x7f213006d290 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f21358de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f213015e290 con 0x7f21300b2f10 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f21301f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f21301f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54942/0 (socket says 172.21.15.6:54942) 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212f7fe640 1 -- 172.21.15.6:0/2822763109 learned_addr learned my addr 172.21.15.6:0/2822763109 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212effd640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f213006d290 0x7f213009f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f2127fff640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 0x7f2130152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212f7fe640 1 -- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 msgr2=0x7f2130152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212f7fe640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 0x7f2130152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212f7fe640 1 -- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f213006d290 msgr2=0x7f213009f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212f7fe640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f213006d290 0x7f213009f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:03.999+0000 7f212f7fe640 1 -- 172.21.15.6:0/2822763109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213015ae90 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.000+0000 7f212f7fe640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f21301f66c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2128034040 tx=0x7f2128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.000+0000 7f212cff9640 1 -- 172.21.15.6:0/2822763109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128036050 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.000+0000 7f212cff9640 1 -- 172.21.15.6:0/2822763109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2128042070 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.000+0000 7f212cff9640 1 -- 172.21.15.6:0/2822763109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128009510 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.000+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213015b170 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.000+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f213015b730 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.001+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2130075b00 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.001+0000 7f212cff9640 1 -- 172.21.15.6:0/2822763109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2128007bf0 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.002+0000 7f212cff9640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f211006be30 0x7f211006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.002+0000 7f212cff9640 1 -- 172.21.15.6:0/2822763109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f21280abff0 con 0x7f213015d940 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.002+0000 7f212effd640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f211006be30 0x7f211006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.003+0000 7f212effd640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f211006be30 0x7f211006e340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f21300cde90 tx=0x7f2120009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.007+0000 7f212cff9640 1 -- 172.21.15.6:0/2822763109 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2128079ff0 con 0x7f213015d940 2024-05-20T17:54:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.189+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21300b1dd0 con 0x7f213015d940 2024-05-20T17:54:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.191+0000 7f212cff9640 1 -- 172.21.15.6:0/2822763109 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f212807e2f0 con 0x7f213015d940 2024-05-20T17:54:04.190 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:04.190 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f211006be30 msgr2=0x7f211006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f211006be30 0x7f211006e340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f21300cde90 tx=0x7f2120009190 comp rx=0 tx=0).stop 2024-05-20T17:54:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 msgr2=0x7f21301f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f21301f66c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2128034040 tx=0x7f2128004a40 comp rx=0 tx=0).stop 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 shutdown_connections 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f211006be30 0x7f211006e340 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f213015d940 0x7f21301f66c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21300b2f10 0x7f2130152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 --2- 172.21.15.6:0/2822763109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f213006d290 0x7f213009f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 >> 172.21.15.6:0/2822763109 conn(0x7f21300b6670 msgr2=0x7f21300b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 shutdown_connections 2024-05-20T17:54:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.193+0000 7f21358de640 1 -- 172.21.15.6:0/2822763109 wait complete. 2024-05-20T17:54:04.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:54:04.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:54:04.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.323+0000 7f1756af6640 1 Processor -- start 2024-05-20T17:54:04.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.323+0000 7f1756af6640 1 -- start start 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f1756af6640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1750162820 0x7f17500b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f1756af6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17500b3e80 0x7f175006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f1756af6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f175006dd20 con 0x7f175006d910 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f1756af6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f17500d0630 con 0x7f17500b3e80 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f1756af6640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f17500d39c0 con 0x7f1750162820 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f174ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17500b3e80 0x7f175006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f1755093640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f175006d910 0x7f17500d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36910/0 (socket says 172.21.15.6:36910) 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f1755093640 1 -- 172.21.15.6:0/1139565297 learned_addr learned my addr 172.21.15.6:0/1139565297 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f1754892640 1 --2- 172.21.15.6:0/1139565297 >> v2:172.21.15.171:3300/0 conn(0x7f1750162820 0x7f17500b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f174ffff640 1 -- 172.21.15.6:0/1139565297 >> v2:172.21.15.171:3300/0 conn(0x7f1750162820 msgr2=0x7f17500b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f174ffff640 1 --2- 172.21.15.6:0/1139565297 >> v2:172.21.15.171:3300/0 conn(0x7f1750162820 0x7f17500b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f174ffff640 1 -- 172.21.15.6:0/1139565297 >> v1:172.21.15.6:6789/0 conn(0x7f175006d910 legacy=0x7f17500d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f174ffff640 1 -- 172.21.15.6:0/1139565297 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17500d3ca0 con 0x7f17500b3e80 2024-05-20T17:54:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.325+0000 7f174f7fe640 1 -- 172.21.15.6:0/1139565297 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014309381 0 0) 0x7f1748001490 con 0x7f175006d910 2024-05-20T17:54:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.326+0000 7f174ffff640 1 --2- 172.21.15.6:0/1139565297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17500b3e80 0x7f175006d3d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f17500b7740 tx=0x7f174402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1149581507468874 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.326+0000 7f174f7fe640 1 -- 172.21.15.6:0/1139565297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744037070 con 0x7f17500b3e80 2024-05-20T17:54:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.326+0000 7f174f7fe640 1 -- 172.21.15.6:0/1139565297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1744032440 con 0x7f17500b3e80 2024-05-20T17:54:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.326+0000 7f174f7fe640 1 -- 172.21.15.6:0/1139565297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744032810 con 0x7f17500b3e80 2024-05-20T17:54:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.327+0000 7f1756af6640 1 -- 172.21.15.6:0/1139565297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17500b3e80 msgr2=0x7f175006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.327+0000 7f1756af6640 1 --2- 172.21.15.6:0/1139565297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17500b3e80 0x7f175006d3d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f17500b7740 tx=0x7f174402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.327+0000 7f1756af6640 1 -- 172.21.15.6:0/1139565297 shutdown_connections 2024-05-20T17:54:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.327+0000 7f1756af6640 1 --2- 172.21.15.6:0/1139565297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17500b3e80 0x7f175006d3d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.327+0000 7f1756af6640 1 --2- 172.21.15.6:0/1139565297 >> v2:172.21.15.171:3300/0 conn(0x7f1750162820 0x7f17500b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.327+0000 7f1756af6640 1 -- 172.21.15.6:0/1139565297 >> 172.21.15.6:0/1139565297 conn(0x7f17500d4bd0 msgr2=0x7f17500d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.327+0000 7f1756af6640 1 -- 172.21.15.6:0/1139565297 shutdown_connections 2024-05-20T17:54:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.327+0000 7f1756af6640 1 -- 172.21.15.6:0/1139565297 wait complete. 2024-05-20T17:54:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.329+0000 7f1756af6640 1 Processor -- start 2024-05-20T17:54:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.329+0000 7f1756af6640 1 -- start start 2024-05-20T17:54:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1756af6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d910 0x7f17500b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1756af6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17500b3e80 0x7f175014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1756af6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1750162820 0x7f17500cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1756af6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f17500d0300 con 0x7f175006d910 2024-05-20T17:54:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1756af6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17500d4260 con 0x7f17500b3e80 2024-05-20T17:54:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1756af6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17500b91a0 con 0x7f1750162820 2024-05-20T17:54:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1754892640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d910 0x7f17500b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1754892640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d910 0x7f17500b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54948/0 (socket says 172.21.15.6:54948) 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.330+0000 7f1754892640 1 -- 172.21.15.6:0/3877916857 learned_addr learned my addr 172.21.15.6:0/3877916857 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f174ffff640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17500b3e80 0x7f175014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1754892640 1 -- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1750162820 msgr2=0x7f17500cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1755093640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1750162820 0x7f17500cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1754892640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1750162820 0x7f17500cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1754892640 1 -- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17500b3e80 msgr2=0x7f175014e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1754892640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17500b3e80 0x7f175014e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1754892640 1 -- 172.21.15.6:0/3877916857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17500b6720 con 0x7f175006d910 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f174ffff640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17500b3e80 0x7f175014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1754892640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d910 0x7f17500b61e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f174000d5f0 tx=0x7f174000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f174d7fa640 1 -- 172.21.15.6:0/3877916857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17400125f0 con 0x7f175006d910 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f174d7fa640 1 -- 172.21.15.6:0/3877916857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1740019070 con 0x7f175006d910 2024-05-20T17:54:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17500b53a0 con 0x7f175006d910 2024-05-20T17:54:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f174d7fa640 1 -- 172.21.15.6:0/3877916857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17400129d0 con 0x7f175006d910 2024-05-20T17:54:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.331+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17500b5960 con 0x7f175006d910 2024-05-20T17:54:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.332+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17500d4780 con 0x7f175006d910 2024-05-20T17:54:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.333+0000 7f174d7fa640 1 -- 172.21.15.6:0/3877916857 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1740012b70 con 0x7f175006d910 2024-05-20T17:54:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.333+0000 7f174d7fa640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f173c06be30 0x7f173c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.333+0000 7f174d7fa640 1 -- 172.21.15.6:0/3877916857 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f174008b720 con 0x7f175006d910 2024-05-20T17:54:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.333+0000 7f174ffff640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f173c06be30 0x7f173c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.334+0000 7f174ffff640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f173c06be30 0x7f173c06e340 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1744034000 tx=0x7f174402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.338+0000 7f174d7fa640 1 -- 172.21.15.6:0/3877916857 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f17500d4780 con 0x7f175006d910 2024-05-20T17:54:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.522+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1750075b00 con 0x7f175006d910 2024-05-20T17:54:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.522+0000 7f174d7fa640 1 -- 172.21.15.6:0/3877916857 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f1740059c00 con 0x7f175006d910 2024-05-20T17:54:04.522 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:54:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f173c06be30 msgr2=0x7f173c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f173c06be30 0x7f173c06e340 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1744034000 tx=0x7f174402e000 comp rx=0 tx=0).stop 2024-05-20T17:54:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d910 msgr2=0x7f17500b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d910 0x7f17500b61e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f174000d5f0 tx=0x7f174000dab0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 shutdown_connections 2024-05-20T17:54:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f173c06be30 0x7f173c06e340 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1750162820 0x7f17500cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17500b3e80 0x7f175014e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 --2- 172.21.15.6:0/3877916857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d910 0x7f17500b61e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 >> 172.21.15.6:0/3877916857 conn(0x7f17500d4bd0 msgr2=0x7f175015eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 shutdown_connections 2024-05-20T17:54:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.525+0000 7f1756af6640 1 -- 172.21.15.6:0/3877916857 wait complete. 2024-05-20T17:54:04.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:54:04.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.654+0000 7fc01aede640 1 Processor -- start 2024-05-20T17:54:04.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.654+0000 7fc01aede640 1 -- start start 2024-05-20T17:54:04.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc01aede640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc014162820 0x7fc0140b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc01aede640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0140b3e80 0x7fc01406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc01aede640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc01406dd20 con 0x7fc01406d910 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc01aede640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc0140d0630 con 0x7fc0140b3e80 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc01aede640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc0140d39c0 con 0x7fc014162820 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc013fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0140b3e80 0x7fc01406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc013fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0140b3e80 0x7fc01406d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54952/0 (socket says 172.21.15.6:54952) 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc013fff640 1 -- 172.21.15.6:0/4203814595 learned_addr learned my addr 172.21.15.6:0/4203814595 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc018c7a640 1 --2- 172.21.15.6:0/4203814595 >> v2:172.21.15.171:3300/0 conn(0x7fc014162820 0x7fc0140b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc013fff640 1 -- 172.21.15.6:0/4203814595 >> v2:172.21.15.171:3300/0 conn(0x7fc014162820 msgr2=0x7fc0140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc013fff640 1 --2- 172.21.15.6:0/4203814595 >> v2:172.21.15.171:3300/0 conn(0x7fc014162820 0x7fc0140b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc013fff640 1 -- 172.21.15.6:0/4203814595 >> v1:172.21.15.171:6789/0 conn(0x7fc01406d910 legacy=0x7fc0140d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.656+0000 7fc013fff640 1 -- 172.21.15.6:0/4203814595 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0140d3ca0 con 0x7fc0140b3e80 2024-05-20T17:54:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.657+0000 7fc013fff640 1 --2- 172.21.15.6:0/4203814595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0140b3e80 0x7fc01406d3d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc0140b7740 tx=0x7fbffc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543e7d04540b92d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.657+0000 7fc0137fe640 1 -- 172.21.15.6:0/4203814595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc036070 con 0x7fc0140b3e80 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.657+0000 7fc0137fe640 1 -- 172.21.15.6:0/4203814595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc031600 con 0x7fc0140b3e80 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.657+0000 7fc0137fe640 1 -- 172.21.15.6:0/4203814595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0319d0 con 0x7fc0140b3e80 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.658+0000 7fc01aede640 1 -- 172.21.15.6:0/4203814595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0140b3e80 msgr2=0x7fc01406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.658+0000 7fc01aede640 1 --2- 172.21.15.6:0/4203814595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0140b3e80 0x7fc01406d3d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc0140b7740 tx=0x7fbffc02a730 comp rx=0 tx=0).stop 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.658+0000 7fc01aede640 1 -- 172.21.15.6:0/4203814595 shutdown_connections 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.658+0000 7fc01aede640 1 --2- 172.21.15.6:0/4203814595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0140b3e80 0x7fc01406d3d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.658+0000 7fc01aede640 1 --2- 172.21.15.6:0/4203814595 >> v2:172.21.15.171:3300/0 conn(0x7fc014162820 0x7fc0140b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.658+0000 7fc01aede640 1 -- 172.21.15.6:0/4203814595 >> 172.21.15.6:0/4203814595 conn(0x7fc0140d4bd0 msgr2=0x7fc0140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.658+0000 7fc01aede640 1 -- 172.21.15.6:0/4203814595 shutdown_connections 2024-05-20T17:54:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.658+0000 7fc01aede640 1 -- 172.21.15.6:0/4203814595 wait complete. 2024-05-20T17:54:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.660+0000 7fc01aede640 1 Processor -- start 2024-05-20T17:54:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.660+0000 7fc01aede640 1 -- start start 2024-05-20T17:54:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc01aede640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc01406d910 0x7fc01414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc01aede640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0140b3e80 0x7fc0141f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc01aede640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc014162820 0x7fc0141f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc01aede640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc0140d0300 con 0x7fc01406d910 2024-05-20T17:54:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc01aede640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc0140d4260 con 0x7fc014162820 2024-05-20T17:54:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc01aede640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc0140b91a0 con 0x7fc0140b3e80 2024-05-20T17:54:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc018c7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc01406d910 0x7fc01414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc018c7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc01406d910 0x7fc01414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54966/0 (socket says 172.21.15.6:54966) 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.661+0000 7fc018c7a640 1 -- 172.21.15.6:0/984225136 learned_addr learned my addr 172.21.15.6:0/984225136 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc01947b640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc014162820 0x7fc0141f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc013fff640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0140b3e80 0x7fc0141f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc018c7a640 1 -- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0140b3e80 msgr2=0x7fc0141f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc018c7a640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0140b3e80 0x7fc0141f89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc018c7a640 1 -- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc014162820 msgr2=0x7fc0141f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc018c7a640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc014162820 0x7fc0141f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc018c7a640 1 -- 172.21.15.6:0/984225136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01414e640 con 0x7fc01406d910 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc01947b640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc014162820 0x7fc0141f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc018c7a640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc01406d910 0x7fc01414e100 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc00400e8a0 tx=0x7fc00400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc0117fa640 1 -- 172.21.15.6:0/984225136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004017070 con 0x7fc01406d910 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc0117fa640 1 -- 172.21.15.6:0/984225136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00400c940 con 0x7fc01406d910 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0140cbed0 con 0x7fc01406d910 2024-05-20T17:54:04.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc0117fa640 1 -- 172.21.15.6:0/984225136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00400cd30 con 0x7fc01406d910 2024-05-20T17:54:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.662+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0140cc490 con 0x7fc01406d910 2024-05-20T17:54:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.663+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc014072fc0 con 0x7fc01406d910 2024-05-20T17:54:04.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.664+0000 7fc0117fa640 1 -- 172.21.15.6:0/984225136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc00401a070 con 0x7fc01406d910 2024-05-20T17:54:04.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.664+0000 7fc0117fa640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff406be30 0x7fbff406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.664+0000 7fc0117fa640 1 -- 172.21.15.6:0/984225136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fc00408b4b0 con 0x7fc01406d910 2024-05-20T17:54:04.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.664+0000 7fc013fff640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff406be30 0x7fbff406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.665+0000 7fc013fff640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff406be30 0x7fbff406e340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbffc033000 tx=0x7fbffc009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.669+0000 7fc0117fa640 1 -- 172.21.15.6:0/984225136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc014072fc0 con 0x7fc01406d910 2024-05-20T17:54:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.858+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc014075b00 con 0x7fc01406d910 2024-05-20T17:54:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.859+0000 7fc0117fa640 1 -- 172.21.15.6:0/984225136 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fc004059a20 con 0x7fc01406d910 2024-05-20T17:54:04.858 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:04.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff406be30 msgr2=0x7fbff406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff406be30 0x7fbff406e340 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbffc033000 tx=0x7fbffc009000 comp rx=0 tx=0).stop 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc01406d910 msgr2=0x7fc01414e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc01406d910 0x7fc01414e100 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc00400e8a0 tx=0x7fc00400ed60 comp rx=0 tx=0).stop 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 shutdown_connections 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbff406be30 0x7fbff406e340 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc014162820 0x7fc0141f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0140b3e80 0x7fc0141f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 --2- 172.21.15.6:0/984225136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc01406d910 0x7fc01414e100 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 >> 172.21.15.6:0/984225136 conn(0x7fc0140d4bd0 msgr2=0x7fc0140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 shutdown_connections 2024-05-20T17:54:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.861+0000 7fc01aede640 1 -- 172.21.15.6:0/984225136 wait complete. 2024-05-20T17:54:04.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:54:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.990+0000 7f49c668d640 1 Processor -- start 2024-05-20T17:54:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.990+0000 7f49c668d640 1 -- start start 2024-05-20T17:54:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.991+0000 7f49c668d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49c00cf3d0 0x7f49c00cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.991+0000 7f49c668d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f49c00ce7e0 0x7f49c00cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.991+0000 7f49c668d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c00cfd20 con 0x7f49c015f220 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.991+0000 7f49c668d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f49c00cf130 con 0x7f49c00cf3d0 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.991+0000 7f49c668d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f49c00cda20 con 0x7f49c00ce7e0 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.992+0000 7f49bf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49c00cf3d0 0x7f49c00cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.992+0000 7f49bf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49c00cf3d0 0x7f49c00cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54982/0 (socket says 172.21.15.6:54982) 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.992+0000 7f49bf7fe640 1 -- 172.21.15.6:0/2655979707 learned_addr learned my addr 172.21.15.6:0/2655979707 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.992+0000 7f49c4c2a640 1 --2- 172.21.15.6:0/2655979707 >> v2:172.21.15.171:3300/0 conn(0x7f49c00ce7e0 0x7f49c00cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.992+0000 7f49bf7fe640 1 -- 172.21.15.6:0/2655979707 >> v2:172.21.15.171:3300/0 conn(0x7f49c00ce7e0 msgr2=0x7f49c00cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.992+0000 7f49bf7fe640 1 --2- 172.21.15.6:0/2655979707 >> v2:172.21.15.171:3300/0 conn(0x7f49c00ce7e0 0x7f49c00cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.992+0000 7f49bf7fe640 1 -- 172.21.15.6:0/2655979707 >> v1:172.21.15.171:6789/0 conn(0x7f49c015f220 legacy=0x7f49c00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.992+0000 7f49bf7fe640 1 -- 172.21.15.6:0/2655979707 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c00cdd00 con 0x7f49c00cf3d0 2024-05-20T17:54:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.993+0000 7f49bf7fe640 1 --2- 172.21.15.6:0/2655979707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c00cf3d0 0x7f49c00cf7e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49c006e3e0 tx=0x7f49b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02d1b938229350a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.993+0000 7f49beffd640 1 -- 172.21.15.6:0/2655979707 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4037070 con 0x7f49c00cf3d0 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.993+0000 7f49beffd640 1 -- 172.21.15.6:0/2655979707 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b4032440 con 0x7f49c00cf3d0 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.993+0000 7f49beffd640 1 -- 172.21.15.6:0/2655979707 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4032810 con 0x7f49c00cf3d0 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.994+0000 7f49c668d640 1 -- 172.21.15.6:0/2655979707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c00cf3d0 msgr2=0x7f49c00cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.994+0000 7f49c668d640 1 --2- 172.21.15.6:0/2655979707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c00cf3d0 0x7f49c00cf7e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49c006e3e0 tx=0x7f49b402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.994+0000 7f49c668d640 1 -- 172.21.15.6:0/2655979707 shutdown_connections 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.994+0000 7f49c668d640 1 --2- 172.21.15.6:0/2655979707 >> v2:172.21.15.171:3300/0 conn(0x7f49c00ce7e0 0x7f49c00cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.994+0000 7f49c668d640 1 --2- 172.21.15.6:0/2655979707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c00cf3d0 0x7f49c00cf7e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.994+0000 7f49c668d640 1 -- 172.21.15.6:0/2655979707 >> 172.21.15.6:0/2655979707 conn(0x7f49c00b44d0 msgr2=0x7f49c00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.994+0000 7f49c668d640 1 -- 172.21.15.6:0/2655979707 shutdown_connections 2024-05-20T17:54:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.994+0000 7f49c668d640 1 -- 172.21.15.6:0/2655979707 wait complete. 2024-05-20T17:54:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.995+0000 7f49c668d640 1 Processor -- start 2024-05-20T17:54:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.996+0000 7f49c668d640 1 -- start start 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c668d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49c00ce7e0 0x7f49c00b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c668d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49c00cf3d0 0x7f49c0151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c668d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c015f220 0x7f49c00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c668d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f49c00d0fd0 con 0x7f49c015f220 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c668d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49c00ce2c0 con 0x7f49c00ce7e0 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c668d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f49c00cd680 con 0x7f49c00cf3d0 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c4c2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c015f220 0x7f49c00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c4c2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c015f220 0x7f49c00b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54984/0 (socket says 172.21.15.6:54984) 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c4c2a640 1 -- 172.21.15.6:0/4273715144 learned_addr learned my addr 172.21.15.6:0/4273715144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49bffff640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49c00ce7e0 0x7f49c00b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49bf7fe640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49c00cf3d0 0x7f49c0151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c4c2a640 1 -- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49c00cf3d0 msgr2=0x7f49c0151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c4c2a640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49c00cf3d0 0x7f49c0151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c4c2a640 1 -- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49c00ce7e0 msgr2=0x7f49c00b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.997+0000 7f49c4c2a640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49c00ce7e0 0x7f49c00b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.998+0000 7f49c4c2a640 1 -- 172.21.15.6:0/4273715144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c0161930 con 0x7f49c015f220 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.998+0000 7f49bffff640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49c00ce7e0 0x7f49c00b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.998+0000 7f49c4c2a640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c015f220 0x7f49c00b55e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f49b8007e90 tx=0x7f49b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.998+0000 7f49bcff9640 1 -- 172.21.15.6:0/4273715144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8014420 con 0x7f49c015f220 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.998+0000 7f49bcff9640 1 -- 172.21.15.6:0/4273715144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b8019070 con 0x7f49c015f220 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.998+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c0161c10 con 0x7f49c015f220 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.998+0000 7f49bcff9640 1 -- 172.21.15.6:0/4273715144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8014800 con 0x7f49c015f220 2024-05-20T17:54:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.998+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c01f5c00 con 0x7f49c015f220 2024-05-20T17:54:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:04.999+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c0075b00 con 0x7f49c015f220 2024-05-20T17:54:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.000+0000 7f49bcff9640 1 -- 172.21.15.6:0/4273715144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49b80149a0 con 0x7f49c015f220 2024-05-20T17:54:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.000+0000 7f49bcff9640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f49ac06be30 0x7f49ac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.000+0000 7f49bcff9640 1 -- 172.21.15.6:0/4273715144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f49b808bb50 con 0x7f49c015f220 2024-05-20T17:54:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.001+0000 7f49bffff640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f49ac06be30 0x7f49ac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.001+0000 7f49bffff640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f49ac06be30 0x7f49ac06e340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49c00c64c0 tx=0x7f49b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:05.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.005+0000 7f49bcff9640 1 -- 172.21.15.6:0/4273715144 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f49b805a020 con 0x7f49c015f220 2024-05-20T17:54:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.190+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f49c00b4da0 con 0x7f49c015f220 2024-05-20T17:54:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.191+0000 7f49bcff9640 1 -- 172.21.15.6:0/4273715144 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f49b8059920 con 0x7f49c015f220 2024-05-20T17:54:05.190 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:54:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f49ac06be30 msgr2=0x7f49ac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f49ac06be30 0x7f49ac06e340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49c00c64c0 tx=0x7f49b0009040 comp rx=0 tx=0).stop 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c015f220 msgr2=0x7f49c00b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c015f220 0x7f49c00b55e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f49b8007e90 tx=0x7f49b800e4b0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 shutdown_connections 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f49ac06be30 0x7f49ac06e340 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49c015f220 0x7f49c00b55e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49c00cf3d0 0x7f49c0151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 --2- 172.21.15.6:0/4273715144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49c00ce7e0 0x7f49c00b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 >> 172.21.15.6:0/4273715144 conn(0x7f49c00b44d0 msgr2=0x7f49c00b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 shutdown_connections 2024-05-20T17:54:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.193+0000 7f49c668d640 1 -- 172.21.15.6:0/4273715144 wait complete. 2024-05-20T17:54:05.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:54:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.322+0000 7fae23f1a640 1 Processor -- start 2024-05-20T17:54:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.322+0000 7fae23f1a640 1 -- start start 2024-05-20T17:54:05.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae23f1a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fae1c15f220 0x7fae1c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae23f1a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae1c0d0e00 0x7fae1c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae23f1a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1c0cfd20 con 0x7fae1c0cf910 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae23f1a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c0cda20 con 0x7fae1c0d0e00 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae23f1a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c0cdd00 con 0x7fae1c15f220 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae214b5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae1c0d0e00 0x7fae1c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae214b5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae1c0d0e00 0x7fae1c0cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54996/0 (socket says 172.21.15.6:54996) 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae214b5640 1 -- 172.21.15.6:0/2447741731 learned_addr learned my addr 172.21.15.6:0/2447741731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae21cb6640 1 --2- 172.21.15.6:0/2447741731 >> v2:172.21.15.171:3300/0 conn(0x7fae1c15f220 0x7fae1c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae214b5640 1 -- 172.21.15.6:0/2447741731 >> v2:172.21.15.171:3300/0 conn(0x7fae1c15f220 msgr2=0x7fae1c0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae214b5640 1 --2- 172.21.15.6:0/2447741731 >> v2:172.21.15.171:3300/0 conn(0x7fae1c15f220 0x7fae1c0d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae214b5640 1 -- 172.21.15.6:0/2447741731 >> v1:172.21.15.171:6789/0 conn(0x7fae1c0cf910 legacy=0x7fae1c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.324+0000 7fae214b5640 1 -- 172.21.15.6:0/2447741731 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c0cdfe0 con 0x7fae1c0d0e00 2024-05-20T17:54:05.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.325+0000 7fae214b5640 1 --2- 172.21.15.6:0/2447741731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0d0e00 0x7fae1c0cf3d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fae1c06e810 tx=0x7fae0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebf13182a02765e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.325+0000 7fae20cb4640 1 -- 172.21.15.6:0/2447741731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c037070 con 0x7fae1c0d0e00 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.325+0000 7fae20cb4640 1 -- 172.21.15.6:0/2447741731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c032440 con 0x7fae1c0d0e00 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.325+0000 7fae20cb4640 1 -- 172.21.15.6:0/2447741731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c032810 con 0x7fae1c0d0e00 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.326+0000 7fae23f1a640 1 -- 172.21.15.6:0/2447741731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0d0e00 msgr2=0x7fae1c0cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.326+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2447741731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0d0e00 0x7fae1c0cf3d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fae1c06e810 tx=0x7fae0c02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.326+0000 7fae23f1a640 1 -- 172.21.15.6:0/2447741731 shutdown_connections 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.326+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2447741731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0d0e00 0x7fae1c0cf3d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.326+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2447741731 >> v2:172.21.15.171:3300/0 conn(0x7fae1c15f220 0x7fae1c0d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.326+0000 7fae23f1a640 1 -- 172.21.15.6:0/2447741731 >> 172.21.15.6:0/2447741731 conn(0x7fae1c0b44d0 msgr2=0x7fae1c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.326+0000 7fae23f1a640 1 -- 172.21.15.6:0/2447741731 shutdown_connections 2024-05-20T17:54:05.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.326+0000 7fae23f1a640 1 -- 172.21.15.6:0/2447741731 wait complete. 2024-05-20T17:54:05.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.328+0000 7fae23f1a640 1 Processor -- start 2024-05-20T17:54:05.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.328+0000 7fae23f1a640 1 -- start start 2024-05-20T17:54:05.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae23f1a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1c0cf910 0x7fae1c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae23f1a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1c0d0e00 0x7fae1c1f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae23f1a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c15f220 0x7fae1c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae23f1a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0cd800 con 0x7fae1c15f220 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae23f1a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0cd680 con 0x7fae1c0cf910 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae23f1a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c15f630 con 0x7fae1c0d0e00 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae224b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c15f220 0x7fae1c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae224b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c15f220 0x7fae1c0ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55002/0 (socket says 172.21.15.6:55002) 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae224b7640 1 -- 172.21.15.6:0/2224078779 learned_addr learned my addr 172.21.15.6:0/2224078779 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae214b5640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1c0d0e00 0x7fae1c1f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae21cb6640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1c0cf910 0x7fae1c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae224b7640 1 -- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1c0d0e00 msgr2=0x7fae1c1f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae224b7640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1c0d0e00 0x7fae1c1f5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae224b7640 1 -- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1c0cf910 msgr2=0x7fae1c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.329+0000 7fae224b7640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1c0cf910 0x7fae1c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.330+0000 7fae224b7640 1 -- 172.21.15.6:0/2224078779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c0c9e60 con 0x7fae1c15f220 2024-05-20T17:54:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.330+0000 7fae224b7640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c15f220 0x7fae1c0ca5c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c6b0 tx=0x7fae1400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.330+0000 7fae127fc640 1 -- 172.21.15.6:0/2224078779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14003b70 con 0x7fae1c15f220 2024-05-20T17:54:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.330+0000 7fae127fc640 1 -- 172.21.15.6:0/2224078779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae14003d30 con 0x7fae1c15f220 2024-05-20T17:54:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.330+0000 7fae127fc640 1 -- 172.21.15.6:0/2224078779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14005310 con 0x7fae1c15f220 2024-05-20T17:54:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.330+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c1f56d0 con 0x7fae1c15f220 2024-05-20T17:54:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.330+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c14fb00 con 0x7fae1c15f220 2024-05-20T17:54:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.331+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1c075b00 con 0x7fae1c15f220 2024-05-20T17:54:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.332+0000 7fae127fc640 1 -- 172.21.15.6:0/2224078779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae140054b0 con 0x7fae1c15f220 2024-05-20T17:54:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.332+0000 7fae127fc640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae0006be30 0x7fae0006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.332+0000 7fae127fc640 1 -- 172.21.15.6:0/2224078779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fae1408afb0 con 0x7fae1c15f220 2024-05-20T17:54:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.332+0000 7fae21cb6640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae0006be30 0x7fae0006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.333+0000 7fae21cb6640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae0006be30 0x7fae0006e340 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0c64c0 tx=0x7fae18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:05.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.337+0000 7fae127fc640 1 -- 172.21.15.6:0/2224078779 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fae1c0cfd20 con 0x7fae1c15f220 2024-05-20T17:54:05.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.518+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fae1c162c60 con 0x7fae1c15f220 2024-05-20T17:54:05.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.519+0000 7fae127fc640 1 -- 172.21.15.6:0/2224078779 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fae14058ed0 con 0x7fae1c15f220 2024-05-20T17:54:05.518 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:05.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae0006be30 msgr2=0x7fae0006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae0006be30 0x7fae0006e340 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0c64c0 tx=0x7fae18008040 comp rx=0 tx=0).stop 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c15f220 msgr2=0x7fae1c0ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c15f220 0x7fae1c0ca5c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c6b0 tx=0x7fae1400cb70 comp rx=0 tx=0).stop 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 shutdown_connections 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae0006be30 0x7fae0006e340 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c15f220 0x7fae1c0ca5c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae1c0d0e00 0x7fae1c1f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 --2- 172.21.15.6:0/2224078779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae1c0cf910 0x7fae1c0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 >> 172.21.15.6:0/2224078779 conn(0x7fae1c0b44d0 msgr2=0x7fae1c162e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 shutdown_connections 2024-05-20T17:54:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.521+0000 7fae23f1a640 1 -- 172.21.15.6:0/2224078779 wait complete. 2024-05-20T17:54:05.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:54:05.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:54:05.580 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:54:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.648+0000 7f5142280640 1 Processor -- start 2024-05-20T17:54:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.648+0000 7f5142280640 1 -- start start 2024-05-20T17:54:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.649+0000 7f5142280640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f513c159aa0 0x7f513c06da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.649+0000 7f5142280640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c0d1580 0x7f513c0d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.649+0000 7f5142280640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f513c09a4f0 0x7f513c09a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.649+0000 7f5142280640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f513c160630 con 0x7f513c159aa0 2024-05-20T17:54:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.649+0000 7f5142280640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f513c0d1ed0 con 0x7f513c09a4f0 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.649+0000 7f5142280640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f513c15fa20 con 0x7f513c0d1580 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f513c159aa0 0x7f513c06da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f513c159aa0 0x7f513c06da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55014/0 (socket says 172.21.15.6:55014) 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513bfff640 1 -- 172.21.15.6:0/2869044888 learned_addr learned my addr 172.21.15.6:0/2869044888 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513b7fe640 1 --2- 172.21.15.6:0/2869044888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c0d1580 0x7f513c0d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f514081d640 1 --2- 172.21.15.6:0/2869044888 >> v2:172.21.15.171:3300/0 conn(0x7f513c09a4f0 0x7f513c09a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513bfff640 1 -- 172.21.15.6:0/2869044888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c0d1580 msgr2=0x7f513c0d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513bfff640 1 --2- 172.21.15.6:0/2869044888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c0d1580 0x7f513c0d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513bfff640 1 -- 172.21.15.6:0/2869044888 >> v2:172.21.15.171:3300/0 conn(0x7f513c09a4f0 msgr2=0x7f513c09a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513bfff640 1 --2- 172.21.15.6:0/2869044888 >> v2:172.21.15.171:3300/0 conn(0x7f513c09a4f0 0x7f513c09a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.650+0000 7f513bfff640 1 -- 172.21.15.6:0/2869044888 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c15fd00 con 0x7f513c159aa0 2024-05-20T17:54:05.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.651+0000 7f513bfff640 1 --2- 172.21.15.6:0/2869044888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c159aa0 0x7f513c06da80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f513c0b7920 tx=0x7f512c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c192f921a9fb7f3b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.651+0000 7f513affd640 1 -- 172.21.15.6:0/2869044888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c037070 con 0x7f513c159aa0 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.651+0000 7f513affd640 1 -- 172.21.15.6:0/2869044888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c032440 con 0x7f513c159aa0 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.651+0000 7f513affd640 1 -- 172.21.15.6:0/2869044888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c032810 con 0x7f513c159aa0 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 -- 172.21.15.6:0/2869044888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c159aa0 msgr2=0x7f513c06da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 --2- 172.21.15.6:0/2869044888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c159aa0 0x7f513c06da80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f513c0b7920 tx=0x7f512c02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 -- 172.21.15.6:0/2869044888 shutdown_connections 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 --2- 172.21.15.6:0/2869044888 >> v2:172.21.15.171:3300/0 conn(0x7f513c09a4f0 0x7f513c09a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 --2- 172.21.15.6:0/2869044888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c0d1580 0x7f513c0d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 --2- 172.21.15.6:0/2869044888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c159aa0 0x7f513c06da80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 -- 172.21.15.6:0/2869044888 >> 172.21.15.6:0/2869044888 conn(0x7f513c0b6620 msgr2=0x7f513c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 -- 172.21.15.6:0/2869044888 shutdown_connections 2024-05-20T17:54:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.652+0000 7f5142280640 1 -- 172.21.15.6:0/2869044888 wait complete. 2024-05-20T17:54:05.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.654+0000 7f5142280640 1 Processor -- start 2024-05-20T17:54:05.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.654+0000 7f5142280640 1 -- start start 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f5142280640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c09a4f0 0x7f513c161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f5142280640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f513c0d1580 0x7f513c1f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f5142280640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c159aa0 0x7f513c1f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f5142280640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f513c06dfc0 con 0x7f513c09a4f0 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f5142280640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f513c1602c0 con 0x7f513c0d1580 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f5142280640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f513c0b1420 con 0x7f513c159aa0 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f513bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c09a4f0 0x7f513c161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f513bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c09a4f0 0x7f513c161fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55018/0 (socket says 172.21.15.6:55018) 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f513bfff640 1 -- 172.21.15.6:0/3698905420 learned_addr learned my addr 172.21.15.6:0/3698905420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f514081d640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c159aa0 0x7f513c1f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f513b7fe640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f513c0d1580 0x7f513c1f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f513bfff640 1 -- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c159aa0 msgr2=0x7f513c1f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f513bfff640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c159aa0 0x7f513c1f9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f513bfff640 1 -- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f513c0d1580 msgr2=0x7f513c1f8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.655+0000 7f513bfff640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f513c0d1580 0x7f513c1f8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.656+0000 7f513bfff640 1 -- 172.21.15.6:0/3698905420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c162500 con 0x7f513c09a4f0 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.656+0000 7f513b7fe640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f513c0d1580 0x7f513c1f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.656+0000 7f513bfff640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c09a4f0 0x7f513c161fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f512c02a220 tx=0x7f512c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.656+0000 7f5138ff9640 1 -- 172.21.15.6:0/3698905420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c041020 con 0x7f513c09a4f0 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.656+0000 7f5138ff9640 1 -- 172.21.15.6:0/3698905420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c0306c0 con 0x7f513c09a4f0 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.656+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c1f5a10 con 0x7f513c09a4f0 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.656+0000 7f5138ff9640 1 -- 172.21.15.6:0/3698905420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c037040 con 0x7f513c09a4f0 2024-05-20T17:54:05.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.656+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c1f5fd0 con 0x7f513c09a4f0 2024-05-20T17:54:05.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.657+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513c075b00 con 0x7f513c09a4f0 2024-05-20T17:54:05.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.658+0000 7f5138ff9640 1 -- 172.21.15.6:0/3698905420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f512c044020 con 0x7f513c09a4f0 2024-05-20T17:54:05.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.658+0000 7f5138ff9640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f512806be30 0x7f512806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:05.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.658+0000 7f5138ff9640 1 -- 172.21.15.6:0/3698905420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f512c0aba30 con 0x7f513c09a4f0 2024-05-20T17:54:05.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.658+0000 7f513b7fe640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f512806be30 0x7f512806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:05.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.659+0000 7f513b7fe640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f512806be30 0x7f512806e340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5130006fd0 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:05.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.663+0000 7f5138ff9640 1 -- 172.21.15.6:0/3698905420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f512c04b030 con 0x7f513c09a4f0 2024-05-20T17:54:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.861+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f513c1549c0 con 0x7f513c09a4f0 2024-05-20T17:54:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.861+0000 7f5138ff9640 1 -- 172.21.15.6:0/3698905420 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f512c07a030 con 0x7f513c09a4f0 2024-05-20T17:54:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:54:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f512806be30 msgr2=0x7f512806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f512806be30 0x7f512806e340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5130006fd0 tx=0x7f5130008040 comp rx=0 tx=0).stop 2024-05-20T17:54:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c09a4f0 msgr2=0x7f513c161fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c09a4f0 0x7f513c161fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f512c02a220 tx=0x7f512c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 shutdown_connections 2024-05-20T17:54:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f512806be30 0x7f512806e340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f513c159aa0 0x7f513c1f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f513c0d1580 0x7f513c1f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 --2- 172.21.15.6:0/3698905420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f513c09a4f0 0x7f513c161fc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 >> 172.21.15.6:0/3698905420 conn(0x7f513c0b6620 msgr2=0x7f513c0b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 shutdown_connections 2024-05-20T17:54:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:05.863+0000 7f5142280640 1 -- 172.21.15.6:0/3698905420 wait complete. 2024-05-20T17:54:05.874 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-20T17:54:05.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:05.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-20T17:54:05.941 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:54:05.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:05.941 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-20T17:54:05.997 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:54:05.997 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:06.017 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:54:06.017 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:06.076 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:54:06.076 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:06.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:06.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.251+0000 7f43cef8f640 1 Processor -- start 2024-05-20T17:54:06.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.251+0000 7f43cef8f640 1 -- start start 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cef8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c80b2f10 0x7f43c80d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cef8f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f43c806d290 0x7f43c806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cef8f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c815d940 0x7f43c815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cef8f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f43c80d2400 con 0x7f43c815d940 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cef8f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f43c80d1a30 con 0x7f43c806d290 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cef8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43c80b3320 con 0x7f43c80b2f10 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cd52c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c815d940 0x7f43c815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cd52c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c815d940 0x7f43c815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55034/0 (socket says 172.21.15.6:55034) 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cd52c640 1 -- 172.21.15.6:0/1848336624 learned_addr learned my addr 172.21.15.6:0/1848336624 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cd52c640 1 -- 172.21.15.6:0/1848336624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c80b2f10 msgr2=0x7f43c80d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43c7fff640 1 --2- 172.21.15.6:0/1848336624 >> v2:172.21.15.171:3300/0 conn(0x7f43c806d290 0x7f43c806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43ccd2b640 1 --2- 172.21.15.6:0/1848336624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c80b2f10 0x7f43c80d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cd52c640 1 --2- 172.21.15.6:0/1848336624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c80b2f10 0x7f43c80d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cd52c640 1 -- 172.21.15.6:0/1848336624 >> v2:172.21.15.171:3300/0 conn(0x7f43c806d290 msgr2=0x7f43c806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cd52c640 1 --2- 172.21.15.6:0/1848336624 >> v2:172.21.15.171:3300/0 conn(0x7f43c806d290 0x7f43c806d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43cd52c640 1 -- 172.21.15.6:0/1848336624 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c815e6b0 con 0x7f43c815d940 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43ccd2b640 1 --2- 172.21.15.6:0/1848336624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c80b2f10 0x7f43c80d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.253+0000 7f43c7fff640 1 --2- 172.21.15.6:0/1848336624 >> v2:172.21.15.171:3300/0 conn(0x7f43c806d290 0x7f43c806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.254+0000 7f43cd52c640 1 --2- 172.21.15.6:0/1848336624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c815d940 0x7f43c815dd50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f43c8074db0 tx=0x7f43c002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3516467fbec09c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.254+0000 7f43c77fe640 1 -- 172.21.15.6:0/1848336624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0036070 con 0x7f43c815d940 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.254+0000 7f43c77fe640 1 -- 172.21.15.6:0/1848336624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c0031600 con 0x7f43c815d940 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.254+0000 7f43c77fe640 1 -- 172.21.15.6:0/1848336624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c00319d0 con 0x7f43c815d940 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 -- 172.21.15.6:0/1848336624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c815d940 msgr2=0x7f43c815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1848336624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c815d940 0x7f43c815dd50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f43c8074db0 tx=0x7f43c002a610 comp rx=0 tx=0).stop 2024-05-20T17:54:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 -- 172.21.15.6:0/1848336624 shutdown_connections 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1848336624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c815d940 0x7f43c815dd50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1848336624 >> v2:172.21.15.171:3300/0 conn(0x7f43c806d290 0x7f43c806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1848336624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c80b2f10 0x7f43c80d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 -- 172.21.15.6:0/1848336624 >> 172.21.15.6:0/1848336624 conn(0x7f43c80b6670 msgr2=0x7f43c80b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 -- 172.21.15.6:0/1848336624 shutdown_connections 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.255+0000 7f43cef8f640 1 -- 172.21.15.6:0/1848336624 wait complete. 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.257+0000 7f43cef8f640 1 Processor -- start 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.257+0000 7f43cef8f640 1 -- start start 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43cef8f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c806d290 0x7f43c809c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43cef8f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c80b2f10 0x7f43c80cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43cef8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815d940 0x7f43c80cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43cef8f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43c80d16c0 con 0x7f43c806d290 2024-05-20T17:54:06.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43cef8f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f43c80d13e0 con 0x7f43c80b2f10 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43cef8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43c806dbe0 con 0x7f43c815d940 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43ccd2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c806d290 0x7f43c809c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43ccd2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c806d290 0x7f43c809c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55038/0 (socket says 172.21.15.6:55038) 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.258+0000 7f43ccd2b640 1 -- 172.21.15.6:0/1650916821 learned_addr learned my addr 172.21.15.6:0/1650916821 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43cd52c640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815d940 0x7f43c80cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43c7fff640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c80b2f10 0x7f43c80cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43ccd2b640 1 -- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815d940 msgr2=0x7f43c80cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43ccd2b640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815d940 0x7f43c80cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43ccd2b640 1 -- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c80b2f10 msgr2=0x7f43c80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43ccd2b640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c80b2f10 0x7f43c80cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43ccd2b640 1 -- 172.21.15.6:0/1650916821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c8155410 con 0x7f43c806d290 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43cd52c640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815d940 0x7f43c80cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43c7fff640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c80b2f10 0x7f43c80cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43ccd2b640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c806d290 0x7f43c809c9e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c7f0 tx=0x7f43b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43c57fa640 1 -- 172.21.15.6:0/1650916821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8015070 con 0x7f43c806d290 2024-05-20T17:54:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43c57fa640 1 -- 172.21.15.6:0/1650916821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b8007820 con 0x7f43c806d290 2024-05-20T17:54:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c809d290 con 0x7f43c806d290 2024-05-20T17:54:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43c57fa640 1 -- 172.21.15.6:0/1650916821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8007c10 con 0x7f43c806d290 2024-05-20T17:54:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.259+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c813de30 con 0x7f43c806d290 2024-05-20T17:54:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.260+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c81555e0 con 0x7f43c806d290 2024-05-20T17:54:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.261+0000 7f43c57fa640 1 -- 172.21.15.6:0/1650916821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43b8018070 con 0x7f43c806d290 2024-05-20T17:54:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.261+0000 7f43c57fa640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43b406be30 0x7f43b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.261+0000 7f43c57fa640 1 -- 172.21.15.6:0/1650916821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f43b808b1a0 con 0x7f43c806d290 2024-05-20T17:54:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.261+0000 7f43c7fff640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43b406be30 0x7f43b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.262+0000 7f43c7fff640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43b406be30 0x7f43b406e340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43bc006fd0 tx=0x7f43bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.266+0000 7f43c57fa640 1 -- 172.21.15.6:0/1650916821 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f43b8059690 con 0x7f43c806d290 2024-05-20T17:54:06.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.450+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43c806b9a0 con 0x7f43c806d290 2024-05-20T17:54:06.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.451+0000 7f43c57fa640 1 -- 172.21.15.6:0/1650916821 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f43b8058f90 con 0x7f43c806d290 2024-05-20T17:54:06.451 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:06.451 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43b406be30 msgr2=0x7f43b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43b406be30 0x7f43b406e340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43bc006fd0 tx=0x7f43bc008040 comp rx=0 tx=0).stop 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c806d290 msgr2=0x7f43c809c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c806d290 0x7f43c809c9e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c7f0 tx=0x7f43b800ccb0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 shutdown_connections 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43b406be30 0x7f43b406e340 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43c815d940 0x7f43c80cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43c80b2f10 0x7f43c80cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 --2- 172.21.15.6:0/1650916821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c806d290 0x7f43c809c9e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 >> 172.21.15.6:0/1650916821 conn(0x7f43c80b6670 msgr2=0x7f43c8070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:06.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 shutdown_connections 2024-05-20T17:54:06.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.453+0000 7f43cef8f640 1 -- 172.21.15.6:0/1650916821 wait complete. 2024-05-20T17:54:06.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:54:06.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:54:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.583+0000 7f25724f0640 1 Processor -- start 2024-05-20T17:54:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.583+0000 7f25724f0640 1 -- start start 2024-05-20T17:54:06.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f25724f0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c162820 0x7f256c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f25724f0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f256c0b3e80 0x7f256c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f25724f0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f256c06dd20 con 0x7f256c06d910 2024-05-20T17:54:06.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f25724f0640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f256c0d0630 con 0x7f256c0b3e80 2024-05-20T17:54:06.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f25724f0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f256c0d39c0 con 0x7f256c162820 2024-05-20T17:54:06.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f2570a8d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f256c06d910 0x7f256c0d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36926/0 (socket says 172.21.15.6:36926) 2024-05-20T17:54:06.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f2570a8d640 1 -- 172.21.15.6:0/3422135063 learned_addr learned my addr 172.21.15.6:0/3422135063 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404685753 0 0) 0x7f2564001490 con 0x7f256c06d910 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f256bfff640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c162820 0x7f256c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f2563fff640 1 --2- 172.21.15.6:0/3422135063 >> v2:172.21.15.171:3300/0 conn(0x7f256c0b3e80 0x7f256c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.585+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2558003520 con 0x7f256c06d910 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2937327581 0 0) 0x7f2558003520 con 0x7f256c06d910 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c162820 msgr2=0x7f256c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c162820 0x7f256c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 >> v2:172.21.15.171:3300/0 conn(0x7f256c0b3e80 msgr2=0x7f256c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 --2- 172.21.15.6:0/3422135063 >> v2:172.21.15.171:3300/0 conn(0x7f256c0b3e80 0x7f256c06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c0d3ca0 con 0x7f256c06d910 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f2564001bc0 con 0x7f256c06d910 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 >> v1:172.21.15.6:6789/0 conn(0x7f256c06d910 legacy=0x7f256c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25580039b0 0x7f2558003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c162820 0x7f2558004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2558004d40 0x7f2558005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0d0630 con 0x7f25580039b0 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0d39c0 con 0x7f2558004d40 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f255800b9c0 con 0x7f256c162820 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256bfff640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25580039b0 0x7f2558003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f2570a8d640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2558004d40 0x7f2558005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f2563fff640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c162820 0x7f2558004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256bfff640 1 -- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c162820 msgr2=0x7f2558004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256bfff640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c162820 0x7f2558004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256bfff640 1 -- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2558004d40 msgr2=0x7f2558005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256bfff640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2558004d40 0x7f2558005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.586+0000 7f256bfff640 1 -- 172.21.15.6:0/3422135063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2558003520 con 0x7f25580039b0 2024-05-20T17:54:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.587+0000 7f256bfff640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25580039b0 0x7f2558003e20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f255c009ac0 tx=0x7f2558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a3a9f51547d9b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.587+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c036070 con 0x7f25580039b0 2024-05-20T17:54:06.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.587+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c031400 con 0x7f25580039b0 2024-05-20T17:54:06.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.587+0000 7f256b7fe640 1 -- 172.21.15.6:0/3422135063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c009690 con 0x7f25580039b0 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.588+0000 7f25724f0640 1 -- 172.21.15.6:0/3422135063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25580039b0 msgr2=0x7f2558003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.588+0000 7f25724f0640 1 --2- 172.21.15.6:0/3422135063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25580039b0 0x7f2558003e20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f255c009ac0 tx=0x7f2558005830 comp rx=0 tx=0).stop 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.588+0000 7f2570a8d640 1 -- 172.21.15.6:0/3422135063 reap_dead start 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.588+0000 7f25724f0640 1 -- 172.21.15.6:0/3422135063 shutdown_connections 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.588+0000 7f25724f0640 1 -- 172.21.15.6:0/3422135063 >> 172.21.15.6:0/3422135063 conn(0x7f256c0d4bd0 msgr2=0x7f256c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.588+0000 7f25724f0640 1 -- 172.21.15.6:0/3422135063 shutdown_connections 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.588+0000 7f25724f0640 1 -- 172.21.15.6:0/3422135063 wait complete. 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.590+0000 7f25724f0640 1 Processor -- start 2024-05-20T17:54:06.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.590+0000 7f25724f0640 1 -- start start 2024-05-20T17:54:06.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f25724f0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25580039b0 0x7f256c0b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f25724f0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c1f4fd0 0x7f256c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f25724f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f256c147f50 0x7f256c148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f25724f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0d0300 con 0x7f256c147f50 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f25724f0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0d4260 con 0x7f25580039b0 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f25724f0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f256c0b91a0 con 0x7f256c1f4fd0 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f2570a8d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f256c147f50 0x7f256c148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f2570a8d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f256c147f50 0x7f256c148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55056/0 (socket says 172.21.15.6:55056) 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f2570a8d640 1 -- 172.21.15.6:0/3401180470 learned_addr learned my addr 172.21.15.6:0/3401180470 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f2563fff640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c1f4fd0 0x7f256c15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.591+0000 7f256bfff640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25580039b0 0x7f256c0b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f2570a8d640 1 -- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c1f4fd0 msgr2=0x7f256c15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f2570a8d640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c1f4fd0 0x7f256c15a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f2570a8d640 1 -- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25580039b0 msgr2=0x7f256c0b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f2570a8d640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25580039b0 0x7f256c0b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f2570a8d640 1 -- 172.21.15.6:0/3401180470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c0b5d80 con 0x7f256c147f50 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f256bfff640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25580039b0 0x7f256c0b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f2563fff640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c1f4fd0 0x7f256c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f2570a8d640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f256c147f50 0x7f256c148360 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b7740 tx=0x7f256400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f25697fa640 1 -- 172.21.15.6:0/3401180470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256400ec10 con 0x7f256c147f50 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f25697fa640 1 -- 172.21.15.6:0/3401180470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2564019070 con 0x7f256c147f50 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256c15d620 con 0x7f256c147f50 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f25697fa640 1 -- 172.21.15.6:0/3401180470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564013420 con 0x7f256c147f50 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.592+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256c0b6040 con 0x7f256c147f50 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.593+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256c075b00 con 0x7f256c147f50 2024-05-20T17:54:06.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.594+0000 7f25697fa640 1 -- 172.21.15.6:0/3401180470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f25640135c0 con 0x7f256c147f50 2024-05-20T17:54:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.594+0000 7f25697fa640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f254c06be60 0x7f254c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.594+0000 7f25697fa640 1 -- 172.21.15.6:0/3401180470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f256408b510 con 0x7f256c147f50 2024-05-20T17:54:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.594+0000 7f256bfff640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f254c06be60 0x7f254c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.595+0000 7f256bfff640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f254c06be60 0x7f254c06e370 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f255c033000 tx=0x7f255c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.599+0000 7f25697fa640 1 -- 172.21.15.6:0/3401180470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f256c06dd20 con 0x7f256c147f50 2024-05-20T17:54:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.781+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f256c160460 con 0x7f256c147f50 2024-05-20T17:54:06.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.782+0000 7f25697fa640 1 -- 172.21.15.6:0/3401180470 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f2564059a80 con 0x7f256c147f50 2024-05-20T17:54:06.781 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:54:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f254c06be60 msgr2=0x7f254c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f254c06be60 0x7f254c06e370 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f255c033000 tx=0x7f255c008030 comp rx=0 tx=0).stop 2024-05-20T17:54:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f256c147f50 msgr2=0x7f256c148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f256c147f50 0x7f256c148360 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b7740 tx=0x7f256400e530 comp rx=0 tx=0).stop 2024-05-20T17:54:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 shutdown_connections 2024-05-20T17:54:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f254c06be60 0x7f254c06e370 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f256c147f50 0x7f256c148360 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f256c1f4fd0 0x7f256c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 --2- 172.21.15.6:0/3401180470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25580039b0 0x7f256c0b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 >> 172.21.15.6:0/3401180470 conn(0x7f256c0d4bd0 msgr2=0x7f256c160680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 shutdown_connections 2024-05-20T17:54:06.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.784+0000 7f25724f0640 1 -- 172.21.15.6:0/3401180470 wait complete. 2024-05-20T17:54:06.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:54:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.913+0000 7f3164492640 1 Processor -- start 2024-05-20T17:54:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.913+0000 7f3164492640 1 -- start start 2024-05-20T17:54:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f3164492640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f315c0d1bc0 0x7f315c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f3164492640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c0d0370 con 0x7f315c163a10 2024-05-20T17:54:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f3164492640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c0d0650 con 0x7f315c0b4010 2024-05-20T17:54:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f3164492640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f315c0d3ca0 con 0x7f315c0d1bc0 2024-05-20T17:54:06.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f3162a2f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f315c0d1bc0 0x7f315c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f316222e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f315c163a10 0x7f315c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36934/0 (socket says 172.21.15.6:36934) 2024-05-20T17:54:06.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f316222e640 1 -- 172.21.15.6:0/483818867 learned_addr learned my addr 172.21.15.6:0/483818867 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f3162a2f640 1 -- 172.21.15.6:0/483818867 >> v1:172.21.15.171:6789/0 conn(0x7f315c0b4010 legacy=0x7f315c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f3162a2f640 1 -- 172.21.15.6:0/483818867 >> v1:172.21.15.6:6789/0 conn(0x7f315c163a10 legacy=0x7f315c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f3162a2f640 1 -- 172.21.15.6:0/483818867 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c0d3650 con 0x7f315c0d1bc0 2024-05-20T17:54:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.915+0000 7f316122c640 1 -- 172.21.15.6:0/483818867 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313168726 0 0) 0x7f315c0d0370 con 0x7f315c163a10 2024-05-20T17:54:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.916+0000 7f3162a2f640 1 --2- 172.21.15.6:0/483818867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c0d1bc0 0x7f315c0d4130 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f31540097a0 tx=0x7f315402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58e17e1314f19b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.916+0000 7f316122c640 1 -- 172.21.15.6:0/483818867 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154037070 con 0x7f315c0d1bc0 2024-05-20T17:54:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.916+0000 7f316122c640 1 -- 172.21.15.6:0/483818867 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3154032440 con 0x7f315c0d1bc0 2024-05-20T17:54:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.916+0000 7f316122c640 1 -- 172.21.15.6:0/483818867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154032810 con 0x7f315c0d1bc0 2024-05-20T17:54:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.917+0000 7f3164492640 1 -- 172.21.15.6:0/483818867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c0d1bc0 msgr2=0x7f315c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.917+0000 7f3164492640 1 --2- 172.21.15.6:0/483818867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c0d1bc0 0x7f315c0d4130 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f31540097a0 tx=0x7f315402a230 comp rx=0 tx=0).stop 2024-05-20T17:54:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.917+0000 7f3164492640 1 -- 172.21.15.6:0/483818867 shutdown_connections 2024-05-20T17:54:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.917+0000 7f3164492640 1 --2- 172.21.15.6:0/483818867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c0d1bc0 0x7f315c0d4130 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.917+0000 7f3164492640 1 -- 172.21.15.6:0/483818867 >> 172.21.15.6:0/483818867 conn(0x7f315c06d240 msgr2=0x7f315c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.917+0000 7f3164492640 1 -- 172.21.15.6:0/483818867 shutdown_connections 2024-05-20T17:54:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.917+0000 7f3164492640 1 -- 172.21.15.6:0/483818867 wait complete. 2024-05-20T17:54:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.919+0000 7f3164492640 1 Processor -- start 2024-05-20T17:54:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.919+0000 7f3164492640 1 -- start start 2024-05-20T17:54:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3164492640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f315c0b4010 0x7f315c1f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3164492640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c0d1bc0 0x7f315c1f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3164492640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c163a10 0x7f315c1f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3164492640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0b8390 con 0x7f315c163a10 2024-05-20T17:54:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3164492640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0b8210 con 0x7f315c0d1bc0 2024-05-20T17:54:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3164492640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0b8510 con 0x7f315c0b4010 2024-05-20T17:54:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3162a2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c163a10 0x7f315c1f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3162a2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c163a10 0x7f315c1f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55068/0 (socket says 172.21.15.6:55068) 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.920+0000 7f3162a2f640 1 -- 172.21.15.6:0/178505348 learned_addr learned my addr 172.21.15.6:0/178505348 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3162a2f640 1 -- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f315c0b4010 msgr2=0x7f315c1f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f316222e640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f315c0b4010 0x7f315c1f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3161a2d640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c0d1bc0 0x7f315c1f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3162a2f640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f315c0b4010 0x7f315c1f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3162a2f640 1 -- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c0d1bc0 msgr2=0x7f315c1f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3162a2f640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c0d1bc0 0x7f315c1f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3162a2f640 1 -- 172.21.15.6:0/178505348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c0b6200 con 0x7f315c163a10 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3162a2f640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c163a10 0x7f315c1f6460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f31540097a0 tx=0x7f31540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3152ffd640 1 -- 172.21.15.6:0/178505348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154037040 con 0x7f315c163a10 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3152ffd640 1 -- 172.21.15.6:0/178505348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3154042070 con 0x7f315c163a10 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c0b64e0 con 0x7f315c163a10 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3152ffd640 1 -- 172.21.15.6:0/178505348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154030b30 con 0x7f315c163a10 2024-05-20T17:54:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.921+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c0b6aa0 con 0x7f315c163a10 2024-05-20T17:54:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.922+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c075b00 con 0x7f315c163a10 2024-05-20T17:54:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.923+0000 7f3152ffd640 1 -- 172.21.15.6:0/178505348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3154030cd0 con 0x7f315c163a10 2024-05-20T17:54:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.923+0000 7f3152ffd640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f314006be60 0x7f314006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.924+0000 7f3152ffd640 1 -- 172.21.15.6:0/178505348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f31540abcb0 con 0x7f315c163a10 2024-05-20T17:54:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.924+0000 7f316222e640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f314006be60 0x7f314006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.924+0000 7f316222e640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f314006be60 0x7f314006e370 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3158007fd0 tx=0x7f3158009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:06.928+0000 7f3152ffd640 1 -- 172.21.15.6:0/178505348 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f315407a220 con 0x7f315c163a10 2024-05-20T17:54:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.110+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f315c162710 con 0x7f315c163a10 2024-05-20T17:54:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.111+0000 7f3152ffd640 1 -- 172.21.15.6:0/178505348 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f3154079b20 con 0x7f315c163a10 2024-05-20T17:54:07.110 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:07.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f314006be60 msgr2=0x7f314006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f314006be60 0x7f314006e370 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3158007fd0 tx=0x7f3158009040 comp rx=0 tx=0).stop 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c163a10 msgr2=0x7f315c1f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c163a10 0x7f315c1f6460 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f31540097a0 tx=0x7f31540046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 shutdown_connections 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f314006be60 0x7f314006e370 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f315c163a10 0x7f315c1f6460 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f315c0d1bc0 0x7f315c1f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 --2- 172.21.15.6:0/178505348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f315c0b4010 0x7f315c1f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 >> 172.21.15.6:0/178505348 conn(0x7f315c06d240 msgr2=0x7f315c0d4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 shutdown_connections 2024-05-20T17:54:07.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.113+0000 7f3164492640 1 -- 172.21.15.6:0/178505348 wait complete. 2024-05-20T17:54:07.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:54:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.242+0000 7f7185557640 1 Processor -- start 2024-05-20T17:54:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.242+0000 7f7185557640 1 -- start start 2024-05-20T17:54:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.243+0000 7f7185557640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7180159ca0 0x7f71800af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.243+0000 7f7185557640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f71800b23f0 0x7f718015c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.243+0000 7f7185557640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f718009a740 con 0x7f71800b1650 2024-05-20T17:54:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.243+0000 7f7185557640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f718009a4f0 con 0x7f7180159ca0 2024-05-20T17:54:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.243+0000 7f7185557640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f718009b350 con 0x7f71800b23f0 2024-05-20T17:54:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.243+0000 7f717effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7180159ca0 0x7f71800af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.243+0000 7f717effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7180159ca0 0x7f71800af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55076/0 (socket says 172.21.15.6:55076) 2024-05-20T17:54:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.243+0000 7f717effd640 1 -- 172.21.15.6:0/3170903981 learned_addr learned my addr 172.21.15.6:0/3170903981 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.244+0000 7f717f7fe640 1 --2- 172.21.15.6:0/3170903981 >> v2:172.21.15.171:3300/0 conn(0x7f71800b23f0 0x7f718015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.244+0000 7f717effd640 1 -- 172.21.15.6:0/3170903981 >> v2:172.21.15.171:3300/0 conn(0x7f71800b23f0 msgr2=0x7f718015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.244+0000 7f717effd640 1 --2- 172.21.15.6:0/3170903981 >> v2:172.21.15.171:3300/0 conn(0x7f71800b23f0 0x7f718015c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.244+0000 7f717effd640 1 -- 172.21.15.6:0/3170903981 >> v1:172.21.15.171:6789/0 conn(0x7f71800b1650 legacy=0x7f71800b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.244+0000 7f717effd640 1 -- 172.21.15.6:0/3170903981 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718009aa20 con 0x7f7180159ca0 2024-05-20T17:54:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.245+0000 7f717effd640 1 --2- 172.21.15.6:0/3170903981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7180159ca0 0x7f71800af230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f71800b7920 tx=0x7f717002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a15ab0360c7fefc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.245+0000 7f717dffb640 1 -- 172.21.15.6:0/3170903981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170036070 con 0x7f7180159ca0 2024-05-20T17:54:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.245+0000 7f717dffb640 1 -- 172.21.15.6:0/3170903981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7170031600 con 0x7f7180159ca0 2024-05-20T17:54:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.245+0000 7f717dffb640 1 -- 172.21.15.6:0/3170903981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71700319d0 con 0x7f7180159ca0 2024-05-20T17:54:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.245+0000 7f7185557640 1 -- 172.21.15.6:0/3170903981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7180159ca0 msgr2=0x7f71800af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.245+0000 7f7185557640 1 --2- 172.21.15.6:0/3170903981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7180159ca0 0x7f71800af230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f71800b7920 tx=0x7f717002a6a0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.246+0000 7f7185557640 1 -- 172.21.15.6:0/3170903981 shutdown_connections 2024-05-20T17:54:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.246+0000 7f7185557640 1 --2- 172.21.15.6:0/3170903981 >> v2:172.21.15.171:3300/0 conn(0x7f71800b23f0 0x7f718015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.246+0000 7f7185557640 1 --2- 172.21.15.6:0/3170903981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7180159ca0 0x7f71800af230 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.246+0000 7f7185557640 1 -- 172.21.15.6:0/3170903981 >> 172.21.15.6:0/3170903981 conn(0x7f71800b6620 msgr2=0x7f71800b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.246+0000 7f7185557640 1 -- 172.21.15.6:0/3170903981 shutdown_connections 2024-05-20T17:54:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.246+0000 7f7185557640 1 -- 172.21.15.6:0/3170903981 wait complete. 2024-05-20T17:54:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.247+0000 7f7185557640 1 Processor -- start 2024-05-20T17:54:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.248+0000 7f7185557640 1 -- start start 2024-05-20T17:54:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f7185557640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71800b1650 0x7f71801e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f7185557640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71800b23f0 0x7f718009f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f7185557640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7180159ca0 0x7f71801f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f7185557640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f718009afe0 con 0x7f71800b23f0 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f7185557640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f71800af770 con 0x7f71800b1650 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f7185557640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f718006c630 con 0x7f7180159ca0 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71800b23f0 0x7f718009f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71800b23f0 0x7f718009f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55084/0 (socket says 172.21.15.6:55084) 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717effd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71800b1650 0x7f71801e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717e7fc640 1 -- 172.21.15.6:0/2556788095 learned_addr learned my addr 172.21.15.6:0/2556788095 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717f7fe640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7180159ca0 0x7f71801f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717e7fc640 1 -- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7180159ca0 msgr2=0x7f71801f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717e7fc640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7180159ca0 0x7f71801f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717e7fc640 1 -- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71800b1650 msgr2=0x7f71801e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717e7fc640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71800b1650 0x7f71801e7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.249+0000 7f717e7fc640 1 -- 172.21.15.6:0/2556788095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718009f6f0 con 0x7f71800b23f0 2024-05-20T17:54:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.250+0000 7f717e7fc640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71800b23f0 0x7f718009f1b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f716800e710 tx=0x7f716800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.250+0000 7f71777fe640 1 -- 172.21.15.6:0/2556788095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71680052d0 con 0x7f71800b23f0 2024-05-20T17:54:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.250+0000 7f71777fe640 1 -- 172.21.15.6:0/2556788095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7168005470 con 0x7f71800b23f0 2024-05-20T17:54:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.250+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71801e5410 con 0x7f71800b23f0 2024-05-20T17:54:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.250+0000 7f71777fe640 1 -- 172.21.15.6:0/2556788095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168001ab0 con 0x7f71800b23f0 2024-05-20T17:54:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.250+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71801e59d0 con 0x7f71800b23f0 2024-05-20T17:54:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.251+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7180075b00 con 0x7f71800b23f0 2024-05-20T17:54:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.252+0000 7f71777fe640 1 -- 172.21.15.6:0/2556788095 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71680035f0 con 0x7f71800b23f0 2024-05-20T17:54:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.252+0000 7f71777fe640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f716006be30 0x7f716006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.252+0000 7f71777fe640 1 -- 172.21.15.6:0/2556788095 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f716808d4b0 con 0x7f71800b23f0 2024-05-20T17:54:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.252+0000 7f717effd640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f716006be30 0x7f716006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.253+0000 7f717effd640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f716006be30 0x7f716006e340 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7170033000 tx=0x7f7170009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.257+0000 7f71777fe640 1 -- 172.21.15.6:0/2556788095 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7168016020 con 0x7f71800b23f0 2024-05-20T17:54:07.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.440+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f718015a4c0 con 0x7f71800b23f0 2024-05-20T17:54:07.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.441+0000 7f71777fe640 1 -- 172.21.15.6:0/2556788095 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f716800ee20 con 0x7f71800b23f0 2024-05-20T17:54:07.440 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:54:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f716006be30 msgr2=0x7f716006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f716006be30 0x7f716006e340 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7170033000 tx=0x7f7170009000 comp rx=0 tx=0).stop 2024-05-20T17:54:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71800b23f0 msgr2=0x7f718009f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71800b23f0 0x7f718009f1b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f716800e710 tx=0x7f716800ebd0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 shutdown_connections 2024-05-20T17:54:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f716006be30 0x7f716006e340 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7180159ca0 0x7f71801f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71800b23f0 0x7f718009f1b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 --2- 172.21.15.6:0/2556788095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71800b1650 0x7f71801e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 >> 172.21.15.6:0/2556788095 conn(0x7f71800b6620 msgr2=0x7f71800b6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 shutdown_connections 2024-05-20T17:54:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.443+0000 7f7185557640 1 -- 172.21.15.6:0/2556788095 wait complete. 2024-05-20T17:54:07.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:54:07.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.572+0000 7f047c651640 1 Processor -- start 2024-05-20T17:54:07.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.572+0000 7f047c651640 1 -- start start 2024-05-20T17:54:07.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047c651640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f04740afad0 0x7f04740b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047c651640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f047415d160 0x7f04740b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047c651640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04740b3aa0 con 0x7f04740afee0 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047c651640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f04740b3850 con 0x7f047415d160 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047c651640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f04740703e0 con 0x7f04740afad0 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f0479bec640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04740afee0 0x7f047415ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36950/0 (socket says 172.21.15.6:36950) 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047abee640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f047415d160 0x7f04740b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f0479bec640 1 -- 172.21.15.6:0/686921928 learned_addr learned my addr 172.21.15.6:0/686921928 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047a3ed640 1 --2- 172.21.15.6:0/686921928 >> v2:172.21.15.171:3300/0 conn(0x7f04740afad0 0x7f04740b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047abee640 1 -- 172.21.15.6:0/686921928 >> v2:172.21.15.171:3300/0 conn(0x7f04740afad0 msgr2=0x7f04740b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047abee640 1 --2- 172.21.15.6:0/686921928 >> v2:172.21.15.171:3300/0 conn(0x7f04740afad0 0x7f04740b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047abee640 1 -- 172.21.15.6:0/686921928 >> v1:172.21.15.6:6789/0 conn(0x7f04740afee0 legacy=0x7f047415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f04793eb640 1 -- 172.21.15.6:0/686921928 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951259856 0 0) 0x7f04740b3aa0 con 0x7f04740afee0 2024-05-20T17:54:07.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047abee640 1 -- 172.21.15.6:0/686921928 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04740b3d80 con 0x7f047415d160 2024-05-20T17:54:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.574+0000 7f047a3ed640 1 --2- 172.21.15.6:0/686921928 >> v2:172.21.15.171:3300/0 conn(0x7f04740afad0 0x7f04740b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.575+0000 7f047abee640 1 --2- 172.21.15.6:0/686921928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f047415d160 0x7f04740b5720 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f047406cf20 tx=0x7f046c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e7db03901a6d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.575+0000 7f04793eb640 1 -- 172.21.15.6:0/686921928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c037070 con 0x7f047415d160 2024-05-20T17:54:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.575+0000 7f04793eb640 1 -- 172.21.15.6:0/686921928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046c032440 con 0x7f047415d160 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.575+0000 7f04793eb640 1 -- 172.21.15.6:0/686921928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c02ae60 con 0x7f047415d160 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.576+0000 7f047c651640 1 -- 172.21.15.6:0/686921928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f047415d160 msgr2=0x7f04740b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.576+0000 7f047c651640 1 --2- 172.21.15.6:0/686921928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f047415d160 0x7f04740b5720 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f047406cf20 tx=0x7f046c02a110 comp rx=0 tx=0).stop 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.576+0000 7f047c651640 1 -- 172.21.15.6:0/686921928 shutdown_connections 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.576+0000 7f047c651640 1 --2- 172.21.15.6:0/686921928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f047415d160 0x7f04740b5720 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.576+0000 7f047c651640 1 --2- 172.21.15.6:0/686921928 >> v2:172.21.15.171:3300/0 conn(0x7f04740afad0 0x7f04740b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.576+0000 7f047c651640 1 -- 172.21.15.6:0/686921928 >> 172.21.15.6:0/686921928 conn(0x7f04740cd2a0 msgr2=0x7f04740cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.576+0000 7f047c651640 1 -- 172.21.15.6:0/686921928 shutdown_connections 2024-05-20T17:54:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.576+0000 7f047c651640 1 -- 172.21.15.6:0/686921928 wait complete. 2024-05-20T17:54:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.578+0000 7f047c651640 1 Processor -- start 2024-05-20T17:54:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.578+0000 7f047c651640 1 -- start start 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f047c651640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04740afad0 0x7f047415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f047c651640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04740afee0 0x7f047414e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f047c651640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f047415d160 0x7f04740ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f047c651640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04740b4860 con 0x7f04740afee0 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f047c651640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04740b4340 con 0x7f047415d160 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f047c651640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f047415c150 con 0x7f04740afad0 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f0479bec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04740afee0 0x7f047414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f0479bec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04740afee0 0x7f047414e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55102/0 (socket says 172.21.15.6:55102) 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f0479bec640 1 -- 172.21.15.6:0/993119821 learned_addr learned my addr 172.21.15.6:0/993119821 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f047a3ed640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04740afad0 0x7f047415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.579+0000 7f047abee640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f047415d160 0x7f04740ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0479bec640 1 -- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04740afad0 msgr2=0x7f047415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0479bec640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04740afad0 0x7f047415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0479bec640 1 -- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f047415d160 msgr2=0x7f04740ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0479bec640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f047415d160 0x7f04740ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0479bec640 1 -- 172.21.15.6:0/993119821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047415c3a0 con 0x7f04740afee0 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f047abee640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f047415d160 0x7f04740ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0479bec640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04740afee0 0x7f047414e190 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f046800c430 tx=0x7f046800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0472ffd640 1 -- 172.21.15.6:0/993119821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04680074e0 con 0x7f04740afee0 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0472ffd640 1 -- 172.21.15.6:0/993119821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04680047e0 con 0x7f04740afee0 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0474157900 con 0x7f04740afee0 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f0472ffd640 1 -- 172.21.15.6:0/993119821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468004bd0 con 0x7f04740afee0 2024-05-20T17:54:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.580+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047415ae20 con 0x7f04740afee0 2024-05-20T17:54:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.581+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0474075b00 con 0x7f04740afee0 2024-05-20T17:54:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.582+0000 7f0472ffd640 1 -- 172.21.15.6:0/993119821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0468011070 con 0x7f04740afee0 2024-05-20T17:54:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.582+0000 7f0472ffd640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f046006be30 0x7f046006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.582+0000 7f0472ffd640 1 -- 172.21.15.6:0/993119821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f046808afd0 con 0x7f04740afee0 2024-05-20T17:54:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.582+0000 7f047a3ed640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f046006be30 0x7f046006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.583+0000 7f047a3ed640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f046006be30 0x7f046006e340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0474071be0 tx=0x7f0464003cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.587+0000 7f0472ffd640 1 -- 172.21.15.6:0/993119821 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f04680594b0 con 0x7f04740afee0 2024-05-20T17:54:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.772+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f047415ee00 con 0x7f04740afee0 2024-05-20T17:54:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.773+0000 7f0472ffd640 1 -- 172.21.15.6:0/993119821 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f0468058db0 con 0x7f04740afee0 2024-05-20T17:54:07.772 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:07.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f046006be30 msgr2=0x7f046006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f046006be30 0x7f046006e340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0474071be0 tx=0x7f0464003cd0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04740afee0 msgr2=0x7f047414e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04740afee0 0x7f047414e190 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f046800c430 tx=0x7f046800c8f0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 shutdown_connections 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f046006be30 0x7f046006e340 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f047415d160 0x7f04740ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04740afee0 0x7f047414e190 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 --2- 172.21.15.6:0/993119821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04740afad0 0x7f047415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 >> 172.21.15.6:0/993119821 conn(0x7f04740cd2a0 msgr2=0x7f0474072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 shutdown_connections 2024-05-20T17:54:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.775+0000 7f047c651640 1 -- 172.21.15.6:0/993119821 wait complete. 2024-05-20T17:54:07.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:54:07.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.902+0000 7fb1376e2640 1 Processor -- start 2024-05-20T17:54:07.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.902+0000 7fb1376e2640 1 -- start start 2024-05-20T17:54:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb1376e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1300cfae0 0x7fb130162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb1376e2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb13006c8c0 con 0x7fb13006d6b0 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb1376e2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb13006dac0 con 0x7fb1300cd710 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb1376e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1300d0ba0 con 0x7fb1300cfae0 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb135c7f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb13006d6b0 0x7fb1300d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58578/0 (socket says 172.21.15.6:58578) 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb135c7f640 1 -- 172.21.15.6:0/4201383857 learned_addr learned my addr 172.21.15.6:0/4201383857 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb134c7d640 1 --2- 172.21.15.6:0/4201383857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1300cfae0 0x7fb130162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb127fff640 1 -- 172.21.15.6:0/4201383857 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703330484 0 0) 0x7fb13006c8c0 con 0x7fb13006d6b0 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb127fff640 1 -- 172.21.15.6:0/4201383857 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb11c003520 con 0x7fb13006d6b0 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb127fff640 1 -- 172.21.15.6:0/4201383857 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3814433605 0 0) 0x7fb13006dac0 con 0x7fb1300cd710 2024-05-20T17:54:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb127fff640 1 -- 172.21.15.6:0/4201383857 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb13006c8c0 con 0x7fb1300cd710 2024-05-20T17:54:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb127fff640 1 -- 172.21.15.6:0/4201383857 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1702192773 0 0) 0x7fb11c003520 con 0x7fb13006d6b0 2024-05-20T17:54:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb134c7d640 1 -- 172.21.15.6:0/4201383857 >> v1:172.21.15.171:6789/0 conn(0x7fb1300cd710 legacy=0x7fb1300cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb134c7d640 1 -- 172.21.15.6:0/4201383857 >> v1:172.21.15.6:6789/0 conn(0x7fb13006d6b0 legacy=0x7fb1300d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.904+0000 7fb134c7d640 1 -- 172.21.15.6:0/4201383857 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1301633e0 con 0x7fb1300cfae0 2024-05-20T17:54:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.905+0000 7fb134c7d640 1 --2- 172.21.15.6:0/4201383857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1300cfae0 0x7fb130162e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb1300d0d20 tx=0x7fb12002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a2c0f87fccb137 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.905+0000 7fb127fff640 1 -- 172.21.15.6:0/4201383857 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120037070 con 0x7fb1300cfae0 2024-05-20T17:54:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.905+0000 7fb127fff640 1 -- 172.21.15.6:0/4201383857 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12002ac10 con 0x7fb1300cfae0 2024-05-20T17:54:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.905+0000 7fb127fff640 1 -- 172.21.15.6:0/4201383857 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128001a10 con 0x7fb1300cfae0 2024-05-20T17:54:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.906+0000 7fb1376e2640 1 -- 172.21.15.6:0/4201383857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1300cfae0 msgr2=0x7fb130162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.906+0000 7fb1376e2640 1 --2- 172.21.15.6:0/4201383857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1300cfae0 0x7fb130162e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb1300d0d20 tx=0x7fb12002a180 comp rx=0 tx=0).stop 2024-05-20T17:54:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.906+0000 7fb1376e2640 1 -- 172.21.15.6:0/4201383857 shutdown_connections 2024-05-20T17:54:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.906+0000 7fb1376e2640 1 --2- 172.21.15.6:0/4201383857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1300cfae0 0x7fb130162e00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.906+0000 7fb1376e2640 1 -- 172.21.15.6:0/4201383857 >> 172.21.15.6:0/4201383857 conn(0x7fb1300b44d0 msgr2=0x7fb1300b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.906+0000 7fb1376e2640 1 -- 172.21.15.6:0/4201383857 shutdown_connections 2024-05-20T17:54:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.906+0000 7fb1376e2640 1 -- 172.21.15.6:0/4201383857 wait complete. 2024-05-20T17:54:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.908+0000 7fb1376e2640 1 Processor -- start 2024-05-20T17:54:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.908+0000 7fb1376e2640 1 -- start start 2024-05-20T17:54:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb1376e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13006d6b0 0x7fb13014ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb1376e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1300cd710 0x7fb1300b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb1376e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1300ca4a0 0x7fb1300b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb1376e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb130163c80 con 0x7fb1300ca4a0 2024-05-20T17:54:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb1376e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb130163720 con 0x7fb1300cd710 2024-05-20T17:54:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb1376e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb13015f2b0 con 0x7fb13006d6b0 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb135c7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1300ca4a0 0x7fb1300b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb135c7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1300ca4a0 0x7fb1300b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55672/0 (socket says 172.21.15.6:55672) 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.909+0000 7fb135c7f640 1 -- 172.21.15.6:0/1431685352 learned_addr learned my addr 172.21.15.6:0/1431685352 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb134c7d640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1300cd710 0x7fb1300b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb13547e640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13006d6b0 0x7fb13014ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb135c7f640 1 -- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13006d6b0 msgr2=0x7fb13014ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb135c7f640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13006d6b0 0x7fb13014ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb135c7f640 1 -- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1300cd710 msgr2=0x7fb1300b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb135c7f640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1300cd710 0x7fb1300b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb135c7f640 1 -- 172.21.15.6:0/1431685352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13014f340 con 0x7fb1300ca4a0 2024-05-20T17:54:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb13547e640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13006d6b0 0x7fb13014ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb135c7f640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1300ca4a0 0x7fb1300b6260 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb12800c7d0 tx=0x7fb12800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb125ffb640 1 -- 172.21.15.6:0/1431685352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128018070 con 0x7fb1300ca4a0 2024-05-20T17:54:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb125ffb640 1 -- 172.21.15.6:0/1431685352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12800a640 con 0x7fb1300ca4a0 2024-05-20T17:54:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1300b75f0 con 0x7fb1300ca4a0 2024-05-20T17:54:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb125ffb640 1 -- 172.21.15.6:0/1431685352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12800aa30 con 0x7fb1300ca4a0 2024-05-20T17:54:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.910+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1300b5780 con 0x7fb1300ca4a0 2024-05-20T17:54:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.911+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1300b77c0 con 0x7fb1300ca4a0 2024-05-20T17:54:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.912+0000 7fb125ffb640 1 -- 172.21.15.6:0/1431685352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb12801b070 con 0x7fb1300ca4a0 2024-05-20T17:54:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.912+0000 7fb125ffb640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11406be60 0x7fb11406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.912+0000 7fb125ffb640 1 -- 172.21.15.6:0/1431685352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fb12808a830 con 0x7fb1300ca4a0 2024-05-20T17:54:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.913+0000 7fb13547e640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11406be60 0x7fb11406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.913+0000 7fb13547e640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11406be60 0x7fb11406e370 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0011e0 tx=0x7fb12c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:07.917+0000 7fb125ffb640 1 -- 172.21.15.6:0/1431685352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb128058750 con 0x7fb1300ca4a0 2024-05-20T17:54:08.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.114+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb130075b00 con 0x7fb1300ca4a0 2024-05-20T17:54:08.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.114+0000 7fb125ffb640 1 -- 172.21.15.6:0/1431685352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fb12805ca50 con 0x7fb1300ca4a0 2024-05-20T17:54:08.114 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11406be60 msgr2=0x7fb11406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11406be60 0x7fb11406e370 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0011e0 tx=0x7fb12c009040 comp rx=0 tx=0).stop 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1300ca4a0 msgr2=0x7fb1300b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1300ca4a0 0x7fb1300b6260 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb12800c7d0 tx=0x7fb12800cc90 comp rx=0 tx=0).stop 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 shutdown_connections 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11406be60 0x7fb11406e370 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1300ca4a0 0x7fb1300b6260 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1300cd710 0x7fb1300b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 --2- 172.21.15.6:0/1431685352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb13006d6b0 0x7fb13014ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 >> 172.21.15.6:0/1431685352 conn(0x7fb1300b44d0 msgr2=0x7fb130161690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 shutdown_connections 2024-05-20T17:54:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.116+0000 7fb1376e2640 1 -- 172.21.15.6:0/1431685352 wait complete. 2024-05-20T17:54:08.127 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-20T17:54:08.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:08.127 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-20T17:54:08.161 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:54:08.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:08.162 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-20T17:54:08.221 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T17:54:08.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:54:08.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.337+0000 7ff021584640 1 Processor -- start 2024-05-20T17:54:08.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.337+0000 7ff021584640 1 -- start start 2024-05-20T17:54:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff021584640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 0x7ff01c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff021584640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01c06dd20 con 0x7ff01c162820 2024-05-20T17:54:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff021584640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01c0d0630 con 0x7ff01c0b8190 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff021584640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff01c0d39c0 con 0x7ff01c06d3d0 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff01affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff01c162820 0x7ff01c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58586/0 (socket says 172.21.15.6:58586) 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff01affd640 1 -- 172.21.15.6:0/166006960 learned_addr learned my addr 172.21.15.6:0/166006960 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3340822095 0 0) 0x7ff00c001490 con 0x7ff01c162820 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff01a7fc640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 0x7ff01c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff004003520 con 0x7ff01c162820 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.339+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3450543726 0 0) 0x7ff004003520 con 0x7ff01c162820 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 msgr2=0x7ff01c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 0x7ff01c06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 >> v1:172.21.15.171:6789/0 conn(0x7ff01c0b8190 legacy=0x7ff01c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c0d3ca0 con 0x7ff01c162820 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ff00c001bc0 con 0x7ff01c162820 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 >> v1:172.21.15.6:6789/0 conn(0x7ff01c162820 legacy=0x7ff01c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff004003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff004004800 0x7ff004004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 0x7ff004005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c0d39c0 con 0x7ff0040039e0 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff00400baf0 con 0x7ff004004800 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff00400bcf0 con 0x7ff01c06d3d0 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01affd640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff004003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01a7fc640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff004004800 0x7ff004004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01b7fe640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 0x7ff004005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01affd640 1 -- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 msgr2=0x7ff004005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01affd640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 0x7ff004005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01affd640 1 -- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff004004800 msgr2=0x7ff004004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01affd640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff004004800 0x7ff004004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01affd640 1 -- 172.21.15.6:0/166006960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff004003520 con 0x7ff0040039e0 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.340+0000 7ff01b7fe640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c06d3d0 0x7ff004005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.341+0000 7ff01affd640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff004003e50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00a9f0 tx=0x7ff004005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d1c745e99dd84 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.341+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00a640 con 0x7ff0040039e0 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.341+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00c02f070 con 0x7ff0040039e0 2024-05-20T17:54:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.341+0000 7ff019ffb640 1 -- 172.21.15.6:0/166006960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c034470 con 0x7ff0040039e0 2024-05-20T17:54:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.342+0000 7ff021584640 1 -- 172.21.15.6:0/166006960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 msgr2=0x7ff004003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.342+0000 7ff021584640 1 --2- 172.21.15.6:0/166006960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff004003e50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00a9f0 tx=0x7ff004005830 comp rx=0 tx=0).stop 2024-05-20T17:54:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.342+0000 7ff01b7fe640 1 -- 172.21.15.6:0/166006960 reap_dead start 2024-05-20T17:54:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.342+0000 7ff021584640 1 -- 172.21.15.6:0/166006960 shutdown_connections 2024-05-20T17:54:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.342+0000 7ff021584640 1 -- 172.21.15.6:0/166006960 >> 172.21.15.6:0/166006960 conn(0x7ff01c0d4bd0 msgr2=0x7ff01c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.342+0000 7ff021584640 1 -- 172.21.15.6:0/166006960 shutdown_connections 2024-05-20T17:54:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.342+0000 7ff021584640 1 -- 172.21.15.6:0/166006960 wait complete. 2024-05-20T17:54:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.344+0000 7ff021584640 1 Processor -- start 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.344+0000 7ff021584640 1 -- start start 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff021584640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff01c1f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff021584640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c1e9480 0x7ff01c14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff021584640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff01c0ce540 0x7ff01c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff021584640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c0d0300 con 0x7ff0040039e0 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff021584640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c0d4260 con 0x7ff01c0ce540 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff021584640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff01c0b4050 con 0x7ff01c1e9480 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff01c1f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff01c1f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55688/0 (socket says 172.21.15.6:55688) 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01affd640 1 -- 172.21.15.6:0/3644215540 learned_addr learned my addr 172.21.15.6:0/3644215540 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01b7fe640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff01c0ce540 0x7ff01c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01a7fc640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c1e9480 0x7ff01c14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01affd640 1 -- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c1e9480 msgr2=0x7ff01c14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01affd640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c1e9480 0x7ff01c14ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01affd640 1 -- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff01c0ce540 msgr2=0x7ff01c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01affd640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff01c0ce540 0x7ff01c0ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.345+0000 7ff01affd640 1 -- 172.21.15.6:0/3644215540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c1e9890 con 0x7ff0040039e0 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.346+0000 7ff01affd640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff01c1f51e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff00c001ec0 tx=0x7ff01c08d500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.346+0000 7ff0037fe640 1 -- 172.21.15.6:0/3644215540 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c044070 con 0x7ff0040039e0 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.346+0000 7ff0037fe640 1 -- 172.21.15.6:0/3644215540 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00c0348a0 con 0x7ff0040039e0 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.346+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01c0cee90 con 0x7ff0040039e0 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.346+0000 7ff0037fe640 1 -- 172.21.15.6:0/3644215540 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00a640 con 0x7ff0040039e0 2024-05-20T17:54:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.346+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff01c1e8190 con 0x7ff0040039e0 2024-05-20T17:54:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.347+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c1f88e0 con 0x7ff0040039e0 2024-05-20T17:54:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.347+0000 7ff0037fe640 1 -- 172.21.15.6:0/3644215540 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff00c047070 con 0x7ff0040039e0 2024-05-20T17:54:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.348+0000 7ff0037fe640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff00806be30 0x7ff00806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.348+0000 7ff0037fe640 1 -- 172.21.15.6:0/3644215540 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7ff00c0ab380 con 0x7ff0040039e0 2024-05-20T17:54:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.348+0000 7ff01a7fc640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff00806be30 0x7ff00806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.349+0000 7ff01a7fc640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff00806be30 0x7ff00806e340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0c7da0 tx=0x7ff010008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:08.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.353+0000 7ff0037fe640 1 -- 172.21.15.6:0/3644215540 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff01c0cee90 con 0x7ff0040039e0 2024-05-20T17:54:08.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.579+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff01c075b00 con 0x7ff0040039e0 2024-05-20T17:54:08.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.580+0000 7ff0037fe640 1 -- 172.21.15.6:0/3644215540 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7ff01c1e9890 con 0x7ff0040039e0 2024-05-20T17:54:08.579 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:08.580 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:29.005012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:54:08.580 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:54:08.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff00806be30 msgr2=0x7ff00806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff00806be30 0x7ff00806e340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0c7da0 tx=0x7ff010008040 comp rx=0 tx=0).stop 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 msgr2=0x7ff01c1f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff01c1f51e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff00c001ec0 tx=0x7ff01c08d500 comp rx=0 tx=0).stop 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 shutdown_connections 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff00806be30 0x7ff00806e340 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff01c0ce540 0x7ff01c0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff01c1e9480 0x7ff01c14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 --2- 172.21.15.6:0/3644215540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0040039e0 0x7ff01c1f51e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 >> 172.21.15.6:0/3644215540 conn(0x7ff01c0d4bd0 msgr2=0x7ff01c160b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 shutdown_connections 2024-05-20T17:54:08.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.582+0000 7ff021584640 1 -- 172.21.15.6:0/3644215540 wait complete. 2024-05-20T17:54:08.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:08.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.708+0000 7f946d275640 1 Processor -- start 2024-05-20T17:54:08.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.708+0000 7f946d275640 1 -- start start 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f946d275640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94680d4400 0x7f946815f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f946d275640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 0x7f946806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f946d275640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f946808d2a0 con 0x7f94680d2780 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f946d275640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f94680d3f70 con 0x7f94680d4400 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f946d275640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f946806d850 con 0x7f946806cf00 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f9466ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94680d4400 0x7f946815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f9466ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94680d4400 0x7f946815f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55692/0 (socket says 172.21.15.6:55692) 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f9466ffd640 1 -- 172.21.15.6:0/3691689745 learned_addr learned my addr 172.21.15.6:0/3691689745 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f94667fc640 1 --2- 172.21.15.6:0/3691689745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 0x7f946806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f9466ffd640 1 -- 172.21.15.6:0/3691689745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 msgr2=0x7f946806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:08.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f9466ffd640 1 --2- 172.21.15.6:0/3691689745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 0x7f946806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f9466ffd640 1 -- 172.21.15.6:0/3691689745 >> v1:172.21.15.171:6789/0 conn(0x7f94680d2780 legacy=0x7f94680d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.710+0000 7f9466ffd640 1 -- 172.21.15.6:0/3691689745 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94680d4810 con 0x7f94680d4400 2024-05-20T17:54:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.711+0000 7f9466ffd640 1 --2- 172.21.15.6:0/3691689745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d4400 0x7f946815f440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9460009e80 tx=0x7f946002a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5c8956ab07fc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.711+0000 7f9465ffb640 1 -- 172.21.15.6:0/3691689745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460036070 con 0x7f94680d4400 2024-05-20T17:54:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.711+0000 7f9465ffb640 1 -- 172.21.15.6:0/3691689745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9460031600 con 0x7f94680d4400 2024-05-20T17:54:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.711+0000 7f9465ffb640 1 -- 172.21.15.6:0/3691689745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94600319d0 con 0x7f94680d4400 2024-05-20T17:54:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.712+0000 7f946d275640 1 -- 172.21.15.6:0/3691689745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d4400 msgr2=0x7f946815f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.712+0000 7f946d275640 1 --2- 172.21.15.6:0/3691689745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d4400 0x7f946815f440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9460009e80 tx=0x7f946002a7e0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.712+0000 7f946d275640 1 -- 172.21.15.6:0/3691689745 shutdown_connections 2024-05-20T17:54:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.712+0000 7f946d275640 1 --2- 172.21.15.6:0/3691689745 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 0x7f946806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.712+0000 7f946d275640 1 --2- 172.21.15.6:0/3691689745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d4400 0x7f946815f440 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.712+0000 7f946d275640 1 -- 172.21.15.6:0/3691689745 >> 172.21.15.6:0/3691689745 conn(0x7f94680d4bb0 msgr2=0x7f94680d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:08.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.712+0000 7f946d275640 1 -- 172.21.15.6:0/3691689745 shutdown_connections 2024-05-20T17:54:08.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.712+0000 7f946d275640 1 -- 172.21.15.6:0/3691689745 wait complete. 2024-05-20T17:54:08.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.714+0000 7f946d275640 1 Processor -- start 2024-05-20T17:54:08.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.714+0000 7f946d275640 1 -- start start 2024-05-20T17:54:08.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f946d275640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 0x7f9468153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f946d275640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d2780 0x7f94680cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f946d275640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94680d4400 0x7f94681f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f946d275640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f94680d3920 con 0x7f94680d2780 2024-05-20T17:54:08.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f946d275640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94680d3640 con 0x7f94680d4400 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f946d275640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94680d3c00 con 0x7f946806cf00 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f94667fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d2780 0x7f94680cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f94667fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d2780 0x7f94680cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55700/0 (socket says 172.21.15.6:55700) 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.715+0000 7f94667fc640 1 -- 172.21.15.6:0/3186361704 learned_addr learned my addr 172.21.15.6:0/3186361704 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f9466ffd640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 0x7f9468153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f94677fe640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94680d4400 0x7f94681f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f94667fc640 1 -- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 msgr2=0x7f9468153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f94667fc640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 0x7f9468153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f94667fc640 1 -- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94680d4400 msgr2=0x7f94681f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f94667fc640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94680d4400 0x7f94681f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f94667fc640 1 -- 172.21.15.6:0/3186361704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9468154830 con 0x7f94680d2780 2024-05-20T17:54:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f94667fc640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d2780 0x7f94680cd640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f945000d620 tx=0x7f945000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:08.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f945f7fe640 1 -- 172.21.15.6:0/3186361704 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500125f0 con 0x7f94680d2780 2024-05-20T17:54:08.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f945f7fe640 1 -- 172.21.15.6:0/3186361704 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9450019070 con 0x7f94680d2780 2024-05-20T17:54:08.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f945f7fe640 1 -- 172.21.15.6:0/3186361704 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500129d0 con 0x7f94680d2780 2024-05-20T17:54:08.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9468154b10 con 0x7f94680d2780 2024-05-20T17:54:08.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.716+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94681550d0 con 0x7f94680d2780 2024-05-20T17:54:08.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.717+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94680735a0 con 0x7f94680d2780 2024-05-20T17:54:08.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.718+0000 7f945f7fe640 1 -- 172.21.15.6:0/3186361704 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9450012b70 con 0x7f94680d2780 2024-05-20T17:54:08.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.718+0000 7f945f7fe640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f944806be60 0x7f944806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:08.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.719+0000 7f945f7fe640 1 -- 172.21.15.6:0/3186361704 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f945008b620 con 0x7f94680d2780 2024-05-20T17:54:08.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.719+0000 7f9466ffd640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f944806be60 0x7f944806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:08.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.719+0000 7f9466ffd640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f944806be60 0x7f944806e370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9460033000 tx=0x7f9460009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.723+0000 7f945f7fe640 1 -- 172.21.15.6:0/3186361704 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f94680735a0 con 0x7f94680d2780 2024-05-20T17:54:08.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.908+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94681545c0 con 0x7f94680d2780 2024-05-20T17:54:08.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.910+0000 7f945f7fe640 1 -- 172.21.15.6:0/3186361704 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f9450059b90 con 0x7f94680d2780 2024-05-20T17:54:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:08.909 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:08.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.911+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f944806be60 msgr2=0x7f944806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.911+0000 7f946d275640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f944806be60 0x7f944806e370 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9460033000 tx=0x7f9460009000 comp rx=0 tx=0).stop 2024-05-20T17:54:08.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.911+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d2780 msgr2=0x7f94680cd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:08.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.911+0000 7f946d275640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d2780 0x7f94680cd640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f945000d620 tx=0x7f945000dae0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.912+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 shutdown_connections 2024-05-20T17:54:08.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.912+0000 7f946d275640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f944806be60 0x7f944806e370 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.912+0000 7f946d275640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94680d4400 0x7f94681f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.912+0000 7f946d275640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94680d2780 0x7f94680cd640 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.912+0000 7f946d275640 1 --2- 172.21.15.6:0/3186361704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f946806cf00 0x7f9468153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:08.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.912+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 >> 172.21.15.6:0/3186361704 conn(0x7f94680d4bb0 msgr2=0x7f946815fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:08.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.912+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 shutdown_connections 2024-05-20T17:54:08.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:08.912+0000 7f946d275640 1 -- 172.21.15.6:0/3186361704 wait complete. 2024-05-20T17:54:08.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:53:04.608346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:53:05.926595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-20T17:53:09.616865+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-20T17:54:08.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:54:09.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.042+0000 7f2d92a14640 1 Processor -- start 2024-05-20T17:54:09.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.042+0000 7f2d92a14640 1 -- start start 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.043+0000 7f2d92a14640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d8c0b4010 0x7f2d8c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.043+0000 7f2d92a14640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c0d14b0 0x7f2d8c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.043+0000 7f2d92a14640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8c0d0370 con 0x7f2d8c163a10 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.043+0000 7f2d92a14640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2d8c0d3ca0 con 0x7f2d8c0b4010 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.043+0000 7f2d92a14640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8c0d0650 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8b7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d8c0b4010 0x7f2d8c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d90fb1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c0d14b0 0x7f2d8c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8b7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d8c0b4010 0x7f2d8c0d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:36414/0 (socket says 172.21.15.6:36414) 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8b7fe640 1 -- 172.21.15.6:0/3334482932 learned_addr learned my addr 172.21.15.6:0/3334482932 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d90fb1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c0d14b0 0x7f2d8c0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:46148/0 (socket says 172.21.15.6:46148) 2024-05-20T17:54:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8bfff640 1 --1- 172.21.15.6:0/3334482932 >> v1:172.21.15.171:6789/0 conn(0x7f2d8c163a10 0x7f2d8c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:37608/0 (socket says 172.21.15.6:37608) 2024-05-20T17:54:09.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8b7fe640 1 -- 172.21.15.6:0/3334482932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c0d14b0 msgr2=0x7f2d8c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8b7fe640 1 --2- 172.21.15.6:0/3334482932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c0d14b0 0x7f2d8c0d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8b7fe640 1 -- 172.21.15.6:0/3334482932 >> v1:172.21.15.171:6789/0 conn(0x7f2d8c163a10 legacy=0x7f2d8c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8b7fe640 1 -- 172.21.15.6:0/3334482932 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8c0d3650 con 0x7f2d8c0b4010 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d8affd640 1 -- 172.21.15.6:0/3334482932 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549713190 0 0) 0x7f2d8c0d0370 con 0x7f2d8c163a10 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.044+0000 7f2d90fb1640 1 --2- 172.21.15.6:0/3334482932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c0d14b0 0x7f2d8c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.045+0000 7f2d8b7fe640 1 --2- 172.21.15.6:0/3334482932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 0x7f2d8c0d4130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009870 tx=0x7f2d8002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db2a4bb67efbb78d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.045+0000 7f2d8affd640 1 -- 172.21.15.6:0/3334482932 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80037070 con 0x7f2d8c0b4010 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.045+0000 7f2d8affd640 1 -- 172.21.15.6:0/3334482932 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d80032440 con 0x7f2d8c0b4010 2024-05-20T17:54:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.045+0000 7f2d8affd640 1 -- 172.21.15.6:0/3334482932 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80032810 con 0x7f2d8c0b4010 2024-05-20T17:54:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.046+0000 7f2d92a14640 1 -- 172.21.15.6:0/3334482932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 msgr2=0x7f2d8c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.046+0000 7f2d92a14640 1 --2- 172.21.15.6:0/3334482932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 0x7f2d8c0d4130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009870 tx=0x7f2d8002a250 comp rx=0 tx=0).stop 2024-05-20T17:54:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.046+0000 7f2d92a14640 1 -- 172.21.15.6:0/3334482932 shutdown_connections 2024-05-20T17:54:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.046+0000 7f2d92a14640 1 --2- 172.21.15.6:0/3334482932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c0d14b0 0x7f2d8c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.046+0000 7f2d92a14640 1 --2- 172.21.15.6:0/3334482932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 0x7f2d8c0d4130 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.046+0000 7f2d92a14640 1 -- 172.21.15.6:0/3334482932 >> 172.21.15.6:0/3334482932 conn(0x7f2d8c06d240 msgr2=0x7f2d8c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.046+0000 7f2d92a14640 1 -- 172.21.15.6:0/3334482932 shutdown_connections 2024-05-20T17:54:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.046+0000 7f2d92a14640 1 -- 172.21.15.6:0/3334482932 wait complete. 2024-05-20T17:54:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.048+0000 7f2d92a14640 1 Processor -- start 2024-05-20T17:54:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.048+0000 7f2d92a14640 1 -- start start 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d92a14640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 0x7f2d8c0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d92a14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d8c0d14b0 0x7f2d8c14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d92a14640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c163a10 0x7f2d8c1eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d92a14640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8c0b8210 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d92a14640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8c0d1e00 con 0x7f2d8c0b4010 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d92a14640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8c0b8390 con 0x7f2d8c163a10 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d8c0d14b0 0x7f2d8c14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d8c0d14b0 0x7f2d8c14fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55716/0 (socket says 172.21.15.6:55716) 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.049+0000 7f2d8b7fe640 1 -- 172.21.15.6:0/1881282713 learned_addr learned my addr 172.21.15.6:0/1881282713 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d8bfff640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 0x7f2d8c0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d90fb1640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c163a10 0x7f2d8c1eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d8b7fe640 1 -- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c163a10 msgr2=0x7f2d8c1eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d8b7fe640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c163a10 0x7f2d8c1eab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d8b7fe640 1 -- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 msgr2=0x7f2d8c0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d8b7fe640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 0x7f2d8c0abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d8b7fe640 1 -- 172.21.15.6:0/1881282713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8c150530 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d90fb1640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c163a10 0x7f2d8c1eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d8bfff640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 0x7f2d8c0abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d8b7fe640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d8c0d14b0 0x7f2d8c14fff0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2d80000c00 tx=0x7f2d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d88ff9640 1 -- 172.21.15.6:0/1881282713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80037040 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d88ff9640 1 -- 172.21.15.6:0/1881282713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d80042070 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8c0ad4f0 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d88ff9640 1 -- 172.21.15.6:0/1881282713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80030880 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.050+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d8c0acc50 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.051+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8c075b00 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.052+0000 7f2d88ff9640 1 -- 172.21.15.6:0/1881282713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d80030a20 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.052+0000 7f2d88ff9640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2d7806be30 0x7f2d7806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.052+0000 7f2d88ff9640 1 -- 172.21.15.6:0/1881282713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f2d800abbe0 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.052+0000 7f2d8bfff640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2d7806be30 0x7f2d7806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.053+0000 7f2d8bfff640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2d7806be30 0x7f2d7806e340 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c000f60 tx=0x7f2d7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.057+0000 7f2d88ff9640 1 -- 172.21.15.6:0/1881282713 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2d8007a0c0 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.239+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d8c0d3050 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.239+0000 7f2d88ff9640 1 -- 172.21.15.6:0/1881282713 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f2d800799c0 con 0x7f2d8c0d14b0 2024-05-20T17:54:09.239 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:54:09.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2d7806be30 msgr2=0x7f2d7806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2d7806be30 0x7f2d7806e340 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c000f60 tx=0x7f2d7c009040 comp rx=0 tx=0).stop 2024-05-20T17:54:09.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d8c0d14b0 msgr2=0x7f2d8c14fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d8c0d14b0 0x7f2d8c14fff0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2d80000c00 tx=0x7f2d800046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 shutdown_connections 2024-05-20T17:54:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2d7806be30 0x7f2d7806e340 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d8c163a10 0x7f2d8c1eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d8c0d14b0 0x7f2d8c14fff0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 --2- 172.21.15.6:0/1881282713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d8c0b4010 0x7f2d8c0abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 >> 172.21.15.6:0/1881282713 conn(0x7f2d8c06d240 msgr2=0x7f2d8c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 shutdown_connections 2024-05-20T17:54:09.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.241+0000 7f2d92a14640 1 -- 172.21.15.6:0/1881282713 wait complete. 2024-05-20T17:54:09.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:54:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.370+0000 7f7bd645a640 1 Processor -- start 2024-05-20T17:54:09.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.370+0000 7f7bd645a640 1 -- start start 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.371+0000 7f7bd645a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7bd015f220 0x7f7bd00d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.371+0000 7f7bd645a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bd00d0e00 0x7f7bd00cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.371+0000 7f7bd645a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd00cf910 0x7f7bd00ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.371+0000 7f7bd645a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd00cfd20 con 0x7f7bd00d0e00 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.371+0000 7f7bd645a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd00cda20 con 0x7f7bd015f220 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.371+0000 7f7bd645a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd00cdd00 con 0x7f7bd00cf910 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bd00d0e00 0x7f7bd00cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7bd00d0e00 0x7f7bd00cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55722/0 (socket says 172.21.15.6:55722) 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcf7fe640 1 -- 172.21.15.6:0/2423923188 learned_addr learned my addr 172.21.15.6:0/2423923188 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bd49f7640 1 --2- 172.21.15.6:0/2423923188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd00cf910 0x7f7bd00ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcffff640 1 --2- 172.21.15.6:0/2423923188 >> v2:172.21.15.171:3300/0 conn(0x7f7bd015f220 0x7f7bd00d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcf7fe640 1 -- 172.21.15.6:0/2423923188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd00cf910 msgr2=0x7f7bd00ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcf7fe640 1 --2- 172.21.15.6:0/2423923188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd00cf910 0x7f7bd00ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcf7fe640 1 -- 172.21.15.6:0/2423923188 >> v2:172.21.15.171:3300/0 conn(0x7f7bd015f220 msgr2=0x7f7bd00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcf7fe640 1 --2- 172.21.15.6:0/2423923188 >> v2:172.21.15.171:3300/0 conn(0x7f7bd015f220 0x7f7bd00d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.372+0000 7f7bcf7fe640 1 -- 172.21.15.6:0/2423923188 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd00cdfe0 con 0x7f7bd00d0e00 2024-05-20T17:54:09.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.373+0000 7f7bcf7fe640 1 --2- 172.21.15.6:0/2423923188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd00cf3d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7bd006e810 tx=0x7f7bc402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad2e4228bb6fa02 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.373+0000 7f7bceffd640 1 -- 172.21.15.6:0/2423923188 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4037070 con 0x7f7bd00d0e00 2024-05-20T17:54:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.373+0000 7f7bceffd640 1 -- 172.21.15.6:0/2423923188 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4032440 con 0x7f7bd00d0e00 2024-05-20T17:54:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.373+0000 7f7bceffd640 1 -- 172.21.15.6:0/2423923188 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4032810 con 0x7f7bd00d0e00 2024-05-20T17:54:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 -- 172.21.15.6:0/2423923188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 msgr2=0x7f7bd00cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 --2- 172.21.15.6:0/2423923188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd00cf3d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7bd006e810 tx=0x7f7bc402a140 comp rx=0 tx=0).stop 2024-05-20T17:54:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 -- 172.21.15.6:0/2423923188 shutdown_connections 2024-05-20T17:54:09.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 --2- 172.21.15.6:0/2423923188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd00cf910 0x7f7bd00ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 --2- 172.21.15.6:0/2423923188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd00cf3d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 --2- 172.21.15.6:0/2423923188 >> v2:172.21.15.171:3300/0 conn(0x7f7bd015f220 0x7f7bd00d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 -- 172.21.15.6:0/2423923188 >> 172.21.15.6:0/2423923188 conn(0x7f7bd00b44d0 msgr2=0x7f7bd00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 -- 172.21.15.6:0/2423923188 shutdown_connections 2024-05-20T17:54:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.374+0000 7f7bd645a640 1 -- 172.21.15.6:0/2423923188 wait complete. 2024-05-20T17:54:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.376+0000 7f7bd645a640 1 Processor -- start 2024-05-20T17:54:09.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.376+0000 7f7bd645a640 1 -- start start 2024-05-20T17:54:09.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bd645a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bd00cf910 0x7f7bd00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bd645a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd01f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bd645a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd015f220 0x7f7bd015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bd645a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00cd800 con 0x7f7bd00d0e00 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bd645a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00cd680 con 0x7f7bd00cf910 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bd645a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd015f630 con 0x7f7bd015f220 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd01f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd01f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55728/0 (socket says 172.21.15.6:55728) 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bcf7fe640 1 -- 172.21.15.6:0/237666889 learned_addr learned my addr 172.21.15.6:0/237666889 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bcffff640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bd00cf910 0x7f7bd00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bd49f7640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd015f220 0x7f7bd015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bcf7fe640 1 -- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd015f220 msgr2=0x7f7bd015a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bcf7fe640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd015f220 0x7f7bd015a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bcf7fe640 1 -- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bd00cf910 msgr2=0x7f7bd00b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.377+0000 7f7bcf7fe640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bd00cf910 0x7f7bd00b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.378+0000 7f7bcf7fe640 1 -- 172.21.15.6:0/237666889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd00b5e10 con 0x7f7bd00d0e00 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.378+0000 7f7bd49f7640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd015f220 0x7f7bd015a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.378+0000 7f7bcf7fe640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd01f61a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7bc402a180 tx=0x7f7bc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.378+0000 7f7bccff9640 1 -- 172.21.15.6:0/237666889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4041020 con 0x7f7bd00d0e00 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.378+0000 7f7bccff9640 1 -- 172.21.15.6:0/237666889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc40306c0 con 0x7f7bd00d0e00 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.378+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd00b60f0 con 0x7f7bd00d0e00 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.378+0000 7f7bccff9640 1 -- 172.21.15.6:0/237666889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4037040 con 0x7f7bd00d0e00 2024-05-20T17:54:09.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.378+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd01f6bb0 con 0x7f7bd00d0e00 2024-05-20T17:54:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.379+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd00b6610 con 0x7f7bd00d0e00 2024-05-20T17:54:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.380+0000 7f7bccff9640 1 -- 172.21.15.6:0/237666889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bc4044020 con 0x7f7bd00d0e00 2024-05-20T17:54:09.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.380+0000 7f7bccff9640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bbc06be30 0x7f7bbc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.380+0000 7f7bccff9640 1 -- 172.21.15.6:0/237666889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f7bc40abb00 con 0x7f7bd00d0e00 2024-05-20T17:54:09.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.381+0000 7f7bcffff640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bbc06be30 0x7f7bbc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.381+0000 7f7bcffff640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bbc06be30 0x7f7bbc06e340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00c64c0 tx=0x7f7bc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.385+0000 7f7bccff9640 1 -- 172.21.15.6:0/237666889 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7bd00b6610 con 0x7f7bd00d0e00 2024-05-20T17:54:09.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.568+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7bd0075b00 con 0x7f7bd00d0e00 2024-05-20T17:54:09.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.569+0000 7f7bccff9640 1 -- 172.21.15.6:0/237666889 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f7bc404b030 con 0x7f7bd00d0e00 2024-05-20T17:54:09.568 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.570+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bbc06be30 msgr2=0x7f7bbc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bbc06be30 0x7f7bbc06e340 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00c64c0 tx=0x7f7bc0008040 comp rx=0 tx=0).stop 2024-05-20T17:54:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 msgr2=0x7f7bd01f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd01f61a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7bc402a180 tx=0x7f7bc40046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 shutdown_connections 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bbc06be30 0x7f7bbc06e340 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bd015f220 0x7f7bd015a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bd00d0e00 0x7f7bd01f61a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 --2- 172.21.15.6:0/237666889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bd00cf910 0x7f7bd00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 >> 172.21.15.6:0/237666889 conn(0x7f7bd00b44d0 msgr2=0x7f7bd00d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 shutdown_connections 2024-05-20T17:54:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.571+0000 7f7bd645a640 1 -- 172.21.15.6:0/237666889 wait complete. 2024-05-20T17:54:09.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:54:09.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.701+0000 7f041a757640 1 Processor -- start 2024-05-20T17:54:09.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.701+0000 7f041a757640 1 -- start start 2024-05-20T17:54:09.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.702+0000 7f041a757640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f04140cd680 0x7f041415f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.702+0000 7f041a757640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041406d0f0 con 0x7f041406c6c0 2024-05-20T17:54:09.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.702+0000 7f041a757640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041406d3d0 con 0x7f04140cfae0 2024-05-20T17:54:09.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.702+0000 7f041a757640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f04140cda90 con 0x7f04140cd680 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.702+0000 7f04137fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f041406c6c0 0x7f04140cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58592/0 (socket says 172.21.15.6:58592) 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.702+0000 7f04137fe640 1 -- 172.21.15.6:0/2753633693 learned_addr learned my addr 172.21.15.6:0/2753633693 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.702+0000 7f0413fff640 1 --2- 172.21.15.6:0/2753633693 >> v2:172.21.15.171:3300/0 conn(0x7f04140cd680 0x7f041415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.702+0000 7f0412ffd640 1 -- 172.21.15.6:0/2753633693 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091094818 0 0) 0x7f041406d0f0 con 0x7f041406c6c0 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.703+0000 7f0412ffd640 1 -- 172.21.15.6:0/2753633693 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03fc003520 con 0x7f041406c6c0 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.703+0000 7f0413fff640 1 -- 172.21.15.6:0/2753633693 >> v1:172.21.15.171:6789/0 conn(0x7f04140cfae0 legacy=0x7f04140d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.703+0000 7f0412ffd640 1 -- 172.21.15.6:0/2753633693 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2854191471 0 0) 0x7f03fc003520 con 0x7f041406c6c0 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.703+0000 7f0413fff640 1 -- 172.21.15.6:0/2753633693 >> v1:172.21.15.6:6789/0 conn(0x7f041406c6c0 legacy=0x7f04140cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.703+0000 7f0413fff640 1 -- 172.21.15.6:0/2753633693 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041406d6b0 con 0x7f04140cd680 2024-05-20T17:54:09.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.704+0000 7f0413fff640 1 --2- 172.21.15.6:0/2753633693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04140cd680 0x7f041415f220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f04040097a0 tx=0x7f0404029fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=babeaf058eb48a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.704+0000 7f0412ffd640 1 -- 172.21.15.6:0/2753633693 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404037070 con 0x7f04140cd680 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.704+0000 7f0412ffd640 1 -- 172.21.15.6:0/2753633693 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040402aa40 con 0x7f04140cd680 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.704+0000 7f0412ffd640 1 -- 172.21.15.6:0/2753633693 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408001670 con 0x7f04140cd680 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.705+0000 7f041a757640 1 -- 172.21.15.6:0/2753633693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04140cd680 msgr2=0x7f041415f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.705+0000 7f041a757640 1 --2- 172.21.15.6:0/2753633693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04140cd680 0x7f041415f220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f04040097a0 tx=0x7f0404029fb0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.705+0000 7f041a757640 1 -- 172.21.15.6:0/2753633693 shutdown_connections 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.705+0000 7f041a757640 1 --2- 172.21.15.6:0/2753633693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04140cd680 0x7f041415f220 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.705+0000 7f041a757640 1 -- 172.21.15.6:0/2753633693 >> 172.21.15.6:0/2753633693 conn(0x7f04140b44d0 msgr2=0x7f04140b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.705+0000 7f041a757640 1 -- 172.21.15.6:0/2753633693 shutdown_connections 2024-05-20T17:54:09.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.705+0000 7f041a757640 1 -- 172.21.15.6:0/2753633693 wait complete. 2024-05-20T17:54:09.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.706+0000 7f041a757640 1 Processor -- start 2024-05-20T17:54:09.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.707+0000 7f041a757640 1 -- start start 2024-05-20T17:54:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f041a757640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041406c6c0 0x7f041415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f041a757640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04140cd680 0x7f0414151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f041a757640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04140c7260 0x7f04140c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f041a757640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04140d2460 con 0x7f04140cd680 2024-05-20T17:54:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f041a757640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f041406d990 con 0x7f041406c6c0 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f041a757640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f04140d25e0 con 0x7f04140c7260 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f04137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04140cd680 0x7f0414151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f04137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04140cd680 0x7f0414151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55732/0 (socket says 172.21.15.6:55732) 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f04137fe640 1 -- 172.21.15.6:0/3258005340 learned_addr learned my addr 172.21.15.6:0/3258005340 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f0413fff640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041406c6c0 0x7f041415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f0418cf4640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04140c7260 0x7f04140c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f04137fe640 1 -- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04140c7260 msgr2=0x7f04140c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f04137fe640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04140c7260 0x7f04140c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f04137fe640 1 -- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041406c6c0 msgr2=0x7f041415db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f04137fe640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041406c6c0 0x7f041415db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.708+0000 7f04137fe640 1 -- 172.21.15.6:0/3258005340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04141523e0 con 0x7f04140cd680 2024-05-20T17:54:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.709+0000 7f04137fe640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04140cd680 0x7f0414151ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f040800c550 tx=0x7f040800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.709+0000 7f0410ff9640 1 -- 172.21.15.6:0/3258005340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408018070 con 0x7f04140cd680 2024-05-20T17:54:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.709+0000 7f0410ff9640 1 -- 172.21.15.6:0/3258005340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04080074e0 con 0x7f04140cd680 2024-05-20T17:54:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.709+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04140b5750 con 0x7f04140cd680 2024-05-20T17:54:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.709+0000 7f0410ff9640 1 -- 172.21.15.6:0/3258005340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408004a20 con 0x7f04140cd680 2024-05-20T17:54:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.709+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04140b5d10 con 0x7f04140cd680 2024-05-20T17:54:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.710+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041415e3a0 con 0x7f04140cd680 2024-05-20T17:54:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.711+0000 7f0410ff9640 1 -- 172.21.15.6:0/3258005340 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f040801b070 con 0x7f04140cd680 2024-05-20T17:54:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.711+0000 7f0410ff9640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f040006be60 0x7f040006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.711+0000 7f0410ff9640 1 -- 172.21.15.6:0/3258005340 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f040808a540 con 0x7f04140cd680 2024-05-20T17:54:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.711+0000 7f0413fff640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f040006be60 0x7f040006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.712+0000 7f0413fff640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f040006be60 0x7f040006e370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0404034000 tx=0x7f040402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:09.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.716+0000 7f0410ff9640 1 -- 172.21.15.6:0/3258005340 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0408058460 con 0x7f04140cd680 2024-05-20T17:54:09.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.900+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0414075b00 con 0x7f04140cd680 2024-05-20T17:54:09.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.901+0000 7f0410ff9640 1 -- 172.21.15.6:0/3258005340 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f040805c760 con 0x7f04140cd680 2024-05-20T17:54:09.900 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:54:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f040006be60 msgr2=0x7f040006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f040006be60 0x7f040006e370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0404034000 tx=0x7f040402e000 comp rx=0 tx=0).stop 2024-05-20T17:54:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04140cd680 msgr2=0x7f0414151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04140cd680 0x7f0414151ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f040800c550 tx=0x7f040800ca10 comp rx=0 tx=0).stop 2024-05-20T17:54:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 shutdown_connections 2024-05-20T17:54:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f040006be60 0x7f040006e370 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04140c7260 0x7f04140c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04140cd680 0x7f0414151ea0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 --2- 172.21.15.6:0/3258005340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f041406c6c0 0x7f041415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:09.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.902+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 >> 172.21.15.6:0/3258005340 conn(0x7f04140b44d0 msgr2=0x7f0414163500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:09.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.903+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 shutdown_connections 2024-05-20T17:54:09.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:09.903+0000 7f041a757640 1 -- 172.21.15.6:0/3258005340 wait complete. 2024-05-20T17:54:09.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-20T17:54:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.032+0000 7f44d398b640 1 Processor -- start 2024-05-20T17:54:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.032+0000 7f44d398b640 1 -- start start 2024-05-20T17:54:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.033+0000 7f44d398b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc0b4010 0x7f44cc0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.033+0000 7f44d398b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44cc0d14b0 0x7f44cc0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.033+0000 7f44d398b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44cc0d0370 con 0x7f44cc163a10 2024-05-20T17:54:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.033+0000 7f44d398b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f44cc0d3ca0 con 0x7f44cc0d14b0 2024-05-20T17:54:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.033+0000 7f44d398b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44cc0d0650 con 0x7f44cc0b4010 2024-05-20T17:54:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.033+0000 7f44d1f28640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44cc0d14b0 0x7f44cc0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.033+0000 7f44d1f28640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44cc0d14b0 0x7f44cc0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55746/0 (socket says 172.21.15.6:55746) 2024-05-20T17:54:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.033+0000 7f44d1f28640 1 -- 172.21.15.6:0/1868186758 learned_addr learned my addr 172.21.15.6:0/1868186758 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.034+0000 7f44d0f26640 1 --2- 172.21.15.6:0/1868186758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc0b4010 0x7f44cc0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.034+0000 7f44d1f28640 1 -- 172.21.15.6:0/1868186758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc0b4010 msgr2=0x7f44cc0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.034+0000 7f44d1f28640 1 --2- 172.21.15.6:0/1868186758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc0b4010 0x7f44cc0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.034+0000 7f44d1f28640 1 -- 172.21.15.6:0/1868186758 >> v1:172.21.15.171:6789/0 conn(0x7f44cc163a10 legacy=0x7f44cc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.034+0000 7f44d1f28640 1 -- 172.21.15.6:0/1868186758 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc0d3650 con 0x7f44cc0d14b0 2024-05-20T17:54:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44d1f28640 1 --2- 172.21.15.6:0/1868186758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc0d18c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009e50 tx=0x7f44c402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af9cf4ca14cbdc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44c3fff640 1 -- 172.21.15.6:0/1868186758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4036070 con 0x7f44cc0d14b0 2024-05-20T17:54:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44c3fff640 1 -- 172.21.15.6:0/1868186758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4031600 con 0x7f44cc0d14b0 2024-05-20T17:54:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44c3fff640 1 -- 172.21.15.6:0/1868186758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40319d0 con 0x7f44cc0d14b0 2024-05-20T17:54:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44d398b640 1 -- 172.21.15.6:0/1868186758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 msgr2=0x7f44cc0d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44d398b640 1 --2- 172.21.15.6:0/1868186758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc0d18c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009e50 tx=0x7f44c402a710 comp rx=0 tx=0).stop 2024-05-20T17:54:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44d398b640 1 -- 172.21.15.6:0/1868186758 shutdown_connections 2024-05-20T17:54:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44d398b640 1 --2- 172.21.15.6:0/1868186758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc0d18c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44d398b640 1 --2- 172.21.15.6:0/1868186758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc0b4010 0x7f44cc0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.035+0000 7f44d398b640 1 -- 172.21.15.6:0/1868186758 >> 172.21.15.6:0/1868186758 conn(0x7f44cc06d240 msgr2=0x7f44cc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.036+0000 7f44d398b640 1 -- 172.21.15.6:0/1868186758 shutdown_connections 2024-05-20T17:54:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.036+0000 7f44d398b640 1 -- 172.21.15.6:0/1868186758 wait complete. 2024-05-20T17:54:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.037+0000 7f44d398b640 1 Processor -- start 2024-05-20T17:54:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.037+0000 7f44d398b640 1 -- start start 2024-05-20T17:54:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d398b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44cc0b4010 0x7f44cc0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d398b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d398b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc163a10 0x7f44cc14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d398b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc0b8210 con 0x7f44cc0d14b0 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d398b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f44cc0d1e00 con 0x7f44cc0b4010 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d398b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44cc0b8390 con 0x7f44cc163a10 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55750/0 (socket says 172.21.15.6:55750) 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 -- 172.21.15.6:0/1857583531 learned_addr learned my addr 172.21.15.6:0/1857583531 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d1f28640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc163a10 0x7f44cc14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d1727640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44cc0b4010 0x7f44cc0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 -- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc163a10 msgr2=0x7f44cc14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc163a10 0x7f44cc14aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 -- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44cc0b4010 msgr2=0x7f44cc0cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44cc0b4010 0x7f44cc0cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 -- 172.21.15.6:0/1857583531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44cc1585d0 con 0x7f44cc0d14b0 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d1f28640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc163a10 0x7f44cc14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d1727640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44cc0b4010 0x7f44cc0cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44d0f26640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc157bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00e8a0 tx=0x7f44bc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.039+0000 7f44c1ffb640 1 -- 172.21.15.6:0/1857583531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc017070 con 0x7f44cc0d14b0 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.040+0000 7f44c1ffb640 1 -- 172.21.15.6:0/1857583531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc00c940 con 0x7f44cc0d14b0 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.040+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44cc1588b0 con 0x7f44cc0d14b0 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.040+0000 7f44c1ffb640 1 -- 172.21.15.6:0/1857583531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc00cd30 con 0x7f44cc0d14b0 2024-05-20T17:54:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.040+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44cc158e70 con 0x7f44cc0d14b0 2024-05-20T17:54:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.041+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44cc075b00 con 0x7f44cc0d14b0 2024-05-20T17:54:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.041+0000 7f44c1ffb640 1 -- 172.21.15.6:0/1857583531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44bc01a070 con 0x7f44cc0d14b0 2024-05-20T17:54:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.042+0000 7f44c1ffb640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44b006be60 0x7f44b006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.042+0000 7f44c1ffb640 1 -- 172.21.15.6:0/1857583531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f44bc08b4b0 con 0x7f44cc0d14b0 2024-05-20T17:54:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.042+0000 7f44d1727640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44b006be60 0x7f44b006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.043+0000 7f44d1727640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44b006be60 0x7f44b006e370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0d3020 tx=0x7f44c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.046+0000 7f44c1ffb640 1 -- 172.21.15.6:0/1857583531 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f44bc059a20 con 0x7f44cc0d14b0 2024-05-20T17:54:10.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.231+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f44cc0d3050 con 0x7f44cc0d14b0 2024-05-20T17:54:10.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.231+0000 7f44c1ffb640 1 -- 172.21.15.6:0/1857583531 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f44bc059320 con 0x7f44cc0d14b0 2024-05-20T17:54:10.231 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:54:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.233+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44b006be60 msgr2=0x7f44b006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44b006be60 0x7f44b006e370 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0d3020 tx=0x7f44c8009040 comp rx=0 tx=0).stop 2024-05-20T17:54:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 msgr2=0x7f44cc157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc157bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00e8a0 tx=0x7f44bc00ed60 comp rx=0 tx=0).stop 2024-05-20T17:54:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 shutdown_connections 2024-05-20T17:54:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44b006be60 0x7f44b006e370 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44cc163a10 0x7f44cc14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44cc0d14b0 0x7f44cc157bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 --2- 172.21.15.6:0/1857583531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44cc0b4010 0x7f44cc0cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 >> 172.21.15.6:0/1857583531 conn(0x7f44cc06d240 msgr2=0x7f44cc15dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 shutdown_connections 2024-05-20T17:54:10.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.234+0000 7f44d398b640 1 -- 172.21.15.6:0/1857583531 wait complete. 2024-05-20T17:54:10.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:54:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.360+0000 7fa9f325a640 1 Processor -- start 2024-05-20T17:54:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.360+0000 7fa9f325a640 1 -- start start 2024-05-20T17:54:10.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.361+0000 7fa9f325a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9ec0b6d90 0x7fa9ec15f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.361+0000 7fa9f325a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec0d3220 0x7fa9ec0d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.361+0000 7fa9f325a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9ec0d0550 con 0x7fa9ec0cf250 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.361+0000 7fa9f325a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9ec15f9a0 con 0x7fa9ec0b6d90 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.361+0000 7fa9f325a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ec0d0b10 con 0x7fa9ec0d3220 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.361+0000 7fa9f0ff6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa9ec0cf250 0x7fa9ec0b6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58602/0 (socket says 172.21.15.6:58602) 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.361+0000 7fa9f0ff6640 1 -- 172.21.15.6:0/19968880 learned_addr learned my addr 172.21.15.6:0/19968880 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786687184 0 0) 0x7fa9ec0d0550 con 0x7fa9ec0cf250 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9d8003520 con 0x7fa9ec0cf250 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9ebfff640 1 --2- 172.21.15.6:0/19968880 >> v2:172.21.15.171:3300/0 conn(0x7fa9ec0b6d90 0x7fa9ec15f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9f17f7640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec0d3220 0x7fa9ec0d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1533720333 0 0) 0x7fa9d8003520 con 0x7fa9ec0cf250 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec0d3220 msgr2=0x7fa9ec0d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec0d3220 0x7fa9ec0d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 >> v2:172.21.15.171:3300/0 conn(0x7fa9ec0b6d90 msgr2=0x7fa9ec15f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:10.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 --2- 172.21.15.6:0/19968880 >> v2:172.21.15.171:3300/0 conn(0x7fa9ec0b6d90 0x7fa9ec15f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec0d0830 con 0x7fa9ec0cf250 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fa9dc0019f0 con 0x7fa9ec0cf250 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 >> v1:172.21.15.6:6789/0 conn(0x7fa9ec0cf250 legacy=0x7fa9ec0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9d8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec0d3220 0x7fa9d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8004d40 0x7fa9d8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec15f9a0 con 0x7fa9d80039b0 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d800b9c0 con 0x7fa9d8004d40 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d800bb70 con 0x7fa9ec0d3220 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9f0ff6640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9d8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9ebfff640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec0d3220 0x7fa9d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9f17f7640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8004d40 0x7fa9d8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9f0ff6640 1 -- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec0d3220 msgr2=0x7fa9d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9f0ff6640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec0d3220 0x7fa9d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9f0ff6640 1 -- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8004d40 msgr2=0x7fa9d8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9f0ff6640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8004d40 0x7fa9d8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.362+0000 7fa9f0ff6640 1 -- 172.21.15.6:0/19968880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d8003520 con 0x7fa9d80039b0 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.363+0000 7fa9f17f7640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9d8004d40 0x7fa9d8005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.363+0000 7fa9f0ff6640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9d8003e20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0013d0 tx=0x7fa9d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ed126606f3d867 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.363+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00a4c0 con 0x7fa9d80039b0 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.363+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9dc02f070 con 0x7fa9d80039b0 2024-05-20T17:54:10.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.363+0000 7fa9eb7fe640 1 -- 172.21.15.6:0/19968880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc02bc80 con 0x7fa9d80039b0 2024-05-20T17:54:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.364+0000 7fa9f325a640 1 -- 172.21.15.6:0/19968880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 msgr2=0x7fa9d8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.364+0000 7fa9f325a640 1 --2- 172.21.15.6:0/19968880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9d8003e20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0013d0 tx=0x7fa9d8005830 comp rx=0 tx=0).stop 2024-05-20T17:54:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.364+0000 7fa9f17f7640 1 -- 172.21.15.6:0/19968880 reap_dead start 2024-05-20T17:54:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.364+0000 7fa9f325a640 1 -- 172.21.15.6:0/19968880 shutdown_connections 2024-05-20T17:54:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.364+0000 7fa9f325a640 1 -- 172.21.15.6:0/19968880 >> 172.21.15.6:0/19968880 conn(0x7fa9ec0d1860 msgr2=0x7fa9ec0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.364+0000 7fa9f325a640 1 -- 172.21.15.6:0/19968880 shutdown_connections 2024-05-20T17:54:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.364+0000 7fa9f325a640 1 -- 172.21.15.6:0/19968880 wait complete. 2024-05-20T17:54:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.366+0000 7fa9f325a640 1 Processor -- start 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.366+0000 7fa9f325a640 1 -- start start 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.367+0000 7fa9f325a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9ec0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.367+0000 7fa9f325a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec154b30 0x7fa9ec152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.367+0000 7fa9f325a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9ec1506c0 0x7fa9ec150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.367+0000 7fa9f325a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec0d2d00 con 0x7fa9d80039b0 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.367+0000 7fa9f325a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec0d27d0 con 0x7fa9ec1506c0 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.367+0000 7fa9f325a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ec0d0140 con 0x7fa9ec154b30 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.367+0000 7fa9f0ff6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9ec0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f0ff6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9ec0ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55764/0 (socket says 172.21.15.6:55764) 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f0ff6640 1 -- 172.21.15.6:0/2541342390 learned_addr learned my addr 172.21.15.6:0/2541342390 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9ebfff640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec154b30 0x7fa9ec152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f17f7640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9ec1506c0 0x7fa9ec150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f0ff6640 1 -- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec154b30 msgr2=0x7fa9ec152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f0ff6640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec154b30 0x7fa9ec152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f0ff6640 1 -- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9ec1506c0 msgr2=0x7fa9ec150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f0ff6640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9ec1506c0 0x7fa9ec150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f0ff6640 1 -- 172.21.15.6:0/2541342390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec151380 con 0x7fa9d80039b0 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f0ff6640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9ec0ce190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc02b4f0 tx=0x7fa9dc001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9e97fa640 1 -- 172.21.15.6:0/2541342390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc02ba40 con 0x7fa9d80039b0 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9e97fa640 1 -- 172.21.15.6:0/2541342390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9dc02bbe0 con 0x7fa9d80039b0 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ec151660 con 0x7fa9d80039b0 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9e97fa640 1 -- 172.21.15.6:0/2541342390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc004e30 con 0x7fa9d80039b0 2024-05-20T17:54:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.368+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ec151c20 con 0x7fa9d80039b0 2024-05-20T17:54:10.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.370+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ec075b00 con 0x7fa9d80039b0 2024-05-20T17:54:10.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.370+0000 7fa9e97fa640 1 -- 172.21.15.6:0/2541342390 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9dc034470 con 0x7fa9d80039b0 2024-05-20T17:54:10.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.371+0000 7fa9e97fa640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9cc06be30 0x7fa9cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.371+0000 7fa9e97fa640 1 -- 172.21.15.6:0/2541342390 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fa9dc0ab910 con 0x7fa9d80039b0 2024-05-20T17:54:10.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.371+0000 7fa9ebfff640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9cc06be30 0x7fa9cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.372+0000 7fa9ebfff640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9cc06be30 0x7fa9cc06e340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40090e0 tx=0x7fa9d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.375+0000 7fa9e97fa640 1 -- 172.21.15.6:0/2541342390 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa9dc079e80 con 0x7fa9d80039b0 2024-05-20T17:54:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.597+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9ec075b00 con 0x7fa9d80039b0 2024-05-20T17:54:10.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.598+0000 7fa9e97fa640 1 -- 172.21.15.6:0/2541342390 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7fa9dc079780 con 0x7fa9d80039b0 2024-05-20T17:54:10.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:10.597 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:29.005012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:54:10.597 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:54:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.599+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9cc06be30 msgr2=0x7fa9cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.599+0000 7fa9f325a640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9cc06be30 0x7fa9cc06e340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40090e0 tx=0x7fa9d4008040 comp rx=0 tx=0).stop 2024-05-20T17:54:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 msgr2=0x7fa9ec0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9ec0ce190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc02b4f0 tx=0x7fa9dc001360 comp rx=0 tx=0).stop 2024-05-20T17:54:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 shutdown_connections 2024-05-20T17:54:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9cc06be30 0x7fa9cc06e340 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9ec1506c0 0x7fa9ec150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9ec154b30 0x7fa9ec152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 --2- 172.21.15.6:0/2541342390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9d80039b0 0x7fa9ec0ce190 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 >> 172.21.15.6:0/2541342390 conn(0x7fa9ec0d1860 msgr2=0x7fa9ec0b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 shutdown_connections 2024-05-20T17:54:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.600+0000 7fa9f325a640 1 -- 172.21.15.6:0/2541342390 wait complete. 2024-05-20T17:54:10.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.726+0000 7f64fc40d640 1 Processor -- start 2024-05-20T17:54:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.726+0000 7f64fc40d640 1 -- start start 2024-05-20T17:54:10.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64fc40d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64fc40d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f40d0630 con 0x7f64f406dae0 2024-05-20T17:54:10.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64fc40d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f40d39c0 con 0x7f64f40b3e80 2024-05-20T17:54:10.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64fc40d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f64f40d3ca0 con 0x7f64f4162820 2024-05-20T17:54:10.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64fa9aa640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f64f406dae0 0x7f64f40b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58610/0 (socket says 172.21.15.6:58610) 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64fa9aa640 1 -- 172.21.15.6:0/3527338645 learned_addr learned my addr 172.21.15.6:0/3527338645 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64fa1a9640 1 --2- 172.21.15.6:0/3527338645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64f91a7640 1 -- 172.21.15.6:0/3527338645 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042473952 0 0) 0x7f64f40d0630 con 0x7f64f406dae0 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.728+0000 7f64f91a7640 1 -- 172.21.15.6:0/3527338645 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64dc003520 con 0x7f64f406dae0 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.729+0000 7f64f91a7640 1 -- 172.21.15.6:0/3527338645 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048025784 0 0) 0x7f64f40d39c0 con 0x7f64f40b3e80 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.729+0000 7f64f91a7640 1 -- 172.21.15.6:0/3527338645 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64f40d0630 con 0x7f64f40b3e80 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.729+0000 7f64f91a7640 1 -- 172.21.15.6:0/3527338645 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079789846 0 0) 0x7f64dc003520 con 0x7f64f406dae0 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.729+0000 7f64fa1a9640 1 -- 172.21.15.6:0/3527338645 >> v1:172.21.15.171:6789/0 conn(0x7f64f40b3e80 legacy=0x7f64f406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.729+0000 7f64fa1a9640 1 -- 172.21.15.6:0/3527338645 >> v1:172.21.15.6:6789/0 conn(0x7f64f406dae0 legacy=0x7f64f40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.729+0000 7f64fa1a9640 1 -- 172.21.15.6:0/3527338645 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f40d3f80 con 0x7f64f4162820 2024-05-20T17:54:10.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.730+0000 7f64fa1a9640 1 --2- 172.21.15.6:0/3527338645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f40b3940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f64e40097d0 tx=0x7f64e402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=498a38987cebb79d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.730+0000 7f64f91a7640 1 -- 172.21.15.6:0/3527338645 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4037070 con 0x7f64f4162820 2024-05-20T17:54:10.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.730+0000 7f64f91a7640 1 -- 172.21.15.6:0/3527338645 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e402ac30 con 0x7f64f4162820 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.730+0000 7f64f91a7640 1 -- 172.21.15.6:0/3527338645 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0019f0 con 0x7f64f4162820 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.730+0000 7f64fc40d640 1 -- 172.21.15.6:0/3527338645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 msgr2=0x7f64f40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.731+0000 7f64fc40d640 1 --2- 172.21.15.6:0/3527338645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f40b3940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f64e40097d0 tx=0x7f64e402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.731+0000 7f64fc40d640 1 -- 172.21.15.6:0/3527338645 shutdown_connections 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.731+0000 7f64fc40d640 1 --2- 172.21.15.6:0/3527338645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f40b3940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.731+0000 7f64fc40d640 1 -- 172.21.15.6:0/3527338645 >> 172.21.15.6:0/3527338645 conn(0x7f64f40d4bd0 msgr2=0x7f64f40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.731+0000 7f64fc40d640 1 -- 172.21.15.6:0/3527338645 shutdown_connections 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.731+0000 7f64fc40d640 1 -- 172.21.15.6:0/3527338645 wait complete. 2024-05-20T17:54:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.732+0000 7f64fc40d640 1 Processor -- start 2024-05-20T17:54:10.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.733+0000 7f64fc40d640 1 -- start start 2024-05-20T17:54:10.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fc40d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64f40b3e80 0x7f64f414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fc40d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f415b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fc40d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64f4156120 0x7f64f415b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fc40d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f64f40d4780 con 0x7f64f4156120 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fc40d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f64f40d0300 con 0x7f64f40b3e80 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fc40d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f64f40d4900 con 0x7f64f4162820 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa9aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64f4156120 0x7f64f415b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa9aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64f4156120 0x7f64f415b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55766/0 (socket says 172.21.15.6:55766) 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa9aa640 1 -- 172.21.15.6:0/74213580 learned_addr learned my addr 172.21.15.6:0/74213580 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa1a9640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64f40b3e80 0x7f64f414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64f99a8640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f415b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa9aa640 1 -- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 msgr2=0x7f64f415b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa9aa640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f415b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa9aa640 1 -- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64f40b3e80 msgr2=0x7f64f414aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa9aa640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64f40b3e80 0x7f64f414aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa9aa640 1 -- 172.21.15.6:0/74213580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f415c0c0 con 0x7f64f4156120 2024-05-20T17:54:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.734+0000 7f64fa1a9640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64f40b3e80 0x7f64f414aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.735+0000 7f64fa9aa640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64f4156120 0x7f64f415b690 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f64ec001350 tx=0x7f64ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.735+0000 7f64f2ffd640 1 -- 172.21.15.6:0/74213580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec017070 con 0x7f64f4156120 2024-05-20T17:54:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.735+0000 7f64f2ffd640 1 -- 172.21.15.6:0/74213580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ec00ad40 con 0x7f64f4156120 2024-05-20T17:54:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.735+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f40cb1f0 con 0x7f64f4156120 2024-05-20T17:54:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.735+0000 7f64f2ffd640 1 -- 172.21.15.6:0/74213580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec012600 con 0x7f64f4156120 2024-05-20T17:54:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.735+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f40c8b10 con 0x7f64f4156120 2024-05-20T17:54:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.736+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f4075b00 con 0x7f64f4156120 2024-05-20T17:54:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.736+0000 7f64f2ffd640 1 -- 172.21.15.6:0/74213580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64ec01a070 con 0x7f64f4156120 2024-05-20T17:54:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.737+0000 7f64f2ffd640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f64e006be30 0x7f64e006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.737+0000 7f64f2ffd640 1 -- 172.21.15.6:0/74213580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f64ec08afd0 con 0x7f64f4156120 2024-05-20T17:54:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.737+0000 7f64fa1a9640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f64e006be30 0x7f64e006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.738+0000 7f64fa1a9640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f64e006be30 0x7f64e006e340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64e4034000 tx=0x7f64e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.742+0000 7f64f2ffd640 1 -- 172.21.15.6:0/74213580 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f64ec058f80 con 0x7f64f4156120 2024-05-20T17:54:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.927+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64f415dd40 con 0x7f64f4156120 2024-05-20T17:54:10.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.929+0000 7f64f2ffd640 1 -- 172.21.15.6:0/74213580 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f64ec05d280 con 0x7f64f4156120 2024-05-20T17:54:10.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:10.928 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f64e006be30 msgr2=0x7f64e006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f64e006be30 0x7f64e006e340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64e4034000 tx=0x7f64e402e000 comp rx=0 tx=0).stop 2024-05-20T17:54:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64f4156120 msgr2=0x7f64f415b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64f4156120 0x7f64f415b690 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f64ec001350 tx=0x7f64ec00a430 comp rx=0 tx=0).stop 2024-05-20T17:54:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 shutdown_connections 2024-05-20T17:54:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f64e006be30 0x7f64e006e340 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64f4156120 0x7f64f415b690 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64f4162820 0x7f64f415b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 --2- 172.21.15.6:0/74213580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64f40b3e80 0x7f64f414aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.930+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 >> 172.21.15.6:0/74213580 conn(0x7f64f40d4bd0 msgr2=0x7f64f406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.931+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 shutdown_connections 2024-05-20T17:54:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:10.931+0000 7f64fc40d640 1 -- 172.21.15.6:0/74213580 wait complete. 2024-05-20T17:54:10.942 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T17:54:10.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:54:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.058+0000 7f9446bd5640 1 Processor -- start 2024-05-20T17:54:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.058+0000 7f9446bd5640 1 -- start start 2024-05-20T17:54:11.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.059+0000 7f9446bd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400b4010 0x7f94400d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.059+0000 7f9446bd5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94400d14b0 0x7f94400d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.059+0000 7f9446bd5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94400d0370 con 0x7f9440163a10 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.059+0000 7f9446bd5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f94400d3ca0 con 0x7f94400d14b0 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.059+0000 7f9446bd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94400d0650 con 0x7f94400b4010 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.059+0000 7f9445172640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94400d14b0 0x7f94400d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.059+0000 7f9445172640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94400d14b0 0x7f94400d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55778/0 (socket says 172.21.15.6:55778) 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.059+0000 7f9445172640 1 -- 172.21.15.6:0/3740306130 learned_addr learned my addr 172.21.15.6:0/3740306130 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.060+0000 7f943ffff640 1 --2- 172.21.15.6:0/3740306130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400b4010 0x7f94400d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.060+0000 7f9445172640 1 -- 172.21.15.6:0/3740306130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400b4010 msgr2=0x7f94400d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.060+0000 7f9445172640 1 --2- 172.21.15.6:0/3740306130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400b4010 0x7f94400d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.060+0000 7f9445172640 1 -- 172.21.15.6:0/3740306130 >> v1:172.21.15.171:6789/0 conn(0x7f9440163a10 legacy=0x7f94400cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.060+0000 7f9445172640 1 -- 172.21.15.6:0/3740306130 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94400d3650 con 0x7f94400d14b0 2024-05-20T17:54:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.060+0000 7f943ffff640 1 --2- 172.21.15.6:0/3740306130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400b4010 0x7f94400d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.060+0000 7f9445172640 1 --2- 172.21.15.6:0/3740306130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94400d14b0 0x7f94400d18c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9438009870 tx=0x7f943802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cece90a2fbbc9cbd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.060+0000 7f943f7fe640 1 -- 172.21.15.6:0/3740306130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438037070 con 0x7f94400d14b0 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f943f7fe640 1 -- 172.21.15.6:0/3740306130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9438032440 con 0x7f94400d14b0 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f943f7fe640 1 -- 172.21.15.6:0/3740306130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438032810 con 0x7f94400d14b0 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f9446bd5640 1 -- 172.21.15.6:0/3740306130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94400d14b0 msgr2=0x7f94400d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f9446bd5640 1 --2- 172.21.15.6:0/3740306130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94400d14b0 0x7f94400d18c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9438009870 tx=0x7f943802a210 comp rx=0 tx=0).stop 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f9446bd5640 1 -- 172.21.15.6:0/3740306130 shutdown_connections 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f9446bd5640 1 --2- 172.21.15.6:0/3740306130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94400d14b0 0x7f94400d18c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f9446bd5640 1 --2- 172.21.15.6:0/3740306130 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400b4010 0x7f94400d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f9446bd5640 1 -- 172.21.15.6:0/3740306130 >> 172.21.15.6:0/3740306130 conn(0x7f944006d240 msgr2=0x7f944006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f9446bd5640 1 -- 172.21.15.6:0/3740306130 shutdown_connections 2024-05-20T17:54:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.061+0000 7f9446bd5640 1 -- 172.21.15.6:0/3740306130 wait complete. 2024-05-20T17:54:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.063+0000 7f9446bd5640 1 Processor -- start 2024-05-20T17:54:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.063+0000 7f9446bd5640 1 -- start start 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9446bd5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94400b4010 0x7f9440151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9446bd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400d14b0 0x7f94400b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9446bd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9440163a10 0x7f94400abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9446bd5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f94400b8210 con 0x7f9440163a10 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9446bd5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94400d1e00 con 0x7f94400b4010 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9446bd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94400b8390 con 0x7f94400d14b0 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9440163a10 0x7f94400abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9440163a10 0x7f94400abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55786/0 (socket says 172.21.15.6:55786) 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 -- 172.21.15.6:0/857799401 learned_addr learned my addr 172.21.15.6:0/857799401 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f943ffff640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400d14b0 0x7f94400b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9444971640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94400b4010 0x7f9440151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 -- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400d14b0 msgr2=0x7f94400b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400d14b0 0x7f94400b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 -- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94400b4010 msgr2=0x7f9440151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94400b4010 0x7f9440151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 -- 172.21.15.6:0/857799401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94400b20e0 con 0x7f9440163a10 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f9445172640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9440163a10 0x7f94400abb90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9438009870 tx=0x7f94380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.065+0000 7f943d7fa640 1 -- 172.21.15.6:0/857799401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438037040 con 0x7f9440163a10 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.066+0000 7f943d7fa640 1 -- 172.21.15.6:0/857799401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9438042070 con 0x7f9440163a10 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.066+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94400b23c0 con 0x7f9440163a10 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.066+0000 7f943d7fa640 1 -- 172.21.15.6:0/857799401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438030c90 con 0x7f9440163a10 2024-05-20T17:54:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.066+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94400b2980 con 0x7f9440163a10 2024-05-20T17:54:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.067+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94400b1e50 con 0x7f9440163a10 2024-05-20T17:54:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.067+0000 7f943d7fa640 1 -- 172.21.15.6:0/857799401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9438047460 con 0x7f9440163a10 2024-05-20T17:54:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.068+0000 7f943d7fa640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f942006be30 0x7f942006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.068+0000 7f943d7fa640 1 -- 172.21.15.6:0/857799401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f94380abe50 con 0x7f9440163a10 2024-05-20T17:54:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.068+0000 7f9444971640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f942006be30 0x7f942006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.069+0000 7f9444971640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f942006be30 0x7f942006e340 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9428006fd0 tx=0x7f9428009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.072+0000 7f943d7fa640 1 -- 172.21.15.6:0/857799401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9438079ce0 con 0x7f9440163a10 2024-05-20T17:54:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.294+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94400d3050 con 0x7f9440163a10 2024-05-20T17:54:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.295+0000 7f943d7fa640 1 -- 172.21.15.6:0/857799401 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f943807dfe0 con 0x7f9440163a10 2024-05-20T17:54:11.295 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:11.295 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:29.005012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:54:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:54:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f942006be30 msgr2=0x7f942006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f942006be30 0x7f942006e340 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9428006fd0 tx=0x7f9428009060 comp rx=0 tx=0).stop 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9440163a10 msgr2=0x7f94400abb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9440163a10 0x7f94400abb90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9438009870 tx=0x7f94380046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 shutdown_connections 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f942006be30 0x7f942006e340 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9440163a10 0x7f94400abb90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94400d14b0 0x7f94400b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 --2- 172.21.15.6:0/857799401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94400b4010 0x7f9440151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 >> 172.21.15.6:0/857799401 conn(0x7f944006d240 msgr2=0x7f94400d4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 shutdown_connections 2024-05-20T17:54:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.297+0000 7f9446bd5640 1 -- 172.21.15.6:0/857799401 wait complete. 2024-05-20T17:54:11.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:54:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.424+0000 7f56dffff640 1 Processor -- start 2024-05-20T17:54:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.424+0000 7f56dffff640 1 -- start start 2024-05-20T17:54:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56dffff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f56e00b6560 0x7f56e00b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56e006c5a0 0x7f56e006c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56dffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56dffff640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f56e015d2f0 con 0x7f56e006c5a0 2024-05-20T17:54:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56dffff640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f56e006d370 con 0x7f56e00b6560 2024-05-20T17:54:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56dffff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56e00c5330 con 0x7f56e00d16f0 2024-05-20T17:54:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56d67fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56e006c5a0 0x7f56e006c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56d67fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56e006c5a0 0x7f56e006c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55790/0 (socket says 172.21.15.6:55790) 2024-05-20T17:54:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.425+0000 7f56d67fc640 1 -- 172.21.15.6:0/718152892 learned_addr learned my addr 172.21.15.6:0/718152892 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56df7fe640 1 --2- 172.21.15.6:0/718152892 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56deffd640 1 --2- 172.21.15.6:0/718152892 >> v2:172.21.15.171:3300/0 conn(0x7f56e00b6560 0x7f56e00b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56d67fc640 1 -- 172.21.15.6:0/718152892 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 msgr2=0x7f56e00d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56d67fc640 1 --2- 172.21.15.6:0/718152892 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56d67fc640 1 -- 172.21.15.6:0/718152892 >> v2:172.21.15.171:3300/0 conn(0x7f56e00b6560 msgr2=0x7f56e00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:11.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56d67fc640 1 --2- 172.21.15.6:0/718152892 >> v2:172.21.15.171:3300/0 conn(0x7f56e00b6560 0x7f56e00b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56d67fc640 1 -- 172.21.15.6:0/718152892 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e00b6eb0 con 0x7f56e006c5a0 2024-05-20T17:54:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56df7fe640 1 --2- 172.21.15.6:0/718152892 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56deffd640 1 --2- 172.21.15.6:0/718152892 >> v2:172.21.15.171:3300/0 conn(0x7f56e00b6560 0x7f56e00b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.426+0000 7f56d67fc640 1 --2- 172.21.15.6:0/718152892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e006c9b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f56e00b71f0 tx=0x7f56c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6107d2218ccb8df5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56de7fc640 1 -- 172.21.15.6:0/718152892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8037070 con 0x7f56e006c5a0 2024-05-20T17:54:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56de7fc640 1 -- 172.21.15.6:0/718152892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8032440 con 0x7f56e006c5a0 2024-05-20T17:54:11.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56de7fc640 1 -- 172.21.15.6:0/718152892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8032810 con 0x7f56e006c5a0 2024-05-20T17:54:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 -- 172.21.15.6:0/718152892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 msgr2=0x7f56e006c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 --2- 172.21.15.6:0/718152892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e006c9b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f56e00b71f0 tx=0x7f56c802a1e0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 -- 172.21.15.6:0/718152892 shutdown_connections 2024-05-20T17:54:11.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 --2- 172.21.15.6:0/718152892 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 --2- 172.21.15.6:0/718152892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e006c9b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 --2- 172.21.15.6:0/718152892 >> v2:172.21.15.171:3300/0 conn(0x7f56e00b6560 0x7f56e00b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 -- 172.21.15.6:0/718152892 >> 172.21.15.6:0/718152892 conn(0x7f56e009a4f0 msgr2=0x7f56e009a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:11.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 -- 172.21.15.6:0/718152892 shutdown_connections 2024-05-20T17:54:11.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.427+0000 7f56dffff640 1 -- 172.21.15.6:0/718152892 wait complete. 2024-05-20T17:54:11.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.429+0000 7f56dffff640 1 Processor -- start 2024-05-20T17:54:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.429+0000 7f56dffff640 1 -- start start 2024-05-20T17:54:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e0159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56dffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e00b6560 0x7f56e00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56dffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56dffff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56e00cd880 con 0x7f56e006c5a0 2024-05-20T17:54:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56dffff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f56e00cd5a0 con 0x7f56e00b6560 2024-05-20T17:54:11.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56dffff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56e00cdb60 con 0x7f56e00d16f0 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e0159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e0159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55792/0 (socket says 172.21.15.6:55792) 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 -- 172.21.15.6:0/3364952880 learned_addr learned my addr 172.21.15.6:0/3364952880 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56df7fe640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56d67fc640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e00b6560 0x7f56e00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 -- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 msgr2=0x7f56e00c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 -- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e00b6560 msgr2=0x7f56e00c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e00b6560 0x7f56e00c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 -- 172.21.15.6:0/3364952880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e00ca120 con 0x7f56e006c5a0 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56d67fc640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e00b6560 0x7f56e00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:11.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56df7fe640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56deffd640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e0159d70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f56d000c7f0 tx=0x7f56d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56d7fff640 1 -- 172.21.15.6:0/3364952880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0015070 con 0x7f56e006c5a0 2024-05-20T17:54:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e00d08c0 con 0x7f56e006c5a0 2024-05-20T17:54:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56d7fff640 1 -- 172.21.15.6:0/3364952880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d00077c0 con 0x7f56e006c5a0 2024-05-20T17:54:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.431+0000 7f56d7fff640 1 -- 172.21.15.6:0/3364952880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0007bb0 con 0x7f56e006c5a0 2024-05-20T17:54:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.432+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e00d0e80 con 0x7f56e006c5a0 2024-05-20T17:54:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.433+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e0075980 con 0x7f56e006c5a0 2024-05-20T17:54:11.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.433+0000 7f56d7fff640 1 -- 172.21.15.6:0/3364952880 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56d0018070 con 0x7f56e006c5a0 2024-05-20T17:54:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.433+0000 7f56d7fff640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c006be60 0x7f56c006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.434+0000 7f56d7fff640 1 -- 172.21.15.6:0/3364952880 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f56d008b310 con 0x7f56e006c5a0 2024-05-20T17:54:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.434+0000 7f56d67fc640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c006be60 0x7f56c006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.434+0000 7f56d67fc640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c006be60 0x7f56c006e370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56c8034000 tx=0x7f56c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.438+0000 7f56d7fff640 1 -- 172.21.15.6:0/3364952880 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f56e00ca120 con 0x7f56e006c5a0 2024-05-20T17:54:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.661+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56e015e4d0 con 0x7f56e006c5a0 2024-05-20T17:54:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.661+0000 7f56d7fff640 1 -- 172.21.15.6:0/3364952880 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5174 (secure 0 0 0) 0x7f56d00596d0 con 0x7f56e006c5a0 2024-05-20T17:54:11.661 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:11.662 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2637124447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2637124447},{"type":"v1","addr":"172.21.15.6:6835","nonce":2637124447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/462671542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":462671542},{"type":"v1","addr":"172.21.15.171:6836","nonce":462671542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2796075183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2796075183},{"type":"v1","addr":"172.21.15.171:6837","nonce":2796075183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:53:06.937522+0000","modified":"2024-05-20T17:53:29.005012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/2802786337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2802786337},{"type":"v1","addr":"172.21.15.6:6833","nonce":2802786337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-05-20T17:54:11.662 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2024-05-20T17:54:11.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c006be60 msgr2=0x7f56c006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c006be60 0x7f56c006e370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56c8034000 tx=0x7f56c802e000 comp rx=0 tx=0).stop 2024-05-20T17:54:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 msgr2=0x7f56e0159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e0159d70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f56d000c7f0 tx=0x7f56d000ccb0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 shutdown_connections 2024-05-20T17:54:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c006be60 0x7f56c006e370 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e00d16f0 0x7f56e00c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e00b6560 0x7f56e00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 --2- 172.21.15.6:0/3364952880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e006c5a0 0x7f56e0159d70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.663+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 >> 172.21.15.6:0/3364952880 conn(0x7f56e009a4f0 msgr2=0x7f56e00d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.664+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 shutdown_connections 2024-05-20T17:54:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.664+0000 7f56dffff640 1 -- 172.21.15.6:0/3364952880 wait complete. 2024-05-20T17:54:11.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:11.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.792+0000 7f8b16377640 1 Processor -- start 2024-05-20T17:54:11.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.793+0000 7f8b16377640 1 -- start start 2024-05-20T17:54:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b16377640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b1006d3d0 0x7f8b1006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b16377640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b100b8190 0x7f8b100b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b16377640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1006dd20 con 0x7f8b10162820 2024-05-20T17:54:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b16377640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8b100d0630 con 0x7f8b1006d3d0 2024-05-20T17:54:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b16377640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8b100d39c0 con 0x7f8b100b8190 2024-05-20T17:54:11.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b0ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8b10162820 0x7f8b100b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58620/0 (socket says 172.21.15.6:58620) 2024-05-20T17:54:11.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b0ffff640 1 -- 172.21.15.6:0/1593265126 learned_addr learned my addr 172.21.15.6:0/1593265126 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:11.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b07fff640 1 --2- 172.21.15.6:0/1593265126 >> v2:172.21.15.6:3300/0 conn(0x7f8b1006d3d0 0x7f8b1006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b14914640 1 --2- 172.21.15.6:0/1593265126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b100b8190 0x7f8b100b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b07fff640 1 -- 172.21.15.6:0/1593265126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b100b8190 msgr2=0x7f8b100b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b07fff640 1 --2- 172.21.15.6:0/1593265126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b100b8190 0x7f8b100b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b07fff640 1 -- 172.21.15.6:0/1593265126 >> v1:172.21.15.6:6789/0 conn(0x7f8b10162820 legacy=0x7f8b100b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b07fff640 1 -- 172.21.15.6:0/1593265126 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b100d3ca0 con 0x7f8b1006d3d0 2024-05-20T17:54:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b0f7fe640 1 -- 172.21.15.6:0/1593265126 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246288050 0 0) 0x7f8b00001110 con 0x7f8b10162820 2024-05-20T17:54:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.794+0000 7f8b14914640 1 --2- 172.21.15.6:0/1593265126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b100b8190 0x7f8b100b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.795+0000 7f8b07fff640 1 --2- 172.21.15.6:0/1593265126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1006d3d0 0x7f8b1006d7e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8af80097a0 tx=0x7f8af802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3755b654db14efa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.795+0000 7f8b0f7fe640 1 -- 172.21.15.6:0/1593265126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8037070 con 0x7f8b1006d3d0 2024-05-20T17:54:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.795+0000 7f8b0f7fe640 1 -- 172.21.15.6:0/1593265126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8032440 con 0x7f8b1006d3d0 2024-05-20T17:54:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.795+0000 7f8b0f7fe640 1 -- 172.21.15.6:0/1593265126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8032810 con 0x7f8b1006d3d0 2024-05-20T17:54:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.796+0000 7f8b16377640 1 -- 172.21.15.6:0/1593265126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1006d3d0 msgr2=0x7f8b1006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.796+0000 7f8b16377640 1 --2- 172.21.15.6:0/1593265126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1006d3d0 0x7f8b1006d7e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8af80097a0 tx=0x7f8af802a180 comp rx=0 tx=0).stop 2024-05-20T17:54:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.796+0000 7f8b16377640 1 -- 172.21.15.6:0/1593265126 shutdown_connections 2024-05-20T17:54:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.796+0000 7f8b16377640 1 --2- 172.21.15.6:0/1593265126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b100b8190 0x7f8b100b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.796+0000 7f8b16377640 1 --2- 172.21.15.6:0/1593265126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1006d3d0 0x7f8b1006d7e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.796+0000 7f8b16377640 1 -- 172.21.15.6:0/1593265126 >> 172.21.15.6:0/1593265126 conn(0x7f8b100d4bd0 msgr2=0x7f8b100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.796+0000 7f8b16377640 1 -- 172.21.15.6:0/1593265126 shutdown_connections 2024-05-20T17:54:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.796+0000 7f8b16377640 1 -- 172.21.15.6:0/1593265126 wait complete. 2024-05-20T17:54:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.798+0000 7f8b16377640 1 Processor -- start 2024-05-20T17:54:11.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.798+0000 7f8b16377640 1 -- start start 2024-05-20T17:54:11.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.799+0000 7f8b16377640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b1006d3d0 0x7f8b1014df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.799+0000 7f8b16377640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b100b8190 0x7f8b100b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.799+0000 7f8b16377640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b10162820 0x7f8b100cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.799+0000 7f8b16377640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8b100d0300 con 0x7f8b100b8190 2024-05-20T17:54:11.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.799+0000 7f8b16377640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8b100d4260 con 0x7f8b1006d3d0 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.799+0000 7f8b16377640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8b100b4050 con 0x7f8b10162820 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b100b8190 0x7f8b100b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b100b8190 0x7f8b100b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55804/0 (socket says 172.21.15.6:55804) 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 -- 172.21.15.6:0/2780702928 learned_addr learned my addr 172.21.15.6:0/2780702928 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b14914640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b10162820 0x7f8b100cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b0ffff640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b1006d3d0 0x7f8b1014df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 -- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b10162820 msgr2=0x7f8b100cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b10162820 0x7f8b100cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 -- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b1006d3d0 msgr2=0x7f8b1014df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b1006d3d0 0x7f8b1014df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 -- 172.21.15.6:0/2780702928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b100c9d30 con 0x7f8b100b8190 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b07fff640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b100b8190 0x7f8b100b5040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8af8000c00 tx=0x7f8af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b0d7fa640 1 -- 172.21.15.6:0/2780702928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8037050 con 0x7f8b100b8190 2024-05-20T17:54:11.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b0d7fa640 1 -- 172.21.15.6:0/2780702928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8038040 con 0x7f8b100b8190 2024-05-20T17:54:11.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b0d7fa640 1 -- 172.21.15.6:0/2780702928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8004470 con 0x7f8b100b8190 2024-05-20T17:54:11.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b100ca010 con 0x7f8b100b8190 2024-05-20T17:54:11.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.800+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b100ca5d0 con 0x7f8b100b8190 2024-05-20T17:54:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.801+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b100c9aa0 con 0x7f8b100b8190 2024-05-20T17:54:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.802+0000 7f8b0d7fa640 1 -- 172.21.15.6:0/2780702928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8af8030980 con 0x7f8b100b8190 2024-05-20T17:54:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.803+0000 7f8b0d7fa640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8af006be30 0x7f8af006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.803+0000 7f8b0d7fa640 1 -- 172.21.15.6:0/2780702928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f8af80abed0 con 0x7f8b100b8190 2024-05-20T17:54:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.803+0000 7f8b0ffff640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8af006be30 0x7f8af006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:11.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.803+0000 7f8b0ffff640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8af006be30 0x7f8af006e340 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b00000f60 tx=0x7f8b00007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:11.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.807+0000 7f8b0d7fa640 1 -- 172.21.15.6:0/2780702928 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8af807a4d0 con 0x7f8b100b8190 2024-05-20T17:54:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.992+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b10075b00 con 0x7f8b100b8190 2024-05-20T17:54:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.994+0000 7f8b0d7fa640 1 -- 172.21.15.6:0/2780702928 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18949 (secure 0 0 0) 0x7f8af8079dd0 con 0x7f8b100b8190 2024-05-20T17:54:11.993 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:11.993 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:53:47.717141+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:53:04.608346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-20T17:53:05.926595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-20T17:53:09.616865+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:11.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8af006be30 msgr2=0x7f8af006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8af006be30 0x7f8af006e340 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b00000f60 tx=0x7f8b00007c00 comp rx=0 tx=0).stop 2024-05-20T17:54:11.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b100b8190 msgr2=0x7f8b100b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:11.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b100b8190 0x7f8b100b5040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8af8000c00 tx=0x7f8af80046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 shutdown_connections 2024-05-20T17:54:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8af006be30 0x7f8af006e340 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b10162820 0x7f8b100cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b100b8190 0x7f8b100b5040 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 --2- 172.21.15.6:0/2780702928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b1006d3d0 0x7f8b1014df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 >> 172.21.15.6:0/2780702928 conn(0x7f8b100d4bd0 msgr2=0x7f8b1015b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 shutdown_connections 2024-05-20T17:54:11.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:11.996+0000 7f8b16377640 1 -- 172.21.15.6:0/2780702928 wait complete. 2024-05-20T17:54:12.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T17:54:12.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.123+0000 7f4cd06de640 1 Processor -- start 2024-05-20T17:54:12.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.124+0000 7f4cd06de640 1 -- start start 2024-05-20T17:54:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.125+0000 7f4cd06de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80ba3c0 0x7f4cc80b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.125+0000 7f4cd06de640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc81634a0 con 0x7f4cc80b85b0 2024-05-20T17:54:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.125+0000 7f4cd06de640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc8163780 con 0x7f4cc80b6620 2024-05-20T17:54:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.125+0000 7f4cd06de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc80d3480 con 0x7f4cc80ba3c0 2024-05-20T17:54:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.125+0000 7f4ccec7b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4cc80b85b0 0x7f4cc80d3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58624/0 (socket says 172.21.15.6:58624) 2024-05-20T17:54:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.125+0000 7f4ccec7b640 1 -- 172.21.15.6:0/2119022462 learned_addr learned my addr 172.21.15.6:0/2119022462 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.125+0000 7f4ccdc79640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80ba3c0 0x7f4cc80b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.125+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754617858 0 0) 0x7f4cc81634a0 con 0x7f4cc80b85b0 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb4003520 con 0x7f4cc80b85b0 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961442195 0 0) 0x7f4cc8163780 con 0x7f4cc80b6620 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc81634a0 con 0x7f4cc80b6620 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1217576594 0 0) 0x7f4cb4003520 con 0x7f4cc80b85b0 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80ba3c0 msgr2=0x7f4cc80b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80ba3c0 0x7f4cc80b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 >> v1:172.21.15.171:6789/0 conn(0x7f4cc80b6620 legacy=0x7f4cc8162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc8163a60 con 0x7f4cc80b85b0 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f4cc00019f0 con 0x7f4cc80b85b0 2024-05-20T17:54:12.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 >> v1:172.21.15.6:6789/0 conn(0x7f4cc80b85b0 legacy=0x7f4cc80d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80ba3c0 0x7f4cb4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40040d0 0x7f4cb4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb4004d40 0x7f4cb4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc80d3480 con 0x7f4cb4004d40 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb400bb20 con 0x7f4cb40040d0 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb400bd20 con 0x7f4cc80ba3c0 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccec7b640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb4004d40 0x7f4cb4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4cce47a640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80ba3c0 0x7f4cb4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccdc79640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40040d0 0x7f4cb4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccec7b640 1 -- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80ba3c0 msgr2=0x7f4cb4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccec7b640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80ba3c0 0x7f4cb4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccec7b640 1 -- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40040d0 msgr2=0x7f4cb4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccec7b640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40040d0 0x7f4cb4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.126+0000 7f4ccec7b640 1 -- 172.21.15.6:0/2119022462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb4003520 con 0x7f4cb4004d40 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.127+0000 7f4ccec7b640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb4004d40 0x7f4cb4005150 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8068040 tx=0x7f4cb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87024b27b32145f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.127+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000a410 con 0x7f4cb4004d40 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.127+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc002f070 con 0x7f4cb4004d40 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.127+0000 7f4ccd478640 1 -- 172.21.15.6:0/2119022462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc002bc30 con 0x7f4cb4004d40 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.128+0000 7f4cd06de640 1 -- 172.21.15.6:0/2119022462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb4004d40 msgr2=0x7f4cb4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.128+0000 7f4cd06de640 1 --2- 172.21.15.6:0/2119022462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb4004d40 0x7f4cb4005150 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8068040 tx=0x7f4cb4005830 comp rx=0 tx=0).stop 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.128+0000 7f4ccec7b640 1 -- 172.21.15.6:0/2119022462 reap_dead start 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.128+0000 7f4cd06de640 1 -- 172.21.15.6:0/2119022462 shutdown_connections 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.128+0000 7f4cd06de640 1 -- 172.21.15.6:0/2119022462 >> 172.21.15.6:0/2119022462 conn(0x7f4cc806d240 msgr2=0x7f4cc806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.128+0000 7f4cd06de640 1 -- 172.21.15.6:0/2119022462 shutdown_connections 2024-05-20T17:54:12.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.128+0000 7f4cd06de640 1 -- 172.21.15.6:0/2119022462 wait complete. 2024-05-20T17:54:12.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.130+0000 7f4cd06de640 1 Processor -- start 2024-05-20T17:54:12.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.130+0000 7f4cd06de640 1 -- start start 2024-05-20T17:54:12.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.131+0000 7f4cd06de640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb4004d40 0x7f4cc8157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.131+0000 7f4cd06de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80cb7b0 0x7f4cc815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.131+0000 7f4cd06de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc80cbbc0 0x7f4cc815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.131+0000 7f4cd06de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc80d4480 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.131+0000 7f4cd06de640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc80d4300 con 0x7f4cb4004d40 2024-05-20T17:54:12.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.131+0000 7f4cd06de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc80b8070 con 0x7f4cc80cb7b0 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc80cbbc0 0x7f4cc815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc80cbbc0 0x7f4cc815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55822/0 (socket says 172.21.15.6:55822) 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 -- 172.21.15.6:0/3445402623 learned_addr learned my addr 172.21.15.6:0/3445402623 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccdc79640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80cb7b0 0x7f4cc815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4cce47a640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb4004d40 0x7f4cc8157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 -- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80cb7b0 msgr2=0x7f4cc815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80cb7b0 0x7f4cc815d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 -- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb4004d40 msgr2=0x7f4cc8157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb4004d40 0x7f4cc8157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 -- 172.21.15.6:0/3445402623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc80ce360 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccdc79640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80cb7b0 0x7f4cc815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4cce47a640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb4004d40 0x7f4cc8157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4ccec7b640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc80cbbc0 0x7f4cc815da00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4cc002b440 tx=0x7f4cc8163950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4cbeffd640 1 -- 172.21.15.6:0/3445402623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0044070 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4cbeffd640 1 -- 172.21.15.6:0/3445402623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc000a3f0 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc80ce640 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4cbeffd640 1 -- 172.21.15.6:0/3445402623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0001f70 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.132+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc80cdd80 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.133+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc80ce0d0 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.134+0000 7f4cbeffd640 1 -- 172.21.15.6:0/3445402623 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cc0047070 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.134+0000 7f4cbeffd640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4cac06be30 0x7f4cac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.135+0000 7f4cbeffd640 1 -- 172.21.15.6:0/3445402623 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f4cc00ab300 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.135+0000 7f4cce47a640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4cac06be30 0x7f4cac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.135+0000 7f4cce47a640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4cac06be30 0x7f4cac06e340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4005620 tx=0x7f4cc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:12.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.139+0000 7f4cbeffd640 1 -- 172.21.15.6:0/3445402623 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4cc0079210 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.360+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4cc80d29a0 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.360 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T17:54:12.361+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:54:12.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.365+0000 7f4cbeffd640 1 -- 172.21.15.6:0/3445402623 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f4cc007d510 con 0x7f4cc80cbbc0 2024-05-20T17:54:12.364 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T17:54:12.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4cac06be30 msgr2=0x7f4cac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4cac06be30 0x7f4cac06e340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4005620 tx=0x7f4cc4009040 comp rx=0 tx=0).stop 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc80cbbc0 msgr2=0x7f4cc815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc80cbbc0 0x7f4cc815da00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4cc002b440 tx=0x7f4cc8163950 comp rx=0 tx=0).stop 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 shutdown_connections 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4cac06be30 0x7f4cac06e340 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cc80cbbc0 0x7f4cc815da00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cc80cb7b0 0x7f4cc815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 --2- 172.21.15.6:0/3445402623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb4004d40 0x7f4cc8157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 >> 172.21.15.6:0/3445402623 conn(0x7f4cc806d240 msgr2=0x7f4cc80c8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 shutdown_connections 2024-05-20T17:54:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.367+0000 7f4cd06de640 1 -- 172.21.15.6:0/3445402623 wait complete. 2024-05-20T17:54:12.370 INFO:tasks.ceph.mds.a.smithi006.stderr: -5622> 2024-05-20T17:53:09.951+0000 7f3eac13b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:54:12.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T17:54:12.430 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:54:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.502+0000 7f795bd84640 1 Processor -- start 2024-05-20T17:54:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.502+0000 7f795bd84640 1 -- start start 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795bd84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 0x7f79540af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795bd84640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f795415f700 0x7f795415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795bd84640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79540af980 con 0x7f795409a4f0 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795bd84640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f795406bcf0 con 0x7f795415f700 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795bd84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7954160430 con 0x7f79540af030 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795931f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f795415f700 0x7f795415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795931f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f795415f700 0x7f795415fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55850/0 (socket says 172.21.15.6:55850) 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795a321640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f795409a4f0 0x7f795409a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58656/0 (socket says 172.21.15.6:58656) 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795931f640 1 -- 172.21.15.6:0/3482145545 learned_addr learned my addr 172.21.15.6:0/3482145545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f7959b20640 1 --2- 172.21.15.6:0/3482145545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 0x7f79540af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f7958b1e640 1 -- 172.21.15.6:0/3482145545 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180995232 0 0) 0x7f794c001490 con 0x7f795409a4f0 2024-05-20T17:54:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f7958b1e640 1 -- 172.21.15.6:0/3482145545 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7940003520 con 0x7f795409a4f0 2024-05-20T17:54:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795931f640 1 -- 172.21.15.6:0/3482145545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 msgr2=0x7f79540af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795931f640 1 --2- 172.21.15.6:0/3482145545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 0x7f79540af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795931f640 1 -- 172.21.15.6:0/3482145545 >> v1:172.21.15.6:6789/0 conn(0x7f795409a4f0 legacy=0x7f795409a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.504+0000 7f795931f640 1 -- 172.21.15.6:0/3482145545 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795406b6a0 con 0x7f795415f700 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.505+0000 7f795931f640 1 --2- 172.21.15.6:0/3482145545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795415f700 0x7f795415fb10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7944009870 tx=0x7f794402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d530221bc1619b43 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.505+0000 7f7958b1e640 1 -- 172.21.15.6:0/3482145545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944037070 con 0x7f795415f700 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.505+0000 7f7958b1e640 1 -- 172.21.15.6:0/3482145545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7944032440 con 0x7f795415f700 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.505+0000 7f7958b1e640 1 -- 172.21.15.6:0/3482145545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944032810 con 0x7f795415f700 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.506+0000 7f795bd84640 1 -- 172.21.15.6:0/3482145545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795415f700 msgr2=0x7f795415fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.506+0000 7f795bd84640 1 --2- 172.21.15.6:0/3482145545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795415f700 0x7f795415fb10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7944009870 tx=0x7f794402a270 comp rx=0 tx=0).stop 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.506+0000 7f795bd84640 1 -- 172.21.15.6:0/3482145545 shutdown_connections 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.506+0000 7f795bd84640 1 --2- 172.21.15.6:0/3482145545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795415f700 0x7f795415fb10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.506+0000 7f795bd84640 1 --2- 172.21.15.6:0/3482145545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 0x7f79540af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.506+0000 7f795bd84640 1 -- 172.21.15.6:0/3482145545 >> 172.21.15.6:0/3482145545 conn(0x7f79540b6620 msgr2=0x7f79540b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.506+0000 7f795bd84640 1 -- 172.21.15.6:0/3482145545 shutdown_connections 2024-05-20T17:54:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.506+0000 7f795bd84640 1 -- 172.21.15.6:0/3482145545 wait complete. 2024-05-20T17:54:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.508+0000 7f795bd84640 1 Processor -- start 2024-05-20T17:54:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.508+0000 7f795bd84640 1 -- start start 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f795bd84640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795409a4f0 0x7f7954150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f795bd84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 0x7f7954151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f795bd84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f795415f700 0x7f79541f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f795bd84640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7954160050 con 0x7f795409a4f0 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f795bd84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7954159aa0 con 0x7f795415f700 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f795bd84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f79541601d0 con 0x7f79540af030 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f7959b20640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795409a4f0 0x7f7954150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f7959b20640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795409a4f0 0x7f7954150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55852/0 (socket says 172.21.15.6:55852) 2024-05-20T17:54:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f7959b20640 1 -- 172.21.15.6:0/3038435955 learned_addr learned my addr 172.21.15.6:0/3038435955 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.509+0000 7f795931f640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 0x7f7954151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f795a321640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f795415f700 0x7f79541f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f7959b20640 1 -- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 msgr2=0x7f7954151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f7959b20640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 0x7f7954151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f7959b20640 1 -- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f795415f700 msgr2=0x7f79541f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f7959b20640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f795415f700 0x7f79541f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f7959b20640 1 -- 172.21.15.6:0/3038435955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7954161b80 con 0x7f795409a4f0 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f795a321640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f795415f700 0x7f79541f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f7959b20640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795409a4f0 0x7f7954150fc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f795000e870 tx=0x7f795000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f794a7fc640 1 -- 172.21.15.6:0/3038435955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950017070 con 0x7f795409a4f0 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f794a7fc640 1 -- 172.21.15.6:0/3038435955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f795000c940 con 0x7f795409a4f0 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7954161e60 con 0x7f795409a4f0 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f794a7fc640 1 -- 172.21.15.6:0/3038435955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795000cd10 con 0x7f795409a4f0 2024-05-20T17:54:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.510+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7954162420 con 0x7f795409a4f0 2024-05-20T17:54:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.511+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7954075b00 con 0x7f795409a4f0 2024-05-20T17:54:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.512+0000 7f794a7fc640 1 -- 172.21.15.6:0/3038435955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f795001a070 con 0x7f795409a4f0 2024-05-20T17:54:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.513+0000 7f794a7fc640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f793806be60 0x7f793806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.513+0000 7f794a7fc640 1 -- 172.21.15.6:0/3038435955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6879+0+0 (secure 0 0 0) 0x7f795008b4c0 con 0x7f795409a4f0 2024-05-20T17:54:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.513+0000 7f795931f640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f793806be60 0x7f793806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.514+0000 7f795931f640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f793806be60 0x7f793806e370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7944034000 tx=0x7f794402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.517+0000 7f794a7fc640 1 -- 172.21.15.6:0/3038435955 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7950059300 con 0x7f795409a4f0 2024-05-20T17:54:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:12.742+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f795415f2a0 con 0x7f795409a4f0 2024-05-20T17:54:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.366+0000 7f794a7fc640 1 -- 172.21.15.6:0/3038435955 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f795005d600 con 0x7f795409a4f0 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f793806be60 msgr2=0x7f793806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f793806be60 0x7f793806e370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7944034000 tx=0x7f794402e000 comp rx=0 tx=0).stop 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795409a4f0 msgr2=0x7f7954150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795409a4f0 0x7f7954150fc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f795000e870 tx=0x7f795000ed30 comp rx=0 tx=0).stop 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 shutdown_connections 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f793806be60 0x7f793806e370 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f795415f700 0x7f79541f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79540af030 0x7f7954151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 --2- 172.21.15.6:0/3038435955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f795409a4f0 0x7f7954150fc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.369+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 >> 172.21.15.6:0/3038435955 conn(0x7f79540b6620 msgr2=0x7f795409a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:13.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.370+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 shutdown_connections 2024-05-20T17:54:13.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.370+0000 7f795bd84640 1 -- 172.21.15.6:0/3038435955 wait complete. 2024-05-20T17:54:13.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T17:54:13.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.509+0000 7f85210e2640 1 Processor -- start 2024-05-20T17:54:13.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.510+0000 7f85210e2640 1 -- start start 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f85210e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c163950 0x7f851c0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f85210e2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f851c0d3c60 0x7f851c15f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f85210e2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f851c0b6ff0 con 0x7f851c0b6be0 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f85210e2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f851c1606f0 con 0x7f851c0d3c60 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f85210e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f851c160410 con 0x7f851c163950 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f851b59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f851c0d3c60 0x7f851c15f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f851b59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f851c0d3c60 0x7f851c15f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55866/0 (socket says 172.21.15.6:55866) 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f851b59e640 1 -- 172.21.15.6:0/4086808993 learned_addr learned my addr 172.21.15.6:0/4086808993 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f851ad9d640 1 --2- 172.21.15.6:0/4086808993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c163950 0x7f851c0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f851b59e640 1 -- 172.21.15.6:0/4086808993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c163950 msgr2=0x7f851c0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:13.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f851b59e640 1 --2- 172.21.15.6:0/4086808993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c163950 0x7f851c0b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f851b59e640 1 -- 172.21.15.6:0/4086808993 >> v1:172.21.15.171:6789/0 conn(0x7f851c0b6be0 legacy=0x7f851c0d3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:13.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.511+0000 7f851b59e640 1 -- 172.21.15.6:0/4086808993 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c162e70 con 0x7f851c0d3c60 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.512+0000 7f851b59e640 1 --2- 172.21.15.6:0/4086808993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c0d3c60 0x7f851c15f160 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8514009870 tx=0x7f851402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db802a8408f6b88 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.512+0000 7f8519d9b640 1 -- 172.21.15.6:0/4086808993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514037070 con 0x7f851c0d3c60 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.512+0000 7f8519d9b640 1 -- 172.21.15.6:0/4086808993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8514032440 con 0x7f851c0d3c60 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.512+0000 7f8519d9b640 1 -- 172.21.15.6:0/4086808993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514032810 con 0x7f851c0d3c60 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.513+0000 7f85210e2640 1 -- 172.21.15.6:0/4086808993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c0d3c60 msgr2=0x7f851c15f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.513+0000 7f85210e2640 1 --2- 172.21.15.6:0/4086808993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c0d3c60 0x7f851c15f160 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8514009870 tx=0x7f851402a270 comp rx=0 tx=0).stop 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.513+0000 7f85210e2640 1 -- 172.21.15.6:0/4086808993 shutdown_connections 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.513+0000 7f85210e2640 1 --2- 172.21.15.6:0/4086808993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c0d3c60 0x7f851c15f160 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.513+0000 7f85210e2640 1 --2- 172.21.15.6:0/4086808993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c163950 0x7f851c0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.513+0000 7f85210e2640 1 -- 172.21.15.6:0/4086808993 >> 172.21.15.6:0/4086808993 conn(0x7f851c0d16a0 msgr2=0x7f851c0d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:13.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.513+0000 7f85210e2640 1 -- 172.21.15.6:0/4086808993 shutdown_connections 2024-05-20T17:54:13.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.513+0000 7f85210e2640 1 -- 172.21.15.6:0/4086808993 wait complete. 2024-05-20T17:54:13.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.515+0000 7f85210e2640 1 Processor -- start 2024-05-20T17:54:13.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.515+0000 7f85210e2640 1 -- start start 2024-05-20T17:54:13.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f85210e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0b6be0 0x7f851c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:13.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f85210e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0d3c60 0x7f851c1f9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:13.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f85210e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c163950 0x7f851c15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:13.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f85210e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f851c0d4070 con 0x7f851c163950 2024-05-20T17:54:13.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f85210e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f851c163430 con 0x7f851c0b6be0 2024-05-20T17:54:13.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f85210e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f851c0d41f0 con 0x7f851c0d3c60 2024-05-20T17:54:13.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c163950 0x7f851c15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c163950 0x7f851c15bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55874/0 (socket says 172.21.15.6:55874) 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 -- 172.21.15.6:0/1371186196 learned_addr learned my addr 172.21.15.6:0/1371186196 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851ad9d640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0b6be0 0x7f851c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851a59c640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0d3c60 0x7f851c1f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 -- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0d3c60 msgr2=0x7f851c1f9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0d3c60 0x7f851c1f9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 -- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0b6be0 msgr2=0x7f851c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0b6be0 0x7f851c158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 -- 172.21.15.6:0/1371186196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c1f8a50 con 0x7f851c163950 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851a59c640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0d3c60 0x7f851c1f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851ad9d640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0b6be0 0x7f851c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.517+0000 7f851b59e640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c163950 0x7f851c15bbb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f851402a2b0 tx=0x7f85140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:13.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.518+0000 7f85037fe640 1 -- 172.21.15.6:0/1371186196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514041020 con 0x7f851c163950 2024-05-20T17:54:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.518+0000 7f85037fe640 1 -- 172.21.15.6:0/1371186196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8514030640 con 0x7f851c163950 2024-05-20T17:54:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.518+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851c158a50 con 0x7f851c163950 2024-05-20T17:54:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.518+0000 7f85037fe640 1 -- 172.21.15.6:0/1371186196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514037040 con 0x7f851c163950 2024-05-20T17:54:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.518+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851c159860 con 0x7f851c163950 2024-05-20T17:54:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.519+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f851c0690b0 con 0x7f851c163950 2024-05-20T17:54:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.519+0000 7f85037fe640 1 -- 172.21.15.6:0/1371186196 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8514044020 con 0x7f851c163950 2024-05-20T17:54:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.520+0000 7f85037fe640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850806be30 0x7f850806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.520+0000 7f85037fe640 1 -- 172.21.15.6:0/1371186196 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6879+0+0 (secure 0 0 0) 0x7f85140aba70 con 0x7f851c163950 2024-05-20T17:54:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.520+0000 7f851ad9d640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850806be30 0x7f850806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:13.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.521+0000 7f851ad9d640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850806be30 0x7f850806e340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f850c009fd0 tx=0x7f850c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:13.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.525+0000 7f85037fe640 1 -- 172.21.15.6:0/1371186196 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f851404b030 con 0x7f851c163950 2024-05-20T17:54:13.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:13.708+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f851c155630 con 0x7f851c163950 2024-05-20T17:54:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.368+0000 7f85037fe640 1 -- 172.21.15.6:0/1371186196 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f8514079f90 con 0x7f851c163950 2024-05-20T17:54:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850806be30 msgr2=0x7f850806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850806be30 0x7f850806e340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f850c009fd0 tx=0x7f850c00b040 comp rx=0 tx=0).stop 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c163950 msgr2=0x7f851c15bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c163950 0x7f851c15bbb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f851402a2b0 tx=0x7f85140046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 shutdown_connections 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850806be30 0x7f850806e340 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f851c163950 0x7f851c15bbb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0d3c60 0x7f851c1f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 --2- 172.21.15.6:0/1371186196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0b6be0 0x7f851c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 >> 172.21.15.6:0/1371186196 conn(0x7f851c0d16a0 msgr2=0x7f851c160880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 shutdown_connections 2024-05-20T17:54:14.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.371+0000 7f85210e2640 1 -- 172.21.15.6:0/1371186196 wait complete. 2024-05-20T17:54:14.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T17:54:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.513+0000 7fb5c3759640 1 Processor -- start 2024-05-20T17:54:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.514+0000 7fb5c3759640 1 -- start start 2024-05-20T17:54:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c3759640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc06cbf0 0x7fb5bc0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c3759640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb5bc15d0c0 0x7fb5bc09a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c3759640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5bc0b08c0 con 0x7fb5bc0d0b60 2024-05-20T17:54:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c3759640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb5bc0b1120 con 0x7fb5bc15d0c0 2024-05-20T17:54:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c3759640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc06b520 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c14f5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc06cbf0 0x7fb5bc0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c0cf4640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb5bc15d0c0 0x7fb5bc09a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c14f5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc06cbf0 0x7fb5bc0cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:46398/0 (socket says 172.21.15.6:46398) 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c14f5640 1 -- 172.21.15.6:0/2695719053 learned_addr learned my addr 172.21.15.6:0/2695719053 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.515+0000 7fb5c1cf6640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb5bc0d0b60 0x7fb5bc0d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:37670/0 (socket says 172.21.15.6:37670) 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.516+0000 7fb5c0cf4640 1 -- 172.21.15.6:0/2695719053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc06cbf0 msgr2=0x7fb5bc0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.516+0000 7fb5c0cf4640 1 --2- 172.21.15.6:0/2695719053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc06cbf0 0x7fb5bc0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.516+0000 7fb5c0cf4640 1 -- 172.21.15.6:0/2695719053 >> v1:172.21.15.171:6789/0 conn(0x7fb5bc0d0b60 legacy=0x7fb5bc0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.516+0000 7fb5c0cf4640 1 -- 172.21.15.6:0/2695719053 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc15d4d0 con 0x7fb5bc15d0c0 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.516+0000 7fb5c14f5640 1 --2- 172.21.15.6:0/2695719053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc06cbf0 0x7fb5bc0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.517+0000 7fb5c0cf4640 1 --2- 172.21.15.6:0/2695719053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 0x7fb5bc09a4f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0097a0 tx=0x7fb5ac02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da375485645b92a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.517+0000 7fb5b3fff640 1 -- 172.21.15.6:0/2695719053 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac037070 con 0x7fb5bc15d0c0 2024-05-20T17:54:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.517+0000 7fb5b3fff640 1 -- 172.21.15.6:0/2695719053 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ac02ae50 con 0x7fb5bc15d0c0 2024-05-20T17:54:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.517+0000 7fb5b3fff640 1 -- 172.21.15.6:0/2695719053 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac032660 con 0x7fb5bc15d0c0 2024-05-20T17:54:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.517+0000 7fb5c3759640 1 -- 172.21.15.6:0/2695719053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 msgr2=0x7fb5bc09a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.517+0000 7fb5c3759640 1 --2- 172.21.15.6:0/2695719053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 0x7fb5bc09a4f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0097a0 tx=0x7fb5ac02a100 comp rx=0 tx=0).stop 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.518+0000 7fb5c3759640 1 -- 172.21.15.6:0/2695719053 shutdown_connections 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.518+0000 7fb5c3759640 1 --2- 172.21.15.6:0/2695719053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 0x7fb5bc09a4f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.518+0000 7fb5c3759640 1 --2- 172.21.15.6:0/2695719053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc06cbf0 0x7fb5bc0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.518+0000 7fb5c3759640 1 -- 172.21.15.6:0/2695719053 >> 172.21.15.6:0/2695719053 conn(0x7fb5bc072a20 msgr2=0x7fb5bc0b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.518+0000 7fb5c3759640 1 -- 172.21.15.6:0/2695719053 shutdown_connections 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.518+0000 7fb5c3759640 1 -- 172.21.15.6:0/2695719053 wait complete. 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.519+0000 7fb5c3759640 1 Processor -- start 2024-05-20T17:54:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.519+0000 7fb5c3759640 1 -- start start 2024-05-20T17:54:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c3759640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5bc06cbf0 0x7fb5bc1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c3759640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc0d0b60 0x7fb5bc152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c3759640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 0x7fb5bc15ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c3759640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b0b60 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c3759640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc06b800 con 0x7fb5bc15d0c0 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c3759640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b0e40 con 0x7fb5bc0d0b60 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c14f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5bc06cbf0 0x7fb5bc1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c14f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5bc06cbf0 0x7fb5bc1f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55876/0 (socket says 172.21.15.6:55876) 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c14f5640 1 -- 172.21.15.6:0/119664064 learned_addr learned my addr 172.21.15.6:0/119664064 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c0cf4640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc0d0b60 0x7fb5bc152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c1cf6640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 0x7fb5bc15ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c14f5640 1 -- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc0d0b60 msgr2=0x7fb5bc152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c14f5640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc0d0b60 0x7fb5bc152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c14f5640 1 -- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 msgr2=0x7fb5bc15ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c14f5640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 0x7fb5bc15ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.521+0000 7fb5c14f5640 1 -- 172.21.15.6:0/119664064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc1f36e0 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.522+0000 7fb5c14f5640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5bc06cbf0 0x7fb5bc1f31a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800e9e0 tx=0x7fb5b800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.522+0000 7fb5b1ffb640 1 -- 172.21.15.6:0/119664064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8017070 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.522+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc1592c0 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.522+0000 7fb5b1ffb640 1 -- 172.21.15.6:0/119664064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b800c9d0 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.522+0000 7fb5b1ffb640 1 -- 172.21.15.6:0/119664064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800cd80 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.522+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc159880 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.523+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc06fe50 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.524+0000 7fb5b1ffb640 1 -- 172.21.15.6:0/119664064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5b801a070 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.524+0000 7fb5b1ffb640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5a006be60 0x7fb5a006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.524+0000 7fb5b1ffb640 1 -- 172.21.15.6:0/119664064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6441+0+0 (secure 0 0 0) 0x7fb5b808b040 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.525+0000 7fb5c0cf4640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5a006be60 0x7fb5a006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.525+0000 7fb5c0cf4640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5a006be60 0x7fb5a006e370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac034000 tx=0x7fb5ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.529+0000 7fb5b1ffb640 1 -- 172.21.15.6:0/119664064 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb5bc06fe50 con 0x7fb5bc06cbf0 2024-05-20T17:54:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:14.713+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb5bc075b30 con 0x7fb5bc06cbf0 2024-05-20T17:54:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.375+0000 7fb5b1ffb640 1 -- 172.21.15.6:0/119664064 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7fb5bc075b30 con 0x7fb5bc06cbf0 2024-05-20T17:54:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T17:54:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.378+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5a006be60 msgr2=0x7fb5a006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.378+0000 7fb5c3759640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5a006be60 0x7fb5a006e370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac034000 tx=0x7fb5ac02e000 comp rx=0 tx=0).stop 2024-05-20T17:54:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.378+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5bc06cbf0 msgr2=0x7fb5bc1f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.378+0000 7fb5c3759640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5bc06cbf0 0x7fb5bc1f31a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800e9e0 tx=0x7fb5b800eea0 comp rx=0 tx=0).stop 2024-05-20T17:54:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.380+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 shutdown_connections 2024-05-20T17:54:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.380+0000 7fb5c3759640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5a006be60 0x7fb5a006e370 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac034000 tx=0x7fb5ac02e000 comp rx=0 tx=0).stop 2024-05-20T17:54:15.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.380+0000 7fb5c3759640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5bc15d0c0 0x7fb5bc15ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:15.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.380+0000 7fb5c3759640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5bc0d0b60 0x7fb5bc152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:15.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.380+0000 7fb5c3759640 1 --2- 172.21.15.6:0/119664064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5bc06cbf0 0x7fb5bc1f31a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:15.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.380+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 >> 172.21.15.6:0/119664064 conn(0x7fb5bc072a20 msgr2=0x7fb5bc0cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:15.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.383+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 shutdown_connections 2024-05-20T17:54:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.384+0000 7fb5c3759640 1 -- 172.21.15.6:0/119664064 wait complete. 2024-05-20T17:54:15.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-20T17:54:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.528+0000 7f61ab208640 1 Processor -- start 2024-05-20T17:54:15.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.528+0000 7f61ab208640 1 -- start start 2024-05-20T17:54:15.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.529+0000 7f61ab208640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a40b3860 0x7f61a40d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:15.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.529+0000 7f61ab208640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a40d0450 con 0x7f61a408bd20 2024-05-20T17:54:15.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.529+0000 7f61ab208640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a40d3b10 con 0x7f61a406d870 2024-05-20T17:54:15.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.529+0000 7f61ab208640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f61a40d3df0 con 0x7f61a40b3860 2024-05-20T17:54:15.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f61a97a5640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f61a408bd20 0x7f61a408c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58672/0 (socket says 172.21.15.6:58672) 2024-05-20T17:54:15.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f61a97a5640 1 -- 172.21.15.6:0/3735947105 learned_addr learned my addr 172.21.15.6:0/3735947105 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:15.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f61a8fa4640 1 --2- 172.21.15.6:0/3735947105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a40b3860 0x7f61a40d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:15.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f619b7fe640 1 -- 172.21.15.6:0/3735947105 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013618359 0 0) 0x7f61a40d0450 con 0x7f61a408bd20 2024-05-20T17:54:15.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f619b7fe640 1 -- 172.21.15.6:0/3735947105 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f618c003520 con 0x7f61a408bd20 2024-05-20T17:54:15.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f619b7fe640 1 -- 172.21.15.6:0/3735947105 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260388951 0 0) 0x7f61a40d3b10 con 0x7f61a406d870 2024-05-20T17:54:15.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f61a8fa4640 1 -- 172.21.15.6:0/3735947105 >> v1:172.21.15.171:6789/0 conn(0x7f61a406d870 legacy=0x7f61a415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:15.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f61a8fa4640 1 -- 172.21.15.6:0/3735947105 >> v1:172.21.15.6:6789/0 conn(0x7f61a408bd20 legacy=0x7f61a408c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:15.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.530+0000 7f61a8fa4640 1 -- 172.21.15.6:0/3735947105 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a40d40d0 con 0x7f61a40b3860 2024-05-20T17:54:15.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.531+0000 7f61a8fa4640 1 --2- 172.21.15.6:0/3735947105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a40b3860 0x7f61a40d45f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f61a00097d0 tx=0x7f61a002a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85a893fae6764a8d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:15.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.531+0000 7f619b7fe640 1 -- 172.21.15.6:0/3735947105 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0037070 con 0x7f61a40b3860 2024-05-20T17:54:15.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.531+0000 7f619b7fe640 1 -- 172.21.15.6:0/3735947105 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a002ab70 con 0x7f61a40b3860 2024-05-20T17:54:15.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.531+0000 7f619b7fe640 1 -- 172.21.15.6:0/3735947105 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c0019f0 con 0x7f61a40b3860 2024-05-20T17:54:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.532+0000 7f61ab208640 1 -- 172.21.15.6:0/3735947105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a40b3860 msgr2=0x7f61a40d45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.532+0000 7f61ab208640 1 --2- 172.21.15.6:0/3735947105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a40b3860 0x7f61a40d45f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f61a00097d0 tx=0x7f61a002a0e0 comp rx=0 tx=0).stop 2024-05-20T17:54:15.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.532+0000 7f61ab208640 1 -- 172.21.15.6:0/3735947105 shutdown_connections 2024-05-20T17:54:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.532+0000 7f61ab208640 1 --2- 172.21.15.6:0/3735947105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a40b3860 0x7f61a40d45f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.532+0000 7f61ab208640 1 -- 172.21.15.6:0/3735947105 >> 172.21.15.6:0/3735947105 conn(0x7f61a40b6d10 msgr2=0x7f61a406d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.532+0000 7f61ab208640 1 -- 172.21.15.6:0/3735947105 shutdown_connections 2024-05-20T17:54:15.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.532+0000 7f61ab208640 1 -- 172.21.15.6:0/3735947105 wait complete. 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.534+0000 7f61ab208640 1 Processor -- start 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.534+0000 7f61ab208640 1 -- start start 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61ab208640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a406d870 0x7f61a414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61ab208640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61a408bd20 0x7f61a4155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61ab208640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a40b3860 0x7f61a4155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61ab208640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f61a416a0f0 con 0x7f61a40b3860 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61ab208640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f61a4169f70 con 0x7f61a408bd20 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61ab208640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f61a416a270 con 0x7f61a406d870 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61a97a5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a40b3860 0x7f61a4155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61a97a5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a40b3860 0x7f61a4155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55880/0 (socket says 172.21.15.6:55880) 2024-05-20T17:54:15.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.535+0000 7f61a97a5640 1 -- 172.21.15.6:0/3624714833 learned_addr learned my addr 172.21.15.6:0/3624714833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61a8fa4640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a406d870 0x7f61a414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f619bfff640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61a408bd20 0x7f61a4155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61a97a5640 1 -- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a406d870 msgr2=0x7f61a414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61a97a5640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a406d870 0x7f61a414cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61a97a5640 1 -- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61a408bd20 msgr2=0x7f61a4155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61a97a5640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61a408bd20 0x7f61a4155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61a97a5640 1 -- 172.21.15.6:0/3624714833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a413ccb0 con 0x7f61a40b3860 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61a97a5640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a40b3860 0x7f61a4155ba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f619c00caf0 tx=0x7f619c0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61997fa640 1 -- 172.21.15.6:0/3624714833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c018070 con 0x7f61a40b3860 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61997fa640 1 -- 172.21.15.6:0/3624714833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619c00a700 con 0x7f61a40b3860 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a413cf90 con 0x7f61a40b3860 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61997fa640 1 -- 172.21.15.6:0/3624714833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c00aad0 con 0x7f61a40b3860 2024-05-20T17:54:15.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.536+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a414d890 con 0x7f61a40b3860 2024-05-20T17:54:15.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.537+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a40690b0 con 0x7f61a40b3860 2024-05-20T17:54:15.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.538+0000 7f61997fa640 1 -- 172.21.15.6:0/3624714833 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f619c01b070 con 0x7f61a40b3860 2024-05-20T17:54:15.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.538+0000 7f61997fa640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f619006be60 0x7f619006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:15.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.538+0000 7f61997fa640 1 -- 172.21.15.6:0/3624714833 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7f619c08a6a0 con 0x7f61a40b3860 2024-05-20T17:54:15.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.538+0000 7f61a8fa4640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f619006be60 0x7f619006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:15.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.539+0000 7f61a8fa4640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f619006be60 0x7f619006e370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f61a0034000 tx=0x7f61a002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:15.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.543+0000 7f61997fa640 1 -- 172.21.15.6:0/3624714833 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f619c058fc0 con 0x7f61a40b3860 2024-05-20T17:54:15.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:15.731+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f61a413ca00 con 0x7f61a40b3860 2024-05-20T17:54:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.380+0000 7f61997fa640 1 -- 172.21.15.6:0/3624714833 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f619c0588c0 con 0x7f61a40b3860 2024-05-20T17:54:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' removed 2024-05-20T17:54:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.383+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f619006be60 msgr2=0x7f619006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.383+0000 7f61ab208640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f619006be60 0x7f619006e370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f61a0034000 tx=0x7f61a002e000 comp rx=0 tx=0).stop 2024-05-20T17:54:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.383+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a40b3860 msgr2=0x7f61a4155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.383+0000 7f61ab208640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a40b3860 0x7f61a4155ba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f619c00caf0 tx=0x7f619c0020c0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.384+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 shutdown_connections 2024-05-20T17:54:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.384+0000 7f61ab208640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f619006be60 0x7f619006e370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.384+0000 7f61ab208640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61a40b3860 0x7f61a4155ba0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.384+0000 7f61ab208640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61a408bd20 0x7f61a4155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.384+0000 7f61ab208640 1 --2- 172.21.15.6:0/3624714833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f61a406d870 0x7f61a414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.384+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 >> 172.21.15.6:0/3624714833 conn(0x7f61a40b6d10 msgr2=0x7f61a40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.384+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 shutdown_connections 2024-05-20T17:54:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.384+0000 7f61ab208640 1 -- 172.21.15.6:0/3624714833 wait complete. 2024-05-20T17:54:16.399 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T17:54:16.399 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T17:54:16.399 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T17:54:16.399 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:54:16.400 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T17:54:16.400 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T17:54:16.400 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T17:54:16.400 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:54:16.400 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T17:54:16.400 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T17:54:16.400 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T17:54:16.401 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:54:16.401 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T17:54:16.401 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T17:54:16.401 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T17:54:16.401 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:54:16.411 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T17:54:16.412 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T17:54:16.414 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T17:54:16.414 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T17:54:16.415 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T17:54:16.415 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T17:54:16.416 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T17:54:16.416 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T17:54:16.457 INFO:tasks.ceph.mds.c:Started 2024-05-20T17:54:16.457 DEBUG:teuthology.parallel:result is None 2024-05-20T17:54:16.458 INFO:tasks.ceph.mds.b:Started 2024-05-20T17:54:16.458 DEBUG:teuthology.parallel:result is None 2024-05-20T17:54:16.459 INFO:tasks.ceph.mds.a:Started 2024-05-20T17:54:16.459 INFO:tasks.ceph.mds.d:Started 2024-05-20T17:54:16.459 DEBUG:teuthology.parallel:result is None 2024-05-20T17:54:16.459 DEBUG:teuthology.parallel:result is None 2024-05-20T17:54:16.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T17:54:16.551 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T17:54:16.551 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T17:54:16.554 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:54:16.554 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:54:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.588+0000 7ff99feeb640 1 Processor -- start 2024-05-20T17:54:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.588+0000 7ff99feeb640 1 -- start start 2024-05-20T17:54:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.589+0000 7ff99feeb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff998163a10 0x7ff9980d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.589+0000 7ff99feeb640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff9980d14b0 0x7ff9980d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.589+0000 7ff99feeb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9980d0370 con 0x7ff9980b4010 2024-05-20T17:54:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99feeb640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff9980d3ca0 con 0x7ff9980d14b0 2024-05-20T17:54:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99feeb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff9980d0650 con 0x7ff998163a10 2024-05-20T17:54:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99d486640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff9980b4010 0x7ff9980cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:37710/0 (socket says 172.21.15.6:37710) 2024-05-20T17:54:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99d486640 1 -- 172.21.15.6:0/190294696 learned_addr learned my addr 172.21.15.6:0/190294696 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99e488640 1 --2- 172.21.15.6:0/190294696 >> v2:172.21.15.171:3300/0 conn(0x7ff9980d14b0 0x7ff9980d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99dc87640 1 --2- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff998163a10 0x7ff9980d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99e488640 1 -- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff998163a10 msgr2=0x7ff9980d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99e488640 1 --2- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff998163a10 0x7ff9980d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99e488640 1 -- 172.21.15.6:0/190294696 >> v1:172.21.15.171:6789/0 conn(0x7ff9980b4010 legacy=0x7ff9980cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99cc85640 1 -- 172.21.15.6:0/190294696 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936231384 0 0) 0x7ff9980d0370 con 0x7ff9980b4010 2024-05-20T17:54:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99e488640 1 -- 172.21.15.6:0/190294696 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9980d3650 con 0x7ff9980d14b0 2024-05-20T17:54:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.590+0000 7ff99dc87640 1 --2- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff998163a10 0x7ff9980d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.591+0000 7ff99e488640 1 --2- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 0x7ff9980d18c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff990009d90 tx=0x7ff99002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24aea195772adea4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.591+0000 7ff99cc85640 1 -- 172.21.15.6:0/190294696 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990007740 con 0x7ff9980d14b0 2024-05-20T17:54:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.591+0000 7ff99cc85640 1 -- 172.21.15.6:0/190294696 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9900078e0 con 0x7ff9980d14b0 2024-05-20T17:54:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.591+0000 7ff99cc85640 1 -- 172.21.15.6:0/190294696 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990007cb0 con 0x7ff9980d14b0 2024-05-20T17:54:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.592+0000 7ff99feeb640 1 -- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 msgr2=0x7ff9980d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.592+0000 7ff99feeb640 1 --2- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 0x7ff9980d18c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff990009d90 tx=0x7ff99002a680 comp rx=0 tx=0).stop 2024-05-20T17:54:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.592+0000 7ff99feeb640 1 -- 172.21.15.6:0/190294696 shutdown_connections 2024-05-20T17:54:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.592+0000 7ff99feeb640 1 --2- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 0x7ff9980d18c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.592+0000 7ff99feeb640 1 --2- 172.21.15.6:0/190294696 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff998163a10 0x7ff9980d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.592+0000 7ff99feeb640 1 -- 172.21.15.6:0/190294696 >> 172.21.15.6:0/190294696 conn(0x7ff99806d240 msgr2=0x7ff99806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.592+0000 7ff99feeb640 1 -- 172.21.15.6:0/190294696 shutdown_connections 2024-05-20T17:54:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.592+0000 7ff99feeb640 1 -- 172.21.15.6:0/190294696 wait complete. 2024-05-20T17:54:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.594+0000 7ff99feeb640 1 Processor -- start 2024-05-20T17:54:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.594+0000 7ff99feeb640 1 -- start start 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99feeb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9980b4010 0x7ff998157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99feeb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 0x7ff99814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99feeb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998163a10 0x7ff998158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99feeb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9980b8210 con 0x7ff998163a10 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99feeb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff9980d1e00 con 0x7ff9980d14b0 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99feeb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff9980b8390 con 0x7ff9980b4010 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99e488640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998163a10 0x7ff998158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99e488640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998163a10 0x7ff998158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55924/0 (socket says 172.21.15.6:55924) 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99e488640 1 -- 172.21.15.6:0/3375576418 learned_addr learned my addr 172.21.15.6:0/3375576418 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99dc87640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9980b4010 0x7ff998157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.595+0000 7ff99d486640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 0x7ff99814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff99e488640 1 -- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9980b4010 msgr2=0x7ff998157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff99e488640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9980b4010 0x7ff998157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff99e488640 1 -- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 msgr2=0x7ff99814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff99e488640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 0x7ff99814a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff99e488640 1 -- 172.21.15.6:0/3375576418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff998154640 con 0x7ff998163a10 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff99e488640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998163a10 0x7ff998158580 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff990009eb0 tx=0x7ff990004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff98e7fc640 1 -- 172.21.15.6:0/3375576418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99003f070 con 0x7ff998163a10 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff98e7fc640 1 -- 172.21.15.6:0/3375576418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff990031c40 con 0x7ff998163a10 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9981560b0 con 0x7ff998163a10 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.596+0000 7ff98e7fc640 1 -- 172.21.15.6:0/3375576418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990009410 con 0x7ff998163a10 2024-05-20T17:54:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.597+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff998159390 con 0x7ff998163a10 2024-05-20T17:54:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.598+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff998155e20 con 0x7ff998163a10 2024-05-20T17:54:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.598+0000 7ff98e7fc640 1 -- 172.21.15.6:0/3375576418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff990003990 con 0x7ff998163a10 2024-05-20T17:54:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.598+0000 7ff98e7fc640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97c06be60 0x7ff97c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.599+0000 7ff98e7fc640 1 -- 172.21.15.6:0/3375576418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7ff9900aba90 con 0x7ff998163a10 2024-05-20T17:54:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.599+0000 7ff99dc87640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97c06be60 0x7ff97c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.599+0000 7ff99dc87640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97c06be60 0x7ff97c06e370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff994009560 tx=0x7ff994009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:16.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.603+0000 7ff98e7fc640 1 -- 172.21.15.6:0/3375576418 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff990079ec0 con 0x7ff998163a10 2024-05-20T17:54:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:16.802+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff998075b00 con 0x7ff998163a10 2024-05-20T17:54:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.394+0000 7ff98e7fc640 1 -- 172.21.15.6:0/3375576418 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7ff99007e1c0 con 0x7ff998163a10 2024-05-20T17:54:17.394 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T17:54:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97c06be60 msgr2=0x7ff97c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97c06be60 0x7ff97c06e370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff994009560 tx=0x7ff994009190 comp rx=0 tx=0).stop 2024-05-20T17:54:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998163a10 msgr2=0x7ff998158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998163a10 0x7ff998158580 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff990009eb0 tx=0x7ff990004a40 comp rx=0 tx=0).stop 2024-05-20T17:54:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 shutdown_connections 2024-05-20T17:54:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97c06be60 0x7ff97c06e370 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff998163a10 0x7ff998158580 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9980d14b0 0x7ff99814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 --2- 172.21.15.6:0/3375576418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9980b4010 0x7ff998157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 >> 172.21.15.6:0/3375576418 conn(0x7ff99806d240 msgr2=0x7ff99815da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 shutdown_connections 2024-05-20T17:54:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.398+0000 7ff99feeb640 1 -- 172.21.15.6:0/3375576418 wait complete. 2024-05-20T17:54:17.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T17:54:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.536+0000 7fcfed338640 1 Processor -- start 2024-05-20T17:54:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.536+0000 7fcfed338640 1 -- start start 2024-05-20T17:54:17.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.537+0000 7fcfed338640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfe8168050 0x7fcfe816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.537+0000 7fcfed338640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe80d0630 con 0x7fcfe8162820 2024-05-20T17:54:17.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.537+0000 7fcfed338640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe80d39c0 con 0x7fcfe806d3d0 2024-05-20T17:54:17.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.537+0000 7fcfed338640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe80d3ca0 con 0x7fcfe8168050 2024-05-20T17:54:17.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.538+0000 7fcfe77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfe8168050 0x7fcfe816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.538+0000 7fcfe6ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcfe8162820 0x7fcfe80b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58688/0 (socket says 172.21.15.6:58688) 2024-05-20T17:54:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.538+0000 7fcfe6ffd640 1 -- 172.21.15.6:0/854439539 learned_addr learned my addr 172.21.15.6:0/854439539 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.538+0000 7fcfe77fe640 1 -- 172.21.15.6:0/854439539 >> v1:172.21.15.171:6789/0 conn(0x7fcfe806d3d0 legacy=0x7fcfe806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.538+0000 7fcfe77fe640 1 -- 172.21.15.6:0/854439539 >> v1:172.21.15.6:6789/0 conn(0x7fcfe8162820 legacy=0x7fcfe80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.538+0000 7fcfe77fe640 1 -- 172.21.15.6:0/854439539 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe80d3f80 con 0x7fcfe8168050 2024-05-20T17:54:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.539+0000 7fcfe77fe640 1 --2- 172.21.15.6:0/854439539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe816a470 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009d90 tx=0x7fcfe002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4013fa103ebdc0f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.539+0000 7fcfe5ffb640 1 -- 172.21.15.6:0/854439539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0007740 con 0x7fcfe8168050 2024-05-20T17:54:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.539+0000 7fcfe5ffb640 1 -- 172.21.15.6:0/854439539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe00078e0 con 0x7fcfe8168050 2024-05-20T17:54:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.539+0000 7fcfe5ffb640 1 -- 172.21.15.6:0/854439539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0007cb0 con 0x7fcfe8168050 2024-05-20T17:54:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.539+0000 7fcfed338640 1 -- 172.21.15.6:0/854439539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 msgr2=0x7fcfe816a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.539+0000 7fcfed338640 1 --2- 172.21.15.6:0/854439539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe816a470 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009d90 tx=0x7fcfe002a6a0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.540+0000 7fcfed338640 1 -- 172.21.15.6:0/854439539 shutdown_connections 2024-05-20T17:54:17.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.540+0000 7fcfed338640 1 --2- 172.21.15.6:0/854439539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe816a470 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.540+0000 7fcfed338640 1 -- 172.21.15.6:0/854439539 >> 172.21.15.6:0/854439539 conn(0x7fcfe80d4bd0 msgr2=0x7fcfe80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:17.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.540+0000 7fcfed338640 1 -- 172.21.15.6:0/854439539 shutdown_connections 2024-05-20T17:54:17.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.540+0000 7fcfed338640 1 -- 172.21.15.6:0/854439539 wait complete. 2024-05-20T17:54:17.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.541+0000 7fcfed338640 1 Processor -- start 2024-05-20T17:54:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.541+0000 7fcfed338640 1 -- start start 2024-05-20T17:54:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfed338640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe806d3d0 0x7fcfe80caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfed338640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe8162820 0x7fcfe81533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfed338640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe8153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfed338640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe80b91a0 con 0x7fcfe8168050 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfed338640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe80d0300 con 0x7fcfe806d3d0 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfed338640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe80b4050 con 0x7fcfe8162820 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe8153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe8153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55942/0 (socket says 172.21.15.6:55942) 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe77fe640 1 -- 172.21.15.6:0/1243731145 learned_addr learned my addr 172.21.15.6:0/1243731145 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe67fc640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe8162820 0x7fcfe81533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe6ffd640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe806d3d0 0x7fcfe80caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe77fe640 1 -- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe8162820 msgr2=0x7fcfe81533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe77fe640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe8162820 0x7fcfe81533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe77fe640 1 -- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe806d3d0 msgr2=0x7fcfe80caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe77fe640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe806d3d0 0x7fcfe80caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.543+0000 7fcfe77fe640 1 -- 172.21.15.6:0/1243731145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe8158170 con 0x7fcfe8168050 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.544+0000 7fcfe77fe640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe8153cc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009eb0 tx=0x7fcfe0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.544+0000 7fcfcf7fe640 1 -- 172.21.15.6:0/1243731145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe003f070 con 0x7fcfe8168050 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.544+0000 7fcfcf7fe640 1 -- 172.21.15.6:0/1243731145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe0031c90 con 0x7fcfe8168050 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.544+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe8158450 con 0x7fcfe8168050 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.544+0000 7fcfcf7fe640 1 -- 172.21.15.6:0/1243731145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0043630 con 0x7fcfe8168050 2024-05-20T17:54:17.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.544+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe8158a10 con 0x7fcfe8168050 2024-05-20T17:54:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.545+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe8157ed0 con 0x7fcfe8168050 2024-05-20T17:54:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.545+0000 7fcfcf7fe640 1 -- 172.21.15.6:0/1243731145 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfe003b410 con 0x7fcfe8168050 2024-05-20T17:54:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.546+0000 7fcfcf7fe640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd406be30 0x7fcfd406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.546+0000 7fcfcf7fe640 1 -- 172.21.15.6:0/1243731145 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fcfe00ac150 con 0x7fcfe8168050 2024-05-20T17:54:17.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.546+0000 7fcfe6ffd640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd406be30 0x7fcfd406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.547+0000 7fcfe6ffd640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd406be30 0x7fcfd406e340 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8007fd0 tx=0x7fcfd8007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.550+0000 7fcfcf7fe640 1 -- 172.21.15.6:0/1243731145 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcfe8157ed0 con 0x7fcfe8168050 2024-05-20T17:54:17.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.801+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcfe8075b00 con 0x7fcfe8168050 2024-05-20T17:54:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.802+0000 7fcfcf7fe640 1 -- 172.21.15.6:0/1243731145 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7fcfe007a730 con 0x7fcfe8168050 2024-05-20T17:54:17.801 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:17.801 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:54:17.801 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T17:54:17.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.801 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T17:54:17.801 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:54:17.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.804 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T17:54:17.805 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:54:17.806 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:54:17.808 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.810 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:54:17.811 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.812 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:54:17.813 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDpjUtmAdTKOhAADJJZwYaa1V4xSIG3+Nqd8w==", 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDpjUtmvNzKOhAAv0eos+zSjLHoMxO29jxeiQ==", 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDpjUtmGuXKOhAALiXVvIrUEu104C5bkTtFWA==", 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDpjUtmv+zKOhAAye4KRG1nYcs+2EUwOej4xQ==", 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDpjUtmxfTKOhAA7LReu1Om629x3bpsPGw/OA==", 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.817 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2024-05-20T17:54:17.817 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDpjUtma/7KOhAA2TENjnfvIHLXhB6ZeWh7Cg==", 2024-05-20T17:54:17.817 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.817 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-20T17:54:17.817 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T17:54:17.818 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:54:17.819 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:54:17.819 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:54:17.819 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:54:17.819 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.819 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:17.819 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:54:17.819 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:54:17.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd406be30 msgr2=0x7fcfd406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd406be30 0x7fcfd406e340 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8007fd0 tx=0x7fcfd8007e80 comp rx=0 tx=0).stop 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 msgr2=0x7fcfe8153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe8153cc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009eb0 tx=0x7fcfe0004a40 comp rx=0 tx=0).stop 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 shutdown_connections 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd406be30 0x7fcfd406e340 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe8168050 0x7fcfe8153cc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe8162820 0x7fcfe81533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 --2- 172.21.15.6:0/1243731145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe806d3d0 0x7fcfe80caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 >> 172.21.15.6:0/1243731145 conn(0x7fcfe80d4bd0 msgr2=0x7fcfe8161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 shutdown_connections 2024-05-20T17:54:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.804+0000 7fcfed338640 1 -- 172.21.15.6:0/1243731145 wait complete. 2024-05-20T17:54:17.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-20T17:54:17.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.939+0000 7f624aa22640 1 Processor -- start 2024-05-20T17:54:17.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.939+0000 7f624aa22640 1 -- start start 2024-05-20T17:54:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f624aa22640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6244162820 0x7f62440b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f624aa22640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62440b3e80 0x7f624406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f624aa22640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624406dd20 con 0x7f624406d910 2024-05-20T17:54:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f624aa22640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f62440d0630 con 0x7f62440b3e80 2024-05-20T17:54:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f624aa22640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f62440d39c0 con 0x7f6244162820 2024-05-20T17:54:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f62437fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62440b3e80 0x7f624406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f62437fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62440b3e80 0x7f624406d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47694/0 (socket says 172.21.15.6:47694) 2024-05-20T17:54:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f62437fe640 1 -- 172.21.15.6:0/2255355167 learned_addr learned my addr 172.21.15.6:0/2255355167 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:17.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.940+0000 7f6243fff640 1 --2- 172.21.15.6:0/2255355167 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6244162820 0x7f62440b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.941+0000 7f62437fe640 1 -- 172.21.15.6:0/2255355167 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6244162820 msgr2=0x7f62440b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:17.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.941+0000 7f62437fe640 1 --2- 172.21.15.6:0/2255355167 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6244162820 0x7f62440b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.941+0000 7f62437fe640 1 -- 172.21.15.6:0/2255355167 >> v1:172.21.15.171:6789/0 conn(0x7f624406d910 legacy=0x7f62440d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.941+0000 7f62437fe640 1 -- 172.21.15.6:0/2255355167 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62440d3ca0 con 0x7f62440b3e80 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.941+0000 7f62437fe640 1 --2- 172.21.15.6:0/2255355167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62440b3e80 0x7f624406d3d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6238009870 tx=0x7f623802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdcca4ad35739f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.941+0000 7f6242ffd640 1 -- 172.21.15.6:0/2255355167 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238037070 con 0x7f62440b3e80 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f6242ffd640 1 -- 172.21.15.6:0/2255355167 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6238032440 con 0x7f62440b3e80 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f6242ffd640 1 -- 172.21.15.6:0/2255355167 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238032810 con 0x7f62440b3e80 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f624aa22640 1 -- 172.21.15.6:0/2255355167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62440b3e80 msgr2=0x7f624406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f624aa22640 1 --2- 172.21.15.6:0/2255355167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62440b3e80 0x7f624406d3d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6238009870 tx=0x7f623802a270 comp rx=0 tx=0).stop 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f624aa22640 1 -- 172.21.15.6:0/2255355167 shutdown_connections 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f624aa22640 1 --2- 172.21.15.6:0/2255355167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62440b3e80 0x7f624406d3d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f624aa22640 1 --2- 172.21.15.6:0/2255355167 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6244162820 0x7f62440b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f624aa22640 1 -- 172.21.15.6:0/2255355167 >> 172.21.15.6:0/2255355167 conn(0x7f62440d4bd0 msgr2=0x7f62440d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f624aa22640 1 -- 172.21.15.6:0/2255355167 shutdown_connections 2024-05-20T17:54:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.942+0000 7f624aa22640 1 -- 172.21.15.6:0/2255355167 wait complete. 2024-05-20T17:54:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.944+0000 7f624aa22640 1 Processor -- start 2024-05-20T17:54:17.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.944+0000 7f624aa22640 1 -- start start 2024-05-20T17:54:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f624aa22640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f624406d910 0x7f62441f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f624aa22640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62440b3e80 0x7f62440c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f624aa22640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6244162820 0x7f62440cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f624aa22640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f62440d0300 con 0x7f6244162820 2024-05-20T17:54:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f624aa22640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f62440d4260 con 0x7f62440b3e80 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f624aa22640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f62440b91a0 con 0x7f624406d910 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6244162820 0x7f62440cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6244162820 0x7f62440cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47702/0 (socket says 172.21.15.6:47702) 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 -- 172.21.15.6:0/2392419904 learned_addr learned my addr 172.21.15.6:0/2392419904 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6243fff640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f624406d910 0x7f62441f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f62437fe640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62440b3e80 0x7f62440c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 -- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f624406d910 msgr2=0x7f62441f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f624406d910 0x7f62441f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 -- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62440b3e80 msgr2=0x7f62440c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62440b3e80 0x7f62440c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 -- 172.21.15.6:0/2392419904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62440c9e00 con 0x7f6244162820 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6243fff640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f624406d910 0x7f62441f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f62437fe640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62440b3e80 0x7f62440c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6248fbf640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6244162820 0x7f62440cd700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f623c00c6e0 tx=0x7f623c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6240ff9640 1 -- 172.21.15.6:0/2392419904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c003b70 con 0x7f6244162820 2024-05-20T17:54:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6240ff9640 1 -- 172.21.15.6:0/2392419904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623c003d30 con 0x7f6244162820 2024-05-20T17:54:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62440cb0d0 con 0x7f6244162820 2024-05-20T17:54:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f6240ff9640 1 -- 172.21.15.6:0/2392419904 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c005310 con 0x7f6244162820 2024-05-20T17:54:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.946+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62440cb690 con 0x7f6244162820 2024-05-20T17:54:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.948+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62441533a0 con 0x7f6244162820 2024-05-20T17:54:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.948+0000 7f6240ff9640 1 -- 172.21.15.6:0/2392419904 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f623c0054b0 con 0x7f6244162820 2024-05-20T17:54:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.949+0000 7f6240ff9640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f623006be30 0x7f623006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.949+0000 7f6240ff9640 1 -- 172.21.15.6:0/2392419904 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f623c08ab70 con 0x7f6244162820 2024-05-20T17:54:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.949+0000 7f6243fff640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f623006be30 0x7f623006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.949+0000 7f6243fff640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f623006be30 0x7f623006e340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6234009af0 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:17.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:17.953+0000 7f6240ff9640 1 -- 172.21.15.6:0/2392419904 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f624406dd20 con 0x7f6244162820 2024-05-20T17:54:18.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.208+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f62440c9b90 con 0x7f6244162820 2024-05-20T17:54:18.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.211+0000 7f6240ff9640 1 -- 172.21.15.6:0/2392419904 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f623c059650 con 0x7f6244162820 2024-05-20T17:54:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f623006be30 msgr2=0x7f623006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f623006be30 0x7f623006e340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6234009af0 tx=0x7f6234008040 comp rx=0 tx=0).stop 2024-05-20T17:54:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6244162820 msgr2=0x7f62440cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6244162820 0x7f62440cd700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f623c00c6e0 tx=0x7f623c00cba0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 shutdown_connections 2024-05-20T17:54:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f623006be30 0x7f623006e340 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6244162820 0x7f62440cd700 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62440b3e80 0x7f62440c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 --2- 172.21.15.6:0/2392419904 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f624406d910 0x7f62441f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 >> 172.21.15.6:0/2392419904 conn(0x7f62440d4bd0 msgr2=0x7f62440b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 shutdown_connections 2024-05-20T17:54:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.214+0000 7f624aa22640 1 -- 172.21.15.6:0/2392419904 wait complete. 2024-05-20T17:54:18.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-20T17:54:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.341+0000 7f9d4b4f7640 1 Processor -- start 2024-05-20T17:54:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.341+0000 7f9d4b4f7640 1 -- start start 2024-05-20T17:54:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d4b4f7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d440b4010 0x7f9d440d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d4b4f7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9d440d14b0 0x7f9d440d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d4b4f7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d440d0370 con 0x7f9d44163a10 2024-05-20T17:54:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d4b4f7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9d440d3ca0 con 0x7f9d440b4010 2024-05-20T17:54:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d4b4f7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9d440d0650 con 0x7f9d440d14b0 2024-05-20T17:54:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d48a92640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d440b4010 0x7f9d440d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d48a92640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d440b4010 0x7f9d440d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47706/0 (socket says 172.21.15.6:47706) 2024-05-20T17:54:18.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d49293640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d44163a10 0x7f9d440cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53818/0 (socket says 172.21.15.6:53818) 2024-05-20T17:54:18.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.342+0000 7f9d48a92640 1 -- 172.21.15.6:0/2732777129 learned_addr learned my addr 172.21.15.6:0/2732777129 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:18.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.343+0000 7f9d49a94640 1 --2- 172.21.15.6:0/2732777129 >> v2:172.21.15.171:3300/0 conn(0x7f9d440d14b0 0x7f9d440d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.343+0000 7f9d48a92640 1 -- 172.21.15.6:0/2732777129 >> v2:172.21.15.171:3300/0 conn(0x7f9d440d14b0 msgr2=0x7f9d440d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:18.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.343+0000 7f9d48a92640 1 --2- 172.21.15.6:0/2732777129 >> v2:172.21.15.171:3300/0 conn(0x7f9d440d14b0 0x7f9d440d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.343+0000 7f9d48a92640 1 -- 172.21.15.6:0/2732777129 >> v1:172.21.15.6:6789/0 conn(0x7f9d44163a10 legacy=0x7f9d440cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.343+0000 7f9d48a92640 1 -- 172.21.15.6:0/2732777129 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d440d3650 con 0x7f9d440b4010 2024-05-20T17:54:18.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.343+0000 7f9d43fff640 1 -- 172.21.15.6:0/2732777129 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322997702 0 0) 0x7f9d440d0370 con 0x7f9d44163a10 2024-05-20T17:54:18.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d48a92640 1 --2- 172.21.15.6:0/2732777129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440b4010 0x7f9d440d4130 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9d440b4590 tx=0x7f9d3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a53398992bbc8f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:18.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d43fff640 1 -- 172.21.15.6:0/2732777129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38037070 con 0x7f9d440b4010 2024-05-20T17:54:18.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d43fff640 1 -- 172.21.15.6:0/2732777129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d38032440 con 0x7f9d440b4010 2024-05-20T17:54:18.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d43fff640 1 -- 172.21.15.6:0/2732777129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38032810 con 0x7f9d440b4010 2024-05-20T17:54:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/2732777129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440b4010 msgr2=0x7f9d440d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/2732777129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440b4010 0x7f9d440d4130 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9d440b4590 tx=0x7f9d3802a270 comp rx=0 tx=0).stop 2024-05-20T17:54:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/2732777129 shutdown_connections 2024-05-20T17:54:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/2732777129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440b4010 0x7f9d440d4130 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/2732777129 >> v2:172.21.15.171:3300/0 conn(0x7f9d440d14b0 0x7f9d440d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.344+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/2732777129 >> 172.21.15.6:0/2732777129 conn(0x7f9d4406d240 msgr2=0x7f9d4406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.345+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/2732777129 shutdown_connections 2024-05-20T17:54:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.345+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/2732777129 wait complete. 2024-05-20T17:54:18.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.346+0000 7f9d4b4f7640 1 Processor -- start 2024-05-20T17:54:18.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.346+0000 7f9d4b4f7640 1 -- start start 2024-05-20T17:54:18.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d4b4f7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d440b4010 0x7f9d441543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d4b4f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440d14b0 0x7f9d441f94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d4b4f7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d44163a10 0x7f9d44158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d4b4f7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440b8210 con 0x7f9d440d14b0 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d4b4f7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440d1e00 con 0x7f9d440b4010 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d4b4f7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9d440b8390 con 0x7f9d44163a10 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440d14b0 0x7f9d441f94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440d14b0 0x7f9d441f94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47710/0 (socket says 172.21.15.6:47710) 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 -- 172.21.15.6:0/1002420400 learned_addr learned my addr 172.21.15.6:0/1002420400 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d49a94640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d44163a10 0x7f9d44158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d49293640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d440b4010 0x7f9d441543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 -- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d44163a10 msgr2=0x7f9d44158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d44163a10 0x7f9d44158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 -- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d440b4010 msgr2=0x7f9d441543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d440b4010 0x7f9d441543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 -- 172.21.15.6:0/1002420400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d44157930 con 0x7f9d440d14b0 2024-05-20T17:54:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d49a94640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d44163a10 0x7f9d44158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d49293640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d440b4010 0x7f9d441543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.348+0000 7f9d48a92640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440d14b0 0x7f9d441f94e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000c00 tx=0x7f9d380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.349+0000 7f9d41ffb640 1 -- 172.21.15.6:0/1002420400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38037040 con 0x7f9d440d14b0 2024-05-20T17:54:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.349+0000 7f9d41ffb640 1 -- 172.21.15.6:0/1002420400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d38042070 con 0x7f9d440d14b0 2024-05-20T17:54:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.349+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d44157bd0 con 0x7f9d440d14b0 2024-05-20T17:54:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.349+0000 7f9d41ffb640 1 -- 172.21.15.6:0/1002420400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38030860 con 0x7f9d440d14b0 2024-05-20T17:54:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.349+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d44158190 con 0x7f9d440d14b0 2024-05-20T17:54:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.350+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d441f9f80 con 0x7f9d440d14b0 2024-05-20T17:54:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.351+0000 7f9d41ffb640 1 -- 172.21.15.6:0/1002420400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d38030a00 con 0x7f9d440d14b0 2024-05-20T17:54:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.351+0000 7f9d41ffb640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d3006be60 0x7f9d3006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.351+0000 7f9d41ffb640 1 -- 172.21.15.6:0/1002420400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f9d380ab5b0 con 0x7f9d440d14b0 2024-05-20T17:54:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.351+0000 7f9d49293640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d3006be60 0x7f9d3006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.352+0000 7f9d49293640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d3006be60 0x7f9d3006e370 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c007fd0 tx=0x7f9d3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:18.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.356+0000 7f9d41ffb640 1 -- 172.21.15.6:0/1002420400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9d3807a090 con 0x7f9d440d14b0 2024-05-20T17:54:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.613+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f9d44075b00 con 0x7f9d440d14b0 2024-05-20T17:54:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.618+0000 7f9d41ffb640 1 -- 172.21.15.6:0/1002420400 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f9d38079990 con 0x7f9d440d14b0 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d3006be60 msgr2=0x7f9d3006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d3006be60 0x7f9d3006e370 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c007fd0 tx=0x7f9d3c009040 comp rx=0 tx=0).stop 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440d14b0 msgr2=0x7f9d441f94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440d14b0 0x7f9d441f94e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000c00 tx=0x7f9d380046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 shutdown_connections 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d3006be60 0x7f9d3006e370 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d44163a10 0x7f9d44158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d440d14b0 0x7f9d441f94e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 --2- 172.21.15.6:0/1002420400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d440b4010 0x7f9d441543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 >> 172.21.15.6:0/1002420400 conn(0x7f9d4406d240 msgr2=0x7f9d4415d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 shutdown_connections 2024-05-20T17:54:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.619+0000 7f9d4b4f7640 1 -- 172.21.15.6:0/1002420400 wait complete. 2024-05-20T17:54:18.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-20T17:54:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.746+0000 7ffa63b21640 1 Processor -- start 2024-05-20T17:54:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.747+0000 7ffa63b21640 1 -- start start 2024-05-20T17:54:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa63b21640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c070f60 0x7ffa5c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa63b21640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5c0ce2b0 con 0x7ffa5c071630 2024-05-20T17:54:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa63b21640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5c06cce0 con 0x7ffa5c0cd1b0 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa63b21640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5c15f790 con 0x7ffa5c070f60 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa618bd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffa5c071630 0x7ffa5c06d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53826/0 (socket says 172.21.15.6:53826) 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa618bd640 1 -- 172.21.15.6:0/3495425427 learned_addr learned my addr 172.21.15.6:0/3495425427 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa620be640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c070f60 0x7ffa5c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611472884 0 0) 0x7ffa5c0ce2b0 con 0x7ffa5c071630 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.748+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa44003520 con 0x7ffa5c071630 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 41743694 0 0) 0x7ffa44003520 con 0x7ffa5c071630 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c070f60 msgr2=0x7ffa5c15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c070f60 0x7ffa5c15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 >> v1:172.21.15.171:6789/0 conn(0x7ffa5c0cd1b0 legacy=0x7ffa5c070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c06cfc0 con 0x7ffa5c071630 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ffa4c0019f0 con 0x7ffa5c071630 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 >> v1:172.21.15.6:6789/0 conn(0x7ffa5c071630 legacy=0x7ffa5c06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa440039e0 0x7ffa44003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa44004800 0x7ffa44004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa440051a0 0x7ffa4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c15f790 con 0x7ffa440039e0 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4400bf00 con 0x7ffa44004800 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4400c100 con 0x7ffa440051a0 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa618bd640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa440039e0 0x7ffa44003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa620be640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa440051a0 0x7ffa4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa610bc640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa44004800 0x7ffa44004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa618bd640 1 -- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa440051a0 msgr2=0x7ffa4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa618bd640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa440051a0 0x7ffa4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa618bd640 1 -- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa44004800 msgr2=0x7ffa44004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa618bd640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa44004800 0x7ffa44004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa618bd640 1 -- 172.21.15.6:0/3495425427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa44003520 con 0x7ffa440039e0 2024-05-20T17:54:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.749+0000 7ffa610bc640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa44004800 0x7ffa44004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.750+0000 7ffa618bd640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa440039e0 0x7ffa44003e10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00a800 tx=0x7ffa44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939d4b0ca8e17a12 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.750+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00a450 con 0x7ffa440039e0 2024-05-20T17:54:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.750+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c02f070 con 0x7ffa440039e0 2024-05-20T17:54:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.750+0000 7ffa608bb640 1 -- 172.21.15.6:0/3495425427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c02bc70 con 0x7ffa440039e0 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.751+0000 7ffa63b21640 1 -- 172.21.15.6:0/3495425427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa440039e0 msgr2=0x7ffa44003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.751+0000 7ffa63b21640 1 --2- 172.21.15.6:0/3495425427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa440039e0 0x7ffa44003e10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00a800 tx=0x7ffa44005830 comp rx=0 tx=0).stop 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.751+0000 7ffa620be640 1 -- 172.21.15.6:0/3495425427 reap_dead start 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.751+0000 7ffa63b21640 1 -- 172.21.15.6:0/3495425427 shutdown_connections 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.751+0000 7ffa63b21640 1 -- 172.21.15.6:0/3495425427 >> 172.21.15.6:0/3495425427 conn(0x7ffa5c0d29d0 msgr2=0x7ffa5c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.751+0000 7ffa63b21640 1 -- 172.21.15.6:0/3495425427 shutdown_connections 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.751+0000 7ffa63b21640 1 -- 172.21.15.6:0/3495425427 wait complete. 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.753+0000 7ffa63b21640 1 Processor -- start 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.753+0000 7ffa63b21640 1 -- start start 2024-05-20T17:54:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa63b21640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa440039e0 0x7ffa5c14ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa63b21640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c0ada90 0x7ffa5c0adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa63b21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c0d0c70 0x7ffa5c0d1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa63b21640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c06ded0 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa63b21640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c06c990 con 0x7ffa440039e0 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa63b21640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5c1f6390 con 0x7ffa5c0ada90 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa620be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c0d0c70 0x7ffa5c0d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa620be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c0d0c70 0x7ffa5c0d1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47734/0 (socket says 172.21.15.6:47734) 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.754+0000 7ffa620be640 1 -- 172.21.15.6:0/3672692315 learned_addr learned my addr 172.21.15.6:0/3672692315 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa610bc640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c0ada90 0x7ffa5c0adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa618bd640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa440039e0 0x7ffa5c14ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa620be640 1 -- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c0ada90 msgr2=0x7ffa5c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa620be640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c0ada90 0x7ffa5c0adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa620be640 1 -- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa440039e0 msgr2=0x7ffa5c14ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa620be640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa440039e0 0x7ffa5c14ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa620be640 1 -- 172.21.15.6:0/3672692315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c0d15c0 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa620be640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c0d0c70 0x7ffa5c0d1080 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0b55e0 tx=0x7ffa54011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa5a7fc640 1 -- 172.21.15.6:0/3672692315 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54004240 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa5a7fc640 1 -- 172.21.15.6:0/3672692315 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5401b070 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5c15cb80 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa5a7fc640 1 -- 172.21.15.6:0/3672692315 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400f7a0 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.755+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5c15d140 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.756+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa5c075b00 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.757+0000 7ffa5a7fc640 1 -- 172.21.15.6:0/3672692315 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa54012040 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.757+0000 7ffa5a7fc640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa4806be30 0x7ffa4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.757+0000 7ffa5a7fc640 1 -- 172.21.15.6:0/3672692315 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7ffa5408a960 con 0x7ffa5c0d0c70 2024-05-20T17:54:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.757+0000 7ffa618bd640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa4806be30 0x7ffa4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.758+0000 7ffa618bd640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa4806be30 0x7ffa4806e340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c033000 tx=0x7ffa4c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:18.762+0000 7ffa5a7fc640 1 -- 172.21.15.6:0/3672692315 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffa54025020 con 0x7ffa5c0d0c70 2024-05-20T17:54:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.014+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7ffa5c15c910 con 0x7ffa5c0d0c70 2024-05-20T17:54:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.019+0000 7ffa5a7fc640 1 -- 172.21.15.6:0/3672692315 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7ffa5c0d15c0 con 0x7ffa5c0d0c70 2024-05-20T17:54:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa4806be30 msgr2=0x7ffa4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa4806be30 0x7ffa4806e340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c033000 tx=0x7ffa4c009030 comp rx=0 tx=0).stop 2024-05-20T17:54:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c0d0c70 msgr2=0x7ffa5c0d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c0d0c70 0x7ffa5c0d1080 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0b55e0 tx=0x7ffa54011cf0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 shutdown_connections 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa4806be30 0x7ffa4806e340 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa5c0d0c70 0x7ffa5c0d1080 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa5c0ada90 0x7ffa5c0adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 --2- 172.21.15.6:0/3672692315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa440039e0 0x7ffa5c14ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 >> 172.21.15.6:0/3672692315 conn(0x7ffa5c0d29d0 msgr2=0x7ffa5c0b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 shutdown_connections 2024-05-20T17:54:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.021+0000 7ffa63b21640 1 -- 172.21.15.6:0/3672692315 wait complete. 2024-05-20T17:54:19.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-20T17:54:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.148+0000 7f411b731640 1 Processor -- start 2024-05-20T17:54:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.148+0000 7f411b731640 1 -- start start 2024-05-20T17:54:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f411b731640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4114168050 0x7f411416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f411b731640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41140d0630 con 0x7f4114162820 2024-05-20T17:54:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f411b731640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41140d39c0 con 0x7f411406d3d0 2024-05-20T17:54:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f411b731640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f41140d3ca0 con 0x7f4114168050 2024-05-20T17:54:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f4119cce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4114168050 0x7f411416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f41194cd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4114162820 0x7f41140b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53832/0 (socket says 172.21.15.6:53832) 2024-05-20T17:54:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f4119cce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4114168050 0x7f411416a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47736/0 (socket says 172.21.15.6:47736) 2024-05-20T17:54:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f41194cd640 1 -- 172.21.15.6:0/69930969 learned_addr learned my addr 172.21.15.6:0/69930969 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f4119cce640 1 -- 172.21.15.6:0/69930969 >> v1:172.21.15.171:6789/0 conn(0x7f411406d3d0 legacy=0x7f411406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f4119cce640 1 -- 172.21.15.6:0/69930969 >> v1:172.21.15.6:6789/0 conn(0x7f4114162820 legacy=0x7f41140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f410bfff640 1 -- 172.21.15.6:0/69930969 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085475498 0 0) 0x7f41140d0630 con 0x7f4114162820 2024-05-20T17:54:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.150+0000 7f4119cce640 1 -- 172.21.15.6:0/69930969 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41140d3f80 con 0x7f4114168050 2024-05-20T17:54:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.151+0000 7f4119cce640 1 --2- 172.21.15.6:0/69930969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114168050 0x7f411416a470 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f410c0097a0 tx=0x7f410c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccadcfb01b9a6ec server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.151+0000 7f410bfff640 1 -- 172.21.15.6:0/69930969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c037070 con 0x7f4114168050 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.151+0000 7f410bfff640 1 -- 172.21.15.6:0/69930969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410c032440 con 0x7f4114168050 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.151+0000 7f410bfff640 1 -- 172.21.15.6:0/69930969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c032810 con 0x7f4114168050 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.152+0000 7f411b731640 1 -- 172.21.15.6:0/69930969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114168050 msgr2=0x7f411416a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.152+0000 7f411b731640 1 --2- 172.21.15.6:0/69930969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114168050 0x7f411416a470 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f410c0097a0 tx=0x7f410c02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.152+0000 7f411b731640 1 -- 172.21.15.6:0/69930969 shutdown_connections 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.152+0000 7f411b731640 1 --2- 172.21.15.6:0/69930969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4114168050 0x7f411416a470 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.152+0000 7f411b731640 1 -- 172.21.15.6:0/69930969 >> 172.21.15.6:0/69930969 conn(0x7f41140d4bd0 msgr2=0x7f41140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.152+0000 7f411b731640 1 -- 172.21.15.6:0/69930969 shutdown_connections 2024-05-20T17:54:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.152+0000 7f411b731640 1 -- 172.21.15.6:0/69930969 wait complete. 2024-05-20T17:54:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.154+0000 7f411b731640 1 Processor -- start 2024-05-20T17:54:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.154+0000 7f411b731640 1 -- start start 2024-05-20T17:54:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f411b731640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411406d3d0 0x7f41141f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f411b731640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4114162820 0x7f41141596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f411b731640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4114168050 0x7f4114159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f411b731640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f41140b91a0 con 0x7f411406d3d0 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f411b731640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f41140d0300 con 0x7f4114168050 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f411b731640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f41140b4050 con 0x7f4114162820 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f41194cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411406d3d0 0x7f41141f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f41194cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411406d3d0 0x7f41141f86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47748/0 (socket says 172.21.15.6:47748) 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f41194cd640 1 -- 172.21.15.6:0/3402965447 learned_addr learned my addr 172.21.15.6:0/3402965447 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f4119cce640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4114168050 0x7f4114159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f4118ccc640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4114162820 0x7f41141596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f41194cd640 1 -- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4114162820 msgr2=0x7f41141596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f41194cd640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4114162820 0x7f41141596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f41194cd640 1 -- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4114168050 msgr2=0x7f4114159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f41194cd640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4114168050 0x7f4114159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.155+0000 7f41194cd640 1 -- 172.21.15.6:0/3402965447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4114151300 con 0x7f411406d3d0 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.156+0000 7f41194cd640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411406d3d0 0x7f41141f86e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f411000c7f0 tx=0x7f411000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.156+0000 7f4109ffb640 1 -- 172.21.15.6:0/3402965447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110018070 con 0x7f411406d3d0 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.156+0000 7f4109ffb640 1 -- 172.21.15.6:0/3402965447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411000a640 con 0x7f411406d3d0 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.156+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4114151570 con 0x7f411406d3d0 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.156+0000 7f4109ffb640 1 -- 172.21.15.6:0/3402965447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411000aa30 con 0x7f411406d3d0 2024-05-20T17:54:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.156+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41140c87a0 con 0x7f411406d3d0 2024-05-20T17:54:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.157+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4114075b00 con 0x7f411406d3d0 2024-05-20T17:54:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.158+0000 7f4109ffb640 1 -- 172.21.15.6:0/3402965447 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f411001b070 con 0x7f411406d3d0 2024-05-20T17:54:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.158+0000 7f4109ffb640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40f806be60 0x7f40f806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.159+0000 7f4109ffb640 1 -- 172.21.15.6:0/3402965447 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f411008a380 con 0x7f411406d3d0 2024-05-20T17:54:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.159+0000 7f4118ccc640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40f806be60 0x7f40f806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.159+0000 7f4118ccc640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40f806be60 0x7f40f806e370 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4104006fd0 tx=0x7f4104008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.163+0000 7f4109ffb640 1 -- 172.21.15.6:0/3402965447 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4110058e60 con 0x7f411406d3d0 2024-05-20T17:54:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.423+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f4114152280 con 0x7f411406d3d0 2024-05-20T17:54:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.427+0000 7f4109ffb640 1 -- 172.21.15.6:0/3402965447 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f4110058760 con 0x7f411406d3d0 2024-05-20T17:54:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40f806be60 msgr2=0x7f40f806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40f806be60 0x7f40f806e370 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4104006fd0 tx=0x7f4104008040 comp rx=0 tx=0).stop 2024-05-20T17:54:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411406d3d0 msgr2=0x7f41141f86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411406d3d0 0x7f41141f86e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f411000c7f0 tx=0x7f411000ccb0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 shutdown_connections 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40f806be60 0x7f40f806e370 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4114168050 0x7f4114159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4114162820 0x7f41141596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 --2- 172.21.15.6:0/3402965447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f411406d3d0 0x7f41141f86e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 >> 172.21.15.6:0/3402965447 conn(0x7f41140d4bd0 msgr2=0x7f41141610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 shutdown_connections 2024-05-20T17:54:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.430+0000 7f411b731640 1 -- 172.21.15.6:0/3402965447 wait complete. 2024-05-20T17:54:19.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-20T17:54:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.557+0000 7ff08493e640 1 Processor -- start 2024-05-20T17:54:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.557+0000 7ff08493e640 1 -- start start 2024-05-20T17:54:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff08493e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff0800b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff08493e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff08006dae0 0x7ff0800b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff08493e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0800d0630 con 0x7ff0800b3e80 2024-05-20T17:54:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff08493e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff0800d39c0 con 0x7ff08006dae0 2024-05-20T17:54:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff08493e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0800d3ca0 con 0x7ff080162820 2024-05-20T17:54:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff07e59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff0800b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff07e59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff0800b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:39496/0 (socket says 172.21.15.6:39496) 2024-05-20T17:54:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff07ed9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff08006dae0 0x7ff0800b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff07e59c640 1 -- 172.21.15.6:0/121611730 learned_addr learned my addr 172.21.15.6:0/121611730 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.559+0000 7ff07dd9b640 1 --1- 172.21.15.6:0/121611730 >> v1:172.21.15.171:6789/0 conn(0x7ff0800b3e80 0x7ff08006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:44844/0 (socket says 172.21.15.6:44844) 2024-05-20T17:54:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.560+0000 7ff07ed9d640 1 -- 172.21.15.6:0/121611730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 msgr2=0x7ff0800b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.560+0000 7ff07ed9d640 1 --2- 172.21.15.6:0/121611730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff0800b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.560+0000 7ff07ed9d640 1 -- 172.21.15.6:0/121611730 >> v1:172.21.15.171:6789/0 conn(0x7ff0800b3e80 legacy=0x7ff08006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.560+0000 7ff07ed9d640 1 -- 172.21.15.6:0/121611730 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0800d3f80 con 0x7ff08006dae0 2024-05-20T17:54:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.560+0000 7ff07e59c640 1 --2- 172.21.15.6:0/121611730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff0800b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.560+0000 7ff07ed9d640 1 --2- 172.21.15.6:0/121611730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08006dae0 0x7ff0800b8190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0700097a0 tx=0x7ff07002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4071e3b56872ba05 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff07d59a640 1 -- 172.21.15.6:0/121611730 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070037070 con 0x7ff08006dae0 2024-05-20T17:54:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff07d59a640 1 -- 172.21.15.6:0/121611730 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff070032440 con 0x7ff08006dae0 2024-05-20T17:54:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff07d59a640 1 -- 172.21.15.6:0/121611730 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070032810 con 0x7ff08006dae0 2024-05-20T17:54:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff08493e640 1 -- 172.21.15.6:0/121611730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08006dae0 msgr2=0x7ff0800b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff08493e640 1 --2- 172.21.15.6:0/121611730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08006dae0 0x7ff0800b8190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0700097a0 tx=0x7ff07002a180 comp rx=0 tx=0).stop 2024-05-20T17:54:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff08493e640 1 -- 172.21.15.6:0/121611730 shutdown_connections 2024-05-20T17:54:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff08493e640 1 --2- 172.21.15.6:0/121611730 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff08006dae0 0x7ff0800b8190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff08493e640 1 --2- 172.21.15.6:0/121611730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff0800b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff08493e640 1 -- 172.21.15.6:0/121611730 >> 172.21.15.6:0/121611730 conn(0x7ff0800d4bd0 msgr2=0x7ff0800d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff08493e640 1 -- 172.21.15.6:0/121611730 shutdown_connections 2024-05-20T17:54:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.561+0000 7ff08493e640 1 -- 172.21.15.6:0/121611730 wait complete. 2024-05-20T17:54:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.563+0000 7ff08493e640 1 Processor -- start 2024-05-20T17:54:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.563+0000 7ff08493e640 1 -- start start 2024-05-20T17:54:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff08493e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0800b3e80 0x7ff0800b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff08493e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff08014aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff08493e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff08014b230 0x7ff08014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff08493e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0800d4780 con 0x7ff08014b230 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff08493e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff0800d0300 con 0x7ff0800b3e80 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff08493e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0800d4900 con 0x7ff080162820 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff08014b230 0x7ff08014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff08014b230 0x7ff08014b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47756/0 (socket says 172.21.15.6:47756) 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07ed9d640 1 -- 172.21.15.6:0/3449881371 learned_addr learned my addr 172.21.15.6:0/3449881371 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07e59c640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0800b3e80 0x7ff0800b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07dd9b640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff08014aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07ed9d640 1 -- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 msgr2=0x7ff08014aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07ed9d640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff08014aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07ed9d640 1 -- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0800b3e80 msgr2=0x7ff0800b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07ed9d640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0800b3e80 0x7ff0800b6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.565+0000 7ff07ed9d640 1 -- 172.21.15.6:0/3449881371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0800b5680 con 0x7ff08014b230 2024-05-20T17:54:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.566+0000 7ff07ed9d640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff08014b230 0x7ff08014b640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff070035040 tx=0x7ff0700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.566+0000 7ff076ffd640 1 -- 172.21.15.6:0/3449881371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070037040 con 0x7ff08014b230 2024-05-20T17:54:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.566+0000 7ff076ffd640 1 -- 172.21.15.6:0/3449881371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff070042070 con 0x7ff08014b230 2024-05-20T17:54:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.566+0000 7ff076ffd640 1 -- 172.21.15.6:0/3449881371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0700308a0 con 0x7ff08014b230 2024-05-20T17:54:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.566+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0800b5b20 con 0x7ff08014b230 2024-05-20T17:54:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.566+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0800b60e0 con 0x7ff08014b230 2024-05-20T17:54:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.567+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff080068aa0 con 0x7ff08014b230 2024-05-20T17:54:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.567+0000 7ff076ffd640 1 -- 172.21.15.6:0/3449881371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff070030a40 con 0x7ff08014b230 2024-05-20T17:54:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.568+0000 7ff076ffd640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff06006be30 0x7ff06006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.568+0000 7ff076ffd640 1 -- 172.21.15.6:0/3449881371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7ff0700ab380 con 0x7ff08014b230 2024-05-20T17:54:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.569+0000 7ff07e59c640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff06006be30 0x7ff06006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.569+0000 7ff07e59c640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff06006be30 0x7ff06006e340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0780072c0 tx=0x7ff07800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.573+0000 7ff076ffd640 1 -- 172.21.15.6:0/3449881371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff080068aa0 con 0x7ff08014b230 2024-05-20T17:54:19.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.835+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ff0800b58b0 con 0x7ff08014b230 2024-05-20T17:54:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.840+0000 7ff076ffd640 1 -- 172.21.15.6:0/3449881371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7ff07004c020 con 0x7ff08014b230 2024-05-20T17:54:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff06006be30 msgr2=0x7ff06006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff06006be30 0x7ff06006e340 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0780072c0 tx=0x7ff07800b040 comp rx=0 tx=0).stop 2024-05-20T17:54:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff08014b230 msgr2=0x7ff08014b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff08014b230 0x7ff08014b640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff070035040 tx=0x7ff0700046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 shutdown_connections 2024-05-20T17:54:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff06006be30 0x7ff06006e340 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff08014b230 0x7ff08014b640 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff080162820 0x7ff08014aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 --2- 172.21.15.6:0/3449881371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0800b3e80 0x7ff0800b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 >> 172.21.15.6:0/3449881371 conn(0x7ff0800d4bd0 msgr2=0x7ff08015f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 shutdown_connections 2024-05-20T17:54:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.842+0000 7ff08493e640 1 -- 172.21.15.6:0/3449881371 wait complete. 2024-05-20T17:54:19.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-20T17:54:19.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.970+0000 7fbbfe1c7640 1 Processor -- start 2024-05-20T17:54:19.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.970+0000 7fbbfe1c7640 1 -- start start 2024-05-20T17:54:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.971+0000 7fbbfe1c7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf80d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.971+0000 7fbbfe1c7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf815e6b0 con 0x7fbbf806d9a0 2024-05-20T17:54:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.971+0000 7fbbfe1c7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf80d1100 con 0x7fbbf80b2f10 2024-05-20T17:54:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.971+0000 7fbbfe1c7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf80d2400 con 0x7fbbf815e050 2024-05-20T17:54:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.971+0000 7fbbf6ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbbf806d9a0 0x7fbbf815d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53838/0 (socket says 172.21.15.6:53838) 2024-05-20T17:54:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.971+0000 7fbbf6ffd640 1 -- 172.21.15.6:0/2006507961 learned_addr learned my addr 172.21.15.6:0/2006507961 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.971+0000 7fbbf7fff640 1 --2- 172.21.15.6:0/2006507961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf80d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.972+0000 7fbbf67fc640 1 -- 172.21.15.6:0/2006507961 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250093667 0 0) 0x7fbbf815e6b0 con 0x7fbbf806d9a0 2024-05-20T17:54:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.972+0000 7fbbf67fc640 1 -- 172.21.15.6:0/2006507961 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbe0003520 con 0x7fbbf806d9a0 2024-05-20T17:54:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.972+0000 7fbbf67fc640 1 -- 172.21.15.6:0/2006507961 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829925281 0 0) 0x7fbbf80d1100 con 0x7fbbf80b2f10 2024-05-20T17:54:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.972+0000 7fbbf67fc640 1 -- 172.21.15.6:0/2006507961 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbf815e6b0 con 0x7fbbf80b2f10 2024-05-20T17:54:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.972+0000 7fbbf7fff640 1 -- 172.21.15.6:0/2006507961 >> v1:172.21.15.171:6789/0 conn(0x7fbbf80b2f10 legacy=0x7fbbf806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.972+0000 7fbbf7fff640 1 -- 172.21.15.6:0/2006507961 >> v1:172.21.15.6:6789/0 conn(0x7fbbf806d9a0 legacy=0x7fbbf815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.972+0000 7fbbf7fff640 1 -- 172.21.15.6:0/2006507961 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf80d13e0 con 0x7fbbf815e050 2024-05-20T17:54:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.973+0000 7fbbf7fff640 1 --2- 172.21.15.6:0/2006507961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf80d1ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009dc0 tx=0x7fbbf002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e7032d8b6741e9a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.973+0000 7fbbf67fc640 1 -- 172.21.15.6:0/2006507961 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf002ae60 con 0x7fbbf815e050 2024-05-20T17:54:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.973+0000 7fbbf67fc640 1 -- 172.21.15.6:0/2006507961 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf0007740 con 0x7fbbf815e050 2024-05-20T17:54:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.973+0000 7fbbf67fc640 1 -- 172.21.15.6:0/2006507961 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0007b10 con 0x7fbbf815e050 2024-05-20T17:54:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.974+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/2006507961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 msgr2=0x7fbbf80d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.974+0000 7fbbfe1c7640 1 --2- 172.21.15.6:0/2006507961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf80d1ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009dc0 tx=0x7fbbf002a640 comp rx=0 tx=0).stop 2024-05-20T17:54:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.974+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/2006507961 shutdown_connections 2024-05-20T17:54:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.974+0000 7fbbfe1c7640 1 --2- 172.21.15.6:0/2006507961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf80d1ec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.974+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/2006507961 >> 172.21.15.6:0/2006507961 conn(0x7fbbf80b6670 msgr2=0x7fbbf80b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.974+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/2006507961 shutdown_connections 2024-05-20T17:54:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.974+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/2006507961 wait complete. 2024-05-20T17:54:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.975+0000 7fbbfe1c7640 1 Processor -- start 2024-05-20T17:54:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.976+0000 7fbbfe1c7640 1 -- start start 2024-05-20T17:54:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbfe1c7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf806d9a0 0x7fbbf809d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbfe1c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf80b2f10 0x7fbbf809d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbfe1c7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf814f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbfe1c7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf80b3320 con 0x7fbbf80b2f10 2024-05-20T17:54:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbfe1c7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf80d1a30 con 0x7fbbf806d9a0 2024-05-20T17:54:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbfe1c7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf815e460 con 0x7fbbf815e050 2024-05-20T17:54:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf80b2f10 0x7fbbf809d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf80b2f10 0x7fbbf809d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47760/0 (socket says 172.21.15.6:47760) 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf6ffd640 1 -- 172.21.15.6:0/3999617146 learned_addr learned my addr 172.21.15.6:0/3999617146 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf7fff640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf814f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf77fe640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf806d9a0 0x7fbbf809d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf6ffd640 1 -- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 msgr2=0x7fbbf814f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf6ffd640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf814f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf6ffd640 1 -- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf806d9a0 msgr2=0x7fbbf809d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf6ffd640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf806d9a0 0x7fbbf809d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.977+0000 7fbbf6ffd640 1 -- 172.21.15.6:0/3999617146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf809e8d0 con 0x7fbbf80b2f10 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.978+0000 7fbbf6ffd640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf80b2f10 0x7fbbf809d730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0010e0 tx=0x7fbbec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.978+0000 7fbbdffff640 1 -- 172.21.15.6:0/3999617146 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec017070 con 0x7fbbf80b2f10 2024-05-20T17:54:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.978+0000 7fbbdffff640 1 -- 172.21.15.6:0/3999617146 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec0074e0 con 0x7fbbf80b2f10 2024-05-20T17:54:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.978+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf809c430 con 0x7fbbf80b2f10 2024-05-20T17:54:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.978+0000 7fbbdffff640 1 -- 172.21.15.6:0/3999617146 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0059c0 con 0x7fbbf80b2f10 2024-05-20T17:54:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.978+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf809c9f0 con 0x7fbbf80b2f10 2024-05-20T17:54:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.979+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf809e640 con 0x7fbbf80b2f10 2024-05-20T17:54:19.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.980+0000 7fbbdffff640 1 -- 172.21.15.6:0/3999617146 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbec01a070 con 0x7fbbf80b2f10 2024-05-20T17:54:19.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.980+0000 7fbbdffff640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbe406be30 0x7fbbe406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:19.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.980+0000 7fbbdffff640 1 -- 172.21.15.6:0/3999617146 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fbbec08a090 con 0x7fbbf80b2f10 2024-05-20T17:54:19.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.980+0000 7fbbf77fe640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbe406be30 0x7fbbe406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:19.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.981+0000 7fbbf77fe640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbe406be30 0x7fbbe406e340 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8007fd0 tx=0x7fbbe8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:19.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:19.985+0000 7fbbdffff640 1 -- 172.21.15.6:0/3999617146 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbbec058520 con 0x7fbbf80b2f10 2024-05-20T17:54:20.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.245+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fbbf8075b00 con 0x7fbbf80b2f10 2024-05-20T17:54:20.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.249+0000 7fbbdffff640 1 -- 172.21.15.6:0/3999617146 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fbbec05c820 con 0x7fbbf80b2f10 2024-05-20T17:54:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbe406be30 msgr2=0x7fbbe406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbe406be30 0x7fbbe406e340 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8007fd0 tx=0x7fbbe8009040 comp rx=0 tx=0).stop 2024-05-20T17:54:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf80b2f10 msgr2=0x7fbbf809d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf80b2f10 0x7fbbf809d730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0010e0 tx=0x7fbbec00c890 comp rx=0 tx=0).stop 2024-05-20T17:54:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 shutdown_connections 2024-05-20T17:54:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbe406be30 0x7fbbe406e340 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf815e050 0x7fbbf814f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbf80b2f10 0x7fbbf809d730 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 --2- 172.21.15.6:0/3999617146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf806d9a0 0x7fbbf809d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 >> 172.21.15.6:0/3999617146 conn(0x7fbbf80b6670 msgr2=0x7fbbf80b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 shutdown_connections 2024-05-20T17:54:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.252+0000 7fbbfe1c7640 1 -- 172.21.15.6:0/3999617146 wait complete. 2024-05-20T17:54:20.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:20.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.378+0000 7fec6d073640 1 Processor -- start 2024-05-20T17:54:20.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.378+0000 7fec6d073640 1 -- start start 2024-05-20T17:54:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec6d073640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec6806da80 0x7fec681602f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec6d073640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fec6809ac00 0x7fec680d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec6d073640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec680af9d0 con 0x7fec680b1c80 2024-05-20T17:54:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec6d073640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fec68159da0 con 0x7fec6806da80 2024-05-20T17:54:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec6d073640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fec680af1c0 con 0x7fec6809ac00 2024-05-20T17:54:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec66d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec6806da80 0x7fec681602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec66d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec6806da80 0x7fec681602f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47762/0 (socket says 172.21.15.6:47762) 2024-05-20T17:54:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec66d9d640 1 -- 172.21.15.6:0/1157653025 learned_addr learned my addr 172.21.15.6:0/1157653025 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.379+0000 7fec6759e640 1 --2- 172.21.15.6:0/1157653025 >> v2:172.21.15.171:3300/0 conn(0x7fec6809ac00 0x7fec680d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.380+0000 7fec66d9d640 1 -- 172.21.15.6:0/1157653025 >> v2:172.21.15.171:3300/0 conn(0x7fec6809ac00 msgr2=0x7fec680d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.380+0000 7fec66d9d640 1 --2- 172.21.15.6:0/1157653025 >> v2:172.21.15.171:3300/0 conn(0x7fec6809ac00 0x7fec680d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.380+0000 7fec66d9d640 1 -- 172.21.15.6:0/1157653025 >> v1:172.21.15.171:6789/0 conn(0x7fec680b1c80 legacy=0x7fec6809a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.380+0000 7fec66d9d640 1 -- 172.21.15.6:0/1157653025 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec680af410 con 0x7fec6806da80 2024-05-20T17:54:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.380+0000 7fec6759e640 1 --2- 172.21.15.6:0/1157653025 >> v2:172.21.15.171:3300/0 conn(0x7fec6809ac00 0x7fec680d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.380+0000 7fec66d9d640 1 --2- 172.21.15.6:0/1157653025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681602f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fec680b1510 tx=0x7fec5802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cb66a4c2542dd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.380+0000 7fec65d9b640 1 -- 172.21.15.6:0/1157653025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58036070 con 0x7fec6806da80 2024-05-20T17:54:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec65d9b640 1 -- 172.21.15.6:0/1157653025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec58031600 con 0x7fec6806da80 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec65d9b640 1 -- 172.21.15.6:0/1157653025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec580319d0 con 0x7fec6806da80 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec6d073640 1 -- 172.21.15.6:0/1157653025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 msgr2=0x7fec681602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec6d073640 1 --2- 172.21.15.6:0/1157653025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681602f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fec680b1510 tx=0x7fec5802a6a0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec6d073640 1 -- 172.21.15.6:0/1157653025 shutdown_connections 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec6d073640 1 --2- 172.21.15.6:0/1157653025 >> v2:172.21.15.171:3300/0 conn(0x7fec6809ac00 0x7fec680d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec6d073640 1 --2- 172.21.15.6:0/1157653025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681602f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec6d073640 1 -- 172.21.15.6:0/1157653025 >> 172.21.15.6:0/1157653025 conn(0x7fec680b6670 msgr2=0x7fec680b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec6d073640 1 -- 172.21.15.6:0/1157653025 shutdown_connections 2024-05-20T17:54:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.381+0000 7fec6d073640 1 -- 172.21.15.6:0/1157653025 wait complete. 2024-05-20T17:54:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.383+0000 7fec6d073640 1 Processor -- start 2024-05-20T17:54:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.383+0000 7fec6d073640 1 -- start start 2024-05-20T17:54:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec6d073640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec6d073640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec680b1c80 0x7fec6813e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec6d073640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec681528e0 0x7fec681548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec6d073640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fec6809b260 con 0x7fec6806da80 2024-05-20T17:54:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec6d073640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fec680d17b0 con 0x7fec681528e0 2024-05-20T17:54:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec6d073640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fec680b2090 con 0x7fec680b1c80 2024-05-20T17:54:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47778/0 (socket says 172.21.15.6:47778) 2024-05-20T17:54:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 -- 172.21.15.6:0/787493741 learned_addr learned my addr 172.21.15.6:0/787493741 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec6759e640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec681528e0 0x7fec681548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec6659c640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec680b1c80 0x7fec6813e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 -- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec680b1c80 msgr2=0x7fec6813e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec680b1c80 0x7fec6813e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 -- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec681528e0 msgr2=0x7fec681548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec681528e0 0x7fec681548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 -- 172.21.15.6:0/787493741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec68153840 con 0x7fec6806da80 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.385+0000 7fec66d9d640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681f5d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fec58034040 tx=0x7fec58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.386+0000 7fec5f7fe640 1 -- 172.21.15.6:0/787493741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58036050 con 0x7fec6806da80 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.386+0000 7fec5f7fe640 1 -- 172.21.15.6:0/787493741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec58042070 con 0x7fec6806da80 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.386+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec68153b20 con 0x7fec6806da80 2024-05-20T17:54:20.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.386+0000 7fec5f7fe640 1 -- 172.21.15.6:0/787493741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58009510 con 0x7fec6806da80 2024-05-20T17:54:20.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.386+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec681540e0 con 0x7fec6806da80 2024-05-20T17:54:20.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.387+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec68075b00 con 0x7fec6806da80 2024-05-20T17:54:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.388+0000 7fec5f7fe640 1 -- 172.21.15.6:0/787493741 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec58007c50 con 0x7fec6806da80 2024-05-20T17:54:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.388+0000 7fec5f7fe640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec4806be30 0x7fec4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.388+0000 7fec5f7fe640 1 -- 172.21.15.6:0/787493741 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fec580abc00 con 0x7fec6806da80 2024-05-20T17:54:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.388+0000 7fec6659c640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec4806be30 0x7fec4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.389+0000 7fec6659c640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec4806be30 0x7fec4806e340 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fec68160800 tx=0x7fec50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:20.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.393+0000 7fec5f7fe640 1 -- 172.21.15.6:0/787493741 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fec580b2080 con 0x7fec6806da80 2024-05-20T17:54:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.579+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec681621f0 con 0x7fec6806da80 2024-05-20T17:54:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.580+0000 7fec5f7fe640 1 -- 172.21.15.6:0/787493741 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+13116 (secure 0 0 0) 0x7fec5807a6f0 con 0x7fec6806da80 2024-05-20T17:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:20.580 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:17.403863+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec4806be30 msgr2=0x7fec4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec4806be30 0x7fec4806e340 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fec68160800 tx=0x7fec50009040 comp rx=0 tx=0).stop 2024-05-20T17:54:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 msgr2=0x7fec681f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681f5d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fec58034040 tx=0x7fec58004a40 comp rx=0 tx=0).stop 2024-05-20T17:54:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 shutdown_connections 2024-05-20T17:54:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec4806be30 0x7fec4806e340 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec681528e0 0x7fec681548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec680b1c80 0x7fec6813e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 --2- 172.21.15.6:0/787493741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec6806da80 0x7fec681f5d90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 >> 172.21.15.6:0/787493741 conn(0x7fec680b6670 msgr2=0x7fec680aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 shutdown_connections 2024-05-20T17:54:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.582+0000 7fec6d073640 1 -- 172.21.15.6:0/787493741 wait complete. 2024-05-20T17:54:20.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:54:20.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:54:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.713+0000 7f41d1702640 1 Processor -- start 2024-05-20T17:54:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.713+0000 7f41d1702640 1 -- start start 2024-05-20T17:54:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41d1702640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41cc06b520 0x7f41cc15d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41d1702640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc0d1f40 0x7f41cc161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41d1702640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41cc160b90 con 0x7f41cc161350 2024-05-20T17:54:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41d1702640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f41cc15de60 con 0x7f41cc06b520 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41d1702640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc15e140 con 0x7f41cc0d1f40 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41caffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41cc06b520 0x7f41cc15d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41ca7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f41cc161350 0x7f41cc0d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53842/0 (socket says 172.21.15.6:53842) 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41caffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41cc06b520 0x7f41cc15d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47780/0 (socket says 172.21.15.6:47780) 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41ca7fc640 1 -- 172.21.15.6:0/962970720 learned_addr learned my addr 172.21.15.6:0/962970720 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.714+0000 7f41cb7fe640 1 --2- 172.21.15.6:0/962970720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc0d1f40 0x7f41cc161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.715+0000 7f41caffd640 1 -- 172.21.15.6:0/962970720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc0d1f40 msgr2=0x7f41cc161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.715+0000 7f41caffd640 1 --2- 172.21.15.6:0/962970720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc0d1f40 0x7f41cc161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.715+0000 7f41caffd640 1 -- 172.21.15.6:0/962970720 >> v1:172.21.15.6:6789/0 conn(0x7f41cc161350 legacy=0x7f41cc0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.715+0000 7f41caffd640 1 -- 172.21.15.6:0/962970720 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc15e420 con 0x7f41cc06b520 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.715+0000 7f41c9ffb640 1 -- 172.21.15.6:0/962970720 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851575630 0 0) 0x7f41cc160b90 con 0x7f41cc161350 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.715+0000 7f41cb7fe640 1 --2- 172.21.15.6:0/962970720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc0d1f40 0x7f41cc161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.715+0000 7f41caffd640 1 --2- 172.21.15.6:0/962970720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc06b520 0x7f41cc15d540 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009d90 tx=0x7f41bc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d9cafe11d8709c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:20.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.715+0000 7f41c9ffb640 1 -- 172.21.15.6:0/962970720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007740 con 0x7f41cc06b520 2024-05-20T17:54:20.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41c9ffb640 1 -- 172.21.15.6:0/962970720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc0078e0 con 0x7f41cc06b520 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41c9ffb640 1 -- 172.21.15.6:0/962970720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007cb0 con 0x7f41cc06b520 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41d1702640 1 -- 172.21.15.6:0/962970720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc06b520 msgr2=0x7f41cc15d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41d1702640 1 --2- 172.21.15.6:0/962970720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc06b520 0x7f41cc15d540 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009d90 tx=0x7f41bc02a660 comp rx=0 tx=0).stop 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41d1702640 1 -- 172.21.15.6:0/962970720 shutdown_connections 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41d1702640 1 --2- 172.21.15.6:0/962970720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc0d1f40 0x7f41cc161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41d1702640 1 --2- 172.21.15.6:0/962970720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc06b520 0x7f41cc15d540 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41d1702640 1 -- 172.21.15.6:0/962970720 >> 172.21.15.6:0/962970720 conn(0x7f41cc0b6670 msgr2=0x7f41cc0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41d1702640 1 -- 172.21.15.6:0/962970720 shutdown_connections 2024-05-20T17:54:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.716+0000 7f41d1702640 1 -- 172.21.15.6:0/962970720 wait complete. 2024-05-20T17:54:20.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.718+0000 7f41d1702640 1 Processor -- start 2024-05-20T17:54:20.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.718+0000 7f41d1702640 1 -- start start 2024-05-20T17:54:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.719+0000 7f41d1702640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc06b520 0x7f41cc158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.719+0000 7f41d1702640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc0d1f40 0x7f41cc09f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.719+0000 7f41d1702640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41cc161350 0x7f41cc0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.719+0000 7f41d1702640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc15da80 con 0x7f41cc0d1f40 2024-05-20T17:54:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.719+0000 7f41d1702640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc143740 con 0x7f41cc161350 2024-05-20T17:54:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.719+0000 7f41d1702640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc15dc00 con 0x7f41cc06b520 2024-05-20T17:54:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc0d1f40 0x7f41cc09f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc0d1f40 0x7f41cc09f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47790/0 (socket says 172.21.15.6:47790) 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 -- 172.21.15.6:0/2946254193 learned_addr learned my addr 172.21.15.6:0/2946254193 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41caffd640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc06b520 0x7f41cc158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41cb7fe640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41cc161350 0x7f41cc0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 -- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc06b520 msgr2=0x7f41cc158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc06b520 0x7f41cc158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 -- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41cc161350 msgr2=0x7f41cc0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41cc161350 0x7f41cc0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 -- 172.21.15.6:0/2946254193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc09d8b0 con 0x7f41cc0d1f40 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41ca7fc640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc0d1f40 0x7f41cc09f2e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c460 tx=0x7f41b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41c37fe640 1 -- 172.21.15.6:0/2946254193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4018070 con 0x7f41cc0d1f40 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41c37fe640 1 -- 172.21.15.6:0/2946254193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b4007500 con 0x7f41cc0d1f40 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41cc0b1350 con 0x7f41cc0d1f40 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41c37fe640 1 -- 172.21.15.6:0/2946254193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4004a20 con 0x7f41cc0d1f40 2024-05-20T17:54:20.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.720+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41cc09d350 con 0x7f41cc0d1f40 2024-05-20T17:54:20.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.721+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41cc075b00 con 0x7f41cc0d1f40 2024-05-20T17:54:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.722+0000 7f41c37fe640 1 -- 172.21.15.6:0/2946254193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41b401b070 con 0x7f41cc0d1f40 2024-05-20T17:54:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.723+0000 7f41c37fe640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f41ac06be30 0x7f41ac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.723+0000 7f41c37fe640 1 -- 172.21.15.6:0/2946254193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f41b408a0e0 con 0x7f41cc0d1f40 2024-05-20T17:54:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.723+0000 7f41caffd640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f41ac06be30 0x7f41ac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:20.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.723+0000 7f41caffd640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f41ac06be30 0x7f41ac06e340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41bc034000 tx=0x7f41bc033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.727+0000 7f41c37fe640 1 -- 172.21.15.6:0/2946254193 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f41b4058b20 con 0x7f41cc0d1f40 2024-05-20T17:54:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.910+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f41cc09d640 con 0x7f41cc0d1f40 2024-05-20T17:54:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.911+0000 7f41c37fe640 1 -- 172.21.15.6:0/2946254193 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f41b4058420 con 0x7f41cc0d1f40 2024-05-20T17:54:20.910 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:54:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f41ac06be30 msgr2=0x7f41ac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f41ac06be30 0x7f41ac06e340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41bc034000 tx=0x7f41bc033040 comp rx=0 tx=0).stop 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc0d1f40 msgr2=0x7f41cc09f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc0d1f40 0x7f41cc09f2e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c460 tx=0x7f41b400c920 comp rx=0 tx=0).stop 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 shutdown_connections 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f41ac06be30 0x7f41ac06e340 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41cc161350 0x7f41cc0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41cc0d1f40 0x7f41cc09f2e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 --2- 172.21.15.6:0/2946254193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41cc06b520 0x7f41cc158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 >> 172.21.15.6:0/2946254193 conn(0x7f41cc0b6670 msgr2=0x7f41cc140dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 shutdown_connections 2024-05-20T17:54:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:20.913+0000 7f41d1702640 1 -- 172.21.15.6:0/2946254193 wait complete. 2024-05-20T17:54:20.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T17:54:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.040+0000 7f106a206640 1 Processor -- start 2024-05-20T17:54:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.040+0000 7f106a206640 1 -- start start 2024-05-20T17:54:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f106a206640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f106415d530 0x7f106415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f106a206640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10640b1700 0x7f10640b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f106a206640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1064070850 0x7f1064070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f106a206640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f10640ce190 con 0x7f10640b1700 2024-05-20T17:54:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f106a206640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f10640cd580 con 0x7f106415d530 2024-05-20T17:54:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f106a206640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f10640cd860 con 0x7f1064070850 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f1062ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10640b1700 0x7f10640b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f1062ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10640b1700 0x7f10640b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47792/0 (socket says 172.21.15.6:47792) 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.041+0000 7f1062ffd640 1 -- 172.21.15.6:0/1178463062 learned_addr learned my addr 172.21.15.6:0/1178463062 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.042+0000 7f10637fe640 1 --2- 172.21.15.6:0/1178463062 >> v2:172.21.15.171:3300/0 conn(0x7f106415d530 0x7f106415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.042+0000 7f1063fff640 1 --2- 172.21.15.6:0/1178463062 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1064070850 0x7f1064070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.042+0000 7f1062ffd640 1 -- 172.21.15.6:0/1178463062 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1064070850 msgr2=0x7f1064070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.042+0000 7f1062ffd640 1 --2- 172.21.15.6:0/1178463062 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1064070850 0x7f1064070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.042+0000 7f1062ffd640 1 -- 172.21.15.6:0/1178463062 >> v2:172.21.15.171:3300/0 conn(0x7f106415d530 msgr2=0x7f106415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.042+0000 7f1062ffd640 1 --2- 172.21.15.6:0/1178463062 >> v2:172.21.15.171:3300/0 conn(0x7f106415d530 0x7f106415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.042+0000 7f1062ffd640 1 -- 172.21.15.6:0/1178463062 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10640cdb40 con 0x7f10640b1700 2024-05-20T17:54:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.042+0000 7f1062ffd640 1 --2- 172.21.15.6:0/1178463062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10640b1700 0x7f10640b1b10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f106404f790 tx=0x7f105802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333fd77ffbbb82de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f10627fc640 1 -- 172.21.15.6:0/1178463062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058037070 con 0x7f10640b1700 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f10627fc640 1 -- 172.21.15.6:0/1178463062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1058032440 con 0x7f10640b1700 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f10627fc640 1 -- 172.21.15.6:0/1178463062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058032810 con 0x7f10640b1700 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f106a206640 1 -- 172.21.15.6:0/1178463062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10640b1700 msgr2=0x7f10640b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f106a206640 1 --2- 172.21.15.6:0/1178463062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10640b1700 0x7f10640b1b10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f106404f790 tx=0x7f105802a1e0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f106a206640 1 -- 172.21.15.6:0/1178463062 shutdown_connections 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f106a206640 1 --2- 172.21.15.6:0/1178463062 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1064070850 0x7f1064070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f106a206640 1 --2- 172.21.15.6:0/1178463062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10640b1700 0x7f10640b1b10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f106a206640 1 --2- 172.21.15.6:0/1178463062 >> v2:172.21.15.171:3300/0 conn(0x7f106415d530 0x7f106415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f106a206640 1 -- 172.21.15.6:0/1178463062 >> 172.21.15.6:0/1178463062 conn(0x7f10640d29d0 msgr2=0x7f10640d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.043+0000 7f106a206640 1 -- 172.21.15.6:0/1178463062 shutdown_connections 2024-05-20T17:54:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.044+0000 7f106a206640 1 -- 172.21.15.6:0/1178463062 wait complete. 2024-05-20T17:54:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.045+0000 7f106a206640 1 Processor -- start 2024-05-20T17:54:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.045+0000 7f106a206640 1 -- start start 2024-05-20T17:54:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f106a206640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1064070850 0x7f1064149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f106a206640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10640b1700 0x7f1064147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f106a206640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f106415d530 0x7f1064148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f106a206640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f10640b2050 con 0x7f106415d530 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f106a206640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f10640cd230 con 0x7f1064070850 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f106a206640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f10640711a0 con 0x7f10640b1700 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f106415d530 0x7f1064148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f106415d530 0x7f1064148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47794/0 (socket says 172.21.15.6:47794) 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 -- 172.21.15.6:0/1936708346 learned_addr learned my addr 172.21.15.6:0/1936708346 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1062ffd640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10640b1700 0x7f1064147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f10637fe640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1064070850 0x7f1064149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 -- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10640b1700 msgr2=0x7f1064147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10640b1700 0x7f1064147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 -- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1064070850 msgr2=0x7f1064149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1064070850 0x7f1064149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 -- 172.21.15.6:0/1936708346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1064148b70 con 0x7f106415d530 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.047+0000 7f1063fff640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f106415d530 0x7f1064148190 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f105c007cf0 tx=0x7f105c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.048+0000 7f104bfff640 1 -- 172.21.15.6:0/1936708346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c014420 con 0x7f106415d530 2024-05-20T17:54:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.048+0000 7f104bfff640 1 -- 172.21.15.6:0/1936708346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f105c019070 con 0x7f106415d530 2024-05-20T17:54:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.048+0000 7f104bfff640 1 -- 172.21.15.6:0/1936708346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c014800 con 0x7f106415d530 2024-05-20T17:54:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.048+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1064148e50 con 0x7f106415d530 2024-05-20T17:54:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.048+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1064149410 con 0x7f106415d530 2024-05-20T17:54:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.049+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1064075b00 con 0x7f106415d530 2024-05-20T17:54:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.049+0000 7f104bfff640 1 -- 172.21.15.6:0/1936708346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f105c0149a0 con 0x7f106415d530 2024-05-20T17:54:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.050+0000 7f104bfff640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f105006be30 0x7f105006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.050+0000 7f104bfff640 1 -- 172.21.15.6:0/1936708346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f105c08b4a0 con 0x7f106415d530 2024-05-20T17:54:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.050+0000 7f10637fe640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f105006be30 0x7f105006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.051+0000 7f10637fe640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f105006be30 0x7f105006e340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1054006fd0 tx=0x7f1054008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.054+0000 7f104bfff640 1 -- 172.21.15.6:0/1936708346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f105c059f90 con 0x7f106415d530 2024-05-20T17:54:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.239+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1064148900 con 0x7f106415d530 2024-05-20T17:54:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.240+0000 7f104bfff640 1 -- 172.21.15.6:0/1936708346 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7f105c059890 con 0x7f106415d530 2024-05-20T17:54:21.239 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:21.239 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T17:54:21.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:54:21.240 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T17:54:21.240 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T17:54:21.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:54:21.240 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T17:54:21.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f105006be30 msgr2=0x7f105006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f105006be30 0x7f105006e340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1054006fd0 tx=0x7f1054008040 comp rx=0 tx=0).stop 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f106415d530 msgr2=0x7f1064148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f106415d530 0x7f1064148190 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f105c007cf0 tx=0x7f105c00e4b0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 shutdown_connections 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f105006be30 0x7f105006e340 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f106415d530 0x7f1064148190 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10640b1700 0x7f1064147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 --2- 172.21.15.6:0/1936708346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1064070850 0x7f1064149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 >> 172.21.15.6:0/1936708346 conn(0x7f10640d29d0 msgr2=0x7f10640b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 shutdown_connections 2024-05-20T17:54:21.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.242+0000 7f106a206640 1 -- 172.21.15.6:0/1936708346 wait complete. 2024-05-20T17:54:21.253 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T17:54:21.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T17:54:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.373+0000 7fcda552a640 1 Processor -- start 2024-05-20T17:54:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.373+0000 7fcda552a640 1 -- start start 2024-05-20T17:54:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.374+0000 7fcda552a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.374+0000 7fcda552a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcda00d1830 0x7fcda00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.374+0000 7fcda552a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda00d0160 con 0x7fcda00cea20 2024-05-20T17:54:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.374+0000 7fcda552a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcda00cda00 con 0x7fcda00d1830 2024-05-20T17:54:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.374+0000 7fcda552a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcda00cdce0 con 0x7fcda00d3510 2024-05-20T17:54:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd9effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd97fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcda00d1830 0x7fcda00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd9effd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda00b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:39586/0 (socket says 172.21.15.6:39586) 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd9f7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fcda00cea20 0x7fcda00b21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:44872/0 (socket says 172.21.15.6:44872) 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd97fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcda00d1830 0x7fcda00ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:45966/0 (socket says 172.21.15.6:45966) 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd9effd640 1 -- 172.21.15.6:0/2245573357 learned_addr learned my addr 172.21.15.6:0/2245573357 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd97fff640 1 -- 172.21.15.6:0/2245573357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 msgr2=0x7fcda00b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd97fff640 1 --2- 172.21.15.6:0/2245573357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda00b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd97fff640 1 -- 172.21.15.6:0/2245573357 >> v1:172.21.15.171:6789/0 conn(0x7fcda00cea20 legacy=0x7fcda00b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd97fff640 1 -- 172.21.15.6:0/2245573357 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda00cdfc0 con 0x7fcda00d1830 2024-05-20T17:54:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.375+0000 7fcd9effd640 1 --2- 172.21.15.6:0/2245573357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda00b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:21.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.376+0000 7fcd97fff640 1 --2- 172.21.15.6:0/2245573357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 0x7fcda00ce4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd880097a0 tx=0x7fcd8802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1df2af3fd81005b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:21.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.376+0000 7fcd9e7fc640 1 -- 172.21.15.6:0/2245573357 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88037070 con 0x7fcda00d1830 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.376+0000 7fcd9e7fc640 1 -- 172.21.15.6:0/2245573357 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8802ae50 con 0x7fcda00d1830 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.376+0000 7fcd9e7fc640 1 -- 172.21.15.6:0/2245573357 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88032660 con 0x7fcda00d1830 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.377+0000 7fcda552a640 1 -- 172.21.15.6:0/2245573357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 msgr2=0x7fcda00ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.377+0000 7fcda552a640 1 --2- 172.21.15.6:0/2245573357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 0x7fcda00ce4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd880097a0 tx=0x7fcd8802a100 comp rx=0 tx=0).stop 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.377+0000 7fcda552a640 1 -- 172.21.15.6:0/2245573357 shutdown_connections 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.377+0000 7fcda552a640 1 --2- 172.21.15.6:0/2245573357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 0x7fcda00ce4e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.377+0000 7fcda552a640 1 --2- 172.21.15.6:0/2245573357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda00b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.377+0000 7fcda552a640 1 -- 172.21.15.6:0/2245573357 >> 172.21.15.6:0/2245573357 conn(0x7fcda00d29f0 msgr2=0x7fcda00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.377+0000 7fcda552a640 1 -- 172.21.15.6:0/2245573357 shutdown_connections 2024-05-20T17:54:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.377+0000 7fcda552a640 1 -- 172.21.15.6:0/2245573357 wait complete. 2024-05-20T17:54:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.379+0000 7fcda552a640 1 Processor -- start 2024-05-20T17:54:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.379+0000 7fcda552a640 1 -- start start 2024-05-20T17:54:21.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcda552a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00cea20 0x7fcda015f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcda552a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 0x7fcda015e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcda552a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda0150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcda552a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcda00cff00 con 0x7fcda00cea20 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcda552a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcda00cfd80 con 0x7fcda00d1830 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcda552a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcda00b1e20 con 0x7fcda00d3510 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcd9effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00cea20 0x7fcda015f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcd9effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00cea20 0x7fcda015f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47808/0 (socket says 172.21.15.6:47808) 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcd9effd640 1 -- 172.21.15.6:0/2899302349 learned_addr learned my addr 172.21.15.6:0/2899302349 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcd97fff640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 0x7fcda015e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.380+0000 7fcd9f7fe640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda0150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd9effd640 1 -- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 msgr2=0x7fcda0150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd9effd640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda0150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd9effd640 1 -- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 msgr2=0x7fcda015e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:21.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd9effd640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 0x7fcda015e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:21.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd9effd640 1 -- 172.21.15.6:0/2899302349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda015fe80 con 0x7fcda00cea20 2024-05-20T17:54:21.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd9effd640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00cea20 0x7fcda015f350 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000e9b0 tx=0x7fcd9000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:21.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd977fe640 1 -- 172.21.15.6:0/2899302349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd90017070 con 0x7fcda00cea20 2024-05-20T17:54:21.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd977fe640 1 -- 172.21.15.6:0/2899302349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9000c9a0 con 0x7fcda00cea20 2024-05-20T17:54:21.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda00c6400 con 0x7fcda00cea20 2024-05-20T17:54:21.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcd977fe640 1 -- 172.21.15.6:0/2899302349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000cd50 con 0x7fcda00cea20 2024-05-20T17:54:21.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.381+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda015fba0 con 0x7fcda00cea20 2024-05-20T17:54:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.382+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda00690b0 con 0x7fcda00cea20 2024-05-20T17:54:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.383+0000 7fcd977fe640 1 -- 172.21.15.6:0/2899302349 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd9001a070 con 0x7fcda00cea20 2024-05-20T17:54:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.383+0000 7fcd977fe640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd8006be60 0x7fcd8006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.383+0000 7fcd977fe640 1 -- 172.21.15.6:0/2899302349 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fcd9008a9d0 con 0x7fcda00cea20 2024-05-20T17:54:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.383+0000 7fcd97fff640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd8006be60 0x7fcd8006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.384+0000 7fcd97fff640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd8006be60 0x7fcd8006e370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcd88034000 tx=0x7fcd8802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.388+0000 7fcd977fe640 1 -- 172.21.15.6:0/2899302349 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcd90058f80 con 0x7fcda00cea20 2024-05-20T17:54:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:21.572+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcda006bf30 con 0x7fcda00cea20 2024-05-20T17:54:22.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.413+0000 7fcd977fe640 1 -- 172.21.15.6:0/2899302349 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7fcd9005d280 con 0x7fcda00cea20 2024-05-20T17:54:22.413 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T17:54:22.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd8006be60 msgr2=0x7fcd8006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd8006be60 0x7fcd8006e370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcd88034000 tx=0x7fcd8802e000 comp rx=0 tx=0).stop 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00cea20 msgr2=0x7fcda015f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00cea20 0x7fcda015f350 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000e9b0 tx=0x7fcd9000ee70 comp rx=0 tx=0).stop 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 shutdown_connections 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd8006be60 0x7fcd8006e370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcda00d3510 0x7fcda0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcda00d1830 0x7fcda015e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 --2- 172.21.15.6:0/2899302349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00cea20 0x7fcda015f350 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 >> 172.21.15.6:0/2899302349 conn(0x7fcda00d29f0 msgr2=0x7fcda015cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 shutdown_connections 2024-05-20T17:54:22.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.416+0000 7fcda552a640 1 -- 172.21.15.6:0/2899302349 wait complete. 2024-05-20T17:54:22.434 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T17:54:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.564+0000 7f1348037640 1 Processor -- start 2024-05-20T17:54:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.564+0000 7f1348037640 1 -- start start 2024-05-20T17:54:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.565+0000 7f1348037640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f13400d0ac0 0x7f134009be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.565+0000 7f1348037640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f134009b280 0x7f13400b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.565+0000 7f1348037640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13400ce950 con 0x7f13400b3ff0 2024-05-20T17:54:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.565+0000 7f1348037640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f13400ce720 con 0x7f134009b280 2024-05-20T17:54:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.565+0000 7f1348037640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f13400d0fc0 con 0x7f13400d0ac0 2024-05-20T17:54:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.565+0000 7f13465d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f134009b280 0x7f13400b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.565+0000 7f13465d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f134009b280 0x7f13400b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47824/0 (socket says 172.21.15.6:47824) 2024-05-20T17:54:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.565+0000 7f13465d4640 1 -- 172.21.15.6:0/1379671176 learned_addr learned my addr 172.21.15.6:0/1379671176 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.566+0000 7f1345dd3640 1 --2- 172.21.15.6:0/1379671176 >> v2:172.21.15.171:3300/0 conn(0x7f13400d0ac0 0x7f134009be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.566+0000 7f13465d4640 1 -- 172.21.15.6:0/1379671176 >> v2:172.21.15.171:3300/0 conn(0x7f13400d0ac0 msgr2=0x7f134009be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.566+0000 7f13465d4640 1 --2- 172.21.15.6:0/1379671176 >> v2:172.21.15.171:3300/0 conn(0x7f13400d0ac0 0x7f134009be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.566+0000 7f13465d4640 1 -- 172.21.15.6:0/1379671176 >> v1:172.21.15.171:6789/0 conn(0x7f13400b3ff0 legacy=0x7f134009ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.566+0000 7f13465d4640 1 -- 172.21.15.6:0/1379671176 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13400cec30 con 0x7f134009b280 2024-05-20T17:54:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.567+0000 7f13465d4640 1 --2- 172.21.15.6:0/1379671176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134009b280 0x7f13400b6010 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1340073b00 tx=0x7f133802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab618b16f461b6a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.567+0000 7f1344dd1640 1 -- 172.21.15.6:0/1379671176 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338036070 con 0x7f134009b280 2024-05-20T17:54:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.567+0000 7f1344dd1640 1 -- 172.21.15.6:0/1379671176 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1338031600 con 0x7f134009b280 2024-05-20T17:54:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.567+0000 7f1344dd1640 1 -- 172.21.15.6:0/1379671176 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13380319d0 con 0x7f134009b280 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.567+0000 7f1348037640 1 -- 172.21.15.6:0/1379671176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134009b280 msgr2=0x7f13400b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.567+0000 7f1348037640 1 --2- 172.21.15.6:0/1379671176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134009b280 0x7f13400b6010 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1340073b00 tx=0x7f133802a730 comp rx=0 tx=0).stop 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.568+0000 7f1348037640 1 -- 172.21.15.6:0/1379671176 shutdown_connections 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.568+0000 7f1348037640 1 --2- 172.21.15.6:0/1379671176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134009b280 0x7f13400b6010 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.568+0000 7f1348037640 1 --2- 172.21.15.6:0/1379671176 >> v2:172.21.15.171:3300/0 conn(0x7f13400d0ac0 0x7f134009be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.568+0000 7f1348037640 1 -- 172.21.15.6:0/1379671176 >> 172.21.15.6:0/1379671176 conn(0x7f13400b44b0 msgr2=0x7f13400b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.568+0000 7f1348037640 1 -- 172.21.15.6:0/1379671176 shutdown_connections 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.568+0000 7f1348037640 1 -- 172.21.15.6:0/1379671176 wait complete. 2024-05-20T17:54:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.569+0000 7f1348037640 1 Processor -- start 2024-05-20T17:54:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.569+0000 7f1348037640 1 -- start start 2024-05-20T17:54:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f1348037640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13400b3ff0 0x7f13400ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f1348037640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13400d0ac0 0x7f134006d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f1348037640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1340154770 0x7f134015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f1348037640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f13400b8230 con 0x7f13400d0ac0 2024-05-20T17:54:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f1348037640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f13400b5b80 con 0x7f1340154770 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f1348037640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f13400c9e80 con 0x7f13400b3ff0 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13400d0ac0 0x7f134006d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13400d0ac0 0x7f134006d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47830/0 (socket says 172.21.15.6:47830) 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 -- 172.21.15.6:0/328611922 learned_addr learned my addr 172.21.15.6:0/328611922 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13465d4640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1340154770 0x7f134015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f1345dd3640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13400b3ff0 0x7f13400ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 -- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13400b3ff0 msgr2=0x7f13400ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13400b3ff0 0x7f13400ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 -- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1340154770 msgr2=0x7f134015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1340154770 0x7f134015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 -- 172.21.15.6:0/328611922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134015e1e0 con 0x7f13400d0ac0 2024-05-20T17:54:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f1345dd3640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13400b3ff0 0x7f13400ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.571+0000 7f13455d2640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13400d0ac0 0x7f134006d9f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f133000c3c0 tx=0x7f133000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.572+0000 7f13367fc640 1 -- 172.21.15.6:0/328611922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13300052d0 con 0x7f13400d0ac0 2024-05-20T17:54:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.572+0000 7f13367fc640 1 -- 172.21.15.6:0/328611922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1330005490 con 0x7f13400d0ac0 2024-05-20T17:54:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.572+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134015e4c0 con 0x7f13400d0ac0 2024-05-20T17:54:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.572+0000 7f13367fc640 1 -- 172.21.15.6:0/328611922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330007260 con 0x7f13400d0ac0 2024-05-20T17:54:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.572+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13400caf50 con 0x7f13400d0ac0 2024-05-20T17:54:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.573+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13400c95b0 con 0x7f13400d0ac0 2024-05-20T17:54:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.573+0000 7f13367fc640 1 -- 172.21.15.6:0/328611922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1330007400 con 0x7f13400d0ac0 2024-05-20T17:54:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.574+0000 7f13367fc640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f132406be30 0x7f132406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.574+0000 7f13367fc640 1 -- 172.21.15.6:0/328611922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7f133008a220 con 0x7f13400d0ac0 2024-05-20T17:54:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.574+0000 7f1345dd3640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f132406be30 0x7f132406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.574+0000 7f1345dd3640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f132406be30 0x7f132406e340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f13400c64c0 tx=0x7f133c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.579+0000 7f13367fc640 1 -- 172.21.15.6:0/328611922 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f13300585d0 con 0x7f13400d0ac0 2024-05-20T17:54:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:22.762+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f13400690b0 con 0x7f13400d0ac0 2024-05-20T17:54:23.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.416+0000 7f13367fc640 1 -- 172.21.15.6:0/328611922 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7f133005c8d0 con 0x7f13400d0ac0 2024-05-20T17:54:23.415 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f132406be30 msgr2=0x7f132406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f132406be30 0x7f132406e340 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f13400c64c0 tx=0x7f133c008040 comp rx=0 tx=0).stop 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13400d0ac0 msgr2=0x7f134006d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13400d0ac0 0x7f134006d9f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f133000c3c0 tx=0x7f133000c880 comp rx=0 tx=0).stop 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 shutdown_connections 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f132406be30 0x7f132406e340 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1340154770 0x7f134015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13400d0ac0 0x7f134006d9f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 --2- 172.21.15.6:0/328611922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13400b3ff0 0x7f13400ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.419+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 >> 172.21.15.6:0/328611922 conn(0x7f13400b44b0 msgr2=0x7f1340071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:23.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.420+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 shutdown_connections 2024-05-20T17:54:23.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.420+0000 7f1348037640 1 -- 172.21.15.6:0/328611922 wait complete. 2024-05-20T17:54:23.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T17:54:23.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.567+0000 7f6ffe7aa640 1 Processor -- start 2024-05-20T17:54:23.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.567+0000 7f6ffe7aa640 1 -- start start 2024-05-20T17:54:23.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ffe7aa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6ff80d4400 0x7f6ff815f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ffe7aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff80d2780 0x7f6ff80d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ffe7aa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff808d2a0 con 0x7f6ff806cf00 2024-05-20T17:54:23.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ffe7aa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff80d3f70 con 0x7f6ff80d4400 2024-05-20T17:54:23.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ffe7aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff80d30d0 con 0x7f6ff80d2780 2024-05-20T17:54:23.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ff806cf00 0x7f6ff806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53848/0 (socket says 172.21.15.6:53848) 2024-05-20T17:54:23.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff77fe640 1 -- 172.21.15.6:0/4040986189 learned_addr learned my addr 172.21.15.6:0/4040986189 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ffcd47640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff80d2780 0x7f6ff80d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff7fff640 1 --2- 172.21.15.6:0/4040986189 >> v2:172.21.15.171:3300/0 conn(0x7f6ff80d4400 0x7f6ff815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973811593 0 0) 0x7f6fec001110 con 0x7f6ff806cf00 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe0003520 con 0x7f6ff806cf00 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2432323487 0 0) 0x7f6fe0003520 con 0x7f6ff806cf00 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff80d2780 msgr2=0x7f6ff80d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff80d2780 0x7f6ff80d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 >> v2:172.21.15.171:3300/0 conn(0x7f6ff80d4400 msgr2=0x7f6ff815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 --2- 172.21.15.6:0/4040986189 >> v2:172.21.15.171:3300/0 conn(0x7f6ff80d4400 0x7f6ff815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff80d4810 con 0x7f6ff806cf00 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f6fec001840 con 0x7f6ff806cf00 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 >> v1:172.21.15.6:6789/0 conn(0x7f6ff806cf00 legacy=0x7f6ff806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff80d2780 0x7f6fe00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0003f30 0x7f6fe0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0004d40 0x7f6fe0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80d3f70 con 0x7f6fe0003f30 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80d30d0 con 0x7f6fe0004d40 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.569+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe000baa0 con 0x7f6ff80d2780 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ff77fe640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0003f30 0x7f6fe0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ff7fff640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff80d2780 0x7f6fe00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ffcd47640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0004d40 0x7f6fe0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ff77fe640 1 -- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff80d2780 msgr2=0x7f6fe00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ff77fe640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff80d2780 0x7f6fe00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ff77fe640 1 -- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0004d40 msgr2=0x7f6fe0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ff77fe640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0004d40 0x7f6fe0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ff77fe640 1 -- 172.21.15.6:0/4040986189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe0003520 con 0x7f6fe0003f30 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.570+0000 7f6ffcd47640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0004d40 0x7f6fe0005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.571+0000 7f6ff77fe640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0003f30 0x7f6fe0004800 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c3b0 tx=0x7f6fe0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147285e3839e74e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.571+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00c0e0 con 0x7f6fe0003f30 2024-05-20T17:54:23.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.571+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec034070 con 0x7f6fe0003f30 2024-05-20T17:54:23.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.571+0000 7f6ff6ffd640 1 -- 172.21.15.6:0/4040986189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec005d70 con 0x7f6fe0003f30 2024-05-20T17:54:23.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.571+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/4040986189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0003f30 msgr2=0x7f6fe0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:23.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.571+0000 7f6ffe7aa640 1 --2- 172.21.15.6:0/4040986189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe0003f30 0x7f6fe0004800 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c3b0 tx=0x7f6fe0005830 comp rx=0 tx=0).stop 2024-05-20T17:54:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.571+0000 7f6ffcd47640 1 -- 172.21.15.6:0/4040986189 reap_dead start 2024-05-20T17:54:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.572+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/4040986189 shutdown_connections 2024-05-20T17:54:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.572+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/4040986189 >> 172.21.15.6:0/4040986189 conn(0x7f6ff80d4bb0 msgr2=0x7f6ff80d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.572+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/4040986189 shutdown_connections 2024-05-20T17:54:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.572+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/4040986189 wait complete. 2024-05-20T17:54:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.573+0000 7f6ffe7aa640 1 Processor -- start 2024-05-20T17:54:23.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.574+0000 7f6ffe7aa640 1 -- start start 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffe7aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0003f30 0x7f6ff81f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffe7aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff81606b0 0x7f6ff815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffe7aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff815d7e0 0x7f6ff814aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffe7aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80d3920 con 0x7f6ff815d7e0 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffe7aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80d3640 con 0x7f6fe0003f30 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffe7aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff80d3c00 con 0x7f6ff81606b0 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffcd47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff815d7e0 0x7f6ff814aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ff7fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0003f30 0x7f6ff81f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffcd47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff815d7e0 0x7f6ff814aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47852/0 (socket says 172.21.15.6:47852) 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffcd47640 1 -- 172.21.15.6:0/1739427663 learned_addr learned my addr 172.21.15.6:0/1739427663 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ff77fe640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff81606b0 0x7f6ff815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffcd47640 1 -- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff81606b0 msgr2=0x7f6ff815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffcd47640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff81606b0 0x7f6ff815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffcd47640 1 -- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0003f30 msgr2=0x7f6ff81f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffcd47640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0003f30 0x7f6ff81f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ffcd47640 1 -- 172.21.15.6:0/1739427663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff81f67e0 con 0x7f6ff815d7e0 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.575+0000 7f6ff7fff640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0003f30 0x7f6ff81f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.576+0000 7f6ffcd47640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff815d7e0 0x7f6ff814aa30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6ff806e790 tx=0x7f6ff0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.576+0000 7f6ff4ff9640 1 -- 172.21.15.6:0/1739427663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0007ea0 con 0x7f6ff815d7e0 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.576+0000 7f6ff4ff9640 1 -- 172.21.15.6:0/1739427663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff0010d80 con 0x7f6ff815d7e0 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.576+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff815c4e0 con 0x7f6ff815d7e0 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.576+0000 7f6ff4ff9640 1 -- 172.21.15.6:0/1739427663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0003bd0 con 0x7f6ff815d7e0 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.576+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff815caa0 con 0x7f6ff815d7e0 2024-05-20T17:54:23.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.577+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff80735a0 con 0x7f6ff815d7e0 2024-05-20T17:54:23.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.578+0000 7f6ff4ff9640 1 -- 172.21.15.6:0/1739427663 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ff001e030 con 0x7f6ff815d7e0 2024-05-20T17:54:23.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.578+0000 7f6ff4ff9640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe406be30 0x7f6fe406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:23.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.578+0000 7f6ff4ff9640 1 -- 172.21.15.6:0/1739427663 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7f6ff008b600 con 0x7f6ff815d7e0 2024-05-20T17:54:23.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.578+0000 7f6ff7fff640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe406be30 0x7f6fe406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:23.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.579+0000 7f6ff7fff640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe406be30 0x7f6fe406e340 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8014400 tx=0x7f6fe8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:23.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.583+0000 7f6ff4ff9640 1 -- 172.21.15.6:0/1739427663 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6ff80735a0 con 0x7f6ff815d7e0 2024-05-20T17:54:23.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:23.808+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6ff8075b00 con 0x7f6ff815d7e0 2024-05-20T17:54:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.435+0000 7f6ff4ff9640 1 -- 172.21.15.6:0/1739427663 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f6ff0025020 con 0x7f6ff815d7e0 2024-05-20T17:54:24.434 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 5 and data pool 6 2024-05-20T17:54:24.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe406be30 msgr2=0x7f6fe406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe406be30 0x7f6fe406e340 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8014400 tx=0x7f6fe8009190 comp rx=0 tx=0).stop 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff815d7e0 msgr2=0x7f6ff814aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff815d7e0 0x7f6ff814aa30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6ff806e790 tx=0x7f6ff0010590 comp rx=0 tx=0).stop 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 shutdown_connections 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6fe406be30 0x7f6fe406e340 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ff815d7e0 0x7f6ff814aa30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ff81606b0 0x7f6ff815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 --2- 172.21.15.6:0/1739427663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6fe0003f30 0x7f6ff81f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 >> 172.21.15.6:0/1739427663 conn(0x7f6ff80d4bb0 msgr2=0x7f6ff80cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.438+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 shutdown_connections 2024-05-20T17:54:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.440+0000 7f6ffe7aa640 1 -- 172.21.15.6:0/1739427663 wait complete. 2024-05-20T17:54:24.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.595+0000 7fd8948a2640 1 Processor -- start 2024-05-20T17:54:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.595+0000 7fd8948a2640 1 -- start start 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd8948a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd890163a10 0x7fd8900d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd8948a2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd8900b4010 0x7fd8900cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd8948a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8900d14b0 0x7fd8900d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd8948a2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd8900d3ca0 con 0x7fd8900d14b0 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd8948a2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd8900d0370 con 0x7fd8900b4010 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd8948a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd8900d0650 con 0x7fd890163a10 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8900d14b0 0x7fd8900d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8900d14b0 0x7fd8900d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47866/0 (socket says 172.21.15.6:47866) 2024-05-20T17:54:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88ed9d640 1 -- 172.21.15.6:0/2179855610 learned_addr learned my addr 172.21.15.6:0/2179855610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88dd9b640 1 --2- 172.21.15.6:0/2179855610 >> v2:172.21.15.171:3300/0 conn(0x7fd8900b4010 0x7fd8900cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88e59c640 1 --2- 172.21.15.6:0/2179855610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd890163a10 0x7fd8900d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88ed9d640 1 -- 172.21.15.6:0/2179855610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd890163a10 msgr2=0x7fd8900d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88ed9d640 1 --2- 172.21.15.6:0/2179855610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd890163a10 0x7fd8900d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88ed9d640 1 -- 172.21.15.6:0/2179855610 >> v2:172.21.15.171:3300/0 conn(0x7fd8900b4010 msgr2=0x7fd8900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88ed9d640 1 --2- 172.21.15.6:0/2179855610 >> v2:172.21.15.171:3300/0 conn(0x7fd8900b4010 0x7fd8900cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.597+0000 7fd88ed9d640 1 -- 172.21.15.6:0/2179855610 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8900d3650 con 0x7fd8900d14b0 2024-05-20T17:54:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.598+0000 7fd88ed9d640 1 --2- 172.21.15.6:0/2179855610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900d14b0 0x7fd8900d18c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd8900b7710 tx=0x7fd88802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23c0986be3ea0a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.598+0000 7fd88d59a640 1 -- 172.21.15.6:0/2179855610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888036070 con 0x7fd8900d14b0 2024-05-20T17:54:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.598+0000 7fd88d59a640 1 -- 172.21.15.6:0/2179855610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888031600 con 0x7fd8900d14b0 2024-05-20T17:54:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.598+0000 7fd88d59a640 1 -- 172.21.15.6:0/2179855610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880319d0 con 0x7fd8900d14b0 2024-05-20T17:54:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 -- 172.21.15.6:0/2179855610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900d14b0 msgr2=0x7fd8900d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2179855610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900d14b0 0x7fd8900d18c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd8900b7710 tx=0x7fd88802a6a0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 -- 172.21.15.6:0/2179855610 shutdown_connections 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2179855610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900d14b0 0x7fd8900d18c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2179855610 >> v2:172.21.15.171:3300/0 conn(0x7fd8900b4010 0x7fd8900cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2179855610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd890163a10 0x7fd8900d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 -- 172.21.15.6:0/2179855610 >> 172.21.15.6:0/2179855610 conn(0x7fd89006d240 msgr2=0x7fd89006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 -- 172.21.15.6:0/2179855610 shutdown_connections 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.599+0000 7fd8948a2640 1 -- 172.21.15.6:0/2179855610 wait complete. 2024-05-20T17:54:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.601+0000 7fd8948a2640 1 Processor -- start 2024-05-20T17:54:24.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.601+0000 7fd8948a2640 1 -- start start 2024-05-20T17:54:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.602+0000 7fd8948a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8900b4010 0x7fd8901592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.602+0000 7fd8948a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8900d14b0 0x7fd890155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.602+0000 7fd8948a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890163a10 0x7fd8901557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.602+0000 7fd8948a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900d1e00 con 0x7fd890163a10 2024-05-20T17:54:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.602+0000 7fd8948a2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900d0040 con 0x7fd8900b4010 2024-05-20T17:54:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.602+0000 7fd8948a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd8900b8210 con 0x7fd8900d14b0 2024-05-20T17:54:24.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890163a10 0x7fd8901557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890163a10 0x7fd8901557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47882/0 (socket says 172.21.15.6:47882) 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 -- 172.21.15.6:0/2097334482 learned_addr learned my addr 172.21.15.6:0/2097334482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88dd9b640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8900d14b0 0x7fd890155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88e59c640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8900b4010 0x7fd8901592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 -- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8900d14b0 msgr2=0x7fd890155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8900d14b0 0x7fd890155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 -- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8900b4010 msgr2=0x7fd8901592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8900b4010 0x7fd8901592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 -- 172.21.15.6:0/2097334482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8901e92a0 con 0x7fd890163a10 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88e59c640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8900b4010 0x7fd8901592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd88ed9d640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890163a10 0x7fd8901557a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd888009f40 tx=0x7fd888004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:24.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd87effd640 1 -- 172.21.15.6:0/2097334482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888036050 con 0x7fd890163a10 2024-05-20T17:54:24.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd87effd640 1 -- 172.21.15.6:0/2097334482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888042070 con 0x7fd890163a10 2024-05-20T17:54:24.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8901e9580 con 0x7fd890163a10 2024-05-20T17:54:24.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.603+0000 7fd87effd640 1 -- 172.21.15.6:0/2097334482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888009510 con 0x7fd890163a10 2024-05-20T17:54:24.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.604+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8901e9b40 con 0x7fd890163a10 2024-05-20T17:54:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.604+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd890075b00 con 0x7fd890163a10 2024-05-20T17:54:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.605+0000 7fd87effd640 1 -- 172.21.15.6:0/2097334482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd888007bd0 con 0x7fd890163a10 2024-05-20T17:54:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.606+0000 7fd87effd640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd87006be60 0x7fd87006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.606+0000 7fd87effd640 1 -- 172.21.15.6:0/2097334482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fd8880ab810 con 0x7fd890163a10 2024-05-20T17:54:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.606+0000 7fd88e59c640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd87006be60 0x7fd87006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.607+0000 7fd88e59c640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd87006be60 0x7fd87006e370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd8900d3020 tx=0x7fd880008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.611+0000 7fd87effd640 1 -- 172.21.15.6:0/2097334482 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd88804b020 con 0x7fd890163a10 2024-05-20T17:54:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.797+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8900d3050 con 0x7fd890163a10 2024-05-20T17:54:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.798+0000 7fd87effd640 1 -- 172.21.15.6:0/2097334482 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16907 (secure 0 0 0) 0x7fd888079f00 con 0x7fd890163a10 2024-05-20T17:54:24.798 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:24.798 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:23.809888+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:54:21.604657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-20T17:54:22.794409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd87006be60 msgr2=0x7fd87006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd87006be60 0x7fd87006e370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd8900d3020 tx=0x7fd880008040 comp rx=0 tx=0).stop 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890163a10 msgr2=0x7fd8901557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890163a10 0x7fd8901557a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd888009f40 tx=0x7fd888004a40 comp rx=0 tx=0).stop 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 shutdown_connections 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd87006be60 0x7fd87006e370 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890163a10 0x7fd8901557a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8900d14b0 0x7fd890155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 --2- 172.21.15.6:0/2097334482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8900b4010 0x7fd8901592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 >> 172.21.15.6:0/2097334482 conn(0x7fd89006d240 msgr2=0x7fd8900b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 shutdown_connections 2024-05-20T17:54:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.800+0000 7fd8948a2640 1 -- 172.21.15.6:0/2097334482 wait complete. 2024-05-20T17:54:24.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.927+0000 7fa07efc7640 1 Processor -- start 2024-05-20T17:54:24.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.927+0000 7fa07efc7640 1 -- start start 2024-05-20T17:54:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.928+0000 7fa07efc7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0780d17f0 0x7fa07815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.928+0000 7fa07efc7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0780cd580 con 0x7fa0780b1e10 2024-05-20T17:54:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.928+0000 7fa07efc7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0780cd860 con 0x7fa07815d530 2024-05-20T17:54:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.928+0000 7fa07efc7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0780ce190 con 0x7fa0780d17f0 2024-05-20T17:54:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.928+0000 7fa06ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa0780b1e10 0x7fa078070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53854/0 (socket says 172.21.15.6:53854) 2024-05-20T17:54:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.928+0000 7fa06ffff640 1 -- 172.21.15.6:0/1620693612 learned_addr learned my addr 172.21.15.6:0/1620693612 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:24.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.929+0000 7fa07d564640 1 --2- 172.21.15.6:0/1620693612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0780d17f0 0x7fa07815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.929+0000 7fa06f7fe640 1 -- 172.21.15.6:0/1620693612 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3871153045 0 0) 0x7fa0780cd580 con 0x7fa0780b1e10 2024-05-20T17:54:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.929+0000 7fa06f7fe640 1 -- 172.21.15.6:0/1620693612 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa060003520 con 0x7fa0780b1e10 2024-05-20T17:54:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.929+0000 7fa06f7fe640 1 -- 172.21.15.6:0/1620693612 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273891393 0 0) 0x7fa0780cd860 con 0x7fa07815d530 2024-05-20T17:54:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.929+0000 7fa07d564640 1 -- 172.21.15.6:0/1620693612 >> v1:172.21.15.171:6789/0 conn(0x7fa07815d530 legacy=0x7fa0780b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.929+0000 7fa07d564640 1 -- 172.21.15.6:0/1620693612 >> v1:172.21.15.6:6789/0 conn(0x7fa0780b1e10 legacy=0x7fa078070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.929+0000 7fa07d564640 1 -- 172.21.15.6:0/1620693612 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0780cdb40 con 0x7fa0780d17f0 2024-05-20T17:54:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.930+0000 7fa07d564640 1 --2- 172.21.15.6:0/1620693612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0780d17f0 0x7fa07815aaa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0700097d0 tx=0x7fa07002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48d59e5c5dca6d8c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.930+0000 7fa06f7fe640 1 -- 172.21.15.6:0/1620693612 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070037070 con 0x7fa0780d17f0 2024-05-20T17:54:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.930+0000 7fa06f7fe640 1 -- 172.21.15.6:0/1620693612 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07002ac10 con 0x7fa0780d17f0 2024-05-20T17:54:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.930+0000 7fa06f7fe640 1 -- 172.21.15.6:0/1620693612 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068001670 con 0x7fa0780d17f0 2024-05-20T17:54:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.931+0000 7fa07efc7640 1 -- 172.21.15.6:0/1620693612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0780d17f0 msgr2=0x7fa07815aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.931+0000 7fa07efc7640 1 --2- 172.21.15.6:0/1620693612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0780d17f0 0x7fa07815aaa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0700097d0 tx=0x7fa07002a180 comp rx=0 tx=0).stop 2024-05-20T17:54:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.931+0000 7fa07efc7640 1 -- 172.21.15.6:0/1620693612 shutdown_connections 2024-05-20T17:54:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.931+0000 7fa07efc7640 1 --2- 172.21.15.6:0/1620693612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0780d17f0 0x7fa07815aaa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.931+0000 7fa07efc7640 1 -- 172.21.15.6:0/1620693612 >> 172.21.15.6:0/1620693612 conn(0x7fa0780d29d0 msgr2=0x7fa0780d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.931+0000 7fa07efc7640 1 -- 172.21.15.6:0/1620693612 shutdown_connections 2024-05-20T17:54:24.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.931+0000 7fa07efc7640 1 -- 172.21.15.6:0/1620693612 wait complete. 2024-05-20T17:54:24.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.933+0000 7fa07efc7640 1 Processor -- start 2024-05-20T17:54:24.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.933+0000 7fa07efc7640 1 -- start start 2024-05-20T17:54:24.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa07efc7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0780b1e10 0x7fa0780b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa07efc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0780d17f0 0x7fa0780cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa07efc7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa07815d530 0x7fa0780cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa07efc7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa078070f60 con 0x7fa0780d17f0 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa07efc7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa0780cd230 con 0x7fa0780b1e10 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa07efc7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0780710e0 con 0x7fa07815d530 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0780d17f0 0x7fa0780cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa06ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0780d17f0 0x7fa0780cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47888/0 (socket says 172.21.15.6:47888) 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa06ffff640 1 -- 172.21.15.6:0/3452887868 learned_addr learned my addr 172.21.15.6:0/3452887868 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa07cd63640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0780b1e10 0x7fa0780b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa07d564640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa07815d530 0x7fa0780cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa06ffff640 1 -- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa07815d530 msgr2=0x7fa0780cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa06ffff640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa07815d530 0x7fa0780cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa06ffff640 1 -- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0780b1e10 msgr2=0x7fa0780b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.934+0000 7fa06ffff640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0780b1e10 0x7fa0780b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.935+0000 7fa06ffff640 1 -- 172.21.15.6:0/3452887868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0780cabc0 con 0x7fa0780d17f0 2024-05-20T17:54:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.935+0000 7fa06ffff640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0780d17f0 0x7fa0780cc900 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa06800c7b0 tx=0x7fa06800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.935+0000 7fa06d7fa640 1 -- 172.21.15.6:0/3452887868 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068018070 con 0x7fa0780d17f0 2024-05-20T17:54:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.935+0000 7fa06d7fa640 1 -- 172.21.15.6:0/3452887868 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0680074e0 con 0x7fa0780d17f0 2024-05-20T17:54:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.935+0000 7fa06d7fa640 1 -- 172.21.15.6:0/3452887868 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06800ce60 con 0x7fa0780d17f0 2024-05-20T17:54:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.935+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0780caea0 con 0x7fa0780d17f0 2024-05-20T17:54:24.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.935+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0780cb460 con 0x7fa0780d17f0 2024-05-20T17:54:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.936+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa078075b00 con 0x7fa0780d17f0 2024-05-20T17:54:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.937+0000 7fa06d7fa640 1 -- 172.21.15.6:0/3452887868 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa06801b070 con 0x7fa0780d17f0 2024-05-20T17:54:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.937+0000 7fa06d7fa640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa06406be60 0x7fa06406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.937+0000 7fa06d7fa640 1 -- 172.21.15.6:0/3452887868 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fa06808a460 con 0x7fa0780d17f0 2024-05-20T17:54:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.937+0000 7fa07cd63640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa06406be60 0x7fa06406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:24.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.938+0000 7fa07cd63640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa06406be60 0x7fa06406e370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa0740012e0 tx=0x7fa074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:24.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:24.942+0000 7fa06d7fa640 1 -- 172.21.15.6:0/3452887868 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa068058630 con 0x7fa0780d17f0 2024-05-20T17:54:25.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.128+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0780b57b0 con 0x7fa0780d17f0 2024-05-20T17:54:25.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.129+0000 7fa06d7fa640 1 -- 172.21.15.6:0/3452887868 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16907 (secure 0 0 0) 0x7fa06805c930 con 0x7fa0780d17f0 2024-05-20T17:54:25.128 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:25.129 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:23.809888+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:54:21.604657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-20T17:54:22.794409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:25.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa06406be60 msgr2=0x7fa06406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:25.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa06406be60 0x7fa06406e370 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa0740012e0 tx=0x7fa074009040 comp rx=0 tx=0).stop 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0780d17f0 msgr2=0x7fa0780cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0780d17f0 0x7fa0780cc900 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa06800c7b0 tx=0x7fa06800cc70 comp rx=0 tx=0).stop 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 shutdown_connections 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa06406be60 0x7fa06406e370 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa07815d530 0x7fa0780cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0780d17f0 0x7fa0780cc900 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 --2- 172.21.15.6:0/3452887868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0780b1e10 0x7fa0780b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 >> 172.21.15.6:0/3452887868 conn(0x7fa0780d29d0 msgr2=0x7fa0780cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 shutdown_connections 2024-05-20T17:54:25.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.131+0000 7fa07efc7640 1 -- 172.21.15.6:0/3452887868 wait complete. 2024-05-20T17:54:25.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T17:54:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.261+0000 7f52de2c3640 1 Processor -- start 2024-05-20T17:54:25.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.261+0000 7f52de2c3640 1 -- start start 2024-05-20T17:54:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52de2c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52d8162820 0x7f52d80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52de2c3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d80d0630 con 0x7f52d806dae0 2024-05-20T17:54:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52de2c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d80d39c0 con 0x7f52d80b3e80 2024-05-20T17:54:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52de2c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f52d80d3ca0 con 0x7f52d8162820 2024-05-20T17:54:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52d7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52d8162820 0x7f52d80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52d7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52d8162820 0x7f52d80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47902/0 (socket says 172.21.15.6:47902) 2024-05-20T17:54:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52dc860640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f52d806dae0 0x7f52d80b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53856/0 (socket says 172.21.15.6:53856) 2024-05-20T17:54:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52d7fff640 1 -- 172.21.15.6:0/3426838253 learned_addr learned my addr 172.21.15.6:0/3426838253 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52d7fff640 1 -- 172.21.15.6:0/3426838253 >> v1:172.21.15.171:6789/0 conn(0x7f52d80b3e80 legacy=0x7f52d806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52d7fff640 1 -- 172.21.15.6:0/3426838253 >> v1:172.21.15.6:6789/0 conn(0x7f52d806dae0 legacy=0x7f52d80b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52d6ffd640 1 -- 172.21.15.6:0/3426838253 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103327643 0 0) 0x7f52d80d0630 con 0x7f52d806dae0 2024-05-20T17:54:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.262+0000 7f52d7fff640 1 -- 172.21.15.6:0/3426838253 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d80d3f80 con 0x7f52d8162820 2024-05-20T17:54:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.263+0000 7f52d7fff640 1 --2- 172.21.15.6:0/3426838253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80b3940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009870 tx=0x7f52c802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0d6fafc80a69c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.263+0000 7f52d6ffd640 1 -- 172.21.15.6:0/3426838253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8037070 con 0x7f52d8162820 2024-05-20T17:54:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.263+0000 7f52d6ffd640 1 -- 172.21.15.6:0/3426838253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c802ae50 con 0x7f52d8162820 2024-05-20T17:54:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.263+0000 7f52d6ffd640 1 -- 172.21.15.6:0/3426838253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8032860 con 0x7f52d8162820 2024-05-20T17:54:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.264+0000 7f52de2c3640 1 -- 172.21.15.6:0/3426838253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 msgr2=0x7f52d80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.264+0000 7f52de2c3640 1 --2- 172.21.15.6:0/3426838253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80b3940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009870 tx=0x7f52c802a300 comp rx=0 tx=0).stop 2024-05-20T17:54:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.264+0000 7f52de2c3640 1 -- 172.21.15.6:0/3426838253 shutdown_connections 2024-05-20T17:54:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.264+0000 7f52de2c3640 1 --2- 172.21.15.6:0/3426838253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80b3940 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.264+0000 7f52de2c3640 1 -- 172.21.15.6:0/3426838253 >> 172.21.15.6:0/3426838253 conn(0x7f52d80d4bd0 msgr2=0x7f52d80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.264+0000 7f52de2c3640 1 -- 172.21.15.6:0/3426838253 shutdown_connections 2024-05-20T17:54:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.264+0000 7f52de2c3640 1 -- 172.21.15.6:0/3426838253 wait complete. 2024-05-20T17:54:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.266+0000 7f52de2c3640 1 Processor -- start 2024-05-20T17:54:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.266+0000 7f52de2c3640 1 -- start start 2024-05-20T17:54:25.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52de2c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d80b3e80 0x7f52d81f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52de2c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52de2c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d80b91e0 0x7f52d80b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52de2c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80d4780 con 0x7f52d8162820 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52de2c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80d0300 con 0x7f52d80b91e0 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52de2c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80d4900 con 0x7f52d80b3e80 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47904/0 (socket says 172.21.15.6:47904) 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 -- 172.21.15.6:0/252642116 learned_addr learned my addr 172.21.15.6:0/252642116 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d7fff640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d80b3e80 0x7f52d81f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52dc860640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d80b91e0 0x7f52d80b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 -- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d80b3e80 msgr2=0x7f52d81f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d80b3e80 0x7f52d81f7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 -- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d80b91e0 msgr2=0x7f52d80b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d80b91e0 0x7f52d80b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 -- 172.21.15.6:0/252642116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d80b9b30 con 0x7f52d8162820 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52dc860640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d80b91e0 0x7f52d80b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d77fe640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80cd8c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c430 tx=0x7f52cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d4ff9640 1 -- 172.21.15.6:0/252642116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc017070 con 0x7f52d8162820 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d4ff9640 1 -- 172.21.15.6:0/252642116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52cc0052d0 con 0x7f52d8162820 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d80ce430 con 0x7f52d8162820 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52d4ff9640 1 -- 172.21.15.6:0/252642116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc003830 con 0x7f52d8162820 2024-05-20T17:54:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.268+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d80ce9f0 con 0x7f52d8162820 2024-05-20T17:54:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.269+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d8075b00 con 0x7f52d8162820 2024-05-20T17:54:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.270+0000 7f52d4ff9640 1 -- 172.21.15.6:0/252642116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52cc01a070 con 0x7f52d8162820 2024-05-20T17:54:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.270+0000 7f52d4ff9640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52c406be60 0x7f52c406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.270+0000 7f52d4ff9640 1 -- 172.21.15.6:0/252642116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f52cc08a350 con 0x7f52d8162820 2024-05-20T17:54:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.270+0000 7f52d7fff640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52c406be60 0x7f52c406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.271+0000 7f52d7fff640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52c406be60 0x7f52c406e370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f52c8034000 tx=0x7f52c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.275+0000 7f52d4ff9640 1 -- 172.21.15.6:0/252642116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f52d80b9b30 con 0x7f52d8162820 2024-05-20T17:54:25.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:25.500+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f52d81619f0 con 0x7f52d8162820 2024-05-20T17:54:26.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.467+0000 7f52d4ff9640 1 -- 172.21.15.6:0/252642116 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f52cc0584a0 con 0x7f52d8162820 2024-05-20T17:54:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52c406be60 msgr2=0x7f52c406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52c406be60 0x7f52c406e370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f52c8034000 tx=0x7f52c802e000 comp rx=0 tx=0).stop 2024-05-20T17:54:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 msgr2=0x7f52d80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80cd8c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c430 tx=0x7f52cc00c8f0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 shutdown_connections 2024-05-20T17:54:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52c406be60 0x7f52c406e370 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52d80b91e0 0x7f52d80b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d8162820 0x7f52d80cd8c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 --2- 172.21.15.6:0/252642116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52d80b3e80 0x7f52d81f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 >> 172.21.15.6:0/252642116 conn(0x7f52d80d4bd0 msgr2=0x7f52d8160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:26.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 shutdown_connections 2024-05-20T17:54:26.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.470+0000 7f52de2c3640 1 -- 172.21.15.6:0/252642116 wait complete. 2024-05-20T17:54:26.482 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T17:54:26.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T17:54:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.608+0000 7fb2b8fb5640 1 Processor -- start 2024-05-20T17:54:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.608+0000 7fb2b8fb5640 1 -- start start 2024-05-20T17:54:26.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.610+0000 7fb2b8fb5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb2b40cd710 0x7fb2b4162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.610+0000 7fb2b8fb5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b406c8c0 con 0x7fb2b40cfae0 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.610+0000 7fb2b8fb5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b406dac0 con 0x7fb2b406d6b0 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.610+0000 7fb2b8fb5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b40d0ba0 con 0x7fb2b40cd710 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.610+0000 7fb2b2d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2b40cfae0 0x7fb2b40d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53860/0 (socket says 172.21.15.6:53860) 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.610+0000 7fb2b2d9d640 1 -- 172.21.15.6:0/1019592842 learned_addr learned my addr 172.21.15.6:0/1019592842 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.610+0000 7fb2b259c640 1 --2- 172.21.15.6:0/1019592842 >> v2:172.21.15.171:3300/0 conn(0x7fb2b40cd710 0x7fb2b4162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.610+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512428677 0 0) 0x7fb2b406c8c0 con 0x7fb2b40cfae0 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb29c003520 con 0x7fb2b40cfae0 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2936335972 0 0) 0x7fb29c003520 con 0x7fb2b40cfae0 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 >> v2:172.21.15.171:3300/0 conn(0x7fb2b40cd710 msgr2=0x7fb2b4162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 --2- 172.21.15.6:0/1019592842 >> v2:172.21.15.171:3300/0 conn(0x7fb2b40cd710 0x7fb2b4162e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 >> v1:172.21.15.171:6789/0 conn(0x7fb2b406d6b0 legacy=0x7fb2b40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:26.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b41633e0 con 0x7fb2b40cfae0 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fb2ac001690 con 0x7fb2b40cfae0 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 >> v1:172.21.15.6:6789/0 conn(0x7fb2b40cfae0 legacy=0x7fb2b40d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb29c0039b0 0x7fb29c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c004800 0x7fb29c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb29c005150 0x7fb29c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b40d0ba0 con 0x7fb29c0039b0 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c00c140 con 0x7fb29c004800 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb29c00c340 con 0x7fb29c005150 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b259c640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb29c0039b0 0x7fb29c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b1d9b640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c004800 0x7fb29c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b2d9d640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb29c005150 0x7fb29c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b259c640 1 -- 172.21.15.6:0/1019592842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb29c005150 msgr2=0x7fb29c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b259c640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb29c005150 0x7fb29c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b259c640 1 -- 172.21.15.6:0/1019592842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c004800 msgr2=0x7fb29c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b259c640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c004800 0x7fb29c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b2d9d640 1 -- 172.21.15.6:0/1019592842 reap_dead start 2024-05-20T17:54:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.611+0000 7fb2b259c640 1 -- 172.21.15.6:0/1019592842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c003520 con 0x7fb29c0039b0 2024-05-20T17:54:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.612+0000 7fb2b259c640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb29c0039b0 0x7fb29c003e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4162d60 tx=0x7fb29c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7976d3d56ac1410d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.612+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4037070 con 0x7fb29c0039b0 2024-05-20T17:54:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.612+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a4032620 con 0x7fb29c0039b0 2024-05-20T17:54:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.612+0000 7fb2b159a640 1 -- 172.21.15.6:0/1019592842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4009c10 con 0x7fb29c0039b0 2024-05-20T17:54:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.613+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/1019592842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb29c0039b0 msgr2=0x7fb29c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.613+0000 7fb2b8fb5640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb29c0039b0 0x7fb29c003e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4162d60 tx=0x7fb29c005830 comp rx=0 tx=0).stop 2024-05-20T17:54:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.613+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/1019592842 shutdown_connections 2024-05-20T17:54:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.613+0000 7fb2b8fb5640 1 --2- 172.21.15.6:0/1019592842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb29c0039b0 0x7fb29c003e00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.613+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/1019592842 >> 172.21.15.6:0/1019592842 conn(0x7fb2b40b44d0 msgr2=0x7fb2b40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.613+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/1019592842 shutdown_connections 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.613+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/1019592842 wait complete. 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.615+0000 7fb2b8fb5640 1 Processor -- start 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.615+0000 7fb2b8fb5640 1 -- start start 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.616+0000 7fb2b8fb5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c0039b0 0x7fb2b40c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.616+0000 7fb2b8fb5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2b40c8500 0x7fb2b415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.616+0000 7fb2b8fb5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b40b7030 0x7fb2b415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.616+0000 7fb2b8fb5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b4163c80 con 0x7fb2b40b7030 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.616+0000 7fb2b8fb5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b41639a0 con 0x7fb29c0039b0 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.616+0000 7fb2b8fb5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b4162e00 con 0x7fb2b40c8500 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.616+0000 7fb2b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b40b7030 0x7fb2b415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b40b7030 0x7fb2b415aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47934/0 (socket says 172.21.15.6:47934) 2024-05-20T17:54:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b2d9d640 1 -- 172.21.15.6:0/282510687 learned_addr learned my addr 172.21.15.6:0/282510687 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b1d9b640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2b40c8500 0x7fb2b415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b259c640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c0039b0 0x7fb2b40c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b2d9d640 1 -- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2b40c8500 msgr2=0x7fb2b415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b2d9d640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2b40c8500 0x7fb2b415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b2d9d640 1 -- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c0039b0 msgr2=0x7fb2b40c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b2d9d640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c0039b0 0x7fb2b40c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b2d9d640 1 -- 172.21.15.6:0/282510687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b415f3e0 con 0x7fb2b40b7030 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b2d9d640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b40b7030 0x7fb2b415aff0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40cd1a0 tx=0x7fb2ac007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2a2ffd640 1 -- 172.21.15.6:0/282510687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac01a070 con 0x7fb2b40b7030 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2a2ffd640 1 -- 172.21.15.6:0/282510687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac00f910 con 0x7fb2b40b7030 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b415f680 con 0x7fb2b40b7030 2024-05-20T17:54:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2a2ffd640 1 -- 172.21.15.6:0/282510687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac00fd20 con 0x7fb2b40b7030 2024-05-20T17:54:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.617+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b415fc40 con 0x7fb2b40b7030 2024-05-20T17:54:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.618+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b406d4d0 con 0x7fb2b40b7030 2024-05-20T17:54:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.619+0000 7fb2a2ffd640 1 -- 172.21.15.6:0/282510687 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2ac01d070 con 0x7fb2b40b7030 2024-05-20T17:54:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.619+0000 7fb2a2ffd640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb29406be30 0x7fb29406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.619+0000 7fb2a2ffd640 1 -- 172.21.15.6:0/282510687 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fb2ac08a750 con 0x7fb2b40b7030 2024-05-20T17:54:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.620+0000 7fb2b259c640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb29406be30 0x7fb29406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.620+0000 7fb2b259c640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb29406be30 0x7fb29406e340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4034000 tx=0x7fb2a402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.624+0000 7fb2a2ffd640 1 -- 172.21.15.6:0/282510687 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb2b406d4d0 con 0x7fb2b40b7030 2024-05-20T17:54:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:26.846+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb2b40b75a0 con 0x7fb2b40b7030 2024-05-20T17:54:27.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.469+0000 7fb2a2ffd640 1 -- 172.21.15.6:0/282510687 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fb2ac058f60 con 0x7fb2b40b7030 2024-05-20T17:54:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.471+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb29406be30 msgr2=0x7fb29406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.471+0000 7fb2b8fb5640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb29406be30 0x7fb29406e340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4034000 tx=0x7fb2a402f000 comp rx=0 tx=0).stop 2024-05-20T17:54:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.471+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b40b7030 msgr2=0x7fb2b415aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.471+0000 7fb2b8fb5640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b40b7030 0x7fb2b415aff0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40cd1a0 tx=0x7fb2ac007720 comp rx=0 tx=0).stop 2024-05-20T17:54:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.472+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 shutdown_connections 2024-05-20T17:54:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.472+0000 7fb2b8fb5640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb29406be30 0x7fb29406e340 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.472+0000 7fb2b8fb5640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b40b7030 0x7fb2b415aff0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.472+0000 7fb2b8fb5640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2b40c8500 0x7fb2b415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.472+0000 7fb2b8fb5640 1 --2- 172.21.15.6:0/282510687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb29c0039b0 0x7fb2b40c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.472+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 >> 172.21.15.6:0/282510687 conn(0x7fb2b40b44d0 msgr2=0x7fb2b40c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:27.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.472+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 shutdown_connections 2024-05-20T17:54:27.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.472+0000 7fb2b8fb5640 1 -- 172.21.15.6:0/282510687 wait complete. 2024-05-20T17:54:27.484 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T17:54:27.484 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:54:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.607+0000 7f3e03c32640 1 Processor -- start 2024-05-20T17:54:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.607+0000 7f3e03c32640 1 -- start start 2024-05-20T17:54:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e03c32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3dfc0cd710 0x7f3dfc162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e03c32640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc06d6b0 0x7f3dfc15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e03c32640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dfc06c8c0 con 0x7f3dfc0cf3d0 2024-05-20T17:54:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e03c32640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3dfc0d0ba0 con 0x7f3dfc0cd710 2024-05-20T17:54:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e03c32640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc06dac0 con 0x7f3dfc06d6b0 2024-05-20T17:54:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e019ce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3dfc0cd710 0x7f3dfc162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e021cf640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3dfc0cf3d0 0x7f3dfc0cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53870/0 (socket says 172.21.15.6:53870) 2024-05-20T17:54:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e021cf640 1 -- 172.21.15.6:0/2351613210 learned_addr learned my addr 172.21.15.6:0/2351613210 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e011cd640 1 --2- 172.21.15.6:0/2351613210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc06d6b0 0x7f3dfc15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e019ce640 1 -- 172.21.15.6:0/2351613210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc06d6b0 msgr2=0x7f3dfc15f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e019ce640 1 --2- 172.21.15.6:0/2351613210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc06d6b0 0x7f3dfc15f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e019ce640 1 -- 172.21.15.6:0/2351613210 >> v1:172.21.15.6:6789/0 conn(0x7f3dfc0cf3d0 legacy=0x7f3dfc0cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e019ce640 1 -- 172.21.15.6:0/2351613210 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc1633e0 con 0x7f3dfc0cd710 2024-05-20T17:54:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.609+0000 7f3e009cc640 1 -- 172.21.15.6:0/2351613210 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681739778 0 0) 0x7f3dfc06c8c0 con 0x7f3dfc0cf3d0 2024-05-20T17:54:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.610+0000 7f3e019ce640 1 --2- 172.21.15.6:0/2351613210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc162e00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3df80097a0 tx=0x7f3df802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f30712b6deaacc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.610+0000 7f3e009cc640 1 -- 172.21.15.6:0/2351613210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8037070 con 0x7f3dfc0cd710 2024-05-20T17:54:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.610+0000 7f3e009cc640 1 -- 172.21.15.6:0/2351613210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df8032440 con 0x7f3dfc0cd710 2024-05-20T17:54:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.610+0000 7f3e009cc640 1 -- 172.21.15.6:0/2351613210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8032810 con 0x7f3dfc0cd710 2024-05-20T17:54:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.611+0000 7f3e03c32640 1 -- 172.21.15.6:0/2351613210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 msgr2=0x7f3dfc162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.611+0000 7f3e03c32640 1 --2- 172.21.15.6:0/2351613210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc162e00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3df80097a0 tx=0x7f3df802a180 comp rx=0 tx=0).stop 2024-05-20T17:54:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.611+0000 7f3e03c32640 1 -- 172.21.15.6:0/2351613210 shutdown_connections 2024-05-20T17:54:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.611+0000 7f3e03c32640 1 --2- 172.21.15.6:0/2351613210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc06d6b0 0x7f3dfc15f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.611+0000 7f3e03c32640 1 --2- 172.21.15.6:0/2351613210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc162e00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.611+0000 7f3e03c32640 1 -- 172.21.15.6:0/2351613210 >> 172.21.15.6:0/2351613210 conn(0x7f3dfc0b44d0 msgr2=0x7f3dfc0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.611+0000 7f3e03c32640 1 -- 172.21.15.6:0/2351613210 shutdown_connections 2024-05-20T17:54:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.611+0000 7f3e03c32640 1 -- 172.21.15.6:0/2351613210 wait complete. 2024-05-20T17:54:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.613+0000 7f3e03c32640 1 Processor -- start 2024-05-20T17:54:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.613+0000 7f3e03c32640 1 -- start start 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.614+0000 7f3e03c32640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dfc06d6b0 0x7f3dfc15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.614+0000 7f3e03c32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.614+0000 7f3e03c32640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc0cf3d0 0x7f3dfc161480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.614+0000 7f3e03c32640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc163c80 con 0x7f3dfc0cd710 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.614+0000 7f3e03c32640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc1639a0 con 0x7f3dfc06d6b0 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.614+0000 7f3e03c32640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc0d1030 con 0x7f3dfc0cf3d0 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.614+0000 7f3e011cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e011cd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc1589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47940/0 (socket says 172.21.15.6:47940) 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e011cd640 1 -- 172.21.15.6:0/280163260 learned_addr learned my addr 172.21.15.6:0/280163260 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e021cf640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc0cf3d0 0x7f3dfc161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e019ce640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dfc06d6b0 0x7f3dfc15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e011cd640 1 -- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc0cf3d0 msgr2=0x7f3dfc161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e011cd640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc0cf3d0 0x7f3dfc161480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e011cd640 1 -- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dfc06d6b0 msgr2=0x7f3dfc15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e011cd640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dfc06d6b0 0x7f3dfc15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e011cd640 1 -- 172.21.15.6:0/280163260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc1f5a20 con 0x7f3dfc0cd710 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e011cd640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc1589c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00d5f0 tx=0x7f3dec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3df27fc640 1 -- 172.21.15.6:0/280163260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0125f0 con 0x7f3dfc0cd710 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3df27fc640 1 -- 172.21.15.6:0/280163260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec019070 con 0x7f3dfc0cd710 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc1f5d00 con 0x7f3dfc0cd710 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3df27fc640 1 -- 172.21.15.6:0/280163260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0129d0 con 0x7f3dfc0cd710 2024-05-20T17:54:27.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.615+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc1f62c0 con 0x7f3dfc0cd710 2024-05-20T17:54:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.616+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dfc0d0250 con 0x7f3dfc0cd710 2024-05-20T17:54:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.617+0000 7f3df27fc640 1 -- 172.21.15.6:0/280163260 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dec012b70 con 0x7f3dfc0cd710 2024-05-20T17:54:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.617+0000 7f3df27fc640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3de006be60 0x7f3de006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.618+0000 7f3df27fc640 1 -- 172.21.15.6:0/280163260 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3dec08b430 con 0x7f3dfc0cd710 2024-05-20T17:54:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.618+0000 7f3e019ce640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3de006be60 0x7f3de006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.618+0000 7f3e019ce640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3de006be60 0x7f3de006e370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3df8034000 tx=0x7f3df802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.622+0000 7f3df27fc640 1 -- 172.21.15.6:0/280163260 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3dfc0d0250 con 0x7f3dfc0cd710 2024-05-20T17:54:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.843+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dfc075b00 con 0x7f3dfc0cd710 2024-05-20T17:54:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.843+0000 7f3df27fc640 1 -- 172.21.15.6:0/280163260 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f3dec059bc0 con 0x7f3dfc0cd710 2024-05-20T17:54:27.842 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:27.842 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:54:23.810231+0000","modified":"2024-05-20T17:54:26.847159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3387888972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3387888972},{"type":"v1","addr":"172.21.15.6:6834","nonce":3387888972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":2}]} 2024-05-20T17:54:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3de006be60 msgr2=0x7f3de006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3de006be60 0x7f3de006e370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3df8034000 tx=0x7f3df802e000 comp rx=0 tx=0).stop 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 msgr2=0x7f3dfc1589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc1589c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00d5f0 tx=0x7f3dec00dab0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 shutdown_connections 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3de006be60 0x7f3de006e370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3dfc0cf3d0 0x7f3dfc161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dfc0cd710 0x7f3dfc1589c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 --2- 172.21.15.6:0/280163260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3dfc06d6b0 0x7f3dfc15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 >> 172.21.15.6:0/280163260 conn(0x7f3dfc0b44d0 msgr2=0x7f3dfc0c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 shutdown_connections 2024-05-20T17:54:27.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.845+0000 7f3e03c32640 1 -- 172.21.15.6:0/280163260 wait complete. 2024-05-20T17:54:27.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:54:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.972+0000 7fe1cbf8f640 1 Processor -- start 2024-05-20T17:54:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.972+0000 7fe1cbf8f640 1 -- start start 2024-05-20T17:54:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.973+0000 7fe1cbf8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c40af030 0x7fe1c40af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.973+0000 7fe1cbf8f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe1c406c180 0x7fe1c406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.973+0000 7fe1cbf8f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c40af980 con 0x7fe1c415f700 2024-05-20T17:54:27.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.973+0000 7fe1cbf8f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe1c406bcf0 con 0x7fe1c406c180 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.973+0000 7fe1cbf8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c4160430 con 0x7fe1c40af030 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c952a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe1c415f700 0x7fe1c415fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40404/0 (socket says 172.21.15.6:40404) 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c952a640 1 -- 172.21.15.6:0/1680091083 learned_addr learned my addr 172.21.15.6:0/1680091083 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c9d2b640 1 --2- 172.21.15.6:0/1680091083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c40af030 0x7fe1c40af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1ca52c640 1 --2- 172.21.15.6:0/1680091083 >> v2:172.21.15.171:3300/0 conn(0x7fe1c406c180 0x7fe1c406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c8d29640 1 -- 172.21.15.6:0/1680091083 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889821320 0 0) 0x7fe1b4001110 con 0x7fe1c415f700 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c8d29640 1 -- 172.21.15.6:0/1680091083 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b0003520 con 0x7fe1c415f700 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c9d2b640 1 -- 172.21.15.6:0/1680091083 >> v2:172.21.15.171:3300/0 conn(0x7fe1c406c180 msgr2=0x7fe1c406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c9d2b640 1 --2- 172.21.15.6:0/1680091083 >> v2:172.21.15.171:3300/0 conn(0x7fe1c406c180 0x7fe1c406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c9d2b640 1 -- 172.21.15.6:0/1680091083 >> v1:172.21.15.6:6789/0 conn(0x7fe1c415f700 legacy=0x7fe1c415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.974+0000 7fe1c9d2b640 1 -- 172.21.15.6:0/1680091083 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c406b6a0 con 0x7fe1c40af030 2024-05-20T17:54:27.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.975+0000 7fe1c9d2b640 1 --2- 172.21.15.6:0/1680091083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c40af030 0x7fe1c40af440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00097a0 tx=0x7fe1c002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68d9b8ee3892f297 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:27.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.975+0000 7fe1c8d29640 1 -- 172.21.15.6:0/1680091083 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0037070 con 0x7fe1c40af030 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.975+0000 7fe1c8d29640 1 -- 172.21.15.6:0/1680091083 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c0032440 con 0x7fe1c40af030 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.975+0000 7fe1c8d29640 1 -- 172.21.15.6:0/1680091083 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00327f0 con 0x7fe1c40af030 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.976+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1680091083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c40af030 msgr2=0x7fe1c40af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.976+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1680091083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c40af030 0x7fe1c40af440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00097a0 tx=0x7fe1c002a180 comp rx=0 tx=0).stop 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.976+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1680091083 shutdown_connections 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.976+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1680091083 >> v2:172.21.15.171:3300/0 conn(0x7fe1c406c180 0x7fe1c406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.976+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1680091083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c40af030 0x7fe1c40af440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.976+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1680091083 >> 172.21.15.6:0/1680091083 conn(0x7fe1c40b6620 msgr2=0x7fe1c40b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.976+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1680091083 shutdown_connections 2024-05-20T17:54:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.976+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1680091083 wait complete. 2024-05-20T17:54:27.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.978+0000 7fe1cbf8f640 1 Processor -- start 2024-05-20T17:54:27.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.978+0000 7fe1cbf8f640 1 -- start start 2024-05-20T17:54:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1cbf8f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c406c180 0x7fe1c4143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1cbf8f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1c40af030 0x7fe1c4146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1cbf8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c415f700 0x7fe1c4157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1cbf8f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c406cad0 con 0x7fe1c406c180 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1cbf8f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4159aa0 con 0x7fe1c40af030 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1cbf8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c406cc50 con 0x7fe1c415f700 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c9d2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c406c180 0x7fe1c4143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c9d2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c406c180 0x7fe1c4143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33216/0 (socket says 172.21.15.6:33216) 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c9d2b640 1 -- 172.21.15.6:0/1617350421 learned_addr learned my addr 172.21.15.6:0/1617350421 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c952a640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1c40af030 0x7fe1c4146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1ca52c640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c415f700 0x7fe1c4157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c9d2b640 1 -- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c415f700 msgr2=0x7fe1c4157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c9d2b640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c415f700 0x7fe1c4157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c9d2b640 1 -- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1c40af030 msgr2=0x7fe1c4146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c9d2b640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1c40af030 0x7fe1c4146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.979+0000 7fe1c9d2b640 1 -- 172.21.15.6:0/1617350421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c4147000 con 0x7fe1c406c180 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.980+0000 7fe1c9d2b640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c406c180 0x7fe1c4143a10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe1c002a1c0 tx=0x7fe1c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.980+0000 7fe1ba7fc640 1 -- 172.21.15.6:0/1617350421 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0041020 con 0x7fe1c406c180 2024-05-20T17:54:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.980+0000 7fe1ba7fc640 1 -- 172.21.15.6:0/1617350421 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c003d620 con 0x7fe1c406c180 2024-05-20T17:54:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.980+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c4144450 con 0x7fe1c406c180 2024-05-20T17:54:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.980+0000 7fe1ba7fc640 1 -- 172.21.15.6:0/1617350421 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0037040 con 0x7fe1c406c180 2024-05-20T17:54:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.980+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c4143f50 con 0x7fe1c406c180 2024-05-20T17:54:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.981+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c4075b00 con 0x7fe1c406c180 2024-05-20T17:54:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.981+0000 7fe1ba7fc640 1 -- 172.21.15.6:0/1617350421 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1c0044020 con 0x7fe1c406c180 2024-05-20T17:54:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.982+0000 7fe1ba7fc640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe1a806be60 0x7fe1a806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.982+0000 7fe1ba7fc640 1 -- 172.21.15.6:0/1617350421 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe1c00ab7f0 con 0x7fe1c406c180 2024-05-20T17:54:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.982+0000 7fe1c952a640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe1a806be60 0x7fe1a806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.983+0000 7fe1c952a640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe1a806be60 0x7fe1a806e370 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4005880 tx=0x7fe1b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:27.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:27.987+0000 7fe1ba7fc640 1 -- 172.21.15.6:0/1617350421 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe1c004b030 con 0x7fe1c406c180 2024-05-20T17:54:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.175+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1c40d1630 con 0x7fe1c406c180 2024-05-20T17:54:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.176+0000 7fe1ba7fc640 1 -- 172.21.15.6:0/1617350421 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16894 (secure 0 0 0) 0x7fe1c007a020 con 0x7fe1c406c180 2024-05-20T17:54:28.175 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:28.175 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:25.436457+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:54:21.604657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-20T17:54:22.794409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:54:28.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.178+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe1a806be60 msgr2=0x7fe1a806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.178+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe1a806be60 0x7fe1a806e370 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4005880 tx=0x7fe1b4009040 comp rx=0 tx=0).stop 2024-05-20T17:54:28.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.178+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c406c180 msgr2=0x7fe1c4143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c406c180 0x7fe1c4143a10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe1c002a1c0 tx=0x7fe1c00046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 shutdown_connections 2024-05-20T17:54:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe1a806be60 0x7fe1a806e370 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe1c415f700 0x7fe1c4157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1c40af030 0x7fe1c4146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 --2- 172.21.15.6:0/1617350421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1c406c180 0x7fe1c4143a10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 >> 172.21.15.6:0/1617350421 conn(0x7fe1c40b6620 msgr2=0x7fe1c40d1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 shutdown_connections 2024-05-20T17:54:28.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.179+0000 7fe1cbf8f640 1 -- 172.21.15.6:0/1617350421 wait complete. 2024-05-20T17:54:28.188 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T17:54:28.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:54:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.306+0000 7ff1cafd5640 1 Processor -- start 2024-05-20T17:54:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.306+0000 7ff1cafd5640 1 -- start start 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1cafd5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1c4162820 0x7ff1c40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1cafd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1cafd5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1c406d910 0x7ff1c40d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1cafd5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c406dd20 con 0x7ff1c406d910 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1cafd5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c40d0630 con 0x7ff1c4162820 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1cafd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c40d39c0 con 0x7ff1c40b3e80 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1c9572640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1c406d910 0x7ff1c40d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1c9572640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1c406d910 0x7ff1c40d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33218/0 (socket says 172.21.15.6:33218) 2024-05-20T17:54:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1c9572640 1 -- 172.21.15.6:0/1942953480 learned_addr learned my addr 172.21.15.6:0/1942953480 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1c8d71640 1 --2- 172.21.15.6:0/1942953480 >> v2:172.21.15.171:3300/0 conn(0x7ff1c4162820 0x7ff1c40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.307+0000 7ff1c3fff640 1 --2- 172.21.15.6:0/1942953480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.308+0000 7ff1c9572640 1 -- 172.21.15.6:0/1942953480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 msgr2=0x7ff1c406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.308+0000 7ff1c9572640 1 --2- 172.21.15.6:0/1942953480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.308+0000 7ff1c9572640 1 -- 172.21.15.6:0/1942953480 >> v2:172.21.15.171:3300/0 conn(0x7ff1c4162820 msgr2=0x7ff1c40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.308+0000 7ff1c9572640 1 --2- 172.21.15.6:0/1942953480 >> v2:172.21.15.171:3300/0 conn(0x7ff1c4162820 0x7ff1c40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.308+0000 7ff1c9572640 1 -- 172.21.15.6:0/1942953480 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c40d3ca0 con 0x7ff1c406d910 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.308+0000 7ff1c9572640 1 --2- 172.21.15.6:0/1942953480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c40d27a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40b7740 tx=0x7ff1bc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa796baa8950e3e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1c37fe640 1 -- 172.21.15.6:0/1942953480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc036070 con 0x7ff1c406d910 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1c37fe640 1 -- 172.21.15.6:0/1942953480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc031600 con 0x7ff1c406d910 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1c37fe640 1 -- 172.21.15.6:0/1942953480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0319d0 con 0x7ff1c406d910 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 -- 172.21.15.6:0/1942953480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 msgr2=0x7ff1c40d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/1942953480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c40d27a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40b7740 tx=0x7ff1bc02a6a0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 -- 172.21.15.6:0/1942953480 shutdown_connections 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/1942953480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c40d27a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/1942953480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/1942953480 >> v2:172.21.15.171:3300/0 conn(0x7ff1c4162820 0x7ff1c40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 -- 172.21.15.6:0/1942953480 >> 172.21.15.6:0/1942953480 conn(0x7ff1c40d4bd0 msgr2=0x7ff1c40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 -- 172.21.15.6:0/1942953480 shutdown_connections 2024-05-20T17:54:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.309+0000 7ff1cafd5640 1 -- 172.21.15.6:0/1942953480 wait complete. 2024-05-20T17:54:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.311+0000 7ff1cafd5640 1 Processor -- start 2024-05-20T17:54:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.311+0000 7ff1cafd5640 1 -- start start 2024-05-20T17:54:28.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1cafd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1cafd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1cafd5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c4162820 0x7ff1c40c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1cafd5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40d0300 con 0x7ff1c406d910 2024-05-20T17:54:28.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1cafd5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40d4260 con 0x7ff1c4162820 2024-05-20T17:54:28.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1cafd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c40d4780 con 0x7ff1c40b3e80 2024-05-20T17:54:28.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c414e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33224/0 (socket says 172.21.15.6:33224) 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 -- 172.21.15.6:0/776656083 learned_addr learned my addr 172.21.15.6:0/776656083 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c3fff640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 -- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 msgr2=0x7ff1c414eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c9572640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c4162820 0x7ff1c40c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c414eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 -- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c4162820 msgr2=0x7ff1c40c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c4162820 0x7ff1c40c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 -- 172.21.15.6:0/776656083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c414f2e0 con 0x7ff1c406d910 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c3fff640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c9572640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c4162820 0x7ff1c40c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c8d71640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c414e3c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400e8d0 tx=0x7ff1b400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c17fa640 1 -- 172.21.15.6:0/776656083 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4017070 con 0x7ff1c406d910 2024-05-20T17:54:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c17fa640 1 -- 172.21.15.6:0/776656083 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b400c940 con 0x7ff1c406d910 2024-05-20T17:54:28.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1c17fa640 1 -- 172.21.15.6:0/776656083 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400cd30 con 0x7ff1c406d910 2024-05-20T17:54:28.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.313+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c40c89a0 con 0x7ff1c406d910 2024-05-20T17:54:28.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.314+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c40c8f60 con 0x7ff1c406d910 2024-05-20T17:54:28.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.315+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c4075b00 con 0x7ff1c406d910 2024-05-20T17:54:28.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.315+0000 7ff1c17fa640 1 -- 172.21.15.6:0/776656083 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1b401a070 con 0x7ff1c406d910 2024-05-20T17:54:28.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.316+0000 7ff1c17fa640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1b006be60 0x7ff1b006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.316+0000 7ff1c17fa640 1 -- 172.21.15.6:0/776656083 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7ff1b408af10 con 0x7ff1c406d910 2024-05-20T17:54:28.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.316+0000 7ff1c3fff640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1b006be60 0x7ff1b006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.317+0000 7ff1c3fff640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1b006be60 0x7ff1b006e370 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4161d30 tx=0x7ff1b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:28.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.320+0000 7ff1c17fa640 1 -- 172.21.15.6:0/776656083 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff1b4059760 con 0x7ff1c406d910 2024-05-20T17:54:28.398 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-20T17:54:28.400+0000 7f7af3c43640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:54:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.503+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1c4161d60 con 0x7ff1b006be60 2024-05-20T17:54:28.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.510+0000 7ff1c17fa640 1 -- 172.21.15.6:0/776656083 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246635 (secure 0 0 0) 0x7ff1c4161d60 con 0x7ff1b006be60 2024-05-20T17:54:28.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1b006be60 msgr2=0x7ff1b006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1b006be60 0x7ff1b006e370 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4161d30 tx=0x7ff1b8008040 comp rx=0 tx=0).stop 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 msgr2=0x7ff1c414e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c414e3c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400e8d0 tx=0x7ff1b400ed90 comp rx=0 tx=0).stop 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 shutdown_connections 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1b006be60 0x7ff1b006e370 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1c4162820 0x7ff1c40c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1c40b3e80 0x7ff1c414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 --2- 172.21.15.6:0/776656083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1c406d910 0x7ff1c414e3c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 >> 172.21.15.6:0/776656083 conn(0x7ff1c40d4bd0 msgr2=0x7ff1c40b8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 shutdown_connections 2024-05-20T17:54:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.513+0000 7ff1cafd5640 1 -- 172.21.15.6:0/776656083 wait complete. 2024-05-20T17:54:28.523 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-05-20T17:54:28.252818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220560,"kb_used_data":4380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754160,"statfs":{"total":773094113280,"available":772868259840,"internally_reserved":0,"allocated":4485120,"data_stored":2586141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.837327"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427101+0000","last_change":"2024-05-20T17:54:23.427101+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427101+0000","last_undegraded":"2024-05-20T17:54:23.427101+0000","last_fullsized":"2024-05-20T17:54:23.427101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426352+0000","last_change":"2024-05-20T17:54:23.426352+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426352+0000","last_undegraded":"2024-05-20T17:54:23.426352+0000","last_fullsized":"2024-05-20T17:54:23.426352+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430129+0000","last_change":"2024-05-20T17:54:23.430129+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430129+0000","last_undegraded":"2024-05-20T17:54:23.430129+0000","last_fullsized":"2024-05-20T17:54:23.430129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428268+0000","last_change":"2024-05-20T17:54:23.428268+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428268+0000","last_undegraded":"2024-05-20T17:54:23.428268+0000","last_fullsized":"2024-05-20T17:54:23.428268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426271+0000","last_change":"2024-05-20T17:54:23.426271+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426271+0000","last_undegraded":"2024-05-20T17:54:23.426271+0000","last_fullsized":"2024-05-20T17:54:23.426271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427396+0000","last_change":"2024-05-20T17:54:23.427396+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427396+0000","last_undegraded":"2024-05-20T17:54:23.427396+0000","last_fullsized":"2024-05-20T17:54:23.427396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429141+0000","last_change":"2024-05-20T17:54:23.429141+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429141+0000","last_undegraded":"2024-05-20T17:54:23.429141+0000","last_fullsized":"2024-05-20T17:54:23.429141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425396+0000","last_change":"2024-05-20T17:54:23.425396+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425396+0000","last_undegraded":"2024-05-20T17:54:23.425396+0000","last_fullsized":"2024-05-20T17:54:23.425396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430395+0000","last_change":"2024-05-20T17:54:23.430395+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430395+0000","last_undegraded":"2024-05-20T17:54:23.430395+0000","last_fullsized":"2024-05-20T17:54:23.430395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431448+0000","last_change":"2024-05-20T17:54:23.431448+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431448+0000","last_undegraded":"2024-05-20T17:54:23.431448+0000","last_fullsized":"2024-05-20T17:54:23.431448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428407+0000","last_change":"2024-05-20T17:54:23.428407+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428407+0000","last_undegraded":"2024-05-20T17:54:23.428407+0000","last_fullsized":"2024-05-20T17:54:23.428407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431513+0000","last_change":"2024-05-20T17:54:23.431513+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431513+0000","last_undegraded":"2024-05-20T17:54:23.431513+0000","last_fullsized":"2024-05-20T17:54:23.431513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429235+0000","last_change":"2024-05-20T17:54:23.429235+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429235+0000","last_undegraded":"2024-05-20T17:54:23.429235+0000","last_fullsized":"2024-05-20T17:54:23.429235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425169+0000","last_change":"2024-05-20T17:54:23.425169+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425169+0000","last_undegraded":"2024-05-20T17:54:23.425169+0000","last_fullsized":"2024-05-20T17:54:23.425169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428575+0000","last_change":"2024-05-20T17:54:23.428575+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428575+0000","last_undegraded":"2024-05-20T17:54:23.428575+0000","last_fullsized":"2024-05-20T17:54:23.428575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431849+0000","last_change":"2024-05-20T17:54:23.431849+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431849+0000","last_undegraded":"2024-05-20T17:54:23.431849+0000","last_fullsized":"2024-05-20T17:54:23.431849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429934+0000","last_change":"2024-05-20T17:54:23.429934+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429934+0000","last_undegraded":"2024-05-20T17:54:23.429934+0000","last_fullsized":"2024-05-20T17:54:23.429934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422614+0000","last_change":"2024-05-20T17:54:23.422614+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422614+0000","last_undegraded":"2024-05-20T17:54:23.422614+0000","last_fullsized":"2024-05-20T17:54:23.422614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431653+0000","last_change":"2024-05-20T17:54:23.431653+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431653+0000","last_undegraded":"2024-05-20T17:54:23.431653+0000","last_fullsized":"2024-05-20T17:54:23.431653+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425392+0000","last_change":"2024-05-20T17:54:23.425392+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425392+0000","last_undegraded":"2024-05-20T17:54:23.425392+0000","last_fullsized":"2024-05-20T17:54:23.425392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428726+0000","last_change":"2024-05-20T17:54:23.428726+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428726+0000","last_undegraded":"2024-05-20T17:54:23.428726+0000","last_fullsized":"2024-05-20T17:54:23.428726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.423568+0000","last_change":"2024-05-20T17:54:23.423568+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.423568+0000","last_undegraded":"2024-05-20T17:54:23.423568+0000","last_fullsized":"2024-05-20T17:54:23.423568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429475+0000","last_change":"2024-05-20T17:54:23.429475+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429475+0000","last_undegraded":"2024-05-20T17:54:23.429475+0000","last_fullsized":"2024-05-20T17:54:23.429475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428463+0000","last_change":"2024-05-20T17:54:23.428463+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428463+0000","last_undegraded":"2024-05-20T17:54:23.428463+0000","last_fullsized":"2024-05-20T17:54:23.428463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422140+0000","last_change":"2024-05-20T17:54:23.422140+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422140+0000","last_undegraded":"2024-05-20T17:54:23.422140+0000","last_fullsized":"2024-05-20T17:54:23.422140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426848+0000","last_change":"2024-05-20T17:54:23.426848+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426848+0000","last_undegraded":"2024-05-20T17:54:23.426848+0000","last_fullsized":"2024-05-20T17:54:23.426848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421757+0000","last_change":"2024-05-20T17:54:23.421757+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421757+0000","last_undegraded":"2024-05-20T17:54:23.421757+0000","last_fullsized":"2024-05-20T17:54:23.421757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429672+0000","last_change":"2024-05-20T17:54:23.429672+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429672+0000","last_undegraded":"2024-05-20T17:54:23.429672+0000","last_fullsized":"2024-05-20T17:54:23.429672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421736+0000","last_change":"2024-05-20T17:54:23.421736+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421736+0000","last_undegraded":"2024-05-20T17:54:23.421736+0000","last_fullsized":"2024-05-20T17:54:23.421736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.423749+0000","last_change":"2024-05-20T17:54:23.423749+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.423749+0000","last_undegraded":"2024-05-20T17:54:23.423749+0000","last_fullsized":"2024-05-20T17:54:23.423749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428891+0000","last_change":"2024-05-20T17:54:23.428891+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428891+0000","last_undegraded":"2024-05-20T17:54:23.428891+0000","last_fullsized":"2024-05-20T17:54:23.428891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426216+0000","last_change":"2024-05-20T17:54:23.426216+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426216+0000","last_undegraded":"2024-05-20T17:54:23.426216+0000","last_fullsized":"2024-05-20T17:54:23.426216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431354+0000","last_change":"2024-05-20T17:54:23.431354+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431354+0000","last_undegraded":"2024-05-20T17:54:23.431354+0000","last_fullsized":"2024-05-20T17:54:23.431354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.429235+0000","last_change":"2024-05-20T17:54:23.426910+0000","last_active":"2024-05-20T17:54:23.429235+0000","last_peered":"2024-05-20T17:54:23.429235+0000","last_clean":"2024-05-20T17:54:23.429235+0000","last_became_active":"2024-05-20T17:54:23.426481+0000","last_became_peered":"2024-05-20T17:54:23.426481+0000","last_unstale":"2024-05-20T17:54:23.429235+0000","last_undegraded":"2024-05-20T17:54:23.429235+0000","last_fullsized":"2024-05-20T17:54:23.429235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425395+0000","last_change":"2024-05-20T17:54:23.425395+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425395+0000","last_undegraded":"2024-05-20T17:54:23.425395+0000","last_fullsized":"2024-05-20T17:54:23.425395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442733+0000","last_change":"2024-05-20T17:54:23.437864+0000","last_active":"2024-05-20T17:54:23.442733+0000","last_peered":"2024-05-20T17:54:23.442733+0000","last_clean":"2024-05-20T17:54:23.442733+0000","last_became_active":"2024-05-20T17:54:23.437555+0000","last_became_peered":"2024-05-20T17:54:23.437555+0000","last_unstale":"2024-05-20T17:54:23.442733+0000","last_undegraded":"2024-05-20T17:54:23.442733+0000","last_fullsized":"2024-05-20T17:54:23.442733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421392+0000","last_change":"2024-05-20T17:54:23.421392+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421392+0000","last_undegraded":"2024-05-20T17:54:23.421392+0000","last_fullsized":"2024-05-20T17:54:23.421392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443106+0000","last_change":"2024-05-20T17:54:23.437547+0000","last_active":"2024-05-20T17:54:23.443106+0000","last_peered":"2024-05-20T17:54:23.443106+0000","last_clean":"2024-05-20T17:54:23.443106+0000","last_became_active":"2024-05-20T17:54:23.436626+0000","last_became_peered":"2024-05-20T17:54:23.436626+0000","last_unstale":"2024-05-20T17:54:23.443106+0000","last_undegraded":"2024-05-20T17:54:23.443106+0000","last_fullsized":"2024-05-20T17:54:23.443106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426445+0000","last_change":"2024-05-20T17:54:23.426445+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426445+0000","last_undegraded":"2024-05-20T17:54:23.426445+0000","last_fullsized":"2024-05-20T17:54:23.426445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443501+0000","last_change":"2024-05-20T17:54:23.441212+0000","last_active":"2024-05-20T17:54:23.443501+0000","last_peered":"2024-05-20T17:54:23.443501+0000","last_clean":"2024-05-20T17:54:23.443501+0000","last_became_active":"2024-05-20T17:54:23.440875+0000","last_became_peered":"2024-05-20T17:54:23.440875+0000","last_unstale":"2024-05-20T17:54:23.443501+0000","last_undegraded":"2024-05-20T17:54:23.443501+0000","last_fullsized":"2024-05-20T17:54:23.443501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.433980+0000","last_change":"2024-05-20T17:54:23.433980+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.433980+0000","last_undegraded":"2024-05-20T17:54:23.433980+0000","last_fullsized":"2024-05-20T17:54:23.433980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445107+0000","last_change":"2024-05-20T17:54:23.441793+0000","last_active":"2024-05-20T17:54:23.445107+0000","last_peered":"2024-05-20T17:54:23.445107+0000","last_clean":"2024-05-20T17:54:23.445107+0000","last_became_active":"2024-05-20T17:54:23.441488+0000","last_became_peered":"2024-05-20T17:54:23.441488+0000","last_unstale":"2024-05-20T17:54:23.445107+0000","last_undegraded":"2024-05-20T17:54:23.445107+0000","last_fullsized":"2024-05-20T17:54:23.445107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:30.532097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427995+0000","last_change":"2024-05-20T17:54:23.427995+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427995+0000","last_undegraded":"2024-05-20T17:54:23.427995+0000","last_fullsized":"2024-05-20T17:54:23.427995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444446+0000","last_change":"2024-05-20T17:54:23.442954+0000","last_active":"2024-05-20T17:54:23.444446+0000","last_peered":"2024-05-20T17:54:23.444446+0000","last_clean":"2024-05-20T17:54:23.444446+0000","last_became_active":"2024-05-20T17:54:23.442646+0000","last_became_peered":"2024-05-20T17:54:23.442646+0000","last_unstale":"2024-05-20T17:54:23.444446+0000","last_undegraded":"2024-05-20T17:54:23.444446+0000","last_fullsized":"2024-05-20T17:54:23.444446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424131+0000","last_change":"2024-05-20T17:54:23.424131+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424131+0000","last_undegraded":"2024-05-20T17:54:23.424131+0000","last_fullsized":"2024-05-20T17:54:23.424131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443205+0000","last_change":"2024-05-20T17:54:23.439623+0000","last_active":"2024-05-20T17:54:23.443205+0000","last_peered":"2024-05-20T17:54:23.443205+0000","last_clean":"2024-05-20T17:54:23.443205+0000","last_became_active":"2024-05-20T17:54:23.439292+0000","last_became_peered":"2024-05-20T17:54:23.439292+0000","last_unstale":"2024-05-20T17:54:23.443205+0000","last_undegraded":"2024-05-20T17:54:23.443205+0000","last_fullsized":"2024-05-20T17:54:23.443205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425767+0000","last_change":"2024-05-20T17:54:23.425767+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425767+0000","last_undegraded":"2024-05-20T17:54:23.425767+0000","last_fullsized":"2024-05-20T17:54:23.425767+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441838+0000","last_change":"2024-05-20T17:54:23.432283+0000","last_active":"2024-05-20T17:54:23.441838+0000","last_peered":"2024-05-20T17:54:23.441838+0000","last_clean":"2024-05-20T17:54:23.441838+0000","last_became_active":"2024-05-20T17:54:23.431945+0000","last_became_peered":"2024-05-20T17:54:23.431945+0000","last_unstale":"2024-05-20T17:54:23.441838+0000","last_undegraded":"2024-05-20T17:54:23.441838+0000","last_fullsized":"2024-05-20T17:54:23.441838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:25:01.023822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425885+0000","last_change":"2024-05-20T17:54:23.425885+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425885+0000","last_undegraded":"2024-05-20T17:54:23.425885+0000","last_fullsized":"2024-05-20T17:54:23.425885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.437075+0000","last_change":"2024-05-20T17:54:23.430490+0000","last_active":"2024-05-20T17:54:23.437075+0000","last_peered":"2024-05-20T17:54:23.437075+0000","last_clean":"2024-05-20T17:54:23.437075+0000","last_became_active":"2024-05-20T17:54:23.430145+0000","last_became_peered":"2024-05-20T17:54:23.430145+0000","last_unstale":"2024-05-20T17:54:23.437075+0000","last_undegraded":"2024-05-20T17:54:23.437075+0000","last_fullsized":"2024-05-20T17:54:23.437075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:48.427860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430380+0000","last_change":"2024-05-20T17:54:23.430380+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430380+0000","last_undegraded":"2024-05-20T17:54:23.430380+0000","last_fullsized":"2024-05-20T17:54:23.430380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445154+0000","last_change":"2024-05-20T17:54:23.442823+0000","last_active":"2024-05-20T17:54:23.445154+0000","last_peered":"2024-05-20T17:54:23.445154+0000","last_clean":"2024-05-20T17:54:23.445154+0000","last_became_active":"2024-05-20T17:54:23.442499+0000","last_became_peered":"2024-05-20T17:54:23.442499+0000","last_unstale":"2024-05-20T17:54:23.445154+0000","last_undegraded":"2024-05-20T17:54:23.445154+0000","last_fullsized":"2024-05-20T17:54:23.445154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429959+0000","last_change":"2024-05-20T17:54:23.429959+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429959+0000","last_undegraded":"2024-05-20T17:54:23.429959+0000","last_fullsized":"2024-05-20T17:54:23.429959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443266+0000","last_change":"2024-05-20T17:54:23.434450+0000","last_active":"2024-05-20T17:54:23.443266+0000","last_peered":"2024-05-20T17:54:23.443266+0000","last_clean":"2024-05-20T17:54:23.443266+0000","last_became_active":"2024-05-20T17:54:23.433895+0000","last_became_peered":"2024-05-20T17:54:23.433895+0000","last_unstale":"2024-05-20T17:54:23.443266+0000","last_undegraded":"2024-05-20T17:54:23.443266+0000","last_fullsized":"2024-05-20T17:54:23.443266+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422880+0000","last_change":"2024-05-20T17:54:23.422880+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422880+0000","last_undegraded":"2024-05-20T17:54:23.422880+0000","last_fullsized":"2024-05-20T17:54:23.422880+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442469+0000","last_change":"2024-05-20T17:54:23.438713+0000","last_active":"2024-05-20T17:54:23.442469+0000","last_peered":"2024-05-20T17:54:23.442469+0000","last_clean":"2024-05-20T17:54:23.442469+0000","last_became_active":"2024-05-20T17:54:23.438399+0000","last_became_peered":"2024-05-20T17:54:23.438399+0000","last_unstale":"2024-05-20T17:54:23.442469+0000","last_undegraded":"2024-05-20T17:54:23.442469+0000","last_fullsized":"2024-05-20T17:54:23.442469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:06.072919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.433431+0000","last_change":"2024-05-20T17:54:23.433431+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.433431+0000","last_undegraded":"2024-05-20T17:54:23.433431+0000","last_fullsized":"2024-05-20T17:54:23.433431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443051+0000","last_change":"2024-05-20T17:54:23.441709+0000","last_active":"2024-05-20T17:54:23.443051+0000","last_peered":"2024-05-20T17:54:23.443051+0000","last_clean":"2024-05-20T17:54:23.443051+0000","last_became_active":"2024-05-20T17:54:23.441340+0000","last_became_peered":"2024-05-20T17:54:23.441340+0000","last_unstale":"2024-05-20T17:54:23.443051+0000","last_undegraded":"2024-05-20T17:54:23.443051+0000","last_fullsized":"2024-05-20T17:54:23.443051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:42.846897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424705+0000","last_change":"2024-05-20T17:54:23.424705+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424705+0000","last_undegraded":"2024-05-20T17:54:23.424705+0000","last_fullsized":"2024-05-20T17:54:23.424705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445696+0000","last_change":"2024-05-20T17:54:23.444497+0000","last_active":"2024-05-20T17:54:23.445696+0000","last_peered":"2024-05-20T17:54:23.445696+0000","last_clean":"2024-05-20T17:54:23.445696+0000","last_became_active":"2024-05-20T17:54:23.444103+0000","last_became_peered":"2024-05-20T17:54:23.444103+0000","last_unstale":"2024-05-20T17:54:23.445696+0000","last_undegraded":"2024-05-20T17:54:23.445696+0000","last_fullsized":"2024-05-20T17:54:23.445696+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430062+0000","last_change":"2024-05-20T17:54:23.430062+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430062+0000","last_undegraded":"2024-05-20T17:54:23.430062+0000","last_fullsized":"2024-05-20T17:54:23.430062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.429325+0000","last_change":"2024-05-20T17:54:23.427305+0000","last_active":"2024-05-20T17:54:23.429325+0000","last_peered":"2024-05-20T17:54:23.429325+0000","last_clean":"2024-05-20T17:54:23.429325+0000","last_became_active":"2024-05-20T17:54:23.426944+0000","last_became_peered":"2024-05-20T17:54:23.426944+0000","last_unstale":"2024-05-20T17:54:23.429325+0000","last_undegraded":"2024-05-20T17:54:23.429325+0000","last_fullsized":"2024-05-20T17:54:23.429325+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425255+0000","last_change":"2024-05-20T17:54:23.425255+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425255+0000","last_undegraded":"2024-05-20T17:54:23.425255+0000","last_fullsized":"2024-05-20T17:54:23.425255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444514+0000","last_change":"2024-05-20T17:54:23.443423+0000","last_active":"2024-05-20T17:54:23.444514+0000","last_peered":"2024-05-20T17:54:23.444514+0000","last_clean":"2024-05-20T17:54:23.444514+0000","last_became_active":"2024-05-20T17:54:23.443132+0000","last_became_peered":"2024-05-20T17:54:23.443132+0000","last_unstale":"2024-05-20T17:54:23.444514+0000","last_undegraded":"2024-05-20T17:54:23.444514+0000","last_fullsized":"2024-05-20T17:54:23.444514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424154+0000","last_change":"2024-05-20T17:54:23.424154+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424154+0000","last_undegraded":"2024-05-20T17:54:23.424154+0000","last_fullsized":"2024-05-20T17:54:23.424154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445078+0000","last_change":"2024-05-20T17:54:23.440734+0000","last_active":"2024-05-20T17:54:23.445078+0000","last_peered":"2024-05-20T17:54:23.445078+0000","last_clean":"2024-05-20T17:54:23.445078+0000","last_became_active":"2024-05-20T17:54:23.440413+0000","last_became_peered":"2024-05-20T17:54:23.440413+0000","last_unstale":"2024-05-20T17:54:23.445078+0000","last_undegraded":"2024-05-20T17:54:23.445078+0000","last_fullsized":"2024-05-20T17:54:23.445078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427758+0000","last_change":"2024-05-20T17:54:23.427758+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427758+0000","last_undegraded":"2024-05-20T17:54:23.427758+0000","last_fullsized":"2024-05-20T17:54:23.427758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442042+0000","last_change":"2024-05-20T17:54:23.437941+0000","last_active":"2024-05-20T17:54:23.442042+0000","last_peered":"2024-05-20T17:54:23.442042+0000","last_clean":"2024-05-20T17:54:23.442042+0000","last_became_active":"2024-05-20T17:54:23.437605+0000","last_became_peered":"2024-05-20T17:54:23.437605+0000","last_unstale":"2024-05-20T17:54:23.442042+0000","last_undegraded":"2024-05-20T17:54:23.442042+0000","last_fullsized":"2024-05-20T17:54:23.442042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421993+0000","last_change":"2024-05-20T17:54:23.421993+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421993+0000","last_undegraded":"2024-05-20T17:54:23.421993+0000","last_fullsized":"2024-05-20T17:54:23.421993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.440936+0000","last_change":"2024-05-20T17:54:23.438445+0000","last_active":"2024-05-20T17:54:23.440936+0000","last_peered":"2024-05-20T17:54:23.440936+0000","last_clean":"2024-05-20T17:54:23.440936+0000","last_became_active":"2024-05-20T17:54:23.438081+0000","last_became_peered":"2024-05-20T17:54:23.438081+0000","last_unstale":"2024-05-20T17:54:23.440936+0000","last_undegraded":"2024-05-20T17:54:23.440936+0000","last_fullsized":"2024-05-20T17:54:23.440936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:48:22.172410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427173+0000","last_change":"2024-05-20T17:54:23.427173+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427173+0000","last_undegraded":"2024-05-20T17:54:23.427173+0000","last_fullsized":"2024-05-20T17:54:23.427173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.440265+0000","last_change":"2024-05-20T17:54:23.435922+0000","last_active":"2024-05-20T17:54:23.440265+0000","last_peered":"2024-05-20T17:54:23.440265+0000","last_clean":"2024-05-20T17:54:23.440265+0000","last_became_active":"2024-05-20T17:54:23.435604+0000","last_became_peered":"2024-05-20T17:54:23.435604+0000","last_unstale":"2024-05-20T17:54:23.440265+0000","last_undegraded":"2024-05-20T17:54:23.440265+0000","last_fullsized":"2024-05-20T17:54:23.440265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431327+0000","last_change":"2024-05-20T17:54:23.431327+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431327+0000","last_undegraded":"2024-05-20T17:54:23.431327+0000","last_fullsized":"2024-05-20T17:54:23.431327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445451+0000","last_change":"2024-05-20T17:54:23.441585+0000","last_active":"2024-05-20T17:54:23.445451+0000","last_peered":"2024-05-20T17:54:23.445451+0000","last_clean":"2024-05-20T17:54:23.445451+0000","last_became_active":"2024-05-20T17:54:23.441237+0000","last_became_peered":"2024-05-20T17:54:23.441237+0000","last_unstale":"2024-05-20T17:54:23.445451+0000","last_undegraded":"2024-05-20T17:54:23.445451+0000","last_fullsized":"2024-05-20T17:54:23.445451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:49.039875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429306+0000","last_change":"2024-05-20T17:54:23.429306+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429306+0000","last_undegraded":"2024-05-20T17:54:23.429306+0000","last_fullsized":"2024-05-20T17:54:23.429306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445460+0000","last_change":"2024-05-20T17:54:23.442515+0000","last_active":"2024-05-20T17:54:23.445460+0000","last_peered":"2024-05-20T17:54:23.445460+0000","last_clean":"2024-05-20T17:54:23.445460+0000","last_became_active":"2024-05-20T17:54:23.442147+0000","last_became_peered":"2024-05-20T17:54:23.442147+0000","last_unstale":"2024-05-20T17:54:23.445460+0000","last_undegraded":"2024-05-20T17:54:23.445460+0000","last_fullsized":"2024-05-20T17:54:23.445460+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:16:33.309272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.432946+0000","last_change":"2024-05-20T17:54:23.432946+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.432946+0000","last_undegraded":"2024-05-20T17:54:23.432946+0000","last_fullsized":"2024-05-20T17:54:23.432946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442990+0000","last_change":"2024-05-20T17:54:23.439937+0000","last_active":"2024-05-20T17:54:23.442990+0000","last_peered":"2024-05-20T17:54:23.442990+0000","last_clean":"2024-05-20T17:54:23.442990+0000","last_became_active":"2024-05-20T17:54:23.439619+0000","last_became_peered":"2024-05-20T17:54:23.439619+0000","last_unstale":"2024-05-20T17:54:23.442990+0000","last_undegraded":"2024-05-20T17:54:23.442990+0000","last_fullsized":"2024-05-20T17:54:23.442990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424183+0000","last_change":"2024-05-20T17:54:23.424183+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424183+0000","last_undegraded":"2024-05-20T17:54:23.424183+0000","last_fullsized":"2024-05-20T17:54:23.424183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445675+0000","last_change":"2024-05-20T17:54:23.443863+0000","last_active":"2024-05-20T17:54:23.445675+0000","last_peered":"2024-05-20T17:54:23.445675+0000","last_clean":"2024-05-20T17:54:23.445675+0000","last_became_active":"2024-05-20T17:54:23.443474+0000","last_became_peered":"2024-05-20T17:54:23.443474+0000","last_unstale":"2024-05-20T17:54:23.445675+0000","last_undegraded":"2024-05-20T17:54:23.445675+0000","last_fullsized":"2024-05-20T17:54:23.445675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:28:12.976404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425702+0000","last_change":"2024-05-20T17:54:23.425702+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425702+0000","last_undegraded":"2024-05-20T17:54:23.425702+0000","last_fullsized":"2024-05-20T17:54:23.425702+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.446987+0000","last_change":"2024-05-20T17:54:23.444259+0000","last_active":"2024-05-20T17:54:23.446987+0000","last_peered":"2024-05-20T17:54:23.446987+0000","last_clean":"2024-05-20T17:54:23.446987+0000","last_became_active":"2024-05-20T17:54:23.443911+0000","last_became_peered":"2024-05-20T17:54:23.443911+0000","last_unstale":"2024-05-20T17:54:23.446987+0000","last_undegraded":"2024-05-20T17:54:23.446987+0000","last_fullsized":"2024-05-20T17:54:23.446987+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:34.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429833+0000","last_change":"2024-05-20T17:54:23.429833+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429833+0000","last_undegraded":"2024-05-20T17:54:23.429833+0000","last_fullsized":"2024-05-20T17:54:23.429833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441104+0000","last_change":"2024-05-20T17:54:23.439443+0000","last_active":"2024-05-20T17:54:23.441104+0000","last_peered":"2024-05-20T17:54:23.441104+0000","last_clean":"2024-05-20T17:54:23.441104+0000","last_became_active":"2024-05-20T17:54:23.439150+0000","last_became_peered":"2024-05-20T17:54:23.439150+0000","last_unstale":"2024-05-20T17:54:23.441104+0000","last_undegraded":"2024-05-20T17:54:23.441104+0000","last_fullsized":"2024-05-20T17:54:23.441104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:21:28.894509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424009+0000","last_change":"2024-05-20T17:54:23.424009+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424009+0000","last_undegraded":"2024-05-20T17:54:23.424009+0000","last_fullsized":"2024-05-20T17:54:23.424009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442170+0000","last_change":"2024-05-20T17:54:23.434953+0000","last_active":"2024-05-20T17:54:23.442170+0000","last_peered":"2024-05-20T17:54:23.442170+0000","last_clean":"2024-05-20T17:54:23.442170+0000","last_became_active":"2024-05-20T17:54:23.434622+0000","last_became_peered":"2024-05-20T17:54:23.434622+0000","last_unstale":"2024-05-20T17:54:23.442170+0000","last_undegraded":"2024-05-20T17:54:23.442170+0000","last_fullsized":"2024-05-20T17:54:23.442170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430867+0000","last_change":"2024-05-20T17:54:23.430867+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430867+0000","last_undegraded":"2024-05-20T17:54:23.430867+0000","last_fullsized":"2024-05-20T17:54:23.430867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442564+0000","last_change":"2024-05-20T17:54:23.436462+0000","last_active":"2024-05-20T17:54:23.442564+0000","last_peered":"2024-05-20T17:54:23.442564+0000","last_clean":"2024-05-20T17:54:23.442564+0000","last_became_active":"2024-05-20T17:54:23.436148+0000","last_became_peered":"2024-05-20T17:54:23.436148+0000","last_unstale":"2024-05-20T17:54:23.442564+0000","last_undegraded":"2024-05-20T17:54:23.442564+0000","last_fullsized":"2024-05-20T17:54:23.442564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426378+0000","last_change":"2024-05-20T17:54:23.426378+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426378+0000","last_undegraded":"2024-05-20T17:54:23.426378+0000","last_fullsized":"2024-05-20T17:54:23.426378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.439117+0000","last_change":"2024-05-20T17:54:23.435232+0000","last_active":"2024-05-20T17:54:23.439117+0000","last_peered":"2024-05-20T17:54:23.439117+0000","last_clean":"2024-05-20T17:54:23.439117+0000","last_became_active":"2024-05-20T17:54:23.434898+0000","last_became_peered":"2024-05-20T17:54:23.434898+0000","last_unstale":"2024-05-20T17:54:23.439117+0000","last_undegraded":"2024-05-20T17:54:23.439117+0000","last_fullsized":"2024-05-20T17:54:23.439117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424665+0000","last_change":"2024-05-20T17:54:23.424665+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424665+0000","last_undegraded":"2024-05-20T17:54:23.424665+0000","last_fullsized":"2024-05-20T17:54:23.424665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441905+0000","last_change":"2024-05-20T17:54:23.438769+0000","last_active":"2024-05-20T17:54:23.441905+0000","last_peered":"2024-05-20T17:54:23.441905+0000","last_clean":"2024-05-20T17:54:23.441905+0000","last_became_active":"2024-05-20T17:54:23.438432+0000","last_became_peered":"2024-05-20T17:54:23.438432+0000","last_unstale":"2024-05-20T17:54:23.441905+0000","last_undegraded":"2024-05-20T17:54:23.441905+0000","last_fullsized":"2024-05-20T17:54:23.441905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431614+0000","last_change":"2024-05-20T17:54:23.431614+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431614+0000","last_undegraded":"2024-05-20T17:54:23.431614+0000","last_fullsized":"2024-05-20T17:54:23.431614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.437123+0000","last_change":"2024-05-20T17:54:23.429638+0000","last_active":"2024-05-20T17:54:23.437123+0000","last_peered":"2024-05-20T17:54:23.437123+0000","last_clean":"2024-05-20T17:54:23.437123+0000","last_became_active":"2024-05-20T17:54:23.429302+0000","last_became_peered":"2024-05-20T17:54:23.429302+0000","last_unstale":"2024-05-20T17:54:23.437123+0000","last_undegraded":"2024-05-20T17:54:23.437123+0000","last_fullsized":"2024-05-20T17:54:23.437123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:55.833142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431307+0000","last_change":"2024-05-20T17:54:23.431307+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431307+0000","last_undegraded":"2024-05-20T17:54:23.431307+0000","last_fullsized":"2024-05-20T17:54:23.431307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444086+0000","last_change":"2024-05-20T17:54:23.442483+0000","last_active":"2024-05-20T17:54:23.444086+0000","last_peered":"2024-05-20T17:54:23.444086+0000","last_clean":"2024-05-20T17:54:23.444086+0000","last_became_active":"2024-05-20T17:54:23.442157+0000","last_became_peered":"2024-05-20T17:54:23.442157+0000","last_unstale":"2024-05-20T17:54:23.444086+0000","last_undegraded":"2024-05-20T17:54:23.444086+0000","last_fullsized":"2024-05-20T17:54:23.444086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.433040+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:54:23.433040+0000","last_peered":"2024-05-20T17:54:23.433040+0000","last_clean":"2024-05-20T17:54:23.433040+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:54:23.433040+0000","last_undegraded":"2024-05-20T17:54:23.433040+0000","last_fullsized":"2024-05-20T17:54:23.433040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:54:28.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:54:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.680+0000 7fdca3699640 1 Processor -- start 2024-05-20T17:54:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.680+0000 7fdca3699640 1 -- start start 2024-05-20T17:54:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca3699640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc9c0ce7e0 0x7fdc9c0cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca3699640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9c0cf130 con 0x7fdc9c0cf3d0 2024-05-20T17:54:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca3699640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9c0cda20 con 0x7fdc9c15f220 2024-05-20T17:54:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca3699640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdc9c0cdd00 con 0x7fdc9c0ce7e0 2024-05-20T17:54:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca1c36640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc9c0ce7e0 0x7fdc9c0cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca1c36640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc9c0ce7e0 0x7fdc9c0cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33238/0 (socket says 172.21.15.6:33238) 2024-05-20T17:54:28.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca0c34640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc9c0cf3d0 0x7fdc9c0cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40416/0 (socket says 172.21.15.6:40416) 2024-05-20T17:54:28.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca1c36640 1 -- 172.21.15.6:0/2415887 learned_addr learned my addr 172.21.15.6:0/2415887 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:28.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca1c36640 1 -- 172.21.15.6:0/2415887 >> v1:172.21.15.171:6789/0 conn(0x7fdc9c15f220 legacy=0x7fdc9c0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca1c36640 1 -- 172.21.15.6:0/2415887 >> v1:172.21.15.6:6789/0 conn(0x7fdc9c0cf3d0 legacy=0x7fdc9c0cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.682+0000 7fdca1c36640 1 -- 172.21.15.6:0/2415887 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c0cdfe0 con 0x7fdc9c0ce7e0 2024-05-20T17:54:28.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.683+0000 7fdca1c36640 1 --2- 172.21.15.6:0/2415887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c0ce7e0 0x7fdc9c0cebf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009e50 tx=0x7fdc9402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c697ddf11e7cdd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:28.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.683+0000 7fdc93fff640 1 -- 172.21.15.6:0/2415887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94036070 con 0x7fdc9c0ce7e0 2024-05-20T17:54:28.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.683+0000 7fdc93fff640 1 -- 172.21.15.6:0/2415887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc94031600 con 0x7fdc9c0ce7e0 2024-05-20T17:54:28.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.683+0000 7fdc93fff640 1 -- 172.21.15.6:0/2415887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc940319d0 con 0x7fdc9c0ce7e0 2024-05-20T17:54:28.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.684+0000 7fdca3699640 1 -- 172.21.15.6:0/2415887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c0ce7e0 msgr2=0x7fdc9c0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.684+0000 7fdca3699640 1 --2- 172.21.15.6:0/2415887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c0ce7e0 0x7fdc9c0cebf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009e50 tx=0x7fdc9402a730 comp rx=0 tx=0).stop 2024-05-20T17:54:28.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.684+0000 7fdca3699640 1 -- 172.21.15.6:0/2415887 shutdown_connections 2024-05-20T17:54:28.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.684+0000 7fdca3699640 1 --2- 172.21.15.6:0/2415887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c0ce7e0 0x7fdc9c0cebf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.684+0000 7fdca3699640 1 -- 172.21.15.6:0/2415887 >> 172.21.15.6:0/2415887 conn(0x7fdc9c0b44d0 msgr2=0x7fdc9c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:28.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.684+0000 7fdca3699640 1 -- 172.21.15.6:0/2415887 shutdown_connections 2024-05-20T17:54:28.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.684+0000 7fdca3699640 1 -- 172.21.15.6:0/2415887 wait complete. 2024-05-20T17:54:28.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.686+0000 7fdca3699640 1 Processor -- start 2024-05-20T17:54:28.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.686+0000 7fdca3699640 1 -- start start 2024-05-20T17:54:28.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca3699640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc9c0ce7e0 0x7fdc9c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca3699640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc9c0cf3d0 0x7fdc9c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca3699640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c15f220 0x7fdc9c148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca3699640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c0cd680 con 0x7fdc9c15f220 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca3699640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c0d0fd0 con 0x7fdc9c0ce7e0 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca3699640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c0cd800 con 0x7fdc9c0cf3d0 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c15f220 0x7fdc9c148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c15f220 0x7fdc9c148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33240/0 (socket says 172.21.15.6:33240) 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 -- 172.21.15.6:0/685941648 learned_addr learned my addr 172.21.15.6:0/685941648 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca0c34640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc9c0cf3d0 0x7fdc9c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1435640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc9c0ce7e0 0x7fdc9c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 -- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc9c0cf3d0 msgr2=0x7fdc9c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc9c0cf3d0 0x7fdc9c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 -- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc9c0ce7e0 msgr2=0x7fdc9c0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc9c0ce7e0 0x7fdc9c0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 -- 172.21.15.6:0/685941648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c0cc840 con 0x7fdc9c15f220 2024-05-20T17:54:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.687+0000 7fdca1c36640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c15f220 0x7fdc9c148ca0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009f70 tx=0x7fdc94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.688+0000 7fdc91ffb640 1 -- 172.21.15.6:0/685941648 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94036050 con 0x7fdc9c15f220 2024-05-20T17:54:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.688+0000 7fdc91ffb640 1 -- 172.21.15.6:0/685941648 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc94042070 con 0x7fdc9c15f220 2024-05-20T17:54:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.688+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c1491e0 con 0x7fdc9c15f220 2024-05-20T17:54:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.688+0000 7fdc91ffb640 1 -- 172.21.15.6:0/685941648 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94009510 con 0x7fdc9c15f220 2024-05-20T17:54:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.688+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c0cc280 con 0x7fdc9c15f220 2024-05-20T17:54:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.689+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9c075b00 con 0x7fdc9c15f220 2024-05-20T17:54:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.689+0000 7fdc91ffb640 1 -- 172.21.15.6:0/685941648 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc94007bf0 con 0x7fdc9c15f220 2024-05-20T17:54:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.690+0000 7fdc91ffb640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdc8006be30 0x7fdc8006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.690+0000 7fdc91ffb640 1 -- 172.21.15.6:0/685941648 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fdc940abf80 con 0x7fdc9c15f220 2024-05-20T17:54:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.690+0000 7fdca1435640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdc8006be30 0x7fdc8006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.691+0000 7fdca1435640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdc8006be30 0x7fdc8006e340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdc98000f60 tx=0x7fdc98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.695+0000 7fdc91ffb640 1 -- 172.21.15.6:0/685941648 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdc9407a7a0 con 0x7fdc9c15f220 2024-05-20T17:54:28.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.877+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc9c0cbd30 con 0x7fdc8006be30 2024-05-20T17:54:28.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.884+0000 7fdc91ffb640 1 -- 172.21.15.6:0/685941648 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246635 (secure 0 0 0) 0x7fdc9c0cbd30 con 0x7fdc8006be30 2024-05-20T17:54:28.884 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdc8006be30 msgr2=0x7fdc8006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdc8006be30 0x7fdc8006e340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdc98000f60 tx=0x7fdc98009040 comp rx=0 tx=0).stop 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c15f220 msgr2=0x7fdc9c148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c15f220 0x7fdc9c148ca0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009f70 tx=0x7fdc94004a40 comp rx=0 tx=0).stop 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 shutdown_connections 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdc8006be30 0x7fdc8006e340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc9c15f220 0x7fdc9c148ca0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdc9c0cf3d0 0x7fdc9c0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 --2- 172.21.15.6:0/685941648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdc9c0ce7e0 0x7fdc9c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 >> 172.21.15.6:0/685941648 conn(0x7fdc9c0b44d0 msgr2=0x7fdc9c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 shutdown_connections 2024-05-20T17:54:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:28.887+0000 7fdca3699640 1 -- 172.21.15.6:0/685941648 wait complete. 2024-05-20T17:54:28.896 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-05-20T17:54:28.252818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220560,"kb_used_data":4380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754160,"statfs":{"total":773094113280,"available":772868259840,"internally_reserved":0,"allocated":4485120,"data_stored":2586141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.837327"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427101+0000","last_change":"2024-05-20T17:54:23.427101+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427101+0000","last_undegraded":"2024-05-20T17:54:23.427101+0000","last_fullsized":"2024-05-20T17:54:23.427101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426352+0000","last_change":"2024-05-20T17:54:23.426352+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426352+0000","last_undegraded":"2024-05-20T17:54:23.426352+0000","last_fullsized":"2024-05-20T17:54:23.426352+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430129+0000","last_change":"2024-05-20T17:54:23.430129+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430129+0000","last_undegraded":"2024-05-20T17:54:23.430129+0000","last_fullsized":"2024-05-20T17:54:23.430129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428268+0000","last_change":"2024-05-20T17:54:23.428268+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428268+0000","last_undegraded":"2024-05-20T17:54:23.428268+0000","last_fullsized":"2024-05-20T17:54:23.428268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426271+0000","last_change":"2024-05-20T17:54:23.426271+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426271+0000","last_undegraded":"2024-05-20T17:54:23.426271+0000","last_fullsized":"2024-05-20T17:54:23.426271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427396+0000","last_change":"2024-05-20T17:54:23.427396+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427396+0000","last_undegraded":"2024-05-20T17:54:23.427396+0000","last_fullsized":"2024-05-20T17:54:23.427396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429141+0000","last_change":"2024-05-20T17:54:23.429141+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429141+0000","last_undegraded":"2024-05-20T17:54:23.429141+0000","last_fullsized":"2024-05-20T17:54:23.429141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425396+0000","last_change":"2024-05-20T17:54:23.425396+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425396+0000","last_undegraded":"2024-05-20T17:54:23.425396+0000","last_fullsized":"2024-05-20T17:54:23.425396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430395+0000","last_change":"2024-05-20T17:54:23.430395+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430395+0000","last_undegraded":"2024-05-20T17:54:23.430395+0000","last_fullsized":"2024-05-20T17:54:23.430395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431448+0000","last_change":"2024-05-20T17:54:23.431448+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431448+0000","last_undegraded":"2024-05-20T17:54:23.431448+0000","last_fullsized":"2024-05-20T17:54:23.431448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428407+0000","last_change":"2024-05-20T17:54:23.428407+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428407+0000","last_undegraded":"2024-05-20T17:54:23.428407+0000","last_fullsized":"2024-05-20T17:54:23.428407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431513+0000","last_change":"2024-05-20T17:54:23.431513+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431513+0000","last_undegraded":"2024-05-20T17:54:23.431513+0000","last_fullsized":"2024-05-20T17:54:23.431513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429235+0000","last_change":"2024-05-20T17:54:23.429235+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429235+0000","last_undegraded":"2024-05-20T17:54:23.429235+0000","last_fullsized":"2024-05-20T17:54:23.429235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425169+0000","last_change":"2024-05-20T17:54:23.425169+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425169+0000","last_undegraded":"2024-05-20T17:54:23.425169+0000","last_fullsized":"2024-05-20T17:54:23.425169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428575+0000","last_change":"2024-05-20T17:54:23.428575+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428575+0000","last_undegraded":"2024-05-20T17:54:23.428575+0000","last_fullsized":"2024-05-20T17:54:23.428575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431849+0000","last_change":"2024-05-20T17:54:23.431849+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431849+0000","last_undegraded":"2024-05-20T17:54:23.431849+0000","last_fullsized":"2024-05-20T17:54:23.431849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429934+0000","last_change":"2024-05-20T17:54:23.429934+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429934+0000","last_undegraded":"2024-05-20T17:54:23.429934+0000","last_fullsized":"2024-05-20T17:54:23.429934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422614+0000","last_change":"2024-05-20T17:54:23.422614+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422614+0000","last_undegraded":"2024-05-20T17:54:23.422614+0000","last_fullsized":"2024-05-20T17:54:23.422614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431653+0000","last_change":"2024-05-20T17:54:23.431653+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431653+0000","last_undegraded":"2024-05-20T17:54:23.431653+0000","last_fullsized":"2024-05-20T17:54:23.431653+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425392+0000","last_change":"2024-05-20T17:54:23.425392+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425392+0000","last_undegraded":"2024-05-20T17:54:23.425392+0000","last_fullsized":"2024-05-20T17:54:23.425392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428726+0000","last_change":"2024-05-20T17:54:23.428726+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428726+0000","last_undegraded":"2024-05-20T17:54:23.428726+0000","last_fullsized":"2024-05-20T17:54:23.428726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.423568+0000","last_change":"2024-05-20T17:54:23.423568+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.423568+0000","last_undegraded":"2024-05-20T17:54:23.423568+0000","last_fullsized":"2024-05-20T17:54:23.423568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429475+0000","last_change":"2024-05-20T17:54:23.429475+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429475+0000","last_undegraded":"2024-05-20T17:54:23.429475+0000","last_fullsized":"2024-05-20T17:54:23.429475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428463+0000","last_change":"2024-05-20T17:54:23.428463+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428463+0000","last_undegraded":"2024-05-20T17:54:23.428463+0000","last_fullsized":"2024-05-20T17:54:23.428463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422140+0000","last_change":"2024-05-20T17:54:23.422140+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422140+0000","last_undegraded":"2024-05-20T17:54:23.422140+0000","last_fullsized":"2024-05-20T17:54:23.422140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426848+0000","last_change":"2024-05-20T17:54:23.426848+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426848+0000","last_undegraded":"2024-05-20T17:54:23.426848+0000","last_fullsized":"2024-05-20T17:54:23.426848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421757+0000","last_change":"2024-05-20T17:54:23.421757+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421757+0000","last_undegraded":"2024-05-20T17:54:23.421757+0000","last_fullsized":"2024-05-20T17:54:23.421757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429672+0000","last_change":"2024-05-20T17:54:23.429672+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429672+0000","last_undegraded":"2024-05-20T17:54:23.429672+0000","last_fullsized":"2024-05-20T17:54:23.429672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421736+0000","last_change":"2024-05-20T17:54:23.421736+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421736+0000","last_undegraded":"2024-05-20T17:54:23.421736+0000","last_fullsized":"2024-05-20T17:54:23.421736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.423749+0000","last_change":"2024-05-20T17:54:23.423749+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.423749+0000","last_undegraded":"2024-05-20T17:54:23.423749+0000","last_fullsized":"2024-05-20T17:54:23.423749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428891+0000","last_change":"2024-05-20T17:54:23.428891+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428891+0000","last_undegraded":"2024-05-20T17:54:23.428891+0000","last_fullsized":"2024-05-20T17:54:23.428891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426216+0000","last_change":"2024-05-20T17:54:23.426216+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426216+0000","last_undegraded":"2024-05-20T17:54:23.426216+0000","last_fullsized":"2024-05-20T17:54:23.426216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431354+0000","last_change":"2024-05-20T17:54:23.431354+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431354+0000","last_undegraded":"2024-05-20T17:54:23.431354+0000","last_fullsized":"2024-05-20T17:54:23.431354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.429235+0000","last_change":"2024-05-20T17:54:23.426910+0000","last_active":"2024-05-20T17:54:23.429235+0000","last_peered":"2024-05-20T17:54:23.429235+0000","last_clean":"2024-05-20T17:54:23.429235+0000","last_became_active":"2024-05-20T17:54:23.426481+0000","last_became_peered":"2024-05-20T17:54:23.426481+0000","last_unstale":"2024-05-20T17:54:23.429235+0000","last_undegraded":"2024-05-20T17:54:23.429235+0000","last_fullsized":"2024-05-20T17:54:23.429235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425395+0000","last_change":"2024-05-20T17:54:23.425395+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425395+0000","last_undegraded":"2024-05-20T17:54:23.425395+0000","last_fullsized":"2024-05-20T17:54:23.425395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442733+0000","last_change":"2024-05-20T17:54:23.437864+0000","last_active":"2024-05-20T17:54:23.442733+0000","last_peered":"2024-05-20T17:54:23.442733+0000","last_clean":"2024-05-20T17:54:23.442733+0000","last_became_active":"2024-05-20T17:54:23.437555+0000","last_became_peered":"2024-05-20T17:54:23.437555+0000","last_unstale":"2024-05-20T17:54:23.442733+0000","last_undegraded":"2024-05-20T17:54:23.442733+0000","last_fullsized":"2024-05-20T17:54:23.442733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421392+0000","last_change":"2024-05-20T17:54:23.421392+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421392+0000","last_undegraded":"2024-05-20T17:54:23.421392+0000","last_fullsized":"2024-05-20T17:54:23.421392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443106+0000","last_change":"2024-05-20T17:54:23.437547+0000","last_active":"2024-05-20T17:54:23.443106+0000","last_peered":"2024-05-20T17:54:23.443106+0000","last_clean":"2024-05-20T17:54:23.443106+0000","last_became_active":"2024-05-20T17:54:23.436626+0000","last_became_peered":"2024-05-20T17:54:23.436626+0000","last_unstale":"2024-05-20T17:54:23.443106+0000","last_undegraded":"2024-05-20T17:54:23.443106+0000","last_fullsized":"2024-05-20T17:54:23.443106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426445+0000","last_change":"2024-05-20T17:54:23.426445+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426445+0000","last_undegraded":"2024-05-20T17:54:23.426445+0000","last_fullsized":"2024-05-20T17:54:23.426445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443501+0000","last_change":"2024-05-20T17:54:23.441212+0000","last_active":"2024-05-20T17:54:23.443501+0000","last_peered":"2024-05-20T17:54:23.443501+0000","last_clean":"2024-05-20T17:54:23.443501+0000","last_became_active":"2024-05-20T17:54:23.440875+0000","last_became_peered":"2024-05-20T17:54:23.440875+0000","last_unstale":"2024-05-20T17:54:23.443501+0000","last_undegraded":"2024-05-20T17:54:23.443501+0000","last_fullsized":"2024-05-20T17:54:23.443501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.433980+0000","last_change":"2024-05-20T17:54:23.433980+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.433980+0000","last_undegraded":"2024-05-20T17:54:23.433980+0000","last_fullsized":"2024-05-20T17:54:23.433980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445107+0000","last_change":"2024-05-20T17:54:23.441793+0000","last_active":"2024-05-20T17:54:23.445107+0000","last_peered":"2024-05-20T17:54:23.445107+0000","last_clean":"2024-05-20T17:54:23.445107+0000","last_became_active":"2024-05-20T17:54:23.441488+0000","last_became_peered":"2024-05-20T17:54:23.441488+0000","last_unstale":"2024-05-20T17:54:23.445107+0000","last_undegraded":"2024-05-20T17:54:23.445107+0000","last_fullsized":"2024-05-20T17:54:23.445107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:30.532097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427995+0000","last_change":"2024-05-20T17:54:23.427995+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427995+0000","last_undegraded":"2024-05-20T17:54:23.427995+0000","last_fullsized":"2024-05-20T17:54:23.427995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444446+0000","last_change":"2024-05-20T17:54:23.442954+0000","last_active":"2024-05-20T17:54:23.444446+0000","last_peered":"2024-05-20T17:54:23.444446+0000","last_clean":"2024-05-20T17:54:23.444446+0000","last_became_active":"2024-05-20T17:54:23.442646+0000","last_became_peered":"2024-05-20T17:54:23.442646+0000","last_unstale":"2024-05-20T17:54:23.444446+0000","last_undegraded":"2024-05-20T17:54:23.444446+0000","last_fullsized":"2024-05-20T17:54:23.444446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424131+0000","last_change":"2024-05-20T17:54:23.424131+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424131+0000","last_undegraded":"2024-05-20T17:54:23.424131+0000","last_fullsized":"2024-05-20T17:54:23.424131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443205+0000","last_change":"2024-05-20T17:54:23.439623+0000","last_active":"2024-05-20T17:54:23.443205+0000","last_peered":"2024-05-20T17:54:23.443205+0000","last_clean":"2024-05-20T17:54:23.443205+0000","last_became_active":"2024-05-20T17:54:23.439292+0000","last_became_peered":"2024-05-20T17:54:23.439292+0000","last_unstale":"2024-05-20T17:54:23.443205+0000","last_undegraded":"2024-05-20T17:54:23.443205+0000","last_fullsized":"2024-05-20T17:54:23.443205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425767+0000","last_change":"2024-05-20T17:54:23.425767+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425767+0000","last_undegraded":"2024-05-20T17:54:23.425767+0000","last_fullsized":"2024-05-20T17:54:23.425767+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441838+0000","last_change":"2024-05-20T17:54:23.432283+0000","last_active":"2024-05-20T17:54:23.441838+0000","last_peered":"2024-05-20T17:54:23.441838+0000","last_clean":"2024-05-20T17:54:23.441838+0000","last_became_active":"2024-05-20T17:54:23.431945+0000","last_became_peered":"2024-05-20T17:54:23.431945+0000","last_unstale":"2024-05-20T17:54:23.441838+0000","last_undegraded":"2024-05-20T17:54:23.441838+0000","last_fullsized":"2024-05-20T17:54:23.441838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:25:01.023822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425885+0000","last_change":"2024-05-20T17:54:23.425885+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425885+0000","last_undegraded":"2024-05-20T17:54:23.425885+0000","last_fullsized":"2024-05-20T17:54:23.425885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.437075+0000","last_change":"2024-05-20T17:54:23.430490+0000","last_active":"2024-05-20T17:54:23.437075+0000","last_peered":"2024-05-20T17:54:23.437075+0000","last_clean":"2024-05-20T17:54:23.437075+0000","last_became_active":"2024-05-20T17:54:23.430145+0000","last_became_peered":"2024-05-20T17:54:23.430145+0000","last_unstale":"2024-05-20T17:54:23.437075+0000","last_undegraded":"2024-05-20T17:54:23.437075+0000","last_fullsized":"2024-05-20T17:54:23.437075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:48.427860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430380+0000","last_change":"2024-05-20T17:54:23.430380+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430380+0000","last_undegraded":"2024-05-20T17:54:23.430380+0000","last_fullsized":"2024-05-20T17:54:23.430380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445154+0000","last_change":"2024-05-20T17:54:23.442823+0000","last_active":"2024-05-20T17:54:23.445154+0000","last_peered":"2024-05-20T17:54:23.445154+0000","last_clean":"2024-05-20T17:54:23.445154+0000","last_became_active":"2024-05-20T17:54:23.442499+0000","last_became_peered":"2024-05-20T17:54:23.442499+0000","last_unstale":"2024-05-20T17:54:23.445154+0000","last_undegraded":"2024-05-20T17:54:23.445154+0000","last_fullsized":"2024-05-20T17:54:23.445154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429959+0000","last_change":"2024-05-20T17:54:23.429959+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429959+0000","last_undegraded":"2024-05-20T17:54:23.429959+0000","last_fullsized":"2024-05-20T17:54:23.429959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443266+0000","last_change":"2024-05-20T17:54:23.434450+0000","last_active":"2024-05-20T17:54:23.443266+0000","last_peered":"2024-05-20T17:54:23.443266+0000","last_clean":"2024-05-20T17:54:23.443266+0000","last_became_active":"2024-05-20T17:54:23.433895+0000","last_became_peered":"2024-05-20T17:54:23.433895+0000","last_unstale":"2024-05-20T17:54:23.443266+0000","last_undegraded":"2024-05-20T17:54:23.443266+0000","last_fullsized":"2024-05-20T17:54:23.443266+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422880+0000","last_change":"2024-05-20T17:54:23.422880+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422880+0000","last_undegraded":"2024-05-20T17:54:23.422880+0000","last_fullsized":"2024-05-20T17:54:23.422880+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442469+0000","last_change":"2024-05-20T17:54:23.438713+0000","last_active":"2024-05-20T17:54:23.442469+0000","last_peered":"2024-05-20T17:54:23.442469+0000","last_clean":"2024-05-20T17:54:23.442469+0000","last_became_active":"2024-05-20T17:54:23.438399+0000","last_became_peered":"2024-05-20T17:54:23.438399+0000","last_unstale":"2024-05-20T17:54:23.442469+0000","last_undegraded":"2024-05-20T17:54:23.442469+0000","last_fullsized":"2024-05-20T17:54:23.442469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:06.072919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.433431+0000","last_change":"2024-05-20T17:54:23.433431+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.433431+0000","last_undegraded":"2024-05-20T17:54:23.433431+0000","last_fullsized":"2024-05-20T17:54:23.433431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443051+0000","last_change":"2024-05-20T17:54:23.441709+0000","last_active":"2024-05-20T17:54:23.443051+0000","last_peered":"2024-05-20T17:54:23.443051+0000","last_clean":"2024-05-20T17:54:23.443051+0000","last_became_active":"2024-05-20T17:54:23.441340+0000","last_became_peered":"2024-05-20T17:54:23.441340+0000","last_unstale":"2024-05-20T17:54:23.443051+0000","last_undegraded":"2024-05-20T17:54:23.443051+0000","last_fullsized":"2024-05-20T17:54:23.443051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:42.846897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424705+0000","last_change":"2024-05-20T17:54:23.424705+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424705+0000","last_undegraded":"2024-05-20T17:54:23.424705+0000","last_fullsized":"2024-05-20T17:54:23.424705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445696+0000","last_change":"2024-05-20T17:54:23.444497+0000","last_active":"2024-05-20T17:54:23.445696+0000","last_peered":"2024-05-20T17:54:23.445696+0000","last_clean":"2024-05-20T17:54:23.445696+0000","last_became_active":"2024-05-20T17:54:23.444103+0000","last_became_peered":"2024-05-20T17:54:23.444103+0000","last_unstale":"2024-05-20T17:54:23.445696+0000","last_undegraded":"2024-05-20T17:54:23.445696+0000","last_fullsized":"2024-05-20T17:54:23.445696+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430062+0000","last_change":"2024-05-20T17:54:23.430062+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430062+0000","last_undegraded":"2024-05-20T17:54:23.430062+0000","last_fullsized":"2024-05-20T17:54:23.430062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.429325+0000","last_change":"2024-05-20T17:54:23.427305+0000","last_active":"2024-05-20T17:54:23.429325+0000","last_peered":"2024-05-20T17:54:23.429325+0000","last_clean":"2024-05-20T17:54:23.429325+0000","last_became_active":"2024-05-20T17:54:23.426944+0000","last_became_peered":"2024-05-20T17:54:23.426944+0000","last_unstale":"2024-05-20T17:54:23.429325+0000","last_undegraded":"2024-05-20T17:54:23.429325+0000","last_fullsized":"2024-05-20T17:54:23.429325+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425255+0000","last_change":"2024-05-20T17:54:23.425255+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425255+0000","last_undegraded":"2024-05-20T17:54:23.425255+0000","last_fullsized":"2024-05-20T17:54:23.425255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444514+0000","last_change":"2024-05-20T17:54:23.443423+0000","last_active":"2024-05-20T17:54:23.444514+0000","last_peered":"2024-05-20T17:54:23.444514+0000","last_clean":"2024-05-20T17:54:23.444514+0000","last_became_active":"2024-05-20T17:54:23.443132+0000","last_became_peered":"2024-05-20T17:54:23.443132+0000","last_unstale":"2024-05-20T17:54:23.444514+0000","last_undegraded":"2024-05-20T17:54:23.444514+0000","last_fullsized":"2024-05-20T17:54:23.444514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424154+0000","last_change":"2024-05-20T17:54:23.424154+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424154+0000","last_undegraded":"2024-05-20T17:54:23.424154+0000","last_fullsized":"2024-05-20T17:54:23.424154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445078+0000","last_change":"2024-05-20T17:54:23.440734+0000","last_active":"2024-05-20T17:54:23.445078+0000","last_peered":"2024-05-20T17:54:23.445078+0000","last_clean":"2024-05-20T17:54:23.445078+0000","last_became_active":"2024-05-20T17:54:23.440413+0000","last_became_peered":"2024-05-20T17:54:23.440413+0000","last_unstale":"2024-05-20T17:54:23.445078+0000","last_undegraded":"2024-05-20T17:54:23.445078+0000","last_fullsized":"2024-05-20T17:54:23.445078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427758+0000","last_change":"2024-05-20T17:54:23.427758+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427758+0000","last_undegraded":"2024-05-20T17:54:23.427758+0000","last_fullsized":"2024-05-20T17:54:23.427758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442042+0000","last_change":"2024-05-20T17:54:23.437941+0000","last_active":"2024-05-20T17:54:23.442042+0000","last_peered":"2024-05-20T17:54:23.442042+0000","last_clean":"2024-05-20T17:54:23.442042+0000","last_became_active":"2024-05-20T17:54:23.437605+0000","last_became_peered":"2024-05-20T17:54:23.437605+0000","last_unstale":"2024-05-20T17:54:23.442042+0000","last_undegraded":"2024-05-20T17:54:23.442042+0000","last_fullsized":"2024-05-20T17:54:23.442042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421993+0000","last_change":"2024-05-20T17:54:23.421993+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421993+0000","last_undegraded":"2024-05-20T17:54:23.421993+0000","last_fullsized":"2024-05-20T17:54:23.421993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.440936+0000","last_change":"2024-05-20T17:54:23.438445+0000","last_active":"2024-05-20T17:54:23.440936+0000","last_peered":"2024-05-20T17:54:23.440936+0000","last_clean":"2024-05-20T17:54:23.440936+0000","last_became_active":"2024-05-20T17:54:23.438081+0000","last_became_peered":"2024-05-20T17:54:23.438081+0000","last_unstale":"2024-05-20T17:54:23.440936+0000","last_undegraded":"2024-05-20T17:54:23.440936+0000","last_fullsized":"2024-05-20T17:54:23.440936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:48:22.172410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427173+0000","last_change":"2024-05-20T17:54:23.427173+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427173+0000","last_undegraded":"2024-05-20T17:54:23.427173+0000","last_fullsized":"2024-05-20T17:54:23.427173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.440265+0000","last_change":"2024-05-20T17:54:23.435922+0000","last_active":"2024-05-20T17:54:23.440265+0000","last_peered":"2024-05-20T17:54:23.440265+0000","last_clean":"2024-05-20T17:54:23.440265+0000","last_became_active":"2024-05-20T17:54:23.435604+0000","last_became_peered":"2024-05-20T17:54:23.435604+0000","last_unstale":"2024-05-20T17:54:23.440265+0000","last_undegraded":"2024-05-20T17:54:23.440265+0000","last_fullsized":"2024-05-20T17:54:23.440265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431327+0000","last_change":"2024-05-20T17:54:23.431327+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431327+0000","last_undegraded":"2024-05-20T17:54:23.431327+0000","last_fullsized":"2024-05-20T17:54:23.431327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445451+0000","last_change":"2024-05-20T17:54:23.441585+0000","last_active":"2024-05-20T17:54:23.445451+0000","last_peered":"2024-05-20T17:54:23.445451+0000","last_clean":"2024-05-20T17:54:23.445451+0000","last_became_active":"2024-05-20T17:54:23.441237+0000","last_became_peered":"2024-05-20T17:54:23.441237+0000","last_unstale":"2024-05-20T17:54:23.445451+0000","last_undegraded":"2024-05-20T17:54:23.445451+0000","last_fullsized":"2024-05-20T17:54:23.445451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:49.039875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429306+0000","last_change":"2024-05-20T17:54:23.429306+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429306+0000","last_undegraded":"2024-05-20T17:54:23.429306+0000","last_fullsized":"2024-05-20T17:54:23.429306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445460+0000","last_change":"2024-05-20T17:54:23.442515+0000","last_active":"2024-05-20T17:54:23.445460+0000","last_peered":"2024-05-20T17:54:23.445460+0000","last_clean":"2024-05-20T17:54:23.445460+0000","last_became_active":"2024-05-20T17:54:23.442147+0000","last_became_peered":"2024-05-20T17:54:23.442147+0000","last_unstale":"2024-05-20T17:54:23.445460+0000","last_undegraded":"2024-05-20T17:54:23.445460+0000","last_fullsized":"2024-05-20T17:54:23.445460+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:16:33.309272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.432946+0000","last_change":"2024-05-20T17:54:23.432946+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.432946+0000","last_undegraded":"2024-05-20T17:54:23.432946+0000","last_fullsized":"2024-05-20T17:54:23.432946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442990+0000","last_change":"2024-05-20T17:54:23.439937+0000","last_active":"2024-05-20T17:54:23.442990+0000","last_peered":"2024-05-20T17:54:23.442990+0000","last_clean":"2024-05-20T17:54:23.442990+0000","last_became_active":"2024-05-20T17:54:23.439619+0000","last_became_peered":"2024-05-20T17:54:23.439619+0000","last_unstale":"2024-05-20T17:54:23.442990+0000","last_undegraded":"2024-05-20T17:54:23.442990+0000","last_fullsized":"2024-05-20T17:54:23.442990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424183+0000","last_change":"2024-05-20T17:54:23.424183+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424183+0000","last_undegraded":"2024-05-20T17:54:23.424183+0000","last_fullsized":"2024-05-20T17:54:23.424183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445675+0000","last_change":"2024-05-20T17:54:23.443863+0000","last_active":"2024-05-20T17:54:23.445675+0000","last_peered":"2024-05-20T17:54:23.445675+0000","last_clean":"2024-05-20T17:54:23.445675+0000","last_became_active":"2024-05-20T17:54:23.443474+0000","last_became_peered":"2024-05-20T17:54:23.443474+0000","last_unstale":"2024-05-20T17:54:23.445675+0000","last_undegraded":"2024-05-20T17:54:23.445675+0000","last_fullsized":"2024-05-20T17:54:23.445675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:28:12.976404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425702+0000","last_change":"2024-05-20T17:54:23.425702+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425702+0000","last_undegraded":"2024-05-20T17:54:23.425702+0000","last_fullsized":"2024-05-20T17:54:23.425702+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.446987+0000","last_change":"2024-05-20T17:54:23.444259+0000","last_active":"2024-05-20T17:54:23.446987+0000","last_peered":"2024-05-20T17:54:23.446987+0000","last_clean":"2024-05-20T17:54:23.446987+0000","last_became_active":"2024-05-20T17:54:23.443911+0000","last_became_peered":"2024-05-20T17:54:23.443911+0000","last_unstale":"2024-05-20T17:54:23.446987+0000","last_undegraded":"2024-05-20T17:54:23.446987+0000","last_fullsized":"2024-05-20T17:54:23.446987+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:34.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429833+0000","last_change":"2024-05-20T17:54:23.429833+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429833+0000","last_undegraded":"2024-05-20T17:54:23.429833+0000","last_fullsized":"2024-05-20T17:54:23.429833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441104+0000","last_change":"2024-05-20T17:54:23.439443+0000","last_active":"2024-05-20T17:54:23.441104+0000","last_peered":"2024-05-20T17:54:23.441104+0000","last_clean":"2024-05-20T17:54:23.441104+0000","last_became_active":"2024-05-20T17:54:23.439150+0000","last_became_peered":"2024-05-20T17:54:23.439150+0000","last_unstale":"2024-05-20T17:54:23.441104+0000","last_undegraded":"2024-05-20T17:54:23.441104+0000","last_fullsized":"2024-05-20T17:54:23.441104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:21:28.894509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424009+0000","last_change":"2024-05-20T17:54:23.424009+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424009+0000","last_undegraded":"2024-05-20T17:54:23.424009+0000","last_fullsized":"2024-05-20T17:54:23.424009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442170+0000","last_change":"2024-05-20T17:54:23.434953+0000","last_active":"2024-05-20T17:54:23.442170+0000","last_peered":"2024-05-20T17:54:23.442170+0000","last_clean":"2024-05-20T17:54:23.442170+0000","last_became_active":"2024-05-20T17:54:23.434622+0000","last_became_peered":"2024-05-20T17:54:23.434622+0000","last_unstale":"2024-05-20T17:54:23.442170+0000","last_undegraded":"2024-05-20T17:54:23.442170+0000","last_fullsized":"2024-05-20T17:54:23.442170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430867+0000","last_change":"2024-05-20T17:54:23.430867+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430867+0000","last_undegraded":"2024-05-20T17:54:23.430867+0000","last_fullsized":"2024-05-20T17:54:23.430867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442564+0000","last_change":"2024-05-20T17:54:23.436462+0000","last_active":"2024-05-20T17:54:23.442564+0000","last_peered":"2024-05-20T17:54:23.442564+0000","last_clean":"2024-05-20T17:54:23.442564+0000","last_became_active":"2024-05-20T17:54:23.436148+0000","last_became_peered":"2024-05-20T17:54:23.436148+0000","last_unstale":"2024-05-20T17:54:23.442564+0000","last_undegraded":"2024-05-20T17:54:23.442564+0000","last_fullsized":"2024-05-20T17:54:23.442564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426378+0000","last_change":"2024-05-20T17:54:23.426378+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426378+0000","last_undegraded":"2024-05-20T17:54:23.426378+0000","last_fullsized":"2024-05-20T17:54:23.426378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.439117+0000","last_change":"2024-05-20T17:54:23.435232+0000","last_active":"2024-05-20T17:54:23.439117+0000","last_peered":"2024-05-20T17:54:23.439117+0000","last_clean":"2024-05-20T17:54:23.439117+0000","last_became_active":"2024-05-20T17:54:23.434898+0000","last_became_peered":"2024-05-20T17:54:23.434898+0000","last_unstale":"2024-05-20T17:54:23.439117+0000","last_undegraded":"2024-05-20T17:54:23.439117+0000","last_fullsized":"2024-05-20T17:54:23.439117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424665+0000","last_change":"2024-05-20T17:54:23.424665+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424665+0000","last_undegraded":"2024-05-20T17:54:23.424665+0000","last_fullsized":"2024-05-20T17:54:23.424665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441905+0000","last_change":"2024-05-20T17:54:23.438769+0000","last_active":"2024-05-20T17:54:23.441905+0000","last_peered":"2024-05-20T17:54:23.441905+0000","last_clean":"2024-05-20T17:54:23.441905+0000","last_became_active":"2024-05-20T17:54:23.438432+0000","last_became_peered":"2024-05-20T17:54:23.438432+0000","last_unstale":"2024-05-20T17:54:23.441905+0000","last_undegraded":"2024-05-20T17:54:23.441905+0000","last_fullsized":"2024-05-20T17:54:23.441905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431614+0000","last_change":"2024-05-20T17:54:23.431614+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431614+0000","last_undegraded":"2024-05-20T17:54:23.431614+0000","last_fullsized":"2024-05-20T17:54:23.431614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.437123+0000","last_change":"2024-05-20T17:54:23.429638+0000","last_active":"2024-05-20T17:54:23.437123+0000","last_peered":"2024-05-20T17:54:23.437123+0000","last_clean":"2024-05-20T17:54:23.437123+0000","last_became_active":"2024-05-20T17:54:23.429302+0000","last_became_peered":"2024-05-20T17:54:23.429302+0000","last_unstale":"2024-05-20T17:54:23.437123+0000","last_undegraded":"2024-05-20T17:54:23.437123+0000","last_fullsized":"2024-05-20T17:54:23.437123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:55.833142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431307+0000","last_change":"2024-05-20T17:54:23.431307+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431307+0000","last_undegraded":"2024-05-20T17:54:23.431307+0000","last_fullsized":"2024-05-20T17:54:23.431307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444086+0000","last_change":"2024-05-20T17:54:23.442483+0000","last_active":"2024-05-20T17:54:23.444086+0000","last_peered":"2024-05-20T17:54:23.444086+0000","last_clean":"2024-05-20T17:54:23.444086+0000","last_became_active":"2024-05-20T17:54:23.442157+0000","last_became_peered":"2024-05-20T17:54:23.442157+0000","last_unstale":"2024-05-20T17:54:23.444086+0000","last_undegraded":"2024-05-20T17:54:23.444086+0000","last_fullsized":"2024-05-20T17:54:23.444086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.433040+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:54:23.433040+0000","last_peered":"2024-05-20T17:54:23.433040+0000","last_clean":"2024-05-20T17:54:23.433040+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:54:23.433040+0000","last_undegraded":"2024-05-20T17:54:23.433040+0000","last_fullsized":"2024-05-20T17:54:23.433040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:54:28.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:54:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.055+0000 7f54095aa640 1 Processor -- start 2024-05-20T17:54:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.055+0000 7f54095aa640 1 -- start start 2024-05-20T17:54:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.056+0000 7f54095aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f540415d530 0x7f540415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.056+0000 7f54095aa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54040cd580 con 0x7f54040b1700 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.056+0000 7f54095aa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54040cd860 con 0x7f5404070850 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.056+0000 7f54095aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f54040ce190 con 0x7f540415d530 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.056+0000 7f5402ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f540415d530 0x7f540415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.056+0000 7f53fbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f54040b1700 0x7f54040b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40420/0 (socket says 172.21.15.6:40420) 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.056+0000 7f53fbfff640 1 -- 172.21.15.6:0/3925656484 learned_addr learned my addr 172.21.15.6:0/3925656484 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.056+0000 7f5402ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f540415d530 0x7f540415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33242/0 (socket says 172.21.15.6:33242) 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.057+0000 7f5402ffd640 1 -- 172.21.15.6:0/3925656484 >> v1:172.21.15.171:6789/0 conn(0x7f5404070850 legacy=0x7f5404070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.057+0000 7f5402ffd640 1 -- 172.21.15.6:0/3925656484 >> v1:172.21.15.6:6789/0 conn(0x7f54040b1700 legacy=0x7f54040b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.057+0000 7f5402ffd640 1 -- 172.21.15.6:0/3925656484 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54040cdb40 con 0x7f540415d530 2024-05-20T17:54:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.057+0000 7f5402ffd640 1 --2- 172.21.15.6:0/3925656484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f540415aaa0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f53f40097a0 tx=0x7f53f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176dd814fb538ec1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.058+0000 7f54027fc640 1 -- 172.21.15.6:0/3925656484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4037070 con 0x7f540415d530 2024-05-20T17:54:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.058+0000 7f54027fc640 1 -- 172.21.15.6:0/3925656484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f4032440 con 0x7f540415d530 2024-05-20T17:54:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.058+0000 7f54027fc640 1 -- 172.21.15.6:0/3925656484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4032810 con 0x7f540415d530 2024-05-20T17:54:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.058+0000 7f54095aa640 1 -- 172.21.15.6:0/3925656484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 msgr2=0x7f540415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.058+0000 7f54095aa640 1 --2- 172.21.15.6:0/3925656484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f540415aaa0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f53f40097a0 tx=0x7f53f402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.058+0000 7f54095aa640 1 -- 172.21.15.6:0/3925656484 shutdown_connections 2024-05-20T17:54:29.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.058+0000 7f54095aa640 1 --2- 172.21.15.6:0/3925656484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f540415aaa0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.058+0000 7f54095aa640 1 -- 172.21.15.6:0/3925656484 >> 172.21.15.6:0/3925656484 conn(0x7f54040d29d0 msgr2=0x7f54040d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.059+0000 7f54095aa640 1 -- 172.21.15.6:0/3925656484 shutdown_connections 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.059+0000 7f54095aa640 1 -- 172.21.15.6:0/3925656484 wait complete. 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.060+0000 7f54095aa640 1 Processor -- start 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.060+0000 7f54095aa640 1 -- start start 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54095aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5404070850 0x7f54040b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54095aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54040b1700 0x7f54040c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54095aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f54040c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54095aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5404071370 con 0x7f540415d530 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54095aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f54040cd230 con 0x7f5404070850 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54095aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f54040714f0 con 0x7f54040b1700 2024-05-20T17:54:29.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f54040c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f54040c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33248/0 (socket says 172.21.15.6:33248) 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 -- 172.21.15.6:0/853452979 learned_addr learned my addr 172.21.15.6:0/853452979 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f53fbfff640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54040b1700 0x7f54040c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f5402ffd640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5404070850 0x7f54040b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 -- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54040b1700 msgr2=0x7f54040c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54040b1700 0x7f54040c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 -- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5404070850 msgr2=0x7f54040b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5404070850 0x7f54040b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 -- 172.21.15.6:0/853452979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5404152510 con 0x7f540415d530 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f5402ffd640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5404070850 0x7f54040b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f53fbfff640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54040b1700 0x7f54040c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:29.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54037fe640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f54040c7190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00ba10 tx=0x7f53fc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f53fb7fe640 1 -- 172.21.15.6:0/853452979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc019070 con 0x7f540415d530 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f53fb7fe640 1 -- 172.21.15.6:0/853452979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc00cb40 con 0x7f540415d530 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54040c8d10 con 0x7f540415d530 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.062+0000 7f53fb7fe640 1 -- 172.21.15.6:0/853452979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc014440 con 0x7f540415d530 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.063+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54040c92d0 con 0x7f540415d530 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.063+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5404152280 con 0x7f540415d530 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.064+0000 7f53fb7fe640 1 -- 172.21.15.6:0/853452979 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53fc01c070 con 0x7f540415d530 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.065+0000 7f53fb7fe640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f53e406be30 0x7f53e406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.065+0000 7f53fb7fe640 1 -- 172.21.15.6:0/853452979 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f53fc08ab60 con 0x7f540415d530 2024-05-20T17:54:29.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.065+0000 7f5402ffd640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f53e406be30 0x7f53e406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.065+0000 7f5402ffd640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f53e406be30 0x7f53e406e340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f53f4034000 tx=0x7f53f402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.069+0000 7f53fb7fe640 1 -- 172.21.15.6:0/853452979 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f53fc059380 con 0x7f540415d530 2024-05-20T17:54:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.249+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54040cada0 con 0x7f53e406be30 2024-05-20T17:54:29.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.255+0000 7f53fb7fe640 1 -- 172.21.15.6:0/853452979 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246635 (secure 0 0 0) 0x7f54040cada0 con 0x7f53e406be30 2024-05-20T17:54:29.256 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:29.258 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f53e406be30 msgr2=0x7f53e406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f53e406be30 0x7f53e406e340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f53f4034000 tx=0x7f53f402e000 comp rx=0 tx=0).stop 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 msgr2=0x7f54040c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f54040c7190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00ba10 tx=0x7f53fc00bed0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 shutdown_connections 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f53e406be30 0x7f53e406e340 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f540415d530 0x7f54040c7190 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54040b1700 0x7f54040c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 --2- 172.21.15.6:0/853452979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5404070850 0x7f54040b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 >> 172.21.15.6:0/853452979 conn(0x7f54040d29d0 msgr2=0x7f54040d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 shutdown_connections 2024-05-20T17:54:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.258+0000 7f54095aa640 1 -- 172.21.15.6:0/853452979 wait complete. 2024-05-20T17:54:29.268 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-05-20T17:54:28.252818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220560,"kb_used_data":4380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754160,"statfs":{"total":773094113280,"available":772868259840,"internally_reserved":0,"allocated":4485120,"data_stored":2586141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.837327"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427101+0000","last_change":"2024-05-20T17:54:23.427101+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427101+0000","last_undegraded":"2024-05-20T17:54:23.427101+0000","last_fullsized":"2024-05-20T17:54:23.427101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426352+0000","last_change":"2024-05-20T17:54:23.426352+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426352+0000","last_undegraded":"2024-05-20T17:54:23.426352+0000","last_fullsized":"2024-05-20T17:54:23.426352+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430129+0000","last_change":"2024-05-20T17:54:23.430129+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430129+0000","last_undegraded":"2024-05-20T17:54:23.430129+0000","last_fullsized":"2024-05-20T17:54:23.430129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428268+0000","last_change":"2024-05-20T17:54:23.428268+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428268+0000","last_undegraded":"2024-05-20T17:54:23.428268+0000","last_fullsized":"2024-05-20T17:54:23.428268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426271+0000","last_change":"2024-05-20T17:54:23.426271+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426271+0000","last_undegraded":"2024-05-20T17:54:23.426271+0000","last_fullsized":"2024-05-20T17:54:23.426271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427396+0000","last_change":"2024-05-20T17:54:23.427396+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427396+0000","last_undegraded":"2024-05-20T17:54:23.427396+0000","last_fullsized":"2024-05-20T17:54:23.427396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429141+0000","last_change":"2024-05-20T17:54:23.429141+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429141+0000","last_undegraded":"2024-05-20T17:54:23.429141+0000","last_fullsized":"2024-05-20T17:54:23.429141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425396+0000","last_change":"2024-05-20T17:54:23.425396+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425396+0000","last_undegraded":"2024-05-20T17:54:23.425396+0000","last_fullsized":"2024-05-20T17:54:23.425396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430395+0000","last_change":"2024-05-20T17:54:23.430395+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430395+0000","last_undegraded":"2024-05-20T17:54:23.430395+0000","last_fullsized":"2024-05-20T17:54:23.430395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431448+0000","last_change":"2024-05-20T17:54:23.431448+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431448+0000","last_undegraded":"2024-05-20T17:54:23.431448+0000","last_fullsized":"2024-05-20T17:54:23.431448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428407+0000","last_change":"2024-05-20T17:54:23.428407+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428407+0000","last_undegraded":"2024-05-20T17:54:23.428407+0000","last_fullsized":"2024-05-20T17:54:23.428407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431513+0000","last_change":"2024-05-20T17:54:23.431513+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431513+0000","last_undegraded":"2024-05-20T17:54:23.431513+0000","last_fullsized":"2024-05-20T17:54:23.431513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429235+0000","last_change":"2024-05-20T17:54:23.429235+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429235+0000","last_undegraded":"2024-05-20T17:54:23.429235+0000","last_fullsized":"2024-05-20T17:54:23.429235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425169+0000","last_change":"2024-05-20T17:54:23.425169+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425169+0000","last_undegraded":"2024-05-20T17:54:23.425169+0000","last_fullsized":"2024-05-20T17:54:23.425169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428575+0000","last_change":"2024-05-20T17:54:23.428575+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428575+0000","last_undegraded":"2024-05-20T17:54:23.428575+0000","last_fullsized":"2024-05-20T17:54:23.428575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431849+0000","last_change":"2024-05-20T17:54:23.431849+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431849+0000","last_undegraded":"2024-05-20T17:54:23.431849+0000","last_fullsized":"2024-05-20T17:54:23.431849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429934+0000","last_change":"2024-05-20T17:54:23.429934+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429934+0000","last_undegraded":"2024-05-20T17:54:23.429934+0000","last_fullsized":"2024-05-20T17:54:23.429934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422614+0000","last_change":"2024-05-20T17:54:23.422614+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422614+0000","last_undegraded":"2024-05-20T17:54:23.422614+0000","last_fullsized":"2024-05-20T17:54:23.422614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431653+0000","last_change":"2024-05-20T17:54:23.431653+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431653+0000","last_undegraded":"2024-05-20T17:54:23.431653+0000","last_fullsized":"2024-05-20T17:54:23.431653+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425392+0000","last_change":"2024-05-20T17:54:23.425392+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425392+0000","last_undegraded":"2024-05-20T17:54:23.425392+0000","last_fullsized":"2024-05-20T17:54:23.425392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428726+0000","last_change":"2024-05-20T17:54:23.428726+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428726+0000","last_undegraded":"2024-05-20T17:54:23.428726+0000","last_fullsized":"2024-05-20T17:54:23.428726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.423568+0000","last_change":"2024-05-20T17:54:23.423568+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.423568+0000","last_undegraded":"2024-05-20T17:54:23.423568+0000","last_fullsized":"2024-05-20T17:54:23.423568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429475+0000","last_change":"2024-05-20T17:54:23.429475+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429475+0000","last_undegraded":"2024-05-20T17:54:23.429475+0000","last_fullsized":"2024-05-20T17:54:23.429475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428463+0000","last_change":"2024-05-20T17:54:23.428463+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428463+0000","last_undegraded":"2024-05-20T17:54:23.428463+0000","last_fullsized":"2024-05-20T17:54:23.428463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422140+0000","last_change":"2024-05-20T17:54:23.422140+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422140+0000","last_undegraded":"2024-05-20T17:54:23.422140+0000","last_fullsized":"2024-05-20T17:54:23.422140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426848+0000","last_change":"2024-05-20T17:54:23.426848+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426848+0000","last_undegraded":"2024-05-20T17:54:23.426848+0000","last_fullsized":"2024-05-20T17:54:23.426848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421757+0000","last_change":"2024-05-20T17:54:23.421757+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421757+0000","last_undegraded":"2024-05-20T17:54:23.421757+0000","last_fullsized":"2024-05-20T17:54:23.421757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429672+0000","last_change":"2024-05-20T17:54:23.429672+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429672+0000","last_undegraded":"2024-05-20T17:54:23.429672+0000","last_fullsized":"2024-05-20T17:54:23.429672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421736+0000","last_change":"2024-05-20T17:54:23.421736+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421736+0000","last_undegraded":"2024-05-20T17:54:23.421736+0000","last_fullsized":"2024-05-20T17:54:23.421736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.423749+0000","last_change":"2024-05-20T17:54:23.423749+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.423749+0000","last_undegraded":"2024-05-20T17:54:23.423749+0000","last_fullsized":"2024-05-20T17:54:23.423749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428891+0000","last_change":"2024-05-20T17:54:23.428891+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428891+0000","last_undegraded":"2024-05-20T17:54:23.428891+0000","last_fullsized":"2024-05-20T17:54:23.428891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426216+0000","last_change":"2024-05-20T17:54:23.426216+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426216+0000","last_undegraded":"2024-05-20T17:54:23.426216+0000","last_fullsized":"2024-05-20T17:54:23.426216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431354+0000","last_change":"2024-05-20T17:54:23.431354+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431354+0000","last_undegraded":"2024-05-20T17:54:23.431354+0000","last_fullsized":"2024-05-20T17:54:23.431354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.429235+0000","last_change":"2024-05-20T17:54:23.426910+0000","last_active":"2024-05-20T17:54:23.429235+0000","last_peered":"2024-05-20T17:54:23.429235+0000","last_clean":"2024-05-20T17:54:23.429235+0000","last_became_active":"2024-05-20T17:54:23.426481+0000","last_became_peered":"2024-05-20T17:54:23.426481+0000","last_unstale":"2024-05-20T17:54:23.429235+0000","last_undegraded":"2024-05-20T17:54:23.429235+0000","last_fullsized":"2024-05-20T17:54:23.429235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425395+0000","last_change":"2024-05-20T17:54:23.425395+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425395+0000","last_undegraded":"2024-05-20T17:54:23.425395+0000","last_fullsized":"2024-05-20T17:54:23.425395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442733+0000","last_change":"2024-05-20T17:54:23.437864+0000","last_active":"2024-05-20T17:54:23.442733+0000","last_peered":"2024-05-20T17:54:23.442733+0000","last_clean":"2024-05-20T17:54:23.442733+0000","last_became_active":"2024-05-20T17:54:23.437555+0000","last_became_peered":"2024-05-20T17:54:23.437555+0000","last_unstale":"2024-05-20T17:54:23.442733+0000","last_undegraded":"2024-05-20T17:54:23.442733+0000","last_fullsized":"2024-05-20T17:54:23.442733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421392+0000","last_change":"2024-05-20T17:54:23.421392+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421392+0000","last_undegraded":"2024-05-20T17:54:23.421392+0000","last_fullsized":"2024-05-20T17:54:23.421392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443106+0000","last_change":"2024-05-20T17:54:23.437547+0000","last_active":"2024-05-20T17:54:23.443106+0000","last_peered":"2024-05-20T17:54:23.443106+0000","last_clean":"2024-05-20T17:54:23.443106+0000","last_became_active":"2024-05-20T17:54:23.436626+0000","last_became_peered":"2024-05-20T17:54:23.436626+0000","last_unstale":"2024-05-20T17:54:23.443106+0000","last_undegraded":"2024-05-20T17:54:23.443106+0000","last_fullsized":"2024-05-20T17:54:23.443106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426445+0000","last_change":"2024-05-20T17:54:23.426445+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426445+0000","last_undegraded":"2024-05-20T17:54:23.426445+0000","last_fullsized":"2024-05-20T17:54:23.426445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443501+0000","last_change":"2024-05-20T17:54:23.441212+0000","last_active":"2024-05-20T17:54:23.443501+0000","last_peered":"2024-05-20T17:54:23.443501+0000","last_clean":"2024-05-20T17:54:23.443501+0000","last_became_active":"2024-05-20T17:54:23.440875+0000","last_became_peered":"2024-05-20T17:54:23.440875+0000","last_unstale":"2024-05-20T17:54:23.443501+0000","last_undegraded":"2024-05-20T17:54:23.443501+0000","last_fullsized":"2024-05-20T17:54:23.443501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.433980+0000","last_change":"2024-05-20T17:54:23.433980+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.433980+0000","last_undegraded":"2024-05-20T17:54:23.433980+0000","last_fullsized":"2024-05-20T17:54:23.433980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445107+0000","last_change":"2024-05-20T17:54:23.441793+0000","last_active":"2024-05-20T17:54:23.445107+0000","last_peered":"2024-05-20T17:54:23.445107+0000","last_clean":"2024-05-20T17:54:23.445107+0000","last_became_active":"2024-05-20T17:54:23.441488+0000","last_became_peered":"2024-05-20T17:54:23.441488+0000","last_unstale":"2024-05-20T17:54:23.445107+0000","last_undegraded":"2024-05-20T17:54:23.445107+0000","last_fullsized":"2024-05-20T17:54:23.445107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:30.532097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427995+0000","last_change":"2024-05-20T17:54:23.427995+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427995+0000","last_undegraded":"2024-05-20T17:54:23.427995+0000","last_fullsized":"2024-05-20T17:54:23.427995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444446+0000","last_change":"2024-05-20T17:54:23.442954+0000","last_active":"2024-05-20T17:54:23.444446+0000","last_peered":"2024-05-20T17:54:23.444446+0000","last_clean":"2024-05-20T17:54:23.444446+0000","last_became_active":"2024-05-20T17:54:23.442646+0000","last_became_peered":"2024-05-20T17:54:23.442646+0000","last_unstale":"2024-05-20T17:54:23.444446+0000","last_undegraded":"2024-05-20T17:54:23.444446+0000","last_fullsized":"2024-05-20T17:54:23.444446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424131+0000","last_change":"2024-05-20T17:54:23.424131+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424131+0000","last_undegraded":"2024-05-20T17:54:23.424131+0000","last_fullsized":"2024-05-20T17:54:23.424131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443205+0000","last_change":"2024-05-20T17:54:23.439623+0000","last_active":"2024-05-20T17:54:23.443205+0000","last_peered":"2024-05-20T17:54:23.443205+0000","last_clean":"2024-05-20T17:54:23.443205+0000","last_became_active":"2024-05-20T17:54:23.439292+0000","last_became_peered":"2024-05-20T17:54:23.439292+0000","last_unstale":"2024-05-20T17:54:23.443205+0000","last_undegraded":"2024-05-20T17:54:23.443205+0000","last_fullsized":"2024-05-20T17:54:23.443205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425767+0000","last_change":"2024-05-20T17:54:23.425767+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425767+0000","last_undegraded":"2024-05-20T17:54:23.425767+0000","last_fullsized":"2024-05-20T17:54:23.425767+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441838+0000","last_change":"2024-05-20T17:54:23.432283+0000","last_active":"2024-05-20T17:54:23.441838+0000","last_peered":"2024-05-20T17:54:23.441838+0000","last_clean":"2024-05-20T17:54:23.441838+0000","last_became_active":"2024-05-20T17:54:23.431945+0000","last_became_peered":"2024-05-20T17:54:23.431945+0000","last_unstale":"2024-05-20T17:54:23.441838+0000","last_undegraded":"2024-05-20T17:54:23.441838+0000","last_fullsized":"2024-05-20T17:54:23.441838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:25:01.023822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425885+0000","last_change":"2024-05-20T17:54:23.425885+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425885+0000","last_undegraded":"2024-05-20T17:54:23.425885+0000","last_fullsized":"2024-05-20T17:54:23.425885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.437075+0000","last_change":"2024-05-20T17:54:23.430490+0000","last_active":"2024-05-20T17:54:23.437075+0000","last_peered":"2024-05-20T17:54:23.437075+0000","last_clean":"2024-05-20T17:54:23.437075+0000","last_became_active":"2024-05-20T17:54:23.430145+0000","last_became_peered":"2024-05-20T17:54:23.430145+0000","last_unstale":"2024-05-20T17:54:23.437075+0000","last_undegraded":"2024-05-20T17:54:23.437075+0000","last_fullsized":"2024-05-20T17:54:23.437075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:48.427860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430380+0000","last_change":"2024-05-20T17:54:23.430380+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430380+0000","last_undegraded":"2024-05-20T17:54:23.430380+0000","last_fullsized":"2024-05-20T17:54:23.430380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445154+0000","last_change":"2024-05-20T17:54:23.442823+0000","last_active":"2024-05-20T17:54:23.445154+0000","last_peered":"2024-05-20T17:54:23.445154+0000","last_clean":"2024-05-20T17:54:23.445154+0000","last_became_active":"2024-05-20T17:54:23.442499+0000","last_became_peered":"2024-05-20T17:54:23.442499+0000","last_unstale":"2024-05-20T17:54:23.445154+0000","last_undegraded":"2024-05-20T17:54:23.445154+0000","last_fullsized":"2024-05-20T17:54:23.445154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429959+0000","last_change":"2024-05-20T17:54:23.429959+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429959+0000","last_undegraded":"2024-05-20T17:54:23.429959+0000","last_fullsized":"2024-05-20T17:54:23.429959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443266+0000","last_change":"2024-05-20T17:54:23.434450+0000","last_active":"2024-05-20T17:54:23.443266+0000","last_peered":"2024-05-20T17:54:23.443266+0000","last_clean":"2024-05-20T17:54:23.443266+0000","last_became_active":"2024-05-20T17:54:23.433895+0000","last_became_peered":"2024-05-20T17:54:23.433895+0000","last_unstale":"2024-05-20T17:54:23.443266+0000","last_undegraded":"2024-05-20T17:54:23.443266+0000","last_fullsized":"2024-05-20T17:54:23.443266+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422880+0000","last_change":"2024-05-20T17:54:23.422880+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422880+0000","last_undegraded":"2024-05-20T17:54:23.422880+0000","last_fullsized":"2024-05-20T17:54:23.422880+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442469+0000","last_change":"2024-05-20T17:54:23.438713+0000","last_active":"2024-05-20T17:54:23.442469+0000","last_peered":"2024-05-20T17:54:23.442469+0000","last_clean":"2024-05-20T17:54:23.442469+0000","last_became_active":"2024-05-20T17:54:23.438399+0000","last_became_peered":"2024-05-20T17:54:23.438399+0000","last_unstale":"2024-05-20T17:54:23.442469+0000","last_undegraded":"2024-05-20T17:54:23.442469+0000","last_fullsized":"2024-05-20T17:54:23.442469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:06.072919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.433431+0000","last_change":"2024-05-20T17:54:23.433431+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.433431+0000","last_undegraded":"2024-05-20T17:54:23.433431+0000","last_fullsized":"2024-05-20T17:54:23.433431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443051+0000","last_change":"2024-05-20T17:54:23.441709+0000","last_active":"2024-05-20T17:54:23.443051+0000","last_peered":"2024-05-20T17:54:23.443051+0000","last_clean":"2024-05-20T17:54:23.443051+0000","last_became_active":"2024-05-20T17:54:23.441340+0000","last_became_peered":"2024-05-20T17:54:23.441340+0000","last_unstale":"2024-05-20T17:54:23.443051+0000","last_undegraded":"2024-05-20T17:54:23.443051+0000","last_fullsized":"2024-05-20T17:54:23.443051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:42.846897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424705+0000","last_change":"2024-05-20T17:54:23.424705+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424705+0000","last_undegraded":"2024-05-20T17:54:23.424705+0000","last_fullsized":"2024-05-20T17:54:23.424705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445696+0000","last_change":"2024-05-20T17:54:23.444497+0000","last_active":"2024-05-20T17:54:23.445696+0000","last_peered":"2024-05-20T17:54:23.445696+0000","last_clean":"2024-05-20T17:54:23.445696+0000","last_became_active":"2024-05-20T17:54:23.444103+0000","last_became_peered":"2024-05-20T17:54:23.444103+0000","last_unstale":"2024-05-20T17:54:23.445696+0000","last_undegraded":"2024-05-20T17:54:23.445696+0000","last_fullsized":"2024-05-20T17:54:23.445696+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430062+0000","last_change":"2024-05-20T17:54:23.430062+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430062+0000","last_undegraded":"2024-05-20T17:54:23.430062+0000","last_fullsized":"2024-05-20T17:54:23.430062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.429325+0000","last_change":"2024-05-20T17:54:23.427305+0000","last_active":"2024-05-20T17:54:23.429325+0000","last_peered":"2024-05-20T17:54:23.429325+0000","last_clean":"2024-05-20T17:54:23.429325+0000","last_became_active":"2024-05-20T17:54:23.426944+0000","last_became_peered":"2024-05-20T17:54:23.426944+0000","last_unstale":"2024-05-20T17:54:23.429325+0000","last_undegraded":"2024-05-20T17:54:23.429325+0000","last_fullsized":"2024-05-20T17:54:23.429325+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425255+0000","last_change":"2024-05-20T17:54:23.425255+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425255+0000","last_undegraded":"2024-05-20T17:54:23.425255+0000","last_fullsized":"2024-05-20T17:54:23.425255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444514+0000","last_change":"2024-05-20T17:54:23.443423+0000","last_active":"2024-05-20T17:54:23.444514+0000","last_peered":"2024-05-20T17:54:23.444514+0000","last_clean":"2024-05-20T17:54:23.444514+0000","last_became_active":"2024-05-20T17:54:23.443132+0000","last_became_peered":"2024-05-20T17:54:23.443132+0000","last_unstale":"2024-05-20T17:54:23.444514+0000","last_undegraded":"2024-05-20T17:54:23.444514+0000","last_fullsized":"2024-05-20T17:54:23.444514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424154+0000","last_change":"2024-05-20T17:54:23.424154+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424154+0000","last_undegraded":"2024-05-20T17:54:23.424154+0000","last_fullsized":"2024-05-20T17:54:23.424154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445078+0000","last_change":"2024-05-20T17:54:23.440734+0000","last_active":"2024-05-20T17:54:23.445078+0000","last_peered":"2024-05-20T17:54:23.445078+0000","last_clean":"2024-05-20T17:54:23.445078+0000","last_became_active":"2024-05-20T17:54:23.440413+0000","last_became_peered":"2024-05-20T17:54:23.440413+0000","last_unstale":"2024-05-20T17:54:23.445078+0000","last_undegraded":"2024-05-20T17:54:23.445078+0000","last_fullsized":"2024-05-20T17:54:23.445078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427758+0000","last_change":"2024-05-20T17:54:23.427758+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427758+0000","last_undegraded":"2024-05-20T17:54:23.427758+0000","last_fullsized":"2024-05-20T17:54:23.427758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442042+0000","last_change":"2024-05-20T17:54:23.437941+0000","last_active":"2024-05-20T17:54:23.442042+0000","last_peered":"2024-05-20T17:54:23.442042+0000","last_clean":"2024-05-20T17:54:23.442042+0000","last_became_active":"2024-05-20T17:54:23.437605+0000","last_became_peered":"2024-05-20T17:54:23.437605+0000","last_unstale":"2024-05-20T17:54:23.442042+0000","last_undegraded":"2024-05-20T17:54:23.442042+0000","last_fullsized":"2024-05-20T17:54:23.442042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421993+0000","last_change":"2024-05-20T17:54:23.421993+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421993+0000","last_undegraded":"2024-05-20T17:54:23.421993+0000","last_fullsized":"2024-05-20T17:54:23.421993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.440936+0000","last_change":"2024-05-20T17:54:23.438445+0000","last_active":"2024-05-20T17:54:23.440936+0000","last_peered":"2024-05-20T17:54:23.440936+0000","last_clean":"2024-05-20T17:54:23.440936+0000","last_became_active":"2024-05-20T17:54:23.438081+0000","last_became_peered":"2024-05-20T17:54:23.438081+0000","last_unstale":"2024-05-20T17:54:23.440936+0000","last_undegraded":"2024-05-20T17:54:23.440936+0000","last_fullsized":"2024-05-20T17:54:23.440936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:48:22.172410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427173+0000","last_change":"2024-05-20T17:54:23.427173+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427173+0000","last_undegraded":"2024-05-20T17:54:23.427173+0000","last_fullsized":"2024-05-20T17:54:23.427173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.440265+0000","last_change":"2024-05-20T17:54:23.435922+0000","last_active":"2024-05-20T17:54:23.440265+0000","last_peered":"2024-05-20T17:54:23.440265+0000","last_clean":"2024-05-20T17:54:23.440265+0000","last_became_active":"2024-05-20T17:54:23.435604+0000","last_became_peered":"2024-05-20T17:54:23.435604+0000","last_unstale":"2024-05-20T17:54:23.440265+0000","last_undegraded":"2024-05-20T17:54:23.440265+0000","last_fullsized":"2024-05-20T17:54:23.440265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431327+0000","last_change":"2024-05-20T17:54:23.431327+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431327+0000","last_undegraded":"2024-05-20T17:54:23.431327+0000","last_fullsized":"2024-05-20T17:54:23.431327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445451+0000","last_change":"2024-05-20T17:54:23.441585+0000","last_active":"2024-05-20T17:54:23.445451+0000","last_peered":"2024-05-20T17:54:23.445451+0000","last_clean":"2024-05-20T17:54:23.445451+0000","last_became_active":"2024-05-20T17:54:23.441237+0000","last_became_peered":"2024-05-20T17:54:23.441237+0000","last_unstale":"2024-05-20T17:54:23.445451+0000","last_undegraded":"2024-05-20T17:54:23.445451+0000","last_fullsized":"2024-05-20T17:54:23.445451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:49.039875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429306+0000","last_change":"2024-05-20T17:54:23.429306+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429306+0000","last_undegraded":"2024-05-20T17:54:23.429306+0000","last_fullsized":"2024-05-20T17:54:23.429306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445460+0000","last_change":"2024-05-20T17:54:23.442515+0000","last_active":"2024-05-20T17:54:23.445460+0000","last_peered":"2024-05-20T17:54:23.445460+0000","last_clean":"2024-05-20T17:54:23.445460+0000","last_became_active":"2024-05-20T17:54:23.442147+0000","last_became_peered":"2024-05-20T17:54:23.442147+0000","last_unstale":"2024-05-20T17:54:23.445460+0000","last_undegraded":"2024-05-20T17:54:23.445460+0000","last_fullsized":"2024-05-20T17:54:23.445460+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:16:33.309272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.432946+0000","last_change":"2024-05-20T17:54:23.432946+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.432946+0000","last_undegraded":"2024-05-20T17:54:23.432946+0000","last_fullsized":"2024-05-20T17:54:23.432946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442990+0000","last_change":"2024-05-20T17:54:23.439937+0000","last_active":"2024-05-20T17:54:23.442990+0000","last_peered":"2024-05-20T17:54:23.442990+0000","last_clean":"2024-05-20T17:54:23.442990+0000","last_became_active":"2024-05-20T17:54:23.439619+0000","last_became_peered":"2024-05-20T17:54:23.439619+0000","last_unstale":"2024-05-20T17:54:23.442990+0000","last_undegraded":"2024-05-20T17:54:23.442990+0000","last_fullsized":"2024-05-20T17:54:23.442990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424183+0000","last_change":"2024-05-20T17:54:23.424183+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424183+0000","last_undegraded":"2024-05-20T17:54:23.424183+0000","last_fullsized":"2024-05-20T17:54:23.424183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445675+0000","last_change":"2024-05-20T17:54:23.443863+0000","last_active":"2024-05-20T17:54:23.445675+0000","last_peered":"2024-05-20T17:54:23.445675+0000","last_clean":"2024-05-20T17:54:23.445675+0000","last_became_active":"2024-05-20T17:54:23.443474+0000","last_became_peered":"2024-05-20T17:54:23.443474+0000","last_unstale":"2024-05-20T17:54:23.445675+0000","last_undegraded":"2024-05-20T17:54:23.445675+0000","last_fullsized":"2024-05-20T17:54:23.445675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:28:12.976404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425702+0000","last_change":"2024-05-20T17:54:23.425702+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425702+0000","last_undegraded":"2024-05-20T17:54:23.425702+0000","last_fullsized":"2024-05-20T17:54:23.425702+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.446987+0000","last_change":"2024-05-20T17:54:23.444259+0000","last_active":"2024-05-20T17:54:23.446987+0000","last_peered":"2024-05-20T17:54:23.446987+0000","last_clean":"2024-05-20T17:54:23.446987+0000","last_became_active":"2024-05-20T17:54:23.443911+0000","last_became_peered":"2024-05-20T17:54:23.443911+0000","last_unstale":"2024-05-20T17:54:23.446987+0000","last_undegraded":"2024-05-20T17:54:23.446987+0000","last_fullsized":"2024-05-20T17:54:23.446987+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:34.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429833+0000","last_change":"2024-05-20T17:54:23.429833+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429833+0000","last_undegraded":"2024-05-20T17:54:23.429833+0000","last_fullsized":"2024-05-20T17:54:23.429833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441104+0000","last_change":"2024-05-20T17:54:23.439443+0000","last_active":"2024-05-20T17:54:23.441104+0000","last_peered":"2024-05-20T17:54:23.441104+0000","last_clean":"2024-05-20T17:54:23.441104+0000","last_became_active":"2024-05-20T17:54:23.439150+0000","last_became_peered":"2024-05-20T17:54:23.439150+0000","last_unstale":"2024-05-20T17:54:23.441104+0000","last_undegraded":"2024-05-20T17:54:23.441104+0000","last_fullsized":"2024-05-20T17:54:23.441104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:21:28.894509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424009+0000","last_change":"2024-05-20T17:54:23.424009+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424009+0000","last_undegraded":"2024-05-20T17:54:23.424009+0000","last_fullsized":"2024-05-20T17:54:23.424009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442170+0000","last_change":"2024-05-20T17:54:23.434953+0000","last_active":"2024-05-20T17:54:23.442170+0000","last_peered":"2024-05-20T17:54:23.442170+0000","last_clean":"2024-05-20T17:54:23.442170+0000","last_became_active":"2024-05-20T17:54:23.434622+0000","last_became_peered":"2024-05-20T17:54:23.434622+0000","last_unstale":"2024-05-20T17:54:23.442170+0000","last_undegraded":"2024-05-20T17:54:23.442170+0000","last_fullsized":"2024-05-20T17:54:23.442170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430867+0000","last_change":"2024-05-20T17:54:23.430867+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430867+0000","last_undegraded":"2024-05-20T17:54:23.430867+0000","last_fullsized":"2024-05-20T17:54:23.430867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442564+0000","last_change":"2024-05-20T17:54:23.436462+0000","last_active":"2024-05-20T17:54:23.442564+0000","last_peered":"2024-05-20T17:54:23.442564+0000","last_clean":"2024-05-20T17:54:23.442564+0000","last_became_active":"2024-05-20T17:54:23.436148+0000","last_became_peered":"2024-05-20T17:54:23.436148+0000","last_unstale":"2024-05-20T17:54:23.442564+0000","last_undegraded":"2024-05-20T17:54:23.442564+0000","last_fullsized":"2024-05-20T17:54:23.442564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426378+0000","last_change":"2024-05-20T17:54:23.426378+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426378+0000","last_undegraded":"2024-05-20T17:54:23.426378+0000","last_fullsized":"2024-05-20T17:54:23.426378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.439117+0000","last_change":"2024-05-20T17:54:23.435232+0000","last_active":"2024-05-20T17:54:23.439117+0000","last_peered":"2024-05-20T17:54:23.439117+0000","last_clean":"2024-05-20T17:54:23.439117+0000","last_became_active":"2024-05-20T17:54:23.434898+0000","last_became_peered":"2024-05-20T17:54:23.434898+0000","last_unstale":"2024-05-20T17:54:23.439117+0000","last_undegraded":"2024-05-20T17:54:23.439117+0000","last_fullsized":"2024-05-20T17:54:23.439117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424665+0000","last_change":"2024-05-20T17:54:23.424665+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424665+0000","last_undegraded":"2024-05-20T17:54:23.424665+0000","last_fullsized":"2024-05-20T17:54:23.424665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441905+0000","last_change":"2024-05-20T17:54:23.438769+0000","last_active":"2024-05-20T17:54:23.441905+0000","last_peered":"2024-05-20T17:54:23.441905+0000","last_clean":"2024-05-20T17:54:23.441905+0000","last_became_active":"2024-05-20T17:54:23.438432+0000","last_became_peered":"2024-05-20T17:54:23.438432+0000","last_unstale":"2024-05-20T17:54:23.441905+0000","last_undegraded":"2024-05-20T17:54:23.441905+0000","last_fullsized":"2024-05-20T17:54:23.441905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431614+0000","last_change":"2024-05-20T17:54:23.431614+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431614+0000","last_undegraded":"2024-05-20T17:54:23.431614+0000","last_fullsized":"2024-05-20T17:54:23.431614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.437123+0000","last_change":"2024-05-20T17:54:23.429638+0000","last_active":"2024-05-20T17:54:23.437123+0000","last_peered":"2024-05-20T17:54:23.437123+0000","last_clean":"2024-05-20T17:54:23.437123+0000","last_became_active":"2024-05-20T17:54:23.429302+0000","last_became_peered":"2024-05-20T17:54:23.429302+0000","last_unstale":"2024-05-20T17:54:23.437123+0000","last_undegraded":"2024-05-20T17:54:23.437123+0000","last_fullsized":"2024-05-20T17:54:23.437123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:55.833142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431307+0000","last_change":"2024-05-20T17:54:23.431307+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431307+0000","last_undegraded":"2024-05-20T17:54:23.431307+0000","last_fullsized":"2024-05-20T17:54:23.431307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444086+0000","last_change":"2024-05-20T17:54:23.442483+0000","last_active":"2024-05-20T17:54:23.444086+0000","last_peered":"2024-05-20T17:54:23.444086+0000","last_clean":"2024-05-20T17:54:23.444086+0000","last_became_active":"2024-05-20T17:54:23.442157+0000","last_became_peered":"2024-05-20T17:54:23.442157+0000","last_unstale":"2024-05-20T17:54:23.444086+0000","last_undegraded":"2024-05-20T17:54:23.444086+0000","last_fullsized":"2024-05-20T17:54:23.444086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.433040+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:54:23.433040+0000","last_peered":"2024-05-20T17:54:23.433040+0000","last_clean":"2024-05-20T17:54:23.433040+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:54:23.433040+0000","last_undegraded":"2024-05-20T17:54:23.433040+0000","last_fullsized":"2024-05-20T17:54:23.433040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:54:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-05-20T17:54:29.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.427101+0000', 'last_change': '2024-05-20T17:54:23.427101+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.427101+0000', 'last_undegraded': '2024-05-20T17:54:23.427101+0000', 'last_fullsized': '2024-05-20T17:54:23.427101+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.426352+0000', 'last_change': '2024-05-20T17:54:23.426352+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.426352+0000', 'last_undegraded': '2024-05-20T17:54:23.426352+0000', 'last_fullsized': '2024-05-20T17:54:23.426352+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.430129+0000', 'last_change': '2024-05-20T17:54:23.430129+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.430129+0000', 'last_undegraded': '2024-05-20T17:54:23.430129+0000', 'last_fullsized': '2024-05-20T17:54:23.430129+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.428268+0000', 'last_change': '2024-05-20T17:54:23.428268+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.428268+0000', 'last_undegraded': '2024-05-20T17:54:23.428268+0000', 'last_fullsized': '2024-05-20T17:54:23.428268+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.426271+0000', 'last_change': '2024-05-20T17:54:23.426271+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.426271+0000', 'last_undegraded': '2024-05-20T17:54:23.426271+0000', 'last_fullsized': '2024-05-20T17:54:23.426271+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T17:54:29.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.427396+0000', 'last_change': '2024-05-20T17:54:23.427396+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.427396+0000', 'last_undegraded': '2024-05-20T17:54:23.427396+0000', 'last_fullsized': '2024-05-20T17:54:23.427396+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.429141+0000', 'last_change': '2024-05-20T17:54:23.429141+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.429141+0000', 'last_undegraded': '2024-05-20T17:54:23.429141+0000', 'last_fullsized': '2024-05-20T17:54:23.429141+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.425396+0000', 'last_change': '2024-05-20T17:54:23.425396+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.425396+0000', 'last_undegraded': '2024-05-20T17:54:23.425396+0000', 'last_fullsized': '2024-05-20T17:54:23.425396+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.430395+0000', 'last_change': '2024-05-20T17:54:23.430395+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.430395+0000', 'last_undegraded': '2024-05-20T17:54:23.430395+0000', 'last_fullsized': '2024-05-20T17:54:23.430395+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-05-20T17:54:29.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.431448+0000', 'last_change': '2024-05-20T17:54:23.431448+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.431448+0000', 'last_undegraded': '2024-05-20T17:54:23.431448+0000', 'last_fullsized': '2024-05-20T17:54:23.431448+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.428407+0000', 'last_change': '2024-05-20T17:54:23.428407+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.428407+0000', 'last_undegraded': '2024-05-20T17:54:23.428407+0000', 'last_fullsized': '2024-05-20T17:54:23.428407+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.431513+0000', 'last_change': '2024-05-20T17:54:23.431513+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.431513+0000', 'last_undegraded': '2024-05-20T17:54:23.431513+0000', 'last_fullsized': '2024-05-20T17:54:23.431513+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.429235+0000', 'last_change': '2024-05-20T17:54:23.429235+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.429235+0000', 'last_undegraded': '2024-05-20T17:54:23.429235+0000', 'last_fullsized': '2024-05-20T17:54:23.429235+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.425169+0000', 'last_change': '2024-05-20T17:54:23.425169+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.425169+0000', 'last_undegraded': '2024-05-20T17:54:23.425169+0000', 'last_fullsized': '2024-05-20T17:54:23.425169+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T17:54:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.428575+0000', 'last_change': '2024-05-20T17:54:23.428575+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.428575+0000', 'last_undegraded': '2024-05-20T17:54:23.428575+0000', 'last_fullsized': '2024-05-20T17:54:23.428575+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.431849+0000', 'last_change': '2024-05-20T17:54:23.431849+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.431849+0000', 'last_undegraded': '2024-05-20T17:54:23.431849+0000', 'last_fullsized': '2024-05-20T17:54:23.431849+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.429934+0000', 'last_change': '2024-05-20T17:54:23.429934+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.429934+0000', 'last_undegraded': '2024-05-20T17:54:23.429934+0000', 'last_fullsized': '2024-05-20T17:54:23.429934+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.422614+0000', 'last_change': '2024-05-20T17:54:23.422614+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.422614+0000', 'last_undegraded': '2024-05-20T17:54:23.422614+0000', 'last_fullsized': '2024-05-20T17:54:23.422614+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-05-20T17:54:29.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.431653+0000', 'last_change': '2024-05-20T17:54:23.431653+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.431653+0000', 'last_undegraded': '2024-05-20T17:54:23.431653+0000', 'last_fullsized': '2024-05-20T17:54:23.431653+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T17:54:29.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-05-20T17:54:29.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.425392+0000', 'last_change': '2024-05-20T17:54:23.425392+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.425392+0000', 'last_undegraded': '2024-05-20T17:54:23.425392+0000', 'last_fullsized': '2024-05-20T17:54:23.425392+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T17:54:29.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-05-20T17:54:29.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.428726+0000', 'last_change': '2024-05-20T17:54:23.428726+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.428726+0000', 'last_undegraded': '2024-05-20T17:54:23.428726+0000', 'last_fullsized': '2024-05-20T17:54:23.428726+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-05-20T17:54:29.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.423568+0000', 'last_change': '2024-05-20T17:54:23.423568+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.423568+0000', 'last_undegraded': '2024-05-20T17:54:23.423568+0000', 'last_fullsized': '2024-05-20T17:54:23.423568+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T17:54:29.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-05-20T17:54:29.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.429475+0000', 'last_change': '2024-05-20T17:54:23.429475+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.429475+0000', 'last_undegraded': '2024-05-20T17:54:23.429475+0000', 'last_fullsized': '2024-05-20T17:54:23.429475+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-05-20T17:54:29.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.428463+0000', 'last_change': '2024-05-20T17:54:23.428463+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.428463+0000', 'last_undegraded': '2024-05-20T17:54:23.428463+0000', 'last_fullsized': '2024-05-20T17:54:23.428463+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T17:54:29.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-05-20T17:54:29.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.422140+0000', 'last_change': '2024-05-20T17:54:23.422140+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.422140+0000', 'last_undegraded': '2024-05-20T17:54:23.422140+0000', 'last_fullsized': '2024-05-20T17:54:23.422140+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T17:54:29.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-05-20T17:54:29.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.426848+0000', 'last_change': '2024-05-20T17:54:23.426848+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.426848+0000', 'last_undegraded': '2024-05-20T17:54:23.426848+0000', 'last_fullsized': '2024-05-20T17:54:23.426848+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T17:54:29.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-05-20T17:54:29.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.421757+0000', 'last_change': '2024-05-20T17:54:23.421757+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.421757+0000', 'last_undegraded': '2024-05-20T17:54:23.421757+0000', 'last_fullsized': '2024-05-20T17:54:23.421757+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T17:54:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-05-20T17:54:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.429672+0000', 'last_change': '2024-05-20T17:54:23.429672+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.429672+0000', 'last_undegraded': '2024-05-20T17:54:23.429672+0000', 'last_fullsized': '2024-05-20T17:54:23.429672+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-05-20T17:54:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.421736+0000', 'last_change': '2024-05-20T17:54:23.421736+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.421736+0000', 'last_undegraded': '2024-05-20T17:54:23.421736+0000', 'last_fullsized': '2024-05-20T17:54:23.421736+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T17:54:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-05-20T17:54:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.423749+0000', 'last_change': '2024-05-20T17:54:23.423749+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.423749+0000', 'last_undegraded': '2024-05-20T17:54:23.423749+0000', 'last_fullsized': '2024-05-20T17:54:23.423749+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T17:54:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-05-20T17:54:29.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.428891+0000', 'last_change': '2024-05-20T17:54:23.428891+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.428891+0000', 'last_undegraded': '2024-05-20T17:54:23.428891+0000', 'last_fullsized': '2024-05-20T17:54:23.428891+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-05-20T17:54:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.426216+0000', 'last_change': '2024-05-20T17:54:23.426216+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.426216+0000', 'last_undegraded': '2024-05-20T17:54:23.426216+0000', 'last_fullsized': '2024-05-20T17:54:23.426216+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T17:54:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-05-20T17:54:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.431354+0000', 'last_change': '2024-05-20T17:54:23.431354+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.431354+0000', 'last_undegraded': '2024-05-20T17:54:23.431354+0000', 'last_fullsized': '2024-05-20T17:54:23.431354+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-05-20T17:54:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.425395+0000', 'last_change': '2024-05-20T17:54:23.425395+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.425395+0000', 'last_undegraded': '2024-05-20T17:54:23.425395+0000', 'last_fullsized': '2024-05-20T17:54:23.425395+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T17:54:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-05-20T17:54:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.421392+0000', 'last_change': '2024-05-20T17:54:23.421392+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.421392+0000', 'last_undegraded': '2024-05-20T17:54:23.421392+0000', 'last_fullsized': '2024-05-20T17:54:23.421392+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.426445+0000', 'last_change': '2024-05-20T17:54:23.426445+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.426445+0000', 'last_undegraded': '2024-05-20T17:54:23.426445+0000', 'last_fullsized': '2024-05-20T17:54:23.426445+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.433980+0000', 'last_change': '2024-05-20T17:54:23.433980+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.433980+0000', 'last_undegraded': '2024-05-20T17:54:23.433980+0000', 'last_fullsized': '2024-05-20T17:54:23.433980+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.427995+0000', 'last_change': '2024-05-20T17:54:23.427995+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.427995+0000', 'last_undegraded': '2024-05-20T17:54:23.427995+0000', 'last_fullsized': '2024-05-20T17:54:23.427995+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.424131+0000', 'last_change': '2024-05-20T17:54:23.424131+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.424131+0000', 'last_undegraded': '2024-05-20T17:54:23.424131+0000', 'last_fullsized': '2024-05-20T17:54:23.424131+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-05-20T17:54:29.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.425767+0000', 'last_change': '2024-05-20T17:54:23.425767+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.425767+0000', 'last_undegraded': '2024-05-20T17:54:23.425767+0000', 'last_fullsized': '2024-05-20T17:54:23.425767+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-05-20T17:54:29.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.425885+0000', 'last_change': '2024-05-20T17:54:23.425885+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.425885+0000', 'last_undegraded': '2024-05-20T17:54:23.425885+0000', 'last_fullsized': '2024-05-20T17:54:23.425885+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T17:54:29.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-05-20T17:54:29.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.430380+0000', 'last_change': '2024-05-20T17:54:23.430380+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.430380+0000', 'last_undegraded': '2024-05-20T17:54:23.430380+0000', 'last_fullsized': '2024-05-20T17:54:23.430380+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-05-20T17:54:29.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.429959+0000', 'last_change': '2024-05-20T17:54:23.429959+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.429959+0000', 'last_undegraded': '2024-05-20T17:54:23.429959+0000', 'last_fullsized': '2024-05-20T17:54:23.429959+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.422880+0000', 'last_change': '2024-05-20T17:54:23.422880+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.422880+0000', 'last_undegraded': '2024-05-20T17:54:23.422880+0000', 'last_fullsized': '2024-05-20T17:54:23.422880+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.433431+0000', 'last_change': '2024-05-20T17:54:23.433431+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.433431+0000', 'last_undegraded': '2024-05-20T17:54:23.433431+0000', 'last_fullsized': '2024-05-20T17:54:23.433431+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.424705+0000', 'last_change': '2024-05-20T17:54:23.424705+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.424705+0000', 'last_undegraded': '2024-05-20T17:54:23.424705+0000', 'last_fullsized': '2024-05-20T17:54:23.424705+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.430062+0000', 'last_change': '2024-05-20T17:54:23.430062+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.430062+0000', 'last_undegraded': '2024-05-20T17:54:23.430062+0000', 'last_fullsized': '2024-05-20T17:54:23.430062+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-05-20T17:54:29.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.425255+0000', 'last_change': '2024-05-20T17:54:23.425255+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.425255+0000', 'last_undegraded': '2024-05-20T17:54:23.425255+0000', 'last_fullsized': '2024-05-20T17:54:23.425255+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-05-20T17:54:29.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.424154+0000', 'last_change': '2024-05-20T17:54:23.424154+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.424154+0000', 'last_undegraded': '2024-05-20T17:54:23.424154+0000', 'last_fullsized': '2024-05-20T17:54:23.424154+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-05-20T17:54:29.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.427758+0000', 'last_change': '2024-05-20T17:54:23.427758+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.427758+0000', 'last_undegraded': '2024-05-20T17:54:23.427758+0000', 'last_fullsized': '2024-05-20T17:54:23.427758+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-05-20T17:54:29.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.421993+0000', 'last_change': '2024-05-20T17:54:23.421993+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.421993+0000', 'last_undegraded': '2024-05-20T17:54:23.421993+0000', 'last_fullsized': '2024-05-20T17:54:23.421993+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T17:54:29.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-05-20T17:54:29.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.427173+0000', 'last_change': '2024-05-20T17:54:23.427173+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.427173+0000', 'last_undegraded': '2024-05-20T17:54:23.427173+0000', 'last_fullsized': '2024-05-20T17:54:23.427173+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T17:54:29.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-05-20T17:54:29.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.431327+0000', 'last_change': '2024-05-20T17:54:23.431327+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.431327+0000', 'last_undegraded': '2024-05-20T17:54:23.431327+0000', 'last_fullsized': '2024-05-20T17:54:23.431327+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-05-20T17:54:29.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.429306+0000', 'last_change': '2024-05-20T17:54:23.429306+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.429306+0000', 'last_undegraded': '2024-05-20T17:54:23.429306+0000', 'last_fullsized': '2024-05-20T17:54:23.429306+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:54:29.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-05-20T17:54:29.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.432946+0000', 'last_change': '2024-05-20T17:54:23.432946+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.432946+0000', 'last_undegraded': '2024-05-20T17:54:23.432946+0000', 'last_fullsized': '2024-05-20T17:54:23.432946+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-05-20T17:54:29.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.424183+0000', 'last_change': '2024-05-20T17:54:23.424183+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.424183+0000', 'last_undegraded': '2024-05-20T17:54:23.424183+0000', 'last_fullsized': '2024-05-20T17:54:23.424183+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-05-20T17:54:29.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.425702+0000', 'last_change': '2024-05-20T17:54:23.425702+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.425702+0000', 'last_undegraded': '2024-05-20T17:54:23.425702+0000', 'last_fullsized': '2024-05-20T17:54:23.425702+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T17:54:29.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-05-20T17:54:29.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.429833+0000', 'last_change': '2024-05-20T17:54:23.429833+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.429833+0000', 'last_undegraded': '2024-05-20T17:54:23.429833+0000', 'last_fullsized': '2024-05-20T17:54:23.429833+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.424009+0000', 'last_change': '2024-05-20T17:54:23.424009+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.424009+0000', 'last_undegraded': '2024-05-20T17:54:23.424009+0000', 'last_fullsized': '2024-05-20T17:54:23.424009+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.430867+0000', 'last_change': '2024-05-20T17:54:23.430867+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.430867+0000', 'last_undegraded': '2024-05-20T17:54:23.430867+0000', 'last_fullsized': '2024-05-20T17:54:23.430867+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.426378+0000', 'last_change': '2024-05-20T17:54:23.426378+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.426378+0000', 'last_undegraded': '2024-05-20T17:54:23.426378+0000', 'last_fullsized': '2024-05-20T17:54:23.426378+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.424665+0000', 'last_change': '2024-05-20T17:54:23.424665+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.424665+0000', 'last_undegraded': '2024-05-20T17:54:23.424665+0000', 'last_fullsized': '2024-05-20T17:54:23.424665+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.431614+0000', 'last_change': '2024-05-20T17:54:23.431614+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.431614+0000', 'last_undegraded': '2024-05-20T17:54:23.431614+0000', 'last_fullsized': '2024-05-20T17:54:23.431614+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-05-20T17:54:29.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:54:23.431307+0000', 'last_change': '2024-05-20T17:54:23.431307+0000', 'last_active': '2024-05-20T17:54:23.414526+0000', 'last_peered': '2024-05-20T17:54:23.414526+0000', 'last_clean': '2024-05-20T17:54:23.414526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:54:23.431307+0000', 'last_undegraded': '2024-05-20T17:54:23.431307+0000', 'last_fullsized': '2024-05-20T17:54:23.431307+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'last_clean_scrub_stamp': '2024-05-20T17:54:23.414526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T17:54:29.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-20T17:54:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.424+0000 7f3b0eb4c640 1 Processor -- start 2024-05-20T17:54:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.424+0000 7f3b0eb4c640 1 -- start start 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0eb4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b080b4070 0x7f3b080ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0eb4c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3b080d0560 0x7f3b0806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0eb4c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0806dd20 con 0x7f3b0806d910 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0eb4c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3b080b8490 con 0x7f3b080d0560 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0eb4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0815fa90 con 0x7f3b080b4070 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0c8e8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b080b4070 0x7f3b080ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b07fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3b080d0560 0x7f3b0806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0c8e8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b080b4070 0x7f3b080ba5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:44016/0 (socket says 172.21.15.6:44016) 2024-05-20T17:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0c8e8640 1 -- 172.21.15.6:0/4107266025 learned_addr learned my addr 172.21.15.6:0/4107266025 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.426+0000 7f3b0d0e9640 1 --1- 172.21.15.6:0/4107266025 >> v1:172.21.15.171:6789/0 conn(0x7f3b0806d910 0x7f3b080d27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:51268/0 (socket says 172.21.15.6:51268) 2024-05-20T17:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.427+0000 7f3b07fff640 1 -- 172.21.15.6:0/4107266025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b080b4070 msgr2=0x7f3b080ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.427+0000 7f3b07fff640 1 --2- 172.21.15.6:0/4107266025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b080b4070 0x7f3b080ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.427+0000 7f3b07fff640 1 -- 172.21.15.6:0/4107266025 >> v1:172.21.15.171:6789/0 conn(0x7f3b0806d910 legacy=0x7f3b080d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.427+0000 7f3b07fff640 1 -- 172.21.15.6:0/4107266025 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b080d3f00 con 0x7f3b080d0560 2024-05-20T17:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.427+0000 7f3b0c8e8640 1 --2- 172.21.15.6:0/4107266025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b080b4070 0x7f3b080ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:29.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b07fff640 1 --2- 172.21.15.6:0/4107266025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080d0560 0x7f3b0806d3d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009d90 tx=0x7f3af802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f400ab56dfeacbb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b077fe640 1 -- 172.21.15.6:0/4107266025 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8007740 con 0x7f3b080d0560 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b077fe640 1 -- 172.21.15.6:0/4107266025 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af80078e0 con 0x7f3b080d0560 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b077fe640 1 -- 172.21.15.6:0/4107266025 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8007cb0 con 0x7f3b080d0560 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/4107266025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080d0560 msgr2=0x7f3b0806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/4107266025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080d0560 0x7f3b0806d3d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009d90 tx=0x7f3af802a660 comp rx=0 tx=0).stop 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/4107266025 shutdown_connections 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/4107266025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080d0560 0x7f3b0806d3d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/4107266025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b080b4070 0x7f3b080ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.428+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/4107266025 >> 172.21.15.6:0/4107266025 conn(0x7f3b080d4c10 msgr2=0x7f3b080d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.429+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/4107266025 shutdown_connections 2024-05-20T17:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.429+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/4107266025 wait complete. 2024-05-20T17:54:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.430+0000 7f3b0eb4c640 1 Processor -- start 2024-05-20T17:54:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.430+0000 7f3b0eb4c640 1 -- start start 2024-05-20T17:54:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0eb4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b0806d910 0x7f3b08154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0eb4c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080b4070 0x7f3b081606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0eb4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b080d0560 0x7f3b08159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0eb4c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3b080d47a0 con 0x7f3b080d0560 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0eb4c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3b080d44c0 con 0x7f3b080b4070 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0eb4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3b080bab00 con 0x7f3b0806d910 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0d0e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b080d0560 0x7f3b08159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0d0e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b080d0560 0x7f3b08159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33260/0 (socket says 172.21.15.6:33260) 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0d0e9640 1 -- 172.21.15.6:0/1775450503 learned_addr learned my addr 172.21.15.6:0/1775450503 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0c8e8640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b0806d910 0x7f3b08154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b07fff640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080b4070 0x7f3b081606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0d0e9640 1 -- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b0806d910 msgr2=0x7f3b08154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0d0e9640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b0806d910 0x7f3b08154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0d0e9640 1 -- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080b4070 msgr2=0x7f3b081606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0d0e9640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080b4070 0x7f3b081606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.432+0000 7f3b0d0e9640 1 -- 172.21.15.6:0/1775450503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b081612c0 con 0x7f3b080d0560 2024-05-20T17:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.433+0000 7f3b0d0e9640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b080d0560 0x7f3b08159de0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c3c0 tx=0x7f3af000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.433+0000 7f3b057fa640 1 -- 172.21.15.6:0/1775450503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00074e0 con 0x7f3b080d0560 2024-05-20T17:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.433+0000 7f3b057fa640 1 -- 172.21.15.6:0/1775450503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af0007680 con 0x7f3b080d0560 2024-05-20T17:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.433+0000 7f3b057fa640 1 -- 172.21.15.6:0/1775450503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00049e0 con 0x7f3b080d0560 2024-05-20T17:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.433+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b081615a0 con 0x7f3b080d0560 2024-05-20T17:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.433+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0815c040 con 0x7f3b080d0560 2024-05-20T17:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.434+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b08161ac0 con 0x7f3b080d0560 2024-05-20T17:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.434+0000 7f3b057fa640 1 -- 172.21.15.6:0/1775450503 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3af001a020 con 0x7f3b080d0560 2024-05-20T17:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.435+0000 7f3b057fa640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ae806be60 0x7f3ae806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.435+0000 7f3b057fa640 1 -- 172.21.15.6:0/1775450503 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3af008a630 con 0x7f3b080d0560 2024-05-20T17:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.435+0000 7f3b0c8e8640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ae806be60 0x7f3ae806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.436+0000 7f3b0c8e8640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ae806be60 0x7f3ae806e370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b00006ca0 tx=0x7f3b00009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.440+0000 7f3b057fa640 1 -- 172.21.15.6:0/1775450503 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3b0806dd20 con 0x7f3b080d0560 2024-05-20T17:54:29.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.693+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3b08161050 con 0x7f3b080d0560 2024-05-20T17:54:29.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.693+0000 7f3b057fa640 1 -- 172.21.15.6:0/1775450503 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1034 (secure 0 0 0) 0x7f3af0058760 con 0x7f3b080d0560 2024-05-20T17:54:29.692 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:29.692 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":107,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1716227573,"num_in_osds":8,"osd_in_since":1716227564,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225853440,"bytes_avail":772868259840,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5394}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-05-20T17:54:10.248842+0000","services":{}},"progress_events":{}} 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ae806be60 msgr2=0x7f3ae806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ae806be60 0x7f3ae806e370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b00006ca0 tx=0x7f3b00009240 comp rx=0 tx=0).stop 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b080d0560 msgr2=0x7f3b08159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b080d0560 0x7f3b08159de0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c3c0 tx=0x7f3af000c880 comp rx=0 tx=0).stop 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 shutdown_connections 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ae806be60 0x7f3ae806e370 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b080d0560 0x7f3b08159de0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b080b4070 0x7f3b081606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 --2- 172.21.15.6:0/1775450503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b0806d910 0x7f3b08154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 >> 172.21.15.6:0/1775450503 conn(0x7f3b080d4c10 msgr2=0x7f3b080ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 shutdown_connections 2024-05-20T17:54:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.695+0000 7f3b0eb4c640 1 -- 172.21.15.6:0/1775450503 wait complete. 2024-05-20T17:54:29.705 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-20T17:54:29.705 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:54:29.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.822+0000 7efca4321640 1 Processor -- start 2024-05-20T17:54:29.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.822+0000 7efca4321640 1 -- start start 2024-05-20T17:54:29.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.823+0000 7efca4321640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c0cd710 0x7efc9c162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.823+0000 7efca4321640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc9c0cfae0 0x7efc9c15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.823+0000 7efca4321640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c06c8c0 con 0x7efc9c06d6b0 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.823+0000 7efca4321640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7efc9c0d0ba0 con 0x7efc9c0cfae0 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.823+0000 7efca4321640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c06dac0 con 0x7efc9c0cd710 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.824+0000 7efca28be640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc9c0cfae0 0x7efc9c15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.824+0000 7efca28be640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc9c0cfae0 0x7efc9c15f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33262/0 (socket says 172.21.15.6:33262) 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.824+0000 7efca28be640 1 -- 172.21.15.6:0/3491391354 learned_addr learned my addr 172.21.15.6:0/3491391354 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.824+0000 7efca20bd640 1 --2- 172.21.15.6:0/3491391354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c0cd710 0x7efc9c162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.824+0000 7efca28be640 1 -- 172.21.15.6:0/3491391354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c0cd710 msgr2=0x7efc9c162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:29.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.824+0000 7efca28be640 1 --2- 172.21.15.6:0/3491391354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c0cd710 0x7efc9c162e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.824+0000 7efca28be640 1 -- 172.21.15.6:0/3491391354 >> v1:172.21.15.171:6789/0 conn(0x7efc9c06d6b0 legacy=0x7efc9c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.824+0000 7efca28be640 1 -- 172.21.15.6:0/3491391354 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c1633e0 con 0x7efc9c0cfae0 2024-05-20T17:54:29.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.825+0000 7efca28be640 1 --2- 172.21.15.6:0/3491391354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cfae0 0x7efc9c15f2b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0d0d20 tx=0x7efc9402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666d9709aff9368e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.825+0000 7efca10bb640 1 -- 172.21.15.6:0/3491391354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94036070 con 0x7efc9c0cfae0 2024-05-20T17:54:29.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.825+0000 7efca10bb640 1 -- 172.21.15.6:0/3491391354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc94031600 con 0x7efc9c0cfae0 2024-05-20T17:54:29.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.825+0000 7efca10bb640 1 -- 172.21.15.6:0/3491391354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc940319d0 con 0x7efc9c0cfae0 2024-05-20T17:54:29.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.826+0000 7efca4321640 1 -- 172.21.15.6:0/3491391354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cfae0 msgr2=0x7efc9c15f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.826+0000 7efca4321640 1 --2- 172.21.15.6:0/3491391354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cfae0 0x7efc9c15f2b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0d0d20 tx=0x7efc9402a710 comp rx=0 tx=0).stop 2024-05-20T17:54:29.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.826+0000 7efca4321640 1 -- 172.21.15.6:0/3491391354 shutdown_connections 2024-05-20T17:54:29.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.826+0000 7efca4321640 1 --2- 172.21.15.6:0/3491391354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cfae0 0x7efc9c15f2b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.826+0000 7efca4321640 1 --2- 172.21.15.6:0/3491391354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c0cd710 0x7efc9c162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.826+0000 7efca4321640 1 -- 172.21.15.6:0/3491391354 >> 172.21.15.6:0/3491391354 conn(0x7efc9c0b44d0 msgr2=0x7efc9c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:29.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.826+0000 7efca4321640 1 -- 172.21.15.6:0/3491391354 shutdown_connections 2024-05-20T17:54:29.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.826+0000 7efca4321640 1 -- 172.21.15.6:0/3491391354 wait complete. 2024-05-20T17:54:29.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.828+0000 7efca4321640 1 Processor -- start 2024-05-20T17:54:29.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.828+0000 7efca4321640 1 -- start start 2024-05-20T17:54:29.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca4321640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c06d6b0 0x7efc9c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca4321640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cd710 0x7efc9c15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca4321640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc9c0cb250 0x7efc9c0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca4321640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c163c80 con 0x7efc9c0cd710 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca4321640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c1639a0 con 0x7efc9c0cb250 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca4321640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c0d1030 con 0x7efc9c06d6b0 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca18bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cd710 0x7efc9c15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca18bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cd710 0x7efc9c15ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33274/0 (socket says 172.21.15.6:33274) 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca18bc640 1 -- 172.21.15.6:0/3577583838 learned_addr learned my addr 172.21.15.6:0/3577583838 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca20bd640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c06d6b0 0x7efc9c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca28be640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc9c0cb250 0x7efc9c0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca18bc640 1 -- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c06d6b0 msgr2=0x7efc9c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca18bc640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c06d6b0 0x7efc9c158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca18bc640 1 -- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc9c0cb250 msgr2=0x7efc9c0cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca18bc640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc9c0cb250 0x7efc9c0cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca18bc640 1 -- 172.21.15.6:0/3577583838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c0cbba0 con 0x7efc9c0cd710 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.829+0000 7efca28be640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc9c0cb250 0x7efc9c0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.830+0000 7efca18bc640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cd710 0x7efc9c15ae50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c3c0 tx=0x7efc8c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.830+0000 7efc92ffd640 1 -- 172.21.15.6:0/3577583838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0052d0 con 0x7efc9c0cd710 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.830+0000 7efc92ffd640 1 -- 172.21.15.6:0/3577583838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c005490 con 0x7efc9c0cd710 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.830+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9c15b830 con 0x7efc9c0cd710 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.830+0000 7efc92ffd640 1 -- 172.21.15.6:0/3577583838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c007260 con 0x7efc9c0cd710 2024-05-20T17:54:29.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.830+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9c15bdf0 con 0x7efc9c0cd710 2024-05-20T17:54:29.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.831+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9c075b00 con 0x7efc9c0cd710 2024-05-20T17:54:29.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.832+0000 7efc92ffd640 1 -- 172.21.15.6:0/3577583838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc8c007400 con 0x7efc9c0cd710 2024-05-20T17:54:29.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.832+0000 7efc92ffd640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc8006be60 0x7efc8006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:29.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.832+0000 7efc92ffd640 1 -- 172.21.15.6:0/3577583838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7efc8c08a4e0 con 0x7efc9c0cd710 2024-05-20T17:54:29.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.832+0000 7efca20bd640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc8006be60 0x7efc8006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:29.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.833+0000 7efca20bd640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc8006be60 0x7efc8006e370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efc9c162d60 tx=0x7efc98009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:29.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:29.837+0000 7efc92ffd640 1 -- 172.21.15.6:0/3577583838 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efc9c0cbba0 con 0x7efc9c0cd710 2024-05-20T17:54:30.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.019+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc9c15f5d0 con 0x7efc8006be60 2024-05-20T17:54:30.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.026+0000 7efc92ffd640 1 -- 172.21.15.6:0/3577583838 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246635 (secure 0 0 0) 0x7efc9c15f5d0 con 0x7efc8006be60 2024-05-20T17:54:30.027 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:30.028 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc8006be60 msgr2=0x7efc8006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc8006be60 0x7efc8006e370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efc9c162d60 tx=0x7efc98009190 comp rx=0 tx=0).stop 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cd710 msgr2=0x7efc9c15ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cd710 0x7efc9c15ae50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c3c0 tx=0x7efc8c00c7c0 comp rx=0 tx=0).stop 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 shutdown_connections 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc8006be60 0x7efc8006e370 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc9c0cb250 0x7efc9c0cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0cd710 0x7efc9c15ae50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 --2- 172.21.15.6:0/3577583838 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc9c06d6b0 0x7efc9c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 >> 172.21.15.6:0/3577583838 conn(0x7efc9c0b44d0 msgr2=0x7efc9c0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:30.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 shutdown_connections 2024-05-20T17:54:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:30.029+0000 7efca4321640 1 -- 172.21.15.6:0/3577583838 wait complete. 2024-05-20T17:54:30.038 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-05-20T17:54:28.252818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220560,"kb_used_data":4380,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754160,"statfs":{"total":773094113280,"available":772868259840,"internally_reserved":0,"allocated":4485120,"data_stored":2586141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.837327"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427101+0000","last_change":"2024-05-20T17:54:23.427101+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427101+0000","last_undegraded":"2024-05-20T17:54:23.427101+0000","last_fullsized":"2024-05-20T17:54:23.427101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426352+0000","last_change":"2024-05-20T17:54:23.426352+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426352+0000","last_undegraded":"2024-05-20T17:54:23.426352+0000","last_fullsized":"2024-05-20T17:54:23.426352+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430129+0000","last_change":"2024-05-20T17:54:23.430129+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430129+0000","last_undegraded":"2024-05-20T17:54:23.430129+0000","last_fullsized":"2024-05-20T17:54:23.430129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428268+0000","last_change":"2024-05-20T17:54:23.428268+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428268+0000","last_undegraded":"2024-05-20T17:54:23.428268+0000","last_fullsized":"2024-05-20T17:54:23.428268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426271+0000","last_change":"2024-05-20T17:54:23.426271+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426271+0000","last_undegraded":"2024-05-20T17:54:23.426271+0000","last_fullsized":"2024-05-20T17:54:23.426271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427396+0000","last_change":"2024-05-20T17:54:23.427396+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427396+0000","last_undegraded":"2024-05-20T17:54:23.427396+0000","last_fullsized":"2024-05-20T17:54:23.427396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429141+0000","last_change":"2024-05-20T17:54:23.429141+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429141+0000","last_undegraded":"2024-05-20T17:54:23.429141+0000","last_fullsized":"2024-05-20T17:54:23.429141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425396+0000","last_change":"2024-05-20T17:54:23.425396+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425396+0000","last_undegraded":"2024-05-20T17:54:23.425396+0000","last_fullsized":"2024-05-20T17:54:23.425396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430395+0000","last_change":"2024-05-20T17:54:23.430395+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430395+0000","last_undegraded":"2024-05-20T17:54:23.430395+0000","last_fullsized":"2024-05-20T17:54:23.430395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431448+0000","last_change":"2024-05-20T17:54:23.431448+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431448+0000","last_undegraded":"2024-05-20T17:54:23.431448+0000","last_fullsized":"2024-05-20T17:54:23.431448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428407+0000","last_change":"2024-05-20T17:54:23.428407+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428407+0000","last_undegraded":"2024-05-20T17:54:23.428407+0000","last_fullsized":"2024-05-20T17:54:23.428407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431513+0000","last_change":"2024-05-20T17:54:23.431513+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431513+0000","last_undegraded":"2024-05-20T17:54:23.431513+0000","last_fullsized":"2024-05-20T17:54:23.431513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429235+0000","last_change":"2024-05-20T17:54:23.429235+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429235+0000","last_undegraded":"2024-05-20T17:54:23.429235+0000","last_fullsized":"2024-05-20T17:54:23.429235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425169+0000","last_change":"2024-05-20T17:54:23.425169+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425169+0000","last_undegraded":"2024-05-20T17:54:23.425169+0000","last_fullsized":"2024-05-20T17:54:23.425169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428575+0000","last_change":"2024-05-20T17:54:23.428575+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428575+0000","last_undegraded":"2024-05-20T17:54:23.428575+0000","last_fullsized":"2024-05-20T17:54:23.428575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431849+0000","last_change":"2024-05-20T17:54:23.431849+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431849+0000","last_undegraded":"2024-05-20T17:54:23.431849+0000","last_fullsized":"2024-05-20T17:54:23.431849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429934+0000","last_change":"2024-05-20T17:54:23.429934+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429934+0000","last_undegraded":"2024-05-20T17:54:23.429934+0000","last_fullsized":"2024-05-20T17:54:23.429934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422614+0000","last_change":"2024-05-20T17:54:23.422614+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422614+0000","last_undegraded":"2024-05-20T17:54:23.422614+0000","last_fullsized":"2024-05-20T17:54:23.422614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431653+0000","last_change":"2024-05-20T17:54:23.431653+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431653+0000","last_undegraded":"2024-05-20T17:54:23.431653+0000","last_fullsized":"2024-05-20T17:54:23.431653+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425392+0000","last_change":"2024-05-20T17:54:23.425392+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425392+0000","last_undegraded":"2024-05-20T17:54:23.425392+0000","last_fullsized":"2024-05-20T17:54:23.425392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428726+0000","last_change":"2024-05-20T17:54:23.428726+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428726+0000","last_undegraded":"2024-05-20T17:54:23.428726+0000","last_fullsized":"2024-05-20T17:54:23.428726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.423568+0000","last_change":"2024-05-20T17:54:23.423568+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.423568+0000","last_undegraded":"2024-05-20T17:54:23.423568+0000","last_fullsized":"2024-05-20T17:54:23.423568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429475+0000","last_change":"2024-05-20T17:54:23.429475+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429475+0000","last_undegraded":"2024-05-20T17:54:23.429475+0000","last_fullsized":"2024-05-20T17:54:23.429475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428463+0000","last_change":"2024-05-20T17:54:23.428463+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428463+0000","last_undegraded":"2024-05-20T17:54:23.428463+0000","last_fullsized":"2024-05-20T17:54:23.428463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422140+0000","last_change":"2024-05-20T17:54:23.422140+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422140+0000","last_undegraded":"2024-05-20T17:54:23.422140+0000","last_fullsized":"2024-05-20T17:54:23.422140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426848+0000","last_change":"2024-05-20T17:54:23.426848+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426848+0000","last_undegraded":"2024-05-20T17:54:23.426848+0000","last_fullsized":"2024-05-20T17:54:23.426848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421757+0000","last_change":"2024-05-20T17:54:23.421757+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421757+0000","last_undegraded":"2024-05-20T17:54:23.421757+0000","last_fullsized":"2024-05-20T17:54:23.421757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429672+0000","last_change":"2024-05-20T17:54:23.429672+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429672+0000","last_undegraded":"2024-05-20T17:54:23.429672+0000","last_fullsized":"2024-05-20T17:54:23.429672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421736+0000","last_change":"2024-05-20T17:54:23.421736+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421736+0000","last_undegraded":"2024-05-20T17:54:23.421736+0000","last_fullsized":"2024-05-20T17:54:23.421736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.423749+0000","last_change":"2024-05-20T17:54:23.423749+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.423749+0000","last_undegraded":"2024-05-20T17:54:23.423749+0000","last_fullsized":"2024-05-20T17:54:23.423749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.428891+0000","last_change":"2024-05-20T17:54:23.428891+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.428891+0000","last_undegraded":"2024-05-20T17:54:23.428891+0000","last_fullsized":"2024-05-20T17:54:23.428891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426216+0000","last_change":"2024-05-20T17:54:23.426216+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426216+0000","last_undegraded":"2024-05-20T17:54:23.426216+0000","last_fullsized":"2024-05-20T17:54:23.426216+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431354+0000","last_change":"2024-05-20T17:54:23.431354+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431354+0000","last_undegraded":"2024-05-20T17:54:23.431354+0000","last_fullsized":"2024-05-20T17:54:23.431354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.429235+0000","last_change":"2024-05-20T17:54:23.426910+0000","last_active":"2024-05-20T17:54:23.429235+0000","last_peered":"2024-05-20T17:54:23.429235+0000","last_clean":"2024-05-20T17:54:23.429235+0000","last_became_active":"2024-05-20T17:54:23.426481+0000","last_became_peered":"2024-05-20T17:54:23.426481+0000","last_unstale":"2024-05-20T17:54:23.429235+0000","last_undegraded":"2024-05-20T17:54:23.429235+0000","last_fullsized":"2024-05-20T17:54:23.429235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425395+0000","last_change":"2024-05-20T17:54:23.425395+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425395+0000","last_undegraded":"2024-05-20T17:54:23.425395+0000","last_fullsized":"2024-05-20T17:54:23.425395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442733+0000","last_change":"2024-05-20T17:54:23.437864+0000","last_active":"2024-05-20T17:54:23.442733+0000","last_peered":"2024-05-20T17:54:23.442733+0000","last_clean":"2024-05-20T17:54:23.442733+0000","last_became_active":"2024-05-20T17:54:23.437555+0000","last_became_peered":"2024-05-20T17:54:23.437555+0000","last_unstale":"2024-05-20T17:54:23.442733+0000","last_undegraded":"2024-05-20T17:54:23.442733+0000","last_fullsized":"2024-05-20T17:54:23.442733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421392+0000","last_change":"2024-05-20T17:54:23.421392+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421392+0000","last_undegraded":"2024-05-20T17:54:23.421392+0000","last_fullsized":"2024-05-20T17:54:23.421392+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443106+0000","last_change":"2024-05-20T17:54:23.437547+0000","last_active":"2024-05-20T17:54:23.443106+0000","last_peered":"2024-05-20T17:54:23.443106+0000","last_clean":"2024-05-20T17:54:23.443106+0000","last_became_active":"2024-05-20T17:54:23.436626+0000","last_became_peered":"2024-05-20T17:54:23.436626+0000","last_unstale":"2024-05-20T17:54:23.443106+0000","last_undegraded":"2024-05-20T17:54:23.443106+0000","last_fullsized":"2024-05-20T17:54:23.443106+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426445+0000","last_change":"2024-05-20T17:54:23.426445+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426445+0000","last_undegraded":"2024-05-20T17:54:23.426445+0000","last_fullsized":"2024-05-20T17:54:23.426445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443501+0000","last_change":"2024-05-20T17:54:23.441212+0000","last_active":"2024-05-20T17:54:23.443501+0000","last_peered":"2024-05-20T17:54:23.443501+0000","last_clean":"2024-05-20T17:54:23.443501+0000","last_became_active":"2024-05-20T17:54:23.440875+0000","last_became_peered":"2024-05-20T17:54:23.440875+0000","last_unstale":"2024-05-20T17:54:23.443501+0000","last_undegraded":"2024-05-20T17:54:23.443501+0000","last_fullsized":"2024-05-20T17:54:23.443501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.433980+0000","last_change":"2024-05-20T17:54:23.433980+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.433980+0000","last_undegraded":"2024-05-20T17:54:23.433980+0000","last_fullsized":"2024-05-20T17:54:23.433980+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445107+0000","last_change":"2024-05-20T17:54:23.441793+0000","last_active":"2024-05-20T17:54:23.445107+0000","last_peered":"2024-05-20T17:54:23.445107+0000","last_clean":"2024-05-20T17:54:23.445107+0000","last_became_active":"2024-05-20T17:54:23.441488+0000","last_became_peered":"2024-05-20T17:54:23.441488+0000","last_unstale":"2024-05-20T17:54:23.445107+0000","last_undegraded":"2024-05-20T17:54:23.445107+0000","last_fullsized":"2024-05-20T17:54:23.445107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:30.532097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427995+0000","last_change":"2024-05-20T17:54:23.427995+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427995+0000","last_undegraded":"2024-05-20T17:54:23.427995+0000","last_fullsized":"2024-05-20T17:54:23.427995+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444446+0000","last_change":"2024-05-20T17:54:23.442954+0000","last_active":"2024-05-20T17:54:23.444446+0000","last_peered":"2024-05-20T17:54:23.444446+0000","last_clean":"2024-05-20T17:54:23.444446+0000","last_became_active":"2024-05-20T17:54:23.442646+0000","last_became_peered":"2024-05-20T17:54:23.442646+0000","last_unstale":"2024-05-20T17:54:23.444446+0000","last_undegraded":"2024-05-20T17:54:23.444446+0000","last_fullsized":"2024-05-20T17:54:23.444446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424131+0000","last_change":"2024-05-20T17:54:23.424131+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424131+0000","last_undegraded":"2024-05-20T17:54:23.424131+0000","last_fullsized":"2024-05-20T17:54:23.424131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443205+0000","last_change":"2024-05-20T17:54:23.439623+0000","last_active":"2024-05-20T17:54:23.443205+0000","last_peered":"2024-05-20T17:54:23.443205+0000","last_clean":"2024-05-20T17:54:23.443205+0000","last_became_active":"2024-05-20T17:54:23.439292+0000","last_became_peered":"2024-05-20T17:54:23.439292+0000","last_unstale":"2024-05-20T17:54:23.443205+0000","last_undegraded":"2024-05-20T17:54:23.443205+0000","last_fullsized":"2024-05-20T17:54:23.443205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425767+0000","last_change":"2024-05-20T17:54:23.425767+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425767+0000","last_undegraded":"2024-05-20T17:54:23.425767+0000","last_fullsized":"2024-05-20T17:54:23.425767+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441838+0000","last_change":"2024-05-20T17:54:23.432283+0000","last_active":"2024-05-20T17:54:23.441838+0000","last_peered":"2024-05-20T17:54:23.441838+0000","last_clean":"2024-05-20T17:54:23.441838+0000","last_became_active":"2024-05-20T17:54:23.431945+0000","last_became_peered":"2024-05-20T17:54:23.431945+0000","last_unstale":"2024-05-20T17:54:23.441838+0000","last_undegraded":"2024-05-20T17:54:23.441838+0000","last_fullsized":"2024-05-20T17:54:23.441838+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:25:01.023822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425885+0000","last_change":"2024-05-20T17:54:23.425885+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425885+0000","last_undegraded":"2024-05-20T17:54:23.425885+0000","last_fullsized":"2024-05-20T17:54:23.425885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.437075+0000","last_change":"2024-05-20T17:54:23.430490+0000","last_active":"2024-05-20T17:54:23.437075+0000","last_peered":"2024-05-20T17:54:23.437075+0000","last_clean":"2024-05-20T17:54:23.437075+0000","last_became_active":"2024-05-20T17:54:23.430145+0000","last_became_peered":"2024-05-20T17:54:23.430145+0000","last_unstale":"2024-05-20T17:54:23.437075+0000","last_undegraded":"2024-05-20T17:54:23.437075+0000","last_fullsized":"2024-05-20T17:54:23.437075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:48.427860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430380+0000","last_change":"2024-05-20T17:54:23.430380+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430380+0000","last_undegraded":"2024-05-20T17:54:23.430380+0000","last_fullsized":"2024-05-20T17:54:23.430380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445154+0000","last_change":"2024-05-20T17:54:23.442823+0000","last_active":"2024-05-20T17:54:23.445154+0000","last_peered":"2024-05-20T17:54:23.445154+0000","last_clean":"2024-05-20T17:54:23.445154+0000","last_became_active":"2024-05-20T17:54:23.442499+0000","last_became_peered":"2024-05-20T17:54:23.442499+0000","last_unstale":"2024-05-20T17:54:23.445154+0000","last_undegraded":"2024-05-20T17:54:23.445154+0000","last_fullsized":"2024-05-20T17:54:23.445154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429959+0000","last_change":"2024-05-20T17:54:23.429959+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429959+0000","last_undegraded":"2024-05-20T17:54:23.429959+0000","last_fullsized":"2024-05-20T17:54:23.429959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443266+0000","last_change":"2024-05-20T17:54:23.434450+0000","last_active":"2024-05-20T17:54:23.443266+0000","last_peered":"2024-05-20T17:54:23.443266+0000","last_clean":"2024-05-20T17:54:23.443266+0000","last_became_active":"2024-05-20T17:54:23.433895+0000","last_became_peered":"2024-05-20T17:54:23.433895+0000","last_unstale":"2024-05-20T17:54:23.443266+0000","last_undegraded":"2024-05-20T17:54:23.443266+0000","last_fullsized":"2024-05-20T17:54:23.443266+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.422880+0000","last_change":"2024-05-20T17:54:23.422880+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.422880+0000","last_undegraded":"2024-05-20T17:54:23.422880+0000","last_fullsized":"2024-05-20T17:54:23.422880+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442469+0000","last_change":"2024-05-20T17:54:23.438713+0000","last_active":"2024-05-20T17:54:23.442469+0000","last_peered":"2024-05-20T17:54:23.442469+0000","last_clean":"2024-05-20T17:54:23.442469+0000","last_became_active":"2024-05-20T17:54:23.438399+0000","last_became_peered":"2024-05-20T17:54:23.438399+0000","last_unstale":"2024-05-20T17:54:23.442469+0000","last_undegraded":"2024-05-20T17:54:23.442469+0000","last_fullsized":"2024-05-20T17:54:23.442469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:06.072919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.433431+0000","last_change":"2024-05-20T17:54:23.433431+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.433431+0000","last_undegraded":"2024-05-20T17:54:23.433431+0000","last_fullsized":"2024-05-20T17:54:23.433431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.443051+0000","last_change":"2024-05-20T17:54:23.441709+0000","last_active":"2024-05-20T17:54:23.443051+0000","last_peered":"2024-05-20T17:54:23.443051+0000","last_clean":"2024-05-20T17:54:23.443051+0000","last_became_active":"2024-05-20T17:54:23.441340+0000","last_became_peered":"2024-05-20T17:54:23.441340+0000","last_unstale":"2024-05-20T17:54:23.443051+0000","last_undegraded":"2024-05-20T17:54:23.443051+0000","last_fullsized":"2024-05-20T17:54:23.443051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:42.846897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424705+0000","last_change":"2024-05-20T17:54:23.424705+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424705+0000","last_undegraded":"2024-05-20T17:54:23.424705+0000","last_fullsized":"2024-05-20T17:54:23.424705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445696+0000","last_change":"2024-05-20T17:54:23.444497+0000","last_active":"2024-05-20T17:54:23.445696+0000","last_peered":"2024-05-20T17:54:23.445696+0000","last_clean":"2024-05-20T17:54:23.445696+0000","last_became_active":"2024-05-20T17:54:23.444103+0000","last_became_peered":"2024-05-20T17:54:23.444103+0000","last_unstale":"2024-05-20T17:54:23.445696+0000","last_undegraded":"2024-05-20T17:54:23.445696+0000","last_fullsized":"2024-05-20T17:54:23.445696+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430062+0000","last_change":"2024-05-20T17:54:23.430062+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430062+0000","last_undegraded":"2024-05-20T17:54:23.430062+0000","last_fullsized":"2024-05-20T17:54:23.430062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.429325+0000","last_change":"2024-05-20T17:54:23.427305+0000","last_active":"2024-05-20T17:54:23.429325+0000","last_peered":"2024-05-20T17:54:23.429325+0000","last_clean":"2024-05-20T17:54:23.429325+0000","last_became_active":"2024-05-20T17:54:23.426944+0000","last_became_peered":"2024-05-20T17:54:23.426944+0000","last_unstale":"2024-05-20T17:54:23.429325+0000","last_undegraded":"2024-05-20T17:54:23.429325+0000","last_fullsized":"2024-05-20T17:54:23.429325+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425255+0000","last_change":"2024-05-20T17:54:23.425255+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425255+0000","last_undegraded":"2024-05-20T17:54:23.425255+0000","last_fullsized":"2024-05-20T17:54:23.425255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444514+0000","last_change":"2024-05-20T17:54:23.443423+0000","last_active":"2024-05-20T17:54:23.444514+0000","last_peered":"2024-05-20T17:54:23.444514+0000","last_clean":"2024-05-20T17:54:23.444514+0000","last_became_active":"2024-05-20T17:54:23.443132+0000","last_became_peered":"2024-05-20T17:54:23.443132+0000","last_unstale":"2024-05-20T17:54:23.444514+0000","last_undegraded":"2024-05-20T17:54:23.444514+0000","last_fullsized":"2024-05-20T17:54:23.444514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424154+0000","last_change":"2024-05-20T17:54:23.424154+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424154+0000","last_undegraded":"2024-05-20T17:54:23.424154+0000","last_fullsized":"2024-05-20T17:54:23.424154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445078+0000","last_change":"2024-05-20T17:54:23.440734+0000","last_active":"2024-05-20T17:54:23.445078+0000","last_peered":"2024-05-20T17:54:23.445078+0000","last_clean":"2024-05-20T17:54:23.445078+0000","last_became_active":"2024-05-20T17:54:23.440413+0000","last_became_peered":"2024-05-20T17:54:23.440413+0000","last_unstale":"2024-05-20T17:54:23.445078+0000","last_undegraded":"2024-05-20T17:54:23.445078+0000","last_fullsized":"2024-05-20T17:54:23.445078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427758+0000","last_change":"2024-05-20T17:54:23.427758+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427758+0000","last_undegraded":"2024-05-20T17:54:23.427758+0000","last_fullsized":"2024-05-20T17:54:23.427758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442042+0000","last_change":"2024-05-20T17:54:23.437941+0000","last_active":"2024-05-20T17:54:23.442042+0000","last_peered":"2024-05-20T17:54:23.442042+0000","last_clean":"2024-05-20T17:54:23.442042+0000","last_became_active":"2024-05-20T17:54:23.437605+0000","last_became_peered":"2024-05-20T17:54:23.437605+0000","last_unstale":"2024-05-20T17:54:23.442042+0000","last_undegraded":"2024-05-20T17:54:23.442042+0000","last_fullsized":"2024-05-20T17:54:23.442042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.421993+0000","last_change":"2024-05-20T17:54:23.421993+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.421993+0000","last_undegraded":"2024-05-20T17:54:23.421993+0000","last_fullsized":"2024-05-20T17:54:23.421993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.440936+0000","last_change":"2024-05-20T17:54:23.438445+0000","last_active":"2024-05-20T17:54:23.440936+0000","last_peered":"2024-05-20T17:54:23.440936+0000","last_clean":"2024-05-20T17:54:23.440936+0000","last_became_active":"2024-05-20T17:54:23.438081+0000","last_became_peered":"2024-05-20T17:54:23.438081+0000","last_unstale":"2024-05-20T17:54:23.440936+0000","last_undegraded":"2024-05-20T17:54:23.440936+0000","last_fullsized":"2024-05-20T17:54:23.440936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:48:22.172410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.427173+0000","last_change":"2024-05-20T17:54:23.427173+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.427173+0000","last_undegraded":"2024-05-20T17:54:23.427173+0000","last_fullsized":"2024-05-20T17:54:23.427173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.440265+0000","last_change":"2024-05-20T17:54:23.435922+0000","last_active":"2024-05-20T17:54:23.440265+0000","last_peered":"2024-05-20T17:54:23.440265+0000","last_clean":"2024-05-20T17:54:23.440265+0000","last_became_active":"2024-05-20T17:54:23.435604+0000","last_became_peered":"2024-05-20T17:54:23.435604+0000","last_unstale":"2024-05-20T17:54:23.440265+0000","last_undegraded":"2024-05-20T17:54:23.440265+0000","last_fullsized":"2024-05-20T17:54:23.440265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431327+0000","last_change":"2024-05-20T17:54:23.431327+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431327+0000","last_undegraded":"2024-05-20T17:54:23.431327+0000","last_fullsized":"2024-05-20T17:54:23.431327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445451+0000","last_change":"2024-05-20T17:54:23.441585+0000","last_active":"2024-05-20T17:54:23.445451+0000","last_peered":"2024-05-20T17:54:23.445451+0000","last_clean":"2024-05-20T17:54:23.445451+0000","last_became_active":"2024-05-20T17:54:23.441237+0000","last_became_peered":"2024-05-20T17:54:23.441237+0000","last_unstale":"2024-05-20T17:54:23.445451+0000","last_undegraded":"2024-05-20T17:54:23.445451+0000","last_fullsized":"2024-05-20T17:54:23.445451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:49.039875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429306+0000","last_change":"2024-05-20T17:54:23.429306+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429306+0000","last_undegraded":"2024-05-20T17:54:23.429306+0000","last_fullsized":"2024-05-20T17:54:23.429306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445460+0000","last_change":"2024-05-20T17:54:23.442515+0000","last_active":"2024-05-20T17:54:23.445460+0000","last_peered":"2024-05-20T17:54:23.445460+0000","last_clean":"2024-05-20T17:54:23.445460+0000","last_became_active":"2024-05-20T17:54:23.442147+0000","last_became_peered":"2024-05-20T17:54:23.442147+0000","last_unstale":"2024-05-20T17:54:23.445460+0000","last_undegraded":"2024-05-20T17:54:23.445460+0000","last_fullsized":"2024-05-20T17:54:23.445460+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:16:33.309272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.432946+0000","last_change":"2024-05-20T17:54:23.432946+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.432946+0000","last_undegraded":"2024-05-20T17:54:23.432946+0000","last_fullsized":"2024-05-20T17:54:23.432946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442990+0000","last_change":"2024-05-20T17:54:23.439937+0000","last_active":"2024-05-20T17:54:23.442990+0000","last_peered":"2024-05-20T17:54:23.442990+0000","last_clean":"2024-05-20T17:54:23.442990+0000","last_became_active":"2024-05-20T17:54:23.439619+0000","last_became_peered":"2024-05-20T17:54:23.439619+0000","last_unstale":"2024-05-20T17:54:23.442990+0000","last_undegraded":"2024-05-20T17:54:23.442990+0000","last_fullsized":"2024-05-20T17:54:23.442990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424183+0000","last_change":"2024-05-20T17:54:23.424183+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424183+0000","last_undegraded":"2024-05-20T17:54:23.424183+0000","last_fullsized":"2024-05-20T17:54:23.424183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.445675+0000","last_change":"2024-05-20T17:54:23.443863+0000","last_active":"2024-05-20T17:54:23.445675+0000","last_peered":"2024-05-20T17:54:23.445675+0000","last_clean":"2024-05-20T17:54:23.445675+0000","last_became_active":"2024-05-20T17:54:23.443474+0000","last_became_peered":"2024-05-20T17:54:23.443474+0000","last_unstale":"2024-05-20T17:54:23.445675+0000","last_undegraded":"2024-05-20T17:54:23.445675+0000","last_fullsized":"2024-05-20T17:54:23.445675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:28:12.976404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.425702+0000","last_change":"2024-05-20T17:54:23.425702+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.425702+0000","last_undegraded":"2024-05-20T17:54:23.425702+0000","last_fullsized":"2024-05-20T17:54:23.425702+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.446987+0000","last_change":"2024-05-20T17:54:23.444259+0000","last_active":"2024-05-20T17:54:23.446987+0000","last_peered":"2024-05-20T17:54:23.446987+0000","last_clean":"2024-05-20T17:54:23.446987+0000","last_became_active":"2024-05-20T17:54:23.443911+0000","last_became_peered":"2024-05-20T17:54:23.443911+0000","last_unstale":"2024-05-20T17:54:23.446987+0000","last_undegraded":"2024-05-20T17:54:23.446987+0000","last_fullsized":"2024-05-20T17:54:23.446987+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:34.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.429833+0000","last_change":"2024-05-20T17:54:23.429833+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.429833+0000","last_undegraded":"2024-05-20T17:54:23.429833+0000","last_fullsized":"2024-05-20T17:54:23.429833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441104+0000","last_change":"2024-05-20T17:54:23.439443+0000","last_active":"2024-05-20T17:54:23.441104+0000","last_peered":"2024-05-20T17:54:23.441104+0000","last_clean":"2024-05-20T17:54:23.441104+0000","last_became_active":"2024-05-20T17:54:23.439150+0000","last_became_peered":"2024-05-20T17:54:23.439150+0000","last_unstale":"2024-05-20T17:54:23.441104+0000","last_undegraded":"2024-05-20T17:54:23.441104+0000","last_fullsized":"2024-05-20T17:54:23.441104+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:21:28.894509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424009+0000","last_change":"2024-05-20T17:54:23.424009+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424009+0000","last_undegraded":"2024-05-20T17:54:23.424009+0000","last_fullsized":"2024-05-20T17:54:23.424009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442170+0000","last_change":"2024-05-20T17:54:23.434953+0000","last_active":"2024-05-20T17:54:23.442170+0000","last_peered":"2024-05-20T17:54:23.442170+0000","last_clean":"2024-05-20T17:54:23.442170+0000","last_became_active":"2024-05-20T17:54:23.434622+0000","last_became_peered":"2024-05-20T17:54:23.434622+0000","last_unstale":"2024-05-20T17:54:23.442170+0000","last_undegraded":"2024-05-20T17:54:23.442170+0000","last_fullsized":"2024-05-20T17:54:23.442170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:53.863565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.430867+0000","last_change":"2024-05-20T17:54:23.430867+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.430867+0000","last_undegraded":"2024-05-20T17:54:23.430867+0000","last_fullsized":"2024-05-20T17:54:23.430867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.442564+0000","last_change":"2024-05-20T17:54:23.436462+0000","last_active":"2024-05-20T17:54:23.442564+0000","last_peered":"2024-05-20T17:54:23.442564+0000","last_clean":"2024-05-20T17:54:23.442564+0000","last_became_active":"2024-05-20T17:54:23.436148+0000","last_became_peered":"2024-05-20T17:54:23.436148+0000","last_unstale":"2024-05-20T17:54:23.442564+0000","last_undegraded":"2024-05-20T17:54:23.442564+0000","last_fullsized":"2024-05-20T17:54:23.442564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.426378+0000","last_change":"2024-05-20T17:54:23.426378+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.426378+0000","last_undegraded":"2024-05-20T17:54:23.426378+0000","last_fullsized":"2024-05-20T17:54:23.426378+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.439117+0000","last_change":"2024-05-20T17:54:23.435232+0000","last_active":"2024-05-20T17:54:23.439117+0000","last_peered":"2024-05-20T17:54:23.439117+0000","last_clean":"2024-05-20T17:54:23.439117+0000","last_became_active":"2024-05-20T17:54:23.434898+0000","last_became_peered":"2024-05-20T17:54:23.434898+0000","last_unstale":"2024-05-20T17:54:23.439117+0000","last_undegraded":"2024-05-20T17:54:23.439117+0000","last_fullsized":"2024-05-20T17:54:23.439117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:11.533370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.424665+0000","last_change":"2024-05-20T17:54:23.424665+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.424665+0000","last_undegraded":"2024-05-20T17:54:23.424665+0000","last_fullsized":"2024-05-20T17:54:23.424665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.441905+0000","last_change":"2024-05-20T17:54:23.438769+0000","last_active":"2024-05-20T17:54:23.441905+0000","last_peered":"2024-05-20T17:54:23.441905+0000","last_clean":"2024-05-20T17:54:23.441905+0000","last_became_active":"2024-05-20T17:54:23.438432+0000","last_became_peered":"2024-05-20T17:54:23.438432+0000","last_unstale":"2024-05-20T17:54:23.441905+0000","last_undegraded":"2024-05-20T17:54:23.441905+0000","last_fullsized":"2024-05-20T17:54:23.441905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:47.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431614+0000","last_change":"2024-05-20T17:54:23.431614+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431614+0000","last_undegraded":"2024-05-20T17:54:23.431614+0000","last_fullsized":"2024-05-20T17:54:23.431614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.437123+0000","last_change":"2024-05-20T17:54:23.429638+0000","last_active":"2024-05-20T17:54:23.437123+0000","last_peered":"2024-05-20T17:54:23.437123+0000","last_clean":"2024-05-20T17:54:23.437123+0000","last_became_active":"2024-05-20T17:54:23.429302+0000","last_became_peered":"2024-05-20T17:54:23.429302+0000","last_unstale":"2024-05-20T17:54:23.437123+0000","last_undegraded":"2024-05-20T17:54:23.437123+0000","last_fullsized":"2024-05-20T17:54:23.437123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:55.833142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-05-20T17:54:23.431307+0000","last_change":"2024-05-20T17:54:23.431307+0000","last_active":"2024-05-20T17:54:23.414526+0000","last_peered":"2024-05-20T17:54:23.414526+0000","last_clean":"2024-05-20T17:54:23.414526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:54:23.431307+0000","last_undegraded":"2024-05-20T17:54:23.431307+0000","last_fullsized":"2024-05-20T17:54:23.431307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.444086+0000","last_change":"2024-05-20T17:54:23.442483+0000","last_active":"2024-05-20T17:54:23.444086+0000","last_peered":"2024-05-20T17:54:23.444086+0000","last_clean":"2024-05-20T17:54:23.444086+0000","last_became_active":"2024-05-20T17:54:23.442157+0000","last_became_peered":"2024-05-20T17:54:23.442157+0000","last_unstale":"2024-05-20T17:54:23.444086+0000","last_undegraded":"2024-05-20T17:54:23.444086+0000","last_fullsized":"2024-05-20T17:54:23.444086+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-20T17:54:23.433040+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:54:23.433040+0000","last_peered":"2024-05-20T17:54:23.433040+0000","last_clean":"2024-05-20T17:54:23.433040+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:54:23.433040+0000","last_undegraded":"2024-05-20T17:54:23.433040+0000","last_fullsized":"2024-05-20T17:54:23.433040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":766877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:54:33.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:54:33.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.174+0000 7fdba5c67640 1 Processor -- start 2024-05-20T17:54:33.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.174+0000 7fdba5c67640 1 -- start start 2024-05-20T17:54:33.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.175+0000 7fdba5c67640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdba0163a10 0x7fdba00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.175+0000 7fdba5c67640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00d14b0 0x7fdba00d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.175+0000 7fdba5c67640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba00d0370 con 0x7fdba00b4010 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.175+0000 7fdba5c67640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdba00d3ca0 con 0x7fdba0163a10 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.175+0000 7fdba5c67640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdba00d0650 con 0x7fdba00d14b0 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdba0163a10 0x7fdba00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdba0163a10 0x7fdba00d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33280/0 (socket says 172.21.15.6:33280) 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9f7fe640 1 -- 172.21.15.6:0/175993034 learned_addr learned my addr 172.21.15.6:0/175993034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9ffff640 1 --2- 172.21.15.6:0/175993034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00d14b0 0x7fdba00d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9f7fe640 1 -- 172.21.15.6:0/175993034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00d14b0 msgr2=0x7fdba00d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9f7fe640 1 --2- 172.21.15.6:0/175993034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00d14b0 0x7fdba00d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9f7fe640 1 -- 172.21.15.6:0/175993034 >> v1:172.21.15.171:6789/0 conn(0x7fdba00b4010 legacy=0x7fdba00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9f7fe640 1 -- 172.21.15.6:0/175993034 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba00d3650 con 0x7fdba0163a10 2024-05-20T17:54:33.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.176+0000 7fdb9ffff640 1 --2- 172.21.15.6:0/175993034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00d14b0 0x7fdba00d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:33.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.177+0000 7fdb9f7fe640 1 --2- 172.21.15.6:0/175993034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba0163a10 0x7fdba00d4130 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009870 tx=0x7fdb9002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba0fc031d8277c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.177+0000 7fdb9e7fc640 1 -- 172.21.15.6:0/175993034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90037070 con 0x7fdba0163a10 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.177+0000 7fdb9e7fc640 1 -- 172.21.15.6:0/175993034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb90032440 con 0x7fdba0163a10 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.177+0000 7fdb9e7fc640 1 -- 172.21.15.6:0/175993034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90032810 con 0x7fdba0163a10 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.178+0000 7fdba5c67640 1 -- 172.21.15.6:0/175993034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba0163a10 msgr2=0x7fdba00d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.178+0000 7fdba5c67640 1 --2- 172.21.15.6:0/175993034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba0163a10 0x7fdba00d4130 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009870 tx=0x7fdb9002a210 comp rx=0 tx=0).stop 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.178+0000 7fdba5c67640 1 -- 172.21.15.6:0/175993034 shutdown_connections 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.178+0000 7fdba5c67640 1 --2- 172.21.15.6:0/175993034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00d14b0 0x7fdba00d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.178+0000 7fdba5c67640 1 --2- 172.21.15.6:0/175993034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba0163a10 0x7fdba00d4130 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.178+0000 7fdba5c67640 1 -- 172.21.15.6:0/175993034 >> 172.21.15.6:0/175993034 conn(0x7fdba006d240 msgr2=0x7fdba006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.178+0000 7fdba5c67640 1 -- 172.21.15.6:0/175993034 shutdown_connections 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.178+0000 7fdba5c67640 1 -- 172.21.15.6:0/175993034 wait complete. 2024-05-20T17:54:33.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.180+0000 7fdba5c67640 1 Processor -- start 2024-05-20T17:54:33.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.180+0000 7fdba5c67640 1 -- start start 2024-05-20T17:54:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdba5c67640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00b4010 0x7fdba0153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdba5c67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba00d14b0 0x7fdba015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdba5c67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdba0163a10 0x7fdba015e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdba5c67640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00b8210 con 0x7fdba00d14b0 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdba5c67640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00d1e00 con 0x7fdba0163a10 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdba5c67640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdba00b8390 con 0x7fdba00b4010 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdb9effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba00d14b0 0x7fdba015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdb9effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba00d14b0 0x7fdba015dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33288/0 (socket says 172.21.15.6:33288) 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdb9effd640 1 -- 172.21.15.6:0/3491850307 learned_addr learned my addr 172.21.15.6:0/3491850307 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdb9f7fe640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00b4010 0x7fdba0153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.181+0000 7fdb9ffff640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdba0163a10 0x7fdba015e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb9effd640 1 -- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00b4010 msgr2=0x7fdba0153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb9effd640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00b4010 0x7fdba0153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb9effd640 1 -- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdba0163a10 msgr2=0x7fdba015e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb9effd640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdba0163a10 0x7fdba015e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb9effd640 1 -- 172.21.15.6:0/3491850307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba01577e0 con 0x7fdba00d14b0 2024-05-20T17:54:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb9effd640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba00d14b0 0x7fdba015dca0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400b3f0 tx=0x7fdb9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb87fff640 1 -- 172.21.15.6:0/3491850307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94015020 con 0x7fdba00d14b0 2024-05-20T17:54:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb87fff640 1 -- 172.21.15.6:0/3491850307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb94011830 con 0x7fdba00d14b0 2024-05-20T17:54:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdb87fff640 1 -- 172.21.15.6:0/3491850307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94011c20 con 0x7fdba00d14b0 2024-05-20T17:54:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba0157500 con 0x7fdba00d14b0 2024-05-20T17:54:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.182+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba015fcf0 con 0x7fdba00d14b0 2024-05-20T17:54:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.183+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba0075b00 con 0x7fdba00d14b0 2024-05-20T17:54:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.184+0000 7fdb87fff640 1 -- 172.21.15.6:0/3491850307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb94018020 con 0x7fdba00d14b0 2024-05-20T17:54:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.184+0000 7fdb87fff640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdb8c06be60 0x7fdb8c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.184+0000 7fdb87fff640 1 -- 172.21.15.6:0/3491850307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fdb9408b070 con 0x7fdba00d14b0 2024-05-20T17:54:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.185+0000 7fdb9f7fe640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdb8c06be60 0x7fdb8c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.185+0000 7fdb9f7fe640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdb8c06be60 0x7fdb8c06e370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdb90034000 tx=0x7fdb9002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.189+0000 7fdb87fff640 1 -- 172.21.15.6:0/3491850307 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdb9401f020 con 0x7fdba00d14b0 2024-05-20T17:54:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.374+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdba00d3050 con 0x7fdb8c06be60 2024-05-20T17:54:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.381+0000 7fdb87fff640 1 -- 172.21.15.6:0/3491850307 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fdba00d3050 con 0x7fdb8c06be60 2024-05-20T17:54:33.381 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:33.382 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:54:33.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdb8c06be60 msgr2=0x7fdb8c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdb8c06be60 0x7fdb8c06e370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdb90034000 tx=0x7fdb9002e000 comp rx=0 tx=0).stop 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba00d14b0 msgr2=0x7fdba015dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba00d14b0 0x7fdba015dca0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400b3f0 tx=0x7fdb9400b8b0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 shutdown_connections 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdb8c06be60 0x7fdb8c06e370 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdba0163a10 0x7fdba015e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba00d14b0 0x7fdba015dca0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 --2- 172.21.15.6:0/3491850307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdba00b4010 0x7fdba0153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 >> 172.21.15.6:0/3491850307 conn(0x7fdba006d240 msgr2=0x7fdba00b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 shutdown_connections 2024-05-20T17:54:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.384+0000 7fdba5c67640 1 -- 172.21.15.6:0/3491850307 wait complete. 2024-05-20T17:54:33.394 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-05-20T17:54:32.253817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220816,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753904,"statfs":{"total":773094113280,"available":772867997696,"internally_reserved":0,"allocated":4759552,"data_stored":2708500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001918"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441867+0000","last_change":"2024-05-20T17:54:24.450602+0000","last_active":"2024-05-20T17:54:25.441867+0000","last_peered":"2024-05-20T17:54:25.441867+0000","last_clean":"2024-05-20T17:54:25.441867+0000","last_became_active":"2024-05-20T17:54:24.450269+0000","last_became_peered":"2024-05-20T17:54:24.450269+0000","last_unstale":"2024-05-20T17:54:25.441867+0000","last_undegraded":"2024-05-20T17:54:25.441867+0000","last_fullsized":"2024-05-20T17:54:25.441867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:07:56.965839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441563+0000","last_change":"2024-05-20T17:54:24.465620+0000","last_active":"2024-05-20T17:54:25.441563+0000","last_peered":"2024-05-20T17:54:25.441563+0000","last_clean":"2024-05-20T17:54:25.441563+0000","last_became_active":"2024-05-20T17:54:24.465293+0000","last_became_peered":"2024-05-20T17:54:24.465293+0000","last_unstale":"2024-05-20T17:54:25.441563+0000","last_undegraded":"2024-05-20T17:54:25.441563+0000","last_fullsized":"2024-05-20T17:54:25.441563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:01:48.407748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.594019+0000","last_change":"2024-05-20T17:54:24.471349+0000","last_active":"2024-05-20T17:54:25.594019+0000","last_peered":"2024-05-20T17:54:25.594019+0000","last_clean":"2024-05-20T17:54:25.594019+0000","last_became_active":"2024-05-20T17:54:24.471037+0000","last_became_peered":"2024-05-20T17:54:24.471037+0000","last_unstale":"2024-05-20T17:54:25.594019+0000","last_undegraded":"2024-05-20T17:54:25.594019+0000","last_fullsized":"2024-05-20T17:54:25.594019+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:20.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445482+0000","last_change":"2024-05-20T17:54:24.466266+0000","last_active":"2024-05-20T17:54:26.445482+0000","last_peered":"2024-05-20T17:54:26.445482+0000","last_clean":"2024-05-20T17:54:26.445482+0000","last_became_active":"2024-05-20T17:54:24.465907+0000","last_became_peered":"2024-05-20T17:54:24.465907+0000","last_unstale":"2024-05-20T17:54:26.445482+0000","last_undegraded":"2024-05-20T17:54:26.445482+0000","last_fullsized":"2024-05-20T17:54:26.445482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:46.886517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445358+0000","last_change":"2024-05-20T17:54:24.464469+0000","last_active":"2024-05-20T17:54:26.445358+0000","last_peered":"2024-05-20T17:54:26.445358+0000","last_clean":"2024-05-20T17:54:26.445358+0000","last_became_active":"2024-05-20T17:54:24.464158+0000","last_became_peered":"2024-05-20T17:54:24.464158+0000","last_unstale":"2024-05-20T17:54:26.445358+0000","last_undegraded":"2024-05-20T17:54:26.445358+0000","last_fullsized":"2024-05-20T17:54:26.445358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:12.543935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.656085+0000","last_change":"2024-05-20T17:54:24.457305+0000","last_active":"2024-05-20T17:54:25.656085+0000","last_peered":"2024-05-20T17:54:25.656085+0000","last_clean":"2024-05-20T17:54:25.656085+0000","last_became_active":"2024-05-20T17:54:24.456957+0000","last_became_peered":"2024-05-20T17:54:24.456957+0000","last_unstale":"2024-05-20T17:54:25.656085+0000","last_undegraded":"2024-05-20T17:54:25.656085+0000","last_fullsized":"2024-05-20T17:54:25.656085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:08.125394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448232+0000","last_change":"2024-05-20T17:54:24.463440+0000","last_active":"2024-05-20T17:54:26.448232+0000","last_peered":"2024-05-20T17:54:26.448232+0000","last_clean":"2024-05-20T17:54:26.448232+0000","last_became_active":"2024-05-20T17:54:24.462964+0000","last_became_peered":"2024-05-20T17:54:24.462964+0000","last_unstale":"2024-05-20T17:54:26.448232+0000","last_undegraded":"2024-05-20T17:54:26.448232+0000","last_fullsized":"2024-05-20T17:54:26.448232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:15:16.948164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441246+0000","last_change":"2024-05-20T17:54:24.461543+0000","last_active":"2024-05-20T17:54:25.441246+0000","last_peered":"2024-05-20T17:54:25.441246+0000","last_clean":"2024-05-20T17:54:25.441246+0000","last_became_active":"2024-05-20T17:54:24.459792+0000","last_became_peered":"2024-05-20T17:54:24.459792+0000","last_unstale":"2024-05-20T17:54:25.441246+0000","last_undegraded":"2024-05-20T17:54:25.441246+0000","last_fullsized":"2024-05-20T17:54:25.441246+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:02:21.820493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.594093+0000","last_change":"2024-05-20T17:54:24.472301+0000","last_active":"2024-05-20T17:54:25.594093+0000","last_peered":"2024-05-20T17:54:25.594093+0000","last_clean":"2024-05-20T17:54:25.594093+0000","last_became_active":"2024-05-20T17:54:24.471639+0000","last_became_peered":"2024-05-20T17:54:24.471639+0000","last_unstale":"2024-05-20T17:54:25.594093+0000","last_undegraded":"2024-05-20T17:54:25.594093+0000","last_fullsized":"2024-05-20T17:54:25.594093+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:07:14.956214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448602+0000","last_change":"2024-05-20T17:54:24.470128+0000","last_active":"2024-05-20T17:54:26.448602+0000","last_peered":"2024-05-20T17:54:26.448602+0000","last_clean":"2024-05-20T17:54:26.448602+0000","last_became_active":"2024-05-20T17:54:24.469828+0000","last_became_peered":"2024-05-20T17:54:24.469828+0000","last_unstale":"2024-05-20T17:54:26.448602+0000","last_undegraded":"2024-05-20T17:54:26.448602+0000","last_fullsized":"2024-05-20T17:54:26.448602+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:49.569743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448670+0000","last_change":"2024-05-20T17:54:24.467914+0000","last_active":"2024-05-20T17:54:26.448670+0000","last_peered":"2024-05-20T17:54:26.448670+0000","last_clean":"2024-05-20T17:54:26.448670+0000","last_became_active":"2024-05-20T17:54:24.467599+0000","last_became_peered":"2024-05-20T17:54:24.467599+0000","last_unstale":"2024-05-20T17:54:26.448670+0000","last_undegraded":"2024-05-20T17:54:26.448670+0000","last_fullsized":"2024-05-20T17:54:26.448670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:11.879759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.593819+0000","last_change":"2024-05-20T17:54:24.467985+0000","last_active":"2024-05-20T17:54:25.593819+0000","last_peered":"2024-05-20T17:54:25.593819+0000","last_clean":"2024-05-20T17:54:25.593819+0000","last_became_active":"2024-05-20T17:54:24.467671+0000","last_became_peered":"2024-05-20T17:54:24.467671+0000","last_unstale":"2024-05-20T17:54:25.593819+0000","last_undegraded":"2024-05-20T17:54:25.593819+0000","last_fullsized":"2024-05-20T17:54:25.593819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:08.125394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448304+0000","last_change":"2024-05-20T17:54:24.461500+0000","last_active":"2024-05-20T17:54:26.448304+0000","last_peered":"2024-05-20T17:54:26.448304+0000","last_clean":"2024-05-20T17:54:26.448304+0000","last_became_active":"2024-05-20T17:54:24.461179+0000","last_became_peered":"2024-05-20T17:54:24.461179+0000","last_unstale":"2024-05-20T17:54:26.448304+0000","last_undegraded":"2024-05-20T17:54:26.448304+0000","last_fullsized":"2024-05-20T17:54:26.448304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:03:46.794090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441204+0000","last_change":"2024-05-20T17:54:24.461550+0000","last_active":"2024-05-20T17:54:25.441204+0000","last_peered":"2024-05-20T17:54:25.441204+0000","last_clean":"2024-05-20T17:54:25.441204+0000","last_became_active":"2024-05-20T17:54:24.461243+0000","last_became_peered":"2024-05-20T17:54:24.461243+0000","last_unstale":"2024-05-20T17:54:25.441204+0000","last_undegraded":"2024-05-20T17:54:25.441204+0000","last_fullsized":"2024-05-20T17:54:25.441204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:41.489479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448199+0000","last_change":"2024-05-20T17:54:24.468064+0000","last_active":"2024-05-20T17:54:26.448199+0000","last_peered":"2024-05-20T17:54:26.448199+0000","last_clean":"2024-05-20T17:54:26.448199+0000","last_became_active":"2024-05-20T17:54:24.467757+0000","last_became_peered":"2024-05-20T17:54:24.467757+0000","last_unstale":"2024-05-20T17:54:26.448199+0000","last_undegraded":"2024-05-20T17:54:26.448199+0000","last_fullsized":"2024-05-20T17:54:26.448199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:59.222943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.771671+0000","last_change":"2024-05-20T17:54:24.474832+0000","last_active":"2024-05-20T17:54:26.771671+0000","last_peered":"2024-05-20T17:54:26.771671+0000","last_clean":"2024-05-20T17:54:26.771671+0000","last_became_active":"2024-05-20T17:54:24.474464+0000","last_became_peered":"2024-05-20T17:54:24.474464+0000","last_unstale":"2024-05-20T17:54:26.771671+0000","last_undegraded":"2024-05-20T17:54:26.771671+0000","last_fullsized":"2024-05-20T17:54:26.771671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:36:54.845295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772342+0000","last_change":"2024-05-20T17:54:24.474837+0000","last_active":"2024-05-20T17:54:26.772342+0000","last_peered":"2024-05-20T17:54:26.772342+0000","last_clean":"2024-05-20T17:54:26.772342+0000","last_became_active":"2024-05-20T17:54:24.474538+0000","last_became_peered":"2024-05-20T17:54:24.474538+0000","last_unstale":"2024-05-20T17:54:26.772342+0000","last_undegraded":"2024-05-20T17:54:26.772342+0000","last_fullsized":"2024-05-20T17:54:26.772342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:38.282232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441827+0000","last_change":"2024-05-20T17:54:24.460605+0000","last_active":"2024-05-20T17:54:25.441827+0000","last_peered":"2024-05-20T17:54:25.441827+0000","last_clean":"2024-05-20T17:54:25.441827+0000","last_became_active":"2024-05-20T17:54:24.460263+0000","last_became_peered":"2024-05-20T17:54:24.460263+0000","last_unstale":"2024-05-20T17:54:25.441827+0000","last_undegraded":"2024-05-20T17:54:25.441827+0000","last_fullsized":"2024-05-20T17:54:25.441827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:55.834954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445649+0000","last_change":"2024-05-20T17:54:24.465427+0000","last_active":"2024-05-20T17:54:26.445649+0000","last_peered":"2024-05-20T17:54:26.445649+0000","last_clean":"2024-05-20T17:54:26.445649+0000","last_became_active":"2024-05-20T17:54:24.465040+0000","last_became_peered":"2024-05-20T17:54:24.465040+0000","last_unstale":"2024-05-20T17:54:26.445649+0000","last_undegraded":"2024-05-20T17:54:26.445649+0000","last_fullsized":"2024-05-20T17:54:26.445649+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:27.540045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441443+0000","last_change":"2024-05-20T17:54:24.460653+0000","last_active":"2024-05-20T17:54:25.441443+0000","last_peered":"2024-05-20T17:54:25.441443+0000","last_clean":"2024-05-20T17:54:25.441443+0000","last_became_active":"2024-05-20T17:54:24.460294+0000","last_became_peered":"2024-05-20T17:54:24.460294+0000","last_unstale":"2024-05-20T17:54:25.441443+0000","last_undegraded":"2024-05-20T17:54:25.441443+0000","last_fullsized":"2024-05-20T17:54:25.441443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:57.782345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448394+0000","last_change":"2024-05-20T17:54:24.469020+0000","last_active":"2024-05-20T17:54:26.448394+0000","last_peered":"2024-05-20T17:54:26.448394+0000","last_clean":"2024-05-20T17:54:26.448394+0000","last_became_active":"2024-05-20T17:54:24.464516+0000","last_became_peered":"2024-05-20T17:54:24.464516+0000","last_unstale":"2024-05-20T17:54:26.448394+0000","last_undegraded":"2024-05-20T17:54:26.448394+0000","last_fullsized":"2024-05-20T17:54:26.448394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:38.282232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441659+0000","last_change":"2024-05-20T17:54:24.469356+0000","last_active":"2024-05-20T17:54:25.441659+0000","last_peered":"2024-05-20T17:54:25.441659+0000","last_clean":"2024-05-20T17:54:25.441659+0000","last_became_active":"2024-05-20T17:54:24.468873+0000","last_became_peered":"2024-05-20T17:54:24.468873+0000","last_unstale":"2024-05-20T17:54:25.441659+0000","last_undegraded":"2024-05-20T17:54:25.441659+0000","last_fullsized":"2024-05-20T17:54:25.441659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:08.125394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.771763+0000","last_change":"2024-05-20T17:54:24.467124+0000","last_active":"2024-05-20T17:54:26.771763+0000","last_peered":"2024-05-20T17:54:26.771763+0000","last_clean":"2024-05-20T17:54:26.771763+0000","last_became_active":"2024-05-20T17:54:24.465915+0000","last_became_peered":"2024-05-20T17:54:24.465915+0000","last_unstale":"2024-05-20T17:54:26.771763+0000","last_undegraded":"2024-05-20T17:54:26.771763+0000","last_fullsized":"2024-05-20T17:54:26.771763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:20.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445339+0000","last_change":"2024-05-20T17:54:24.459677+0000","last_active":"2024-05-20T17:54:26.445339+0000","last_peered":"2024-05-20T17:54:26.445339+0000","last_clean":"2024-05-20T17:54:26.445339+0000","last_became_active":"2024-05-20T17:54:24.459343+0000","last_became_peered":"2024-05-20T17:54:24.459343+0000","last_unstale":"2024-05-20T17:54:26.445339+0000","last_undegraded":"2024-05-20T17:54:26.445339+0000","last_fullsized":"2024-05-20T17:54:26.445339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:48.589009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.442033+0000","last_change":"2024-05-20T17:54:24.457347+0000","last_active":"2024-05-20T17:54:25.442033+0000","last_peered":"2024-05-20T17:54:25.442033+0000","last_clean":"2024-05-20T17:54:25.442033+0000","last_became_active":"2024-05-20T17:54:24.457016+0000","last_became_peered":"2024-05-20T17:54:24.457016+0000","last_unstale":"2024-05-20T17:54:25.442033+0000","last_undegraded":"2024-05-20T17:54:25.442033+0000","last_fullsized":"2024-05-20T17:54:25.442033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:03:04.272873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.656343+0000","last_change":"2024-05-20T17:54:24.474203+0000","last_active":"2024-05-20T17:54:25.656343+0000","last_peered":"2024-05-20T17:54:25.656343+0000","last_clean":"2024-05-20T17:54:25.656343+0000","last_became_active":"2024-05-20T17:54:24.473820+0000","last_became_peered":"2024-05-20T17:54:24.473820+0000","last_unstale":"2024-05-20T17:54:25.656343+0000","last_undegraded":"2024-05-20T17:54:25.656343+0000","last_fullsized":"2024-05-20T17:54:25.656343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:20.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441614+0000","last_change":"2024-05-20T17:54:24.466099+0000","last_active":"2024-05-20T17:54:25.441614+0000","last_peered":"2024-05-20T17:54:25.441614+0000","last_clean":"2024-05-20T17:54:25.441614+0000","last_became_active":"2024-05-20T17:54:24.465807+0000","last_became_peered":"2024-05-20T17:54:24.465807+0000","last_unstale":"2024-05-20T17:54:25.441614+0000","last_undegraded":"2024-05-20T17:54:25.441614+0000","last_fullsized":"2024-05-20T17:54:25.441614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:41.489479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448633+0000","last_change":"2024-05-20T17:54:24.464101+0000","last_active":"2024-05-20T17:54:26.448633+0000","last_peered":"2024-05-20T17:54:26.448633+0000","last_clean":"2024-05-20T17:54:26.448633+0000","last_became_active":"2024-05-20T17:54:24.463800+0000","last_became_peered":"2024-05-20T17:54:24.463800+0000","last_unstale":"2024-05-20T17:54:26.448633+0000","last_undegraded":"2024-05-20T17:54:26.448633+0000","last_fullsized":"2024-05-20T17:54:26.448633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:03.456695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441337+0000","last_change":"2024-05-20T17:54:24.459586+0000","last_active":"2024-05-20T17:54:25.441337+0000","last_peered":"2024-05-20T17:54:25.441337+0000","last_clean":"2024-05-20T17:54:25.441337+0000","last_became_active":"2024-05-20T17:54:24.459269+0000","last_became_peered":"2024-05-20T17:54:24.459269+0000","last_unstale":"2024-05-20T17:54:25.441337+0000","last_undegraded":"2024-05-20T17:54:25.441337+0000","last_fullsized":"2024-05-20T17:54:25.441337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:21:56.066485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441095+0000","last_change":"2024-05-20T17:54:24.460251+0000","last_active":"2024-05-20T17:54:25.441095+0000","last_peered":"2024-05-20T17:54:25.441095+0000","last_clean":"2024-05-20T17:54:25.441095+0000","last_became_active":"2024-05-20T17:54:24.459930+0000","last_became_peered":"2024-05-20T17:54:24.459930+0000","last_unstale":"2024-05-20T17:54:25.441095+0000","last_undegraded":"2024-05-20T17:54:25.441095+0000","last_fullsized":"2024-05-20T17:54:25.441095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:43.857462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.771869+0000","last_change":"2024-05-20T17:54:24.467816+0000","last_active":"2024-05-20T17:54:26.771869+0000","last_peered":"2024-05-20T17:54:26.771869+0000","last_clean":"2024-05-20T17:54:26.771869+0000","last_became_active":"2024-05-20T17:54:24.467504+0000","last_became_peered":"2024-05-20T17:54:24.467504+0000","last_unstale":"2024-05-20T17:54:26.771869+0000","last_undegraded":"2024-05-20T17:54:26.771869+0000","last_fullsized":"2024-05-20T17:54:26.771869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:25:08.236384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.655976+0000","last_change":"2024-05-20T17:54:24.466266+0000","last_active":"2024-05-20T17:54:25.655976+0000","last_peered":"2024-05-20T17:54:25.655976+0000","last_clean":"2024-05-20T17:54:25.655976+0000","last_became_active":"2024-05-20T17:54:24.465898+0000","last_became_peered":"2024-05-20T17:54:24.465898+0000","last_unstale":"2024-05-20T17:54:25.655976+0000","last_undegraded":"2024-05-20T17:54:25.655976+0000","last_fullsized":"2024-05-20T17:54:25.655976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:55.834954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772014+0000","last_change":"2024-05-20T17:54:24.474946+0000","last_active":"2024-05-20T17:54:26.772014+0000","last_peered":"2024-05-20T17:54:26.772014+0000","last_clean":"2024-05-20T17:54:26.772014+0000","last_became_active":"2024-05-20T17:54:24.474535+0000","last_became_peered":"2024-05-20T17:54:24.474535+0000","last_unstale":"2024-05-20T17:54:26.772014+0000","last_undegraded":"2024-05-20T17:54:26.772014+0000","last_fullsized":"2024-05-20T17:54:26.772014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:21:34.246203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.442112+0000","last_change":"2024-05-20T17:54:23.426910+0000","last_active":"2024-05-20T17:54:25.442112+0000","last_peered":"2024-05-20T17:54:25.442112+0000","last_clean":"2024-05-20T17:54:25.442112+0000","last_became_active":"2024-05-20T17:54:23.426481+0000","last_became_peered":"2024-05-20T17:54:23.426481+0000","last_unstale":"2024-05-20T17:54:25.442112+0000","last_undegraded":"2024-05-20T17:54:25.442112+0000","last_fullsized":"2024-05-20T17:54:25.442112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.656322+0000","last_change":"2024-05-20T17:54:24.456539+0000","last_active":"2024-05-20T17:54:25.656322+0000","last_peered":"2024-05-20T17:54:25.656322+0000","last_clean":"2024-05-20T17:54:25.656322+0000","last_became_active":"2024-05-20T17:54:24.456248+0000","last_became_peered":"2024-05-20T17:54:24.456248+0000","last_unstale":"2024-05-20T17:54:25.656322+0000","last_undegraded":"2024-05-20T17:54:25.656322+0000","last_fullsized":"2024-05-20T17:54:25.656322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:36:54.845295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.593802+0000","last_change":"2024-05-20T17:54:23.437864+0000","last_active":"2024-05-20T17:54:25.593802+0000","last_peered":"2024-05-20T17:54:25.593802+0000","last_clean":"2024-05-20T17:54:25.593802+0000","last_became_active":"2024-05-20T17:54:23.437555+0000","last_became_peered":"2024-05-20T17:54:23.437555+0000","last_unstale":"2024-05-20T17:54:25.593802+0000","last_undegraded":"2024-05-20T17:54:25.593802+0000","last_fullsized":"2024-05-20T17:54:25.593802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.442205+0000","last_change":"2024-05-20T17:54:24.457775+0000","last_active":"2024-05-20T17:54:25.442205+0000","last_peered":"2024-05-20T17:54:25.442205+0000","last_clean":"2024-05-20T17:54:25.442205+0000","last_became_active":"2024-05-20T17:54:24.457478+0000","last_became_peered":"2024-05-20T17:54:24.457478+0000","last_unstale":"2024-05-20T17:54:25.442205+0000","last_undegraded":"2024-05-20T17:54:25.442205+0000","last_fullsized":"2024-05-20T17:54:25.442205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.740265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.656390+0000","last_change":"2024-05-20T17:54:23.437547+0000","last_active":"2024-05-20T17:54:25.656390+0000","last_peered":"2024-05-20T17:54:25.656390+0000","last_clean":"2024-05-20T17:54:25.656390+0000","last_became_active":"2024-05-20T17:54:23.436626+0000","last_became_peered":"2024-05-20T17:54:23.436626+0000","last_unstale":"2024-05-20T17:54:25.656390+0000","last_undegraded":"2024-05-20T17:54:25.656390+0000","last_fullsized":"2024-05-20T17:54:25.656390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:30.532097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441838+0000","last_change":"2024-05-20T17:54:24.464685+0000","last_active":"2024-05-20T17:54:25.441838+0000","last_peered":"2024-05-20T17:54:25.441838+0000","last_clean":"2024-05-20T17:54:25.441838+0000","last_became_active":"2024-05-20T17:54:24.459761+0000","last_became_peered":"2024-05-20T17:54:24.459761+0000","last_unstale":"2024-05-20T17:54:25.441838+0000","last_undegraded":"2024-05-20T17:54:25.441838+0000","last_fullsized":"2024-05-20T17:54:25.441838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:47:07.582234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.442040+0000","last_change":"2024-05-20T17:54:23.441212+0000","last_active":"2024-05-20T17:54:25.442040+0000","last_peered":"2024-05-20T17:54:25.442040+0000","last_clean":"2024-05-20T17:54:25.442040+0000","last_became_active":"2024-05-20T17:54:23.440875+0000","last_became_peered":"2024-05-20T17:54:23.440875+0000","last_unstale":"2024-05-20T17:54:25.442040+0000","last_undegraded":"2024-05-20T17:54:25.442040+0000","last_fullsized":"2024-05-20T17:54:25.442040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.593688+0000","last_change":"2024-05-20T17:54:24.456956+0000","last_active":"2024-05-20T17:54:25.593688+0000","last_peered":"2024-05-20T17:54:25.593688+0000","last_clean":"2024-05-20T17:54:25.593688+0000","last_became_active":"2024-05-20T17:54:24.456648+0000","last_became_peered":"2024-05-20T17:54:24.456648+0000","last_unstale":"2024-05-20T17:54:25.593688+0000","last_undegraded":"2024-05-20T17:54:25.593688+0000","last_fullsized":"2024-05-20T17:54:25.593688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:41.489479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448431+0000","last_change":"2024-05-20T17:54:23.441793+0000","last_active":"2024-05-20T17:54:26.448431+0000","last_peered":"2024-05-20T17:54:26.448431+0000","last_clean":"2024-05-20T17:54:26.448431+0000","last_became_active":"2024-05-20T17:54:23.441488+0000","last_became_peered":"2024-05-20T17:54:23.441488+0000","last_unstale":"2024-05-20T17:54:26.448431+0000","last_undegraded":"2024-05-20T17:54:26.448431+0000","last_fullsized":"2024-05-20T17:54:26.448431+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:06.072919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448620+0000","last_change":"2024-05-20T17:54:24.466921+0000","last_active":"2024-05-20T17:54:26.448620+0000","last_peered":"2024-05-20T17:54:26.448620+0000","last_clean":"2024-05-20T17:54:26.448620+0000","last_became_active":"2024-05-20T17:54:24.466597+0000","last_became_peered":"2024-05-20T17:54:24.466597+0000","last_unstale":"2024-05-20T17:54:26.448620+0000","last_undegraded":"2024-05-20T17:54:26.448620+0000","last_fullsized":"2024-05-20T17:54:26.448620+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:33:00.440354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.771766+0000","last_change":"2024-05-20T17:54:23.442954+0000","last_active":"2024-05-20T17:54:26.771766+0000","last_peered":"2024-05-20T17:54:26.771766+0000","last_clean":"2024-05-20T17:54:26.771766+0000","last_became_active":"2024-05-20T17:54:23.442646+0000","last_became_peered":"2024-05-20T17:54:23.442646+0000","last_unstale":"2024-05-20T17:54:26.771766+0000","last_undegraded":"2024-05-20T17:54:26.771766+0000","last_fullsized":"2024-05-20T17:54:26.771766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441575+0000","last_change":"2024-05-20T17:54:24.471000+0000","last_active":"2024-05-20T17:54:25.441575+0000","last_peered":"2024-05-20T17:54:25.441575+0000","last_clean":"2024-05-20T17:54:25.441575+0000","last_became_active":"2024-05-20T17:54:24.469365+0000","last_became_peered":"2024-05-20T17:54:24.469365+0000","last_unstale":"2024-05-20T17:54:25.441575+0000","last_undegraded":"2024-05-20T17:54:25.441575+0000","last_fullsized":"2024-05-20T17:54:25.441575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:03:04.272873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.656031+0000","last_change":"2024-05-20T17:54:23.439623+0000","last_active":"2024-05-20T17:54:25.656031+0000","last_peered":"2024-05-20T17:54:25.656031+0000","last_clean":"2024-05-20T17:54:25.656031+0000","last_became_active":"2024-05-20T17:54:23.439292+0000","last_became_peered":"2024-05-20T17:54:23.439292+0000","last_unstale":"2024-05-20T17:54:25.656031+0000","last_undegraded":"2024-05-20T17:54:25.656031+0000","last_fullsized":"2024-05-20T17:54:25.656031+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441757+0000","last_change":"2024-05-20T17:54:24.459115+0000","last_active":"2024-05-20T17:54:25.441757+0000","last_peered":"2024-05-20T17:54:25.441757+0000","last_clean":"2024-05-20T17:54:25.441757+0000","last_became_active":"2024-05-20T17:54:24.458783+0000","last_became_peered":"2024-05-20T17:54:24.458783+0000","last_unstale":"2024-05-20T17:54:25.441757+0000","last_undegraded":"2024-05-20T17:54:25.441757+0000","last_fullsized":"2024-05-20T17:54:25.441757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:11.879759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.440904+0000","last_change":"2024-05-20T17:54:23.432283+0000","last_active":"2024-05-20T17:54:25.440904+0000","last_peered":"2024-05-20T17:54:25.440904+0000","last_clean":"2024-05-20T17:54:25.440904+0000","last_became_active":"2024-05-20T17:54:23.431945+0000","last_became_peered":"2024-05-20T17:54:23.431945+0000","last_unstale":"2024-05-20T17:54:25.440904+0000","last_undegraded":"2024-05-20T17:54:25.440904+0000","last_fullsized":"2024-05-20T17:54:25.440904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:30.532097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445748+0000","last_change":"2024-05-20T17:54:24.466626+0000","last_active":"2024-05-20T17:54:26.445748+0000","last_peered":"2024-05-20T17:54:26.445748+0000","last_clean":"2024-05-20T17:54:26.445748+0000","last_became_active":"2024-05-20T17:54:24.465596+0000","last_became_peered":"2024-05-20T17:54:24.465596+0000","last_unstale":"2024-05-20T17:54:26.445748+0000","last_undegraded":"2024-05-20T17:54:26.445748+0000","last_fullsized":"2024-05-20T17:54:26.445748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:30.810622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441930+0000","last_change":"2024-05-20T17:54:23.430490+0000","last_active":"2024-05-20T17:54:25.441930+0000","last_peered":"2024-05-20T17:54:25.441930+0000","last_clean":"2024-05-20T17:54:25.441930+0000","last_became_active":"2024-05-20T17:54:23.430145+0000","last_became_peered":"2024-05-20T17:54:23.430145+0000","last_unstale":"2024-05-20T17:54:25.441930+0000","last_undegraded":"2024-05-20T17:54:25.441930+0000","last_fullsized":"2024-05-20T17:54:25.441930+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:40.478914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772213+0000","last_change":"2024-05-20T17:54:24.467088+0000","last_active":"2024-05-20T17:54:26.772213+0000","last_peered":"2024-05-20T17:54:26.772213+0000","last_clean":"2024-05-20T17:54:26.772213+0000","last_became_active":"2024-05-20T17:54:24.465299+0000","last_became_peered":"2024-05-20T17:54:24.465299+0000","last_unstale":"2024-05-20T17:54:26.772213+0000","last_undegraded":"2024-05-20T17:54:26.772213+0000","last_fullsized":"2024-05-20T17:54:26.772213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:02:21.820493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448827+0000","last_change":"2024-05-20T17:54:23.442823+0000","last_active":"2024-05-20T17:54:26.448827+0000","last_peered":"2024-05-20T17:54:26.448827+0000","last_clean":"2024-05-20T17:54:26.448827+0000","last_became_active":"2024-05-20T17:54:23.442499+0000","last_became_peered":"2024-05-20T17:54:23.442499+0000","last_unstale":"2024-05-20T17:54:26.448827+0000","last_undegraded":"2024-05-20T17:54:26.448827+0000","last_fullsized":"2024-05-20T17:54:26.448827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:48.427860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.593887+0000","last_change":"2024-05-20T17:54:24.457445+0000","last_active":"2024-05-20T17:54:25.593887+0000","last_peered":"2024-05-20T17:54:25.593887+0000","last_clean":"2024-05-20T17:54:25.593887+0000","last_became_active":"2024-05-20T17:54:24.457138+0000","last_became_peered":"2024-05-20T17:54:24.457138+0000","last_unstale":"2024-05-20T17:54:25.593887+0000","last_undegraded":"2024-05-20T17:54:25.593887+0000","last_fullsized":"2024-05-20T17:54:25.593887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.740265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448794+0000","last_change":"2024-05-20T17:54:23.434450+0000","last_active":"2024-05-20T17:54:26.448794+0000","last_peered":"2024-05-20T17:54:26.448794+0000","last_clean":"2024-05-20T17:54:26.448794+0000","last_became_active":"2024-05-20T17:54:23.433895+0000","last_became_peered":"2024-05-20T17:54:23.433895+0000","last_unstale":"2024-05-20T17:54:26.448794+0000","last_undegraded":"2024-05-20T17:54:26.448794+0000","last_fullsized":"2024-05-20T17:54:26.448794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:56.771779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.442317+0000","last_change":"2024-05-20T17:54:24.465293+0000","last_active":"2024-05-20T17:54:25.442317+0000","last_peered":"2024-05-20T17:54:25.442317+0000","last_clean":"2024-05-20T17:54:25.442317+0000","last_became_active":"2024-05-20T17:54:24.464967+0000","last_became_peered":"2024-05-20T17:54:24.464967+0000","last_unstale":"2024-05-20T17:54:25.442317+0000","last_undegraded":"2024-05-20T17:54:25.442317+0000","last_fullsized":"2024-05-20T17:54:25.442317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:20.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441641+0000","last_change":"2024-05-20T17:54:23.438713+0000","last_active":"2024-05-20T17:54:25.441641+0000","last_peered":"2024-05-20T17:54:25.441641+0000","last_clean":"2024-05-20T17:54:25.441641+0000","last_became_active":"2024-05-20T17:54:23.438399+0000","last_became_peered":"2024-05-20T17:54:23.438399+0000","last_unstale":"2024-05-20T17:54:25.441641+0000","last_undegraded":"2024-05-20T17:54:25.441641+0000","last_fullsized":"2024-05-20T17:54:25.441641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:21:55.055919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.593730+0000","last_change":"2024-05-20T17:54:24.470853+0000","last_active":"2024-05-20T17:54:25.593730+0000","last_peered":"2024-05-20T17:54:25.593730+0000","last_clean":"2024-05-20T17:54:25.593730+0000","last_became_active":"2024-05-20T17:54:24.470491+0000","last_became_peered":"2024-05-20T17:54:24.470491+0000","last_unstale":"2024-05-20T17:54:25.593730+0000","last_undegraded":"2024-05-20T17:54:25.593730+0000","last_fullsized":"2024-05-20T17:54:25.593730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:55.834954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441836+0000","last_change":"2024-05-20T17:54:23.441709+0000","last_active":"2024-05-20T17:54:25.441836+0000","last_peered":"2024-05-20T17:54:25.441836+0000","last_clean":"2024-05-20T17:54:25.441836+0000","last_became_active":"2024-05-20T17:54:23.441340+0000","last_became_peered":"2024-05-20T17:54:23.441340+0000","last_unstale":"2024-05-20T17:54:25.441836+0000","last_undegraded":"2024-05-20T17:54:25.441836+0000","last_fullsized":"2024-05-20T17:54:25.441836+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:56.771779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441362+0000","last_change":"2024-05-20T17:54:24.451763+0000","last_active":"2024-05-20T17:54:25.441362+0000","last_peered":"2024-05-20T17:54:25.441362+0000","last_clean":"2024-05-20T17:54:25.441362+0000","last_became_active":"2024-05-20T17:54:24.451414+0000","last_became_peered":"2024-05-20T17:54:24.451414+0000","last_unstale":"2024-05-20T17:54:25.441362+0000","last_undegraded":"2024-05-20T17:54:25.441362+0000","last_fullsized":"2024-05-20T17:54:25.441362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:15:16.948164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.655966+0000","last_change":"2024-05-20T17:54:23.444497+0000","last_active":"2024-05-20T17:54:25.655966+0000","last_peered":"2024-05-20T17:54:25.655966+0000","last_clean":"2024-05-20T17:54:25.655966+0000","last_became_active":"2024-05-20T17:54:23.444103+0000","last_became_peered":"2024-05-20T17:54:23.444103+0000","last_unstale":"2024-05-20T17:54:25.655966+0000","last_undegraded":"2024-05-20T17:54:25.655966+0000","last_fullsized":"2024-05-20T17:54:25.655966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.771843+0000","last_change":"2024-05-20T17:54:24.468318+0000","last_active":"2024-05-20T17:54:26.771843+0000","last_peered":"2024-05-20T17:54:26.771843+0000","last_clean":"2024-05-20T17:54:26.771843+0000","last_became_active":"2024-05-20T17:54:24.467983+0000","last_became_peered":"2024-05-20T17:54:24.467983+0000","last_unstale":"2024-05-20T17:54:26.771843+0000","last_undegraded":"2024-05-20T17:54:26.771843+0000","last_fullsized":"2024-05-20T17:54:26.771843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:07:14.956214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441668+0000","last_change":"2024-05-20T17:54:23.427305+0000","last_active":"2024-05-20T17:54:25.441668+0000","last_peered":"2024-05-20T17:54:25.441668+0000","last_clean":"2024-05-20T17:54:25.441668+0000","last_became_active":"2024-05-20T17:54:23.426944+0000","last_became_peered":"2024-05-20T17:54:23.426944+0000","last_unstale":"2024-05-20T17:54:25.441668+0000","last_undegraded":"2024-05-20T17:54:25.441668+0000","last_fullsized":"2024-05-20T17:54:25.441668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:45.875952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441528+0000","last_change":"2024-05-20T17:54:24.454028+0000","last_active":"2024-05-20T17:54:25.441528+0000","last_peered":"2024-05-20T17:54:25.441528+0000","last_clean":"2024-05-20T17:54:25.441528+0000","last_became_active":"2024-05-20T17:54:24.453705+0000","last_became_peered":"2024-05-20T17:54:24.453705+0000","last_unstale":"2024-05-20T17:54:25.441528+0000","last_undegraded":"2024-05-20T17:54:25.441528+0000","last_fullsized":"2024-05-20T17:54:25.441528+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:38.282232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.771718+0000","last_change":"2024-05-20T17:54:23.443423+0000","last_active":"2024-05-20T17:54:26.771718+0000","last_peered":"2024-05-20T17:54:26.771718+0000","last_clean":"2024-05-20T17:54:26.771718+0000","last_became_active":"2024-05-20T17:54:23.443132+0000","last_became_peered":"2024-05-20T17:54:23.443132+0000","last_unstale":"2024-05-20T17:54:26.771718+0000","last_undegraded":"2024-05-20T17:54:26.771718+0000","last_fullsized":"2024-05-20T17:54:26.771718+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:30.532097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441565+0000","last_change":"2024-05-20T17:54:24.455490+0000","last_active":"2024-05-20T17:54:25.441565+0000","last_peered":"2024-05-20T17:54:25.441565+0000","last_clean":"2024-05-20T17:54:25.441565+0000","last_became_active":"2024-05-20T17:54:24.455161+0000","last_became_peered":"2024-05-20T17:54:24.455161+0000","last_unstale":"2024-05-20T17:54:25.441565+0000","last_undegraded":"2024-05-20T17:54:25.441565+0000","last_fullsized":"2024-05-20T17:54:25.441565+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:33:00.440354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448839+0000","last_change":"2024-05-20T17:54:23.440734+0000","last_active":"2024-05-20T17:54:26.448839+0000","last_peered":"2024-05-20T17:54:26.448839+0000","last_clean":"2024-05-20T17:54:26.448839+0000","last_became_active":"2024-05-20T17:54:23.440413+0000","last_became_peered":"2024-05-20T17:54:23.440413+0000","last_unstale":"2024-05-20T17:54:26.448839+0000","last_undegraded":"2024-05-20T17:54:26.448839+0000","last_fullsized":"2024-05-20T17:54:26.448839+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:35:42.846897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448631+0000","last_change":"2024-05-20T17:54:24.455630+0000","last_active":"2024-05-20T17:54:26.448631+0000","last_peered":"2024-05-20T17:54:26.448631+0000","last_clean":"2024-05-20T17:54:26.448631+0000","last_became_active":"2024-05-20T17:54:24.455276+0000","last_became_peered":"2024-05-20T17:54:24.455276+0000","last_unstale":"2024-05-20T17:54:26.448631+0000","last_undegraded":"2024-05-20T17:54:26.448631+0000","last_fullsized":"2024-05-20T17:54:26.448631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:01:48.407748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.442309+0000","last_change":"2024-05-20T17:54:23.437941+0000","last_active":"2024-05-20T17:54:25.442309+0000","last_peered":"2024-05-20T17:54:25.442309+0000","last_clean":"2024-05-20T17:54:25.442309+0000","last_became_active":"2024-05-20T17:54:23.437605+0000","last_became_peered":"2024-05-20T17:54:23.437605+0000","last_unstale":"2024-05-20T17:54:25.442309+0000","last_undegraded":"2024-05-20T17:54:25.442309+0000","last_fullsized":"2024-05-20T17:54:25.442309+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.759769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.442215+0000","last_change":"2024-05-20T17:54:24.452783+0000","last_active":"2024-05-20T17:54:25.442215+0000","last_peered":"2024-05-20T17:54:25.442215+0000","last_clean":"2024-05-20T17:54:25.442215+0000","last_became_active":"2024-05-20T17:54:24.452474+0000","last_became_peered":"2024-05-20T17:54:24.452474+0000","last_unstale":"2024-05-20T17:54:25.442215+0000","last_undegraded":"2024-05-20T17:54:25.442215+0000","last_fullsized":"2024-05-20T17:54:25.442215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:36:54.845295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445529+0000","last_change":"2024-05-20T17:54:23.438445+0000","last_active":"2024-05-20T17:54:26.445529+0000","last_peered":"2024-05-20T17:54:26.445529+0000","last_clean":"2024-05-20T17:54:26.445529+0000","last_became_active":"2024-05-20T17:54:23.438081+0000","last_became_peered":"2024-05-20T17:54:23.438081+0000","last_unstale":"2024-05-20T17:54:26.445529+0000","last_undegraded":"2024-05-20T17:54:26.445529+0000","last_fullsized":"2024-05-20T17:54:26.445529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:23:35.766050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445751+0000","last_change":"2024-05-20T17:54:24.464223+0000","last_active":"2024-05-20T17:54:26.445751+0000","last_peered":"2024-05-20T17:54:26.445751+0000","last_clean":"2024-05-20T17:54:26.445751+0000","last_became_active":"2024-05-20T17:54:24.463904+0000","last_became_peered":"2024-05-20T17:54:24.463904+0000","last_unstale":"2024-05-20T17:54:26.445751+0000","last_undegraded":"2024-05-20T17:54:26.445751+0000","last_fullsized":"2024-05-20T17:54:26.445751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:31.542662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.656188+0000","last_change":"2024-05-20T17:54:23.435922+0000","last_active":"2024-05-20T17:54:25.656188+0000","last_peered":"2024-05-20T17:54:25.656188+0000","last_clean":"2024-05-20T17:54:25.656188+0000","last_became_active":"2024-05-20T17:54:23.435604+0000","last_became_peered":"2024-05-20T17:54:23.435604+0000","last_unstale":"2024-05-20T17:54:25.656188+0000","last_undegraded":"2024-05-20T17:54:25.656188+0000","last_fullsized":"2024-05-20T17:54:25.656188+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:34.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772028+0000","last_change":"2024-05-20T17:54:24.468830+0000","last_active":"2024-05-20T17:54:26.772028+0000","last_peered":"2024-05-20T17:54:26.772028+0000","last_clean":"2024-05-20T17:54:26.772028+0000","last_became_active":"2024-05-20T17:54:24.468519+0000","last_became_peered":"2024-05-20T17:54:24.468519+0000","last_unstale":"2024-05-20T17:54:26.772028+0000","last_undegraded":"2024-05-20T17:54:26.772028+0000","last_fullsized":"2024-05-20T17:54:26.772028+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:59.222943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445199+0000","last_change":"2024-05-20T17:54:23.441585+0000","last_active":"2024-05-20T17:54:26.445199+0000","last_peered":"2024-05-20T17:54:26.445199+0000","last_clean":"2024-05-20T17:54:26.445199+0000","last_became_active":"2024-05-20T17:54:23.441237+0000","last_became_peered":"2024-05-20T17:54:23.441237+0000","last_unstale":"2024-05-20T17:54:26.445199+0000","last_undegraded":"2024-05-20T17:54:26.445199+0000","last_fullsized":"2024-05-20T17:54:26.445199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:42:35.795029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.593756+0000","last_change":"2024-05-20T17:54:24.460900+0000","last_active":"2024-05-20T17:54:25.593756+0000","last_peered":"2024-05-20T17:54:25.593756+0000","last_clean":"2024-05-20T17:54:25.593756+0000","last_became_active":"2024-05-20T17:54:24.460359+0000","last_became_peered":"2024-05-20T17:54:24.460359+0000","last_unstale":"2024-05-20T17:54:25.593756+0000","last_undegraded":"2024-05-20T17:54:25.593756+0000","last_fullsized":"2024-05-20T17:54:25.593756+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:03:04.272873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445202+0000","last_change":"2024-05-20T17:54:23.442515+0000","last_active":"2024-05-20T17:54:26.445202+0000","last_peered":"2024-05-20T17:54:26.445202+0000","last_clean":"2024-05-20T17:54:26.445202+0000","last_became_active":"2024-05-20T17:54:23.442147+0000","last_became_peered":"2024-05-20T17:54:23.442147+0000","last_unstale":"2024-05-20T17:54:26.445202+0000","last_undegraded":"2024-05-20T17:54:26.445202+0000","last_fullsized":"2024-05-20T17:54:26.445202+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:23:30.619910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448303+0000","last_change":"2024-05-20T17:54:24.461169+0000","last_active":"2024-05-20T17:54:26.448303+0000","last_peered":"2024-05-20T17:54:26.448303+0000","last_clean":"2024-05-20T17:54:26.448303+0000","last_became_active":"2024-05-20T17:54:24.460769+0000","last_became_peered":"2024-05-20T17:54:24.460769+0000","last_unstale":"2024-05-20T17:54:26.448303+0000","last_undegraded":"2024-05-20T17:54:26.448303+0000","last_fullsized":"2024-05-20T17:54:26.448303+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:02:21.820493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772012+0000","last_change":"2024-05-20T17:54:23.439937+0000","last_active":"2024-05-20T17:54:26.772012+0000","last_peered":"2024-05-20T17:54:26.772012+0000","last_clean":"2024-05-20T17:54:26.772012+0000","last_became_active":"2024-05-20T17:54:23.439619+0000","last_became_peered":"2024-05-20T17:54:23.439619+0000","last_unstale":"2024-05-20T17:54:26.772012+0000","last_undegraded":"2024-05-20T17:54:26.772012+0000","last_fullsized":"2024-05-20T17:54:26.772012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:17:55.833142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441711+0000","last_change":"2024-05-20T17:54:24.459106+0000","last_active":"2024-05-20T17:54:25.441711+0000","last_peered":"2024-05-20T17:54:25.441711+0000","last_clean":"2024-05-20T17:54:25.441711+0000","last_became_active":"2024-05-20T17:54:24.458761+0000","last_became_peered":"2024-05-20T17:54:24.458761+0000","last_unstale":"2024-05-20T17:54:25.441711+0000","last_undegraded":"2024-05-20T17:54:25.441711+0000","last_fullsized":"2024-05-20T17:54:25.441711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:49.569743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445160+0000","last_change":"2024-05-20T17:54:23.443863+0000","last_active":"2024-05-20T17:54:26.445160+0000","last_peered":"2024-05-20T17:54:26.445160+0000","last_clean":"2024-05-20T17:54:26.445160+0000","last_became_active":"2024-05-20T17:54:23.443474+0000","last_became_peered":"2024-05-20T17:54:23.443474+0000","last_unstale":"2024-05-20T17:54:26.445160+0000","last_undegraded":"2024-05-20T17:54:26.445160+0000","last_fullsized":"2024-05-20T17:54:26.445160+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:35.162681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.656155+0000","last_change":"2024-05-20T17:54:24.456991+0000","last_active":"2024-05-20T17:54:25.656155+0000","last_peered":"2024-05-20T17:54:25.656155+0000","last_clean":"2024-05-20T17:54:25.656155+0000","last_became_active":"2024-05-20T17:54:24.456700+0000","last_became_peered":"2024-05-20T17:54:24.456700+0000","last_unstale":"2024-05-20T17:54:25.656155+0000","last_undegraded":"2024-05-20T17:54:25.656155+0000","last_fullsized":"2024-05-20T17:54:25.656155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:06.740265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448969+0000","last_change":"2024-05-20T17:54:23.444259+0000","last_active":"2024-05-20T17:54:26.448969+0000","last_peered":"2024-05-20T17:54:26.448969+0000","last_clean":"2024-05-20T17:54:26.448969+0000","last_became_active":"2024-05-20T17:54:23.443911+0000","last_became_peered":"2024-05-20T17:54:23.443911+0000","last_unstale":"2024-05-20T17:54:26.448969+0000","last_undegraded":"2024-05-20T17:54:26.448969+0000","last_fullsized":"2024-05-20T17:54:26.448969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:21:55.055919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772276+0000","last_change":"2024-05-20T17:54:24.466673+0000","last_active":"2024-05-20T17:54:26.772276+0000","last_peered":"2024-05-20T17:54:26.772276+0000","last_clean":"2024-05-20T17:54:26.772276+0000","last_became_active":"2024-05-20T17:54:24.466318+0000","last_became_peered":"2024-05-20T17:54:24.466318+0000","last_unstale":"2024-05-20T17:54:26.772276+0000","last_undegraded":"2024-05-20T17:54:26.772276+0000","last_fullsized":"2024-05-20T17:54:26.772276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:15:16.948164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.445644+0000","last_change":"2024-05-20T17:54:23.439443+0000","last_active":"2024-05-20T17:54:26.445644+0000","last_peered":"2024-05-20T17:54:26.445644+0000","last_clean":"2024-05-20T17:54:26.445644+0000","last_became_active":"2024-05-20T17:54:23.439150+0000","last_became_peered":"2024-05-20T17:54:23.439150+0000","last_unstale":"2024-05-20T17:54:26.445644+0000","last_undegraded":"2024-05-20T17:54:26.445644+0000","last_fullsized":"2024-05-20T17:54:26.445644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:37:06.670689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441579+0000","last_change":"2024-05-20T17:54:24.450693+0000","last_active":"2024-05-20T17:54:25.441579+0000","last_peered":"2024-05-20T17:54:25.441579+0000","last_clean":"2024-05-20T17:54:25.441579+0000","last_became_active":"2024-05-20T17:54:24.450333+0000","last_became_peered":"2024-05-20T17:54:24.450333+0000","last_unstale":"2024-05-20T17:54:25.441579+0000","last_undegraded":"2024-05-20T17:54:25.441579+0000","last_fullsized":"2024-05-20T17:54:25.441579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:03.456695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.593910+0000","last_change":"2024-05-20T17:54:23.434953+0000","last_active":"2024-05-20T17:54:25.593910+0000","last_peered":"2024-05-20T17:54:25.593910+0000","last_clean":"2024-05-20T17:54:25.593910+0000","last_became_active":"2024-05-20T17:54:23.434622+0000","last_became_peered":"2024-05-20T17:54:23.434622+0000","last_unstale":"2024-05-20T17:54:25.593910+0000","last_undegraded":"2024-05-20T17:54:25.593910+0000","last_fullsized":"2024-05-20T17:54:25.593910+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.593927+0000","last_change":"2024-05-20T17:54:24.463250+0000","last_active":"2024-05-20T17:54:25.593927+0000","last_peered":"2024-05-20T17:54:25.593927+0000","last_clean":"2024-05-20T17:54:25.593927+0000","last_became_active":"2024-05-20T17:54:24.462847+0000","last_became_peered":"2024-05-20T17:54:24.462847+0000","last_unstale":"2024-05-20T17:54:25.593927+0000","last_undegraded":"2024-05-20T17:54:25.593927+0000","last_fullsized":"2024-05-20T17:54:25.593927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:36:54.845295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.594058+0000","last_change":"2024-05-20T17:54:23.436462+0000","last_active":"2024-05-20T17:54:25.594058+0000","last_peered":"2024-05-20T17:54:25.594058+0000","last_clean":"2024-05-20T17:54:25.594058+0000","last_became_active":"2024-05-20T17:54:23.436148+0000","last_became_peered":"2024-05-20T17:54:23.436148+0000","last_unstale":"2024-05-20T17:54:25.594058+0000","last_undegraded":"2024-05-20T17:54:25.594058+0000","last_fullsized":"2024-05-20T17:54:25.594058+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.656009+0000","last_change":"2024-05-20T17:54:24.455237+0000","last_active":"2024-05-20T17:54:25.656009+0000","last_peered":"2024-05-20T17:54:25.656009+0000","last_clean":"2024-05-20T17:54:25.656009+0000","last_became_active":"2024-05-20T17:54:24.454906+0000","last_became_peered":"2024-05-20T17:54:24.454906+0000","last_unstale":"2024-05-20T17:54:25.656009+0000","last_undegraded":"2024-05-20T17:54:25.656009+0000","last_fullsized":"2024-05-20T17:54:25.656009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:03:04.272873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441231+0000","last_change":"2024-05-20T17:54:23.435232+0000","last_active":"2024-05-20T17:54:25.441231+0000","last_peered":"2024-05-20T17:54:25.441231+0000","last_clean":"2024-05-20T17:54:25.441231+0000","last_became_active":"2024-05-20T17:54:23.434898+0000","last_became_peered":"2024-05-20T17:54:23.434898+0000","last_unstale":"2024-05-20T17:54:25.441231+0000","last_undegraded":"2024-05-20T17:54:25.441231+0000","last_fullsized":"2024-05-20T17:54:25.441231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:29.800057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441382+0000","last_change":"2024-05-20T17:54:24.451987+0000","last_active":"2024-05-20T17:54:25.441382+0000","last_peered":"2024-05-20T17:54:25.441382+0000","last_clean":"2024-05-20T17:54:25.441382+0000","last_became_active":"2024-05-20T17:54:24.451690+0000","last_became_peered":"2024-05-20T17:54:24.451690+0000","last_unstale":"2024-05-20T17:54:25.441382+0000","last_undegraded":"2024-05-20T17:54:25.441382+0000","last_fullsized":"2024-05-20T17:54:25.441382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:55.834954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.440883+0000","last_change":"2024-05-20T17:54:23.438769+0000","last_active":"2024-05-20T17:54:25.440883+0000","last_peered":"2024-05-20T17:54:25.440883+0000","last_clean":"2024-05-20T17:54:25.440883+0000","last_became_active":"2024-05-20T17:54:23.438432+0000","last_became_peered":"2024-05-20T17:54:23.438432+0000","last_unstale":"2024-05-20T17:54:25.440883+0000","last_undegraded":"2024-05-20T17:54:25.440883+0000","last_fullsized":"2024-05-20T17:54:25.440883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:26.529480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772085+0000","last_change":"2024-05-20T17:54:24.467403+0000","last_active":"2024-05-20T17:54:26.772085+0000","last_peered":"2024-05-20T17:54:26.772085+0000","last_clean":"2024-05-20T17:54:26.772085+0000","last_became_active":"2024-05-20T17:54:24.467055+0000","last_became_peered":"2024-05-20T17:54:24.467055+0000","last_unstale":"2024-05-20T17:54:26.772085+0000","last_undegraded":"2024-05-20T17:54:26.772085+0000","last_fullsized":"2024-05-20T17:54:26.772085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:03:46.794090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:25.441257+0000","last_change":"2024-05-20T17:54:23.429638+0000","last_active":"2024-05-20T17:54:25.441257+0000","last_peered":"2024-05-20T17:54:25.441257+0000","last_clean":"2024-05-20T17:54:25.441257+0000","last_became_active":"2024-05-20T17:54:23.429302+0000","last_became_peered":"2024-05-20T17:54:23.429302+0000","last_unstale":"2024-05-20T17:54:25.441257+0000","last_undegraded":"2024-05-20T17:54:25.441257+0000","last_fullsized":"2024-05-20T17:54:25.441257+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:54.824389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.448783+0000","last_change":"2024-05-20T17:54:24.470272+0000","last_active":"2024-05-20T17:54:26.448783+0000","last_peered":"2024-05-20T17:54:26.448783+0000","last_clean":"2024-05-20T17:54:26.448783+0000","last_became_active":"2024-05-20T17:54:24.469957+0000","last_became_peered":"2024-05-20T17:54:24.469957+0000","last_unstale":"2024-05-20T17:54:26.448783+0000","last_undegraded":"2024-05-20T17:54:26.448783+0000","last_fullsized":"2024-05-20T17:54:26.448783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:23.414526+0000","last_clean_scrub_stamp":"2024-05-20T17:54:23.414526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:47:07.582234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772054+0000","last_change":"2024-05-20T17:54:23.442483+0000","last_active":"2024-05-20T17:54:26.772054+0000","last_peered":"2024-05-20T17:54:26.772054+0000","last_clean":"2024-05-20T17:54:26.772054+0000","last_became_active":"2024-05-20T17:54:23.442157+0000","last_became_peered":"2024-05-20T17:54:23.442157+0000","last_unstale":"2024-05-20T17:54:26.772054+0000","last_undegraded":"2024-05-20T17:54:26.772054+0000","last_fullsized":"2024-05-20T17:54:26.772054+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:54:22.403961+0000","last_clean_scrub_stamp":"2024-05-20T17:54:22.403961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:34.872205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-20T17:54:26.772019+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:54:26.772019+0000","last_peered":"2024-05-20T17:54:26.772019+0000","last_clean":"2024-05-20T17:54:26.772019+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:54:26.772019+0000","last_undegraded":"2024-05-20T17:54:26.772019+0000","last_fullsized":"2024-05-20T17:54:26.772019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":782418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":192014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1036288,"data_stored":780770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:54:33.397 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T17:54:33.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T17:54:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.559+0000 7fb379337640 1 Processor -- start 2024-05-20T17:54:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.559+0000 7fb379337640 1 -- start start 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb379337640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 0x7fb3740d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb379337640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3740d0370 con 0x7fb374163a10 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb379337640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3740d0650 con 0x7fb3740b4010 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb379337640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3740d3ca0 con 0x7fb3740d1bc0 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb372ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb374163a10 0x7fb3740cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40436/0 (socket says 172.21.15.6:40436) 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb372ffd640 1 -- 172.21.15.6:0/4105284678 learned_addr learned my addr 172.21.15.6:0/4105284678 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb3737fe640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 0x7fb3740d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526745584 0 0) 0x7fb3740d0370 con 0x7fb374163a10 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.560+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb35c003520 con 0x7fb374163a10 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 224919237 0 0) 0x7fb35c003520 con 0x7fb374163a10 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 msgr2=0x7fb3740d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 0x7fb3740d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 >> v1:172.21.15.171:6789/0 conn(0x7fb3740b4010 legacy=0x7fb3740d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3740d3650 con 0x7fb374163a10 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fb364001670 con 0x7fb374163a10 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 >> v1:172.21.15.6:6789/0 conn(0x7fb374163a10 legacy=0x7fb3740cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb35c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 0x7fb35c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb35c004d40 0x7fb35c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740d3ca0 con 0x7fb35c0039e0 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c00ba70 con 0x7fb35c004d40 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb35c00bc40 con 0x7fb3740d1bc0 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb372ffd640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb35c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb3737fe640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb35c004d40 0x7fb35c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb3727fc640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 0x7fb35c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb372ffd640 1 -- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 msgr2=0x7fb35c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb372ffd640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 0x7fb35c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb372ffd640 1 -- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb35c004d40 msgr2=0x7fb35c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb372ffd640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb35c004d40 0x7fb35c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb372ffd640 1 -- 172.21.15.6:0/4105284678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c003520 con 0x7fb35c0039e0 2024-05-20T17:54:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.561+0000 7fb3727fc640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3740d1bc0 0x7fb35c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.562+0000 7fb372ffd640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb35c003e10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb36400c160 tx=0x7fb35c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4708434542d11067 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.562+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364007cc0 con 0x7fb35c0039e0 2024-05-20T17:54:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.562+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb364005ad0 con 0x7fb35c0039e0 2024-05-20T17:54:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.562+0000 7fb371ffb640 1 -- 172.21.15.6:0/4105284678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364007070 con 0x7fb35c0039e0 2024-05-20T17:54:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.563+0000 7fb379337640 1 -- 172.21.15.6:0/4105284678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 msgr2=0x7fb35c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.563+0000 7fb379337640 1 --2- 172.21.15.6:0/4105284678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb35c003e10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb36400c160 tx=0x7fb35c005830 comp rx=0 tx=0).stop 2024-05-20T17:54:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.563+0000 7fb3737fe640 1 -- 172.21.15.6:0/4105284678 reap_dead start 2024-05-20T17:54:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.563+0000 7fb379337640 1 -- 172.21.15.6:0/4105284678 shutdown_connections 2024-05-20T17:54:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.563+0000 7fb379337640 1 -- 172.21.15.6:0/4105284678 >> 172.21.15.6:0/4105284678 conn(0x7fb37406d240 msgr2=0x7fb37406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.563+0000 7fb379337640 1 -- 172.21.15.6:0/4105284678 shutdown_connections 2024-05-20T17:54:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.563+0000 7fb379337640 1 -- 172.21.15.6:0/4105284678 wait complete. 2024-05-20T17:54:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.565+0000 7fb379337640 1 Processor -- start 2024-05-20T17:54:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.565+0000 7fb379337640 1 -- start start 2024-05-20T17:54:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb379337640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb374154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb379337640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3740b9e40 0x7fb3740ba250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb379337640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb374157070 0x7fb374157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb379337640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740d42b0 con 0x7fb35c0039e0 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb379337640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740d4130 con 0x7fb3740b9e40 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb379337640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3740d4430 con 0x7fb374157070 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb372ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb374154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb372ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb374154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33310/0 (socket says 172.21.15.6:33310) 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.566+0000 7fb372ffd640 1 -- 172.21.15.6:0/1193372283 learned_addr learned my addr 172.21.15.6:0/1193372283 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb3737fe640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb374157070 0x7fb374157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb3727fc640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3740b9e40 0x7fb3740ba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb372ffd640 1 -- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb374157070 msgr2=0x7fb374157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb372ffd640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb374157070 0x7fb374157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb372ffd640 1 -- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3740b9e40 msgr2=0x7fb3740ba250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb372ffd640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3740b9e40 0x7fb3740ba250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb372ffd640 1 -- 172.21.15.6:0/1193372283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3741579c0 con 0x7fb35c0039e0 2024-05-20T17:54:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb3727fc640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3740b9e40 0x7fb3740ba250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb372ffd640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb374154140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb364000fb0 tx=0x7fb3640019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb35b7fe640 1 -- 172.21.15.6:0/1193372283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364043070 con 0x7fb35c0039e0 2024-05-20T17:54:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb35b7fe640 1 -- 172.21.15.6:0/1193372283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb364038040 con 0x7fb35c0039e0 2024-05-20T17:54:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb374154e00 con 0x7fb35c0039e0 2024-05-20T17:54:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb35b7fe640 1 -- 172.21.15.6:0/1193372283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3640072b0 con 0x7fb35c0039e0 2024-05-20T17:54:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.567+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3741553c0 con 0x7fb35c0039e0 2024-05-20T17:54:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.568+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb374075b00 con 0x7fb35c0039e0 2024-05-20T17:54:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.569+0000 7fb35b7fe640 1 -- 172.21.15.6:0/1193372283 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb364007450 con 0x7fb35c0039e0 2024-05-20T17:54:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.569+0000 7fb35b7fe640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb36006be60 0x7fb36006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.569+0000 7fb35b7fe640 1 -- 172.21.15.6:0/1193372283 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fb3640aaf70 con 0x7fb35c0039e0 2024-05-20T17:54:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.570+0000 7fb3727fc640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb36006be60 0x7fb36006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.570+0000 7fb3727fc640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb36006be60 0x7fb36006e370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb368007fd0 tx=0x7fb368009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.574+0000 7fb35b7fe640 1 -- 172.21.15.6:0/1193372283 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb3741579c0 con 0x7fb35c0039e0 2024-05-20T17:54:33.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.830+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb3740d3050 con 0x7fb35c0039e0 2024-05-20T17:54:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.833+0000 7fb35b7fe640 1 -- 172.21.15.6:0/1193372283 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7fb364005aa0 con 0x7fb35c0039e0 2024-05-20T17:54:33.831 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T17:54:33.831 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T17:54:33.831 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T17:54:33.832 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T17:54:33.832 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T17:54:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T17:54:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb36006be60 msgr2=0x7fb36006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb36006be60 0x7fb36006e370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb368007fd0 tx=0x7fb368009040 comp rx=0 tx=0).stop 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 msgr2=0x7fb374154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb374154140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb364000fb0 tx=0x7fb3640019c0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 shutdown_connections 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb36006be60 0x7fb36006e370 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb374157070 0x7fb374157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3740b9e40 0x7fb3740ba250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 --2- 172.21.15.6:0/1193372283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb35c0039e0 0x7fb374154140 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 >> 172.21.15.6:0/1193372283 conn(0x7fb37406d240 msgr2=0x7fb37415fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 shutdown_connections 2024-05-20T17:54:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.835+0000 7fb379337640 1 -- 172.21.15.6:0/1193372283 wait complete. 2024-05-20T17:54:33.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:54:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.961+0000 7f0446e51640 1 Processor -- start 2024-05-20T17:54:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.961+0000 7f0446e51640 1 -- start start 2024-05-20T17:54:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.962+0000 7f0446e51640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400b6d90 0x7f044015f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.962+0000 7f0446e51640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f04400d3220 0x7f04400d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.962+0000 7f0446e51640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04400d0550 con 0x7f04400cf250 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.962+0000 7f0446e51640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f044015f9a0 con 0x7f04400d3220 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.962+0000 7f0446e51640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f04400d0b10 con 0x7f04400b6d90 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f0444bed640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04400cf250 0x7f04400b6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40452/0 (socket says 172.21.15.6:40452) 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f0444bed640 1 -- 172.21.15.6:0/3111034354 learned_addr learned my addr 172.21.15.6:0/3111034354 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f0437fff640 1 --2- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400b6d90 0x7f044015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f04453ee640 1 --2- 172.21.15.6:0/3111034354 >> v2:172.21.15.171:3300/0 conn(0x7f04400d3220 0x7f04400d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f04377fe640 1 -- 172.21.15.6:0/3111034354 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048367248 0 0) 0x7f04400d0550 con 0x7f04400cf250 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f04377fe640 1 -- 172.21.15.6:0/3111034354 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0428003520 con 0x7f04400cf250 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f04453ee640 1 -- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400b6d90 msgr2=0x7f044015f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f04453ee640 1 --2- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400b6d90 0x7f044015f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f04453ee640 1 -- 172.21.15.6:0/3111034354 >> v1:172.21.15.6:6789/0 conn(0x7f04400cf250 legacy=0x7f04400b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f04453ee640 1 -- 172.21.15.6:0/3111034354 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04400d0830 con 0x7f04400d3220 2024-05-20T17:54:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.963+0000 7f0437fff640 1 --2- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400b6d90 0x7f044015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.964+0000 7f04453ee640 1 --2- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04400d3220 0x7f04400d3630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04380097a0 tx=0x7f043802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f0ed29b100ed4f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.964+0000 7f04377fe640 1 -- 172.21.15.6:0/3111034354 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438037070 con 0x7f04400d3220 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.964+0000 7f04377fe640 1 -- 172.21.15.6:0/3111034354 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0438032440 con 0x7f04400d3220 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.964+0000 7f04377fe640 1 -- 172.21.15.6:0/3111034354 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438032810 con 0x7f04400d3220 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.965+0000 7f0446e51640 1 -- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04400d3220 msgr2=0x7f04400d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.965+0000 7f0446e51640 1 --2- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04400d3220 0x7f04400d3630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04380097a0 tx=0x7f043802a180 comp rx=0 tx=0).stop 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.965+0000 7f0446e51640 1 -- 172.21.15.6:0/3111034354 shutdown_connections 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.965+0000 7f0446e51640 1 --2- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400b6d90 0x7f044015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.965+0000 7f0446e51640 1 --2- 172.21.15.6:0/3111034354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04400d3220 0x7f04400d3630 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.965+0000 7f0446e51640 1 -- 172.21.15.6:0/3111034354 >> 172.21.15.6:0/3111034354 conn(0x7f04400d1860 msgr2=0x7f04400d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.965+0000 7f0446e51640 1 -- 172.21.15.6:0/3111034354 shutdown_connections 2024-05-20T17:54:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.965+0000 7f0446e51640 1 -- 172.21.15.6:0/3111034354 wait complete. 2024-05-20T17:54:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.967+0000 7f0446e51640 1 Processor -- start 2024-05-20T17:54:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.967+0000 7f0446e51640 1 -- start start 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0446e51640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400cf250 0x7f04401f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0446e51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04400d3220 0x7f044014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0446e51640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04401f8e60 0x7f04401f9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0446e51640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04400d2d00 con 0x7f04400d3220 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0446e51640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04400d27d0 con 0x7f04401f8e60 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0446e51640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f04400d0140 con 0x7f04400cf250 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0437fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04400d3220 0x7f044014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0437fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04400d3220 0x7f044014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33316/0 (socket says 172.21.15.6:33316) 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.968+0000 7f0437fff640 1 -- 172.21.15.6:0/1171585142 learned_addr learned my addr 172.21.15.6:0/1171585142 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0444bed640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400cf250 0x7f04401f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f04453ee640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04401f8e60 0x7f04401f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0437fff640 1 -- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400cf250 msgr2=0x7f04401f9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0437fff640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400cf250 0x7f04401f9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0437fff640 1 -- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04401f8e60 msgr2=0x7f04401f9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0437fff640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04401f8e60 0x7f04401f9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0437fff640 1 -- 172.21.15.6:0/1171585142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04401f97b0 con 0x7f04400d3220 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0444bed640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400cf250 0x7f04401f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f04453ee640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04401f8e60 0x7f04401f9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0437fff640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04400d3220 0x7f044014cc40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f043000e960 tx=0x7f043000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f04357fa640 1 -- 172.21.15.6:0/1171585142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430017070 con 0x7f04400d3220 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f04357fa640 1 -- 172.21.15.6:0/1171585142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043000c9a0 con 0x7f04400d3220 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044014d180 con 0x7f04400d3220 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f04357fa640 1 -- 172.21.15.6:0/1171585142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043000cd70 con 0x7f04400d3220 2024-05-20T17:54:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.969+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0440160390 con 0x7f04400d3220 2024-05-20T17:54:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.970+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04400b5af0 con 0x7f04400d3220 2024-05-20T17:54:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.971+0000 7f04357fa640 1 -- 172.21.15.6:0/1171585142 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f043001a070 con 0x7f04400d3220 2024-05-20T17:54:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.971+0000 7f04357fa640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f042c06be30 0x7f042c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.972+0000 7f04357fa640 1 -- 172.21.15.6:0/1171585142 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f043008afd0 con 0x7f04400d3220 2024-05-20T17:54:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.972+0000 7f0444bed640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f042c06be30 0x7f042c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.972+0000 7f0444bed640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f042c06be30 0x7f042c06e340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f043c005c00 tx=0x7f043c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:33.976+0000 7f04357fa640 1 -- 172.21.15.6:0/1171585142 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f04401f97b0 con 0x7f04400d3220 2024-05-20T17:54:34.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.197+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0440075b00 con 0x7f04400d3220 2024-05-20T17:54:34.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.198+0000 7f04357fa640 1 -- 172.21.15.6:0/1171585142 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f04300596e0 con 0x7f04400d3220 2024-05-20T17:54:34.196 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:54:34.196 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:54:23.810231+0000","modified":"2024-05-20T17:54:26.847159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3387888972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3387888972},{"type":"v1","addr":"172.21.15.6:6834","nonce":3387888972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":2}]} 2024-05-20T17:54:34.196 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-05-20T17:54:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f042c06be30 msgr2=0x7f042c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f042c06be30 0x7f042c06e340 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f043c005c00 tx=0x7f043c009040 comp rx=0 tx=0).stop 2024-05-20T17:54:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04400d3220 msgr2=0x7f044014cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04400d3220 0x7f044014cc40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f043000e960 tx=0x7f043000ee20 comp rx=0 tx=0).stop 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 shutdown_connections 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f042c06be30 0x7f042c06e340 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04401f8e60 0x7f04401f9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04400d3220 0x7f044014cc40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 --2- 172.21.15.6:0/1171585142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04400cf250 0x7f04401f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 >> 172.21.15.6:0/1171585142 conn(0x7f04400d1860 msgr2=0x7f04400b9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 shutdown_connections 2024-05-20T17:54:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.200+0000 7f0446e51640 1 -- 172.21.15.6:0/1171585142 wait complete. 2024-05-20T17:54:34.611 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T17:54:23.810231+0000', 'modified': '2024-05-20T17:54:26.847159+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5394}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5394': {'gid': 5394, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6834/3387888972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 3387888972}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 3387888972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5394, 'qdb_cluster': [5394]} 2024-05-20T17:54:34.612 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T17:54:34.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-20T17:54:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.736+0000 7f952997e640 1 Processor -- start 2024-05-20T17:54:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.736+0000 7f952997e640 1 -- start start 2024-05-20T17:54:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.737+0000 7f952997e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f95240d1610 0x7f95240d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.737+0000 7f952997e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f952406c880 0x7f952406cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.737+0000 7f952997e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952415d430 con 0x7f9524156690 2024-05-20T17:54:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.737+0000 7f952997e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f95240b29b0 con 0x7f952406c880 2024-05-20T17:54:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.737+0000 7f952997e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f95240b1910 con 0x7f95240d1610 2024-05-20T17:54:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.737+0000 7f95237fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f952406c880 0x7f952406cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.737+0000 7f95237fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f952406c880 0x7f952406cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33332/0 (socket says 172.21.15.6:33332) 2024-05-20T17:54:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.737+0000 7f95237fe640 1 -- 172.21.15.6:0/3863623929 learned_addr learned my addr 172.21.15.6:0/3863623929 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.738+0000 7f95227fc640 1 --2- 172.21.15.6:0/3863623929 >> v2:172.21.15.171:3300/0 conn(0x7f95240d1610 0x7f95240d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.738+0000 7f95237fe640 1 -- 172.21.15.6:0/3863623929 >> v2:172.21.15.171:3300/0 conn(0x7f95240d1610 msgr2=0x7f95240d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.738+0000 7f95237fe640 1 --2- 172.21.15.6:0/3863623929 >> v2:172.21.15.171:3300/0 conn(0x7f95240d1610 0x7f95240d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.738+0000 7f95237fe640 1 -- 172.21.15.6:0/3863623929 >> v1:172.21.15.171:6789/0 conn(0x7f9524156690 legacy=0x7f952415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.738+0000 7f95237fe640 1 -- 172.21.15.6:0/3863623929 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95240b1bf0 con 0x7f952406c880 2024-05-20T17:54:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.738+0000 7f95227fc640 1 --2- 172.21.15.6:0/3863623929 >> v2:172.21.15.171:3300/0 conn(0x7f95240d1610 0x7f95240d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.738+0000 7f95237fe640 1 --2- 172.21.15.6:0/3863623929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f952406c880 0x7f952406cc90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f95240d2920 tx=0x7f951402c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c306c7c4d8b112 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.738+0000 7f9521ffb640 1 -- 172.21.15.6:0/3863623929 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514038070 con 0x7f952406c880 2024-05-20T17:54:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f9521ffb640 1 -- 172.21.15.6:0/3863623929 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9514031710 con 0x7f952406c880 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f9521ffb640 1 -- 172.21.15.6:0/3863623929 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514031ae0 con 0x7f952406c880 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f952997e640 1 -- 172.21.15.6:0/3863623929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f952406c880 msgr2=0x7f952406cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f952997e640 1 --2- 172.21.15.6:0/3863623929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f952406c880 0x7f952406cc90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f95240d2920 tx=0x7f951402c7b0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f952997e640 1 -- 172.21.15.6:0/3863623929 shutdown_connections 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f952997e640 1 --2- 172.21.15.6:0/3863623929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f952406c880 0x7f952406cc90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f952997e640 1 --2- 172.21.15.6:0/3863623929 >> v2:172.21.15.171:3300/0 conn(0x7f95240d1610 0x7f95240d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f952997e640 1 -- 172.21.15.6:0/3863623929 >> 172.21.15.6:0/3863623929 conn(0x7f95240b6670 msgr2=0x7f95240b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f952997e640 1 -- 172.21.15.6:0/3863623929 shutdown_connections 2024-05-20T17:54:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.739+0000 7f952997e640 1 -- 172.21.15.6:0/3863623929 wait complete. 2024-05-20T17:54:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.741+0000 7f952997e640 1 Processor -- start 2024-05-20T17:54:34.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.741+0000 7f952997e640 1 -- start start 2024-05-20T17:54:34.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f952997e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952406c880 0x7f95241440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f952997e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95240d1610 0x7f95241552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f952997e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9524156690 0x7f9524155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f952997e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f95240b2490 con 0x7f95240d1610 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f952997e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f95240b21b0 con 0x7f9524156690 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f952997e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f95240d1f60 con 0x7f952406c880 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95240d1610 0x7f95241552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95240d1610 0x7f95241552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33338/0 (socket says 172.21.15.6:33338) 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 -- 172.21.15.6:0/3629384580 learned_addr learned my addr 172.21.15.6:0/3629384580 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f9522ffd640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952406c880 0x7f95241440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95237fe640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9524156690 0x7f9524155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 -- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952406c880 msgr2=0x7f95241440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952406c880 0x7f95241440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 -- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9524156690 msgr2=0x7f9524155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9524156690 0x7f9524155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 -- 172.21.15.6:0/3629384580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95240b0f10 con 0x7f95240d1610 2024-05-20T17:54:34.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.743+0000 7f95227fc640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95240d1610 0x7f95241552e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f950c00c7f0 tx=0x7f950c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.744+0000 7f951bfff640 1 -- 172.21.15.6:0/3629384580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c005b90 con 0x7f95240d1610 2024-05-20T17:54:34.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.744+0000 7f951bfff640 1 -- 172.21.15.6:0/3629384580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c005d30 con 0x7f95240d1610 2024-05-20T17:54:34.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.744+0000 7f951bfff640 1 -- 172.21.15.6:0/3629384580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c006250 con 0x7f95240d1610 2024-05-20T17:54:34.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.744+0000 7f952997e640 1 -- 172.21.15.6:0/3629384580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952415d730 con 0x7f95240d1610 2024-05-20T17:54:34.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.744+0000 7f952997e640 1 -- 172.21.15.6:0/3629384580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952415dcf0 con 0x7f95240d1610 2024-05-20T17:54:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.745+0000 7f951bfff640 1 -- 172.21.15.6:0/3629384580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f950c006600 con 0x7f95240d1610 2024-05-20T17:54:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.746+0000 7f951bfff640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950406be30 0x7f950406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.746+0000 7f951bfff640 1 -- 172.21.15.6:0/3629384580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f950c08b1c0 con 0x7f95240d1610 2024-05-20T17:54:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.746+0000 7f9522ffd640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950406be30 0x7f950406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.747+0000 7f9522ffd640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950406be30 0x7f950406e340 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95240729c0 tx=0x7f951c00d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.747+0000 7f953082b740 1 Processor -- start 2024-05-20T17:54:34.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.747+0000 7f953082b740 1 -- start start 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.748+0000 7f953082b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.748+0000 7f953082b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.748+0000 7f953082b740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.748+0000 7f953082b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5625c25334d0 con 0x5625c22063b0 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.748+0000 7f953082b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5625c24db3e0 con 0x5625c222f270 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.748+0000 7f953082b740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5625c252f490 con 0x5625c220e590 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33340/0 (socket says 172.21.15.6:33340) 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 -- 172.21.15.6:0/2222348386 learned_addr learned my addr 172.21.15.6:0/2222348386 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f9522ffd640 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95237fe640 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 -- 172.21.15.6:0/2222348386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 msgr2=0x5625c25d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 -- 172.21.15.6:0/2222348386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 msgr2=0x5625c25ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 -- 172.21.15.6:0/2222348386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c22472d0 con 0x5625c22063b0 2024-05-20T17:54:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95227fc640 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f75a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f950c0557f0 tx=0x7f950c058fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7129878af65f0b80 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95197fa640 1 -- 172.21.15.6:0/2222348386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c087070 con 0x5625c22063b0 2024-05-20T17:54:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95197fa640 1 -- 172.21.15.6:0/2222348386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c061ec0 con 0x5625c22063b0 2024-05-20T17:54:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.749+0000 7f95197fa640 1 -- 172.21.15.6:0/2222348386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c055a00 con 0x5625c22063b0 2024-05-20T17:54:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 -- 172.21.15.6:0/2222348386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 msgr2=0x5625c25f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f75a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f950c0557f0 tx=0x7f950c058fd0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 -- 172.21.15.6:0/2222348386 shutdown_connections 2024-05-20T17:54:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f75a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 --2- 172.21.15.6:0/2222348386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 -- 172.21.15.6:0/2222348386 >> 172.21.15.6:0/2222348386 conn(0x5625c22233c0 msgr2=0x5625c25cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 -- 172.21.15.6:0/2222348386 shutdown_connections 2024-05-20T17:54:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.750+0000 7f953082b740 1 -- 172.21.15.6:0/2222348386 wait complete. 2024-05-20T17:54:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.751+0000 7f953082b740 1 -- start start 2024-05-20T17:54:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.751+0000 7f953082b740 1 Processor -- start 2024-05-20T17:54:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f953082b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f953082b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c220e590 0x5625c26122d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f953082b740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c222f270 0x5625c25fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f953082b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5625c24ee8e0 con 0x5625c22063b0 2024-05-20T17:54:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f953082b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5625c25fae40 con 0x5625c220e590 2024-05-20T17:54:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f953082b740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5625c2613cd0 con 0x5625c222f270 2024-05-20T17:54:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f953082b740 10 client.0 _ll_register_callbacks cb 0x5625c24bb9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33356/0 (socket says 172.21.15.6:33356) 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 -- 172.21.15.6:0/4222653166 learned_addr learned my addr 172.21.15.6:0/4222653166 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f95237fe640 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c222f270 0x5625c25fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f95227fc640 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c220e590 0x5625c26122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 -- 172.21.15.6:0/4222653166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c222f270 msgr2=0x5625c25fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c222f270 0x5625c25fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 -- 172.21.15.6:0/4222653166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c220e590 msgr2=0x5625c26122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c220e590 0x5625c26122d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 -- 172.21.15.6:0/4222653166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c23116b0 con 0x5625c22063b0 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f9522ffd640 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f2a00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f951c016fd0 tx=0x7f951c004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0ad6a6f2fad3d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f95027fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:54:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f95027fc640 1 -- 172.21.15.6:0/4222653166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c0217e0 con 0x5625c22063b0 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f95027fc640 1 -- 172.21.15.6:0/4222653166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f951c021980 con 0x5625c22063b0 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.753+0000 7f953082b740 1 -- 172.21.15.6:0/4222653166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f950c061ec0 con 0x5625c22063b0 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f95027fc640 1 -- 172.21.15.6:0/4222653166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f951c02f050 con 0x5625c22063b0 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f953082b740 10 client.5589 fetch_fsmap learned FSMap version 18 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f953082b740 1 -- 172.21.15.6:0/4222653166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5625c25f42c0 con 0x5625c22063b0 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f95027fc640 1 -- 172.21.15.6:0/4222653166 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c061ec0 con 0x5625c22063b0 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f95027fc640 1 -- 172.21.15.6:0/4222653166 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f951c032020 con 0x5625c22063b0 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f953082b740 10 client.5589 fetch_fsmap finished waiting for FSMap version 18 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f953082b740 10 client.5589 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f953082b740 20 client.5589 populate_metadata read hostname 'smithi006' 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f953082b740 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x5625c21ede40 0x5625c25f3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f953082b740 4 client.5589 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:54:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f953082b740 1 -- 172.21.15.6:0/4222653166 --> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625c2540c00 con 0x5625c21ede40 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f95227fc640 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x5625c21ede40 0x5625c25f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f95227fc640 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x5625c21ede40 0x5625c25f3140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deef00c4be7e7d1c server_cookie=38715127cd49aac2 in_seq=0 out_seq=0 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.754+0000 7f95027fc640 10 client.5589 ms_handle_connect on v2:172.21.15.6:6832/3387888972 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f95027fc640 1 -- 172.21.15.6:0/4222653166 <== mds.0 v2:172.21.15.6:6832/3387888972 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5625c2540c00 con 0x5625c21ede40 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f95027fc640 10 client.5589 handle_command_reply: tid=0 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 client.5589 shutdown 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 -- 172.21.15.6:0/4222653166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 msgr2=0x5625c25f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f2a00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f951c016fd0 tx=0x7f951c004a00 comp rx=0 tx=0).stop 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 -- 172.21.15.6:0/4222653166 shutdown_connections 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x5625c21ede40 0x5625c25f3140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c222f270 0x5625c25fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c220e590 0x5625c26122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f95027fc640 0 client.5589 ms_handle_reset on v2:172.21.15.6:6832/3387888972 2024-05-20T17:54:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 --2- 172.21.15.6:0/4222653166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c22063b0 0x5625c25f2a00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 -- 172.21.15.6:0/4222653166 >> 172.21.15.6:0/4222653166 conn(0x5625c22233c0 msgr2=0x5625c25ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 -- 172.21.15.6:0/4222653166 shutdown_connections 2024-05-20T17:54:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.755+0000 7f953082b740 1 -- 172.21.15.6:0/4222653166 wait complete. 2024-05-20T17:54:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.756+0000 7f953082b740 20 client.5589 trim_cache size 0 max 16384 2024-05-20T17:54:34.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.775+0000 7f953082b740 1 Processor -- start 2024-05-20T17:54:34.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.775+0000 7f953082b740 1 -- start start 2024-05-20T17:54:34.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f953082b740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c22063b0 0x5625c25cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f953082b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c220e590 0x5625c25ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f953082b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25fc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f953082b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f95241fd120 con 0x5625c220e590 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f953082b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f95240b03a0 con 0x5625c222f270 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f953082b740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f95241fcb00 con 0x5625c22063b0 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95227fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c220e590 0x5625c25ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95227fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c220e590 0x5625c25ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33366/0 (socket says 172.21.15.6:33366) 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95227fc640 1 -- 172.21.15.6:0/1458629520 learned_addr learned my addr 172.21.15.6:0/1458629520 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f9522ffd640 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c22063b0 0x5625c25cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95237fe640 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95227fc640 1 -- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c22063b0 msgr2=0x5625c25cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95227fc640 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c22063b0 0x5625c25cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95227fc640 1 -- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 msgr2=0x5625c25fc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95227fc640 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25fc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95227fc640 1 -- 172.21.15.6:0/1458629520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c25cadc0 con 0x5625c220e590 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.776+0000 7f95237fe640 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25fc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.777+0000 7f95227fc640 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c220e590 0x5625c25ce3e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f950c059320 tx=0x7f950c06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef0da38714bc849 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.777+0000 7f9518ff9640 1 -- 172.21.15.6:0/1458629520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c087040 con 0x5625c220e590 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.777+0000 7f9518ff9640 1 -- 172.21.15.6:0/1458629520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c055a00 con 0x5625c220e590 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.777+0000 7f9518ff9640 1 -- 172.21.15.6:0/1458629520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c05d170 con 0x5625c220e590 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.777+0000 7f953082b740 1 -- 172.21.15.6:0/1458629520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c220e590 msgr2=0x5625c25ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c220e590 0x5625c25ce3e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f950c059320 tx=0x7f950c06f000 comp rx=0 tx=0).stop 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 -- 172.21.15.6:0/1458629520 shutdown_connections 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c222f270 0x5625c25fc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c220e590 0x5625c25ce3e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 --2- 172.21.15.6:0/1458629520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c22063b0 0x5625c25cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 -- 172.21.15.6:0/1458629520 >> 172.21.15.6:0/1458629520 conn(0x5625c22233c0 msgr2=0x5625c25f2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:34.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 -- 172.21.15.6:0/1458629520 shutdown_connections 2024-05-20T17:54:34.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 -- 172.21.15.6:0/1458629520 wait complete. 2024-05-20T17:54:34.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.778+0000 7f953082b740 1 -- start start 2024-05-20T17:54:34.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.779+0000 7f953082b740 1 Processor -- start 2024-05-20T17:54:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f953082b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c22063b0 0x5625c2699ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f953082b740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f953082b740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c222f270 0x5625c25ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f953082b740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5625c25fc1c0 con 0x5625c222f270 2024-05-20T17:54:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f953082b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5625c2612870 con 0x5625c22063b0 2024-05-20T17:54:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f953082b740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5625c2612f40 con 0x5625c220e590 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f953082b740 10 client.0 _ll_register_callbacks cb 0x7f951c016430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c222f270 0x5625c25ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c222f270 0x5625c25ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33370/0 (socket says 172.21.15.6:33370) 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95237fe640 1 -- 172.21.15.6:0/190496479 learned_addr learned my addr 172.21.15.6:0/190496479 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f9522ffd640 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c22063b0 0x5625c2699ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95227fc640 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95237fe640 1 -- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 msgr2=0x5625c25cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95237fe640 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95237fe640 1 -- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c22063b0 msgr2=0x5625c2699ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95237fe640 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c22063b0 0x5625c2699ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95237fe640 1 -- 172.21.15.6:0/190496479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c25fa350 con 0x5625c222f270 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.780+0000 7f95227fc640 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:54:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f95237fe640 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c222f270 0x5625c25ce3e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f951400bbd0 tx=0x7f951402cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f51124009e21a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f95027fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f95027fc640 1 -- 172.21.15.6:0/190496479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514038040 con 0x5625c222f270 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f95027fc640 1 -- 172.21.15.6:0/190496479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f951403d410 con 0x5625c222f270 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 1 -- 172.21.15.6:0/190496479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f950c055a00 con 0x5625c222f270 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f95027fc640 1 -- 172.21.15.6:0/190496479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9514055050 con 0x5625c222f270 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 10 client.5595 fetch_fsmap learned FSMap version 18 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 1 -- 172.21.15.6:0/190496479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5625c269a390 con 0x5625c222f270 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f95027fc640 1 -- 172.21.15.6:0/190496479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c055a00 con 0x5625c222f270 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f95027fc640 1 -- 172.21.15.6:0/190496479 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f9514058020 con 0x5625c222f270 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 10 client.5595 fetch_fsmap finished waiting for FSMap version 18 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 10 client.5595 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 20 client.5595 populate_metadata read hostname 'smithi006' 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x5625c2613e60 0x5625c260af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 4 client.5595 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f953082b740 1 -- 172.21.15.6:0/190496479 --> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] -- command(tid 0: {"prefix": "status"}) -- 0x5625c260c590 con 0x5625c2613e60 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.781+0000 7f9522ffd640 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x5625c2613e60 0x5625c260af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f95027fc640 10 client.5595 ms_handle_connect on v2:172.21.15.6:6832/3387888972 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f9522ffd640 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x5625c2613e60 0x5625c260af80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcf04a5ed3899cd server_cookie=757aa538b801ae3a in_seq=0 out_seq=0 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f95027fc640 1 -- 172.21.15.6:0/190496479 <== mds.0 v2:172.21.15.6:6832/3387888972 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5625c260c590 con 0x5625c2613e60 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f95027fc640 10 client.5595 handle_command_reply: tid=0 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 client.5595 shutdown 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 -- 172.21.15.6:0/190496479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c222f270 msgr2=0x5625c25ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c222f270 0x5625c25ce3e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f951400bbd0 tx=0x7f951402cf90 comp rx=0 tx=0).stop 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 -- 172.21.15.6:0/190496479 shutdown_connections 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x5625c2613e60 0x5625c260af80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c222f270 0x5625c25ce3e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5625c220e590 0x5625c25cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 --2- 172.21.15.6:0/190496479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625c22063b0 0x5625c2699ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f95027fc640 0 client.5595 ms_handle_reset on v2:172.21.15.6:6832/3387888972 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 -- 172.21.15.6:0/190496479 >> 172.21.15.6:0/190496479 conn(0x5625c22233c0 msgr2=0x5625c25fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 -- 172.21.15.6:0/190496479 shutdown_connections 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 1 -- 172.21.15.6:0/190496479 wait complete. 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.782+0000 7f953082b740 20 client.5595 trim_cache size 0 max 16384 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T17:54:34.790 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5394, 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.345485826000001, 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 18, 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 38, 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 38, 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 18.224196494000001 2024-05-20T17:54:34.791 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:54:34.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 -- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950406be30 msgr2=0x7f950406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950406be30 0x7f950406e340 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95240729c0 tx=0x7f951c00d040 comp rx=0 tx=0).stop 2024-05-20T17:54:34.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 -- 172.21.15.6:0/3629384580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95240d1610 msgr2=0x7f95241552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95240d1610 0x7f95241552e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f950c00c7f0 tx=0x7f950c00ccb0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 -- 172.21.15.6:0/3629384580 shutdown_connections 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950406be30 0x7f950406e340 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9524156690 0x7f9524155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95240d1610 0x7f95241552e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 --2- 172.21.15.6:0/3629384580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952406c880 0x7f95241440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 -- 172.21.15.6:0/3629384580 >> 172.21.15.6:0/3629384580 conn(0x7f95240b6670 msgr2=0x7f95241478c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 -- 172.21.15.6:0/3629384580 shutdown_connections 2024-05-20T17:54:34.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.783+0000 7f952997e640 1 -- 172.21.15.6:0/3629384580 wait complete. 2024-05-20T17:54:34.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:54:34.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.910+0000 7f4490338640 1 Processor -- start 2024-05-20T17:54:34.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.910+0000 7f4490338640 1 -- start start 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f4490338640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4488162820 0x7f44880b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f4490338640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f44880b3e80 0x7f448806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f4490338640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448806dd20 con 0x7f448806d910 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f4490338640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f44880d0630 con 0x7f4488162820 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f4490338640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f44880d39c0 con 0x7f44880b3e80 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f448e0d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4488162820 0x7f44880b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f448e8d5640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f448806d910 0x7f44880d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40460/0 (socket says 172.21.15.6:40460) 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f448e8d5640 1 -- 172.21.15.6:0/2412495159 learned_addr learned my addr 172.21.15.6:0/2412495159 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f448d8d3640 1 --2- 172.21.15.6:0/2412495159 >> v2:172.21.15.171:3300/0 conn(0x7f44880b3e80 0x7f448806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f448e0d4640 1 -- 172.21.15.6:0/2412495159 >> v2:172.21.15.171:3300/0 conn(0x7f44880b3e80 msgr2=0x7f448806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:34.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f448e0d4640 1 --2- 172.21.15.6:0/2412495159 >> v2:172.21.15.171:3300/0 conn(0x7f44880b3e80 0x7f448806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.912+0000 7f448e0d4640 1 -- 172.21.15.6:0/2412495159 >> v1:172.21.15.6:6789/0 conn(0x7f448806d910 legacy=0x7f44880d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.913+0000 7f448e0d4640 1 -- 172.21.15.6:0/2412495159 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44880d3ca0 con 0x7f4488162820 2024-05-20T17:54:34.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.913+0000 7f448d0d2640 1 -- 172.21.15.6:0/2412495159 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038480504 0 0) 0x7f4480001490 con 0x7f448806d910 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.913+0000 7f448e0d4640 1 --2- 172.21.15.6:0/2412495159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488162820 0x7f44880b3940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f44880d1230 tx=0x7f448402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5574aa4c66dfbdde server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.913+0000 7f448d0d2640 1 -- 172.21.15.6:0/2412495159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484037070 con 0x7f4488162820 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.913+0000 7f448d0d2640 1 -- 172.21.15.6:0/2412495159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4484032440 con 0x7f4488162820 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.913+0000 7f448d0d2640 1 -- 172.21.15.6:0/2412495159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484032810 con 0x7f4488162820 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.914+0000 7f4490338640 1 -- 172.21.15.6:0/2412495159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488162820 msgr2=0x7f44880b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.914+0000 7f4490338640 1 --2- 172.21.15.6:0/2412495159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488162820 0x7f44880b3940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f44880d1230 tx=0x7f448402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.914+0000 7f4490338640 1 -- 172.21.15.6:0/2412495159 shutdown_connections 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.914+0000 7f4490338640 1 --2- 172.21.15.6:0/2412495159 >> v2:172.21.15.171:3300/0 conn(0x7f44880b3e80 0x7f448806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.914+0000 7f4490338640 1 --2- 172.21.15.6:0/2412495159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488162820 0x7f44880b3940 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.914+0000 7f4490338640 1 -- 172.21.15.6:0/2412495159 >> 172.21.15.6:0/2412495159 conn(0x7f44880d4bd0 msgr2=0x7f44880d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.914+0000 7f4490338640 1 -- 172.21.15.6:0/2412495159 shutdown_connections 2024-05-20T17:54:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.914+0000 7f4490338640 1 -- 172.21.15.6:0/2412495159 wait complete. 2024-05-20T17:54:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.916+0000 7f4490338640 1 Processor -- start 2024-05-20T17:54:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.916+0000 7f4490338640 1 -- start start 2024-05-20T17:54:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.917+0000 7f4490338640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448806d910 0x7f448814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.917+0000 7f4490338640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44880b3e80 0x7f44881f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.917+0000 7f4490338640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4488162820 0x7f44880b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.917+0000 7f4490338640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44880d0300 con 0x7f448806d910 2024-05-20T17:54:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.917+0000 7f4490338640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f44880d4260 con 0x7f44880b3e80 2024-05-20T17:54:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.917+0000 7f4490338640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44880b91a0 con 0x7f4488162820 2024-05-20T17:54:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448806d910 0x7f448814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448806d910 0x7f448814d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33388/0 (socket says 172.21.15.6:33388) 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 -- 172.21.15.6:0/1381555590 learned_addr learned my addr 172.21.15.6:0/1381555590 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e8d5640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4488162820 0x7f44880b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 -- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4488162820 msgr2=0x7f44880b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4488162820 0x7f44880b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448d8d3640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44880b3e80 0x7f44881f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 -- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44880b3e80 msgr2=0x7f44881f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44880b3e80 0x7f44881f5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 -- 172.21.15.6:0/1381555590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44881f9930 con 0x7f448806d910 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f448e0d4640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448806d910 0x7f448814d0f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4484009890 tx=0x7f44840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f447effd640 1 -- 172.21.15.6:0/1381555590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484037040 con 0x7f448806d910 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f447effd640 1 -- 172.21.15.6:0/1381555590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4484042070 con 0x7f448806d910 2024-05-20T17:54:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448814d920 con 0x7f448806d910 2024-05-20T17:54:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f447effd640 1 -- 172.21.15.6:0/1381555590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484030bd0 con 0x7f448806d910 2024-05-20T17:54:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.918+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448814dee0 con 0x7f448806d910 2024-05-20T17:54:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.919+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44880ba390 con 0x7f448806d910 2024-05-20T17:54:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.920+0000 7f447effd640 1 -- 172.21.15.6:0/1381555590 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4484047460 con 0x7f448806d910 2024-05-20T17:54:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.921+0000 7f447effd640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f446c06be60 0x7f446c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.921+0000 7f447effd640 1 -- 172.21.15.6:0/1381555590 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f44840abac0 con 0x7f448806d910 2024-05-20T17:54:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.921+0000 7f448d8d3640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f446c06be60 0x7f446c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.921+0000 7f448d8d3640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f446c06be60 0x7f446c06e370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4478006fd0 tx=0x7f4478008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:34.925+0000 7f447effd640 1 -- 172.21.15.6:0/1381555590 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f44880ba390 con 0x7f448806d910 2024-05-20T17:54:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.147+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4488075b00 con 0x7f448806d910 2024-05-20T17:54:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.148+0000 7f447effd640 1 -- 172.21.15.6:0/1381555590 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f448404c020 con 0x7f448806d910 2024-05-20T17:54:35.146 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:54:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f446c06be60 msgr2=0x7f446c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f446c06be60 0x7f446c06e370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4478006fd0 tx=0x7f4478008040 comp rx=0 tx=0).stop 2024-05-20T17:54:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448806d910 msgr2=0x7f448814d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448806d910 0x7f448814d0f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4484009890 tx=0x7f44840046c0 comp rx=0 tx=0).stop 2024-05-20T17:54:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 shutdown_connections 2024-05-20T17:54:35.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f446c06be60 0x7f446c06e370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:35.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4488162820 0x7f44880b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:35.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44880b3e80 0x7f44881f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:35.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 --2- 172.21.15.6:0/1381555590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f448806d910 0x7f448814d0f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:35.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 >> 172.21.15.6:0/1381555590 conn(0x7f44880d4bd0 msgr2=0x7f4488160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:35.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 shutdown_connections 2024-05-20T17:54:35.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35.150+0000 7f4490338640 1 -- 172.21.15.6:0/1381555590 wait complete. 2024-05-20T17:54:35.159 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:54:35.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:54:35.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:54:35.159 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T17:54:35.160 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:54:35.160 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:54:35.160 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:54:35.160 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:54:35.160 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:54:35.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:35.160 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:54:35.177 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42639sec preferred_lft 42639sec 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:54:35.178 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T17:54:35.179 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:35.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:35.180 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:54:35.241 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:54:35.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:35.243 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:54:35.300 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:54:35.300 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:54:35.300 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:54:35.300 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:54:35.300 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:54:35.300 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:54:35.300 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:54:35.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:54:35.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:54:35.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:54:35.301 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:54:35.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:54:35.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:35.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:35.430 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:54:35.446 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T17:54:35.446 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T17:54:35.447 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:54:35.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:35.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:54:35.513 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:54:35.513 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T17:54:35.569 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:54:35.569 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:54:35.570 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:54:35.626 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T17:54:35.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:35.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:54:35.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:54:35.669 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:54:35.722 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:54:35.722 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:54:35.733 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:54:35.733 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:54:35.733 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:54:35.733 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:54:35.733 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:54:35.733 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T17:54:35.734 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:54:35.734 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:54:35.734 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:54:35.734 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:54:35.740 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:54:35.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:35.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:54:35.816 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:54:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:54:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:35.919 INFO:teuthology.orchestra.run.smithi006.stdout:client5078 2024-05-20T17:54:35.920 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:35.920 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:35.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:54:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.092+0000 7f48c4302640 1 Processor -- start 2024-05-20T17:54:36.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.092+0000 7f48c4302640 1 -- start start 2024-05-20T17:54:36.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.094+0000 7f48c4302640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0cd680 0x7f48bc15f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.094+0000 7f48c4302640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f48bc0cfae0 0x7f48bc06cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.094+0000 7f48c4302640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48bc06d0f0 con 0x7f48bc06c6c0 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.094+0000 7f48c4302640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f48bc0cda90 con 0x7f48bc0cfae0 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.094+0000 7f48c4302640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48bc15f760 con 0x7f48bc0cd680 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.094+0000 7f48c189d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f48bc06c6c0 0x7f48bc0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40462/0 (socket says 172.21.15.6:40462) 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.094+0000 7f48c189d640 1 -- 172.21.15.6:0/3057307615 learned_addr learned my addr 172.21.15.6:0/3057307615 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c209e640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0cd680 0x7f48bc15f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c289f640 1 --2- 172.21.15.6:0/3057307615 >> v2:172.21.15.171:3300/0 conn(0x7f48bc0cfae0 0x7f48bc06cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024830501 0 0) 0x7f48bc06d0f0 con 0x7f48bc06c6c0 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48a4003520 con 0x7f48bc06c6c0 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4047439094 0 0) 0x7f48a4003520 con 0x7f48bc06c6c0 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0cd680 msgr2=0x7f48bc15f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:36.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0cd680 0x7f48bc15f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 >> v2:172.21.15.171:3300/0 conn(0x7f48bc0cfae0 msgr2=0x7f48bc06cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 --2- 172.21.15.6:0/3057307615 >> v2:172.21.15.171:3300/0 conn(0x7f48bc0cfae0 0x7f48bc06cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc06d3d0 con 0x7f48bc06c6c0 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f48b0001670 con 0x7f48bc06c6c0 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 >> v1:172.21.15.6:6789/0 conn(0x7f48bc06c6c0 legacy=0x7f48bc0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a40039b0 0x7f48a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a4004800 0x7f48a4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0cd680 0x7f48a4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc15f760 con 0x7f48a40039b0 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48a400ba70 con 0x7f48a4004800 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48a400bbf0 con 0x7f48bc0cd680 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c209e640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a40039b0 0x7f48a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c189d640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a4004800 0x7f48a4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c289f640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0cd680 0x7f48a4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c209e640 1 -- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0cd680 msgr2=0x7f48a4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c209e640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0cd680 0x7f48a4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.095+0000 7f48c209e640 1 -- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a4004800 msgr2=0x7f48a4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.096+0000 7f48c209e640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a4004800 0x7f48a4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.096+0000 7f48c209e640 1 -- 172.21.15.6:0/3057307615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a4003520 con 0x7f48a40039b0 2024-05-20T17:54:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.096+0000 7f48c209e640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a40039b0 0x7f48a4003e20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009f90 tx=0x7f48a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0baab1f3b89aa24 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.096+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac009c10 con 0x7f48a40039b0 2024-05-20T17:54:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.096+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac036070 con 0x7f48a40039b0 2024-05-20T17:54:36.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.096+0000 7f48c109c640 1 -- 172.21.15.6:0/3057307615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac031810 con 0x7f48a40039b0 2024-05-20T17:54:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.097+0000 7f48c4302640 1 -- 172.21.15.6:0/3057307615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a40039b0 msgr2=0x7f48a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.097+0000 7f48c4302640 1 --2- 172.21.15.6:0/3057307615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a40039b0 0x7f48a4003e20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009f90 tx=0x7f48a4005830 comp rx=0 tx=0).stop 2024-05-20T17:54:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.097+0000 7f48c289f640 1 -- 172.21.15.6:0/3057307615 reap_dead start 2024-05-20T17:54:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.097+0000 7f48c4302640 1 -- 172.21.15.6:0/3057307615 shutdown_connections 2024-05-20T17:54:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.097+0000 7f48c4302640 1 -- 172.21.15.6:0/3057307615 >> 172.21.15.6:0/3057307615 conn(0x7f48bc0b44d0 msgr2=0x7f48bc0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:36.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.097+0000 7f48c4302640 1 -- 172.21.15.6:0/3057307615 shutdown_connections 2024-05-20T17:54:36.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.097+0000 7f48c4302640 1 -- 172.21.15.6:0/3057307615 wait complete. 2024-05-20T17:54:36.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.099+0000 7f48c4302640 1 Processor -- start 2024-05-20T17:54:36.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.099+0000 7f48c4302640 1 -- start start 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.100+0000 7f48c4302640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a40039b0 0x7f48bc0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.100+0000 7f48c4302640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48bc0cc840 0x7f48bc0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c4302640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0c9e60 0x7f48bc0c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c4302640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc06d990 con 0x7f48bc0cc840 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c4302640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc0d0b80 con 0x7f48a40039b0 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c4302640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48bc0d2460 con 0x7f48bc0c9e60 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48bc0cc840 0x7f48bc0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48bc0cc840 0x7f48bc0c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33394/0 (socket says 172.21.15.6:33394) 2024-05-20T17:54:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 -- 172.21.15.6:0/146004400 learned_addr learned my addr 172.21.15.6:0/146004400 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c209e640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a40039b0 0x7f48bc0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c289f640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0c9e60 0x7f48bc0c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 -- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0c9e60 msgr2=0x7f48bc0c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0c9e60 0x7f48bc0c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 -- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a40039b0 msgr2=0x7f48bc0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a40039b0 0x7f48bc0cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 -- 172.21.15.6:0/146004400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc0ca850 con 0x7f48bc0cc840 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c189d640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48bc0cc840 0x7f48bc0c9920 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f48b0007340 tx=0x7f48b0007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48baffd640 1 -- 172.21.15.6:0/146004400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b001a070 con 0x7f48bc0cc840 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48baffd640 1 -- 172.21.15.6:0/146004400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b000f940 con 0x7f48bc0cc840 2024-05-20T17:54:36.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48bc0ca570 con 0x7f48bc0cc840 2024-05-20T17:54:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48baffd640 1 -- 172.21.15.6:0/146004400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b000fd30 con 0x7f48bc0cc840 2024-05-20T17:54:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.101+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48bc0c1900 con 0x7f48bc0cc840 2024-05-20T17:54:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.103+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48bc075b00 con 0x7f48bc0cc840 2024-05-20T17:54:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.103+0000 7f48baffd640 1 -- 172.21.15.6:0/146004400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48b001d070 con 0x7f48bc0cc840 2024-05-20T17:54:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.103+0000 7f48baffd640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a806be30 0x7f48a806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.104+0000 7f48baffd640 1 -- 172.21.15.6:0/146004400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f48b008a9a0 con 0x7f48bc0cc840 2024-05-20T17:54:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.104+0000 7f48c209e640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a806be30 0x7f48a806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:36.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.104+0000 7f48c209e640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a806be30 0x7f48a806e340 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009f90 tx=0x7f48ac02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:36.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.108+0000 7f48baffd640 1 -- 172.21.15.6:0/146004400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f48b0059130 con 0x7f48bc0cc840 2024-05-20T17:54:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.331+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f48bc0cfdd0 con 0x7f48bc0cc840 2024-05-20T17:54:36.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.331+0000 7f48baffd640 1 -- 172.21.15.6:0/146004400 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f48b0058a30 con 0x7f48bc0cc840 2024-05-20T17:54:36.330 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a806be30 msgr2=0x7f48a806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a806be30 0x7f48a806e340 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009f90 tx=0x7f48ac02f000 comp rx=0 tx=0).stop 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48bc0cc840 msgr2=0x7f48bc0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48bc0cc840 0x7f48bc0c9920 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f48b0007340 tx=0x7f48b0007800 comp rx=0 tx=0).stop 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 shutdown_connections 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f48a806be30 0x7f48a806e340 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48bc0c9e60 0x7f48bc0c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48bc0cc840 0x7f48bc0c9920 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 --2- 172.21.15.6:0/146004400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a40039b0 0x7f48bc0cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 >> 172.21.15.6:0/146004400 conn(0x7f48bc0b44d0 msgr2=0x7f48bc0b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 shutdown_connections 2024-05-20T17:54:36.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:36.333+0000 7f48c4302640 1 -- 172.21.15.6:0/146004400 wait complete. 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:54:36.343 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:54:36.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:36.344 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T17:54:36.364 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42649sec preferred_lft 42649sec 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:36.365 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:54:36.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:36.367 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:54:36.432 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T17:54:36.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:36.434 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T17:54:36.492 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T17:54:36.493 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:54:36.493 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T17:54:36.493 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T17:54:36.493 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:54:36.493 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:54:36.493 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:54:36.493 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T17:54:36.493 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T17:54:36.493 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T17:54:36.494 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:54:36.588 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:54:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:54:36.623 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:54:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:36.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:36.629 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:54:36.645 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T17:54:36.645 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T17:54:36.645 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:54:36.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:36.645 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T17:54:36.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:54:36.711 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T17:54:36.767 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:54:36.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:54:36.767 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:54:36.822 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T17:54:36.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:36.822 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:54:36.918 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:54:36.918 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:54:36.928 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:54:36.928 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:54:36.928 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:54:36.929 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:54:36.929 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:54:36.929 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T17:54:36.929 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:54:36.929 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:54:36.929 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:54:36.929 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:54:36.931 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:54:36.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:54:36.931 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:54:36.959 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:54:37.049 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:54:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:54:37.051 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:54:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:37.056 INFO:teuthology.orchestra.run.smithi171.stdout:client5359 2024-05-20T17:54:37.056 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:54:37.057 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:37.072 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 1 2024-05-20T17:54:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.208+0000 7f68405d5640 1 Processor -- start 2024-05-20T17:54:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.208+0000 7f68405d5640 1 -- start start 2024-05-20T17:54:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f68405d5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6838162820 0x7f68380b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f68405d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68380b3e80 0x7f683806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f68405d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f683806d910 0x7f68380d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f68405d5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f683806dd20 con 0x7f683806d910 2024-05-20T17:54:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f68405d5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f68380d0630 con 0x7f6838162820 2024-05-20T17:54:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f68405d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68380d39c0 con 0x7f68380b3e80 2024-05-20T17:54:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f683eb72640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f683806d910 0x7f68380d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f683eb72640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f683806d910 0x7f68380d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33398/0 (socket says 172.21.15.6:33398) 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.209+0000 7f683eb72640 1 -- 172.21.15.6:0/699608621 learned_addr learned my addr 172.21.15.6:0/699608621 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.210+0000 7f683db70640 1 --2- 172.21.15.6:0/699608621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68380b3e80 0x7f683806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.210+0000 7f683e371640 1 --2- 172.21.15.6:0/699608621 >> v2:172.21.15.171:3300/0 conn(0x7f6838162820 0x7f68380b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.210+0000 7f683eb72640 1 -- 172.21.15.6:0/699608621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68380b3e80 msgr2=0x7f683806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.210+0000 7f683eb72640 1 --2- 172.21.15.6:0/699608621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68380b3e80 0x7f683806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.210+0000 7f683eb72640 1 -- 172.21.15.6:0/699608621 >> v2:172.21.15.171:3300/0 conn(0x7f6838162820 msgr2=0x7f68380b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.210+0000 7f683eb72640 1 --2- 172.21.15.6:0/699608621 >> v2:172.21.15.171:3300/0 conn(0x7f6838162820 0x7f68380b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.210+0000 7f683eb72640 1 -- 172.21.15.6:0/699608621 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68380d3ca0 con 0x7f683806d910 2024-05-20T17:54:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.210+0000 7f683eb72640 1 --2- 172.21.15.6:0/699608621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f683806d910 0x7f68380d27a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f68380b7740 tx=0x7f683002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23766917d837244 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f683d36f640 1 -- 172.21.15.6:0/699608621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830036070 con 0x7f683806d910 2024-05-20T17:54:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f683d36f640 1 -- 172.21.15.6:0/699608621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6830031600 con 0x7f683806d910 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f683d36f640 1 -- 172.21.15.6:0/699608621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68300319d0 con 0x7f683806d910 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f68405d5640 1 -- 172.21.15.6:0/699608621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f683806d910 msgr2=0x7f68380d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f68405d5640 1 --2- 172.21.15.6:0/699608621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f683806d910 0x7f68380d27a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f68380b7740 tx=0x7f683002a6a0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f68405d5640 1 -- 172.21.15.6:0/699608621 shutdown_connections 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f68405d5640 1 --2- 172.21.15.6:0/699608621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f683806d910 0x7f68380d27a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f68405d5640 1 --2- 172.21.15.6:0/699608621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f68380b3e80 0x7f683806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.211+0000 7f68405d5640 1 --2- 172.21.15.6:0/699608621 >> v2:172.21.15.171:3300/0 conn(0x7f6838162820 0x7f68380b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.212+0000 7f68405d5640 1 -- 172.21.15.6:0/699608621 >> 172.21.15.6:0/699608621 conn(0x7f68380d4bd0 msgr2=0x7f68380d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.212+0000 7f68405d5640 1 -- 172.21.15.6:0/699608621 shutdown_connections 2024-05-20T17:54:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.212+0000 7f68405d5640 1 -- 172.21.15.6:0/699608621 wait complete. 2024-05-20T17:54:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.213+0000 7f68405d5640 1 Processor -- start 2024-05-20T17:54:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.213+0000 7f68405d5640 1 -- start start 2024-05-20T17:54:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f68405d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683806d910 0x7f68380c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f68405d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68380b3e80 0x7f68381f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f68405d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6838162820 0x7f68380ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f68405d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f68380d0300 con 0x7f6838162820 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f68405d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f68380d4260 con 0x7f68380b3e80 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f68405d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68380d4780 con 0x7f683806d910 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6838162820 0x7f68380ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6838162820 0x7f68380ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33408/0 (socket says 172.21.15.6:33408) 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 -- 172.21.15.6:0/1463736891 learned_addr learned my addr 172.21.15.6:0/1463736891 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683db70640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68380b3e80 0x7f68381f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683e371640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683806d910 0x7f68380c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 -- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683806d910 msgr2=0x7f68380c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683806d910 0x7f68380c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 -- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68380b3e80 msgr2=0x7f68381f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68380b3e80 0x7f68381f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 -- 172.21.15.6:0/1463736891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68380ca170 con 0x7f6838162820 2024-05-20T17:54:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.215+0000 7f683eb72640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6838162820 0x7f68380ca900 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6830009f40 tx=0x7f6830004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.216+0000 7f682affd640 1 -- 172.21.15.6:0/1463736891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830036050 con 0x7f6838162820 2024-05-20T17:54:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.216+0000 7f682affd640 1 -- 172.21.15.6:0/1463736891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6830042070 con 0x7f6838162820 2024-05-20T17:54:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.216+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683815c0a0 con 0x7f6838162820 2024-05-20T17:54:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.216+0000 7f682affd640 1 -- 172.21.15.6:0/1463736891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830009510 con 0x7f6838162820 2024-05-20T17:54:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.216+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68380c8e70 con 0x7f6838162820 2024-05-20T17:54:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.217+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6838075b00 con 0x7f6838162820 2024-05-20T17:54:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.218+0000 7f682affd640 1 -- 172.21.15.6:0/1463736891 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6830007c50 con 0x7f6838162820 2024-05-20T17:54:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.218+0000 7f682affd640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f681c06be30 0x7f681c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.218+0000 7f682affd640 1 -- 172.21.15.6:0/1463736891 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f68300abdc0 con 0x7f6838162820 2024-05-20T17:54:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.219+0000 7f683e371640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f681c06be30 0x7f681c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.219+0000 7f683e371640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f681c06be30 0x7f681c06e340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f68340079a0 tx=0x7f6834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.223+0000 7f682affd640 1 -- 172.21.15.6:0/1463736891 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6830079f00 con 0x7f6838162820 2024-05-20T17:54:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.406+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) -- 0x7f68380c8920 con 0x7f6838162820 2024-05-20T17:54:37.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.410+0000 7f682affd640 1 -- 172.21.15.6:0/1463736891 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v11)=0 v11) ==== 121+0+0 (secure 0 0 0) 0x7f683007e200 con 0x7f6838162820 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f681c06be30 msgr2=0x7f681c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f681c06be30 0x7f681c06e340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f68340079a0 tx=0x7f6834008040 comp rx=0 tx=0).stop 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6838162820 msgr2=0x7f68380ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6838162820 0x7f68380ca900 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6830009f40 tx=0x7f6830004a40 comp rx=0 tx=0).stop 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 shutdown_connections 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f681c06be30 0x7f681c06e340 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6838162820 0x7f68380ca900 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68380b3e80 0x7f68381f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 --2- 172.21.15.6:0/1463736891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f683806d910 0x7f68380c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 >> 172.21.15.6:0/1463736891 conn(0x7f68380d4bd0 msgr2=0x7f683815cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 shutdown_connections 2024-05-20T17:54:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.412+0000 7f68405d5640 1 -- 172.21.15.6:0/1463736891 wait complete. 2024-05-20T17:54:37.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_cap_acquisition_throttle 37 2024-05-20T17:54:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.541+0000 7f336c498640 1 Processor -- start 2024-05-20T17:54:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.541+0000 7f336c498640 1 -- start start 2024-05-20T17:54:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f336c498640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f336406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f336c498640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f33640b8190 0x7f33640b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f336c498640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336406dd20 con 0x7f3364162820 2024-05-20T17:54:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f336c498640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f33640d0630 con 0x7f33640b8190 2024-05-20T17:54:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f336c498640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33640d39c0 con 0x7f336406d3d0 2024-05-20T17:54:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f336a234640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3364162820 0x7f33640b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40470/0 (socket says 172.21.15.6:40470) 2024-05-20T17:54:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f336a234640 1 -- 172.21.15.6:0/3083589790 learned_addr learned my addr 172.21.15.6:0/3083589790 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:54:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f3369a33640 1 --2- 172.21.15.6:0/3083589790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f336406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f336aa35640 1 --2- 172.21.15.6:0/3083589790 >> v2:172.21.15.171:3300/0 conn(0x7f33640b8190 0x7f33640b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f3369232640 1 -- 172.21.15.6:0/3083589790 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2337876782 0 0) 0x7f3360001490 con 0x7f3364162820 2024-05-20T17:54:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.543+0000 7f3369232640 1 -- 172.21.15.6:0/3083589790 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3350003520 con 0x7f3364162820 2024-05-20T17:54:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.544+0000 7f3369a33640 1 -- 172.21.15.6:0/3083589790 >> v2:172.21.15.171:3300/0 conn(0x7f33640b8190 msgr2=0x7f33640b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:54:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.544+0000 7f3369a33640 1 --2- 172.21.15.6:0/3083589790 >> v2:172.21.15.171:3300/0 conn(0x7f33640b8190 0x7f33640b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.544+0000 7f3369a33640 1 -- 172.21.15.6:0/3083589790 >> v1:172.21.15.6:6789/0 conn(0x7f3364162820 legacy=0x7f33640b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.544+0000 7f3369a33640 1 -- 172.21.15.6:0/3083589790 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33640d3ca0 con 0x7f336406d3d0 2024-05-20T17:54:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.544+0000 7f336aa35640 1 --2- 172.21.15.6:0/3083589790 >> v2:172.21.15.171:3300/0 conn(0x7f33640b8190 0x7f33640b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:54:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.544+0000 7f3369a33640 1 --2- 172.21.15.6:0/3083589790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f336406d7e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33540097a0 tx=0x7f335402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa0b67c8fd72483 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f3369232640 1 -- 172.21.15.6:0/3083589790 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354037070 con 0x7f336406d3d0 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f3369232640 1 -- 172.21.15.6:0/3083589790 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3354032440 con 0x7f336406d3d0 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f3369232640 1 -- 172.21.15.6:0/3083589790 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354032810 con 0x7f336406d3d0 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f336c498640 1 -- 172.21.15.6:0/3083589790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 msgr2=0x7f336406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f336c498640 1 --2- 172.21.15.6:0/3083589790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f336406d7e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33540097a0 tx=0x7f335402a180 comp rx=0 tx=0).stop 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f336c498640 1 -- 172.21.15.6:0/3083589790 shutdown_connections 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f336c498640 1 --2- 172.21.15.6:0/3083589790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f336406d7e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f336c498640 1 --2- 172.21.15.6:0/3083589790 >> v2:172.21.15.171:3300/0 conn(0x7f33640b8190 0x7f33640b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f336c498640 1 -- 172.21.15.6:0/3083589790 >> 172.21.15.6:0/3083589790 conn(0x7f33640d4bd0 msgr2=0x7f33640d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f336c498640 1 -- 172.21.15.6:0/3083589790 shutdown_connections 2024-05-20T17:54:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.545+0000 7f336c498640 1 -- 172.21.15.6:0/3083589790 wait complete. 2024-05-20T17:54:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.547+0000 7f336c498640 1 Processor -- start 2024-05-20T17:54:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.547+0000 7f336c498640 1 -- start start 2024-05-20T17:54:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.548+0000 7f336c498640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f33640b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.548+0000 7f336c498640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33640b8190 0x7f33640adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336c498640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3364162820 0x7f33640b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336c498640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33640d0300 con 0x7f3364162820 2024-05-20T17:54:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336c498640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33640d4260 con 0x7f33640b8190 2024-05-20T17:54:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336c498640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33640b4050 con 0x7f336406d3d0 2024-05-20T17:54:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3364162820 0x7f33640b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3364162820 0x7f33640b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33420/0 (socket says 172.21.15.6:33420) 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 -- 172.21.15.6:0/1124097927 learned_addr learned my addr 172.21.15.6:0/1124097927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f3369a33640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33640b8190 0x7f33640adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336a234640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f33640b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 -- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 msgr2=0x7f33640b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f33640b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 -- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33640b8190 msgr2=0x7f33640adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33640b8190 0x7f33640adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 -- 172.21.15.6:0/1124097927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33641f5a80 con 0x7f3364162820 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336a234640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f33640b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336aa35640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3364162820 0x7f33640b68a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e880 tx=0x7f335c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f335affd640 1 -- 172.21.15.6:0/1124097927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c017070 con 0x7f3364162820 2024-05-20T17:54:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f335affd640 1 -- 172.21.15.6:0/1124097927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335c00c940 con 0x7f3364162820 2024-05-20T17:54:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f335affd640 1 -- 172.21.15.6:0/1124097927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c00cd30 con 0x7f3364162820 2024-05-20T17:54:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33641f5d60 con 0x7f3364162820 2024-05-20T17:54:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.549+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33640ac510 con 0x7f3364162820 2024-05-20T17:54:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.550+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33640ac770 con 0x7f3364162820 2024-05-20T17:54:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.551+0000 7f335affd640 1 -- 172.21.15.6:0/1124097927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f335c01a070 con 0x7f3364162820 2024-05-20T17:54:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.552+0000 7f335affd640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334806be30 0x7f334806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:54:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.552+0000 7f335affd640 1 -- 172.21.15.6:0/1124097927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f335c08ae60 con 0x7f3364162820 2024-05-20T17:54:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.552+0000 7f336a234640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334806be30 0x7f334806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:54:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.552+0000 7f336a234640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334806be30 0x7f334806e340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3360001630 tx=0x7f3360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:54:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.556+0000 7f335affd640 1 -- 172.21.15.6:0/1124097927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f335c059670 con 0x7f3364162820 2024-05-20T17:54:37.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.741+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_session_cap_acquisition_throttle}] v 0) -- 0x7f3364075b00 con 0x7f3364162820 2024-05-20T17:54:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.744+0000 7f335affd640 1 -- 172.21.15.6:0/1124097927 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_cap_acquisition_throttle}]=0 v12)=0 v12) ==== 135+0+0 (secure 0 0 0) 0x7f335c058f70 con 0x7f3364162820 2024-05-20T17:54:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334806be30 msgr2=0x7f334806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334806be30 0x7f334806e340 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3360001630 tx=0x7f3360009040 comp rx=0 tx=0).stop 2024-05-20T17:54:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3364162820 msgr2=0x7f33640b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:54:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3364162820 0x7f33640b68a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e880 tx=0x7f335c00ed40 comp rx=0 tx=0).stop 2024-05-20T17:54:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 shutdown_connections 2024-05-20T17:54:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334806be30 0x7f334806e340 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3364162820 0x7f33640b68a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33640b8190 0x7f33640adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 --2- 172.21.15.6:0/1124097927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336406d3d0 0x7f33640b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:54:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 >> 172.21.15.6:0/1124097927 conn(0x7f33640d4bd0 msgr2=0x7f33640d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:54:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 shutdown_connections 2024-05-20T17:54:37.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:37.746+0000 7f336c498640 1 -- 172.21.15.6:0/1124097927 wait complete. 2024-05-20T17:54:37.756 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:37.756 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> import uuid 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> n = 25 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = False 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> if 0 > 0: 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = True 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> path = "/home/ubuntu/cephtest/mnt.0/dir1/file" 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> dpath = os.path.dirname(path) 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> fnameprefix = os.path.basename(path) 2024-05-20T17:54:37.773 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(dpath, exist_ok=True) 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(n): 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> with open(fpath, '"'"'w'"'"') as f: 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> f.write(f"{i}") 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> if True: 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> f.flush() 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f.fileno()) 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:37.774 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink(fpath) 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> if create_hard_links: 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> for j in range(0): 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> finally: 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> os.close(dirfd) 2024-05-20T17:54:37.775 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:54:38.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:38.026 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:38.026 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:38.082 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> import uuid 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> n = 25 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = False 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> if 0 > 0: 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = True 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> path = "/home/ubuntu/cephtest/mnt.0/dir2/file" 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> dpath = os.path.dirname(path) 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> fnameprefix = os.path.basename(path) 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(dpath, exist_ok=True) 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T17:54:38.083 DEBUG:teuthology.orchestra.run.smithi006:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(n): 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> with open(fpath, '"'"'w'"'"') as f: 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> f.write(f"{i}") 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> if True: 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> f.flush() 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f.fileno()) 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink(fpath) 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> if create_hard_links: 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> for j in range(0): 2024-05-20T17:54:38.084 DEBUG:teuthology.orchestra.run.smithi006:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-05-20T17:54:38.085 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.085 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:54:38.085 DEBUG:teuthology.orchestra.run.smithi006:> finally: 2024-05-20T17:54:38.085 DEBUG:teuthology.orchestra.run.smithi006:> os.close(dirfd) 2024-05-20T17:54:38.085 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:54:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:38.335 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:38.335 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:38.391 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T17:54:38.391 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:54:38.391 DEBUG:teuthology.orchestra.run.smithi006:> import uuid 2024-05-20T17:54:38.391 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.391 DEBUG:teuthology.orchestra.run.smithi006:> n = 25 2024-05-20T17:54:38.391 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = False 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> if 0 > 0: 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = True 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> path = "/home/ubuntu/cephtest/mnt.0/dir3/file" 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> dpath = os.path.dirname(path) 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> fnameprefix = os.path.basename(path) 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(dpath, exist_ok=True) 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(n): 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> with open(fpath, '"'"'w'"'"') as f: 2024-05-20T17:54:38.392 DEBUG:teuthology.orchestra.run.smithi006:> f.write(f"{i}") 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> if True: 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> f.flush() 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f.fileno()) 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink(fpath) 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> if create_hard_links: 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> for j in range(0): 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> finally: 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> os.close(dirfd) 2024-05-20T17:54:38.393 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:54:38.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:38.634 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:38.635 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:38.691 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T17:54:38.691 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> import uuid 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> n = 25 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = False 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> if 0 > 0: 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = True 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> path = "/home/ubuntu/cephtest/mnt.0/dir4/file" 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> dpath = os.path.dirname(path) 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> fnameprefix = os.path.basename(path) 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(dpath, exist_ok=True) 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-05-20T17:54:38.692 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(n): 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> with open(fpath, '"'"'w'"'"') as f: 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> f.write(f"{i}") 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> if True: 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> f.flush() 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f.fileno()) 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink(fpath) 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> if create_hard_links: 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> for j in range(0): 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:54:38.693 DEBUG:teuthology.orchestra.run.smithi006:> finally: 2024-05-20T17:54:38.694 DEBUG:teuthology.orchestra.run.smithi006:> os.close(dirfd) 2024-05-20T17:54:38.694 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:54:38.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:38.927 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:54:38.928 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:54:38.984 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:54:39.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:54:39.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:54:39.083 INFO:teuthology.orchestra.run.smithi006.stdout:client5078 2024-05-20T17:54:39.084 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'find . | wc') 2024-05-20T17:54:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:54:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:55:05.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:55:05.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:55:18.154 INFO:teuthology.orchestra.run.smithi006.stdout: 105 105 1490 2024-05-20T17:55:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:55:18.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:18.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.292+0000 7f8272936640 1 Processor -- start 2024-05-20T17:55:18.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.292+0000 7f8272936640 1 -- start start 2024-05-20T17:55:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.293+0000 7f8272936640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f826c163a10 0x7f826c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.293+0000 7f8272936640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f826c0d14b0 0x7f826c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.293+0000 7f8272936640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f826c0d0370 con 0x7f826c0b4010 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.293+0000 7f8272936640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f826c0d3ca0 con 0x7f826c163a10 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.293+0000 7f8272936640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f826c0d0650 con 0x7f826c0d14b0 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.293+0000 7f826bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f826c163a10 0x7f826c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.294+0000 7f826bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f826c163a10 0x7f826c0d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42702/0 (socket says 172.21.15.6:42702) 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.294+0000 7f826bfff640 1 -- 172.21.15.6:0/356372275 learned_addr learned my addr 172.21.15.6:0/356372275 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.294+0000 7f8270ed3640 1 --2- 172.21.15.6:0/356372275 >> v2:172.21.15.171:3300/0 conn(0x7f826c0d14b0 0x7f826c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.294+0000 7f826bfff640 1 -- 172.21.15.6:0/356372275 >> v2:172.21.15.171:3300/0 conn(0x7f826c0d14b0 msgr2=0x7f826c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.294+0000 7f826bfff640 1 --2- 172.21.15.6:0/356372275 >> v2:172.21.15.171:3300/0 conn(0x7f826c0d14b0 0x7f826c0d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.294+0000 7f826bfff640 1 -- 172.21.15.6:0/356372275 >> v1:172.21.15.171:6789/0 conn(0x7f826c0b4010 legacy=0x7f826c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.294+0000 7f826bfff640 1 -- 172.21.15.6:0/356372275 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c0d3650 con 0x7f826c163a10 2024-05-20T17:55:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.295+0000 7f826bfff640 1 --2- 172.21.15.6:0/356372275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c163a10 0x7f826c0d4130 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f826c0b4590 tx=0x7f825c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fc3a0d8ca16e72 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.295+0000 7f826affd640 1 -- 172.21.15.6:0/356372275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c037070 con 0x7f826c163a10 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.295+0000 7f826affd640 1 -- 172.21.15.6:0/356372275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c032440 con 0x7f826c163a10 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.295+0000 7f826affd640 1 -- 172.21.15.6:0/356372275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c032810 con 0x7f826c163a10 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.295+0000 7f8272936640 1 -- 172.21.15.6:0/356372275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c163a10 msgr2=0x7f826c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.295+0000 7f8272936640 1 --2- 172.21.15.6:0/356372275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c163a10 0x7f826c0d4130 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f826c0b4590 tx=0x7f825c02a270 comp rx=0 tx=0).stop 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.296+0000 7f8272936640 1 -- 172.21.15.6:0/356372275 shutdown_connections 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.296+0000 7f8272936640 1 --2- 172.21.15.6:0/356372275 >> v2:172.21.15.171:3300/0 conn(0x7f826c0d14b0 0x7f826c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.296+0000 7f8272936640 1 --2- 172.21.15.6:0/356372275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c163a10 0x7f826c0d4130 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.296+0000 7f8272936640 1 -- 172.21.15.6:0/356372275 >> 172.21.15.6:0/356372275 conn(0x7f826c06d240 msgr2=0x7f826c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.296+0000 7f8272936640 1 -- 172.21.15.6:0/356372275 shutdown_connections 2024-05-20T17:55:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.296+0000 7f8272936640 1 -- 172.21.15.6:0/356372275 wait complete. 2024-05-20T17:55:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.297+0000 7f8272936640 1 Processor -- start 2024-05-20T17:55:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.298+0000 7f8272936640 1 -- start start 2024-05-20T17:55:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f8272936640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c0b4010 0x7f826c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f8272936640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f826c0d14b0 0x7f826c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f8272936640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f826c163a10 0x7f826c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f8272936640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f826c0b8210 con 0x7f826c0b4010 2024-05-20T17:55:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f8272936640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f826c0d1e00 con 0x7f826c0d14b0 2024-05-20T17:55:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f8272936640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f826c0b8390 con 0x7f826c163a10 2024-05-20T17:55:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c0b4010 0x7f826c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c0b4010 0x7f826c0ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42718/0 (socket says 172.21.15.6:42718) 2024-05-20T17:55:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826bfff640 1 -- 172.21.15.6:0/1873258761 learned_addr learned my addr 172.21.15.6:0/1873258761 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826b7fe640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f826c0d14b0 0x7f826c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f8270ed3640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f826c163a10 0x7f826c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826bfff640 1 -- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f826c163a10 msgr2=0x7f826c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826bfff640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f826c163a10 0x7f826c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826bfff640 1 -- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f826c0d14b0 msgr2=0x7f826c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826bfff640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f826c0d14b0 0x7f826c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.299+0000 7f826bfff640 1 -- 172.21.15.6:0/1873258761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c155530 con 0x7f826c0b4010 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.300+0000 7f826bfff640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c0b4010 0x7f826c0ce1d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f825c02a2b0 tx=0x7f825c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.300+0000 7f8268ff9640 1 -- 172.21.15.6:0/1873258761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c037040 con 0x7f826c0b4010 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.300+0000 7f8268ff9640 1 -- 172.21.15.6:0/1873258761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c042070 con 0x7f826c0b4010 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.300+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826c155810 con 0x7f826c0b4010 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.300+0000 7f8268ff9640 1 -- 172.21.15.6:0/1873258761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c030880 con 0x7f826c0b4010 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.300+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826c155dd0 con 0x7f826c0b4010 2024-05-20T17:55:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.301+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826c075b00 con 0x7f826c0b4010 2024-05-20T17:55:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.301+0000 7f8268ff9640 1 -- 172.21.15.6:0/1873258761 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f825c030a20 con 0x7f826c0b4010 2024-05-20T17:55:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.302+0000 7f8268ff9640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f824c06be30 0x7f824c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.302+0000 7f8268ff9640 1 -- 172.21.15.6:0/1873258761 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f825c0ab830 con 0x7f826c0b4010 2024-05-20T17:55:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.302+0000 7f826b7fe640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f824c06be30 0x7f824c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.303+0000 7f826b7fe640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f824c06be30 0x7f824c06e340 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f826c15eb80 tx=0x7f8254009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:18.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.307+0000 7f8268ff9640 1 -- 172.21.15.6:0/1873258761 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f825c079950 con 0x7f826c0b4010 2024-05-20T17:55:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.528+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f826c0d3050 con 0x7f826c0b4010 2024-05-20T17:55:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.529+0000 7f8268ff9640 1 -- 172.21.15.6:0/1873258761 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f825c07dc50 con 0x7f826c0b4010 2024-05-20T17:55:18.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:18.531 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:54:23.810231+0000","modified":"2024-05-20T17:54:26.847159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3387888972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3387888972},{"type":"v1","addr":"172.21.15.6:6834","nonce":3387888972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":2}]} 2024-05-20T17:55:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-05-20T17:55:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f824c06be30 msgr2=0x7f824c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f824c06be30 0x7f824c06e340 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f826c15eb80 tx=0x7f8254009040 comp rx=0 tx=0).stop 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c0b4010 msgr2=0x7f826c0ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c0b4010 0x7f826c0ce1d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f825c02a2b0 tx=0x7f825c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 shutdown_connections 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f824c06be30 0x7f824c06e340 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f826c163a10 0x7f826c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f826c0d14b0 0x7f826c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 --2- 172.21.15.6:0/1873258761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f826c0b4010 0x7f826c0ce1d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.530+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 >> 172.21.15.6:0/1873258761 conn(0x7f826c06d240 msgr2=0x7f826c0b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.531+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 shutdown_connections 2024-05-20T17:55:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.531+0000 7f8272936640 1 -- 172.21.15.6:0/1873258761 wait complete. 2024-05-20T17:55:18.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-20T17:55:18.673 INFO:teuthology.orchestra.run.smithi006.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":186,"msgr_send_messages":151,"msgr_recv_bytes":53710,"msgr_send_bytes":508803,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.027714110,"msgr_running_send_time":0.006538883,"msgr_running_recv_time":0.013394119,"msgr_running_fast_dispatch_time":0.005464037,"msgr_send_messages_queue_lat":{"avgcount":149,"sum":0.161249332,"avgtime":0.001082210},"msgr_handle_ack_lat":{"avgcount":62,"sum":0.000013503,"avgtime":0.000000217},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":82,"msgr_send_messages":74,"msgr_recv_bytes":120819,"msgr_send_bytes":23249,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.014649037,"msgr_running_send_time":0.003307185,"msgr_running_recv_time":0.013455004,"msgr_running_fast_dispatch_time":0.000552773,"msgr_send_messages_queue_lat":{"avgcount":74,"sum":0.090849597,"avgtime":0.001227697},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":118000,"msgr_send_encrypted_bytes":18464},"AsyncMessenger::Worker-2":{"msgr_recv_messages":406,"msgr_send_messages":493,"msgr_recv_bytes":116597,"msgr_send_bytes":381829,"msgr_created_connections":8,"msgr_active_connections":7,"msgr_running_total_time":0.048978343,"msgr_running_send_time":0.023109385,"msgr_running_recv_time":0.028910605,"msgr_running_fast_dispatch_time":0.002251004,"msgr_send_messages_queue_lat":{"avgcount":492,"sum":0.104845868,"avgtime":0.000213101},"msgr_handle_ack_lat":{"avgcount":856,"sum":0.000115504,"avgtime":0.000000134},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":109936},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":264,"sum":0.089890142,"avgtime":0.000340492}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000014043,"avgtime":0.000007021}},"mds":{"request":148,"reply":148,"reply_latency":{"avgcount":148,"sum":39.108109002,"avgtime":0.264243979},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":114,"inodes_top":0,"inodes_bottom":114,"inodes_pin_tail":0,"inodes_pinned":114,"inodes_expired":0,"inodes_with_caps":100,"caps":101,"subtrees":2,"traverse":188,"traverse_hit":174,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":100,"root_rbytes":160,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":4,"ceph_cap_op_grant":112,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":104,"handle_client_caps_dirty":100,"handle_client_cap_release":1,"process_request_cap_release":14},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":219,"evex":0,"evtrm":0,"ev":219,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4639776,"rdpos":0,"jlat":{"avgcount":110,"sum":0.181341973,"avgtime":0.001648563},"replayed":0},"mds_mem":{"ino":117,"ino+":117,"ino-":0,"dir":16,"dir+":16,"dir-":0,"dn":114,"dn+":115,"dn-":1,"cap":101,"cap+":106,"cap-":5,"rss":118896,"heap":231804},"mds_server":{"dispatch_client_request":230,"dispatch_server_request":0,"handle_client_request":148,"handle_client_session":106,"handle_peer_request":0,"req_create_latency":{"avgcount":100,"sum":0.078630208,"avgtime":0.000786302},"req_getattr_latency":{"avgcount":32,"sum":0.005595130,"avgtime":0.000174847},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":4,"sum":0.000459771,"avgtime":0.000114942},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":4,"sum":0.006250566,"avgtime":0.001562641},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000230652,"avgtime":0.000115326},"req_readdir_latency":{"avgcount":5,"sum":39.016668387,"avgtime":7.803333677},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000274288,"avgtime":0.000274288},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":78,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":2,"session_add":2,"session_remove":0,"sessions_open":2,"sessions_stale":0,"total_load":93,"average_load":46,"avg_session_uptime":40,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":246528,"buffer_anon_items":216,"buffer_meta_bytes":1584,"buffer_meta_items":18,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5520,"osdmap_items":78,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":418264,"mds_co_items":4385,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":152,"op_send_bytes":463251,"op_resend":37,"op_reply":152,"op_latency":{"avgcount":152,"sum":1.092987377,"avgtime":0.007190706},"op_inflight":0,"oplen_avg":{"avgcount":152,"sum":179},"op":152,"op_r":0,"op_w":152,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":110,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":40,"map_full":0,"map_inc":3,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":20,"omap_rd":0,"omap_del":2},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":2},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":669,"get_sum":225837,"get_or_fail_fail":0,"get_or_fail_success":669,"take":0,"take_sum":0,"put":669,"put_sum":225837,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":152,"take_sum":463251,"put":152,"put_sum":463251,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":152,"take_sum":152,"put":152,"put_sum":152,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x558ca74fec30":{"val":0,"max":3758096384,"get_started":0,"get":219,"get_sum":445472,"get_or_fail_fail":0,"get_or_fail_success":219,"take":0,"take_sum":0,"put":110,"put_sum":445472,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-20T17:55:18.674 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 62, "avgtime": 2.17e-07, "sum": 1.3503e-05 }, "msgr_recv_bytes": 53710, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 186, "msgr_running_fast_dispatch_time": 0.005464037, "msgr_running_recv_time": 0.013394119, "msgr_running_send_time": 0.006538883, "msgr_running_total_time": 0.02771411, "msgr_send_bytes": 508803, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 151, "msgr_send_messages_queue_lat": { "avgcount": 149, "avgtime": 0.00108221, "sum": 0.161249332 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 120819, "msgr_recv_encrypted_bytes": 118000, "msgr_recv_messages": 82, "msgr_running_fast_dispatch_time": 0.000552773, "msgr_running_recv_time": 0.013455004, "msgr_running_send_time": 0.003307185, "msgr_running_total_time": 0.014649037, "msgr_send_bytes": 23249, "msgr_send_encrypted_bytes": 18464, "msgr_send_messages": 74, "msgr_send_messages_queue_lat": { "avgcount": 74, "avgtime": 0.001227697, "sum": 0.090849597 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 7, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 856, "avgtime": 1.34e-07, "sum": 0.000115504 }, "msgr_recv_bytes": 116597, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 406, "msgr_running_fast_dispatch_time": 0.002251004, "msgr_running_recv_time": 0.028910605, "msgr_running_send_time": 0.023109385, "msgr_running_total_time": 0.048978343, "msgr_send_bytes": 381829, "msgr_send_encrypted_bytes": 109936, "msgr_send_messages": 493, "msgr_send_messages_queue_lat": { "avgcount": 492, "avgtime": 0.000213101, "sum": 0.104845868 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 264, "avgtime": 0.000340492, "sum": 0.089890142 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 7.021e-06, "sum": 1.4043e-05 }, "queue_len": 0 }, "mds": { "caps": 101, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 112, "ceph_cap_op_revoke": 4, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 104, "handle_client_caps_dirty": 100, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 114, "inodes_bottom": 114, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 114, "inodes_top": 0, "inodes_with_caps": 100, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 14, "q": 0, "reply": 148, "reply_latency": { "avgcount": 148, "avgtime": 0.264243979, "sum": 39.108109002 }, "request": 148, "root_rbytes": 160, "root_rfiles": 100, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 188, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 174, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 219, "evadd": 219, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 110, "avgtime": 0.001648563, "sum": 0.181341973 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4639776 }, "mds_mem": { "cap": 101, "cap+": 106, "cap-": 5, "dir": 16, "dir+": 16, "dir-": 0, "dn": 114, "dn+": 115, "dn-": 1, "heap": 231804, "ino": 117, "ino+": 117, "ino-": 0, "rss": 118896 }, "mds_server": { "cap_acquisition_throttle": 78, "cap_revoke_eviction": 0, "dispatch_client_request": 230, "dispatch_server_request": 0, "handle_client_request": 148, "handle_client_session": 106, "handle_peer_request": 0, "req_create_latency": { "avgcount": 100, "avgtime": 0.000786302, "sum": 0.078630208 }, "req_getattr_latency": { "avgcount": 32, "avgtime": 0.000174847, "sum": 0.00559513 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 4, "avgtime": 0.000114942, "sum": 0.000459771 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 4, "avgtime": 0.001562641, "sum": 0.006250566 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000115326, "sum": 0.000230652 }, "req_readdir_latency": { "avgcount": 5, "avgtime": 7.803333677, "sum": 39.016668387 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000274288, "sum": 0.000274288 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 46, "avg_session_uptime": 40, "mdthresh_evicted": 0, "session_add": 2, "session_count": 2, "session_remove": 0, "sessions_open": 2, "sessions_stale": 0, "total_load": 93 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 246528, "buffer_anon_items": 216, "buffer_meta_bytes": 1584, "buffer_meta_items": 18, "mds_co_bytes": 418264, "mds_co_items": 4385, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5520, "osdmap_items": 78, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 40, "map_full": 0, "map_inc": 3, "omap_del": 2, "omap_rd": 0, "omap_wr": 20, "op": 152, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 152, "avgtime": 0.007190706, "sum": 1.092987377 }, "op_pg": 0, "op_r": 0, "op_reply": 152, "op_resend": 37, "op_rmw": 0, "op_send": 152, "op_send_bytes": 463251, "op_w": 152, "oplen_avg": { "avgcount": 152, "sum": 179 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 110, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 669, "get_or_fail_fail": 0, "get_or_fail_success": 669, "get_started": 0, "get_sum": 225837, "max": 104857600, "put": 669, "put_sum": 225837, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 152, "put_sum": 463251, "take": 152, "take_sum": 463251, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 152, "put_sum": 152, "take": 152, "take_sum": 152, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x558ca74fec30": { "get": 219, "get_or_fail_fail": 0, "get_or_fail_success": 219, "get_started": 0, "get_sum": 445472, "max": 3758096384, "put": 110, "put_sum": 445472, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-20T17:55:18.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:18.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.789+0000 7f4d085b7640 1 Processor -- start 2024-05-20T17:55:18.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.789+0000 7f4d085b7640 1 -- start start 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d085b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d00162820 0x7f4d000b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d085b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d000b3e80 0x7f4d0006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d085b7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0006dd20 con 0x7f4d0006d910 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d085b7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4d000d0630 con 0x7f4d000b3e80 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d085b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4d000d39c0 con 0x7f4d00162820 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d05b52640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d000b3e80 0x7f4d0006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d05b52640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d000b3e80 0x7f4d0006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42732/0 (socket says 172.21.15.6:42732) 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d05b52640 1 -- 172.21.15.6:0/2274594916 learned_addr learned my addr 172.21.15.6:0/2274594916 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.791+0000 7f4d06353640 1 --2- 172.21.15.6:0/2274594916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d00162820 0x7f4d000b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.792+0000 7f4d05b52640 1 -- 172.21.15.6:0/2274594916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d00162820 msgr2=0x7f4d000b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:18.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.792+0000 7f4d05b52640 1 --2- 172.21.15.6:0/2274594916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d00162820 0x7f4d000b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.792+0000 7f4d05b52640 1 -- 172.21.15.6:0/2274594916 >> v1:172.21.15.171:6789/0 conn(0x7f4d0006d910 legacy=0x7f4d000d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.792+0000 7f4d05b52640 1 -- 172.21.15.6:0/2274594916 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d000d3ca0 con 0x7f4d000b3e80 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.792+0000 7f4d05b52640 1 --2- 172.21.15.6:0/2274594916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d000b3e80 0x7f4d0006d3d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009870 tx=0x7f4cf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7952f30e87b88c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d05351640 1 -- 172.21.15.6:0/2274594916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0037070 con 0x7f4d000b3e80 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d05351640 1 -- 172.21.15.6:0/2274594916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf0032440 con 0x7f4d000b3e80 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d05351640 1 -- 172.21.15.6:0/2274594916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0032810 con 0x7f4d000b3e80 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d085b7640 1 -- 172.21.15.6:0/2274594916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d000b3e80 msgr2=0x7f4d0006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d085b7640 1 --2- 172.21.15.6:0/2274594916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d000b3e80 0x7f4d0006d3d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009870 tx=0x7f4cf002a270 comp rx=0 tx=0).stop 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d085b7640 1 -- 172.21.15.6:0/2274594916 shutdown_connections 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d085b7640 1 --2- 172.21.15.6:0/2274594916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d000b3e80 0x7f4d0006d3d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d085b7640 1 --2- 172.21.15.6:0/2274594916 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d00162820 0x7f4d000b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d085b7640 1 -- 172.21.15.6:0/2274594916 >> 172.21.15.6:0/2274594916 conn(0x7f4d000d4bd0 msgr2=0x7f4d000d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d085b7640 1 -- 172.21.15.6:0/2274594916 shutdown_connections 2024-05-20T17:55:18.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.793+0000 7f4d085b7640 1 -- 172.21.15.6:0/2274594916 wait complete. 2024-05-20T17:55:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.795+0000 7f4d085b7640 1 Processor -- start 2024-05-20T17:55:18.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.795+0000 7f4d085b7640 1 -- start start 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.796+0000 7f4d085b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d0006d910 0x7f4d000c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.796+0000 7f4d085b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d000b3e80 0x7f4d0014ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d085b7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d00162820 0x7f4d0015d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d085b7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000d0300 con 0x7f4d0006d910 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d085b7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000d4260 con 0x7f4d00162820 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d085b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4d000b91a0 con 0x7f4d000b3e80 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d0006d910 0x7f4d000c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d0006d910 0x7f4d000c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42740/0 (socket says 172.21.15.6:42740) 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 -- 172.21.15.6:0/1742277797 learned_addr learned my addr 172.21.15.6:0/1742277797 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 -- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d000b3e80 msgr2=0x7f4d0014ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d000b3e80 0x7f4d0014ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 -- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d00162820 msgr2=0x7f4d0015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d00162820 0x7f4d0015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 -- 172.21.15.6:0/1742277797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d001f5980 con 0x7f4d0006d910 2024-05-20T17:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d06353640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d0006d910 0x7f4d000c89a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00e870 tx=0x7f4cfc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4cf6ffd640 1 -- 172.21.15.6:0/1742277797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc017070 con 0x7f4d0006d910 2024-05-20T17:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4cf6ffd640 1 -- 172.21.15.6:0/1742277797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00c8e0 con 0x7f4d0006d910 2024-05-20T17:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d001f5c60 con 0x7f4d0006d910 2024-05-20T17:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4cf6ffd640 1 -- 172.21.15.6:0/1742277797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00ccd0 con 0x7f4d0006d910 2024-05-20T17:55:18.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.797+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d001f6220 con 0x7f4d0006d910 2024-05-20T17:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.798+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d00075b00 con 0x7f4d0006d910 2024-05-20T17:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.799+0000 7f4cf6ffd640 1 -- 172.21.15.6:0/1742277797 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cfc01a070 con 0x7f4d0006d910 2024-05-20T17:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.799+0000 7f4cf6ffd640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce406be30 0x7f4ce406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.800+0000 7f4cf6ffd640 1 -- 172.21.15.6:0/1742277797 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f4cfc08af40 con 0x7f4d0006d910 2024-05-20T17:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.800+0000 7f4d05b52640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce406be30 0x7f4ce406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:18.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.800+0000 7f4d05b52640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce406be30 0x7f4ce406e340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0034000 tx=0x7f4cf002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:18.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:18.804+0000 7f4cf6ffd640 1 -- 172.21.15.6:0/1742277797 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4cfc0596b0 con 0x7f4d0006d910 2024-05-20T17:55:19.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.027+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d000b3970 con 0x7f4d0006d910 2024-05-20T17:55:19.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.028+0000 7f4cf6ffd640 1 -- 172.21.15.6:0/1742277797 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f4cfc058fb0 con 0x7f4d0006d910 2024-05-20T17:55:19.027 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:19.027 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:54:23.810231+0000","modified":"2024-05-20T17:54:26.847159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3387888972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3387888972},{"type":"v1","addr":"172.21.15.6:6834","nonce":3387888972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":2}]} 2024-05-20T17:55:19.027 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-05-20T17:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce406be30 msgr2=0x7f4ce406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce406be30 0x7f4ce406e340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0034000 tx=0x7f4cf002c000 comp rx=0 tx=0).stop 2024-05-20T17:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d0006d910 msgr2=0x7f4d000c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d0006d910 0x7f4d000c89a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00e870 tx=0x7f4cfc00ed30 comp rx=0 tx=0).stop 2024-05-20T17:55:19.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 shutdown_connections 2024-05-20T17:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce406be30 0x7f4ce406e340 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d00162820 0x7f4d0015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d000b3e80 0x7f4d0014ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 --2- 172.21.15.6:0/1742277797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d0006d910 0x7f4d000c89a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 >> 172.21.15.6:0/1742277797 conn(0x7f4d000d4bd0 msgr2=0x7f4d000b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 shutdown_connections 2024-05-20T17:55:19.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.030+0000 7f4d085b7640 1 -- 172.21.15.6:0/1742277797 wait complete. 2024-05-20T17:55:19.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-05-20T17:55:19.173 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":5359,"entity":{"name":{"type":"client","num":5359},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":933144610}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":2,"uptime":42.239512795000003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":8.1871065775675849,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5359 192.168.0.1:0/933144610","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":5078,"entity":{"name":{"type":"client","num":5078},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":1111113528}},"state":"open","num_leases":1,"num_caps":100,"request_load_avg":90,"uptime":43.434499012000003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":12.862632277906954,"halflife":60},"release_caps":{"value":3.3097409278639849,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":194.7608354624534,"halflife":300},"cap_acquisition":{"value":60.360677471837818,"halflife":30},"last_trim_completed_requests_tid":144,"last_trim_completed_flushes_tid":101,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5078 172.21.15.6:0/1111113528","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000025c","length":899}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T17:55:19.174 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 933144610, "type": "any" }, "name": { "num": 5359, "type": "client" } }, "id": 5359, "inst": "client.5359 192.168.0.1:0/933144610", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 8.187106577567585 }, "state": "open", "uptime": 42.239512795 }, { "cap_acquisition": { "halflife": 30, "value": 60.36067747183782 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 1111113528, "type": "any" }, "name": { "num": 5078, "type": "client" } }, "id": 5078, "inst": "client.5078 172.21.15.6:0/1111113528", "last_trim_completed_flushes_tid": 101, "last_trim_completed_requests_tid": 144, "num_caps": 100, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 899, "start": "0x1000000025c" } ], "recall_caps": { "halflife": 60, "value": 12.862632277906954 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 3.309740927863985 }, "request_load_avg": 90, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 194.7608354624534 }, "state": "open", "uptime": 43.434499012 } ] 2024-05-20T17:55:19.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump_historic_ops 2024-05-20T17:55:19.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.291+0000 7f841cc5f640 1 Processor -- start 2024-05-20T17:55:19.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.291+0000 7f841cc5f640 1 -- start start 2024-05-20T17:55:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f841cc5f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f84180d4700 0x7f841815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f841cc5f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84180b3b00 con 0x7f84180b3de0 2024-05-20T17:55:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f841cc5f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84180cf980 con 0x7f841806db00 2024-05-20T17:55:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f841cc5f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f84180b38b0 con 0x7f84180d4700 2024-05-20T17:55:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f8415d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f84180b3de0 0x7f841806d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46278/0 (socket says 172.21.15.6:46278) 2024-05-20T17:55:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f8415d9b640 1 -- 172.21.15.6:0/4262022159 learned_addr learned my addr 172.21.15.6:0/4262022159 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f841659c640 1 --2- 172.21.15.6:0/4262022159 >> v2:172.21.15.171:3300/0 conn(0x7f84180d4700 0x7f841815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755995467 0 0) 0x7f84180b3b00 con 0x7f84180b3de0 2024-05-20T17:55:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.293+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8400003520 con 0x7f84180b3de0 2024-05-20T17:55:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2121914536 0 0) 0x7f8400003520 con 0x7f84180b3de0 2024-05-20T17:55:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 >> v2:172.21.15.171:3300/0 conn(0x7f84180d4700 msgr2=0x7f841815f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 --2- 172.21.15.6:0/4262022159 >> v2:172.21.15.171:3300/0 conn(0x7f84180d4700 0x7f841815f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 >> v1:172.21.15.171:6789/0 conn(0x7f841806db00 legacy=0x7f84180b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84180cfc60 con 0x7f84180b3de0 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f840c001670 con 0x7f84180b3de0 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841659c640 1 --2- 172.21.15.6:0/4262022159 >> v2:172.21.15.171:3300/0 conn(0x7f84180d4700 0x7f841815f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 >> v1:172.21.15.6:6789/0 conn(0x7f84180b3de0 legacy=0x7f841806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84000039b0 0x7f8400003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8400004800 0x7f8400004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84000051c0 0x7f840000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f84180b38b0 con 0x7f8400004800 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f840000c160 con 0x7f84000039b0 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f840000c360 con 0x7f84000051c0 2024-05-20T17:55:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8415d9b640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8400004800 0x7f8400004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f841659c640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84000039b0 0x7f8400003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8416d9d640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84000051c0 0x7f840000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8415d9b640 1 -- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84000051c0 msgr2=0x7f840000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8415d9b640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84000051c0 0x7f840000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8415d9b640 1 -- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84000039b0 msgr2=0x7f8400003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8415d9b640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84000039b0 0x7f8400003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8415d9b640 1 -- 172.21.15.6:0/4262022159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8400003520 con 0x7f8400004800 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8416d9d640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84000051c0 0x7f840000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.294+0000 7f8416d9d640 1 -- 172.21.15.6:0/4262022159 reap_dead start 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.295+0000 7f8415d9b640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8400004800 0x7f8400004c10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c240 tx=0x7f8400005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587717ae038c43a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.295+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c007cf0 con 0x7f8400004800 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.295+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0058d0 con 0x7f8400004800 2024-05-20T17:55:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.295+0000 7f841559a640 1 -- 172.21.15.6:0/4262022159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c005d20 con 0x7f8400004800 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.296+0000 7f841cc5f640 1 -- 172.21.15.6:0/4262022159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8400004800 msgr2=0x7f8400004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.296+0000 7f841cc5f640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8400004800 0x7f8400004c10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c240 tx=0x7f8400005830 comp rx=0 tx=0).stop 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.296+0000 7f841cc5f640 1 -- 172.21.15.6:0/4262022159 shutdown_connections 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.296+0000 7f841cc5f640 1 --2- 172.21.15.6:0/4262022159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8400004800 0x7f8400004c10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.296+0000 7f841cc5f640 1 -- 172.21.15.6:0/4262022159 >> 172.21.15.6:0/4262022159 conn(0x7f84180d4e20 msgr2=0x7f84180d5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.296+0000 7f841cc5f640 1 -- 172.21.15.6:0/4262022159 shutdown_connections 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.296+0000 7f841cc5f640 1 -- 172.21.15.6:0/4262022159 wait complete. 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.298+0000 7f841cc5f640 1 Processor -- start 2024-05-20T17:55:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.298+0000 7f841cc5f640 1 -- start start 2024-05-20T17:55:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f841cc5f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8400004800 0x7f84181f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f841cc5f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84181f8b90 0x7f841814a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f841cc5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841814ac90 0x7f841814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f841cc5f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f841808d7b0 con 0x7f841814ac90 2024-05-20T17:55:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f841cc5f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f84180d0220 con 0x7f84181f8b90 2024-05-20T17:55:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f841cc5f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f84180d0740 con 0x7f8400004800 2024-05-20T17:55:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841814ac90 0x7f841814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841814ac90 0x7f841814b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42748/0 (socket says 172.21.15.6:42748) 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.299+0000 7f8416d9d640 1 -- 172.21.15.6:0/734240973 learned_addr learned my addr 172.21.15.6:0/734240973 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8415d9b640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84181f8b90 0x7f841814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f841659c640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8400004800 0x7f84181f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8416d9d640 1 -- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8400004800 msgr2=0x7f84181f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8416d9d640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8400004800 0x7f84181f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8416d9d640 1 -- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84181f8b90 msgr2=0x7f841814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8416d9d640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84181f8b90 0x7f841814a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8416d9d640 1 -- 172.21.15.6:0/734240973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84181f8fa0 con 0x7f841814ac90 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8415d9b640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84181f8b90 0x7f841814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:19.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8416d9d640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841814ac90 0x7f841814b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f841806e790 tx=0x7f841000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8406ffd640 1 -- 172.21.15.6:0/734240973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410019070 con 0x7f841814ac90 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8406ffd640 1 -- 172.21.15.6:0/734240973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841000ee80 con 0x7f841814ac90 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f841cc5f640 1 -- 172.21.15.6:0/734240973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8418155990 con 0x7f841814ac90 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f8406ffd640 1 -- 172.21.15.6:0/734240973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100035f0 con 0x7f841814ac90 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.300+0000 7f841cc5f640 1 -- 172.21.15.6:0/734240973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8418161060 con 0x7f841814ac90 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.302+0000 7f8406ffd640 1 -- 172.21.15.6:0/734240973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8410003790 con 0x7f841814ac90 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.302+0000 7f8406ffd640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83f806be30 0x7f83f806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.302+0000 7f8406ffd640 1 -- 172.21.15.6:0/734240973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f841008a100 con 0x7f841814ac90 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.303+0000 7f841659c640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83f806be30 0x7f83f806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.303+0000 7f8423bd7740 1 Processor -- start 2024-05-20T17:55:19.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.303+0000 7f841659c640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83f806be30 0x7f83f806e340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f84180c86a0 tx=0x7f840800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.304+0000 7f8423bd7740 1 -- start start 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1713c390 0x563a17523a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a175077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1711b6b0 0x563a174dd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8423bd7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563a174405d0 con 0x563a1711b6b0 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8423bd7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563a173e83a0 con 0x563a1713c390 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8423bd7740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x563a1743c590 con 0x563a171134d0 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1711b6b0 0x563a174dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1711b6b0 0x563a174dd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42760/0 (socket says 172.21.15.6:42760) 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 -- 172.21.15.6:0/940109585 learned_addr learned my addr 172.21.15.6:0/940109585 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f841659c640 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1713c390 0x563a17523a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8415d9b640 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a175077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 -- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 msgr2=0x563a175077c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a175077c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 -- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1713c390 msgr2=0x563a17523a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1713c390 0x563a17523a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 -- 172.21.15.6:0/940109585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a171543f0 con 0x563a1711b6b0 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f841659c640 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1713c390 0x563a17523a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.305+0000 7f8416d9d640 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1711b6b0 0x563a174dd040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f84100544f0 tx=0x7f8410057fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc33a715757aa86 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f83f7fff640 1 -- 172.21.15.6:0/940109585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410060cc0 con 0x563a1711b6b0 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f83f7fff640 1 -- 172.21.15.6:0/940109585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100563e0 con 0x563a1711b6b0 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f83f7fff640 1 -- 172.21.15.6:0/940109585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410077070 con 0x563a1711b6b0 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f8423bd7740 1 -- 172.21.15.6:0/940109585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1711b6b0 msgr2=0x563a174dd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f8423bd7740 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1711b6b0 0x563a174dd040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f84100544f0 tx=0x7f8410057fe0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f8423bd7740 1 -- 172.21.15.6:0/940109585 shutdown_connections 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f8423bd7740 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1711b6b0 0x563a174dd040 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f8423bd7740 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a175077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f8423bd7740 1 --2- 172.21.15.6:0/940109585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1713c390 0x563a17523a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.306+0000 7f8423bd7740 1 -- 172.21.15.6:0/940109585 >> 172.21.15.6:0/940109585 conn(0x563a171304e0 msgr2=0x563a174dc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.307+0000 7f8423bd7740 1 -- 172.21.15.6:0/940109585 shutdown_connections 2024-05-20T17:55:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.307+0000 7f8423bd7740 1 -- 172.21.15.6:0/940109585 wait complete. 2024-05-20T17:55:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.307+0000 7f8423bd7740 1 -- start start 2024-05-20T17:55:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.308+0000 7f8423bd7740 1 Processor -- start 2024-05-20T17:55:19.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a17508280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 0x563a17524fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8423bd7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563a173fb900 con 0x563a1713c390 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8423bd7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563a175282f0 con 0x563a1711b6b0 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8423bd7740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x563a17508980 con 0x563a171134d0 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8423bd7740 10 client.0 _ll_register_callbacks cb 0x563a1740dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175254e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42774/0 (socket says 172.21.15.6:42774) 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8416d9d640 1 -- 172.21.15.6:0/2827185326 learned_addr learned my addr 172.21.15.6:0/2827185326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f841659c640 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a17508280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8415d9b640 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 0x563a17524fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8416d9d640 1 -- 172.21.15.6:0/2827185326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 msgr2=0x563a17508280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8416d9d640 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a17508280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8416d9d640 1 -- 172.21.15.6:0/2827185326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 msgr2=0x563a17524fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8416d9d640 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 0x563a17524fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.309+0000 7f8416d9d640 1 -- 172.21.15.6:0/2827185326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1721c760 con 0x563a1713c390 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8416d9d640 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175254e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f84100050a0 tx=0x7f8410016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a491c8202b8eef3f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f83f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f83f57fa640 1 -- 172.21.15.6:0/2827185326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410060cc0 con 0x563a1713c390 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f83f57fa640 1 -- 172.21.15.6:0/2827185326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f8410077070 con 0x563a1713c390 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 1 -- 172.21.15.6:0/2827185326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84100563e0 con 0x563a1713c390 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f83f57fa640 1 -- 172.21.15.6:0/2827185326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8410057530 con 0x563a1713c390 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 10 client.5646 fetch_fsmap learned FSMap version 18 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 1 -- 172.21.15.6:0/2827185326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x563a17509750 con 0x563a1713c390 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f83f57fa640 1 -- 172.21.15.6:0/2827185326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100563e0 con 0x563a1713c390 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f83f57fa640 1 -- 172.21.15.6:0/2827185326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f84100576d0 con 0x563a1713c390 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 10 client.5646 fetch_fsmap finished waiting for FSMap version 18 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 10 client.5646 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-05-20T17:55:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 20 client.5646 populate_metadata read hostname 'smithi006' 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x563a170faf60 0x563a175276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 4 client.5646 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f8423bd7740 1 -- 172.21.15.6:0/2827185326 --> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a1744dd00 con 0x563a170faf60 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.310+0000 7f841659c640 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x563a170faf60 0x563a175276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.311+0000 7f83f57fa640 10 client.5646 ms_handle_connect on v2:172.21.15.6:6832/3387888972 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.311+0000 7f841659c640 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x563a170faf60 0x563a175276b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6188bd13aa494e6d server_cookie=9e5a7cf7141d3405 in_seq=0 out_seq=0 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.311+0000 7f83f57fa640 1 -- 172.21.15.6:0/2827185326 <== mds.0 v2:172.21.15.6:6832/3387888972 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563a1744dd00 con 0x563a170faf60 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.311+0000 7f83f57fa640 10 client.5646 handle_command_reply: tid=0 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 client.5646 shutdown 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 -- 172.21.15.6:0/2827185326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 msgr2=0x563a175254e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175254e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f84100050a0 tx=0x7f8410016070 comp rx=0 tx=0).stop 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 -- 172.21.15.6:0/2827185326 shutdown_connections 2024-05-20T17:55:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x563a170faf60 0x563a175276b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175254e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 0x563a17524fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 --2- 172.21.15.6:0/2827185326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a17508280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f83f57fa640 0 client.5646 ms_handle_reset on v2:172.21.15.6:6832/3387888972 2024-05-20T17:55:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 -- 172.21.15.6:0/2827185326 >> 172.21.15.6:0/2827185326 conn(0x563a171304e0 msgr2=0x563a17507730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 -- 172.21.15.6:0/2827185326 shutdown_connections 2024-05-20T17:55:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 1 -- 172.21.15.6:0/2827185326 wait complete. 2024-05-20T17:55:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.312+0000 7f8423bd7740 20 client.5646 trim_cache size 0 max 16384 2024-05-20T17:55:19.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.327+0000 7f8423bd7740 1 Processor -- start 2024-05-20T17:55:19.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.327+0000 7f8423bd7740 1 -- start start 2024-05-20T17:55:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a17506b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 0x563a1753a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a1753aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8423bd7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8418202450 con 0x563a1713c390 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8423bd7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f84182014c0 con 0x563a1711b6b0 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8423bd7740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f84181579f0 con 0x563a171134d0 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a1753aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a1753aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42782/0 (socket says 172.21.15.6:42782) 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 -- 172.21.15.6:0/3438651381 learned_addr learned my addr 172.21.15.6:0/3438651381 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 -- 172.21.15.6:0/3438651381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 msgr2=0x563a17506b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 --2- 172.21.15.6:0/3438651381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a17506b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 -- 172.21.15.6:0/3438651381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 msgr2=0x563a1753a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8415d9b640 1 --2- 172.21.15.6:0/3438651381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 0x563a1753a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 --2- 172.21.15.6:0/3438651381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 0x563a1753a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 -- 172.21.15.6:0/3438651381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a17507850 con 0x563a1713c390 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f8416d9d640 1 --2- 172.21.15.6:0/3438651381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a1753aa50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8410057de0 tx=0x7f841006e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389a43d84d502371 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f83f77fe640 1 -- 172.21.15.6:0/3438651381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410057eb0 con 0x563a1713c390 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f83f77fe640 1 -- 172.21.15.6:0/3438651381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8410060cc0 con 0x563a1713c390 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.329+0000 7f83f77fe640 1 -- 172.21.15.6:0/3438651381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841005c0e0 con 0x563a1713c390 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 -- 172.21.15.6:0/3438651381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 msgr2=0x563a1753aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 --2- 172.21.15.6:0/3438651381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a1753aa50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8410057de0 tx=0x7f841006e040 comp rx=0 tx=0).stop 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 -- 172.21.15.6:0/3438651381 shutdown_connections 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 --2- 172.21.15.6:0/3438651381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a1753aa50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 --2- 172.21.15.6:0/3438651381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a1711b6b0 0x563a1753a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 --2- 172.21.15.6:0/3438651381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a171134d0 0x563a17506b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 -- 172.21.15.6:0/3438651381 >> 172.21.15.6:0/3438651381 conn(0x563a171304e0 msgr2=0x563a17525430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 -- 172.21.15.6:0/3438651381 shutdown_connections 2024-05-20T17:55:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.330+0000 7f8423bd7740 1 -- 172.21.15.6:0/3438651381 wait complete. 2024-05-20T17:55:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.331+0000 7f8423bd7740 1 -- start start 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.331+0000 7f8423bd7740 1 Processor -- start 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a171134d0 0x563a1759d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a1711b6b0 0x563a175181c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8423bd7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175251a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8423bd7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x563a175003e0 con 0x563a1713c390 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8423bd7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8418158040 con 0x563a171134d0 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8423bd7740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x563a1759f070 con 0x563a1711b6b0 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8423bd7740 10 client.0 _ll_register_callbacks cb 0x7f8410057cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175251a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42794/0 (socket says 172.21.15.6:42794) 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 -- 172.21.15.6:0/837701149 learned_addr learned my addr 172.21.15.6:0/837701149 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f841659c640 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a171134d0 0x563a1759d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8415d9b640 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a1711b6b0 0x563a175181c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 -- 172.21.15.6:0/837701149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a1711b6b0 msgr2=0x563a175181c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a1711b6b0 0x563a175181c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 -- 172.21.15.6:0/837701149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a171134d0 msgr2=0x563a1759d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a171134d0 0x563a1759d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 -- 172.21.15.6:0/837701149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a174d6f60 con 0x563a1713c390 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8416d9d640 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175251a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8410058130 tx=0x7f8410054400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c9ffb976422ad9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f83f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f83f57fa640 1 -- 172.21.15.6:0/837701149 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410053e30 con 0x563a1713c390 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f83f57fa640 1 -- 172.21.15.6:0/837701149 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f8410078d60 con 0x563a1713c390 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.333+0000 7f8423bd7740 1 -- 172.21.15.6:0/837701149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8410060cc0 con 0x563a1713c390 2024-05-20T17:55:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f83f57fa640 1 -- 172.21.15.6:0/837701149 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8410053fd0 con 0x563a1713c390 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f8423bd7740 10 client.5652 fetch_fsmap learned FSMap version 18 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f8423bd7740 1 -- 172.21.15.6:0/837701149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x563a174d6f60 con 0x563a1713c390 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f83f57fa640 1 -- 172.21.15.6:0/837701149 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8410060cc0 con 0x563a1713c390 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f83f57fa640 1 -- 172.21.15.6:0/837701149 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f8410056fa0 con 0x563a1713c390 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f8423bd7740 10 client.5652 fetch_fsmap finished waiting for FSMap version 18 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f8423bd7740 10 client.5652 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f8423bd7740 20 client.5652 populate_metadata read hostname 'smithi006' 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f8423bd7740 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x563a175256e0 0x563a17520fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f8423bd7740 4 client.5652 mds_command: new command op to 5394 tid=0 multi_id=0 [{"prefix": "dump_historic_ops"}] 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f8423bd7740 1 -- 172.21.15.6:0/837701149 --> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] -- command(tid 0: {"prefix": "dump_historic_ops"}) -- 0x563a17448050 con 0x563a175256e0 2024-05-20T17:55:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f841659c640 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x563a175256e0 0x563a17520fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f83f57fa640 10 client.5652 ms_handle_connect on v2:172.21.15.6:6832/3387888972 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.334+0000 7f841659c640 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x563a175256e0 0x563a17520fc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f92aa03ada52d server_cookie=75c0adb1a295cad6 in_seq=0 out_seq=0 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f83f57fa640 1 -- 172.21.15.6:0/837701149 <== mds.0 v2:172.21.15.6:6832/3387888972 1 ==== command_reply(tid 0: 0 ) ==== 8+0+71568 (crc 0 0 0) 0x563a17448050 con 0x563a175256e0 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f83f57fa640 10 client.5652 handle_command_reply: tid=0 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 client.5652 shutdown 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 -- 172.21.15.6:0/837701149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 msgr2=0x563a175251a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175251a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8410058130 tx=0x7f8410054400 comp rx=0 tx=0).stop 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 -- 172.21.15.6:0/837701149 shutdown_connections 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.6:6832/3387888972,v1:172.21.15.6:6834/3387888972] conn(0x563a175256e0 0x563a17520fc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a1713c390 0x563a175251a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x563a1711b6b0 0x563a175181c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 --2- 172.21.15.6:0/837701149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a171134d0 0x563a1759d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f83f57fa640 0 client.5652 ms_handle_reset on v2:172.21.15.6:6832/3387888972 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 -- 172.21.15.6:0/837701149 >> 172.21.15.6:0/837701149 conn(0x563a171304e0 msgr2=0x563a17506e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 -- 172.21.15.6:0/837701149 shutdown_connections 2024-05-20T17:55:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 1 -- 172.21.15.6:0/837701149 wait complete. 2024-05-20T17:55:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.336+0000 7f8423bd7740 20 client.5652 trim_cache size 0 max 16384 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:2 setattr mode=041777 #0x1 2024-05-20T17:54:35.816172+0000 caller_uid=0, caller_gid=0{0,})", 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:35.816536+0000", 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 43.519789555000003, 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.74652945900000001, 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 2 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:35.816536+0000", 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:35.816536+0000", 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:35.816538+0000", 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:35.816550+0000", 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:35.816587+0000", 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:35.816743+0000", 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:35.816814+0000", 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:35.816815+0000", 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:36.562916+0000", 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:36.562956+0000", 2024-05-20T17:55:19.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:36.563047+0000", 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:36.563065+0000", 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:36.563066+0000", 2024-05-20T17:55:19.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:27 create owner_uid=1000, owner_gid=1316 #0x10000000000/file_0 2024-05-20T17:54:37.892148+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:37.893184+0000", 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.443142111, 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0062637450000000003, 2024-05-20T17:55:19.347 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 27 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.893184+0000", 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.893184+0000", 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.893184+0000", 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.893189+0000", 2024-05-20T17:55:19.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.893212+0000", 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.893409+0000", 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.893699+0000", 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.893700+0000", 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.899112+0000", 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.899259+0000", 2024-05-20T17:55:19.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.899359+0000", 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.899446+0000", 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.899447+0000", 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:32 create owner_uid=1000, owner_gid=1316 #0x10000000000/file_5 2024-05-20T17:54:37.917147+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:37.917376+0000", 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.418949738999999, 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0065909330000000002, 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.353 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.354 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.354 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 32 2024-05-20T17:55:19.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.354 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.357 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.917376+0000", 2024-05-20T17:55:19.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.917376+0000", 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.917377+0000", 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.917383+0000", 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.917403+0000", 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.917774+0000", 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.918104+0000", 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.918105+0000", 2024-05-20T17:55:19.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923605+0000", 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923748+0000", 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923861+0000", 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923965+0000", 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923967+0000", 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:33 create owner_uid=1000, owner_gid=1316 #0x10000000000/file_6 2024-05-20T17:54:37.923147+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:37.923974+0000", 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.412352155000001, 2024-05-20T17:55:19.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060495439999999996, 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 33 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.362 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923974+0000", 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923974+0000", 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923974+0000", 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.923981+0000", 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.924002+0000", 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.924365+0000", 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.924691+0000", 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.924692+0000", 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.929651+0000", 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.929797+0000", 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.929908+0000", 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930021+0000", 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930023+0000", 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:34 create owner_uid=1000, owner_gid=1316 #0x10000000000/file_7 2024-05-20T17:54:37.929147+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:37.930018+0000", 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.406307388000002, 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0078172139999999994, 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 34 2024-05-20T17:55:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930018+0000", 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930018+0000", 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930019+0000", 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930026+0000", 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930047+0000", 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930415+0000", 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930735+0000", 2024-05-20T17:55:19.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.930736+0000", 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.937461+0000", 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.937599+0000", 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.937716+0000", 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.937832+0000", 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.937836+0000", 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:46 create owner_uid=1000, owner_gid=1316 #0x10000000000/file_19 2024-05-20T17:54:37.989147+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:37.989573+0000", 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.346752322, 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054972969999999999, 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 46 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.989573+0000", 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.989573+0000", 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.989574+0000", 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.989581+0000", 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.989604+0000", 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.990117+0000", 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.990707+0000", 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.990708+0000", 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.994711+0000", 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.994859+0000", 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.994969+0000", 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.995069+0000", 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:37.995071+0000", 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:54 mkdir owner_uid=1000, owner_gid=1316 #0x1/dir2 2024-05-20T17:54:38.199144+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.378 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.199410+0000", 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.136915438999999, 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055752969999999999, 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.379 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.199410+0000", 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.199410+0000", 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.199411+0000", 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.199416+0000", 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.199432+0000", 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.199643+0000", 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "failed to wrlock, waiting" 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.200035+0000", 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.200331+0000", 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.200331+0000", 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.204769+0000", 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.204875+0000", 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.204952+0000", 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.204985+0000", 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.204986+0000", 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.384 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:63 create owner_uid=1000, owner_gid=1316 #0x1000000020e/file_8 2024-05-20T17:54:38.236144+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.236815+0000", 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.099510748, 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0079412460000000008, 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.385 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 63 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.236815+0000", 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.236815+0000", 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.236816+0000", 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.236820+0000", 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.236844+0000", 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.237296+0000", 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.237881+0000", 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.237882+0000", 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.244395+0000", 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.244577+0000", 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.244665+0000", 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.244755+0000", 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.244756+0000", 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:74 create owner_uid=1000, owner_gid=1316 #0x1000000020e/file_19 2024-05-20T17:54:38.293143+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.294104+0000", 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.042221757, 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055552010000000001, 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.390 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 74 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.294104+0000", 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.294104+0000", 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.294105+0000", 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.294109+0000", 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.294135+0000", 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.294601+0000", 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.295195+0000", 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.295196+0000", 2024-05-20T17:55:19.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299336+0000", 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299474+0000", 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299566+0000", 2024-05-20T17:55:19.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299658+0000", 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299659+0000", 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:75 create owner_uid=1000, owner_gid=1316 #0x1000000020e/file_20 2024-05-20T17:54:38.299143+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.299673+0000", 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.036652314999998, 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055845979999999996, 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 75 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299673+0000", 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299673+0000", 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299674+0000", 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299678+0000", 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.299706+0000", 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.300157+0000", 2024-05-20T17:55:19.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.300751+0000", 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.300752+0000", 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.304944+0000", 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305083+0000", 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305169+0000", 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305257+0000", 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305258+0000", 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.400 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:76 create owner_uid=1000, owner_gid=1316 #0x1000000020e/file_21 2024-05-20T17:54:38.304143+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.305285+0000", 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.031041068, 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054852640000000001, 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.401 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 76 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305285+0000", 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305285+0000", 2024-05-20T17:55:19.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305285+0000", 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305290+0000", 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305313+0000", 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.305771+0000", 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.306366+0000", 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.306367+0000", 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310454+0000", 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310593+0000", 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310681+0000", 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310769+0000", 2024-05-20T17:55:19.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310770+0000", 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:77 create owner_uid=1000, owner_gid=1316 #0x1000000020e/file_22 2024-05-20T17:54:38.310143+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.310791+0000", 2024-05-20T17:55:19.406 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.025534501000003, 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055793270000000002, 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 77 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.407 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310791+0000", 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310791+0000", 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310792+0000", 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310796+0000", 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.310821+0000", 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.311262+0000", 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.311854+0000", 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.311855+0000", 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.316050+0000", 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.316187+0000", 2024-05-20T17:55:19.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.316276+0000", 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.316369+0000", 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.316371+0000", 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.411 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:79 create owner_uid=1000, owner_gid=1316 #0x1000000020e/file_24 2024-05-20T17:54:38.321143+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.321473+0000", 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.014852900000001, 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054847419999999999, 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 79 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.321473+0000", 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.321473+0000", 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.321473+0000", 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.321478+0000", 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.321501+0000", 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.321943+0000", 2024-05-20T17:55:19.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.322541+0000", 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.322542+0000", 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.326637+0000", 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.326781+0000", 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.326870+0000", 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.326956+0000", 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.326958+0000", 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:82 mkdir owner_uid=1000, owner_gid=1316 #0x1/dir3 2024-05-20T17:54:38.507141+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.507763+0000", 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 40.828562873000003, 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055155320000000001, 2024-05-20T17:55:19.417 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 82 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.418 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.507763+0000", 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.507763+0000", 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.507763+0000", 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.507767+0000", 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.507783+0000", 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.508008+0000", 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "failed to wrlock, waiting" 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.508438+0000", 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.508728+0000", 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.508729+0000", 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.513042+0000", 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.513161+0000", 2024-05-20T17:55:19.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.513243+0000", 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.513278+0000", 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.513278+0000", 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.422 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:87 create owner_uid=1000, owner_gid=1316 #0x10000000228/file_4 2024-05-20T17:54:38.526140+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.527112+0000", 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 40.809213700999997, 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0057770440000000003, 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 87 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.527112+0000", 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.527112+0000", 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.527113+0000", 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.527117+0000", 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.527156+0000", 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.527440+0000", 2024-05-20T17:55:19.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.527788+0000", 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.527788+0000", 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.532345+0000", 2024-05-20T17:55:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.532560+0000", 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.532711+0000", 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.532887+0000", 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.532889+0000", 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:99 create owner_uid=1000, owner_gid=1316 #0x10000000228/file_16 2024-05-20T17:54:38.580140+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.580695+0000", 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 40.755630279999998, 2024-05-20T17:55:19.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010175236000000001, 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 99 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.429 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.580695+0000", 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.580695+0000", 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.580696+0000", 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.580700+0000", 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.580724+0000", 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.580995+0000", 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.581340+0000", 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.581340+0000", 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.590309+0000", 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.590535+0000", 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.590690+0000", 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.590864+0000", 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.590871+0000", 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.433 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:110 mkdir owner_uid=1000, owner_gid=1316 #0x1/dir4 2024-05-20T17:54:38.808137+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.809142+0000", 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 40.527183839000003, 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0059883799999999997, 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 110 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.809142+0000", 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.809142+0000", 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.809142+0000", 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.809147+0000", 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.809170+0000", 2024-05-20T17:55:19.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.809410+0000", 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "failed to wrlock, waiting" 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.809880+0000", 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.810173+0000", 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.810174+0000", 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.814749+0000", 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.814924+0000", 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.815066+0000", 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.815128+0000", 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.815130+0000", 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:128 create owner_uid=1000, owner_gid=1316 #0x10000000242/file_17 2024-05-20T17:54:38.884136+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:38.884809+0000", 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 40.451516452999996, 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0056396179999999999, 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.440 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 128 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.884809+0000", 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.884809+0000", 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.884810+0000", 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.884814+0000", 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.884838+0000", 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.885136+0000", 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.885494+0000", 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "early_replied" 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.885494+0000", 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "submit entry: journal_and_reply" 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.890112+0000", 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "journal_committed: " 2024-05-20T17:55:19.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.890250+0000", 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.890345+0000", 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.890447+0000", 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:38.890449+0000", 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:143 readdir #0x10000000242 2024-05-20T17:54:39.140133+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:39.140839+0000", 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 40.195486830999997, 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 16.506603558999998, 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.445 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 143 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:39.140839+0000", 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:39.140839+0000", 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:39.140839+0000", 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:39.140844+0000", 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:39.140859+0000", 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:39.140940+0000", 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:39.641132+0000", 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:40.141299+0000", 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:40.641470+0000", 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:41.141657+0000", 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:41.641822+0000", 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:42.141997+0000", 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:42.642186+0000", 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:43.142376+0000", 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:43.642544+0000", 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:44.142665+0000", 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:44.642864+0000", 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:45.143063+0000", 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:45.643206+0000", 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:46.143373+0000", 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:46.643565+0000", 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:47.143763+0000", 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:47.643956+0000", 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:48.144172+0000", 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:48.644375+0000", 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:49.144479+0000", 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:49.644622+0000", 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:50.144746+0000", 2024-05-20T17:55:19.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:50.644920+0000", 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:51.145081+0000", 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:51.645224+0000", 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:52.145394+0000", 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:52.645577+0000", 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:53.145732+0000", 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:53.645856+0000", 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:54.146038+0000", 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:54.646229+0000", 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.146430+0000", 2024-05-20T17:55:19.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.646732+0000", 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647233+0000", 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647297+0000", 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647439+0000", 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647442+0000", 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.459 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "client_request(client.5078:144 readdir #0x10000000228 2024-05-20T17:54:55.646943+0000 caller_uid=1000, caller_gid=1316{6,36,1000,1316,})", 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-05-20T17:54:55.647623+0000", 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.688702855999999, 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 22.508963262999998, 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "result": 0, 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "done", 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "reqid": { 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": { 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 5078 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 144 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.460 INFO:teuthology.orchestra.run.smithi006.stdout: "op_type": "client_request", 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647623+0000", 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated" 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647623+0000", 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read" 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647623+0000", 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled" 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647628+0000", 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read" 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647724+0000", 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched" 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:55.647844+0000", 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:56.148040+0000", 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:56.648234+0000", 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:57.148412+0000", 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:57.648555+0000", 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:58.148707+0000", 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:58.648887+0000", 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:59.149093+0000", 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:54:59.649245+0000", 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:00.149438+0000", 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:00.649582+0000", 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:01.149763+0000", 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:01.649917+0000", 2024-05-20T17:55:19.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:02.150053+0000", 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:02.650222+0000", 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:03.150402+0000", 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:03.650574+0000", 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:04.150748+0000", 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:04.650931+0000", 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:05.151099+0000", 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:05.651313+0000", 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:06.151530+0000", 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:06.651648+0000", 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:07.151807+0000", 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:07.651999+0000", 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:08.152166+0000", 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:08.652321+0000", 2024-05-20T17:55:19.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:09.152514+0000", 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:09.652694+0000", 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:10.152868+0000", 2024-05-20T17:55:19.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:10.653043+0000", 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:11.153198+0000", 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:11.653386+0000", 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:12.153577+0000", 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:12.653755+0000", 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:13.153953+0000", 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:13.654151+0000", 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:14.154359+0000", 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:14.654558+0000", 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:15.154743+0000", 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:15.654939+0000", 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:16.155081+0000", 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:16.655276+0000", 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:17.155479+0000", 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:17.655624+0000", 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cap_acquisition_throttle" 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:18.155891+0000", 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "acquired locks" 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:18.156399+0000", 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "replying" 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:18.156455+0000", 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "finishing request" 2024-05-20T17:55:19.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:18.156584+0000", 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "cleaned up request" 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-05-20T17:55:18.156586+0000", 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done" 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: "locks": null 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:55:19.476 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:55:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 -- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83f806be30 msgr2=0x7f83f806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83f806be30 0x7f83f806e340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f84180c86a0 tx=0x7f840800b040 comp rx=0 tx=0).stop 2024-05-20T17:55:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 -- 172.21.15.6:0/734240973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841814ac90 msgr2=0x7f841814b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841814ac90 0x7f841814b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f841806e790 tx=0x7f841000e820 comp rx=0 tx=0).stop 2024-05-20T17:55:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 -- 172.21.15.6:0/734240973 shutdown_connections 2024-05-20T17:55:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83f806be30 0x7f83f806e340 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f841814ac90 0x7f841814b0a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84181f8b90 0x7f841814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 --2- 172.21.15.6:0/734240973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8400004800 0x7f84181f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 -- 172.21.15.6:0/734240973 >> 172.21.15.6:0/734240973 conn(0x7f84180d4e20 msgr2=0x7f84180c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 -- 172.21.15.6:0/734240973 shutdown_connections 2024-05-20T17:55:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.337+0000 7f841cc5f640 1 -- 172.21.15.6:0/734240973 wait complete. 2024-05-20T17:55:19.480 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:55:19.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:55:19.532 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:55:19.585 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:55:19.585 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:55:19.585 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:19.585 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:19.601 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:19.602 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:19.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.813+0000 7fad3edaa640 1 Processor -- start 2024-05-20T17:55:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.813+0000 7fad3edaa640 1 -- start start 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad3edaa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad380d1740 0x7fad3815d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad3edaa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3806b520 con 0x7fad380b25d0 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad3edaa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad380b2b20 con 0x7fad38074bc0 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad3edaa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad3806b7c0 con 0x7fad380d1740 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad3d347640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fad380b25d0 0x7fad3806c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46282/0 (socket says 172.21.15.6:46282) 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad3d347640 1 -- 172.21.15.6:0/1286978610 learned_addr learned my addr 172.21.15.6:0/1286978610 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad37fff640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad380d1740 0x7fad3815d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975273348 0 0) 0x7fad3806b520 con 0x7fad380b25d0 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad20003520 con 0x7fad380b25d0 2024-05-20T17:55:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842924179 0 0) 0x7fad380b2b20 con 0x7fad38074bc0 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad3806b520 con 0x7fad38074bc0 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 553918108 0 0) 0x7fad20003520 con 0x7fad380b25d0 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad380d1740 msgr2=0x7fad3815d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad380d1740 0x7fad3815d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 >> v1:172.21.15.171:6789/0 conn(0x7fad38074bc0 legacy=0x7fad380d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3806baa0 con 0x7fad380b25d0 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fad300019f0 con 0x7fad380b25d0 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.815+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 >> v1:172.21.15.6:6789/0 conn(0x7fad380b25d0 legacy=0x7fad3806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad377fe640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20003b70 0x7fad20003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad377fe640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad20004800 0x7fad20004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad377fe640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad20005150 0x7fad2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fad3806b7c0 con 0x7fad20004800 2024-05-20T17:55:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad2000bf30 con 0x7fad20005150 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad2000c130 con 0x7fad20003b70 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad37fff640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad20004800 0x7fad20004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad3cb46640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20003b70 0x7fad20003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad3d347640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad20005150 0x7fad2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad37fff640 1 -- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20003b70 msgr2=0x7fad20003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad37fff640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20003b70 0x7fad20003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad37fff640 1 -- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad20005150 msgr2=0x7fad2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad37fff640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad20005150 0x7fad2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.816+0000 7fad37fff640 1 -- 172.21.15.6:0/1286978610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad20003520 con 0x7fad20004800 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.817+0000 7fad37fff640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad20004800 0x7fad20004c10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009ac0 tx=0x7fad20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7288568cdfb52b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.817+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c036070 con 0x7fad20004800 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.817+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c031400 con 0x7fad20004800 2024-05-20T17:55:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.817+0000 7fad377fe640 1 -- 172.21.15.6:0/1286978610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c009690 con 0x7fad20004800 2024-05-20T17:55:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.817+0000 7fad3edaa640 1 -- 172.21.15.6:0/1286978610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad20004800 msgr2=0x7fad20004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.817+0000 7fad3edaa640 1 --2- 172.21.15.6:0/1286978610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad20004800 0x7fad20004c10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009ac0 tx=0x7fad20005830 comp rx=0 tx=0).stop 2024-05-20T17:55:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.817+0000 7fad3d347640 1 -- 172.21.15.6:0/1286978610 reap_dead start 2024-05-20T17:55:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.818+0000 7fad3edaa640 1 -- 172.21.15.6:0/1286978610 shutdown_connections 2024-05-20T17:55:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.818+0000 7fad3edaa640 1 -- 172.21.15.6:0/1286978610 >> 172.21.15.6:0/1286978610 conn(0x7fad38072ed0 msgr2=0x7fad380b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.818+0000 7fad3edaa640 1 -- 172.21.15.6:0/1286978610 shutdown_connections 2024-05-20T17:55:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.818+0000 7fad3edaa640 1 -- 172.21.15.6:0/1286978610 wait complete. 2024-05-20T17:55:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.819+0000 7fad3edaa640 1 Processor -- start 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.819+0000 7fad3edaa640 1 -- start start 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad3edaa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20004800 0x7fad3809da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad3edaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38154af0 0x7fad38154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad3edaa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad38155440 0x7fad381f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad3edaa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fad380d18c0 con 0x7fad38154af0 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad3edaa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad380d1740 con 0x7fad38155440 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad3edaa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fad380b0bd0 con 0x7fad20004800 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad37fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38154af0 0x7fad38154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad37fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38154af0 0x7fad38154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42806/0 (socket says 172.21.15.6:42806) 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad37fff640 1 -- 172.21.15.6:0/2148235378 learned_addr learned my addr 172.21.15.6:0/2148235378 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad3d347640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad38155440 0x7fad381f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad3cb46640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20004800 0x7fad3809da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad37fff640 1 -- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20004800 msgr2=0x7fad3809da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad37fff640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20004800 0x7fad3809da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad37fff640 1 -- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad38155440 msgr2=0x7fad381f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad37fff640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad38155440 0x7fad381f2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.821+0000 7fad37fff640 1 -- 172.21.15.6:0/2148235378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad381f3bf0 con 0x7fad38154af0 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.822+0000 7fad37fff640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38154af0 0x7fad38154f00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009ac0 tx=0x7fad2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.822+0000 7fad357fa640 1 -- 172.21.15.6:0/2148235378 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c040020 con 0x7fad38154af0 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.822+0000 7fad357fa640 1 -- 172.21.15.6:0/2148235378 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c003a40 con 0x7fad38154af0 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.822+0000 7fad357fa640 1 -- 172.21.15.6:0/2148235378 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c036040 con 0x7fad38154af0 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.822+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3809dfa0 con 0x7fad38154af0 2024-05-20T17:55:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.822+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3809e770 con 0x7fad38154af0 2024-05-20T17:55:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.823+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3809e200 con 0x7fad38154af0 2024-05-20T17:55:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.824+0000 7fad357fa640 1 -- 172.21.15.6:0/2148235378 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad2c043020 con 0x7fad38154af0 2024-05-20T17:55:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.824+0000 7fad357fa640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fad2406be60 0x7fad2406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.824+0000 7fad357fa640 1 -- 172.21.15.6:0/2148235378 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fad2c0aae70 con 0x7fad38154af0 2024-05-20T17:55:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.824+0000 7fad3cb46640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fad2406be60 0x7fad2406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.825+0000 7fad3cb46640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fad2406be60 0x7fad2406e370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fad280018d0 tx=0x7fad28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:19.829+0000 7fad357fa640 1 -- 172.21.15.6:0/2148235378 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fad2c04a070 con 0x7fad38154af0 2024-05-20T17:55:20.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.016+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad38075b00 con 0x7fad38154af0 2024-05-20T17:55:20.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.017+0000 7fad357fa640 1 -- 172.21.15.6:0/2148235378 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16886 (secure 0 0 0) 0x7fad2c078f90 con 0x7fad38154af0 2024-05-20T17:55:20.017 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:20.017 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:47.860427+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:54:21.604657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-20T17:54:22.794409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fad2406be60 msgr2=0x7fad2406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fad2406be60 0x7fad2406e370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fad280018d0 tx=0x7fad28009040 comp rx=0 tx=0).stop 2024-05-20T17:55:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38154af0 msgr2=0x7fad38154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38154af0 0x7fad38154f00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009ac0 tx=0x7fad2c004730 comp rx=0 tx=0).stop 2024-05-20T17:55:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 shutdown_connections 2024-05-20T17:55:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fad2406be60 0x7fad2406e370 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad38155440 0x7fad381f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38154af0 0x7fad38154f00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 --2- 172.21.15.6:0/2148235378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad20004800 0x7fad3809da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 >> 172.21.15.6:0/2148235378 conn(0x7fad38072ed0 msgr2=0x7fad3806f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 shutdown_connections 2024-05-20T17:55:20.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.020+0000 7fad3edaa640 1 -- 172.21.15.6:0/2148235378 wait complete. 2024-05-20T17:55:20.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:54:21.604657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:54:22.794409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:55:20.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:55:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.149+0000 7f7a71b38640 1 Processor -- start 2024-05-20T17:55:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.149+0000 7f7a71b38640 1 -- start start 2024-05-20T17:55:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a71b38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6c15f220 0x7f7a6c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a71b38640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6c0cfd20 con 0x7f7a6c0cd680 2024-05-20T17:55:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a71b38640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6c06d0f0 con 0x7f7a6c0cf910 2024-05-20T17:55:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a71b38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6c0cda90 con 0x7f7a6c15f220 2024-05-20T17:55:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a6b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7a6c0cd680 0x7f7a6c06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46296/0 (socket says 172.21.15.6:46296) 2024-05-20T17:55:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a6b7fe640 1 -- 172.21.15.6:0/3650156683 learned_addr learned my addr 172.21.15.6:0/3650156683 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935847050 0 0) 0x7f7a5c001110 con 0x7f7a6c0cd680 2024-05-20T17:55:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a54003520 con 0x7f7a6c0cd680 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a6affd640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6c15f220 0x7f7a6c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.151+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2190412121 0 0) 0x7f7a54003520 con 0x7f7a6c0cd680 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6c15f220 msgr2=0x7f7a6c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6c15f220 0x7f7a6c0cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 >> v1:172.21.15.171:6789/0 conn(0x7f7a6c0cf910 legacy=0x7f7a6c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c06d3d0 con 0x7f7a6c0cd680 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f7a5c001840 con 0x7f7a6c0cd680 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 >> v1:172.21.15.6:6789/0 conn(0x7f7a6c0cd680 legacy=0x7f7a6c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a540039e0 0x7f7a54003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6c15f220 0x7f7a54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a54004d40 0x7f7a54005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5400bb80 con 0x7f7a540039e0 2024-05-20T17:55:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5400bd30 con 0x7f7a54004d40 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5400bf30 con 0x7f7a6c15f220 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6b7fe640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a540039e0 0x7f7a54003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6bfff640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a54004d40 0x7f7a54005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6affd640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6c15f220 0x7f7a54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6b7fe640 1 -- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6c15f220 msgr2=0x7f7a54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6b7fe640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a6c15f220 0x7f7a54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6b7fe640 1 -- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a54004d40 msgr2=0x7f7a54005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6b7fe640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a54004d40 0x7f7a54005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.152+0000 7f7a6b7fe640 1 -- 172.21.15.6:0/3650156683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a54003520 con 0x7f7a540039e0 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.153+0000 7f7a6b7fe640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a540039e0 0x7f7a54003e50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c490 tx=0x7f7a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc89f1e616acb54f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.153+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00c0e0 con 0x7f7a540039e0 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.153+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c034070 con 0x7f7a540039e0 2024-05-20T17:55:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.153+0000 7f7a6a7fc640 1 -- 172.21.15.6:0/3650156683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c005d30 con 0x7f7a540039e0 2024-05-20T17:55:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.154+0000 7f7a71b38640 1 -- 172.21.15.6:0/3650156683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a540039e0 msgr2=0x7f7a54003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.154+0000 7f7a71b38640 1 --2- 172.21.15.6:0/3650156683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a540039e0 0x7f7a54003e50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00c490 tx=0x7f7a54005830 comp rx=0 tx=0).stop 2024-05-20T17:55:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.154+0000 7f7a6bfff640 1 -- 172.21.15.6:0/3650156683 reap_dead start 2024-05-20T17:55:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.154+0000 7f7a71b38640 1 -- 172.21.15.6:0/3650156683 shutdown_connections 2024-05-20T17:55:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.154+0000 7f7a71b38640 1 -- 172.21.15.6:0/3650156683 >> 172.21.15.6:0/3650156683 conn(0x7f7a6c0b44d0 msgr2=0x7f7a6c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.154+0000 7f7a71b38640 1 -- 172.21.15.6:0/3650156683 shutdown_connections 2024-05-20T17:55:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.154+0000 7f7a71b38640 1 -- 172.21.15.6:0/3650156683 wait complete. 2024-05-20T17:55:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.156+0000 7f7a71b38640 1 Processor -- start 2024-05-20T17:55:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.156+0000 7f7a71b38640 1 -- start start 2024-05-20T17:55:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a71b38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a540039e0 0x7f7a6c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a71b38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a6c0cafa0 0x7f7a6c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a71b38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6c0d2910 0x7f7a6c0d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a71b38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c06d990 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a71b38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c0d0b40 con 0x7f7a6c0d2910 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a71b38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6c06cdd0 con 0x7f7a540039e0 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a6affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a6c0cafa0 0x7f7a6c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a6affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a6c0cafa0 0x7f7a6c0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42822/0 (socket says 172.21.15.6:42822) 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a6affd640 1 -- 172.21.15.6:0/3217247217 learned_addr learned my addr 172.21.15.6:0/3217247217 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.157+0000 7f7a6b7fe640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a540039e0 0x7f7a6c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a6bfff640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6c0d2910 0x7f7a6c0d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a6affd640 1 -- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a540039e0 msgr2=0x7f7a6c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a6affd640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a540039e0 0x7f7a6c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a6affd640 1 -- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6c0d2910 msgr2=0x7f7a6c0d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a6affd640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6c0d2910 0x7f7a6c0d2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a6affd640 1 -- 172.21.15.6:0/3217247217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c0d3260 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a6b7fe640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a540039e0 0x7f7a6c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a6affd640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a6c0cafa0 0x7f7a6c0c8d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7a600119d0 tx=0x7f7a60011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a53fff640 1 -- 172.21.15.6:0/3217247217 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6000fb50 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a53fff640 1 -- 172.21.15.6:0/3217247217 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6000fcf0 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c0c9f00 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a53fff640 1 -- 172.21.15.6:0/3217247217 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6000fea0 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.158+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c0ca4c0 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.159+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6c075b00 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.160+0000 7f7a53fff640 1 -- 172.21.15.6:0/3217247217 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a60012040 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.160+0000 7f7a53fff640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.161+0000 7f7a53fff640 1 -- 172.21.15.6:0/3217247217 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f7a6008b720 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.161+0000 7f7a6b7fe640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.161+0000 7f7a6b7fe640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c033000 tx=0x7f7a5c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.165+0000 7f7a53fff640 1 -- 172.21.15.6:0/3217247217 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7a6c0d3260 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.348+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7a6c0b8940 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.349+0000 7f7a53fff640 1 -- 172.21.15.6:0/3217247217 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f7a60019030 con 0x7f7a6c0cafa0 2024-05-20T17:55:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:55:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 msgr2=0x7f7a5806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c033000 tx=0x7f7a5c009030 comp rx=0 tx=0).stop 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a6c0cafa0 msgr2=0x7f7a6c0c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a6c0cafa0 0x7f7a6c0c8d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7a600119d0 tx=0x7f7a60011e90 comp rx=0 tx=0).stop 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 shutdown_connections 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a6c0d2910 0x7f7a6c0d2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a6c0cafa0 0x7f7a6c0c8d40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 --2- 172.21.15.6:0/3217247217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a540039e0 0x7f7a6c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 >> 172.21.15.6:0/3217247217 conn(0x7f7a6c0b44d0 msgr2=0x7f7a6c0b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 shutdown_connections 2024-05-20T17:55:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.351+0000 7f7a71b38640 1 -- 172.21.15.6:0/3217247217 wait complete. 2024-05-20T17:55:20.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:55:20.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.482+0000 7f1771338640 1 Processor -- start 2024-05-20T17:55:20.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.482+0000 7f1771338640 1 -- start start 2024-05-20T17:55:20.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f1771338640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f176c162820 0x7f176c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f1771338640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f176c06dae0 0x7f176c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f1771338640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176c0d0630 con 0x7f176c0b3e80 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f1771338640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f176c0d39c0 con 0x7f176c162820 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f1771338640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f176c0d3ca0 con 0x7f176c06dae0 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f176c162820 0x7f176c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f176c162820 0x7f176c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42832/0 (socket says 172.21.15.6:42832) 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176affd640 1 -- 172.21.15.6:0/364904647 learned_addr learned my addr 172.21.15.6:0/364904647 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176b7fe640 1 --2- 172.21.15.6:0/364904647 >> v2:172.21.15.171:3300/0 conn(0x7f176c06dae0 0x7f176c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176affd640 1 -- 172.21.15.6:0/364904647 >> v2:172.21.15.171:3300/0 conn(0x7f176c06dae0 msgr2=0x7f176c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176affd640 1 --2- 172.21.15.6:0/364904647 >> v2:172.21.15.171:3300/0 conn(0x7f176c06dae0 0x7f176c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176affd640 1 -- 172.21.15.6:0/364904647 >> v1:172.21.15.171:6789/0 conn(0x7f176c0b3e80 legacy=0x7f176c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176affd640 1 -- 172.21.15.6:0/364904647 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c0d3f80 con 0x7f176c162820 2024-05-20T17:55:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.484+0000 7f176b7fe640 1 --2- 172.21.15.6:0/364904647 >> v2:172.21.15.171:3300/0 conn(0x7f176c06dae0 0x7f176c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:20.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.485+0000 7f176affd640 1 --2- 172.21.15.6:0/364904647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c162820 0x7f176c0b3940 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f176c08e070 tx=0x7f176402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad28d8fbf516f0b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.485+0000 7f1769ffb640 1 -- 172.21.15.6:0/364904647 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764037070 con 0x7f176c162820 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.485+0000 7f1769ffb640 1 -- 172.21.15.6:0/364904647 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1764032440 con 0x7f176c162820 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.485+0000 7f1769ffb640 1 -- 172.21.15.6:0/364904647 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764032810 con 0x7f176c162820 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.486+0000 7f1771338640 1 -- 172.21.15.6:0/364904647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c162820 msgr2=0x7f176c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.486+0000 7f1771338640 1 --2- 172.21.15.6:0/364904647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c162820 0x7f176c0b3940 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f176c08e070 tx=0x7f176402a230 comp rx=0 tx=0).stop 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.486+0000 7f1771338640 1 -- 172.21.15.6:0/364904647 shutdown_connections 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.486+0000 7f1771338640 1 --2- 172.21.15.6:0/364904647 >> v2:172.21.15.171:3300/0 conn(0x7f176c06dae0 0x7f176c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.486+0000 7f1771338640 1 --2- 172.21.15.6:0/364904647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c162820 0x7f176c0b3940 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.486+0000 7f1771338640 1 -- 172.21.15.6:0/364904647 >> 172.21.15.6:0/364904647 conn(0x7f176c0d4bd0 msgr2=0x7f176c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.486+0000 7f1771338640 1 -- 172.21.15.6:0/364904647 shutdown_connections 2024-05-20T17:55:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.486+0000 7f1771338640 1 -- 172.21.15.6:0/364904647 wait complete. 2024-05-20T17:55:20.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.488+0000 7f1771338640 1 Processor -- start 2024-05-20T17:55:20.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.488+0000 7f1771338640 1 -- start start 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f1771338640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c0b3e80 0x7f176c1f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f1771338640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f176c162820 0x7f176c0ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f1771338640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f176c0b6f10 0x7f176c0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f1771338640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f176c0d4780 con 0x7f176c0b3e80 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f1771338640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f176c0d0300 con 0x7f176c0b6f10 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f1771338640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f176c0d4900 con 0x7f176c162820 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f176affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c0b3e80 0x7f176c1f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f176affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c0b3e80 0x7f176c1f9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42840/0 (socket says 172.21.15.6:42840) 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.489+0000 7f176affd640 1 -- 172.21.15.6:0/2227405723 learned_addr learned my addr 172.21.15.6:0/2227405723 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f176b7fe640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f176c0b6f10 0x7f176c0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f176a7fc640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f176c162820 0x7f176c0ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f176affd640 1 -- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f176c162820 msgr2=0x7f176c0ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f176affd640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f176c162820 0x7f176c0ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f176affd640 1 -- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f176c0b6f10 msgr2=0x7f176c0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f176affd640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f176c0b6f10 0x7f176c0b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f176affd640 1 -- 172.21.15.6:0/2227405723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c0ceb90 con 0x7f176c0b3e80 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f176affd640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c0b3e80 0x7f176c1f9260 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f176402a270 tx=0x7f17640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f17637fe640 1 -- 172.21.15.6:0/2227405723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764037040 con 0x7f176c0b3e80 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f17637fe640 1 -- 172.21.15.6:0/2227405723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1764042070 con 0x7f176c0b3e80 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c0cf0a0 con 0x7f176c0b3e80 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f17637fe640 1 -- 172.21.15.6:0/2227405723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764030bb0 con 0x7f176c0b3e80 2024-05-20T17:55:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.490+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c1f8a60 con 0x7f176c0b3e80 2024-05-20T17:55:20.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.491+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176c160740 con 0x7f176c0b3e80 2024-05-20T17:55:20.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.492+0000 7f17637fe640 1 -- 172.21.15.6:0/2227405723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1764047460 con 0x7f176c0b3e80 2024-05-20T17:55:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.492+0000 7f17637fe640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f174c06be60 0x7f174c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.493+0000 7f17637fe640 1 -- 172.21.15.6:0/2227405723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f17640abd00 con 0x7f176c0b3e80 2024-05-20T17:55:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.493+0000 7f176a7fc640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f174c06be60 0x7f174c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.493+0000 7f176a7fc640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f174c06be60 0x7f174c06e370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1754006fd0 tx=0x7f1754008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.497+0000 7f17637fe640 1 -- 172.21.15.6:0/2227405723 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f176c160740 con 0x7f176c0b3e80 2024-05-20T17:55:20.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.680+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f176c075b00 con 0x7f176c0b3e80 2024-05-20T17:55:20.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.680+0000 7f17637fe640 1 -- 172.21.15.6:0/2227405723 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7f176407a470 con 0x7f176c0b3e80 2024-05-20T17:55:20.679 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:55:20.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f174c06be60 msgr2=0x7f174c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f174c06be60 0x7f174c06e370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1754006fd0 tx=0x7f1754008040 comp rx=0 tx=0).stop 2024-05-20T17:55:20.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c0b3e80 msgr2=0x7f176c1f9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c0b3e80 0x7f176c1f9260 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f176402a270 tx=0x7f17640046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 shutdown_connections 2024-05-20T17:55:20.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f174c06be60 0x7f174c06e370 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f176c0b6f10 0x7f176c0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f176c162820 0x7f176c0ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 --2- 172.21.15.6:0/2227405723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f176c0b3e80 0x7f176c1f9260 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 >> 172.21.15.6:0/2227405723 conn(0x7f176c0d4bd0 msgr2=0x7f176c15d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 shutdown_connections 2024-05-20T17:55:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.682+0000 7f1771338640 1 -- 172.21.15.6:0/2227405723 wait complete. 2024-05-20T17:55:20.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:55:20.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.813+0000 7f96aa051640 1 Processor -- start 2024-05-20T17:55:20.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.813+0000 7f96aa051640 1 -- start start 2024-05-20T17:55:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96aa051640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a406d3d0 0x7f96a406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96aa051640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f96a40b8190 0x7f96a40b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96aa051640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a406dd20 con 0x7f96a4162820 2024-05-20T17:55:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96aa051640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f96a40d0630 con 0x7f96a40b8190 2024-05-20T17:55:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96aa051640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f96a40d39c0 con 0x7f96a406d3d0 2024-05-20T17:55:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f96a4162820 0x7f96a40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46306/0 (socket says 172.21.15.6:46306) 2024-05-20T17:55:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a37fe640 1 -- 172.21.15.6:0/2402957931 learned_addr learned my addr 172.21.15.6:0/2402957931 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a2ffd640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a406d3d0 0x7f96a406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a3fff640 1 --2- 172.21.15.6:0/2402957931 >> v2:172.21.15.171:3300/0 conn(0x7f96a40b8190 0x7f96a40b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195891167 0 0) 0x7f9694001110 con 0x7f96a4162820 2024-05-20T17:55:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f968c003520 con 0x7f96a4162820 2024-05-20T17:55:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3872538783 0 0) 0x7f968c003520 con 0x7f96a4162820 2024-05-20T17:55:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a406d3d0 msgr2=0x7f96a406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a406d3d0 0x7f96a406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 >> v2:172.21.15.171:3300/0 conn(0x7f96a40b8190 msgr2=0x7f96a40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 --2- 172.21.15.6:0/2402957931 >> v2:172.21.15.171:3300/0 conn(0x7f96a40b8190 0x7f96a40b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a40d3ca0 con 0x7f96a4162820 2024-05-20T17:55:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f9694001840 con 0x7f96a4162820 2024-05-20T17:55:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 >> v1:172.21.15.6:6789/0 conn(0x7f96a4162820 legacy=0x7f96a40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a406d3d0 0x7f968c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c003f30 0x7f968c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c004d40 0x7f968c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96a40d0630 con 0x7f968c004d40 2024-05-20T17:55:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f96a40d39c0 con 0x7f968c003f30 2024-05-20T17:55:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.815+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f968c00ba10 con 0x7f96a406d3d0 2024-05-20T17:55:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.816+0000 7f96a3fff640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c004d40 0x7f968c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.816+0000 7f96a2ffd640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c003f30 0x7f968c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.816+0000 7f96a37fe640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a406d3d0 0x7f968c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.816+0000 7f96a3fff640 1 -- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a406d3d0 msgr2=0x7f968c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.816+0000 7f96a3fff640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a406d3d0 0x7f968c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.816+0000 7f96a3fff640 1 -- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c003f30 msgr2=0x7f968c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.816+0000 7f96a3fff640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c003f30 0x7f968c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.816+0000 7f96a3fff640 1 -- 172.21.15.6:0/2402957931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c003520 con 0x7f968c004d40 2024-05-20T17:55:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.817+0000 7f96a3fff640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c004d40 0x7f968c005150 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f96a408e090 tx=0x7f968c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e73699d9c807b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.817+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c009c10 con 0x7f968c004d40 2024-05-20T17:55:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.817+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c036070 con 0x7f968c004d40 2024-05-20T17:55:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.817+0000 7f96a27fc640 1 -- 172.21.15.6:0/2402957931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c031810 con 0x7f968c004d40 2024-05-20T17:55:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.818+0000 7f96aa051640 1 -- 172.21.15.6:0/2402957931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c004d40 msgr2=0x7f968c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.818+0000 7f96aa051640 1 --2- 172.21.15.6:0/2402957931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c004d40 0x7f968c005150 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f96a408e090 tx=0x7f968c005830 comp rx=0 tx=0).stop 2024-05-20T17:55:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.818+0000 7f96a3fff640 1 -- 172.21.15.6:0/2402957931 reap_dead start 2024-05-20T17:55:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.818+0000 7f96aa051640 1 -- 172.21.15.6:0/2402957931 shutdown_connections 2024-05-20T17:55:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.818+0000 7f96aa051640 1 -- 172.21.15.6:0/2402957931 >> 172.21.15.6:0/2402957931 conn(0x7f96a40d4bd0 msgr2=0x7f96a40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.818+0000 7f96aa051640 1 -- 172.21.15.6:0/2402957931 shutdown_connections 2024-05-20T17:55:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.818+0000 7f96aa051640 1 -- 172.21.15.6:0/2402957931 wait complete. 2024-05-20T17:55:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.819+0000 7f96aa051640 1 Processor -- start 2024-05-20T17:55:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.820+0000 7f96aa051640 1 -- start start 2024-05-20T17:55:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96aa051640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c004d40 0x7f96a40c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96aa051640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a40b5290 0x7f96a40b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96aa051640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96a40c9160 0x7f96a40c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96aa051640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96a40d0300 con 0x7f96a40c9160 2024-05-20T17:55:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96aa051640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f96a40d4260 con 0x7f968c004d40 2024-05-20T17:55:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96aa051640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f96a40b4050 con 0x7f96a40b5290 2024-05-20T17:55:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96a40c9160 0x7f96a40c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96a40c9160 0x7f96a40c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42862/0 (socket says 172.21.15.6:42862) 2024-05-20T17:55:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a3fff640 1 -- 172.21.15.6:0/2401557166 learned_addr learned my addr 172.21.15.6:0/2401557166 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a37fe640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c004d40 0x7f96a40c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a2ffd640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a40b5290 0x7f96a40b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a3fff640 1 -- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a40b5290 msgr2=0x7f96a40b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a3fff640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a40b5290 0x7f96a40b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a3fff640 1 -- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c004d40 msgr2=0x7f96a40c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a3fff640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c004d40 0x7f96a40c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.821+0000 7f96a3fff640 1 -- 172.21.15.6:0/2401557166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a40b6110 con 0x7f96a40c9160 2024-05-20T17:55:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.822+0000 7f96a3fff640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96a40c9160 0x7f96a40c9570 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f969c033040 tx=0x7f969c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.822+0000 7f968bfff640 1 -- 172.21.15.6:0/2401557166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c009c10 con 0x7f96a40c9160 2024-05-20T17:55:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.822+0000 7f968bfff640 1 -- 172.21.15.6:0/2401557166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c045630 con 0x7f96a40c9160 2024-05-20T17:55:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.822+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a40c8680 con 0x7f96a40c9160 2024-05-20T17:55:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.822+0000 7f968bfff640 1 -- 172.21.15.6:0/2401557166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c045a20 con 0x7f96a40c9160 2024-05-20T17:55:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.822+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a40c8c40 con 0x7f96a40c9160 2024-05-20T17:55:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.823+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a40cf320 con 0x7f96a40c9160 2024-05-20T17:55:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.824+0000 7f968bfff640 1 -- 172.21.15.6:0/2401557166 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f969c005d10 con 0x7f96a40c9160 2024-05-20T17:55:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.824+0000 7f968bfff640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f969006be30 0x7f969006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.824+0000 7f968bfff640 1 -- 172.21.15.6:0/2401557166 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f969c0ac300 con 0x7f96a40c9160 2024-05-20T17:55:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.824+0000 7f96a37fe640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f969006be30 0x7f969006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.825+0000 7f96a37fe640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f969006be30 0x7f969006e340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f96940017c0 tx=0x7f9694007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:20.829+0000 7f968bfff640 1 -- 172.21.15.6:0/2401557166 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f96a40cf320 con 0x7f96a40c9160 2024-05-20T17:55:21.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.011+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f96a4075b00 con 0x7f96a40c9160 2024-05-20T17:55:21.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.012+0000 7f968bfff640 1 -- 172.21.15.6:0/2401557166 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7f969c02e050 con 0x7f96a40c9160 2024-05-20T17:55:21.011 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.013+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f969006be30 msgr2=0x7f969006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.013+0000 7f96aa051640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f969006be30 0x7f969006e340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f96940017c0 tx=0x7f9694007aa0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96a40c9160 msgr2=0x7f96a40c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96a40c9160 0x7f96a40c9570 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f969c033040 tx=0x7f969c009750 comp rx=0 tx=0).stop 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 shutdown_connections 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f969006be30 0x7f969006e340 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96a40c9160 0x7f96a40c9570 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96a40b5290 0x7f96a40b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 --2- 172.21.15.6:0/2401557166 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f968c004d40 0x7f96a40c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 >> 172.21.15.6:0/2401557166 conn(0x7f96a40d4bd0 msgr2=0x7f96a40cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 shutdown_connections 2024-05-20T17:55:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.014+0000 7f96aa051640 1 -- 172.21.15.6:0/2401557166 wait complete. 2024-05-20T17:55:21.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:55:21.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.141+0000 7f0a6f9aa640 1 Processor -- start 2024-05-20T17:55:21.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.141+0000 7f0a6f9aa640 1 -- start start 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.142+0000 7f0a6f9aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a681602f0 0x7f0a6809a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.142+0000 7f0a6f9aa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a6809aa30 0x7f0a680d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.142+0000 7f0a6f9aa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a68160700 con 0x7f0a6806da80 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.142+0000 7f0a6f9aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0a68159da0 con 0x7f0a681602f0 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.142+0000 7f0a6f9aa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0a680af1c0 con 0x7f0a6809aa30 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.142+0000 7f0a6cf45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a681602f0 0x7f0a6809a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.142+0000 7f0a6cf45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a681602f0 0x7f0a6809a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42868/0 (socket says 172.21.15.6:42868) 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.142+0000 7f0a6cf45640 1 -- 172.21.15.6:0/1578078279 learned_addr learned my addr 172.21.15.6:0/1578078279 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.143+0000 7f0a6df47640 1 --2- 172.21.15.6:0/1578078279 >> v2:172.21.15.171:3300/0 conn(0x7f0a6809aa30 0x7f0a680d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.143+0000 7f0a6cf45640 1 -- 172.21.15.6:0/1578078279 >> v2:172.21.15.171:3300/0 conn(0x7f0a6809aa30 msgr2=0x7f0a680d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.143+0000 7f0a6cf45640 1 --2- 172.21.15.6:0/1578078279 >> v2:172.21.15.171:3300/0 conn(0x7f0a6809aa30 0x7f0a680d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.143+0000 7f0a6cf45640 1 -- 172.21.15.6:0/1578078279 >> v1:172.21.15.171:6789/0 conn(0x7f0a6806da80 legacy=0x7f0a680b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:21.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.143+0000 7f0a6cf45640 1 -- 172.21.15.6:0/1578078279 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6809ae40 con 0x7f0a681602f0 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.143+0000 7f0a6cf45640 1 --2- 172.21.15.6:0/1578078279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809a4f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b1510 tx=0x7f0a5c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fdefe4172a63bc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a67fff640 1 -- 172.21.15.6:0/1578078279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c004030 con 0x7f0a681602f0 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a67fff640 1 -- 172.21.15.6:0/1578078279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0041d0 con 0x7f0a681602f0 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a67fff640 1 -- 172.21.15.6:0/1578078279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c003610 con 0x7f0a681602f0 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1578078279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 msgr2=0x7f0a6809a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1578078279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809a4f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b1510 tx=0x7f0a5c02a180 comp rx=0 tx=0).stop 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1578078279 shutdown_connections 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1578078279 >> v2:172.21.15.171:3300/0 conn(0x7f0a6809aa30 0x7f0a680d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1578078279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809a4f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1578078279 >> 172.21.15.6:0/1578078279 conn(0x7f0a680b6670 msgr2=0x7f0a680b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1578078279 shutdown_connections 2024-05-20T17:55:21.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.144+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1578078279 wait complete. 2024-05-20T17:55:21.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.146+0000 7f0a6f9aa640 1 Processor -- start 2024-05-20T17:55:21.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.146+0000 7f0a6f9aa640 1 -- start start 2024-05-20T17:55:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.147+0000 7f0a6f9aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a6806da80 0x7f0a681482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.147+0000 7f0a6f9aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a6809aa30 0x7f0a68155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.147+0000 7f0a6f9aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.147+0000 7f0a6f9aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0a680b2390 con 0x7f0a681602f0 2024-05-20T17:55:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.147+0000 7f0a6f9aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0a680d17b0 con 0x7f0a6809aa30 2024-05-20T17:55:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.147+0000 7f0a6f9aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0a680af410 con 0x7f0a6806da80 2024-05-20T17:55:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42882/0 (socket says 172.21.15.6:42882) 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 -- 172.21.15.6:0/1707911032 learned_addr learned my addr 172.21.15.6:0/1707911032 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6cf45640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a6809aa30 0x7f0a68155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 -- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a6806da80 msgr2=0x7f0a681482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a6806da80 0x7f0a681482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 -- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a6809aa30 msgr2=0x7f0a68155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a6809aa30 0x7f0a68155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 -- 172.21.15.6:0/1707911032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6809c730 con 0x7f0a681602f0 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6cf45640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a6809aa30 0x7f0a68155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6df47640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809ee40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000d510 tx=0x7f0a6000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a65ffb640 1 -- 172.21.15.6:0/1707911032 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a600125f0 con 0x7f0a681602f0 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a65ffb640 1 -- 172.21.15.6:0/1707911032 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a60019070 con 0x7f0a681602f0 2024-05-20T17:55:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6809ca10 con 0x7f0a681602f0 2024-05-20T17:55:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.148+0000 7f0a65ffb640 1 -- 172.21.15.6:0/1707911032 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a600129f0 con 0x7f0a681602f0 2024-05-20T17:55:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.149+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a6809cfd0 con 0x7f0a681602f0 2024-05-20T17:55:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.150+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a68075b00 con 0x7f0a681602f0 2024-05-20T17:55:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.150+0000 7f0a65ffb640 1 -- 172.21.15.6:0/1707911032 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a60012b90 con 0x7f0a681602f0 2024-05-20T17:55:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.150+0000 7f0a65ffb640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a5406be60 0x7f0a5406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.151+0000 7f0a65ffb640 1 -- 172.21.15.6:0/1707911032 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f0a6008b380 con 0x7f0a681602f0 2024-05-20T17:55:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.151+0000 7f0a6d746640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a5406be60 0x7f0a5406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.151+0000 7f0a6d746640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a5406be60 0x7f0a5406e370 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b6ca0 tx=0x7f0a58009230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.155+0000 7f0a65ffb640 1 -- 172.21.15.6:0/1707911032 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0a60059b80 con 0x7f0a681602f0 2024-05-20T17:55:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.354+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0a680b2750 con 0x7f0a681602f0 2024-05-20T17:55:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.355+0000 7f0a65ffb640 1 -- 172.21.15.6:0/1707911032 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f0a60059480 con 0x7f0a681602f0 2024-05-20T17:55:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a5406be60 msgr2=0x7f0a5406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a5406be60 0x7f0a5406e370 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b6ca0 tx=0x7f0a58009230 comp rx=0 tx=0).stop 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 msgr2=0x7f0a6809ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809ee40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000d510 tx=0x7f0a6000d9d0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 shutdown_connections 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a5406be60 0x7f0a5406e370 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a681602f0 0x7f0a6809ee40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a6809aa30 0x7f0a68155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 --2- 172.21.15.6:0/1707911032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a6806da80 0x7f0a681482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 >> 172.21.15.6:0/1707911032 conn(0x7f0a680b6670 msgr2=0x7f0a68067490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 shutdown_connections 2024-05-20T17:55:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.357+0000 7f0a6f9aa640 1 -- 172.21.15.6:0/1707911032 wait complete. 2024-05-20T17:55:21.367 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T17:55:21.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:21.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T17:55:21.465 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:55:21.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:21.465 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T17:55:21.481 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:55:21.481 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:21.481 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:21.499 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:21.499 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:21.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:21.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.673+0000 7f5ebd7b5640 1 Processor -- start 2024-05-20T17:55:21.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.673+0000 7f5ebd7b5640 1 -- start start 2024-05-20T17:55:21.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5ebd7b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80b4010 0x7f5eb80d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5ebd7b5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5eb80d14b0 0x7f5eb80d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5ebd7b5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb80d0370 con 0x7f5eb8163a10 2024-05-20T17:55:21.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5ebd7b5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb80d3ca0 con 0x7f5eb80d14b0 2024-05-20T17:55:21.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5ebd7b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb80d0650 con 0x7f5eb80b4010 2024-05-20T17:55:21.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5eb77fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5eb80d14b0 0x7f5eb80d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5eae7fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80b4010 0x7f5eb80d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5eb6ffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f5eb8163a10 0x7f5eb80cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:58592/0 (socket says 172.21.15.6:58592) 2024-05-20T17:55:21.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.674+0000 7f5eb6ffd640 1 -- 172.21.15.6:0/438607845 learned_addr learned my addr 172.21.15.6:0/438607845 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.675+0000 7f5eae7fc640 1 -- 172.21.15.6:0/438607845 >> v2:172.21.15.171:3300/0 conn(0x7f5eb80d14b0 msgr2=0x7f5eb80d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.675+0000 7f5eae7fc640 1 --2- 172.21.15.6:0/438607845 >> v2:172.21.15.171:3300/0 conn(0x7f5eb80d14b0 0x7f5eb80d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.675+0000 7f5eae7fc640 1 -- 172.21.15.6:0/438607845 >> v1:172.21.15.171:6789/0 conn(0x7f5eb8163a10 legacy=0x7f5eb80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.675+0000 7f5eb67fc640 1 -- 172.21.15.6:0/438607845 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189184312 0 0) 0x7f5eb80d0370 con 0x7f5eb8163a10 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.675+0000 7f5eae7fc640 1 -- 172.21.15.6:0/438607845 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb80d3650 con 0x7f5eb80b4010 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.675+0000 7f5eb77fe640 1 --2- 172.21.15.6:0/438607845 >> v2:172.21.15.171:3300/0 conn(0x7f5eb80d14b0 0x7f5eb80d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.676+0000 7f5eae7fc640 1 --2- 172.21.15.6:0/438607845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80b4010 0x7f5eb80d4130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00097a0 tx=0x7f5ea002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd8f7fc6d9e127de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.676+0000 7f5eb67fc640 1 -- 172.21.15.6:0/438607845 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0037070 con 0x7f5eb80b4010 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.676+0000 7f5eb67fc640 1 -- 172.21.15.6:0/438607845 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea0032440 con 0x7f5eb80b4010 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.676+0000 7f5eb67fc640 1 -- 172.21.15.6:0/438607845 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0032810 con 0x7f5eb80b4010 2024-05-20T17:55:21.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.677+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/438607845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80b4010 msgr2=0x7f5eb80d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.677+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/438607845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80b4010 0x7f5eb80d4130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00097a0 tx=0x7f5ea002a180 comp rx=0 tx=0).stop 2024-05-20T17:55:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.677+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/438607845 shutdown_connections 2024-05-20T17:55:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.677+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/438607845 >> v2:172.21.15.171:3300/0 conn(0x7f5eb80d14b0 0x7f5eb80d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.677+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/438607845 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80b4010 0x7f5eb80d4130 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.677+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/438607845 >> 172.21.15.6:0/438607845 conn(0x7f5eb806d240 msgr2=0x7f5eb806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.677+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/438607845 shutdown_connections 2024-05-20T17:55:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.677+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/438607845 wait complete. 2024-05-20T17:55:21.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.678+0000 7f5ebd7b5640 1 Processor -- start 2024-05-20T17:55:21.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.679+0000 7f5ebd7b5640 1 -- start start 2024-05-20T17:55:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5ebd7b5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eb80b4010 0x7f5eb80b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5ebd7b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80d14b0 0x7f5eb8156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5ebd7b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb8163a10 0x7f5eb80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5ebd7b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb80b8210 con 0x7f5eb8163a10 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5ebd7b5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb80d1e00 con 0x7f5eb80b4010 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5ebd7b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb80b8390 con 0x7f5eb80d14b0 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5eb77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb8163a10 0x7f5eb80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5eb77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb8163a10 0x7f5eb80b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42892/0 (socket says 172.21.15.6:42892) 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5eb77fe640 1 -- 172.21.15.6:0/3135368400 learned_addr learned my addr 172.21.15.6:0/3135368400 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5eb6ffd640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eb80b4010 0x7f5eb80b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.680+0000 7f5eae7fc640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80d14b0 0x7f5eb8156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eb77fe640 1 -- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80d14b0 msgr2=0x7f5eb8156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eb77fe640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80d14b0 0x7f5eb8156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eb77fe640 1 -- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eb80b4010 msgr2=0x7f5eb80b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eb77fe640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eb80b4010 0x7f5eb80b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eb77fe640 1 -- 172.21.15.6:0/3135368400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb80b50d0 con 0x7f5eb8163a10 2024-05-20T17:55:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eb6ffd640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eb80b4010 0x7f5eb80b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eb77fe640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb8163a10 0x7f5eb80b5b70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000efb0 tx=0x7f5eb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eaffff640 1 -- 172.21.15.6:0/3135368400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0003990 con 0x7f5eb8163a10 2024-05-20T17:55:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eaffff640 1 -- 172.21.15.6:0/3135368400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb0003b30 con 0x7f5eb8163a10 2024-05-20T17:55:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb815a1a0 con 0x7f5eb8163a10 2024-05-20T17:55:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5eaffff640 1 -- 172.21.15.6:0/3135368400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0004030 con 0x7f5eb8163a10 2024-05-20T17:55:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.681+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb80b5650 con 0x7f5eb8163a10 2024-05-20T17:55:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.682+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb80b2e20 con 0x7f5eb8163a10 2024-05-20T17:55:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.683+0000 7f5eaffff640 1 -- 172.21.15.6:0/3135368400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5eb0005d10 con 0x7f5eb8163a10 2024-05-20T17:55:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.683+0000 7f5eaffff640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e9806be30 0x7f5e9806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.683+0000 7f5eaffff640 1 -- 172.21.15.6:0/3135368400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f5eb008bae0 con 0x7f5eb8163a10 2024-05-20T17:55:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.683+0000 7f5eb6ffd640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e9806be30 0x7f5e9806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.684+0000 7f5eb6ffd640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e9806be30 0x7f5e9806e340 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8007fd0 tx=0x7f5ea8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.688+0000 7f5eaffff640 1 -- 172.21.15.6:0/3135368400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5eb80b2e20 con 0x7f5eb8163a10 2024-05-20T17:55:21.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.878+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5eb8075b00 con 0x7f5eb8163a10 2024-05-20T17:55:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.879+0000 7f5eaffff640 1 -- 172.21.15.6:0/3135368400 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16886 (secure 0 0 0) 0x7f5eb0060020 con 0x7f5eb8163a10 2024-05-20T17:55:21.878 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:21.878 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:47.860427+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:54:21.604657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-20T17:54:22.794409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:21.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e9806be30 msgr2=0x7f5e9806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e9806be30 0x7f5e9806e340 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8007fd0 tx=0x7f5ea8007de0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb8163a10 msgr2=0x7f5eb80b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb8163a10 0x7f5eb80b5b70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000efb0 tx=0x7f5eb000c490 comp rx=0 tx=0).stop 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 shutdown_connections 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e9806be30 0x7f5e9806e340 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eb8163a10 0x7f5eb80b5b70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5eb80d14b0 0x7f5eb8156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 --2- 172.21.15.6:0/3135368400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eb80b4010 0x7f5eb80b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 >> 172.21.15.6:0/3135368400 conn(0x7f5eb806d240 msgr2=0x7f5eb815f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 shutdown_connections 2024-05-20T17:55:21.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:21.881+0000 7f5ebd7b5640 1 -- 172.21.15.6:0/3135368400 wait complete. 2024-05-20T17:55:21.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:54:21.604657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:54:22.794409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:55:21.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:55:22.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.010+0000 7f4fb0ce9640 1 Processor -- start 2024-05-20T17:55:22.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.010+0000 7f4fb0ce9640 1 -- start start 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4fb0ce9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d10e0 0x7f4fac0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4fb0ce9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4fac0b7210 0x7f4fac0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4fb0ce9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac0d1ac0 con 0x7f4fac0d14f0 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4fb0ce9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4fac0d1da0 con 0x7f4fac0b7210 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4fb0ce9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac0d2080 con 0x7f4fac0d10e0 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4faa59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d10e0 0x7f4fac0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4faad9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4fac0b7210 0x7f4fac0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4faa59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d10e0 0x7f4fac0cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:54914/0 (socket says 172.21.15.6:54914) 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4faa59c640 1 -- 172.21.15.6:0/1793491629 learned_addr learned my addr 172.21.15.6:0/1793491629 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.012+0000 7f4fa9d9b640 1 --1- 172.21.15.6:0/1793491629 >> v1:172.21.15.171:6789/0 conn(0x7f4fac0d14f0 0x7f4fac0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:58598/0 (socket says 172.21.15.6:58598) 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.013+0000 7f4faa59c640 1 -- 172.21.15.6:0/1793491629 >> v2:172.21.15.171:3300/0 conn(0x7f4fac0b7210 msgr2=0x7f4fac0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.013+0000 7f4faa59c640 1 --2- 172.21.15.6:0/1793491629 >> v2:172.21.15.171:3300/0 conn(0x7f4fac0b7210 0x7f4fac0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.013+0000 7f4faa59c640 1 -- 172.21.15.6:0/1793491629 >> v1:172.21.15.171:6789/0 conn(0x7f4fac0d14f0 legacy=0x7f4fac0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.013+0000 7f4faa59c640 1 -- 172.21.15.6:0/1793491629 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac0d2360 con 0x7f4fac0d10e0 2024-05-20T17:55:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.013+0000 7f4faad9d640 1 --2- 172.21.15.6:0/1793491629 >> v2:172.21.15.171:3300/0 conn(0x7f4fac0b7210 0x7f4fac0cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4faa59c640 1 --2- 172.21.15.6:0/1793491629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d10e0 0x7f4fac0cf140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009e50 tx=0x7f4f9c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99002a1c4f9b2a39 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fa959a640 1 -- 172.21.15.6:0/1793491629 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c036070 con 0x7f4fac0d10e0 2024-05-20T17:55:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fa959a640 1 -- 172.21.15.6:0/1793491629 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f9c031600 con 0x7f4fac0d10e0 2024-05-20T17:55:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fa959a640 1 -- 172.21.15.6:0/1793491629 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0319d0 con 0x7f4fac0d10e0 2024-05-20T17:55:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1793491629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d10e0 msgr2=0x7f4fac0cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1793491629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d10e0 0x7f4fac0cf140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009e50 tx=0x7f4f9c02a710 comp rx=0 tx=0).stop 2024-05-20T17:55:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1793491629 shutdown_connections 2024-05-20T17:55:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1793491629 >> v2:172.21.15.171:3300/0 conn(0x7f4fac0b7210 0x7f4fac0cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1793491629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d10e0 0x7f4fac0cf140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.014+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1793491629 >> 172.21.15.6:0/1793491629 conn(0x7f4fac0b44d0 msgr2=0x7f4fac0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.015+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1793491629 shutdown_connections 2024-05-20T17:55:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.015+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1793491629 wait complete. 2024-05-20T17:55:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.016+0000 7f4fb0ce9640 1 Processor -- start 2024-05-20T17:55:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.017+0000 7f4fb0ce9640 1 -- start start 2024-05-20T17:55:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fb0ce9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fac0b7210 0x7f4fac06e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fb0ce9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac0d10e0 0x7f4fac1f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fb0ce9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d14f0 0x7f4fac0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fb0ce9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac0b8440 con 0x7f4fac0d10e0 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fb0ce9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac0b82c0 con 0x7f4fac0b7210 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fb0ce9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac0709f0 con 0x7f4fac0d14f0 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fa9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac0d10e0 0x7f4fac1f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fa9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac0d10e0 0x7f4fac1f51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42908/0 (socket says 172.21.15.6:42908) 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fa9d9b640 1 -- 172.21.15.6:0/1874713412 learned_addr learned my addr 172.21.15.6:0/1874713412 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4faa59c640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fac0b7210 0x7f4fac06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4faad9d640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d14f0 0x7f4fac0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fa9d9b640 1 -- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d14f0 msgr2=0x7f4fac0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fa9d9b640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d14f0 0x7f4fac0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fa9d9b640 1 -- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fac0b7210 msgr2=0x7f4fac06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fa9d9b640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fac0b7210 0x7f4fac06e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4fa9d9b640 1 -- 172.21.15.6:0/1874713412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac1f5710 con 0x7f4fac0d10e0 2024-05-20T17:55:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.018+0000 7f4faa59c640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fac0b7210 0x7f4fac06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.019+0000 7f4fa9d9b640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac0d10e0 0x7f4fac1f51d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c3f0 tx=0x7f4fa000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.019+0000 7f4f9affd640 1 -- 172.21.15.6:0/1874713412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00074e0 con 0x7f4fac0d10e0 2024-05-20T17:55:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.019+0000 7f4f9affd640 1 -- 172.21.15.6:0/1874713412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa0007680 con 0x7f4fac0d10e0 2024-05-20T17:55:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.019+0000 7f4f9affd640 1 -- 172.21.15.6:0/1874713412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00049e0 con 0x7f4fac0d10e0 2024-05-20T17:55:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.019+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac06cd60 con 0x7f4fac0d10e0 2024-05-20T17:55:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.019+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac06d320 con 0x7f4fac0d10e0 2024-05-20T17:55:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.020+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac06cad0 con 0x7f4fac0d10e0 2024-05-20T17:55:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.021+0000 7f4f9affd640 1 -- 172.21.15.6:0/1874713412 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fa001a020 con 0x7f4fac0d10e0 2024-05-20T17:55:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.021+0000 7f4f9affd640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f8c06be30 0x7f4f8c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.021+0000 7f4f9affd640 1 -- 172.21.15.6:0/1874713412 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f4fa008a670 con 0x7f4fac0d10e0 2024-05-20T17:55:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.021+0000 7f4faa59c640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f8c06be30 0x7f4f8c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.022+0000 7f4faa59c640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f8c06be30 0x7f4f8c06e340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c033000 tx=0x7f4f9c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.026+0000 7f4f9affd640 1 -- 172.21.15.6:0/1874713412 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4fa0058790 con 0x7f4fac0d10e0 2024-05-20T17:55:22.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.208+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4fac075b00 con 0x7f4fac0d10e0 2024-05-20T17:55:22.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.209+0000 7f4f9affd640 1 -- 172.21.15.6:0/1874713412 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f4fa005ca90 con 0x7f4fac0d10e0 2024-05-20T17:55:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:55:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f8c06be30 msgr2=0x7f4f8c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f8c06be30 0x7f4f8c06e340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c033000 tx=0x7f4f9c009000 comp rx=0 tx=0).stop 2024-05-20T17:55:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac0d10e0 msgr2=0x7f4fac1f51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac0d10e0 0x7f4fac1f51d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c3f0 tx=0x7f4fa000c8b0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 shutdown_connections 2024-05-20T17:55:22.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f8c06be30 0x7f4f8c06e340 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fac0d14f0 0x7f4fac0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac0d10e0 0x7f4fac1f51d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 --2- 172.21.15.6:0/1874713412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fac0b7210 0x7f4fac06e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 >> 172.21.15.6:0/1874713412 conn(0x7f4fac0b44d0 msgr2=0x7f4fac0c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:22.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 shutdown_connections 2024-05-20T17:55:22.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.211+0000 7f4fb0ce9640 1 -- 172.21.15.6:0/1874713412 wait complete. 2024-05-20T17:55:22.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:55:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.340+0000 7fb54c626640 1 Processor -- start 2024-05-20T17:55:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.340+0000 7fb54c626640 1 -- start start 2024-05-20T17:55:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54c626640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544071630 0x7fb54415f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54c626640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb5440cd1b0 0x7fb54406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54c626640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb544070850 0x7fb544070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54c626640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb54415f790 con 0x7fb544070850 2024-05-20T17:55:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54c626640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb54406e590 con 0x7fb5440cd1b0 2024-05-20T17:55:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54c626640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5440ce590 con 0x7fb544071630 2024-05-20T17:55:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54abc3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb544070850 0x7fb544070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54abc3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb544070850 0x7fb544070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42924/0 (socket says 172.21.15.6:42924) 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.341+0000 7fb54abc3640 1 -- 172.21.15.6:0/2494486253 learned_addr learned my addr 172.21.15.6:0/2494486253 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.342+0000 7fb549bc1640 1 --2- 172.21.15.6:0/2494486253 >> v2:172.21.15.171:3300/0 conn(0x7fb5440cd1b0 0x7fb54406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.342+0000 7fb54a3c2640 1 --2- 172.21.15.6:0/2494486253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544071630 0x7fb54415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.342+0000 7fb54abc3640 1 -- 172.21.15.6:0/2494486253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544071630 msgr2=0x7fb54415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.342+0000 7fb54abc3640 1 --2- 172.21.15.6:0/2494486253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544071630 0x7fb54415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.342+0000 7fb54abc3640 1 -- 172.21.15.6:0/2494486253 >> v2:172.21.15.171:3300/0 conn(0x7fb5440cd1b0 msgr2=0x7fb54406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.342+0000 7fb54abc3640 1 --2- 172.21.15.6:0/2494486253 >> v2:172.21.15.171:3300/0 conn(0x7fb5440cd1b0 0x7fb54406d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.342+0000 7fb54abc3640 1 -- 172.21.15.6:0/2494486253 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5440711a0 con 0x7fb544070850 2024-05-20T17:55:22.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb54abc3640 1 --2- 172.21.15.6:0/2494486253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb544070850 0x7fb544070c60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb544068540 tx=0x7fb53c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ece14e0bc4b7d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb5493c0640 1 -- 172.21.15.6:0/2494486253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c036070 con 0x7fb544070850 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb5493c0640 1 -- 172.21.15.6:0/2494486253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53c031600 con 0x7fb544070850 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb5493c0640 1 -- 172.21.15.6:0/2494486253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0319d0 con 0x7fb544070850 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb54c626640 1 -- 172.21.15.6:0/2494486253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb544070850 msgr2=0x7fb544070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb54c626640 1 --2- 172.21.15.6:0/2494486253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb544070850 0x7fb544070c60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb544068540 tx=0x7fb53c02a610 comp rx=0 tx=0).stop 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb54c626640 1 -- 172.21.15.6:0/2494486253 shutdown_connections 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb54c626640 1 --2- 172.21.15.6:0/2494486253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb544070850 0x7fb544070c60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb54c626640 1 --2- 172.21.15.6:0/2494486253 >> v2:172.21.15.171:3300/0 conn(0x7fb5440cd1b0 0x7fb54406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb54c626640 1 --2- 172.21.15.6:0/2494486253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544071630 0x7fb54415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.343+0000 7fb54c626640 1 -- 172.21.15.6:0/2494486253 >> 172.21.15.6:0/2494486253 conn(0x7fb5440d29d0 msgr2=0x7fb5440d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.344+0000 7fb54c626640 1 -- 172.21.15.6:0/2494486253 shutdown_connections 2024-05-20T17:55:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.344+0000 7fb54c626640 1 -- 172.21.15.6:0/2494486253 wait complete. 2024-05-20T17:55:22.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.345+0000 7fb54c626640 1 Processor -- start 2024-05-20T17:55:22.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.345+0000 7fb54c626640 1 -- start start 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54c626640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544070850 0x7fb5440cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54c626640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb544071630 0x7fb54415df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54c626640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5440cd1b0 0x7fb544162970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54c626640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb54406cfc0 con 0x7fb5440cd1b0 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54c626640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb54406cce0 con 0x7fb544071630 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54c626640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb54406d2a0 con 0x7fb544070850 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5440cd1b0 0x7fb544162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5440cd1b0 0x7fb544162970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42936/0 (socket says 172.21.15.6:42936) 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 -- 172.21.15.6:0/1098020242 learned_addr learned my addr 172.21.15.6:0/1098020242 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54a3c2640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544070850 0x7fb5440cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb549bc1640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb544071630 0x7fb54415df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 -- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544070850 msgr2=0x7fb5440cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544070850 0x7fb5440cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 -- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb544071630 msgr2=0x7fb54415df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb544071630 0x7fb54415df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 -- 172.21.15.6:0/1098020242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5440adc30 con 0x7fb5440cd1b0 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.347+0000 7fb54abc3640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5440cd1b0 0x7fb544162970 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb53c034040 tx=0x7fb53c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.348+0000 7fb53affd640 1 -- 172.21.15.6:0/1098020242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c036050 con 0x7fb5440cd1b0 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.348+0000 7fb53affd640 1 -- 172.21.15.6:0/1098020242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53c042070 con 0x7fb5440cd1b0 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.348+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5440adf10 con 0x7fb5440cd1b0 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.348+0000 7fb53affd640 1 -- 172.21.15.6:0/1098020242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c009510 con 0x7fb5440cd1b0 2024-05-20T17:55:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.348+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5440ae4d0 con 0x7fb5440cd1b0 2024-05-20T17:55:22.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.349+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5440cc4d0 con 0x7fb5440cd1b0 2024-05-20T17:55:22.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.349+0000 7fb53affd640 1 -- 172.21.15.6:0/1098020242 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb53c007bd0 con 0x7fb5440cd1b0 2024-05-20T17:55:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.350+0000 7fb53affd640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb52806be60 0x7fb52806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.350+0000 7fb53affd640 1 -- 172.21.15.6:0/1098020242 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fb53c0abe40 con 0x7fb5440cd1b0 2024-05-20T17:55:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.350+0000 7fb54a3c2640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb52806be60 0x7fb52806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.351+0000 7fb54a3c2640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb52806be60 0x7fb52806e370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb540006fd0 tx=0x7fb540008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.354+0000 7fb53affd640 1 -- 172.21.15.6:0/1098020242 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb5440711a0 con 0x7fb5440cd1b0 2024-05-20T17:55:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.539+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb544075b00 con 0x7fb5440cd1b0 2024-05-20T17:55:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.539+0000 7fb53affd640 1 -- 172.21.15.6:0/1098020242 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7fb53c07a6b0 con 0x7fb5440cd1b0 2024-05-20T17:55:22.539 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb52806be60 msgr2=0x7fb52806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb52806be60 0x7fb52806e370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb540006fd0 tx=0x7fb540008040 comp rx=0 tx=0).stop 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5440cd1b0 msgr2=0x7fb544162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5440cd1b0 0x7fb544162970 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb53c034040 tx=0x7fb53c004a40 comp rx=0 tx=0).stop 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 shutdown_connections 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb52806be60 0x7fb52806e370 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5440cd1b0 0x7fb544162970 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb544071630 0x7fb54415df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 --2- 172.21.15.6:0/1098020242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb544070850 0x7fb5440cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 >> 172.21.15.6:0/1098020242 conn(0x7fb5440d29d0 msgr2=0x7fb5440d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 shutdown_connections 2024-05-20T17:55:22.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.541+0000 7fb54c626640 1 -- 172.21.15.6:0/1098020242 wait complete. 2024-05-20T17:55:22.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:55:22.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.670+0000 7f3659e73640 1 Processor -- start 2024-05-20T17:55:22.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.670+0000 7f3659e73640 1 -- start start 2024-05-20T17:55:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.671+0000 7f3659e73640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3654162820 0x7f36540b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f3659e73640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36540d0630 con 0x7f365406dae0 2024-05-20T17:55:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f3659e73640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36540d39c0 con 0x7f36540b3e80 2024-05-20T17:55:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f3659e73640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f36540d3ca0 con 0x7f3654162820 2024-05-20T17:55:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f36537fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3654162820 0x7f36540b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f3653fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f365406dae0 0x7f36540b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46310/0 (socket says 172.21.15.6:46310) 2024-05-20T17:55:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f3653fff640 1 -- 172.21.15.6:0/953823074 learned_addr learned my addr 172.21.15.6:0/953823074 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f36537fe640 1 -- 172.21.15.6:0/953823074 >> v1:172.21.15.171:6789/0 conn(0x7f36540b3e80 legacy=0x7f365406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f36537fe640 1 -- 172.21.15.6:0/953823074 >> v1:172.21.15.6:6789/0 conn(0x7f365406dae0 legacy=0x7f36540b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f36537fe640 1 -- 172.21.15.6:0/953823074 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36540d3f80 con 0x7f3654162820 2024-05-20T17:55:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.672+0000 7f36527fc640 1 -- 172.21.15.6:0/953823074 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583713721 0 0) 0x7f36540d0630 con 0x7f365406dae0 2024-05-20T17:55:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.673+0000 7f36537fe640 1 --2- 172.21.15.6:0/953823074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654162820 0x7f36540b3940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f36440097a0 tx=0x7f364402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ddf51fe89b51fa server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.673+0000 7f36527fc640 1 -- 172.21.15.6:0/953823074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644037070 con 0x7f3654162820 2024-05-20T17:55:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.673+0000 7f36527fc640 1 -- 172.21.15.6:0/953823074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644032440 con 0x7f3654162820 2024-05-20T17:55:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.673+0000 7f36527fc640 1 -- 172.21.15.6:0/953823074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644032810 con 0x7f3654162820 2024-05-20T17:55:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.674+0000 7f3659e73640 1 -- 172.21.15.6:0/953823074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654162820 msgr2=0x7f36540b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.674+0000 7f3659e73640 1 --2- 172.21.15.6:0/953823074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654162820 0x7f36540b3940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f36440097a0 tx=0x7f364402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.674+0000 7f3659e73640 1 -- 172.21.15.6:0/953823074 shutdown_connections 2024-05-20T17:55:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.674+0000 7f3659e73640 1 --2- 172.21.15.6:0/953823074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654162820 0x7f36540b3940 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.674+0000 7f3659e73640 1 -- 172.21.15.6:0/953823074 >> 172.21.15.6:0/953823074 conn(0x7f36540d4bd0 msgr2=0x7f36540d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.674+0000 7f3659e73640 1 -- 172.21.15.6:0/953823074 shutdown_connections 2024-05-20T17:55:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.674+0000 7f3659e73640 1 -- 172.21.15.6:0/953823074 wait complete. 2024-05-20T17:55:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.676+0000 7f3659e73640 1 Processor -- start 2024-05-20T17:55:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.676+0000 7f3659e73640 1 -- start start 2024-05-20T17:55:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3659e73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36540b3e80 0x7f36540cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3659e73640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3654162820 0x7f36540b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3659e73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654149120 0x7f3654153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3659e73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36540d4780 con 0x7f3654149120 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3659e73640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36540d0300 con 0x7f3654162820 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3659e73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36540d4900 con 0x7f36540b3e80 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3653fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654149120 0x7f3654153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3653fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654149120 0x7f3654153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42956/0 (socket says 172.21.15.6:42956) 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3653fff640 1 -- 172.21.15.6:0/3464310076 learned_addr learned my addr 172.21.15.6:0/3464310076 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f3652ffd640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3654162820 0x7f36540b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.677+0000 7f36537fe640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36540b3e80 0x7f36540cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f3653fff640 1 -- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36540b3e80 msgr2=0x7f36540cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f3653fff640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36540b3e80 0x7f36540cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f3653fff640 1 -- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3654162820 msgr2=0x7f36540b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f3653fff640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3654162820 0x7f36540b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f3653fff640 1 -- 172.21.15.6:0/3464310076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36541f4ed0 con 0x7f3654149120 2024-05-20T17:55:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f3653fff640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654149120 0x7f3654153e40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c700 tx=0x7f364c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f363bfff640 1 -- 172.21.15.6:0/3464310076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c018070 con 0x7f3654149120 2024-05-20T17:55:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f363bfff640 1 -- 172.21.15.6:0/3464310076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c00ce10 con 0x7f3654149120 2024-05-20T17:55:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36540b4860 con 0x7f3654149120 2024-05-20T17:55:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f363bfff640 1 -- 172.21.15.6:0/3464310076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c00a860 con 0x7f3654149120 2024-05-20T17:55:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.678+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36540ba600 con 0x7f3654149120 2024-05-20T17:55:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.679+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3654075b00 con 0x7f3654149120 2024-05-20T17:55:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.680+0000 7f363bfff640 1 -- 172.21.15.6:0/3464310076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f364c01b070 con 0x7f3654149120 2024-05-20T17:55:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.680+0000 7f363bfff640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f364006be60 0x7f364006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.680+0000 7f363bfff640 1 -- 172.21.15.6:0/3464310076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f364c08a490 con 0x7f3654149120 2024-05-20T17:55:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.680+0000 7f36537fe640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f364006be60 0x7f364006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.681+0000 7f36537fe640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f364006be60 0x7f364006e370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3644034000 tx=0x7f364402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.685+0000 7f363bfff640 1 -- 172.21.15.6:0/3464310076 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f364c058640 con 0x7f3654149120 2024-05-20T17:55:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.868+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f365415f930 con 0x7f3654149120 2024-05-20T17:55:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.869+0000 7f363bfff640 1 -- 172.21.15.6:0/3464310076 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7f364c05c940 con 0x7f3654149120 2024-05-20T17:55:22.868 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:55:22.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f364006be60 msgr2=0x7f364006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f364006be60 0x7f364006e370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3644034000 tx=0x7f364402e000 comp rx=0 tx=0).stop 2024-05-20T17:55:22.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654149120 msgr2=0x7f3654153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654149120 0x7f3654153e40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c700 tx=0x7f364c00cbc0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 shutdown_connections 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f364006be60 0x7f364006e370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3654149120 0x7f3654153e40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3654162820 0x7f36540b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 --2- 172.21.15.6:0/3464310076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36540b3e80 0x7f36540cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 >> 172.21.15.6:0/3464310076 conn(0x7f36540d4bd0 msgr2=0x7f365415e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 shutdown_connections 2024-05-20T17:55:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.871+0000 7f3659e73640 1 -- 172.21.15.6:0/3464310076 wait complete. 2024-05-20T17:55:22.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:55:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.999+0000 7fdb0067a640 1 Processor -- start 2024-05-20T17:55:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:22.999+0000 7fdb0067a640 1 -- start start 2024-05-20T17:55:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.000+0000 7fdb0067a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdaf8162820 0x7fdaf80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.000+0000 7fdb0067a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdaf80b3e80 0x7fdaf806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.000+0000 7fdb0067a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf806dd20 con 0x7fdaf806d910 2024-05-20T17:55:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.000+0000 7fdb0067a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf80d0630 con 0x7fdaf80b3e80 2024-05-20T17:55:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.000+0000 7fdb0067a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf80d39c0 con 0x7fdaf8162820 2024-05-20T17:55:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafdc15640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdaf80b3e80 0x7fdaf806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafdc15640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdaf80b3e80 0x7fdaf806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42968/0 (socket says 172.21.15.6:42968) 2024-05-20T17:55:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafdc15640 1 -- 172.21.15.6:0/2141323860 learned_addr learned my addr 172.21.15.6:0/2141323860 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafe416640 1 --2- 172.21.15.6:0/2141323860 >> v2:172.21.15.171:3300/0 conn(0x7fdaf8162820 0x7fdaf80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafdc15640 1 -- 172.21.15.6:0/2141323860 >> v2:172.21.15.171:3300/0 conn(0x7fdaf8162820 msgr2=0x7fdaf80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafdc15640 1 --2- 172.21.15.6:0/2141323860 >> v2:172.21.15.171:3300/0 conn(0x7fdaf8162820 0x7fdaf80b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafdc15640 1 -- 172.21.15.6:0/2141323860 >> v1:172.21.15.171:6789/0 conn(0x7fdaf806d910 legacy=0x7fdaf80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafdc15640 1 -- 172.21.15.6:0/2141323860 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf80d3ca0 con 0x7fdaf80b3e80 2024-05-20T17:55:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.001+0000 7fdafe416640 1 --2- 172.21.15.6:0/2141323860 >> v2:172.21.15.171:3300/0 conn(0x7fdaf8162820 0x7fdaf80b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.002+0000 7fdafdc15640 1 --2- 172.21.15.6:0/2141323860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf80b3e80 0x7fdaf806d3d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80b7740 tx=0x7fdae802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a2afbfc2f672ae server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.002+0000 7fdafd414640 1 -- 172.21.15.6:0/2141323860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8037070 con 0x7fdaf80b3e80 2024-05-20T17:55:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.002+0000 7fdafd414640 1 -- 172.21.15.6:0/2141323860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae8032440 con 0x7fdaf80b3e80 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.002+0000 7fdafd414640 1 -- 172.21.15.6:0/2141323860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8032810 con 0x7fdaf80b3e80 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.003+0000 7fdb0067a640 1 -- 172.21.15.6:0/2141323860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf80b3e80 msgr2=0x7fdaf806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.003+0000 7fdb0067a640 1 --2- 172.21.15.6:0/2141323860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf80b3e80 0x7fdaf806d3d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80b7740 tx=0x7fdae802a230 comp rx=0 tx=0).stop 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.003+0000 7fdb0067a640 1 -- 172.21.15.6:0/2141323860 shutdown_connections 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.003+0000 7fdb0067a640 1 --2- 172.21.15.6:0/2141323860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf80b3e80 0x7fdaf806d3d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.003+0000 7fdb0067a640 1 --2- 172.21.15.6:0/2141323860 >> v2:172.21.15.171:3300/0 conn(0x7fdaf8162820 0x7fdaf80b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.003+0000 7fdb0067a640 1 -- 172.21.15.6:0/2141323860 >> 172.21.15.6:0/2141323860 conn(0x7fdaf80d4bd0 msgr2=0x7fdaf80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.003+0000 7fdb0067a640 1 -- 172.21.15.6:0/2141323860 shutdown_connections 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.003+0000 7fdb0067a640 1 -- 172.21.15.6:0/2141323860 wait complete. 2024-05-20T17:55:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.004+0000 7fdb0067a640 1 Processor -- start 2024-05-20T17:55:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.005+0000 7fdb0067a640 1 -- start start 2024-05-20T17:55:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdb0067a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf806d910 0x7fdaf81e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdb0067a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf80b3e80 0x7fdaf81f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdb0067a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf8162820 0x7fdaf815c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdb0067a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf80d0300 con 0x7fdaf8162820 2024-05-20T17:55:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdb0067a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf80d4260 con 0x7fdaf806d910 2024-05-20T17:55:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdb0067a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf80b91a0 con 0x7fdaf80b3e80 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafec17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf8162820 0x7fdaf815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafe416640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf806d910 0x7fdaf81e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafec17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf8162820 0x7fdaf815c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42978/0 (socket says 172.21.15.6:42978) 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafdc15640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf80b3e80 0x7fdaf81f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafec17640 1 -- 172.21.15.6:0/4063890018 learned_addr learned my addr 172.21.15.6:0/4063890018 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafec17640 1 -- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf80b3e80 msgr2=0x7fdaf81f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafec17640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf80b3e80 0x7fdaf81f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafec17640 1 -- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf806d910 msgr2=0x7fdaf81e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafec17640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf806d910 0x7fdaf81e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.006+0000 7fdafec17640 1 -- 172.21.15.6:0/4063890018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf81e9230 con 0x7fdaf8162820 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.007+0000 7fdafec17640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf8162820 0x7fdaf815c010 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000b970 tx=0x7fdaf000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.007+0000 7fdaeeffd640 1 -- 172.21.15.6:0/4063890018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0019070 con 0x7fdaf8162820 2024-05-20T17:55:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.007+0000 7fdaeeffd640 1 -- 172.21.15.6:0/4063890018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf000cb40 con 0x7fdaf8162820 2024-05-20T17:55:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.007+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf81e8190 con 0x7fdaf8162820 2024-05-20T17:55:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.007+0000 7fdaeeffd640 1 -- 172.21.15.6:0/4063890018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0014440 con 0x7fdaf8162820 2024-05-20T17:55:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.007+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf81e8750 con 0x7fdaf8162820 2024-05-20T17:55:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.008+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf81e7f00 con 0x7fdaf8162820 2024-05-20T17:55:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.008+0000 7fdaeeffd640 1 -- 172.21.15.6:0/4063890018 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdaf001c070 con 0x7fdaf8162820 2024-05-20T17:55:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.009+0000 7fdaeeffd640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdadc06be30 0x7fdadc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.009+0000 7fdaeeffd640 1 -- 172.21.15.6:0/4063890018 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fdaf008ac10 con 0x7fdaf8162820 2024-05-20T17:55:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.009+0000 7fdafe416640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdadc06be30 0x7fdadc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.010+0000 7fdafe416640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdadc06be30 0x7fdadc06e340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400aac0 tx=0x7fdaf4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.014+0000 7fdaeeffd640 1 -- 172.21.15.6:0/4063890018 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdaf0058d30 con 0x7fdaf8162820 2024-05-20T17:55:23.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.213+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdaf8075b00 con 0x7fdaf8162820 2024-05-20T17:55:23.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.213+0000 7fdaeeffd640 1 -- 172.21.15.6:0/4063890018 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7fdaf005d030 con 0x7fdaf8162820 2024-05-20T17:55:23.213 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:55:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdadc06be30 msgr2=0x7fdadc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdadc06be30 0x7fdadc06e340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400aac0 tx=0x7fdaf4008040 comp rx=0 tx=0).stop 2024-05-20T17:55:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf8162820 msgr2=0x7fdaf815c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf8162820 0x7fdaf815c010 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000b970 tx=0x7fdaf000be30 comp rx=0 tx=0).stop 2024-05-20T17:55:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 shutdown_connections 2024-05-20T17:55:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdadc06be30 0x7fdadc06e340 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdaf8162820 0x7fdaf815c010 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaf80b3e80 0x7fdaf81f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 --2- 172.21.15.6:0/4063890018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaf806d910 0x7fdaf81e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 >> 172.21.15.6:0/4063890018 conn(0x7fdaf80d4bd0 msgr2=0x7fdaf8161ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 shutdown_connections 2024-05-20T17:55:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.216+0000 7fdb0067a640 1 -- 172.21.15.6:0/4063890018 wait complete. 2024-05-20T17:55:23.226 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T17:55:23.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:23.226 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T17:55:23.260 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:55:23.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:23.260 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T17:55:23.318 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:55:23.318 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:23.318 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:23.335 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:55:23.335 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:55:23.335 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:23.335 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:23.376 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:55:23.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.492+0000 7fd8802a0640 1 Processor -- start 2024-05-20T17:55:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.492+0000 7fd8802a0640 1 -- start start 2024-05-20T17:55:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd8802a0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd87806c9a0 0x7fd8780cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd8802a0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd878157ae0 con 0x7fd87815d5f0 2024-05-20T17:55:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd8802a0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87806b900 con 0x7fd8781576d0 2024-05-20T17:55:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd8802a0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd8780cf310 con 0x7fd87806c9a0 2024-05-20T17:55:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd87e03c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd87815d5f0 0x7fd8780ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46322/0 (socket says 172.21.15.6:46322) 2024-05-20T17:55:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd87e03c640 1 -- 172.21.15.6:0/3231639092 learned_addr learned my addr 172.21.15.6:0/3231639092 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd87e83d640 1 --2- 172.21.15.6:0/3231639092 >> v2:172.21.15.6:3300/0 conn(0x7fd87806c9a0 0x7fd8780cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd87e83d640 1 -- 172.21.15.6:0/3231639092 >> v1:172.21.15.171:6789/0 conn(0x7fd8781576d0 legacy=0x7fd87806e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd87e83d640 1 -- 172.21.15.6:0/3231639092 >> v1:172.21.15.6:6789/0 conn(0x7fd87815d5f0 legacy=0x7fd8780ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd87e83d640 1 -- 172.21.15.6:0/3231639092 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87806bbe0 con 0x7fd87806c9a0 2024-05-20T17:55:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.494+0000 7fd87d03a640 1 -- 172.21.15.6:0/3231639092 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244632744 0 0) 0x7fd878157ae0 con 0x7fd87815d5f0 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.495+0000 7fd87e83d640 1 --2- 172.21.15.6:0/3231639092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8780cedd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd870009d90 tx=0x7fd87002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1f644205639149 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.495+0000 7fd87d03a640 1 -- 172.21.15.6:0/3231639092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870031600 con 0x7fd87806c9a0 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.495+0000 7fd87d03a640 1 -- 172.21.15.6:0/3231639092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8700317a0 con 0x7fd87806c9a0 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.495+0000 7fd87d03a640 1 -- 172.21.15.6:0/3231639092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870031b70 con 0x7fd87806c9a0 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.496+0000 7fd8802a0640 1 -- 172.21.15.6:0/3231639092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 msgr2=0x7fd8780cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.496+0000 7fd8802a0640 1 --2- 172.21.15.6:0/3231639092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8780cedd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd870009d90 tx=0x7fd87002a610 comp rx=0 tx=0).stop 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.496+0000 7fd8802a0640 1 -- 172.21.15.6:0/3231639092 shutdown_connections 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.496+0000 7fd8802a0640 1 --2- 172.21.15.6:0/3231639092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8780cedd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.496+0000 7fd8802a0640 1 -- 172.21.15.6:0/3231639092 >> 172.21.15.6:0/3231639092 conn(0x7fd8780cd2a0 msgr2=0x7fd8780cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.496+0000 7fd8802a0640 1 -- 172.21.15.6:0/3231639092 shutdown_connections 2024-05-20T17:55:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.496+0000 7fd8802a0640 1 -- 172.21.15.6:0/3231639092 wait complete. 2024-05-20T17:55:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.498+0000 7fd8802a0640 1 Processor -- start 2024-05-20T17:55:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.498+0000 7fd8802a0640 1 -- start start 2024-05-20T17:55:23.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd8802a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8781400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd8802a0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8781576d0 0x7fd878155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd8802a0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87815d5f0 0x7fd8781f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd8802a0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd87806c480 con 0x7fd87806c9a0 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd8802a0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd87806c1a0 con 0x7fd8781576d0 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd8802a0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd87806cdb0 con 0x7fd87815d5f0 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd87e03c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8781400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd87e03c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8781400b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43002/0 (socket says 172.21.15.6:43002) 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd87e03c640 1 -- 172.21.15.6:0/513333355 learned_addr learned my addr 172.21.15.6:0/513333355 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd87d83b640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8781576d0 0x7fd878155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.499+0000 7fd87e83d640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87815d5f0 0x7fd8781f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd87e03c640 1 -- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87815d5f0 msgr2=0x7fd8781f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd87e03c640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87815d5f0 0x7fd8781f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd87e03c640 1 -- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8781576d0 msgr2=0x7fd878155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd87e03c640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8781576d0 0x7fd878155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd87e03c640 1 -- 172.21.15.6:0/513333355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd878151640 con 0x7fd87806c9a0 2024-05-20T17:55:23.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd87e03c640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8781400b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd87400c410 tx=0x7fd87400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd86effd640 1 -- 172.21.15.6:0/513333355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8740074e0 con 0x7fd87806c9a0 2024-05-20T17:55:23.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd86effd640 1 -- 172.21.15.6:0/513333355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8740047e0 con 0x7fd87806c9a0 2024-05-20T17:55:23.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd86effd640 1 -- 172.21.15.6:0/513333355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874004bd0 con 0x7fd87806c9a0 2024-05-20T17:55:23.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8781505a0 con 0x7fd87806c9a0 2024-05-20T17:55:23.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.500+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd878150b60 con 0x7fd87806c9a0 2024-05-20T17:55:23.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.501+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8780b3640 con 0x7fd87806c9a0 2024-05-20T17:55:23.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.502+0000 7fd86effd640 1 -- 172.21.15.6:0/513333355 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd874011070 con 0x7fd87806c9a0 2024-05-20T17:55:23.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.502+0000 7fd86effd640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85c06be30 0x7fd85c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.502+0000 7fd86effd640 1 -- 172.21.15.6:0/513333355 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fd87408acf0 con 0x7fd87806c9a0 2024-05-20T17:55:23.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.503+0000 7fd87d83b640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85c06be30 0x7fd85c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.503+0000 7fd87d83b640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85c06be30 0x7fd85c06e340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd868006fd0 tx=0x7fd868008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.507+0000 7fd86effd640 1 -- 172.21.15.6:0/513333355 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd8780b3640 con 0x7fd87806c9a0 2024-05-20T17:55:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.735+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd878075b00 con 0x7fd87806c9a0 2024-05-20T17:55:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.736+0000 7fd86effd640 1 -- 172.21.15.6:0/513333355 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7fd87408f070 con 0x7fd87806c9a0 2024-05-20T17:55:23.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:23.735 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:54:23.810231+0000","modified":"2024-05-20T17:54:26.847159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3387888972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3387888972},{"type":"v1","addr":"172.21.15.6:6834","nonce":3387888972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":2}]} 2024-05-20T17:55:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-05-20T17:55:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85c06be30 msgr2=0x7fd85c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85c06be30 0x7fd85c06e340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd868006fd0 tx=0x7fd868008040 comp rx=0 tx=0).stop 2024-05-20T17:55:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 msgr2=0x7fd8781400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8781400b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd87400c410 tx=0x7fd87400c8d0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 shutdown_connections 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd85c06be30 0x7fd85c06e340 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd87815d5f0 0x7fd8781f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8781576d0 0x7fd878155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 --2- 172.21.15.6:0/513333355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd87806c9a0 0x7fd8781400b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 >> 172.21.15.6:0/513333355 conn(0x7fd8780cd2a0 msgr2=0x7fd8780ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 shutdown_connections 2024-05-20T17:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.738+0000 7fd8802a0640 1 -- 172.21.15.6:0/513333355 wait complete. 2024-05-20T17:55:23.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.864+0000 7f9bec31a640 1 Processor -- start 2024-05-20T17:55:23.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.864+0000 7f9bec31a640 1 -- start start 2024-05-20T17:55:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.865+0000 7f9bec31a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9be40b1e10 0x7f9be415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.865+0000 7f9bec31a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9be4070850 0x7f9be4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.865+0000 7f9bec31a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be40cd580 con 0x7f9be415d530 2024-05-20T17:55:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.865+0000 7f9bec31a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9be40ce190 con 0x7f9be40b1e10 2024-05-20T17:55:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.865+0000 7f9bec31a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9be40cd860 con 0x7f9be4070850 2024-05-20T17:55:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.865+0000 7f9be98b5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9be40b1e10 0x7f9be415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.865+0000 7f9be98b5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9be40b1e10 0x7f9be415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43016/0 (socket says 172.21.15.6:43016) 2024-05-20T17:55:23.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.865+0000 7f9be98b5640 1 -- 172.21.15.6:0/2500625710 learned_addr learned my addr 172.21.15.6:0/2500625710 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:23.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.866+0000 7f9bea8b7640 1 --2- 172.21.15.6:0/2500625710 >> v2:172.21.15.171:3300/0 conn(0x7f9be4070850 0x7f9be4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.866+0000 7f9be98b5640 1 -- 172.21.15.6:0/2500625710 >> v2:172.21.15.171:3300/0 conn(0x7f9be4070850 msgr2=0x7f9be4070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:23.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.866+0000 7f9be98b5640 1 --2- 172.21.15.6:0/2500625710 >> v2:172.21.15.171:3300/0 conn(0x7f9be4070850 0x7f9be4070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.866+0000 7f9be98b5640 1 -- 172.21.15.6:0/2500625710 >> v1:172.21.15.171:6789/0 conn(0x7f9be415d530 legacy=0x7f9be40b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:23.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.866+0000 7f9be98b5640 1 -- 172.21.15.6:0/2500625710 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be40cdb40 con 0x7f9be40b1e10 2024-05-20T17:55:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.866+0000 7f9be98b5640 1 --2- 172.21.15.6:0/2500625710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be415aaa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9be40b8400 tx=0x7f9bd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812e53f68c5db8ce server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.867+0000 7f9be90b4640 1 -- 172.21.15.6:0/2500625710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4037070 con 0x7f9be40b1e10 2024-05-20T17:55:23.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.867+0000 7f9be90b4640 1 -- 172.21.15.6:0/2500625710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd4032440 con 0x7f9be40b1e10 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.867+0000 7f9be90b4640 1 -- 172.21.15.6:0/2500625710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4032810 con 0x7f9be40b1e10 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.867+0000 7f9bec31a640 1 -- 172.21.15.6:0/2500625710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 msgr2=0x7f9be415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.867+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2500625710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be415aaa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9be40b8400 tx=0x7f9bd402a270 comp rx=0 tx=0).stop 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.868+0000 7f9bec31a640 1 -- 172.21.15.6:0/2500625710 shutdown_connections 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.868+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2500625710 >> v2:172.21.15.171:3300/0 conn(0x7f9be4070850 0x7f9be4070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.868+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2500625710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be415aaa0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.868+0000 7f9bec31a640 1 -- 172.21.15.6:0/2500625710 >> 172.21.15.6:0/2500625710 conn(0x7f9be40d29d0 msgr2=0x7f9be40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.868+0000 7f9bec31a640 1 -- 172.21.15.6:0/2500625710 shutdown_connections 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.868+0000 7f9bec31a640 1 -- 172.21.15.6:0/2500625710 wait complete. 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.869+0000 7f9bec31a640 1 Processor -- start 2024-05-20T17:55:23.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.869+0000 7f9bec31a640 1 -- start start 2024-05-20T17:55:23.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9bec31a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9be4070850 0x7f9be414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9bec31a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9bec31a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9be415d530 0x7f9be40b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9bec31a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9be40711a0 con 0x7f9be40b1e10 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9bec31a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9be40cd230 con 0x7f9be415d530 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9bec31a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9be4071320 con 0x7f9be4070850 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be414de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43024/0 (socket says 172.21.15.6:43024) 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 -- 172.21.15.6:0/2157139750 learned_addr learned my addr 172.21.15.6:0/2157139750 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9bea0b6640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9be4070850 0x7f9be414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9bea8b7640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9be415d530 0x7f9be40b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 -- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9be4070850 msgr2=0x7f9be414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9be4070850 0x7f9be414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 -- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9be415d530 msgr2=0x7f9be40b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9be415d530 0x7f9be40b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 -- 172.21.15.6:0/2157139750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be40c6a50 con 0x7f9be40b1e10 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.871+0000 7f9be98b5640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be414de20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4000c00 tx=0x7f9bd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.872+0000 7f9bdaffd640 1 -- 172.21.15.6:0/2157139750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4041020 con 0x7f9be40b1e10 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.872+0000 7f9bdaffd640 1 -- 172.21.15.6:0/2157139750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd40306c0 con 0x7f9be40b1e10 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.872+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be40c6d30 con 0x7f9be40b1e10 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.872+0000 7f9bdaffd640 1 -- 172.21.15.6:0/2157139750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4037040 con 0x7f9be40b1e10 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.872+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be40c72f0 con 0x7f9be40b1e10 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.873+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be4075b00 con 0x7f9be40b1e10 2024-05-20T17:55:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.873+0000 7f9bdaffd640 1 -- 172.21.15.6:0/2157139750 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bd4044020 con 0x7f9be40b1e10 2024-05-20T17:55:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.874+0000 7f9bdaffd640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9bc806be30 0x7f9bc806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.874+0000 7f9bdaffd640 1 -- 172.21.15.6:0/2157139750 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f9bd40ab730 con 0x7f9be40b1e10 2024-05-20T17:55:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.874+0000 7f9bea0b6640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9bc806be30 0x7f9bc806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.875+0000 7f9bea0b6640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9bc806be30 0x7f9bc806e340 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9be40d29a0 tx=0x7f9be0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:23.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:23.878+0000 7f9bdaffd640 1 -- 172.21.15.6:0/2157139750 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9bd404b030 con 0x7f9be40b1e10 2024-05-20T17:55:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.065+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9be415cf70 con 0x7f9be40b1e10 2024-05-20T17:55:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.066+0000 7f9bdaffd640 1 -- 172.21.15.6:0/2157139750 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16886 (secure 0 0 0) 0x7f9bd40798e0 con 0x7f9be40b1e10 2024-05-20T17:55:24.066 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:24.066 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:47.860427+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:54:21.604657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-20T17:54:22.794409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:24.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9bc806be30 msgr2=0x7f9bc806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9bc806be30 0x7f9bc806e340 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9be40d29a0 tx=0x7f9be0009040 comp rx=0 tx=0).stop 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 msgr2=0x7f9be414de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be414de20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4000c00 tx=0x7f9bd40046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 shutdown_connections 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9bc806be30 0x7f9bc806e340 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9be415d530 0x7f9be40b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9be40b1e10 0x7f9be414de20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 --2- 172.21.15.6:0/2157139750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9be4070850 0x7f9be414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 >> 172.21.15.6:0/2157139750 conn(0x7f9be40d29d0 msgr2=0x7f9be40d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 shutdown_connections 2024-05-20T17:55:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.068+0000 7f9bec31a640 1 -- 172.21.15.6:0/2157139750 wait complete. 2024-05-20T17:55:24.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:54:21.604657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:54:22.794409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:55:24.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:55:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.197+0000 7f227bcfe640 1 Processor -- start 2024-05-20T17:55:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.198+0000 7f227bcfe640 1 -- start start 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f227bcfe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cd680 0x7f227415f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f227bcfe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f227406c6c0 0x7f227406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f227bcfe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227406d0f0 con 0x7f22740cf3d0 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f227bcfe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f22740cda90 con 0x7f227406c6c0 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f227bcfe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f227415f760 con 0x7f22740cd680 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f2279299640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f227406c6c0 0x7f227406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f2279299640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f227406c6c0 0x7f227406cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43030/0 (socket says 172.21.15.6:43030) 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f2279299640 1 -- 172.21.15.6:0/1502018197 learned_addr learned my addr 172.21.15.6:0/1502018197 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.199+0000 7f2279a9a640 1 --2- 172.21.15.6:0/1502018197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cd680 0x7f227415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.200+0000 7f2279299640 1 -- 172.21.15.6:0/1502018197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cd680 msgr2=0x7f227415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.200+0000 7f2279299640 1 --2- 172.21.15.6:0/1502018197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cd680 0x7f227415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.200+0000 7f2279299640 1 -- 172.21.15.6:0/1502018197 >> v1:172.21.15.171:6789/0 conn(0x7f22740cf3d0 legacy=0x7f22740cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.200+0000 7f2279299640 1 -- 172.21.15.6:0/1502018197 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227406d3d0 con 0x7f227406c6c0 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.200+0000 7f2279299640 1 --2- 172.21.15.6:0/1502018197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f227406c6c0 0x7f227406cad0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2268009870 tx=0x7f226802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c79be0a6772aa2c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.200+0000 7f2278a98640 1 -- 172.21.15.6:0/1502018197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268037070 con 0x7f227406c6c0 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f2278a98640 1 -- 172.21.15.6:0/1502018197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2268032440 con 0x7f227406c6c0 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f2278a98640 1 -- 172.21.15.6:0/1502018197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268032810 con 0x7f227406c6c0 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f227bcfe640 1 -- 172.21.15.6:0/1502018197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f227406c6c0 msgr2=0x7f227406cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f227bcfe640 1 --2- 172.21.15.6:0/1502018197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f227406c6c0 0x7f227406cad0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2268009870 tx=0x7f226802a180 comp rx=0 tx=0).stop 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f227bcfe640 1 -- 172.21.15.6:0/1502018197 shutdown_connections 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f227bcfe640 1 --2- 172.21.15.6:0/1502018197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f227406c6c0 0x7f227406cad0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f227bcfe640 1 --2- 172.21.15.6:0/1502018197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cd680 0x7f227415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f227bcfe640 1 -- 172.21.15.6:0/1502018197 >> 172.21.15.6:0/1502018197 conn(0x7f22740b44d0 msgr2=0x7f22740b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f227bcfe640 1 -- 172.21.15.6:0/1502018197 shutdown_connections 2024-05-20T17:55:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.201+0000 7f227bcfe640 1 -- 172.21.15.6:0/1502018197 wait complete. 2024-05-20T17:55:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.203+0000 7f227bcfe640 1 Processor -- start 2024-05-20T17:55:24.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.203+0000 7f227bcfe640 1 -- start start 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.204+0000 7f227bcfe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f227406c6c0 0x7f22741510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.204+0000 7f227bcfe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd680 0x7f22740b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.204+0000 7f227bcfe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cf3d0 0x7f22740b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.204+0000 7f227bcfe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f227406d990 con 0x7f22740cd680 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.204+0000 7f227bcfe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22740d0b40 con 0x7f227406c6c0 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.204+0000 7f227bcfe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22740d2460 con 0x7f22740cf3d0 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd680 0x7f22740b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd680 0x7f22740b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43038/0 (socket says 172.21.15.6:43038) 2024-05-20T17:55:24.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 -- 172.21.15.6:0/2428663720 learned_addr learned my addr 172.21.15.6:0/2428663720 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279a9a640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f227406c6c0 0x7f22741510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f227a29b640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cf3d0 0x7f22740b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 -- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cf3d0 msgr2=0x7f22740b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cf3d0 0x7f22740b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 -- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f227406c6c0 msgr2=0x7f22741510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f227406c6c0 0x7f22741510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 -- 172.21.15.6:0/2428663720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22740b6510 con 0x7f22740cd680 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279a9a640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f227406c6c0 0x7f22741510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f2279299640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd680 0x7f22740b0c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2268009870 tx=0x7f22680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f22727fc640 1 -- 172.21.15.6:0/2428663720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268041020 con 0x7f22740cd680 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f22727fc640 1 -- 172.21.15.6:0/2428663720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22680306c0 con 0x7f22740cd680 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f22727fc640 1 -- 172.21.15.6:0/2428663720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268037040 con 0x7f22740cd680 2024-05-20T17:55:24.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22740b5750 con 0x7f22740cd680 2024-05-20T17:55:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.205+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22740b5d10 con 0x7f22740cd680 2024-05-20T17:55:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.206+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22740b1710 con 0x7f22740cd680 2024-05-20T17:55:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.207+0000 7f22727fc640 1 -- 172.21.15.6:0/2428663720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2268044020 con 0x7f22740cd680 2024-05-20T17:55:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.208+0000 7f22727fc640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f226006be30 0x7f226006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.208+0000 7f22727fc640 1 -- 172.21.15.6:0/2428663720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f22680ab400 con 0x7f22740cd680 2024-05-20T17:55:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.208+0000 7f2279a9a640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f226006be30 0x7f226006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.208+0000 7f2279a9a640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f226006be30 0x7f226006e340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f226c006fd0 tx=0x7f226c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.212+0000 7f22727fc640 1 -- 172.21.15.6:0/2428663720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f226804b070 con 0x7f22740cd680 2024-05-20T17:55:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.394+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22740b4de0 con 0x7f22740cd680 2024-05-20T17:55:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.394+0000 7f22727fc640 1 -- 172.21.15.6:0/2428663720 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f22740b4de0 con 0x7f22740cd680 2024-05-20T17:55:24.394 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f226006be30 msgr2=0x7f226006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f226006be30 0x7f226006e340 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f226c006fd0 tx=0x7f226c008040 comp rx=0 tx=0).stop 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd680 msgr2=0x7f22740b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd680 0x7f22740b0c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2268009870 tx=0x7f22680046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 shutdown_connections 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f226006be30 0x7f226006e340 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22740cf3d0 0x7f22740b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22740cd680 0x7f22740b0c90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 --2- 172.21.15.6:0/2428663720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f227406c6c0 0x7f22741510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 >> 172.21.15.6:0/2428663720 conn(0x7f22740b44d0 msgr2=0x7f2274151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 shutdown_connections 2024-05-20T17:55:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.396+0000 7f227bcfe640 1 -- 172.21.15.6:0/2428663720 wait complete. 2024-05-20T17:55:24.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:55:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.525+0000 7f889adf7640 1 Processor -- start 2024-05-20T17:55:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.526+0000 7f889adf7640 1 -- start start 2024-05-20T17:55:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f889adf7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88940b6620 0x7f88940ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f889adf7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88941634a0 con 0x7f8894162ce0 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f889adf7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8894163780 con 0x7f88940d3bf0 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f889adf7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f88940d3480 con 0x7f88940b6620 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f8893fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8894162ce0 0x7f88940b8070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46338/0 (socket says 172.21.15.6:46338) 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f8893fff640 1 -- 172.21.15.6:0/3846494264 learned_addr learned my addr 172.21.15.6:0/3846494264 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f8898b93640 1 --2- 172.21.15.6:0/3846494264 >> v2:172.21.15.171:3300/0 conn(0x7f88940b6620 0x7f88940ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f88937fe640 1 -- 172.21.15.6:0/3846494264 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093932947 0 0) 0x7f88941634a0 con 0x7f8894162ce0 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.527+0000 7f88937fe640 1 -- 172.21.15.6:0/3846494264 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f887c003520 con 0x7f8894162ce0 2024-05-20T17:55:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.528+0000 7f8898b93640 1 -- 172.21.15.6:0/3846494264 >> v1:172.21.15.171:6789/0 conn(0x7f88940d3bf0 legacy=0x7f88940d4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.528+0000 7f8898b93640 1 -- 172.21.15.6:0/3846494264 >> v1:172.21.15.6:6789/0 conn(0x7f8894162ce0 legacy=0x7f88940b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.528+0000 7f8898b93640 1 -- 172.21.15.6:0/3846494264 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8894163a60 con 0x7f88940b6620 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.528+0000 7f8898b93640 1 --2- 172.21.15.6:0/3846494264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940b6620 0x7f88940ba3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88840097a0 tx=0x7f888402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55ac0c6bce1839b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f88937fe640 1 -- 172.21.15.6:0/3846494264 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884037070 con 0x7f88940b6620 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f88937fe640 1 -- 172.21.15.6:0/3846494264 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8884032440 con 0x7f88940b6620 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f88937fe640 1 -- 172.21.15.6:0/3846494264 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884032810 con 0x7f88940b6620 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f889adf7640 1 -- 172.21.15.6:0/3846494264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940b6620 msgr2=0x7f88940ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f889adf7640 1 --2- 172.21.15.6:0/3846494264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940b6620 0x7f88940ba3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88840097a0 tx=0x7f888402a230 comp rx=0 tx=0).stop 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f889adf7640 1 -- 172.21.15.6:0/3846494264 shutdown_connections 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f889adf7640 1 --2- 172.21.15.6:0/3846494264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940b6620 0x7f88940ba3c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f889adf7640 1 -- 172.21.15.6:0/3846494264 >> 172.21.15.6:0/3846494264 conn(0x7f889406d240 msgr2=0x7f889406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f889adf7640 1 -- 172.21.15.6:0/3846494264 shutdown_connections 2024-05-20T17:55:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.529+0000 7f889adf7640 1 -- 172.21.15.6:0/3846494264 wait complete. 2024-05-20T17:55:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.531+0000 7f889adf7640 1 Processor -- start 2024-05-20T17:55:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.531+0000 7f889adf7640 1 -- start start 2024-05-20T17:55:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f889adf7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88940b6620 0x7f88941538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f889adf7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940d3bf0 0x7f88941f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f889adf7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8894162ce0 0x7f88941f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f889adf7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f88941630f0 con 0x7f88940b6620 2024-05-20T17:55:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f889adf7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f88940b8780 con 0x7f88940d3bf0 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f889adf7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f88941f61b0 con 0x7f8894162ce0 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88940b6620 0x7f88941538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88940b6620 0x7f88941538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43052/0 (socket says 172.21.15.6:43052) 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 -- 172.21.15.6:0/3395992092 learned_addr learned my addr 172.21.15.6:0/3395992092 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8893fff640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940d3bf0 0x7f88941f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8899394640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8894162ce0 0x7f88941f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 -- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8894162ce0 msgr2=0x7f88941f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8894162ce0 0x7f88941f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 -- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940d3bf0 msgr2=0x7f88941f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940d3bf0 0x7f88941f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 -- 172.21.15.6:0/3395992092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8894152e80 con 0x7f88940b6620 2024-05-20T17:55:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.533+0000 7f8898b93640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88940b6620 0x7f88941538b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f88840098c0 tx=0x7f88840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.534+0000 7f88917fa640 1 -- 172.21.15.6:0/3395992092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884037040 con 0x7f88940b6620 2024-05-20T17:55:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.534+0000 7f88917fa640 1 -- 172.21.15.6:0/3395992092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8884042070 con 0x7f88940b6620 2024-05-20T17:55:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.534+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8894153160 con 0x7f88940b6620 2024-05-20T17:55:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.534+0000 7f88917fa640 1 -- 172.21.15.6:0/3395992092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884030940 con 0x7f88940b6620 2024-05-20T17:55:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.534+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88941e9010 con 0x7f88940b6620 2024-05-20T17:55:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.535+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8894075b00 con 0x7f88940b6620 2024-05-20T17:55:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.535+0000 7f88917fa640 1 -- 172.21.15.6:0/3395992092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8884030ae0 con 0x7f88940b6620 2024-05-20T17:55:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.536+0000 7f88917fa640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888006be30 0x7f888006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.536+0000 7f88917fa640 1 -- 172.21.15.6:0/3395992092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f88840ab930 con 0x7f88940b6620 2024-05-20T17:55:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.536+0000 7f8893fff640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888006be30 0x7f888006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.537+0000 7f8893fff640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888006be30 0x7f888006e340 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f88880011e0 tx=0x7f8888009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.540+0000 7f88917fa640 1 -- 172.21.15.6:0/3395992092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8884045360 con 0x7f88940b6620 2024-05-20T17:55:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.727+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f88940d2fa0 con 0x7f88940b6620 2024-05-20T17:55:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.728+0000 7f88917fa640 1 -- 172.21.15.6:0/3395992092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) ==== 104+0+11 (secure 0 0 0) 0x7f888407a1c0 con 0x7f88940b6620 2024-05-20T17:55:24.727 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:55:24.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888006be30 msgr2=0x7f888006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888006be30 0x7f888006e340 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f88880011e0 tx=0x7f8888009040 comp rx=0 tx=0).stop 2024-05-20T17:55:24.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88940b6620 msgr2=0x7f88941538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88940b6620 0x7f88941538b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f88840098c0 tx=0x7f88840046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 shutdown_connections 2024-05-20T17:55:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f888006be30 0x7f888006e340 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8894162ce0 0x7f88941f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88940d3bf0 0x7f88941f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 --2- 172.21.15.6:0/3395992092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88940b6620 0x7f88941538b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 >> 172.21.15.6:0/3395992092 conn(0x7f889406d240 msgr2=0x7f88940c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 shutdown_connections 2024-05-20T17:55:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.730+0000 7f889adf7640 1 -- 172.21.15.6:0/3395992092 wait complete. 2024-05-20T17:55:24.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:55:24.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.860+0000 7fd171996640 1 Processor -- start 2024-05-20T17:55:24.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.860+0000 7fd171996640 1 -- start start 2024-05-20T17:55:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.861+0000 7fd171996640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd16c15d460 0x7fd16c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.861+0000 7fd171996640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 0x7fd16c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.861+0000 7fd171996640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c15d870 con 0x7fd16c0d1780 2024-05-20T17:55:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd171996640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd16c15dae0 con 0x7fd16c15d460 2024-05-20T17:55:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd171996640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c15ddc0 con 0x7fd16c0b17f0 2024-05-20T17:55:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd16affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd16c15d460 0x7fd16c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd16affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd16c15d460 0x7fd16c06b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43054/0 (socket says 172.21.15.6:43054) 2024-05-20T17:55:24.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd16affd640 1 -- 172.21.15.6:0/2058339965 learned_addr learned my addr 172.21.15.6:0/2058339965 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd16b7fe640 1 --2- 172.21.15.6:0/2058339965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 0x7fd16c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd16affd640 1 -- 172.21.15.6:0/2058339965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 msgr2=0x7fd16c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd16affd640 1 --2- 172.21.15.6:0/2058339965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 0x7fd16c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd16affd640 1 -- 172.21.15.6:0/2058339965 >> v1:172.21.15.171:6789/0 conn(0x7fd16c0d1780 legacy=0x7fd16c0d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:24.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.862+0000 7fd16affd640 1 -- 172.21.15.6:0/2058339965 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c15e0a0 con 0x7fd16c15d460 2024-05-20T17:55:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.863+0000 7fd16affd640 1 --2- 172.21.15.6:0/2058339965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c06b870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009870 tx=0x7fd15c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9d951454d8ff91 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.863+0000 7fd16a7fc640 1 -- 172.21.15.6:0/2058339965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c037070 con 0x7fd16c15d460 2024-05-20T17:55:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.863+0000 7fd16a7fc640 1 -- 172.21.15.6:0/2058339965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15c032440 con 0x7fd16c15d460 2024-05-20T17:55:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.863+0000 7fd16a7fc640 1 -- 172.21.15.6:0/2058339965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c032810 con 0x7fd16c15d460 2024-05-20T17:55:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.864+0000 7fd171996640 1 -- 172.21.15.6:0/2058339965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 msgr2=0x7fd16c06b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.864+0000 7fd171996640 1 --2- 172.21.15.6:0/2058339965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c06b870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009870 tx=0x7fd15c02a210 comp rx=0 tx=0).stop 2024-05-20T17:55:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.864+0000 7fd171996640 1 -- 172.21.15.6:0/2058339965 shutdown_connections 2024-05-20T17:55:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.864+0000 7fd171996640 1 --2- 172.21.15.6:0/2058339965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 0x7fd16c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.864+0000 7fd171996640 1 --2- 172.21.15.6:0/2058339965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c06b870 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.864+0000 7fd171996640 1 -- 172.21.15.6:0/2058339965 >> 172.21.15.6:0/2058339965 conn(0x7fd16c0b6620 msgr2=0x7fd16c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.864+0000 7fd171996640 1 -- 172.21.15.6:0/2058339965 shutdown_connections 2024-05-20T17:55:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.864+0000 7fd171996640 1 -- 172.21.15.6:0/2058339965 wait complete. 2024-05-20T17:55:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.866+0000 7fd171996640 1 Processor -- start 2024-05-20T17:55:24.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.866+0000 7fd171996640 1 -- start start 2024-05-20T17:55:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd171996640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 0x7fd16c15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd171996640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd16c0d1780 0x7fd16c13f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd171996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c13ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd171996640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c15e380 con 0x7fd16c15d460 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd171996640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c06bdb0 con 0x7fd16c0d1780 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd171996640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c0b2140 con 0x7fd16c0b17f0 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c13ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c13ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43060/0 (socket says 172.21.15.6:43060) 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16b7fe640 1 -- 172.21.15.6:0/4095479996 learned_addr learned my addr 172.21.15.6:0/4095479996 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16affd640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 0x7fd16c15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd163fff640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd16c0d1780 0x7fd16c13f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16b7fe640 1 -- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 msgr2=0x7fd16c15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16b7fe640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 0x7fd16c15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16b7fe640 1 -- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd16c0d1780 msgr2=0x7fd16c13f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16b7fe640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd16c0d1780 0x7fd16c13f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.867+0000 7fd16b7fe640 1 -- 172.21.15.6:0/4095479996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c0af410 con 0x7fd16c15d460 2024-05-20T17:55:24.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.868+0000 7fd16b7fe640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c13ff10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd16400cc80 tx=0x7fd16400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.868+0000 7fd168ff9640 1 -- 172.21.15.6:0/4095479996 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16400ce30 con 0x7fd16c15d460 2024-05-20T17:55:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.868+0000 7fd168ff9640 1 -- 172.21.15.6:0/4095479996 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd164003990 con 0x7fd16c15d460 2024-05-20T17:55:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.868+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16c0af6f0 con 0x7fd16c15d460 2024-05-20T17:55:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.868+0000 7fd168ff9640 1 -- 172.21.15.6:0/4095479996 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd164003da0 con 0x7fd16c15d460 2024-05-20T17:55:24.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.868+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16c15f600 con 0x7fd16c15d460 2024-05-20T17:55:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.869+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16c075b00 con 0x7fd16c15d460 2024-05-20T17:55:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.870+0000 7fd168ff9640 1 -- 172.21.15.6:0/4095479996 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd164003f40 con 0x7fd16c15d460 2024-05-20T17:55:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.870+0000 7fd168ff9640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd14c06be30 0x7fd14c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.870+0000 7fd168ff9640 1 -- 172.21.15.6:0/4095479996 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fd16408b530 con 0x7fd16c15d460 2024-05-20T17:55:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.870+0000 7fd16affd640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd14c06be30 0x7fd14c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:24.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.871+0000 7fd16affd640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd14c06be30 0x7fd14c06e340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd15c034000 tx=0x7fd15c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:24.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:24.875+0000 7fd168ff9640 1 -- 172.21.15.6:0/4095479996 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd164014030 con 0x7fd16c15d460 2024-05-20T17:55:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.058+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd16c15b1a0 con 0x7fd16c15d460 2024-05-20T17:55:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.059+0000 7fd168ff9640 1 -- 172.21.15.6:0/4095479996 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) ==== 100+0+11 (secure 0 0 0) 0x7fd164059ca0 con 0x7fd16c15d460 2024-05-20T17:55:25.058 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.060+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd14c06be30 msgr2=0x7fd14c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.060+0000 7fd171996640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd14c06be30 0x7fd14c06e340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd15c034000 tx=0x7fd15c02e000 comp rx=0 tx=0).stop 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.060+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 msgr2=0x7fd16c13ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.060+0000 7fd171996640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c13ff10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd16400cc80 tx=0x7fd16400a5c0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.061+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 shutdown_connections 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.061+0000 7fd171996640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd14c06be30 0x7fd14c06e340 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.061+0000 7fd171996640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c15d460 0x7fd16c13ff10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.061+0000 7fd171996640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd16c0d1780 0x7fd16c13f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.061+0000 7fd171996640 1 --2- 172.21.15.6:0/4095479996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd16c0b17f0 0x7fd16c15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.061+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 >> 172.21.15.6:0/4095479996 conn(0x7fd16c0b6620 msgr2=0x7fd16c0b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.061+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 shutdown_connections 2024-05-20T17:55:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.061+0000 7fd171996640 1 -- 172.21.15.6:0/4095479996 wait complete. 2024-05-20T17:55:25.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.186+0000 7f6c57437640 1 Processor -- start 2024-05-20T17:55:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.186+0000 7f6c57437640 1 -- start start 2024-05-20T17:55:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.187+0000 7f6c57437640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c5015d530 0x7f6c5015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.187+0000 7f6c57437640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c500cd580 con 0x7f6c50070850 2024-05-20T17:55:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.187+0000 7f6c57437640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c500cd860 con 0x7f6c500b1700 2024-05-20T17:55:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.187+0000 7f6c57437640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6c500ce190 con 0x7f6c5015d530 2024-05-20T17:55:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.187+0000 7f6c551d3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c5015d530 0x7f6c5015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.188+0000 7f6c559d4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6c50070850 0x7f6c50070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46346/0 (socket says 172.21.15.6:46346) 2024-05-20T17:55:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.188+0000 7f6c559d4640 1 -- 172.21.15.6:0/2246763921 learned_addr learned my addr 172.21.15.6:0/2246763921 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.188+0000 7f6c551d3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c5015d530 0x7f6c5015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43076/0 (socket says 172.21.15.6:43076) 2024-05-20T17:55:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.188+0000 7f6c551d3640 1 -- 172.21.15.6:0/2246763921 >> v1:172.21.15.171:6789/0 conn(0x7f6c500b1700 legacy=0x7f6c500b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.188+0000 7f6c551d3640 1 -- 172.21.15.6:0/2246763921 >> v1:172.21.15.6:6789/0 conn(0x7f6c50070850 legacy=0x7f6c50070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.188+0000 7f6c47fff640 1 -- 172.21.15.6:0/2246763921 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478745050 0 0) 0x7f6c500cd580 con 0x7f6c50070850 2024-05-20T17:55:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.188+0000 7f6c551d3640 1 -- 172.21.15.6:0/2246763921 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c500cdb40 con 0x7f6c5015d530 2024-05-20T17:55:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.189+0000 7f6c551d3640 1 --2- 172.21.15.6:0/2246763921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015aaa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009d90 tx=0x7f6c4c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd753d21622f336c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.189+0000 7f6c47fff640 1 -- 172.21.15.6:0/2246763921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c007740 con 0x7f6c5015d530 2024-05-20T17:55:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.189+0000 7f6c47fff640 1 -- 172.21.15.6:0/2246763921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4c0078e0 con 0x7f6c5015d530 2024-05-20T17:55:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.189+0000 7f6c47fff640 1 -- 172.21.15.6:0/2246763921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c007cb0 con 0x7f6c5015d530 2024-05-20T17:55:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.189+0000 7f6c57437640 1 -- 172.21.15.6:0/2246763921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 msgr2=0x7f6c5015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.189+0000 7f6c57437640 1 --2- 172.21.15.6:0/2246763921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015aaa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009d90 tx=0x7f6c4c02a6a0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.189+0000 7f6c57437640 1 -- 172.21.15.6:0/2246763921 shutdown_connections 2024-05-20T17:55:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.189+0000 7f6c57437640 1 --2- 172.21.15.6:0/2246763921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015aaa0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.190+0000 7f6c57437640 1 -- 172.21.15.6:0/2246763921 >> 172.21.15.6:0/2246763921 conn(0x7f6c500d29d0 msgr2=0x7f6c500d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.190+0000 7f6c57437640 1 -- 172.21.15.6:0/2246763921 shutdown_connections 2024-05-20T17:55:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.190+0000 7f6c57437640 1 -- 172.21.15.6:0/2246763921 wait complete. 2024-05-20T17:55:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.191+0000 7f6c57437640 1 Processor -- start 2024-05-20T17:55:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.191+0000 7f6c57437640 1 -- start start 2024-05-20T17:55:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c57437640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c50070850 0x7f6c5014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c57437640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c500b1700 0x7f6c500c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c57437640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c57437640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6c50071370 con 0x7f6c5015d530 2024-05-20T17:55:25.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c57437640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500cd230 con 0x7f6c50070850 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c57437640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6c500714f0 con 0x7f6c500b1700 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43092/0 (socket says 172.21.15.6:43092) 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 -- 172.21.15.6:0/288071895 learned_addr learned my addr 172.21.15.6:0/288071895 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c551d3640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c50070850 0x7f6c5014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c549d2640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c500b1700 0x7f6c500c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 -- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c500b1700 msgr2=0x7f6c500c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c500b1700 0x7f6c500c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 -- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c50070850 msgr2=0x7f6c5014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c50070850 0x7f6c5014cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 -- 172.21.15.6:0/288071895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c500cafd0 con 0x7f6c5015d530 2024-05-20T17:55:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.193+0000 7f6c559d4640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015baf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800c410 tx=0x7f6c4800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.194+0000 7f6c45ffb640 1 -- 172.21.15.6:0/288071895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c480074e0 con 0x7f6c5015d530 2024-05-20T17:55:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.194+0000 7f6c45ffb640 1 -- 172.21.15.6:0/288071895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c480047e0 con 0x7f6c5015d530 2024-05-20T17:55:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.194+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c500cb2b0 con 0x7f6c5015d530 2024-05-20T17:55:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.194+0000 7f6c45ffb640 1 -- 172.21.15.6:0/288071895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48004bd0 con 0x7f6c5015d530 2024-05-20T17:55:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.194+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c500cb870 con 0x7f6c5015d530 2024-05-20T17:55:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.195+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c500cad40 con 0x7f6c5015d530 2024-05-20T17:55:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.195+0000 7f6c45ffb640 1 -- 172.21.15.6:0/288071895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c48011070 con 0x7f6c5015d530 2024-05-20T17:55:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.196+0000 7f6c45ffb640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3406be30 0x7f6c3406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.196+0000 7f6c45ffb640 1 -- 172.21.15.6:0/288071895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f6c4808aa80 con 0x7f6c5015d530 2024-05-20T17:55:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.196+0000 7f6c551d3640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3406be30 0x7f6c3406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.197+0000 7f6c551d3640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3406be30 0x7f6c3406e340 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c034000 tx=0x7f6c4c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.200+0000 7f6c45ffb640 1 -- 172.21.15.6:0/288071895 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6c48058cf0 con 0x7f6c5015d530 2024-05-20T17:55:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.425+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c50075b00 con 0x7f6c5015d530 2024-05-20T17:55:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.426+0000 7f6c45ffb640 1 -- 172.21.15.6:0/288071895 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f6c4805cff0 con 0x7f6c5015d530 2024-05-20T17:55:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:25.425 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:54:23.810231+0000","modified":"2024-05-20T17:54:26.847159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3387888972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3387888972},{"type":"v1","addr":"172.21.15.6:6834","nonce":3387888972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":2}]} 2024-05-20T17:55:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-05-20T17:55:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3406be30 msgr2=0x7f6c3406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3406be30 0x7f6c3406e340 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c034000 tx=0x7f6c4c02f000 comp rx=0 tx=0).stop 2024-05-20T17:55:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 msgr2=0x7f6c5015baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015baf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800c410 tx=0x7f6c4800c8d0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 shutdown_connections 2024-05-20T17:55:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3406be30 0x7f6c3406e340 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c5015d530 0x7f6c5015baf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c500b1700 0x7f6c500c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 --2- 172.21.15.6:0/288071895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c50070850 0x7f6c5014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 >> 172.21.15.6:0/288071895 conn(0x7f6c500d29d0 msgr2=0x7f6c500d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 shutdown_connections 2024-05-20T17:55:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.428+0000 7f6c57437640 1 -- 172.21.15.6:0/288071895 wait complete. 2024-05-20T17:55:25.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.555+0000 7f7f4b745640 1 Processor -- start 2024-05-20T17:55:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.555+0000 7f7f4b745640 1 -- start start 2024-05-20T17:55:25.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.556+0000 7f7f4b745640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f4415f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.556+0000 7f7f4b745640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7f440cd1b0 0x7f7f4406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.556+0000 7f7f4b745640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f440ce2b0 con 0x7f7f44070850 2024-05-20T17:55:25.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.556+0000 7f7f4b745640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4415f790 con 0x7f7f440cd1b0 2024-05-20T17:55:25.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.556+0000 7f7f4b745640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4406e590 con 0x7f7f44071630 2024-05-20T17:55:25.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.556+0000 7f7f49ce2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7f44070850 0x7f7f44070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46362/0 (socket says 172.21.15.6:46362) 2024-05-20T17:55:25.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.556+0000 7f7f49ce2640 1 -- 172.21.15.6:0/962321088 learned_addr learned my addr 172.21.15.6:0/962321088 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f494e1640 1 --2- 172.21.15.6:0/962321088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f4415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f48ce0640 1 --2- 172.21.15.6:0/962321088 >> v2:172.21.15.171:3300/0 conn(0x7f7f440cd1b0 0x7f7f4406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f3bfff640 1 -- 172.21.15.6:0/962321088 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933802850 0 0) 0x7f7f440ce2b0 con 0x7f7f44070850 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f3bfff640 1 -- 172.21.15.6:0/962321088 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f30003520 con 0x7f7f44070850 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f3bfff640 1 -- 172.21.15.6:0/962321088 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 961071159 0 0) 0x7f7f30003520 con 0x7f7f44070850 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f494e1640 1 -- 172.21.15.6:0/962321088 >> v2:172.21.15.171:3300/0 conn(0x7f7f440cd1b0 msgr2=0x7f7f4406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f494e1640 1 --2- 172.21.15.6:0/962321088 >> v2:172.21.15.171:3300/0 conn(0x7f7f440cd1b0 0x7f7f4406d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f494e1640 1 -- 172.21.15.6:0/962321088 >> v1:172.21.15.6:6789/0 conn(0x7f7f44070850 legacy=0x7f7f44070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f494e1640 1 -- 172.21.15.6:0/962321088 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4406cce0 con 0x7f7f44071630 2024-05-20T17:55:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.557+0000 7f7f48ce0640 1 --2- 172.21.15.6:0/962321088 >> v2:172.21.15.171:3300/0 conn(0x7f7f440cd1b0 0x7f7f4406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:25.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.558+0000 7f7f494e1640 1 --2- 172.21.15.6:0/962321088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f4415f250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f400097a0 tx=0x7f7f4002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5be8a67a9f34d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.558+0000 7f7f3bfff640 1 -- 172.21.15.6:0/962321088 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f40037070 con 0x7f7f44071630 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.558+0000 7f7f3bfff640 1 -- 172.21.15.6:0/962321088 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4002ab10 con 0x7f7f44071630 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.558+0000 7f7f3bfff640 1 -- 172.21.15.6:0/962321088 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0019f0 con 0x7f7f44071630 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.559+0000 7f7f4b745640 1 -- 172.21.15.6:0/962321088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 msgr2=0x7f7f4415f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.559+0000 7f7f4b745640 1 --2- 172.21.15.6:0/962321088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f4415f250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f400097a0 tx=0x7f7f4002a080 comp rx=0 tx=0).stop 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.559+0000 7f7f4b745640 1 -- 172.21.15.6:0/962321088 shutdown_connections 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.559+0000 7f7f4b745640 1 --2- 172.21.15.6:0/962321088 >> v2:172.21.15.171:3300/0 conn(0x7f7f440cd1b0 0x7f7f4406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.559+0000 7f7f4b745640 1 --2- 172.21.15.6:0/962321088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f4415f250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.559+0000 7f7f4b745640 1 -- 172.21.15.6:0/962321088 >> 172.21.15.6:0/962321088 conn(0x7f7f440d29d0 msgr2=0x7f7f440d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.559+0000 7f7f4b745640 1 -- 172.21.15.6:0/962321088 shutdown_connections 2024-05-20T17:55:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.559+0000 7f7f4b745640 1 -- 172.21.15.6:0/962321088 wait complete. 2024-05-20T17:55:25.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.561+0000 7f7f4b745640 1 Processor -- start 2024-05-20T17:55:25.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.561+0000 7f7f4b745640 1 -- start start 2024-05-20T17:55:25.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f4b745640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f44070850 0x7f7f4415e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f4b745640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f440b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f4b745640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f440cd1b0 0x7f7f441616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f4b745640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4406d2a0 con 0x7f7f440cd1b0 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f4b745640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4406c990 con 0x7f7f44070850 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f4b745640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4406dd00 con 0x7f7f44071630 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f49ce2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f440cd1b0 0x7f7f441616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f49ce2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f440cd1b0 0x7f7f441616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43100/0 (socket says 172.21.15.6:43100) 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f49ce2640 1 -- 172.21.15.6:0/2667398637 learned_addr learned my addr 172.21.15.6:0/2667398637 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f494e1640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f44070850 0x7f7f4415e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f48ce0640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f440b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f49ce2640 1 -- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 msgr2=0x7f7f440b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f49ce2640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f440b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f49ce2640 1 -- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f44070850 msgr2=0x7f7f4415e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f49ce2640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f44070850 0x7f7f4415e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.562+0000 7f7f49ce2640 1 -- 172.21.15.6:0/2667398637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f441f6230 con 0x7f7f440cd1b0 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.563+0000 7f7f49ce2640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f440cd1b0 0x7f7f441616b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00cc00 tx=0x7f7f3c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.563+0000 7f7f39ffb640 1 -- 172.21.15.6:0/2667398637 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c017070 con 0x7f7f440cd1b0 2024-05-20T17:55:25.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.563+0000 7f7f39ffb640 1 -- 172.21.15.6:0/2667398637 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00ce10 con 0x7f7f440cd1b0 2024-05-20T17:55:25.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.563+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f441f6730 con 0x7f7f440cd1b0 2024-05-20T17:55:25.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.563+0000 7f7f39ffb640 1 -- 172.21.15.6:0/2667398637 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c012640 con 0x7f7f440cd1b0 2024-05-20T17:55:25.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.563+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f44160160 con 0x7f7f440cd1b0 2024-05-20T17:55:25.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.564+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f441f64a0 con 0x7f7f440cd1b0 2024-05-20T17:55:25.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.565+0000 7f7f39ffb640 1 -- 172.21.15.6:0/2667398637 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f3c01a070 con 0x7f7f440cd1b0 2024-05-20T17:55:25.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.565+0000 7f7f39ffb640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7f2806be30 0x7f7f2806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.565+0000 7f7f39ffb640 1 -- 172.21.15.6:0/2667398637 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f7f3c08aea0 con 0x7f7f440cd1b0 2024-05-20T17:55:25.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.566+0000 7f7f494e1640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7f2806be30 0x7f7f2806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.566+0000 7f7f494e1640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7f2806be30 0x7f7f2806e340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f40034000 tx=0x7f7f4002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.570+0000 7f7f39ffb640 1 -- 172.21.15.6:0/2667398637 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7f3c058fd0 con 0x7f7f440cd1b0 2024-05-20T17:55:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.754+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f44075b00 con 0x7f7f440cd1b0 2024-05-20T17:55:25.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.755+0000 7f7f39ffb640 1 -- 172.21.15.6:0/2667398637 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16886 (secure 0 0 0) 0x7f7f3c05d2d0 con 0x7f7f440cd1b0 2024-05-20T17:55:25.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:25.754 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:47.860427+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:54:21.604657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-20T17:54:22.794409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7f2806be30 msgr2=0x7f7f2806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7f2806be30 0x7f7f2806e340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f40034000 tx=0x7f7f4002e000 comp rx=0 tx=0).stop 2024-05-20T17:55:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f440cd1b0 msgr2=0x7f7f441616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f440cd1b0 0x7f7f441616b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00cc00 tx=0x7f7f3c00a430 comp rx=0 tx=0).stop 2024-05-20T17:55:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 shutdown_connections 2024-05-20T17:55:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7f2806be30 0x7f7f2806e340 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f440cd1b0 0x7f7f441616b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f44071630 0x7f7f440b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 --2- 172.21.15.6:0/2667398637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f44070850 0x7f7f4415e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 >> 172.21.15.6:0/2667398637 conn(0x7f7f440d29d0 msgr2=0x7f7f440b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 shutdown_connections 2024-05-20T17:55:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.757+0000 7f7f4b745640 1 -- 172.21.15.6:0/2667398637 wait complete. 2024-05-20T17:55:25.767 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T17:55:25.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:25.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.884+0000 7f1a9790f640 1 Processor -- start 2024-05-20T17:55:25.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.884+0000 7f1a9790f640 1 -- start start 2024-05-20T17:55:25.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.885+0000 7f1a9790f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1a9015d530 0x7f1a9015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.885+0000 7f1a9790f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a900cd580 con 0x7f1a900b1700 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.885+0000 7f1a9790f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a900cd860 con 0x7f1a90070850 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.885+0000 7f1a9790f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1a900ce190 con 0x7f1a9015d530 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.885+0000 7f1a94eaa640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1a900b1700 0x7f1a900b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46368/0 (socket says 172.21.15.6:46368) 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.885+0000 7f1a94eaa640 1 -- 172.21.15.6:0/2689467048 learned_addr learned my addr 172.21.15.6:0/2689467048 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a956ab640 1 --2- 172.21.15.6:0/2689467048 >> v2:172.21.15.171:3300/0 conn(0x7f1a9015d530 0x7f1a9015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1782940372 0 0) 0x7f1a900cd580 con 0x7f1a900b1700 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a7c003520 con 0x7f1a900b1700 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 470309276 0 0) 0x7f1a7c003520 con 0x7f1a900b1700 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 >> v2:172.21.15.171:3300/0 conn(0x7f1a9015d530 msgr2=0x7f1a9015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 --2- 172.21.15.6:0/2689467048 >> v2:172.21.15.171:3300/0 conn(0x7f1a9015d530 0x7f1a9015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 >> v1:172.21.15.171:6789/0 conn(0x7f1a90070850 legacy=0x7f1a90070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900cdb40 con 0x7f1a900b1700 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f1a80001670 con 0x7f1a900b1700 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a956ab640 1 --2- 172.21.15.6:0/2689467048 >> v2:172.21.15.171:3300/0 conn(0x7f1a9015d530 0x7f1a9015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 >> v1:172.21.15.6:6789/0 conn(0x7f1a900b1700 legacy=0x7f1a900b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a7c0039b0 0x7f1a7c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a7c004800 0x7f1a7c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900ce190 con 0x7f1a7c005270 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c00c200 con 0x7f1a7c004800 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7c00c400 con 0x7f1a7c0039b0 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a95eac640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a94eaa640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a7c004800 0x7f1a7c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.886+0000 7f1a956ab640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a7c0039b0 0x7f1a7c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a95eac640 1 -- 172.21.15.6:0/2689467048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a7c0039b0 msgr2=0x7f1a7c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a95eac640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a7c0039b0 0x7f1a7c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a95eac640 1 -- 172.21.15.6:0/2689467048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a7c004800 msgr2=0x7f1a7c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a95eac640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a7c004800 0x7f1a7c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a95eac640 1 -- 172.21.15.6:0/2689467048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c003520 con 0x7f1a7c005270 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a95eac640 1 -- 172.21.15.6:0/2689467048 reap_dead start 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a95eac640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a7c00b9c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1a88001720 tx=0x7f1a7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e6873975d8dfa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88001370 con 0x7f1a7c005270 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880052d0 con 0x7f1a7c005270 2024-05-20T17:55:25.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.887+0000 7f1a87fff640 1 -- 172.21.15.6:0/2689467048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8802abc0 con 0x7f1a7c005270 2024-05-20T17:55:25.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.888+0000 7f1a9790f640 1 -- 172.21.15.6:0/2689467048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 msgr2=0x7f1a7c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.888+0000 7f1a9790f640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a7c00b9c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1a88001720 tx=0x7f1a7c005830 comp rx=0 tx=0).stop 2024-05-20T17:55:25.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.888+0000 7f1a9790f640 1 -- 172.21.15.6:0/2689467048 shutdown_connections 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.888+0000 7f1a9790f640 1 --2- 172.21.15.6:0/2689467048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a7c00b9c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.888+0000 7f1a9790f640 1 -- 172.21.15.6:0/2689467048 >> 172.21.15.6:0/2689467048 conn(0x7f1a900d29d0 msgr2=0x7f1a900d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.888+0000 7f1a9790f640 1 -- 172.21.15.6:0/2689467048 shutdown_connections 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.888+0000 7f1a9790f640 1 -- 172.21.15.6:0/2689467048 wait complete. 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.890+0000 7f1a9790f640 1 Processor -- start 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.890+0000 7f1a9790f640 1 -- start start 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a9790f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a901f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a9790f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a900c9a80 0x7f1a900c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a9790f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a900cb8f0 0x7f1a900cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a9790f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9015aaa0 con 0x7f1a7c005270 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a9790f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900cd230 con 0x7f1a900cb8f0 2024-05-20T17:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a9790f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9015ac20 con 0x7f1a900c9a80 2024-05-20T17:55:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a956ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a901f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a956ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a901f29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43126/0 (socket says 172.21.15.6:43126) 2024-05-20T17:55:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.891+0000 7f1a956ab640 1 -- 172.21.15.6:0/531029197 learned_addr learned my addr 172.21.15.6:0/531029197 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a94eaa640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a900c9a80 0x7f1a900c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a95eac640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a900cb8f0 0x7f1a900cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a956ab640 1 -- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a900c9a80 msgr2=0x7f1a900c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a956ab640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a900c9a80 0x7f1a900c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a956ab640 1 -- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a900cb8f0 msgr2=0x7f1a900cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a956ab640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a900cb8f0 0x7f1a900cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a956ab640 1 -- 172.21.15.6:0/531029197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a900cc240 con 0x7f1a7c005270 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a956ab640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a901f29c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009fd0 tx=0x7f1a8c010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a85ffb640 1 -- 172.21.15.6:0/531029197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c01c070 con 0x7f1a7c005270 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a85ffb640 1 -- 172.21.15.6:0/531029197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c003990 con 0x7f1a7c005270 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a900ca770 con 0x7f1a7c005270 2024-05-20T17:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.892+0000 7f1a85ffb640 1 -- 172.21.15.6:0/531029197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c003d60 con 0x7f1a7c005270 2024-05-20T17:55:25.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.893+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a900cad30 con 0x7f1a7c005270 2024-05-20T17:55:25.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.893+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a90075b00 con 0x7f1a7c005270 2024-05-20T17:55:25.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.894+0000 7f1a85ffb640 1 -- 172.21.15.6:0/531029197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a8c01f070 con 0x7f1a7c005270 2024-05-20T17:55:25.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.895+0000 7f1a85ffb640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a7406be60 0x7f1a7406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:25.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.895+0000 7f1a85ffb640 1 -- 172.21.15.6:0/531029197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f1a8c08b270 con 0x7f1a7c005270 2024-05-20T17:55:25.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.895+0000 7f1a94eaa640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a7406be60 0x7f1a7406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:25.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.896+0000 7f1a94eaa640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a7406be60 0x7f1a7406e370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1a900b7bd0 tx=0x7f1a80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:25.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:25.900+0000 7f1a85ffb640 1 -- 172.21.15.6:0/531029197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1a900cc240 con 0x7f1a7c005270 2024-05-20T17:55:26.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.121+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a9015f250 con 0x7f1a7c005270 2024-05-20T17:55:26.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.121+0000 7f1a85ffb640 1 -- 172.21.15.6:0/531029197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f1a8c059420 con 0x7f1a7c005270 2024-05-20T17:55:26.120 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:26.120 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:54:23.810231+0000","modified":"2024-05-20T17:54:26.847159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3387888972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3387888972},{"type":"v1","addr":"172.21.15.6:6834","nonce":3387888972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":2}]} 2024-05-20T17:55:26.121 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-05-20T17:55:26.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a7406be60 msgr2=0x7f1a7406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a7406be60 0x7f1a7406e370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1a900b7bd0 tx=0x7f1a80009040 comp rx=0 tx=0).stop 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 msgr2=0x7f1a901f29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a901f29c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009fd0 tx=0x7f1a8c010530 comp rx=0 tx=0).stop 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 shutdown_connections 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a7406be60 0x7f1a7406e370 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a900cb8f0 0x7f1a900cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a900c9a80 0x7f1a900c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 --2- 172.21.15.6:0/531029197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7c005270 0x7f1a901f29c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 >> 172.21.15.6:0/531029197 conn(0x7f1a900d29d0 msgr2=0x7f1a9015ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 shutdown_connections 2024-05-20T17:55:26.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.123+0000 7f1a9790f640 1 -- 172.21.15.6:0/531029197 wait complete. 2024-05-20T17:55:26.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:26.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.249+0000 7fb9e6502640 1 Processor -- start 2024-05-20T17:55:26.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.249+0000 7fb9e6502640 1 -- start start 2024-05-20T17:55:26.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e6502640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0162820 0x7fb9e00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e6502640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb9e006dae0 0x7fb9e00b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e6502640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e00d0630 con 0x7fb9e00b3e80 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e6502640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e00d39c0 con 0x7fb9e006dae0 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e6502640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e00d3ca0 con 0x7fb9e0162820 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e4a9f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb9e006dae0 0x7fb9e00b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0162820 0x7fb9e00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e4a9f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb9e006dae0 0x7fb9e00b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:37196/0 (socket says 172.21.15.6:37196) 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9dffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0162820 0x7fb9e00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:55048/0 (socket says 172.21.15.6:55048) 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e4a9f640 1 -- 172.21.15.6:0/811996482 learned_addr learned my addr 172.21.15.6:0/811996482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9df7fe640 1 --1- 172.21.15.6:0/811996482 >> v1:172.21.15.171:6789/0 conn(0x7fb9e00b3e80 0x7fb9e006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:58692/0 (socket says 172.21.15.6:58692) 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9dffff640 1 -- 172.21.15.6:0/811996482 >> v2:172.21.15.171:3300/0 conn(0x7fb9e006dae0 msgr2=0x7fb9e00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:26.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9dffff640 1 --2- 172.21.15.6:0/811996482 >> v2:172.21.15.171:3300/0 conn(0x7fb9e006dae0 0x7fb9e00b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9dffff640 1 -- 172.21.15.6:0/811996482 >> v1:172.21.15.171:6789/0 conn(0x7fb9e00b3e80 legacy=0x7fb9e006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9dffff640 1 -- 172.21.15.6:0/811996482 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e00d3f80 con 0x7fb9e0162820 2024-05-20T17:55:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.251+0000 7fb9e4a9f640 1 --2- 172.21.15.6:0/811996482 >> v2:172.21.15.171:3300/0 conn(0x7fb9e006dae0 0x7fb9e00b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.252+0000 7fb9dffff640 1 --2- 172.21.15.6:0/811996482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0162820 0x7fb9e00b3940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00097a0 tx=0x7fb9d002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9df7b1596986090 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.252+0000 7fb9deffd640 1 -- 172.21.15.6:0/811996482 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0037070 con 0x7fb9e0162820 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.252+0000 7fb9deffd640 1 -- 172.21.15.6:0/811996482 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d0032440 con 0x7fb9e0162820 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.252+0000 7fb9deffd640 1 -- 172.21.15.6:0/811996482 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0032810 con 0x7fb9e0162820 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.253+0000 7fb9e6502640 1 -- 172.21.15.6:0/811996482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0162820 msgr2=0x7fb9e00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.253+0000 7fb9e6502640 1 --2- 172.21.15.6:0/811996482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0162820 0x7fb9e00b3940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00097a0 tx=0x7fb9d002a180 comp rx=0 tx=0).stop 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.253+0000 7fb9e6502640 1 -- 172.21.15.6:0/811996482 shutdown_connections 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.253+0000 7fb9e6502640 1 --2- 172.21.15.6:0/811996482 >> v2:172.21.15.171:3300/0 conn(0x7fb9e006dae0 0x7fb9e00b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.253+0000 7fb9e6502640 1 --2- 172.21.15.6:0/811996482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0162820 0x7fb9e00b3940 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.253+0000 7fb9e6502640 1 -- 172.21.15.6:0/811996482 >> 172.21.15.6:0/811996482 conn(0x7fb9e00d4bd0 msgr2=0x7fb9e00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:26.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.253+0000 7fb9e6502640 1 -- 172.21.15.6:0/811996482 shutdown_connections 2024-05-20T17:55:26.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.253+0000 7fb9e6502640 1 -- 172.21.15.6:0/811996482 wait complete. 2024-05-20T17:55:26.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.255+0000 7fb9e6502640 1 Processor -- start 2024-05-20T17:55:26.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.255+0000 7fb9e6502640 1 -- start start 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.256+0000 7fb9e6502640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9e00b3e80 0x7fb9e01559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.256+0000 7fb9e6502640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e0162820 0x7fb9e00c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.256+0000 7fb9e6502640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0156000 0x7fb9e00c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.256+0000 7fb9e6502640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00d4780 con 0x7fb9e0162820 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9e6502640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00d0300 con 0x7fb9e00b3e80 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9e6502640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e00d4900 con 0x7fb9e0156000 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e0162820 0x7fb9e00c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e0162820 0x7fb9e00c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43132/0 (socket says 172.21.15.6:43132) 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 -- 172.21.15.6:0/2439600553 learned_addr learned my addr 172.21.15.6:0/2439600553 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9dffff640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9e00b3e80 0x7fb9e01559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9e4a9f640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0156000 0x7fb9e00c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 -- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0156000 msgr2=0x7fb9e00c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0156000 0x7fb9e00c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 -- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9e00b3e80 msgr2=0x7fb9e01559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9e00b3e80 0x7fb9e01559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 -- 172.21.15.6:0/2439600553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e00ca1a0 con 0x7fb9e0162820 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9df7fe640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e0162820 0x7fb9e00c8bd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800c3c0 tx=0x7fb9c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9dcff9640 1 -- 172.21.15.6:0/2439600553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80074e0 con 0x7fb9e0162820 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9dcff9640 1 -- 172.21.15.6:0/2439600553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c8007680 con 0x7fb9e0162820 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9dcff9640 1 -- 172.21.15.6:0/2439600553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80049e0 con 0x7fb9e0162820 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e00b6f80 con 0x7fb9e0162820 2024-05-20T17:55:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.257+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e00b5a90 con 0x7fb9e0162820 2024-05-20T17:55:26.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.259+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e00b6d70 con 0x7fb9e0162820 2024-05-20T17:55:26.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.259+0000 7fb9dcff9640 1 -- 172.21.15.6:0/2439600553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb9c801a020 con 0x7fb9e0162820 2024-05-20T17:55:26.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.260+0000 7fb9dcff9640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb9c006be30 0x7fb9c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.260+0000 7fb9dcff9640 1 -- 172.21.15.6:0/2439600553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fb9c808a720 con 0x7fb9e0162820 2024-05-20T17:55:26.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.260+0000 7fb9dffff640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb9c006be30 0x7fb9c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.261+0000 7fb9dffff640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb9c006be30 0x7fb9c006e340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0034000 tx=0x7fb9d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.264+0000 7fb9dcff9640 1 -- 172.21.15.6:0/2439600553 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb9c8058fb0 con 0x7fb9e0162820 2024-05-20T17:55:26.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.485+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9e0075b00 con 0x7fb9e0162820 2024-05-20T17:55:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.486+0000 7fb9dcff9640 1 -- 172.21.15.6:0/2439600553 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7fb9c80588b0 con 0x7fb9e0162820 2024-05-20T17:55:26.485 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:26.485 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:54:23.810231+0000","modified":"2024-05-20T17:54:26.847159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5394":{"gid":5394,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3387888972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3387888972},{"type":"v1","addr":"172.21.15.6:6834","nonce":3387888972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5394,"qdb_cluster":[5394]},"id":2}]} 2024-05-20T17:55:26.485 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-05-20T17:55:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb9c006be30 msgr2=0x7fb9c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb9c006be30 0x7fb9c006e340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0034000 tx=0x7fb9d002e000 comp rx=0 tx=0).stop 2024-05-20T17:55:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e0162820 msgr2=0x7fb9e00c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e0162820 0x7fb9e00c8bd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800c3c0 tx=0x7fb9c800c880 comp rx=0 tx=0).stop 2024-05-20T17:55:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 shutdown_connections 2024-05-20T17:55:26.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb9c006be30 0x7fb9c006e340 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9e0156000 0x7fb9e00c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9e0162820 0x7fb9e00c8bd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 --2- 172.21.15.6:0/2439600553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9e00b3e80 0x7fb9e01559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 >> 172.21.15.6:0/2439600553 conn(0x7fb9e00d4bd0 msgr2=0x7fb9e015d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 shutdown_connections 2024-05-20T17:55:26.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.488+0000 7fb9e6502640 1 -- 172.21.15.6:0/2439600553 wait complete. 2024-05-20T17:55:26.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.614+0000 7f00f03d5640 1 Processor -- start 2024-05-20T17:55:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.614+0000 7f00f03d5640 1 -- start start 2024-05-20T17:55:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00f03d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00e8162820 0x7f00e80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00f03d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e806dae0 0x7f00e80b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00f03d5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e80d0630 con 0x7f00e80b3e80 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00f03d5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f00e80d39c0 con 0x7f00e8162820 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00f03d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f00e80d3ca0 con 0x7f00e806dae0 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00ee171640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00e8162820 0x7f00e80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00ee171640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00e8162820 0x7f00e80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43146/0 (socket says 172.21.15.6:43146) 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00ee171640 1 -- 172.21.15.6:0/4275080495 learned_addr learned my addr 172.21.15.6:0/4275080495 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00ee972640 1 --2- 172.21.15.6:0/4275080495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e806dae0 0x7f00e80b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00ee171640 1 -- 172.21.15.6:0/4275080495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e806dae0 msgr2=0x7f00e80b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00ee171640 1 --2- 172.21.15.6:0/4275080495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e806dae0 0x7f00e80b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.616+0000 7f00ee171640 1 -- 172.21.15.6:0/4275080495 >> v1:172.21.15.171:6789/0 conn(0x7f00e80b3e80 legacy=0x7f00e806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.617+0000 7f00ee171640 1 -- 172.21.15.6:0/4275080495 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e80d3f80 con 0x7f00e8162820 2024-05-20T17:55:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.617+0000 7f00ee171640 1 --2- 172.21.15.6:0/4275080495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e8162820 0x7f00e80b3940 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009870 tx=0x7f00e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e50436f95ba6a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.617+0000 7f00ed16f640 1 -- 172.21.15.6:0/4275080495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4037070 con 0x7f00e8162820 2024-05-20T17:55:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.617+0000 7f00ed16f640 1 -- 172.21.15.6:0/4275080495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e4032440 con 0x7f00e8162820 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.617+0000 7f00ed16f640 1 -- 172.21.15.6:0/4275080495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4032810 con 0x7f00e8162820 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.618+0000 7f00f03d5640 1 -- 172.21.15.6:0/4275080495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e8162820 msgr2=0x7f00e80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.618+0000 7f00f03d5640 1 --2- 172.21.15.6:0/4275080495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e8162820 0x7f00e80b3940 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009870 tx=0x7f00e402a270 comp rx=0 tx=0).stop 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.618+0000 7f00f03d5640 1 -- 172.21.15.6:0/4275080495 shutdown_connections 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.618+0000 7f00f03d5640 1 --2- 172.21.15.6:0/4275080495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e806dae0 0x7f00e80b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.618+0000 7f00f03d5640 1 --2- 172.21.15.6:0/4275080495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e8162820 0x7f00e80b3940 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.618+0000 7f00f03d5640 1 -- 172.21.15.6:0/4275080495 >> 172.21.15.6:0/4275080495 conn(0x7f00e80d4bd0 msgr2=0x7f00e80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.618+0000 7f00f03d5640 1 -- 172.21.15.6:0/4275080495 shutdown_connections 2024-05-20T17:55:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.618+0000 7f00f03d5640 1 -- 172.21.15.6:0/4275080495 wait complete. 2024-05-20T17:55:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.620+0000 7f00f03d5640 1 Processor -- start 2024-05-20T17:55:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.620+0000 7f00f03d5640 1 -- start start 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.621+0000 7f00f03d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e80b3e80 0x7f00e8159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.621+0000 7f00f03d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00e8162820 0x7f00e80ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.621+0000 7f00f03d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e80c8700 0x7f00e80c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.621+0000 7f00f03d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f00e80d4780 con 0x7f00e80c8700 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.621+0000 7f00f03d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f00e80d0300 con 0x7f00e8162820 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.621+0000 7f00f03d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f00e80d4900 con 0x7f00e80b3e80 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e80c8700 0x7f00e80c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e80c8700 0x7f00e80c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43160/0 (socket says 172.21.15.6:43160) 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 -- 172.21.15.6:0/1598784360 learned_addr learned my addr 172.21.15.6:0/1598784360 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee171640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e80b3e80 0x7f00e8159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ed970640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00e8162820 0x7f00e80ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 -- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e80b3e80 msgr2=0x7f00e8159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e80b3e80 0x7f00e8159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 -- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00e8162820 msgr2=0x7f00e80ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00e8162820 0x7f00e80ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 -- 172.21.15.6:0/1598784360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e80cb1c0 con 0x7f00e80c8700 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00ee972640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e80c8700 0x7f00e80c8b10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f00e000ef90 tx=0x7f00e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00deffd640 1 -- 172.21.15.6:0/1598784360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0018020 con 0x7f00e80c8700 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00deffd640 1 -- 172.21.15.6:0/1598784360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e0014480 con 0x7f00e80c8700 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e80cb4a0 con 0x7f00e80c8700 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00deffd640 1 -- 172.21.15.6:0/1598784360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0009e60 con 0x7f00e80c8700 2024-05-20T17:55:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.622+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e80b56c0 con 0x7f00e80c8700 2024-05-20T17:55:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.623+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e80caf30 con 0x7f00e80c8700 2024-05-20T17:55:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.624+0000 7f00deffd640 1 -- 172.21.15.6:0/1598784360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00e0005d10 con 0x7f00e80c8700 2024-05-20T17:55:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.624+0000 7f00deffd640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f00cc06be60 0x7f00cc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.625+0000 7f00deffd640 1 -- 172.21.15.6:0/1598784360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f00e008bc20 con 0x7f00e80c8700 2024-05-20T17:55:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.625+0000 7f00ee171640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f00cc06be60 0x7f00cc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.625+0000 7f00ee171640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f00cc06be60 0x7f00cc06e370 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f00e4034000 tx=0x7f00e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.629+0000 7f00deffd640 1 -- 172.21.15.6:0/1598784360 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f00e0022030 con 0x7f00e80c8700 2024-05-20T17:55:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.814+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00e80cb9c0 con 0x7f00e80c8700 2024-05-20T17:55:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.815+0000 7f00deffd640 1 -- 172.21.15.6:0/1598784360 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16886 (secure 0 0 0) 0x7f00e80cb9c0 con 0x7f00e80c8700 2024-05-20T17:55:26.814 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:26.815 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:54:47.860427+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:54:21.604657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-20T17:54:22.794409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f00cc06be60 msgr2=0x7f00cc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f00cc06be60 0x7f00cc06e370 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f00e4034000 tx=0x7f00e402e000 comp rx=0 tx=0).stop 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e80c8700 msgr2=0x7f00e80c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e80c8700 0x7f00e80c8b10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f00e000ef90 tx=0x7f00e000c490 comp rx=0 tx=0).stop 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 shutdown_connections 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f00cc06be60 0x7f00cc06e370 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e80c8700 0x7f00e80c8b10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00e8162820 0x7f00e80ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 --2- 172.21.15.6:0/1598784360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f00e80b3e80 0x7f00e8159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 >> 172.21.15.6:0/1598784360 conn(0x7f00e80d4bd0 msgr2=0x7f00e815da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 shutdown_connections 2024-05-20T17:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.817+0000 7f00f03d5640 1 -- 172.21.15.6:0/1598784360 wait complete. 2024-05-20T17:55:26.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T17:55:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.945+0000 7f7428cf0640 1 Processor -- start 2024-05-20T17:55:26.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.945+0000 7f7428cf0640 1 -- start start 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f7428cf0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7424163a10 0x7f74240d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f7428cf0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74240b4010 0x7f74240cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f7428cf0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74240d0370 con 0x7f74240d14b0 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f7428cf0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f74240d3ca0 con 0x7f7424163a10 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f7428cf0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74240d0650 con 0x7f74240b4010 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f742259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7424163a10 0x7f74240d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f7422d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74240d14b0 0x7f74240d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46378/0 (socket says 172.21.15.6:46378) 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f7422d9d640 1 -- 172.21.15.6:0/3111038900 learned_addr learned my addr 172.21.15.6:0/3111038900 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f742259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7424163a10 0x7f74240d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43162/0 (socket says 172.21.15.6:43162) 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.946+0000 7f741bfff640 1 --2- 172.21.15.6:0/3111038900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74240b4010 0x7f74240cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.947+0000 7f742259c640 1 -- 172.21.15.6:0/3111038900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74240b4010 msgr2=0x7f74240cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:26.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.947+0000 7f742259c640 1 --2- 172.21.15.6:0/3111038900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74240b4010 0x7f74240cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.947+0000 7f742259c640 1 -- 172.21.15.6:0/3111038900 >> v1:172.21.15.6:6789/0 conn(0x7f74240d14b0 legacy=0x7f74240d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.947+0000 7f742259c640 1 -- 172.21.15.6:0/3111038900 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74240d3650 con 0x7f7424163a10 2024-05-20T17:55:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.948+0000 7f742259c640 1 --2- 172.21.15.6:0/3111038900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7424163a10 0x7f74240d4130 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f74140097a0 tx=0x7f741402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492786b45f5d645 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.948+0000 7f7421d9b640 1 -- 172.21.15.6:0/3111038900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414037070 con 0x7f7424163a10 2024-05-20T17:55:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.948+0000 7f7421d9b640 1 -- 172.21.15.6:0/3111038900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7414032440 con 0x7f7424163a10 2024-05-20T17:55:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.948+0000 7f7421d9b640 1 -- 172.21.15.6:0/3111038900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414032810 con 0x7f7424163a10 2024-05-20T17:55:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.948+0000 7f7428cf0640 1 -- 172.21.15.6:0/3111038900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7424163a10 msgr2=0x7f74240d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.948+0000 7f7428cf0640 1 --2- 172.21.15.6:0/3111038900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7424163a10 0x7f74240d4130 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f74140097a0 tx=0x7f741402a180 comp rx=0 tx=0).stop 2024-05-20T17:55:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.949+0000 7f7428cf0640 1 -- 172.21.15.6:0/3111038900 shutdown_connections 2024-05-20T17:55:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.949+0000 7f7428cf0640 1 --2- 172.21.15.6:0/3111038900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74240b4010 0x7f74240cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.949+0000 7f7428cf0640 1 --2- 172.21.15.6:0/3111038900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7424163a10 0x7f74240d4130 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.949+0000 7f7428cf0640 1 -- 172.21.15.6:0/3111038900 >> 172.21.15.6:0/3111038900 conn(0x7f742406d240 msgr2=0x7f742406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:26.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.949+0000 7f7428cf0640 1 -- 172.21.15.6:0/3111038900 shutdown_connections 2024-05-20T17:55:26.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.949+0000 7f7428cf0640 1 -- 172.21.15.6:0/3111038900 wait complete. 2024-05-20T17:55:26.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.951+0000 7f7428cf0640 1 Processor -- start 2024-05-20T17:55:26.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.951+0000 7f7428cf0640 1 -- start start 2024-05-20T17:55:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f7428cf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240b4010 0x7f74241f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f7428cf0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74240d14b0 0x7f742415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f7428cf0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7424163a10 0x7f742415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f7428cf0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74240b8210 con 0x7f74240b4010 2024-05-20T17:55:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f7428cf0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74240d0040 con 0x7f74240d14b0 2024-05-20T17:55:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f7428cf0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74240b8390 con 0x7f7424163a10 2024-05-20T17:55:26.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f742259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240b4010 0x7f74241f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f742259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240b4010 0x7f74241f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43164/0 (socket says 172.21.15.6:43164) 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f742259c640 1 -- 172.21.15.6:0/2279987530 learned_addr learned my addr 172.21.15.6:0/2279987530 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f7422d9d640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7424163a10 0x7f742415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f741bfff640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74240d14b0 0x7f742415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f742259c640 1 -- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7424163a10 msgr2=0x7f742415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f742259c640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7424163a10 0x7f742415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f742259c640 1 -- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74240d14b0 msgr2=0x7f742415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f742259c640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74240d14b0 0x7f742415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.952+0000 7f742259c640 1 -- 172.21.15.6:0/2279987530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7424159a80 con 0x7f74240b4010 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.953+0000 7f742259c640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240b4010 0x7f74241f50b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7414000c00 tx=0x7f74140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.953+0000 7f741affd640 1 -- 172.21.15.6:0/2279987530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414037040 con 0x7f74240b4010 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.953+0000 7f741affd640 1 -- 172.21.15.6:0/2279987530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7414042070 con 0x7f74240b4010 2024-05-20T17:55:26.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.953+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7424159d60 con 0x7f74240b4010 2024-05-20T17:55:26.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.953+0000 7f741affd640 1 -- 172.21.15.6:0/2279987530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414030940 con 0x7f74240b4010 2024-05-20T17:55:26.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.953+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742415a320 con 0x7f74240b4010 2024-05-20T17:55:26.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.954+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7424075b00 con 0x7f74240b4010 2024-05-20T17:55:26.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.955+0000 7f741affd640 1 -- 172.21.15.6:0/2279987530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7414030ae0 con 0x7f74240b4010 2024-05-20T17:55:26.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.955+0000 7f741affd640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f740406be30 0x7f740406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:26.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.955+0000 7f741affd640 1 -- 172.21.15.6:0/2279987530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7f74140ab8d0 con 0x7f74240b4010 2024-05-20T17:55:26.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.956+0000 7f741bfff640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f740406be30 0x7f740406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:26.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.956+0000 7f741bfff640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f740406be30 0x7f740406e340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f742414ad80 tx=0x7f740c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:26.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:26.960+0000 7f741affd640 1 -- 172.21.15.6:0/2279987530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f74140799f0 con 0x7f74240b4010 2024-05-20T17:55:27.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.182+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f74240d3050 con 0x7f74240b4010 2024-05-20T17:55:27.181 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T17:55:27.182+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:55:27.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.184+0000 7f741affd640 1 -- 172.21.15.6:0/2279987530 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f741407dcf0 con 0x7f74240b4010 2024-05-20T17:55:27.183 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T17:55:27.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f740406be30 msgr2=0x7f740406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:27.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f740406be30 0x7f740406e340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f742414ad80 tx=0x7f740c009190 comp rx=0 tx=0).stop 2024-05-20T17:55:27.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240b4010 msgr2=0x7f74241f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:27.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240b4010 0x7f74241f50b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7414000c00 tx=0x7f74140046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:27.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 shutdown_connections 2024-05-20T17:55:27.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f740406be30 0x7f740406e340 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:27.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7424163a10 0x7f742415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:27.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74240d14b0 0x7f742415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:27.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 --2- 172.21.15.6:0/2279987530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74240b4010 0x7f74241f50b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:27.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 >> 172.21.15.6:0/2279987530 conn(0x7f742406d240 msgr2=0x7f74240b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:27.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 shutdown_connections 2024-05-20T17:55:27.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.187+0000 7f7428cf0640 1 -- 172.21.15.6:0/2279987530 wait complete. 2024-05-20T17:55:27.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T17:55:27.251 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:55:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.319+0000 7fd1b3f77640 1 Processor -- start 2024-05-20T17:55:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.319+0000 7fd1b3f77640 1 -- start start 2024-05-20T17:55:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b3f77640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1ac0cf850 0x7fd1ac0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b3f77640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ac0d1ac0 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b3f77640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ac0d1da0 con 0x7fd1ac0d10e0 2024-05-20T17:55:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b3f77640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ac0d2080 con 0x7fd1ac0cf850 2024-05-20T17:55:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b1512640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1ac0cf850 0x7fd1ac0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b2514640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd1ac0d14f0 0x7fd1ac0b6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46384/0 (socket says 172.21.15.6:46384) 2024-05-20T17:55:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b2514640 1 -- 172.21.15.6:0/3819658713 learned_addr learned my addr 172.21.15.6:0/3819658713 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b1512640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1ac0cf850 0x7fd1ac0b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43188/0 (socket says 172.21.15.6:43188) 2024-05-20T17:55:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b1512640 1 -- 172.21.15.6:0/3819658713 >> v1:172.21.15.171:6789/0 conn(0x7fd1ac0d10e0 legacy=0x7fd1ac0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b1512640 1 -- 172.21.15.6:0/3819658713 >> v1:172.21.15.6:6789/0 conn(0x7fd1ac0d14f0 legacy=0x7fd1ac0b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b0d11640 1 -- 172.21.15.6:0/3819658713 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901813797 0 0) 0x7fd1ac0d1ac0 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.321+0000 7fd1b1512640 1 -- 172.21.15.6:0/3819658713 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac0d2360 con 0x7fd1ac0cf850 2024-05-20T17:55:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.322+0000 7fd1b1512640 1 --2- 172.21.15.6:0/3819658713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0cf850 0x7fd1ac0b6200 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0097a0 tx=0x7fd19c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336ebecf09a7cce4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.322+0000 7fd1b0d11640 1 -- 172.21.15.6:0/3819658713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c037070 con 0x7fd1ac0cf850 2024-05-20T17:55:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.322+0000 7fd1b0d11640 1 -- 172.21.15.6:0/3819658713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19c032440 con 0x7fd1ac0cf850 2024-05-20T17:55:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.322+0000 7fd1b0d11640 1 -- 172.21.15.6:0/3819658713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19c032810 con 0x7fd1ac0cf850 2024-05-20T17:55:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.323+0000 7fd1b3f77640 1 -- 172.21.15.6:0/3819658713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0cf850 msgr2=0x7fd1ac0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.323+0000 7fd1b3f77640 1 --2- 172.21.15.6:0/3819658713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0cf850 0x7fd1ac0b6200 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0097a0 tx=0x7fd19c02a230 comp rx=0 tx=0).stop 2024-05-20T17:55:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.323+0000 7fd1b3f77640 1 -- 172.21.15.6:0/3819658713 shutdown_connections 2024-05-20T17:55:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.323+0000 7fd1b3f77640 1 --2- 172.21.15.6:0/3819658713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0cf850 0x7fd1ac0b6200 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.323+0000 7fd1b3f77640 1 -- 172.21.15.6:0/3819658713 >> 172.21.15.6:0/3819658713 conn(0x7fd1ac0b44d0 msgr2=0x7fd1ac0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.323+0000 7fd1b3f77640 1 -- 172.21.15.6:0/3819658713 shutdown_connections 2024-05-20T17:55:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.323+0000 7fd1b3f77640 1 -- 172.21.15.6:0/3819658713 wait complete. 2024-05-20T17:55:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.325+0000 7fd1b3f77640 1 Processor -- start 2024-05-20T17:55:27.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.325+0000 7fd1b3f77640 1 -- start start 2024-05-20T17:55:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b3f77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1ac0cf850 0x7fd1ac158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b3f77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ac0d10e0 0x7fd1ac0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b3f77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0d14f0 0x7fd1ac0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b3f77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac0b8440 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b3f77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac0b82c0 con 0x7fd1ac0d10e0 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b3f77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ac0709f0 con 0x7fd1ac0cf850 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b2514640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0d14f0 0x7fd1ac0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b2514640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0d14f0 0x7fd1ac0cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43196/0 (socket says 172.21.15.6:43196) 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b2514640 1 -- 172.21.15.6:0/1111824808 learned_addr learned my addr 172.21.15.6:0/1111824808 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b1512640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ac0d10e0 0x7fd1ac0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b1d13640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1ac0cf850 0x7fd1ac158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b2514640 1 -- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1ac0cf850 msgr2=0x7fd1ac158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b2514640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1ac0cf850 0x7fd1ac158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b2514640 1 -- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ac0d10e0 msgr2=0x7fd1ac0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b2514640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ac0d10e0 0x7fd1ac0cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b2514640 1 -- 172.21.15.6:0/1111824808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac15b7c0 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.326+0000 7fd1b1512640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ac0d10e0 0x7fd1ac0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.327+0000 7fd1b2514640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0d14f0 0x7fd1ac0cc4a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400c6d0 tx=0x7fd1a400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.327+0000 7fd1a27fc640 1 -- 172.21.15.6:0/1111824808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4018070 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.327+0000 7fd1a27fc640 1 -- 172.21.15.6:0/1111824808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a4004d60 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.327+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac15baa0 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.327+0000 7fd1a27fc640 1 -- 172.21.15.6:0/1111824808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400a880 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.327+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac147d90 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.328+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ac075b00 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.329+0000 7fd1a27fc640 1 -- 172.21.15.6:0/1111824808 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1a401b070 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.329+0000 7fd1a27fc640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd19006be30 0x7fd19006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.329+0000 7fd1a27fc640 1 -- 172.21.15.6:0/1111824808 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6216+0+0 (secure 0 0 0) 0x7fd1a408a680 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.329+0000 7fd1b1d13640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd19006be30 0x7fd19006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.330+0000 7fd1b1d13640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd19006be30 0x7fd19006e340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8000f60 tx=0x7fd1a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.334+0000 7fd1a27fc640 1 -- 172.21.15.6:0/1111824808 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd1a4058da0 con 0x7fd1ac0d14f0 2024-05-20T17:55:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:27.557+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd1ac068a90 con 0x7fd1ac0d14f0 2024-05-20T17:55:28.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.185+0000 7fd1a27fc640 1 -- 172.21.15.6:0/1111824808 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fd1a40586a0 con 0x7fd1ac0d14f0 2024-05-20T17:55:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.188+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd19006be30 msgr2=0x7fd19006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.188+0000 7fd1b3f77640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd19006be30 0x7fd19006e340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8000f60 tx=0x7fd1a8009040 comp rx=0 tx=0).stop 2024-05-20T17:55:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.188+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0d14f0 msgr2=0x7fd1ac0cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.188+0000 7fd1b3f77640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0d14f0 0x7fd1ac0cc4a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400c6d0 tx=0x7fd1a400cb90 comp rx=0 tx=0).stop 2024-05-20T17:55:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.189+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 shutdown_connections 2024-05-20T17:55:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.189+0000 7fd1b3f77640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd19006be30 0x7fd19006e340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.189+0000 7fd1b3f77640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0d14f0 0x7fd1ac0cc4a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.189+0000 7fd1b3f77640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1ac0d10e0 0x7fd1ac0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.189+0000 7fd1b3f77640 1 --2- 172.21.15.6:0/1111824808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd1ac0cf850 0x7fd1ac158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.189+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 >> 172.21.15.6:0/1111824808 conn(0x7fd1ac0b44d0 msgr2=0x7fd1ac0c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.189+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 shutdown_connections 2024-05-20T17:55:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.189+0000 7fd1b3f77640 1 -- 172.21.15.6:0/1111824808 wait complete. 2024-05-20T17:55:28.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T17:55:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.329+0000 7fc63ff1a640 1 Processor -- start 2024-05-20T17:55:28.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.329+0000 7fc63ff1a640 1 -- start start 2024-05-20T17:55:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.330+0000 7fc63ff1a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6380b1df0 0x7fc6380d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.330+0000 7fc63ff1a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380b3450 0x7fc6380b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.330+0000 7fc63ff1a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63809c350 con 0x7fc6380d14a0 2024-05-20T17:55:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.330+0000 7fc63ff1a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc63809bc20 con 0x7fc6380b1df0 2024-05-20T17:55:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.330+0000 7fc63ff1a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc6380cedb0 con 0x7fc6380b3450 2024-05-20T17:55:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.330+0000 7fc63dcb6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6380b1df0 0x7fc6380d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63dcb6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6380b1df0 0x7fc6380d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42184/0 (socket says 172.21.15.6:42184) 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63dcb6640 1 -- 172.21.15.6:0/3108682124 learned_addr learned my addr 172.21.15.6:0/3108682124 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63d4b5640 1 --1- 172.21.15.6:0/3108682124 >> v1:172.21.15.6:6789/0 conn(0x7fc6380d14a0 0x7fc6380b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54304/0 (socket says 172.21.15.6:54304) 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63e4b7640 1 --2- 172.21.15.6:0/3108682124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380b3450 0x7fc6380b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63dcb6640 1 -- 172.21.15.6:0/3108682124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380b3450 msgr2=0x7fc6380b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63dcb6640 1 --2- 172.21.15.6:0/3108682124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380b3450 0x7fc6380b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63dcb6640 1 -- 172.21.15.6:0/3108682124 >> v1:172.21.15.6:6789/0 conn(0x7fc6380d14a0 legacy=0x7fc6380b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63dcb6640 1 -- 172.21.15.6:0/3108682124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6380d1a50 con 0x7fc6380b1df0 2024-05-20T17:55:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.331+0000 7fc63ccb4640 1 -- 172.21.15.6:0/3108682124 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929899094 0 0) 0x7fc62c001110 con 0x7fc6380d14a0 2024-05-20T17:55:28.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.332+0000 7fc63dcb6640 1 --2- 172.21.15.6:0/3108682124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6380d0f60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc630009850 tx=0x7fc63002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a50e77f01e9ef9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:28.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.332+0000 7fc63ccb4640 1 -- 172.21.15.6:0/3108682124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630004030 con 0x7fc6380b1df0 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.332+0000 7fc63ccb4640 1 -- 172.21.15.6:0/3108682124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6300041d0 con 0x7fc6380b1df0 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.332+0000 7fc63ccb4640 1 -- 172.21.15.6:0/3108682124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630003610 con 0x7fc6380b1df0 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.332+0000 7fc63ff1a640 1 -- 172.21.15.6:0/3108682124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 msgr2=0x7fc6380d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.332+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/3108682124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6380d0f60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc630009850 tx=0x7fc63002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.333+0000 7fc63ff1a640 1 -- 172.21.15.6:0/3108682124 shutdown_connections 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.333+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/3108682124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380b3450 0x7fc6380b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.333+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/3108682124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6380d0f60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.333+0000 7fc63ff1a640 1 -- 172.21.15.6:0/3108682124 >> 172.21.15.6:0/3108682124 conn(0x7fc6380cf450 msgr2=0x7fc6380cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.333+0000 7fc63ff1a640 1 -- 172.21.15.6:0/3108682124 shutdown_connections 2024-05-20T17:55:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.333+0000 7fc63ff1a640 1 -- 172.21.15.6:0/3108682124 wait complete. 2024-05-20T17:55:28.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.335+0000 7fc63ff1a640 1 Processor -- start 2024-05-20T17:55:28.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.335+0000 7fc63ff1a640 1 -- start start 2024-05-20T17:55:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63ff1a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6381d7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63ff1a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6380b3450 0x7fc6381da430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63ff1a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380d14a0 0x7fc6381da970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63ff1a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc6380ce820 con 0x7fc6380b1df0 2024-05-20T17:55:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63ff1a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc6380b3da0 con 0x7fc6380b3450 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63ff1a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc6380d0650 con 0x7fc6380d14a0 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63dcb6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6381d7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63dcb6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6381d7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42188/0 (socket says 172.21.15.6:42188) 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63dcb6640 1 -- 172.21.15.6:0/2005613537 learned_addr learned my addr 172.21.15.6:0/2005613537 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63d4b5640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6380b3450 0x7fc6381da430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63e4b7640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380d14a0 0x7fc6381da970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63dcb6640 1 -- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380d14a0 msgr2=0x7fc6381da970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63dcb6640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380d14a0 0x7fc6381da970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63dcb6640 1 -- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6380b3450 msgr2=0x7fc6381da430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63dcb6640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6380b3450 0x7fc6381da430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.336+0000 7fc63dcb6640 1 -- 172.21.15.6:0/2005613537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6381d80a0 con 0x7fc6380b1df0 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.337+0000 7fc63dcb6640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6381d7b60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc630009970 tx=0x7fc6300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.337+0000 7fc6367fc640 1 -- 172.21.15.6:0/2005613537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630041030 con 0x7fc6380b1df0 2024-05-20T17:55:28.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.337+0000 7fc6367fc640 1 -- 172.21.15.6:0/2005613537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc630003c50 con 0x7fc6380b1df0 2024-05-20T17:55:28.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.337+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63809ed20 con 0x7fc6380b1df0 2024-05-20T17:55:28.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.337+0000 7fc6367fc640 1 -- 172.21.15.6:0/2005613537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630004030 con 0x7fc6380b1df0 2024-05-20T17:55:28.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.337+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63809f2e0 con 0x7fc6380b1df0 2024-05-20T17:55:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.338+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6380690b0 con 0x7fc6380b1df0 2024-05-20T17:55:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.338+0000 7fc6367fc640 1 -- 172.21.15.6:0/2005613537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc630044070 con 0x7fc6380b1df0 2024-05-20T17:55:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.339+0000 7fc6367fc640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62406be60 0x7fc62406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.339+0000 7fc6367fc640 1 -- 172.21.15.6:0/2005613537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6216+0+0 (secure 0 0 0) 0x7fc6300abb10 con 0x7fc6380b1df0 2024-05-20T17:55:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.339+0000 7fc63d4b5640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62406be60 0x7fc62406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.340+0000 7fc63d4b5640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62406be60 0x7fc62406e370 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc63806e280 tx=0x7fc62c007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:28.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.343+0000 7fc6367fc640 1 -- 172.21.15.6:0/2005613537 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc63007a2c0 con 0x7fc6380b1df0 2024-05-20T17:55:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:28.529+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc6380c5f50 con 0x7fc6380b1df0 2024-05-20T17:55:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.190+0000 7fc6367fc640 1 -- 172.21.15.6:0/2005613537 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7fc630079bc0 con 0x7fc6380b1df0 2024-05-20T17:55:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T17:55:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62406be60 msgr2=0x7fc62406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62406be60 0x7fc62406e370 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc63806e280 tx=0x7fc62c007c00 comp rx=0 tx=0).stop 2024-05-20T17:55:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 msgr2=0x7fc6381d7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6381d7b60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc630009970 tx=0x7fc6300046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 shutdown_connections 2024-05-20T17:55:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62406be60 0x7fc62406e370 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6380d14a0 0x7fc6381da970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6380b3450 0x7fc6381da430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 --2- 172.21.15.6:0/2005613537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6380b1df0 0x7fc6381d7b60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 >> 172.21.15.6:0/2005613537 conn(0x7fc6380cf450 msgr2=0x7fc6380b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 shutdown_connections 2024-05-20T17:55:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.196+0000 7fc63ff1a640 1 -- 172.21.15.6:0/2005613537 wait complete. 2024-05-20T17:55:29.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T17:55:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.336+0000 7f47eb006640 1 Processor -- start 2024-05-20T17:55:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.336+0000 7f47eb006640 1 -- start start 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47eb006640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e4163950 0x7f47e40b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47eb006640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47e40d3c60 0x7f47e415f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47eb006640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e40b6ff0 con 0x7f47e40b6be0 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47eb006640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f47e41606f0 con 0x7f47e4163950 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47eb006640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f47e4160410 con 0x7f47e40d3c60 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47e8da2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e4163950 0x7f47e40b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47e8da2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f47e4163950 0x7f47e40b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42198/0 (socket says 172.21.15.6:42198) 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47e8da2640 1 -- 172.21.15.6:0/614955767 learned_addr learned my addr 172.21.15.6:0/614955767 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.337+0000 7f47e95a3640 1 --2- 172.21.15.6:0/614955767 >> v2:172.21.15.171:3300/0 conn(0x7f47e40d3c60 0x7f47e415f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.338+0000 7f47e8da2640 1 -- 172.21.15.6:0/614955767 >> v2:172.21.15.171:3300/0 conn(0x7f47e40d3c60 msgr2=0x7f47e415f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.338+0000 7f47e8da2640 1 --2- 172.21.15.6:0/614955767 >> v2:172.21.15.171:3300/0 conn(0x7f47e40d3c60 0x7f47e415f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.338+0000 7f47e8da2640 1 -- 172.21.15.6:0/614955767 >> v1:172.21.15.171:6789/0 conn(0x7f47e40b6be0 legacy=0x7f47e40d3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.338+0000 7f47e8da2640 1 -- 172.21.15.6:0/614955767 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e4162e70 con 0x7f47e4163950 2024-05-20T17:55:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.338+0000 7f47e8da2640 1 --2- 172.21.15.6:0/614955767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e40b66a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f47e408e050 tx=0x7f47d402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfccb4d7b1b9a05e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.338+0000 7f47e37fe640 1 -- 172.21.15.6:0/614955767 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4037070 con 0x7f47e4163950 2024-05-20T17:55:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47e37fe640 1 -- 172.21.15.6:0/614955767 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d4032440 con 0x7f47e4163950 2024-05-20T17:55:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47e37fe640 1 -- 172.21.15.6:0/614955767 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4032810 con 0x7f47e4163950 2024-05-20T17:55:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47eb006640 1 -- 172.21.15.6:0/614955767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 msgr2=0x7f47e40b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47eb006640 1 --2- 172.21.15.6:0/614955767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e40b66a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f47e408e050 tx=0x7f47d402a230 comp rx=0 tx=0).stop 2024-05-20T17:55:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47eb006640 1 -- 172.21.15.6:0/614955767 shutdown_connections 2024-05-20T17:55:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47eb006640 1 --2- 172.21.15.6:0/614955767 >> v2:172.21.15.171:3300/0 conn(0x7f47e40d3c60 0x7f47e415f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47eb006640 1 --2- 172.21.15.6:0/614955767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e40b66a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47eb006640 1 -- 172.21.15.6:0/614955767 >> 172.21.15.6:0/614955767 conn(0x7f47e40d16a0 msgr2=0x7f47e40d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47eb006640 1 -- 172.21.15.6:0/614955767 shutdown_connections 2024-05-20T17:55:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.339+0000 7f47eb006640 1 -- 172.21.15.6:0/614955767 wait complete. 2024-05-20T17:55:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.341+0000 7f47eb006640 1 Processor -- start 2024-05-20T17:55:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.341+0000 7f47eb006640 1 -- start start 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.342+0000 7f47eb006640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40b6be0 0x7f47e4152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.342+0000 7f47eb006640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40d3c60 0x7f47e41e9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47eb006640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e41e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47eb006640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f47e40d4070 con 0x7f47e4163950 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47eb006640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4163430 con 0x7f47e40b6be0 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47eb006640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f47e40d41f0 con 0x7f47e40d3c60 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e41e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e41e9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42202/0 (socket says 172.21.15.6:42202) 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 -- 172.21.15.6:0/687981790 learned_addr learned my addr 172.21.15.6:0/687981790 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e8da2640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40b6be0 0x7f47e4152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e3fff640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40d3c60 0x7f47e41e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 -- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40d3c60 msgr2=0x7f47e41e9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40d3c60 0x7f47e41e9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 -- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40b6be0 msgr2=0x7f47e4152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40b6be0 0x7f47e4152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 -- 172.21.15.6:0/687981790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e41410b0 con 0x7f47e4163950 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e8da2640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40b6be0 0x7f47e4152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e95a3640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e41e9980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00d4e0 tx=0x7f47dc00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e17fa640 1 -- 172.21.15.6:0/687981790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc0125f0 con 0x7f47e4163950 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e17fa640 1 -- 172.21.15.6:0/687981790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc019070 con 0x7f47e4163950 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e41ea270 con 0x7f47e4163950 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47e17fa640 1 -- 172.21.15.6:0/687981790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc0129f0 con 0x7f47e4163950 2024-05-20T17:55:29.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.343+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e4141650 con 0x7f47e4163950 2024-05-20T17:55:29.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.345+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e41e9fe0 con 0x7f47e4163950 2024-05-20T17:55:29.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.345+0000 7f47e17fa640 1 -- 172.21.15.6:0/687981790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47dc012b90 con 0x7f47e4163950 2024-05-20T17:55:29.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.346+0000 7f47e17fa640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c406be30 0x7f47c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:29.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.346+0000 7f47e17fa640 1 -- 172.21.15.6:0/687981790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5778+0+0 (secure 0 0 0) 0x7f47dc08b230 con 0x7f47e4163950 2024-05-20T17:55:29.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.346+0000 7f47e8da2640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c406be30 0x7f47c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:29.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.347+0000 7f47e8da2640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c406be30 0x7f47c406e340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f47d4034000 tx=0x7f47d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:29.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.351+0000 7f47e17fa640 1 -- 172.21.15.6:0/687981790 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f47dc059b00 con 0x7f47e4163950 2024-05-20T17:55:29.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:29.538+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f47e40d1ab0 con 0x7f47e4163950 2024-05-20T17:55:30.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.192+0000 7f47e17fa640 1 -- 172.21.15.6:0/687981790 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7f47e40d1ab0 con 0x7f47e4163950 2024-05-20T17:55:30.191 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T17:55:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.198+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c406be30 msgr2=0x7f47c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.198+0000 7f47eb006640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c406be30 0x7f47c406e340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f47d4034000 tx=0x7f47d402e000 comp rx=0 tx=0).stop 2024-05-20T17:55:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.198+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 msgr2=0x7f47e41e9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.198+0000 7f47eb006640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e41e9980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00d4e0 tx=0x7f47dc00d9a0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.200+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 shutdown_connections 2024-05-20T17:55:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.200+0000 7f47eb006640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c406be30 0x7f47c406e340 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.200+0000 7f47eb006640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e4163950 0x7f47e41e9980 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.200+0000 7f47eb006640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e40d3c60 0x7f47e41e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.201+0000 7f47eb006640 1 --2- 172.21.15.6:0/687981790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e40b6be0 0x7f47e4152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.201+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 >> 172.21.15.6:0/687981790 conn(0x7f47e40d16a0 msgr2=0x7f47e415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.201+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 shutdown_connections 2024-05-20T17:55:30.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.201+0000 7f47eb006640 1 -- 172.21.15.6:0/687981790 wait complete. 2024-05-20T17:55:30.218 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T17:55:30.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.342+0000 7ff7c6702640 1 Processor -- start 2024-05-20T17:55:30.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.342+0000 7ff7c6702640 1 -- start start 2024-05-20T17:55:30.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7c6702640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7c006d3d0 0x7ff7c006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7c6702640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff7c00b8190 0x7ff7c00b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7c6702640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c006dd20 con 0x7ff7c0162820 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7c6702640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c00d0630 con 0x7ff7c006d3d0 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7c6702640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c00d39c0 con 0x7ff7c00b8190 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7bf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7c006d3d0 0x7ff7c006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7bf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7c006d3d0 0x7ff7c006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42214/0 (socket says 172.21.15.6:42214) 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7bf7fe640 1 -- 172.21.15.6:0/2478723523 learned_addr learned my addr 172.21.15.6:0/2478723523 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7c4c9f640 1 --2- 172.21.15.6:0/2478723523 >> v2:172.21.15.171:3300/0 conn(0x7ff7c00b8190 0x7ff7c00b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7bf7fe640 1 -- 172.21.15.6:0/2478723523 >> v2:172.21.15.171:3300/0 conn(0x7ff7c00b8190 msgr2=0x7ff7c00b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7bf7fe640 1 --2- 172.21.15.6:0/2478723523 >> v2:172.21.15.171:3300/0 conn(0x7ff7c00b8190 0x7ff7c00b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7bf7fe640 1 -- 172.21.15.6:0/2478723523 >> v1:172.21.15.171:6789/0 conn(0x7ff7c0162820 legacy=0x7ff7c00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.344+0000 7ff7bf7fe640 1 -- 172.21.15.6:0/2478723523 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c00d3ca0 con 0x7ff7c006d3d0 2024-05-20T17:55:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.345+0000 7ff7bf7fe640 1 --2- 172.21.15.6:0/2478723523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c006d3d0 0x7ff7c006d7e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff7c008e070 tx=0x7ff7b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb74f3fa28aad573 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.345+0000 7ff7beffd640 1 -- 172.21.15.6:0/2478723523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4037070 con 0x7ff7c006d3d0 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.345+0000 7ff7beffd640 1 -- 172.21.15.6:0/2478723523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b4032440 con 0x7ff7c006d3d0 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.345+0000 7ff7beffd640 1 -- 172.21.15.6:0/2478723523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4032810 con 0x7ff7c006d3d0 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.346+0000 7ff7c6702640 1 -- 172.21.15.6:0/2478723523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c006d3d0 msgr2=0x7ff7c006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.346+0000 7ff7c6702640 1 --2- 172.21.15.6:0/2478723523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c006d3d0 0x7ff7c006d7e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff7c008e070 tx=0x7ff7b402a270 comp rx=0 tx=0).stop 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.346+0000 7ff7c6702640 1 -- 172.21.15.6:0/2478723523 shutdown_connections 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.346+0000 7ff7c6702640 1 --2- 172.21.15.6:0/2478723523 >> v2:172.21.15.171:3300/0 conn(0x7ff7c00b8190 0x7ff7c00b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.346+0000 7ff7c6702640 1 --2- 172.21.15.6:0/2478723523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c006d3d0 0x7ff7c006d7e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.346+0000 7ff7c6702640 1 -- 172.21.15.6:0/2478723523 >> 172.21.15.6:0/2478723523 conn(0x7ff7c00d4bd0 msgr2=0x7ff7c00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.346+0000 7ff7c6702640 1 -- 172.21.15.6:0/2478723523 shutdown_connections 2024-05-20T17:55:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.346+0000 7ff7c6702640 1 -- 172.21.15.6:0/2478723523 wait complete. 2024-05-20T17:55:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.348+0000 7ff7c6702640 1 Processor -- start 2024-05-20T17:55:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.348+0000 7ff7c6702640 1 -- start start 2024-05-20T17:55:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7c6702640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7c006d3d0 0x7ff7c014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7c6702640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c00b8190 0x7ff7c00b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7c6702640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7c0162820 0x7ff7c014afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7c6702640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c00d0300 con 0x7ff7c00b8190 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7c6702640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c00d4260 con 0x7ff7c006d3d0 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7c6702640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c00b4050 con 0x7ff7c0162820 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c00b8190 0x7ff7c00b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c00b8190 0x7ff7c00b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42230/0 (socket says 172.21.15.6:42230) 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.349+0000 7ff7bf7fe640 1 -- 172.21.15.6:0/4032914780 learned_addr learned my addr 172.21.15.6:0/4032914780 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7c4c9f640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7c0162820 0x7ff7c014afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bffff640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7c006d3d0 0x7ff7c014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bf7fe640 1 -- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7c0162820 msgr2=0x7ff7c014afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bf7fe640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7c0162820 0x7ff7c014afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bf7fe640 1 -- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7c006d3d0 msgr2=0x7ff7c014e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bf7fe640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7c006d3d0 0x7ff7c014e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bf7fe640 1 -- 172.21.15.6:0/4032914780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c014b4f0 con 0x7ff7c00b8190 2024-05-20T17:55:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bf7fe640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c00b8190 0x7ff7c00b5d60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4000c00 tx=0x7ff7b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bcff9640 1 -- 172.21.15.6:0/4032914780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4041020 con 0x7ff7c00b8190 2024-05-20T17:55:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bcff9640 1 -- 172.21.15.6:0/4032914780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b40306c0 con 0x7ff7c00b8190 2024-05-20T17:55:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c00b6600 con 0x7ff7c00b8190 2024-05-20T17:55:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7bcff9640 1 -- 172.21.15.6:0/4032914780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4037040 con 0x7ff7c00b8190 2024-05-20T17:55:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.350+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c00b6bc0 con 0x7ff7c00b8190 2024-05-20T17:55:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.351+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c00b6350 con 0x7ff7c00b8190 2024-05-20T17:55:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.352+0000 7ff7bcff9640 1 -- 172.21.15.6:0/4032914780 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7b4044020 con 0x7ff7c00b8190 2024-05-20T17:55:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.352+0000 7ff7bcff9640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff7ac06be30 0x7ff7ac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.352+0000 7ff7bcff9640 1 -- 172.21.15.6:0/4032914780 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7ff7b40ab430 con 0x7ff7c00b8190 2024-05-20T17:55:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.353+0000 7ff7bffff640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff7ac06be30 0x7ff7ac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.353+0000 7ff7bffff640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff7ac06be30 0x7ff7ac06e340 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00016e0 tx=0x7ff7b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.357+0000 7ff7bcff9640 1 -- 172.21.15.6:0/4032914780 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff7b404b030 con 0x7ff7c00b8190 2024-05-20T17:55:30.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.543+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff7c0075b00 con 0x7ff7c00b8190 2024-05-20T17:55:30.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.547+0000 7ff7bcff9640 1 -- 172.21.15.6:0/4032914780 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7ff7b4079870 con 0x7ff7c00b8190 2024-05-20T17:55:30.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff7ac06be30 msgr2=0x7ff7ac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff7ac06be30 0x7ff7ac06e340 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00016e0 tx=0x7ff7b0009040 comp rx=0 tx=0).stop 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c00b8190 msgr2=0x7ff7c00b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c00b8190 0x7ff7c00b5d60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4000c00 tx=0x7ff7b40046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 shutdown_connections 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff7ac06be30 0x7ff7ac06e340 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff7c0162820 0x7ff7c014afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c00b8190 0x7ff7c00b5d60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 --2- 172.21.15.6:0/4032914780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7c006d3d0 0x7ff7c014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 >> 172.21.15.6:0/4032914780 conn(0x7ff7c00d4bd0 msgr2=0x7ff7c015e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 shutdown_connections 2024-05-20T17:55:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.549+0000 7ff7c6702640 1 -- 172.21.15.6:0/4032914780 wait complete. 2024-05-20T17:55:30.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_session_cap_acquisition_throttle 2024-05-20T17:55:30.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.677+0000 7f4e94cf0640 1 Processor -- start 2024-05-20T17:55:30.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.677+0000 7f4e94cf0640 1 -- start start 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e94cf0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e90162820 0x7f4e900b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e94cf0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e900b3e80 0x7f4e9006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e94cf0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4e9006d910 0x7f4e900d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e94cf0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9006dd20 con 0x7f4e90162820 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e94cf0640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4e900d0630 con 0x7f4e9006d910 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e94cf0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4e900d39c0 con 0x7f4e900b3e80 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e90162820 0x7f4e900b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e90162820 0x7f4e900b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42242/0 (socket says 172.21.15.6:42242) 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8e59c640 1 -- 172.21.15.6:0/3166242552 learned_addr learned my addr 172.21.15.6:0/3166242552 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8ed9d640 1 --2- 172.21.15.6:0/3166242552 >> v2:172.21.15.171:3300/0 conn(0x7f4e9006d910 0x7f4e900d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8dd9b640 1 --2- 172.21.15.6:0/3166242552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e900b3e80 0x7f4e9006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8e59c640 1 -- 172.21.15.6:0/3166242552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e900b3e80 msgr2=0x7f4e9006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8e59c640 1 --2- 172.21.15.6:0/3166242552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e900b3e80 0x7f4e9006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8e59c640 1 -- 172.21.15.6:0/3166242552 >> v2:172.21.15.171:3300/0 conn(0x7f4e9006d910 msgr2=0x7f4e900d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8e59c640 1 --2- 172.21.15.6:0/3166242552 >> v2:172.21.15.171:3300/0 conn(0x7f4e9006d910 0x7f4e900d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8e59c640 1 -- 172.21.15.6:0/3166242552 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e900d3ca0 con 0x7f4e90162820 2024-05-20T17:55:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8ed9d640 1 --2- 172.21.15.6:0/3166242552 >> v2:172.21.15.171:3300/0 conn(0x7f4e9006d910 0x7f4e900d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.679+0000 7f4e8dd9b640 1 --2- 172.21.15.6:0/3166242552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e900b3e80 0x7f4e9006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.680+0000 7f4e8e59c640 1 --2- 172.21.15.6:0/3166242552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e90162820 0x7f4e900b3940 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4e9008d5e0 tx=0x7f4e8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8618db557b6df91 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.680+0000 7f4e8d59a640 1 -- 172.21.15.6:0/3166242552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80037070 con 0x7f4e90162820 2024-05-20T17:55:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.680+0000 7f4e8d59a640 1 -- 172.21.15.6:0/3166242552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e80032440 con 0x7f4e90162820 2024-05-20T17:55:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.680+0000 7f4e8d59a640 1 -- 172.21.15.6:0/3166242552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80032810 con 0x7f4e90162820 2024-05-20T17:55:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 -- 172.21.15.6:0/3166242552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e90162820 msgr2=0x7f4e900b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/3166242552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e90162820 0x7f4e900b3940 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4e9008d5e0 tx=0x7f4e8002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 -- 172.21.15.6:0/3166242552 shutdown_connections 2024-05-20T17:55:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/3166242552 >> v2:172.21.15.171:3300/0 conn(0x7f4e9006d910 0x7f4e900d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/3166242552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e900b3e80 0x7f4e9006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/3166242552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e90162820 0x7f4e900b3940 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 -- 172.21.15.6:0/3166242552 >> 172.21.15.6:0/3166242552 conn(0x7f4e900d4bd0 msgr2=0x7f4e900d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 -- 172.21.15.6:0/3166242552 shutdown_connections 2024-05-20T17:55:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.681+0000 7f4e94cf0640 1 -- 172.21.15.6:0/3166242552 wait complete. 2024-05-20T17:55:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.683+0000 7f4e94cf0640 1 Processor -- start 2024-05-20T17:55:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.683+0000 7f4e94cf0640 1 -- start start 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e94cf0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e9006d910 0x7f4e9014afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e94cf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e900b3e80 0x7f4e9015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e94cf0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e90162820 0x7f4e9015a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e94cf0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4e900d0300 con 0x7f4e900b3e80 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e94cf0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e900d4260 con 0x7f4e9006d910 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e94cf0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4e900d4780 con 0x7f4e90162820 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e8dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e900b3e80 0x7f4e9015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e8dd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e900b3e80 0x7f4e9015a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42246/0 (socket says 172.21.15.6:42246) 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.684+0000 7f4e8dd9b640 1 -- 172.21.15.6:0/2448933669 learned_addr learned my addr 172.21.15.6:0/2448933669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8e59c640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e9006d910 0x7f4e9014afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8ed9d640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e90162820 0x7f4e9015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8dd9b640 1 -- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e90162820 msgr2=0x7f4e9015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8dd9b640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e90162820 0x7f4e9015a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8dd9b640 1 -- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e9006d910 msgr2=0x7f4e9014afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8dd9b640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e9006d910 0x7f4e9014afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8dd9b640 1 -- 172.21.15.6:0/2448933669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9014b4f0 con 0x7f4e900b3e80 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8ed9d640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e90162820 0x7f4e9015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e8dd9b640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e900b3e80 0x7f4e9015a130 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400d7d0 tx=0x7f4e8400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e7effd640 1 -- 172.21.15.6:0/2448933669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84004030 con 0x7f4e900b3e80 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e7effd640 1 -- 172.21.15.6:0/2448933669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e840041d0 con 0x7f4e900b3e80 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e901587a0 con 0x7f4e900b3e80 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e7effd640 1 -- 172.21.15.6:0/2448933669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e840096a0 con 0x7f4e900b3e80 2024-05-20T17:55:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.685+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e900cb840 con 0x7f4e900b3e80 2024-05-20T17:55:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.686+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9006e3f0 con 0x7f4e900b3e80 2024-05-20T17:55:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.687+0000 7f4e7effd640 1 -- 172.21.15.6:0/2448933669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e84009840 con 0x7f4e900b3e80 2024-05-20T17:55:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.687+0000 7f4e7effd640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4e7006be30 0x7f4e7006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.687+0000 7f4e7effd640 1 -- 172.21.15.6:0/2448933669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f4e8408aef0 con 0x7f4e900b3e80 2024-05-20T17:55:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.687+0000 7f4e8e59c640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4e7006be30 0x7f4e7006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.688+0000 7f4e8e59c640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4e7006be30 0x7f4e7006e340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4e80034000 tx=0x7f4e8002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.692+0000 7f4e7effd640 1 -- 172.21.15.6:0/2448933669 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4e84059aa0 con 0x7f4e900b3e80 2024-05-20T17:55:30.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.884+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"} v 0) -- 0x7f4e90075b00 con 0x7f4e900b3e80 2024-05-20T17:55:30.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.887+0000 7f4e7effd640 1 -- 172.21.15.6:0/2448933669 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"}]=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7f4e840593a0 con 0x7f4e900b3e80 2024-05-20T17:55:30.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4e7006be30 msgr2=0x7f4e7006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4e7006be30 0x7f4e7006e340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4e80034000 tx=0x7f4e8002e000 comp rx=0 tx=0).stop 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e900b3e80 msgr2=0x7f4e9015a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e900b3e80 0x7f4e9015a130 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400d7d0 tx=0x7f4e8400dc90 comp rx=0 tx=0).stop 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 shutdown_connections 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4e7006be30 0x7f4e7006e340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4e90162820 0x7f4e9015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e900b3e80 0x7f4e9015a130 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 --2- 172.21.15.6:0/2448933669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e9006d910 0x7f4e9014afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 >> 172.21.15.6:0/2448933669 conn(0x7f4e900d4bd0 msgr2=0x7f4e90160740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 shutdown_connections 2024-05-20T17:55:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:30.889+0000 7f4e94cf0640 1 -- 172.21.15.6:0/2448933669 wait complete. 2024-05-20T17:55:30.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_caps_per_client 2024-05-20T17:55:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.017+0000 7f5ce0545640 1 Processor -- start 2024-05-20T17:55:31.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.017+0000 7f5ce0545640 1 -- start start 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5ce0545640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5cd8168050 0x7f5cd816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5ce0545640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd80d0630 con 0x7f5cd806d3d0 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5ce0545640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd80d39c0 con 0x7f5cd8162820 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5ce0545640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd80d3ca0 con 0x7f5cd8168050 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cddae0640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5cd806d3d0 0x7f5cd806d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54314/0 (socket says 172.21.15.6:54314) 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cddae0640 1 -- 172.21.15.6:0/3960485058 learned_addr learned my addr 172.21.15.6:0/3960485058 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdeae2640 1 --2- 172.21.15.6:0/3960485058 >> v2:172.21.15.171:3300/0 conn(0x7f5cd8168050 0x7f5cd816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472621206 0 0) 0x7f5cd80d0630 con 0x7f5cd806d3d0 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc4003520 con 0x7f5cd806d3d0 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 639053320 0 0) 0x7f5cc4003520 con 0x7f5cd806d3d0 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 >> v2:172.21.15.171:3300/0 conn(0x7f5cd8168050 msgr2=0x7f5cd816a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 --2- 172.21.15.6:0/3960485058 >> v2:172.21.15.171:3300/0 conn(0x7f5cd8168050 0x7f5cd816a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 >> v1:172.21.15.171:6789/0 conn(0x7f5cd8162820 legacy=0x7f5cd80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd80d3f80 con 0x7f5cd806d3d0 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5cc8001670 con 0x7f5cd806d3d0 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 >> v1:172.21.15.6:6789/0 conn(0x7f5cd806d3d0 legacy=0x7f5cd806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40039b0 0x7f5cc4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.019+0000 7f5cdd2df640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc4004800 0x7f5cc4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cdd2df640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc40051c0 0x7f5cc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd80d3ca0 con 0x7f5cc40039b0 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc400c160 con 0x7f5cc4004800 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc400c360 con 0x7f5cc40051c0 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cde2e1640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40039b0 0x7f5cc4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cddae0640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc4004800 0x7f5cc4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cdeae2640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc40051c0 0x7f5cc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cde2e1640 1 -- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc40051c0 msgr2=0x7f5cc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cde2e1640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc40051c0 0x7f5cc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cde2e1640 1 -- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc4004800 msgr2=0x7f5cc4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cde2e1640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc4004800 0x7f5cc4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cde2e1640 1 -- 172.21.15.6:0/3960485058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc4003520 con 0x7f5cc40039b0 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cdeae2640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cc40051c0 0x7f5cc400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.020+0000 7f5cdeae2640 1 -- 172.21.15.6:0/3960485058 reap_dead start 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.021+0000 7f5cde2e1640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40039b0 0x7f5cc4003e20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4001e50 tx=0x7f5cc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0c81da96120160 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.021+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4001a70 con 0x7f5cc40039b0 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.021+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd402ad80 con 0x7f5cc40039b0 2024-05-20T17:55:31.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.021+0000 7f5cdd2df640 1 -- 172.21.15.6:0/3960485058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4003bb0 con 0x7f5cc40039b0 2024-05-20T17:55:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.021+0000 7f5ce0545640 1 -- 172.21.15.6:0/3960485058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40039b0 msgr2=0x7f5cc4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.021+0000 7f5ce0545640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40039b0 0x7f5cc4003e20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4001e50 tx=0x7f5cc4005830 comp rx=0 tx=0).stop 2024-05-20T17:55:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.022+0000 7f5ce0545640 1 -- 172.21.15.6:0/3960485058 shutdown_connections 2024-05-20T17:55:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.022+0000 7f5ce0545640 1 --2- 172.21.15.6:0/3960485058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cc40039b0 0x7f5cc4003e20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.022+0000 7f5ce0545640 1 -- 172.21.15.6:0/3960485058 >> 172.21.15.6:0/3960485058 conn(0x7f5cd80d4bd0 msgr2=0x7f5cd80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.022+0000 7f5ce0545640 1 -- 172.21.15.6:0/3960485058 shutdown_connections 2024-05-20T17:55:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.022+0000 7f5ce0545640 1 -- 172.21.15.6:0/3960485058 wait complete. 2024-05-20T17:55:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.023+0000 7f5ce0545640 1 Processor -- start 2024-05-20T17:55:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.023+0000 7f5ce0545640 1 -- start start 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5ce0545640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc40039b0 0x7f5cd815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5ce0545640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd80ce320 0x7f5cd80ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5ce0545640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd80b5c60 0x7f5cd80b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5ce0545640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd80d4780 con 0x7f5cd80ce320 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5ce0545640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd80d0300 con 0x7f5cc40039b0 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5ce0545640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd80d4900 con 0x7f5cd80b5c60 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd80ce320 0x7f5cd80ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd80ce320 0x7f5cd80ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42274/0 (socket says 172.21.15.6:42274) 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 -- 172.21.15.6:0/4267149480 learned_addr learned my addr 172.21.15.6:0/4267149480 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:31.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cdeae2640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd80b5c60 0x7f5cd80b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cde2e1640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc40039b0 0x7f5cd815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 -- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd80b5c60 msgr2=0x7f5cd80b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd80b5c60 0x7f5cd80b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 -- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc40039b0 msgr2=0x7f5cd815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc40039b0 0x7f5cd815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 -- 172.21.15.6:0/4267149480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd80b65b0 con 0x7f5cd80ce320 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.025+0000 7f5cddae0640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd80ce320 0x7f5cd80ce730 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8004f20 tx=0x7f5cc80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.026+0000 7f5cceffd640 1 -- 172.21.15.6:0/4267149480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800f7b0 con 0x7f5cd80ce320 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.026+0000 7f5cceffd640 1 -- 172.21.15.6:0/4267149480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc8018070 con 0x7f5cd80ce320 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.026+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd80cd5c0 con 0x7f5cd80ce320 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.026+0000 7f5cceffd640 1 -- 172.21.15.6:0/4267149480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800fbb0 con 0x7f5cd80ce320 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.026+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd80cd000 con 0x7f5cd80ce320 2024-05-20T17:55:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.027+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd80cca80 con 0x7f5cd80ce320 2024-05-20T17:55:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.027+0000 7f5cceffd640 1 -- 172.21.15.6:0/4267149480 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cc800fd50 con 0x7f5cd80ce320 2024-05-20T17:55:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.028+0000 7f5cceffd640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cbc06be60 0x7f5cbc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.028+0000 7f5cceffd640 1 -- 172.21.15.6:0/4267149480 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f5cc808ab10 con 0x7f5cd80ce320 2024-05-20T17:55:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.028+0000 7f5cde2e1640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cbc06be60 0x7f5cbc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.029+0000 7f5cde2e1640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cbc06be60 0x7f5cbc06e370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4032000 tx=0x7f5cd402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:31.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.033+0000 7f5cceffd640 1 -- 172.21.15.6:0/4267149480 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5cd80cca80 con 0x7f5cd80ce320 2024-05-20T17:55:31.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.216+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"} v 0) -- 0x7f5cd8075b00 con 0x7f5cd80ce320 2024-05-20T17:55:31.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.219+0000 7f5cceffd640 1 -- 172.21.15.6:0/4267149480 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"}]=0 v15) ==== 106+0+0 (secure 0 0 0) 0x7f5cd80b65b0 con 0x7f5cd80ce320 2024-05-20T17:55:31.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cbc06be60 msgr2=0x7f5cbc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cbc06be60 0x7f5cbc06e370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4032000 tx=0x7f5cd402e000 comp rx=0 tx=0).stop 2024-05-20T17:55:31.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd80ce320 msgr2=0x7f5cd80ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd80ce320 0x7f5cd80ce730 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8004f20 tx=0x7f5cc80074f0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 shutdown_connections 2024-05-20T17:55:31.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cbc06be60 0x7f5cbc06e370 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd80b5c60 0x7f5cd80b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd80ce320 0x7f5cd80ce730 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 --2- 172.21.15.6:0/4267149480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cc40039b0 0x7f5cd815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 >> 172.21.15.6:0/4267149480 conn(0x7f5cd80d4bd0 msgr2=0x7f5cd80b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:31.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 shutdown_connections 2024-05-20T17:55:31.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.221+0000 7f5ce0545640 1 -- 172.21.15.6:0/4267149480 wait complete. 2024-05-20T17:55:31.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2024-05-20T17:55:31.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.347+0000 7f2831d3e640 1 Processor -- start 2024-05-20T17:55:31.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.347+0000 7f2831d3e640 1 -- start start 2024-05-20T17:55:31.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f2831d3e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f282c162820 0x7f282c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f2831d3e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f282c0b3e80 0x7f282c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f2831d3e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282c06dd20 con 0x7f282c06d910 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f2831d3e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f282c0d0630 con 0x7f282c162820 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f2831d3e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f282c0d39c0 con 0x7f282c0b3e80 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f282b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f282c162820 0x7f282c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f282b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f282c162820 0x7f282c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42286/0 (socket says 172.21.15.6:42286) 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f282b7fe640 1 -- 172.21.15.6:0/1279756651 learned_addr learned my addr 172.21.15.6:0/1279756651 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.348+0000 7f282affd640 1 --2- 172.21.15.6:0/1279756651 >> v2:172.21.15.171:3300/0 conn(0x7f282c0b3e80 0x7f282c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.349+0000 7f282b7fe640 1 -- 172.21.15.6:0/1279756651 >> v2:172.21.15.171:3300/0 conn(0x7f282c0b3e80 msgr2=0x7f282c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.349+0000 7f282b7fe640 1 --2- 172.21.15.6:0/1279756651 >> v2:172.21.15.171:3300/0 conn(0x7f282c0b3e80 0x7f282c06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.349+0000 7f282b7fe640 1 -- 172.21.15.6:0/1279756651 >> v1:172.21.15.171:6789/0 conn(0x7f282c06d910 legacy=0x7f282c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.349+0000 7f282b7fe640 1 -- 172.21.15.6:0/1279756651 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c0d3ca0 con 0x7f282c162820 2024-05-20T17:55:31.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.349+0000 7f282b7fe640 1 --2- 172.21.15.6:0/1279756651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c0b3940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f282c0d1230 tx=0x7f281c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85b30c7f4553c1b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f282a7fc640 1 -- 172.21.15.6:0/1279756651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c037070 con 0x7f282c162820 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f282a7fc640 1 -- 172.21.15.6:0/1279756651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c032440 con 0x7f282c162820 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f282a7fc640 1 -- 172.21.15.6:0/1279756651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c032810 con 0x7f282c162820 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f2831d3e640 1 -- 172.21.15.6:0/1279756651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 msgr2=0x7f282c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f2831d3e640 1 --2- 172.21.15.6:0/1279756651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c0b3940 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f282c0d1230 tx=0x7f281c02a270 comp rx=0 tx=0).stop 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f2831d3e640 1 -- 172.21.15.6:0/1279756651 shutdown_connections 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f2831d3e640 1 --2- 172.21.15.6:0/1279756651 >> v2:172.21.15.171:3300/0 conn(0x7f282c0b3e80 0x7f282c06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f2831d3e640 1 --2- 172.21.15.6:0/1279756651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c0b3940 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f2831d3e640 1 -- 172.21.15.6:0/1279756651 >> 172.21.15.6:0/1279756651 conn(0x7f282c0d4bd0 msgr2=0x7f282c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f2831d3e640 1 -- 172.21.15.6:0/1279756651 shutdown_connections 2024-05-20T17:55:31.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.350+0000 7f2831d3e640 1 -- 172.21.15.6:0/1279756651 wait complete. 2024-05-20T17:55:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.352+0000 7f2831d3e640 1 Processor -- start 2024-05-20T17:55:31.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.352+0000 7f2831d3e640 1 -- start start 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f2831d3e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282c06d910 0x7f282c14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f2831d3e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282c0b3e80 0x7f282c1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f2831d3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c1f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f2831d3e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f282c0d0300 con 0x7f282c162820 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f2831d3e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f282c0d4260 con 0x7f282c06d910 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f2831d3e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f282c0b91a0 con 0x7f282c0b3e80 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c1f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c1f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42302/0 (socket says 172.21.15.6:42302) 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 -- 172.21.15.6:0/67897388 learned_addr learned my addr 172.21.15.6:0/67897388 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282b7fe640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282c06d910 0x7f282c14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282affd640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282c0b3e80 0x7f282c1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 -- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282c0b3e80 msgr2=0x7f282c1487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282c0b3e80 0x7f282c1487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 -- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282c06d910 msgr2=0x7f282c14b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282c06d910 0x7f282c14b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 -- 172.21.15.6:0/67897388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c0cce00 con 0x7f282c162820 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f282bfff640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c1f4bf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f282400c6b0 tx=0x7f282400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.354+0000 7f2813fff640 1 -- 172.21.15.6:0/67897388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824003b70 con 0x7f282c162820 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.355+0000 7f2813fff640 1 -- 172.21.15.6:0/67897388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2824003d30 con 0x7f282c162820 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.355+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c0cd0e0 con 0x7f282c162820 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.355+0000 7f2813fff640 1 -- 172.21.15.6:0/67897388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824005310 con 0x7f282c162820 2024-05-20T17:55:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.355+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c0cd6a0 con 0x7f282c162820 2024-05-20T17:55:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.356+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282c075b00 con 0x7f282c162820 2024-05-20T17:55:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.356+0000 7f2813fff640 1 -- 172.21.15.6:0/67897388 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28240054b0 con 0x7f282c162820 2024-05-20T17:55:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.357+0000 7f2813fff640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281806be60 0x7f281806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.357+0000 7f2813fff640 1 -- 172.21.15.6:0/67897388 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f282408aad0 con 0x7f282c162820 2024-05-20T17:55:31.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.357+0000 7f282b7fe640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281806be60 0x7f281806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:31.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.358+0000 7f282b7fe640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281806be60 0x7f281806e370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f281c034000 tx=0x7f281c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.362+0000 7f2813fff640 1 -- 172.21.15.6:0/67897388 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f282c06dd20 con 0x7f282c162820 2024-05-20T17:55:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:31.617+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) -- 0x7f282c160b70 con 0x7f282c162820 2024-05-20T17:55:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.202+0000 7f2813fff640 1 -- 172.21.15.6:0/67897388 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v145) ==== 165+0+0 (secure 0 0 0) 0x7f2824058f10 con 0x7f282c162820 2024-05-20T17:55:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281806be60 msgr2=0x7f281806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281806be60 0x7f281806e370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f281c034000 tx=0x7f281c02e000 comp rx=0 tx=0).stop 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 msgr2=0x7f282c1f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c1f4bf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f282400c6b0 tx=0x7f282400cb70 comp rx=0 tx=0).stop 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 shutdown_connections 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281806be60 0x7f281806e370 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f282c162820 0x7f282c1f4bf0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f282c0b3e80 0x7f282c1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 --2- 172.21.15.6:0/67897388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f282c06d910 0x7f282c14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.205+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 >> 172.21.15.6:0/67897388 conn(0x7f282c0d4bd0 msgr2=0x7f282c0b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.206+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 shutdown_connections 2024-05-20T17:55:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.206+0000 7f2831d3e640 1 -- 172.21.15.6:0/67897388 wait complete. 2024-05-20T17:55:32.218 INFO:tasks.cephfs_test_runner:Mostly readdir acquires caps faster than the mds recalls, so the cap ... ok 2024-05-20T17:55:32.218 INFO:tasks.cephfs_test_runner:Starting test: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) that a client is blocklisted when its encoded session metadata exceeds the 2024-05-20T17:55:32.218 INFO:tasks.cephfs_test_runner:test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T17:55:32.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.342+0000 7f088e5d5640 1 Processor -- start 2024-05-20T17:55:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.342+0000 7f088e5d5640 1 -- start start 2024-05-20T17:55:32.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.343+0000 7f088e5d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f088815d530 0x7f088815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.343+0000 7f088e5d5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08880cd580 con 0x7f08880b1700 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.343+0000 7f088e5d5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08880cd860 con 0x7f0888070850 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.343+0000 7f088e5d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f08880ce190 con 0x7f088815d530 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.343+0000 7f08877fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f08880b1700 0x7f08880b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54322/0 (socket says 172.21.15.6:54322) 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.343+0000 7f08877fe640 1 -- 172.21.15.6:0/345982849 learned_addr learned my addr 172.21.15.6:0/345982849 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0887fff640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f088815d530 0x7f088815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259130153 0 0) 0x7f08880cd580 con 0x7f08880b1700 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0870003520 con 0x7f08880b1700 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190629168 0 0) 0x7f08880cd860 con 0x7f0888070850 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08880cd580 con 0x7f0888070850 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 729093270 0 0) 0x7f0870003520 con 0x7f08880b1700 2024-05-20T17:55:32.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f088815d530 msgr2=0x7f088815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f088815d530 0x7f088815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 >> v1:172.21.15.171:6789/0 conn(0x7f0888070850 legacy=0x7f0888070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880cdb40 con 0x7f08880b1700 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f087c001670 con 0x7f08880b1700 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 >> v1:172.21.15.6:6789/0 conn(0x7f08880b1700 legacy=0x7f08880b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870003b70 0x7f0870003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870004800 0x7f0870004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08700051a0 0x7f087000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f08880ce190 con 0x7f0870004800 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f087000c0f0 con 0x7f08700051a0 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f087000c2f0 con 0x7f0870003b70 2024-05-20T17:55:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f0887fff640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f088815d530 0x7f088815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.344+0000 7f08877fe640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870004800 0x7f0870004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f088cb72640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08700051a0 0x7f087000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f0887fff640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870003b70 0x7f0870003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f08877fe640 1 -- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870003b70 msgr2=0x7f0870003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f08877fe640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870003b70 0x7f0870003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f08877fe640 1 -- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08700051a0 msgr2=0x7f087000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f08877fe640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08700051a0 0x7f087000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f08877fe640 1 -- 172.21.15.6:0/345982849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0870003520 con 0x7f0870004800 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f088cb72640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08700051a0 0x7f087000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.345+0000 7f08877fe640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870004800 0x7f0870004c10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f08880d3ad0 tx=0x7f0870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792b45492af86848 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c007c00 con 0x7f0870004800 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c005ad0 con 0x7f0870004800 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f0886ffd640 1 -- 172.21.15.6:0/345982849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c007070 con 0x7f0870004800 2024-05-20T17:55:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f088e5d5640 1 -- 172.21.15.6:0/345982849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870004800 msgr2=0x7f0870004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f088e5d5640 1 --2- 172.21.15.6:0/345982849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0870004800 0x7f0870004c10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f08880d3ad0 tx=0x7f0870005830 comp rx=0 tx=0).stop 2024-05-20T17:55:32.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f088cb72640 1 -- 172.21.15.6:0/345982849 reap_dead start 2024-05-20T17:55:32.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f088e5d5640 1 -- 172.21.15.6:0/345982849 shutdown_connections 2024-05-20T17:55:32.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f088e5d5640 1 -- 172.21.15.6:0/345982849 >> 172.21.15.6:0/345982849 conn(0x7f08880d29d0 msgr2=0x7f08880d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:32.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f088e5d5640 1 -- 172.21.15.6:0/345982849 shutdown_connections 2024-05-20T17:55:32.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.346+0000 7f088e5d5640 1 -- 172.21.15.6:0/345982849 wait complete. 2024-05-20T17:55:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.348+0000 7f088e5d5640 1 Processor -- start 2024-05-20T17:55:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.348+0000 7f088e5d5640 1 -- start start 2024-05-20T17:55:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f088e5d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870004800 0x7f08880c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f088e5d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880c90c0 0x7f08881f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f088e5d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08881f9180 0x7f088806c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f088e5d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0888071370 con 0x7f08880c90c0 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f088e5d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08880cd230 con 0x7f08881f9180 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f088e5d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f08880714f0 con 0x7f0870004800 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880c90c0 0x7f08881f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880c90c0 0x7f08881f8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42324/0 (socket says 172.21.15.6:42324) 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 -- 172.21.15.6:0/3299710231 learned_addr learned my addr 172.21.15.6:0/3299710231 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f0887fff640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870004800 0x7f08880c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f088cb72640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08881f9180 0x7f088806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 -- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870004800 msgr2=0x7f08880c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870004800 0x7f08880c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 -- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08881f9180 msgr2=0x7f088806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08881f9180 0x7f088806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 -- 172.21.15.6:0/3299710231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880c69f0 con 0x7f08880c90c0 2024-05-20T17:55:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.350+0000 7f08877fe640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880c90c0 0x7f08881f8c40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c1d0 tx=0x7f08880cd750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.351+0000 7f0884ff9640 1 -- 172.21.15.6:0/3299710231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c040020 con 0x7f08880c90c0 2024-05-20T17:55:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.351+0000 7f0884ff9640 1 -- 172.21.15.6:0/3299710231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c001470 con 0x7f08880c90c0 2024-05-20T17:55:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.351+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08880c6cd0 con 0x7f08880c90c0 2024-05-20T17:55:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.351+0000 7f0884ff9640 1 -- 172.21.15.6:0/3299710231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c037040 con 0x7f08880c90c0 2024-05-20T17:55:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.351+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08880c7290 con 0x7f08880c90c0 2024-05-20T17:55:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.352+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08880b8200 con 0x7f08880c90c0 2024-05-20T17:55:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.352+0000 7f0884ff9640 1 -- 172.21.15.6:0/3299710231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f087c043020 con 0x7f08880c90c0 2024-05-20T17:55:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.353+0000 7f0884ff9640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f087406be60 0x7f087406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.353+0000 7f0884ff9640 1 -- 172.21.15.6:0/3299710231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f087c0aa140 con 0x7f08880c90c0 2024-05-20T17:55:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.353+0000 7f0887fff640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f087406be60 0x7f087406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.354+0000 7f0887fff640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f087406be60 0x7f087406e370 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f088804f790 tx=0x7f0878008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.358+0000 7f0884ff9640 1 -- 172.21.15.6:0/3299710231 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f08880b8200 con 0x7f08880c90c0 2024-05-20T17:55:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.545+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0888075b00 con 0x7f08880c90c0 2024-05-20T17:55:32.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.546+0000 7f0884ff9640 1 -- 172.21.15.6:0/3299710231 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13243 (secure 0 0 0) 0x7f087c078db0 con 0x7f08880c90c0 2024-05-20T17:55:32.545 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:32.545 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:30.191802+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/3387888972":"2024-05-21T17:55:27.183842+0000","172.21.15.6:6832/3387888972":"2024-05-21T17:55:27.183842+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:32.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f087406be60 msgr2=0x7f087406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f087406be60 0x7f087406e370 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f088804f790 tx=0x7f0878008040 comp rx=0 tx=0).stop 2024-05-20T17:55:32.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880c90c0 msgr2=0x7f08881f8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880c90c0 0x7f08881f8c40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f087c00c1d0 tx=0x7f08880cd750 comp rx=0 tx=0).stop 2024-05-20T17:55:32.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 shutdown_connections 2024-05-20T17:55:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f087406be60 0x7f087406e370 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08881f9180 0x7f088806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08880c90c0 0x7f08881f8c40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 --2- 172.21.15.6:0/3299710231 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0870004800 0x7f08880c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 >> 172.21.15.6:0/3299710231 conn(0x7f08880d29d0 msgr2=0x7f08880d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 shutdown_connections 2024-05-20T17:55:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.548+0000 7f088e5d5640 1 -- 172.21.15.6:0/3299710231 wait complete. 2024-05-20T17:55:32.558 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:55:32.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:55:32.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.677+0000 7f83eb8e2640 1 Processor -- start 2024-05-20T17:55:32.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.678+0000 7f83eb8e2640 1 -- start start 2024-05-20T17:55:32.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83eb8e2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83e4162820 0x7f83e40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83eb8e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e406dae0 0x7f83e40b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83eb8e2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e40d0630 con 0x7f83e40b3e80 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83eb8e2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f83e40d39c0 con 0x7f83e4162820 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83eb8e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f83e40d3ca0 con 0x7f83e406dae0 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83e967e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83e4162820 0x7f83e40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83e967e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83e4162820 0x7f83e40b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42328/0 (socket says 172.21.15.6:42328) 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83e967e640 1 -- 172.21.15.6:0/2028433187 learned_addr learned my addr 172.21.15.6:0/2028433187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83e9e7f640 1 --2- 172.21.15.6:0/2028433187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e406dae0 0x7f83e40b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83e967e640 1 -- 172.21.15.6:0/2028433187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e406dae0 msgr2=0x7f83e40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83e967e640 1 --2- 172.21.15.6:0/2028433187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e406dae0 0x7f83e40b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83e967e640 1 -- 172.21.15.6:0/2028433187 >> v1:172.21.15.171:6789/0 conn(0x7f83e40b3e80 legacy=0x7f83e406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:32.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.679+0000 7f83e967e640 1 -- 172.21.15.6:0/2028433187 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e40d3f80 con 0x7f83e4162820 2024-05-20T17:55:32.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.680+0000 7f83e967e640 1 --2- 172.21.15.6:0/2028433187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e4162820 0x7f83e40b3940 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009e50 tx=0x7f83d402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce7f1f04bdbc963 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.680+0000 7f83e3fff640 1 -- 172.21.15.6:0/2028433187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4036070 con 0x7f83e4162820 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.680+0000 7f83e3fff640 1 -- 172.21.15.6:0/2028433187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d4031600 con 0x7f83e4162820 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.680+0000 7f83e3fff640 1 -- 172.21.15.6:0/2028433187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d40319d0 con 0x7f83e4162820 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.681+0000 7f83eb8e2640 1 -- 172.21.15.6:0/2028433187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e4162820 msgr2=0x7f83e40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.681+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/2028433187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e4162820 0x7f83e40b3940 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009e50 tx=0x7f83d402a6c0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.681+0000 7f83eb8e2640 1 -- 172.21.15.6:0/2028433187 shutdown_connections 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.681+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/2028433187 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e406dae0 0x7f83e40b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.681+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/2028433187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e4162820 0x7f83e40b3940 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.681+0000 7f83eb8e2640 1 -- 172.21.15.6:0/2028433187 >> 172.21.15.6:0/2028433187 conn(0x7f83e40d4bd0 msgr2=0x7f83e40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.681+0000 7f83eb8e2640 1 -- 172.21.15.6:0/2028433187 shutdown_connections 2024-05-20T17:55:32.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.681+0000 7f83eb8e2640 1 -- 172.21.15.6:0/2028433187 wait complete. 2024-05-20T17:55:32.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.683+0000 7f83eb8e2640 1 Processor -- start 2024-05-20T17:55:32.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.683+0000 7f83eb8e2640 1 -- start start 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.684+0000 7f83eb8e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83e40b3e80 0x7f83e41f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.684+0000 7f83eb8e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e4162820 0x7f83e40c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.684+0000 7f83eb8e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c9c90 0x7f83e41f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.684+0000 7f83eb8e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83e40d4780 con 0x7f83e40c9c90 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.684+0000 7f83eb8e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f83e40d0300 con 0x7f83e40b3e80 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.684+0000 7f83eb8e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f83e40d4900 con 0x7f83e4162820 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.684+0000 7f83e9e7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c9c90 0x7f83e41f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e9e7f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c9c90 0x7f83e41f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42340/0 (socket says 172.21.15.6:42340) 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e9e7f640 1 -- 172.21.15.6:0/1127419961 learned_addr learned my addr 172.21.15.6:0/1127419961 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e8e7d640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e4162820 0x7f83e40c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e967e640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83e40b3e80 0x7f83e41f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e9e7f640 1 -- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e4162820 msgr2=0x7f83e40c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e9e7f640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e4162820 0x7f83e40c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e9e7f640 1 -- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83e40b3e80 msgr2=0x7f83e41f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e9e7f640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83e40b3e80 0x7f83e41f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e9e7f640 1 -- 172.21.15.6:0/1127419961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e40ca460 con 0x7f83e40c9c90 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e9e7f640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c9c90 0x7f83e41f5000 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00d510 tx=0x7f83dc00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e1ffb640 1 -- 172.21.15.6:0/1127419961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc0125f0 con 0x7f83e40c9c90 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e1ffb640 1 -- 172.21.15.6:0/1127419961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83dc019070 con 0x7f83e40c9c90 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e40ca740 con 0x7f83e40c9c90 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83e1ffb640 1 -- 172.21.15.6:0/1127419961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc0129f0 con 0x7f83e40c9c90 2024-05-20T17:55:32.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.685+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e40cad00 con 0x7f83e40c9c90 2024-05-20T17:55:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.687+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e4075b00 con 0x7f83e40c9c90 2024-05-20T17:55:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.687+0000 7f83e1ffb640 1 -- 172.21.15.6:0/1127419961 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83dc012b90 con 0x7f83e40c9c90 2024-05-20T17:55:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.688+0000 7f83e1ffb640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83d006be60 0x7f83d006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.688+0000 7f83e1ffb640 1 -- 172.21.15.6:0/1127419961 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f83dc08af40 con 0x7f83e40c9c90 2024-05-20T17:55:32.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.688+0000 7f83e967e640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83d006be60 0x7f83d006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.689+0000 7f83e967e640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83d006be60 0x7f83d006e370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83d4033000 tx=0x7f83d4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.693+0000 7f83e1ffb640 1 -- 172.21.15.6:0/1127419961 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f83dc059380 con 0x7f83e40c9c90 2024-05-20T17:55:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.878+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f83e4161dd0 con 0x7f83e40c9c90 2024-05-20T17:55:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.879+0000 7f83e1ffb640 1 -- 172.21.15.6:0/1127419961 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) ==== 93+0+10 (secure 0 0 0) 0x7f83dc05d680 con 0x7f83e40c9c90 2024-05-20T17:55:32.878 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:55:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83d006be60 msgr2=0x7f83d006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83d006be60 0x7f83d006e370 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83d4033000 tx=0x7f83d4009000 comp rx=0 tx=0).stop 2024-05-20T17:55:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c9c90 msgr2=0x7f83e41f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c9c90 0x7f83e41f5000 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00d510 tx=0x7f83dc00d9d0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 shutdown_connections 2024-05-20T17:55:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f83d006be60 0x7f83d006e370 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c9c90 0x7f83e41f5000 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83e4162820 0x7f83e40c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 --2- 172.21.15.6:0/1127419961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83e40b3e80 0x7f83e41f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 >> 172.21.15.6:0/1127419961 conn(0x7f83e40d4bd0 msgr2=0x7f83e415e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 shutdown_connections 2024-05-20T17:55:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:32.881+0000 7f83eb8e2640 1 -- 172.21.15.6:0/1127419961 wait complete. 2024-05-20T17:55:32.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2024-05-20T17:55:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.007+0000 7f22d03fe640 1 Processor -- start 2024-05-20T17:55:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.007+0000 7f22d03fe640 1 -- start start 2024-05-20T17:55:33.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22d03fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f22c80d0dd0 0x7f22c80d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:33.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22d03fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22c80cdca0 0x7f22c80ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:33.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22d03fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22c80d11e0 con 0x7f22c808be30 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22d03fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f22c80b2170 con 0x7f22c80cdca0 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22d03fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f22c80d2840 con 0x7f22c80d0dd0 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22ce99b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22c80cdca0 0x7f22c80ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22cd999640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f22c808be30 0x7f22c808c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54332/0 (socket says 172.21.15.6:54332) 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22cd999640 1 -- 172.21.15.6:0/277348397 learned_addr learned my addr 172.21.15.6:0/277348397 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22ce19a640 1 --2- 172.21.15.6:0/277348397 >> v2:172.21.15.171:3300/0 conn(0x7f22c80d0dd0 0x7f22c80d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22ce99b640 1 -- 172.21.15.6:0/277348397 >> v2:172.21.15.171:3300/0 conn(0x7f22c80d0dd0 msgr2=0x7f22c80d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22ce99b640 1 --2- 172.21.15.6:0/277348397 >> v2:172.21.15.171:3300/0 conn(0x7f22c80d0dd0 0x7f22c80d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22ce99b640 1 -- 172.21.15.6:0/277348397 >> v1:172.21.15.6:6789/0 conn(0x7f22c808be30 legacy=0x7f22c808c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.009+0000 7f22ce99b640 1 -- 172.21.15.6:0/277348397 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c815f870 con 0x7f22c80cdca0 2024-05-20T17:55:33.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.010+0000 7f22ce99b640 1 --2- 172.21.15.6:0/277348397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c80ce0b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f22c80739f0 tx=0x7f22c002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e3d0b213a621fa server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:33.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.010+0000 7f22cd198640 1 -- 172.21.15.6:0/277348397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0007740 con 0x7f22c80cdca0 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.010+0000 7f22cd198640 1 -- 172.21.15.6:0/277348397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c00078e0 con 0x7f22c80cdca0 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.010+0000 7f22cd198640 1 -- 172.21.15.6:0/277348397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0007cb0 con 0x7f22c80cdca0 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.011+0000 7f22d03fe640 1 -- 172.21.15.6:0/277348397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 msgr2=0x7f22c80ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.011+0000 7f22d03fe640 1 --2- 172.21.15.6:0/277348397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c80ce0b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f22c80739f0 tx=0x7f22c002a680 comp rx=0 tx=0).stop 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.011+0000 7f22d03fe640 1 -- 172.21.15.6:0/277348397 shutdown_connections 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.011+0000 7f22d03fe640 1 --2- 172.21.15.6:0/277348397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c80ce0b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.011+0000 7f22d03fe640 1 --2- 172.21.15.6:0/277348397 >> v2:172.21.15.171:3300/0 conn(0x7f22c80d0dd0 0x7f22c80d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.011+0000 7f22d03fe640 1 -- 172.21.15.6:0/277348397 >> 172.21.15.6:0/277348397 conn(0x7f22c80b44c0 msgr2=0x7f22c80b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.011+0000 7f22d03fe640 1 -- 172.21.15.6:0/277348397 shutdown_connections 2024-05-20T17:55:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.011+0000 7f22d03fe640 1 -- 172.21.15.6:0/277348397 wait complete. 2024-05-20T17:55:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.013+0000 7f22d03fe640 1 Processor -- start 2024-05-20T17:55:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.013+0000 7f22d03fe640 1 -- start start 2024-05-20T17:55:33.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22d03fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22c808be30 0x7f22c81606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:33.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22d03fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c8155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:33.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22d03fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22c80d0dd0 0x7f22c8161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:33.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22d03fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22c80cd1c0 con 0x7f22c80cdca0 2024-05-20T17:55:33.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22d03fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22c80d2300 con 0x7f22c808be30 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22d03fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22c80cd4a0 con 0x7f22c80d0dd0 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22cd999640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c8155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22cd999640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c8155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42348/0 (socket says 172.21.15.6:42348) 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.014+0000 7f22cd999640 1 -- 172.21.15.6:0/2929705317 learned_addr learned my addr 172.21.15.6:0/2929705317 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22ce19a640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22c808be30 0x7f22c81606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22ce99b640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22c80d0dd0 0x7f22c8161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22cd999640 1 -- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22c80d0dd0 msgr2=0x7f22c8161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22cd999640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22c80d0dd0 0x7f22c8161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22cd999640 1 -- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22c808be30 msgr2=0x7f22c81606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22cd999640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22c808be30 0x7f22c81606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22cd999640 1 -- 172.21.15.6:0/2929705317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c81555d0 con 0x7f22c80cdca0 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22ce19a640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22c808be30 0x7f22c81606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:33.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22ce99b640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22c80d0dd0 0x7f22c8161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22cd999640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c8155090 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f22c400c3f0 tx=0x7f22c400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22baffd640 1 -- 172.21.15.6:0/2929705317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4017070 con 0x7f22c80cdca0 2024-05-20T17:55:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22baffd640 1 -- 172.21.15.6:0/2929705317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c4005ce0 con 0x7f22c80cdca0 2024-05-20T17:55:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c81620a0 con 0x7f22c80cdca0 2024-05-20T17:55:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22baffd640 1 -- 172.21.15.6:0/2929705317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40072f0 con 0x7f22c80cdca0 2024-05-20T17:55:33.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.015+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c815fec0 con 0x7f22c80cdca0 2024-05-20T17:55:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.016+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c8075b00 con 0x7f22c80cdca0 2024-05-20T17:55:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.017+0000 7f22baffd640 1 -- 172.21.15.6:0/2929705317 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22c401a070 con 0x7f22c80cdca0 2024-05-20T17:55:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.017+0000 7f22baffd640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22ac06be30 0x7f22ac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.017+0000 7f22baffd640 1 -- 172.21.15.6:0/2929705317 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f22c408a070 con 0x7f22c80cdca0 2024-05-20T17:55:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.018+0000 7f22ce19a640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22ac06be30 0x7f22ac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:33.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.018+0000 7f22ce19a640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22ac06be30 0x7f22ac06e340 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f22bc006fd0 tx=0x7f22bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:33.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.022+0000 7f22baffd640 1 -- 172.21.15.6:0/2929705317 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f22c4058b00 con 0x7f22c80cdca0 2024-05-20T17:55:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:33.278+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) -- 0x7f22c80723a0 con 0x7f22c80cdca0 2024-05-20T17:55:34.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.208+0000 7f22baffd640 1 -- 172.21.15.6:0/2929705317 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v147) ==== 165+0+0 (secure 0 0 0) 0x7f22c4058400 con 0x7f22c80cdca0 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22ac06be30 msgr2=0x7f22ac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22ac06be30 0x7f22ac06e340 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f22bc006fd0 tx=0x7f22bc008040 comp rx=0 tx=0).stop 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 msgr2=0x7f22c8155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c8155090 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f22c400c3f0 tx=0x7f22c400c7f0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 shutdown_connections 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22ac06be30 0x7f22ac06e340 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22c80d0dd0 0x7f22c8161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22c80cdca0 0x7f22c8155090 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 --2- 172.21.15.6:0/2929705317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22c808be30 0x7f22c81606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.211+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 >> 172.21.15.6:0/2929705317 conn(0x7f22c80b44c0 msgr2=0x7f22c806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.212+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 shutdown_connections 2024-05-20T17:55:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.212+0000 7f22d03fe640 1 -- 172.21.15.6:0/2929705317 wait complete. 2024-05-20T17:55:34.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T17:55:34.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.350+0000 7f5076051640 1 Processor -- start 2024-05-20T17:55:34.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.350+0000 7f5076051640 1 -- start start 2024-05-20T17:55:34.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f5076051640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5070162820 0x7f50700b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f5076051640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50700b3e80 0x7f507006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f5076051640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507006dd20 con 0x7f507006d910 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f5076051640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f50700d0630 con 0x7f50700b3e80 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f5076051640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f50700d39c0 con 0x7f5070162820 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f506effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50700b3e80 0x7f507006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f506effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50700b3e80 0x7f507006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42352/0 (socket says 172.21.15.6:42352) 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f506effd640 1 -- 172.21.15.6:0/3627649693 learned_addr learned my addr 172.21.15.6:0/3627649693 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f506f7fe640 1 --2- 172.21.15.6:0/3627649693 >> v2:172.21.15.171:3300/0 conn(0x7f5070162820 0x7f50700b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f506effd640 1 -- 172.21.15.6:0/3627649693 >> v2:172.21.15.171:3300/0 conn(0x7f5070162820 msgr2=0x7f50700b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f506effd640 1 --2- 172.21.15.6:0/3627649693 >> v2:172.21.15.171:3300/0 conn(0x7f5070162820 0x7f50700b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f506effd640 1 -- 172.21.15.6:0/3627649693 >> v1:172.21.15.171:6789/0 conn(0x7f507006d910 legacy=0x7f50700d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.352+0000 7f506effd640 1 -- 172.21.15.6:0/3627649693 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50700d3ca0 con 0x7f50700b3e80 2024-05-20T17:55:34.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.353+0000 7f506effd640 1 --2- 172.21.15.6:0/3627649693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700b3e80 0x7f507006d3d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f50700b7740 tx=0x7f506402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e646b46cbed0a69 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:34.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.353+0000 7f506e7fc640 1 -- 172.21.15.6:0/3627649693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064037070 con 0x7f50700b3e80 2024-05-20T17:55:34.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.353+0000 7f506e7fc640 1 -- 172.21.15.6:0/3627649693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5064032440 con 0x7f50700b3e80 2024-05-20T17:55:34.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.353+0000 7f506e7fc640 1 -- 172.21.15.6:0/3627649693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064032810 con 0x7f50700b3e80 2024-05-20T17:55:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.354+0000 7f5076051640 1 -- 172.21.15.6:0/3627649693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700b3e80 msgr2=0x7f507006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.354+0000 7f5076051640 1 --2- 172.21.15.6:0/3627649693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700b3e80 0x7f507006d3d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f50700b7740 tx=0x7f506402a230 comp rx=0 tx=0).stop 2024-05-20T17:55:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.354+0000 7f5076051640 1 -- 172.21.15.6:0/3627649693 shutdown_connections 2024-05-20T17:55:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.354+0000 7f5076051640 1 --2- 172.21.15.6:0/3627649693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700b3e80 0x7f507006d3d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.354+0000 7f5076051640 1 --2- 172.21.15.6:0/3627649693 >> v2:172.21.15.171:3300/0 conn(0x7f5070162820 0x7f50700b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.354+0000 7f5076051640 1 -- 172.21.15.6:0/3627649693 >> 172.21.15.6:0/3627649693 conn(0x7f50700d4bd0 msgr2=0x7f50700d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.354+0000 7f5076051640 1 -- 172.21.15.6:0/3627649693 shutdown_connections 2024-05-20T17:55:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.354+0000 7f5076051640 1 -- 172.21.15.6:0/3627649693 wait complete. 2024-05-20T17:55:34.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.356+0000 7f5076051640 1 Processor -- start 2024-05-20T17:55:34.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.356+0000 7f5076051640 1 -- start start 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.357+0000 7f5076051640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f507006d910 0x7f50700c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.357+0000 7f5076051640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50700b3e80 0x7f50700c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.357+0000 7f5076051640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070162820 0x7f507014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.357+0000 7f5076051640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f50700d0300 con 0x7f5070162820 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.357+0000 7f5076051640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f50700d4260 con 0x7f507006d910 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.357+0000 7f5076051640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f50700b91a0 con 0x7f50700b3e80 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070162820 0x7f507014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070162820 0x7f507014bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42362/0 (socket says 172.21.15.6:42362) 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 -- 172.21.15.6:0/3770763407 learned_addr learned my addr 172.21.15.6:0/3770763407 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506f7fe640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f507006d910 0x7f50700c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506effd640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50700b3e80 0x7f50700c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 -- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50700b3e80 msgr2=0x7f50700c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50700b3e80 0x7f50700c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 -- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f507006d910 msgr2=0x7f50700c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f507006d910 0x7f50700c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 -- 172.21.15.6:0/3770763407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50700c9180 con 0x7f5070162820 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f506ffff640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070162820 0x7f507014bcd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f506800b970 tx=0x7f506800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f5057fff640 1 -- 172.21.15.6:0/3770763407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068019070 con 0x7f5070162820 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f5057fff640 1 -- 172.21.15.6:0/3770763407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f506800cb40 con 0x7f5070162820 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50701eaa40 con 0x7f5070162820 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f5057fff640 1 -- 172.21.15.6:0/3770763407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068014440 con 0x7f5070162820 2024-05-20T17:55:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.358+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50701f8ce0 con 0x7f5070162820 2024-05-20T17:55:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.359+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50701ea7b0 con 0x7f5070162820 2024-05-20T17:55:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.360+0000 7f5057fff640 1 -- 172.21.15.6:0/3770763407 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f506801c070 con 0x7f5070162820 2024-05-20T17:55:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.361+0000 7f5057fff640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505c06be30 0x7f505c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.361+0000 7f5057fff640 1 -- 172.21.15.6:0/3770763407 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f506808a9e0 con 0x7f5070162820 2024-05-20T17:55:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.361+0000 7f506f7fe640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505c06be30 0x7f505c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.361+0000 7f506f7fe640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505c06be30 0x7f505c06e340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50600079a0 tx=0x7f5060008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:34.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.365+0000 7f5057fff640 1 -- 172.21.15.6:0/3770763407 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5068058e20 con 0x7f5070162820 2024-05-20T17:55:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.546+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f50700c9950 con 0x7f5070162820 2024-05-20T17:55:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.550+0000 7f5057fff640 1 -- 172.21.15.6:0/3770763407 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f506805d120 con 0x7f5070162820 2024-05-20T17:55:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505c06be30 msgr2=0x7f505c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505c06be30 0x7f505c06e340 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50600079a0 tx=0x7f5060008040 comp rx=0 tx=0).stop 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070162820 msgr2=0x7f507014bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070162820 0x7f507014bcd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f506800b970 tx=0x7f506800be30 comp rx=0 tx=0).stop 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 shutdown_connections 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505c06be30 0x7f505c06e340 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070162820 0x7f507014bcd0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50700b3e80 0x7f50700c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 --2- 172.21.15.6:0/3770763407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f507006d910 0x7f50700c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 >> 172.21.15.6:0/3770763407 conn(0x7f50700d4bd0 msgr2=0x7f50700b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 shutdown_connections 2024-05-20T17:55:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.552+0000 7f5076051640 1 -- 172.21.15.6:0/3770763407 wait complete. 2024-05-20T17:55:34.563 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:55:34.563 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:55:34.601 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:55:34.652 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:55:34.652 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:34.652 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:34.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:55:34.669 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:34.669 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:34.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:55:34.687 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:34.687 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:34.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:55:34.725 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:34.725 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:34.745 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:55:34.745 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T17:55:34.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:34.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.881+0000 7f3fb71ea640 1 Processor -- start 2024-05-20T17:55:34.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.881+0000 7f3fb71ea640 1 -- start start 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb71ea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fb0162820 0x7f3fb00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb71ea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3fb00b3e80 0x7f3fb006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb71ea640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fb006dd20 con 0x7f3fb006d910 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb71ea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3fb00d0630 con 0x7f3fb0162820 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb71ea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3fb00d39c0 con 0x7f3fb00b3e80 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb4f86640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fb0162820 0x7f3fb00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb5787640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3fb006d910 0x7f3fb00d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54336/0 (socket says 172.21.15.6:54336) 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb5787640 1 -- 172.21.15.6:0/3787772805 learned_addr learned my addr 172.21.15.6:0/3787772805 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3faffff640 1 --2- 172.21.15.6:0/3787772805 >> v2:172.21.15.171:3300/0 conn(0x7f3fb00b3e80 0x7f3fb006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3fb4f86640 1 -- 172.21.15.6:0/3787772805 >> v2:172.21.15.171:3300/0 conn(0x7f3fb00b3e80 msgr2=0x7f3fb006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.882+0000 7f3faf7fe640 1 -- 172.21.15.6:0/3787772805 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536351076 0 0) 0x7f3fa0001490 con 0x7f3fb006d910 2024-05-20T17:55:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.883+0000 7f3fb4f86640 1 --2- 172.21.15.6:0/3787772805 >> v2:172.21.15.171:3300/0 conn(0x7f3fb00b3e80 0x7f3fb006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.883+0000 7f3fb4f86640 1 -- 172.21.15.6:0/3787772805 >> v1:172.21.15.6:6789/0 conn(0x7f3fb006d910 legacy=0x7f3fb00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.883+0000 7f3fb4f86640 1 -- 172.21.15.6:0/3787772805 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb00d3ca0 con 0x7f3fb0162820 2024-05-20T17:55:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.883+0000 7f3fb4f86640 1 --2- 172.21.15.6:0/3787772805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b3940 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00d1230 tx=0x7f3fa802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aae8f2169b4d763 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.883+0000 7f3faf7fe640 1 -- 172.21.15.6:0/3787772805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8037070 con 0x7f3fb0162820 2024-05-20T17:55:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3faf7fe640 1 -- 172.21.15.6:0/3787772805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa8032440 con 0x7f3fb0162820 2024-05-20T17:55:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3faf7fe640 1 -- 172.21.15.6:0/3787772805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8032810 con 0x7f3fb0162820 2024-05-20T17:55:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3fb71ea640 1 -- 172.21.15.6:0/3787772805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 msgr2=0x7f3fb00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/3787772805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b3940 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00d1230 tx=0x7f3fa802a1a0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3fb71ea640 1 -- 172.21.15.6:0/3787772805 shutdown_connections 2024-05-20T17:55:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/3787772805 >> v2:172.21.15.171:3300/0 conn(0x7f3fb00b3e80 0x7f3fb006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/3787772805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b3940 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3fb71ea640 1 -- 172.21.15.6:0/3787772805 >> 172.21.15.6:0/3787772805 conn(0x7f3fb00d4bd0 msgr2=0x7f3fb00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3fb71ea640 1 -- 172.21.15.6:0/3787772805 shutdown_connections 2024-05-20T17:55:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.884+0000 7f3fb71ea640 1 -- 172.21.15.6:0/3787772805 wait complete. 2024-05-20T17:55:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.886+0000 7f3fb71ea640 1 Processor -- start 2024-05-20T17:55:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.886+0000 7f3fb71ea640 1 -- start start 2024-05-20T17:55:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.887+0000 7f3fb71ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3fb006d910 0x7f3fb0157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.887+0000 7f3fb71ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3fb00b3e80 0x7f3fb014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.887+0000 7f3fb71ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.887+0000 7f3fb71ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb00d0300 con 0x7f3fb0162820 2024-05-20T17:55:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb71ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb00d4260 con 0x7f3fb006d910 2024-05-20T17:55:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb71ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb00b91a0 con 0x7f3fb00b3e80 2024-05-20T17:55:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42378/0 (socket says 172.21.15.6:42378) 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 -- 172.21.15.6:0/1457641434 learned_addr learned my addr 172.21.15.6:0/1457641434 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb4f86640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3fb006d910 0x7f3fb0157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3faffff640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3fb00b3e80 0x7f3fb014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 -- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3fb00b3e80 msgr2=0x7f3fb014b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3fb00b3e80 0x7f3fb014b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 -- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3fb006d910 msgr2=0x7f3fb0157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3fb006d910 0x7f3fb0157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 -- 172.21.15.6:0/1457641434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb0158790 con 0x7f3fb0162820 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb4f86640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3fb006d910 0x7f3fb0157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb5787640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b5910 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c700 tx=0x7f3fa000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fad7fa640 1 -- 172.21.15.6:0/1457641434 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0018070 con 0x7f3fb0162820 2024-05-20T17:55:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fad7fa640 1 -- 172.21.15.6:0/1457641434 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa000ce10 con 0x7f3fb0162820 2024-05-20T17:55:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb0158a70 con 0x7f3fb0162820 2024-05-20T17:55:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fad7fa640 1 -- 172.21.15.6:0/1457641434 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000a820 con 0x7f3fb0162820 2024-05-20T17:55:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.888+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb0159030 con 0x7f3fb0162820 2024-05-20T17:55:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.889+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb0075b00 con 0x7f3fb0162820 2024-05-20T17:55:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.890+0000 7f3fad7fa640 1 -- 172.21.15.6:0/1457641434 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fa001b070 con 0x7f3fb0162820 2024-05-20T17:55:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.890+0000 7f3fad7fa640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3f9006be30 0x7f3f9006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.891+0000 7f3fad7fa640 1 -- 172.21.15.6:0/1457641434 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f3fa008a2f0 con 0x7f3fb0162820 2024-05-20T17:55:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.891+0000 7f3fb4f86640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3f9006be30 0x7f3f9006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.891+0000 7f3fb4f86640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3f9006be30 0x7f3f9006e340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8034000 tx=0x7f3fa802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:34.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:34.895+0000 7f3fad7fa640 1 -- 172.21.15.6:0/1457641434 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3fb006dd20 con 0x7f3fb0162820 2024-05-20T17:55:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.115+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fb0158520 con 0x7f3fb0162820 2024-05-20T17:55:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.116+0000 7f3fad7fa640 1 -- 172.21.15.6:0/1457641434 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3869 (secure 0 0 0) 0x7f3fa0058d70 con 0x7f3fb0162820 2024-05-20T17:55:35.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:35.115 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2198108863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2198108863},{"type":"v1","addr":"172.21.15.171:6836","nonce":2198108863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/3892278773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":3892278773},{"type":"v1","addr":"172.21.15.171:6837","nonce":3892278773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5179,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2764249868","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2764249868},{"type":"v1","addr":"172.21.15.6:6835","nonce":2764249868}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5784,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1348277628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1348277628},{"type":"v1","addr":"172.21.15.6:6834","nonce":1348277628}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-05-20T17:55:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 20 2024-05-20T17:55:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3f9006be30 msgr2=0x7f3f9006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3f9006be30 0x7f3f9006e340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8034000 tx=0x7f3fa802e000 comp rx=0 tx=0).stop 2024-05-20T17:55:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 msgr2=0x7f3fb00b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b5910 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c700 tx=0x7f3fa000cbc0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 shutdown_connections 2024-05-20T17:55:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3f9006be30 0x7f3f9006e340 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fb0162820 0x7f3fb00b5910 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3fb00b3e80 0x7f3fb014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 --2- 172.21.15.6:0/1457641434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3fb006d910 0x7f3fb0157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 >> 172.21.15.6:0/1457641434 conn(0x7f3fb00d4bd0 msgr2=0x7f3fb00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 shutdown_connections 2024-05-20T17:55:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.118+0000 7f3fb71ea640 1 -- 172.21.15.6:0/1457641434 wait complete. 2024-05-20T17:55:35.128 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T17:55:35.128 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T17:55:35.129 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T17:55:35.129 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:55:35.129 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T17:55:35.129 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T17:55:35.129 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T17:55:35.129 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:55:35.129 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T17:55:35.129 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T17:55:35.130 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T17:55:35.130 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:55:35.130 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T17:55:35.130 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T17:55:35.130 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T17:55:35.130 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:55:35.139 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T17:55:35.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T17:55:35.141 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T17:55:35.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T17:55:35.142 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T17:55:35.142 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T17:55:35.143 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T17:55:35.143 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T17:55:35.183 INFO:tasks.ceph.mds.c:Started 2024-05-20T17:55:35.183 DEBUG:teuthology.parallel:result is None 2024-05-20T17:55:35.184 INFO:tasks.ceph.mds.a:Started 2024-05-20T17:55:35.184 DEBUG:teuthology.parallel:result is None 2024-05-20T17:55:35.185 INFO:tasks.ceph.mds.b:Started 2024-05-20T17:55:35.186 DEBUG:teuthology.parallel:result is None 2024-05-20T17:55:35.186 INFO:tasks.ceph.mds.d:Started 2024-05-20T17:55:35.186 DEBUG:teuthology.parallel:result is None 2024-05-20T17:55:35.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T17:55:35.275 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:55:35.275 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:55:35.275 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-20T17:55:35.277+0000 7f14beed8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-20T17:55:35.282 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T17:55:35.282 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T17:55:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.310+0000 7fc64faa2640 1 Processor -- start 2024-05-20T17:55:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.310+0000 7fc64faa2640 1 -- start start 2024-05-20T17:55:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.311+0000 7fc64faa2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648071630 0x7fc64815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.311+0000 7fc64faa2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6480cd1b0 0x7fc64806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.311+0000 7fc64faa2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6480ce2b0 con 0x7fc648070850 2024-05-20T17:55:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.311+0000 7fc64d03d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6480cd1b0 0x7fc64806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.311+0000 7fc64d03d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6480cd1b0 0x7fc64806d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42418/0 (socket says 172.21.15.6:42418) 2024-05-20T17:55:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.311+0000 7fc64d03d640 1 -- 172.21.15.6:0/2928381642 learned_addr learned my addr 172.21.15.6:0/2928381642 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.311+0000 7fc64faa2640 1 -- 172.21.15.6:0/2928381642 --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc64815f790 con 0x7fc6480cd1b0 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.311+0000 7fc64d83e640 1 --2- 172.21.15.6:0/2928381642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648071630 0x7fc64815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.312+0000 7fc64faa2640 1 -- 172.21.15.6:0/2928381642 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc64806e590 con 0x7fc648071630 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.312+0000 7fc64c83c640 1 -- 172.21.15.6:0/2928381642 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062010744 0 0) 0x7fc6480ce2b0 con 0x7fc648070850 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.312+0000 7fc64c83c640 1 -- 172.21.15.6:0/2928381642 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc634003520 con 0x7fc648070850 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.312+0000 7fc64d83e640 1 -- 172.21.15.6:0/2928381642 >> v2:172.21.15.6:3300/0 conn(0x7fc6480cd1b0 msgr2=0x7fc64806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.312+0000 7fc64d83e640 1 --2- 172.21.15.6:0/2928381642 >> v2:172.21.15.6:3300/0 conn(0x7fc6480cd1b0 0x7fc64806d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.312+0000 7fc64d83e640 1 -- 172.21.15.6:0/2928381642 >> v1:172.21.15.6:6789/0 conn(0x7fc648070850 legacy=0x7fc648070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.312+0000 7fc64d83e640 1 -- 172.21.15.6:0/2928381642 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64806cce0 con 0x7fc648071630 2024-05-20T17:55:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.312+0000 7fc64d03d640 1 --2- 172.21.15.6:0/2928381642 >> v2:172.21.15.6:3300/0 conn(0x7fc6480cd1b0 0x7fc64806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.313+0000 7fc64d83e640 1 --2- 172.21.15.6:0/2928381642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648071630 0x7fc64815f250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc6440097a0 tx=0x7fc64402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853be37aa8b9c51e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.313+0000 7fc64c83c640 1 -- 172.21.15.6:0/2928381642 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644037070 con 0x7fc648071630 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.313+0000 7fc64c83c640 1 -- 172.21.15.6:0/2928381642 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64402ae50 con 0x7fc648071630 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.313+0000 7fc64c83c640 1 -- 172.21.15.6:0/2928381642 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644032640 con 0x7fc648071630 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.314+0000 7fc64faa2640 1 -- 172.21.15.6:0/2928381642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648071630 msgr2=0x7fc64815f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.314+0000 7fc64faa2640 1 --2- 172.21.15.6:0/2928381642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648071630 0x7fc64815f250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc6440097a0 tx=0x7fc64402a100 comp rx=0 tx=0).stop 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.314+0000 7fc64faa2640 1 -- 172.21.15.6:0/2928381642 shutdown_connections 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.314+0000 7fc64faa2640 1 --2- 172.21.15.6:0/2928381642 >> v2:172.21.15.6:3300/0 conn(0x7fc6480cd1b0 0x7fc64806d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.314+0000 7fc64faa2640 1 --2- 172.21.15.6:0/2928381642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648071630 0x7fc64815f250 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.314+0000 7fc64faa2640 1 -- 172.21.15.6:0/2928381642 >> 172.21.15.6:0/2928381642 conn(0x7fc6480d29d0 msgr2=0x7fc6480d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.314+0000 7fc64faa2640 1 -- 172.21.15.6:0/2928381642 shutdown_connections 2024-05-20T17:55:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.314+0000 7fc64faa2640 1 -- 172.21.15.6:0/2928381642 wait complete. 2024-05-20T17:55:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.316+0000 7fc64faa2640 1 Processor -- start 2024-05-20T17:55:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.316+0000 7fc64faa2640 1 -- start start 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64faa2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648070850 0x7fc6481e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64faa2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc648071630 0x7fc6480cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64faa2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6480cd1b0 0x7fc6481e7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64faa2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc64806d2a0 con 0x7fc648071630 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64faa2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc64806c990 con 0x7fc6480cd1b0 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64faa2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc64806dd00 con 0x7fc648070850 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc648071630 0x7fc6480cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc648071630 0x7fc6480cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42420/0 (socket says 172.21.15.6:42420) 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 -- 172.21.15.6:0/1721792054 learned_addr learned my addr 172.21.15.6:0/1721792054 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d83e640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648070850 0x7fc6481e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64e03f640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6480cd1b0 0x7fc6481e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 -- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648070850 msgr2=0x7fc6481e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648070850 0x7fc6481e59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 -- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6480cd1b0 msgr2=0x7fc6481e7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6480cd1b0 0x7fc6481e7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 -- 172.21.15.6:0/1721792054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6480cbff0 con 0x7fc648071630 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc64d03d640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc648071630 0x7fc6480cbab0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc63800e9b0 tx=0x7fc63800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc63e7fc640 1 -- 172.21.15.6:0/1721792054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638017070 con 0x7fc648071630 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.318+0000 7fc63e7fc640 1 -- 172.21.15.6:0/1721792054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63800c9a0 con 0x7fc648071630 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.319+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6481e7850 con 0x7fc648071630 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.319+0000 7fc63e7fc640 1 -- 172.21.15.6:0/1721792054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63800cd50 con 0x7fc648071630 2024-05-20T17:55:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.319+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6481e6550 con 0x7fc648071630 2024-05-20T17:55:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.320+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc648075b00 con 0x7fc648071630 2024-05-20T17:55:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.320+0000 7fc63e7fc640 1 -- 172.21.15.6:0/1721792054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc63801a070 con 0x7fc648071630 2024-05-20T17:55:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.321+0000 7fc63e7fc640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62c06be60 0x7fc62c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.321+0000 7fc63e7fc640 1 -- 172.21.15.6:0/1721792054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fc63808afe0 con 0x7fc648071630 2024-05-20T17:55:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.321+0000 7fc64d83e640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62c06be60 0x7fc62c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.321+0000 7fc64d83e640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62c06be60 0x7fc62c06e370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc644034000 tx=0x7fc64402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:35.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.325+0000 7fc63e7fc640 1 -- 172.21.15.6:0/1721792054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc6481e7850 con 0x7fc648071630 2024-05-20T17:55:35.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:35.524+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc648071410 con 0x7fc648071630 2024-05-20T17:55:35.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:55:35.903 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:55:36.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.227+0000 7fc63e7fc640 1 -- 172.21.15.6:0/1721792054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) ==== 97+0+0 (secure 0 0 0) 0x7fc638059360 con 0x7fc648071630 2024-05-20T17:55:36.226 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T17:55:36.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62c06be60 msgr2=0x7fc62c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62c06be60 0x7fc62c06e370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc644034000 tx=0x7fc64402e000 comp rx=0 tx=0).stop 2024-05-20T17:55:36.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc648071630 msgr2=0x7fc6480cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc648071630 0x7fc6480cbab0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc63800e9b0 tx=0x7fc63800ee70 comp rx=0 tx=0).stop 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 shutdown_connections 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62c06be60 0x7fc62c06e370 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6480cd1b0 0x7fc6481e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc648071630 0x7fc6480cbab0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 --2- 172.21.15.6:0/1721792054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648070850 0x7fc6481e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 >> 172.21.15.6:0/1721792054 conn(0x7fc6480d29d0 msgr2=0x7fc6480d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 shutdown_connections 2024-05-20T17:55:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.230+0000 7fc64faa2640 1 -- 172.21.15.6:0/1721792054 wait complete. 2024-05-20T17:55:36.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T17:55:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.368+0000 7ff61a33e640 1 Processor -- start 2024-05-20T17:55:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.368+0000 7ff61a33e640 1 -- start start 2024-05-20T17:55:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff61a33e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff61406d3d0 0x7ff61406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff61a33e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6140b8190 0x7ff6140b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff61a33e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61406dd20 con 0x7ff614162820 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff61a33e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff6140d0630 con 0x7ff6140b8190 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff61a33e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff6140d39c0 con 0x7ff61406d3d0 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff6188db640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6140b8190 0x7ff6140b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff6188db640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff6140b8190 0x7ff6140b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42432/0 (socket says 172.21.15.6:42432) 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff6188db640 1 -- 172.21.15.6:0/1710172714 learned_addr learned my addr 172.21.15.6:0/1710172714 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.369+0000 7ff60bfff640 1 --2- 172.21.15.6:0/1710172714 >> v2:172.21.15.171:3300/0 conn(0x7ff61406d3d0 0x7ff61406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.370+0000 7ff6188db640 1 -- 172.21.15.6:0/1710172714 >> v2:172.21.15.171:3300/0 conn(0x7ff61406d3d0 msgr2=0x7ff61406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.370+0000 7ff6188db640 1 --2- 172.21.15.6:0/1710172714 >> v2:172.21.15.171:3300/0 conn(0x7ff61406d3d0 0x7ff61406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.370+0000 7ff6188db640 1 -- 172.21.15.6:0/1710172714 >> v1:172.21.15.171:6789/0 conn(0x7ff614162820 legacy=0x7ff6140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.370+0000 7ff6188db640 1 -- 172.21.15.6:0/1710172714 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6140d3ca0 con 0x7ff6140b8190 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.370+0000 7ff6188db640 1 --2- 172.21.15.6:0/1710172714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6140b8190 0x7ff6140b85a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff6140d1230 tx=0x7ff60c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276da0d37efd6361 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.370+0000 7ff6137fe640 1 -- 172.21.15.6:0/1710172714 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c036070 con 0x7ff6140b8190 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.370+0000 7ff6137fe640 1 -- 172.21.15.6:0/1710172714 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c031600 con 0x7ff6140b8190 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff6137fe640 1 -- 172.21.15.6:0/1710172714 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0319d0 con 0x7ff6140b8190 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff61a33e640 1 -- 172.21.15.6:0/1710172714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6140b8190 msgr2=0x7ff6140b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff61a33e640 1 --2- 172.21.15.6:0/1710172714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6140b8190 0x7ff6140b85a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff6140d1230 tx=0x7ff60c02a730 comp rx=0 tx=0).stop 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff61a33e640 1 -- 172.21.15.6:0/1710172714 shutdown_connections 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff61a33e640 1 --2- 172.21.15.6:0/1710172714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6140b8190 0x7ff6140b85a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff61a33e640 1 --2- 172.21.15.6:0/1710172714 >> v2:172.21.15.171:3300/0 conn(0x7ff61406d3d0 0x7ff61406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff61a33e640 1 -- 172.21.15.6:0/1710172714 >> 172.21.15.6:0/1710172714 conn(0x7ff6140d4bd0 msgr2=0x7ff6140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff61a33e640 1 -- 172.21.15.6:0/1710172714 shutdown_connections 2024-05-20T17:55:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.371+0000 7ff61a33e640 1 -- 172.21.15.6:0/1710172714 wait complete. 2024-05-20T17:55:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.373+0000 7ff61a33e640 1 Processor -- start 2024-05-20T17:55:36.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.373+0000 7ff61a33e640 1 -- start start 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.374+0000 7ff61a33e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61406d3d0 0x7ff61415bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff61a33e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6140b8190 0x7ff6140c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff61a33e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff614162820 0x7ff6140b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff61a33e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff6140d0300 con 0x7ff61406d3d0 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff61a33e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff6140d4260 con 0x7ff614162820 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff61a33e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff6140b4050 con 0x7ff6140b8190 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61406d3d0 0x7ff61415bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61406d3d0 0x7ff61415bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42446/0 (socket says 172.21.15.6:42446) 2024-05-20T17:55:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 -- 172.21.15.6:0/2656533013 learned_addr learned my addr 172.21.15.6:0/2656533013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff60bfff640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6140b8190 0x7ff6140c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff6188db640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff614162820 0x7ff6140b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 -- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6140b8190 msgr2=0x7ff6140c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6140b8190 0x7ff6140c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 -- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff614162820 msgr2=0x7ff6140b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff614162820 0x7ff6140b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 -- 172.21.15.6:0/2656533013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6141ea610 con 0x7ff61406d3d0 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff613fff640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61406d3d0 0x7ff61415bc70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c3c0 tx=0x7ff60400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff6117fa640 1 -- 172.21.15.6:0/2656533013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6040052d0 con 0x7ff61406d3d0 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff6117fa640 1 -- 172.21.15.6:0/2656533013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff604005490 con 0x7ff61406d3d0 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff6117fa640 1 -- 172.21.15.6:0/2656533013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604007260 con 0x7ff61406d3d0 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6141ea8f0 con 0x7ff61406d3d0 2024-05-20T17:55:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.375+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6141eaeb0 con 0x7ff61406d3d0 2024-05-20T17:55:36.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.377+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff614075b00 con 0x7ff61406d3d0 2024-05-20T17:55:36.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.377+0000 7ff6117fa640 1 -- 172.21.15.6:0/2656533013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff604007400 con 0x7ff61406d3d0 2024-05-20T17:55:36.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.377+0000 7ff6117fa640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5f406be30 0x7ff5f406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.378+0000 7ff6117fa640 1 -- 172.21.15.6:0/2656533013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7ff60408a1f0 con 0x7ff61406d3d0 2024-05-20T17:55:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.378+0000 7ff60bfff640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5f406be30 0x7ff5f406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.378+0000 7ff60bfff640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5f406be30 0x7ff5f406e340 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff61415f6e0 tx=0x7ff5fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.382+0000 7ff6117fa640 1 -- 172.21.15.6:0/2656533013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff61406dd20 con 0x7ff61406d3d0 2024-05-20T17:55:36.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.636+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff61415c1b0 con 0x7ff61406d3d0 2024-05-20T17:55:36.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.636+0000 7ff6117fa640 1 -- 172.21.15.6:0/2656533013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7ff604058cd0 con 0x7ff61406d3d0 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.637 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.638 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.642 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T17:55:36.644 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:55:36.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T17:55:36.646 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:55:36.647 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:55:36.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:55:36.649 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:55:36.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.638+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5f406be30 msgr2=0x7ff5f406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.638+0000 7ff61a33e640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5f406be30 0x7ff5f406e340 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff61415f6e0 tx=0x7ff5fc008040 comp rx=0 tx=0).stop 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.638+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61406d3d0 msgr2=0x7ff61415bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.638+0000 7ff61a33e640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61406d3d0 0x7ff61415bc70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c3c0 tx=0x7ff60400c880 comp rx=0 tx=0).stop 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.639+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 shutdown_connections 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.639+0000 7ff61a33e640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5f406be30 0x7ff5f406e340 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.639+0000 7ff61a33e640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff614162820 0x7ff6140b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.639+0000 7ff61a33e640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6140b8190 0x7ff6140c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.639+0000 7ff61a33e640 1 --2- 172.21.15.6:0/2656533013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff61406d3d0 0x7ff61415bc70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.639+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 >> 172.21.15.6:0/2656533013 conn(0x7ff6140d4bd0 msgr2=0x7ff614160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.639+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 shutdown_connections 2024-05-20T17:55:36.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.639+0000 7ff61a33e640 1 -- 172.21.15.6:0/2656533013 wait complete. 2024-05-20T17:55:36.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.767+0000 7fc53cb77640 1 Processor -- start 2024-05-20T17:55:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.767+0000 7fc53cb77640 1 -- start start 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc53cb77640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5380ce7a0 0x7fc5380afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc53cb77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc5380b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc53cb77640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5380d0c00 con 0x7fc5380b21f0 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc53cb77640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc5380d17f0 con 0x7fc5380ce7a0 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc53cb77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5380d0ec0 con 0x7fc53815f3f0 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc53659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5380ce7a0 0x7fc5380afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc536d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc5380b21f0 0x7fc53806b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54374/0 (socket says 172.21.15.6:54374) 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc536d9d640 1 -- 172.21.15.6:0/1464049617 learned_addr learned my addr 172.21.15.6:0/1464049617 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.769+0000 7fc535d9b640 1 --2- 172.21.15.6:0/1464049617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc5380b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.770+0000 7fc53659c640 1 -- 172.21.15.6:0/1464049617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 msgr2=0x7fc5380b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.770+0000 7fc53659c640 1 --2- 172.21.15.6:0/1464049617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc5380b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.770+0000 7fc53659c640 1 -- 172.21.15.6:0/1464049617 >> v1:172.21.15.6:6789/0 conn(0x7fc5380b21f0 legacy=0x7fc53806b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.770+0000 7fc53559a640 1 -- 172.21.15.6:0/1464049617 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226820164 0 0) 0x7fc5380d0c00 con 0x7fc5380b21f0 2024-05-20T17:55:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.770+0000 7fc53659c640 1 -- 172.21.15.6:0/1464049617 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5380d11a0 con 0x7fc5380ce7a0 2024-05-20T17:55:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.770+0000 7fc535d9b640 1 --2- 172.21.15.6:0/1464049617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc5380b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.770+0000 7fc53659c640 1 --2- 172.21.15.6:0/1464049617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380ce7a0 0x7fc5380afe30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc5300097a0 tx=0x7fc53002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8fa437ee8edf8e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.770+0000 7fc53559a640 1 -- 172.21.15.6:0/1464049617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530037070 con 0x7fc5380ce7a0 2024-05-20T17:55:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53559a640 1 -- 172.21.15.6:0/1464049617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc530032440 con 0x7fc5380ce7a0 2024-05-20T17:55:36.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53559a640 1 -- 172.21.15.6:0/1464049617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530032810 con 0x7fc5380ce7a0 2024-05-20T17:55:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53cb77640 1 -- 172.21.15.6:0/1464049617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380ce7a0 msgr2=0x7fc5380afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53cb77640 1 --2- 172.21.15.6:0/1464049617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380ce7a0 0x7fc5380afe30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc5300097a0 tx=0x7fc53002a180 comp rx=0 tx=0).stop 2024-05-20T17:55:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53cb77640 1 -- 172.21.15.6:0/1464049617 shutdown_connections 2024-05-20T17:55:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53cb77640 1 --2- 172.21.15.6:0/1464049617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc5380b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53cb77640 1 --2- 172.21.15.6:0/1464049617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380ce7a0 0x7fc5380afe30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53cb77640 1 -- 172.21.15.6:0/1464049617 >> 172.21.15.6:0/1464049617 conn(0x7fc53809a4f0 msgr2=0x7fc5380b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53cb77640 1 -- 172.21.15.6:0/1464049617 shutdown_connections 2024-05-20T17:55:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.771+0000 7fc53cb77640 1 -- 172.21.15.6:0/1464049617 wait complete. 2024-05-20T17:55:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.773+0000 7fc53cb77640 1 Processor -- start 2024-05-20T17:55:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.773+0000 7fc53cb77640 1 -- start start 2024-05-20T17:55:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53cb77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380b21f0 0x7fc5380cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53cb77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5380ce7a0 0x7fc53814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53cb77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc53815d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53cb77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5380b6460 con 0x7fc5380b21f0 2024-05-20T17:55:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53cb77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5380b2600 con 0x7fc5380ce7a0 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53cb77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5380b65e0 con 0x7fc53815f3f0 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380b21f0 0x7fc5380cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380b21f0 0x7fc5380cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42464/0 (socket says 172.21.15.6:42464) 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 -- 172.21.15.6:0/635620868 learned_addr learned my addr 172.21.15.6:0/635620868 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc536d9d640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc53815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc535d9b640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5380ce7a0 0x7fc53814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 -- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 msgr2=0x7fc53815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc53815d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 -- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5380ce7a0 msgr2=0x7fc53814d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5380ce7a0 0x7fc53814d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 -- 172.21.15.6:0/635620868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc538160c60 con 0x7fc5380b21f0 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53659c640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380b21f0 0x7fc5380cc7d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc530000c00 tx=0x7fc5300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc52effd640 1 -- 172.21.15.6:0/635620868 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530037050 con 0x7fc5380b21f0 2024-05-20T17:55:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc52effd640 1 -- 172.21.15.6:0/635620868 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc530038040 con 0x7fc5380b21f0 2024-05-20T17:55:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.775+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc538160f40 con 0x7fc5380b21f0 2024-05-20T17:55:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.776+0000 7fc52effd640 1 -- 172.21.15.6:0/635620868 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530004470 con 0x7fc5380b21f0 2024-05-20T17:55:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.776+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc538161500 con 0x7fc5380b21f0 2024-05-20T17:55:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.777+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc538075b00 con 0x7fc5380b21f0 2024-05-20T17:55:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.777+0000 7fc52effd640 1 -- 172.21.15.6:0/635620868 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc530030980 con 0x7fc5380b21f0 2024-05-20T17:55:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.778+0000 7fc52effd640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc51806be30 0x7fc51806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.778+0000 7fc52effd640 1 -- 172.21.15.6:0/635620868 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fc5300ab7b0 con 0x7fc5380b21f0 2024-05-20T17:55:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.778+0000 7fc535d9b640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc51806be30 0x7fc51806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.778+0000 7fc535d9b640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc51806be30 0x7fc51806e340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc538160950 tx=0x7fc520008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:36.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.782+0000 7fc52effd640 1 -- 172.21.15.6:0/635620868 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc530030c70 con 0x7fc5380b21f0 2024-05-20T17:55:36.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.968+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc53806c460 con 0x7fc5380b21f0 2024-05-20T17:55:36.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.968+0000 7fc52effd640 1 -- 172.21.15.6:0/635620868 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+13116 (secure 0 0 0) 0x7fc53007a290 con 0x7fc5380b21f0 2024-05-20T17:55:36.968 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:36.968 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:36.235827+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc51806be30 msgr2=0x7fc51806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc51806be30 0x7fc51806e340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc538160950 tx=0x7fc520008040 comp rx=0 tx=0).stop 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380b21f0 msgr2=0x7fc5380cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380b21f0 0x7fc5380cc7d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc530000c00 tx=0x7fc5300046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 shutdown_connections 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc51806be30 0x7fc51806e340 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53815f3f0 0x7fc53815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5380ce7a0 0x7fc53814d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.970+0000 7fc53cb77640 1 --2- 172.21.15.6:0/635620868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5380b21f0 0x7fc5380cc7d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.971+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 >> 172.21.15.6:0/635620868 conn(0x7fc53809a4f0 msgr2=0x7fc53806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.971+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 shutdown_connections 2024-05-20T17:55:36.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:36.971+0000 7fc53cb77640 1 -- 172.21.15.6:0/635620868 wait complete. 2024-05-20T17:55:36.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:55:36.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:55:37.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.100+0000 7fd2faf4b640 1 Processor -- start 2024-05-20T17:55:37.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.100+0000 7fd2faf4b640 1 -- start start 2024-05-20T17:55:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.101+0000 7fd2faf4b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2f40d4400 0x7fd2f415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.101+0000 7fd2faf4b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d2780 0x7fd2f40d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.101+0000 7fd2faf4b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f408d2a0 con 0x7fd2f406cf00 2024-05-20T17:55:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2faf4b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f40d3f70 con 0x7fd2f40d4400 2024-05-20T17:55:37.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2faf4b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40d30d0 con 0x7fd2f40d2780 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f8ce7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2f40d4400 0x7fd2f415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd2f406cf00 0x7fd2f406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54380/0 (socket says 172.21.15.6:54380) 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f3fff640 1 -- 172.21.15.6:0/1824700252 learned_addr learned my addr 172.21.15.6:0/1824700252 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f94e8640 1 --2- 172.21.15.6:0/1824700252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d2780 0x7fd2f40d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f8ce7640 1 -- 172.21.15.6:0/1824700252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d2780 msgr2=0x7fd2f40d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f8ce7640 1 --2- 172.21.15.6:0/1824700252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d2780 0x7fd2f40d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f8ce7640 1 -- 172.21.15.6:0/1824700252 >> v1:172.21.15.6:6789/0 conn(0x7fd2f406cf00 legacy=0x7fd2f406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f8ce7640 1 -- 172.21.15.6:0/1824700252 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f40d4810 con 0x7fd2f40d4400 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f37fe640 1 -- 172.21.15.6:0/1824700252 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3273970027 0 0) 0x7fd2e8001110 con 0x7fd2f406cf00 2024-05-20T17:55:37.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.102+0000 7fd2f94e8640 1 --2- 172.21.15.6:0/1824700252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d2780 0x7fd2f40d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.103+0000 7fd2f8ce7640 1 --2- 172.21.15.6:0/1824700252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d4400 0x7fd2f415f440 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097a0 tx=0x7fd2e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7820bc15f9b763d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.103+0000 7fd2f37fe640 1 -- 172.21.15.6:0/1824700252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4037070 con 0x7fd2f40d4400 2024-05-20T17:55:37.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.103+0000 7fd2f37fe640 1 -- 172.21.15.6:0/1824700252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e4032440 con 0x7fd2f40d4400 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.103+0000 7fd2f37fe640 1 -- 172.21.15.6:0/1824700252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4032810 con 0x7fd2f40d4400 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.104+0000 7fd2faf4b640 1 -- 172.21.15.6:0/1824700252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d4400 msgr2=0x7fd2f415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.104+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/1824700252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d4400 0x7fd2f415f440 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097a0 tx=0x7fd2e402a210 comp rx=0 tx=0).stop 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.104+0000 7fd2faf4b640 1 -- 172.21.15.6:0/1824700252 shutdown_connections 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.104+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/1824700252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d2780 0x7fd2f40d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.104+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/1824700252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d4400 0x7fd2f415f440 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.104+0000 7fd2faf4b640 1 -- 172.21.15.6:0/1824700252 >> 172.21.15.6:0/1824700252 conn(0x7fd2f40d4bb0 msgr2=0x7fd2f40d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.104+0000 7fd2faf4b640 1 -- 172.21.15.6:0/1824700252 shutdown_connections 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.104+0000 7fd2faf4b640 1 -- 172.21.15.6:0/1824700252 wait complete. 2024-05-20T17:55:37.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.105+0000 7fd2faf4b640 1 Processor -- start 2024-05-20T17:55:37.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.106+0000 7fd2faf4b640 1 -- start start 2024-05-20T17:55:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2faf4b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f406cf00 0x7fd2f415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2faf4b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d2780 0x7fd2f4153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2faf4b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d4400 0x7fd2f4154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2faf4b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f40d3920 con 0x7fd2f40d2780 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2faf4b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f40d3640 con 0x7fd2f406cf00 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2faf4b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40d3c00 con 0x7fd2f40d4400 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d2780 0x7fd2f4153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d2780 0x7fd2f4153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42478/0 (socket says 172.21.15.6:42478) 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f3fff640 1 -- 172.21.15.6:0/2670060507 learned_addr learned my addr 172.21.15.6:0/2670060507 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f94e8640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d4400 0x7fd2f4154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f8ce7640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f406cf00 0x7fd2f415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f3fff640 1 -- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d4400 msgr2=0x7fd2f4154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f3fff640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d4400 0x7fd2f4154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f3fff640 1 -- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f406cf00 msgr2=0x7fd2f415c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.107+0000 7fd2f3fff640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f406cf00 0x7fd2f415c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.108+0000 7fd2f3fff640 1 -- 172.21.15.6:0/2670060507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f415d510 con 0x7fd2f40d2780 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.108+0000 7fd2f8ce7640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f406cf00 0x7fd2f415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.108+0000 7fd2f3fff640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d2780 0x7fd2f4153c40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800c430 tx=0x7fd2e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.108+0000 7fd2f17fa640 1 -- 172.21.15.6:0/2670060507 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80074e0 con 0x7fd2f40d2780 2024-05-20T17:55:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.108+0000 7fd2f17fa640 1 -- 172.21.15.6:0/2670060507 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e80047e0 con 0x7fd2f40d2780 2024-05-20T17:55:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.108+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f415d7f0 con 0x7fd2f40d2780 2024-05-20T17:55:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.108+0000 7fd2f17fa640 1 -- 172.21.15.6:0/2670060507 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8004bd0 con 0x7fd2f40d2780 2024-05-20T17:55:37.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.108+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f415ddb0 con 0x7fd2f40d2780 2024-05-20T17:55:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.109+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f415d280 con 0x7fd2f40d2780 2024-05-20T17:55:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.110+0000 7fd2f17fa640 1 -- 172.21.15.6:0/2670060507 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2e8011070 con 0x7fd2f40d2780 2024-05-20T17:55:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.110+0000 7fd2f17fa640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e006be60 0x7fd2e006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.110+0000 7fd2f17fa640 1 -- 172.21.15.6:0/2670060507 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fd2e808a990 con 0x7fd2f40d2780 2024-05-20T17:55:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.111+0000 7fd2f8ce7640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e006be60 0x7fd2e006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.111+0000 7fd2f8ce7640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e006be60 0x7fd2e006e370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4034000 tx=0x7fd2e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.115+0000 7fd2f17fa640 1 -- 172.21.15.6:0/2670060507 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd2f408d2a0 con 0x7fd2f40d2780 2024-05-20T17:55:37.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.301+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd2f40735a0 con 0x7fd2f40d2780 2024-05-20T17:55:37.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.301+0000 7fd2f17fa640 1 -- 172.21.15.6:0/2670060507 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) ==== 93+0+10 (secure 0 0 0) 0x7fd2f40735a0 con 0x7fd2f40d2780 2024-05-20T17:55:37.300 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:55:37.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e006be60 msgr2=0x7fd2e006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e006be60 0x7fd2e006e370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4034000 tx=0x7fd2e402e000 comp rx=0 tx=0).stop 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d2780 msgr2=0x7fd2f4153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d2780 0x7fd2f4153c40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800c430 tx=0x7fd2e800c8f0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 shutdown_connections 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e006be60 0x7fd2e006e370 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2f40d4400 0x7fd2f4154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2f40d2780 0x7fd2f4153c40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 --2- 172.21.15.6:0/2670060507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2f406cf00 0x7fd2f415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 >> 172.21.15.6:0/2670060507 conn(0x7fd2f40d4bb0 msgr2=0x7fd2f4160550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 shutdown_connections 2024-05-20T17:55:37.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.303+0000 7fd2faf4b640 1 -- 172.21.15.6:0/2670060507 wait complete. 2024-05-20T17:55:37.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T17:55:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.430+0000 7f318e7c7640 1 Processor -- start 2024-05-20T17:55:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.430+0000 7f318e7c7640 1 -- start start 2024-05-20T17:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.431+0000 7f318e7c7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f31881602f0 0x7f318809a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.431+0000 7f318e7c7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f318809aa30 0x7f31880d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.431+0000 7f318e7c7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3188160700 con 0x7f318806da80 2024-05-20T17:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.431+0000 7f318e7c7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3188159da0 con 0x7f318809aa30 2024-05-20T17:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.431+0000 7f318e7c7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f31880af1c0 con 0x7f31881602f0 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.431+0000 7f318cd64640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f318809aa30 0x7f31880d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.431+0000 7f318cd64640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f318809aa30 0x7f31880d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42494/0 (socket says 172.21.15.6:42494) 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.431+0000 7f318cd64640 1 -- 172.21.15.6:0/3581946106 learned_addr learned my addr 172.21.15.6:0/3581946106 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.432+0000 7f31877fe640 1 --2- 172.21.15.6:0/3581946106 >> v2:172.21.15.171:3300/0 conn(0x7f31881602f0 0x7f318809a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.432+0000 7f318cd64640 1 -- 172.21.15.6:0/3581946106 >> v2:172.21.15.171:3300/0 conn(0x7f31881602f0 msgr2=0x7f318809a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.432+0000 7f318cd64640 1 --2- 172.21.15.6:0/3581946106 >> v2:172.21.15.171:3300/0 conn(0x7f31881602f0 0x7f318809a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.432+0000 7f318cd64640 1 -- 172.21.15.6:0/3581946106 >> v1:172.21.15.171:6789/0 conn(0x7f318806da80 legacy=0x7f31880b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.432+0000 7f318cd64640 1 -- 172.21.15.6:0/3581946106 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318809ae40 con 0x7f318809aa30 2024-05-20T17:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f318cd64640 1 --2- 172.21.15.6:0/3581946106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318809aa30 0x7f31880d1c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f31880afd90 tx=0x7f318002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89473f55243f695 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f3186ffd640 1 -- 172.21.15.6:0/3581946106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180036070 con 0x7f318809aa30 2024-05-20T17:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f3186ffd640 1 -- 172.21.15.6:0/3581946106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3180031600 con 0x7f318809aa30 2024-05-20T17:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f3186ffd640 1 -- 172.21.15.6:0/3581946106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31800319d0 con 0x7f318809aa30 2024-05-20T17:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f318e7c7640 1 -- 172.21.15.6:0/3581946106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318809aa30 msgr2=0x7f31880d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f318e7c7640 1 --2- 172.21.15.6:0/3581946106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318809aa30 0x7f31880d1c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f31880afd90 tx=0x7f318002a6a0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f318e7c7640 1 -- 172.21.15.6:0/3581946106 shutdown_connections 2024-05-20T17:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f318e7c7640 1 --2- 172.21.15.6:0/3581946106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318809aa30 0x7f31880d1c40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f318e7c7640 1 --2- 172.21.15.6:0/3581946106 >> v2:172.21.15.171:3300/0 conn(0x7f31881602f0 0x7f318809a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f318e7c7640 1 -- 172.21.15.6:0/3581946106 >> 172.21.15.6:0/3581946106 conn(0x7f31880b6670 msgr2=0x7f31880b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.433+0000 7f318e7c7640 1 -- 172.21.15.6:0/3581946106 shutdown_connections 2024-05-20T17:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.434+0000 7f318e7c7640 1 -- 172.21.15.6:0/3581946106 wait complete. 2024-05-20T17:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.435+0000 7f318e7c7640 1 Processor -- start 2024-05-20T17:55:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.435+0000 7f318e7c7640 1 -- start start 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f318e7c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318806da80 0x7f318814a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f318e7c7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318809aa30 0x7f318809c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f318e7c7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31881602f0 0x7f318809e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f318e7c7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f31880b2390 con 0x7f318806da80 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f318e7c7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f31880d17b0 con 0x7f31881602f0 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f318e7c7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f31880af410 con 0x7f318809aa30 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318806da80 0x7f318814a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318806da80 0x7f318814a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42496/0 (socket says 172.21.15.6:42496) 2024-05-20T17:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 -- 172.21.15.6:0/1553761115 learned_addr learned my addr 172.21.15.6:0/1553761115 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f31877fe640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318809aa30 0x7f318809c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f318cd64640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31881602f0 0x7f318809e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 -- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318809aa30 msgr2=0x7f318809c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318809aa30 0x7f318809c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 -- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31881602f0 msgr2=0x7f318809e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31881602f0 0x7f318809e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 -- 172.21.15.6:0/1553761115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318809ce50 con 0x7f318806da80 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.437+0000 7f3187fff640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318806da80 0x7f318814a1a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f317800c470 tx=0x7f317800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.438+0000 7f3184ff9640 1 -- 172.21.15.6:0/1553761115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31780052d0 con 0x7f318806da80 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.438+0000 7f3184ff9640 1 -- 172.21.15.6:0/1553761115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3178005490 con 0x7f318806da80 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.438+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318809d130 con 0x7f318806da80 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.438+0000 7f3184ff9640 1 -- 172.21.15.6:0/1553761115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178007260 con 0x7f318806da80 2024-05-20T17:55:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.438+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318809d6f0 con 0x7f318806da80 2024-05-20T17:55:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.439+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3188162760 con 0x7f318806da80 2024-05-20T17:55:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.439+0000 7f3184ff9640 1 -- 172.21.15.6:0/1553761115 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3178007400 con 0x7f318806da80 2024-05-20T17:55:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.440+0000 7f3184ff9640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f317406be60 0x7f317406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.440+0000 7f3184ff9640 1 -- 172.21.15.6:0/1553761115 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f317808a140 con 0x7f318806da80 2024-05-20T17:55:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.440+0000 7f31877fe640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f317406be60 0x7f317406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.441+0000 7f31877fe640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f317406be60 0x7f317406e370 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3188159400 tx=0x7f317c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.445+0000 7f3184ff9640 1 -- 172.21.15.6:0/1553761115 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3188162760 con 0x7f318806da80 2024-05-20T17:55:37.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.632+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3188075b00 con 0x7f318806da80 2024-05-20T17:55:37.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.633+0000 7f3184ff9640 1 -- 172.21.15.6:0/1553761115 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) ==== 84+0+65 (secure 0 0 0) 0x7f3188160700 con 0x7f318806da80 2024-05-20T17:55:37.632 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:37.632 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T17:55:37.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:55:37.632 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T17:55:37.633 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T17:55:37.633 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:55:37.633 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T17:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f317406be60 msgr2=0x7f317406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f317406be60 0x7f317406e370 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3188159400 tx=0x7f317c008040 comp rx=0 tx=0).stop 2024-05-20T17:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318806da80 msgr2=0x7f318814a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318806da80 0x7f318814a1a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f317800c470 tx=0x7f317800c930 comp rx=0 tx=0).stop 2024-05-20T17:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 shutdown_connections 2024-05-20T17:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f317406be60 0x7f317406e370 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31881602f0 0x7f318809e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f318809aa30 0x7f318809c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 --2- 172.21.15.6:0/1553761115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318806da80 0x7f318814a1a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 >> 172.21.15.6:0/1553761115 conn(0x7f31880b6670 msgr2=0x7f3188162050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 shutdown_connections 2024-05-20T17:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.635+0000 7f318e7c7640 1 -- 172.21.15.6:0/1553761115 wait complete. 2024-05-20T17:55:37.645 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T17:55:37.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T17:55:37.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.765+0000 7f1d6ff7e640 1 Processor -- start 2024-05-20T17:55:37.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.766+0000 7f1d6ff7e640 1 -- start start 2024-05-20T17:55:37.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.767+0000 7f1d6ff7e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d680b6db0 0x7f1d680d3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.767+0000 7f1d6ff7e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d68160410 con 0x7f1d680d3a90 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.767+0000 7f1d6ff7e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d68162e70 con 0x7f1d68163950 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.767+0000 7f1d6ff7e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1d681606f0 con 0x7f1d680b6db0 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.767+0000 7f1d6d519640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d680b6db0 0x7f1d680d3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.767+0000 7f1d6e51b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1d680d3a90 0x7f1d6815f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43916/0 (socket says 172.21.15.6:43916) 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.767+0000 7f1d6e51b640 1 -- 172.21.15.6:0/2246959973 learned_addr learned my addr 172.21.15.6:0/2246959973 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.768+0000 7f1d6d519640 1 -- 172.21.15.6:0/2246959973 >> v1:172.21.15.171:6789/0 conn(0x7f1d68163950 legacy=0x7f1d680b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.768+0000 7f1d6d519640 1 -- 172.21.15.6:0/2246959973 >> v1:172.21.15.6:6789/0 conn(0x7f1d680d3a90 legacy=0x7f1d6815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.768+0000 7f1d6d519640 1 -- 172.21.15.6:0/2246959973 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d68163150 con 0x7f1d680b6db0 2024-05-20T17:55:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.768+0000 7f1d6cd18640 1 -- 172.21.15.6:0/2246959973 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327405201 0 0) 0x7f1d68160410 con 0x7f1d680d3a90 2024-05-20T17:55:37.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.768+0000 7f1d6d519640 1 --2- 172.21.15.6:0/2246959973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d680b6db0 0x7f1d680d3550 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1d580097a0 tx=0x7f1d5802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39b05e33ed5e3af server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6cd18640 1 -- 172.21.15.6:0/2246959973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58037070 con 0x7f1d680b6db0 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6cd18640 1 -- 172.21.15.6:0/2246959973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d58032440 con 0x7f1d680b6db0 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6cd18640 1 -- 172.21.15.6:0/2246959973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58032810 con 0x7f1d680b6db0 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/2246959973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d680b6db0 msgr2=0x7f1d680d3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6ff7e640 1 --2- 172.21.15.6:0/2246959973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d680b6db0 0x7f1d680d3550 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1d580097a0 tx=0x7f1d5802a230 comp rx=0 tx=0).stop 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/2246959973 shutdown_connections 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6ff7e640 1 --2- 172.21.15.6:0/2246959973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d680b6db0 0x7f1d680d3550 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/2246959973 >> 172.21.15.6:0/2246959973 conn(0x7f1d680d16a0 msgr2=0x7f1d680d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/2246959973 shutdown_connections 2024-05-20T17:55:37.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.769+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/2246959973 wait complete. 2024-05-20T17:55:37.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.771+0000 7f1d6ff7e640 1 Processor -- start 2024-05-20T17:55:37.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.771+0000 7f1d6ff7e640 1 -- start start 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.772+0000 7f1d6ff7e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d680d3a90 0x7f1d6815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.772+0000 7f1d6ff7e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d68163950 0x7f1d680c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.772+0000 7f1d6ff7e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681ea8b0 0x7f1d681eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.772+0000 7f1d6ff7e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1d680d4020 con 0x7f1d681ea8b0 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.772+0000 7f1d6ff7e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d680d3ea0 con 0x7f1d68163950 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.772+0000 7f1d6ff7e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1d680d41a0 con 0x7f1d680d3a90 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681ea8b0 0x7f1d681eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681ea8b0 0x7f1d681eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56740/0 (socket says 172.21.15.6:56740) 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 -- 172.21.15.6:0/195833751 learned_addr learned my addr 172.21.15.6:0/195833751 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6dd1a640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d680d3a90 0x7f1d6815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6d519640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d68163950 0x7f1d680c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 -- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d680d3a90 msgr2=0x7f1d6815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d680d3a90 0x7f1d6815df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 -- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d68163950 msgr2=0x7f1d680c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d68163950 0x7f1d680c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 -- 172.21.15.6:0/195833751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d681eb200 con 0x7f1d681ea8b0 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6d519640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d68163950 0x7f1d680c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6e51b640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681ea8b0 0x7f1d681eacc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000c780 tx=0x7f1d6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d5e7fc640 1 -- 172.21.15.6:0/195833751 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60018070 con 0x7f1d681ea8b0 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d5e7fc640 1 -- 172.21.15.6:0/195833751 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d6000ce30 con 0x7f1d681ea8b0 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d680cd8d0 con 0x7f1d681ea8b0 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d5e7fc640 1 -- 172.21.15.6:0/195833751 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000a800 con 0x7f1d681ea8b0 2024-05-20T17:55:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.773+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d680c95f0 con 0x7f1d681ea8b0 2024-05-20T17:55:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.774+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d680d1ab0 con 0x7f1d681ea8b0 2024-05-20T17:55:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.775+0000 7f1d5e7fc640 1 -- 172.21.15.6:0/195833751 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d6001b070 con 0x7f1d681ea8b0 2024-05-20T17:55:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.776+0000 7f1d5e7fc640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1d4c06be60 0x7f1d4c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.776+0000 7f1d5e7fc640 1 -- 172.21.15.6:0/195833751 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f1d6008a0e0 con 0x7f1d681ea8b0 2024-05-20T17:55:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.776+0000 7f1d6dd1a640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1d4c06be60 0x7f1d4c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.776+0000 7f1d6dd1a640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1d4c06be60 0x7f1d4c06e370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1d64000f60 tx=0x7f1d64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.780+0000 7f1d5e7fc640 1 -- 172.21.15.6:0/195833751 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1d680d1ab0 con 0x7f1d681ea8b0 2024-05-20T17:55:37.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:37.964+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1d680690b0 con 0x7f1d681ea8b0 2024-05-20T17:55:38.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.240+0000 7f1d5e7fc640 1 -- 172.21.15.6:0/195833751 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) ==== 138+0+0 (secure 0 0 0) 0x7f1d681eb200 con 0x7f1d681ea8b0 2024-05-20T17:55:38.240 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T17:55:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1d4c06be60 msgr2=0x7f1d4c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:38.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1d4c06be60 0x7f1d4c06e370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1d64000f60 tx=0x7f1d64009040 comp rx=0 tx=0).stop 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681ea8b0 msgr2=0x7f1d681eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681ea8b0 0x7f1d681eacc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000c780 tx=0x7f1d6000cc40 comp rx=0 tx=0).stop 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 shutdown_connections 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1d4c06be60 0x7f1d4c06e370 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d681ea8b0 0x7f1d681eacc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d68163950 0x7f1d680c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 --2- 172.21.15.6:0/195833751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d680d3a90 0x7f1d6815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 >> 172.21.15.6:0/195833751 conn(0x7f1d680d16a0 msgr2=0x7f1d6815f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 shutdown_connections 2024-05-20T17:55:38.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.243+0000 7f1d6ff7e640 1 -- 172.21.15.6:0/195833751 wait complete. 2024-05-20T17:55:38.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T17:55:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.383+0000 7f1c17414640 1 Processor -- start 2024-05-20T17:55:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.383+0000 7f1c17414640 1 -- start start 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.384+0000 7f1c17414640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c100b0a00 0x7f1c1015c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.384+0000 7f1c17414640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c1006c630 0x7f1c1006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.384+0000 7f1c17414640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c1006dfa0 con 0x7f1c100ce9b0 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.384+0000 7f1c17414640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1c100b3000 con 0x7f1c100b0a00 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.384+0000 7f1c17414640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1c100b2cf0 con 0x7f1c1006c630 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.384+0000 7f1c151b0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c100b0a00 0x7f1c1015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.384+0000 7f1c151b0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1c100b0a00 0x7f1c1015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56742/0 (socket says 172.21.15.6:56742) 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.384+0000 7f1c151b0640 1 -- 172.21.15.6:0/2970565899 learned_addr learned my addr 172.21.15.6:0/2970565899 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.385+0000 7f1c149af640 1 --2- 172.21.15.6:0/2970565899 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c1006c630 0x7f1c1006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.385+0000 7f1c151b0640 1 -- 172.21.15.6:0/2970565899 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c1006c630 msgr2=0x7f1c1006ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.385+0000 7f1c151b0640 1 --2- 172.21.15.6:0/2970565899 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c1006c630 0x7f1c1006ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.385+0000 7f1c151b0640 1 -- 172.21.15.6:0/2970565899 >> v1:172.21.15.171:6789/0 conn(0x7f1c100ce9b0 legacy=0x7f1c100cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.385+0000 7f1c151b0640 1 -- 172.21.15.6:0/2970565899 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1015ca90 con 0x7f1c100b0a00 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.385+0000 7f1c151b0640 1 --2- 172.21.15.6:0/2970565899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c100b0a00 0x7f1c1015c550 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009870 tx=0x7f1c0c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce835eca6b7e6a5b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c07fff640 1 -- 172.21.15.6:0/2970565899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c037070 con 0x7f1c100b0a00 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c07fff640 1 -- 172.21.15.6:0/2970565899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0c032440 con 0x7f1c100b0a00 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c07fff640 1 -- 172.21.15.6:0/2970565899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c032810 con 0x7f1c100b0a00 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c17414640 1 -- 172.21.15.6:0/2970565899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c100b0a00 msgr2=0x7f1c1015c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c17414640 1 --2- 172.21.15.6:0/2970565899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c100b0a00 0x7f1c1015c550 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009870 tx=0x7f1c0c02a210 comp rx=0 tx=0).stop 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c17414640 1 -- 172.21.15.6:0/2970565899 shutdown_connections 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c17414640 1 --2- 172.21.15.6:0/2970565899 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c1006c630 0x7f1c1006ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c17414640 1 --2- 172.21.15.6:0/2970565899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c100b0a00 0x7f1c1015c550 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.386+0000 7f1c17414640 1 -- 172.21.15.6:0/2970565899 >> 172.21.15.6:0/2970565899 conn(0x7f1c10073670 msgr2=0x7f1c100b6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.387+0000 7f1c17414640 1 -- 172.21.15.6:0/2970565899 shutdown_connections 2024-05-20T17:55:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.387+0000 7f1c17414640 1 -- 172.21.15.6:0/2970565899 wait complete. 2024-05-20T17:55:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.388+0000 7f1c17414640 1 Processor -- start 2024-05-20T17:55:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.388+0000 7f1c17414640 1 -- start start 2024-05-20T17:55:38.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c17414640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1006c630 0x7f1c10158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c17414640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c100b0a00 0x7f1c100cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c17414640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c100ce9b0 0x7f1c1006b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c17414640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1015d2f0 con 0x7f1c1006c630 2024-05-20T17:55:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c17414640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1015d010 con 0x7f1c100b0a00 2024-05-20T17:55:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c17414640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1c10159d70 con 0x7f1c100ce9b0 2024-05-20T17:55:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1006c630 0x7f1c10158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1006c630 0x7f1c10158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56752/0 (socket says 172.21.15.6:56752) 2024-05-20T17:55:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 -- 172.21.15.6:0/3611727345 learned_addr learned my addr 172.21.15.6:0/3611727345 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c149af640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c100b0a00 0x7f1c100cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c159b1640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c100ce9b0 0x7f1c1006b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:38.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 -- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c100ce9b0 msgr2=0x7f1c1006b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:38.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c100ce9b0 0x7f1c1006b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 -- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c100b0a00 msgr2=0x7f1c100cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:38.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c100b0a00 0x7f1c100cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:38.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 -- 172.21.15.6:0/3611727345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c100cb0b0 con 0x7f1c1006c630 2024-05-20T17:55:38.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c149af640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c100b0a00 0x7f1c100cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:38.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.390+0000 7f1c151b0640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1006c630 0x7f1c10158a20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c000c00 tx=0x7f1c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:38.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.391+0000 7f1c05ffb640 1 -- 172.21.15.6:0/3611727345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c037040 con 0x7f1c1006c630 2024-05-20T17:55:38.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.391+0000 7f1c05ffb640 1 -- 172.21.15.6:0/3611727345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0c042070 con 0x7f1c1006c630 2024-05-20T17:55:38.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.391+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c100cb5c0 con 0x7f1c1006c630 2024-05-20T17:55:38.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.391+0000 7f1c05ffb640 1 -- 172.21.15.6:0/3611727345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c030bb0 con 0x7f1c1006c630 2024-05-20T17:55:38.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.391+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c100cbb80 con 0x7f1c1006c630 2024-05-20T17:55:38.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.392+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c100690b0 con 0x7f1c1006c630 2024-05-20T17:55:38.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.393+0000 7f1c05ffb640 1 -- 172.21.15.6:0/3611727345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c0c047460 con 0x7f1c1006c630 2024-05-20T17:55:38.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.393+0000 7f1c05ffb640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bf406be60 0x7f1bf406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:38.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.393+0000 7f1c05ffb640 1 -- 172.21.15.6:0/3611727345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5619+0+0 (secure 0 0 0) 0x7f1c0c0abb40 con 0x7f1c1006c630 2024-05-20T17:55:38.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.393+0000 7f1c149af640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bf406be60 0x7f1bf406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:38.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.394+0000 7f1c149af640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bf406be60 0x7f1bf406e370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1c00006fd0 tx=0x7f1c00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:38.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.398+0000 7f1c05ffb640 1 -- 172.21.15.6:0/3611727345 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1c0c079e60 con 0x7f1c1006c630 2024-05-20T17:55:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:38.583+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1c1006ffd0 con 0x7f1c1006c630 2024-05-20T17:55:39.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.248+0000 7f1c05ffb640 1 -- 172.21.15.6:0/3611727345 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) ==== 170+0+0 (secure 0 0 0) 0x7f1c0c07e160 con 0x7f1c1006c630 2024-05-20T17:55:39.247 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T17:55:39.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.253+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bf406be60 msgr2=0x7f1bf406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:39.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.253+0000 7f1c17414640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bf406be60 0x7f1bf406e370 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1c00006fd0 tx=0x7f1c00008040 comp rx=0 tx=0).stop 2024-05-20T17:55:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.253+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1006c630 msgr2=0x7f1c10158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.253+0000 7f1c17414640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1006c630 0x7f1c10158a20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c000c00 tx=0x7f1c0c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.254+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 shutdown_connections 2024-05-20T17:55:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.254+0000 7f1c17414640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bf406be60 0x7f1bf406e370 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.254+0000 7f1c17414640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c100ce9b0 0x7f1c1006b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.254+0000 7f1c17414640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c100b0a00 0x7f1c100cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.254+0000 7f1c17414640 1 --2- 172.21.15.6:0/3611727345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c1006c630 0x7f1c10158a20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.254+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 >> 172.21.15.6:0/3611727345 conn(0x7f1c10073670 msgr2=0x7f1c1006f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:39.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.256+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 shutdown_connections 2024-05-20T17:55:39.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.258+0000 7f1c17414640 1 -- 172.21.15.6:0/3611727345 wait complete. 2024-05-20T17:55:39.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T17:55:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.407+0000 7f9d91d77640 1 Processor -- start 2024-05-20T17:55:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.407+0000 7f9d91d77640 1 -- start start 2024-05-20T17:55:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.408+0000 7f9d91d77640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d8c15d530 0x7f9d8c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.408+0000 7f9d91d77640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9d8c0b1700 0x7f9d8c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.408+0000 7f9d91d77640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d8c0cd580 con 0x7f9d8c070850 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.408+0000 7f9d91d77640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8c0ce190 con 0x7f9d8c15d530 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.408+0000 7f9d91d77640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9d8c0cd860 con 0x7f9d8c0b1700 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.408+0000 7f9d8b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d8c15d530 0x7f9d8c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.408+0000 7f9d8b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d8c15d530 0x7f9d8c15aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56758/0 (socket says 172.21.15.6:56758) 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.408+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2905676613 learned_addr learned my addr 172.21.15.6:0/2905676613 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.409+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2905676613 >> v2:172.21.15.171:3300/0 conn(0x7f9d8c0b1700 msgr2=0x7f9d8c0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.409+0000 7f9d8affd640 1 --2- 172.21.15.6:0/2905676613 >> v2:172.21.15.171:3300/0 conn(0x7f9d8c0b1700 0x7f9d8c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.409+0000 7f9d8b7fe640 1 --2- 172.21.15.6:0/2905676613 >> v2:172.21.15.171:3300/0 conn(0x7f9d8c0b1700 0x7f9d8c0b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.409+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2905676613 >> v1:172.21.15.171:6789/0 conn(0x7f9d8c070850 legacy=0x7f9d8c070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.409+0000 7f9d8b7fe640 1 -- 172.21.15.6:0/2905676613 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c0cdb40 con 0x7f9d8c15d530 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.409+0000 7f9d8b7fe640 1 --2- 172.21.15.6:0/2905676613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15aaa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0d3ad0 tx=0x7f9d7c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342da17a6ed564a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d8a7fc640 1 -- 172.21.15.6:0/2905676613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c037070 con 0x7f9d8c15d530 2024-05-20T17:55:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d8a7fc640 1 -- 172.21.15.6:0/2905676613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7c032440 con 0x7f9d8c15d530 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d8a7fc640 1 -- 172.21.15.6:0/2905676613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c032810 con 0x7f9d8c15d530 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d91d77640 1 -- 172.21.15.6:0/2905676613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 msgr2=0x7f9d8c15aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d91d77640 1 --2- 172.21.15.6:0/2905676613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15aaa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0d3ad0 tx=0x7f9d7c02a230 comp rx=0 tx=0).stop 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d91d77640 1 -- 172.21.15.6:0/2905676613 shutdown_connections 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d91d77640 1 --2- 172.21.15.6:0/2905676613 >> v2:172.21.15.171:3300/0 conn(0x7f9d8c0b1700 0x7f9d8c0b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d91d77640 1 --2- 172.21.15.6:0/2905676613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15aaa0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d91d77640 1 -- 172.21.15.6:0/2905676613 >> 172.21.15.6:0/2905676613 conn(0x7f9d8c0d29d0 msgr2=0x7f9d8c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d91d77640 1 -- 172.21.15.6:0/2905676613 shutdown_connections 2024-05-20T17:55:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.410+0000 7f9d91d77640 1 -- 172.21.15.6:0/2905676613 wait complete. 2024-05-20T17:55:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.412+0000 7f9d91d77640 1 Processor -- start 2024-05-20T17:55:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.412+0000 7f9d91d77640 1 -- start start 2024-05-20T17:55:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d91d77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d8c070850 0x7f9d8c1f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d91d77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d8c0b1700 0x7f9d8c156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d91d77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d91d77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c0b2050 con 0x7f9d8c15d530 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d91d77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c0cd230 con 0x7f9d8c0b1700 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d91d77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8c071370 con 0x7f9d8c070850 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56760/0 (socket says 172.21.15.6:56760) 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 -- 172.21.15.6:0/56603465 learned_addr learned my addr 172.21.15.6:0/56603465 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8b7fe640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d8c070850 0x7f9d8c1f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8affd640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d8c0b1700 0x7f9d8c156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 -- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d8c070850 msgr2=0x7f9d8c1f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d8c070850 0x7f9d8c1f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 -- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d8c0b1700 msgr2=0x7f9d8c156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d8c0b1700 0x7f9d8c156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 -- 172.21.15.6:0/56603465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c158b00 con 0x7f9d8c15d530 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.414+0000 7f9d8bfff640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15baf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400ba10 tx=0x7f9d8400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.415+0000 7f9d73fff640 1 -- 172.21.15.6:0/56603465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84019070 con 0x7f9d8c15d530 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.415+0000 7f9d73fff640 1 -- 172.21.15.6:0/56603465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8400cba0 con 0x7f9d8c15d530 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.415+0000 7f9d73fff640 1 -- 172.21.15.6:0/56603465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84014440 con 0x7f9d8c15d530 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.415+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8c157f80 con 0x7f9d8c15d530 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.415+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8c158540 con 0x7f9d8c15d530 2024-05-20T17:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.416+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8c1f3540 con 0x7f9d8c15d530 2024-05-20T17:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.416+0000 7f9d73fff640 1 -- 172.21.15.6:0/56603465 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d8401c360 con 0x7f9d8c15d530 2024-05-20T17:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.417+0000 7f9d73fff640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7806be60 0x7f9d7806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.417+0000 7f9d73fff640 1 -- 172.21.15.6:0/56603465 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6001+0+0 (secure 0 0 0) 0x7f9d8408ab50 con 0x7f9d8c15d530 2024-05-20T17:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.417+0000 7f9d8b7fe640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7806be60 0x7f9d7806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.418+0000 7f9d8b7fe640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7806be60 0x7f9d7806e370 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c034000 tx=0x7f9d7c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:39.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.422+0000 7f9d73fff640 1 -- 172.21.15.6:0/56603465 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9d8c1f3540 con 0x7f9d8c15d530 2024-05-20T17:55:39.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:39.643+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9d8c157d10 con 0x7f9d8c15d530 2024-05-20T17:55:40.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.249+0000 7f9d73fff640 1 -- 172.21.15.6:0/56603465 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v23) ==== 172+0+0 (secure 0 0 0) 0x7f9d84058ce0 con 0x7f9d8c15d530 2024-05-20T17:55:40.249 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 7 and data pool 8 2024-05-20T17:55:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.256+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7806be60 msgr2=0x7f9d7806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.257+0000 7f9d91d77640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7806be60 0x7f9d7806e370 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c034000 tx=0x7f9d7c02e000 comp rx=0 tx=0).stop 2024-05-20T17:55:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.257+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 msgr2=0x7f9d8c15baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.257+0000 7f9d91d77640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15baf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400ba10 tx=0x7f9d8400bed0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.264+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 shutdown_connections 2024-05-20T17:55:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.264+0000 7f9d91d77640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7806be60 0x7f9d7806e370 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.264+0000 7f9d91d77640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c15d530 0x7f9d8c15baf0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.264+0000 7f9d91d77640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d8c0b1700 0x7f9d8c156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.264+0000 7f9d91d77640 1 --2- 172.21.15.6:0/56603465 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d8c070850 0x7f9d8c1f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.264+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 >> 172.21.15.6:0/56603465 conn(0x7f9d8c0d29d0 msgr2=0x7f9d8c0b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.269+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 shutdown_connections 2024-05-20T17:55:40.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.271+0000 7f9d91d77640 1 -- 172.21.15.6:0/56603465 wait complete. 2024-05-20T17:55:40.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:40.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.415+0000 7f16e5f36640 1 Processor -- start 2024-05-20T17:55:40.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.415+0000 7f16e5f36640 1 -- start start 2024-05-20T17:55:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16e5f36640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16e0162820 0x7f16e00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16e5f36640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e00d0630 con 0x7f16e006dae0 2024-05-20T17:55:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16e5f36640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e00d39c0 con 0x7f16e00b3e80 2024-05-20T17:55:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16e5f36640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f16e00d3ca0 con 0x7f16e0162820 2024-05-20T17:55:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16df7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16e0162820 0x7f16e00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16dffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f16e006dae0 0x7f16e00b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43920/0 (socket says 172.21.15.6:43920) 2024-05-20T17:55:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16df7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16e0162820 0x7f16e00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56764/0 (socket says 172.21.15.6:56764) 2024-05-20T17:55:40.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16dffff640 1 -- 172.21.15.6:0/2689827983 learned_addr learned my addr 172.21.15.6:0/2689827983 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:40.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16df7fe640 1 -- 172.21.15.6:0/2689827983 >> v1:172.21.15.171:6789/0 conn(0x7f16e00b3e80 legacy=0x7f16e006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:40.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16df7fe640 1 -- 172.21.15.6:0/2689827983 >> v1:172.21.15.6:6789/0 conn(0x7f16e006dae0 legacy=0x7f16e00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16df7fe640 1 -- 172.21.15.6:0/2689827983 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e00d3f80 con 0x7f16e0162820 2024-05-20T17:55:40.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.417+0000 7f16de7fc640 1 -- 172.21.15.6:0/2689827983 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595185810 0 0) 0x7f16e00d0630 con 0x7f16e006dae0 2024-05-20T17:55:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.418+0000 7f16df7fe640 1 --2- 172.21.15.6:0/2689827983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e0162820 0x7f16e00b3940 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f16d00097a0 tx=0x7f16d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be196de9f69b53d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.418+0000 7f16de7fc640 1 -- 172.21.15.6:0/2689827983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0037070 con 0x7f16e0162820 2024-05-20T17:55:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.418+0000 7f16de7fc640 1 -- 172.21.15.6:0/2689827983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d0032440 con 0x7f16e0162820 2024-05-20T17:55:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.418+0000 7f16de7fc640 1 -- 172.21.15.6:0/2689827983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0032810 con 0x7f16e0162820 2024-05-20T17:55:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.419+0000 7f16e5f36640 1 -- 172.21.15.6:0/2689827983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e0162820 msgr2=0x7f16e00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.419+0000 7f16e5f36640 1 --2- 172.21.15.6:0/2689827983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e0162820 0x7f16e00b3940 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f16d00097a0 tx=0x7f16d002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.419+0000 7f16e5f36640 1 -- 172.21.15.6:0/2689827983 shutdown_connections 2024-05-20T17:55:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.419+0000 7f16e5f36640 1 --2- 172.21.15.6:0/2689827983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e0162820 0x7f16e00b3940 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.419+0000 7f16e5f36640 1 -- 172.21.15.6:0/2689827983 >> 172.21.15.6:0/2689827983 conn(0x7f16e00d4bd0 msgr2=0x7f16e00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.419+0000 7f16e5f36640 1 -- 172.21.15.6:0/2689827983 shutdown_connections 2024-05-20T17:55:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.419+0000 7f16e5f36640 1 -- 172.21.15.6:0/2689827983 wait complete. 2024-05-20T17:55:40.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.421+0000 7f16e5f36640 1 Processor -- start 2024-05-20T17:55:40.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.421+0000 7f16e5f36640 1 -- start start 2024-05-20T17:55:40.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16e5f36640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16e00b3e80 0x7f16e014aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16e5f36640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16e0162820 0x7f16e00c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16e5f36640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e00ba5d0 0x7f16e00c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16e5f36640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f16e00d4780 con 0x7f16e00ba5d0 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16e5f36640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16e00d0300 con 0x7f16e00b3e80 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16e5f36640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16e00d4900 con 0x7f16e0162820 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e00ba5d0 0x7f16e00c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e00ba5d0 0x7f16e00c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56776/0 (socket says 172.21.15.6:56776) 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16dffff640 1 -- 172.21.15.6:0/451614586 learned_addr learned my addr 172.21.15.6:0/451614586 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16deffd640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16e0162820 0x7f16e00c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.422+0000 7f16df7fe640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16e00b3e80 0x7f16e014aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16dffff640 1 -- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16e0162820 msgr2=0x7f16e00c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16dffff640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16e0162820 0x7f16e00c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16dffff640 1 -- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16e00b3e80 msgr2=0x7f16e014aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16dffff640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16e00b3e80 0x7f16e014aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16dffff640 1 -- 172.21.15.6:0/451614586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e00b6df0 con 0x7f16e00ba5d0 2024-05-20T17:55:40.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16dffff640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e00ba5d0 0x7f16e00c8c40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f16d800c700 tx=0x7f16d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:40.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16c7fff640 1 -- 172.21.15.6:0/451614586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d8018070 con 0x7f16e00ba5d0 2024-05-20T17:55:40.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16c7fff640 1 -- 172.21.15.6:0/451614586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d800ce10 con 0x7f16e00ba5d0 2024-05-20T17:55:40.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e00b7060 con 0x7f16e00ba5d0 2024-05-20T17:55:40.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16c7fff640 1 -- 172.21.15.6:0/451614586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d800a860 con 0x7f16e00ba5d0 2024-05-20T17:55:40.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.423+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e00c9280 con 0x7f16e00ba5d0 2024-05-20T17:55:40.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.424+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e00b9bf0 con 0x7f16e00ba5d0 2024-05-20T17:55:40.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.425+0000 7f16c7fff640 1 -- 172.21.15.6:0/451614586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16d801b070 con 0x7f16e00ba5d0 2024-05-20T17:55:40.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.425+0000 7f16c7fff640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16cc06be30 0x7f16cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.425+0000 7f16c7fff640 1 -- 172.21.15.6:0/451614586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f16d808a480 con 0x7f16e00ba5d0 2024-05-20T17:55:40.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.426+0000 7f16df7fe640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16cc06be30 0x7f16cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.426+0000 7f16df7fe640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16cc06be30 0x7f16cc06e340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f16d0034000 tx=0x7f16d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:40.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.430+0000 7f16c7fff640 1 -- 172.21.15.6:0/451614586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f16e00b9bf0 con 0x7f16e00ba5d0 2024-05-20T17:55:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.615+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16e0075b00 con 0x7f16e00ba5d0 2024-05-20T17:55:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.616+0000 7f16c7fff640 1 -- 172.21.15.6:0/451614586 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16907 (secure 0 0 0) 0x7f16d80586e0 con 0x7f16e00ba5d0 2024-05-20T17:55:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:40.616 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":50,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:39.645034+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:55:37.996162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-20T17:55:38.615776+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16cc06be30 msgr2=0x7f16cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16cc06be30 0x7f16cc06e340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f16d0034000 tx=0x7f16d002e000 comp rx=0 tx=0).stop 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e00ba5d0 msgr2=0x7f16e00c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e00ba5d0 0x7f16e00c8c40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f16d800c700 tx=0x7f16d800cbc0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 shutdown_connections 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16cc06be30 0x7f16cc06e340 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16e00ba5d0 0x7f16e00c8c40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16e0162820 0x7f16e00c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 --2- 172.21.15.6:0/451614586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16e00b3e80 0x7f16e014aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.618+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 >> 172.21.15.6:0/451614586 conn(0x7f16e00d4bd0 msgr2=0x7f16e006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.619+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 shutdown_connections 2024-05-20T17:55:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.619+0000 7f16e5f36640 1 -- 172.21.15.6:0/451614586 wait complete. 2024-05-20T17:55:40.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.745+0000 7fc55738b640 1 Processor -- start 2024-05-20T17:55:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.745+0000 7fc55738b640 1 -- start start 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc55738b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc550168050 0x7fc55016a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc55738b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5500d0630 con 0x7fc55006d3d0 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc55738b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5500d39c0 con 0x7fc550162820 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc55738b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc5500d3ca0 con 0x7fc550168050 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc554926640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc55006d3d0 0x7fc55006d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43924/0 (socket says 172.21.15.6:43924) 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc554926640 1 -- 172.21.15.6:0/1518758598 learned_addr learned my addr 172.21.15.6:0/1518758598 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc555928640 1 --2- 172.21.15.6:0/1518758598 >> v2:172.21.15.171:3300/0 conn(0x7fc550168050 0x7fc55016a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549004558 0 0) 0x7fc5500d0630 con 0x7fc55006d3d0 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.747+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc53c003520 con 0x7fc55006d3d0 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1944950870 0 0) 0x7fc53c003520 con 0x7fc55006d3d0 2024-05-20T17:55:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 >> v2:172.21.15.171:3300/0 conn(0x7fc550168050 msgr2=0x7fc55016a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 --2- 172.21.15.6:0/1518758598 >> v2:172.21.15.171:3300/0 conn(0x7fc550168050 0x7fc55016a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 >> v1:172.21.15.171:6789/0 conn(0x7fc550162820 legacy=0x7fc5500b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5500d3f80 con 0x7fc55006d3d0 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fc540001670 con 0x7fc55006d3d0 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555928640 1 --2- 172.21.15.6:0/1518758598 >> v2:172.21.15.171:3300/0 conn(0x7fc550168050 0x7fc55016a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 >> v1:172.21.15.6:6789/0 conn(0x7fc55006d3d0 legacy=0x7fc55006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc53c0039b0 0x7fc53c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c004800 0x7fc53c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc53c0051c0 0x7fc53c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5500d3ca0 con 0x7fc53c0051c0 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c00c160 con 0x7fc53c0039b0 2024-05-20T17:55:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc53c00c360 con 0x7fc53c004800 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555928640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc53c0051c0 0x7fc53c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc554926640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c004800 0x7fc53c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555127640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc53c0039b0 0x7fc53c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555928640 1 -- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c004800 msgr2=0x7fc53c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555928640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c004800 0x7fc53c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555928640 1 -- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc53c0039b0 msgr2=0x7fc53c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555928640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc53c0039b0 0x7fc53c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555928640 1 -- 172.21.15.6:0/1518758598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c003520 con 0x7fc53c0051c0 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.748+0000 7fc555127640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc53c0039b0 0x7fc53c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.749+0000 7fc555928640 1 -- 172.21.15.6:0/1518758598 reap_dead start 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.749+0000 7fc555928640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc53c0051c0 0x7fc53c00b9c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc54800e350 tx=0x7fc53c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbdab079d5c5db3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.749+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548033070 con 0x7fc53c0051c0 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.749+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54802f650 con 0x7fc53c0051c0 2024-05-20T17:55:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.749+0000 7fc547fff640 1 -- 172.21.15.6:0/1518758598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548009de0 con 0x7fc53c0051c0 2024-05-20T17:55:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.750+0000 7fc55738b640 1 -- 172.21.15.6:0/1518758598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc53c0051c0 msgr2=0x7fc53c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.750+0000 7fc55738b640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc53c0051c0 0x7fc53c00b9c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc54800e350 tx=0x7fc53c005830 comp rx=0 tx=0).stop 2024-05-20T17:55:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.750+0000 7fc55738b640 1 -- 172.21.15.6:0/1518758598 shutdown_connections 2024-05-20T17:55:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.750+0000 7fc55738b640 1 --2- 172.21.15.6:0/1518758598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc53c0051c0 0x7fc53c00b9c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.750+0000 7fc55738b640 1 -- 172.21.15.6:0/1518758598 >> 172.21.15.6:0/1518758598 conn(0x7fc5500d4bd0 msgr2=0x7fc5500d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.750+0000 7fc55738b640 1 -- 172.21.15.6:0/1518758598 shutdown_connections 2024-05-20T17:55:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.750+0000 7fc55738b640 1 -- 172.21.15.6:0/1518758598 wait complete. 2024-05-20T17:55:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.752+0000 7fc55738b640 1 Processor -- start 2024-05-20T17:55:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.752+0000 7fc55738b640 1 -- start start 2024-05-20T17:55:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc55738b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c0051c0 0x7fc550160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc55738b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc550152540 0x7fc55014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc55738b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5501571c0 0x7fc5501575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc55738b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5500d4780 con 0x7fc550152540 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc55738b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5500d0300 con 0x7fc5501571c0 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc55738b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5500d4900 con 0x7fc53c0051c0 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc554926640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc550152540 0x7fc55014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc554926640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc550152540 0x7fc55014e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56798/0 (socket says 172.21.15.6:56798) 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc554926640 1 -- 172.21.15.6:0/2051701064 learned_addr learned my addr 172.21.15.6:0/2051701064 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc554926640 1 -- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c0051c0 msgr2=0x7fc550160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.753+0000 7fc555127640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c0051c0 0x7fc550160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc555928640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5501571c0 0x7fc5501575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc554926640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c0051c0 0x7fc550160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc554926640 1 -- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5501571c0 msgr2=0x7fc5501575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc554926640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5501571c0 0x7fc5501575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc554926640 1 -- 172.21.15.6:0/2051701064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc550156400 con 0x7fc550152540 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc555127640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c0051c0 0x7fc550160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc555928640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5501571c0 0x7fc5501575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc554926640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc550152540 0x7fc55014e070 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc540004ef0 tx=0x7fc540007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc545ffb640 1 -- 172.21.15.6:0/2051701064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54000f7b0 con 0x7fc550152540 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc545ffb640 1 -- 172.21.15.6:0/2051701064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc540018070 con 0x7fc550152540 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc545ffb640 1 -- 172.21.15.6:0/2051701064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54000fbb0 con 0x7fc550152540 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5501566e0 con 0x7fc550152540 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.754+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc550152980 con 0x7fc550152540 2024-05-20T17:55:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.755+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55015f0b0 con 0x7fc550152540 2024-05-20T17:55:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.756+0000 7fc545ffb640 1 -- 172.21.15.6:0/2051701064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc54000fd50 con 0x7fc550152540 2024-05-20T17:55:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.756+0000 7fc545ffb640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be60 0x7fc53406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.756+0000 7fc545ffb640 1 -- 172.21.15.6:0/2051701064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fc54008aee0 con 0x7fc550152540 2024-05-20T17:55:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.757+0000 7fc555127640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be60 0x7fc53406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.757+0000 7fc555127640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be60 0x7fc53406e370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc54c001630 tx=0x7fc54c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.761+0000 7fc545ffb640 1 -- 172.21.15.6:0/2051701064 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc540059700 con 0x7fc550152540 2024-05-20T17:55:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.946+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc550075b00 con 0x7fc550152540 2024-05-20T17:55:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.947+0000 7fc545ffb640 1 -- 172.21.15.6:0/2051701064 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16907 (secure 0 0 0) 0x7fc540059000 con 0x7fc550152540 2024-05-20T17:55:40.946 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:40.946 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":50,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:39.645034+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:55:37.996162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-20T17:55:38.615776+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be60 msgr2=0x7fc53406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be60 0x7fc53406e370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc54c001630 tx=0x7fc54c009040 comp rx=0 tx=0).stop 2024-05-20T17:55:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc550152540 msgr2=0x7fc55014e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc550152540 0x7fc55014e070 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc540004ef0 tx=0x7fc540007430 comp rx=0 tx=0).stop 2024-05-20T17:55:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 shutdown_connections 2024-05-20T17:55:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be60 0x7fc53406e370 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5501571c0 0x7fc5501575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc550152540 0x7fc55014e070 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 --2- 172.21.15.6:0/2051701064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc53c0051c0 0x7fc550160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 >> 172.21.15.6:0/2051701064 conn(0x7fc5500d4bd0 msgr2=0x7fc5500b8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 shutdown_connections 2024-05-20T17:55:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:40.949+0000 7fc55738b640 1 -- 172.21.15.6:0/2051701064 wait complete. 2024-05-20T17:55:40.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T17:55:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.078+0000 7f06b212a640 1 Processor -- start 2024-05-20T17:55:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.078+0000 7f06b212a640 1 -- start start 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06b212a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f06ac06d3d0 0x7f06ac06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06b212a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ac06dd20 con 0x7f06ac0b8190 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06b212a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ac0d0630 con 0x7f06ac162820 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06b212a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f06ac0d39c0 con 0x7f06ac06d3d0 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06abfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f06ac0b8190 0x7f06ac0b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43934/0 (socket says 172.21.15.6:43934) 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06abfff640 1 -- 172.21.15.6:0/1032507621 learned_addr learned my addr 172.21.15.6:0/1032507621 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06aaffd640 1 --2- 172.21.15.6:0/1032507621 >> v2:172.21.15.171:3300/0 conn(0x7f06ac06d3d0 0x7f06ac06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160269884 0 0) 0x7f06a4001490 con 0x7f06ac0b8190 2024-05-20T17:55:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0694003520 con 0x7f06ac0b8190 2024-05-20T17:55:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 415233401 0 0) 0x7f0694003520 con 0x7f06ac0b8190 2024-05-20T17:55:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 >> v2:172.21.15.171:3300/0 conn(0x7f06ac06d3d0 msgr2=0x7f06ac06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.080+0000 7f06aa7fc640 1 --2- 172.21.15.6:0/1032507621 >> v2:172.21.15.171:3300/0 conn(0x7f06ac06d3d0 0x7f06ac06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 >> v1:172.21.15.171:6789/0 conn(0x7f06ac162820 legacy=0x7f06ac0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac0d3ca0 con 0x7f06ac0b8190 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f06a4001bc0 con 0x7f06ac0b8190 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 >> v1:172.21.15.6:6789/0 conn(0x7f06ac0b8190 legacy=0x7f06ac0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06940039b0 0x7f0694003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f0694004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940051c0 0x7f069400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac0d39c0 con 0x7f0694004800 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f069400c160 con 0x7f06940039b0 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f069400c360 con 0x7f06940051c0 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aaffd640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f0694004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06ab7fe640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06940039b0 0x7f0694003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06abfff640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940051c0 0x7f069400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aaffd640 1 -- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940051c0 msgr2=0x7f069400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aaffd640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940051c0 0x7f069400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aaffd640 1 -- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06940039b0 msgr2=0x7f0694003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aaffd640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06940039b0 0x7f0694003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06aaffd640 1 -- 172.21.15.6:0/1032507621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0694003520 con 0x7f0694004800 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06abfff640 1 -- 172.21.15.6:0/1032507621 reap_dead start 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.081+0000 7f06ab7fe640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06940039b0 0x7f0694003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.082+0000 7f06aaffd640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f0694004c10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009ac0 tx=0x7f0694005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e6810e54b1413 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.082+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a0036070 con 0x7f0694004800 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.082+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a0031400 con 0x7f0694004800 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.082+0000 7f06aa7fc640 1 -- 172.21.15.6:0/1032507621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a0009690 con 0x7f0694004800 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.083+0000 7f06b212a640 1 -- 172.21.15.6:0/1032507621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 msgr2=0x7f0694004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.083+0000 7f06b212a640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f0694004c10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009ac0 tx=0x7f0694005830 comp rx=0 tx=0).stop 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.083+0000 7f06b212a640 1 -- 172.21.15.6:0/1032507621 shutdown_connections 2024-05-20T17:55:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.083+0000 7f06b212a640 1 --2- 172.21.15.6:0/1032507621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f0694004c10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:41.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.083+0000 7f06b212a640 1 -- 172.21.15.6:0/1032507621 >> 172.21.15.6:0/1032507621 conn(0x7f06ac0d4bd0 msgr2=0x7f06ac0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:41.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.083+0000 7f06b212a640 1 -- 172.21.15.6:0/1032507621 shutdown_connections 2024-05-20T17:55:41.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.083+0000 7f06b212a640 1 -- 172.21.15.6:0/1032507621 wait complete. 2024-05-20T17:55:41.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.085+0000 7f06b212a640 1 Processor -- start 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.085+0000 7f06b212a640 1 -- start start 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06b212a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f06ac1f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06b212a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06ac15b140 0x7f06ac158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06b212a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06ac158940 0x7f06ac1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06b212a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac0d0300 con 0x7f0694004800 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06b212a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac0d4260 con 0x7f06ac15b140 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06b212a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f06ac0d4780 con 0x7f06ac158940 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06ab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f06ac1f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06ab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f06ac1f8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56810/0 (socket says 172.21.15.6:56810) 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.086+0000 7f06ab7fe640 1 -- 172.21.15.6:0/2412314806 learned_addr learned my addr 172.21.15.6:0/2412314806 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06aaffd640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06ac15b140 0x7f06ac158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06abfff640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06ac158940 0x7f06ac1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06ab7fe640 1 -- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06ac158940 msgr2=0x7f06ac1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:41.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06ab7fe640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06ac158940 0x7f06ac1597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06ab7fe640 1 -- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06ac15b140 msgr2=0x7f06ac158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06ab7fe640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06ac15b140 0x7f06ac158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06ab7fe640 1 -- 172.21.15.6:0/2412314806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac158d50 con 0x7f0694004800 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06ab7fe640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f06ac1f8400 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f069c00e4b0 tx=0x7f069c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f0693fff640 1 -- 172.21.15.6:0/2412314806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c0052e0 con 0x7f0694004800 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f0693fff640 1 -- 172.21.15.6:0/2412314806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c007020 con 0x7f0694004800 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f0693fff640 1 -- 172.21.15.6:0/2412314806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c007210 con 0x7f0694004800 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ac15bc00 con 0x7f0694004800 2024-05-20T17:55:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.087+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ac15c1c0 con 0x7f0694004800 2024-05-20T17:55:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.088+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ac075b00 con 0x7f0694004800 2024-05-20T17:55:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.089+0000 7f0693fff640 1 -- 172.21.15.6:0/2412314806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f069c01a020 con 0x7f0694004800 2024-05-20T17:55:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.089+0000 7f0693fff640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f069806be60 0x7f069806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.089+0000 7f0693fff640 1 -- 172.21.15.6:0/2412314806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f069c08a580 con 0x7f0694004800 2024-05-20T17:55:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.090+0000 7f06aaffd640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f069806be60 0x7f069806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.090+0000 7f06aaffd640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f069806be60 0x7f069806e370 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f06a0033000 tx=0x7f06a0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:41.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.094+0000 7f0693fff640 1 -- 172.21.15.6:0/2412314806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f06ac158d50 con 0x7f0694004800 2024-05-20T17:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:41.320+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f06ac0d54a0 con 0x7f0694004800 2024-05-20T17:55:42.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.292+0000 7f0693fff640 1 -- 172.21.15.6:0/2412314806 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f069c01a310 con 0x7f0694004800 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f069806be60 msgr2=0x7f069806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f069806be60 0x7f069806e370 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f06a0033000 tx=0x7f06a0008030 comp rx=0 tx=0).stop 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 msgr2=0x7f06ac1f8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f06ac1f8400 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f069c00e4b0 tx=0x7f069c00e970 comp rx=0 tx=0).stop 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 shutdown_connections 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f069806be60 0x7f069806e370 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06ac158940 0x7f06ac1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06ac15b140 0x7f06ac158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 --2- 172.21.15.6:0/2412314806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0694004800 0x7f06ac1f8400 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.295+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 >> 172.21.15.6:0/2412314806 conn(0x7f06ac0d4bd0 msgr2=0x7f06ac0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.296+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 shutdown_connections 2024-05-20T17:55:42.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.296+0000 7f06b212a640 1 -- 172.21.15.6:0/2412314806 wait complete. 2024-05-20T17:55:42.308 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T17:55:42.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T17:55:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.434+0000 7f77813ea640 1 Processor -- start 2024-05-20T17:55:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.434+0000 7f77813ea640 1 -- start start 2024-05-20T17:55:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.435+0000 7f77813ea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f777c162820 0x7f777c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.435+0000 7f77813ea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f777c06dae0 0x7f777c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.435+0000 7f77813ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c0d0630 con 0x7f777c0b3e80 2024-05-20T17:55:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.435+0000 7f77813ea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f777c0d39c0 con 0x7f777c162820 2024-05-20T17:55:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.435+0000 7f77813ea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f777c0d3ca0 con 0x7f777c06dae0 2024-05-20T17:55:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.436+0000 7f777affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f777c162820 0x7f777c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.436+0000 7f777affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f777c162820 0x7f777c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56812/0 (socket says 172.21.15.6:56812) 2024-05-20T17:55:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.436+0000 7f777affd640 1 -- 172.21.15.6:0/743766143 learned_addr learned my addr 172.21.15.6:0/743766143 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.436+0000 7f777b7fe640 1 --2- 172.21.15.6:0/743766143 >> v2:172.21.15.171:3300/0 conn(0x7f777c06dae0 0x7f777c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.436+0000 7f777affd640 1 -- 172.21.15.6:0/743766143 >> v2:172.21.15.171:3300/0 conn(0x7f777c06dae0 msgr2=0x7f777c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.436+0000 7f777affd640 1 --2- 172.21.15.6:0/743766143 >> v2:172.21.15.171:3300/0 conn(0x7f777c06dae0 0x7f777c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.436+0000 7f777affd640 1 -- 172.21.15.6:0/743766143 >> v1:172.21.15.171:6789/0 conn(0x7f777c0b3e80 legacy=0x7f777c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.436+0000 7f777affd640 1 -- 172.21.15.6:0/743766143 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c0d3f80 con 0x7f777c162820 2024-05-20T17:55:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.437+0000 7f777affd640 1 --2- 172.21.15.6:0/743766143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c162820 0x7f777c0b3940 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f777c08e070 tx=0x7f776c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bbb21df26aa7f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.437+0000 7f777a7fc640 1 -- 172.21.15.6:0/743766143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c037070 con 0x7f777c162820 2024-05-20T17:55:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.437+0000 7f777a7fc640 1 -- 172.21.15.6:0/743766143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c032440 con 0x7f777c162820 2024-05-20T17:55:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.437+0000 7f777a7fc640 1 -- 172.21.15.6:0/743766143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c032810 con 0x7f777c162820 2024-05-20T17:55:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.437+0000 7f77813ea640 1 -- 172.21.15.6:0/743766143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c162820 msgr2=0x7f777c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.437+0000 7f77813ea640 1 --2- 172.21.15.6:0/743766143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c162820 0x7f777c0b3940 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f777c08e070 tx=0x7f776c02a230 comp rx=0 tx=0).stop 2024-05-20T17:55:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.438+0000 7f77813ea640 1 -- 172.21.15.6:0/743766143 shutdown_connections 2024-05-20T17:55:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.438+0000 7f77813ea640 1 --2- 172.21.15.6:0/743766143 >> v2:172.21.15.171:3300/0 conn(0x7f777c06dae0 0x7f777c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.438+0000 7f77813ea640 1 --2- 172.21.15.6:0/743766143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c162820 0x7f777c0b3940 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.438+0000 7f77813ea640 1 -- 172.21.15.6:0/743766143 >> 172.21.15.6:0/743766143 conn(0x7f777c0d4bd0 msgr2=0x7f777c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.438+0000 7f77813ea640 1 -- 172.21.15.6:0/743766143 shutdown_connections 2024-05-20T17:55:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.438+0000 7f77813ea640 1 -- 172.21.15.6:0/743766143 wait complete. 2024-05-20T17:55:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.439+0000 7f77813ea640 1 Processor -- start 2024-05-20T17:55:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.440+0000 7f77813ea640 1 -- start start 2024-05-20T17:55:42.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f77813ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c0b3e80 0x7f777c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:42.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f77813ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777c162820 0x7f777c1f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:42.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f77813ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777c15b0e0 0x7f777c0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f77813ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f777c0d4780 con 0x7f777c0b3e80 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f77813ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f777c0d0300 con 0x7f777c162820 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f77813ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f777c0d4900 con 0x7f777c15b0e0 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c0b3e80 0x7f777c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c0b3e80 0x7f777c1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56818/0 (socket says 172.21.15.6:56818) 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777affd640 1 -- 172.21.15.6:0/1782486380 learned_addr learned my addr 172.21.15.6:0/1782486380 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777b7fe640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777c15b0e0 0x7f777c0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f77727fc640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777c162820 0x7f777c1f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777affd640 1 -- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777c15b0e0 msgr2=0x7f777c0c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777affd640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777c15b0e0 0x7f777c0c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777affd640 1 -- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777c162820 msgr2=0x7f777c1f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777affd640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777c162820 0x7f777c1f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f777affd640 1 -- 172.21.15.6:0/1782486380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c0c8950 con 0x7f777c0b3e80 2024-05-20T17:55:42.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.441+0000 7f77727fc640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777c162820 0x7f777c1f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:42.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.442+0000 7f777affd640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c0b3e80 0x7f777c1520d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f776c000c00 tx=0x7f776c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:42.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.442+0000 7f7773fff640 1 -- 172.21.15.6:0/1782486380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c041020 con 0x7f777c0b3e80 2024-05-20T17:55:42.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.442+0000 7f7773fff640 1 -- 172.21.15.6:0/1782486380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c0306c0 con 0x7f777c0b3e80 2024-05-20T17:55:42.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.442+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777c0c8c30 con 0x7f777c0b3e80 2024-05-20T17:55:42.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.442+0000 7f7773fff640 1 -- 172.21.15.6:0/1782486380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c037040 con 0x7f777c0b3e80 2024-05-20T17:55:42.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.442+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777c0c91f0 con 0x7f777c0b3e80 2024-05-20T17:55:42.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.443+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777c075b00 con 0x7f777c0b3e80 2024-05-20T17:55:42.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.443+0000 7f7773fff640 1 -- 172.21.15.6:0/1782486380 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f776c044020 con 0x7f777c0b3e80 2024-05-20T17:55:42.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.444+0000 7f7773fff640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f775c06be30 0x7f775c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:42.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.444+0000 7f7773fff640 1 -- 172.21.15.6:0/1782486380 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f776c0ab4e0 con 0x7f777c0b3e80 2024-05-20T17:55:42.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.444+0000 7f77727fc640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f775c06be30 0x7f775c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:42.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.445+0000 7f77727fc640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f775c06be30 0x7f775c06e340 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7764006fd0 tx=0x7f7764008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:42.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.449+0000 7f7773fff640 1 -- 172.21.15.6:0/1782486380 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f776c04b070 con 0x7f777c0b3e80 2024-05-20T17:55:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:42.670+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f777c15da60 con 0x7f777c0b3e80 2024-05-20T17:55:43.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.299+0000 7f7773fff640 1 -- 172.21.15.6:0/1782486380 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7f776c079bf0 con 0x7f777c0b3e80 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.301+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f775c06be30 msgr2=0x7f775c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f775c06be30 0x7f775c06e340 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7764006fd0 tx=0x7f7764008040 comp rx=0 tx=0).stop 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c0b3e80 msgr2=0x7f777c1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c0b3e80 0x7f777c1520d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f776c000c00 tx=0x7f776c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 shutdown_connections 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f775c06be30 0x7f775c06e340 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777c15b0e0 0x7f777c0c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777c162820 0x7f777c1f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 --2- 172.21.15.6:0/1782486380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f777c0b3e80 0x7f777c1520d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 >> 172.21.15.6:0/1782486380 conn(0x7f777c0d4bd0 msgr2=0x7f777c15e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:43.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 shutdown_connections 2024-05-20T17:55:43.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.302+0000 7f77813ea640 1 -- 172.21.15.6:0/1782486380 wait complete. 2024-05-20T17:55:43.315 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T17:55:43.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.438+0000 7f09f4b85640 1 Processor -- start 2024-05-20T17:55:43.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.438+0000 7f09f4b85640 1 -- start start 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.439+0000 7f09f4b85640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09f015e050 0x7f09f00d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.439+0000 7f09f4b85640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f015e6b0 con 0x7f09f006d9a0 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.439+0000 7f09f4b85640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f00d1100 con 0x7f09f00b2f10 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.439+0000 7f09f4b85640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f09f00d2400 con 0x7f09f015e050 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.439+0000 7f09eed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09f015e050 0x7f09f00d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.439+0000 7f09edd9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f09f006d9a0 0x7f09f015d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43948/0 (socket says 172.21.15.6:43948) 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.439+0000 7f09eed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09f015e050 0x7f09f00d1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56832/0 (socket says 172.21.15.6:56832) 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.439+0000 7f09edd9b640 1 -- 172.21.15.6:0/3942817799 learned_addr learned my addr 172.21.15.6:0/3942817799 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:43.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.440+0000 7f09eed9d640 1 -- 172.21.15.6:0/3942817799 >> v1:172.21.15.171:6789/0 conn(0x7f09f00b2f10 legacy=0x7f09f006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.440+0000 7f09eed9d640 1 -- 172.21.15.6:0/3942817799 >> v1:172.21.15.6:6789/0 conn(0x7f09f006d9a0 legacy=0x7f09f015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.440+0000 7f09eed9d640 1 -- 172.21.15.6:0/3942817799 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f00d13e0 con 0x7f09f015e050 2024-05-20T17:55:43.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.440+0000 7f09ed59a640 1 -- 172.21.15.6:0/3942817799 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932357748 0 0) 0x7f09f015e6b0 con 0x7f09f006d9a0 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.440+0000 7f09eed9d640 1 --2- 172.21.15.6:0/3942817799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00d1ec0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f09e80097a0 tx=0x7f09e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b49fdd7c04a4cad server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09ed59a640 1 -- 172.21.15.6:0/3942817799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8037070 con 0x7f09f015e050 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09ed59a640 1 -- 172.21.15.6:0/3942817799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e8032440 con 0x7f09f015e050 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09ed59a640 1 -- 172.21.15.6:0/3942817799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8032810 con 0x7f09f015e050 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09f4b85640 1 -- 172.21.15.6:0/3942817799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 msgr2=0x7f09f00d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09f4b85640 1 --2- 172.21.15.6:0/3942817799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00d1ec0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f09e80097a0 tx=0x7f09e802a1a0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09f4b85640 1 -- 172.21.15.6:0/3942817799 shutdown_connections 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09f4b85640 1 --2- 172.21.15.6:0/3942817799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00d1ec0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09f4b85640 1 -- 172.21.15.6:0/3942817799 >> 172.21.15.6:0/3942817799 conn(0x7f09f00b6670 msgr2=0x7f09f00b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09f4b85640 1 -- 172.21.15.6:0/3942817799 shutdown_connections 2024-05-20T17:55:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.441+0000 7f09f4b85640 1 -- 172.21.15.6:0/3942817799 wait complete. 2024-05-20T17:55:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.443+0000 7f09f4b85640 1 Processor -- start 2024-05-20T17:55:43.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.444+0000 7f09f4b85640 1 -- start start 2024-05-20T17:55:43.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09f4b85640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f006d9a0 0x7f09f014d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09f4b85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f00b2f10 0x7f09f014f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09f4b85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09f4b85640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f09f00b3320 con 0x7f09f015e050 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09f4b85640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f09f00d1a30 con 0x7f09f006d9a0 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09f4b85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09f015e460 con 0x7f09f00b2f10 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09eed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09eed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56836/0 (socket says 172.21.15.6:56836) 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09eed9d640 1 -- 172.21.15.6:0/220956297 learned_addr learned my addr 172.21.15.6:0/220956297 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09ee59c640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f006d9a0 0x7f09f014d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09edd9b640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f00b2f10 0x7f09f014f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09eed9d640 1 -- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f00b2f10 msgr2=0x7f09f014f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09eed9d640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f00b2f10 0x7f09f014f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09eed9d640 1 -- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f006d9a0 msgr2=0x7f09f014d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09eed9d640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f006d9a0 0x7f09f014d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09eed9d640 1 -- 172.21.15.6:0/220956297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f014dd70 con 0x7f09f015e050 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.445+0000 7f09edd9b640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f00b2f10 0x7f09f014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.446+0000 7f09eed9d640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00cf320 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f09e80097a0 tx=0x7f09e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.446+0000 7f09deffd640 1 -- 172.21.15.6:0/220956297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8041070 con 0x7f09f015e050 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.446+0000 7f09deffd640 1 -- 172.21.15.6:0/220956297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e803c870 con 0x7f09f015e050 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.446+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f014e050 con 0x7f09f015e050 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.446+0000 7f09deffd640 1 -- 172.21.15.6:0/220956297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8037040 con 0x7f09f015e050 2024-05-20T17:55:43.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.446+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f014e610 con 0x7f09f015e050 2024-05-20T17:55:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.447+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f014fbc0 con 0x7f09f015e050 2024-05-20T17:55:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.448+0000 7f09deffd640 1 -- 172.21.15.6:0/220956297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09e8044070 con 0x7f09f015e050 2024-05-20T17:55:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.448+0000 7f09deffd640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d006be60 0x7f09d006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.448+0000 7f09deffd640 1 -- 172.21.15.6:0/220956297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f09e80abb80 con 0x7f09f015e050 2024-05-20T17:55:43.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.448+0000 7f09ee59c640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d006be60 0x7f09d006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.449+0000 7f09ee59c640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d006be60 0x7f09d006e370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09e00012e0 tx=0x7f09e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:43.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.453+0000 7f09deffd640 1 -- 172.21.15.6:0/220956297 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f09e807a550 con 0x7f09f015e050 2024-05-20T17:55:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.677+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09f014d710 con 0x7f09f015e050 2024-05-20T17:55:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.677+0000 7f09deffd640 1 -- 172.21.15.6:0/220956297 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5178 (secure 0 0 0) 0x7f09f014d710 con 0x7f09f015e050 2024-05-20T17:55:43.677 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:43.677 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/855682127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":855682127},{"type":"v1","addr":"172.21.15.171:6837","nonce":855682127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2086456440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2086456440},{"type":"v1","addr":"172.21.15.171:6836","nonce":2086456440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3128490033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3128490033},{"type":"v1","addr":"172.21.15.6:6834","nonce":3128490033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:55:39.645375+0000","modified":"2024-05-20T17:55:42.672561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5880},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5880":{"gid":5880,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1365830773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1365830773},{"type":"v1","addr":"172.21.15.6:6835","nonce":1365830773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5880,"qdb_cluster":[5880]},"id":3}]} 2024-05-20T17:55:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-05-20T17:55:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d006be60 msgr2=0x7f09d006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d006be60 0x7f09d006e370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09e00012e0 tx=0x7f09e0009040 comp rx=0 tx=0).stop 2024-05-20T17:55:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 msgr2=0x7f09f00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00cf320 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f09e80097a0 tx=0x7f09e80046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 shutdown_connections 2024-05-20T17:55:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d006be60 0x7f09d006e370 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f015e050 0x7f09f00cf320 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f00b2f10 0x7f09f014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 --2- 172.21.15.6:0/220956297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f006d9a0 0x7f09f014d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 >> 172.21.15.6:0/220956297 conn(0x7f09f00b6670 msgr2=0x7f09f006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 shutdown_connections 2024-05-20T17:55:43.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.680+0000 7f09f4b85640 1 -- 172.21.15.6:0/220956297 wait complete. 2024-05-20T17:55:43.691 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:43.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.806+0000 7f0adf1aa640 1 Processor -- start 2024-05-20T17:55:43.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.806+0000 7f0adf1aa640 1 -- start start 2024-05-20T17:55:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.807+0000 7f0adf1aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad80b47b0 0x7f0ad80afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.807+0000 7f0adf1aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ad80b58f0 0x7f0ad806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.807+0000 7f0adf1aa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad80b39f0 con 0x7f0ad815d060 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.807+0000 7f0adf1aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad80b3cd0 con 0x7f0ad80b58f0 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.807+0000 7f0adf1aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad80b3fb0 con 0x7f0ad80b47b0 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.807+0000 7f0add747640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ad80b58f0 0x7f0ad806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.807+0000 7f0add747640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ad80b58f0 0x7f0ad806f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56844/0 (socket says 172.21.15.6:56844) 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.807+0000 7f0add747640 1 -- 172.21.15.6:0/1215884515 learned_addr learned my addr 172.21.15.6:0/1215884515 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.808+0000 7f0adcf46640 1 --2- 172.21.15.6:0/1215884515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad80b47b0 0x7f0ad80afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.808+0000 7f0add747640 1 -- 172.21.15.6:0/1215884515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad80b47b0 msgr2=0x7f0ad80afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.808+0000 7f0add747640 1 --2- 172.21.15.6:0/1215884515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad80b47b0 0x7f0ad80afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.808+0000 7f0add747640 1 -- 172.21.15.6:0/1215884515 >> v1:172.21.15.171:6789/0 conn(0x7f0ad815d060 legacy=0x7f0ad80b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.808+0000 7f0add747640 1 -- 172.21.15.6:0/1215884515 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad80b4290 con 0x7f0ad80b58f0 2024-05-20T17:55:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.808+0000 7f0add747640 1 --2- 172.21.15.6:0/1215884515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad80b58f0 0x7f0ad806f3d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009e50 tx=0x7f0ad002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3791a6f6988b230d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0ad77fe640 1 -- 172.21.15.6:0/1215884515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0036070 con 0x7f0ad80b58f0 2024-05-20T17:55:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0ad77fe640 1 -- 172.21.15.6:0/1215884515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad0031600 con 0x7f0ad80b58f0 2024-05-20T17:55:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0ad77fe640 1 -- 172.21.15.6:0/1215884515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00319d0 con 0x7f0ad80b58f0 2024-05-20T17:55:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0adf1aa640 1 -- 172.21.15.6:0/1215884515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad80b58f0 msgr2=0x7f0ad806f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/1215884515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad80b58f0 0x7f0ad806f3d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009e50 tx=0x7f0ad002a680 comp rx=0 tx=0).stop 2024-05-20T17:55:43.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0adf1aa640 1 -- 172.21.15.6:0/1215884515 shutdown_connections 2024-05-20T17:55:43.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/1215884515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad80b58f0 0x7f0ad806f3d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/1215884515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad80b47b0 0x7f0ad80afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0adf1aa640 1 -- 172.21.15.6:0/1215884515 >> 172.21.15.6:0/1215884515 conn(0x7f0ad80cd2a0 msgr2=0x7f0ad80cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:43.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.809+0000 7f0adf1aa640 1 -- 172.21.15.6:0/1215884515 shutdown_connections 2024-05-20T17:55:43.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.810+0000 7f0adf1aa640 1 -- 172.21.15.6:0/1215884515 wait complete. 2024-05-20T17:55:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.811+0000 7f0adf1aa640 1 Processor -- start 2024-05-20T17:55:43.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.811+0000 7f0adf1aa640 1 -- start start 2024-05-20T17:55:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0adf1aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad815d060 0x7f0ad81e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0adf1aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad8152200 0x7f0ad815e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0adf1aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad81541c0 0x7f0ad815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0adf1aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8159de0 con 0x7f0ad81541c0 2024-05-20T17:55:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0adf1aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8159c60 con 0x7f0ad815d060 2024-05-20T17:55:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0adf1aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad806f910 con 0x7f0ad8152200 2024-05-20T17:55:43.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad81541c0 0x7f0ad815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad81541c0 0x7f0ad815ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56852/0 (socket says 172.21.15.6:56852) 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 -- 172.21.15.6:0/423733028 learned_addr learned my addr 172.21.15.6:0/423733028 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0adcf46640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad815d060 0x7f0ad81e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0ad7fff640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad8152200 0x7f0ad815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 -- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad8152200 msgr2=0x7f0ad815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad8152200 0x7f0ad815e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 -- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad815d060 msgr2=0x7f0ad81e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad815d060 0x7f0ad81e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 -- 172.21.15.6:0/423733028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad8153120 con 0x7f0ad81541c0 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.813+0000 7f0add747640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad81541c0 0x7f0ad815ec40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0034040 tx=0x7f0ad0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.814+0000 7f0ad57fa640 1 -- 172.21.15.6:0/423733028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0036050 con 0x7f0ad81541c0 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.814+0000 7f0ad57fa640 1 -- 172.21.15.6:0/423733028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad0042070 con 0x7f0ad81541c0 2024-05-20T17:55:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.814+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad8153400 con 0x7f0ad81541c0 2024-05-20T17:55:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.814+0000 7f0ad57fa640 1 -- 172.21.15.6:0/423733028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0009510 con 0x7f0ad81541c0 2024-05-20T17:55:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.814+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad81539c0 con 0x7f0ad81541c0 2024-05-20T17:55:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.815+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad8075b00 con 0x7f0ad81541c0 2024-05-20T17:55:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.815+0000 7f0ad57fa640 1 -- 172.21.15.6:0/423733028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ad0007bf0 con 0x7f0ad81541c0 2024-05-20T17:55:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.816+0000 7f0ad57fa640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0abc06be30 0x7f0abc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.816+0000 7f0ad57fa640 1 -- 172.21.15.6:0/423733028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f0ad00abd50 con 0x7f0ad81541c0 2024-05-20T17:55:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.816+0000 7f0adcf46640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0abc06be30 0x7f0abc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.816+0000 7f0adcf46640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0abc06be30 0x7f0abc06e340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ad806cf20 tx=0x7f0acc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:43.820+0000 7f0ad57fa640 1 -- 172.21.15.6:0/423733028 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0ad00af030 con 0x7f0ad81541c0 2024-05-20T17:55:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.005+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ad80ced20 con 0x7f0ad81541c0 2024-05-20T17:55:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.006+0000 7f0ad57fa640 1 -- 172.21.15.6:0/423733028 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16894 (secure 0 0 0) 0x7f0ad0079e90 con 0x7f0ad81541c0 2024-05-20T17:55:44.005 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:44.006 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":51,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:41.251044+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:55:37.996162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-20T17:55:38.615776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.008+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0abc06be30 msgr2=0x7f0abc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.008+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0abc06be30 0x7f0abc06e340 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ad806cf20 tx=0x7f0acc009190 comp rx=0 tx=0).stop 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.008+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad81541c0 msgr2=0x7f0ad815ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.008+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad81541c0 0x7f0ad815ec40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0034040 tx=0x7f0ad0004a40 comp rx=0 tx=0).stop 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.009+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 shutdown_connections 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.009+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0abc06be30 0x7f0abc06e340 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.009+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ad81541c0 0x7f0ad815ec40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.009+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ad8152200 0x7f0ad815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.009+0000 7f0adf1aa640 1 --2- 172.21.15.6:0/423733028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad815d060 0x7f0ad81e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.009+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 >> 172.21.15.6:0/423733028 conn(0x7f0ad80cd2a0 msgr2=0x7f0ad80cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.009+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 shutdown_connections 2024-05-20T17:55:44.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.009+0000 7f0adf1aa640 1 -- 172.21.15.6:0/423733028 wait complete. 2024-05-20T17:55:44.019 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T17:55:44.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:55:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.136+0000 7f660f109640 1 Processor -- start 2024-05-20T17:55:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.136+0000 7f660f109640 1 -- start start 2024-05-20T17:55:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.137+0000 7f660f109640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6608162820 0x7f66080b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660f109640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660806dae0 0x7f66080b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660f109640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66080d0630 con 0x7f66080b3e80 2024-05-20T17:55:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660f109640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f66080d39c0 con 0x7f6608162820 2024-05-20T17:55:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660f109640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66080d3ca0 con 0x7f660806dae0 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660cea5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6608162820 0x7f66080b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660d6a6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660806dae0 0x7f66080b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660cea5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6608162820 0x7f66080b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:36460/0 (socket says 172.21.15.6:36460) 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660d6a6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660806dae0 0x7f66080b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:41748/0 (socket says 172.21.15.6:41748) 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660cea5640 1 -- 172.21.15.6:0/1566061801 learned_addr learned my addr 172.21.15.6:0/1566061801 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f6607fff640 1 --1- 172.21.15.6:0/1566061801 >> v1:172.21.15.171:6789/0 conn(0x7f66080b3e80 0x7f660806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:33694/0 (socket says 172.21.15.6:33694) 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660cea5640 1 -- 172.21.15.6:0/1566061801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660806dae0 msgr2=0x7f66080b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660cea5640 1 --2- 172.21.15.6:0/1566061801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660806dae0 0x7f66080b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660cea5640 1 -- 172.21.15.6:0/1566061801 >> v1:172.21.15.171:6789/0 conn(0x7f66080b3e80 legacy=0x7f660806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f66077fe640 1 -- 172.21.15.6:0/1566061801 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 177025386 0 0) 0x7f66080d0630 con 0x7f66080b3e80 2024-05-20T17:55:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.138+0000 7f660cea5640 1 -- 172.21.15.6:0/1566061801 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66080d3f80 con 0x7f6608162820 2024-05-20T17:55:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.139+0000 7f660cea5640 1 --2- 172.21.15.6:0/1566061801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6608162820 0x7f66080b3940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009870 tx=0x7f65f802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc5ce4fa1c098061 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.139+0000 7f66077fe640 1 -- 172.21.15.6:0/1566061801 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8037070 con 0x7f6608162820 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.139+0000 7f66077fe640 1 -- 172.21.15.6:0/1566061801 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f8032440 con 0x7f6608162820 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.139+0000 7f66077fe640 1 -- 172.21.15.6:0/1566061801 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8032810 con 0x7f6608162820 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.140+0000 7f660f109640 1 -- 172.21.15.6:0/1566061801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6608162820 msgr2=0x7f66080b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.140+0000 7f660f109640 1 --2- 172.21.15.6:0/1566061801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6608162820 0x7f66080b3940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009870 tx=0x7f65f802a270 comp rx=0 tx=0).stop 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.140+0000 7f660f109640 1 -- 172.21.15.6:0/1566061801 shutdown_connections 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.140+0000 7f660f109640 1 --2- 172.21.15.6:0/1566061801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f660806dae0 0x7f66080b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.140+0000 7f660f109640 1 --2- 172.21.15.6:0/1566061801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6608162820 0x7f66080b3940 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.140+0000 7f660f109640 1 -- 172.21.15.6:0/1566061801 >> 172.21.15.6:0/1566061801 conn(0x7f66080d4bd0 msgr2=0x7f66080d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.140+0000 7f660f109640 1 -- 172.21.15.6:0/1566061801 shutdown_connections 2024-05-20T17:55:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.140+0000 7f660f109640 1 -- 172.21.15.6:0/1566061801 wait complete. 2024-05-20T17:55:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.142+0000 7f660f109640 1 Processor -- start 2024-05-20T17:55:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.142+0000 7f660f109640 1 -- start start 2024-05-20T17:55:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660f109640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66080b3e80 0x7f6608156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660f109640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6608162820 0x7f6608156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660f109640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66080c8aa0 0x7f66080c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660f109640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66080d4780 con 0x7f66080c8aa0 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660f109640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66080d0300 con 0x7f66080b3e80 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660f109640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66080d4900 con 0x7f6608162820 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660d6a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66080c8aa0 0x7f66080c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660d6a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66080c8aa0 0x7f66080c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56866/0 (socket says 172.21.15.6:56866) 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.143+0000 7f660d6a6640 1 -- 172.21.15.6:0/832921248 learned_addr learned my addr 172.21.15.6:0/832921248 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f6607fff640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6608162820 0x7f6608156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660cea5640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66080b3e80 0x7f6608156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660d6a6640 1 -- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6608162820 msgr2=0x7f6608156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660d6a6640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6608162820 0x7f6608156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660d6a6640 1 -- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66080b3e80 msgr2=0x7f6608156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660d6a6640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66080b3e80 0x7f6608156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660d6a6640 1 -- 172.21.15.6:0/832921248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66081570c0 con 0x7f66080c8aa0 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660cea5640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66080b3e80 0x7f6608156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660d6a6640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66080c8aa0 0x7f66080c8eb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f660000efc0 tx=0x7f660000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f66057fa640 1 -- 172.21.15.6:0/832921248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600018020 con 0x7f66080c8aa0 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f66057fa640 1 -- 172.21.15.6:0/832921248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6600014480 con 0x7f66080c8aa0 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66080c9820 con 0x7f66080c8aa0 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f66057fa640 1 -- 172.21.15.6:0/832921248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600009e60 con 0x7f66080c8aa0 2024-05-20T17:55:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.144+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66080b5ac0 con 0x7f66080c8aa0 2024-05-20T17:55:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.145+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6608157290 con 0x7f66080c8aa0 2024-05-20T17:55:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.146+0000 7f66057fa640 1 -- 172.21.15.6:0/832921248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6600005d10 con 0x7f66080c8aa0 2024-05-20T17:55:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.147+0000 7f66057fa640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f65f406be30 0x7f65f406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.147+0000 7f66057fa640 1 -- 172.21.15.6:0/832921248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f660008bd80 con 0x7f66080c8aa0 2024-05-20T17:55:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.147+0000 7f660cea5640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f65f406be30 0x7f65f406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.147+0000 7f660cea5640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f65f406be30 0x7f65f406e340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65f8034000 tx=0x7f65f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.151+0000 7f66057fa640 1 -- 172.21.15.6:0/832921248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6600022030 con 0x7f66080c8aa0 2024-05-20T17:55:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.334+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66080b3620 con 0x7f65f406be30 2024-05-20T17:55:44.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.341+0000 7f66057fa640 1 -- 172.21.15.6:0/832921248 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250649 (secure 0 0 0) 0x7f66080b3620 con 0x7f65f406be30 2024-05-20T17:55:44.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f65f406be30 msgr2=0x7f65f406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f65f406be30 0x7f65f406e340 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65f8034000 tx=0x7f65f802e000 comp rx=0 tx=0).stop 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66080c8aa0 msgr2=0x7f66080c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66080c8aa0 0x7f66080c8eb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f660000efc0 tx=0x7f660000c490 comp rx=0 tx=0).stop 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 shutdown_connections 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f65f406be30 0x7f65f406e340 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66080c8aa0 0x7f66080c8eb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6608162820 0x7f6608156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 --2- 172.21.15.6:0/832921248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66080b3e80 0x7f6608156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 >> 172.21.15.6:0/832921248 conn(0x7f66080d4bd0 msgr2=0x7f660815c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 shutdown_connections 2024-05-20T17:55:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.344+0000 7f660f109640 1 -- 172.21.15.6:0/832921248 wait complete. 2024-05-20T17:55:44.354 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-20T17:55:44.271301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":192,"acting":192,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226264,"kb_used_data":5916,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748456,"statfs":{"total":773094113280,"available":772862418944,"internally_reserved":0,"allocated":6057984,"data_stored":3330190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966036+0000","last_change":"2024-05-20T17:55:40.270773+0000","last_active":"2024-05-20T17:55:41.966036+0000","last_peered":"2024-05-20T17:55:41.966036+0000","last_clean":"2024-05-20T17:55:41.966036+0000","last_became_active":"2024-05-20T17:55:40.270461+0000","last_became_peered":"2024-05-20T17:55:40.270461+0000","last_unstale":"2024-05-20T17:55:41.966036+0000","last_undegraded":"2024-05-20T17:55:41.966036+0000","last_fullsized":"2024-05-20T17:55:41.966036+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:53.123523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966594+0000","last_change":"2024-05-20T17:55:40.281497+0000","last_active":"2024-05-20T17:55:41.966594+0000","last_peered":"2024-05-20T17:55:41.966594+0000","last_clean":"2024-05-20T17:55:41.966594+0000","last_became_active":"2024-05-20T17:55:40.281191+0000","last_became_peered":"2024-05-20T17:55:40.281191+0000","last_unstale":"2024-05-20T17:55:41.966594+0000","last_undegraded":"2024-05-20T17:55:41.966594+0000","last_fullsized":"2024-05-20T17:55:41.966594+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.274706+0000","last_change":"2024-05-20T17:55:39.274706+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.274706+0000","last_undegraded":"2024-05-20T17:55:39.274706+0000","last_fullsized":"2024-05-20T17:55:39.274706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966155+0000","last_change":"2024-05-20T17:55:40.289561+0000","last_active":"2024-05-20T17:55:41.966155+0000","last_peered":"2024-05-20T17:55:41.966155+0000","last_clean":"2024-05-20T17:55:41.966155+0000","last_became_active":"2024-05-20T17:55:40.289232+0000","last_became_peered":"2024-05-20T17:55:40.289232+0000","last_unstale":"2024-05-20T17:55:41.966155+0000","last_undegraded":"2024-05-20T17:55:41.966155+0000","last_fullsized":"2024-05-20T17:55:41.966155+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257998+0000","last_change":"2024-05-20T17:55:40.268614+0000","last_active":"2024-05-20T17:55:41.257998+0000","last_peered":"2024-05-20T17:55:41.257998+0000","last_clean":"2024-05-20T17:55:41.257998+0000","last_became_active":"2024-05-20T17:55:40.268295+0000","last_became_peered":"2024-05-20T17:55:40.268295+0000","last_unstale":"2024-05-20T17:55:41.257998+0000","last_undegraded":"2024-05-20T17:55:41.257998+0000","last_fullsized":"2024-05-20T17:55:41.257998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:43.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965810+0000","last_change":"2024-05-20T17:55:40.278388+0000","last_active":"2024-05-20T17:55:41.965810+0000","last_peered":"2024-05-20T17:55:41.965810+0000","last_clean":"2024-05-20T17:55:41.965810+0000","last_became_active":"2024-05-20T17:55:40.278061+0000","last_became_peered":"2024-05-20T17:55:40.278061+0000","last_unstale":"2024-05-20T17:55:41.965810+0000","last_undegraded":"2024-05-20T17:55:41.965810+0000","last_fullsized":"2024-05-20T17:55:41.965810+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.270276+0000","last_change":"2024-05-20T17:55:39.270276+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.270276+0000","last_undegraded":"2024-05-20T17:55:39.270276+0000","last_fullsized":"2024-05-20T17:55:39.270276+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254404+0000","last_change":"2024-05-20T17:55:40.282267+0000","last_active":"2024-05-20T17:55:41.254404+0000","last_peered":"2024-05-20T17:55:41.254404+0000","last_clean":"2024-05-20T17:55:41.254404+0000","last_became_active":"2024-05-20T17:55:40.281957+0000","last_became_peered":"2024-05-20T17:55:40.281957+0000","last_unstale":"2024-05-20T17:55:41.254404+0000","last_undegraded":"2024-05-20T17:55:41.254404+0000","last_fullsized":"2024-05-20T17:55:41.254404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:36.957704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254821+0000","last_change":"2024-05-20T17:55:40.277468+0000","last_active":"2024-05-20T17:55:41.254821+0000","last_peered":"2024-05-20T17:55:41.254821+0000","last_clean":"2024-05-20T17:55:41.254821+0000","last_became_active":"2024-05-20T17:55:40.276903+0000","last_became_peered":"2024-05-20T17:55:40.276903+0000","last_unstale":"2024-05-20T17:55:41.254821+0000","last_undegraded":"2024-05-20T17:55:41.254821+0000","last_fullsized":"2024-05-20T17:55:41.254821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:02.671800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965875+0000","last_change":"2024-05-20T17:55:40.282130+0000","last_active":"2024-05-20T17:55:41.965875+0000","last_peered":"2024-05-20T17:55:41.965875+0000","last_clean":"2024-05-20T17:55:41.965875+0000","last_became_active":"2024-05-20T17:55:40.281789+0000","last_became_peered":"2024-05-20T17:55:40.281789+0000","last_unstale":"2024-05-20T17:55:41.965875+0000","last_undegraded":"2024-05-20T17:55:41.965875+0000","last_fullsized":"2024-05-20T17:55:41.965875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257338+0000","last_change":"2024-05-20T17:55:40.276661+0000","last_active":"2024-05-20T17:55:41.257338+0000","last_peered":"2024-05-20T17:55:41.257338+0000","last_clean":"2024-05-20T17:55:41.257338+0000","last_became_active":"2024-05-20T17:55:40.276358+0000","last_became_peered":"2024-05-20T17:55:40.276358+0000","last_unstale":"2024-05-20T17:55:41.257338+0000","last_undegraded":"2024-05-20T17:55:41.257338+0000","last_fullsized":"2024-05-20T17:55:41.257338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:33.789874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254780+0000","last_change":"2024-05-20T17:55:40.272120+0000","last_active":"2024-05-20T17:55:41.254780+0000","last_peered":"2024-05-20T17:55:41.254780+0000","last_clean":"2024-05-20T17:55:41.254780+0000","last_became_active":"2024-05-20T17:55:40.271802+0000","last_became_peered":"2024-05-20T17:55:40.271802+0000","last_unstale":"2024-05-20T17:55:41.254780+0000","last_undegraded":"2024-05-20T17:55:41.254780+0000","last_fullsized":"2024-05-20T17:55:41.254780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:00.485107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966039+0000","last_change":"2024-05-20T17:55:40.280972+0000","last_active":"2024-05-20T17:55:41.966039+0000","last_peered":"2024-05-20T17:55:41.966039+0000","last_clean":"2024-05-20T17:55:41.966039+0000","last_became_active":"2024-05-20T17:55:40.280674+0000","last_became_peered":"2024-05-20T17:55:40.280674+0000","last_unstale":"2024-05-20T17:55:41.966039+0000","last_undegraded":"2024-05-20T17:55:41.966039+0000","last_fullsized":"2024-05-20T17:55:41.966039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.272813+0000","last_change":"2024-05-20T17:55:39.272813+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.272813+0000","last_undegraded":"2024-05-20T17:55:39.272813+0000","last_fullsized":"2024-05-20T17:55:39.272813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966878+0000","last_change":"2024-05-20T17:55:40.278390+0000","last_active":"2024-05-20T17:55:41.966878+0000","last_peered":"2024-05-20T17:55:41.966878+0000","last_clean":"2024-05-20T17:55:41.966878+0000","last_became_active":"2024-05-20T17:55:40.278036+0000","last_became_peered":"2024-05-20T17:55:40.278036+0000","last_unstale":"2024-05-20T17:55:41.966878+0000","last_undegraded":"2024-05-20T17:55:41.966878+0000","last_fullsized":"2024-05-20T17:55:41.966878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:32.756855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965699+0000","last_change":"2024-05-20T17:55:40.271972+0000","last_active":"2024-05-20T17:55:41.965699+0000","last_peered":"2024-05-20T17:55:41.965699+0000","last_clean":"2024-05-20T17:55:41.965699+0000","last_became_active":"2024-05-20T17:55:40.271620+0000","last_became_peered":"2024-05-20T17:55:40.271620+0000","last_unstale":"2024-05-20T17:55:41.965699+0000","last_undegraded":"2024-05-20T17:55:41.965699+0000","last_fullsized":"2024-05-20T17:55:41.965699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.276707+0000","last_change":"2024-05-20T17:55:39.276707+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.276707+0000","last_undegraded":"2024-05-20T17:55:39.276707+0000","last_fullsized":"2024-05-20T17:55:39.276707+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966717+0000","last_change":"2024-05-20T17:55:40.282461+0000","last_active":"2024-05-20T17:55:41.966717+0000","last_peered":"2024-05-20T17:55:41.966717+0000","last_clean":"2024-05-20T17:55:41.966717+0000","last_became_active":"2024-05-20T17:55:40.282146+0000","last_became_peered":"2024-05-20T17:55:40.282146+0000","last_unstale":"2024-05-20T17:55:41.966717+0000","last_undegraded":"2024-05-20T17:55:41.966717+0000","last_fullsized":"2024-05-20T17:55:41.966717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:59:35.697636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.273100+0000","last_change":"2024-05-20T17:55:39.273100+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.273100+0000","last_undegraded":"2024-05-20T17:55:39.273100+0000","last_fullsized":"2024-05-20T17:55:39.273100+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557223+0000","last_change":"2024-05-20T17:55:40.266526+0000","last_active":"2024-05-20T17:55:41.557223+0000","last_peered":"2024-05-20T17:55:41.557223+0000","last_clean":"2024-05-20T17:55:41.557223+0000","last_became_active":"2024-05-20T17:55:40.265920+0000","last_became_peered":"2024-05-20T17:55:40.265920+0000","last_unstale":"2024-05-20T17:55:41.557223+0000","last_undegraded":"2024-05-20T17:55:41.557223+0000","last_fullsized":"2024-05-20T17:55:41.557223+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557207+0000","last_change":"2024-05-20T17:55:40.271285+0000","last_active":"2024-05-20T17:55:41.557207+0000","last_peered":"2024-05-20T17:55:41.557207+0000","last_clean":"2024-05-20T17:55:41.557207+0000","last_became_active":"2024-05-20T17:55:40.270660+0000","last_became_peered":"2024-05-20T17:55:40.270660+0000","last_unstale":"2024-05-20T17:55:41.557207+0000","last_undegraded":"2024-05-20T17:55:41.557207+0000","last_fullsized":"2024-05-20T17:55:41.557207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254365+0000","last_change":"2024-05-20T17:55:40.282955+0000","last_active":"2024-05-20T17:55:41.254365+0000","last_peered":"2024-05-20T17:55:41.254365+0000","last_clean":"2024-05-20T17:55:41.254365+0000","last_became_active":"2024-05-20T17:55:40.282609+0000","last_became_peered":"2024-05-20T17:55:40.282609+0000","last_unstale":"2024-05-20T17:55:41.254365+0000","last_undegraded":"2024-05-20T17:55:41.254365+0000","last_fullsized":"2024-05-20T17:55:41.254365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:15.702355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257167+0000","last_change":"2024-05-20T17:55:40.277466+0000","last_active":"2024-05-20T17:55:41.257167+0000","last_peered":"2024-05-20T17:55:41.257167+0000","last_clean":"2024-05-20T17:55:41.257167+0000","last_became_active":"2024-05-20T17:55:40.277117+0000","last_became_peered":"2024-05-20T17:55:40.277117+0000","last_unstale":"2024-05-20T17:55:41.257167+0000","last_undegraded":"2024-05-20T17:55:41.257167+0000","last_fullsized":"2024-05-20T17:55:41.257167+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:35:09.265029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T17:55:39.242479+0000","last_change":"2024-05-20T17:55:39.242479+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.242479+0000","last_undegraded":"2024-05-20T17:55:39.242479+0000","last_fullsized":"2024-05-20T17:55:39.242479+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.267813+0000","last_change":"2024-05-20T17:55:39.267813+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.267813+0000","last_undegraded":"2024-05-20T17:55:39.267813+0000","last_fullsized":"2024-05-20T17:55:39.267813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254723+0000","last_change":"2024-05-20T17:55:40.270685+0000","last_active":"2024-05-20T17:55:41.254723+0000","last_peered":"2024-05-20T17:55:41.254723+0000","last_clean":"2024-05-20T17:55:41.254723+0000","last_became_active":"2024-05-20T17:55:40.270370+0000","last_became_peered":"2024-05-20T17:55:40.270370+0000","last_unstale":"2024-05-20T17:55:41.254723+0000","last_undegraded":"2024-05-20T17:55:41.254723+0000","last_fullsized":"2024-05-20T17:55:41.254723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:07.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966227+0000","last_change":"2024-05-20T17:55:40.276848+0000","last_active":"2024-05-20T17:55:41.966227+0000","last_peered":"2024-05-20T17:55:41.966227+0000","last_clean":"2024-05-20T17:55:41.966227+0000","last_became_active":"2024-05-20T17:55:40.276542+0000","last_became_peered":"2024-05-20T17:55:40.276542+0000","last_unstale":"2024-05-20T17:55:41.966227+0000","last_undegraded":"2024-05-20T17:55:41.966227+0000","last_fullsized":"2024-05-20T17:55:41.966227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557367+0000","last_change":"2024-05-20T17:55:40.267011+0000","last_active":"2024-05-20T17:55:41.557367+0000","last_peered":"2024-05-20T17:55:41.557367+0000","last_clean":"2024-05-20T17:55:41.557367+0000","last_became_active":"2024-05-20T17:55:40.266683+0000","last_became_peered":"2024-05-20T17:55:40.266683+0000","last_unstale":"2024-05-20T17:55:41.557367+0000","last_undegraded":"2024-05-20T17:55:41.557367+0000","last_fullsized":"2024-05-20T17:55:41.557367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.265869+0000","last_change":"2024-05-20T17:55:39.265869+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.265869+0000","last_undegraded":"2024-05-20T17:55:39.265869+0000","last_fullsized":"2024-05-20T17:55:39.265869+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966369+0000","last_change":"2024-05-20T17:55:40.282635+0000","last_active":"2024-05-20T17:55:41.966369+0000","last_peered":"2024-05-20T17:55:41.966369+0000","last_clean":"2024-05-20T17:55:41.966369+0000","last_became_active":"2024-05-20T17:55:40.281020+0000","last_became_peered":"2024-05-20T17:55:40.281020+0000","last_unstale":"2024-05-20T17:55:41.966369+0000","last_undegraded":"2024-05-20T17:55:41.966369+0000","last_fullsized":"2024-05-20T17:55:41.966369+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.265335+0000","last_change":"2024-05-20T17:55:39.265335+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.265335+0000","last_undegraded":"2024-05-20T17:55:39.265335+0000","last_fullsized":"2024-05-20T17:55:39.265335+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966105+0000","last_change":"2024-05-20T17:55:40.271887+0000","last_active":"2024-05-20T17:55:41.966105+0000","last_peered":"2024-05-20T17:55:41.966105+0000","last_clean":"2024-05-20T17:55:41.966105+0000","last_became_active":"2024-05-20T17:55:40.270696+0000","last_became_peered":"2024-05-20T17:55:40.270696+0000","last_unstale":"2024-05-20T17:55:41.966105+0000","last_undegraded":"2024-05-20T17:55:41.966105+0000","last_fullsized":"2024-05-20T17:55:41.966105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965868+0000","last_change":"2024-05-20T17:55:40.275752+0000","last_active":"2024-05-20T17:55:41.965868+0000","last_peered":"2024-05-20T17:55:41.965868+0000","last_clean":"2024-05-20T17:55:41.965868+0000","last_became_active":"2024-05-20T17:55:40.275317+0000","last_became_peered":"2024-05-20T17:55:40.275317+0000","last_unstale":"2024-05-20T17:55:41.965868+0000","last_undegraded":"2024-05-20T17:55:41.965868+0000","last_fullsized":"2024-05-20T17:55:41.965868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557249+0000","last_change":"2024-05-20T17:55:39.270058+0000","last_active":"2024-05-20T17:55:41.557249+0000","last_peered":"2024-05-20T17:55:41.557249+0000","last_clean":"2024-05-20T17:55:41.557249+0000","last_became_active":"2024-05-20T17:55:39.269730+0000","last_became_peered":"2024-05-20T17:55:39.269730+0000","last_unstale":"2024-05-20T17:55:41.557249+0000","last_undegraded":"2024-05-20T17:55:41.557249+0000","last_fullsized":"2024-05-20T17:55:41.557249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966028+0000","last_change":"2024-05-20T17:55:40.274646+0000","last_active":"2024-05-20T17:55:41.966028+0000","last_peered":"2024-05-20T17:55:41.966028+0000","last_clean":"2024-05-20T17:55:41.966028+0000","last_became_active":"2024-05-20T17:55:40.274299+0000","last_became_peered":"2024-05-20T17:55:40.274299+0000","last_unstale":"2024-05-20T17:55:41.966028+0000","last_undegraded":"2024-05-20T17:55:41.966028+0000","last_fullsized":"2024-05-20T17:55:41.966028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965800+0000","last_change":"2024-05-20T17:55:39.271593+0000","last_active":"2024-05-20T17:55:41.965800+0000","last_peered":"2024-05-20T17:55:41.965800+0000","last_clean":"2024-05-20T17:55:41.965800+0000","last_became_active":"2024-05-20T17:55:39.271252+0000","last_became_peered":"2024-05-20T17:55:39.271252+0000","last_unstale":"2024-05-20T17:55:41.965800+0000","last_undegraded":"2024-05-20T17:55:41.965800+0000","last_fullsized":"2024-05-20T17:55:41.965800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557093+0000","last_change":"2024-05-20T17:55:40.268788+0000","last_active":"2024-05-20T17:55:41.557093+0000","last_peered":"2024-05-20T17:55:41.557093+0000","last_clean":"2024-05-20T17:55:41.557093+0000","last_became_active":"2024-05-20T17:55:40.268438+0000","last_became_peered":"2024-05-20T17:55:40.268438+0000","last_unstale":"2024-05-20T17:55:41.557093+0000","last_undegraded":"2024-05-20T17:55:41.557093+0000","last_fullsized":"2024-05-20T17:55:41.557093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966191+0000","last_change":"2024-05-20T17:55:39.273435+0000","last_active":"2024-05-20T17:55:41.966191+0000","last_peered":"2024-05-20T17:55:41.966191+0000","last_clean":"2024-05-20T17:55:41.966191+0000","last_became_active":"2024-05-20T17:55:39.272038+0000","last_became_peered":"2024-05-20T17:55:39.272038+0000","last_unstale":"2024-05-20T17:55:41.966191+0000","last_undegraded":"2024-05-20T17:55:41.966191+0000","last_fullsized":"2024-05-20T17:55:41.966191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254607+0000","last_change":"2024-05-20T17:55:40.269504+0000","last_active":"2024-05-20T17:55:41.254607+0000","last_peered":"2024-05-20T17:55:41.254607+0000","last_clean":"2024-05-20T17:55:41.254607+0000","last_became_active":"2024-05-20T17:55:40.269183+0000","last_became_peered":"2024-05-20T17:55:40.269183+0000","last_unstale":"2024-05-20T17:55:41.254607+0000","last_undegraded":"2024-05-20T17:55:41.254607+0000","last_fullsized":"2024-05-20T17:55:41.254607+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:13:50.189523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966477+0000","last_change":"2024-05-20T17:55:39.271665+0000","last_active":"2024-05-20T17:55:41.966477+0000","last_peered":"2024-05-20T17:55:41.966477+0000","last_clean":"2024-05-20T17:55:41.966477+0000","last_became_active":"2024-05-20T17:55:39.271355+0000","last_became_peered":"2024-05-20T17:55:39.271355+0000","last_unstale":"2024-05-20T17:55:41.966477+0000","last_undegraded":"2024-05-20T17:55:41.966477+0000","last_fullsized":"2024-05-20T17:55:41.966477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258077+0000","last_change":"2024-05-20T17:55:40.277184+0000","last_active":"2024-05-20T17:55:41.258077+0000","last_peered":"2024-05-20T17:55:41.258077+0000","last_clean":"2024-05-20T17:55:41.258077+0000","last_became_active":"2024-05-20T17:55:40.276858+0000","last_became_peered":"2024-05-20T17:55:40.276858+0000","last_unstale":"2024-05-20T17:55:41.258077+0000","last_undegraded":"2024-05-20T17:55:41.258077+0000","last_fullsized":"2024-05-20T17:55:41.258077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.259300+0000","last_change":"2024-05-20T17:55:39.256734+0000","last_active":"2024-05-20T17:55:39.259300+0000","last_peered":"2024-05-20T17:55:39.259300+0000","last_clean":"2024-05-20T17:55:39.259300+0000","last_became_active":"2024-05-20T17:55:39.256389+0000","last_became_peered":"2024-05-20T17:55:39.256389+0000","last_unstale":"2024-05-20T17:55:39.259300+0000","last_undegraded":"2024-05-20T17:55:39.259300+0000","last_fullsized":"2024-05-20T17:55:39.259300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:22:46.780789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966181+0000","last_change":"2024-05-20T17:55:40.283253+0000","last_active":"2024-05-20T17:55:41.966181+0000","last_peered":"2024-05-20T17:55:41.966181+0000","last_clean":"2024-05-20T17:55:41.966181+0000","last_became_active":"2024-05-20T17:55:40.282357+0000","last_became_peered":"2024-05-20T17:55:40.282357+0000","last_unstale":"2024-05-20T17:55:41.966181+0000","last_undegraded":"2024-05-20T17:55:41.966181+0000","last_fullsized":"2024-05-20T17:55:41.966181+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257712+0000","last_change":"2024-05-20T17:55:39.267829+0000","last_active":"2024-05-20T17:55:41.257712+0000","last_peered":"2024-05-20T17:55:41.257712+0000","last_clean":"2024-05-20T17:55:41.257712+0000","last_became_active":"2024-05-20T17:55:39.267501+0000","last_became_peered":"2024-05-20T17:55:39.267501+0000","last_unstale":"2024-05-20T17:55:41.257712+0000","last_undegraded":"2024-05-20T17:55:41.257712+0000","last_fullsized":"2024-05-20T17:55:41.257712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254976+0000","last_change":"2024-05-20T17:55:40.267881+0000","last_active":"2024-05-20T17:55:41.254976+0000","last_peered":"2024-05-20T17:55:41.254976+0000","last_clean":"2024-05-20T17:55:41.254976+0000","last_became_active":"2024-05-20T17:55:40.267566+0000","last_became_peered":"2024-05-20T17:55:40.267566+0000","last_unstale":"2024-05-20T17:55:41.254976+0000","last_undegraded":"2024-05-20T17:55:41.254976+0000","last_fullsized":"2024-05-20T17:55:41.254976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:42.086335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557032+0000","last_change":"2024-05-20T17:55:39.266116+0000","last_active":"2024-05-20T17:55:41.557032+0000","last_peered":"2024-05-20T17:55:41.557032+0000","last_clean":"2024-05-20T17:55:41.557032+0000","last_became_active":"2024-05-20T17:55:39.265728+0000","last_became_peered":"2024-05-20T17:55:39.265728+0000","last_unstale":"2024-05-20T17:55:41.557032+0000","last_undegraded":"2024-05-20T17:55:41.557032+0000","last_fullsized":"2024-05-20T17:55:41.557032+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:05:12.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966819+0000","last_change":"2024-05-20T17:55:40.286432+0000","last_active":"2024-05-20T17:55:41.966819+0000","last_peered":"2024-05-20T17:55:41.966819+0000","last_clean":"2024-05-20T17:55:41.966819+0000","last_became_active":"2024-05-20T17:55:40.286118+0000","last_became_peered":"2024-05-20T17:55:40.286118+0000","last_unstale":"2024-05-20T17:55:41.966819+0000","last_undegraded":"2024-05-20T17:55:41.966819+0000","last_fullsized":"2024-05-20T17:55:41.966819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:22.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.276136+0000","last_change":"2024-05-20T17:55:39.276136+0000","last_active":"2024-05-20T17:55:39.276136+0000","last_peered":"2024-05-20T17:55:39.276136+0000","last_clean":"2024-05-20T17:55:39.276136+0000","last_became_active":"2024-05-20T17:55:39.275769+0000","last_became_peered":"2024-05-20T17:55:39.275769+0000","last_unstale":"2024-05-20T17:55:39.276136+0000","last_undegraded":"2024-05-20T17:55:39.276136+0000","last_fullsized":"2024-05-20T17:55:39.276136+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257645+0000","last_change":"2024-05-20T17:55:40.273680+0000","last_active":"2024-05-20T17:55:41.257645+0000","last_peered":"2024-05-20T17:55:41.257645+0000","last_clean":"2024-05-20T17:55:41.257645+0000","last_became_active":"2024-05-20T17:55:40.273073+0000","last_became_peered":"2024-05-20T17:55:40.273073+0000","last_unstale":"2024-05-20T17:55:41.257645+0000","last_undegraded":"2024-05-20T17:55:41.257645+0000","last_fullsized":"2024-05-20T17:55:41.257645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:03.789329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966609+0000","last_change":"2024-05-20T17:55:39.267936+0000","last_active":"2024-05-20T17:55:41.966609+0000","last_peered":"2024-05-20T17:55:41.966609+0000","last_clean":"2024-05-20T17:55:41.966609+0000","last_became_active":"2024-05-20T17:55:39.267565+0000","last_became_peered":"2024-05-20T17:55:39.267565+0000","last_unstale":"2024-05-20T17:55:41.966609+0000","last_undegraded":"2024-05-20T17:55:41.966609+0000","last_fullsized":"2024-05-20T17:55:41.966609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965996+0000","last_change":"2024-05-20T17:55:40.259853+0000","last_active":"2024-05-20T17:55:41.965996+0000","last_peered":"2024-05-20T17:55:41.965996+0000","last_clean":"2024-05-20T17:55:41.965996+0000","last_became_active":"2024-05-20T17:55:40.259465+0000","last_became_peered":"2024-05-20T17:55:40.259465+0000","last_unstale":"2024-05-20T17:55:41.965996+0000","last_undegraded":"2024-05-20T17:55:41.965996+0000","last_fullsized":"2024-05-20T17:55:41.965996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258204+0000","last_change":"2024-05-20T17:55:39.258507+0000","last_active":"2024-05-20T17:55:41.258204+0000","last_peered":"2024-05-20T17:55:41.258204+0000","last_clean":"2024-05-20T17:55:41.258204+0000","last_became_active":"2024-05-20T17:55:39.258195+0000","last_became_peered":"2024-05-20T17:55:39.258195+0000","last_unstale":"2024-05-20T17:55:41.258204+0000","last_undegraded":"2024-05-20T17:55:41.258204+0000","last_fullsized":"2024-05-20T17:55:41.258204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.263457+0000","last_change":"2024-05-20T17:55:39.263457+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.263457+0000","last_undegraded":"2024-05-20T17:55:39.263457+0000","last_fullsized":"2024-05-20T17:55:39.263457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966420+0000","last_change":"2024-05-20T17:55:39.271032+0000","last_active":"2024-05-20T17:55:41.966420+0000","last_peered":"2024-05-20T17:55:41.966420+0000","last_clean":"2024-05-20T17:55:41.966420+0000","last_became_active":"2024-05-20T17:55:39.270719+0000","last_became_peered":"2024-05-20T17:55:39.270719+0000","last_unstale":"2024-05-20T17:55:41.966420+0000","last_undegraded":"2024-05-20T17:55:41.966420+0000","last_fullsized":"2024-05-20T17:55:41.966420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258048+0000","last_change":"2024-05-20T17:55:40.266407+0000","last_active":"2024-05-20T17:55:41.258048+0000","last_peered":"2024-05-20T17:55:41.258048+0000","last_clean":"2024-05-20T17:55:41.258048+0000","last_became_active":"2024-05-20T17:55:40.266040+0000","last_became_peered":"2024-05-20T17:55:40.266040+0000","last_unstale":"2024-05-20T17:55:41.258048+0000","last_undegraded":"2024-05-20T17:55:41.258048+0000","last_fullsized":"2024-05-20T17:55:41.258048+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:18.657015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254993+0000","last_change":"2024-05-20T17:55:39.275133+0000","last_active":"2024-05-20T17:55:41.254993+0000","last_peered":"2024-05-20T17:55:41.254993+0000","last_clean":"2024-05-20T17:55:41.254993+0000","last_became_active":"2024-05-20T17:55:39.274819+0000","last_became_peered":"2024-05-20T17:55:39.274819+0000","last_unstale":"2024-05-20T17:55:41.254993+0000","last_undegraded":"2024-05-20T17:55:41.254993+0000","last_fullsized":"2024-05-20T17:55:41.254993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:10.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966204+0000","last_change":"2024-05-20T17:55:40.268720+0000","last_active":"2024-05-20T17:55:41.966204+0000","last_peered":"2024-05-20T17:55:41.966204+0000","last_clean":"2024-05-20T17:55:41.966204+0000","last_became_active":"2024-05-20T17:55:40.268272+0000","last_became_peered":"2024-05-20T17:55:40.268272+0000","last_unstale":"2024-05-20T17:55:41.966204+0000","last_undegraded":"2024-05-20T17:55:41.966204+0000","last_fullsized":"2024-05-20T17:55:41.966204+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.276770+0000","last_change":"2024-05-20T17:55:39.274602+0000","last_active":"2024-05-20T17:55:39.276770+0000","last_peered":"2024-05-20T17:55:39.276770+0000","last_clean":"2024-05-20T17:55:39.276770+0000","last_became_active":"2024-05-20T17:55:39.274202+0000","last_became_peered":"2024-05-20T17:55:39.274202+0000","last_unstale":"2024-05-20T17:55:39.276770+0000","last_undegraded":"2024-05-20T17:55:39.276770+0000","last_fullsized":"2024-05-20T17:55:39.276770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.264058+0000","last_change":"2024-05-20T17:55:39.264058+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.264058+0000","last_undegraded":"2024-05-20T17:55:39.264058+0000","last_fullsized":"2024-05-20T17:55:39.264058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557215+0000","last_change":"2024-05-20T17:55:39.278757+0000","last_active":"2024-05-20T17:55:41.557215+0000","last_peered":"2024-05-20T17:55:41.557215+0000","last_clean":"2024-05-20T17:55:41.557215+0000","last_became_active":"2024-05-20T17:55:39.278446+0000","last_became_peered":"2024-05-20T17:55:39.278446+0000","last_unstale":"2024-05-20T17:55:41.557215+0000","last_undegraded":"2024-05-20T17:55:41.557215+0000","last_fullsized":"2024-05-20T17:55:41.557215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254913+0000","last_change":"2024-05-20T17:55:40.277815+0000","last_active":"2024-05-20T17:55:41.254913+0000","last_peered":"2024-05-20T17:55:41.254913+0000","last_clean":"2024-05-20T17:55:41.254913+0000","last_became_active":"2024-05-20T17:55:40.277472+0000","last_became_peered":"2024-05-20T17:55:40.277472+0000","last_unstale":"2024-05-20T17:55:41.254913+0000","last_undegraded":"2024-05-20T17:55:41.254913+0000","last_fullsized":"2024-05-20T17:55:41.254913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:07.635141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966866+0000","last_change":"2024-05-20T17:55:39.269641+0000","last_active":"2024-05-20T17:55:41.966866+0000","last_peered":"2024-05-20T17:55:41.966866+0000","last_clean":"2024-05-20T17:55:41.966866+0000","last_became_active":"2024-05-20T17:55:39.269150+0000","last_became_peered":"2024-05-20T17:55:39.269150+0000","last_unstale":"2024-05-20T17:55:41.966866+0000","last_undegraded":"2024-05-20T17:55:41.966866+0000","last_fullsized":"2024-05-20T17:55:41.966866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:42.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.264805+0000","last_change":"2024-05-20T17:55:39.264805+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.264805+0000","last_undegraded":"2024-05-20T17:55:39.264805+0000","last_fullsized":"2024-05-20T17:55:39.264805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254512+0000","last_change":"2024-05-20T17:55:39.275778+0000","last_active":"2024-05-20T17:55:41.254512+0000","last_peered":"2024-05-20T17:55:41.254512+0000","last_clean":"2024-05-20T17:55:41.254512+0000","last_became_active":"2024-05-20T17:55:39.275467+0000","last_became_peered":"2024-05-20T17:55:39.275467+0000","last_unstale":"2024-05-20T17:55:41.254512+0000","last_undegraded":"2024-05-20T17:55:41.254512+0000","last_fullsized":"2024-05-20T17:55:41.254512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:55.528047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254470+0000","last_change":"2024-05-20T17:55:40.264575+0000","last_active":"2024-05-20T17:55:41.254470+0000","last_peered":"2024-05-20T17:55:41.254470+0000","last_clean":"2024-05-20T17:55:41.254470+0000","last_became_active":"2024-05-20T17:55:40.264241+0000","last_became_peered":"2024-05-20T17:55:40.264241+0000","last_unstale":"2024-05-20T17:55:41.254470+0000","last_undegraded":"2024-05-20T17:55:41.254470+0000","last_fullsized":"2024-05-20T17:55:41.254470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:06.124095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":6,"reported_epoch":49,"state":"active","last_fresh":"2024-05-20T17:55:39.277815+0000","last_change":"2024-05-20T17:55:39.277743+0000","last_active":"2024-05-20T17:55:39.277815+0000","last_peered":"2024-05-20T17:55:39.277815+0000","last_clean":"2024-05-20T17:55:38.240371+0000","last_became_active":"2024-05-20T17:55:39.277743+0000","last_became_peered":"2024-05-20T17:55:39.277743+0000","last_unstale":"2024-05-20T17:55:39.277815+0000","last_undegraded":"2024-05-20T17:55:39.277815+0000","last_fullsized":"2024-05-20T17:55:39.277815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965685+0000","last_change":"2024-05-20T17:55:40.277654+0000","last_active":"2024-05-20T17:55:41.965685+0000","last_peered":"2024-05-20T17:55:41.965685+0000","last_clean":"2024-05-20T17:55:41.965685+0000","last_became_active":"2024-05-20T17:55:40.277356+0000","last_became_peered":"2024-05-20T17:55:40.277356+0000","last_unstale":"2024-05-20T17:55:41.965685+0000","last_undegraded":"2024-05-20T17:55:41.965685+0000","last_fullsized":"2024-05-20T17:55:41.965685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257414+0000","last_change":"2024-05-20T17:55:39.265979+0000","last_active":"2024-05-20T17:55:41.257414+0000","last_peered":"2024-05-20T17:55:41.257414+0000","last_clean":"2024-05-20T17:55:41.257414+0000","last_became_active":"2024-05-20T17:55:39.265679+0000","last_became_peered":"2024-05-20T17:55:39.265679+0000","last_unstale":"2024-05-20T17:55:41.257414+0000","last_undegraded":"2024-05-20T17:55:41.257414+0000","last_fullsized":"2024-05-20T17:55:41.257414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:34.833740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257757+0000","last_change":"2024-05-20T17:55:40.277228+0000","last_active":"2024-05-20T17:55:41.257757+0000","last_peered":"2024-05-20T17:55:41.257757+0000","last_clean":"2024-05-20T17:55:41.257757+0000","last_became_active":"2024-05-20T17:55:40.276880+0000","last_became_peered":"2024-05-20T17:55:40.276880+0000","last_unstale":"2024-05-20T17:55:41.257757+0000","last_undegraded":"2024-05-20T17:55:41.257757+0000","last_fullsized":"2024-05-20T17:55:41.257757+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:39.200975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557190+0000","last_change":"2024-05-20T17:55:39.273470+0000","last_active":"2024-05-20T17:55:41.557190+0000","last_peered":"2024-05-20T17:55:41.557190+0000","last_clean":"2024-05-20T17:55:41.557190+0000","last_became_active":"2024-05-20T17:55:39.273151+0000","last_became_peered":"2024-05-20T17:55:39.273151+0000","last_unstale":"2024-05-20T17:55:41.557190+0000","last_undegraded":"2024-05-20T17:55:41.557190+0000","last_fullsized":"2024-05-20T17:55:41.557190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966012+0000","last_change":"2024-05-20T17:55:40.272795+0000","last_active":"2024-05-20T17:55:41.966012+0000","last_peered":"2024-05-20T17:55:41.966012+0000","last_clean":"2024-05-20T17:55:41.966012+0000","last_became_active":"2024-05-20T17:55:40.272473+0000","last_became_peered":"2024-05-20T17:55:40.272473+0000","last_unstale":"2024-05-20T17:55:41.966012+0000","last_undegraded":"2024-05-20T17:55:41.966012+0000","last_fullsized":"2024-05-20T17:55:41.966012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557373+0000","last_change":"2024-05-20T17:55:39.266166+0000","last_active":"2024-05-20T17:55:41.557373+0000","last_peered":"2024-05-20T17:55:41.557373+0000","last_clean":"2024-05-20T17:55:41.557373+0000","last_became_active":"2024-05-20T17:55:39.265830+0000","last_became_peered":"2024-05-20T17:55:39.265830+0000","last_unstale":"2024-05-20T17:55:41.557373+0000","last_undegraded":"2024-05-20T17:55:41.557373+0000","last_fullsized":"2024-05-20T17:55:41.557373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:35:39.407657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966454+0000","last_change":"2024-05-20T17:55:40.264272+0000","last_active":"2024-05-20T17:55:41.966454+0000","last_peered":"2024-05-20T17:55:41.966454+0000","last_clean":"2024-05-20T17:55:41.966454+0000","last_became_active":"2024-05-20T17:55:40.263229+0000","last_became_peered":"2024-05-20T17:55:40.263229+0000","last_unstale":"2024-05-20T17:55:41.966454+0000","last_undegraded":"2024-05-20T17:55:41.966454+0000","last_fullsized":"2024-05-20T17:55:41.966454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966167+0000","last_change":"2024-05-20T17:55:39.265914+0000","last_active":"2024-05-20T17:55:41.966167+0000","last_peered":"2024-05-20T17:55:41.966167+0000","last_clean":"2024-05-20T17:55:41.966167+0000","last_became_active":"2024-05-20T17:55:39.265583+0000","last_became_peered":"2024-05-20T17:55:39.265583+0000","last_unstale":"2024-05-20T17:55:41.966167+0000","last_undegraded":"2024-05-20T17:55:41.966167+0000","last_fullsized":"2024-05-20T17:55:41.966167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557422+0000","last_change":"2024-05-20T17:55:40.270988+0000","last_active":"2024-05-20T17:55:41.557422+0000","last_peered":"2024-05-20T17:55:41.557422+0000","last_clean":"2024-05-20T17:55:41.557422+0000","last_became_active":"2024-05-20T17:55:40.270582+0000","last_became_peered":"2024-05-20T17:55:40.270582+0000","last_unstale":"2024-05-20T17:55:41.557422+0000","last_undegraded":"2024-05-20T17:55:41.557422+0000","last_fullsized":"2024-05-20T17:55:41.557422+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254285+0000","last_change":"2024-05-20T17:55:39.272103+0000","last_active":"2024-05-20T17:55:41.254285+0000","last_peered":"2024-05-20T17:55:41.254285+0000","last_clean":"2024-05-20T17:55:41.254285+0000","last_became_active":"2024-05-20T17:55:39.271787+0000","last_became_peered":"2024-05-20T17:55:39.271787+0000","last_unstale":"2024-05-20T17:55:41.254285+0000","last_undegraded":"2024-05-20T17:55:41.254285+0000","last_fullsized":"2024-05-20T17:55:41.254285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:41.864783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.258373+0000","last_change":"2024-05-20T17:55:39.258373+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.258373+0000","last_undegraded":"2024-05-20T17:55:39.258373+0000","last_fullsized":"2024-05-20T17:55:39.258373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.263524+0000","last_change":"2024-05-20T17:55:39.262518+0000","last_active":"2024-05-20T17:55:39.263524+0000","last_peered":"2024-05-20T17:55:39.263524+0000","last_clean":"2024-05-20T17:55:39.263524+0000","last_became_active":"2024-05-20T17:55:39.262191+0000","last_became_peered":"2024-05-20T17:55:39.262191+0000","last_unstale":"2024-05-20T17:55:39.263524+0000","last_undegraded":"2024-05-20T17:55:39.263524+0000","last_fullsized":"2024-05-20T17:55:39.263524+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965915+0000","last_change":"2024-05-20T17:55:40.275681+0000","last_active":"2024-05-20T17:55:41.965915+0000","last_peered":"2024-05-20T17:55:41.965915+0000","last_clean":"2024-05-20T17:55:41.965915+0000","last_became_active":"2024-05-20T17:55:40.275360+0000","last_became_peered":"2024-05-20T17:55:40.275360+0000","last_unstale":"2024-05-20T17:55:41.965915+0000","last_undegraded":"2024-05-20T17:55:41.965915+0000","last_fullsized":"2024-05-20T17:55:41.965915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.256993+0000","last_change":"2024-05-20T17:55:39.269421+0000","last_active":"2024-05-20T17:55:41.256993+0000","last_peered":"2024-05-20T17:55:41.256993+0000","last_clean":"2024-05-20T17:55:41.256993+0000","last_became_active":"2024-05-20T17:55:39.269101+0000","last_became_peered":"2024-05-20T17:55:39.269101+0000","last_unstale":"2024-05-20T17:55:41.256993+0000","last_undegraded":"2024-05-20T17:55:41.256993+0000","last_fullsized":"2024-05-20T17:55:41.256993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:11.791684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966253+0000","last_change":"2024-05-20T17:55:40.267783+0000","last_active":"2024-05-20T17:55:41.966253+0000","last_peered":"2024-05-20T17:55:41.966253+0000","last_clean":"2024-05-20T17:55:41.966253+0000","last_became_active":"2024-05-20T17:55:40.267415+0000","last_became_peered":"2024-05-20T17:55:40.267415+0000","last_unstale":"2024-05-20T17:55:41.966253+0000","last_undegraded":"2024-05-20T17:55:41.966253+0000","last_fullsized":"2024-05-20T17:55:41.966253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557363+0000","last_change":"2024-05-20T17:55:39.280002+0000","last_active":"2024-05-20T17:55:41.557363+0000","last_peered":"2024-05-20T17:55:41.557363+0000","last_clean":"2024-05-20T17:55:41.557363+0000","last_became_active":"2024-05-20T17:55:39.279754+0000","last_became_peered":"2024-05-20T17:55:39.279754+0000","last_unstale":"2024-05-20T17:55:41.557363+0000","last_undegraded":"2024-05-20T17:55:41.557363+0000","last_fullsized":"2024-05-20T17:55:41.557363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:11:28.961264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965866+0000","last_change":"2024-05-20T17:55:40.268902+0000","last_active":"2024-05-20T17:55:41.965866+0000","last_peered":"2024-05-20T17:55:41.965866+0000","last_clean":"2024-05-20T17:55:41.965866+0000","last_became_active":"2024-05-20T17:55:40.268587+0000","last_became_peered":"2024-05-20T17:55:40.268587+0000","last_unstale":"2024-05-20T17:55:41.965866+0000","last_undegraded":"2024-05-20T17:55:41.965866+0000","last_fullsized":"2024-05-20T17:55:41.965866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966557+0000","last_change":"2024-05-20T17:55:39.274048+0000","last_active":"2024-05-20T17:55:41.966557+0000","last_peered":"2024-05-20T17:55:41.966557+0000","last_clean":"2024-05-20T17:55:41.966557+0000","last_became_active":"2024-05-20T17:55:39.273738+0000","last_became_peered":"2024-05-20T17:55:39.273738+0000","last_unstale":"2024-05-20T17:55:41.966557+0000","last_undegraded":"2024-05-20T17:55:41.966557+0000","last_fullsized":"2024-05-20T17:55:41.966557+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:07.062814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254624+0000","last_change":"2024-05-20T17:55:40.265532+0000","last_active":"2024-05-20T17:55:41.254624+0000","last_peered":"2024-05-20T17:55:41.254624+0000","last_clean":"2024-05-20T17:55:41.254624+0000","last_became_active":"2024-05-20T17:55:40.265164+0000","last_became_peered":"2024-05-20T17:55:40.265164+0000","last_unstale":"2024-05-20T17:55:41.254624+0000","last_undegraded":"2024-05-20T17:55:41.254624+0000","last_fullsized":"2024-05-20T17:55:41.254624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:15:38.124970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.262718+0000","last_change":"2024-05-20T17:55:39.260761+0000","last_active":"2024-05-20T17:55:39.262718+0000","last_peered":"2024-05-20T17:55:39.262718+0000","last_clean":"2024-05-20T17:55:39.262718+0000","last_became_active":"2024-05-20T17:55:39.260432+0000","last_became_peered":"2024-05-20T17:55:39.260432+0000","last_unstale":"2024-05-20T17:55:39.262718+0000","last_undegraded":"2024-05-20T17:55:39.262718+0000","last_fullsized":"2024-05-20T17:55:39.262718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:08:37.860132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.259020+0000","last_change":"2024-05-20T17:55:39.259020+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.259020+0000","last_undegraded":"2024-05-20T17:55:39.259020+0000","last_fullsized":"2024-05-20T17:55:39.259020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254740+0000","last_change":"2024-05-20T17:55:39.272924+0000","last_active":"2024-05-20T17:55:41.254740+0000","last_peered":"2024-05-20T17:55:41.254740+0000","last_clean":"2024-05-20T17:55:41.254740+0000","last_became_active":"2024-05-20T17:55:39.272604+0000","last_became_peered":"2024-05-20T17:55:39.272604+0000","last_unstale":"2024-05-20T17:55:41.254740+0000","last_undegraded":"2024-05-20T17:55:41.254740+0000","last_fullsized":"2024-05-20T17:55:41.254740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.121415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966476+0000","last_change":"2024-05-20T17:55:40.270269+0000","last_active":"2024-05-20T17:55:41.966476+0000","last_peered":"2024-05-20T17:55:41.966476+0000","last_clean":"2024-05-20T17:55:41.966476+0000","last_became_active":"2024-05-20T17:55:40.269480+0000","last_became_peered":"2024-05-20T17:55:40.269480+0000","last_unstale":"2024-05-20T17:55:41.966476+0000","last_undegraded":"2024-05-20T17:55:41.966476+0000","last_fullsized":"2024-05-20T17:55:41.966476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254494+0000","last_change":"2024-05-20T17:55:39.270561+0000","last_active":"2024-05-20T17:55:41.254494+0000","last_peered":"2024-05-20T17:55:41.254494+0000","last_clean":"2024-05-20T17:55:41.254494+0000","last_became_active":"2024-05-20T17:55:39.270216+0000","last_became_peered":"2024-05-20T17:55:39.270216+0000","last_unstale":"2024-05-20T17:55:41.254494+0000","last_undegraded":"2024-05-20T17:55:41.254494+0000","last_fullsized":"2024-05-20T17:55:41.254494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:14.931204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.259825+0000","last_change":"2024-05-20T17:55:39.259825+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.259825+0000","last_undegraded":"2024-05-20T17:55:39.259825+0000","last_fullsized":"2024-05-20T17:55:39.259825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257596+0000","last_change":"2024-05-20T17:55:39.266935+0000","last_active":"2024-05-20T17:55:41.257596+0000","last_peered":"2024-05-20T17:55:41.257596+0000","last_clean":"2024-05-20T17:55:41.257596+0000","last_became_active":"2024-05-20T17:55:39.264958+0000","last_became_peered":"2024-05-20T17:55:39.264958+0000","last_unstale":"2024-05-20T17:55:41.257596+0000","last_undegraded":"2024-05-20T17:55:41.257596+0000","last_fullsized":"2024-05-20T17:55:41.257596+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254927+0000","last_change":"2024-05-20T17:55:40.266843+0000","last_active":"2024-05-20T17:55:41.254927+0000","last_peered":"2024-05-20T17:55:41.254927+0000","last_clean":"2024-05-20T17:55:41.254927+0000","last_became_active":"2024-05-20T17:55:40.266052+0000","last_became_peered":"2024-05-20T17:55:40.266052+0000","last_unstale":"2024-05-20T17:55:41.254927+0000","last_undegraded":"2024-05-20T17:55:41.254927+0000","last_fullsized":"2024-05-20T17:55:41.254927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:04.314309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966202+0000","last_change":"2024-05-20T17:55:39.270669+0000","last_active":"2024-05-20T17:55:41.966202+0000","last_peered":"2024-05-20T17:55:41.966202+0000","last_clean":"2024-05-20T17:55:41.966202+0000","last_became_active":"2024-05-20T17:55:39.270233+0000","last_became_peered":"2024-05-20T17:55:39.270233+0000","last_unstale":"2024-05-20T17:55:41.966202+0000","last_undegraded":"2024-05-20T17:55:41.966202+0000","last_fullsized":"2024-05-20T17:55:41.966202+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557129+0000","last_change":"2024-05-20T17:55:40.264890+0000","last_active":"2024-05-20T17:55:41.557129+0000","last_peered":"2024-05-20T17:55:41.557129+0000","last_clean":"2024-05-20T17:55:41.557129+0000","last_became_active":"2024-05-20T17:55:40.264196+0000","last_became_peered":"2024-05-20T17:55:40.264196+0000","last_unstale":"2024-05-20T17:55:41.557129+0000","last_undegraded":"2024-05-20T17:55:41.557129+0000","last_fullsized":"2024-05-20T17:55:41.557129+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.274803+0000","last_change":"2024-05-20T17:55:39.269301+0000","last_active":"2024-05-20T17:55:39.274803+0000","last_peered":"2024-05-20T17:55:39.274803+0000","last_clean":"2024-05-20T17:55:39.274803+0000","last_became_active":"2024-05-20T17:55:39.268957+0000","last_became_peered":"2024-05-20T17:55:39.268957+0000","last_unstale":"2024-05-20T17:55:39.274803+0000","last_undegraded":"2024-05-20T17:55:39.274803+0000","last_fullsized":"2024-05-20T17:55:39.274803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965845+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:55:41.965845+0000","last_peered":"2024-05-20T17:55:41.965845+0000","last_clean":"2024-05-20T17:55:41.965845+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:55:41.965845+0000","last_undegraded":"2024-05-20T17:55:41.965845+0000","last_fullsized":"2024-05-20T17:55:41.965845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":126,"acting":126,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":861144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":271304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":270652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":271234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":272264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":270812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1163264,"data_stored":840494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:55:44.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:55:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.511+0000 7f40bacf6640 1 Processor -- start 2024-05-20T17:55:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.511+0000 7f40bacf6640 1 -- start start 2024-05-20T17:55:44.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40bacf6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40b406d3d0 0x7f40b406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40bacf6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b406dd20 con 0x7f40b4162820 2024-05-20T17:55:44.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40bacf6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b40d0630 con 0x7f40b40b8190 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40bacf6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f40b40d39c0 con 0x7f40b406d3d0 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40b3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40b406d3d0 0x7f40b406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40b8a92640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40b4162820 0x7f40b40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43960/0 (socket says 172.21.15.6:43960) 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40b8a92640 1 -- 172.21.15.6:0/4115450508 learned_addr learned my addr 172.21.15.6:0/4115450508 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40b3fff640 1 --2- 172.21.15.6:0/4115450508 >> v2:172.21.15.6:3300/0 conn(0x7f40b406d3d0 0x7f40b406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56876/0 (socket says 172.21.15.6:56876) 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40b3fff640 1 -- 172.21.15.6:0/4115450508 >> v1:172.21.15.171:6789/0 conn(0x7f40b40b8190 legacy=0x7f40b40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40b3fff640 1 -- 172.21.15.6:0/4115450508 >> v1:172.21.15.6:6789/0 conn(0x7f40b4162820 legacy=0x7f40b40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.512+0000 7f40b37fe640 1 -- 172.21.15.6:0/4115450508 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158019890 0 0) 0x7f40a8001110 con 0x7f40b4162820 2024-05-20T17:55:44.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.513+0000 7f40b3fff640 1 -- 172.21.15.6:0/4115450508 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b40d3ca0 con 0x7f40b406d3d0 2024-05-20T17:55:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.513+0000 7f40b3fff640 1 --2- 172.21.15.6:0/4115450508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b406d7e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f40a00097a0 tx=0x7f40a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cfd6f2e715d9b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.513+0000 7f40b37fe640 1 -- 172.21.15.6:0/4115450508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0037070 con 0x7f40b406d3d0 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.513+0000 7f40b37fe640 1 -- 172.21.15.6:0/4115450508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a0032440 con 0x7f40b406d3d0 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.513+0000 7f40b37fe640 1 -- 172.21.15.6:0/4115450508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0032810 con 0x7f40b406d3d0 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.514+0000 7f40bacf6640 1 -- 172.21.15.6:0/4115450508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 msgr2=0x7f40b406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.514+0000 7f40bacf6640 1 --2- 172.21.15.6:0/4115450508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b406d7e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f40a00097a0 tx=0x7f40a002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.514+0000 7f40bacf6640 1 -- 172.21.15.6:0/4115450508 shutdown_connections 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.514+0000 7f40bacf6640 1 --2- 172.21.15.6:0/4115450508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b406d7e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.514+0000 7f40bacf6640 1 -- 172.21.15.6:0/4115450508 >> 172.21.15.6:0/4115450508 conn(0x7f40b40d4bd0 msgr2=0x7f40b40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.514+0000 7f40bacf6640 1 -- 172.21.15.6:0/4115450508 shutdown_connections 2024-05-20T17:55:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.514+0000 7f40bacf6640 1 -- 172.21.15.6:0/4115450508 wait complete. 2024-05-20T17:55:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.516+0000 7f40bacf6640 1 Processor -- start 2024-05-20T17:55:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.516+0000 7f40bacf6640 1 -- start start 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.517+0000 7f40bacf6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b41f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.517+0000 7f40bacf6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b40b8190 0x7f40b40b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.517+0000 7f40bacf6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b4162820 0x7f40b40b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.517+0000 7f40bacf6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40b40d0300 con 0x7f40b406d3d0 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.517+0000 7f40bacf6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40b40d42e0 con 0x7f40b4162820 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.517+0000 7f40bacf6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40b40b4050 con 0x7f40b40b8190 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b41f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b41f82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56890/0 (socket says 172.21.15.6:56890) 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 -- 172.21.15.6:0/2116061709 learned_addr learned my addr 172.21.15.6:0/2116061709 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b3fff640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b40b8190 0x7f40b40b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b9293640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b4162820 0x7f40b40b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 -- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b40b8190 msgr2=0x7f40b40b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b40b8190 0x7f40b40b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 -- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b4162820 msgr2=0x7f40b40b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b4162820 0x7f40b40b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 -- 172.21.15.6:0/2116061709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b41f87e0 con 0x7f40b406d3d0 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b8a92640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b41f82a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c430 tx=0x7f40a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b17fa640 1 -- 172.21.15.6:0/2116061709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a80074e0 con 0x7f40b406d3d0 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b17fa640 1 -- 172.21.15.6:0/2116061709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a80047e0 con 0x7f40b406d3d0 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b41e8360 con 0x7f40b406d3d0 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40b17fa640 1 -- 172.21.15.6:0/2116061709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8004bd0 con 0x7f40b406d3d0 2024-05-20T17:55:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.518+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b41e8920 con 0x7f40b406d3d0 2024-05-20T17:55:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.519+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b4161d50 con 0x7f40b406d3d0 2024-05-20T17:55:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.520+0000 7f40b17fa640 1 -- 172.21.15.6:0/2116061709 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40a8011070 con 0x7f40b406d3d0 2024-05-20T17:55:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.520+0000 7f40b17fa640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409806be30 0x7f409806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.520+0000 7f40b17fa640 1 -- 172.21.15.6:0/2116061709 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f40a808ab50 con 0x7f40b406d3d0 2024-05-20T17:55:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.521+0000 7f40b3fff640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409806be30 0x7f409806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.521+0000 7f40b3fff640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409806be30 0x7f409806e340 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f40a0034000 tx=0x7f40a002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.525+0000 7f40b17fa640 1 -- 172.21.15.6:0/2116061709 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f40b4161d50 con 0x7f40b406d3d0 2024-05-20T17:55:44.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.704+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40b4075b00 con 0x7f409806be30 2024-05-20T17:55:44.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.711+0000 7f40b17fa640 1 -- 172.21.15.6:0/2116061709 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250649 (secure 0 0 0) 0x7f40b4075b00 con 0x7f409806be30 2024-05-20T17:55:44.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:44.713 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409806be30 msgr2=0x7f409806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409806be30 0x7f409806e340 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f40a0034000 tx=0x7f40a002e000 comp rx=0 tx=0).stop 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 msgr2=0x7f40b41f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b41f82a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c430 tx=0x7f40a800c8f0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 shutdown_connections 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409806be30 0x7f409806e340 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b4162820 0x7f40b40b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b40b8190 0x7f40b40b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 --2- 172.21.15.6:0/2116061709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b406d3d0 0x7f40b41f82a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 >> 172.21.15.6:0/2116061709 conn(0x7f40b40d4bd0 msgr2=0x7f40b40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 shutdown_connections 2024-05-20T17:55:44.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.713+0000 7f40bacf6640 1 -- 172.21.15.6:0/2116061709 wait complete. 2024-05-20T17:55:44.724 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-20T17:55:44.271301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":192,"acting":192,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226264,"kb_used_data":5916,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748456,"statfs":{"total":773094113280,"available":772862418944,"internally_reserved":0,"allocated":6057984,"data_stored":3330190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966036+0000","last_change":"2024-05-20T17:55:40.270773+0000","last_active":"2024-05-20T17:55:41.966036+0000","last_peered":"2024-05-20T17:55:41.966036+0000","last_clean":"2024-05-20T17:55:41.966036+0000","last_became_active":"2024-05-20T17:55:40.270461+0000","last_became_peered":"2024-05-20T17:55:40.270461+0000","last_unstale":"2024-05-20T17:55:41.966036+0000","last_undegraded":"2024-05-20T17:55:41.966036+0000","last_fullsized":"2024-05-20T17:55:41.966036+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:53.123523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966594+0000","last_change":"2024-05-20T17:55:40.281497+0000","last_active":"2024-05-20T17:55:41.966594+0000","last_peered":"2024-05-20T17:55:41.966594+0000","last_clean":"2024-05-20T17:55:41.966594+0000","last_became_active":"2024-05-20T17:55:40.281191+0000","last_became_peered":"2024-05-20T17:55:40.281191+0000","last_unstale":"2024-05-20T17:55:41.966594+0000","last_undegraded":"2024-05-20T17:55:41.966594+0000","last_fullsized":"2024-05-20T17:55:41.966594+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.274706+0000","last_change":"2024-05-20T17:55:39.274706+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.274706+0000","last_undegraded":"2024-05-20T17:55:39.274706+0000","last_fullsized":"2024-05-20T17:55:39.274706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966155+0000","last_change":"2024-05-20T17:55:40.289561+0000","last_active":"2024-05-20T17:55:41.966155+0000","last_peered":"2024-05-20T17:55:41.966155+0000","last_clean":"2024-05-20T17:55:41.966155+0000","last_became_active":"2024-05-20T17:55:40.289232+0000","last_became_peered":"2024-05-20T17:55:40.289232+0000","last_unstale":"2024-05-20T17:55:41.966155+0000","last_undegraded":"2024-05-20T17:55:41.966155+0000","last_fullsized":"2024-05-20T17:55:41.966155+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257998+0000","last_change":"2024-05-20T17:55:40.268614+0000","last_active":"2024-05-20T17:55:41.257998+0000","last_peered":"2024-05-20T17:55:41.257998+0000","last_clean":"2024-05-20T17:55:41.257998+0000","last_became_active":"2024-05-20T17:55:40.268295+0000","last_became_peered":"2024-05-20T17:55:40.268295+0000","last_unstale":"2024-05-20T17:55:41.257998+0000","last_undegraded":"2024-05-20T17:55:41.257998+0000","last_fullsized":"2024-05-20T17:55:41.257998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:43.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965810+0000","last_change":"2024-05-20T17:55:40.278388+0000","last_active":"2024-05-20T17:55:41.965810+0000","last_peered":"2024-05-20T17:55:41.965810+0000","last_clean":"2024-05-20T17:55:41.965810+0000","last_became_active":"2024-05-20T17:55:40.278061+0000","last_became_peered":"2024-05-20T17:55:40.278061+0000","last_unstale":"2024-05-20T17:55:41.965810+0000","last_undegraded":"2024-05-20T17:55:41.965810+0000","last_fullsized":"2024-05-20T17:55:41.965810+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.270276+0000","last_change":"2024-05-20T17:55:39.270276+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.270276+0000","last_undegraded":"2024-05-20T17:55:39.270276+0000","last_fullsized":"2024-05-20T17:55:39.270276+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254404+0000","last_change":"2024-05-20T17:55:40.282267+0000","last_active":"2024-05-20T17:55:41.254404+0000","last_peered":"2024-05-20T17:55:41.254404+0000","last_clean":"2024-05-20T17:55:41.254404+0000","last_became_active":"2024-05-20T17:55:40.281957+0000","last_became_peered":"2024-05-20T17:55:40.281957+0000","last_unstale":"2024-05-20T17:55:41.254404+0000","last_undegraded":"2024-05-20T17:55:41.254404+0000","last_fullsized":"2024-05-20T17:55:41.254404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:36.957704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254821+0000","last_change":"2024-05-20T17:55:40.277468+0000","last_active":"2024-05-20T17:55:41.254821+0000","last_peered":"2024-05-20T17:55:41.254821+0000","last_clean":"2024-05-20T17:55:41.254821+0000","last_became_active":"2024-05-20T17:55:40.276903+0000","last_became_peered":"2024-05-20T17:55:40.276903+0000","last_unstale":"2024-05-20T17:55:41.254821+0000","last_undegraded":"2024-05-20T17:55:41.254821+0000","last_fullsized":"2024-05-20T17:55:41.254821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:02.671800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965875+0000","last_change":"2024-05-20T17:55:40.282130+0000","last_active":"2024-05-20T17:55:41.965875+0000","last_peered":"2024-05-20T17:55:41.965875+0000","last_clean":"2024-05-20T17:55:41.965875+0000","last_became_active":"2024-05-20T17:55:40.281789+0000","last_became_peered":"2024-05-20T17:55:40.281789+0000","last_unstale":"2024-05-20T17:55:41.965875+0000","last_undegraded":"2024-05-20T17:55:41.965875+0000","last_fullsized":"2024-05-20T17:55:41.965875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257338+0000","last_change":"2024-05-20T17:55:40.276661+0000","last_active":"2024-05-20T17:55:41.257338+0000","last_peered":"2024-05-20T17:55:41.257338+0000","last_clean":"2024-05-20T17:55:41.257338+0000","last_became_active":"2024-05-20T17:55:40.276358+0000","last_became_peered":"2024-05-20T17:55:40.276358+0000","last_unstale":"2024-05-20T17:55:41.257338+0000","last_undegraded":"2024-05-20T17:55:41.257338+0000","last_fullsized":"2024-05-20T17:55:41.257338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:33.789874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254780+0000","last_change":"2024-05-20T17:55:40.272120+0000","last_active":"2024-05-20T17:55:41.254780+0000","last_peered":"2024-05-20T17:55:41.254780+0000","last_clean":"2024-05-20T17:55:41.254780+0000","last_became_active":"2024-05-20T17:55:40.271802+0000","last_became_peered":"2024-05-20T17:55:40.271802+0000","last_unstale":"2024-05-20T17:55:41.254780+0000","last_undegraded":"2024-05-20T17:55:41.254780+0000","last_fullsized":"2024-05-20T17:55:41.254780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:00.485107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966039+0000","last_change":"2024-05-20T17:55:40.280972+0000","last_active":"2024-05-20T17:55:41.966039+0000","last_peered":"2024-05-20T17:55:41.966039+0000","last_clean":"2024-05-20T17:55:41.966039+0000","last_became_active":"2024-05-20T17:55:40.280674+0000","last_became_peered":"2024-05-20T17:55:40.280674+0000","last_unstale":"2024-05-20T17:55:41.966039+0000","last_undegraded":"2024-05-20T17:55:41.966039+0000","last_fullsized":"2024-05-20T17:55:41.966039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.272813+0000","last_change":"2024-05-20T17:55:39.272813+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.272813+0000","last_undegraded":"2024-05-20T17:55:39.272813+0000","last_fullsized":"2024-05-20T17:55:39.272813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966878+0000","last_change":"2024-05-20T17:55:40.278390+0000","last_active":"2024-05-20T17:55:41.966878+0000","last_peered":"2024-05-20T17:55:41.966878+0000","last_clean":"2024-05-20T17:55:41.966878+0000","last_became_active":"2024-05-20T17:55:40.278036+0000","last_became_peered":"2024-05-20T17:55:40.278036+0000","last_unstale":"2024-05-20T17:55:41.966878+0000","last_undegraded":"2024-05-20T17:55:41.966878+0000","last_fullsized":"2024-05-20T17:55:41.966878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:32.756855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965699+0000","last_change":"2024-05-20T17:55:40.271972+0000","last_active":"2024-05-20T17:55:41.965699+0000","last_peered":"2024-05-20T17:55:41.965699+0000","last_clean":"2024-05-20T17:55:41.965699+0000","last_became_active":"2024-05-20T17:55:40.271620+0000","last_became_peered":"2024-05-20T17:55:40.271620+0000","last_unstale":"2024-05-20T17:55:41.965699+0000","last_undegraded":"2024-05-20T17:55:41.965699+0000","last_fullsized":"2024-05-20T17:55:41.965699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.276707+0000","last_change":"2024-05-20T17:55:39.276707+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.276707+0000","last_undegraded":"2024-05-20T17:55:39.276707+0000","last_fullsized":"2024-05-20T17:55:39.276707+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966717+0000","last_change":"2024-05-20T17:55:40.282461+0000","last_active":"2024-05-20T17:55:41.966717+0000","last_peered":"2024-05-20T17:55:41.966717+0000","last_clean":"2024-05-20T17:55:41.966717+0000","last_became_active":"2024-05-20T17:55:40.282146+0000","last_became_peered":"2024-05-20T17:55:40.282146+0000","last_unstale":"2024-05-20T17:55:41.966717+0000","last_undegraded":"2024-05-20T17:55:41.966717+0000","last_fullsized":"2024-05-20T17:55:41.966717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:59:35.697636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.273100+0000","last_change":"2024-05-20T17:55:39.273100+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.273100+0000","last_undegraded":"2024-05-20T17:55:39.273100+0000","last_fullsized":"2024-05-20T17:55:39.273100+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557223+0000","last_change":"2024-05-20T17:55:40.266526+0000","last_active":"2024-05-20T17:55:41.557223+0000","last_peered":"2024-05-20T17:55:41.557223+0000","last_clean":"2024-05-20T17:55:41.557223+0000","last_became_active":"2024-05-20T17:55:40.265920+0000","last_became_peered":"2024-05-20T17:55:40.265920+0000","last_unstale":"2024-05-20T17:55:41.557223+0000","last_undegraded":"2024-05-20T17:55:41.557223+0000","last_fullsized":"2024-05-20T17:55:41.557223+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557207+0000","last_change":"2024-05-20T17:55:40.271285+0000","last_active":"2024-05-20T17:55:41.557207+0000","last_peered":"2024-05-20T17:55:41.557207+0000","last_clean":"2024-05-20T17:55:41.557207+0000","last_became_active":"2024-05-20T17:55:40.270660+0000","last_became_peered":"2024-05-20T17:55:40.270660+0000","last_unstale":"2024-05-20T17:55:41.557207+0000","last_undegraded":"2024-05-20T17:55:41.557207+0000","last_fullsized":"2024-05-20T17:55:41.557207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254365+0000","last_change":"2024-05-20T17:55:40.282955+0000","last_active":"2024-05-20T17:55:41.254365+0000","last_peered":"2024-05-20T17:55:41.254365+0000","last_clean":"2024-05-20T17:55:41.254365+0000","last_became_active":"2024-05-20T17:55:40.282609+0000","last_became_peered":"2024-05-20T17:55:40.282609+0000","last_unstale":"2024-05-20T17:55:41.254365+0000","last_undegraded":"2024-05-20T17:55:41.254365+0000","last_fullsized":"2024-05-20T17:55:41.254365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:15.702355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257167+0000","last_change":"2024-05-20T17:55:40.277466+0000","last_active":"2024-05-20T17:55:41.257167+0000","last_peered":"2024-05-20T17:55:41.257167+0000","last_clean":"2024-05-20T17:55:41.257167+0000","last_became_active":"2024-05-20T17:55:40.277117+0000","last_became_peered":"2024-05-20T17:55:40.277117+0000","last_unstale":"2024-05-20T17:55:41.257167+0000","last_undegraded":"2024-05-20T17:55:41.257167+0000","last_fullsized":"2024-05-20T17:55:41.257167+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:35:09.265029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T17:55:39.242479+0000","last_change":"2024-05-20T17:55:39.242479+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.242479+0000","last_undegraded":"2024-05-20T17:55:39.242479+0000","last_fullsized":"2024-05-20T17:55:39.242479+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.267813+0000","last_change":"2024-05-20T17:55:39.267813+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.267813+0000","last_undegraded":"2024-05-20T17:55:39.267813+0000","last_fullsized":"2024-05-20T17:55:39.267813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254723+0000","last_change":"2024-05-20T17:55:40.270685+0000","last_active":"2024-05-20T17:55:41.254723+0000","last_peered":"2024-05-20T17:55:41.254723+0000","last_clean":"2024-05-20T17:55:41.254723+0000","last_became_active":"2024-05-20T17:55:40.270370+0000","last_became_peered":"2024-05-20T17:55:40.270370+0000","last_unstale":"2024-05-20T17:55:41.254723+0000","last_undegraded":"2024-05-20T17:55:41.254723+0000","last_fullsized":"2024-05-20T17:55:41.254723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:07.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966227+0000","last_change":"2024-05-20T17:55:40.276848+0000","last_active":"2024-05-20T17:55:41.966227+0000","last_peered":"2024-05-20T17:55:41.966227+0000","last_clean":"2024-05-20T17:55:41.966227+0000","last_became_active":"2024-05-20T17:55:40.276542+0000","last_became_peered":"2024-05-20T17:55:40.276542+0000","last_unstale":"2024-05-20T17:55:41.966227+0000","last_undegraded":"2024-05-20T17:55:41.966227+0000","last_fullsized":"2024-05-20T17:55:41.966227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557367+0000","last_change":"2024-05-20T17:55:40.267011+0000","last_active":"2024-05-20T17:55:41.557367+0000","last_peered":"2024-05-20T17:55:41.557367+0000","last_clean":"2024-05-20T17:55:41.557367+0000","last_became_active":"2024-05-20T17:55:40.266683+0000","last_became_peered":"2024-05-20T17:55:40.266683+0000","last_unstale":"2024-05-20T17:55:41.557367+0000","last_undegraded":"2024-05-20T17:55:41.557367+0000","last_fullsized":"2024-05-20T17:55:41.557367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.265869+0000","last_change":"2024-05-20T17:55:39.265869+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.265869+0000","last_undegraded":"2024-05-20T17:55:39.265869+0000","last_fullsized":"2024-05-20T17:55:39.265869+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966369+0000","last_change":"2024-05-20T17:55:40.282635+0000","last_active":"2024-05-20T17:55:41.966369+0000","last_peered":"2024-05-20T17:55:41.966369+0000","last_clean":"2024-05-20T17:55:41.966369+0000","last_became_active":"2024-05-20T17:55:40.281020+0000","last_became_peered":"2024-05-20T17:55:40.281020+0000","last_unstale":"2024-05-20T17:55:41.966369+0000","last_undegraded":"2024-05-20T17:55:41.966369+0000","last_fullsized":"2024-05-20T17:55:41.966369+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.265335+0000","last_change":"2024-05-20T17:55:39.265335+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.265335+0000","last_undegraded":"2024-05-20T17:55:39.265335+0000","last_fullsized":"2024-05-20T17:55:39.265335+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966105+0000","last_change":"2024-05-20T17:55:40.271887+0000","last_active":"2024-05-20T17:55:41.966105+0000","last_peered":"2024-05-20T17:55:41.966105+0000","last_clean":"2024-05-20T17:55:41.966105+0000","last_became_active":"2024-05-20T17:55:40.270696+0000","last_became_peered":"2024-05-20T17:55:40.270696+0000","last_unstale":"2024-05-20T17:55:41.966105+0000","last_undegraded":"2024-05-20T17:55:41.966105+0000","last_fullsized":"2024-05-20T17:55:41.966105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965868+0000","last_change":"2024-05-20T17:55:40.275752+0000","last_active":"2024-05-20T17:55:41.965868+0000","last_peered":"2024-05-20T17:55:41.965868+0000","last_clean":"2024-05-20T17:55:41.965868+0000","last_became_active":"2024-05-20T17:55:40.275317+0000","last_became_peered":"2024-05-20T17:55:40.275317+0000","last_unstale":"2024-05-20T17:55:41.965868+0000","last_undegraded":"2024-05-20T17:55:41.965868+0000","last_fullsized":"2024-05-20T17:55:41.965868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557249+0000","last_change":"2024-05-20T17:55:39.270058+0000","last_active":"2024-05-20T17:55:41.557249+0000","last_peered":"2024-05-20T17:55:41.557249+0000","last_clean":"2024-05-20T17:55:41.557249+0000","last_became_active":"2024-05-20T17:55:39.269730+0000","last_became_peered":"2024-05-20T17:55:39.269730+0000","last_unstale":"2024-05-20T17:55:41.557249+0000","last_undegraded":"2024-05-20T17:55:41.557249+0000","last_fullsized":"2024-05-20T17:55:41.557249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966028+0000","last_change":"2024-05-20T17:55:40.274646+0000","last_active":"2024-05-20T17:55:41.966028+0000","last_peered":"2024-05-20T17:55:41.966028+0000","last_clean":"2024-05-20T17:55:41.966028+0000","last_became_active":"2024-05-20T17:55:40.274299+0000","last_became_peered":"2024-05-20T17:55:40.274299+0000","last_unstale":"2024-05-20T17:55:41.966028+0000","last_undegraded":"2024-05-20T17:55:41.966028+0000","last_fullsized":"2024-05-20T17:55:41.966028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965800+0000","last_change":"2024-05-20T17:55:39.271593+0000","last_active":"2024-05-20T17:55:41.965800+0000","last_peered":"2024-05-20T17:55:41.965800+0000","last_clean":"2024-05-20T17:55:41.965800+0000","last_became_active":"2024-05-20T17:55:39.271252+0000","last_became_peered":"2024-05-20T17:55:39.271252+0000","last_unstale":"2024-05-20T17:55:41.965800+0000","last_undegraded":"2024-05-20T17:55:41.965800+0000","last_fullsized":"2024-05-20T17:55:41.965800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557093+0000","last_change":"2024-05-20T17:55:40.268788+0000","last_active":"2024-05-20T17:55:41.557093+0000","last_peered":"2024-05-20T17:55:41.557093+0000","last_clean":"2024-05-20T17:55:41.557093+0000","last_became_active":"2024-05-20T17:55:40.268438+0000","last_became_peered":"2024-05-20T17:55:40.268438+0000","last_unstale":"2024-05-20T17:55:41.557093+0000","last_undegraded":"2024-05-20T17:55:41.557093+0000","last_fullsized":"2024-05-20T17:55:41.557093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966191+0000","last_change":"2024-05-20T17:55:39.273435+0000","last_active":"2024-05-20T17:55:41.966191+0000","last_peered":"2024-05-20T17:55:41.966191+0000","last_clean":"2024-05-20T17:55:41.966191+0000","last_became_active":"2024-05-20T17:55:39.272038+0000","last_became_peered":"2024-05-20T17:55:39.272038+0000","last_unstale":"2024-05-20T17:55:41.966191+0000","last_undegraded":"2024-05-20T17:55:41.966191+0000","last_fullsized":"2024-05-20T17:55:41.966191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254607+0000","last_change":"2024-05-20T17:55:40.269504+0000","last_active":"2024-05-20T17:55:41.254607+0000","last_peered":"2024-05-20T17:55:41.254607+0000","last_clean":"2024-05-20T17:55:41.254607+0000","last_became_active":"2024-05-20T17:55:40.269183+0000","last_became_peered":"2024-05-20T17:55:40.269183+0000","last_unstale":"2024-05-20T17:55:41.254607+0000","last_undegraded":"2024-05-20T17:55:41.254607+0000","last_fullsized":"2024-05-20T17:55:41.254607+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:13:50.189523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966477+0000","last_change":"2024-05-20T17:55:39.271665+0000","last_active":"2024-05-20T17:55:41.966477+0000","last_peered":"2024-05-20T17:55:41.966477+0000","last_clean":"2024-05-20T17:55:41.966477+0000","last_became_active":"2024-05-20T17:55:39.271355+0000","last_became_peered":"2024-05-20T17:55:39.271355+0000","last_unstale":"2024-05-20T17:55:41.966477+0000","last_undegraded":"2024-05-20T17:55:41.966477+0000","last_fullsized":"2024-05-20T17:55:41.966477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258077+0000","last_change":"2024-05-20T17:55:40.277184+0000","last_active":"2024-05-20T17:55:41.258077+0000","last_peered":"2024-05-20T17:55:41.258077+0000","last_clean":"2024-05-20T17:55:41.258077+0000","last_became_active":"2024-05-20T17:55:40.276858+0000","last_became_peered":"2024-05-20T17:55:40.276858+0000","last_unstale":"2024-05-20T17:55:41.258077+0000","last_undegraded":"2024-05-20T17:55:41.258077+0000","last_fullsized":"2024-05-20T17:55:41.258077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.259300+0000","last_change":"2024-05-20T17:55:39.256734+0000","last_active":"2024-05-20T17:55:39.259300+0000","last_peered":"2024-05-20T17:55:39.259300+0000","last_clean":"2024-05-20T17:55:39.259300+0000","last_became_active":"2024-05-20T17:55:39.256389+0000","last_became_peered":"2024-05-20T17:55:39.256389+0000","last_unstale":"2024-05-20T17:55:39.259300+0000","last_undegraded":"2024-05-20T17:55:39.259300+0000","last_fullsized":"2024-05-20T17:55:39.259300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:22:46.780789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966181+0000","last_change":"2024-05-20T17:55:40.283253+0000","last_active":"2024-05-20T17:55:41.966181+0000","last_peered":"2024-05-20T17:55:41.966181+0000","last_clean":"2024-05-20T17:55:41.966181+0000","last_became_active":"2024-05-20T17:55:40.282357+0000","last_became_peered":"2024-05-20T17:55:40.282357+0000","last_unstale":"2024-05-20T17:55:41.966181+0000","last_undegraded":"2024-05-20T17:55:41.966181+0000","last_fullsized":"2024-05-20T17:55:41.966181+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257712+0000","last_change":"2024-05-20T17:55:39.267829+0000","last_active":"2024-05-20T17:55:41.257712+0000","last_peered":"2024-05-20T17:55:41.257712+0000","last_clean":"2024-05-20T17:55:41.257712+0000","last_became_active":"2024-05-20T17:55:39.267501+0000","last_became_peered":"2024-05-20T17:55:39.267501+0000","last_unstale":"2024-05-20T17:55:41.257712+0000","last_undegraded":"2024-05-20T17:55:41.257712+0000","last_fullsized":"2024-05-20T17:55:41.257712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254976+0000","last_change":"2024-05-20T17:55:40.267881+0000","last_active":"2024-05-20T17:55:41.254976+0000","last_peered":"2024-05-20T17:55:41.254976+0000","last_clean":"2024-05-20T17:55:41.254976+0000","last_became_active":"2024-05-20T17:55:40.267566+0000","last_became_peered":"2024-05-20T17:55:40.267566+0000","last_unstale":"2024-05-20T17:55:41.254976+0000","last_undegraded":"2024-05-20T17:55:41.254976+0000","last_fullsized":"2024-05-20T17:55:41.254976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:42.086335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557032+0000","last_change":"2024-05-20T17:55:39.266116+0000","last_active":"2024-05-20T17:55:41.557032+0000","last_peered":"2024-05-20T17:55:41.557032+0000","last_clean":"2024-05-20T17:55:41.557032+0000","last_became_active":"2024-05-20T17:55:39.265728+0000","last_became_peered":"2024-05-20T17:55:39.265728+0000","last_unstale":"2024-05-20T17:55:41.557032+0000","last_undegraded":"2024-05-20T17:55:41.557032+0000","last_fullsized":"2024-05-20T17:55:41.557032+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:05:12.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966819+0000","last_change":"2024-05-20T17:55:40.286432+0000","last_active":"2024-05-20T17:55:41.966819+0000","last_peered":"2024-05-20T17:55:41.966819+0000","last_clean":"2024-05-20T17:55:41.966819+0000","last_became_active":"2024-05-20T17:55:40.286118+0000","last_became_peered":"2024-05-20T17:55:40.286118+0000","last_unstale":"2024-05-20T17:55:41.966819+0000","last_undegraded":"2024-05-20T17:55:41.966819+0000","last_fullsized":"2024-05-20T17:55:41.966819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:22.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.276136+0000","last_change":"2024-05-20T17:55:39.276136+0000","last_active":"2024-05-20T17:55:39.276136+0000","last_peered":"2024-05-20T17:55:39.276136+0000","last_clean":"2024-05-20T17:55:39.276136+0000","last_became_active":"2024-05-20T17:55:39.275769+0000","last_became_peered":"2024-05-20T17:55:39.275769+0000","last_unstale":"2024-05-20T17:55:39.276136+0000","last_undegraded":"2024-05-20T17:55:39.276136+0000","last_fullsized":"2024-05-20T17:55:39.276136+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257645+0000","last_change":"2024-05-20T17:55:40.273680+0000","last_active":"2024-05-20T17:55:41.257645+0000","last_peered":"2024-05-20T17:55:41.257645+0000","last_clean":"2024-05-20T17:55:41.257645+0000","last_became_active":"2024-05-20T17:55:40.273073+0000","last_became_peered":"2024-05-20T17:55:40.273073+0000","last_unstale":"2024-05-20T17:55:41.257645+0000","last_undegraded":"2024-05-20T17:55:41.257645+0000","last_fullsized":"2024-05-20T17:55:41.257645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:03.789329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966609+0000","last_change":"2024-05-20T17:55:39.267936+0000","last_active":"2024-05-20T17:55:41.966609+0000","last_peered":"2024-05-20T17:55:41.966609+0000","last_clean":"2024-05-20T17:55:41.966609+0000","last_became_active":"2024-05-20T17:55:39.267565+0000","last_became_peered":"2024-05-20T17:55:39.267565+0000","last_unstale":"2024-05-20T17:55:41.966609+0000","last_undegraded":"2024-05-20T17:55:41.966609+0000","last_fullsized":"2024-05-20T17:55:41.966609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965996+0000","last_change":"2024-05-20T17:55:40.259853+0000","last_active":"2024-05-20T17:55:41.965996+0000","last_peered":"2024-05-20T17:55:41.965996+0000","last_clean":"2024-05-20T17:55:41.965996+0000","last_became_active":"2024-05-20T17:55:40.259465+0000","last_became_peered":"2024-05-20T17:55:40.259465+0000","last_unstale":"2024-05-20T17:55:41.965996+0000","last_undegraded":"2024-05-20T17:55:41.965996+0000","last_fullsized":"2024-05-20T17:55:41.965996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258204+0000","last_change":"2024-05-20T17:55:39.258507+0000","last_active":"2024-05-20T17:55:41.258204+0000","last_peered":"2024-05-20T17:55:41.258204+0000","last_clean":"2024-05-20T17:55:41.258204+0000","last_became_active":"2024-05-20T17:55:39.258195+0000","last_became_peered":"2024-05-20T17:55:39.258195+0000","last_unstale":"2024-05-20T17:55:41.258204+0000","last_undegraded":"2024-05-20T17:55:41.258204+0000","last_fullsized":"2024-05-20T17:55:41.258204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.263457+0000","last_change":"2024-05-20T17:55:39.263457+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.263457+0000","last_undegraded":"2024-05-20T17:55:39.263457+0000","last_fullsized":"2024-05-20T17:55:39.263457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966420+0000","last_change":"2024-05-20T17:55:39.271032+0000","last_active":"2024-05-20T17:55:41.966420+0000","last_peered":"2024-05-20T17:55:41.966420+0000","last_clean":"2024-05-20T17:55:41.966420+0000","last_became_active":"2024-05-20T17:55:39.270719+0000","last_became_peered":"2024-05-20T17:55:39.270719+0000","last_unstale":"2024-05-20T17:55:41.966420+0000","last_undegraded":"2024-05-20T17:55:41.966420+0000","last_fullsized":"2024-05-20T17:55:41.966420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258048+0000","last_change":"2024-05-20T17:55:40.266407+0000","last_active":"2024-05-20T17:55:41.258048+0000","last_peered":"2024-05-20T17:55:41.258048+0000","last_clean":"2024-05-20T17:55:41.258048+0000","last_became_active":"2024-05-20T17:55:40.266040+0000","last_became_peered":"2024-05-20T17:55:40.266040+0000","last_unstale":"2024-05-20T17:55:41.258048+0000","last_undegraded":"2024-05-20T17:55:41.258048+0000","last_fullsized":"2024-05-20T17:55:41.258048+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:18.657015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254993+0000","last_change":"2024-05-20T17:55:39.275133+0000","last_active":"2024-05-20T17:55:41.254993+0000","last_peered":"2024-05-20T17:55:41.254993+0000","last_clean":"2024-05-20T17:55:41.254993+0000","last_became_active":"2024-05-20T17:55:39.274819+0000","last_became_peered":"2024-05-20T17:55:39.274819+0000","last_unstale":"2024-05-20T17:55:41.254993+0000","last_undegraded":"2024-05-20T17:55:41.254993+0000","last_fullsized":"2024-05-20T17:55:41.254993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:10.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966204+0000","last_change":"2024-05-20T17:55:40.268720+0000","last_active":"2024-05-20T17:55:41.966204+0000","last_peered":"2024-05-20T17:55:41.966204+0000","last_clean":"2024-05-20T17:55:41.966204+0000","last_became_active":"2024-05-20T17:55:40.268272+0000","last_became_peered":"2024-05-20T17:55:40.268272+0000","last_unstale":"2024-05-20T17:55:41.966204+0000","last_undegraded":"2024-05-20T17:55:41.966204+0000","last_fullsized":"2024-05-20T17:55:41.966204+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.276770+0000","last_change":"2024-05-20T17:55:39.274602+0000","last_active":"2024-05-20T17:55:39.276770+0000","last_peered":"2024-05-20T17:55:39.276770+0000","last_clean":"2024-05-20T17:55:39.276770+0000","last_became_active":"2024-05-20T17:55:39.274202+0000","last_became_peered":"2024-05-20T17:55:39.274202+0000","last_unstale":"2024-05-20T17:55:39.276770+0000","last_undegraded":"2024-05-20T17:55:39.276770+0000","last_fullsized":"2024-05-20T17:55:39.276770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.264058+0000","last_change":"2024-05-20T17:55:39.264058+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.264058+0000","last_undegraded":"2024-05-20T17:55:39.264058+0000","last_fullsized":"2024-05-20T17:55:39.264058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557215+0000","last_change":"2024-05-20T17:55:39.278757+0000","last_active":"2024-05-20T17:55:41.557215+0000","last_peered":"2024-05-20T17:55:41.557215+0000","last_clean":"2024-05-20T17:55:41.557215+0000","last_became_active":"2024-05-20T17:55:39.278446+0000","last_became_peered":"2024-05-20T17:55:39.278446+0000","last_unstale":"2024-05-20T17:55:41.557215+0000","last_undegraded":"2024-05-20T17:55:41.557215+0000","last_fullsized":"2024-05-20T17:55:41.557215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254913+0000","last_change":"2024-05-20T17:55:40.277815+0000","last_active":"2024-05-20T17:55:41.254913+0000","last_peered":"2024-05-20T17:55:41.254913+0000","last_clean":"2024-05-20T17:55:41.254913+0000","last_became_active":"2024-05-20T17:55:40.277472+0000","last_became_peered":"2024-05-20T17:55:40.277472+0000","last_unstale":"2024-05-20T17:55:41.254913+0000","last_undegraded":"2024-05-20T17:55:41.254913+0000","last_fullsized":"2024-05-20T17:55:41.254913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:07.635141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966866+0000","last_change":"2024-05-20T17:55:39.269641+0000","last_active":"2024-05-20T17:55:41.966866+0000","last_peered":"2024-05-20T17:55:41.966866+0000","last_clean":"2024-05-20T17:55:41.966866+0000","last_became_active":"2024-05-20T17:55:39.269150+0000","last_became_peered":"2024-05-20T17:55:39.269150+0000","last_unstale":"2024-05-20T17:55:41.966866+0000","last_undegraded":"2024-05-20T17:55:41.966866+0000","last_fullsized":"2024-05-20T17:55:41.966866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:42.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.264805+0000","last_change":"2024-05-20T17:55:39.264805+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.264805+0000","last_undegraded":"2024-05-20T17:55:39.264805+0000","last_fullsized":"2024-05-20T17:55:39.264805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254512+0000","last_change":"2024-05-20T17:55:39.275778+0000","last_active":"2024-05-20T17:55:41.254512+0000","last_peered":"2024-05-20T17:55:41.254512+0000","last_clean":"2024-05-20T17:55:41.254512+0000","last_became_active":"2024-05-20T17:55:39.275467+0000","last_became_peered":"2024-05-20T17:55:39.275467+0000","last_unstale":"2024-05-20T17:55:41.254512+0000","last_undegraded":"2024-05-20T17:55:41.254512+0000","last_fullsized":"2024-05-20T17:55:41.254512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:55.528047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254470+0000","last_change":"2024-05-20T17:55:40.264575+0000","last_active":"2024-05-20T17:55:41.254470+0000","last_peered":"2024-05-20T17:55:41.254470+0000","last_clean":"2024-05-20T17:55:41.254470+0000","last_became_active":"2024-05-20T17:55:40.264241+0000","last_became_peered":"2024-05-20T17:55:40.264241+0000","last_unstale":"2024-05-20T17:55:41.254470+0000","last_undegraded":"2024-05-20T17:55:41.254470+0000","last_fullsized":"2024-05-20T17:55:41.254470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:06.124095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":6,"reported_epoch":49,"state":"active","last_fresh":"2024-05-20T17:55:39.277815+0000","last_change":"2024-05-20T17:55:39.277743+0000","last_active":"2024-05-20T17:55:39.277815+0000","last_peered":"2024-05-20T17:55:39.277815+0000","last_clean":"2024-05-20T17:55:38.240371+0000","last_became_active":"2024-05-20T17:55:39.277743+0000","last_became_peered":"2024-05-20T17:55:39.277743+0000","last_unstale":"2024-05-20T17:55:39.277815+0000","last_undegraded":"2024-05-20T17:55:39.277815+0000","last_fullsized":"2024-05-20T17:55:39.277815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965685+0000","last_change":"2024-05-20T17:55:40.277654+0000","last_active":"2024-05-20T17:55:41.965685+0000","last_peered":"2024-05-20T17:55:41.965685+0000","last_clean":"2024-05-20T17:55:41.965685+0000","last_became_active":"2024-05-20T17:55:40.277356+0000","last_became_peered":"2024-05-20T17:55:40.277356+0000","last_unstale":"2024-05-20T17:55:41.965685+0000","last_undegraded":"2024-05-20T17:55:41.965685+0000","last_fullsized":"2024-05-20T17:55:41.965685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257414+0000","last_change":"2024-05-20T17:55:39.265979+0000","last_active":"2024-05-20T17:55:41.257414+0000","last_peered":"2024-05-20T17:55:41.257414+0000","last_clean":"2024-05-20T17:55:41.257414+0000","last_became_active":"2024-05-20T17:55:39.265679+0000","last_became_peered":"2024-05-20T17:55:39.265679+0000","last_unstale":"2024-05-20T17:55:41.257414+0000","last_undegraded":"2024-05-20T17:55:41.257414+0000","last_fullsized":"2024-05-20T17:55:41.257414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:34.833740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257757+0000","last_change":"2024-05-20T17:55:40.277228+0000","last_active":"2024-05-20T17:55:41.257757+0000","last_peered":"2024-05-20T17:55:41.257757+0000","last_clean":"2024-05-20T17:55:41.257757+0000","last_became_active":"2024-05-20T17:55:40.276880+0000","last_became_peered":"2024-05-20T17:55:40.276880+0000","last_unstale":"2024-05-20T17:55:41.257757+0000","last_undegraded":"2024-05-20T17:55:41.257757+0000","last_fullsized":"2024-05-20T17:55:41.257757+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:39.200975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557190+0000","last_change":"2024-05-20T17:55:39.273470+0000","last_active":"2024-05-20T17:55:41.557190+0000","last_peered":"2024-05-20T17:55:41.557190+0000","last_clean":"2024-05-20T17:55:41.557190+0000","last_became_active":"2024-05-20T17:55:39.273151+0000","last_became_peered":"2024-05-20T17:55:39.273151+0000","last_unstale":"2024-05-20T17:55:41.557190+0000","last_undegraded":"2024-05-20T17:55:41.557190+0000","last_fullsized":"2024-05-20T17:55:41.557190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966012+0000","last_change":"2024-05-20T17:55:40.272795+0000","last_active":"2024-05-20T17:55:41.966012+0000","last_peered":"2024-05-20T17:55:41.966012+0000","last_clean":"2024-05-20T17:55:41.966012+0000","last_became_active":"2024-05-20T17:55:40.272473+0000","last_became_peered":"2024-05-20T17:55:40.272473+0000","last_unstale":"2024-05-20T17:55:41.966012+0000","last_undegraded":"2024-05-20T17:55:41.966012+0000","last_fullsized":"2024-05-20T17:55:41.966012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557373+0000","last_change":"2024-05-20T17:55:39.266166+0000","last_active":"2024-05-20T17:55:41.557373+0000","last_peered":"2024-05-20T17:55:41.557373+0000","last_clean":"2024-05-20T17:55:41.557373+0000","last_became_active":"2024-05-20T17:55:39.265830+0000","last_became_peered":"2024-05-20T17:55:39.265830+0000","last_unstale":"2024-05-20T17:55:41.557373+0000","last_undegraded":"2024-05-20T17:55:41.557373+0000","last_fullsized":"2024-05-20T17:55:41.557373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:35:39.407657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966454+0000","last_change":"2024-05-20T17:55:40.264272+0000","last_active":"2024-05-20T17:55:41.966454+0000","last_peered":"2024-05-20T17:55:41.966454+0000","last_clean":"2024-05-20T17:55:41.966454+0000","last_became_active":"2024-05-20T17:55:40.263229+0000","last_became_peered":"2024-05-20T17:55:40.263229+0000","last_unstale":"2024-05-20T17:55:41.966454+0000","last_undegraded":"2024-05-20T17:55:41.966454+0000","last_fullsized":"2024-05-20T17:55:41.966454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966167+0000","last_change":"2024-05-20T17:55:39.265914+0000","last_active":"2024-05-20T17:55:41.966167+0000","last_peered":"2024-05-20T17:55:41.966167+0000","last_clean":"2024-05-20T17:55:41.966167+0000","last_became_active":"2024-05-20T17:55:39.265583+0000","last_became_peered":"2024-05-20T17:55:39.265583+0000","last_unstale":"2024-05-20T17:55:41.966167+0000","last_undegraded":"2024-05-20T17:55:41.966167+0000","last_fullsized":"2024-05-20T17:55:41.966167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557422+0000","last_change":"2024-05-20T17:55:40.270988+0000","last_active":"2024-05-20T17:55:41.557422+0000","last_peered":"2024-05-20T17:55:41.557422+0000","last_clean":"2024-05-20T17:55:41.557422+0000","last_became_active":"2024-05-20T17:55:40.270582+0000","last_became_peered":"2024-05-20T17:55:40.270582+0000","last_unstale":"2024-05-20T17:55:41.557422+0000","last_undegraded":"2024-05-20T17:55:41.557422+0000","last_fullsized":"2024-05-20T17:55:41.557422+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254285+0000","last_change":"2024-05-20T17:55:39.272103+0000","last_active":"2024-05-20T17:55:41.254285+0000","last_peered":"2024-05-20T17:55:41.254285+0000","last_clean":"2024-05-20T17:55:41.254285+0000","last_became_active":"2024-05-20T17:55:39.271787+0000","last_became_peered":"2024-05-20T17:55:39.271787+0000","last_unstale":"2024-05-20T17:55:41.254285+0000","last_undegraded":"2024-05-20T17:55:41.254285+0000","last_fullsized":"2024-05-20T17:55:41.254285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:41.864783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.258373+0000","last_change":"2024-05-20T17:55:39.258373+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.258373+0000","last_undegraded":"2024-05-20T17:55:39.258373+0000","last_fullsized":"2024-05-20T17:55:39.258373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.263524+0000","last_change":"2024-05-20T17:55:39.262518+0000","last_active":"2024-05-20T17:55:39.263524+0000","last_peered":"2024-05-20T17:55:39.263524+0000","last_clean":"2024-05-20T17:55:39.263524+0000","last_became_active":"2024-05-20T17:55:39.262191+0000","last_became_peered":"2024-05-20T17:55:39.262191+0000","last_unstale":"2024-05-20T17:55:39.263524+0000","last_undegraded":"2024-05-20T17:55:39.263524+0000","last_fullsized":"2024-05-20T17:55:39.263524+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965915+0000","last_change":"2024-05-20T17:55:40.275681+0000","last_active":"2024-05-20T17:55:41.965915+0000","last_peered":"2024-05-20T17:55:41.965915+0000","last_clean":"2024-05-20T17:55:41.965915+0000","last_became_active":"2024-05-20T17:55:40.275360+0000","last_became_peered":"2024-05-20T17:55:40.275360+0000","last_unstale":"2024-05-20T17:55:41.965915+0000","last_undegraded":"2024-05-20T17:55:41.965915+0000","last_fullsized":"2024-05-20T17:55:41.965915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.256993+0000","last_change":"2024-05-20T17:55:39.269421+0000","last_active":"2024-05-20T17:55:41.256993+0000","last_peered":"2024-05-20T17:55:41.256993+0000","last_clean":"2024-05-20T17:55:41.256993+0000","last_became_active":"2024-05-20T17:55:39.269101+0000","last_became_peered":"2024-05-20T17:55:39.269101+0000","last_unstale":"2024-05-20T17:55:41.256993+0000","last_undegraded":"2024-05-20T17:55:41.256993+0000","last_fullsized":"2024-05-20T17:55:41.256993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:11.791684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966253+0000","last_change":"2024-05-20T17:55:40.267783+0000","last_active":"2024-05-20T17:55:41.966253+0000","last_peered":"2024-05-20T17:55:41.966253+0000","last_clean":"2024-05-20T17:55:41.966253+0000","last_became_active":"2024-05-20T17:55:40.267415+0000","last_became_peered":"2024-05-20T17:55:40.267415+0000","last_unstale":"2024-05-20T17:55:41.966253+0000","last_undegraded":"2024-05-20T17:55:41.966253+0000","last_fullsized":"2024-05-20T17:55:41.966253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557363+0000","last_change":"2024-05-20T17:55:39.280002+0000","last_active":"2024-05-20T17:55:41.557363+0000","last_peered":"2024-05-20T17:55:41.557363+0000","last_clean":"2024-05-20T17:55:41.557363+0000","last_became_active":"2024-05-20T17:55:39.279754+0000","last_became_peered":"2024-05-20T17:55:39.279754+0000","last_unstale":"2024-05-20T17:55:41.557363+0000","last_undegraded":"2024-05-20T17:55:41.557363+0000","last_fullsized":"2024-05-20T17:55:41.557363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:11:28.961264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965866+0000","last_change":"2024-05-20T17:55:40.268902+0000","last_active":"2024-05-20T17:55:41.965866+0000","last_peered":"2024-05-20T17:55:41.965866+0000","last_clean":"2024-05-20T17:55:41.965866+0000","last_became_active":"2024-05-20T17:55:40.268587+0000","last_became_peered":"2024-05-20T17:55:40.268587+0000","last_unstale":"2024-05-20T17:55:41.965866+0000","last_undegraded":"2024-05-20T17:55:41.965866+0000","last_fullsized":"2024-05-20T17:55:41.965866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966557+0000","last_change":"2024-05-20T17:55:39.274048+0000","last_active":"2024-05-20T17:55:41.966557+0000","last_peered":"2024-05-20T17:55:41.966557+0000","last_clean":"2024-05-20T17:55:41.966557+0000","last_became_active":"2024-05-20T17:55:39.273738+0000","last_became_peered":"2024-05-20T17:55:39.273738+0000","last_unstale":"2024-05-20T17:55:41.966557+0000","last_undegraded":"2024-05-20T17:55:41.966557+0000","last_fullsized":"2024-05-20T17:55:41.966557+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:07.062814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254624+0000","last_change":"2024-05-20T17:55:40.265532+0000","last_active":"2024-05-20T17:55:41.254624+0000","last_peered":"2024-05-20T17:55:41.254624+0000","last_clean":"2024-05-20T17:55:41.254624+0000","last_became_active":"2024-05-20T17:55:40.265164+0000","last_became_peered":"2024-05-20T17:55:40.265164+0000","last_unstale":"2024-05-20T17:55:41.254624+0000","last_undegraded":"2024-05-20T17:55:41.254624+0000","last_fullsized":"2024-05-20T17:55:41.254624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:15:38.124970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.262718+0000","last_change":"2024-05-20T17:55:39.260761+0000","last_active":"2024-05-20T17:55:39.262718+0000","last_peered":"2024-05-20T17:55:39.262718+0000","last_clean":"2024-05-20T17:55:39.262718+0000","last_became_active":"2024-05-20T17:55:39.260432+0000","last_became_peered":"2024-05-20T17:55:39.260432+0000","last_unstale":"2024-05-20T17:55:39.262718+0000","last_undegraded":"2024-05-20T17:55:39.262718+0000","last_fullsized":"2024-05-20T17:55:39.262718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:08:37.860132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.259020+0000","last_change":"2024-05-20T17:55:39.259020+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.259020+0000","last_undegraded":"2024-05-20T17:55:39.259020+0000","last_fullsized":"2024-05-20T17:55:39.259020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254740+0000","last_change":"2024-05-20T17:55:39.272924+0000","last_active":"2024-05-20T17:55:41.254740+0000","last_peered":"2024-05-20T17:55:41.254740+0000","last_clean":"2024-05-20T17:55:41.254740+0000","last_became_active":"2024-05-20T17:55:39.272604+0000","last_became_peered":"2024-05-20T17:55:39.272604+0000","last_unstale":"2024-05-20T17:55:41.254740+0000","last_undegraded":"2024-05-20T17:55:41.254740+0000","last_fullsized":"2024-05-20T17:55:41.254740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.121415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966476+0000","last_change":"2024-05-20T17:55:40.270269+0000","last_active":"2024-05-20T17:55:41.966476+0000","last_peered":"2024-05-20T17:55:41.966476+0000","last_clean":"2024-05-20T17:55:41.966476+0000","last_became_active":"2024-05-20T17:55:40.269480+0000","last_became_peered":"2024-05-20T17:55:40.269480+0000","last_unstale":"2024-05-20T17:55:41.966476+0000","last_undegraded":"2024-05-20T17:55:41.966476+0000","last_fullsized":"2024-05-20T17:55:41.966476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254494+0000","last_change":"2024-05-20T17:55:39.270561+0000","last_active":"2024-05-20T17:55:41.254494+0000","last_peered":"2024-05-20T17:55:41.254494+0000","last_clean":"2024-05-20T17:55:41.254494+0000","last_became_active":"2024-05-20T17:55:39.270216+0000","last_became_peered":"2024-05-20T17:55:39.270216+0000","last_unstale":"2024-05-20T17:55:41.254494+0000","last_undegraded":"2024-05-20T17:55:41.254494+0000","last_fullsized":"2024-05-20T17:55:41.254494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:14.931204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.259825+0000","last_change":"2024-05-20T17:55:39.259825+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.259825+0000","last_undegraded":"2024-05-20T17:55:39.259825+0000","last_fullsized":"2024-05-20T17:55:39.259825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257596+0000","last_change":"2024-05-20T17:55:39.266935+0000","last_active":"2024-05-20T17:55:41.257596+0000","last_peered":"2024-05-20T17:55:41.257596+0000","last_clean":"2024-05-20T17:55:41.257596+0000","last_became_active":"2024-05-20T17:55:39.264958+0000","last_became_peered":"2024-05-20T17:55:39.264958+0000","last_unstale":"2024-05-20T17:55:41.257596+0000","last_undegraded":"2024-05-20T17:55:41.257596+0000","last_fullsized":"2024-05-20T17:55:41.257596+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254927+0000","last_change":"2024-05-20T17:55:40.266843+0000","last_active":"2024-05-20T17:55:41.254927+0000","last_peered":"2024-05-20T17:55:41.254927+0000","last_clean":"2024-05-20T17:55:41.254927+0000","last_became_active":"2024-05-20T17:55:40.266052+0000","last_became_peered":"2024-05-20T17:55:40.266052+0000","last_unstale":"2024-05-20T17:55:41.254927+0000","last_undegraded":"2024-05-20T17:55:41.254927+0000","last_fullsized":"2024-05-20T17:55:41.254927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:04.314309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966202+0000","last_change":"2024-05-20T17:55:39.270669+0000","last_active":"2024-05-20T17:55:41.966202+0000","last_peered":"2024-05-20T17:55:41.966202+0000","last_clean":"2024-05-20T17:55:41.966202+0000","last_became_active":"2024-05-20T17:55:39.270233+0000","last_became_peered":"2024-05-20T17:55:39.270233+0000","last_unstale":"2024-05-20T17:55:41.966202+0000","last_undegraded":"2024-05-20T17:55:41.966202+0000","last_fullsized":"2024-05-20T17:55:41.966202+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557129+0000","last_change":"2024-05-20T17:55:40.264890+0000","last_active":"2024-05-20T17:55:41.557129+0000","last_peered":"2024-05-20T17:55:41.557129+0000","last_clean":"2024-05-20T17:55:41.557129+0000","last_became_active":"2024-05-20T17:55:40.264196+0000","last_became_peered":"2024-05-20T17:55:40.264196+0000","last_unstale":"2024-05-20T17:55:41.557129+0000","last_undegraded":"2024-05-20T17:55:41.557129+0000","last_fullsized":"2024-05-20T17:55:41.557129+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.274803+0000","last_change":"2024-05-20T17:55:39.269301+0000","last_active":"2024-05-20T17:55:39.274803+0000","last_peered":"2024-05-20T17:55:39.274803+0000","last_clean":"2024-05-20T17:55:39.274803+0000","last_became_active":"2024-05-20T17:55:39.268957+0000","last_became_peered":"2024-05-20T17:55:39.268957+0000","last_unstale":"2024-05-20T17:55:39.274803+0000","last_undegraded":"2024-05-20T17:55:39.274803+0000","last_fullsized":"2024-05-20T17:55:39.274803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965845+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:55:41.965845+0000","last_peered":"2024-05-20T17:55:41.965845+0000","last_clean":"2024-05-20T17:55:41.965845+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:55:41.965845+0000","last_undegraded":"2024-05-20T17:55:41.965845+0000","last_fullsized":"2024-05-20T17:55:41.965845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":126,"acting":126,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":861144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":271304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":270652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":271234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":272264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":270812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1163264,"data_stored":840494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:55:44.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:55:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.879+0000 7f2c1a806640 1 Processor -- start 2024-05-20T17:55:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.880+0000 7f2c1a806640 1 -- start start 2024-05-20T17:55:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c1a806640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406d3d0 0x7f2c1406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c1a806640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1406dd20 con 0x7f2c14162820 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c1a806640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c140d0630 con 0x7f2c140b8190 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c1a806640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140d39c0 con 0x7f2c1406d3d0 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c13fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2c14162820 0x7f2c140b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43974/0 (socket says 172.21.15.6:43974) 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c13fff640 1 -- 172.21.15.6:0/3297503383 learned_addr learned my addr 172.21.15.6:0/3297503383 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c0bfff640 1 --2- 172.21.15.6:0/3297503383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406d3d0 0x7f2c1406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c137fe640 1 -- 172.21.15.6:0/3297503383 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463901429 0 0) 0x7f2c04001110 con 0x7f2c14162820 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c137fe640 1 -- 172.21.15.6:0/3297503383 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c00003520 con 0x7f2c14162820 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.881+0000 7f2c137fe640 1 -- 172.21.15.6:0/3297503383 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052246502 0 0) 0x7f2c140d0630 con 0x7f2c140b8190 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.882+0000 7f2c137fe640 1 -- 172.21.15.6:0/3297503383 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c04001110 con 0x7f2c140b8190 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.882+0000 7f2c0bfff640 1 -- 172.21.15.6:0/3297503383 >> v1:172.21.15.171:6789/0 conn(0x7f2c140b8190 legacy=0x7f2c140b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.882+0000 7f2c0bfff640 1 -- 172.21.15.6:0/3297503383 >> v1:172.21.15.6:6789/0 conn(0x7f2c14162820 legacy=0x7f2c140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.882+0000 7f2c0bfff640 1 -- 172.21.15.6:0/3297503383 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c140d3ca0 con 0x7f2c1406d3d0 2024-05-20T17:55:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.882+0000 7f2c0bfff640 1 --2- 172.21.15.6:0/3297503383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406d3d0 0x7f2c1406d7e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0097d0 tx=0x7f2bfc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f41365697a84197e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c137fe640 1 -- 172.21.15.6:0/3297503383 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc037070 con 0x7f2c1406d3d0 2024-05-20T17:55:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c137fe640 1 -- 172.21.15.6:0/3297503383 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc032440 con 0x7f2c1406d3d0 2024-05-20T17:55:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c137fe640 1 -- 172.21.15.6:0/3297503383 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0327f0 con 0x7f2c1406d3d0 2024-05-20T17:55:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c1a806640 1 -- 172.21.15.6:0/3297503383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406d3d0 msgr2=0x7f2c1406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c1a806640 1 --2- 172.21.15.6:0/3297503383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406d3d0 0x7f2c1406d7e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0097d0 tx=0x7f2bfc02a210 comp rx=0 tx=0).stop 2024-05-20T17:55:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c1a806640 1 -- 172.21.15.6:0/3297503383 shutdown_connections 2024-05-20T17:55:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c1a806640 1 --2- 172.21.15.6:0/3297503383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c1406d3d0 0x7f2c1406d7e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c1a806640 1 -- 172.21.15.6:0/3297503383 >> 172.21.15.6:0/3297503383 conn(0x7f2c140d4bd0 msgr2=0x7f2c140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c1a806640 1 -- 172.21.15.6:0/3297503383 shutdown_connections 2024-05-20T17:55:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.883+0000 7f2c1a806640 1 -- 172.21.15.6:0/3297503383 wait complete. 2024-05-20T17:55:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.885+0000 7f2c1a806640 1 Processor -- start 2024-05-20T17:55:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.885+0000 7f2c1a806640 1 -- start start 2024-05-20T17:55:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c1a806640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c1406d3d0 0x7f2c1415bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c1a806640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c140b8190 0x7f2c140abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c1a806640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c14162820 0x7f2c140b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c1a806640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140d0300 con 0x7f2c140b8190 2024-05-20T17:55:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c1a806640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140d4260 con 0x7f2c1406d3d0 2024-05-20T17:55:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c1a806640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140b4050 con 0x7f2c14162820 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c140b8190 0x7f2c140abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c140b8190 0x7f2c140abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56894/0 (socket says 172.21.15.6:56894) 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 -- 172.21.15.6:0/1754166049 learned_addr learned my addr 172.21.15.6:0/1754166049 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c13fff640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c1406d3d0 0x7f2c1415bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c18da3640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c14162820 0x7f2c140b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 -- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c14162820 msgr2=0x7f2c140b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c14162820 0x7f2c140b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 -- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c1406d3d0 msgr2=0x7f2c1415bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c1406d3d0 0x7f2c1415bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 -- 172.21.15.6:0/1754166049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c140ce530 con 0x7f2c140b8190 2024-05-20T17:55:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.887+0000 7f2c0bfff640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c140b8190 0x7f2c140abf20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc02a250 tx=0x7f2bfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.888+0000 7f2c117fa640 1 -- 172.21.15.6:0/1754166049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc041020 con 0x7f2c140b8190 2024-05-20T17:55:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.888+0000 7f2c117fa640 1 -- 172.21.15.6:0/1754166049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc03d6e0 con 0x7f2c140b8190 2024-05-20T17:55:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.888+0000 7f2c117fa640 1 -- 172.21.15.6:0/1754166049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc037040 con 0x7f2c140b8190 2024-05-20T17:55:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.888+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c140ce810 con 0x7f2c140b8190 2024-05-20T17:55:44.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.888+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c140cedd0 con 0x7f2c140b8190 2024-05-20T17:55:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.889+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c14075b00 con 0x7f2c140b8190 2024-05-20T17:55:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.889+0000 7f2c117fa640 1 -- 172.21.15.6:0/1754166049 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bfc044020 con 0x7f2c140b8190 2024-05-20T17:55:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.890+0000 7f2c117fa640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.890+0000 7f2c117fa640 1 -- 172.21.15.6:0/1754166049 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f2bfc0ab8e0 con 0x7f2c140b8190 2024-05-20T17:55:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.890+0000 7f2c13fff640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.891+0000 7f2c13fff640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2c04000f60 tx=0x7f2c04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:44.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:44.894+0000 7f2c117fa640 1 -- 172.21.15.6:0/1754166049 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2bfc04b030 con 0x7f2c140b8190 2024-05-20T17:55:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.077+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c140ce070 con 0x7f2bf406be30 2024-05-20T17:55:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.083+0000 7f2c117fa640 1 -- 172.21.15.6:0/1754166049 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250649 (secure 0 0 0) 0x7f2c04001500 con 0x7f2bf406be30 2024-05-20T17:55:45.085 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:55:45.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 msgr2=0x7f2bf406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2c04000f60 tx=0x7f2c04009040 comp rx=0 tx=0).stop 2024-05-20T17:55:45.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c140b8190 msgr2=0x7f2c140abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c140b8190 0x7f2c140abf20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc02a250 tx=0x7f2bfc0046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 shutdown_connections 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bf406be30 0x7f2bf406e340 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2c14162820 0x7f2c140b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c140b8190 0x7f2c140abf20 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 --2- 172.21.15.6:0/1754166049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c1406d3d0 0x7f2c1415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 >> 172.21.15.6:0/1754166049 conn(0x7f2c140d4bd0 msgr2=0x7f2c140ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 shutdown_connections 2024-05-20T17:55:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.086+0000 7f2c1a806640 1 -- 172.21.15.6:0/1754166049 wait complete. 2024-05-20T17:55:45.097 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-20T17:55:44.271301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":192,"acting":192,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226264,"kb_used_data":5916,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748456,"statfs":{"total":773094113280,"available":772862418944,"internally_reserved":0,"allocated":6057984,"data_stored":3330190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966036+0000","last_change":"2024-05-20T17:55:40.270773+0000","last_active":"2024-05-20T17:55:41.966036+0000","last_peered":"2024-05-20T17:55:41.966036+0000","last_clean":"2024-05-20T17:55:41.966036+0000","last_became_active":"2024-05-20T17:55:40.270461+0000","last_became_peered":"2024-05-20T17:55:40.270461+0000","last_unstale":"2024-05-20T17:55:41.966036+0000","last_undegraded":"2024-05-20T17:55:41.966036+0000","last_fullsized":"2024-05-20T17:55:41.966036+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:53.123523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966594+0000","last_change":"2024-05-20T17:55:40.281497+0000","last_active":"2024-05-20T17:55:41.966594+0000","last_peered":"2024-05-20T17:55:41.966594+0000","last_clean":"2024-05-20T17:55:41.966594+0000","last_became_active":"2024-05-20T17:55:40.281191+0000","last_became_peered":"2024-05-20T17:55:40.281191+0000","last_unstale":"2024-05-20T17:55:41.966594+0000","last_undegraded":"2024-05-20T17:55:41.966594+0000","last_fullsized":"2024-05-20T17:55:41.966594+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.274706+0000","last_change":"2024-05-20T17:55:39.274706+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.274706+0000","last_undegraded":"2024-05-20T17:55:39.274706+0000","last_fullsized":"2024-05-20T17:55:39.274706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966155+0000","last_change":"2024-05-20T17:55:40.289561+0000","last_active":"2024-05-20T17:55:41.966155+0000","last_peered":"2024-05-20T17:55:41.966155+0000","last_clean":"2024-05-20T17:55:41.966155+0000","last_became_active":"2024-05-20T17:55:40.289232+0000","last_became_peered":"2024-05-20T17:55:40.289232+0000","last_unstale":"2024-05-20T17:55:41.966155+0000","last_undegraded":"2024-05-20T17:55:41.966155+0000","last_fullsized":"2024-05-20T17:55:41.966155+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257998+0000","last_change":"2024-05-20T17:55:40.268614+0000","last_active":"2024-05-20T17:55:41.257998+0000","last_peered":"2024-05-20T17:55:41.257998+0000","last_clean":"2024-05-20T17:55:41.257998+0000","last_became_active":"2024-05-20T17:55:40.268295+0000","last_became_peered":"2024-05-20T17:55:40.268295+0000","last_unstale":"2024-05-20T17:55:41.257998+0000","last_undegraded":"2024-05-20T17:55:41.257998+0000","last_fullsized":"2024-05-20T17:55:41.257998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:43.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965810+0000","last_change":"2024-05-20T17:55:40.278388+0000","last_active":"2024-05-20T17:55:41.965810+0000","last_peered":"2024-05-20T17:55:41.965810+0000","last_clean":"2024-05-20T17:55:41.965810+0000","last_became_active":"2024-05-20T17:55:40.278061+0000","last_became_peered":"2024-05-20T17:55:40.278061+0000","last_unstale":"2024-05-20T17:55:41.965810+0000","last_undegraded":"2024-05-20T17:55:41.965810+0000","last_fullsized":"2024-05-20T17:55:41.965810+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.270276+0000","last_change":"2024-05-20T17:55:39.270276+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.270276+0000","last_undegraded":"2024-05-20T17:55:39.270276+0000","last_fullsized":"2024-05-20T17:55:39.270276+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254404+0000","last_change":"2024-05-20T17:55:40.282267+0000","last_active":"2024-05-20T17:55:41.254404+0000","last_peered":"2024-05-20T17:55:41.254404+0000","last_clean":"2024-05-20T17:55:41.254404+0000","last_became_active":"2024-05-20T17:55:40.281957+0000","last_became_peered":"2024-05-20T17:55:40.281957+0000","last_unstale":"2024-05-20T17:55:41.254404+0000","last_undegraded":"2024-05-20T17:55:41.254404+0000","last_fullsized":"2024-05-20T17:55:41.254404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:36.957704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254821+0000","last_change":"2024-05-20T17:55:40.277468+0000","last_active":"2024-05-20T17:55:41.254821+0000","last_peered":"2024-05-20T17:55:41.254821+0000","last_clean":"2024-05-20T17:55:41.254821+0000","last_became_active":"2024-05-20T17:55:40.276903+0000","last_became_peered":"2024-05-20T17:55:40.276903+0000","last_unstale":"2024-05-20T17:55:41.254821+0000","last_undegraded":"2024-05-20T17:55:41.254821+0000","last_fullsized":"2024-05-20T17:55:41.254821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:02.671800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965875+0000","last_change":"2024-05-20T17:55:40.282130+0000","last_active":"2024-05-20T17:55:41.965875+0000","last_peered":"2024-05-20T17:55:41.965875+0000","last_clean":"2024-05-20T17:55:41.965875+0000","last_became_active":"2024-05-20T17:55:40.281789+0000","last_became_peered":"2024-05-20T17:55:40.281789+0000","last_unstale":"2024-05-20T17:55:41.965875+0000","last_undegraded":"2024-05-20T17:55:41.965875+0000","last_fullsized":"2024-05-20T17:55:41.965875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257338+0000","last_change":"2024-05-20T17:55:40.276661+0000","last_active":"2024-05-20T17:55:41.257338+0000","last_peered":"2024-05-20T17:55:41.257338+0000","last_clean":"2024-05-20T17:55:41.257338+0000","last_became_active":"2024-05-20T17:55:40.276358+0000","last_became_peered":"2024-05-20T17:55:40.276358+0000","last_unstale":"2024-05-20T17:55:41.257338+0000","last_undegraded":"2024-05-20T17:55:41.257338+0000","last_fullsized":"2024-05-20T17:55:41.257338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:33.789874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254780+0000","last_change":"2024-05-20T17:55:40.272120+0000","last_active":"2024-05-20T17:55:41.254780+0000","last_peered":"2024-05-20T17:55:41.254780+0000","last_clean":"2024-05-20T17:55:41.254780+0000","last_became_active":"2024-05-20T17:55:40.271802+0000","last_became_peered":"2024-05-20T17:55:40.271802+0000","last_unstale":"2024-05-20T17:55:41.254780+0000","last_undegraded":"2024-05-20T17:55:41.254780+0000","last_fullsized":"2024-05-20T17:55:41.254780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:00.485107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966039+0000","last_change":"2024-05-20T17:55:40.280972+0000","last_active":"2024-05-20T17:55:41.966039+0000","last_peered":"2024-05-20T17:55:41.966039+0000","last_clean":"2024-05-20T17:55:41.966039+0000","last_became_active":"2024-05-20T17:55:40.280674+0000","last_became_peered":"2024-05-20T17:55:40.280674+0000","last_unstale":"2024-05-20T17:55:41.966039+0000","last_undegraded":"2024-05-20T17:55:41.966039+0000","last_fullsized":"2024-05-20T17:55:41.966039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.272813+0000","last_change":"2024-05-20T17:55:39.272813+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.272813+0000","last_undegraded":"2024-05-20T17:55:39.272813+0000","last_fullsized":"2024-05-20T17:55:39.272813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966878+0000","last_change":"2024-05-20T17:55:40.278390+0000","last_active":"2024-05-20T17:55:41.966878+0000","last_peered":"2024-05-20T17:55:41.966878+0000","last_clean":"2024-05-20T17:55:41.966878+0000","last_became_active":"2024-05-20T17:55:40.278036+0000","last_became_peered":"2024-05-20T17:55:40.278036+0000","last_unstale":"2024-05-20T17:55:41.966878+0000","last_undegraded":"2024-05-20T17:55:41.966878+0000","last_fullsized":"2024-05-20T17:55:41.966878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:32.756855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965699+0000","last_change":"2024-05-20T17:55:40.271972+0000","last_active":"2024-05-20T17:55:41.965699+0000","last_peered":"2024-05-20T17:55:41.965699+0000","last_clean":"2024-05-20T17:55:41.965699+0000","last_became_active":"2024-05-20T17:55:40.271620+0000","last_became_peered":"2024-05-20T17:55:40.271620+0000","last_unstale":"2024-05-20T17:55:41.965699+0000","last_undegraded":"2024-05-20T17:55:41.965699+0000","last_fullsized":"2024-05-20T17:55:41.965699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.276707+0000","last_change":"2024-05-20T17:55:39.276707+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.276707+0000","last_undegraded":"2024-05-20T17:55:39.276707+0000","last_fullsized":"2024-05-20T17:55:39.276707+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966717+0000","last_change":"2024-05-20T17:55:40.282461+0000","last_active":"2024-05-20T17:55:41.966717+0000","last_peered":"2024-05-20T17:55:41.966717+0000","last_clean":"2024-05-20T17:55:41.966717+0000","last_became_active":"2024-05-20T17:55:40.282146+0000","last_became_peered":"2024-05-20T17:55:40.282146+0000","last_unstale":"2024-05-20T17:55:41.966717+0000","last_undegraded":"2024-05-20T17:55:41.966717+0000","last_fullsized":"2024-05-20T17:55:41.966717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:59:35.697636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.273100+0000","last_change":"2024-05-20T17:55:39.273100+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.273100+0000","last_undegraded":"2024-05-20T17:55:39.273100+0000","last_fullsized":"2024-05-20T17:55:39.273100+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557223+0000","last_change":"2024-05-20T17:55:40.266526+0000","last_active":"2024-05-20T17:55:41.557223+0000","last_peered":"2024-05-20T17:55:41.557223+0000","last_clean":"2024-05-20T17:55:41.557223+0000","last_became_active":"2024-05-20T17:55:40.265920+0000","last_became_peered":"2024-05-20T17:55:40.265920+0000","last_unstale":"2024-05-20T17:55:41.557223+0000","last_undegraded":"2024-05-20T17:55:41.557223+0000","last_fullsized":"2024-05-20T17:55:41.557223+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557207+0000","last_change":"2024-05-20T17:55:40.271285+0000","last_active":"2024-05-20T17:55:41.557207+0000","last_peered":"2024-05-20T17:55:41.557207+0000","last_clean":"2024-05-20T17:55:41.557207+0000","last_became_active":"2024-05-20T17:55:40.270660+0000","last_became_peered":"2024-05-20T17:55:40.270660+0000","last_unstale":"2024-05-20T17:55:41.557207+0000","last_undegraded":"2024-05-20T17:55:41.557207+0000","last_fullsized":"2024-05-20T17:55:41.557207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254365+0000","last_change":"2024-05-20T17:55:40.282955+0000","last_active":"2024-05-20T17:55:41.254365+0000","last_peered":"2024-05-20T17:55:41.254365+0000","last_clean":"2024-05-20T17:55:41.254365+0000","last_became_active":"2024-05-20T17:55:40.282609+0000","last_became_peered":"2024-05-20T17:55:40.282609+0000","last_unstale":"2024-05-20T17:55:41.254365+0000","last_undegraded":"2024-05-20T17:55:41.254365+0000","last_fullsized":"2024-05-20T17:55:41.254365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:15.702355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257167+0000","last_change":"2024-05-20T17:55:40.277466+0000","last_active":"2024-05-20T17:55:41.257167+0000","last_peered":"2024-05-20T17:55:41.257167+0000","last_clean":"2024-05-20T17:55:41.257167+0000","last_became_active":"2024-05-20T17:55:40.277117+0000","last_became_peered":"2024-05-20T17:55:40.277117+0000","last_unstale":"2024-05-20T17:55:41.257167+0000","last_undegraded":"2024-05-20T17:55:41.257167+0000","last_fullsized":"2024-05-20T17:55:41.257167+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:35:09.265029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T17:55:39.242479+0000","last_change":"2024-05-20T17:55:39.242479+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.242479+0000","last_undegraded":"2024-05-20T17:55:39.242479+0000","last_fullsized":"2024-05-20T17:55:39.242479+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.267813+0000","last_change":"2024-05-20T17:55:39.267813+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.267813+0000","last_undegraded":"2024-05-20T17:55:39.267813+0000","last_fullsized":"2024-05-20T17:55:39.267813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254723+0000","last_change":"2024-05-20T17:55:40.270685+0000","last_active":"2024-05-20T17:55:41.254723+0000","last_peered":"2024-05-20T17:55:41.254723+0000","last_clean":"2024-05-20T17:55:41.254723+0000","last_became_active":"2024-05-20T17:55:40.270370+0000","last_became_peered":"2024-05-20T17:55:40.270370+0000","last_unstale":"2024-05-20T17:55:41.254723+0000","last_undegraded":"2024-05-20T17:55:41.254723+0000","last_fullsized":"2024-05-20T17:55:41.254723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:07.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966227+0000","last_change":"2024-05-20T17:55:40.276848+0000","last_active":"2024-05-20T17:55:41.966227+0000","last_peered":"2024-05-20T17:55:41.966227+0000","last_clean":"2024-05-20T17:55:41.966227+0000","last_became_active":"2024-05-20T17:55:40.276542+0000","last_became_peered":"2024-05-20T17:55:40.276542+0000","last_unstale":"2024-05-20T17:55:41.966227+0000","last_undegraded":"2024-05-20T17:55:41.966227+0000","last_fullsized":"2024-05-20T17:55:41.966227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557367+0000","last_change":"2024-05-20T17:55:40.267011+0000","last_active":"2024-05-20T17:55:41.557367+0000","last_peered":"2024-05-20T17:55:41.557367+0000","last_clean":"2024-05-20T17:55:41.557367+0000","last_became_active":"2024-05-20T17:55:40.266683+0000","last_became_peered":"2024-05-20T17:55:40.266683+0000","last_unstale":"2024-05-20T17:55:41.557367+0000","last_undegraded":"2024-05-20T17:55:41.557367+0000","last_fullsized":"2024-05-20T17:55:41.557367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.265869+0000","last_change":"2024-05-20T17:55:39.265869+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.265869+0000","last_undegraded":"2024-05-20T17:55:39.265869+0000","last_fullsized":"2024-05-20T17:55:39.265869+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966369+0000","last_change":"2024-05-20T17:55:40.282635+0000","last_active":"2024-05-20T17:55:41.966369+0000","last_peered":"2024-05-20T17:55:41.966369+0000","last_clean":"2024-05-20T17:55:41.966369+0000","last_became_active":"2024-05-20T17:55:40.281020+0000","last_became_peered":"2024-05-20T17:55:40.281020+0000","last_unstale":"2024-05-20T17:55:41.966369+0000","last_undegraded":"2024-05-20T17:55:41.966369+0000","last_fullsized":"2024-05-20T17:55:41.966369+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.265335+0000","last_change":"2024-05-20T17:55:39.265335+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.265335+0000","last_undegraded":"2024-05-20T17:55:39.265335+0000","last_fullsized":"2024-05-20T17:55:39.265335+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966105+0000","last_change":"2024-05-20T17:55:40.271887+0000","last_active":"2024-05-20T17:55:41.966105+0000","last_peered":"2024-05-20T17:55:41.966105+0000","last_clean":"2024-05-20T17:55:41.966105+0000","last_became_active":"2024-05-20T17:55:40.270696+0000","last_became_peered":"2024-05-20T17:55:40.270696+0000","last_unstale":"2024-05-20T17:55:41.966105+0000","last_undegraded":"2024-05-20T17:55:41.966105+0000","last_fullsized":"2024-05-20T17:55:41.966105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965868+0000","last_change":"2024-05-20T17:55:40.275752+0000","last_active":"2024-05-20T17:55:41.965868+0000","last_peered":"2024-05-20T17:55:41.965868+0000","last_clean":"2024-05-20T17:55:41.965868+0000","last_became_active":"2024-05-20T17:55:40.275317+0000","last_became_peered":"2024-05-20T17:55:40.275317+0000","last_unstale":"2024-05-20T17:55:41.965868+0000","last_undegraded":"2024-05-20T17:55:41.965868+0000","last_fullsized":"2024-05-20T17:55:41.965868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557249+0000","last_change":"2024-05-20T17:55:39.270058+0000","last_active":"2024-05-20T17:55:41.557249+0000","last_peered":"2024-05-20T17:55:41.557249+0000","last_clean":"2024-05-20T17:55:41.557249+0000","last_became_active":"2024-05-20T17:55:39.269730+0000","last_became_peered":"2024-05-20T17:55:39.269730+0000","last_unstale":"2024-05-20T17:55:41.557249+0000","last_undegraded":"2024-05-20T17:55:41.557249+0000","last_fullsized":"2024-05-20T17:55:41.557249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966028+0000","last_change":"2024-05-20T17:55:40.274646+0000","last_active":"2024-05-20T17:55:41.966028+0000","last_peered":"2024-05-20T17:55:41.966028+0000","last_clean":"2024-05-20T17:55:41.966028+0000","last_became_active":"2024-05-20T17:55:40.274299+0000","last_became_peered":"2024-05-20T17:55:40.274299+0000","last_unstale":"2024-05-20T17:55:41.966028+0000","last_undegraded":"2024-05-20T17:55:41.966028+0000","last_fullsized":"2024-05-20T17:55:41.966028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965800+0000","last_change":"2024-05-20T17:55:39.271593+0000","last_active":"2024-05-20T17:55:41.965800+0000","last_peered":"2024-05-20T17:55:41.965800+0000","last_clean":"2024-05-20T17:55:41.965800+0000","last_became_active":"2024-05-20T17:55:39.271252+0000","last_became_peered":"2024-05-20T17:55:39.271252+0000","last_unstale":"2024-05-20T17:55:41.965800+0000","last_undegraded":"2024-05-20T17:55:41.965800+0000","last_fullsized":"2024-05-20T17:55:41.965800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557093+0000","last_change":"2024-05-20T17:55:40.268788+0000","last_active":"2024-05-20T17:55:41.557093+0000","last_peered":"2024-05-20T17:55:41.557093+0000","last_clean":"2024-05-20T17:55:41.557093+0000","last_became_active":"2024-05-20T17:55:40.268438+0000","last_became_peered":"2024-05-20T17:55:40.268438+0000","last_unstale":"2024-05-20T17:55:41.557093+0000","last_undegraded":"2024-05-20T17:55:41.557093+0000","last_fullsized":"2024-05-20T17:55:41.557093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966191+0000","last_change":"2024-05-20T17:55:39.273435+0000","last_active":"2024-05-20T17:55:41.966191+0000","last_peered":"2024-05-20T17:55:41.966191+0000","last_clean":"2024-05-20T17:55:41.966191+0000","last_became_active":"2024-05-20T17:55:39.272038+0000","last_became_peered":"2024-05-20T17:55:39.272038+0000","last_unstale":"2024-05-20T17:55:41.966191+0000","last_undegraded":"2024-05-20T17:55:41.966191+0000","last_fullsized":"2024-05-20T17:55:41.966191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254607+0000","last_change":"2024-05-20T17:55:40.269504+0000","last_active":"2024-05-20T17:55:41.254607+0000","last_peered":"2024-05-20T17:55:41.254607+0000","last_clean":"2024-05-20T17:55:41.254607+0000","last_became_active":"2024-05-20T17:55:40.269183+0000","last_became_peered":"2024-05-20T17:55:40.269183+0000","last_unstale":"2024-05-20T17:55:41.254607+0000","last_undegraded":"2024-05-20T17:55:41.254607+0000","last_fullsized":"2024-05-20T17:55:41.254607+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:13:50.189523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966477+0000","last_change":"2024-05-20T17:55:39.271665+0000","last_active":"2024-05-20T17:55:41.966477+0000","last_peered":"2024-05-20T17:55:41.966477+0000","last_clean":"2024-05-20T17:55:41.966477+0000","last_became_active":"2024-05-20T17:55:39.271355+0000","last_became_peered":"2024-05-20T17:55:39.271355+0000","last_unstale":"2024-05-20T17:55:41.966477+0000","last_undegraded":"2024-05-20T17:55:41.966477+0000","last_fullsized":"2024-05-20T17:55:41.966477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258077+0000","last_change":"2024-05-20T17:55:40.277184+0000","last_active":"2024-05-20T17:55:41.258077+0000","last_peered":"2024-05-20T17:55:41.258077+0000","last_clean":"2024-05-20T17:55:41.258077+0000","last_became_active":"2024-05-20T17:55:40.276858+0000","last_became_peered":"2024-05-20T17:55:40.276858+0000","last_unstale":"2024-05-20T17:55:41.258077+0000","last_undegraded":"2024-05-20T17:55:41.258077+0000","last_fullsized":"2024-05-20T17:55:41.258077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.259300+0000","last_change":"2024-05-20T17:55:39.256734+0000","last_active":"2024-05-20T17:55:39.259300+0000","last_peered":"2024-05-20T17:55:39.259300+0000","last_clean":"2024-05-20T17:55:39.259300+0000","last_became_active":"2024-05-20T17:55:39.256389+0000","last_became_peered":"2024-05-20T17:55:39.256389+0000","last_unstale":"2024-05-20T17:55:39.259300+0000","last_undegraded":"2024-05-20T17:55:39.259300+0000","last_fullsized":"2024-05-20T17:55:39.259300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:22:46.780789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966181+0000","last_change":"2024-05-20T17:55:40.283253+0000","last_active":"2024-05-20T17:55:41.966181+0000","last_peered":"2024-05-20T17:55:41.966181+0000","last_clean":"2024-05-20T17:55:41.966181+0000","last_became_active":"2024-05-20T17:55:40.282357+0000","last_became_peered":"2024-05-20T17:55:40.282357+0000","last_unstale":"2024-05-20T17:55:41.966181+0000","last_undegraded":"2024-05-20T17:55:41.966181+0000","last_fullsized":"2024-05-20T17:55:41.966181+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257712+0000","last_change":"2024-05-20T17:55:39.267829+0000","last_active":"2024-05-20T17:55:41.257712+0000","last_peered":"2024-05-20T17:55:41.257712+0000","last_clean":"2024-05-20T17:55:41.257712+0000","last_became_active":"2024-05-20T17:55:39.267501+0000","last_became_peered":"2024-05-20T17:55:39.267501+0000","last_unstale":"2024-05-20T17:55:41.257712+0000","last_undegraded":"2024-05-20T17:55:41.257712+0000","last_fullsized":"2024-05-20T17:55:41.257712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254976+0000","last_change":"2024-05-20T17:55:40.267881+0000","last_active":"2024-05-20T17:55:41.254976+0000","last_peered":"2024-05-20T17:55:41.254976+0000","last_clean":"2024-05-20T17:55:41.254976+0000","last_became_active":"2024-05-20T17:55:40.267566+0000","last_became_peered":"2024-05-20T17:55:40.267566+0000","last_unstale":"2024-05-20T17:55:41.254976+0000","last_undegraded":"2024-05-20T17:55:41.254976+0000","last_fullsized":"2024-05-20T17:55:41.254976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:42.086335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557032+0000","last_change":"2024-05-20T17:55:39.266116+0000","last_active":"2024-05-20T17:55:41.557032+0000","last_peered":"2024-05-20T17:55:41.557032+0000","last_clean":"2024-05-20T17:55:41.557032+0000","last_became_active":"2024-05-20T17:55:39.265728+0000","last_became_peered":"2024-05-20T17:55:39.265728+0000","last_unstale":"2024-05-20T17:55:41.557032+0000","last_undegraded":"2024-05-20T17:55:41.557032+0000","last_fullsized":"2024-05-20T17:55:41.557032+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:05:12.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966819+0000","last_change":"2024-05-20T17:55:40.286432+0000","last_active":"2024-05-20T17:55:41.966819+0000","last_peered":"2024-05-20T17:55:41.966819+0000","last_clean":"2024-05-20T17:55:41.966819+0000","last_became_active":"2024-05-20T17:55:40.286118+0000","last_became_peered":"2024-05-20T17:55:40.286118+0000","last_unstale":"2024-05-20T17:55:41.966819+0000","last_undegraded":"2024-05-20T17:55:41.966819+0000","last_fullsized":"2024-05-20T17:55:41.966819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:22.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.276136+0000","last_change":"2024-05-20T17:55:39.276136+0000","last_active":"2024-05-20T17:55:39.276136+0000","last_peered":"2024-05-20T17:55:39.276136+0000","last_clean":"2024-05-20T17:55:39.276136+0000","last_became_active":"2024-05-20T17:55:39.275769+0000","last_became_peered":"2024-05-20T17:55:39.275769+0000","last_unstale":"2024-05-20T17:55:39.276136+0000","last_undegraded":"2024-05-20T17:55:39.276136+0000","last_fullsized":"2024-05-20T17:55:39.276136+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257645+0000","last_change":"2024-05-20T17:55:40.273680+0000","last_active":"2024-05-20T17:55:41.257645+0000","last_peered":"2024-05-20T17:55:41.257645+0000","last_clean":"2024-05-20T17:55:41.257645+0000","last_became_active":"2024-05-20T17:55:40.273073+0000","last_became_peered":"2024-05-20T17:55:40.273073+0000","last_unstale":"2024-05-20T17:55:41.257645+0000","last_undegraded":"2024-05-20T17:55:41.257645+0000","last_fullsized":"2024-05-20T17:55:41.257645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:03.789329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966609+0000","last_change":"2024-05-20T17:55:39.267936+0000","last_active":"2024-05-20T17:55:41.966609+0000","last_peered":"2024-05-20T17:55:41.966609+0000","last_clean":"2024-05-20T17:55:41.966609+0000","last_became_active":"2024-05-20T17:55:39.267565+0000","last_became_peered":"2024-05-20T17:55:39.267565+0000","last_unstale":"2024-05-20T17:55:41.966609+0000","last_undegraded":"2024-05-20T17:55:41.966609+0000","last_fullsized":"2024-05-20T17:55:41.966609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965996+0000","last_change":"2024-05-20T17:55:40.259853+0000","last_active":"2024-05-20T17:55:41.965996+0000","last_peered":"2024-05-20T17:55:41.965996+0000","last_clean":"2024-05-20T17:55:41.965996+0000","last_became_active":"2024-05-20T17:55:40.259465+0000","last_became_peered":"2024-05-20T17:55:40.259465+0000","last_unstale":"2024-05-20T17:55:41.965996+0000","last_undegraded":"2024-05-20T17:55:41.965996+0000","last_fullsized":"2024-05-20T17:55:41.965996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258204+0000","last_change":"2024-05-20T17:55:39.258507+0000","last_active":"2024-05-20T17:55:41.258204+0000","last_peered":"2024-05-20T17:55:41.258204+0000","last_clean":"2024-05-20T17:55:41.258204+0000","last_became_active":"2024-05-20T17:55:39.258195+0000","last_became_peered":"2024-05-20T17:55:39.258195+0000","last_unstale":"2024-05-20T17:55:41.258204+0000","last_undegraded":"2024-05-20T17:55:41.258204+0000","last_fullsized":"2024-05-20T17:55:41.258204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.263457+0000","last_change":"2024-05-20T17:55:39.263457+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.263457+0000","last_undegraded":"2024-05-20T17:55:39.263457+0000","last_fullsized":"2024-05-20T17:55:39.263457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966420+0000","last_change":"2024-05-20T17:55:39.271032+0000","last_active":"2024-05-20T17:55:41.966420+0000","last_peered":"2024-05-20T17:55:41.966420+0000","last_clean":"2024-05-20T17:55:41.966420+0000","last_became_active":"2024-05-20T17:55:39.270719+0000","last_became_peered":"2024-05-20T17:55:39.270719+0000","last_unstale":"2024-05-20T17:55:41.966420+0000","last_undegraded":"2024-05-20T17:55:41.966420+0000","last_fullsized":"2024-05-20T17:55:41.966420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258048+0000","last_change":"2024-05-20T17:55:40.266407+0000","last_active":"2024-05-20T17:55:41.258048+0000","last_peered":"2024-05-20T17:55:41.258048+0000","last_clean":"2024-05-20T17:55:41.258048+0000","last_became_active":"2024-05-20T17:55:40.266040+0000","last_became_peered":"2024-05-20T17:55:40.266040+0000","last_unstale":"2024-05-20T17:55:41.258048+0000","last_undegraded":"2024-05-20T17:55:41.258048+0000","last_fullsized":"2024-05-20T17:55:41.258048+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:18.657015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254993+0000","last_change":"2024-05-20T17:55:39.275133+0000","last_active":"2024-05-20T17:55:41.254993+0000","last_peered":"2024-05-20T17:55:41.254993+0000","last_clean":"2024-05-20T17:55:41.254993+0000","last_became_active":"2024-05-20T17:55:39.274819+0000","last_became_peered":"2024-05-20T17:55:39.274819+0000","last_unstale":"2024-05-20T17:55:41.254993+0000","last_undegraded":"2024-05-20T17:55:41.254993+0000","last_fullsized":"2024-05-20T17:55:41.254993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:10.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966204+0000","last_change":"2024-05-20T17:55:40.268720+0000","last_active":"2024-05-20T17:55:41.966204+0000","last_peered":"2024-05-20T17:55:41.966204+0000","last_clean":"2024-05-20T17:55:41.966204+0000","last_became_active":"2024-05-20T17:55:40.268272+0000","last_became_peered":"2024-05-20T17:55:40.268272+0000","last_unstale":"2024-05-20T17:55:41.966204+0000","last_undegraded":"2024-05-20T17:55:41.966204+0000","last_fullsized":"2024-05-20T17:55:41.966204+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.276770+0000","last_change":"2024-05-20T17:55:39.274602+0000","last_active":"2024-05-20T17:55:39.276770+0000","last_peered":"2024-05-20T17:55:39.276770+0000","last_clean":"2024-05-20T17:55:39.276770+0000","last_became_active":"2024-05-20T17:55:39.274202+0000","last_became_peered":"2024-05-20T17:55:39.274202+0000","last_unstale":"2024-05-20T17:55:39.276770+0000","last_undegraded":"2024-05-20T17:55:39.276770+0000","last_fullsized":"2024-05-20T17:55:39.276770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.264058+0000","last_change":"2024-05-20T17:55:39.264058+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.264058+0000","last_undegraded":"2024-05-20T17:55:39.264058+0000","last_fullsized":"2024-05-20T17:55:39.264058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557215+0000","last_change":"2024-05-20T17:55:39.278757+0000","last_active":"2024-05-20T17:55:41.557215+0000","last_peered":"2024-05-20T17:55:41.557215+0000","last_clean":"2024-05-20T17:55:41.557215+0000","last_became_active":"2024-05-20T17:55:39.278446+0000","last_became_peered":"2024-05-20T17:55:39.278446+0000","last_unstale":"2024-05-20T17:55:41.557215+0000","last_undegraded":"2024-05-20T17:55:41.557215+0000","last_fullsized":"2024-05-20T17:55:41.557215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254913+0000","last_change":"2024-05-20T17:55:40.277815+0000","last_active":"2024-05-20T17:55:41.254913+0000","last_peered":"2024-05-20T17:55:41.254913+0000","last_clean":"2024-05-20T17:55:41.254913+0000","last_became_active":"2024-05-20T17:55:40.277472+0000","last_became_peered":"2024-05-20T17:55:40.277472+0000","last_unstale":"2024-05-20T17:55:41.254913+0000","last_undegraded":"2024-05-20T17:55:41.254913+0000","last_fullsized":"2024-05-20T17:55:41.254913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:07.635141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966866+0000","last_change":"2024-05-20T17:55:39.269641+0000","last_active":"2024-05-20T17:55:41.966866+0000","last_peered":"2024-05-20T17:55:41.966866+0000","last_clean":"2024-05-20T17:55:41.966866+0000","last_became_active":"2024-05-20T17:55:39.269150+0000","last_became_peered":"2024-05-20T17:55:39.269150+0000","last_unstale":"2024-05-20T17:55:41.966866+0000","last_undegraded":"2024-05-20T17:55:41.966866+0000","last_fullsized":"2024-05-20T17:55:41.966866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:42.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.264805+0000","last_change":"2024-05-20T17:55:39.264805+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.264805+0000","last_undegraded":"2024-05-20T17:55:39.264805+0000","last_fullsized":"2024-05-20T17:55:39.264805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254512+0000","last_change":"2024-05-20T17:55:39.275778+0000","last_active":"2024-05-20T17:55:41.254512+0000","last_peered":"2024-05-20T17:55:41.254512+0000","last_clean":"2024-05-20T17:55:41.254512+0000","last_became_active":"2024-05-20T17:55:39.275467+0000","last_became_peered":"2024-05-20T17:55:39.275467+0000","last_unstale":"2024-05-20T17:55:41.254512+0000","last_undegraded":"2024-05-20T17:55:41.254512+0000","last_fullsized":"2024-05-20T17:55:41.254512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:55.528047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254470+0000","last_change":"2024-05-20T17:55:40.264575+0000","last_active":"2024-05-20T17:55:41.254470+0000","last_peered":"2024-05-20T17:55:41.254470+0000","last_clean":"2024-05-20T17:55:41.254470+0000","last_became_active":"2024-05-20T17:55:40.264241+0000","last_became_peered":"2024-05-20T17:55:40.264241+0000","last_unstale":"2024-05-20T17:55:41.254470+0000","last_undegraded":"2024-05-20T17:55:41.254470+0000","last_fullsized":"2024-05-20T17:55:41.254470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:06.124095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":6,"reported_epoch":49,"state":"active","last_fresh":"2024-05-20T17:55:39.277815+0000","last_change":"2024-05-20T17:55:39.277743+0000","last_active":"2024-05-20T17:55:39.277815+0000","last_peered":"2024-05-20T17:55:39.277815+0000","last_clean":"2024-05-20T17:55:38.240371+0000","last_became_active":"2024-05-20T17:55:39.277743+0000","last_became_peered":"2024-05-20T17:55:39.277743+0000","last_unstale":"2024-05-20T17:55:39.277815+0000","last_undegraded":"2024-05-20T17:55:39.277815+0000","last_fullsized":"2024-05-20T17:55:39.277815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965685+0000","last_change":"2024-05-20T17:55:40.277654+0000","last_active":"2024-05-20T17:55:41.965685+0000","last_peered":"2024-05-20T17:55:41.965685+0000","last_clean":"2024-05-20T17:55:41.965685+0000","last_became_active":"2024-05-20T17:55:40.277356+0000","last_became_peered":"2024-05-20T17:55:40.277356+0000","last_unstale":"2024-05-20T17:55:41.965685+0000","last_undegraded":"2024-05-20T17:55:41.965685+0000","last_fullsized":"2024-05-20T17:55:41.965685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257414+0000","last_change":"2024-05-20T17:55:39.265979+0000","last_active":"2024-05-20T17:55:41.257414+0000","last_peered":"2024-05-20T17:55:41.257414+0000","last_clean":"2024-05-20T17:55:41.257414+0000","last_became_active":"2024-05-20T17:55:39.265679+0000","last_became_peered":"2024-05-20T17:55:39.265679+0000","last_unstale":"2024-05-20T17:55:41.257414+0000","last_undegraded":"2024-05-20T17:55:41.257414+0000","last_fullsized":"2024-05-20T17:55:41.257414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:34.833740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257757+0000","last_change":"2024-05-20T17:55:40.277228+0000","last_active":"2024-05-20T17:55:41.257757+0000","last_peered":"2024-05-20T17:55:41.257757+0000","last_clean":"2024-05-20T17:55:41.257757+0000","last_became_active":"2024-05-20T17:55:40.276880+0000","last_became_peered":"2024-05-20T17:55:40.276880+0000","last_unstale":"2024-05-20T17:55:41.257757+0000","last_undegraded":"2024-05-20T17:55:41.257757+0000","last_fullsized":"2024-05-20T17:55:41.257757+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:39.200975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557190+0000","last_change":"2024-05-20T17:55:39.273470+0000","last_active":"2024-05-20T17:55:41.557190+0000","last_peered":"2024-05-20T17:55:41.557190+0000","last_clean":"2024-05-20T17:55:41.557190+0000","last_became_active":"2024-05-20T17:55:39.273151+0000","last_became_peered":"2024-05-20T17:55:39.273151+0000","last_unstale":"2024-05-20T17:55:41.557190+0000","last_undegraded":"2024-05-20T17:55:41.557190+0000","last_fullsized":"2024-05-20T17:55:41.557190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966012+0000","last_change":"2024-05-20T17:55:40.272795+0000","last_active":"2024-05-20T17:55:41.966012+0000","last_peered":"2024-05-20T17:55:41.966012+0000","last_clean":"2024-05-20T17:55:41.966012+0000","last_became_active":"2024-05-20T17:55:40.272473+0000","last_became_peered":"2024-05-20T17:55:40.272473+0000","last_unstale":"2024-05-20T17:55:41.966012+0000","last_undegraded":"2024-05-20T17:55:41.966012+0000","last_fullsized":"2024-05-20T17:55:41.966012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557373+0000","last_change":"2024-05-20T17:55:39.266166+0000","last_active":"2024-05-20T17:55:41.557373+0000","last_peered":"2024-05-20T17:55:41.557373+0000","last_clean":"2024-05-20T17:55:41.557373+0000","last_became_active":"2024-05-20T17:55:39.265830+0000","last_became_peered":"2024-05-20T17:55:39.265830+0000","last_unstale":"2024-05-20T17:55:41.557373+0000","last_undegraded":"2024-05-20T17:55:41.557373+0000","last_fullsized":"2024-05-20T17:55:41.557373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:35:39.407657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966454+0000","last_change":"2024-05-20T17:55:40.264272+0000","last_active":"2024-05-20T17:55:41.966454+0000","last_peered":"2024-05-20T17:55:41.966454+0000","last_clean":"2024-05-20T17:55:41.966454+0000","last_became_active":"2024-05-20T17:55:40.263229+0000","last_became_peered":"2024-05-20T17:55:40.263229+0000","last_unstale":"2024-05-20T17:55:41.966454+0000","last_undegraded":"2024-05-20T17:55:41.966454+0000","last_fullsized":"2024-05-20T17:55:41.966454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966167+0000","last_change":"2024-05-20T17:55:39.265914+0000","last_active":"2024-05-20T17:55:41.966167+0000","last_peered":"2024-05-20T17:55:41.966167+0000","last_clean":"2024-05-20T17:55:41.966167+0000","last_became_active":"2024-05-20T17:55:39.265583+0000","last_became_peered":"2024-05-20T17:55:39.265583+0000","last_unstale":"2024-05-20T17:55:41.966167+0000","last_undegraded":"2024-05-20T17:55:41.966167+0000","last_fullsized":"2024-05-20T17:55:41.966167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557422+0000","last_change":"2024-05-20T17:55:40.270988+0000","last_active":"2024-05-20T17:55:41.557422+0000","last_peered":"2024-05-20T17:55:41.557422+0000","last_clean":"2024-05-20T17:55:41.557422+0000","last_became_active":"2024-05-20T17:55:40.270582+0000","last_became_peered":"2024-05-20T17:55:40.270582+0000","last_unstale":"2024-05-20T17:55:41.557422+0000","last_undegraded":"2024-05-20T17:55:41.557422+0000","last_fullsized":"2024-05-20T17:55:41.557422+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254285+0000","last_change":"2024-05-20T17:55:39.272103+0000","last_active":"2024-05-20T17:55:41.254285+0000","last_peered":"2024-05-20T17:55:41.254285+0000","last_clean":"2024-05-20T17:55:41.254285+0000","last_became_active":"2024-05-20T17:55:39.271787+0000","last_became_peered":"2024-05-20T17:55:39.271787+0000","last_unstale":"2024-05-20T17:55:41.254285+0000","last_undegraded":"2024-05-20T17:55:41.254285+0000","last_fullsized":"2024-05-20T17:55:41.254285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:41.864783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.258373+0000","last_change":"2024-05-20T17:55:39.258373+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.258373+0000","last_undegraded":"2024-05-20T17:55:39.258373+0000","last_fullsized":"2024-05-20T17:55:39.258373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.263524+0000","last_change":"2024-05-20T17:55:39.262518+0000","last_active":"2024-05-20T17:55:39.263524+0000","last_peered":"2024-05-20T17:55:39.263524+0000","last_clean":"2024-05-20T17:55:39.263524+0000","last_became_active":"2024-05-20T17:55:39.262191+0000","last_became_peered":"2024-05-20T17:55:39.262191+0000","last_unstale":"2024-05-20T17:55:39.263524+0000","last_undegraded":"2024-05-20T17:55:39.263524+0000","last_fullsized":"2024-05-20T17:55:39.263524+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965915+0000","last_change":"2024-05-20T17:55:40.275681+0000","last_active":"2024-05-20T17:55:41.965915+0000","last_peered":"2024-05-20T17:55:41.965915+0000","last_clean":"2024-05-20T17:55:41.965915+0000","last_became_active":"2024-05-20T17:55:40.275360+0000","last_became_peered":"2024-05-20T17:55:40.275360+0000","last_unstale":"2024-05-20T17:55:41.965915+0000","last_undegraded":"2024-05-20T17:55:41.965915+0000","last_fullsized":"2024-05-20T17:55:41.965915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.256993+0000","last_change":"2024-05-20T17:55:39.269421+0000","last_active":"2024-05-20T17:55:41.256993+0000","last_peered":"2024-05-20T17:55:41.256993+0000","last_clean":"2024-05-20T17:55:41.256993+0000","last_became_active":"2024-05-20T17:55:39.269101+0000","last_became_peered":"2024-05-20T17:55:39.269101+0000","last_unstale":"2024-05-20T17:55:41.256993+0000","last_undegraded":"2024-05-20T17:55:41.256993+0000","last_fullsized":"2024-05-20T17:55:41.256993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:11.791684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966253+0000","last_change":"2024-05-20T17:55:40.267783+0000","last_active":"2024-05-20T17:55:41.966253+0000","last_peered":"2024-05-20T17:55:41.966253+0000","last_clean":"2024-05-20T17:55:41.966253+0000","last_became_active":"2024-05-20T17:55:40.267415+0000","last_became_peered":"2024-05-20T17:55:40.267415+0000","last_unstale":"2024-05-20T17:55:41.966253+0000","last_undegraded":"2024-05-20T17:55:41.966253+0000","last_fullsized":"2024-05-20T17:55:41.966253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557363+0000","last_change":"2024-05-20T17:55:39.280002+0000","last_active":"2024-05-20T17:55:41.557363+0000","last_peered":"2024-05-20T17:55:41.557363+0000","last_clean":"2024-05-20T17:55:41.557363+0000","last_became_active":"2024-05-20T17:55:39.279754+0000","last_became_peered":"2024-05-20T17:55:39.279754+0000","last_unstale":"2024-05-20T17:55:41.557363+0000","last_undegraded":"2024-05-20T17:55:41.557363+0000","last_fullsized":"2024-05-20T17:55:41.557363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:11:28.961264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965866+0000","last_change":"2024-05-20T17:55:40.268902+0000","last_active":"2024-05-20T17:55:41.965866+0000","last_peered":"2024-05-20T17:55:41.965866+0000","last_clean":"2024-05-20T17:55:41.965866+0000","last_became_active":"2024-05-20T17:55:40.268587+0000","last_became_peered":"2024-05-20T17:55:40.268587+0000","last_unstale":"2024-05-20T17:55:41.965866+0000","last_undegraded":"2024-05-20T17:55:41.965866+0000","last_fullsized":"2024-05-20T17:55:41.965866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966557+0000","last_change":"2024-05-20T17:55:39.274048+0000","last_active":"2024-05-20T17:55:41.966557+0000","last_peered":"2024-05-20T17:55:41.966557+0000","last_clean":"2024-05-20T17:55:41.966557+0000","last_became_active":"2024-05-20T17:55:39.273738+0000","last_became_peered":"2024-05-20T17:55:39.273738+0000","last_unstale":"2024-05-20T17:55:41.966557+0000","last_undegraded":"2024-05-20T17:55:41.966557+0000","last_fullsized":"2024-05-20T17:55:41.966557+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:07.062814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254624+0000","last_change":"2024-05-20T17:55:40.265532+0000","last_active":"2024-05-20T17:55:41.254624+0000","last_peered":"2024-05-20T17:55:41.254624+0000","last_clean":"2024-05-20T17:55:41.254624+0000","last_became_active":"2024-05-20T17:55:40.265164+0000","last_became_peered":"2024-05-20T17:55:40.265164+0000","last_unstale":"2024-05-20T17:55:41.254624+0000","last_undegraded":"2024-05-20T17:55:41.254624+0000","last_fullsized":"2024-05-20T17:55:41.254624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:15:38.124970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.262718+0000","last_change":"2024-05-20T17:55:39.260761+0000","last_active":"2024-05-20T17:55:39.262718+0000","last_peered":"2024-05-20T17:55:39.262718+0000","last_clean":"2024-05-20T17:55:39.262718+0000","last_became_active":"2024-05-20T17:55:39.260432+0000","last_became_peered":"2024-05-20T17:55:39.260432+0000","last_unstale":"2024-05-20T17:55:39.262718+0000","last_undegraded":"2024-05-20T17:55:39.262718+0000","last_fullsized":"2024-05-20T17:55:39.262718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:08:37.860132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.259020+0000","last_change":"2024-05-20T17:55:39.259020+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.259020+0000","last_undegraded":"2024-05-20T17:55:39.259020+0000","last_fullsized":"2024-05-20T17:55:39.259020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254740+0000","last_change":"2024-05-20T17:55:39.272924+0000","last_active":"2024-05-20T17:55:41.254740+0000","last_peered":"2024-05-20T17:55:41.254740+0000","last_clean":"2024-05-20T17:55:41.254740+0000","last_became_active":"2024-05-20T17:55:39.272604+0000","last_became_peered":"2024-05-20T17:55:39.272604+0000","last_unstale":"2024-05-20T17:55:41.254740+0000","last_undegraded":"2024-05-20T17:55:41.254740+0000","last_fullsized":"2024-05-20T17:55:41.254740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.121415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966476+0000","last_change":"2024-05-20T17:55:40.270269+0000","last_active":"2024-05-20T17:55:41.966476+0000","last_peered":"2024-05-20T17:55:41.966476+0000","last_clean":"2024-05-20T17:55:41.966476+0000","last_became_active":"2024-05-20T17:55:40.269480+0000","last_became_peered":"2024-05-20T17:55:40.269480+0000","last_unstale":"2024-05-20T17:55:41.966476+0000","last_undegraded":"2024-05-20T17:55:41.966476+0000","last_fullsized":"2024-05-20T17:55:41.966476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254494+0000","last_change":"2024-05-20T17:55:39.270561+0000","last_active":"2024-05-20T17:55:41.254494+0000","last_peered":"2024-05-20T17:55:41.254494+0000","last_clean":"2024-05-20T17:55:41.254494+0000","last_became_active":"2024-05-20T17:55:39.270216+0000","last_became_peered":"2024-05-20T17:55:39.270216+0000","last_unstale":"2024-05-20T17:55:41.254494+0000","last_undegraded":"2024-05-20T17:55:41.254494+0000","last_fullsized":"2024-05-20T17:55:41.254494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:14.931204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.259825+0000","last_change":"2024-05-20T17:55:39.259825+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.259825+0000","last_undegraded":"2024-05-20T17:55:39.259825+0000","last_fullsized":"2024-05-20T17:55:39.259825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257596+0000","last_change":"2024-05-20T17:55:39.266935+0000","last_active":"2024-05-20T17:55:41.257596+0000","last_peered":"2024-05-20T17:55:41.257596+0000","last_clean":"2024-05-20T17:55:41.257596+0000","last_became_active":"2024-05-20T17:55:39.264958+0000","last_became_peered":"2024-05-20T17:55:39.264958+0000","last_unstale":"2024-05-20T17:55:41.257596+0000","last_undegraded":"2024-05-20T17:55:41.257596+0000","last_fullsized":"2024-05-20T17:55:41.257596+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254927+0000","last_change":"2024-05-20T17:55:40.266843+0000","last_active":"2024-05-20T17:55:41.254927+0000","last_peered":"2024-05-20T17:55:41.254927+0000","last_clean":"2024-05-20T17:55:41.254927+0000","last_became_active":"2024-05-20T17:55:40.266052+0000","last_became_peered":"2024-05-20T17:55:40.266052+0000","last_unstale":"2024-05-20T17:55:41.254927+0000","last_undegraded":"2024-05-20T17:55:41.254927+0000","last_fullsized":"2024-05-20T17:55:41.254927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:04.314309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966202+0000","last_change":"2024-05-20T17:55:39.270669+0000","last_active":"2024-05-20T17:55:41.966202+0000","last_peered":"2024-05-20T17:55:41.966202+0000","last_clean":"2024-05-20T17:55:41.966202+0000","last_became_active":"2024-05-20T17:55:39.270233+0000","last_became_peered":"2024-05-20T17:55:39.270233+0000","last_unstale":"2024-05-20T17:55:41.966202+0000","last_undegraded":"2024-05-20T17:55:41.966202+0000","last_fullsized":"2024-05-20T17:55:41.966202+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557129+0000","last_change":"2024-05-20T17:55:40.264890+0000","last_active":"2024-05-20T17:55:41.557129+0000","last_peered":"2024-05-20T17:55:41.557129+0000","last_clean":"2024-05-20T17:55:41.557129+0000","last_became_active":"2024-05-20T17:55:40.264196+0000","last_became_peered":"2024-05-20T17:55:40.264196+0000","last_unstale":"2024-05-20T17:55:41.557129+0000","last_undegraded":"2024-05-20T17:55:41.557129+0000","last_fullsized":"2024-05-20T17:55:41.557129+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.274803+0000","last_change":"2024-05-20T17:55:39.269301+0000","last_active":"2024-05-20T17:55:39.274803+0000","last_peered":"2024-05-20T17:55:39.274803+0000","last_clean":"2024-05-20T17:55:39.274803+0000","last_became_active":"2024-05-20T17:55:39.268957+0000","last_became_peered":"2024-05-20T17:55:39.268957+0000","last_unstale":"2024-05-20T17:55:39.274803+0000","last_undegraded":"2024-05-20T17:55:39.274803+0000","last_fullsized":"2024-05-20T17:55:39.274803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965845+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:55:41.965845+0000","last_peered":"2024-05-20T17:55:41.965845+0000","last_clean":"2024-05-20T17:55:41.965845+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:55:41.965845+0000","last_undegraded":"2024-05-20T17:55:41.965845+0000","last_fullsized":"2024-05-20T17:55:41.965845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":126,"acting":126,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":861144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":271304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":270652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":271234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":272264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":270812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1163264,"data_stored":840494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:55:45.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2024-05-20T17:55:45.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.274706+0000', 'last_change': '2024-05-20T17:55:39.274706+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.274706+0000', 'last_undegraded': '2024-05-20T17:55:39.274706+0000', 'last_fullsized': '2024-05-20T17:55:39.274706+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.270276+0000', 'last_change': '2024-05-20T17:55:39.270276+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.270276+0000', 'last_undegraded': '2024-05-20T17:55:39.270276+0000', 'last_fullsized': '2024-05-20T17:55:39.270276+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.272813+0000', 'last_change': '2024-05-20T17:55:39.272813+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.272813+0000', 'last_undegraded': '2024-05-20T17:55:39.272813+0000', 'last_fullsized': '2024-05-20T17:55:39.272813+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.276707+0000', 'last_change': '2024-05-20T17:55:39.276707+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.276707+0000', 'last_undegraded': '2024-05-20T17:55:39.276707+0000', 'last_fullsized': '2024-05-20T17:55:39.276707+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.273100+0000', 'last_change': '2024-05-20T17:55:39.273100+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.273100+0000', 'last_undegraded': '2024-05-20T17:55:39.273100+0000', 'last_fullsized': '2024-05-20T17:55:39.273100+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-20T17:55:39.242479+0000', 'last_change': '2024-05-20T17:55:39.242479+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.242479+0000', 'last_undegraded': '2024-05-20T17:55:39.242479+0000', 'last_fullsized': '2024-05-20T17:55:39.242479+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-20T17:55:45.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.267813+0000', 'last_change': '2024-05-20T17:55:39.267813+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.267813+0000', 'last_undegraded': '2024-05-20T17:55:39.267813+0000', 'last_fullsized': '2024-05-20T17:55:39.267813+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.265869+0000', 'last_change': '2024-05-20T17:55:39.265869+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.265869+0000', 'last_undegraded': '2024-05-20T17:55:39.265869+0000', 'last_fullsized': '2024-05-20T17:55:39.265869+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.265335+0000', 'last_change': '2024-05-20T17:55:39.265335+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.265335+0000', 'last_undegraded': '2024-05-20T17:55:39.265335+0000', 'last_fullsized': '2024-05-20T17:55:39.265335+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.263457+0000', 'last_change': '2024-05-20T17:55:39.263457+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.263457+0000', 'last_undegraded': '2024-05-20T17:55:39.263457+0000', 'last_fullsized': '2024-05-20T17:55:39.263457+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.264058+0000', 'last_change': '2024-05-20T17:55:39.264058+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.264058+0000', 'last_undegraded': '2024-05-20T17:55:39.264058+0000', 'last_fullsized': '2024-05-20T17:55:39.264058+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.264805+0000', 'last_change': '2024-05-20T17:55:39.264805+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.264805+0000', 'last_undegraded': '2024-05-20T17:55:39.264805+0000', 'last_fullsized': '2024-05-20T17:55:39.264805+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 49, 'state': 'active', 'last_fresh': '2024-05-20T17:55:39.277815+0000', 'last_change': '2024-05-20T17:55:39.277743+0000', 'last_active': '2024-05-20T17:55:39.277815+0000', 'last_peered': '2024-05-20T17:55:39.277815+0000', 'last_clean': '2024-05-20T17:55:38.240371+0000', 'last_became_active': '2024-05-20T17:55:39.277743+0000', 'last_became_peered': '2024-05-20T17:55:39.277743+0000', 'last_unstale': '2024-05-20T17:55:39.277815+0000', 'last_undegraded': '2024-05-20T17:55:39.277815+0000', 'last_fullsized': '2024-05-20T17:55:39.277815+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:38.240371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:38.240371+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:38.240371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.258373+0000', 'last_change': '2024-05-20T17:55:39.258373+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.258373+0000', 'last_undegraded': '2024-05-20T17:55:39.258373+0000', 'last_fullsized': '2024-05-20T17:55:39.258373+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.259020+0000', 'last_change': '2024-05-20T17:55:39.259020+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.259020+0000', 'last_undegraded': '2024-05-20T17:55:39.259020+0000', 'last_fullsized': '2024-05-20T17:55:39.259020+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-05-20T17:55:45.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-05-20T17:55:39.259825+0000', 'last_change': '2024-05-20T17:55:39.259825+0000', 'last_active': '2024-05-20T17:55:39.242479+0000', 'last_peered': '2024-05-20T17:55:39.242479+0000', 'last_clean': '2024-05-20T17:55:39.242479+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T17:55:39.259825+0000', 'last_undegraded': '2024-05-20T17:55:39.259825+0000', 'last_fullsized': '2024-05-20T17:55:39.259825+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'last_clean_scrub_stamp': '2024-05-20T17:55:39.242479+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T17:55:45.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-20T17:55:45.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.251+0000 7f297c19c640 1 Processor -- start 2024-05-20T17:55:45.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.251+0000 7f297c19c640 1 -- start start 2024-05-20T17:55:45.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.252+0000 7f297c19c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29740d0560 0x7f297406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f297c19c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f297406d910 0x7f29740b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f297c19c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297406dd20 con 0x7f29740b4070 2024-05-20T17:55:45.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f297c19c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f29740b8490 con 0x7f29740d0560 2024-05-20T17:55:45.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f297c19c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f297415fa90 con 0x7f297406d910 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f2979737640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29740d0560 0x7f297406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f2979f38640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f29740b4070 0x7f29740ba5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43988/0 (socket says 172.21.15.6:43988) 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f2979f38640 1 -- 172.21.15.6:0/506938696 learned_addr learned my addr 172.21.15.6:0/506938696 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f297a739640 1 --2- 172.21.15.6:0/506938696 >> v2:172.21.15.171:3300/0 conn(0x7f297406d910 0x7f29740b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f2979737640 1 -- 172.21.15.6:0/506938696 >> v2:172.21.15.171:3300/0 conn(0x7f297406d910 msgr2=0x7f29740b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f2979737640 1 --2- 172.21.15.6:0/506938696 >> v2:172.21.15.171:3300/0 conn(0x7f297406d910 0x7f29740b8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f2979737640 1 -- 172.21.15.6:0/506938696 >> v1:172.21.15.6:6789/0 conn(0x7f29740b4070 legacy=0x7f29740ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f2978f36640 1 -- 172.21.15.6:0/506938696 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802586290 0 0) 0x7f2968001110 con 0x7f29740b4070 2024-05-20T17:55:45.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.253+0000 7f2979737640 1 -- 172.21.15.6:0/506938696 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29740d3f00 con 0x7f29740d0560 2024-05-20T17:55:45.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.254+0000 7f2979737640 1 --2- 172.21.15.6:0/506938696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740d0560 0x7f297406d3d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f29740cbc60 tx=0x7f297002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a68fec9fcbbb331 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.254+0000 7f2978f36640 1 -- 172.21.15.6:0/506938696 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970037070 con 0x7f29740d0560 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.254+0000 7f2978f36640 1 -- 172.21.15.6:0/506938696 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2970032440 con 0x7f29740d0560 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.254+0000 7f2978f36640 1 -- 172.21.15.6:0/506938696 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297002ae60 con 0x7f29740d0560 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.255+0000 7f297c19c640 1 -- 172.21.15.6:0/506938696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740d0560 msgr2=0x7f297406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.255+0000 7f297c19c640 1 --2- 172.21.15.6:0/506938696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740d0560 0x7f297406d3d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f29740cbc60 tx=0x7f297002a110 comp rx=0 tx=0).stop 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.255+0000 7f297c19c640 1 -- 172.21.15.6:0/506938696 shutdown_connections 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.255+0000 7f297c19c640 1 --2- 172.21.15.6:0/506938696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740d0560 0x7f297406d3d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.255+0000 7f297c19c640 1 --2- 172.21.15.6:0/506938696 >> v2:172.21.15.171:3300/0 conn(0x7f297406d910 0x7f29740b8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.255+0000 7f297c19c640 1 -- 172.21.15.6:0/506938696 >> 172.21.15.6:0/506938696 conn(0x7f29740d4c10 msgr2=0x7f29740d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.255+0000 7f297c19c640 1 -- 172.21.15.6:0/506938696 shutdown_connections 2024-05-20T17:55:45.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.255+0000 7f297c19c640 1 -- 172.21.15.6:0/506938696 wait complete. 2024-05-20T17:55:45.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.257+0000 7f297c19c640 1 Processor -- start 2024-05-20T17:55:45.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.257+0000 7f297c19c640 1 -- start start 2024-05-20T17:55:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f297c19c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297406d910 0x7f2974155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f297c19c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740b4070 0x7f29740cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f297c19c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740d0560 0x7f29740b9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f297c19c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f29740d47a0 con 0x7f29740b4070 2024-05-20T17:55:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f297c19c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f29740d44c0 con 0x7f297406d910 2024-05-20T17:55:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f297c19c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f29740d3b20 con 0x7f29740d0560 2024-05-20T17:55:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979737640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740b4070 0x7f29740cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979737640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740b4070 0x7f29740cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56916/0 (socket says 172.21.15.6:56916) 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979737640 1 -- 172.21.15.6:0/4131247659 learned_addr learned my addr 172.21.15.6:0/4131247659 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979f38640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297406d910 0x7f2974155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f297a739640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740d0560 0x7f29740b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979737640 1 -- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740d0560 msgr2=0x7f29740b9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979737640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740d0560 0x7f29740b9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979737640 1 -- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297406d910 msgr2=0x7f2974155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979737640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297406d910 0x7f2974155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f2979737640 1 -- 172.21.15.6:0/4131247659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29740cc510 con 0x7f29740b4070 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.258+0000 7f297a739640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740d0560 0x7f29740b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.259+0000 7f2979737640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740b4070 0x7f29740cb9a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2970035040 tx=0x7f29700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.259+0000 7f29667fc640 1 -- 172.21.15.6:0/4131247659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970037050 con 0x7f29740b4070 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.259+0000 7f29667fc640 1 -- 172.21.15.6:0/4131247659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2970038040 con 0x7f29740b4070 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.259+0000 7f29667fc640 1 -- 172.21.15.6:0/4131247659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970004470 con 0x7f29740b4070 2024-05-20T17:55:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.259+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29740cc7f0 con 0x7f29740b4070 2024-05-20T17:55:45.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.259+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29740ccdb0 con 0x7f29740b4070 2024-05-20T17:55:45.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.260+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29740690b0 con 0x7f29740b4070 2024-05-20T17:55:45.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.261+0000 7f29667fc640 1 -- 172.21.15.6:0/4131247659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2970030900 con 0x7f29740b4070 2024-05-20T17:55:45.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.261+0000 7f29667fc640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f295806be30 0x7f295806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.261+0000 7f29667fc640 1 -- 172.21.15.6:0/4131247659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f29700aba70 con 0x7f29740b4070 2024-05-20T17:55:45.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.261+0000 7f2979f38640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f295806be30 0x7f295806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.262+0000 7f2979f38640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f295806be30 0x7f295806e340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2968007fd0 tx=0x7f2968007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:45.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.266+0000 7f29667fc640 1 -- 172.21.15.6:0/4131247659 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f297007a3b0 con 0x7f29740b4070 2024-05-20T17:55:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.522+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f29740b3b60 con 0x7f29740b4070 2024-05-20T17:55:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.522+0000 7f29667fc640 1 -- 172.21.15.6:0/4131247659 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1370 (secure 0 0 0) 0x7f2970079cb0 con 0x7f29740b4070 2024-05-20T17:55:45.522 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:45.522 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":183,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1716227573,"num_in_osds":8,"osd_in_since":1716227564,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"creating+peering","count":14},{"state_name":"unknown","count":1},{"state_name":"active","count":1}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592722,"bytes_used":231694336,"bytes_avail":772862418944,"bytes_total":773094113280,"unknown_pgs_ratio":0.010309278033673763,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5880}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-05-20T17:55:20.265587+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-20T17:55:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f295806be30 msgr2=0x7f295806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f295806be30 0x7f295806e340 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2968007fd0 tx=0x7f2968007de0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740b4070 msgr2=0x7f29740cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740b4070 0x7f29740cb9a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2970035040 tx=0x7f29700046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 shutdown_connections 2024-05-20T17:55:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f295806be30 0x7f295806e340 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29740d0560 0x7f29740b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29740b4070 0x7f29740cb9a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 --2- 172.21.15.6:0/4131247659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f297406d910 0x7f2974155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 >> 172.21.15.6:0/4131247659 conn(0x7f29740d4c10 msgr2=0x7f29740b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:45.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 shutdown_connections 2024-05-20T17:55:45.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.524+0000 7f297c19c640 1 -- 172.21.15.6:0/4131247659 wait complete. 2024-05-20T17:55:45.534 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-20T17:55:45.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:55:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.650+0000 7fd7b92b8640 1 Processor -- start 2024-05-20T17:55:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.650+0000 7fd7b92b8640 1 -- start start 2024-05-20T17:55:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b92b8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd7b4162820 0x7fd7b40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b92b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b406dae0 0x7fd7b40b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b92b8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b40d0630 con 0x7fd7b40b3e80 2024-05-20T17:55:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b92b8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b40d39c0 con 0x7fd7b4162820 2024-05-20T17:55:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b92b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b40d3ca0 con 0x7fd7b406dae0 2024-05-20T17:55:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b406dae0 0x7fd7b40b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b2ffd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd7b4162820 0x7fd7b40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b406dae0 0x7fd7b40b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:41798/0 (socket says 172.21.15.6:41798) 2024-05-20T17:55:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.652+0000 7fd7b37fe640 1 -- 172.21.15.6:0/2723361548 learned_addr learned my addr 172.21.15.6:0/2723361548 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.653+0000 7fd7b37fe640 1 -- 172.21.15.6:0/2723361548 >> v2:172.21.15.171:3300/0 conn(0x7fd7b4162820 msgr2=0x7fd7b40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.653+0000 7fd7b37fe640 1 --2- 172.21.15.6:0/2723361548 >> v2:172.21.15.171:3300/0 conn(0x7fd7b4162820 0x7fd7b40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.653+0000 7fd7b37fe640 1 -- 172.21.15.6:0/2723361548 >> v1:172.21.15.171:6789/0 conn(0x7fd7b40b3e80 legacy=0x7fd7b406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.653+0000 7fd7b37fe640 1 -- 172.21.15.6:0/2723361548 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40d3f80 con 0x7fd7b406dae0 2024-05-20T17:55:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.653+0000 7fd7b37fe640 1 --2- 172.21.15.6:0/2723361548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b406dae0 0x7fd7b40b8190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009870 tx=0x7fd7ac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c214795c968a1d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b1ffb640 1 -- 172.21.15.6:0/2723361548 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac037070 con 0x7fd7b406dae0 2024-05-20T17:55:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b1ffb640 1 -- 172.21.15.6:0/2723361548 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac032440 con 0x7fd7b406dae0 2024-05-20T17:55:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b1ffb640 1 -- 172.21.15.6:0/2723361548 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac032810 con 0x7fd7b406dae0 2024-05-20T17:55:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2723361548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b406dae0 msgr2=0x7fd7b40b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2723361548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b406dae0 0x7fd7b40b8190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009870 tx=0x7fd7ac02a270 comp rx=0 tx=0).stop 2024-05-20T17:55:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2723361548 shutdown_connections 2024-05-20T17:55:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2723361548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b406dae0 0x7fd7b40b8190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2723361548 >> v2:172.21.15.171:3300/0 conn(0x7fd7b4162820 0x7fd7b40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2723361548 >> 172.21.15.6:0/2723361548 conn(0x7fd7b40d4bd0 msgr2=0x7fd7b40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2723361548 shutdown_connections 2024-05-20T17:55:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.654+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2723361548 wait complete. 2024-05-20T17:55:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.656+0000 7fd7b92b8640 1 Processor -- start 2024-05-20T17:55:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.656+0000 7fd7b92b8640 1 -- start start 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b92b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b40b3e80 0x7fd7b415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b92b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b4162820 0x7fd7b40b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b92b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40b5920 0x7fd7b40cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b92b8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b40d4780 con 0x7fd7b40b5920 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b92b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b40d0300 con 0x7fd7b40b3e80 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b92b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b40d4900 con 0x7fd7b4162820 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40b5920 0x7fd7b40cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40b5920 0x7fd7b40cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56928/0 (socket says 172.21.15.6:56928) 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 -- 172.21.15.6:0/2026682034 learned_addr learned my addr 172.21.15.6:0/2026682034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b27fc640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b4162820 0x7fd7b40b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b2ffd640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b40b3e80 0x7fd7b415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 -- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b4162820 msgr2=0x7fd7b40b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b4162820 0x7fd7b40b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 -- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b40b3e80 msgr2=0x7fd7b415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b40b3e80 0x7fd7b415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 -- 172.21.15.6:0/2026682034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b40b6d20 con 0x7fd7b40b5920 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd7b37fe640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40b5920 0x7fd7b40cb6d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009870 tx=0x7fd7ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.658+0000 7fd79b7fe640 1 -- 172.21.15.6:0/2026682034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac041020 con 0x7fd7b40b5920 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.659+0000 7fd79b7fe640 1 -- 172.21.15.6:0/2026682034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac03d640 con 0x7fd7b40b5920 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.659+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b40b6110 con 0x7fd7b40b5920 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.659+0000 7fd79b7fe640 1 -- 172.21.15.6:0/2026682034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac037040 con 0x7fd7b40b5920 2024-05-20T17:55:45.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.659+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b40b66d0 con 0x7fd7b40b5920 2024-05-20T17:55:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.660+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b4075b00 con 0x7fd7b40b5920 2024-05-20T17:55:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.660+0000 7fd79b7fe640 1 -- 172.21.15.6:0/2026682034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7ac044020 con 0x7fd7b40b5920 2024-05-20T17:55:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.661+0000 7fd79b7fe640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a006be30 0x7fd7a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.661+0000 7fd79b7fe640 1 -- 172.21.15.6:0/2026682034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fd7ac0ab6f0 con 0x7fd7b40b5920 2024-05-20T17:55:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.661+0000 7fd7b2ffd640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a006be30 0x7fd7a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:45.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.661+0000 7fd7b2ffd640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a006be30 0x7fd7a006e340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40073f0 tx=0x7fd7a400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:45.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.665+0000 7fd79b7fe640 1 -- 172.21.15.6:0/2026682034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd7ac04b030 con 0x7fd7b40b5920 2024-05-20T17:55:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.845+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd7b4161df0 con 0x7fd7a006be30 2024-05-20T17:55:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.852+0000 7fd79b7fe640 1 -- 172.21.15.6:0/2026682034 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250649 (secure 0 0 0) 0x7fd7b4161df0 con 0x7fd7a006be30 2024-05-20T17:55:45.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:45.856 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:55:45.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a006be30 msgr2=0x7fd7a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a006be30 0x7fd7a006e340 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40073f0 tx=0x7fd7a400b040 comp rx=0 tx=0).stop 2024-05-20T17:55:45.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40b5920 msgr2=0x7fd7b40cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:45.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40b5920 0x7fd7b40cb6d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009870 tx=0x7fd7ac0046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 shutdown_connections 2024-05-20T17:55:45.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a006be30 0x7fd7a006e340 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40b5920 0x7fd7b40cb6d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7b4162820 0x7fd7b40b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 --2- 172.21.15.6:0/2026682034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b40b3e80 0x7fd7b415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 >> 172.21.15.6:0/2026682034 conn(0x7fd7b40d4bd0 msgr2=0x7fd7b415cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 shutdown_connections 2024-05-20T17:55:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:45.855+0000 7fd7b92b8640 1 -- 172.21.15.6:0/2026682034 wait complete. 2024-05-20T17:55:45.865 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-20T17:55:44.271301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592722,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":192,"acting":192,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226264,"kb_used_data":5916,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748456,"statfs":{"total":773094113280,"available":772862418944,"internally_reserved":0,"allocated":6057984,"data_stored":3330190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2354,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001414"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966036+0000","last_change":"2024-05-20T17:55:40.270773+0000","last_active":"2024-05-20T17:55:41.966036+0000","last_peered":"2024-05-20T17:55:41.966036+0000","last_clean":"2024-05-20T17:55:41.966036+0000","last_became_active":"2024-05-20T17:55:40.270461+0000","last_became_peered":"2024-05-20T17:55:40.270461+0000","last_unstale":"2024-05-20T17:55:41.966036+0000","last_undegraded":"2024-05-20T17:55:41.966036+0000","last_fullsized":"2024-05-20T17:55:41.966036+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:53.123523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966594+0000","last_change":"2024-05-20T17:55:40.281497+0000","last_active":"2024-05-20T17:55:41.966594+0000","last_peered":"2024-05-20T17:55:41.966594+0000","last_clean":"2024-05-20T17:55:41.966594+0000","last_became_active":"2024-05-20T17:55:40.281191+0000","last_became_peered":"2024-05-20T17:55:40.281191+0000","last_unstale":"2024-05-20T17:55:41.966594+0000","last_undegraded":"2024-05-20T17:55:41.966594+0000","last_fullsized":"2024-05-20T17:55:41.966594+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.274706+0000","last_change":"2024-05-20T17:55:39.274706+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.274706+0000","last_undegraded":"2024-05-20T17:55:39.274706+0000","last_fullsized":"2024-05-20T17:55:39.274706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966155+0000","last_change":"2024-05-20T17:55:40.289561+0000","last_active":"2024-05-20T17:55:41.966155+0000","last_peered":"2024-05-20T17:55:41.966155+0000","last_clean":"2024-05-20T17:55:41.966155+0000","last_became_active":"2024-05-20T17:55:40.289232+0000","last_became_peered":"2024-05-20T17:55:40.289232+0000","last_unstale":"2024-05-20T17:55:41.966155+0000","last_undegraded":"2024-05-20T17:55:41.966155+0000","last_fullsized":"2024-05-20T17:55:41.966155+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257998+0000","last_change":"2024-05-20T17:55:40.268614+0000","last_active":"2024-05-20T17:55:41.257998+0000","last_peered":"2024-05-20T17:55:41.257998+0000","last_clean":"2024-05-20T17:55:41.257998+0000","last_became_active":"2024-05-20T17:55:40.268295+0000","last_became_peered":"2024-05-20T17:55:40.268295+0000","last_unstale":"2024-05-20T17:55:41.257998+0000","last_undegraded":"2024-05-20T17:55:41.257998+0000","last_fullsized":"2024-05-20T17:55:41.257998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:43.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965810+0000","last_change":"2024-05-20T17:55:40.278388+0000","last_active":"2024-05-20T17:55:41.965810+0000","last_peered":"2024-05-20T17:55:41.965810+0000","last_clean":"2024-05-20T17:55:41.965810+0000","last_became_active":"2024-05-20T17:55:40.278061+0000","last_became_peered":"2024-05-20T17:55:40.278061+0000","last_unstale":"2024-05-20T17:55:41.965810+0000","last_undegraded":"2024-05-20T17:55:41.965810+0000","last_fullsized":"2024-05-20T17:55:41.965810+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.270276+0000","last_change":"2024-05-20T17:55:39.270276+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.270276+0000","last_undegraded":"2024-05-20T17:55:39.270276+0000","last_fullsized":"2024-05-20T17:55:39.270276+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254404+0000","last_change":"2024-05-20T17:55:40.282267+0000","last_active":"2024-05-20T17:55:41.254404+0000","last_peered":"2024-05-20T17:55:41.254404+0000","last_clean":"2024-05-20T17:55:41.254404+0000","last_became_active":"2024-05-20T17:55:40.281957+0000","last_became_peered":"2024-05-20T17:55:40.281957+0000","last_unstale":"2024-05-20T17:55:41.254404+0000","last_undegraded":"2024-05-20T17:55:41.254404+0000","last_fullsized":"2024-05-20T17:55:41.254404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:36.957704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254821+0000","last_change":"2024-05-20T17:55:40.277468+0000","last_active":"2024-05-20T17:55:41.254821+0000","last_peered":"2024-05-20T17:55:41.254821+0000","last_clean":"2024-05-20T17:55:41.254821+0000","last_became_active":"2024-05-20T17:55:40.276903+0000","last_became_peered":"2024-05-20T17:55:40.276903+0000","last_unstale":"2024-05-20T17:55:41.254821+0000","last_undegraded":"2024-05-20T17:55:41.254821+0000","last_fullsized":"2024-05-20T17:55:41.254821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:02.671800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965875+0000","last_change":"2024-05-20T17:55:40.282130+0000","last_active":"2024-05-20T17:55:41.965875+0000","last_peered":"2024-05-20T17:55:41.965875+0000","last_clean":"2024-05-20T17:55:41.965875+0000","last_became_active":"2024-05-20T17:55:40.281789+0000","last_became_peered":"2024-05-20T17:55:40.281789+0000","last_unstale":"2024-05-20T17:55:41.965875+0000","last_undegraded":"2024-05-20T17:55:41.965875+0000","last_fullsized":"2024-05-20T17:55:41.965875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257338+0000","last_change":"2024-05-20T17:55:40.276661+0000","last_active":"2024-05-20T17:55:41.257338+0000","last_peered":"2024-05-20T17:55:41.257338+0000","last_clean":"2024-05-20T17:55:41.257338+0000","last_became_active":"2024-05-20T17:55:40.276358+0000","last_became_peered":"2024-05-20T17:55:40.276358+0000","last_unstale":"2024-05-20T17:55:41.257338+0000","last_undegraded":"2024-05-20T17:55:41.257338+0000","last_fullsized":"2024-05-20T17:55:41.257338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:33.789874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254780+0000","last_change":"2024-05-20T17:55:40.272120+0000","last_active":"2024-05-20T17:55:41.254780+0000","last_peered":"2024-05-20T17:55:41.254780+0000","last_clean":"2024-05-20T17:55:41.254780+0000","last_became_active":"2024-05-20T17:55:40.271802+0000","last_became_peered":"2024-05-20T17:55:40.271802+0000","last_unstale":"2024-05-20T17:55:41.254780+0000","last_undegraded":"2024-05-20T17:55:41.254780+0000","last_fullsized":"2024-05-20T17:55:41.254780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:00.485107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966039+0000","last_change":"2024-05-20T17:55:40.280972+0000","last_active":"2024-05-20T17:55:41.966039+0000","last_peered":"2024-05-20T17:55:41.966039+0000","last_clean":"2024-05-20T17:55:41.966039+0000","last_became_active":"2024-05-20T17:55:40.280674+0000","last_became_peered":"2024-05-20T17:55:40.280674+0000","last_unstale":"2024-05-20T17:55:41.966039+0000","last_undegraded":"2024-05-20T17:55:41.966039+0000","last_fullsized":"2024-05-20T17:55:41.966039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.272813+0000","last_change":"2024-05-20T17:55:39.272813+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.272813+0000","last_undegraded":"2024-05-20T17:55:39.272813+0000","last_fullsized":"2024-05-20T17:55:39.272813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966878+0000","last_change":"2024-05-20T17:55:40.278390+0000","last_active":"2024-05-20T17:55:41.966878+0000","last_peered":"2024-05-20T17:55:41.966878+0000","last_clean":"2024-05-20T17:55:41.966878+0000","last_became_active":"2024-05-20T17:55:40.278036+0000","last_became_peered":"2024-05-20T17:55:40.278036+0000","last_unstale":"2024-05-20T17:55:41.966878+0000","last_undegraded":"2024-05-20T17:55:41.966878+0000","last_fullsized":"2024-05-20T17:55:41.966878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:32.756855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965699+0000","last_change":"2024-05-20T17:55:40.271972+0000","last_active":"2024-05-20T17:55:41.965699+0000","last_peered":"2024-05-20T17:55:41.965699+0000","last_clean":"2024-05-20T17:55:41.965699+0000","last_became_active":"2024-05-20T17:55:40.271620+0000","last_became_peered":"2024-05-20T17:55:40.271620+0000","last_unstale":"2024-05-20T17:55:41.965699+0000","last_undegraded":"2024-05-20T17:55:41.965699+0000","last_fullsized":"2024-05-20T17:55:41.965699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.276707+0000","last_change":"2024-05-20T17:55:39.276707+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.276707+0000","last_undegraded":"2024-05-20T17:55:39.276707+0000","last_fullsized":"2024-05-20T17:55:39.276707+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966717+0000","last_change":"2024-05-20T17:55:40.282461+0000","last_active":"2024-05-20T17:55:41.966717+0000","last_peered":"2024-05-20T17:55:41.966717+0000","last_clean":"2024-05-20T17:55:41.966717+0000","last_became_active":"2024-05-20T17:55:40.282146+0000","last_became_peered":"2024-05-20T17:55:40.282146+0000","last_unstale":"2024-05-20T17:55:41.966717+0000","last_undegraded":"2024-05-20T17:55:41.966717+0000","last_fullsized":"2024-05-20T17:55:41.966717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:59:35.697636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.273100+0000","last_change":"2024-05-20T17:55:39.273100+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.273100+0000","last_undegraded":"2024-05-20T17:55:39.273100+0000","last_fullsized":"2024-05-20T17:55:39.273100+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557223+0000","last_change":"2024-05-20T17:55:40.266526+0000","last_active":"2024-05-20T17:55:41.557223+0000","last_peered":"2024-05-20T17:55:41.557223+0000","last_clean":"2024-05-20T17:55:41.557223+0000","last_became_active":"2024-05-20T17:55:40.265920+0000","last_became_peered":"2024-05-20T17:55:40.265920+0000","last_unstale":"2024-05-20T17:55:41.557223+0000","last_undegraded":"2024-05-20T17:55:41.557223+0000","last_fullsized":"2024-05-20T17:55:41.557223+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557207+0000","last_change":"2024-05-20T17:55:40.271285+0000","last_active":"2024-05-20T17:55:41.557207+0000","last_peered":"2024-05-20T17:55:41.557207+0000","last_clean":"2024-05-20T17:55:41.557207+0000","last_became_active":"2024-05-20T17:55:40.270660+0000","last_became_peered":"2024-05-20T17:55:40.270660+0000","last_unstale":"2024-05-20T17:55:41.557207+0000","last_undegraded":"2024-05-20T17:55:41.557207+0000","last_fullsized":"2024-05-20T17:55:41.557207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254365+0000","last_change":"2024-05-20T17:55:40.282955+0000","last_active":"2024-05-20T17:55:41.254365+0000","last_peered":"2024-05-20T17:55:41.254365+0000","last_clean":"2024-05-20T17:55:41.254365+0000","last_became_active":"2024-05-20T17:55:40.282609+0000","last_became_peered":"2024-05-20T17:55:40.282609+0000","last_unstale":"2024-05-20T17:55:41.254365+0000","last_undegraded":"2024-05-20T17:55:41.254365+0000","last_fullsized":"2024-05-20T17:55:41.254365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:15.702355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257167+0000","last_change":"2024-05-20T17:55:40.277466+0000","last_active":"2024-05-20T17:55:41.257167+0000","last_peered":"2024-05-20T17:55:41.257167+0000","last_clean":"2024-05-20T17:55:41.257167+0000","last_became_active":"2024-05-20T17:55:40.277117+0000","last_became_peered":"2024-05-20T17:55:40.277117+0000","last_unstale":"2024-05-20T17:55:41.257167+0000","last_undegraded":"2024-05-20T17:55:41.257167+0000","last_fullsized":"2024-05-20T17:55:41.257167+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:35:09.265029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T17:55:39.242479+0000","last_change":"2024-05-20T17:55:39.242479+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.242479+0000","last_undegraded":"2024-05-20T17:55:39.242479+0000","last_fullsized":"2024-05-20T17:55:39.242479+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.267813+0000","last_change":"2024-05-20T17:55:39.267813+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.267813+0000","last_undegraded":"2024-05-20T17:55:39.267813+0000","last_fullsized":"2024-05-20T17:55:39.267813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254723+0000","last_change":"2024-05-20T17:55:40.270685+0000","last_active":"2024-05-20T17:55:41.254723+0000","last_peered":"2024-05-20T17:55:41.254723+0000","last_clean":"2024-05-20T17:55:41.254723+0000","last_became_active":"2024-05-20T17:55:40.270370+0000","last_became_peered":"2024-05-20T17:55:40.270370+0000","last_unstale":"2024-05-20T17:55:41.254723+0000","last_undegraded":"2024-05-20T17:55:41.254723+0000","last_fullsized":"2024-05-20T17:55:41.254723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:07.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966227+0000","last_change":"2024-05-20T17:55:40.276848+0000","last_active":"2024-05-20T17:55:41.966227+0000","last_peered":"2024-05-20T17:55:41.966227+0000","last_clean":"2024-05-20T17:55:41.966227+0000","last_became_active":"2024-05-20T17:55:40.276542+0000","last_became_peered":"2024-05-20T17:55:40.276542+0000","last_unstale":"2024-05-20T17:55:41.966227+0000","last_undegraded":"2024-05-20T17:55:41.966227+0000","last_fullsized":"2024-05-20T17:55:41.966227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557367+0000","last_change":"2024-05-20T17:55:40.267011+0000","last_active":"2024-05-20T17:55:41.557367+0000","last_peered":"2024-05-20T17:55:41.557367+0000","last_clean":"2024-05-20T17:55:41.557367+0000","last_became_active":"2024-05-20T17:55:40.266683+0000","last_became_peered":"2024-05-20T17:55:40.266683+0000","last_unstale":"2024-05-20T17:55:41.557367+0000","last_undegraded":"2024-05-20T17:55:41.557367+0000","last_fullsized":"2024-05-20T17:55:41.557367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.265869+0000","last_change":"2024-05-20T17:55:39.265869+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.265869+0000","last_undegraded":"2024-05-20T17:55:39.265869+0000","last_fullsized":"2024-05-20T17:55:39.265869+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966369+0000","last_change":"2024-05-20T17:55:40.282635+0000","last_active":"2024-05-20T17:55:41.966369+0000","last_peered":"2024-05-20T17:55:41.966369+0000","last_clean":"2024-05-20T17:55:41.966369+0000","last_became_active":"2024-05-20T17:55:40.281020+0000","last_became_peered":"2024-05-20T17:55:40.281020+0000","last_unstale":"2024-05-20T17:55:41.966369+0000","last_undegraded":"2024-05-20T17:55:41.966369+0000","last_fullsized":"2024-05-20T17:55:41.966369+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.265335+0000","last_change":"2024-05-20T17:55:39.265335+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.265335+0000","last_undegraded":"2024-05-20T17:55:39.265335+0000","last_fullsized":"2024-05-20T17:55:39.265335+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966105+0000","last_change":"2024-05-20T17:55:40.271887+0000","last_active":"2024-05-20T17:55:41.966105+0000","last_peered":"2024-05-20T17:55:41.966105+0000","last_clean":"2024-05-20T17:55:41.966105+0000","last_became_active":"2024-05-20T17:55:40.270696+0000","last_became_peered":"2024-05-20T17:55:40.270696+0000","last_unstale":"2024-05-20T17:55:41.966105+0000","last_undegraded":"2024-05-20T17:55:41.966105+0000","last_fullsized":"2024-05-20T17:55:41.966105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965868+0000","last_change":"2024-05-20T17:55:40.275752+0000","last_active":"2024-05-20T17:55:41.965868+0000","last_peered":"2024-05-20T17:55:41.965868+0000","last_clean":"2024-05-20T17:55:41.965868+0000","last_became_active":"2024-05-20T17:55:40.275317+0000","last_became_peered":"2024-05-20T17:55:40.275317+0000","last_unstale":"2024-05-20T17:55:41.965868+0000","last_undegraded":"2024-05-20T17:55:41.965868+0000","last_fullsized":"2024-05-20T17:55:41.965868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557249+0000","last_change":"2024-05-20T17:55:39.270058+0000","last_active":"2024-05-20T17:55:41.557249+0000","last_peered":"2024-05-20T17:55:41.557249+0000","last_clean":"2024-05-20T17:55:41.557249+0000","last_became_active":"2024-05-20T17:55:39.269730+0000","last_became_peered":"2024-05-20T17:55:39.269730+0000","last_unstale":"2024-05-20T17:55:41.557249+0000","last_undegraded":"2024-05-20T17:55:41.557249+0000","last_fullsized":"2024-05-20T17:55:41.557249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966028+0000","last_change":"2024-05-20T17:55:40.274646+0000","last_active":"2024-05-20T17:55:41.966028+0000","last_peered":"2024-05-20T17:55:41.966028+0000","last_clean":"2024-05-20T17:55:41.966028+0000","last_became_active":"2024-05-20T17:55:40.274299+0000","last_became_peered":"2024-05-20T17:55:40.274299+0000","last_unstale":"2024-05-20T17:55:41.966028+0000","last_undegraded":"2024-05-20T17:55:41.966028+0000","last_fullsized":"2024-05-20T17:55:41.966028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965800+0000","last_change":"2024-05-20T17:55:39.271593+0000","last_active":"2024-05-20T17:55:41.965800+0000","last_peered":"2024-05-20T17:55:41.965800+0000","last_clean":"2024-05-20T17:55:41.965800+0000","last_became_active":"2024-05-20T17:55:39.271252+0000","last_became_peered":"2024-05-20T17:55:39.271252+0000","last_unstale":"2024-05-20T17:55:41.965800+0000","last_undegraded":"2024-05-20T17:55:41.965800+0000","last_fullsized":"2024-05-20T17:55:41.965800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557093+0000","last_change":"2024-05-20T17:55:40.268788+0000","last_active":"2024-05-20T17:55:41.557093+0000","last_peered":"2024-05-20T17:55:41.557093+0000","last_clean":"2024-05-20T17:55:41.557093+0000","last_became_active":"2024-05-20T17:55:40.268438+0000","last_became_peered":"2024-05-20T17:55:40.268438+0000","last_unstale":"2024-05-20T17:55:41.557093+0000","last_undegraded":"2024-05-20T17:55:41.557093+0000","last_fullsized":"2024-05-20T17:55:41.557093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966191+0000","last_change":"2024-05-20T17:55:39.273435+0000","last_active":"2024-05-20T17:55:41.966191+0000","last_peered":"2024-05-20T17:55:41.966191+0000","last_clean":"2024-05-20T17:55:41.966191+0000","last_became_active":"2024-05-20T17:55:39.272038+0000","last_became_peered":"2024-05-20T17:55:39.272038+0000","last_unstale":"2024-05-20T17:55:41.966191+0000","last_undegraded":"2024-05-20T17:55:41.966191+0000","last_fullsized":"2024-05-20T17:55:41.966191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254607+0000","last_change":"2024-05-20T17:55:40.269504+0000","last_active":"2024-05-20T17:55:41.254607+0000","last_peered":"2024-05-20T17:55:41.254607+0000","last_clean":"2024-05-20T17:55:41.254607+0000","last_became_active":"2024-05-20T17:55:40.269183+0000","last_became_peered":"2024-05-20T17:55:40.269183+0000","last_unstale":"2024-05-20T17:55:41.254607+0000","last_undegraded":"2024-05-20T17:55:41.254607+0000","last_fullsized":"2024-05-20T17:55:41.254607+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:13:50.189523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966477+0000","last_change":"2024-05-20T17:55:39.271665+0000","last_active":"2024-05-20T17:55:41.966477+0000","last_peered":"2024-05-20T17:55:41.966477+0000","last_clean":"2024-05-20T17:55:41.966477+0000","last_became_active":"2024-05-20T17:55:39.271355+0000","last_became_peered":"2024-05-20T17:55:39.271355+0000","last_unstale":"2024-05-20T17:55:41.966477+0000","last_undegraded":"2024-05-20T17:55:41.966477+0000","last_fullsized":"2024-05-20T17:55:41.966477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258077+0000","last_change":"2024-05-20T17:55:40.277184+0000","last_active":"2024-05-20T17:55:41.258077+0000","last_peered":"2024-05-20T17:55:41.258077+0000","last_clean":"2024-05-20T17:55:41.258077+0000","last_became_active":"2024-05-20T17:55:40.276858+0000","last_became_peered":"2024-05-20T17:55:40.276858+0000","last_unstale":"2024-05-20T17:55:41.258077+0000","last_undegraded":"2024-05-20T17:55:41.258077+0000","last_fullsized":"2024-05-20T17:55:41.258077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.259300+0000","last_change":"2024-05-20T17:55:39.256734+0000","last_active":"2024-05-20T17:55:39.259300+0000","last_peered":"2024-05-20T17:55:39.259300+0000","last_clean":"2024-05-20T17:55:39.259300+0000","last_became_active":"2024-05-20T17:55:39.256389+0000","last_became_peered":"2024-05-20T17:55:39.256389+0000","last_unstale":"2024-05-20T17:55:39.259300+0000","last_undegraded":"2024-05-20T17:55:39.259300+0000","last_fullsized":"2024-05-20T17:55:39.259300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:22:46.780789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966181+0000","last_change":"2024-05-20T17:55:40.283253+0000","last_active":"2024-05-20T17:55:41.966181+0000","last_peered":"2024-05-20T17:55:41.966181+0000","last_clean":"2024-05-20T17:55:41.966181+0000","last_became_active":"2024-05-20T17:55:40.282357+0000","last_became_peered":"2024-05-20T17:55:40.282357+0000","last_unstale":"2024-05-20T17:55:41.966181+0000","last_undegraded":"2024-05-20T17:55:41.966181+0000","last_fullsized":"2024-05-20T17:55:41.966181+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257712+0000","last_change":"2024-05-20T17:55:39.267829+0000","last_active":"2024-05-20T17:55:41.257712+0000","last_peered":"2024-05-20T17:55:41.257712+0000","last_clean":"2024-05-20T17:55:41.257712+0000","last_became_active":"2024-05-20T17:55:39.267501+0000","last_became_peered":"2024-05-20T17:55:39.267501+0000","last_unstale":"2024-05-20T17:55:41.257712+0000","last_undegraded":"2024-05-20T17:55:41.257712+0000","last_fullsized":"2024-05-20T17:55:41.257712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254976+0000","last_change":"2024-05-20T17:55:40.267881+0000","last_active":"2024-05-20T17:55:41.254976+0000","last_peered":"2024-05-20T17:55:41.254976+0000","last_clean":"2024-05-20T17:55:41.254976+0000","last_became_active":"2024-05-20T17:55:40.267566+0000","last_became_peered":"2024-05-20T17:55:40.267566+0000","last_unstale":"2024-05-20T17:55:41.254976+0000","last_undegraded":"2024-05-20T17:55:41.254976+0000","last_fullsized":"2024-05-20T17:55:41.254976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:42.086335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557032+0000","last_change":"2024-05-20T17:55:39.266116+0000","last_active":"2024-05-20T17:55:41.557032+0000","last_peered":"2024-05-20T17:55:41.557032+0000","last_clean":"2024-05-20T17:55:41.557032+0000","last_became_active":"2024-05-20T17:55:39.265728+0000","last_became_peered":"2024-05-20T17:55:39.265728+0000","last_unstale":"2024-05-20T17:55:41.557032+0000","last_undegraded":"2024-05-20T17:55:41.557032+0000","last_fullsized":"2024-05-20T17:55:41.557032+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:05:12.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966819+0000","last_change":"2024-05-20T17:55:40.286432+0000","last_active":"2024-05-20T17:55:41.966819+0000","last_peered":"2024-05-20T17:55:41.966819+0000","last_clean":"2024-05-20T17:55:41.966819+0000","last_became_active":"2024-05-20T17:55:40.286118+0000","last_became_peered":"2024-05-20T17:55:40.286118+0000","last_unstale":"2024-05-20T17:55:41.966819+0000","last_undegraded":"2024-05-20T17:55:41.966819+0000","last_fullsized":"2024-05-20T17:55:41.966819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:22.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.276136+0000","last_change":"2024-05-20T17:55:39.276136+0000","last_active":"2024-05-20T17:55:39.276136+0000","last_peered":"2024-05-20T17:55:39.276136+0000","last_clean":"2024-05-20T17:55:39.276136+0000","last_became_active":"2024-05-20T17:55:39.275769+0000","last_became_peered":"2024-05-20T17:55:39.275769+0000","last_unstale":"2024-05-20T17:55:39.276136+0000","last_undegraded":"2024-05-20T17:55:39.276136+0000","last_fullsized":"2024-05-20T17:55:39.276136+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257645+0000","last_change":"2024-05-20T17:55:40.273680+0000","last_active":"2024-05-20T17:55:41.257645+0000","last_peered":"2024-05-20T17:55:41.257645+0000","last_clean":"2024-05-20T17:55:41.257645+0000","last_became_active":"2024-05-20T17:55:40.273073+0000","last_became_peered":"2024-05-20T17:55:40.273073+0000","last_unstale":"2024-05-20T17:55:41.257645+0000","last_undegraded":"2024-05-20T17:55:41.257645+0000","last_fullsized":"2024-05-20T17:55:41.257645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:03.789329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966609+0000","last_change":"2024-05-20T17:55:39.267936+0000","last_active":"2024-05-20T17:55:41.966609+0000","last_peered":"2024-05-20T17:55:41.966609+0000","last_clean":"2024-05-20T17:55:41.966609+0000","last_became_active":"2024-05-20T17:55:39.267565+0000","last_became_peered":"2024-05-20T17:55:39.267565+0000","last_unstale":"2024-05-20T17:55:41.966609+0000","last_undegraded":"2024-05-20T17:55:41.966609+0000","last_fullsized":"2024-05-20T17:55:41.966609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965996+0000","last_change":"2024-05-20T17:55:40.259853+0000","last_active":"2024-05-20T17:55:41.965996+0000","last_peered":"2024-05-20T17:55:41.965996+0000","last_clean":"2024-05-20T17:55:41.965996+0000","last_became_active":"2024-05-20T17:55:40.259465+0000","last_became_peered":"2024-05-20T17:55:40.259465+0000","last_unstale":"2024-05-20T17:55:41.965996+0000","last_undegraded":"2024-05-20T17:55:41.965996+0000","last_fullsized":"2024-05-20T17:55:41.965996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258204+0000","last_change":"2024-05-20T17:55:39.258507+0000","last_active":"2024-05-20T17:55:41.258204+0000","last_peered":"2024-05-20T17:55:41.258204+0000","last_clean":"2024-05-20T17:55:41.258204+0000","last_became_active":"2024-05-20T17:55:39.258195+0000","last_became_peered":"2024-05-20T17:55:39.258195+0000","last_unstale":"2024-05-20T17:55:41.258204+0000","last_undegraded":"2024-05-20T17:55:41.258204+0000","last_fullsized":"2024-05-20T17:55:41.258204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.263457+0000","last_change":"2024-05-20T17:55:39.263457+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.263457+0000","last_undegraded":"2024-05-20T17:55:39.263457+0000","last_fullsized":"2024-05-20T17:55:39.263457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966420+0000","last_change":"2024-05-20T17:55:39.271032+0000","last_active":"2024-05-20T17:55:41.966420+0000","last_peered":"2024-05-20T17:55:41.966420+0000","last_clean":"2024-05-20T17:55:41.966420+0000","last_became_active":"2024-05-20T17:55:39.270719+0000","last_became_peered":"2024-05-20T17:55:39.270719+0000","last_unstale":"2024-05-20T17:55:41.966420+0000","last_undegraded":"2024-05-20T17:55:41.966420+0000","last_fullsized":"2024-05-20T17:55:41.966420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258048+0000","last_change":"2024-05-20T17:55:40.266407+0000","last_active":"2024-05-20T17:55:41.258048+0000","last_peered":"2024-05-20T17:55:41.258048+0000","last_clean":"2024-05-20T17:55:41.258048+0000","last_became_active":"2024-05-20T17:55:40.266040+0000","last_became_peered":"2024-05-20T17:55:40.266040+0000","last_unstale":"2024-05-20T17:55:41.258048+0000","last_undegraded":"2024-05-20T17:55:41.258048+0000","last_fullsized":"2024-05-20T17:55:41.258048+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:18.657015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254993+0000","last_change":"2024-05-20T17:55:39.275133+0000","last_active":"2024-05-20T17:55:41.254993+0000","last_peered":"2024-05-20T17:55:41.254993+0000","last_clean":"2024-05-20T17:55:41.254993+0000","last_became_active":"2024-05-20T17:55:39.274819+0000","last_became_peered":"2024-05-20T17:55:39.274819+0000","last_unstale":"2024-05-20T17:55:41.254993+0000","last_undegraded":"2024-05-20T17:55:41.254993+0000","last_fullsized":"2024-05-20T17:55:41.254993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:10.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966204+0000","last_change":"2024-05-20T17:55:40.268720+0000","last_active":"2024-05-20T17:55:41.966204+0000","last_peered":"2024-05-20T17:55:41.966204+0000","last_clean":"2024-05-20T17:55:41.966204+0000","last_became_active":"2024-05-20T17:55:40.268272+0000","last_became_peered":"2024-05-20T17:55:40.268272+0000","last_unstale":"2024-05-20T17:55:41.966204+0000","last_undegraded":"2024-05-20T17:55:41.966204+0000","last_fullsized":"2024-05-20T17:55:41.966204+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.276770+0000","last_change":"2024-05-20T17:55:39.274602+0000","last_active":"2024-05-20T17:55:39.276770+0000","last_peered":"2024-05-20T17:55:39.276770+0000","last_clean":"2024-05-20T17:55:39.276770+0000","last_became_active":"2024-05-20T17:55:39.274202+0000","last_became_peered":"2024-05-20T17:55:39.274202+0000","last_unstale":"2024-05-20T17:55:39.276770+0000","last_undegraded":"2024-05-20T17:55:39.276770+0000","last_fullsized":"2024-05-20T17:55:39.276770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.264058+0000","last_change":"2024-05-20T17:55:39.264058+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.264058+0000","last_undegraded":"2024-05-20T17:55:39.264058+0000","last_fullsized":"2024-05-20T17:55:39.264058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557215+0000","last_change":"2024-05-20T17:55:39.278757+0000","last_active":"2024-05-20T17:55:41.557215+0000","last_peered":"2024-05-20T17:55:41.557215+0000","last_clean":"2024-05-20T17:55:41.557215+0000","last_became_active":"2024-05-20T17:55:39.278446+0000","last_became_peered":"2024-05-20T17:55:39.278446+0000","last_unstale":"2024-05-20T17:55:41.557215+0000","last_undegraded":"2024-05-20T17:55:41.557215+0000","last_fullsized":"2024-05-20T17:55:41.557215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254913+0000","last_change":"2024-05-20T17:55:40.277815+0000","last_active":"2024-05-20T17:55:41.254913+0000","last_peered":"2024-05-20T17:55:41.254913+0000","last_clean":"2024-05-20T17:55:41.254913+0000","last_became_active":"2024-05-20T17:55:40.277472+0000","last_became_peered":"2024-05-20T17:55:40.277472+0000","last_unstale":"2024-05-20T17:55:41.254913+0000","last_undegraded":"2024-05-20T17:55:41.254913+0000","last_fullsized":"2024-05-20T17:55:41.254913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:07.635141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966866+0000","last_change":"2024-05-20T17:55:39.269641+0000","last_active":"2024-05-20T17:55:41.966866+0000","last_peered":"2024-05-20T17:55:41.966866+0000","last_clean":"2024-05-20T17:55:41.966866+0000","last_became_active":"2024-05-20T17:55:39.269150+0000","last_became_peered":"2024-05-20T17:55:39.269150+0000","last_unstale":"2024-05-20T17:55:41.966866+0000","last_undegraded":"2024-05-20T17:55:41.966866+0000","last_fullsized":"2024-05-20T17:55:41.966866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:42.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.264805+0000","last_change":"2024-05-20T17:55:39.264805+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.264805+0000","last_undegraded":"2024-05-20T17:55:39.264805+0000","last_fullsized":"2024-05-20T17:55:39.264805+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254512+0000","last_change":"2024-05-20T17:55:39.275778+0000","last_active":"2024-05-20T17:55:41.254512+0000","last_peered":"2024-05-20T17:55:41.254512+0000","last_clean":"2024-05-20T17:55:41.254512+0000","last_became_active":"2024-05-20T17:55:39.275467+0000","last_became_peered":"2024-05-20T17:55:39.275467+0000","last_unstale":"2024-05-20T17:55:41.254512+0000","last_undegraded":"2024-05-20T17:55:41.254512+0000","last_fullsized":"2024-05-20T17:55:41.254512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:55.528047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254470+0000","last_change":"2024-05-20T17:55:40.264575+0000","last_active":"2024-05-20T17:55:41.254470+0000","last_peered":"2024-05-20T17:55:41.254470+0000","last_clean":"2024-05-20T17:55:41.254470+0000","last_became_active":"2024-05-20T17:55:40.264241+0000","last_became_peered":"2024-05-20T17:55:40.264241+0000","last_unstale":"2024-05-20T17:55:41.254470+0000","last_undegraded":"2024-05-20T17:55:41.254470+0000","last_fullsized":"2024-05-20T17:55:41.254470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:06.124095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":6,"reported_epoch":49,"state":"active","last_fresh":"2024-05-20T17:55:39.277815+0000","last_change":"2024-05-20T17:55:39.277743+0000","last_active":"2024-05-20T17:55:39.277815+0000","last_peered":"2024-05-20T17:55:39.277815+0000","last_clean":"2024-05-20T17:55:38.240371+0000","last_became_active":"2024-05-20T17:55:39.277743+0000","last_became_peered":"2024-05-20T17:55:39.277743+0000","last_unstale":"2024-05-20T17:55:39.277815+0000","last_undegraded":"2024-05-20T17:55:39.277815+0000","last_fullsized":"2024-05-20T17:55:39.277815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965685+0000","last_change":"2024-05-20T17:55:40.277654+0000","last_active":"2024-05-20T17:55:41.965685+0000","last_peered":"2024-05-20T17:55:41.965685+0000","last_clean":"2024-05-20T17:55:41.965685+0000","last_became_active":"2024-05-20T17:55:40.277356+0000","last_became_peered":"2024-05-20T17:55:40.277356+0000","last_unstale":"2024-05-20T17:55:41.965685+0000","last_undegraded":"2024-05-20T17:55:41.965685+0000","last_fullsized":"2024-05-20T17:55:41.965685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257414+0000","last_change":"2024-05-20T17:55:39.265979+0000","last_active":"2024-05-20T17:55:41.257414+0000","last_peered":"2024-05-20T17:55:41.257414+0000","last_clean":"2024-05-20T17:55:41.257414+0000","last_became_active":"2024-05-20T17:55:39.265679+0000","last_became_peered":"2024-05-20T17:55:39.265679+0000","last_unstale":"2024-05-20T17:55:41.257414+0000","last_undegraded":"2024-05-20T17:55:41.257414+0000","last_fullsized":"2024-05-20T17:55:41.257414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:34.833740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257757+0000","last_change":"2024-05-20T17:55:40.277228+0000","last_active":"2024-05-20T17:55:41.257757+0000","last_peered":"2024-05-20T17:55:41.257757+0000","last_clean":"2024-05-20T17:55:41.257757+0000","last_became_active":"2024-05-20T17:55:40.276880+0000","last_became_peered":"2024-05-20T17:55:40.276880+0000","last_unstale":"2024-05-20T17:55:41.257757+0000","last_undegraded":"2024-05-20T17:55:41.257757+0000","last_fullsized":"2024-05-20T17:55:41.257757+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:39.200975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557190+0000","last_change":"2024-05-20T17:55:39.273470+0000","last_active":"2024-05-20T17:55:41.557190+0000","last_peered":"2024-05-20T17:55:41.557190+0000","last_clean":"2024-05-20T17:55:41.557190+0000","last_became_active":"2024-05-20T17:55:39.273151+0000","last_became_peered":"2024-05-20T17:55:39.273151+0000","last_unstale":"2024-05-20T17:55:41.557190+0000","last_undegraded":"2024-05-20T17:55:41.557190+0000","last_fullsized":"2024-05-20T17:55:41.557190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966012+0000","last_change":"2024-05-20T17:55:40.272795+0000","last_active":"2024-05-20T17:55:41.966012+0000","last_peered":"2024-05-20T17:55:41.966012+0000","last_clean":"2024-05-20T17:55:41.966012+0000","last_became_active":"2024-05-20T17:55:40.272473+0000","last_became_peered":"2024-05-20T17:55:40.272473+0000","last_unstale":"2024-05-20T17:55:41.966012+0000","last_undegraded":"2024-05-20T17:55:41.966012+0000","last_fullsized":"2024-05-20T17:55:41.966012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557373+0000","last_change":"2024-05-20T17:55:39.266166+0000","last_active":"2024-05-20T17:55:41.557373+0000","last_peered":"2024-05-20T17:55:41.557373+0000","last_clean":"2024-05-20T17:55:41.557373+0000","last_became_active":"2024-05-20T17:55:39.265830+0000","last_became_peered":"2024-05-20T17:55:39.265830+0000","last_unstale":"2024-05-20T17:55:41.557373+0000","last_undegraded":"2024-05-20T17:55:41.557373+0000","last_fullsized":"2024-05-20T17:55:41.557373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:35:39.407657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966454+0000","last_change":"2024-05-20T17:55:40.264272+0000","last_active":"2024-05-20T17:55:41.966454+0000","last_peered":"2024-05-20T17:55:41.966454+0000","last_clean":"2024-05-20T17:55:41.966454+0000","last_became_active":"2024-05-20T17:55:40.263229+0000","last_became_peered":"2024-05-20T17:55:40.263229+0000","last_unstale":"2024-05-20T17:55:41.966454+0000","last_undegraded":"2024-05-20T17:55:41.966454+0000","last_fullsized":"2024-05-20T17:55:41.966454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966167+0000","last_change":"2024-05-20T17:55:39.265914+0000","last_active":"2024-05-20T17:55:41.966167+0000","last_peered":"2024-05-20T17:55:41.966167+0000","last_clean":"2024-05-20T17:55:41.966167+0000","last_became_active":"2024-05-20T17:55:39.265583+0000","last_became_peered":"2024-05-20T17:55:39.265583+0000","last_unstale":"2024-05-20T17:55:41.966167+0000","last_undegraded":"2024-05-20T17:55:41.966167+0000","last_fullsized":"2024-05-20T17:55:41.966167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557422+0000","last_change":"2024-05-20T17:55:40.270988+0000","last_active":"2024-05-20T17:55:41.557422+0000","last_peered":"2024-05-20T17:55:41.557422+0000","last_clean":"2024-05-20T17:55:41.557422+0000","last_became_active":"2024-05-20T17:55:40.270582+0000","last_became_peered":"2024-05-20T17:55:40.270582+0000","last_unstale":"2024-05-20T17:55:41.557422+0000","last_undegraded":"2024-05-20T17:55:41.557422+0000","last_fullsized":"2024-05-20T17:55:41.557422+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254285+0000","last_change":"2024-05-20T17:55:39.272103+0000","last_active":"2024-05-20T17:55:41.254285+0000","last_peered":"2024-05-20T17:55:41.254285+0000","last_clean":"2024-05-20T17:55:41.254285+0000","last_became_active":"2024-05-20T17:55:39.271787+0000","last_became_peered":"2024-05-20T17:55:39.271787+0000","last_unstale":"2024-05-20T17:55:41.254285+0000","last_undegraded":"2024-05-20T17:55:41.254285+0000","last_fullsized":"2024-05-20T17:55:41.254285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:41.864783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.258373+0000","last_change":"2024-05-20T17:55:39.258373+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.258373+0000","last_undegraded":"2024-05-20T17:55:39.258373+0000","last_fullsized":"2024-05-20T17:55:39.258373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.263524+0000","last_change":"2024-05-20T17:55:39.262518+0000","last_active":"2024-05-20T17:55:39.263524+0000","last_peered":"2024-05-20T17:55:39.263524+0000","last_clean":"2024-05-20T17:55:39.263524+0000","last_became_active":"2024-05-20T17:55:39.262191+0000","last_became_peered":"2024-05-20T17:55:39.262191+0000","last_unstale":"2024-05-20T17:55:39.263524+0000","last_undegraded":"2024-05-20T17:55:39.263524+0000","last_fullsized":"2024-05-20T17:55:39.263524+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965915+0000","last_change":"2024-05-20T17:55:40.275681+0000","last_active":"2024-05-20T17:55:41.965915+0000","last_peered":"2024-05-20T17:55:41.965915+0000","last_clean":"2024-05-20T17:55:41.965915+0000","last_became_active":"2024-05-20T17:55:40.275360+0000","last_became_peered":"2024-05-20T17:55:40.275360+0000","last_unstale":"2024-05-20T17:55:41.965915+0000","last_undegraded":"2024-05-20T17:55:41.965915+0000","last_fullsized":"2024-05-20T17:55:41.965915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.256993+0000","last_change":"2024-05-20T17:55:39.269421+0000","last_active":"2024-05-20T17:55:41.256993+0000","last_peered":"2024-05-20T17:55:41.256993+0000","last_clean":"2024-05-20T17:55:41.256993+0000","last_became_active":"2024-05-20T17:55:39.269101+0000","last_became_peered":"2024-05-20T17:55:39.269101+0000","last_unstale":"2024-05-20T17:55:41.256993+0000","last_undegraded":"2024-05-20T17:55:41.256993+0000","last_fullsized":"2024-05-20T17:55:41.256993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:11.791684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966253+0000","last_change":"2024-05-20T17:55:40.267783+0000","last_active":"2024-05-20T17:55:41.966253+0000","last_peered":"2024-05-20T17:55:41.966253+0000","last_clean":"2024-05-20T17:55:41.966253+0000","last_became_active":"2024-05-20T17:55:40.267415+0000","last_became_peered":"2024-05-20T17:55:40.267415+0000","last_unstale":"2024-05-20T17:55:41.966253+0000","last_undegraded":"2024-05-20T17:55:41.966253+0000","last_fullsized":"2024-05-20T17:55:41.966253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557363+0000","last_change":"2024-05-20T17:55:39.280002+0000","last_active":"2024-05-20T17:55:41.557363+0000","last_peered":"2024-05-20T17:55:41.557363+0000","last_clean":"2024-05-20T17:55:41.557363+0000","last_became_active":"2024-05-20T17:55:39.279754+0000","last_became_peered":"2024-05-20T17:55:39.279754+0000","last_unstale":"2024-05-20T17:55:41.557363+0000","last_undegraded":"2024-05-20T17:55:41.557363+0000","last_fullsized":"2024-05-20T17:55:41.557363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:11:28.961264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965866+0000","last_change":"2024-05-20T17:55:40.268902+0000","last_active":"2024-05-20T17:55:41.965866+0000","last_peered":"2024-05-20T17:55:41.965866+0000","last_clean":"2024-05-20T17:55:41.965866+0000","last_became_active":"2024-05-20T17:55:40.268587+0000","last_became_peered":"2024-05-20T17:55:40.268587+0000","last_unstale":"2024-05-20T17:55:41.965866+0000","last_undegraded":"2024-05-20T17:55:41.965866+0000","last_fullsized":"2024-05-20T17:55:41.965866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966557+0000","last_change":"2024-05-20T17:55:39.274048+0000","last_active":"2024-05-20T17:55:41.966557+0000","last_peered":"2024-05-20T17:55:41.966557+0000","last_clean":"2024-05-20T17:55:41.966557+0000","last_became_active":"2024-05-20T17:55:39.273738+0000","last_became_peered":"2024-05-20T17:55:39.273738+0000","last_unstale":"2024-05-20T17:55:41.966557+0000","last_undegraded":"2024-05-20T17:55:41.966557+0000","last_fullsized":"2024-05-20T17:55:41.966557+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:07.062814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254624+0000","last_change":"2024-05-20T17:55:40.265532+0000","last_active":"2024-05-20T17:55:41.254624+0000","last_peered":"2024-05-20T17:55:41.254624+0000","last_clean":"2024-05-20T17:55:41.254624+0000","last_became_active":"2024-05-20T17:55:40.265164+0000","last_became_peered":"2024-05-20T17:55:40.265164+0000","last_unstale":"2024-05-20T17:55:41.254624+0000","last_undegraded":"2024-05-20T17:55:41.254624+0000","last_fullsized":"2024-05-20T17:55:41.254624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:15:38.124970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.262718+0000","last_change":"2024-05-20T17:55:39.260761+0000","last_active":"2024-05-20T17:55:39.262718+0000","last_peered":"2024-05-20T17:55:39.262718+0000","last_clean":"2024-05-20T17:55:39.262718+0000","last_became_active":"2024-05-20T17:55:39.260432+0000","last_became_peered":"2024-05-20T17:55:39.260432+0000","last_unstale":"2024-05-20T17:55:39.262718+0000","last_undegraded":"2024-05-20T17:55:39.262718+0000","last_fullsized":"2024-05-20T17:55:39.262718+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:08:37.860132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.259020+0000","last_change":"2024-05-20T17:55:39.259020+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.259020+0000","last_undegraded":"2024-05-20T17:55:39.259020+0000","last_fullsized":"2024-05-20T17:55:39.259020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254740+0000","last_change":"2024-05-20T17:55:39.272924+0000","last_active":"2024-05-20T17:55:41.254740+0000","last_peered":"2024-05-20T17:55:41.254740+0000","last_clean":"2024-05-20T17:55:41.254740+0000","last_became_active":"2024-05-20T17:55:39.272604+0000","last_became_peered":"2024-05-20T17:55:39.272604+0000","last_unstale":"2024-05-20T17:55:41.254740+0000","last_undegraded":"2024-05-20T17:55:41.254740+0000","last_fullsized":"2024-05-20T17:55:41.254740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.121415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966476+0000","last_change":"2024-05-20T17:55:40.270269+0000","last_active":"2024-05-20T17:55:41.966476+0000","last_peered":"2024-05-20T17:55:41.966476+0000","last_clean":"2024-05-20T17:55:41.966476+0000","last_became_active":"2024-05-20T17:55:40.269480+0000","last_became_peered":"2024-05-20T17:55:40.269480+0000","last_unstale":"2024-05-20T17:55:41.966476+0000","last_undegraded":"2024-05-20T17:55:41.966476+0000","last_fullsized":"2024-05-20T17:55:41.966476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254494+0000","last_change":"2024-05-20T17:55:39.270561+0000","last_active":"2024-05-20T17:55:41.254494+0000","last_peered":"2024-05-20T17:55:41.254494+0000","last_clean":"2024-05-20T17:55:41.254494+0000","last_became_active":"2024-05-20T17:55:39.270216+0000","last_became_peered":"2024-05-20T17:55:39.270216+0000","last_unstale":"2024-05-20T17:55:41.254494+0000","last_undegraded":"2024-05-20T17:55:41.254494+0000","last_fullsized":"2024-05-20T17:55:41.254494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:14.931204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-05-20T17:55:39.259825+0000","last_change":"2024-05-20T17:55:39.259825+0000","last_active":"2024-05-20T17:55:39.242479+0000","last_peered":"2024-05-20T17:55:39.242479+0000","last_clean":"2024-05-20T17:55:39.242479+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T17:55:39.259825+0000","last_undegraded":"2024-05-20T17:55:39.259825+0000","last_fullsized":"2024-05-20T17:55:39.259825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257596+0000","last_change":"2024-05-20T17:55:39.266935+0000","last_active":"2024-05-20T17:55:41.257596+0000","last_peered":"2024-05-20T17:55:41.257596+0000","last_clean":"2024-05-20T17:55:41.257596+0000","last_became_active":"2024-05-20T17:55:39.264958+0000","last_became_peered":"2024-05-20T17:55:39.264958+0000","last_unstale":"2024-05-20T17:55:41.257596+0000","last_undegraded":"2024-05-20T17:55:41.257596+0000","last_fullsized":"2024-05-20T17:55:41.257596+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254927+0000","last_change":"2024-05-20T17:55:40.266843+0000","last_active":"2024-05-20T17:55:41.254927+0000","last_peered":"2024-05-20T17:55:41.254927+0000","last_clean":"2024-05-20T17:55:41.254927+0000","last_became_active":"2024-05-20T17:55:40.266052+0000","last_became_peered":"2024-05-20T17:55:40.266052+0000","last_unstale":"2024-05-20T17:55:41.254927+0000","last_undegraded":"2024-05-20T17:55:41.254927+0000","last_fullsized":"2024-05-20T17:55:41.254927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:04.314309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966202+0000","last_change":"2024-05-20T17:55:39.270669+0000","last_active":"2024-05-20T17:55:41.966202+0000","last_peered":"2024-05-20T17:55:41.966202+0000","last_clean":"2024-05-20T17:55:41.966202+0000","last_became_active":"2024-05-20T17:55:39.270233+0000","last_became_peered":"2024-05-20T17:55:39.270233+0000","last_unstale":"2024-05-20T17:55:41.966202+0000","last_undegraded":"2024-05-20T17:55:41.966202+0000","last_fullsized":"2024-05-20T17:55:41.966202+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557129+0000","last_change":"2024-05-20T17:55:40.264890+0000","last_active":"2024-05-20T17:55:41.557129+0000","last_peered":"2024-05-20T17:55:41.557129+0000","last_clean":"2024-05-20T17:55:41.557129+0000","last_became_active":"2024-05-20T17:55:40.264196+0000","last_became_peered":"2024-05-20T17:55:40.264196+0000","last_unstale":"2024-05-20T17:55:41.557129+0000","last_undegraded":"2024-05-20T17:55:41.557129+0000","last_fullsized":"2024-05-20T17:55:41.557129+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-05-20T17:55:39.274803+0000","last_change":"2024-05-20T17:55:39.269301+0000","last_active":"2024-05-20T17:55:39.274803+0000","last_peered":"2024-05-20T17:55:39.274803+0000","last_clean":"2024-05-20T17:55:39.274803+0000","last_became_active":"2024-05-20T17:55:39.268957+0000","last_became_peered":"2024-05-20T17:55:39.268957+0000","last_unstale":"2024-05-20T17:55:39.274803+0000","last_undegraded":"2024-05-20T17:55:39.274803+0000","last_fullsized":"2024-05-20T17:55:39.274803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965845+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:55:41.965845+0000","last_peered":"2024-05-20T17:55:41.965845+0000","last_clean":"2024-05-20T17:55:41.965845+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:55:41.965845+0000","last_undegraded":"2024-05-20T17:55:41.965845+0000","last_fullsized":"2024-05-20T17:55:41.965845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":126,"acting":126,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2354,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":861144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":271304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":270652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":271234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":272264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":270812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1163264,"data_stored":840494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:55:46.229 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-20T17:55:46.231+0000 7f14b8ecc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:55:48.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:55:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.000+0000 7f5831ed8640 1 Processor -- start 2024-05-20T17:55:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.001+0000 7f5831ed8640 1 -- start start 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f5831ed8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f582c06d3d0 0x7f582c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f5831ed8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f582c0b8190 0x7f582c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f5831ed8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582c06dd20 con 0x7f582c162820 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f5831ed8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f582c0d0630 con 0x7f582c0b8190 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f5831ed8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f582c0d39c0 con 0x7f582c06d3d0 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f582bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f582c0b8190 0x7f582c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f582bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f582c0b8190 0x7f582c0b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34980/0 (socket says 172.21.15.6:34980) 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f582bfff640 1 -- 172.21.15.6:0/3377974390 learned_addr learned my addr 172.21.15.6:0/3377974390 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f582affd640 1 --2- 172.21.15.6:0/3377974390 >> v2:172.21.15.171:3300/0 conn(0x7f582c06d3d0 0x7f582c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f582bfff640 1 -- 172.21.15.6:0/3377974390 >> v2:172.21.15.171:3300/0 conn(0x7f582c06d3d0 msgr2=0x7f582c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f582bfff640 1 --2- 172.21.15.6:0/3377974390 >> v2:172.21.15.171:3300/0 conn(0x7f582c06d3d0 0x7f582c06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f582bfff640 1 -- 172.21.15.6:0/3377974390 >> v1:172.21.15.171:6789/0 conn(0x7f582c162820 legacy=0x7f582c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.002+0000 7f582bfff640 1 -- 172.21.15.6:0/3377974390 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c0d3ca0 con 0x7f582c0b8190 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.003+0000 7f582bfff640 1 --2- 172.21.15.6:0/3377974390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c0b8190 0x7f582c0b85a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f582c0d1230 tx=0x7f582402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a903e45558fa3a20 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.003+0000 7f582a7fc640 1 -- 172.21.15.6:0/3377974390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824036070 con 0x7f582c0b8190 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.003+0000 7f582a7fc640 1 -- 172.21.15.6:0/3377974390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5824031600 con 0x7f582c0b8190 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.003+0000 7f582a7fc640 1 -- 172.21.15.6:0/3377974390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58240319d0 con 0x7f582c0b8190 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.004+0000 7f5831ed8640 1 -- 172.21.15.6:0/3377974390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c0b8190 msgr2=0x7f582c0b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.004+0000 7f5831ed8640 1 --2- 172.21.15.6:0/3377974390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c0b8190 0x7f582c0b85a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f582c0d1230 tx=0x7f582402a6f0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.004+0000 7f5831ed8640 1 -- 172.21.15.6:0/3377974390 shutdown_connections 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.004+0000 7f5831ed8640 1 --2- 172.21.15.6:0/3377974390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c0b8190 0x7f582c0b85a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.004+0000 7f5831ed8640 1 --2- 172.21.15.6:0/3377974390 >> v2:172.21.15.171:3300/0 conn(0x7f582c06d3d0 0x7f582c06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.004+0000 7f5831ed8640 1 -- 172.21.15.6:0/3377974390 >> 172.21.15.6:0/3377974390 conn(0x7f582c0d4bd0 msgr2=0x7f582c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.004+0000 7f5831ed8640 1 -- 172.21.15.6:0/3377974390 shutdown_connections 2024-05-20T17:55:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.004+0000 7f5831ed8640 1 -- 172.21.15.6:0/3377974390 wait complete. 2024-05-20T17:55:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.006+0000 7f5831ed8640 1 Processor -- start 2024-05-20T17:55:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.006+0000 7f5831ed8640 1 -- start start 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f5831ed8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f582c06d3d0 0x7f582c14dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f5831ed8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f582c0b8190 0x7f582c1e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f5831ed8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c162820 0x7f582c1e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f5831ed8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f582c0d0300 con 0x7f582c162820 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f5831ed8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f582c0d4260 con 0x7f582c06d3d0 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f5831ed8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f582c0b4050 con 0x7f582c0b8190 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c162820 0x7f582c1e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c162820 0x7f582c1e90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34990/0 (socket says 172.21.15.6:34990) 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 -- 172.21.15.6:0/2647494450 learned_addr learned my addr 172.21.15.6:0/2647494450 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582affd640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f582c0b8190 0x7f582c1e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582b7fe640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f582c06d3d0 0x7f582c14dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 -- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f582c0b8190 msgr2=0x7f582c1e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f582c0b8190 0x7f582c1e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 -- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f582c06d3d0 msgr2=0x7f582c14dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f582c06d3d0 0x7f582c14dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 -- 172.21.15.6:0/2647494450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c1e7ae0 con 0x7f582c162820 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.008+0000 7f582bfff640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c162820 0x7f582c1e90c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5824009f10 tx=0x7f5824004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.009+0000 7f5813fff640 1 -- 172.21.15.6:0/2647494450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582403f020 con 0x7f582c162820 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.009+0000 7f5813fff640 1 -- 172.21.15.6:0/2647494450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5824037040 con 0x7f582c162820 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.009+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582c1e7dc0 con 0x7f582c162820 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.009+0000 7f5813fff640 1 -- 172.21.15.6:0/2647494450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824036070 con 0x7f582c162820 2024-05-20T17:55:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.009+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582c1e8380 con 0x7f582c162820 2024-05-20T17:55:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.010+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582c075b00 con 0x7f582c162820 2024-05-20T17:55:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.010+0000 7f5813fff640 1 -- 172.21.15.6:0/2647494450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5824042020 con 0x7f582c162820 2024-05-20T17:55:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.011+0000 7f5813fff640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f581806be30 0x7f581806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.011+0000 7f5813fff640 1 -- 172.21.15.6:0/2647494450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f58240ab300 con 0x7f582c162820 2024-05-20T17:55:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.011+0000 7f582b7fe640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f581806be30 0x7f581806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.012+0000 7f582b7fe640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f581806be30 0x7f581806e340 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f581c006fd0 tx=0x7f581c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.016+0000 7f5813fff640 1 -- 172.21.15.6:0/2647494450 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5824049030 con 0x7f582c162820 2024-05-20T17:55:49.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.196+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f582c1ea530 con 0x7f581806be30 2024-05-20T17:55:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.203+0000 7f5813fff640 1 -- 172.21.15.6:0/2647494450 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7f582c1ea530 con 0x7f581806be30 2024-05-20T17:55:49.204 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:55:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f581806be30 msgr2=0x7f581806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f581806be30 0x7f581806e340 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f581c006fd0 tx=0x7f581c009060 comp rx=0 tx=0).stop 2024-05-20T17:55:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c162820 msgr2=0x7f582c1e90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c162820 0x7f582c1e90c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5824009f10 tx=0x7f5824004a40 comp rx=0 tx=0).stop 2024-05-20T17:55:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 shutdown_connections 2024-05-20T17:55:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f581806be30 0x7f581806e340 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582c162820 0x7f582c1e90c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f582c0b8190 0x7f582c1e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 --2- 172.21.15.6:0/2647494450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f582c06d3d0 0x7f582c14dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 >> 172.21.15.6:0/2647494450 conn(0x7f582c0d4bd0 msgr2=0x7f582c15e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 shutdown_connections 2024-05-20T17:55:49.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.206+0000 7f5831ed8640 1 -- 172.21.15.6:0/2647494450 wait complete. 2024-05-20T17:55:49.216 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-05-20T17:55:48.324680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226308,"kb_used_data":5960,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748412,"statfs":{"total":773094113280,"available":772862373888,"internally_reserved":0,"allocated":6103040,"data_stored":3350772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.068731"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966036+0000","last_change":"2024-05-20T17:55:40.270773+0000","last_active":"2024-05-20T17:55:41.966036+0000","last_peered":"2024-05-20T17:55:41.966036+0000","last_clean":"2024-05-20T17:55:41.966036+0000","last_became_active":"2024-05-20T17:55:40.270461+0000","last_became_peered":"2024-05-20T17:55:40.270461+0000","last_unstale":"2024-05-20T17:55:41.966036+0000","last_undegraded":"2024-05-20T17:55:41.966036+0000","last_fullsized":"2024-05-20T17:55:41.966036+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:53.123523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966594+0000","last_change":"2024-05-20T17:55:40.281497+0000","last_active":"2024-05-20T17:55:41.966594+0000","last_peered":"2024-05-20T17:55:41.966594+0000","last_clean":"2024-05-20T17:55:41.966594+0000","last_became_active":"2024-05-20T17:55:40.281191+0000","last_became_peered":"2024-05-20T17:55:40.281191+0000","last_unstale":"2024-05-20T17:55:41.966594+0000","last_undegraded":"2024-05-20T17:55:41.966594+0000","last_fullsized":"2024-05-20T17:55:41.966594+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805248+0000","last_change":"2024-05-20T17:55:40.269899+0000","last_active":"2024-05-20T17:55:41.805248+0000","last_peered":"2024-05-20T17:55:41.805248+0000","last_clean":"2024-05-20T17:55:41.805248+0000","last_became_active":"2024-05-20T17:55:40.269307+0000","last_became_peered":"2024-05-20T17:55:40.269307+0000","last_unstale":"2024-05-20T17:55:41.805248+0000","last_undegraded":"2024-05-20T17:55:41.805248+0000","last_fullsized":"2024-05-20T17:55:41.805248+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:13:50.189523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966155+0000","last_change":"2024-05-20T17:55:40.289561+0000","last_active":"2024-05-20T17:55:41.966155+0000","last_peered":"2024-05-20T17:55:41.966155+0000","last_clean":"2024-05-20T17:55:41.966155+0000","last_became_active":"2024-05-20T17:55:40.289232+0000","last_became_peered":"2024-05-20T17:55:40.289232+0000","last_unstale":"2024-05-20T17:55:41.966155+0000","last_undegraded":"2024-05-20T17:55:41.966155+0000","last_fullsized":"2024-05-20T17:55:41.966155+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257998+0000","last_change":"2024-05-20T17:55:40.268614+0000","last_active":"2024-05-20T17:55:41.257998+0000","last_peered":"2024-05-20T17:55:41.257998+0000","last_clean":"2024-05-20T17:55:41.257998+0000","last_became_active":"2024-05-20T17:55:40.268295+0000","last_became_peered":"2024-05-20T17:55:40.268295+0000","last_unstale":"2024-05-20T17:55:41.257998+0000","last_undegraded":"2024-05-20T17:55:41.257998+0000","last_fullsized":"2024-05-20T17:55:41.257998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:43.071681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965810+0000","last_change":"2024-05-20T17:55:40.278388+0000","last_active":"2024-05-20T17:55:41.965810+0000","last_peered":"2024-05-20T17:55:41.965810+0000","last_clean":"2024-05-20T17:55:41.965810+0000","last_became_active":"2024-05-20T17:55:40.278061+0000","last_became_peered":"2024-05-20T17:55:40.278061+0000","last_unstale":"2024-05-20T17:55:41.965810+0000","last_undegraded":"2024-05-20T17:55:41.965810+0000","last_fullsized":"2024-05-20T17:55:41.965810+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.804810+0000","last_change":"2024-05-20T17:55:40.271353+0000","last_active":"2024-05-20T17:55:41.804810+0000","last_peered":"2024-05-20T17:55:41.804810+0000","last_clean":"2024-05-20T17:55:41.804810+0000","last_became_active":"2024-05-20T17:55:40.270218+0000","last_became_peered":"2024-05-20T17:55:40.270218+0000","last_unstale":"2024-05-20T17:55:41.804810+0000","last_undegraded":"2024-05-20T17:55:41.804810+0000","last_fullsized":"2024-05-20T17:55:41.804810+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:32.756855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254404+0000","last_change":"2024-05-20T17:55:40.282267+0000","last_active":"2024-05-20T17:55:41.254404+0000","last_peered":"2024-05-20T17:55:41.254404+0000","last_clean":"2024-05-20T17:55:41.254404+0000","last_became_active":"2024-05-20T17:55:40.281957+0000","last_became_peered":"2024-05-20T17:55:40.281957+0000","last_unstale":"2024-05-20T17:55:41.254404+0000","last_undegraded":"2024-05-20T17:55:41.254404+0000","last_fullsized":"2024-05-20T17:55:41.254404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:36.957704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254821+0000","last_change":"2024-05-20T17:55:40.277468+0000","last_active":"2024-05-20T17:55:41.254821+0000","last_peered":"2024-05-20T17:55:41.254821+0000","last_clean":"2024-05-20T17:55:41.254821+0000","last_became_active":"2024-05-20T17:55:40.276903+0000","last_became_peered":"2024-05-20T17:55:40.276903+0000","last_unstale":"2024-05-20T17:55:41.254821+0000","last_undegraded":"2024-05-20T17:55:41.254821+0000","last_fullsized":"2024-05-20T17:55:41.254821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:02.671800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965875+0000","last_change":"2024-05-20T17:55:40.282130+0000","last_active":"2024-05-20T17:55:41.965875+0000","last_peered":"2024-05-20T17:55:41.965875+0000","last_clean":"2024-05-20T17:55:41.965875+0000","last_became_active":"2024-05-20T17:55:40.281789+0000","last_became_peered":"2024-05-20T17:55:40.281789+0000","last_unstale":"2024-05-20T17:55:41.965875+0000","last_undegraded":"2024-05-20T17:55:41.965875+0000","last_fullsized":"2024-05-20T17:55:41.965875+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257338+0000","last_change":"2024-05-20T17:55:40.276661+0000","last_active":"2024-05-20T17:55:41.257338+0000","last_peered":"2024-05-20T17:55:41.257338+0000","last_clean":"2024-05-20T17:55:41.257338+0000","last_became_active":"2024-05-20T17:55:40.276358+0000","last_became_peered":"2024-05-20T17:55:40.276358+0000","last_unstale":"2024-05-20T17:55:41.257338+0000","last_undegraded":"2024-05-20T17:55:41.257338+0000","last_fullsized":"2024-05-20T17:55:41.257338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:33.789874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254780+0000","last_change":"2024-05-20T17:55:40.272120+0000","last_active":"2024-05-20T17:55:41.254780+0000","last_peered":"2024-05-20T17:55:41.254780+0000","last_clean":"2024-05-20T17:55:41.254780+0000","last_became_active":"2024-05-20T17:55:40.271802+0000","last_became_peered":"2024-05-20T17:55:40.271802+0000","last_unstale":"2024-05-20T17:55:41.254780+0000","last_undegraded":"2024-05-20T17:55:41.254780+0000","last_fullsized":"2024-05-20T17:55:41.254780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:00.485107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966039+0000","last_change":"2024-05-20T17:55:40.280972+0000","last_active":"2024-05-20T17:55:41.966039+0000","last_peered":"2024-05-20T17:55:41.966039+0000","last_clean":"2024-05-20T17:55:41.966039+0000","last_became_active":"2024-05-20T17:55:40.280674+0000","last_became_peered":"2024-05-20T17:55:40.280674+0000","last_unstale":"2024-05-20T17:55:41.966039+0000","last_undegraded":"2024-05-20T17:55:41.966039+0000","last_fullsized":"2024-05-20T17:55:41.966039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805209+0000","last_change":"2024-05-20T17:55:40.287249+0000","last_active":"2024-05-20T17:55:41.805209+0000","last_peered":"2024-05-20T17:55:41.805209+0000","last_clean":"2024-05-20T17:55:41.805209+0000","last_became_active":"2024-05-20T17:55:40.286514+0000","last_became_peered":"2024-05-20T17:55:40.286514+0000","last_unstale":"2024-05-20T17:55:41.805209+0000","last_undegraded":"2024-05-20T17:55:41.805209+0000","last_fullsized":"2024-05-20T17:55:41.805209+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:06.124095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966878+0000","last_change":"2024-05-20T17:55:40.278390+0000","last_active":"2024-05-20T17:55:41.966878+0000","last_peered":"2024-05-20T17:55:41.966878+0000","last_clean":"2024-05-20T17:55:41.966878+0000","last_became_active":"2024-05-20T17:55:40.278036+0000","last_became_peered":"2024-05-20T17:55:40.278036+0000","last_unstale":"2024-05-20T17:55:41.966878+0000","last_undegraded":"2024-05-20T17:55:41.966878+0000","last_fullsized":"2024-05-20T17:55:41.966878+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:32.756855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965699+0000","last_change":"2024-05-20T17:55:40.271972+0000","last_active":"2024-05-20T17:55:41.965699+0000","last_peered":"2024-05-20T17:55:41.965699+0000","last_clean":"2024-05-20T17:55:41.965699+0000","last_became_active":"2024-05-20T17:55:40.271620+0000","last_became_peered":"2024-05-20T17:55:40.271620+0000","last_unstale":"2024-05-20T17:55:41.965699+0000","last_undegraded":"2024-05-20T17:55:41.965699+0000","last_fullsized":"2024-05-20T17:55:41.965699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805587+0000","last_change":"2024-05-20T17:55:40.270678+0000","last_active":"2024-05-20T17:55:41.805587+0000","last_peered":"2024-05-20T17:55:41.805587+0000","last_clean":"2024-05-20T17:55:41.805587+0000","last_became_active":"2024-05-20T17:55:40.270241+0000","last_became_peered":"2024-05-20T17:55:40.270241+0000","last_unstale":"2024-05-20T17:55:41.805587+0000","last_undegraded":"2024-05-20T17:55:41.805587+0000","last_fullsized":"2024-05-20T17:55:41.805587+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:02.671800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966717+0000","last_change":"2024-05-20T17:55:40.282461+0000","last_active":"2024-05-20T17:55:41.966717+0000","last_peered":"2024-05-20T17:55:41.966717+0000","last_clean":"2024-05-20T17:55:41.966717+0000","last_became_active":"2024-05-20T17:55:40.282146+0000","last_became_peered":"2024-05-20T17:55:40.282146+0000","last_unstale":"2024-05-20T17:55:41.966717+0000","last_undegraded":"2024-05-20T17:55:41.966717+0000","last_fullsized":"2024-05-20T17:55:41.966717+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:59:35.697636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805441+0000","last_change":"2024-05-20T17:55:40.271785+0000","last_active":"2024-05-20T17:55:41.805441+0000","last_peered":"2024-05-20T17:55:41.805441+0000","last_clean":"2024-05-20T17:55:41.805441+0000","last_became_active":"2024-05-20T17:55:40.270190+0000","last_became_peered":"2024-05-20T17:55:40.270190+0000","last_unstale":"2024-05-20T17:55:41.805441+0000","last_undegraded":"2024-05-20T17:55:41.805441+0000","last_fullsized":"2024-05-20T17:55:41.805441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:15:38.124970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557223+0000","last_change":"2024-05-20T17:55:40.266526+0000","last_active":"2024-05-20T17:55:41.557223+0000","last_peered":"2024-05-20T17:55:41.557223+0000","last_clean":"2024-05-20T17:55:41.557223+0000","last_became_active":"2024-05-20T17:55:40.265920+0000","last_became_peered":"2024-05-20T17:55:40.265920+0000","last_unstale":"2024-05-20T17:55:41.557223+0000","last_undegraded":"2024-05-20T17:55:41.557223+0000","last_fullsized":"2024-05-20T17:55:41.557223+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:55:42.382000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557207+0000","last_change":"2024-05-20T17:55:40.271285+0000","last_active":"2024-05-20T17:55:41.557207+0000","last_peered":"2024-05-20T17:55:41.557207+0000","last_clean":"2024-05-20T17:55:41.557207+0000","last_became_active":"2024-05-20T17:55:40.270660+0000","last_became_peered":"2024-05-20T17:55:40.270660+0000","last_unstale":"2024-05-20T17:55:41.557207+0000","last_undegraded":"2024-05-20T17:55:41.557207+0000","last_fullsized":"2024-05-20T17:55:41.557207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254365+0000","last_change":"2024-05-20T17:55:40.282955+0000","last_active":"2024-05-20T17:55:41.254365+0000","last_peered":"2024-05-20T17:55:41.254365+0000","last_clean":"2024-05-20T17:55:41.254365+0000","last_became_active":"2024-05-20T17:55:40.282609+0000","last_became_peered":"2024-05-20T17:55:40.282609+0000","last_unstale":"2024-05-20T17:55:41.254365+0000","last_undegraded":"2024-05-20T17:55:41.254365+0000","last_fullsized":"2024-05-20T17:55:41.254365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:15.702355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257167+0000","last_change":"2024-05-20T17:55:40.277466+0000","last_active":"2024-05-20T17:55:41.257167+0000","last_peered":"2024-05-20T17:55:41.257167+0000","last_clean":"2024-05-20T17:55:41.257167+0000","last_became_active":"2024-05-20T17:55:40.277117+0000","last_became_peered":"2024-05-20T17:55:40.277117+0000","last_unstale":"2024-05-20T17:55:41.257167+0000","last_undegraded":"2024-05-20T17:55:41.257167+0000","last_fullsized":"2024-05-20T17:55:41.257167+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:35:09.265029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.804793+0000","last_change":"2024-05-20T17:55:40.282279+0000","last_active":"2024-05-20T17:55:41.804793+0000","last_peered":"2024-05-20T17:55:41.804793+0000","last_clean":"2024-05-20T17:55:41.804793+0000","last_became_active":"2024-05-20T17:55:40.281931+0000","last_became_peered":"2024-05-20T17:55:40.281931+0000","last_unstale":"2024-05-20T17:55:41.804793+0000","last_undegraded":"2024-05-20T17:55:41.804793+0000","last_fullsized":"2024-05-20T17:55:41.804793+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:22.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805757+0000","last_change":"2024-05-20T17:55:40.280859+0000","last_active":"2024-05-20T17:55:41.805757+0000","last_peered":"2024-05-20T17:55:41.805757+0000","last_clean":"2024-05-20T17:55:41.805757+0000","last_became_active":"2024-05-20T17:55:40.280507+0000","last_became_peered":"2024-05-20T17:55:40.280507+0000","last_unstale":"2024-05-20T17:55:41.805757+0000","last_undegraded":"2024-05-20T17:55:41.805757+0000","last_fullsized":"2024-05-20T17:55:41.805757+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:42.086335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254723+0000","last_change":"2024-05-20T17:55:40.270685+0000","last_active":"2024-05-20T17:55:41.254723+0000","last_peered":"2024-05-20T17:55:41.254723+0000","last_clean":"2024-05-20T17:55:41.254723+0000","last_became_active":"2024-05-20T17:55:40.270370+0000","last_became_peered":"2024-05-20T17:55:40.270370+0000","last_unstale":"2024-05-20T17:55:41.254723+0000","last_undegraded":"2024-05-20T17:55:41.254723+0000","last_fullsized":"2024-05-20T17:55:41.254723+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:07.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966227+0000","last_change":"2024-05-20T17:55:40.276848+0000","last_active":"2024-05-20T17:55:41.966227+0000","last_peered":"2024-05-20T17:55:41.966227+0000","last_clean":"2024-05-20T17:55:41.966227+0000","last_became_active":"2024-05-20T17:55:40.276542+0000","last_became_peered":"2024-05-20T17:55:40.276542+0000","last_unstale":"2024-05-20T17:55:41.966227+0000","last_undegraded":"2024-05-20T17:55:41.966227+0000","last_fullsized":"2024-05-20T17:55:41.966227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557367+0000","last_change":"2024-05-20T17:55:40.267011+0000","last_active":"2024-05-20T17:55:41.557367+0000","last_peered":"2024-05-20T17:55:41.557367+0000","last_clean":"2024-05-20T17:55:41.557367+0000","last_became_active":"2024-05-20T17:55:40.266683+0000","last_became_peered":"2024-05-20T17:55:40.266683+0000","last_unstale":"2024-05-20T17:55:41.557367+0000","last_undegraded":"2024-05-20T17:55:41.557367+0000","last_fullsized":"2024-05-20T17:55:41.557367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805241+0000","last_change":"2024-05-20T17:55:40.272466+0000","last_active":"2024-05-20T17:55:41.805241+0000","last_peered":"2024-05-20T17:55:41.805241+0000","last_clean":"2024-05-20T17:55:41.805241+0000","last_became_active":"2024-05-20T17:55:40.272127+0000","last_became_peered":"2024-05-20T17:55:40.272127+0000","last_unstale":"2024-05-20T17:55:41.805241+0000","last_undegraded":"2024-05-20T17:55:41.805241+0000","last_fullsized":"2024-05-20T17:55:41.805241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:36.957704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966369+0000","last_change":"2024-05-20T17:55:40.282635+0000","last_active":"2024-05-20T17:55:41.966369+0000","last_peered":"2024-05-20T17:55:41.966369+0000","last_clean":"2024-05-20T17:55:41.966369+0000","last_became_active":"2024-05-20T17:55:40.281020+0000","last_became_peered":"2024-05-20T17:55:40.281020+0000","last_unstale":"2024-05-20T17:55:41.966369+0000","last_undegraded":"2024-05-20T17:55:41.966369+0000","last_fullsized":"2024-05-20T17:55:41.966369+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.804920+0000","last_change":"2024-05-20T17:55:40.271599+0000","last_active":"2024-05-20T17:55:41.804920+0000","last_peered":"2024-05-20T17:55:41.804920+0000","last_clean":"2024-05-20T17:55:41.804920+0000","last_became_active":"2024-05-20T17:55:40.270950+0000","last_became_peered":"2024-05-20T17:55:40.270950+0000","last_unstale":"2024-05-20T17:55:41.804920+0000","last_undegraded":"2024-05-20T17:55:41.804920+0000","last_fullsized":"2024-05-20T17:55:41.804920+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:26:20.612275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966105+0000","last_change":"2024-05-20T17:55:40.271887+0000","last_active":"2024-05-20T17:55:41.966105+0000","last_peered":"2024-05-20T17:55:41.966105+0000","last_clean":"2024-05-20T17:55:41.966105+0000","last_became_active":"2024-05-20T17:55:40.270696+0000","last_became_peered":"2024-05-20T17:55:40.270696+0000","last_unstale":"2024-05-20T17:55:41.966105+0000","last_undegraded":"2024-05-20T17:55:41.966105+0000","last_fullsized":"2024-05-20T17:55:41.966105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965868+0000","last_change":"2024-05-20T17:55:40.275752+0000","last_active":"2024-05-20T17:55:41.965868+0000","last_peered":"2024-05-20T17:55:41.965868+0000","last_clean":"2024-05-20T17:55:41.965868+0000","last_became_active":"2024-05-20T17:55:40.275317+0000","last_became_peered":"2024-05-20T17:55:40.275317+0000","last_unstale":"2024-05-20T17:55:41.965868+0000","last_undegraded":"2024-05-20T17:55:41.965868+0000","last_fullsized":"2024-05-20T17:55:41.965868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:40:23.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557249+0000","last_change":"2024-05-20T17:55:39.270058+0000","last_active":"2024-05-20T17:55:41.557249+0000","last_peered":"2024-05-20T17:55:41.557249+0000","last_clean":"2024-05-20T17:55:41.557249+0000","last_became_active":"2024-05-20T17:55:39.269730+0000","last_became_peered":"2024-05-20T17:55:39.269730+0000","last_unstale":"2024-05-20T17:55:41.557249+0000","last_undegraded":"2024-05-20T17:55:41.557249+0000","last_fullsized":"2024-05-20T17:55:41.557249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:04:54.585800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966028+0000","last_change":"2024-05-20T17:55:40.274646+0000","last_active":"2024-05-20T17:55:41.966028+0000","last_peered":"2024-05-20T17:55:41.966028+0000","last_clean":"2024-05-20T17:55:41.966028+0000","last_became_active":"2024-05-20T17:55:40.274299+0000","last_became_peered":"2024-05-20T17:55:40.274299+0000","last_unstale":"2024-05-20T17:55:41.966028+0000","last_undegraded":"2024-05-20T17:55:41.966028+0000","last_fullsized":"2024-05-20T17:55:41.966028+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:05:01.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965800+0000","last_change":"2024-05-20T17:55:39.271593+0000","last_active":"2024-05-20T17:55:41.965800+0000","last_peered":"2024-05-20T17:55:41.965800+0000","last_clean":"2024-05-20T17:55:41.965800+0000","last_became_active":"2024-05-20T17:55:39.271252+0000","last_became_peered":"2024-05-20T17:55:39.271252+0000","last_unstale":"2024-05-20T17:55:41.965800+0000","last_undegraded":"2024-05-20T17:55:41.965800+0000","last_fullsized":"2024-05-20T17:55:41.965800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557093+0000","last_change":"2024-05-20T17:55:40.268788+0000","last_active":"2024-05-20T17:55:41.557093+0000","last_peered":"2024-05-20T17:55:41.557093+0000","last_clean":"2024-05-20T17:55:41.557093+0000","last_became_active":"2024-05-20T17:55:40.268438+0000","last_became_peered":"2024-05-20T17:55:40.268438+0000","last_unstale":"2024-05-20T17:55:41.557093+0000","last_undegraded":"2024-05-20T17:55:41.557093+0000","last_fullsized":"2024-05-20T17:55:41.557093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:58.699184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966191+0000","last_change":"2024-05-20T17:55:39.273435+0000","last_active":"2024-05-20T17:55:41.966191+0000","last_peered":"2024-05-20T17:55:41.966191+0000","last_clean":"2024-05-20T17:55:41.966191+0000","last_became_active":"2024-05-20T17:55:39.272038+0000","last_became_peered":"2024-05-20T17:55:39.272038+0000","last_unstale":"2024-05-20T17:55:41.966191+0000","last_undegraded":"2024-05-20T17:55:41.966191+0000","last_fullsized":"2024-05-20T17:55:41.966191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254607+0000","last_change":"2024-05-20T17:55:40.269504+0000","last_active":"2024-05-20T17:55:41.254607+0000","last_peered":"2024-05-20T17:55:41.254607+0000","last_clean":"2024-05-20T17:55:41.254607+0000","last_became_active":"2024-05-20T17:55:40.269183+0000","last_became_peered":"2024-05-20T17:55:40.269183+0000","last_unstale":"2024-05-20T17:55:41.254607+0000","last_undegraded":"2024-05-20T17:55:41.254607+0000","last_fullsized":"2024-05-20T17:55:41.254607+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:13:50.189523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966477+0000","last_change":"2024-05-20T17:55:39.271665+0000","last_active":"2024-05-20T17:55:41.966477+0000","last_peered":"2024-05-20T17:55:41.966477+0000","last_clean":"2024-05-20T17:55:41.966477+0000","last_became_active":"2024-05-20T17:55:39.271355+0000","last_became_peered":"2024-05-20T17:55:39.271355+0000","last_unstale":"2024-05-20T17:55:41.966477+0000","last_undegraded":"2024-05-20T17:55:41.966477+0000","last_fullsized":"2024-05-20T17:55:41.966477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258077+0000","last_change":"2024-05-20T17:55:40.277184+0000","last_active":"2024-05-20T17:55:41.258077+0000","last_peered":"2024-05-20T17:55:41.258077+0000","last_clean":"2024-05-20T17:55:41.258077+0000","last_became_active":"2024-05-20T17:55:40.276858+0000","last_became_peered":"2024-05-20T17:55:40.276858+0000","last_unstale":"2024-05-20T17:55:41.258077+0000","last_undegraded":"2024-05-20T17:55:41.258077+0000","last_fullsized":"2024-05-20T17:55:41.258077+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.804923+0000","last_change":"2024-05-20T17:55:39.256734+0000","last_active":"2024-05-20T17:55:41.804923+0000","last_peered":"2024-05-20T17:55:41.804923+0000","last_clean":"2024-05-20T17:55:41.804923+0000","last_became_active":"2024-05-20T17:55:39.256389+0000","last_became_peered":"2024-05-20T17:55:39.256389+0000","last_unstale":"2024-05-20T17:55:41.804923+0000","last_undegraded":"2024-05-20T17:55:41.804923+0000","last_fullsized":"2024-05-20T17:55:41.804923+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:35:39.407657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966181+0000","last_change":"2024-05-20T17:55:40.283253+0000","last_active":"2024-05-20T17:55:41.966181+0000","last_peered":"2024-05-20T17:55:41.966181+0000","last_clean":"2024-05-20T17:55:41.966181+0000","last_became_active":"2024-05-20T17:55:40.282357+0000","last_became_peered":"2024-05-20T17:55:40.282357+0000","last_unstale":"2024-05-20T17:55:41.966181+0000","last_undegraded":"2024-05-20T17:55:41.966181+0000","last_fullsized":"2024-05-20T17:55:41.966181+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257712+0000","last_change":"2024-05-20T17:55:39.267829+0000","last_active":"2024-05-20T17:55:41.257712+0000","last_peered":"2024-05-20T17:55:41.257712+0000","last_clean":"2024-05-20T17:55:41.257712+0000","last_became_active":"2024-05-20T17:55:39.267501+0000","last_became_peered":"2024-05-20T17:55:39.267501+0000","last_unstale":"2024-05-20T17:55:41.257712+0000","last_undegraded":"2024-05-20T17:55:41.257712+0000","last_fullsized":"2024-05-20T17:55:41.257712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254976+0000","last_change":"2024-05-20T17:55:40.267881+0000","last_active":"2024-05-20T17:55:41.254976+0000","last_peered":"2024-05-20T17:55:41.254976+0000","last_clean":"2024-05-20T17:55:41.254976+0000","last_became_active":"2024-05-20T17:55:40.267566+0000","last_became_peered":"2024-05-20T17:55:40.267566+0000","last_unstale":"2024-05-20T17:55:41.254976+0000","last_undegraded":"2024-05-20T17:55:41.254976+0000","last_fullsized":"2024-05-20T17:55:41.254976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:42.086335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557032+0000","last_change":"2024-05-20T17:55:39.266116+0000","last_active":"2024-05-20T17:55:41.557032+0000","last_peered":"2024-05-20T17:55:41.557032+0000","last_clean":"2024-05-20T17:55:41.557032+0000","last_became_active":"2024-05-20T17:55:39.265728+0000","last_became_peered":"2024-05-20T17:55:39.265728+0000","last_unstale":"2024-05-20T17:55:41.557032+0000","last_undegraded":"2024-05-20T17:55:41.557032+0000","last_fullsized":"2024-05-20T17:55:41.557032+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:05:12.727539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966819+0000","last_change":"2024-05-20T17:55:40.286432+0000","last_active":"2024-05-20T17:55:41.966819+0000","last_peered":"2024-05-20T17:55:41.966819+0000","last_clean":"2024-05-20T17:55:41.966819+0000","last_became_active":"2024-05-20T17:55:40.286118+0000","last_became_peered":"2024-05-20T17:55:40.286118+0000","last_unstale":"2024-05-20T17:55:41.966819+0000","last_undegraded":"2024-05-20T17:55:41.966819+0000","last_fullsized":"2024-05-20T17:55:41.966819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:28:22.151936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.804751+0000","last_change":"2024-05-20T17:55:39.276136+0000","last_active":"2024-05-20T17:55:41.804751+0000","last_peered":"2024-05-20T17:55:41.804751+0000","last_clean":"2024-05-20T17:55:41.804751+0000","last_became_active":"2024-05-20T17:55:39.275769+0000","last_became_peered":"2024-05-20T17:55:39.275769+0000","last_unstale":"2024-05-20T17:55:41.804751+0000","last_undegraded":"2024-05-20T17:55:41.804751+0000","last_fullsized":"2024-05-20T17:55:41.804751+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257645+0000","last_change":"2024-05-20T17:55:40.273680+0000","last_active":"2024-05-20T17:55:41.257645+0000","last_peered":"2024-05-20T17:55:41.257645+0000","last_clean":"2024-05-20T17:55:41.257645+0000","last_became_active":"2024-05-20T17:55:40.273073+0000","last_became_peered":"2024-05-20T17:55:40.273073+0000","last_unstale":"2024-05-20T17:55:41.257645+0000","last_undegraded":"2024-05-20T17:55:41.257645+0000","last_fullsized":"2024-05-20T17:55:41.257645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:03.789329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966609+0000","last_change":"2024-05-20T17:55:39.267936+0000","last_active":"2024-05-20T17:55:41.966609+0000","last_peered":"2024-05-20T17:55:41.966609+0000","last_clean":"2024-05-20T17:55:41.966609+0000","last_became_active":"2024-05-20T17:55:39.267565+0000","last_became_peered":"2024-05-20T17:55:39.267565+0000","last_unstale":"2024-05-20T17:55:41.966609+0000","last_undegraded":"2024-05-20T17:55:41.966609+0000","last_fullsized":"2024-05-20T17:55:41.966609+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:17.654907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965996+0000","last_change":"2024-05-20T17:55:40.259853+0000","last_active":"2024-05-20T17:55:41.965996+0000","last_peered":"2024-05-20T17:55:41.965996+0000","last_clean":"2024-05-20T17:55:41.965996+0000","last_became_active":"2024-05-20T17:55:40.259465+0000","last_became_peered":"2024-05-20T17:55:40.259465+0000","last_unstale":"2024-05-20T17:55:41.965996+0000","last_undegraded":"2024-05-20T17:55:41.965996+0000","last_fullsized":"2024-05-20T17:55:41.965996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:11.390387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258204+0000","last_change":"2024-05-20T17:55:39.258507+0000","last_active":"2024-05-20T17:55:41.258204+0000","last_peered":"2024-05-20T17:55:41.258204+0000","last_clean":"2024-05-20T17:55:41.258204+0000","last_became_active":"2024-05-20T17:55:39.258195+0000","last_became_peered":"2024-05-20T17:55:39.258195+0000","last_unstale":"2024-05-20T17:55:41.258204+0000","last_undegraded":"2024-05-20T17:55:41.258204+0000","last_fullsized":"2024-05-20T17:55:41.258204+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805164+0000","last_change":"2024-05-20T17:55:40.287539+0000","last_active":"2024-05-20T17:55:41.805164+0000","last_peered":"2024-05-20T17:55:41.805164+0000","last_clean":"2024-05-20T17:55:41.805164+0000","last_became_active":"2024-05-20T17:55:40.286931+0000","last_became_peered":"2024-05-20T17:55:40.286931+0000","last_unstale":"2024-05-20T17:55:41.805164+0000","last_undegraded":"2024-05-20T17:55:41.805164+0000","last_fullsized":"2024-05-20T17:55:41.805164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:15.702355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966420+0000","last_change":"2024-05-20T17:55:39.271032+0000","last_active":"2024-05-20T17:55:41.966420+0000","last_peered":"2024-05-20T17:55:41.966420+0000","last_clean":"2024-05-20T17:55:41.966420+0000","last_became_active":"2024-05-20T17:55:39.270719+0000","last_became_peered":"2024-05-20T17:55:39.270719+0000","last_unstale":"2024-05-20T17:55:41.966420+0000","last_undegraded":"2024-05-20T17:55:41.966420+0000","last_fullsized":"2024-05-20T17:55:41.966420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.258048+0000","last_change":"2024-05-20T17:55:40.266407+0000","last_active":"2024-05-20T17:55:41.258048+0000","last_peered":"2024-05-20T17:55:41.258048+0000","last_clean":"2024-05-20T17:55:41.258048+0000","last_became_active":"2024-05-20T17:55:40.266040+0000","last_became_peered":"2024-05-20T17:55:40.266040+0000","last_unstale":"2024-05-20T17:55:41.258048+0000","last_undegraded":"2024-05-20T17:55:41.258048+0000","last_fullsized":"2024-05-20T17:55:41.258048+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:18.657015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254993+0000","last_change":"2024-05-20T17:55:39.275133+0000","last_active":"2024-05-20T17:55:41.254993+0000","last_peered":"2024-05-20T17:55:41.254993+0000","last_clean":"2024-05-20T17:55:41.254993+0000","last_became_active":"2024-05-20T17:55:39.274819+0000","last_became_peered":"2024-05-20T17:55:39.274819+0000","last_unstale":"2024-05-20T17:55:41.254993+0000","last_undegraded":"2024-05-20T17:55:41.254993+0000","last_fullsized":"2024-05-20T17:55:41.254993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:10.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966204+0000","last_change":"2024-05-20T17:55:40.268720+0000","last_active":"2024-05-20T17:55:41.966204+0000","last_peered":"2024-05-20T17:55:41.966204+0000","last_clean":"2024-05-20T17:55:41.966204+0000","last_became_active":"2024-05-20T17:55:40.268272+0000","last_became_peered":"2024-05-20T17:55:40.268272+0000","last_unstale":"2024-05-20T17:55:41.966204+0000","last_undegraded":"2024-05-20T17:55:41.966204+0000","last_fullsized":"2024-05-20T17:55:41.966204+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:05.937762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805061+0000","last_change":"2024-05-20T17:55:39.274602+0000","last_active":"2024-05-20T17:55:41.805061+0000","last_peered":"2024-05-20T17:55:41.805061+0000","last_clean":"2024-05-20T17:55:41.805061+0000","last_became_active":"2024-05-20T17:55:39.274202+0000","last_became_peered":"2024-05-20T17:55:39.274202+0000","last_unstale":"2024-05-20T17:55:41.805061+0000","last_undegraded":"2024-05-20T17:55:41.805061+0000","last_fullsized":"2024-05-20T17:55:41.805061+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:39.792921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805486+0000","last_change":"2024-05-20T17:55:40.273133+0000","last_active":"2024-05-20T17:55:41.805486+0000","last_peered":"2024-05-20T17:55:41.805486+0000","last_clean":"2024-05-20T17:55:41.805486+0000","last_became_active":"2024-05-20T17:55:40.272755+0000","last_became_peered":"2024-05-20T17:55:40.272755+0000","last_unstale":"2024-05-20T17:55:41.805486+0000","last_undegraded":"2024-05-20T17:55:41.805486+0000","last_fullsized":"2024-05-20T17:55:41.805486+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:00.485107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557215+0000","last_change":"2024-05-20T17:55:39.278757+0000","last_active":"2024-05-20T17:55:41.557215+0000","last_peered":"2024-05-20T17:55:41.557215+0000","last_clean":"2024-05-20T17:55:41.557215+0000","last_became_active":"2024-05-20T17:55:39.278446+0000","last_became_peered":"2024-05-20T17:55:39.278446+0000","last_unstale":"2024-05-20T17:55:41.557215+0000","last_undegraded":"2024-05-20T17:55:41.557215+0000","last_fullsized":"2024-05-20T17:55:41.557215+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254913+0000","last_change":"2024-05-20T17:55:40.277815+0000","last_active":"2024-05-20T17:55:41.254913+0000","last_peered":"2024-05-20T17:55:41.254913+0000","last_clean":"2024-05-20T17:55:41.254913+0000","last_became_active":"2024-05-20T17:55:40.277472+0000","last_became_peered":"2024-05-20T17:55:40.277472+0000","last_unstale":"2024-05-20T17:55:41.254913+0000","last_undegraded":"2024-05-20T17:55:41.254913+0000","last_fullsized":"2024-05-20T17:55:41.254913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:07.635141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966866+0000","last_change":"2024-05-20T17:55:39.269641+0000","last_active":"2024-05-20T17:55:41.966866+0000","last_peered":"2024-05-20T17:55:41.966866+0000","last_clean":"2024-05-20T17:55:41.966866+0000","last_became_active":"2024-05-20T17:55:39.269150+0000","last_became_peered":"2024-05-20T17:55:39.269150+0000","last_unstale":"2024-05-20T17:55:41.966866+0000","last_undegraded":"2024-05-20T17:55:41.966866+0000","last_fullsized":"2024-05-20T17:55:41.966866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:42.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805713+0000","last_change":"2024-05-20T17:55:40.279274+0000","last_active":"2024-05-20T17:55:41.805713+0000","last_peered":"2024-05-20T17:55:41.805713+0000","last_clean":"2024-05-20T17:55:41.805713+0000","last_became_active":"2024-05-20T17:55:40.274131+0000","last_became_peered":"2024-05-20T17:55:40.274131+0000","last_unstale":"2024-05-20T17:55:41.805713+0000","last_undegraded":"2024-05-20T17:55:41.805713+0000","last_fullsized":"2024-05-20T17:55:41.805713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:04.314309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254512+0000","last_change":"2024-05-20T17:55:39.275778+0000","last_active":"2024-05-20T17:55:41.254512+0000","last_peered":"2024-05-20T17:55:41.254512+0000","last_clean":"2024-05-20T17:55:41.254512+0000","last_became_active":"2024-05-20T17:55:39.275467+0000","last_became_peered":"2024-05-20T17:55:39.275467+0000","last_unstale":"2024-05-20T17:55:41.254512+0000","last_undegraded":"2024-05-20T17:55:41.254512+0000","last_fullsized":"2024-05-20T17:55:41.254512+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:55.528047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254470+0000","last_change":"2024-05-20T17:55:40.264575+0000","last_active":"2024-05-20T17:55:41.254470+0000","last_peered":"2024-05-20T17:55:41.254470+0000","last_clean":"2024-05-20T17:55:41.254470+0000","last_became_active":"2024-05-20T17:55:40.264241+0000","last_became_peered":"2024-05-20T17:55:40.264241+0000","last_unstale":"2024-05-20T17:55:41.254470+0000","last_undegraded":"2024-05-20T17:55:41.254470+0000","last_fullsized":"2024-05-20T17:55:41.254470+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:06.124095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805797+0000","last_change":"2024-05-20T17:55:39.278930+0000","last_active":"2024-05-20T17:55:41.805797+0000","last_peered":"2024-05-20T17:55:41.805797+0000","last_clean":"2024-05-20T17:55:41.805797+0000","last_became_active":"2024-05-20T17:55:39.277743+0000","last_became_peered":"2024-05-20T17:55:39.277743+0000","last_unstale":"2024-05-20T17:55:41.805797+0000","last_undegraded":"2024-05-20T17:55:41.805797+0000","last_fullsized":"2024-05-20T17:55:41.805797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:38.198867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965685+0000","last_change":"2024-05-20T17:55:40.277654+0000","last_active":"2024-05-20T17:55:41.965685+0000","last_peered":"2024-05-20T17:55:41.965685+0000","last_clean":"2024-05-20T17:55:41.965685+0000","last_became_active":"2024-05-20T17:55:40.277356+0000","last_became_peered":"2024-05-20T17:55:40.277356+0000","last_unstale":"2024-05-20T17:55:41.965685+0000","last_undegraded":"2024-05-20T17:55:41.965685+0000","last_fullsized":"2024-05-20T17:55:41.965685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:16.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257414+0000","last_change":"2024-05-20T17:55:39.265979+0000","last_active":"2024-05-20T17:55:41.257414+0000","last_peered":"2024-05-20T17:55:41.257414+0000","last_clean":"2024-05-20T17:55:41.257414+0000","last_became_active":"2024-05-20T17:55:39.265679+0000","last_became_peered":"2024-05-20T17:55:39.265679+0000","last_unstale":"2024-05-20T17:55:41.257414+0000","last_undegraded":"2024-05-20T17:55:41.257414+0000","last_fullsized":"2024-05-20T17:55:41.257414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:11:34.833740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257757+0000","last_change":"2024-05-20T17:55:40.277228+0000","last_active":"2024-05-20T17:55:41.257757+0000","last_peered":"2024-05-20T17:55:41.257757+0000","last_clean":"2024-05-20T17:55:41.257757+0000","last_became_active":"2024-05-20T17:55:40.276880+0000","last_became_peered":"2024-05-20T17:55:40.276880+0000","last_unstale":"2024-05-20T17:55:41.257757+0000","last_undegraded":"2024-05-20T17:55:41.257757+0000","last_fullsized":"2024-05-20T17:55:41.257757+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:46:39.200975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557190+0000","last_change":"2024-05-20T17:55:39.273470+0000","last_active":"2024-05-20T17:55:41.557190+0000","last_peered":"2024-05-20T17:55:41.557190+0000","last_clean":"2024-05-20T17:55:41.557190+0000","last_became_active":"2024-05-20T17:55:39.273151+0000","last_became_peered":"2024-05-20T17:55:39.273151+0000","last_unstale":"2024-05-20T17:55:41.557190+0000","last_undegraded":"2024-05-20T17:55:41.557190+0000","last_fullsized":"2024-05-20T17:55:41.557190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:31.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966012+0000","last_change":"2024-05-20T17:55:40.272795+0000","last_active":"2024-05-20T17:55:41.966012+0000","last_peered":"2024-05-20T17:55:41.966012+0000","last_clean":"2024-05-20T17:55:41.966012+0000","last_became_active":"2024-05-20T17:55:40.272473+0000","last_became_peered":"2024-05-20T17:55:40.272473+0000","last_unstale":"2024-05-20T17:55:41.966012+0000","last_undegraded":"2024-05-20T17:55:41.966012+0000","last_fullsized":"2024-05-20T17:55:41.966012+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557373+0000","last_change":"2024-05-20T17:55:39.266166+0000","last_active":"2024-05-20T17:55:41.557373+0000","last_peered":"2024-05-20T17:55:41.557373+0000","last_clean":"2024-05-20T17:55:41.557373+0000","last_became_active":"2024-05-20T17:55:39.265830+0000","last_became_peered":"2024-05-20T17:55:39.265830+0000","last_unstale":"2024-05-20T17:55:41.557373+0000","last_undegraded":"2024-05-20T17:55:41.557373+0000","last_fullsized":"2024-05-20T17:55:41.557373+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:35:39.407657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966454+0000","last_change":"2024-05-20T17:55:40.264272+0000","last_active":"2024-05-20T17:55:41.966454+0000","last_peered":"2024-05-20T17:55:41.966454+0000","last_clean":"2024-05-20T17:55:41.966454+0000","last_became_active":"2024-05-20T17:55:40.263229+0000","last_became_peered":"2024-05-20T17:55:40.263229+0000","last_unstale":"2024-05-20T17:55:41.966454+0000","last_undegraded":"2024-05-20T17:55:41.966454+0000","last_fullsized":"2024-05-20T17:55:41.966454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:01:13.611518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966167+0000","last_change":"2024-05-20T17:55:39.265914+0000","last_active":"2024-05-20T17:55:41.966167+0000","last_peered":"2024-05-20T17:55:41.966167+0000","last_clean":"2024-05-20T17:55:41.966167+0000","last_became_active":"2024-05-20T17:55:39.265583+0000","last_became_peered":"2024-05-20T17:55:39.265583+0000","last_unstale":"2024-05-20T17:55:41.966167+0000","last_undegraded":"2024-05-20T17:55:41.966167+0000","last_fullsized":"2024-05-20T17:55:41.966167+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:52:21.185871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557422+0000","last_change":"2024-05-20T17:55:40.270988+0000","last_active":"2024-05-20T17:55:41.557422+0000","last_peered":"2024-05-20T17:55:41.557422+0000","last_clean":"2024-05-20T17:55:41.557422+0000","last_became_active":"2024-05-20T17:55:40.270582+0000","last_became_peered":"2024-05-20T17:55:40.270582+0000","last_unstale":"2024-05-20T17:55:41.557422+0000","last_undegraded":"2024-05-20T17:55:41.557422+0000","last_fullsized":"2024-05-20T17:55:41.557422+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:15.933312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254285+0000","last_change":"2024-05-20T17:55:39.272103+0000","last_active":"2024-05-20T17:55:41.254285+0000","last_peered":"2024-05-20T17:55:41.254285+0000","last_clean":"2024-05-20T17:55:41.254285+0000","last_became_active":"2024-05-20T17:55:39.271787+0000","last_became_peered":"2024-05-20T17:55:39.271787+0000","last_unstale":"2024-05-20T17:55:41.254285+0000","last_undegraded":"2024-05-20T17:55:41.254285+0000","last_fullsized":"2024-05-20T17:55:41.254285+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:41.864783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805461+0000","last_change":"2024-05-20T17:55:40.274800+0000","last_active":"2024-05-20T17:55:41.805461+0000","last_peered":"2024-05-20T17:55:41.805461+0000","last_clean":"2024-05-20T17:55:41.805461+0000","last_became_active":"2024-05-20T17:55:40.274511+0000","last_became_peered":"2024-05-20T17:55:40.274511+0000","last_unstale":"2024-05-20T17:55:41.805461+0000","last_undegraded":"2024-05-20T17:55:41.805461+0000","last_fullsized":"2024-05-20T17:55:41.805461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:07.676645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805053+0000","last_change":"2024-05-20T17:55:39.262518+0000","last_active":"2024-05-20T17:55:41.805053+0000","last_peered":"2024-05-20T17:55:41.805053+0000","last_clean":"2024-05-20T17:55:41.805053+0000","last_became_active":"2024-05-20T17:55:39.262191+0000","last_became_peered":"2024-05-20T17:55:39.262191+0000","last_unstale":"2024-05-20T17:55:41.805053+0000","last_undegraded":"2024-05-20T17:55:41.805053+0000","last_fullsized":"2024-05-20T17:55:41.805053+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:00:48.535956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965915+0000","last_change":"2024-05-20T17:55:40.275681+0000","last_active":"2024-05-20T17:55:41.965915+0000","last_peered":"2024-05-20T17:55:41.965915+0000","last_clean":"2024-05-20T17:55:41.965915+0000","last_became_active":"2024-05-20T17:55:40.275360+0000","last_became_peered":"2024-05-20T17:55:40.275360+0000","last_unstale":"2024-05-20T17:55:41.965915+0000","last_undegraded":"2024-05-20T17:55:41.965915+0000","last_fullsized":"2024-05-20T17:55:41.965915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:42.866892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.256993+0000","last_change":"2024-05-20T17:55:39.269421+0000","last_active":"2024-05-20T17:55:41.256993+0000","last_peered":"2024-05-20T17:55:41.256993+0000","last_clean":"2024-05-20T17:55:41.256993+0000","last_became_active":"2024-05-20T17:55:39.269101+0000","last_became_peered":"2024-05-20T17:55:39.269101+0000","last_unstale":"2024-05-20T17:55:41.256993+0000","last_undegraded":"2024-05-20T17:55:41.256993+0000","last_fullsized":"2024-05-20T17:55:41.256993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:09:11.791684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966253+0000","last_change":"2024-05-20T17:55:40.267783+0000","last_active":"2024-05-20T17:55:41.966253+0000","last_peered":"2024-05-20T17:55:41.966253+0000","last_clean":"2024-05-20T17:55:41.966253+0000","last_became_active":"2024-05-20T17:55:40.267415+0000","last_became_peered":"2024-05-20T17:55:40.267415+0000","last_unstale":"2024-05-20T17:55:41.966253+0000","last_undegraded":"2024-05-20T17:55:41.966253+0000","last_fullsized":"2024-05-20T17:55:41.966253+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:31.641343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557363+0000","last_change":"2024-05-20T17:55:39.280002+0000","last_active":"2024-05-20T17:55:41.557363+0000","last_peered":"2024-05-20T17:55:41.557363+0000","last_clean":"2024-05-20T17:55:41.557363+0000","last_became_active":"2024-05-20T17:55:39.279754+0000","last_became_peered":"2024-05-20T17:55:39.279754+0000","last_unstale":"2024-05-20T17:55:41.557363+0000","last_undegraded":"2024-05-20T17:55:41.557363+0000","last_fullsized":"2024-05-20T17:55:41.557363+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:11:28.961264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965866+0000","last_change":"2024-05-20T17:55:40.268902+0000","last_active":"2024-05-20T17:55:41.965866+0000","last_peered":"2024-05-20T17:55:41.965866+0000","last_clean":"2024-05-20T17:55:41.965866+0000","last_became_active":"2024-05-20T17:55:40.268587+0000","last_became_peered":"2024-05-20T17:55:40.268587+0000","last_unstale":"2024-05-20T17:55:41.965866+0000","last_undegraded":"2024-05-20T17:55:41.965866+0000","last_fullsized":"2024-05-20T17:55:41.965866+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:44:56.530155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966557+0000","last_change":"2024-05-20T17:55:39.274048+0000","last_active":"2024-05-20T17:55:41.966557+0000","last_peered":"2024-05-20T17:55:41.966557+0000","last_clean":"2024-05-20T17:55:41.966557+0000","last_became_active":"2024-05-20T17:55:39.273738+0000","last_became_peered":"2024-05-20T17:55:39.273738+0000","last_unstale":"2024-05-20T17:55:41.966557+0000","last_undegraded":"2024-05-20T17:55:41.966557+0000","last_fullsized":"2024-05-20T17:55:41.966557+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:07.062814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254624+0000","last_change":"2024-05-20T17:55:40.265532+0000","last_active":"2024-05-20T17:55:41.254624+0000","last_peered":"2024-05-20T17:55:41.254624+0000","last_clean":"2024-05-20T17:55:41.254624+0000","last_became_active":"2024-05-20T17:55:40.265164+0000","last_became_peered":"2024-05-20T17:55:40.265164+0000","last_unstale":"2024-05-20T17:55:41.254624+0000","last_undegraded":"2024-05-20T17:55:41.254624+0000","last_fullsized":"2024-05-20T17:55:41.254624+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:15:38.124970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805052+0000","last_change":"2024-05-20T17:55:39.260761+0000","last_active":"2024-05-20T17:55:41.805052+0000","last_peered":"2024-05-20T17:55:41.805052+0000","last_clean":"2024-05-20T17:55:41.805052+0000","last_became_active":"2024-05-20T17:55:39.260432+0000","last_became_peered":"2024-05-20T17:55:39.260432+0000","last_unstale":"2024-05-20T17:55:41.805052+0000","last_undegraded":"2024-05-20T17:55:41.805052+0000","last_fullsized":"2024-05-20T17:55:41.805052+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:21:42.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805016+0000","last_change":"2024-05-20T17:55:40.276148+0000","last_active":"2024-05-20T17:55:41.805016+0000","last_peered":"2024-05-20T17:55:41.805016+0000","last_clean":"2024-05-20T17:55:41.805016+0000","last_became_active":"2024-05-20T17:55:40.275813+0000","last_became_peered":"2024-05-20T17:55:40.275813+0000","last_unstale":"2024-05-20T17:55:41.805016+0000","last_undegraded":"2024-05-20T17:55:41.805016+0000","last_fullsized":"2024-05-20T17:55:41.805016+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:15.403222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254740+0000","last_change":"2024-05-20T17:55:39.272924+0000","last_active":"2024-05-20T17:55:41.254740+0000","last_peered":"2024-05-20T17:55:41.254740+0000","last_clean":"2024-05-20T17:55:41.254740+0000","last_became_active":"2024-05-20T17:55:39.272604+0000","last_became_peered":"2024-05-20T17:55:39.272604+0000","last_unstale":"2024-05-20T17:55:41.254740+0000","last_undegraded":"2024-05-20T17:55:41.254740+0000","last_fullsized":"2024-05-20T17:55:41.254740+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:00:52.121415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966476+0000","last_change":"2024-05-20T17:55:40.270269+0000","last_active":"2024-05-20T17:55:41.966476+0000","last_peered":"2024-05-20T17:55:41.966476+0000","last_clean":"2024-05-20T17:55:41.966476+0000","last_became_active":"2024-05-20T17:55:40.269480+0000","last_became_peered":"2024-05-20T17:55:40.269480+0000","last_unstale":"2024-05-20T17:55:41.966476+0000","last_undegraded":"2024-05-20T17:55:41.966476+0000","last_fullsized":"2024-05-20T17:55:41.966476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:54:33.137115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254494+0000","last_change":"2024-05-20T17:55:39.270561+0000","last_active":"2024-05-20T17:55:41.254494+0000","last_peered":"2024-05-20T17:55:41.254494+0000","last_clean":"2024-05-20T17:55:41.254494+0000","last_became_active":"2024-05-20T17:55:39.270216+0000","last_became_peered":"2024-05-20T17:55:39.270216+0000","last_unstale":"2024-05-20T17:55:41.254494+0000","last_undegraded":"2024-05-20T17:55:41.254494+0000","last_fullsized":"2024-05-20T17:55:41.254494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:14.931204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805620+0000","last_change":"2024-05-20T17:55:40.269813+0000","last_active":"2024-05-20T17:55:41.805620+0000","last_peered":"2024-05-20T17:55:41.805620+0000","last_clean":"2024-05-20T17:55:41.805620+0000","last_became_active":"2024-05-20T17:55:40.269475+0000","last_became_peered":"2024-05-20T17:55:40.269475+0000","last_unstale":"2024-05-20T17:55:41.805620+0000","last_undegraded":"2024-05-20T17:55:41.805620+0000","last_fullsized":"2024-05-20T17:55:41.805620+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:07.635141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.257596+0000","last_change":"2024-05-20T17:55:39.266935+0000","last_active":"2024-05-20T17:55:41.257596+0000","last_peered":"2024-05-20T17:55:41.257596+0000","last_clean":"2024-05-20T17:55:41.257596+0000","last_became_active":"2024-05-20T17:55:39.264958+0000","last_became_peered":"2024-05-20T17:55:39.264958+0000","last_unstale":"2024-05-20T17:55:41.257596+0000","last_undegraded":"2024-05-20T17:55:41.257596+0000","last_fullsized":"2024-05-20T17:55:41.257596+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:22:23.155010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.254927+0000","last_change":"2024-05-20T17:55:40.266843+0000","last_active":"2024-05-20T17:55:41.254927+0000","last_peered":"2024-05-20T17:55:41.254927+0000","last_clean":"2024-05-20T17:55:41.254927+0000","last_became_active":"2024-05-20T17:55:40.266052+0000","last_became_peered":"2024-05-20T17:55:40.266052+0000","last_unstale":"2024-05-20T17:55:41.254927+0000","last_undegraded":"2024-05-20T17:55:41.254927+0000","last_fullsized":"2024-05-20T17:55:41.254927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:04.314309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.966202+0000","last_change":"2024-05-20T17:55:39.270669+0000","last_active":"2024-05-20T17:55:41.966202+0000","last_peered":"2024-05-20T17:55:41.966202+0000","last_clean":"2024-05-20T17:55:41.966202+0000","last_became_active":"2024-05-20T17:55:39.270233+0000","last_became_peered":"2024-05-20T17:55:39.270233+0000","last_unstale":"2024-05-20T17:55:41.966202+0000","last_undegraded":"2024-05-20T17:55:41.966202+0000","last_fullsized":"2024-05-20T17:55:41.966202+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:15.224675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.557129+0000","last_change":"2024-05-20T17:55:40.264890+0000","last_active":"2024-05-20T17:55:41.557129+0000","last_peered":"2024-05-20T17:55:41.557129+0000","last_clean":"2024-05-20T17:55:41.557129+0000","last_became_active":"2024-05-20T17:55:40.264196+0000","last_became_peered":"2024-05-20T17:55:40.264196+0000","last_unstale":"2024-05-20T17:55:41.557129+0000","last_undegraded":"2024-05-20T17:55:41.557129+0000","last_fullsized":"2024-05-20T17:55:41.557129+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:39.242479+0000","last_clean_scrub_stamp":"2024-05-20T17:55:39.242479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:08.064923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.805643+0000","last_change":"2024-05-20T17:55:39.269301+0000","last_active":"2024-05-20T17:55:41.805643+0000","last_peered":"2024-05-20T17:55:41.805643+0000","last_clean":"2024-05-20T17:55:41.805643+0000","last_became_active":"2024-05-20T17:55:39.268957+0000","last_became_peered":"2024-05-20T17:55:39.268957+0000","last_unstale":"2024-05-20T17:55:41.805643+0000","last_undegraded":"2024-05-20T17:55:41.805643+0000","last_fullsized":"2024-05-20T17:55:41.805643+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:55:38.240371+0000","last_clean_scrub_stamp":"2024-05-20T17:55:38.240371+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:02.787221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-05-20T17:55:41.965845+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:55:41.965845+0000","last_peered":"2024-05-20T17:55:41.965845+0000","last_clean":"2024-05-20T17:55:41.965845+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:55:41.965845+0000","last_undegraded":"2024-05-20T17:55:41.965845+0000","last_fullsized":"2024-05-20T17:55:41.965845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1208320,"data_stored":861144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":271304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":270652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":271234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":272286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":272264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":614400,"data_stored":270812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1208320,"data_stored":861076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:55:49.221 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T17:55:49.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T17:55:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.379+0000 7f31cb52f640 1 Processor -- start 2024-05-20T17:55:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.379+0000 7f31cb52f640 1 -- start start 2024-05-20T17:55:49.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31cb52f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c40d4400 0x7f31c415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31cb52f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31c40d2780 0x7f31c40d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31cb52f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c408d2a0 con 0x7f31c406cf00 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31cb52f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f31c40d3f70 con 0x7f31c40d2780 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31cb52f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f31c40d30d0 con 0x7f31c40d4400 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31c9acc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31c40d2780 0x7f31c40d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31c9acc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31c40d2780 0x7f31c40d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34998/0 (socket says 172.21.15.6:34998) 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31c9acc640 1 -- 172.21.15.6:0/1589889398 learned_addr learned my addr 172.21.15.6:0/1589889398 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31c92cb640 1 --2- 172.21.15.6:0/1589889398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c40d4400 0x7f31c415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31c9acc640 1 -- 172.21.15.6:0/1589889398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c40d4400 msgr2=0x7f31c415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31c9acc640 1 --2- 172.21.15.6:0/1589889398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c40d4400 0x7f31c415f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31c9acc640 1 -- 172.21.15.6:0/1589889398 >> v1:172.21.15.171:6789/0 conn(0x7f31c406cf00 legacy=0x7f31c406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:49.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.381+0000 7f31c9acc640 1 -- 172.21.15.6:0/1589889398 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c40d4810 con 0x7f31c40d2780 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.382+0000 7f31c9acc640 1 --2- 172.21.15.6:0/1589889398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c40d2b90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009870 tx=0x7f31bc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb697ced076f271e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.382+0000 7f31bbfff640 1 -- 172.21.15.6:0/1589889398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc037070 con 0x7f31c40d2780 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.382+0000 7f31bbfff640 1 -- 172.21.15.6:0/1589889398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31bc032440 con 0x7f31c40d2780 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.382+0000 7f31bbfff640 1 -- 172.21.15.6:0/1589889398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc032810 con 0x7f31c40d2780 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.383+0000 7f31cb52f640 1 -- 172.21.15.6:0/1589889398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 msgr2=0x7f31c40d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.383+0000 7f31cb52f640 1 --2- 172.21.15.6:0/1589889398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c40d2b90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009870 tx=0x7f31bc02a2a0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.383+0000 7f31cb52f640 1 -- 172.21.15.6:0/1589889398 shutdown_connections 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.383+0000 7f31cb52f640 1 --2- 172.21.15.6:0/1589889398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c40d2b90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.383+0000 7f31cb52f640 1 --2- 172.21.15.6:0/1589889398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c40d4400 0x7f31c415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.383+0000 7f31cb52f640 1 -- 172.21.15.6:0/1589889398 >> 172.21.15.6:0/1589889398 conn(0x7f31c40d4bb0 msgr2=0x7f31c40d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:49.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.383+0000 7f31cb52f640 1 -- 172.21.15.6:0/1589889398 shutdown_connections 2024-05-20T17:55:49.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.383+0000 7f31cb52f640 1 -- 172.21.15.6:0/1589889398 wait complete. 2024-05-20T17:55:49.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.385+0000 7f31cb52f640 1 Processor -- start 2024-05-20T17:55:49.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.385+0000 7f31cb52f640 1 -- start start 2024-05-20T17:55:49.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31cb52f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c406cf00 0x7f31c415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31cb52f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c41f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31cb52f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31c40d4400 0x7f31c40cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31cb52f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f31c40d3920 con 0x7f31c40d2780 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31cb52f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f31c40d3640 con 0x7f31c40d4400 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31cb52f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f31c40d3c00 con 0x7f31c406cf00 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31c8aca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c41f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31c8aca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c41f8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35002/0 (socket says 172.21.15.6:35002) 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31c8aca640 1 -- 172.21.15.6:0/3086755883 learned_addr learned my addr 172.21.15.6:0/3086755883 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31c9acc640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31c40d4400 0x7f31c40cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.386+0000 7f31c92cb640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c406cf00 0x7f31c415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31c8aca640 1 -- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c406cf00 msgr2=0x7f31c415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31c8aca640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c406cf00 0x7f31c415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31c8aca640 1 -- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31c40d4400 msgr2=0x7f31c40cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31c8aca640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31c40d4400 0x7f31c40cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31c8aca640 1 -- 172.21.15.6:0/3086755883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c415d750 con 0x7f31c40d2780 2024-05-20T17:55:49.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31c92cb640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c406cf00 0x7f31c415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:49.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31c8aca640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c41f8620 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b3f0 tx=0x7f31b400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31b9ffb640 1 -- 172.21.15.6:0/3086755883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4015020 con 0x7f31c40d2780 2024-05-20T17:55:49.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31b9ffb640 1 -- 172.21.15.6:0/3086755883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b4011830 con 0x7f31c40d2780 2024-05-20T17:55:49.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c415da30 con 0x7f31c40d2780 2024-05-20T17:55:49.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31b9ffb640 1 -- 172.21.15.6:0/3086755883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4011c20 con 0x7f31c40d2780 2024-05-20T17:55:49.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.387+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c415dff0 con 0x7f31c40d2780 2024-05-20T17:55:49.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.388+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c40735a0 con 0x7f31c40d2780 2024-05-20T17:55:49.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.389+0000 7f31b9ffb640 1 -- 172.21.15.6:0/3086755883 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31b4018020 con 0x7f31c40d2780 2024-05-20T17:55:49.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.389+0000 7f31b9ffb640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31a806be30 0x7f31a806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.389+0000 7f31b9ffb640 1 -- 172.21.15.6:0/3086755883 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f31b408ac30 con 0x7f31c40d2780 2024-05-20T17:55:49.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.390+0000 7f31c92cb640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31a806be30 0x7f31a806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.390+0000 7f31c92cb640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31a806be30 0x7f31a806e340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009a80 tx=0x7f31c00039d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.394+0000 7f31b9ffb640 1 -- 172.21.15.6:0/3086755883 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f31c40735a0 con 0x7f31c40d2780 2024-05-20T17:55:49.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.653+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f31c4075b00 con 0x7f31c40d2780 2024-05-20T17:55:49.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.655+0000 7f31b9ffb640 1 -- 172.21.15.6:0/3086755883 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7f31b401f030 con 0x7f31c40d2780 2024-05-20T17:55:49.655 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T17:55:49.655 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T17:55:49.655 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T17:55:49.655 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T17:55:49.655 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T17:55:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T17:55:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31a806be30 msgr2=0x7f31a806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31a806be30 0x7f31a806e340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009a80 tx=0x7f31c00039d0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 msgr2=0x7f31c41f8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c41f8620 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f31b400b3f0 tx=0x7f31b400b8b0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 shutdown_connections 2024-05-20T17:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31a806be30 0x7f31a806e340 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31c40d4400 0x7f31c40cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2780 0x7f31c41f8620 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 --2- 172.21.15.6:0/3086755883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31c406cf00 0x7f31c415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 >> 172.21.15.6:0/3086755883 conn(0x7f31c40d4bb0 msgr2=0x7f31c4158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 shutdown_connections 2024-05-20T17:55:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.658+0000 7f31cb52f640 1 -- 172.21.15.6:0/3086755883 wait complete. 2024-05-20T17:55:49.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.784+0000 7f82b1826640 1 Processor -- start 2024-05-20T17:55:49.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.784+0000 7f82b1826640 1 -- start start 2024-05-20T17:55:49.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.785+0000 7f82b1826640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82ac0ce7a0 0x7f82ac0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.785+0000 7f82b1826640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac0d0c00 con 0x7f82ac15f3f0 2024-05-20T17:55:49.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.785+0000 7f82b1826640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac0d0ec0 con 0x7f82ac0b23c0 2024-05-20T17:55:49.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.785+0000 7f82b1826640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f82ac0d17f0 con 0x7f82ac0ce7a0 2024-05-20T17:55:49.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.786+0000 7f82aaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82ac0ce7a0 0x7f82ac0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.786+0000 7f82a3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f82ac15f3f0 0x7f82ac0b1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55494/0 (socket says 172.21.15.6:55494) 2024-05-20T17:55:49.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.786+0000 7f82a3fff640 1 -- 172.21.15.6:0/3035478625 learned_addr learned my addr 172.21.15.6:0/3035478625 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.786+0000 7f82aaffd640 1 -- 172.21.15.6:0/3035478625 >> v1:172.21.15.171:6789/0 conn(0x7f82ac0b23c0 legacy=0x7f82ac0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.786+0000 7f82aaffd640 1 -- 172.21.15.6:0/3035478625 >> v1:172.21.15.6:6789/0 conn(0x7f82ac15f3f0 legacy=0x7f82ac0b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.786+0000 7f82aaffd640 1 -- 172.21.15.6:0/3035478625 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac0d11a0 con 0x7f82ac0ce7a0 2024-05-20T17:55:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.786+0000 7f82aa7fc640 1 -- 172.21.15.6:0/3035478625 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104482562 0 0) 0x7f82ac0d0c00 con 0x7f82ac15f3f0 2024-05-20T17:55:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.787+0000 7f82aaffd640 1 --2- 172.21.15.6:0/3035478625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ce7a0 0x7f82ac0afe30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0d1970 tx=0x7f829c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5204076bc51fc52 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.787+0000 7f82aa7fc640 1 -- 172.21.15.6:0/3035478625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c037070 con 0x7f82ac0ce7a0 2024-05-20T17:55:49.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.787+0000 7f82aa7fc640 1 -- 172.21.15.6:0/3035478625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c032440 con 0x7f82ac0ce7a0 2024-05-20T17:55:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.787+0000 7f82aa7fc640 1 -- 172.21.15.6:0/3035478625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c032810 con 0x7f82ac0ce7a0 2024-05-20T17:55:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.788+0000 7f82b1826640 1 -- 172.21.15.6:0/3035478625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ce7a0 msgr2=0x7f82ac0afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.788+0000 7f82b1826640 1 --2- 172.21.15.6:0/3035478625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ce7a0 0x7f82ac0afe30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0d1970 tx=0x7f829c02a210 comp rx=0 tx=0).stop 2024-05-20T17:55:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.788+0000 7f82b1826640 1 -- 172.21.15.6:0/3035478625 shutdown_connections 2024-05-20T17:55:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.788+0000 7f82b1826640 1 --2- 172.21.15.6:0/3035478625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ce7a0 0x7f82ac0afe30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.788+0000 7f82b1826640 1 -- 172.21.15.6:0/3035478625 >> 172.21.15.6:0/3035478625 conn(0x7f82ac09a4f0 msgr2=0x7f82ac0b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.788+0000 7f82b1826640 1 -- 172.21.15.6:0/3035478625 shutdown_connections 2024-05-20T17:55:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.788+0000 7f82b1826640 1 -- 172.21.15.6:0/3035478625 wait complete. 2024-05-20T17:55:49.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.789+0000 7f82b1826640 1 Processor -- start 2024-05-20T17:55:49.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.789+0000 7f82b1826640 1 -- start start 2024-05-20T17:55:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82b1826640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0b23c0 0x7f82ac15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82b1826640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac0ce7a0 0x7f82ac15fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82b1826640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac15f3f0 0x7f82ac1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82b1826640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0b65e0 con 0x7f82ac0b23c0 2024-05-20T17:55:49.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82b1826640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0b6460 con 0x7f82ac15f3f0 2024-05-20T17:55:49.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82b1826640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac0b0370 con 0x7f82ac0ce7a0 2024-05-20T17:55:49.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0b23c0 0x7f82ac15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0b23c0 0x7f82ac15f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35014/0 (socket says 172.21.15.6:35014) 2024-05-20T17:55:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 -- 172.21.15.6:0/4087108538 learned_addr learned my addr 172.21.15.6:0/4087108538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82ab7fe640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac15f3f0 0x7f82ac1618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82a3fff640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac0ce7a0 0x7f82ac15fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 -- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac0ce7a0 msgr2=0x7f82ac15fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac0ce7a0 0x7f82ac15fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 -- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac15f3f0 msgr2=0x7f82ac1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac15f3f0 0x7f82ac1618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 -- 172.21.15.6:0/4087108538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac0caa60 con 0x7f82ac0b23c0 2024-05-20T17:55:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82aaffd640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0b23c0 0x7f82ac15f840 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f829c009890 tx=0x7f829c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.791+0000 7f82a8ff9640 1 -- 172.21.15.6:0/4087108538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c037040 con 0x7f82ac0b23c0 2024-05-20T17:55:49.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.792+0000 7f82a8ff9640 1 -- 172.21.15.6:0/4087108538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c042070 con 0x7f82ac0b23c0 2024-05-20T17:55:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.792+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ac0cad40 con 0x7f82ac0b23c0 2024-05-20T17:55:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.792+0000 7f82a8ff9640 1 -- 172.21.15.6:0/4087108538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c030bd0 con 0x7f82ac0b23c0 2024-05-20T17:55:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.792+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ac0cb300 con 0x7f82ac0b23c0 2024-05-20T17:55:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.793+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ac075b00 con 0x7f82ac0b23c0 2024-05-20T17:55:49.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.793+0000 7f82a8ff9640 1 -- 172.21.15.6:0/4087108538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f829c047460 con 0x7f82ac0b23c0 2024-05-20T17:55:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.794+0000 7f82a8ff9640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f828c06be60 0x7f828c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.794+0000 7f82a8ff9640 1 -- 172.21.15.6:0/4087108538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f829c0abc80 con 0x7f82ac0b23c0 2024-05-20T17:55:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.794+0000 7f82a3fff640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f828c06be60 0x7f828c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:49.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.795+0000 7f82a3fff640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f828c06be60 0x7f828c06e370 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f82ac15bb40 tx=0x7f8294009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:49.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:49.799+0000 7f82a8ff9640 1 -- 172.21.15.6:0/4087108538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f829c04c020 con 0x7f82ac0b23c0 2024-05-20T17:55:50.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.024+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82ac06bfd0 con 0x7f82ac0b23c0 2024-05-20T17:55:50.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.025+0000 7f82a8ff9640 1 -- 172.21.15.6:0/4087108538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5178 (secure 0 0 0) 0x7f829c032e20 con 0x7f82ac0b23c0 2024-05-20T17:55:50.024 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:50.024 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/855682127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":855682127},{"type":"v1","addr":"172.21.15.171:6837","nonce":855682127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2086456440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2086456440},{"type":"v1","addr":"172.21.15.171:6836","nonce":2086456440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3128490033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3128490033},{"type":"v1","addr":"172.21.15.6:6834","nonce":3128490033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:55:39.645375+0000","modified":"2024-05-20T17:55:42.672561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5880},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5880":{"gid":5880,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1365830773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1365830773},{"type":"v1","addr":"172.21.15.6:6835","nonce":1365830773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5880,"qdb_cluster":[5880]},"id":3}]} 2024-05-20T17:55:50.024 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-05-20T17:55:50.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f828c06be60 msgr2=0x7f828c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f828c06be60 0x7f828c06e370 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f82ac15bb40 tx=0x7f8294009040 comp rx=0 tx=0).stop 2024-05-20T17:55:50.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0b23c0 msgr2=0x7f82ac15f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0b23c0 0x7f82ac15f840 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f829c009890 tx=0x7f829c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 shutdown_connections 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f828c06be60 0x7f828c06e370 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82ac15f3f0 0x7f82ac1618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f82ac0ce7a0 0x7f82ac15fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 --2- 172.21.15.6:0/4087108538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0b23c0 0x7f82ac15f840 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 >> 172.21.15.6:0/4087108538 conn(0x7f82ac09a4f0 msgr2=0x7f82ac06b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 shutdown_connections 2024-05-20T17:55:50.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.027+0000 7f82b1826640 1 -- 172.21.15.6:0/4087108538 wait complete. 2024-05-20T17:55:50.440 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T17:55:39.645375+0000', 'modified': '2024-05-20T17:55:42.672561+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5880}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5880': {'gid': 5880, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/1365830773', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1365830773}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1365830773}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5880, 'qdb_cluster': [5880]} 2024-05-20T17:55:50.440 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T17:55:50.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-20T17:55:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.559+0000 7fe016977640 1 Processor -- start 2024-05-20T17:55:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.559+0000 7fe016977640 1 -- start start 2024-05-20T17:55:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe016977640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe010162820 0x7fe0100b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe016977640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0100d0630 con 0x7fe01006dae0 2024-05-20T17:55:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe016977640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0100d39c0 con 0x7fe0100b3e80 2024-05-20T17:55:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe016977640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe0100d3ca0 con 0x7fe010162820 2024-05-20T17:55:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe00ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe010162820 0x7fe0100b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe014f14640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe01006dae0 0x7fe0100b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55500/0 (socket says 172.21.15.6:55500) 2024-05-20T17:55:50.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe014f14640 1 -- 172.21.15.6:0/2471903884 learned_addr learned my addr 172.21.15.6:0/2471903884 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:50.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe00ffff640 1 -- 172.21.15.6:0/2471903884 >> v1:172.21.15.171:6789/0 conn(0x7fe0100b3e80 legacy=0x7fe01006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe00ffff640 1 -- 172.21.15.6:0/2471903884 >> v1:172.21.15.6:6789/0 conn(0x7fe01006dae0 legacy=0x7fe0100b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe00ffff640 1 -- 172.21.15.6:0/2471903884 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0100d3f80 con 0x7fe010162820 2024-05-20T17:55:50.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.561+0000 7fe00effd640 1 -- 172.21.15.6:0/2471903884 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1568813341 0 0) 0x7fe0100d0630 con 0x7fe01006dae0 2024-05-20T17:55:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.562+0000 7fe00ffff640 1 --2- 172.21.15.6:0/2471903884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe0100b3940 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe0000097a0 tx=0x7fe00002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dba7998042ad1b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.562+0000 7fe00effd640 1 -- 172.21.15.6:0/2471903884 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000037070 con 0x7fe010162820 2024-05-20T17:55:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.562+0000 7fe00effd640 1 -- 172.21.15.6:0/2471903884 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe000032440 con 0x7fe010162820 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.562+0000 7fe00effd640 1 -- 172.21.15.6:0/2471903884 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000032810 con 0x7fe010162820 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.563+0000 7fe016977640 1 -- 172.21.15.6:0/2471903884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 msgr2=0x7fe0100b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.563+0000 7fe016977640 1 --2- 172.21.15.6:0/2471903884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe0100b3940 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe0000097a0 tx=0x7fe00002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.563+0000 7fe016977640 1 -- 172.21.15.6:0/2471903884 shutdown_connections 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.563+0000 7fe016977640 1 --2- 172.21.15.6:0/2471903884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe0100b3940 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.563+0000 7fe016977640 1 -- 172.21.15.6:0/2471903884 >> 172.21.15.6:0/2471903884 conn(0x7fe0100d4bd0 msgr2=0x7fe0100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.563+0000 7fe016977640 1 -- 172.21.15.6:0/2471903884 shutdown_connections 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.563+0000 7fe016977640 1 -- 172.21.15.6:0/2471903884 wait complete. 2024-05-20T17:55:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.565+0000 7fe016977640 1 Processor -- start 2024-05-20T17:55:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.565+0000 7fe016977640 1 -- start start 2024-05-20T17:55:50.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe016977640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0100b3e80 0x7fe0100ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe016977640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe010149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe016977640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0100b9570 0x7fe0100b9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe016977640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe0100d4780 con 0x7fe010162820 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe016977640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe0100d0300 con 0x7fe0100b9570 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe016977640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe0100d4900 con 0x7fe0100b3e80 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe00f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe010149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe00f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe010149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35040/0 (socket says 172.21.15.6:35040) 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe00f7fe640 1 -- 172.21.15.6:0/3040271599 learned_addr learned my addr 172.21.15.6:0/3040271599 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe00ffff640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0100b3e80 0x7fe0100ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.566+0000 7fe014f14640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0100b9570 0x7fe0100b9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00f7fe640 1 -- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0100b3e80 msgr2=0x7fe0100ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0100b3e80 0x7fe0100ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00f7fe640 1 -- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0100b9570 msgr2=0x7fe0100b9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0100b9570 0x7fe0100b9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00f7fe640 1 -- 172.21.15.6:0/3040271599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0100b9ec0 con 0x7fe010162820 2024-05-20T17:55:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe014f14640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0100b9570 0x7fe0100b9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe010149210 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe00400b410 tx=0x7fe00400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00cff9640 1 -- 172.21.15.6:0/3040271599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004015020 con 0x7fe010162820 2024-05-20T17:55:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00cff9640 1 -- 172.21.15.6:0/3040271599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe004011830 con 0x7fe010162820 2024-05-20T17:55:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe016977640 1 -- 172.21.15.6:0/3040271599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe010149bf0 con 0x7fe010162820 2024-05-20T17:55:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe00cff9640 1 -- 172.21.15.6:0/3040271599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004011c20 con 0x7fe010162820 2024-05-20T17:55:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.567+0000 7fe016977640 1 -- 172.21.15.6:0/3040271599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe010147320 con 0x7fe010162820 2024-05-20T17:55:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.569+0000 7fe00cff9640 1 -- 172.21.15.6:0/3040271599 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe004018020 con 0x7fe010162820 2024-05-20T17:55:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.569+0000 7fe00cff9640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdffc06be30 0x7fdffc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.569+0000 7fe00cff9640 1 -- 172.21.15.6:0/3040271599 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fe00408aea0 con 0x7fe010162820 2024-05-20T17:55:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.570+0000 7fe00ffff640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdffc06be30 0x7fdffc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.570+0000 7fe00ffff640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdffc06be30 0x7fdffc06e340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe000034000 tx=0x7fe00002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.570+0000 7fe01d81d740 1 Processor -- start 2024-05-20T17:55:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.570+0000 7fe01d81d740 1 -- start start 2024-05-20T17:55:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 0x558343780700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x55834377d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 0x558343756360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe01d81d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5583436b94d0 con 0x55834338c3b0 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe01d81d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5583436613e0 con 0x5583433b5270 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe01d81d740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5583436b5490 con 0x558343394590 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x55834377d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x55834377d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35044/0 (socket says 172.21.15.6:35044) 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 -- 172.21.15.6:0/2675211584 learned_addr learned my addr 172.21.15.6:0/2675211584 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00ffff640 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 0x558343780700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe014f14640 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 0x558343756360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 -- 172.21.15.6:0/2675211584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 msgr2=0x558343756360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 0x558343756360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 -- 172.21.15.6:0/2675211584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 msgr2=0x558343780700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 0x558343780700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 -- 172.21.15.6:0/2675211584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583433cd2d0 con 0x55834338c3b0 2024-05-20T17:55:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x55834377d0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe004009360 tx=0x7fe00405d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639c8754e4810a58 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fdff5ffb640 1 -- 172.21.15.6:0/2675211584 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004057290 con 0x55834338c3b0 2024-05-20T17:55:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fdff5ffb640 1 -- 172.21.15.6:0/2675211584 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe004055600 con 0x55834338c3b0 2024-05-20T17:55:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.572+0000 7fdff5ffb640 1 -- 172.21.15.6:0/2675211584 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004082d70 con 0x55834338c3b0 2024-05-20T17:55:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 -- 172.21.15.6:0/2675211584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 msgr2=0x55834377d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x55834377d0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe004009360 tx=0x7fe00405d400 comp rx=0 tx=0).stop 2024-05-20T17:55:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 -- 172.21.15.6:0/2675211584 shutdown_connections 2024-05-20T17:55:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 0x558343756360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x55834377d0a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2675211584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 0x558343780700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 -- 172.21.15.6:0/2675211584 >> 172.21.15.6:0/2675211584 conn(0x5583433a93c0 msgr2=0x558343755af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 -- 172.21.15.6:0/2675211584 shutdown_connections 2024-05-20T17:55:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.573+0000 7fe01d81d740 1 -- 172.21.15.6:0/2675211584 wait complete. 2024-05-20T17:55:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.574+0000 7fe01d81d740 1 -- start start 2024-05-20T17:55:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.574+0000 7fe01d81d740 1 Processor -- start 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343781950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 0x558343781e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5583433b5270 0x55834379cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe01d81d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5583436748e0 con 0x55834338c3b0 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe01d81d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5583437aced0 con 0x558343394590 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe01d81d740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x558343782450 con 0x5583433b5270 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe01d81d740 10 client.0 _ll_register_callbacks cb 0x5583436419c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343781950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343781950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35058/0 (socket says 172.21.15.6:35058) 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 -- 172.21.15.6:0/2817824918 learned_addr learned my addr 172.21.15.6:0/2817824918 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe014f14640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5583433b5270 0x55834379cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 0x558343781e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 -- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5583433b5270 msgr2=0x55834379cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5583433b5270 0x55834379cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 -- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 msgr2=0x558343781e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 0x558343781e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 -- 172.21.15.6:0/2817824918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583434976b0 con 0x55834338c3b0 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe014f14640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5583433b5270 0x55834379cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 0x558343781e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fe00ffff640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343781950 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe0000097a0 tx=0x7fe000004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f004ce1bd6e5131 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fdfeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.576+0000 7fdfeeffd640 1 -- 172.21.15.6:0/2817824918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00004f020 con 0x55834338c3b0 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fdfeeffd640 1 -- 172.21.15.6:0/2817824918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fe00004b870 con 0x55834338c3b0 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 1 -- 172.21.15.6:0/2817824918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe004055600 con 0x55834338c3b0 2024-05-20T17:55:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fdfeeffd640 1 -- 172.21.15.6:0/2817824918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe000037040 con 0x55834338c3b0 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 10 client.6057 fetch_fsmap learned FSMap version 27 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 1 -- 172.21.15.6:0/2817824918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5583437a7ab0 con 0x55834338c3b0 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fdfeeffd640 1 -- 172.21.15.6:0/2817824918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe004055600 con 0x55834338c3b0 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fdfeeffd640 1 -- 172.21.15.6:0/2817824918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fe00004ba70 con 0x55834338c3b0 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 10 client.6057 fetch_fsmap finished waiting for FSMap version 27 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 10 client.6057 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 20 client.6057 populate_metadata read hostname 'smithi006' 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] conn(0x558343373e40 0x5583437ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 4 client.6057 mds_command: new command op to 5880 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe01d81d740 1 -- 172.21.15.6:0/2817824918 --> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583436c6c00 con 0x558343373e40 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] conn(0x558343373e40 0x5583437ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.577+0000 7fdfeeffd640 10 client.6057 ms_handle_connect on v2:172.21.15.6:6833/1365830773 2024-05-20T17:55:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] conn(0x558343373e40 0x5583437ac210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85128288f0282aa5 server_cookie=24b68c6c06a20e2 in_seq=0 out_seq=0 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fdfeeffd640 1 -- 172.21.15.6:0/2817824918 <== mds.0 v2:172.21.15.6:6833/1365830773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5583436c6c00 con 0x558343373e40 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fdfeeffd640 10 client.6057 handle_command_reply: tid=0 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe01d81d740 1 client.6057 shutdown 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe01d81d740 1 -- 172.21.15.6:0/2817824918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 msgr2=0x558343781950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343781950 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe0000097a0 tx=0x7fe000004730 comp rx=0 tx=0).stop 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe01d81d740 1 -- 172.21.15.6:0/2817824918 shutdown_connections 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] conn(0x558343373e40 0x5583437ac210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5583433b5270 0x55834379cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 0x558343781e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fdfeeffd640 0 client.6057 ms_handle_reset on v2:172.21.15.6:6833/1365830773 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.578+0000 7fe01d81d740 1 --2- 172.21.15.6:0/2817824918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343781950 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.579+0000 7fe01d81d740 1 -- 172.21.15.6:0/2817824918 >> 172.21.15.6:0/2817824918 conn(0x5583433a93c0 msgr2=0x558343755af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.579+0000 7fe01d81d740 1 -- 172.21.15.6:0/2817824918 shutdown_connections 2024-05-20T17:55:50.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.579+0000 7fe01d81d740 1 -- 172.21.15.6:0/2817824918 wait complete. 2024-05-20T17:55:50.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.579+0000 7fe01d81d740 20 client.6057 trim_cache size 0 max 16384 2024-05-20T17:55:50.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.598+0000 7fe01d81d740 1 Processor -- start 2024-05-20T17:55:50.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.598+0000 7fe01d81d740 1 -- start start 2024-05-20T17:55:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55834338c3b0 0x5583437814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 0x55834379eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583433b5270 0x55834377b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe01d81d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe010201340 con 0x5583433b5270 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe01d81d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101488e0 con 0x558343394590 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe01d81d740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe010200cf0 con 0x55834338c3b0 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe014f14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583433b5270 0x55834377b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe014f14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583433b5270 0x55834377b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35070/0 (socket says 172.21.15.6:35070) 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe014f14640 1 -- 172.21.15.6:0/1070584731 learned_addr learned my addr 172.21.15.6:0/1070584731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe00ffff640 1 --2- 172.21.15.6:0/1070584731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55834338c3b0 0x5583437814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe014f14640 1 -- 172.21.15.6:0/1070584731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55834338c3b0 msgr2=0x5583437814c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe014f14640 1 --2- 172.21.15.6:0/1070584731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55834338c3b0 0x5583437814c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe014f14640 1 -- 172.21.15.6:0/1070584731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 msgr2=0x55834379eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe014f14640 1 --2- 172.21.15.6:0/1070584731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 0x55834379eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.599+0000 7fe014f14640 1 -- 172.21.15.6:0/1070584731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55834379bfd0 con 0x5583433b5270 2024-05-20T17:55:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fe014f14640 1 --2- 172.21.15.6:0/1070584731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583433b5270 0x55834377b8d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe008007630 tx=0x7fe008005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a22aba4cbdc6fc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fdff57fa640 1 -- 172.21.15.6:0/1070584731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00801a020 con 0x5583433b5270 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fdff57fa640 1 -- 172.21.15.6:0/1070584731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0080128e0 con 0x5583433b5270 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fdff57fa640 1 -- 172.21.15.6:0/1070584731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008012c90 con 0x5583433b5270 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fe01d81d740 1 -- 172.21.15.6:0/1070584731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583433b5270 msgr2=0x55834377b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fe01d81d740 1 --2- 172.21.15.6:0/1070584731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583433b5270 0x55834377b8d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe008007630 tx=0x7fe008005f50 comp rx=0 tx=0).stop 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fe01d81d740 1 -- 172.21.15.6:0/1070584731 shutdown_connections 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fe01d81d740 1 --2- 172.21.15.6:0/1070584731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583433b5270 0x55834377b8d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fe01d81d740 1 --2- 172.21.15.6:0/1070584731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558343394590 0x55834379eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fe01d81d740 1 --2- 172.21.15.6:0/1070584731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55834338c3b0 0x5583437814c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.600+0000 7fe01d81d740 1 -- 172.21.15.6:0/1070584731 >> 172.21.15.6:0/1070584731 conn(0x5583433a93c0 msgr2=0x55834377fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.601+0000 7fe01d81d740 1 -- 172.21.15.6:0/1070584731 shutdown_connections 2024-05-20T17:55:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.601+0000 7fe01d81d740 1 -- 172.21.15.6:0/1070584731 wait complete. 2024-05-20T17:55:50.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.601+0000 7fe01d81d740 1 -- start start 2024-05-20T17:55:50.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.602+0000 7fe01d81d740 1 Processor -- start 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343756970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 0x558343756eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe01d81d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 0x558343782ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe01d81d740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55834379a610 con 0x55834338c3b0 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe01d81d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5583437a7d40 con 0x5583433b5270 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe01d81d740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55834379ac00 con 0x558343394590 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe01d81d740 10 client.0 _ll_register_callbacks cb 0x7fe000032ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343756970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343756970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35080/0 (socket says 172.21.15.6:35080) 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00ffff640 1 -- 172.21.15.6:0/151840079 learned_addr learned my addr 172.21.15.6:0/151840079 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 0x558343756eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe014f14640 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 0x558343782ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00ffff640 1 -- 172.21.15.6:0/151840079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 msgr2=0x558343756eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00ffff640 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 0x558343756eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00ffff640 1 -- 172.21.15.6:0/151840079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 msgr2=0x558343782ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00ffff640 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 0x558343782ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.603+0000 7fe00ffff640 1 -- 172.21.15.6:0/151840079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583437aa1b0 con 0x55834338c3b0 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe00ffff640 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343756970 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe0000098c0 tx=0x7fe00003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574e871c6bd803e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fdfeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fdfeeffd640 1 -- 172.21.15.6:0/151840079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000061060 con 0x55834338c3b0 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fdfeeffd640 1 -- 172.21.15.6:0/151840079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fe000054890 con 0x55834338c3b0 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 1 -- 172.21.15.6:0/151840079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0080128e0 con 0x55834338c3b0 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fdfeeffd640 1 -- 172.21.15.6:0/151840079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe00004f030 con 0x55834338c3b0 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 10 client.6063 fetch_fsmap learned FSMap version 27 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 1 -- 172.21.15.6:0/151840079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5583437aaab0 con 0x55834338c3b0 2024-05-20T17:55:50.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fdfeeffd640 1 -- 172.21.15.6:0/151840079 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0080128e0 con 0x55834338c3b0 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fdfeeffd640 1 -- 172.21.15.6:0/151840079 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fe00005b070 con 0x55834338c3b0 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 10 client.6063 fetch_fsmap finished waiting for FSMap version 27 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 10 client.6063 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 20 client.6063 populate_metadata read hostname 'smithi006' 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] conn(0x55834377e980 0x55834377ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 4 client.6063 mds_command: new command op to 5880 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe01d81d740 1 -- 172.21.15.6:0/151840079 --> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] -- command(tid 0: {"prefix": "status"}) -- 0x55834379fd60 con 0x55834377e980 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.604+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] conn(0x55834377e980 0x55834377ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fdfeeffd640 10 client.6063 ms_handle_connect on v2:172.21.15.6:6833/1365830773 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe00f7fe640 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] conn(0x55834377e980 0x55834377ed90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=840fcfa043d33741 server_cookie=244e5e2c18d86542 in_seq=0 out_seq=0 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fdfeeffd640 1 -- 172.21.15.6:0/151840079 <== mds.0 v2:172.21.15.6:6833/1365830773 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55834379fd60 con 0x55834377e980 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fdfeeffd640 10 client.6063 handle_command_reply: tid=0 2024-05-20T17:55:50.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 client.6063 shutdown 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 -- 172.21.15.6:0/151840079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 msgr2=0x558343756970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343756970 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe0000098c0 tx=0x7fe00003c000 comp rx=0 tx=0).stop 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 -- 172.21.15.6:0/151840079 shutdown_connections 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583433b5270 0x558343782ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.6:6833/1365830773,v1:172.21.15.6:6835/1365830773] conn(0x55834377e980 0x55834377ed90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x558343394590 0x558343756eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 --2- 172.21.15.6:0/151840079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55834338c3b0 0x558343756970 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fdfeeffd640 0 client.6063 ms_handle_reset on v2:172.21.15.6:6833/1365830773 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 -- 172.21.15.6:0/151840079 >> 172.21.15.6:0/151840079 conn(0x5583433a93c0 msgr2=0x55834379eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 -- 172.21.15.6:0/151840079 shutdown_connections 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.605+0000 7fe01d81d740 1 -- 172.21.15.6:0/151840079 wait complete. 2024-05-20T17:55:50.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe01d81d740 20 client.6063 trim_cache size 0 max 16384 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5880, 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.354803264999999, 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 53, 2024-05-20T17:55:50.610 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 51, 2024-05-20T17:55:50.611 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 15.327284239999999 2024-05-20T17:55:50.611 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:55:50.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 -- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdffc06be30 msgr2=0x7fdffc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdffc06be30 0x7fdffc06e340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe000034000 tx=0x7fe00002e000 comp rx=0 tx=0).stop 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 -- 172.21.15.6:0/3040271599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 msgr2=0x7fe010149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe010149210 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe00400b410 tx=0x7fe00400b8d0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 -- 172.21.15.6:0/3040271599 shutdown_connections 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdffc06be30 0x7fdffc06e340 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe0100b9570 0x7fe0100b9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe010162820 0x7fe010149210 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 --2- 172.21.15.6:0/3040271599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe0100b3e80 0x7fe0100ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 -- 172.21.15.6:0/3040271599 >> 172.21.15.6:0/3040271599 conn(0x7fe0100d4bd0 msgr2=0x7fe0100ba460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 -- 172.21.15.6:0/3040271599 shutdown_connections 2024-05-20T17:55:50.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.606+0000 7fe016977640 1 -- 172.21.15.6:0/3040271599 wait complete. 2024-05-20T17:55:50.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:55:50.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.733+0000 7f25436ab640 1 Processor -- start 2024-05-20T17:55:50.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.733+0000 7f25436ab640 1 -- start start 2024-05-20T17:55:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f25436ab640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f253c163a10 0x7f253c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f25436ab640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c0d14b0 0x7f253c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f25436ab640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0d0370 con 0x7f253c0b4010 2024-05-20T17:55:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f25436ab640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f253c0d3ca0 con 0x7f253c163a10 2024-05-20T17:55:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f25436ab640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f253c0d0650 con 0x7f253c0d14b0 2024-05-20T17:55:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f2540c46640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f253c0b4010 0x7f253c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55508/0 (socket says 172.21.15.6:55508) 2024-05-20T17:55:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f2540c46640 1 -- 172.21.15.6:0/2307161933 learned_addr learned my addr 172.21.15.6:0/2307161933 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f2541447640 1 --2- 172.21.15.6:0/2307161933 >> v2:172.21.15.171:3300/0 conn(0x7f253c163a10 0x7f253c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.734+0000 7f2541c48640 1 --2- 172.21.15.6:0/2307161933 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c0d14b0 0x7f253c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.735+0000 7f2533fff640 1 -- 172.21.15.6:0/2307161933 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594789180 0 0) 0x7f253c0d0370 con 0x7f253c0b4010 2024-05-20T17:55:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.735+0000 7f2533fff640 1 -- 172.21.15.6:0/2307161933 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2528003520 con 0x7f253c0b4010 2024-05-20T17:55:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.735+0000 7f2541c48640 1 -- 172.21.15.6:0/2307161933 >> v2:172.21.15.171:3300/0 conn(0x7f253c163a10 msgr2=0x7f253c0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.735+0000 7f2541c48640 1 --2- 172.21.15.6:0/2307161933 >> v2:172.21.15.171:3300/0 conn(0x7f253c163a10 0x7f253c0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.735+0000 7f2541c48640 1 -- 172.21.15.6:0/2307161933 >> v1:172.21.15.6:6789/0 conn(0x7f253c0b4010 legacy=0x7f253c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.735+0000 7f2541c48640 1 -- 172.21.15.6:0/2307161933 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c0d3650 con 0x7f253c0d14b0 2024-05-20T17:55:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.736+0000 7f2541c48640 1 --2- 172.21.15.6:0/2307161933 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c0d14b0 0x7f253c0d18c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25340097a0 tx=0x7f253402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d58a944623f219c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.736+0000 7f2533fff640 1 -- 172.21.15.6:0/2307161933 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534037070 con 0x7f253c0d14b0 2024-05-20T17:55:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.736+0000 7f2533fff640 1 -- 172.21.15.6:0/2307161933 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2534032440 con 0x7f253c0d14b0 2024-05-20T17:55:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.736+0000 7f2533fff640 1 -- 172.21.15.6:0/2307161933 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25340327f0 con 0x7f253c0d14b0 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.737+0000 7f25436ab640 1 -- 172.21.15.6:0/2307161933 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c0d14b0 msgr2=0x7f253c0d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.737+0000 7f25436ab640 1 --2- 172.21.15.6:0/2307161933 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c0d14b0 0x7f253c0d18c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f25340097a0 tx=0x7f253402a180 comp rx=0 tx=0).stop 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.737+0000 7f25436ab640 1 -- 172.21.15.6:0/2307161933 shutdown_connections 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.737+0000 7f25436ab640 1 --2- 172.21.15.6:0/2307161933 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c0d14b0 0x7f253c0d18c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.737+0000 7f25436ab640 1 --2- 172.21.15.6:0/2307161933 >> v2:172.21.15.171:3300/0 conn(0x7f253c163a10 0x7f253c0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.737+0000 7f25436ab640 1 -- 172.21.15.6:0/2307161933 >> 172.21.15.6:0/2307161933 conn(0x7f253c06d240 msgr2=0x7f253c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.737+0000 7f25436ab640 1 -- 172.21.15.6:0/2307161933 shutdown_connections 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.737+0000 7f25436ab640 1 -- 172.21.15.6:0/2307161933 wait complete. 2024-05-20T17:55:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.738+0000 7f25436ab640 1 Processor -- start 2024-05-20T17:55:50.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.739+0000 7f25436ab640 1 -- start start 2024-05-20T17:55:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f25436ab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f253c0b4010 0x7f253c1e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f25436ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c0d14b0 0x7f253c144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f25436ab640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c163a10 0x7f253c161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f25436ab640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f253c0b8210 con 0x7f253c0d14b0 2024-05-20T17:55:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f25436ab640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f253c0d1e00 con 0x7f253c0b4010 2024-05-20T17:55:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f25436ab640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f253c0b8390 con 0x7f253c163a10 2024-05-20T17:55:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2540c46640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c0d14b0 0x7f253c144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2540c46640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c0d14b0 0x7f253c144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35092/0 (socket says 172.21.15.6:35092) 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2540c46640 1 -- 172.21.15.6:0/396269677 learned_addr learned my addr 172.21.15.6:0/396269677 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2541c48640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c163a10 0x7f253c161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2541447640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f253c0b4010 0x7f253c1e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2540c46640 1 -- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c163a10 msgr2=0x7f253c161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2540c46640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c163a10 0x7f253c161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2540c46640 1 -- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f253c0b4010 msgr2=0x7f253c1e8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2540c46640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f253c0b4010 0x7f253c1e8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.740+0000 7f2540c46640 1 -- 172.21.15.6:0/396269677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c1e90f0 con 0x7f253c0d14b0 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.741+0000 7f2540c46640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c0d14b0 0x7f253c144770 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f252c00c390 tx=0x7f252c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.741+0000 7f2531ffb640 1 -- 172.21.15.6:0/396269677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c017070 con 0x7f253c0d14b0 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.741+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c160b80 con 0x7f253c0d14b0 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.741+0000 7f2531ffb640 1 -- 172.21.15.6:0/396269677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252c005ce0 con 0x7f253c0d14b0 2024-05-20T17:55:50.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.741+0000 7f2531ffb640 1 -- 172.21.15.6:0/396269677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c0072f0 con 0x7f253c0d14b0 2024-05-20T17:55:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.741+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c161140 con 0x7f253c0d14b0 2024-05-20T17:55:50.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.742+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c075b00 con 0x7f253c0d14b0 2024-05-20T17:55:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.742+0000 7f2531ffb640 1 -- 172.21.15.6:0/396269677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f252c01a070 con 0x7f253c0d14b0 2024-05-20T17:55:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.743+0000 7f2531ffb640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f252006be60 0x7f252006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.743+0000 7f2531ffb640 1 -- 172.21.15.6:0/396269677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f252c08a3f0 con 0x7f253c0d14b0 2024-05-20T17:55:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.743+0000 7f2541447640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f252006be60 0x7f252006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:50.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.744+0000 7f2541447640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f252006be60 0x7f252006e370 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f253c0d3020 tx=0x7f253800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:50.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.748+0000 7f2531ffb640 1 -- 172.21.15.6:0/396269677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f252c058510 con 0x7f253c0d14b0 2024-05-20T17:55:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.968+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f253c0b39c0 con 0x7f253c0d14b0 2024-05-20T17:55:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.968+0000 7f2531ffb640 1 -- 172.21.15.6:0/396269677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f252c05c810 con 0x7f253c0d14b0 2024-05-20T17:55:50.967 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:55:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f252006be60 msgr2=0x7f252006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f252006be60 0x7f252006e370 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f253c0d3020 tx=0x7f253800b040 comp rx=0 tx=0).stop 2024-05-20T17:55:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c0d14b0 msgr2=0x7f253c144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c0d14b0 0x7f253c144770 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f252c00c390 tx=0x7f252c00c850 comp rx=0 tx=0).stop 2024-05-20T17:55:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 shutdown_connections 2024-05-20T17:55:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f252006be60 0x7f252006e370 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f253c163a10 0x7f253c161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c0d14b0 0x7f253c144770 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 --2- 172.21.15.6:0/396269677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f253c0b4010 0x7f253c1e8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 >> 172.21.15.6:0/396269677 conn(0x7f253c06d240 msgr2=0x7f253c0b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 shutdown_connections 2024-05-20T17:55:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:50.970+0000 7f25436ab640 1 -- 172.21.15.6:0/396269677 wait complete. 2024-05-20T17:55:50.980 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:55:50.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:55:50.980 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:55:50.980 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T17:55:50.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:55:50.981 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:55:50.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:55:50.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:55:50.981 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:55:50.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:50.981 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:55:50.997 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:55:50.997 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42563sec preferred_lft 42563sec 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T17:55:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:51.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:51.000 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:55:51.062 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:55:51.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:51.064 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:55:51.120 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:55:51.120 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:55:51.120 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:55:51.120 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:55:51.121 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:55:51.121 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:55:51.121 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:55:51.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:55:51.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:55:51.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:55:51.121 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:55:51.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:55:51.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:55:51.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:51.251 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:55:51.267 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T17:55:51.267 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T17:55:51.268 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:55:51.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:51.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:55:51.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:55:51.335 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T17:55:51.390 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:55:51.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:55:51.391 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:55:51.446 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T17:55:51.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:51.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:55:51.542 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:55:51.542 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:55:51.557 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:55:51.557 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:55:51.557 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:55:51.557 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:55:51.557 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:55:51.558 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T17:55:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:55:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:55:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:55:51.558 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:55:51.559 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:55:51.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:51.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:55:51.585 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:55:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:55:51.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:55:51.689 INFO:teuthology.orchestra.run.smithi006.stdout:client5740 2024-05-20T17:55:51.690 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:51.690 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:51.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:55:51.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.863+0000 7f6064110640 1 Processor -- start 2024-05-20T17:55:51.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.863+0000 7f6064110640 1 -- start start 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6064110640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f605c0d4400 0x7f605c15f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6064110640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c08d2a0 con 0x7f605c0d2780 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6064110640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c0d4810 con 0x7f605c06cf00 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6064110640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f605c0d3f70 con 0x7f605c0d4400 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f60626ad640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f605c0d2780 0x7f605c0d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55512/0 (socket says 172.21.15.6:55512) 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f60626ad640 1 -- 172.21.15.6:0/2211164642 learned_addr learned my addr 172.21.15.6:0/2211164642 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6061eac640 1 --2- 172.21.15.6:0/2211164642 >> v2:172.21.15.171:3300/0 conn(0x7f605c0d4400 0x7f605c15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 541314237 0 0) 0x7f604c001490 con 0x7f605c0d2780 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6044003520 con 0x7f605c0d2780 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551884490 0 0) 0x7f605c0d4810 con 0x7f605c06cf00 2024-05-20T17:55:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f604c001490 con 0x7f605c06cf00 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3535190996 0 0) 0x7f6044003520 con 0x7f605c0d2780 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 >> v2:172.21.15.171:3300/0 conn(0x7f605c0d4400 msgr2=0x7f605c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 --2- 172.21.15.6:0/2211164642 >> v2:172.21.15.171:3300/0 conn(0x7f605c0d4400 0x7f605c15f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 >> v1:172.21.15.171:6789/0 conn(0x7f605c06cf00 legacy=0x7f605c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c0d3360 con 0x7f605c0d2780 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f604c001bc0 con 0x7f605c0d2780 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6061eac640 1 --2- 172.21.15.6:0/2211164642 >> v2:172.21.15.171:3300/0 conn(0x7f605c0d4400 0x7f605c15f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 >> v1:172.21.15.6:6789/0 conn(0x7f605c0d2780 legacy=0x7f605c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6044003b40 0x7f6044003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044004800 0x7f6044004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60440051c0 0x7f604400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f605c0d3f70 con 0x7f6044003b40 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f604400c0c0 con 0x7f60440051c0 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f604400c2c0 con 0x7f6044004800 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6061eac640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6044003b40 0x7f6044003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f60626ad640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60440051c0 0x7f604400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f60616ab640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044004800 0x7f6044004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6061eac640 1 -- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044004800 msgr2=0x7f6044004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6061eac640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044004800 0x7f6044004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6061eac640 1 -- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60440051c0 msgr2=0x7f604400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6061eac640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60440051c0 0x7f604400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f6061eac640 1 -- 172.21.15.6:0/2211164642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6044003520 con 0x7f6044003b40 2024-05-20T17:55:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f60626ad640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60440051c0 0x7f604400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f60616ab640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044004800 0x7f6044004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.865+0000 7f60626ad640 1 -- 172.21.15.6:0/2211164642 reap_dead start 2024-05-20T17:55:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.866+0000 7f6061eac640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6044003b40 0x7f6044003fb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6054009c90 tx=0x7f6044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56affa569bfa0005 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.866+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054036070 con 0x7f6044003b40 2024-05-20T17:55:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.866+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6054031400 con 0x7f6044003b40 2024-05-20T17:55:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.866+0000 7f6060eaa640 1 -- 172.21.15.6:0/2211164642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054009860 con 0x7f6044003b40 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.867+0000 7f6064110640 1 -- 172.21.15.6:0/2211164642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6044003b40 msgr2=0x7f6044003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.867+0000 7f6064110640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6044003b40 0x7f6044003fb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6054009c90 tx=0x7f6044005830 comp rx=0 tx=0).stop 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.867+0000 7f6064110640 1 -- 172.21.15.6:0/2211164642 shutdown_connections 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.867+0000 7f6064110640 1 --2- 172.21.15.6:0/2211164642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6044003b40 0x7f6044003fb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.867+0000 7f6064110640 1 -- 172.21.15.6:0/2211164642 >> 172.21.15.6:0/2211164642 conn(0x7f605c0d4bb0 msgr2=0x7f605c0d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.867+0000 7f6064110640 1 -- 172.21.15.6:0/2211164642 shutdown_connections 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.867+0000 7f6064110640 1 -- 172.21.15.6:0/2211164642 wait complete. 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.868+0000 7f6064110640 1 Processor -- start 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.869+0000 7f6064110640 1 -- start start 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6064110640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044003b40 0x7f605c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6064110640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c15d020 0x7f605c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6064110640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f605c15d970 0x7f605c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6064110640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f605c0d3c00 con 0x7f605c15d020 2024-05-20T17:55:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6064110640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f605c0d3920 con 0x7f605c15d970 2024-05-20T17:55:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6064110640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f605c0d2b90 con 0x7f6044003b40 2024-05-20T17:55:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c15d020 0x7f605c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c15d020 0x7f605c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35106/0 (socket says 172.21.15.6:35106) 2024-05-20T17:55:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 -- 172.21.15.6:0/978045755 learned_addr learned my addr 172.21.15.6:0/978045755 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6061eac640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044003b40 0x7f605c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60626ad640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f605c15d970 0x7f605c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 -- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044003b40 msgr2=0x7f605c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044003b40 0x7f605c15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 -- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f605c15d970 msgr2=0x7f605c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f605c15d970 0x7f605c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 -- 172.21.15.6:0/978045755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c15bf80 con 0x7f605c15d020 2024-05-20T17:55:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f60616ab640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c15d020 0x7f605c15d430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f605000e500 tx=0x7f605000e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f605a7fc640 1 -- 172.21.15.6:0/978045755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050019070 con 0x7f605c15d020 2024-05-20T17:55:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f605a7fc640 1 -- 172.21.15.6:0/978045755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60500052e0 con 0x7f605c15d020 2024-05-20T17:55:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c1f8e80 con 0x7f605c15d020 2024-05-20T17:55:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f605a7fc640 1 -- 172.21.15.6:0/978045755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050003830 con 0x7f605c15d020 2024-05-20T17:55:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.871+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c15c540 con 0x7f605c15d020 2024-05-20T17:55:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.872+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605c0735a0 con 0x7f605c15d020 2024-05-20T17:55:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.872+0000 7f605a7fc640 1 -- 172.21.15.6:0/978045755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f605001c070 con 0x7f605c15d020 2024-05-20T17:55:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.873+0000 7f605a7fc640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f604806be60 0x7f604806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.873+0000 7f605a7fc640 1 -- 172.21.15.6:0/978045755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f605008a5f0 con 0x7f605c15d020 2024-05-20T17:55:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.873+0000 7f6061eac640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f604806be60 0x7f604806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.874+0000 7f6061eac640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f604806be60 0x7f604806e370 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6054033000 tx=0x7f6054008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:51.877+0000 7f605a7fc640 1 -- 172.21.15.6:0/978045755 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f605c0735a0 con 0x7f605c15d020 2024-05-20T17:55:52.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.102+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f605c075b00 con 0x7f605c15d020 2024-05-20T17:55:52.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.103+0000 7f605a7fc640 1 -- 172.21.15.6:0/978045755 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f6050058700 con 0x7f605c15d020 2024-05-20T17:55:52.102 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:55:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f604806be60 msgr2=0x7f604806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f604806be60 0x7f604806e370 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6054033000 tx=0x7f6054008030 comp rx=0 tx=0).stop 2024-05-20T17:55:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c15d020 msgr2=0x7f605c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c15d020 0x7f605c15d430 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f605000e500 tx=0x7f605000e900 comp rx=0 tx=0).stop 2024-05-20T17:55:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 shutdown_connections 2024-05-20T17:55:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f604806be60 0x7f604806e370 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f605c15d970 0x7f605c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f605c15d020 0x7f605c15d430 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 --2- 172.21.15.6:0/978045755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6044003b40 0x7f605c15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 >> 172.21.15.6:0/978045755 conn(0x7f605c0d4bb0 msgr2=0x7f605c0b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 shutdown_connections 2024-05-20T17:55:52.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:52.105+0000 7f6064110640 1 -- 172.21.15.6:0/978045755 wait complete. 2024-05-20T17:55:52.115 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:55:52.115 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:55:52.116 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T17:55:52.116 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T17:55:52.116 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T17:55:52.116 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:55:52.116 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:55:52.116 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:55:52.116 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:55:52.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:52.116 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T17:55:52.137 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:55:52.137 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:55:52.137 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:55:52.137 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:52.137 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:55:52.137 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:52.138 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:55:52.138 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:52.138 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T17:55:52.138 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:55:52.138 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:52.138 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T17:55:52.138 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42573sec preferred_lft 42573sec 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T17:55:52.139 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:55:52.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:52.141 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:55:52.206 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T17:55:52.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:52.208 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T17:55:52.267 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T17:55:52.268 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:55:52.268 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T17:55:52.268 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T17:55:52.268 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:55:52.269 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:55:52.269 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:55:52.269 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T17:55:52.269 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T17:55:52.269 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T17:55:52.269 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:55:52.362 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:55:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:55:52.396 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:55:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:55:52.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:52.403 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:55:52.419 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T17:55:52.419 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T17:55:52.419 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:55:52.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:52.420 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T17:55:52.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:55:52.487 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T17:55:52.543 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:55:52.543 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:55:52.543 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:55:52.598 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T17:55:52.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:52.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:55:52.694 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:55:52.694 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:55:52.702 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:55:52.702 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:55:52.702 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:55:52.702 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:55:52.702 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:55:52.703 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T17:55:52.703 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:55:52.703 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:55:52.703 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:55:52.703 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:55:52.704 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:55:52.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:52.705 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:55:52.734 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:55:52.824 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:55:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:55:52.826 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:55:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:55:52.832 INFO:teuthology.orchestra.run.smithi171.stdout:client5752 2024-05-20T17:55:52.832 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:52.832 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:52.848 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:55:52.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:55:52.899 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:55:52.948 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:55:52.948 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:55:52.948 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:52.948 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:52.967 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:52.967 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:53.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:53.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.189+0000 7fe65d59d640 1 Processor -- start 2024-05-20T17:55:53.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.189+0000 7fe65d59d640 1 -- start start 2024-05-20T17:55:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.190+0000 7fe65d59d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe65815fd30 0x7fe6581607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.190+0000 7fe65d59d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe658160270 con 0x7fe6580d12a0 2024-05-20T17:55:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.190+0000 7fe65d59d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe658160550 con 0x7fe65815ce20 2024-05-20T17:55:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.190+0000 7fe65d59d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe6580cfb20 con 0x7fe65815fd30 2024-05-20T17:55:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.190+0000 7fe6577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe65815fd30 0x7fe6581607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.190+0000 7fe65cd9c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe6580d12a0 0x7fe6580d16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55516/0 (socket says 172.21.15.6:55516) 2024-05-20T17:55:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.190+0000 7fe65cd9c640 1 -- 172.21.15.6:0/3275219632 learned_addr learned my addr 172.21.15.6:0/3275219632 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.191+0000 7fe6577fe640 1 -- 172.21.15.6:0/3275219632 >> v1:172.21.15.171:6789/0 conn(0x7fe65815ce20 legacy=0x7fe65815f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.191+0000 7fe6577fe640 1 -- 172.21.15.6:0/3275219632 >> v1:172.21.15.6:6789/0 conn(0x7fe6580d12a0 legacy=0x7fe6580d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.191+0000 7fe6577fe640 1 -- 172.21.15.6:0/3275219632 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6580d2d60 con 0x7fe65815fd30 2024-05-20T17:55:53.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.191+0000 7fe6577fe640 1 --2- 172.21.15.6:0/3275219632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe65815fd30 0x7fe6581607e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097a0 tx=0x7fe64c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787dfec0cdca2aa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.191+0000 7fe656ffd640 1 -- 172.21.15.6:0/3275219632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c037070 con 0x7fe65815fd30 2024-05-20T17:55:53.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.191+0000 7fe656ffd640 1 -- 172.21.15.6:0/3275219632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64c032440 con 0x7fe65815fd30 2024-05-20T17:55:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.192+0000 7fe656ffd640 1 -- 172.21.15.6:0/3275219632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c032810 con 0x7fe65815fd30 2024-05-20T17:55:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.192+0000 7fe65d59d640 1 -- 172.21.15.6:0/3275219632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe65815fd30 msgr2=0x7fe6581607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.192+0000 7fe65d59d640 1 --2- 172.21.15.6:0/3275219632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe65815fd30 0x7fe6581607e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097a0 tx=0x7fe64c02a1a0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.192+0000 7fe65d59d640 1 -- 172.21.15.6:0/3275219632 shutdown_connections 2024-05-20T17:55:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.192+0000 7fe65d59d640 1 --2- 172.21.15.6:0/3275219632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe65815fd30 0x7fe6581607e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.192+0000 7fe65d59d640 1 -- 172.21.15.6:0/3275219632 >> 172.21.15.6:0/3275219632 conn(0x7fe65806dbb0 msgr2=0x7fe65806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.192+0000 7fe65d59d640 1 -- 172.21.15.6:0/3275219632 shutdown_connections 2024-05-20T17:55:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.192+0000 7fe65d59d640 1 -- 172.21.15.6:0/3275219632 wait complete. 2024-05-20T17:55:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.194+0000 7fe65d59d640 1 Processor -- start 2024-05-20T17:55:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.194+0000 7fe65d59d640 1 -- start start 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.195+0000 7fe65d59d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6580d12a0 0x7fe658154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.195+0000 7fe65d59d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe65815fd30 0x7fe6580abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.195+0000 7fe65d59d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6581f5a90 0x7fe6580ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe65d59d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe6580d39c0 con 0x7fe6580d12a0 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe65d59d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe6580d3840 con 0x7fe6581f5a90 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe65d59d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580d3b40 con 0x7fe65815fd30 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6580d12a0 0x7fe658154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6580d12a0 0x7fe658154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35120/0 (socket says 172.21.15.6:35120) 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 -- 172.21.15.6:0/2115700071 learned_addr learned my addr 172.21.15.6:0/2115700071 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe6577fe640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe65815fd30 0x7fe6580abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe65cd9c640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6581f5a90 0x7fe6580ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 -- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe65815fd30 msgr2=0x7fe6580abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe65815fd30 0x7fe6580abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 -- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6581f5a90 msgr2=0x7fe6580ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6581f5a90 0x7fe6580ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 -- 172.21.15.6:0/2115700071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6580c9f20 con 0x7fe6580d12a0 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe657fff640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6580d12a0 0x7fe658154d00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe64800c440 tx=0x7fe64800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe654ff9640 1 -- 172.21.15.6:0/2115700071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6480052d0 con 0x7fe6580d12a0 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe654ff9640 1 -- 172.21.15.6:0/2115700071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648005470 con 0x7fe6580d12a0 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe654ff9640 1 -- 172.21.15.6:0/2115700071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648007260 con 0x7fe6580d12a0 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.196+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6580ca200 con 0x7fe6580d12a0 2024-05-20T17:55:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.197+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6581f5f40 con 0x7fe6580d12a0 2024-05-20T17:55:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.197+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe658075980 con 0x7fe6580d12a0 2024-05-20T17:55:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.198+0000 7fe654ff9640 1 -- 172.21.15.6:0/2115700071 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe648007400 con 0x7fe6580d12a0 2024-05-20T17:55:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.198+0000 7fe654ff9640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe64406be60 0x7fe64406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.199+0000 7fe654ff9640 1 -- 172.21.15.6:0/2115700071 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fe64808a4b0 con 0x7fe6580d12a0 2024-05-20T17:55:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.199+0000 7fe6577fe640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe64406be60 0x7fe64406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.199+0000 7fe6577fe640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe64406be60 0x7fe64406e370 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe64c034000 tx=0x7fe64c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.203+0000 7fe654ff9640 1 -- 172.21.15.6:0/2115700071 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe648058ca0 con 0x7fe6580d12a0 2024-05-20T17:55:53.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.389+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe658160950 con 0x7fe6580d12a0 2024-05-20T17:55:53.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.390+0000 7fe654ff9640 1 -- 172.21.15.6:0/2115700071 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16933 (secure 0 0 0) 0x7fe6480585a0 con 0x7fe6580d12a0 2024-05-20T17:55:53.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:53.389 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:48.321415+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:55:37.996162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-20T17:55:38.615776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe64406be60 msgr2=0x7fe64406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe64406be60 0x7fe64406e370 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe64c034000 tx=0x7fe64c02e000 comp rx=0 tx=0).stop 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6580d12a0 msgr2=0x7fe658154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6580d12a0 0x7fe658154d00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe64800c440 tx=0x7fe64800c900 comp rx=0 tx=0).stop 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 shutdown_connections 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe64406be60 0x7fe64406e370 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6581f5a90 0x7fe6580ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe65815fd30 0x7fe6580abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 --2- 172.21.15.6:0/2115700071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6580d12a0 0x7fe658154d00 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.392+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 >> 172.21.15.6:0/2115700071 conn(0x7fe65806dbb0 msgr2=0x7fe6580b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.393+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 shutdown_connections 2024-05-20T17:55:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.393+0000 7fe65d59d640 1 -- 172.21.15.6:0/2115700071 wait complete. 2024-05-20T17:55:53.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:55:37.996162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:55:38.615776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:55:53.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:55:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.522+0000 7f1c0241a640 1 Processor -- start 2024-05-20T17:55:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.522+0000 7f1c0241a640 1 -- start start 2024-05-20T17:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1c0241a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1bfc162820 0x7f1bfc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1c0241a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1bfc0b3e80 0x7f1bfc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1c0241a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1c0241a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1bfc06dd20 con 0x7f1bfc0b3e80 2024-05-20T17:55:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1c0241a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1bfc0d0630 con 0x7f1bfc162820 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1c0241a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1bfc0d39c0 con 0x7f1bfc06d910 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1bfc0b3e80 0x7f1bfc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1bfc0b3e80 0x7f1bfc06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35122/0 (socket says 172.21.15.6:35122) 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfb7fe640 1 -- 172.21.15.6:0/1938328357 learned_addr learned my addr 172.21.15.6:0/1938328357 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1c009b7640 1 --2- 172.21.15.6:0/1938328357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfbfff640 1 --2- 172.21.15.6:0/1938328357 >> v2:172.21.15.171:3300/0 conn(0x7f1bfc162820 0x7f1bfc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfb7fe640 1 -- 172.21.15.6:0/1938328357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 msgr2=0x7f1bfc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfb7fe640 1 --2- 172.21.15.6:0/1938328357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfb7fe640 1 -- 172.21.15.6:0/1938328357 >> v2:172.21.15.171:3300/0 conn(0x7f1bfc162820 msgr2=0x7f1bfc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfb7fe640 1 --2- 172.21.15.6:0/1938328357 >> v2:172.21.15.171:3300/0 conn(0x7f1bfc162820 0x7f1bfc0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.524+0000 7f1bfb7fe640 1 -- 172.21.15.6:0/1938328357 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc0d3ca0 con 0x7f1bfc0b3e80 2024-05-20T17:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.525+0000 7f1bfb7fe640 1 --2- 172.21.15.6:0/1938328357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc0b3e80 0x7f1bfc06d3d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0b7740 tx=0x7f1bf002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b80c5c5d8930b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.525+0000 7f1bfaffd640 1 -- 172.21.15.6:0/1938328357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0037070 con 0x7f1bfc0b3e80 2024-05-20T17:55:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.525+0000 7f1bfaffd640 1 -- 172.21.15.6:0/1938328357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf0032440 con 0x7f1bfc0b3e80 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.525+0000 7f1bfaffd640 1 -- 172.21.15.6:0/1938328357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0032810 con 0x7f1bfc0b3e80 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 -- 172.21.15.6:0/1938328357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc0b3e80 msgr2=0x7f1bfc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 --2- 172.21.15.6:0/1938328357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc0b3e80 0x7f1bfc06d3d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0b7740 tx=0x7f1bf002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 -- 172.21.15.6:0/1938328357 shutdown_connections 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 --2- 172.21.15.6:0/1938328357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 --2- 172.21.15.6:0/1938328357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc0b3e80 0x7f1bfc06d3d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 --2- 172.21.15.6:0/1938328357 >> v2:172.21.15.171:3300/0 conn(0x7f1bfc162820 0x7f1bfc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 -- 172.21.15.6:0/1938328357 >> 172.21.15.6:0/1938328357 conn(0x7f1bfc0d4bd0 msgr2=0x7f1bfc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 -- 172.21.15.6:0/1938328357 shutdown_connections 2024-05-20T17:55:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.526+0000 7f1c0241a640 1 -- 172.21.15.6:0/1938328357 wait complete. 2024-05-20T17:55:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.528+0000 7f1c0241a640 1 Processor -- start 2024-05-20T17:55:53.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.528+0000 7f1c0241a640 1 -- start start 2024-05-20T17:55:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c0241a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc1e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c0241a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bfc0b3e80 0x7f1bfc14a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c0241a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc162820 0x7f1bfc14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c0241a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc0d0300 con 0x7f1bfc162820 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c0241a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc0d4260 con 0x7f1bfc0b3e80 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c0241a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1bfc0d4780 con 0x7f1bfc06d910 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c009b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc162820 0x7f1bfc14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c009b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc162820 0x7f1bfc14cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35130/0 (socket says 172.21.15.6:35130) 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.529+0000 7f1c009b7640 1 -- 172.21.15.6:0/332218228 learned_addr learned my addr 172.21.15.6:0/332218228 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1bfbfff640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc1e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1bfb7fe640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bfc0b3e80 0x7f1bfc14a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1c009b7640 1 -- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 msgr2=0x7f1bfc1e7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1c009b7640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc1e7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1c009b7640 1 -- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bfc0b3e80 msgr2=0x7f1bfc14a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1c009b7640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bfc0b3e80 0x7f1bfc14a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1c009b7640 1 -- 172.21.15.6:0/332218228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc14ac20 con 0x7f1bfc162820 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1bfbfff640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc1e7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1bfb7fe640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bfc0b3e80 0x7f1bfc14a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1c009b7640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc162820 0x7f1bfc14cf80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400eea0 tx=0x7f1bf400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1bf8ff9640 1 -- 172.21.15.6:0/332218228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4018020 con 0x7f1bfc162820 2024-05-20T17:55:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1bf8ff9640 1 -- 172.21.15.6:0/332218228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf400bca0 con 0x7f1bfc162820 2024-05-20T17:55:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bfc14b240 con 0x7f1bfc162820 2024-05-20T17:55:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1bf8ff9640 1 -- 172.21.15.6:0/332218228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4014640 con 0x7f1bfc162820 2024-05-20T17:55:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.530+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bfc14b800 con 0x7f1bfc162820 2024-05-20T17:55:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.531+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bfc075b00 con 0x7f1bfc162820 2024-05-20T17:55:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.532+0000 7f1bf8ff9640 1 -- 172.21.15.6:0/332218228 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bf4005d10 con 0x7f1bfc162820 2024-05-20T17:55:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.532+0000 7f1bf8ff9640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1be806be60 0x7f1be806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.532+0000 7f1bf8ff9640 1 -- 172.21.15.6:0/332218228 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f1bf408b8f0 con 0x7f1bfc162820 2024-05-20T17:55:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.533+0000 7f1bfbfff640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1be806be60 0x7f1be806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.533+0000 7f1bfbfff640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1be806be60 0x7f1be806e370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009af0 tx=0x7f1bec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.537+0000 7f1bf8ff9640 1 -- 172.21.15.6:0/332218228 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1bf4022030 con 0x7f1bfc162820 2024-05-20T17:55:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.722+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1bfc0cb6c0 con 0x7f1bfc162820 2024-05-20T17:55:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.722+0000 7f1bf8ff9640 1 -- 172.21.15.6:0/332218228 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f1bf405a040 con 0x7f1bfc162820 2024-05-20T17:55:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:55:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1be806be60 msgr2=0x7f1be806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1be806be60 0x7f1be806e370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009af0 tx=0x7f1bec008040 comp rx=0 tx=0).stop 2024-05-20T17:55:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc162820 msgr2=0x7f1bfc14cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc162820 0x7f1bfc14cf80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400eea0 tx=0x7f1bf400ef90 comp rx=0 tx=0).stop 2024-05-20T17:55:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 shutdown_connections 2024-05-20T17:55:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1be806be60 0x7f1be806e370 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bfc162820 0x7f1bfc14cf80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bfc0b3e80 0x7f1bfc14a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 --2- 172.21.15.6:0/332218228 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bfc06d910 0x7f1bfc1e7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.724+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 >> 172.21.15.6:0/332218228 conn(0x7f1bfc0d4bd0 msgr2=0x7f1bfc0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.725+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 shutdown_connections 2024-05-20T17:55:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.725+0000 7f1c0241a640 1 -- 172.21.15.6:0/332218228 wait complete. 2024-05-20T17:55:53.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:55:53.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.853+0000 7f7ef7e32640 1 Processor -- start 2024-05-20T17:55:53.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.853+0000 7f7ef7e32640 1 -- start start 2024-05-20T17:55:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef7e32640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7ef00cf3d0 0x7f7ef00cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef7e32640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef00cfd20 con 0x7f7ef00ce7e0 2024-05-20T17:55:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef7e32640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ef00cda20 con 0x7f7ef015f220 2024-05-20T17:55:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef7e32640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef00cdd00 con 0x7f7ef00cf3d0 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef63cf640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7ef00ce7e0 0x7f7ef00cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55530/0 (socket says 172.21.15.6:55530) 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef63cf640 1 -- 172.21.15.6:0/2006630603 learned_addr learned my addr 172.21.15.6:0/2006630603 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef53cd640 1 --2- 172.21.15.6:0/2006630603 >> v2:172.21.15.171:3300/0 conn(0x7f7ef00cf3d0 0x7f7ef00cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef4bcc640 1 -- 172.21.15.6:0/2006630603 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515876343 0 0) 0x7f7ee8001490 con 0x7f7ef00ce7e0 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef4bcc640 1 -- 172.21.15.6:0/2006630603 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7edc003520 con 0x7f7ef00ce7e0 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef4bcc640 1 -- 172.21.15.6:0/2006630603 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1784260189 0 0) 0x7f7edc003520 con 0x7f7ef00ce7e0 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef53cd640 1 -- 172.21.15.6:0/2006630603 >> v1:172.21.15.171:6789/0 conn(0x7f7ef015f220 legacy=0x7f7ef00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef53cd640 1 -- 172.21.15.6:0/2006630603 >> v1:172.21.15.6:6789/0 conn(0x7f7ef00ce7e0 legacy=0x7f7ef00cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.855+0000 7f7ef53cd640 1 -- 172.21.15.6:0/2006630603 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef00cdfe0 con 0x7f7ef00cf3d0 2024-05-20T17:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.856+0000 7f7ef53cd640 1 --2- 172.21.15.6:0/2006630603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00cf3d0 0x7f7ef00cf7e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00097a0 tx=0x7f7ee002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf92d1fa22240e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.856+0000 7f7ef4bcc640 1 -- 172.21.15.6:0/2006630603 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0037070 con 0x7f7ef00cf3d0 2024-05-20T17:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef4bcc640 1 -- 172.21.15.6:0/2006630603 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee002abc0 con 0x7f7ef00cf3d0 2024-05-20T17:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef4bcc640 1 -- 172.21.15.6:0/2006630603 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8001bc0 con 0x7f7ef00cf3d0 2024-05-20T17:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef7e32640 1 -- 172.21.15.6:0/2006630603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00cf3d0 msgr2=0x7f7ef00cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef7e32640 1 --2- 172.21.15.6:0/2006630603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00cf3d0 0x7f7ef00cf7e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00097a0 tx=0x7f7ee002a130 comp rx=0 tx=0).stop 2024-05-20T17:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef7e32640 1 -- 172.21.15.6:0/2006630603 shutdown_connections 2024-05-20T17:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef7e32640 1 --2- 172.21.15.6:0/2006630603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00cf3d0 0x7f7ef00cf7e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef7e32640 1 -- 172.21.15.6:0/2006630603 >> 172.21.15.6:0/2006630603 conn(0x7f7ef00b44d0 msgr2=0x7f7ef00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef7e32640 1 -- 172.21.15.6:0/2006630603 shutdown_connections 2024-05-20T17:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.857+0000 7f7ef7e32640 1 -- 172.21.15.6:0/2006630603 wait complete. 2024-05-20T17:55:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.859+0000 7f7ef7e32640 1 Processor -- start 2024-05-20T17:55:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.859+0000 7f7ef7e32640 1 -- start start 2024-05-20T17:55:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.860+0000 7f7ef7e32640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00ce7e0 0x7f7ef00c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.860+0000 7f7ef7e32640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ef00cf3d0 0x7f7ef0145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.860+0000 7f7ef7e32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef015f220 0x7f7ef0145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.860+0000 7f7ef7e32640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef00cd680 con 0x7f7ef015f220 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.860+0000 7f7ef7e32640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef00d0fd0 con 0x7f7ef00ce7e0 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.860+0000 7f7ef7e32640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef00cd800 con 0x7f7ef00cf3d0 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef015f220 0x7f7ef0145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef015f220 0x7f7ef0145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35140/0 (socket says 172.21.15.6:35140) 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 -- 172.21.15.6:0/3854772168 learned_addr learned my addr 172.21.15.6:0/3854772168 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef5bce640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00ce7e0 0x7f7ef00c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef53cd640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ef00cf3d0 0x7f7ef0145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 -- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ef00cf3d0 msgr2=0x7f7ef0145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ef00cf3d0 0x7f7ef0145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 -- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00ce7e0 msgr2=0x7f7ef00c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00ce7e0 0x7f7ef00c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 -- 172.21.15.6:0/3854772168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef01464d0 con 0x7f7ef015f220 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef63cf640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef015f220 0x7f7ef0145c60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800cc10 tx=0x7f7ee800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ee67fc640 1 -- 172.21.15.6:0/3854772168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8017070 con 0x7f7ef015f220 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ee67fc640 1 -- 172.21.15.6:0/3854772168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee800ce20 con 0x7f7ef015f220 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef00c83c0 con 0x7f7ef015f220 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ee67fc640 1 -- 172.21.15.6:0/3854772168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8012640 con 0x7f7ef015f220 2024-05-20T17:55:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.861+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef00c8980 con 0x7f7ef015f220 2024-05-20T17:55:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.862+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef0075b00 con 0x7f7ef015f220 2024-05-20T17:55:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.863+0000 7f7ee67fc640 1 -- 172.21.15.6:0/3854772168 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ee801a070 con 0x7f7ef015f220 2024-05-20T17:55:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.863+0000 7f7ee67fc640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ed406be30 0x7f7ed406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.864+0000 7f7ee67fc640 1 -- 172.21.15.6:0/3854772168 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f7ee808afb0 con 0x7f7ef015f220 2024-05-20T17:55:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.864+0000 7f7ef5bce640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ed406be30 0x7f7ed406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.864+0000 7f7ef5bce640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ed406be30 0x7f7ed406e340 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7eec000f60 tx=0x7f7eec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:53.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:53.868+0000 7f7ee67fc640 1 -- 172.21.15.6:0/3854772168 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7ef00cfd20 con 0x7f7ef015f220 2024-05-20T17:55:54.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.051+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7ef0162c60 con 0x7f7ef015f220 2024-05-20T17:55:54.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.051+0000 7f7ee67fc640 1 -- 172.21.15.6:0/3854772168 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) ==== 104+0+11 (secure 0 0 0) 0x7f7ee8059020 con 0x7f7ef015f220 2024-05-20T17:55:54.049 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ed406be30 msgr2=0x7f7ed406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ed406be30 0x7f7ed406e340 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7eec000f60 tx=0x7f7eec009040 comp rx=0 tx=0).stop 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef015f220 msgr2=0x7f7ef0145c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef015f220 0x7f7ef0145c60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800cc10 tx=0x7f7ee800a430 comp rx=0 tx=0).stop 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 shutdown_connections 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ed406be30 0x7f7ed406e340 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef015f220 0x7f7ef0145c60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ef00cf3d0 0x7f7ef0145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 --2- 172.21.15.6:0/3854772168 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ef00ce7e0 0x7f7ef00c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 >> 172.21.15.6:0/3854772168 conn(0x7f7ef00b44d0 msgr2=0x7f7ef00d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 shutdown_connections 2024-05-20T17:55:54.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.053+0000 7f7ef7e32640 1 -- 172.21.15.6:0/3854772168 wait complete. 2024-05-20T17:55:54.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:55:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.182+0000 7f0252c1b640 1 Processor -- start 2024-05-20T17:55:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.182+0000 7f0252c1b640 1 -- start start 2024-05-20T17:55:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f0252c1b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f024c0d4400 0x7f024c15f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f0252c1b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d2780 0x7f024c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f0252c1b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f024c08d2a0 con 0x7f024c06cf00 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f0252c1b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f024c0d3f70 con 0x7f024c0d4400 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f0252c1b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f024c0d30d0 con 0x7f024c0d2780 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f02509b7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f024c0d4400 0x7f024c15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f024bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f024c06cf00 0x7f024c06d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55546/0 (socket says 172.21.15.6:55546) 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f024bfff640 1 -- 172.21.15.6:0/1326375821 learned_addr learned my addr 172.21.15.6:0/1326375821 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f02511b8640 1 --2- 172.21.15.6:0/1326375821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d2780 0x7f024c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f02509b7640 1 -- 172.21.15.6:0/1326375821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d2780 msgr2=0x7f024c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f02509b7640 1 --2- 172.21.15.6:0/1326375821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d2780 0x7f024c0d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f02509b7640 1 -- 172.21.15.6:0/1326375821 >> v1:172.21.15.6:6789/0 conn(0x7f024c06cf00 legacy=0x7f024c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f02509b7640 1 -- 172.21.15.6:0/1326375821 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c0d4810 con 0x7f024c0d4400 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f024b7fe640 1 -- 172.21.15.6:0/1326375821 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3667367135 0 0) 0x7f0240001110 con 0x7f024c06cf00 2024-05-20T17:55:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.184+0000 7f02511b8640 1 --2- 172.21.15.6:0/1326375821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d2780 0x7f024c0d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.185+0000 7f02509b7640 1 --2- 172.21.15.6:0/1326375821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d4400 0x7f024c15f440 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f023c0097a0 tx=0x7f023c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d63a698dd19c98 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.185+0000 7f024b7fe640 1 -- 172.21.15.6:0/1326375821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c037070 con 0x7f024c0d4400 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.185+0000 7f024b7fe640 1 -- 172.21.15.6:0/1326375821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023c032440 con 0x7f024c0d4400 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.185+0000 7f024b7fe640 1 -- 172.21.15.6:0/1326375821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c032810 con 0x7f024c0d4400 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.186+0000 7f0252c1b640 1 -- 172.21.15.6:0/1326375821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d4400 msgr2=0x7f024c15f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.186+0000 7f0252c1b640 1 --2- 172.21.15.6:0/1326375821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d4400 0x7f024c15f440 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f023c0097a0 tx=0x7f023c02a210 comp rx=0 tx=0).stop 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.186+0000 7f0252c1b640 1 -- 172.21.15.6:0/1326375821 shutdown_connections 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.186+0000 7f0252c1b640 1 --2- 172.21.15.6:0/1326375821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d2780 0x7f024c0d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.186+0000 7f0252c1b640 1 --2- 172.21.15.6:0/1326375821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d4400 0x7f024c15f440 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.186+0000 7f0252c1b640 1 -- 172.21.15.6:0/1326375821 >> 172.21.15.6:0/1326375821 conn(0x7f024c0d4bb0 msgr2=0x7f024c0d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.186+0000 7f0252c1b640 1 -- 172.21.15.6:0/1326375821 shutdown_connections 2024-05-20T17:55:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.186+0000 7f0252c1b640 1 -- 172.21.15.6:0/1326375821 wait complete. 2024-05-20T17:55:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.188+0000 7f0252c1b640 1 Processor -- start 2024-05-20T17:55:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.188+0000 7f0252c1b640 1 -- start start 2024-05-20T17:55:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f0252c1b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c06cf00 0x7f024c0b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f0252c1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d2780 0x7f024c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f0252c1b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d4400 0x7f024c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f0252c1b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f024c0d3920 con 0x7f024c0d2780 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f0252c1b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f024c0d3640 con 0x7f024c06cf00 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f0252c1b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f024c0d3c00 con 0x7f024c0d4400 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f024bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d2780 0x7f024c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f024bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d2780 0x7f024c150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35152/0 (socket says 172.21.15.6:35152) 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f024bfff640 1 -- 172.21.15.6:0/3769988153 learned_addr learned my addr 172.21.15.6:0/3769988153 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f02511b8640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d4400 0x7f024c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.189+0000 7f02509b7640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c06cf00 0x7f024c0b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f024bfff640 1 -- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d4400 msgr2=0x7f024c14f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f024bfff640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d4400 0x7f024c14f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f024bfff640 1 -- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c06cf00 msgr2=0x7f024c0b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f024bfff640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c06cf00 0x7f024c0b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f024bfff640 1 -- 172.21.15.6:0/3769988153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c14fe90 con 0x7f024c0d2780 2024-05-20T17:55:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f024bfff640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d2780 0x7f024c150c50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f024000c430 tx=0x7f024000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f02497fa640 1 -- 172.21.15.6:0/3769988153 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02400074e0 con 0x7f024c0d2780 2024-05-20T17:55:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f02497fa640 1 -- 172.21.15.6:0/3769988153 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02400047e0 con 0x7f024c0d2780 2024-05-20T17:55:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c150170 con 0x7f024c0d2780 2024-05-20T17:55:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f02497fa640 1 -- 172.21.15.6:0/3769988153 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240004bd0 con 0x7f024c0d2780 2024-05-20T17:55:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.190+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c15eab0 con 0x7f024c0d2780 2024-05-20T17:55:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.191+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024c0735a0 con 0x7f024c0d2780 2024-05-20T17:55:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.192+0000 7f02497fa640 1 -- 172.21.15.6:0/3769988153 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0240011070 con 0x7f024c0d2780 2024-05-20T17:55:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.192+0000 7f02497fa640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f023806be60 0x7f023806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.192+0000 7f02497fa640 1 -- 172.21.15.6:0/3769988153 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f024008ab70 con 0x7f024c0d2780 2024-05-20T17:55:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.192+0000 7f02509b7640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f023806be60 0x7f023806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.193+0000 7f02509b7640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f023806be60 0x7f023806e370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f023c034000 tx=0x7f023c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:54.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.197+0000 7f02497fa640 1 -- 172.21.15.6:0/3769988153 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f024c0735a0 con 0x7f024c0d2780 2024-05-20T17:55:54.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.380+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f024c075b00 con 0x7f024c0d2780 2024-05-20T17:55:54.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.380+0000 7f02497fa640 1 -- 172.21.15.6:0/3769988153 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) ==== 100+0+11 (secure 0 0 0) 0x7f024c08d2a0 con 0x7f024c0d2780 2024-05-20T17:55:54.378 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:55:54.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f023806be60 msgr2=0x7f023806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f023806be60 0x7f023806e370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f023c034000 tx=0x7f023c02e000 comp rx=0 tx=0).stop 2024-05-20T17:55:54.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d2780 msgr2=0x7f024c150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d2780 0x7f024c150c50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f024000c430 tx=0x7f024000c8f0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 shutdown_connections 2024-05-20T17:55:54.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f023806be60 0x7f023806e370 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0d4400 0x7f024c14f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f024c0d2780 0x7f024c150c50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 --2- 172.21.15.6:0/3769988153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c06cf00 0x7f024c0b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 >> 172.21.15.6:0/3769988153 conn(0x7f024c0d4bb0 msgr2=0x7f024c15faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:54.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 shutdown_connections 2024-05-20T17:55:54.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.382+0000 7f0252c1b640 1 -- 172.21.15.6:0/3769988153 wait complete. 2024-05-20T17:55:54.391 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:55:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.508+0000 7ff010121640 1 Processor -- start 2024-05-20T17:55:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.509+0000 7ff010121640 1 -- start start 2024-05-20T17:55:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff010121640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff008162820 0x7ff0080b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff010121640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff0080b3e80 0x7ff00806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff010121640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00806dd20 con 0x7ff00806d910 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff010121640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff0080d0630 con 0x7ff008162820 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff010121640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff0080d39c0 con 0x7ff0080b3e80 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff00debd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff008162820 0x7ff0080b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff00e6be640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff00806d910 0x7ff0080d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55548/0 (socket says 172.21.15.6:55548) 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff00e6be640 1 -- 172.21.15.6:0/2555207926 learned_addr learned my addr 172.21.15.6:0/2555207926 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.510+0000 7ff00d6bc640 1 --2- 172.21.15.6:0/2555207926 >> v2:172.21.15.171:3300/0 conn(0x7ff0080b3e80 0x7ff00806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.511+0000 7ff00debd640 1 -- 172.21.15.6:0/2555207926 >> v2:172.21.15.171:3300/0 conn(0x7ff0080b3e80 msgr2=0x7ff00806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.511+0000 7ff00debd640 1 --2- 172.21.15.6:0/2555207926 >> v2:172.21.15.171:3300/0 conn(0x7ff0080b3e80 0x7ff00806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.511+0000 7ff00debd640 1 -- 172.21.15.6:0/2555207926 >> v1:172.21.15.6:6789/0 conn(0x7ff00806d910 legacy=0x7ff0080d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.511+0000 7ff00cebb640 1 -- 172.21.15.6:0/2555207926 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1753759089 0 0) 0x7ff000001110 con 0x7ff00806d910 2024-05-20T17:55:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.511+0000 7ff00debd640 1 -- 172.21.15.6:0/2555207926 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0080d3ca0 con 0x7ff008162820 2024-05-20T17:55:54.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.511+0000 7ff00d6bc640 1 --2- 172.21.15.6:0/2555207926 >> v2:172.21.15.171:3300/0 conn(0x7ff0080b3e80 0x7ff00806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.511+0000 7ff00debd640 1 --2- 172.21.15.6:0/2555207926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff008162820 0x7ff0080b3940 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff0080d1230 tx=0x7ff00402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69f09f1ac127e78 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff00cebb640 1 -- 172.21.15.6:0/2555207926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004007740 con 0x7ff008162820 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff00cebb640 1 -- 172.21.15.6:0/2555207926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0040078e0 con 0x7ff008162820 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff00cebb640 1 -- 172.21.15.6:0/2555207926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004007cb0 con 0x7ff008162820 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff010121640 1 -- 172.21.15.6:0/2555207926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff008162820 msgr2=0x7ff0080b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff010121640 1 --2- 172.21.15.6:0/2555207926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff008162820 0x7ff0080b3940 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff0080d1230 tx=0x7ff00402a680 comp rx=0 tx=0).stop 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff010121640 1 -- 172.21.15.6:0/2555207926 shutdown_connections 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff010121640 1 --2- 172.21.15.6:0/2555207926 >> v2:172.21.15.171:3300/0 conn(0x7ff0080b3e80 0x7ff00806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff010121640 1 --2- 172.21.15.6:0/2555207926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff008162820 0x7ff0080b3940 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff010121640 1 -- 172.21.15.6:0/2555207926 >> 172.21.15.6:0/2555207926 conn(0x7ff0080d4bd0 msgr2=0x7ff0080d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff010121640 1 -- 172.21.15.6:0/2555207926 shutdown_connections 2024-05-20T17:55:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.512+0000 7ff010121640 1 -- 172.21.15.6:0/2555207926 wait complete. 2024-05-20T17:55:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.514+0000 7ff010121640 1 Processor -- start 2024-05-20T17:55:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.514+0000 7ff010121640 1 -- start start 2024-05-20T17:55:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.515+0000 7ff010121640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00806d910 0x7ff0081e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.515+0000 7ff010121640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0080b3e80 0x7ff0080cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.515+0000 7ff010121640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff008162820 0x7ff0081f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.515+0000 7ff010121640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0080d0300 con 0x7ff00806d910 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.515+0000 7ff010121640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff0080d4260 con 0x7ff008162820 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff010121640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0080b91a0 con 0x7ff0080b3e80 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00806d910 0x7ff0081e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00806d910 0x7ff0081e87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35160/0 (socket says 172.21.15.6:35160) 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 -- 172.21.15.6:0/4056326200 learned_addr learned my addr 172.21.15.6:0/4056326200 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00e6be640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff008162820 0x7ff0081f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00d6bc640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0080b3e80 0x7ff0080cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 -- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0080b3e80 msgr2=0x7ff0080cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0080b3e80 0x7ff0080cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 -- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff008162820 msgr2=0x7ff0081f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff008162820 0x7ff0081f8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 -- 172.21.15.6:0/4056326200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0081e8ec0 con 0x7ff00806d910 2024-05-20T17:55:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff00debd640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00806d910 0x7ff0081e87a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff00402ac70 tx=0x7ff004004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7feffe7fc640 1 -- 172.21.15.6:0/4056326200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00403f070 con 0x7ff00806d910 2024-05-20T17:55:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7feffe7fc640 1 -- 172.21.15.6:0/4056326200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff004031c40 con 0x7ff00806d910 2024-05-20T17:55:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0081e91a0 con 0x7ff00806d910 2024-05-20T17:55:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7feffe7fc640 1 -- 172.21.15.6:0/4056326200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004043410 con 0x7ff00806d910 2024-05-20T17:55:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.516+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00814b210 con 0x7ff00806d910 2024-05-20T17:55:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.517+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00814b470 con 0x7ff00806d910 2024-05-20T17:55:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.518+0000 7feffe7fc640 1 -- 172.21.15.6:0/4056326200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0040435b0 con 0x7ff00806d910 2024-05-20T17:55:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.518+0000 7feffe7fc640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefec06be30 0x7fefec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.519+0000 7feffe7fc640 1 -- 172.21.15.6:0/4056326200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7ff0040ac520 con 0x7ff00806d910 2024-05-20T17:55:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.519+0000 7ff00d6bc640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefec06be30 0x7fefec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.519+0000 7ff00d6bc640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefec06be30 0x7fefec06e340 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff0081f99d0 tx=0x7feff8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.523+0000 7feffe7fc640 1 -- 172.21.15.6:0/4056326200 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff00407ad10 con 0x7ff00806d910 2024-05-20T17:55:54.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.721+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff008075b00 con 0x7ff00806d910 2024-05-20T17:55:54.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.721+0000 7feffe7fc640 1 -- 172.21.15.6:0/4056326200 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) ==== 80+0+0 (secure 0 0 0) 0x7ff00407a610 con 0x7ff00806d910 2024-05-20T17:55:54.719 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:55:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefec06be30 msgr2=0x7fefec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefec06be30 0x7fefec06e340 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff0081f99d0 tx=0x7feff8008040 comp rx=0 tx=0).stop 2024-05-20T17:55:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00806d910 msgr2=0x7ff0081e87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00806d910 0x7ff0081e87a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff00402ac70 tx=0x7ff004004a40 comp rx=0 tx=0).stop 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 shutdown_connections 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefec06be30 0x7fefec06e340 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff008162820 0x7ff0081f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0080b3e80 0x7ff0080cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 --2- 172.21.15.6:0/4056326200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00806d910 0x7ff0081e87a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 >> 172.21.15.6:0/4056326200 conn(0x7ff0080d4bd0 msgr2=0x7ff0080b83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 shutdown_connections 2024-05-20T17:55:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:54.723+0000 7ff010121640 1 -- 172.21.15.6:0/4056326200 wait complete. 2024-05-20T17:55:54.732 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T17:55:54.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:54.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T17:55:54.761 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:55:54.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:54.761 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T17:55:54.822 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:55:54.822 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:54.822 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:54.842 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:54.842 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:54.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.017+0000 7f5e01c3d640 1 Processor -- start 2024-05-20T17:55:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.017+0000 7f5e01c3d640 1 -- start start 2024-05-20T17:55:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5e01c3d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5dfc162820 0x7f5dfc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5e01c3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc0b3e80 0x7f5dfc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5e01c3d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dfc06dd20 con 0x7f5dfc06d910 2024-05-20T17:55:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5e01c3d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5dfc0d0630 con 0x7f5dfc162820 2024-05-20T17:55:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5e01c3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5dfc0d39c0 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5dfaffd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc0b3e80 0x7f5dfc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5dfb7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5dfc162820 0x7f5dfc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5dfbfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f5dfc06d910 0x7f5dfc0d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:52272/0 (socket says 172.21.15.6:52272) 2024-05-20T17:55:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5dfbfff640 1 -- 172.21.15.6:0/1513836995 learned_addr learned my addr 172.21.15.6:0/1513836995 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5dfb7fe640 1 -- 172.21.15.6:0/1513836995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc0b3e80 msgr2=0x7f5dfc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5dfb7fe640 1 --2- 172.21.15.6:0/1513836995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc0b3e80 0x7f5dfc06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5dfb7fe640 1 -- 172.21.15.6:0/1513836995 >> v1:172.21.15.171:6789/0 conn(0x7f5dfc06d910 legacy=0x7f5dfc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.019+0000 7f5dfb7fe640 1 -- 172.21.15.6:0/1513836995 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc0d3ca0 con 0x7f5dfc162820 2024-05-20T17:55:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.020+0000 7f5dfb7fe640 1 --2- 172.21.15.6:0/1513836995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc162820 0x7f5dfc0b3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0097a0 tx=0x7f5dec02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b9680167d4a31f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.020+0000 7f5dfa7fc640 1 -- 172.21.15.6:0/1513836995 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec037070 con 0x7f5dfc162820 2024-05-20T17:55:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.020+0000 7f5dfa7fc640 1 -- 172.21.15.6:0/1513836995 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dec032440 con 0x7f5dfc162820 2024-05-20T17:55:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.020+0000 7f5dfa7fc640 1 -- 172.21.15.6:0/1513836995 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec032810 con 0x7f5dfc162820 2024-05-20T17:55:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.021+0000 7f5e01c3d640 1 -- 172.21.15.6:0/1513836995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc162820 msgr2=0x7f5dfc0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.021+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/1513836995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc162820 0x7f5dfc0b3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5dec0097a0 tx=0x7f5dec02a180 comp rx=0 tx=0).stop 2024-05-20T17:55:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.021+0000 7f5e01c3d640 1 -- 172.21.15.6:0/1513836995 shutdown_connections 2024-05-20T17:55:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.021+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/1513836995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc0b3e80 0x7f5dfc06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.021+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/1513836995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc162820 0x7f5dfc0b3940 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.021+0000 7f5e01c3d640 1 -- 172.21.15.6:0/1513836995 >> 172.21.15.6:0/1513836995 conn(0x7f5dfc0d4bd0 msgr2=0x7f5dfc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.021+0000 7f5e01c3d640 1 -- 172.21.15.6:0/1513836995 shutdown_connections 2024-05-20T17:55:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.021+0000 7f5e01c3d640 1 -- 172.21.15.6:0/1513836995 wait complete. 2024-05-20T17:55:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.023+0000 7f5e01c3d640 1 Processor -- start 2024-05-20T17:55:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.023+0000 7f5e01c3d640 1 -- start start 2024-05-20T17:55:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.024+0000 7f5e01c3d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc06d910 0x7f5dfc0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.024+0000 7f5e01c3d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc0b3e80 0x7f5dfc0b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.024+0000 7f5e01c3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc162820 0x7f5dfc0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.024+0000 7f5e01c3d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc0d0300 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.024+0000 7f5e01c3d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc0d4260 con 0x7f5dfc06d910 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.024+0000 7f5e01c3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5dfc0b91a0 con 0x7f5dfc162820 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc0b3e80 0x7f5dfc0b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc0b3e80 0x7f5dfc0b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35174/0 (socket says 172.21.15.6:35174) 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 -- 172.21.15.6:0/2705289325 learned_addr learned my addr 172.21.15.6:0/2705289325 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfb7fe640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc06d910 0x7f5dfc0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfbfff640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc162820 0x7f5dfc0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 -- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc162820 msgr2=0x7f5dfc0cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc162820 0x7f5dfc0cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 -- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc06d910 msgr2=0x7f5dfc0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc06d910 0x7f5dfc0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 -- 172.21.15.6:0/2705289325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc0cc3d0 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5dfaffd640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc0b3e80 0x7f5dfc0b6430 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5df000e8a0 tx=0x7f5df000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5de3fff640 1 -- 172.21.15.6:0/2705289325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0017070 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5de3fff640 1 -- 172.21.15.6:0/2705289325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df000c940 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.025+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc1f9d90 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.026+0000 7f5de3fff640 1 -- 172.21.15.6:0/2705289325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df000cd30 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.026+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc1fa350 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.027+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dfc075b00 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.027+0000 7f5de3fff640 1 -- 172.21.15.6:0/2705289325 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5df001a070 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.028+0000 7f5de3fff640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5de806be60 0x7f5de806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.028+0000 7f5de3fff640 1 -- 172.21.15.6:0/2705289325 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f5df008b330 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.028+0000 7f5dfb7fe640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5de806be60 0x7f5de806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.029+0000 7f5dfb7fe640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5de806be60 0x7f5de806e370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5dec034000 tx=0x7f5dec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.032+0000 7f5de3fff640 1 -- 172.21.15.6:0/2705289325 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5df0059320 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.219+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5dfc1f9b50 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.220+0000 7f5de3fff640 1 -- 172.21.15.6:0/2705289325 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16933 (secure 0 0 0) 0x7f5df005d620 con 0x7f5dfc0b3e80 2024-05-20T17:55:55.218 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:55.218 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:48.321415+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:55:37.996162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-20T17:55:38.615776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5de806be60 msgr2=0x7f5de806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5de806be60 0x7f5de806e370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5dec034000 tx=0x7f5dec02e000 comp rx=0 tx=0).stop 2024-05-20T17:55:55.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc0b3e80 msgr2=0x7f5dfc0b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc0b3e80 0x7f5dfc0b6430 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5df000e8a0 tx=0x7f5df000ed60 comp rx=0 tx=0).stop 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 shutdown_connections 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5de806be60 0x7f5de806e370 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dfc162820 0x7f5dfc0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dfc0b3e80 0x7f5dfc0b6430 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 --2- 172.21.15.6:0/2705289325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dfc06d910 0x7f5dfc0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 >> 172.21.15.6:0/2705289325 conn(0x7f5dfc0d4bd0 msgr2=0x7f5dfc15f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 shutdown_connections 2024-05-20T17:55:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.222+0000 7f5e01c3d640 1 -- 172.21.15.6:0/2705289325 wait complete. 2024-05-20T17:55:55.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:55:37.996162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:55:38.615776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:55:55.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:55:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.354+0000 7fea2a777640 1 Processor -- start 2024-05-20T17:55:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.354+0000 7fea2a777640 1 -- start start 2024-05-20T17:55:55.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.355+0000 7fea2a777640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea24163a10 0x7fea240d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.355+0000 7fea2a777640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea240cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.355+0000 7fea2a777640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fea240d14b0 0x7fea240d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.355+0000 7fea2a777640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fea240d3ca0 con 0x7fea24163a10 2024-05-20T17:55:55.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.355+0000 7fea2a777640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fea240d0370 con 0x7fea240d14b0 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.355+0000 7fea2a777640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fea240d0650 con 0x7fea240b4010 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea23fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea24163a10 0x7fea240d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea23fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea24163a10 0x7fea240d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35178/0 (socket says 172.21.15.6:35178) 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea23fff640 1 -- 172.21.15.6:0/2433337502 learned_addr learned my addr 172.21.15.6:0/2433337502 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea1bfff640 1 --2- 172.21.15.6:0/2433337502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea240cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea28d14640 1 --2- 172.21.15.6:0/2433337502 >> v2:172.21.15.171:3300/0 conn(0x7fea240d14b0 0x7fea240d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea23fff640 1 -- 172.21.15.6:0/2433337502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 msgr2=0x7fea240cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea23fff640 1 --2- 172.21.15.6:0/2433337502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea240cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea23fff640 1 -- 172.21.15.6:0/2433337502 >> v2:172.21.15.171:3300/0 conn(0x7fea240d14b0 msgr2=0x7fea240d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea23fff640 1 --2- 172.21.15.6:0/2433337502 >> v2:172.21.15.171:3300/0 conn(0x7fea240d14b0 0x7fea240d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea23fff640 1 -- 172.21.15.6:0/2433337502 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea240d3650 con 0x7fea24163a10 2024-05-20T17:55:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.356+0000 7fea1bfff640 1 --2- 172.21.15.6:0/2433337502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea240cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.357+0000 7fea23fff640 1 --2- 172.21.15.6:0/2433337502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea24163a10 0x7fea240d4130 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fea2408dea0 tx=0x7fea1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf9a492ff62210c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.357+0000 7fea237fe640 1 -- 172.21.15.6:0/2433337502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14037070 con 0x7fea24163a10 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.357+0000 7fea237fe640 1 -- 172.21.15.6:0/2433337502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea14032440 con 0x7fea24163a10 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.357+0000 7fea237fe640 1 -- 172.21.15.6:0/2433337502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14032810 con 0x7fea24163a10 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 -- 172.21.15.6:0/2433337502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea24163a10 msgr2=0x7fea240d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 --2- 172.21.15.6:0/2433337502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea24163a10 0x7fea240d4130 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fea2408dea0 tx=0x7fea1402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 -- 172.21.15.6:0/2433337502 shutdown_connections 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 --2- 172.21.15.6:0/2433337502 >> v2:172.21.15.171:3300/0 conn(0x7fea240d14b0 0x7fea240d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 --2- 172.21.15.6:0/2433337502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea240cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 --2- 172.21.15.6:0/2433337502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea24163a10 0x7fea240d4130 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 -- 172.21.15.6:0/2433337502 >> 172.21.15.6:0/2433337502 conn(0x7fea2406d240 msgr2=0x7fea2406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 -- 172.21.15.6:0/2433337502 shutdown_connections 2024-05-20T17:55:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.358+0000 7fea2a777640 1 -- 172.21.15.6:0/2433337502 wait complete. 2024-05-20T17:55:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.359+0000 7fea2a777640 1 Processor -- start 2024-05-20T17:55:55.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.359+0000 7fea2a777640 1 -- start start 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea2a777640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea241444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea2a777640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240d14b0 0x7fea241449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea2a777640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea24163a10 0x7fea240b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea2a777640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fea240d1e00 con 0x7fea240d14b0 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea2a777640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fea240d0040 con 0x7fea24163a10 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea2a777640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fea240b8210 con 0x7fea240b4010 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240d14b0 0x7fea241449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240d14b0 0x7fea241449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35186/0 (socket says 172.21.15.6:35186) 2024-05-20T17:55:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 -- 172.21.15.6:0/1448124200 learned_addr learned my addr 172.21.15.6:0/1448124200 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea23fff640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea241444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea28d14640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea24163a10 0x7fea240b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 -- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 msgr2=0x7fea241444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea241444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 -- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea24163a10 msgr2=0x7fea240b9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea24163a10 0x7fea240b9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 -- 172.21.15.6:0/1448124200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea241421f0 con 0x7fea240d14b0 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.361+0000 7fea1bfff640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240d14b0 0x7fea241449f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c820 tx=0x7fea0c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.362+0000 7fea217fa640 1 -- 172.21.15.6:0/1448124200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c015070 con 0x7fea240d14b0 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.362+0000 7fea217fa640 1 -- 172.21.15.6:0/1448124200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea0c007a30 con 0x7fea240d14b0 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.362+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea241424d0 con 0x7fea240d14b0 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.362+0000 7fea217fa640 1 -- 172.21.15.6:0/1448124200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c007e20 con 0x7fea240d14b0 2024-05-20T17:55:55.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.362+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea24142a90 con 0x7fea240d14b0 2024-05-20T17:55:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.363+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea24075b00 con 0x7fea240d14b0 2024-05-20T17:55:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.363+0000 7fea217fa640 1 -- 172.21.15.6:0/1448124200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea0c018070 con 0x7fea240d14b0 2024-05-20T17:55:55.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.364+0000 7fea217fa640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fea0406be60 0x7fea0406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.364+0000 7fea217fa640 1 -- 172.21.15.6:0/1448124200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fea0c08af00 con 0x7fea240d14b0 2024-05-20T17:55:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.364+0000 7fea23fff640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fea0406be60 0x7fea0406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.365+0000 7fea23fff640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fea0406be60 0x7fea0406e370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea14034000 tx=0x7fea1402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.368+0000 7fea217fa640 1 -- 172.21.15.6:0/1448124200 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fea0c058f90 con 0x7fea240d14b0 2024-05-20T17:55:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.550+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea24141f80 con 0x7fea240d14b0 2024-05-20T17:55:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.551+0000 7fea217fa640 1 -- 172.21.15.6:0/1448124200 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7fea0c05d290 con 0x7fea240d14b0 2024-05-20T17:55:55.549 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:55:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fea0406be60 msgr2=0x7fea0406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fea0406be60 0x7fea0406e370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fea14034000 tx=0x7fea1402e000 comp rx=0 tx=0).stop 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240d14b0 msgr2=0x7fea241449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240d14b0 0x7fea241449f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c820 tx=0x7fea0c00cce0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 shutdown_connections 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fea0406be60 0x7fea0406e370 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea24163a10 0x7fea240b9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea240d14b0 0x7fea241449f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 --2- 172.21.15.6:0/1448124200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea240b4010 0x7fea241444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 >> 172.21.15.6:0/1448124200 conn(0x7fea2406d240 msgr2=0x7fea241611f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 shutdown_connections 2024-05-20T17:55:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.553+0000 7fea2a777640 1 -- 172.21.15.6:0/1448124200 wait complete. 2024-05-20T17:55:55.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.688+0000 7ff1d0a37640 1 Processor -- start 2024-05-20T17:55:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.688+0000 7ff1d0a37640 1 -- start start 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1d0a37640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1cc162820 0x7ff1cc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1d0a37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1cc0d0630 con 0x7ff1cc06dae0 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1d0a37640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1cc0d39c0 con 0x7ff1cc0b3e80 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1d0a37640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff1cc0d3ca0 con 0x7ff1cc162820 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1cad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff1cc06dae0 0x7ff1cc0b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55552/0 (socket says 172.21.15.6:55552) 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1cad9d640 1 -- 172.21.15.6:0/2630728133 learned_addr learned my addr 172.21.15.6:0/2630728133 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2630728133 >> v2:172.21.15.171:3300/0 conn(0x7ff1cc162820 0x7ff1cc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559250724 0 0) 0x7ff1cc0d0630 con 0x7ff1cc06dae0 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1b4003520 con 0x7ff1cc06dae0 2024-05-20T17:55:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3713108442 0 0) 0x7ff1b4003520 con 0x7ff1cc06dae0 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 >> v2:172.21.15.171:3300/0 conn(0x7ff1cc162820 msgr2=0x7ff1cc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 --2- 172.21.15.6:0/2630728133 >> v2:172.21.15.171:3300/0 conn(0x7ff1cc162820 0x7ff1cc0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 >> v1:172.21.15.171:6789/0 conn(0x7ff1cc0b3e80 legacy=0x7ff1cc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc0d3f80 con 0x7ff1cc06dae0 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ff1c40019f0 con 0x7ff1cc06dae0 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2630728133 >> v2:172.21.15.171:3300/0 conn(0x7ff1cc162820 0x7ff1cc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 >> v1:172.21.15.6:6789/0 conn(0x7ff1cc06dae0 legacy=0x7ff1cc0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40039b0 0x7ff1b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.690+0000 7ff1c959a640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4004800 0x7ff1b4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1c959a640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40051c0 0x7ff1b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc0d3ca0 con 0x7ff1b40039b0 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b400c160 con 0x7ff1b4004800 2024-05-20T17:55:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b400c360 con 0x7ff1b40051c0 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40039b0 0x7ff1b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1c9d9b640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4004800 0x7ff1b4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1cad9d640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40051c0 0x7ff1b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1ca59c640 1 -- 172.21.15.6:0/2630728133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40051c0 msgr2=0x7ff1b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40051c0 0x7ff1b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1ca59c640 1 -- 172.21.15.6:0/2630728133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4004800 msgr2=0x7ff1b4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4004800 0x7ff1b4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1ca59c640 1 -- 172.21.15.6:0/2630728133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b4003520 con 0x7ff1b40039b0 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.691+0000 7ff1cad9d640 1 -- 172.21.15.6:0/2630728133 reap_dead start 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.692+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40039b0 0x7ff1b4003e20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009c90 tx=0x7ff1b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2f19f70be93faf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.692+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc036070 con 0x7ff1b40039b0 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.692+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc031400 con 0x7ff1b40039b0 2024-05-20T17:55:55.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.692+0000 7ff1c959a640 1 -- 172.21.15.6:0/2630728133 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc009860 con 0x7ff1b40039b0 2024-05-20T17:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.692+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2630728133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40039b0 msgr2=0x7ff1b4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.692+0000 7ff1d0a37640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40039b0 0x7ff1b4003e20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009c90 tx=0x7ff1b4005830 comp rx=0 tx=0).stop 2024-05-20T17:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.693+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2630728133 shutdown_connections 2024-05-20T17:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.693+0000 7ff1d0a37640 1 --2- 172.21.15.6:0/2630728133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40039b0 0x7ff1b4003e20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.693+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2630728133 >> 172.21.15.6:0/2630728133 conn(0x7ff1cc0d4bd0 msgr2=0x7ff1cc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.693+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2630728133 shutdown_connections 2024-05-20T17:55:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.693+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2630728133 wait complete. 2024-05-20T17:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.695+0000 7ff1d0a37640 1 Processor -- start 2024-05-20T17:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.695+0000 7ff1d0a37640 1 -- start start 2024-05-20T17:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1d0a37640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40039b0 0x7ff1cc160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1d0a37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1cc0ae7d0 0x7ff1cc0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1d0a37640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1cc0cde30 0x7ff1cc0ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1d0a37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc0d4780 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1d0a37640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc0d0300 con 0x7ff1cc0cde30 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1d0a37640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1cc0d4900 con 0x7ff1b40039b0 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1c9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1cc0ae7d0 0x7ff1cc0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1c9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1cc0ae7d0 0x7ff1cc0aebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35198/0 (socket says 172.21.15.6:35198) 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1c9d9b640 1 -- 172.21.15.6:0/2582525133 learned_addr learned my addr 172.21.15.6:0/2582525133 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40039b0 0x7ff1cc160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1cad9d640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1cc0cde30 0x7ff1cc0ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1c9d9b640 1 -- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40039b0 msgr2=0x7ff1cc160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1c9d9b640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40039b0 0x7ff1cc160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1c9d9b640 1 -- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1cc0cde30 msgr2=0x7ff1cc0ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1c9d9b640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1cc0cde30 0x7ff1cc0ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1c9d9b640 1 -- 172.21.15.6:0/2582525133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc0ce780 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.696+0000 7ff1cad9d640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1cc0cde30 0x7ff1cc0ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.697+0000 7ff1c9d9b640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1cc0ae7d0 0x7ff1cc0aebe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000f850 tx=0x7ff1c000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.697+0000 7ff1baffd640 1 -- 172.21.15.6:0/2582525133 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000fe40 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.697+0000 7ff1baffd640 1 -- 172.21.15.6:0/2582525133 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c0018070 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.697+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1cc0af450 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.697+0000 7ff1baffd640 1 -- 172.21.15.6:0/2582525133 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000d730 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.697+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1cc1f5de0 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.698+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1cc0af1c0 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.699+0000 7ff1baffd640 1 -- 172.21.15.6:0/2582525133 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1c000d8d0 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.699+0000 7ff1baffd640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1ac06be60 0x7ff1ac06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.699+0000 7ff1baffd640 1 -- 172.21.15.6:0/2582525133 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7ff1c008ada0 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.699+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1ac06be60 0x7ff1ac06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.700+0000 7ff1ca59c640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1ac06be60 0x7ff1ac06e370 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc033000 tx=0x7ff1bc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:55.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.704+0000 7ff1baffd640 1 -- 172.21.15.6:0/2582525133 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff1cc0ce780 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.891+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff1cc075b00 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.892+0000 7ff1baffd640 1 -- 172.21.15.6:0/2582525133 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) ==== 104+0+11 (secure 0 0 0) 0x7ff1c0059620 con 0x7ff1cc0ae7d0 2024-05-20T17:55:55.890 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:55:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1ac06be60 msgr2=0x7ff1ac06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1ac06be60 0x7ff1ac06e370 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc033000 tx=0x7ff1bc008030 comp rx=0 tx=0).stop 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1cc0ae7d0 msgr2=0x7ff1cc0aebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1cc0ae7d0 0x7ff1cc0aebe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff1c000f850 tx=0x7ff1c000fd10 comp rx=0 tx=0).stop 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 shutdown_connections 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1ac06be60 0x7ff1ac06e370 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1cc0cde30 0x7ff1cc0ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1cc0ae7d0 0x7ff1cc0aebe0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 --2- 172.21.15.6:0/2582525133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40039b0 0x7ff1cc160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 >> 172.21.15.6:0/2582525133 conn(0x7ff1cc0d4bd0 msgr2=0x7ff1cc0cb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 shutdown_connections 2024-05-20T17:55:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:55.894+0000 7ff1d0a37640 1 -- 172.21.15.6:0/2582525133 wait complete. 2024-05-20T17:55:55.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:55:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.024+0000 7ffba6e6c640 1 Processor -- start 2024-05-20T17:55:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.024+0000 7ffba6e6c640 1 -- start start 2024-05-20T17:55:56.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.025+0000 7ffba6e6c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba00cf3d0 0x7ffba00cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.025+0000 7ffba6e6c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffba00ce7e0 0x7ffba00cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.025+0000 7ffba6e6c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba00cfd20 con 0x7ffba015f220 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.025+0000 7ffba6e6c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ffba00cf130 con 0x7ffba00ce7e0 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.025+0000 7ffba6e6c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffba00cda20 con 0x7ffba00cf3d0 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffba4c08640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffba015f220 0x7ffba00d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55558/0 (socket says 172.21.15.6:55558) 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffba4c08640 1 -- 172.21.15.6:0/2034520580 learned_addr learned my addr 172.21.15.6:0/2034520580 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb97fff640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba00cf3d0 0x7ffba00cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517748512 0 0) 0x7ffb9c001110 con 0x7ffba015f220 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb88003520 con 0x7ffba015f220 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffba5409640 1 --2- 172.21.15.6:0/2034520580 >> v2:172.21.15.171:3300/0 conn(0x7ffba00ce7e0 0x7ffba00cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2740884556 0 0) 0x7ffb88003520 con 0x7ffba015f220 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba00cf3d0 msgr2=0x7ffba00cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba00cf3d0 0x7ffba00cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 >> v2:172.21.15.171:3300/0 conn(0x7ffba00ce7e0 msgr2=0x7ffba00cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 --2- 172.21.15.6:0/2034520580 >> v2:172.21.15.171:3300/0 conn(0x7ffba00ce7e0 0x7ffba00cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba00cdd00 con 0x7ffba015f220 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ffb9c001840 con 0x7ffba015f220 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 >> v1:172.21.15.6:6789/0 conn(0x7ffba015f220 legacy=0x7ffba00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba00cf3d0 0x7ffb880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb88003f30 0x7ffb88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb88004d40 0x7ffb88005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffba00cf130 con 0x7ffb88004d40 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffba00cda20 con 0x7ffb88003f30 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8800bac0 con 0x7ffba00cf3d0 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffba5409640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb88004d40 0x7ffb88005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffba4c08640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba00cf3d0 0x7ffb880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.026+0000 7ffb97fff640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb88003f30 0x7ffb88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.027+0000 7ffba5409640 1 -- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba00cf3d0 msgr2=0x7ffb880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.027+0000 7ffba5409640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba00cf3d0 0x7ffb880039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.027+0000 7ffba5409640 1 -- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb88003f30 msgr2=0x7ffb88004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.027+0000 7ffba5409640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb88003f30 0x7ffb88004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.027+0000 7ffba5409640 1 -- 172.21.15.6:0/2034520580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb88003520 con 0x7ffb88004d40 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.027+0000 7ffba5409640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb88004d40 0x7ffb88005150 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009f90 tx=0x7ffb88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fb8f70491f7947 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98009c10 con 0x7ffb88004d40 2024-05-20T17:55:56.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb98036070 con 0x7ffb88004d40 2024-05-20T17:55:56.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffb977fe640 1 -- 172.21.15.6:0/2034520580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98031880 con 0x7ffb88004d40 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2034520580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb88004d40 msgr2=0x7ffb88005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffba6e6c640 1 --2- 172.21.15.6:0/2034520580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb88004d40 0x7ffb88005150 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009f90 tx=0x7ffb88005830 comp rx=0 tx=0).stop 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffba5409640 1 -- 172.21.15.6:0/2034520580 reap_dead start 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2034520580 shutdown_connections 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2034520580 >> 172.21.15.6:0/2034520580 conn(0x7ffba00b44d0 msgr2=0x7ffba00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2034520580 shutdown_connections 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.028+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2034520580 wait complete. 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.030+0000 7ffba6e6c640 1 Processor -- start 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.030+0000 7ffba6e6c640 1 -- start start 2024-05-20T17:55:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba6e6c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba0161bb0 0x7ffba01497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba6e6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffba00b57a0 0x7ffba0145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba6e6c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffba00b5bb0 0x7ffba0145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba6e6c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffba00d0fd0 con 0x7ffba00b57a0 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba6e6c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffba00ce2c0 con 0x7ffba00b5bb0 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba6e6c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffba00cd680 con 0x7ffba0161bb0 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffba00b57a0 0x7ffba0145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffba00b57a0 0x7ffba0145870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35218/0 (socket says 172.21.15.6:35218) 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 -- 172.21.15.6:0/2210289045 learned_addr learned my addr 172.21.15.6:0/2210289045 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba4c08640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba0161bb0 0x7ffba01497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba5409640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffba00b5bb0 0x7ffba0145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 -- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba0161bb0 msgr2=0x7ffba01497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba0161bb0 0x7ffba01497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 -- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffba00b5bb0 msgr2=0x7ffba0145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffba00b5bb0 0x7ffba0145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 -- 172.21.15.6:0/2210289045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba0160b10 con 0x7ffba00b57a0 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba5409640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffba00b5bb0 0x7ffba0145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba4c08640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba0161bb0 0x7ffba01497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb97fff640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffba00b57a0 0x7ffba0145870 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffb90011960 tx=0x7ffb90011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb957fa640 1 -- 172.21.15.6:0/2210289045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90019070 con 0x7ffba00b57a0 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb957fa640 1 -- 172.21.15.6:0/2210289045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb90004240 con 0x7ffba00b57a0 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba0160df0 con 0x7ffba00b57a0 2024-05-20T17:55:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.032+0000 7ffb957fa640 1 -- 172.21.15.6:0/2210289045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9000f820 con 0x7ffba00b57a0 2024-05-20T17:55:56.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.033+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba01613b0 con 0x7ffba00b57a0 2024-05-20T17:55:56.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.033+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba0075b00 con 0x7ffba00b57a0 2024-05-20T17:55:56.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.034+0000 7ffb957fa640 1 -- 172.21.15.6:0/2210289045 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb9001c070 con 0x7ffba00b57a0 2024-05-20T17:55:56.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.034+0000 7ffb957fa640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffb8c06be30 0x7ffb8c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.035+0000 7ffb957fa640 1 -- 172.21.15.6:0/2210289045 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7ffb9008b560 con 0x7ffba00b57a0 2024-05-20T17:55:56.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.035+0000 7ffba4c08640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffb8c06be30 0x7ffb8c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.035+0000 7ffba4c08640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffb8c06be30 0x7ffb8c06e340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0012b0 tx=0x7ffb9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.039+0000 7ffb957fa640 1 -- 172.21.15.6:0/2210289045 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffb90059cc0 con 0x7ffba00b57a0 2024-05-20T17:55:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.222+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffba0162c60 con 0x7ffba00b57a0 2024-05-20T17:55:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.222+0000 7ffb957fa640 1 -- 172.21.15.6:0/2210289045 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) ==== 100+0+11 (secure 0 0 0) 0x7ffb900595c0 con 0x7ffba00b57a0 2024-05-20T17:55:56.220 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:55:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffb8c06be30 msgr2=0x7ffb8c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffb8c06be30 0x7ffb8c06e340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0012b0 tx=0x7ffb9c009040 comp rx=0 tx=0).stop 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffba00b57a0 msgr2=0x7ffba0145870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffba00b57a0 0x7ffba0145870 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffb90011960 tx=0x7ffb90011e20 comp rx=0 tx=0).stop 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 shutdown_connections 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffb8c06be30 0x7ffb8c06e340 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffba00b5bb0 0x7ffba0145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffba00b57a0 0x7ffba0145870 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 --2- 172.21.15.6:0/2210289045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffba0161bb0 0x7ffba01497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 >> 172.21.15.6:0/2210289045 conn(0x7ffba00b44d0 msgr2=0x7ffba015aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 shutdown_connections 2024-05-20T17:55:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.224+0000 7ffba6e6c640 1 -- 172.21.15.6:0/2210289045 wait complete. 2024-05-20T17:55:56.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:55:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.354+0000 7fa972461640 1 Processor -- start 2024-05-20T17:55:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.354+0000 7fa972461640 1 -- start start 2024-05-20T17:55:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa972461640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa96c15f220 0x7fa96c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa972461640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa96c0d0e00 0x7fa96c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa972461640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0cf910 0x7fa96c0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa972461640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa96c0cfd20 con 0x7fa96c15f220 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa972461640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa96c0cda20 con 0x7fa96c0d0e00 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa972461640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa96c0cdd00 con 0x7fa96c0cf910 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa96c15f220 0x7fa96c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa96c15f220 0x7fa96c0d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35224/0 (socket says 172.21.15.6:35224) 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96bfff640 1 -- 172.21.15.6:0/2793998127 learned_addr learned my addr 172.21.15.6:0/2793998127 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa9709fe640 1 --2- 172.21.15.6:0/2793998127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0cf910 0x7fa96c0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96bfff640 1 -- 172.21.15.6:0/2793998127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0cf910 msgr2=0x7fa96c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96bfff640 1 --2- 172.21.15.6:0/2793998127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0cf910 0x7fa96c0ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96b7fe640 1 --2- 172.21.15.6:0/2793998127 >> v2:172.21.15.171:3300/0 conn(0x7fa96c0d0e00 0x7fa96c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96bfff640 1 -- 172.21.15.6:0/2793998127 >> v2:172.21.15.171:3300/0 conn(0x7fa96c0d0e00 msgr2=0x7fa96c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:56.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96bfff640 1 --2- 172.21.15.6:0/2793998127 >> v2:172.21.15.171:3300/0 conn(0x7fa96c0d0e00 0x7fa96c0cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96bfff640 1 -- 172.21.15.6:0/2793998127 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c0cdfe0 con 0x7fa96c15f220 2024-05-20T17:55:56.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.356+0000 7fa96b7fe640 1 --2- 172.21.15.6:0/2793998127 >> v2:172.21.15.171:3300/0 conn(0x7fa96c0d0e00 0x7fa96c0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:55:56.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.357+0000 7fa96bfff640 1 --2- 172.21.15.6:0/2793998127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c0d08c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa96c068350 tx=0x7fa95c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be9af34e6368bab server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.357+0000 7fa96affd640 1 -- 172.21.15.6:0/2793998127 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c037070 con 0x7fa96c15f220 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.357+0000 7fa96affd640 1 -- 172.21.15.6:0/2793998127 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c032440 con 0x7fa96c15f220 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.357+0000 7fa96affd640 1 -- 172.21.15.6:0/2793998127 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c032810 con 0x7fa96c15f220 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 -- 172.21.15.6:0/2793998127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 msgr2=0x7fa96c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 --2- 172.21.15.6:0/2793998127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c0d08c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa96c068350 tx=0x7fa95c02a140 comp rx=0 tx=0).stop 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 -- 172.21.15.6:0/2793998127 shutdown_connections 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 --2- 172.21.15.6:0/2793998127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0cf910 0x7fa96c0ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 --2- 172.21.15.6:0/2793998127 >> v2:172.21.15.171:3300/0 conn(0x7fa96c0d0e00 0x7fa96c0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 --2- 172.21.15.6:0/2793998127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c0d08c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 -- 172.21.15.6:0/2793998127 >> 172.21.15.6:0/2793998127 conn(0x7fa96c0b44d0 msgr2=0x7fa96c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:56.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 -- 172.21.15.6:0/2793998127 shutdown_connections 2024-05-20T17:55:56.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.358+0000 7fa972461640 1 -- 172.21.15.6:0/2793998127 wait complete. 2024-05-20T17:55:56.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.360+0000 7fa972461640 1 Processor -- start 2024-05-20T17:55:56.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.360+0000 7fa972461640 1 -- start start 2024-05-20T17:55:56.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa972461640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c0cf910 0x7fa96c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa972461640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0d0e00 0x7fa96c1f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa972461640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa972461640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c0cd800 con 0x7fa96c15f220 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa972461640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c0cd680 con 0x7fa96c0cf910 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa972461640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa96c15f630 con 0x7fa96c0d0e00 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa9709fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa96b7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0d0e00 0x7fa96c1f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa9709fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c15d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35234/0 (socket says 172.21.15.6:35234) 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa9709fe640 1 -- 172.21.15.6:0/1401224121 learned_addr learned my addr 172.21.15.6:0/1401224121 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.361+0000 7fa96bfff640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c0cf910 0x7fa96c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa9709fe640 1 -- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0d0e00 msgr2=0x7fa96c1f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa9709fe640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0d0e00 0x7fa96c1f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa9709fe640 1 -- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c0cf910 msgr2=0x7fa96c158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa9709fe640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c0cf910 0x7fa96c158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa9709fe640 1 -- 172.21.15.6:0/1401224121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c15a760 con 0x7fa96c15f220 2024-05-20T17:55:56.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa9709fe640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c15d8e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa964007d50 tx=0x7fa96400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa968ff9640 1 -- 172.21.15.6:0/1401224121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964014420 con 0x7fa96c15f220 2024-05-20T17:55:56.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa968ff9640 1 -- 172.21.15.6:0/1401224121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa964019070 con 0x7fa96c15f220 2024-05-20T17:55:56.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c15aa40 con 0x7fa96c15f220 2024-05-20T17:55:56.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa968ff9640 1 -- 172.21.15.6:0/1401224121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964014820 con 0x7fa96c15f220 2024-05-20T17:55:56.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.362+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c15b000 con 0x7fa96c15f220 2024-05-20T17:55:56.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.363+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96c075b00 con 0x7fa96c15f220 2024-05-20T17:55:56.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.364+0000 7fa968ff9640 1 -- 172.21.15.6:0/1401224121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9640149c0 con 0x7fa96c15f220 2024-05-20T17:55:56.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.364+0000 7fa968ff9640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa95806be30 0x7fa95806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.364+0000 7fa968ff9640 1 -- 172.21.15.6:0/1401224121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fa96408b820 con 0x7fa96c15f220 2024-05-20T17:55:56.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.365+0000 7fa96bfff640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa95806be30 0x7fa95806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.365+0000 7fa96bfff640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa95806be30 0x7fa95806e340 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa95c034000 tx=0x7fa95c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.369+0000 7fa968ff9640 1 -- 172.21.15.6:0/1401224121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa9640598a0 con 0x7fa96c15f220 2024-05-20T17:55:56.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.565+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa96c15a4f0 con 0x7fa96c15f220 2024-05-20T17:55:56.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.565+0000 7fa968ff9640 1 -- 172.21.15.6:0/1401224121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) ==== 80+0+0 (secure 0 0 0) 0x7fa96405dba0 con 0x7fa96c15f220 2024-05-20T17:55:56.563 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:55:56.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa95806be30 msgr2=0x7fa95806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa95806be30 0x7fa95806e340 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa95c034000 tx=0x7fa95c02e000 comp rx=0 tx=0).stop 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 msgr2=0x7fa96c15d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c15d8e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa964007d50 tx=0x7fa96400e4b0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 shutdown_connections 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa95806be30 0x7fa95806e340 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa96c15f220 0x7fa96c15d8e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa96c0d0e00 0x7fa96c1f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 --2- 172.21.15.6:0/1401224121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa96c0cf910 0x7fa96c158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 >> 172.21.15.6:0/1401224121 conn(0x7fa96c0b44d0 msgr2=0x7fa96c162e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 shutdown_connections 2024-05-20T17:55:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.567+0000 7fa972461640 1 -- 172.21.15.6:0/1401224121 wait complete. 2024-05-20T17:55:56.577 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T17:55:56.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:56.577 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T17:55:56.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:55:56.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:55:56.611 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T17:55:56.671 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:55:56.671 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:55:56.671 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:56.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:55:56.688 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:55:56.688 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:55:56.688 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:55:56.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:55:56.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.845+0000 7f507302b640 1 Processor -- start 2024-05-20T17:55:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.845+0000 7f507302b640 1 -- start start 2024-05-20T17:55:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f507302b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f506c06cf00 0x7f506c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f507302b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506c08d2a0 con 0x7f506c0d4400 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f507302b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506c06d850 con 0x7f506c0d2780 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f507302b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f506c0d3f70 con 0x7f506c06cf00 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f506bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f506c06cf00 0x7f506c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f5070dc7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f506c0d4400 0x7f506c15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55574/0 (socket says 172.21.15.6:55574) 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f5070dc7640 1 -- 172.21.15.6:0/3012234463 learned_addr learned my addr 172.21.15.6:0/3012234463 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f506bfff640 1 -- 172.21.15.6:0/3012234463 >> v1:172.21.15.171:6789/0 conn(0x7f506c0d2780 legacy=0x7f506c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f506bfff640 1 -- 172.21.15.6:0/3012234463 >> v1:172.21.15.6:6789/0 conn(0x7f506c0d4400 legacy=0x7f506c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f506bfff640 1 -- 172.21.15.6:0/3012234463 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c0d4810 con 0x7f506c06cf00 2024-05-20T17:55:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.847+0000 7f506b7fe640 1 -- 172.21.15.6:0/3012234463 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720655196 0 0) 0x7f505c001110 con 0x7f506c0d4400 2024-05-20T17:55:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.848+0000 7f506bfff640 1 --2- 172.21.15.6:0/3012234463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c06cf00 0x7f506c06d310 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f506c0d40f0 tx=0x7f506002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94493c3a572cdf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.848+0000 7f506b7fe640 1 -- 172.21.15.6:0/3012234463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060037070 con 0x7f506c06cf00 2024-05-20T17:55:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.848+0000 7f506b7fe640 1 -- 172.21.15.6:0/3012234463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5060032640 con 0x7f506c06cf00 2024-05-20T17:55:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.848+0000 7f506b7fe640 1 -- 172.21.15.6:0/3012234463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060032a10 con 0x7f506c06cf00 2024-05-20T17:55:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.849+0000 7f507302b640 1 -- 172.21.15.6:0/3012234463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c06cf00 msgr2=0x7f506c06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.849+0000 7f507302b640 1 --2- 172.21.15.6:0/3012234463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c06cf00 0x7f506c06d310 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f506c0d40f0 tx=0x7f506002a2c0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.849+0000 7f507302b640 1 -- 172.21.15.6:0/3012234463 shutdown_connections 2024-05-20T17:55:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.849+0000 7f507302b640 1 --2- 172.21.15.6:0/3012234463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c06cf00 0x7f506c06d310 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.849+0000 7f507302b640 1 -- 172.21.15.6:0/3012234463 >> 172.21.15.6:0/3012234463 conn(0x7f506c0d4bb0 msgr2=0x7f506c0d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.849+0000 7f507302b640 1 -- 172.21.15.6:0/3012234463 shutdown_connections 2024-05-20T17:55:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.849+0000 7f507302b640 1 -- 172.21.15.6:0/3012234463 wait complete. 2024-05-20T17:55:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.851+0000 7f507302b640 1 Processor -- start 2024-05-20T17:55:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.851+0000 7f507302b640 1 -- start start 2024-05-20T17:55:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.852+0000 7f507302b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506c06cf00 0x7f506c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.852+0000 7f507302b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c0d2780 0x7f506c160d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f507302b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506c0d4400 0x7f506c1612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f507302b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f506c0d3920 con 0x7f506c0d2780 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f507302b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f506c0d3680 con 0x7f506c0d4400 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f507302b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f506c0d3c00 con 0x7f506c06cf00 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c0d2780 0x7f506c160d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c0d2780 0x7f506c160d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35256/0 (socket says 172.21.15.6:35256) 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 -- 172.21.15.6:0/3351939371 learned_addr learned my addr 172.21.15.6:0/3351939371 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f5070dc7640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506c06cf00 0x7f506c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f50715c8640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506c0d4400 0x7f506c1612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 -- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506c06cf00 msgr2=0x7f506c1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506c06cf00 0x7f506c1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 -- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506c0d4400 msgr2=0x7f506c1612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506c0d4400 0x7f506c1612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 -- 172.21.15.6:0/3351939371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c0b4e30 con 0x7f506c0d2780 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f506bfff640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c0d2780 0x7f506c160d60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5060009890 tx=0x7f50600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f50697fa640 1 -- 172.21.15.6:0/3351939371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060041020 con 0x7f506c0d2780 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f50697fa640 1 -- 172.21.15.6:0/3351939371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5060030990 con 0x7f506c0d2780 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506c0b5110 con 0x7f506c0d2780 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f50697fa640 1 -- 172.21.15.6:0/3351939371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060037040 con 0x7f506c0d2780 2024-05-20T17:55:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.853+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506c0b56d0 con 0x7f506c0d2780 2024-05-20T17:55:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.854+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506c0b4ba0 con 0x7f506c0d2780 2024-05-20T17:55:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.855+0000 7f50697fa640 1 -- 172.21.15.6:0/3351939371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5060044020 con 0x7f506c0d2780 2024-05-20T17:55:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.856+0000 7f50697fa640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505806be30 0x7f505806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.856+0000 7f50697fa640 1 -- 172.21.15.6:0/3351939371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f50600aba90 con 0x7f506c0d2780 2024-05-20T17:55:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.856+0000 7f5070dc7640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505806be30 0x7f505806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:56.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.857+0000 7f5070dc7640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505806be30 0x7f505806e340 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f505c000f60 tx=0x7f505c007d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:56.861+0000 7f50697fa640 1 -- 172.21.15.6:0/3351939371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f506004b030 con 0x7f506c0d2780 2024-05-20T17:55:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.081+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f506c0cca40 con 0x7f506c0d2780 2024-05-20T17:55:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.082+0000 7f50697fa640 1 -- 172.21.15.6:0/3351939371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5178 (secure 0 0 0) 0x7f506c0cca40 con 0x7f506c0d2780 2024-05-20T17:55:57.080 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:57.080 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/855682127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":855682127},{"type":"v1","addr":"172.21.15.171:6837","nonce":855682127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2086456440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2086456440},{"type":"v1","addr":"172.21.15.171:6836","nonce":2086456440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3128490033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3128490033},{"type":"v1","addr":"172.21.15.6:6834","nonce":3128490033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:55:39.645375+0000","modified":"2024-05-20T17:55:42.672561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5880},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5880":{"gid":5880,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1365830773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1365830773},{"type":"v1","addr":"172.21.15.6:6835","nonce":1365830773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5880,"qdb_cluster":[5880]},"id":3}]} 2024-05-20T17:55:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-05-20T17:55:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505806be30 msgr2=0x7f505806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505806be30 0x7f505806e340 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f505c000f60 tx=0x7f505c007d00 comp rx=0 tx=0).stop 2024-05-20T17:55:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c0d2780 msgr2=0x7f506c160d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c0d2780 0x7f506c160d60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5060009890 tx=0x7f50600046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 shutdown_connections 2024-05-20T17:55:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f505806be30 0x7f505806e340 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f506c0d4400 0x7f506c1612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f506c0d2780 0x7f506c160d60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 --2- 172.21.15.6:0/3351939371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f506c06cf00 0x7f506c1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 >> 172.21.15.6:0/3351939371 conn(0x7f506c0d4bb0 msgr2=0x7f506c0b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 shutdown_connections 2024-05-20T17:55:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.084+0000 7f507302b640 1 -- 172.21.15.6:0/3351939371 wait complete. 2024-05-20T17:55:57.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:57.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.210+0000 7f6f71451640 1 Processor -- start 2024-05-20T17:55:57.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.210+0000 7f6f71451640 1 -- start start 2024-05-20T17:55:57.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.211+0000 7f6f71451640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f6c0b4010 0x7f6f6c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.211+0000 7f6f71451640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.211+0000 7f6f71451640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c0d0370 con 0x7f6f6c163a10 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.211+0000 7f6f71451640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6f6c0d3ca0 con 0x7f6f6c0b4010 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.211+0000 7f6f71451640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c0d0650 con 0x7f6f6c0d14b0 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.212+0000 7f6f6a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f6c0b4010 0x7f6f6c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.212+0000 7f6f6a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f6c0b4010 0x7f6f6c0d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35262/0 (socket says 172.21.15.6:35262) 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.212+0000 7f6f6a7fc640 1 -- 172.21.15.6:0/2748248669 learned_addr learned my addr 172.21.15.6:0/2748248669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.212+0000 7f6f6b7fe640 1 --2- 172.21.15.6:0/2748248669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.212+0000 7f6f6a7fc640 1 -- 172.21.15.6:0/2748248669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 msgr2=0x7f6f6c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.212+0000 7f6f6a7fc640 1 --2- 172.21.15.6:0/2748248669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c0d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.212+0000 7f6f6a7fc640 1 -- 172.21.15.6:0/2748248669 >> v1:172.21.15.171:6789/0 conn(0x7f6f6c163a10 legacy=0x7f6f6c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.212+0000 7f6f6a7fc640 1 -- 172.21.15.6:0/2748248669 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c0d3650 con 0x7f6f6c0b4010 2024-05-20T17:55:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.213+0000 7f6f6a7fc640 1 --2- 172.21.15.6:0/2748248669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c0b4010 0x7f6f6c0d4130 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009870 tx=0x7f6f5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fe72adfc41e92 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.213+0000 7f6f69ffb640 1 -- 172.21.15.6:0/2748248669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54037070 con 0x7f6f6c0b4010 2024-05-20T17:55:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.213+0000 7f6f69ffb640 1 -- 172.21.15.6:0/2748248669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f54032440 con 0x7f6f6c0b4010 2024-05-20T17:55:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.213+0000 7f6f69ffb640 1 -- 172.21.15.6:0/2748248669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54032810 con 0x7f6f6c0b4010 2024-05-20T17:55:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.214+0000 7f6f71451640 1 -- 172.21.15.6:0/2748248669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c0b4010 msgr2=0x7f6f6c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.214+0000 7f6f71451640 1 --2- 172.21.15.6:0/2748248669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c0b4010 0x7f6f6c0d4130 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009870 tx=0x7f6f5402a270 comp rx=0 tx=0).stop 2024-05-20T17:55:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.214+0000 7f6f71451640 1 -- 172.21.15.6:0/2748248669 shutdown_connections 2024-05-20T17:55:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.214+0000 7f6f71451640 1 --2- 172.21.15.6:0/2748248669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.214+0000 7f6f71451640 1 --2- 172.21.15.6:0/2748248669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c0b4010 0x7f6f6c0d4130 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.214+0000 7f6f71451640 1 -- 172.21.15.6:0/2748248669 >> 172.21.15.6:0/2748248669 conn(0x7f6f6c06d240 msgr2=0x7f6f6c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.214+0000 7f6f71451640 1 -- 172.21.15.6:0/2748248669 shutdown_connections 2024-05-20T17:55:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.214+0000 7f6f71451640 1 -- 172.21.15.6:0/2748248669 wait complete. 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.216+0000 7f6f71451640 1 Processor -- start 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.216+0000 7f6f71451640 1 -- start start 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f71451640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f6c0b4010 0x7f6f6c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f71451640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f71451640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c163a10 0x7f6f6c1606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f71451640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c0b8210 con 0x7f6f6c163a10 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f71451640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c0d1e00 con 0x7f6f6c0b4010 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f71451640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c0b8390 con 0x7f6f6c0d14b0 2024-05-20T17:55:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f6b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c163a10 0x7f6f6c1606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f6b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c163a10 0x7f6f6c1606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35266/0 (socket says 172.21.15.6:35266) 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f6b7fe640 1 -- 172.21.15.6:0/3235182731 learned_addr learned my addr 172.21.15.6:0/3235182731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f6a7fc640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f6affd640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f6c0b4010 0x7f6f6c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.217+0000 7f6f6b7fe640 1 -- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 msgr2=0x7f6f6c160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f6b7fe640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f6b7fe640 1 -- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f6c0b4010 msgr2=0x7f6f6c0ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f6b7fe640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f6c0b4010 0x7f6f6c0ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f6b7fe640 1 -- 172.21.15.6:0/3235182731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c158720 con 0x7f6f6c163a10 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f6a7fc640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f6affd640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f6c0b4010 0x7f6f6c0ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f6b7fe640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c163a10 0x7f6f6c1606b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00e820 tx=0x7f6f5c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f637fe640 1 -- 172.21.15.6:0/3235182731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c017070 con 0x7f6f6c163a10 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f637fe640 1 -- 172.21.15.6:0/3235182731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5c00c730 con 0x7f6f6c163a10 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c15b690 con 0x7f6f6c163a10 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f637fe640 1 -- 172.21.15.6:0/3235182731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00cb00 con 0x7f6f6c163a10 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.218+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6c155980 con 0x7f6f6c163a10 2024-05-20T17:55:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.219+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6c075b00 con 0x7f6f6c163a10 2024-05-20T17:55:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.220+0000 7f6f637fe640 1 -- 172.21.15.6:0/3235182731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f5c01a070 con 0x7f6f6c163a10 2024-05-20T17:55:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.220+0000 7f6f637fe640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f4c06be60 0x7f6f4c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.221+0000 7f6f637fe640 1 -- 172.21.15.6:0/3235182731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f6f5c08ae50 con 0x7f6f6c163a10 2024-05-20T17:55:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.221+0000 7f6f6affd640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f4c06be60 0x7f6f4c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.221+0000 7f6f6affd640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f4c06be60 0x7f6f4c06e370 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0d3020 tx=0x7f6f64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.225+0000 7f6f637fe640 1 -- 172.21.15.6:0/3235182731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6f6c158720 con 0x7f6f6c163a10 2024-05-20T17:55:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.408+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f6c0b39c0 con 0x7f6f6c163a10 2024-05-20T17:55:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.409+0000 7f6f637fe640 1 -- 172.21.15.6:0/3235182731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16933 (secure 0 0 0) 0x7f6f5c059640 con 0x7f6f6c163a10 2024-05-20T17:55:57.408 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:57.408 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:48.321415+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:55:37.996162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-20T17:55:38.615776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.411+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f4c06be60 msgr2=0x7f6f4c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.411+0000 7f6f71451640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f4c06be60 0x7f6f4c06e370 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0d3020 tx=0x7f6f64009040 comp rx=0 tx=0).stop 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.411+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c163a10 msgr2=0x7f6f6c1606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.411+0000 7f6f71451640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c163a10 0x7f6f6c1606b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00e820 tx=0x7f6f5c00ece0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.412+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 shutdown_connections 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.412+0000 7f6f71451640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f4c06be60 0x7f6f4c06e370 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.412+0000 7f6f71451640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f6c163a10 0x7f6f6c1606b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.412+0000 7f6f71451640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f6c0d14b0 0x7f6f6c160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.412+0000 7f6f71451640 1 --2- 172.21.15.6:0/3235182731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f6c0b4010 0x7f6f6c0ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.412+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 >> 172.21.15.6:0/3235182731 conn(0x7f6f6c06d240 msgr2=0x7f6f6c0b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.412+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 shutdown_connections 2024-05-20T17:55:57.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.412+0000 7f6f71451640 1 -- 172.21.15.6:0/3235182731 wait complete. 2024-05-20T17:55:57.421 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:55:37.996162+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:55:38.615776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:55:57.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:55:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.541+0000 7fa236979640 1 Processor -- start 2024-05-20T17:55:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.541+0000 7fa236979640 1 -- start start 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.542+0000 7fa236979640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa23006d3d0 0x7fa23006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.542+0000 7fa236979640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa2300b8190 0x7fa2300b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.542+0000 7fa236979640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23006dd20 con 0x7fa230162820 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.542+0000 7fa236979640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa2300d0630 con 0x7fa23006d3d0 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.542+0000 7fa236979640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa2300d39c0 con 0x7fa2300b8190 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa22f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa23006d3d0 0x7fa23006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa22ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa230162820 0x7fa2300b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55578/0 (socket says 172.21.15.6:55578) 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa22ffff640 1 -- 172.21.15.6:0/2223329398 learned_addr learned my addr 172.21.15.6:0/2223329398 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa234f16640 1 --2- 172.21.15.6:0/2223329398 >> v2:172.21.15.171:3300/0 conn(0x7fa2300b8190 0x7fa2300b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa22f7fe640 1 -- 172.21.15.6:0/2223329398 >> v2:172.21.15.171:3300/0 conn(0x7fa2300b8190 msgr2=0x7fa2300b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa22f7fe640 1 --2- 172.21.15.6:0/2223329398 >> v2:172.21.15.171:3300/0 conn(0x7fa2300b8190 0x7fa2300b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa22f7fe640 1 -- 172.21.15.6:0/2223329398 >> v1:172.21.15.6:6789/0 conn(0x7fa230162820 legacy=0x7fa2300b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa22effd640 1 -- 172.21.15.6:0/2223329398 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730469087 0 0) 0x7fa220001110 con 0x7fa230162820 2024-05-20T17:55:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.543+0000 7fa22f7fe640 1 -- 172.21.15.6:0/2223329398 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2300d3ca0 con 0x7fa23006d3d0 2024-05-20T17:55:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.544+0000 7fa22f7fe640 1 --2- 172.21.15.6:0/2223329398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa23006d3d0 0x7fa23006d7e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa23008e070 tx=0x7fa22402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fbd83db275657 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.544+0000 7fa22effd640 1 -- 172.21.15.6:0/2223329398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224037070 con 0x7fa23006d3d0 2024-05-20T17:55:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.544+0000 7fa22effd640 1 -- 172.21.15.6:0/2223329398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa224032440 con 0x7fa23006d3d0 2024-05-20T17:55:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.544+0000 7fa22effd640 1 -- 172.21.15.6:0/2223329398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224032810 con 0x7fa23006d3d0 2024-05-20T17:55:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.545+0000 7fa236979640 1 -- 172.21.15.6:0/2223329398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa23006d3d0 msgr2=0x7fa23006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.545+0000 7fa236979640 1 --2- 172.21.15.6:0/2223329398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa23006d3d0 0x7fa23006d7e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa23008e070 tx=0x7fa22402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.545+0000 7fa236979640 1 -- 172.21.15.6:0/2223329398 shutdown_connections 2024-05-20T17:55:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.545+0000 7fa236979640 1 --2- 172.21.15.6:0/2223329398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa23006d3d0 0x7fa23006d7e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.545+0000 7fa236979640 1 --2- 172.21.15.6:0/2223329398 >> v2:172.21.15.171:3300/0 conn(0x7fa2300b8190 0x7fa2300b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.545+0000 7fa236979640 1 -- 172.21.15.6:0/2223329398 >> 172.21.15.6:0/2223329398 conn(0x7fa2300d4bd0 msgr2=0x7fa2300d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.545+0000 7fa236979640 1 -- 172.21.15.6:0/2223329398 shutdown_connections 2024-05-20T17:55:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.545+0000 7fa236979640 1 -- 172.21.15.6:0/2223329398 wait complete. 2024-05-20T17:55:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.546+0000 7fa236979640 1 Processor -- start 2024-05-20T17:55:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.547+0000 7fa236979640 1 -- start start 2024-05-20T17:55:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa236979640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa23006d3d0 0x7fa2300cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa236979640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2300b8190 0x7fa2301f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa236979640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230162820 0x7fa2300b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa236979640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300d0300 con 0x7fa230162820 2024-05-20T17:55:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa236979640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2300d4260 con 0x7fa2300b8190 2024-05-20T17:55:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa236979640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2300b4050 con 0x7fa23006d3d0 2024-05-20T17:55:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa234f16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230162820 0x7fa2300b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa234f16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230162820 0x7fa2300b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35278/0 (socket says 172.21.15.6:35278) 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa234f16640 1 -- 172.21.15.6:0/1214243184 learned_addr learned my addr 172.21.15.6:0/1214243184 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa22ffff640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa23006d3d0 0x7fa2300cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.548+0000 7fa22f7fe640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2300b8190 0x7fa2301f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa234f16640 1 -- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa23006d3d0 msgr2=0x7fa2300cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa234f16640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa23006d3d0 0x7fa2300cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa234f16640 1 -- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2300b8190 msgr2=0x7fa2301f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa234f16640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2300b8190 0x7fa2301f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa234f16640 1 -- 172.21.15.6:0/1214243184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2300c96a0 con 0x7fa230162820 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa234f16640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230162820 0x7fa2300b6520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa228007e90 tx=0x7fa22800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa22cff9640 1 -- 172.21.15.6:0/1214243184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228014420 con 0x7fa230162820 2024-05-20T17:55:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa22cff9640 1 -- 172.21.15.6:0/1214243184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa228019070 con 0x7fa230162820 2024-05-20T17:55:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2301f5620 con 0x7fa230162820 2024-05-20T17:55:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa22cff9640 1 -- 172.21.15.6:0/1214243184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228014800 con 0x7fa230162820 2024-05-20T17:55:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.549+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2300c90e0 con 0x7fa230162820 2024-05-20T17:55:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.550+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa230075b00 con 0x7fa230162820 2024-05-20T17:55:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.551+0000 7fa22cff9640 1 -- 172.21.15.6:0/1214243184 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2280149a0 con 0x7fa230162820 2024-05-20T17:55:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.551+0000 7fa22cff9640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa21c06be60 0x7fa21c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.551+0000 7fa22cff9640 1 -- 172.21.15.6:0/1214243184 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fa22808b720 con 0x7fa230162820 2024-05-20T17:55:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.551+0000 7fa22ffff640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa21c06be60 0x7fa21c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.552+0000 7fa22ffff640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa21c06be60 0x7fa21c06e370 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa220007fd0 tx=0x7fa220007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.556+0000 7fa22cff9640 1 -- 172.21.15.6:0/1214243184 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa2300c96a0 con 0x7fa230162820 2024-05-20T17:55:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.743+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2300c8b90 con 0x7fa230162820 2024-05-20T17:55:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.743+0000 7fa22cff9640 1 -- 172.21.15.6:0/1214243184 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7fa228059840 con 0x7fa230162820 2024-05-20T17:55:57.742 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa21c06be60 msgr2=0x7fa21c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa21c06be60 0x7fa21c06e370 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa220007fd0 tx=0x7fa220007de0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230162820 msgr2=0x7fa2300b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230162820 0x7fa2300b6520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa228007e90 tx=0x7fa22800e4b0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 shutdown_connections 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa21c06be60 0x7fa21c06e370 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230162820 0x7fa2300b6520 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2300b8190 0x7fa2301f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 --2- 172.21.15.6:0/1214243184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa23006d3d0 0x7fa2300cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.745+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 >> 172.21.15.6:0/1214243184 conn(0x7fa2300d4bd0 msgr2=0x7fa23015d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:57.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.746+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 shutdown_connections 2024-05-20T17:55:57.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.746+0000 7fa236979640 1 -- 172.21.15.6:0/1214243184 wait complete. 2024-05-20T17:55:57.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:55:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.874+0000 7fd7a4492640 1 Processor -- start 2024-05-20T17:55:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.874+0000 7fd7a4492640 1 -- start start 2024-05-20T17:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a4492640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd79c06d3d0 0x7fd79c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a4492640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c0b8190 0x7fd79c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a4492640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79c06dd20 con 0x7fd79c162820 2024-05-20T17:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a4492640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd79c0d0630 con 0x7fd79c06d3d0 2024-05-20T17:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a4492640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c0d39c0 con 0x7fd79c0b8190 2024-05-20T17:55:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a1a2d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd79c06d3d0 0x7fd79c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a1a2d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd79c06d3d0 0x7fd79c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37128/0 (socket says 172.21.15.6:37128) 2024-05-20T17:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a1a2d640 1 -- 172.21.15.6:0/2905732359 learned_addr learned my addr 172.21.15.6:0/2905732359 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a2a2f640 1 --2- 172.21.15.6:0/2905732359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c0b8190 0x7fd79c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a1a2d640 1 -- 172.21.15.6:0/2905732359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c0b8190 msgr2=0x7fd79c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a1a2d640 1 --2- 172.21.15.6:0/2905732359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c0b8190 0x7fd79c0b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a1a2d640 1 -- 172.21.15.6:0/2905732359 >> v1:172.21.15.171:6789/0 conn(0x7fd79c162820 legacy=0x7fd79c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.876+0000 7fd7a1a2d640 1 -- 172.21.15.6:0/2905732359 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c0d3ca0 con 0x7fd79c06d3d0 2024-05-20T17:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.877+0000 7fd7a1a2d640 1 --2- 172.21.15.6:0/2905732359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c06d3d0 0x7fd79c06d7e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009870 tx=0x7fd78c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc12b6ef312c872 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.877+0000 7fd7a122c640 1 -- 172.21.15.6:0/2905732359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c037070 con 0x7fd79c06d3d0 2024-05-20T17:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.877+0000 7fd7a122c640 1 -- 172.21.15.6:0/2905732359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c032440 con 0x7fd79c06d3d0 2024-05-20T17:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.877+0000 7fd7a122c640 1 -- 172.21.15.6:0/2905732359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c032810 con 0x7fd79c06d3d0 2024-05-20T17:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.878+0000 7fd7a4492640 1 -- 172.21.15.6:0/2905732359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c06d3d0 msgr2=0x7fd79c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.878+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2905732359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c06d3d0 0x7fd79c06d7e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009870 tx=0x7fd78c02a210 comp rx=0 tx=0).stop 2024-05-20T17:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.878+0000 7fd7a4492640 1 -- 172.21.15.6:0/2905732359 shutdown_connections 2024-05-20T17:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.878+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2905732359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c0b8190 0x7fd79c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.878+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2905732359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c06d3d0 0x7fd79c06d7e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.878+0000 7fd7a4492640 1 -- 172.21.15.6:0/2905732359 >> 172.21.15.6:0/2905732359 conn(0x7fd79c0d4bd0 msgr2=0x7fd79c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.878+0000 7fd7a4492640 1 -- 172.21.15.6:0/2905732359 shutdown_connections 2024-05-20T17:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.878+0000 7fd7a4492640 1 -- 172.21.15.6:0/2905732359 wait complete. 2024-05-20T17:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.880+0000 7fd7a4492640 1 Processor -- start 2024-05-20T17:55:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.880+0000 7fd7a4492640 1 -- start start 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a4492640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd79c06d3d0 0x7fd79c0ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a4492640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c0b8190 0x7fd79c1f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a4492640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c162820 0x7fd79c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a4492640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0d0300 con 0x7fd79c0b8190 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a4492640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0d4260 con 0x7fd79c06d3d0 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a4492640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c0b4050 con 0x7fd79c162820 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a1a2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c0b8190 0x7fd79c1f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a1a2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c0b8190 0x7fd79c1f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37144/0 (socket says 172.21.15.6:37144) 2024-05-20T17:55:57.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a1a2d640 1 -- 172.21.15.6:0/2721860567 learned_addr learned my addr 172.21.15.6:0/2721860567 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a222e640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd79c06d3d0 0x7fd79c0ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a2a2f640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c162820 0x7fd79c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a1a2d640 1 -- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c162820 msgr2=0x7fd79c0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a1a2d640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c162820 0x7fd79c0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a1a2d640 1 -- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd79c06d3d0 msgr2=0x7fd79c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.881+0000 7fd7a1a2d640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd79c06d3d0 0x7fd79c0ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.882+0000 7fd7a1a2d640 1 -- 172.21.15.6:0/2721860567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c0b5d30 con 0x7fd79c0b8190 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.882+0000 7fd7a1a2d640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c0b8190 0x7fd79c1f4fb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009870 tx=0x7fd78c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.882+0000 7fd792ffd640 1 -- 172.21.15.6:0/2721860567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c041020 con 0x7fd79c0b8190 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.882+0000 7fd792ffd640 1 -- 172.21.15.6:0/2721860567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c030970 con 0x7fd79c0b8190 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.882+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c0b6010 con 0x7fd79c0b8190 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.882+0000 7fd792ffd640 1 -- 172.21.15.6:0/2721860567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c037040 con 0x7fd79c0b8190 2024-05-20T17:55:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.882+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c0b65d0 con 0x7fd79c0b8190 2024-05-20T17:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.883+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd79c0b5aa0 con 0x7fd79c0b8190 2024-05-20T17:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.884+0000 7fd792ffd640 1 -- 172.21.15.6:0/2721860567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd78c044020 con 0x7fd79c0b8190 2024-05-20T17:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.884+0000 7fd792ffd640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.884+0000 7fd792ffd640 1 -- 172.21.15.6:0/2721860567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fd78c0aba70 con 0x7fd79c0b8190 2024-05-20T17:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.884+0000 7fd7a222e640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:57.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.885+0000 7fd7a222e640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd79800a750 tx=0x7fd798008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:57.889+0000 7fd792ffd640 1 -- 172.21.15.6:0/2721860567 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd78c04b030 con 0x7fd79c0b8190 2024-05-20T17:55:58.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.073+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd79c075b00 con 0x7fd79c0b8190 2024-05-20T17:55:58.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.073+0000 7fd792ffd640 1 -- 172.21.15.6:0/2721860567 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) ==== 104+0+11 (secure 0 0 0) 0x7fd79c06dd20 con 0x7fd79c0b8190 2024-05-20T17:55:58.071 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:55:58.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 msgr2=0x7fd78006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd79800a750 tx=0x7fd798008040 comp rx=0 tx=0).stop 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c0b8190 msgr2=0x7fd79c1f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c0b8190 0x7fd79c1f4fb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009870 tx=0x7fd78c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 shutdown_connections 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd79c162820 0x7fd79c0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79c0b8190 0x7fd79c1f4fb0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 --2- 172.21.15.6:0/2721860567 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd79c06d3d0 0x7fd79c0ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 >> 172.21.15.6:0/2721860567 conn(0x7fd79c0d4bd0 msgr2=0x7fd79c15f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 shutdown_connections 2024-05-20T17:55:58.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.075+0000 7fd7a4492640 1 -- 172.21.15.6:0/2721860567 wait complete. 2024-05-20T17:55:58.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:55:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.204+0000 7ff1bc0b8640 1 Processor -- start 2024-05-20T17:55:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.204+0000 7ff1bc0b8640 1 -- start start 2024-05-20T17:55:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.205+0000 7ff1bc0b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b4010 0x7ff1b40d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.205+0000 7ff1bc0b8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1b40d14b0 0x7ff1b40d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.205+0000 7ff1bc0b8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b40d0370 con 0x7ff1b4163a10 2024-05-20T17:55:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.205+0000 7ff1bc0b8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b40d3ca0 con 0x7ff1b40d14b0 2024-05-20T17:55:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.205+0000 7ff1bc0b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b40d0650 con 0x7ff1b40b4010 2024-05-20T17:55:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1ba655640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1b40d14b0 0x7ff1b40d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1b9653640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b4010 0x7ff1b40d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1b9e54640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff1b4163a10 0x7ff1b40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:58794/0 (socket says 172.21.15.6:58794) 2024-05-20T17:55:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1ba655640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1b40d14b0 0x7ff1b40d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:42278/0 (socket says 172.21.15.6:42278) 2024-05-20T17:55:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1b9653640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b4010 0x7ff1b40d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:33734/0 (socket says 172.21.15.6:33734) 2024-05-20T17:55:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1b9e54640 1 -- 172.21.15.6:0/333489837 learned_addr learned my addr 172.21.15.6:0/333489837 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1b9653640 1 -- 172.21.15.6:0/333489837 >> v2:172.21.15.171:3300/0 conn(0x7ff1b40d14b0 msgr2=0x7ff1b40d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1b9653640 1 --2- 172.21.15.6:0/333489837 >> v2:172.21.15.171:3300/0 conn(0x7ff1b40d14b0 0x7ff1b40d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1b9653640 1 -- 172.21.15.6:0/333489837 >> v1:172.21.15.171:6789/0 conn(0x7ff1b4163a10 legacy=0x7ff1b40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1b9653640 1 -- 172.21.15.6:0/333489837 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b40d3650 con 0x7ff1b40b4010 2024-05-20T17:55:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.206+0000 7ff1ba655640 1 --2- 172.21.15.6:0/333489837 >> v2:172.21.15.171:3300/0 conn(0x7ff1b40d14b0 0x7ff1b40d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:58.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.207+0000 7ff1b9653640 1 --2- 172.21.15.6:0/333489837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b4010 0x7ff1b40d4130 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80097a0 tx=0x7ff1a802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21337106ebb5a4bb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.207+0000 7ff1b8e52640 1 -- 172.21.15.6:0/333489837 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8037070 con 0x7ff1b40b4010 2024-05-20T17:55:58.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.207+0000 7ff1b8e52640 1 -- 172.21.15.6:0/333489837 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a8032440 con 0x7ff1b40b4010 2024-05-20T17:55:58.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.207+0000 7ff1b8e52640 1 -- 172.21.15.6:0/333489837 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8032810 con 0x7ff1b40b4010 2024-05-20T17:55:58.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.208+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/333489837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b4010 msgr2=0x7ff1b40d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.208+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/333489837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b4010 0x7ff1b40d4130 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80097a0 tx=0x7ff1a802a180 comp rx=0 tx=0).stop 2024-05-20T17:55:58.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.208+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/333489837 shutdown_connections 2024-05-20T17:55:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.208+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/333489837 >> v2:172.21.15.171:3300/0 conn(0x7ff1b40d14b0 0x7ff1b40d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.208+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/333489837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b4010 0x7ff1b40d4130 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.208+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/333489837 >> 172.21.15.6:0/333489837 conn(0x7ff1b406d240 msgr2=0x7ff1b406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.208+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/333489837 shutdown_connections 2024-05-20T17:55:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.208+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/333489837 wait complete. 2024-05-20T17:55:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.210+0000 7ff1bc0b8640 1 Processor -- start 2024-05-20T17:55:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.210+0000 7ff1bc0b8640 1 -- start start 2024-05-20T17:55:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1bc0b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40b4010 0x7ff1b40cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1bc0b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40d14b0 0x7ff1b40ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1bc0b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4163a10 0x7ff1b40b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1bc0b8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b40b8210 con 0x7ff1b40b4010 2024-05-20T17:55:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1bc0b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b40d1e00 con 0x7ff1b4163a10 2024-05-20T17:55:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1bc0b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b40b8390 con 0x7ff1b40d14b0 2024-05-20T17:55:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9e54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40b4010 0x7ff1b40cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9e54640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40b4010 0x7ff1b40cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37148/0 (socket says 172.21.15.6:37148) 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9e54640 1 -- 172.21.15.6:0/1794979029 learned_addr learned my addr 172.21.15.6:0/1794979029 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9653640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40d14b0 0x7ff1b40ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1ba655640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4163a10 0x7ff1b40b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9e54640 1 -- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40d14b0 msgr2=0x7ff1b40ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9e54640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40d14b0 0x7ff1b40ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9e54640 1 -- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4163a10 msgr2=0x7ff1b40b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9e54640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4163a10 0x7ff1b40b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.211+0000 7ff1b9e54640 1 -- 172.21.15.6:0/1794979029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b414ae60 con 0x7ff1b40b4010 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.212+0000 7ff1b9e54640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40b4010 0x7ff1b40cdcc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c440 tx=0x7ff1ac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.212+0000 7ff1b27fc640 1 -- 172.21.15.6:0/1794979029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac017070 con 0x7ff1b40b4010 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.212+0000 7ff1b27fc640 1 -- 172.21.15.6:0/1794979029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ac005ce0 con 0x7ff1b40b4010 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.212+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b414b140 con 0x7ff1b40b4010 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.212+0000 7ff1b27fc640 1 -- 172.21.15.6:0/1794979029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0072f0 con 0x7ff1b40b4010 2024-05-20T17:55:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.212+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b414b700 con 0x7ff1b40b4010 2024-05-20T17:55:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.213+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b4075b00 con 0x7ff1b40b4010 2024-05-20T17:55:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.214+0000 7ff1b27fc640 1 -- 172.21.15.6:0/1794979029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1ac01a070 con 0x7ff1b40b4010 2024-05-20T17:55:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.214+0000 7ff1b27fc640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1a006be30 0x7ff1a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.214+0000 7ff1b27fc640 1 -- 172.21.15.6:0/1794979029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7ff1ac08a190 con 0x7ff1b40b4010 2024-05-20T17:55:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.214+0000 7ff1b9653640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1a006be30 0x7ff1a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.215+0000 7ff1b9653640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1a006be30 0x7ff1a006e340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8034000 tx=0x7ff1a802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.219+0000 7ff1b27fc640 1 -- 172.21.15.6:0/1794979029 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff1ac0582a0 con 0x7ff1b40b4010 2024-05-20T17:55:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.402+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff1b40d3050 con 0x7ff1b40b4010 2024-05-20T17:55:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.403+0000 7ff1b27fc640 1 -- 172.21.15.6:0/1794979029 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) ==== 100+0+11 (secure 0 0 0) 0x7ff1ac05c5a0 con 0x7ff1b40b4010 2024-05-20T17:55:58.401 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:55:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1a006be30 msgr2=0x7ff1a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1a006be30 0x7ff1a006e340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8034000 tx=0x7ff1a802e000 comp rx=0 tx=0).stop 2024-05-20T17:55:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40b4010 msgr2=0x7ff1b40cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40b4010 0x7ff1b40cdcc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c440 tx=0x7ff1ac00c840 comp rx=0 tx=0).stop 2024-05-20T17:55:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 shutdown_connections 2024-05-20T17:55:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1a006be30 0x7ff1a006e340 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b4163a10 0x7ff1b40b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40d14b0 0x7ff1b40ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 --2- 172.21.15.6:0/1794979029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b40b4010 0x7ff1b40cdcc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 >> 172.21.15.6:0/1794979029 conn(0x7ff1b406d240 msgr2=0x7ff1b41610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 shutdown_connections 2024-05-20T17:55:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.405+0000 7ff1bc0b8640 1 -- 172.21.15.6:0/1794979029 wait complete. 2024-05-20T17:55:58.414 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.530+0000 7fb63fe73640 1 Processor -- start 2024-05-20T17:55:58.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.530+0000 7fb63fe73640 1 -- start start 2024-05-20T17:55:58.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63fe73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb638159aa0 0x7fb63806da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63fe73640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6380b1cc0 0x7fb6380b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63fe73640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63815fa20 con 0x7fb6380d1580 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63fe73640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb638160630 con 0x7fb6380b1cc0 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63fe73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb63815fd00 con 0x7fb638159aa0 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63e410640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6380b1cc0 0x7fb6380b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63d40e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb6380d1580 0x7fb6380d1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47192/0 (socket says 172.21.15.6:47192) 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63d40e640 1 -- 172.21.15.6:0/361411486 learned_addr learned my addr 172.21.15.6:0/361411486 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63dc0f640 1 --2- 172.21.15.6:0/361411486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb638159aa0 0x7fb63806da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63e410640 1 -- 172.21.15.6:0/361411486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb638159aa0 msgr2=0x7fb63806da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63e410640 1 --2- 172.21.15.6:0/361411486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb638159aa0 0x7fb63806da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63e410640 1 -- 172.21.15.6:0/361411486 >> v1:172.21.15.6:6789/0 conn(0x7fb6380d1580 legacy=0x7fb6380d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63cc0d640 1 -- 172.21.15.6:0/361411486 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005227985 0 0) 0x7fb63815fa20 con 0x7fb6380d1580 2024-05-20T17:55:58.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.532+0000 7fb63e410640 1 -- 172.21.15.6:0/361411486 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63815ffe0 con 0x7fb6380b1cc0 2024-05-20T17:55:58.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.533+0000 7fb63e410640 1 --2- 172.21.15.6:0/361411486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380b1cc0 0x7fb6380b20d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb6381607b0 tx=0x7fb63002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b9c217ea04bced server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.533+0000 7fb63cc0d640 1 -- 172.21.15.6:0/361411486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63002ae60 con 0x7fb6380b1cc0 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.533+0000 7fb63cc0d640 1 -- 172.21.15.6:0/361411486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb630007740 con 0x7fb6380b1cc0 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.533+0000 7fb63cc0d640 1 -- 172.21.15.6:0/361411486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630007b10 con 0x7fb6380b1cc0 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.534+0000 7fb63fe73640 1 -- 172.21.15.6:0/361411486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380b1cc0 msgr2=0x7fb6380b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.534+0000 7fb63fe73640 1 --2- 172.21.15.6:0/361411486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380b1cc0 0x7fb6380b20d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb6381607b0 tx=0x7fb63002a640 comp rx=0 tx=0).stop 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.534+0000 7fb63fe73640 1 -- 172.21.15.6:0/361411486 shutdown_connections 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.534+0000 7fb63fe73640 1 --2- 172.21.15.6:0/361411486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380b1cc0 0x7fb6380b20d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.534+0000 7fb63fe73640 1 --2- 172.21.15.6:0/361411486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb638159aa0 0x7fb63806da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.534+0000 7fb63fe73640 1 -- 172.21.15.6:0/361411486 >> 172.21.15.6:0/361411486 conn(0x7fb6380b6620 msgr2=0x7fb6380b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.534+0000 7fb63fe73640 1 -- 172.21.15.6:0/361411486 shutdown_connections 2024-05-20T17:55:58.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.534+0000 7fb63fe73640 1 -- 172.21.15.6:0/361411486 wait complete. 2024-05-20T17:55:58.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.536+0000 7fb63fe73640 1 Processor -- start 2024-05-20T17:55:58.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.536+0000 7fb63fe73640 1 -- start start 2024-05-20T17:55:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63fe73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6380b1cc0 0x7fb63809cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63fe73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380d1580 0x7fb638157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63fe73640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb638159aa0 0x7fb638154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63fe73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb6380b1420 con 0x7fb6380d1580 2024-05-20T17:55:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63fe73640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb63806dfc0 con 0x7fb638159aa0 2024-05-20T17:55:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63fe73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb6380b15a0 con 0x7fb6380b1cc0 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63d40e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380d1580 0x7fb638157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63d40e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380d1580 0x7fb638157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37160/0 (socket says 172.21.15.6:37160) 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.537+0000 7fb63d40e640 1 -- 172.21.15.6:0/1124353383 learned_addr learned my addr 172.21.15.6:0/1124353383 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63dc0f640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6380b1cc0 0x7fb63809cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63e410640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb638159aa0 0x7fb638154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63d40e640 1 -- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6380b1cc0 msgr2=0x7fb63809cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63d40e640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6380b1cc0 0x7fb63809cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63d40e640 1 -- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb638159aa0 msgr2=0x7fb638154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63d40e640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb638159aa0 0x7fb638154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63d40e640 1 -- 172.21.15.6:0/1124353383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63809bfa0 con 0x7fb6380d1580 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63d40e640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380d1580 0x7fb638157230 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c460 tx=0x7fb62c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb62a7fc640 1 -- 172.21.15.6:0/1124353383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c018070 con 0x7fb6380d1580 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb62a7fc640 1 -- 172.21.15.6:0/1124353383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c007500 con 0x7fb6380d1580 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63809c280 con 0x7fb6380d1580 2024-05-20T17:55:58.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb62a7fc640 1 -- 172.21.15.6:0/1124353383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c004a20 con 0x7fb6380d1580 2024-05-20T17:55:58.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.538+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63809c840 con 0x7fb6380d1580 2024-05-20T17:55:58.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.539+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb638075b00 con 0x7fb6380d1580 2024-05-20T17:55:58.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.540+0000 7fb62a7fc640 1 -- 172.21.15.6:0/1124353383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb62c01b070 con 0x7fb6380d1580 2024-05-20T17:55:58.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.540+0000 7fb62a7fc640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb61c06be30 0x7fb61c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.540+0000 7fb62a7fc640 1 -- 172.21.15.6:0/1124353383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fb62c08a400 con 0x7fb6380d1580 2024-05-20T17:55:58.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.541+0000 7fb63dc0f640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb61c06be30 0x7fb61c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.541+0000 7fb63dc0f640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb61c06be30 0x7fb61c06e340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb634006fd0 tx=0x7fb634008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.545+0000 7fb62a7fc640 1 -- 172.21.15.6:0/1124353383 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb62c058ac0 con 0x7fb6380d1580 2024-05-20T17:55:58.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.765+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb638158120 con 0x7fb6380d1580 2024-05-20T17:55:58.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.766+0000 7fb62a7fc640 1 -- 172.21.15.6:0/1124353383 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5178 (secure 0 0 0) 0x7fb62c0583c0 con 0x7fb6380d1580 2024-05-20T17:55:58.764 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:58.764 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/855682127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":855682127},{"type":"v1","addr":"172.21.15.171:6837","nonce":855682127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2086456440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2086456440},{"type":"v1","addr":"172.21.15.171:6836","nonce":2086456440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3128490033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3128490033},{"type":"v1","addr":"172.21.15.6:6834","nonce":3128490033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:55:39.645375+0000","modified":"2024-05-20T17:55:42.672561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5880},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5880":{"gid":5880,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1365830773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1365830773},{"type":"v1","addr":"172.21.15.6:6835","nonce":1365830773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5880,"qdb_cluster":[5880]},"id":3}]} 2024-05-20T17:55:58.764 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb61c06be30 msgr2=0x7fb61c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb61c06be30 0x7fb61c06e340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb634006fd0 tx=0x7fb634008040 comp rx=0 tx=0).stop 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380d1580 msgr2=0x7fb638157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380d1580 0x7fb638157230 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c460 tx=0x7fb62c00c920 comp rx=0 tx=0).stop 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 shutdown_connections 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb61c06be30 0x7fb61c06e340 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb638159aa0 0x7fb638154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6380d1580 0x7fb638157230 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 --2- 172.21.15.6:0/1124353383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb6380b1cc0 0x7fb63809cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 >> 172.21.15.6:0/1124353383 conn(0x7fb6380b6620 msgr2=0x7fb638067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 shutdown_connections 2024-05-20T17:55:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.768+0000 7fb63fe73640 1 -- 172.21.15.6:0/1124353383 wait complete. 2024-05-20T17:55:58.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.894+0000 7fe781244640 1 Processor -- start 2024-05-20T17:55:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.894+0000 7fe781244640 1 -- start start 2024-05-20T17:55:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe781244640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 0x7fe77c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe781244640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe77c0b3e80 0x7fe77c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe781244640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe77c06dd20 con 0x7fe77c06d910 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe781244640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe77c0d0630 con 0x7fe77c0b3e80 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe781244640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe77c0d39c0 con 0x7fe77c162820 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe77a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe77c0b3e80 0x7fe77c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe77b59e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe77c06d910 0x7fe77c0d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47204/0 (socket says 172.21.15.6:47204) 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe77b59e640 1 -- 172.21.15.6:0/4082689132 learned_addr learned my addr 172.21.15.6:0/4082689132 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe77ad9d640 1 --2- 172.21.15.6:0/4082689132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 0x7fe77c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe77a59c640 1 -- 172.21.15.6:0/4082689132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 msgr2=0x7fe77c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe77a59c640 1 --2- 172.21.15.6:0/4082689132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 0x7fe77c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe77a59c640 1 -- 172.21.15.6:0/4082689132 >> v1:172.21.15.6:6789/0 conn(0x7fe77c06d910 legacy=0x7fe77c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe77a59c640 1 -- 172.21.15.6:0/4082689132 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77c0d3ca0 con 0x7fe77c0b3e80 2024-05-20T17:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.896+0000 7fe779d9b640 1 -- 172.21.15.6:0/4082689132 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145699037 0 0) 0x7fe774001490 con 0x7fe77c06d910 2024-05-20T17:55:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.897+0000 7fe77a59c640 1 --2- 172.21.15.6:0/4082689132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c06d3d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe7700097a0 tx=0x7fe77002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d325b208d3037aad server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.897+0000 7fe779d9b640 1 -- 172.21.15.6:0/4082689132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770037070 con 0x7fe77c0b3e80 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.897+0000 7fe779d9b640 1 -- 172.21.15.6:0/4082689132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe770032440 con 0x7fe77c0b3e80 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.897+0000 7fe779d9b640 1 -- 172.21.15.6:0/4082689132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770032810 con 0x7fe77c0b3e80 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.898+0000 7fe781244640 1 -- 172.21.15.6:0/4082689132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 msgr2=0x7fe77c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.898+0000 7fe781244640 1 --2- 172.21.15.6:0/4082689132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c06d3d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe7700097a0 tx=0x7fe77002a180 comp rx=0 tx=0).stop 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.898+0000 7fe781244640 1 -- 172.21.15.6:0/4082689132 shutdown_connections 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.898+0000 7fe781244640 1 --2- 172.21.15.6:0/4082689132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c06d3d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.898+0000 7fe781244640 1 --2- 172.21.15.6:0/4082689132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 0x7fe77c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.898+0000 7fe781244640 1 -- 172.21.15.6:0/4082689132 >> 172.21.15.6:0/4082689132 conn(0x7fe77c0d4bd0 msgr2=0x7fe77c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.898+0000 7fe781244640 1 -- 172.21.15.6:0/4082689132 shutdown_connections 2024-05-20T17:55:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.898+0000 7fe781244640 1 -- 172.21.15.6:0/4082689132 wait complete. 2024-05-20T17:55:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.900+0000 7fe781244640 1 Processor -- start 2024-05-20T17:55:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.900+0000 7fe781244640 1 -- start start 2024-05-20T17:55:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe781244640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c06d910 0x7fe77c14af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe781244640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe781244640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 0x7fe77c14def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe781244640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c0d0300 con 0x7fe77c0b3e80 2024-05-20T17:55:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe781244640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c0d4260 con 0x7fe77c06d910 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe781244640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe77c0b91a0 con 0x7fe77c162820 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c14d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37182/0 (socket says 172.21.15.6:37182) 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe77a59c640 1 -- 172.21.15.6:0/3688911523 learned_addr learned my addr 172.21.15.6:0/3688911523 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe77b59e640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 0x7fe77c14def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.901+0000 7fe77ad9d640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c06d910 0x7fe77c14af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe77a59c640 1 -- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 msgr2=0x7fe77c14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe77a59c640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 0x7fe77c14def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe77a59c640 1 -- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c06d910 msgr2=0x7fe77c14af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe77a59c640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c06d910 0x7fe77c14af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe77a59c640 1 -- 172.21.15.6:0/3688911523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77c14b9c0 con 0x7fe77c0b3e80 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe77a59c640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c14d9b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe7700098c0 tx=0x7fe7700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe7637fe640 1 -- 172.21.15.6:0/3688911523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770037040 con 0x7fe77c0b3e80 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe7637fe640 1 -- 172.21.15.6:0/3688911523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe770030770 con 0x7fe77c0b3e80 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77c14bc30 con 0x7fe77c0b3e80 2024-05-20T17:55:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe7637fe640 1 -- 172.21.15.6:0/3688911523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770030b40 con 0x7fe77c0b3e80 2024-05-20T17:55:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.902+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77c0cbc50 con 0x7fe77c0b3e80 2024-05-20T17:55:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.903+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77c0ca2c0 con 0x7fe77c0b3e80 2024-05-20T17:55:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.904+0000 7fe7637fe640 1 -- 172.21.15.6:0/3688911523 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe770044020 con 0x7fe77c0b3e80 2024-05-20T17:55:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.904+0000 7fe7637fe640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe76806be30 0x7fe76806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.904+0000 7fe7637fe640 1 -- 172.21.15.6:0/3688911523 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fe7700ab460 con 0x7fe77c0b3e80 2024-05-20T17:55:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.905+0000 7fe77ad9d640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe76806be30 0x7fe76806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.905+0000 7fe77ad9d640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe76806be30 0x7fe76806e340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0079a0 tx=0x7fe76c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:58.909+0000 7fe7637fe640 1 -- 172.21.15.6:0/3688911523 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe770032e20 con 0x7fe77c0b3e80 2024-05-20T17:55:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.093+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe77c075b00 con 0x7fe77c0b3e80 2024-05-20T17:55:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.094+0000 7fe7637fe640 1 -- 172.21.15.6:0/3688911523 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16933 (secure 0 0 0) 0x7fe770079560 con 0x7fe77c0b3e80 2024-05-20T17:55:59.092 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:59.092 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:48.321415+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:55:37.996162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-20T17:55:38.615776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:55:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe76806be30 msgr2=0x7fe76806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe76806be30 0x7fe76806e340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0079a0 tx=0x7fe76c008040 comp rx=0 tx=0).stop 2024-05-20T17:55:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 msgr2=0x7fe77c14d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c14d9b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe7700098c0 tx=0x7fe7700046c0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 shutdown_connections 2024-05-20T17:55:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe76806be30 0x7fe76806e340 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe77c162820 0x7fe77c14def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0b3e80 0x7fe77c14d9b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 --2- 172.21.15.6:0/3688911523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe77c06d910 0x7fe77c14af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 >> 172.21.15.6:0/3688911523 conn(0x7fe77c0d4bd0 msgr2=0x7fe77c161bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 shutdown_connections 2024-05-20T17:55:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.096+0000 7fe781244640 1 -- 172.21.15.6:0/3688911523 wait complete. 2024-05-20T17:55:59.106 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T17:55:59.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.222+0000 7f7c245c2640 1 Processor -- start 2024-05-20T17:55:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.222+0000 7f7c245c2640 1 -- start start 2024-05-20T17:55:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c245c2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7c1c0af030 0x7f7c1c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c245c2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c15f700 0x7f7c1c15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c245c2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c1c0af980 con 0x7f7c1c09a4f0 2024-05-20T17:55:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c245c2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7c1c06bcf0 con 0x7f7c1c0af030 2024-05-20T17:55:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c245c2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c1c160430 con 0x7f7c1c15f700 2024-05-20T17:55:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c21b5d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c15f700 0x7f7c1c15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c2235e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7c1c0af030 0x7f7c1c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c21b5d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c15f700 0x7f7c1c15fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:33778/0 (socket says 172.21.15.6:33778) 2024-05-20T17:55:59.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.224+0000 7f7c21b5d640 1 -- 172.21.15.6:0/2271340137 learned_addr learned my addr 172.21.15.6:0/2271340137 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:59.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.225+0000 7f7c2135c640 1 -- 172.21.15.6:0/2271340137 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997363057 0 0) 0x7f7c14001110 con 0x7f7c1c09a4f0 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.225+0000 7f7c21b5d640 1 -- 172.21.15.6:0/2271340137 >> v2:172.21.15.171:3300/0 conn(0x7f7c1c0af030 msgr2=0x7f7c1c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.225+0000 7f7c21b5d640 1 --2- 172.21.15.6:0/2271340137 >> v2:172.21.15.171:3300/0 conn(0x7f7c1c0af030 0x7f7c1c0af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.225+0000 7f7c21b5d640 1 -- 172.21.15.6:0/2271340137 >> v1:172.21.15.171:6789/0 conn(0x7f7c1c09a4f0 legacy=0x7f7c1c09a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.225+0000 7f7c21b5d640 1 -- 172.21.15.6:0/2271340137 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c06b6a0 con 0x7f7c1c15f700 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.226+0000 7f7c21b5d640 1 --2- 172.21.15.6:0/2271340137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c15f700 0x7f7c1c15fb10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009870 tx=0x7f7c0c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=145b1cb40206be90 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.226+0000 7f7c2135c640 1 -- 172.21.15.6:0/2271340137 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c037070 con 0x7f7c1c15f700 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.226+0000 7f7c2135c640 1 -- 172.21.15.6:0/2271340137 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c032440 con 0x7f7c1c15f700 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.226+0000 7f7c2135c640 1 -- 172.21.15.6:0/2271340137 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c032810 con 0x7f7c1c15f700 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.226+0000 7f7c245c2640 1 -- 172.21.15.6:0/2271340137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c15f700 msgr2=0x7f7c1c15fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.226+0000 7f7c245c2640 1 --2- 172.21.15.6:0/2271340137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c15f700 0x7f7c1c15fb10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009870 tx=0x7f7c0c02a270 comp rx=0 tx=0).stop 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.227+0000 7f7c245c2640 1 -- 172.21.15.6:0/2271340137 shutdown_connections 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.227+0000 7f7c245c2640 1 --2- 172.21.15.6:0/2271340137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c15f700 0x7f7c1c15fb10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.227+0000 7f7c245c2640 1 --2- 172.21.15.6:0/2271340137 >> v2:172.21.15.171:3300/0 conn(0x7f7c1c0af030 0x7f7c1c0af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.227+0000 7f7c245c2640 1 -- 172.21.15.6:0/2271340137 >> 172.21.15.6:0/2271340137 conn(0x7f7c1c0b6620 msgr2=0x7f7c1c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:59.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.227+0000 7f7c245c2640 1 -- 172.21.15.6:0/2271340137 shutdown_connections 2024-05-20T17:55:59.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.227+0000 7f7c245c2640 1 -- 172.21.15.6:0/2271340137 wait complete. 2024-05-20T17:55:59.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.228+0000 7f7c245c2640 1 Processor -- start 2024-05-20T17:55:59.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.228+0000 7f7c245c2640 1 -- start start 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c245c2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c1c09a4f0 0x7f7c1c1473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c245c2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c0af030 0x7f7c1c144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c245c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1c15f700 0x7f7c1c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c245c2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c160050 con 0x7f7c1c15f700 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c245c2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c159aa0 con 0x7f7c1c09a4f0 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c245c2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c1c1601d0 con 0x7f7c1c0af030 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1c15f700 0x7f7c1c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1c15f700 0x7f7c1c0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37188/0 (socket says 172.21.15.6:37188) 2024-05-20T17:55:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 -- 172.21.15.6:0/1499622368 learned_addr learned my addr 172.21.15.6:0/1499622368 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c21b5d640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c0af030 0x7f7c1c144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c2235e640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c1c09a4f0 0x7f7c1c1473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 -- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c0af030 msgr2=0x7f7c1c144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c0af030 0x7f7c1c144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 -- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c1c09a4f0 msgr2=0x7f7c1c1473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c1c09a4f0 0x7f7c1c1473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 -- 172.21.15.6:0/1499622368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c158500 con 0x7f7c1c15f700 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.230+0000 7f7c22b5f640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1c15f700 0x7f7c1c0b3220 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c410 tx=0x7f7c1400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.231+0000 7f7c12ffd640 1 -- 172.21.15.6:0/1499622368 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14017070 con 0x7f7c1c15f700 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.231+0000 7f7c12ffd640 1 -- 172.21.15.6:0/1499622368 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c140035f0 con 0x7f7c1c15f700 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.231+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1c1587e0 con 0x7f7c1c15f700 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.231+0000 7f7c12ffd640 1 -- 172.21.15.6:0/1499622368 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140039e0 con 0x7f7c1c15f700 2024-05-20T17:55:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.231+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1c158da0 con 0x7f7c1c15f700 2024-05-20T17:55:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.232+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c1c075b00 con 0x7f7c1c15f700 2024-05-20T17:55:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.232+0000 7f7c12ffd640 1 -- 172.21.15.6:0/1499622368 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c1401a070 con 0x7f7c1c15f700 2024-05-20T17:55:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.233+0000 7f7c12ffd640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c0006be30 0x7f7c0006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.233+0000 7f7c12ffd640 1 -- 172.21.15.6:0/1499622368 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f7c1408a370 con 0x7f7c1c15f700 2024-05-20T17:55:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.233+0000 7f7c2235e640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c0006be30 0x7f7c0006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.234+0000 7f7c2235e640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c0006be30 0x7f7c0006e340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c06e1f0 tx=0x7f7c1800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.237+0000 7f7c12ffd640 1 -- 172.21.15.6:0/1499622368 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7c1c0af980 con 0x7f7c1c15f700 2024-05-20T17:55:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.463+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c1c0d1630 con 0x7f7c1c15f700 2024-05-20T17:55:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.463+0000 7f7c12ffd640 1 -- 172.21.15.6:0/1499622368 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5178 (secure 0 0 0) 0x7f7c14058520 con 0x7f7c1c15f700 2024-05-20T17:55:59.461 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:59.462 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/855682127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":855682127},{"type":"v1","addr":"172.21.15.171:6837","nonce":855682127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2086456440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2086456440},{"type":"v1","addr":"172.21.15.171:6836","nonce":2086456440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3128490033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3128490033},{"type":"v1","addr":"172.21.15.6:6834","nonce":3128490033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:55:39.645375+0000","modified":"2024-05-20T17:55:42.672561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5880},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5880":{"gid":5880,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1365830773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1365830773},{"type":"v1","addr":"172.21.15.6:6835","nonce":1365830773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5880,"qdb_cluster":[5880]},"id":3}]} 2024-05-20T17:55:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.465+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c0006be30 msgr2=0x7f7c0006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.465+0000 7f7c245c2640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c0006be30 0x7f7c0006e340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c06e1f0 tx=0x7f7c1800b040 comp rx=0 tx=0).stop 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.465+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1c15f700 msgr2=0x7f7c1c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.465+0000 7f7c245c2640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1c15f700 0x7f7c1c0b3220 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c410 tx=0x7f7c1400c8d0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.465+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 shutdown_connections 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.466+0000 7f7c245c2640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c0006be30 0x7f7c0006e340 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.466+0000 7f7c245c2640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c1c15f700 0x7f7c1c0b3220 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.466+0000 7f7c245c2640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c1c0af030 0x7f7c1c144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.466+0000 7f7c245c2640 1 --2- 172.21.15.6:0/1499622368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c1c09a4f0 0x7f7c1c1473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.466+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 >> 172.21.15.6:0/1499622368 conn(0x7f7c1c0b6620 msgr2=0x7f7c1c06ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:59.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.466+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 shutdown_connections 2024-05-20T17:55:59.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.466+0000 7f7c245c2640 1 -- 172.21.15.6:0/1499622368 wait complete. 2024-05-20T17:55:59.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:55:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.591+0000 7f3d0572a640 1 Processor -- start 2024-05-20T17:55:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.591+0000 7f3d0572a640 1 -- start start 2024-05-20T17:55:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.592+0000 7f3d0572a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3d0006d3d0 0x7f3d0006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.592+0000 7f3d0572a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d0006dd20 con 0x7f3d000b8190 2024-05-20T17:55:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.592+0000 7f3d0572a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d000d0630 con 0x7f3d00162820 2024-05-20T17:55:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.592+0000 7f3d0572a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3d000d39c0 con 0x7f3d0006d3d0 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cff7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3d000b8190 0x7f3d000b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47212/0 (socket says 172.21.15.6:47212) 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cff7fe640 1 -- 172.21.15.6:0/2923138214 learned_addr learned my addr 172.21.15.6:0/2923138214 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cf7fff640 1 --2- 172.21.15.6:0/2923138214 >> v2:172.21.15.171:3300/0 conn(0x7f3d0006d3d0 0x7f3d0006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253458683 0 0) 0x7f3cf8001490 con 0x7f3d000b8190 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cec003520 con 0x7f3d000b8190 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3883185636 0 0) 0x7f3cec003520 con 0x7f3d000b8190 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 >> v2:172.21.15.171:3300/0 conn(0x7f3d0006d3d0 msgr2=0x7f3d0006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 --2- 172.21.15.6:0/2923138214 >> v2:172.21.15.171:3300/0 conn(0x7f3d0006d3d0 0x7f3d0006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 >> v1:172.21.15.171:6789/0 conn(0x7f3d00162820 legacy=0x7f3d000b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d000d3ca0 con 0x7f3d000b8190 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f3cf8001bc0 con 0x7f3d000b8190 2024-05-20T17:55:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 >> v1:172.21.15.6:6789/0 conn(0x7f3d000b8190 legacy=0x7f3d000b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cec0039b0 0x7f3cec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cec004800 0x7f3cec004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3cec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000d39c0 con 0x7f3cec005150 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec00c0c0 con 0x7f3cec0039b0 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3cec00c2c0 con 0x7f3cec004800 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cff7fe640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3cec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cf7fff640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cec004800 0x7f3cec004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.593+0000 7f3cfeffd640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cec0039b0 0x7f3cec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.594+0000 7f3cff7fe640 1 -- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cec004800 msgr2=0x7f3cec004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.594+0000 7f3cff7fe640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3cec004800 0x7f3cec004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.594+0000 7f3cff7fe640 1 -- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cec0039b0 msgr2=0x7f3cec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.594+0000 7f3cff7fe640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cec0039b0 0x7f3cec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.594+0000 7f3cff7fe640 1 -- 172.21.15.6:0/2923138214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cec003520 con 0x7f3cec005150 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.594+0000 7f3cfeffd640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3cec0039b0 0x7f3cec003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.594+0000 7f3cff7fe640 1 -- 172.21.15.6:0/2923138214 reap_dead start 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.594+0000 7f3cff7fe640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3cec00b9c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800aa30 tx=0x7f3cec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabf41f9ba0e7af4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800a650 con 0x7f3cec005150 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf802f070 con 0x7f3cec005150 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3cfe7fc640 1 -- 172.21.15.6:0/2923138214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf802be60 con 0x7f3cec005150 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3d0572a640 1 -- 172.21.15.6:0/2923138214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 msgr2=0x7f3cec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3d0572a640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3cec00b9c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800aa30 tx=0x7f3cec005830 comp rx=0 tx=0).stop 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3d0572a640 1 -- 172.21.15.6:0/2923138214 shutdown_connections 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3d0572a640 1 --2- 172.21.15.6:0/2923138214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3cec00b9c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3d0572a640 1 -- 172.21.15.6:0/2923138214 >> 172.21.15.6:0/2923138214 conn(0x7f3d000d4bd0 msgr2=0x7f3d000d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3d0572a640 1 -- 172.21.15.6:0/2923138214 shutdown_connections 2024-05-20T17:55:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.595+0000 7f3d0572a640 1 -- 172.21.15.6:0/2923138214 wait complete. 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.597+0000 7f3d0572a640 1 Processor -- start 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.597+0000 7f3d0572a640 1 -- start start 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.598+0000 7f3d0572a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3d00157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.598+0000 7f3d0572a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d000ccc60 0x7f3d001f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.598+0000 7f3d0572a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d001f5840 0x7f3d001f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.598+0000 7f3d0572a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000d0300 con 0x7f3cec005150 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.598+0000 7f3d0572a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000d4260 con 0x7f3d001f5840 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.598+0000 7f3d0572a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3d000d4780 con 0x7f3d000ccc60 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3d00157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3d00157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37200/0 (socket says 172.21.15.6:37200) 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 -- 172.21.15.6:0/1023173001 learned_addr learned my addr 172.21.15.6:0/1023173001 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:59.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cf7fff640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d000ccc60 0x7f3d001f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cff7fe640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d001f5840 0x7f3d001f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 -- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d000ccc60 msgr2=0x7f3d001f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d000ccc60 0x7f3d001f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 -- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d001f5840 msgr2=0x7f3d001f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d001f5840 0x7f3d001f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 -- 172.21.15.6:0/1023173001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d001f6520 con 0x7f3cec005150 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cfeffd640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3d00157190 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000e600 tx=0x7f3cf000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cf77fe640 1 -- 172.21.15.6:0/1023173001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00052e0 con 0x7f3cec005150 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cf77fe640 1 -- 172.21.15.6:0/1023173001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf0018070 con 0x7f3cec005150 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d001f6800 con 0x7f3cec005150 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.599+0000 7f3cf77fe640 1 -- 172.21.15.6:0/1023173001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0003810 con 0x7f3cec005150 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.600+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d001f5c50 con 0x7f3cec005150 2024-05-20T17:55:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.601+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d00075b00 con 0x7f3cec005150 2024-05-20T17:55:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.601+0000 7f3cf77fe640 1 -- 172.21.15.6:0/1023173001 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cf00039b0 con 0x7f3cec005150 2024-05-20T17:55:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.602+0000 7f3cf77fe640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ce006be30 0x7f3ce006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.602+0000 7f3cf77fe640 1 -- 172.21.15.6:0/1023173001 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f3cf008acd0 con 0x7f3cec005150 2024-05-20T17:55:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.602+0000 7f3cf7fff640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ce006be30 0x7f3ce006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.603+0000 7f3cf7fff640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ce006be30 0x7f3ce006e340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3d0008dbc0 tx=0x7f3ce8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.606+0000 7f3cf77fe640 1 -- 172.21.15.6:0/1023173001 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3cf0059430 con 0x7f3cec005150 2024-05-20T17:55:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.830+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d000c8530 con 0x7f3cec005150 2024-05-20T17:55:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.830+0000 7f3cf77fe640 1 -- 172.21.15.6:0/1023173001 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5178 (secure 0 0 0) 0x7f3cf0058d30 con 0x7f3cec005150 2024-05-20T17:55:59.829 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:55:59.829 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/855682127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":855682127},{"type":"v1","addr":"172.21.15.171:6837","nonce":855682127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2086456440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2086456440},{"type":"v1","addr":"172.21.15.171:6836","nonce":2086456440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3128490033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3128490033},{"type":"v1","addr":"172.21.15.6:6834","nonce":3128490033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:55:39.645375+0000","modified":"2024-05-20T17:55:42.672561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5880},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5880":{"gid":5880,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1365830773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1365830773},{"type":"v1","addr":"172.21.15.6:6835","nonce":1365830773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5880,"qdb_cluster":[5880]},"id":3}]} 2024-05-20T17:55:59.829 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-05-20T17:55:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ce006be30 msgr2=0x7f3ce006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ce006be30 0x7f3ce006e340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3d0008dbc0 tx=0x7f3ce8009190 comp rx=0 tx=0).stop 2024-05-20T17:55:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 msgr2=0x7f3d00157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3d00157190 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000e600 tx=0x7f3cf000ea00 comp rx=0 tx=0).stop 2024-05-20T17:55:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 shutdown_connections 2024-05-20T17:55:59.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ce006be30 0x7f3ce006e340 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d001f5840 0x7f3d001f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d000ccc60 0x7f3d001f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 --2- 172.21.15.6:0/1023173001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec005150 0x7f3d00157190 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 >> 172.21.15.6:0/1023173001 conn(0x7f3d000d4bd0 msgr2=0x7f3d0015d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:59.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 shutdown_connections 2024-05-20T17:55:59.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.832+0000 7f3d0572a640 1 -- 172.21.15.6:0/1023173001 wait complete. 2024-05-20T17:55:59.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:55:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.958+0000 7fbaa7d02640 1 Processor -- start 2024-05-20T17:55:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.958+0000 7fbaa7d02640 1 -- start start 2024-05-20T17:55:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa7d02640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa00cd680 0x7fbaa015f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa7d02640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbaa006c6c0 0x7fbaa006cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa7d02640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa006d0f0 con 0x7fbaa00cf3d0 2024-05-20T17:55:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa7d02640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa00cda90 con 0x7fbaa006c6c0 2024-05-20T17:55:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa7d02640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa015f760 con 0x7fbaa00cd680 2024-05-20T17:55:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa629f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbaa00cf3d0 0x7fbaa00cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47222/0 (socket says 172.21.15.6:47222) 2024-05-20T17:55:59.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa629f640 1 -- 172.21.15.6:0/1573356115 learned_addr learned my addr 172.21.15.6:0/1573356115 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa5a9e640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa00cd680 0x7fbaa015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa529d640 1 --2- 172.21.15.6:0/1573356115 >> v2:172.21.15.171:3300/0 conn(0x7fbaa006c6c0 0x7fbaa006cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463347813 0 0) 0x7fbaa006d0f0 con 0x7fbaa00cf3d0 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.960+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba88003520 con 0x7fbaa00cf3d0 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2983515110 0 0) 0x7fba88003520 con 0x7fbaa00cf3d0 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa00cd680 msgr2=0x7fbaa015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa00cd680 0x7fbaa015f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 >> v2:172.21.15.171:3300/0 conn(0x7fbaa006c6c0 msgr2=0x7fbaa006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 --2- 172.21.15.6:0/1573356115 >> v2:172.21.15.171:3300/0 conn(0x7fbaa006c6c0 0x7fbaa006cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa006d3d0 con 0x7fbaa00cf3d0 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fba98001670 con 0x7fbaa00cf3d0 2024-05-20T17:55:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 >> v1:172.21.15.6:6789/0 conn(0x7fbaa00cf3d0 legacy=0x7fbaa00cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba880039b0 0x7fba88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004800 0x7fba88004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88005150 0x7fba8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa015f760 con 0x7fba88004800 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fba8800bfb0 con 0x7fba88005150 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fba8800c1b0 con 0x7fba880039b0 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa5a9e640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa00cd680 0x7fbaa015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa529d640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004800 0x7fba88004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa629f640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88005150 0x7fba8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa5a9e640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba880039b0 0x7fba88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa529d640 1 -- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba880039b0 msgr2=0x7fba88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:59.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa529d640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba880039b0 0x7fba88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa529d640 1 -- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88005150 msgr2=0x7fba8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:55:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa529d640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88005150 0x7fba8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.961+0000 7fbaa529d640 1 -- 172.21.15.6:0/1573356115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba88003520 con 0x7fba88004800 2024-05-20T17:55:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.962+0000 7fbaa529d640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004800 0x7fba88004c10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fba94009ac0 tx=0x7fba88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf9c6029a8943de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.962+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94036070 con 0x7fba88004800 2024-05-20T17:55:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.962+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba94031400 con 0x7fba88004800 2024-05-20T17:55:59.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.962+0000 7fbaa4a9c640 1 -- 172.21.15.6:0/1573356115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94009690 con 0x7fba88004800 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.963+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1573356115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004800 msgr2=0x7fba88004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.963+0000 7fbaa7d02640 1 --2- 172.21.15.6:0/1573356115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba88004800 0x7fba88004c10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fba94009ac0 tx=0x7fba88005830 comp rx=0 tx=0).stop 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.963+0000 7fbaa629f640 1 -- 172.21.15.6:0/1573356115 reap_dead start 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.963+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1573356115 shutdown_connections 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.963+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1573356115 >> 172.21.15.6:0/1573356115 conn(0x7fbaa00b44d0 msgr2=0x7fbaa00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.963+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1573356115 shutdown_connections 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.963+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1573356115 wait complete. 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.965+0000 7fbaa7d02640 1 Processor -- start 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.965+0000 7fbaa7d02640 1 -- start start 2024-05-20T17:55:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa7d02640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88004800 0x7fbaa015c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa7d02640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa01f5ac0 0x7fbaa014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa7d02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa01f9070 0x7fbaa01f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa7d02640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa006d990 con 0x7fbaa01f9070 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa7d02640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa00d0b40 con 0x7fba88004800 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa7d02640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa00d2460 con 0x7fbaa01f5ac0 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa629f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa01f9070 0x7fbaa01f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa629f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa01f9070 0x7fbaa01f9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37210/0 (socket says 172.21.15.6:37210) 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa629f640 1 -- 172.21.15.6:0/1130480169 learned_addr learned my addr 172.21.15.6:0/1130480169 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa529d640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa01f5ac0 0x7fbaa014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.966+0000 7fbaa5a9e640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88004800 0x7fbaa015c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa629f640 1 -- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa01f5ac0 msgr2=0x7fbaa014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa629f640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa01f5ac0 0x7fbaa014c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa629f640 1 -- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88004800 msgr2=0x7fbaa015c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa629f640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88004800 0x7fbaa015c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa629f640 1 -- 172.21.15.6:0/1130480169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa01f99c0 con 0x7fbaa01f9070 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa529d640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa01f5ac0 0x7fbaa014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa5a9e640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88004800 0x7fbaa015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa629f640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa01f9070 0x7fbaa01f9480 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fba98001ce0 tx=0x7fba9800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fba9e7fc640 1 -- 172.21.15.6:0/1130480169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98012590 con 0x7fbaa01f9070 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fba9e7fc640 1 -- 172.21.15.6:0/1130480169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba98018070 con 0x7fbaa01f9070 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fba9e7fc640 1 -- 172.21.15.6:0/1130480169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba980129b0 con 0x7fbaa01f9070 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa00b8730 con 0x7fbaa01f9070 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.967+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa00b58e0 con 0x7fbaa01f9070 2024-05-20T17:55:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.968+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa0075b00 con 0x7fbaa01f9070 2024-05-20T17:55:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.969+0000 7fba9e7fc640 1 -- 172.21.15.6:0/1130480169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba98012b50 con 0x7fbaa01f9070 2024-05-20T17:55:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.969+0000 7fba9e7fc640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba8c06be30 0x7fba8c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:55:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.969+0000 7fba9e7fc640 1 -- 172.21.15.6:0/1130480169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fba9808abc0 con 0x7fbaa01f9070 2024-05-20T17:55:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.970+0000 7fbaa5a9e640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba8c06be30 0x7fba8c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:55:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.970+0000 7fbaa5a9e640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba8c06be30 0x7fba8c06e340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba90009670 tx=0x7fba9000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:55:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:55:59.974+0000 7fba9e7fc640 1 -- 172.21.15.6:0/1130480169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbaa01f99c0 con 0x7fbaa01f9070 2024-05-20T17:56:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.159+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaa00b84c0 con 0x7fbaa01f9070 2024-05-20T17:56:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.161+0000 7fba9e7fc640 1 -- 172.21.15.6:0/1130480169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16933 (secure 0 0 0) 0x7fba980593b0 con 0x7fbaa01f9070 2024-05-20T17:56:00.159 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:00.159 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":53,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:55:48.321415+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:55:37.996162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-20T17:55:38.615776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.14","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.162+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba8c06be30 msgr2=0x7fba8c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.162+0000 7fbaa7d02640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba8c06be30 0x7fba8c06e340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba90009670 tx=0x7fba9000b040 comp rx=0 tx=0).stop 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.162+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa01f9070 msgr2=0x7fbaa01f9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.162+0000 7fbaa7d02640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa01f9070 0x7fbaa01f9480 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fba98001ce0 tx=0x7fba9800ead0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.163+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 shutdown_connections 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.163+0000 7fbaa7d02640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba8c06be30 0x7fba8c06e340 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.163+0000 7fbaa7d02640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbaa01f9070 0x7fbaa01f9480 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.163+0000 7fbaa7d02640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbaa01f5ac0 0x7fbaa014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.163+0000 7fbaa7d02640 1 --2- 172.21.15.6:0/1130480169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba88004800 0x7fbaa015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.163+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 >> 172.21.15.6:0/1130480169 conn(0x7fbaa00b44d0 msgr2=0x7fbaa0161df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.163+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 shutdown_connections 2024-05-20T17:56:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.163+0000 7fbaa7d02640 1 -- 172.21.15.6:0/1130480169 wait complete. 2024-05-20T17:56:00.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T17:56:00.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.291+0000 7f58a16b8640 1 Processor -- start 2024-05-20T17:56:00.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.291+0000 7f58a16b8640 1 -- start start 2024-05-20T17:56:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.292+0000 7f58a16b8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f589c0cf850 0x7f589c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.292+0000 7f58a16b8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589c0d1ac0 con 0x7f589c0d10e0 2024-05-20T17:56:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.292+0000 7f58a16b8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589c0d1da0 con 0x7f589c0d14f0 2024-05-20T17:56:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.292+0000 7f58a16b8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f589c0d2080 con 0x7f589c0cf850 2024-05-20T17:56:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.292+0000 7f58927fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f589c0cf850 0x7f589c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.292+0000 7f589affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f589c0d10e0 0x7f589c0cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47226/0 (socket says 172.21.15.6:47226) 2024-05-20T17:56:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.293+0000 7f589affd640 1 -- 172.21.15.6:0/2693337606 learned_addr learned my addr 172.21.15.6:0/2693337606 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:00.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.293+0000 7f58927fc640 1 -- 172.21.15.6:0/2693337606 >> v1:172.21.15.171:6789/0 conn(0x7f589c0d14f0 legacy=0x7f589c0b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:00.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.293+0000 7f58927fc640 1 -- 172.21.15.6:0/2693337606 >> v1:172.21.15.6:6789/0 conn(0x7f589c0d10e0 legacy=0x7f589c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.293+0000 7f58927fc640 1 -- 172.21.15.6:0/2693337606 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c0d2360 con 0x7f589c0cf850 2024-05-20T17:56:00.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.293+0000 7f589a7fc640 1 -- 172.21.15.6:0/2693337606 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566928677 0 0) 0x7f589c0d1ac0 con 0x7f589c0d10e0 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f58927fc640 1 --2- 172.21.15.6:0/2693337606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c0b6200 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f58840097a0 tx=0x7f588402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1014b4234177c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f589a7fc640 1 -- 172.21.15.6:0/2693337606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884037070 con 0x7f589c0cf850 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f589a7fc640 1 -- 172.21.15.6:0/2693337606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884032440 con 0x7f589c0cf850 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f589a7fc640 1 -- 172.21.15.6:0/2693337606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884032810 con 0x7f589c0cf850 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f58a16b8640 1 -- 172.21.15.6:0/2693337606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 msgr2=0x7f589c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f58a16b8640 1 --2- 172.21.15.6:0/2693337606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c0b6200 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f58840097a0 tx=0x7f588402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f58a16b8640 1 -- 172.21.15.6:0/2693337606 shutdown_connections 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f58a16b8640 1 --2- 172.21.15.6:0/2693337606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c0b6200 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f58a16b8640 1 -- 172.21.15.6:0/2693337606 >> 172.21.15.6:0/2693337606 conn(0x7f589c0b44d0 msgr2=0x7f589c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f58a16b8640 1 -- 172.21.15.6:0/2693337606 shutdown_connections 2024-05-20T17:56:00.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.294+0000 7f58a16b8640 1 -- 172.21.15.6:0/2693337606 wait complete. 2024-05-20T17:56:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.296+0000 7f58a16b8640 1 Processor -- start 2024-05-20T17:56:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.296+0000 7f58a16b8640 1 -- start start 2024-05-20T17:56:00.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f58a16b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f58a16b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f589c0d10e0 0x7f589c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f58a16b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f589c0d14f0 0x7f589c0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f58a16b8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f589c0b8440 con 0x7f589c0cf850 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f58a16b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f589c0b82c0 con 0x7f589c0d14f0 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f58a16b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f589c0709f0 con 0x7f589c0d10e0 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c1561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37228/0 (socket says 172.21.15.6:37228) 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 -- 172.21.15.6:0/2732441452 learned_addr learned my addr 172.21.15.6:0/2732441452 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f58927fc640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f589c0d10e0 0x7f589c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589b7fe640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f589c0d14f0 0x7f589c0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 -- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f589c0d10e0 msgr2=0x7f589c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f589c0d10e0 0x7f589c0aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 -- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f589c0d14f0 msgr2=0x7f589c0af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f589c0d14f0 0x7f589c0af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 -- 172.21.15.6:0/2732441452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c06dfc0 con 0x7f589c0cf850 2024-05-20T17:56:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.298+0000 7f589affd640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c1561b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c460 tx=0x7f588c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.299+0000 7f5893fff640 1 -- 172.21.15.6:0/2732441452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c018070 con 0x7f589c0cf850 2024-05-20T17:56:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.299+0000 7f5893fff640 1 -- 172.21.15.6:0/2732441452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c007500 con 0x7f589c0cf850 2024-05-20T17:56:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.299+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589c0b0c90 con 0x7f589c0cf850 2024-05-20T17:56:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.299+0000 7f5893fff640 1 -- 172.21.15.6:0/2732441452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c004a20 con 0x7f589c0cf850 2024-05-20T17:56:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.299+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f589c0b1250 con 0x7f589c0cf850 2024-05-20T17:56:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.300+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589c075b00 con 0x7f589c0cf850 2024-05-20T17:56:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.300+0000 7f5893fff640 1 -- 172.21.15.6:0/2732441452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f588c01b070 con 0x7f589c0cf850 2024-05-20T17:56:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.301+0000 7f5893fff640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f587c06be30 0x7f587c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.301+0000 7f5893fff640 1 -- 172.21.15.6:0/2732441452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f588c08a2a0 con 0x7f589c0cf850 2024-05-20T17:56:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.301+0000 7f58927fc640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f587c06be30 0x7f587c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.301+0000 7f58927fc640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f587c06be30 0x7f587c06e340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5884034000 tx=0x7f588402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:00.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.305+0000 7f5893fff640 1 -- 172.21.15.6:0/2732441452 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f589c06dfc0 con 0x7f589c0cf850 2024-05-20T17:56:00.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.527+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f589c06f850 con 0x7f589c0cf850 2024-05-20T17:56:00.525 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T17:56:00.528+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:56:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.529+0000 7f5893fff640 1 -- 172.21.15.6:0/2732441452 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f588c058a90 con 0x7f589c0cf850 2024-05-20T17:56:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.531+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f587c06be30 msgr2=0x7f587c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.531+0000 7f58a16b8640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f587c06be30 0x7f587c06e340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5884034000 tx=0x7f588402e000 comp rx=0 tx=0).stop 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.531+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 msgr2=0x7f589c1561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.531+0000 7f58a16b8640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c1561b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c460 tx=0x7f588c00c920 comp rx=0 tx=0).stop 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.532+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 shutdown_connections 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.532+0000 7f58a16b8640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f587c06be30 0x7f587c06e340 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.532+0000 7f58a16b8640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f589c0d14f0 0x7f589c0af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.532+0000 7f58a16b8640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f589c0d10e0 0x7f589c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.532+0000 7f58a16b8640 1 --2- 172.21.15.6:0/2732441452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f589c0cf850 0x7f589c1561b0 secure :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c460 tx=0x7f588c00c920 comp rx=0 tx=0).stop 2024-05-20T17:56:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.532+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 >> 172.21.15.6:0/2732441452 conn(0x7f589c0b44d0 msgr2=0x7f589c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:00.531 INFO:tasks.ceph.mds.a.smithi006.stderr: -3552> 2024-05-20T17:55:35.277+0000 7f14beed8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-20T17:56:00.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.532+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 shutdown_connections 2024-05-20T17:56:00.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.532+0000 7f58a16b8640 1 -- 172.21.15.6:0/2732441452 wait complete. 2024-05-20T17:56:00.532 INFO:tasks.ceph.mds.a.smithi006.stderr: -2255> 2024-05-20T17:55:46.231+0000 7f14b8ecc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:56:00.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T17:56:00.588 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:56:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.665+0000 7f36d45b5640 1 Processor -- start 2024-05-20T17:56:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.665+0000 7f36d45b5640 1 -- start start 2024-05-20T17:56:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.666+0000 7f36d45b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.666+0000 7f36d45b5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36cc0d0370 con 0x7f36cc0d14b0 2024-05-20T17:56:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.666+0000 7f36d45b5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36cc0d0650 con 0x7f36cc163a10 2024-05-20T17:56:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.666+0000 7f36d45b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36cc0d3ca0 con 0x7f36cc0b4010 2024-05-20T17:56:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d2b52640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f36cc0d14b0 0x7f36cc0d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47254/0 (socket says 172.21.15.6:47254) 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d2b52640 1 -- 172.21.15.6:0/3372430762 learned_addr learned my addr 172.21.15.6:0/3372430762 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d1b50640 1 --2- 172.21.15.6:0/3372430762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d134f640 1 -- 172.21.15.6:0/3372430762 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494935650 0 0) 0x7f36cc0d0370 con 0x7f36cc0d14b0 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d134f640 1 -- 172.21.15.6:0/3372430762 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36b8003520 con 0x7f36cc0d14b0 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d134f640 1 -- 172.21.15.6:0/3372430762 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991476804 0 0) 0x7f36cc0d0650 con 0x7f36cc163a10 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d134f640 1 -- 172.21.15.6:0/3372430762 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36cc0d0370 con 0x7f36cc163a10 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d1b50640 1 -- 172.21.15.6:0/3372430762 >> v1:172.21.15.171:6789/0 conn(0x7f36cc163a10 legacy=0x7f36cc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d1b50640 1 -- 172.21.15.6:0/3372430762 >> v1:172.21.15.6:6789/0 conn(0x7f36cc0d14b0 legacy=0x7f36cc0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d134f640 1 -- 172.21.15.6:0/3372430762 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2201921001 0 0) 0x7f36b8003520 con 0x7f36cc0d14b0 2024-05-20T17:56:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.667+0000 7f36d1b50640 1 -- 172.21.15.6:0/3372430762 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36cc0d3650 con 0x7f36cc0b4010 2024-05-20T17:56:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.668+0000 7f36d1b50640 1 --2- 172.21.15.6:0/3372430762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc0d4130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f36c80097d0 tx=0x7f36c802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c08a41d267bfe71 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.668+0000 7f36d134f640 1 -- 172.21.15.6:0/3372430762 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8037070 con 0x7f36cc0b4010 2024-05-20T17:56:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.668+0000 7f36d134f640 1 -- 172.21.15.6:0/3372430762 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c802ac30 con 0x7f36cc0b4010 2024-05-20T17:56:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.668+0000 7f36d134f640 1 -- 172.21.15.6:0/3372430762 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c4001670 con 0x7f36cc0b4010 2024-05-20T17:56:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.669+0000 7f36d45b5640 1 -- 172.21.15.6:0/3372430762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 msgr2=0x7f36cc0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.669+0000 7f36d45b5640 1 --2- 172.21.15.6:0/3372430762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc0d4130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f36c80097d0 tx=0x7f36c802a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.669+0000 7f36d45b5640 1 -- 172.21.15.6:0/3372430762 shutdown_connections 2024-05-20T17:56:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.669+0000 7f36d45b5640 1 --2- 172.21.15.6:0/3372430762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc0d4130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.669+0000 7f36d45b5640 1 -- 172.21.15.6:0/3372430762 >> 172.21.15.6:0/3372430762 conn(0x7f36cc06d240 msgr2=0x7f36cc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.669+0000 7f36d45b5640 1 -- 172.21.15.6:0/3372430762 shutdown_connections 2024-05-20T17:56:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.669+0000 7f36d45b5640 1 -- 172.21.15.6:0/3372430762 wait complete. 2024-05-20T17:56:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.671+0000 7f36d45b5640 1 Processor -- start 2024-05-20T17:56:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.671+0000 7f36d45b5640 1 -- start start 2024-05-20T17:56:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d45b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d45b5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36cc0d14b0 0x7f36cc157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d45b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36cc163a10 0x7f36cc0b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d45b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc0b8390 con 0x7f36cc163a10 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d45b5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc0b8210 con 0x7f36cc0d14b0 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d45b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36cc0b8510 con 0x7f36cc0b4010 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d2b52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36cc163a10 0x7f36cc0b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d2b52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36cc163a10 0x7f36cc0b6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37248/0 (socket says 172.21.15.6:37248) 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d2b52640 1 -- 172.21.15.6:0/4102297117 learned_addr learned my addr 172.21.15.6:0/4102297117 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d2351640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.672+0000 7f36d1b50640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36cc0d14b0 0x7f36cc157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d2b52640 1 -- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 msgr2=0x7f36cc153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d2b52640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d2b52640 1 -- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36cc0d14b0 msgr2=0x7f36cc157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d2b52640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36cc0d14b0 0x7f36cc157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d2b52640 1 -- 172.21.15.6:0/4102297117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36cc1578d0 con 0x7f36cc163a10 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d2351640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d1b50640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36cc0d14b0 0x7f36cc157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d2b52640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36cc163a10 0x7f36cc0b6e40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f36c4005880 tx=0x7f36c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36beffd640 1 -- 172.21.15.6:0/4102297117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c4017070 con 0x7f36cc163a10 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36beffd640 1 -- 172.21.15.6:0/4102297117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c4005ce0 con 0x7f36cc163a10 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36cc1565d0 con 0x7f36cc163a10 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36beffd640 1 -- 172.21.15.6:0/4102297117 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c4007310 con 0x7f36cc163a10 2024-05-20T17:56:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.673+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36cc156b90 con 0x7f36cc163a10 2024-05-20T17:56:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.674+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36cc075b00 con 0x7f36cc163a10 2024-05-20T17:56:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.675+0000 7f36beffd640 1 -- 172.21.15.6:0/4102297117 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36c401a070 con 0x7f36cc163a10 2024-05-20T17:56:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.675+0000 7f36beffd640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36b006be30 0x7f36b006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.675+0000 7f36beffd640 1 -- 172.21.15.6:0/4102297117 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6245+0+0 (secure 0 0 0) 0x7f36c408a5b0 con 0x7f36cc163a10 2024-05-20T17:56:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.675+0000 7f36d2351640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36b006be30 0x7f36b006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.676+0000 7f36d2351640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36b006be30 0x7f36b006e340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f36c0001560 tx=0x7f36c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.680+0000 7f36beffd640 1 -- 172.21.15.6:0/4102297117 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f36c4058cb0 con 0x7f36cc163a10 2024-05-20T17:56:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:00.904+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f36cc0d3050 con 0x7f36cc163a10 2024-05-20T17:56:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.530+0000 7f36beffd640 1 -- 172.21.15.6:0/4102297117 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f36c40585b0 con 0x7f36cc163a10 2024-05-20T17:56:01.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36b006be30 msgr2=0x7f36b006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:01.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36b006be30 0x7f36b006e340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f36c0001560 tx=0x7f36c0009040 comp rx=0 tx=0).stop 2024-05-20T17:56:01.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36cc163a10 msgr2=0x7f36cc0b6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:01.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36cc163a10 0x7f36cc0b6e40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f36c4005880 tx=0x7f36c400c8e0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 shutdown_connections 2024-05-20T17:56:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36b006be30 0x7f36b006e340 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36cc163a10 0x7f36cc0b6e40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36cc0d14b0 0x7f36cc157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 --2- 172.21.15.6:0/4102297117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36cc0b4010 0x7f36cc153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 >> 172.21.15.6:0/4102297117 conn(0x7f36cc06d240 msgr2=0x7f36cc0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 shutdown_connections 2024-05-20T17:56:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.533+0000 7f36d45b5640 1 -- 172.21.15.6:0/4102297117 wait complete. 2024-05-20T17:56:01.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T17:56:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.673+0000 7fc3dc92f640 1 Processor -- start 2024-05-20T17:56:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.673+0000 7fc3dc92f640 1 -- start start 2024-05-20T17:56:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3dc92f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc3d80d45f0 0x7fc3d806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3dc92f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3d808bd20 0x7fc3d808c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3dc92f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d808c670 con 0x7fc3d80b3860 2024-05-20T17:56:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3dc92f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d80d0450 con 0x7fc3d808bd20 2024-05-20T17:56:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3dc92f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d80d3b10 con 0x7fc3d80d45f0 2024-05-20T17:56:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3d6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3d808bd20 0x7fc3d808c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3d6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3d808bd20 0x7fc3d808c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37264/0 (socket says 172.21.15.6:37264) 2024-05-20T17:56:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3d6d9d640 1 -- 172.21.15.6:0/3475251228 learned_addr learned my addr 172.21.15.6:0/3475251228 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3d5d9b640 1 --2- 172.21.15.6:0/3475251228 >> v2:172.21.15.171:3300/0 conn(0x7fc3d80d45f0 0x7fc3d806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3d6d9d640 1 -- 172.21.15.6:0/3475251228 >> v2:172.21.15.171:3300/0 conn(0x7fc3d80d45f0 msgr2=0x7fc3d806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3d6d9d640 1 --2- 172.21.15.6:0/3475251228 >> v2:172.21.15.171:3300/0 conn(0x7fc3d80d45f0 0x7fc3d806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3d6d9d640 1 -- 172.21.15.6:0/3475251228 >> v1:172.21.15.171:6789/0 conn(0x7fc3d80b3860 legacy=0x7fc3d815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.675+0000 7fc3d6d9d640 1 -- 172.21.15.6:0/3475251228 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d80d3df0 con 0x7fc3d808bd20 2024-05-20T17:56:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.676+0000 7fc3d6d9d640 1 --2- 172.21.15.6:0/3475251228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d808bd20 0x7fc3d808c130 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80d14c0 tx=0x7fc3d002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a726846d86e908cc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.676+0000 7fc3d559a640 1 -- 172.21.15.6:0/3475251228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0036070 con 0x7fc3d808bd20 2024-05-20T17:56:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.676+0000 7fc3d559a640 1 -- 172.21.15.6:0/3475251228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d0031600 con 0x7fc3d808bd20 2024-05-20T17:56:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.676+0000 7fc3d559a640 1 -- 172.21.15.6:0/3475251228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00319d0 con 0x7fc3d808bd20 2024-05-20T17:56:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.677+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3475251228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d808bd20 msgr2=0x7fc3d808c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.677+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3475251228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d808bd20 0x7fc3d808c130 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80d14c0 tx=0x7fc3d002a5d0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.677+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3475251228 shutdown_connections 2024-05-20T17:56:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.677+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3475251228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d808bd20 0x7fc3d808c130 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.677+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3475251228 >> v2:172.21.15.171:3300/0 conn(0x7fc3d80d45f0 0x7fc3d806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.677+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3475251228 >> 172.21.15.6:0/3475251228 conn(0x7fc3d80b6d10 msgr2=0x7fc3d806d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.677+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3475251228 shutdown_connections 2024-05-20T17:56:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.677+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3475251228 wait complete. 2024-05-20T17:56:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.679+0000 7fc3dc92f640 1 Processor -- start 2024-05-20T17:56:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.679+0000 7fc3dc92f640 1 -- start start 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.680+0000 7fc3dc92f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d808bd20 0x7fc3d81e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.680+0000 7fc3dc92f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d80b3860 0x7fc3d81571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.680+0000 7fc3dc92f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d80d45f0 0x7fc3d81576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.680+0000 7fc3dc92f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d80b81b0 con 0x7fc3d80d45f0 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.680+0000 7fc3dc92f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d80d0730 con 0x7fc3d80b3860 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.680+0000 7fc3dc92f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d80b8330 con 0x7fc3d808bd20 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.680+0000 7fc3d6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d80d45f0 0x7fc3d81576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d80d45f0 0x7fc3d81576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37268/0 (socket says 172.21.15.6:37268) 2024-05-20T17:56:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d6d9d640 1 -- 172.21.15.6:0/3568262655 learned_addr learned my addr 172.21.15.6:0/3568262655 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d659c640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d808bd20 0x7fc3d81e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d5d9b640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d80b3860 0x7fc3d81571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d6d9d640 1 -- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d808bd20 msgr2=0x7fc3d81e8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d6d9d640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d808bd20 0x7fc3d81e8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d6d9d640 1 -- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d80b3860 msgr2=0x7fc3d81571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d6d9d640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d80b3860 0x7fc3d81571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d6d9d640 1 -- 172.21.15.6:0/3568262655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d8155970 con 0x7fc3d80d45f0 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d5d9b640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d80b3860 0x7fc3d81571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d659c640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d808bd20 0x7fc3d81e8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3d6d9d640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d80d45f0 0x7fc3d81576e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009f40 tx=0x7fc3d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3c6ffd640 1 -- 172.21.15.6:0/3568262655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0041020 con 0x7fc3d80d45f0 2024-05-20T17:56:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3c6ffd640 1 -- 172.21.15.6:0/3568262655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d00077a0 con 0x7fc3d80d45f0 2024-05-20T17:56:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d8155c10 con 0x7fc3d80d45f0 2024-05-20T17:56:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3c6ffd640 1 -- 172.21.15.6:0/3568262655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0036040 con 0x7fc3d80d45f0 2024-05-20T17:56:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.681+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d8153060 con 0x7fc3d80d45f0 2024-05-20T17:56:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.683+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d80690b0 con 0x7fc3d80d45f0 2024-05-20T17:56:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.683+0000 7fc3c6ffd640 1 -- 172.21.15.6:0/3568262655 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3d0044020 con 0x7fc3d80d45f0 2024-05-20T17:56:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.683+0000 7fc3c6ffd640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3b806be30 0x7fc3b806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.684+0000 7fc3c6ffd640 1 -- 172.21.15.6:0/3568262655 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6245+0+0 (secure 0 0 0) 0x7fc3d00abd70 con 0x7fc3d80d45f0 2024-05-20T17:56:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.684+0000 7fc3d659c640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3b806be30 0x7fc3b806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.684+0000 7fc3d659c640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3b806be30 0x7fc3b806e340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80d15d0 tx=0x7fc3c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:01.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.688+0000 7fc3c6ffd640 1 -- 172.21.15.6:0/3568262655 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc3d004b030 con 0x7fc3d80d45f0 2024-05-20T17:56:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:01.873+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc3d80b93b0 con 0x7fc3d80d45f0 2024-05-20T17:56:02.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.706+0000 7fc3c6ffd640 1 -- 172.21.15.6:0/3568262655 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) ==== 181+0+0 (secure 0 0 0) 0x7fc3d808c670 con 0x7fc3d80d45f0 2024-05-20T17:56:02.704 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.709+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3b806be30 msgr2=0x7fc3b806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3b806be30 0x7fc3b806e340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80d15d0 tx=0x7fc3c8008040 comp rx=0 tx=0).stop 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d80d45f0 msgr2=0x7fc3d81576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d80d45f0 0x7fc3d81576e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009f40 tx=0x7fc3d0004a40 comp rx=0 tx=0).stop 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 shutdown_connections 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3b806be30 0x7fc3b806e340 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3d80d45f0 0x7fc3d81576e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3d80b3860 0x7fc3d81571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 --2- 172.21.15.6:0/3568262655 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3d808bd20 0x7fc3d81e8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.710+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 >> 172.21.15.6:0/3568262655 conn(0x7fc3d80b6d10 msgr2=0x7fc3d80b98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.711+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 shutdown_connections 2024-05-20T17:56:02.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.711+0000 7fc3dc92f640 1 -- 172.21.15.6:0/3568262655 wait complete. 2024-05-20T17:56:02.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T17:56:02.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.851+0000 7ff172daa640 1 Processor -- start 2024-05-20T17:56:02.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.851+0000 7ff172daa640 1 -- start start 2024-05-20T17:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff172daa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff16c0b1df0 0x7ff16c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff172daa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 0x7ff16c0b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff172daa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff16c09c350 con 0x7ff16c0b3280 2024-05-20T17:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff172daa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff16c09bc20 con 0x7ff16c0b1df0 2024-05-20T17:56:02.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff172daa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff16c0cedb0 con 0x7ff16c0d14a0 2024-05-20T17:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff170b46640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff16c0b1df0 0x7ff16c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff170b46640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff16c0b1df0 0x7ff16c0d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37276/0 (socket says 172.21.15.6:37276) 2024-05-20T17:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff170b46640 1 -- 172.21.15.6:0/3226627554 learned_addr learned my addr 172.21.15.6:0/3226627554 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff16bfff640 1 --2- 172.21.15.6:0/3226627554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 0x7ff16c0b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff170b46640 1 -- 172.21.15.6:0/3226627554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 msgr2=0x7ff16c0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff170b46640 1 --2- 172.21.15.6:0/3226627554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 0x7ff16c0b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff170b46640 1 -- 172.21.15.6:0/3226627554 >> v1:172.21.15.171:6789/0 conn(0x7ff16c0b3280 legacy=0x7ff16c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:02.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.853+0000 7ff170b46640 1 -- 172.21.15.6:0/3226627554 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16c0d1a50 con 0x7ff16c0b1df0 2024-05-20T17:56:02.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.854+0000 7ff170b46640 1 --2- 172.21.15.6:0/3226627554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c0d0f60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009850 tx=0x7ff15c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b9a6b08ffa4266 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:02.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.854+0000 7ff16b7fe640 1 -- 172.21.15.6:0/3226627554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c004030 con 0x7ff16c0b1df0 2024-05-20T17:56:02.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.854+0000 7ff16b7fe640 1 -- 172.21.15.6:0/3226627554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15c0041d0 con 0x7ff16c0b1df0 2024-05-20T17:56:02.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.854+0000 7ff16b7fe640 1 -- 172.21.15.6:0/3226627554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c003610 con 0x7ff16c0b1df0 2024-05-20T17:56:02.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.855+0000 7ff172daa640 1 -- 172.21.15.6:0/3226627554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 msgr2=0x7ff16c0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:02.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.855+0000 7ff172daa640 1 --2- 172.21.15.6:0/3226627554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c0d0f60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009850 tx=0x7ff15c02a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.855+0000 7ff172daa640 1 -- 172.21.15.6:0/3226627554 shutdown_connections 2024-05-20T17:56:02.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.855+0000 7ff172daa640 1 --2- 172.21.15.6:0/3226627554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 0x7ff16c0b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.855+0000 7ff172daa640 1 --2- 172.21.15.6:0/3226627554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c0d0f60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.855+0000 7ff172daa640 1 -- 172.21.15.6:0/3226627554 >> 172.21.15.6:0/3226627554 conn(0x7ff16c0cf450 msgr2=0x7ff16c0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:02.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.855+0000 7ff172daa640 1 -- 172.21.15.6:0/3226627554 shutdown_connections 2024-05-20T17:56:02.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.855+0000 7ff172daa640 1 -- 172.21.15.6:0/3226627554 wait complete. 2024-05-20T17:56:02.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.857+0000 7ff172daa640 1 Processor -- start 2024-05-20T17:56:02.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.857+0000 7ff172daa640 1 -- start start 2024-05-20T17:56:02.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.858+0000 7ff172daa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c09ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:02.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.858+0000 7ff172daa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff16c0b3280 0x7ff16c1f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:02.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.858+0000 7ff172daa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 0x7ff16c1f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.858+0000 7ff172daa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c0ce820 con 0x7ff16c0b1df0 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.858+0000 7ff172daa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c0b3da0 con 0x7ff16c0b3280 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.858+0000 7ff172daa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff16c0d0650 con 0x7ff16c0d14a0 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.858+0000 7ff170b46640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c09ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.858+0000 7ff170b46640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c09ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37280/0 (socket says 172.21.15.6:37280) 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff170b46640 1 -- 172.21.15.6:0/69431013 learned_addr learned my addr 172.21.15.6:0/69431013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff170b46640 1 -- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 msgr2=0x7ff16c1f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff170b46640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 0x7ff16c1f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff170b46640 1 -- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff16c0b3280 msgr2=0x7ff16c1f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff170b46640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff16c0b3280 0x7ff16c1f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff170b46640 1 -- 172.21.15.6:0/69431013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16c1f48e0 con 0x7ff16c0b1df0 2024-05-20T17:56:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff170b46640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c09ff60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff15c02a1e0 tx=0x7ff15c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff1697fa640 1 -- 172.21.15.6:0/69431013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c041020 con 0x7ff16c0b1df0 2024-05-20T17:56:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff1697fa640 1 -- 172.21.15.6:0/69431013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15c003c50 con 0x7ff16c0b1df0 2024-05-20T17:56:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16c0c6750 con 0x7ff16c0b1df0 2024-05-20T17:56:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff1697fa640 1 -- 172.21.15.6:0/69431013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c004030 con 0x7ff16c0b1df0 2024-05-20T17:56:02.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.859+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16c09f3c0 con 0x7ff16c0b1df0 2024-05-20T17:56:02.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.860+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff16c09f680 con 0x7ff16c0b1df0 2024-05-20T17:56:02.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.861+0000 7ff1697fa640 1 -- 172.21.15.6:0/69431013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff15c044020 con 0x7ff16c0b1df0 2024-05-20T17:56:02.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.861+0000 7ff1697fa640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff15806be30 0x7ff15806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:02.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.861+0000 7ff1697fa640 1 -- 172.21.15.6:0/69431013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5807+0+0 (secure 0 0 0) 0x7ff15c0aba70 con 0x7ff16c0b1df0 2024-05-20T17:56:02.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.862+0000 7ff16bfff640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff15806be30 0x7ff15806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:02.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.862+0000 7ff16bfff640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff15806be30 0x7ff15806e340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff160006a90 tx=0x7ff160006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:02.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:02.866+0000 7ff1697fa640 1 -- 172.21.15.6:0/69431013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff15c04b030 con 0x7ff16c0b1df0 2024-05-20T17:56:03.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.051+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff16c0690b0 con 0x7ff16c0b1df0 2024-05-20T17:56:03.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.711+0000 7ff1697fa640 1 -- 172.21.15.6:0/69431013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) ==== 169+0+0 (secure 0 0 0) 0x7ff15c07a320 con 0x7ff16c0b1df0 2024-05-20T17:56:03.709 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.715+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff15806be30 msgr2=0x7ff15806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.715+0000 7ff172daa640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff15806be30 0x7ff15806e340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff160006a90 tx=0x7ff160006a20 comp rx=0 tx=0).stop 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.715+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 msgr2=0x7ff16c09ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.715+0000 7ff172daa640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c09ff60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff15c02a1e0 tx=0x7ff15c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.716+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 shutdown_connections 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.716+0000 7ff172daa640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff15806be30 0x7ff15806e340 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.716+0000 7ff172daa640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff16c0d14a0 0x7ff16c1f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.716+0000 7ff172daa640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff16c0b3280 0x7ff16c1f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.716+0000 7ff172daa640 1 --2- 172.21.15.6:0/69431013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff16c0b1df0 0x7ff16c09ff60 secure :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff15c02a1e0 tx=0x7ff15c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.716+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 >> 172.21.15.6:0/69431013 conn(0x7ff16c0cf450 msgr2=0x7ff16c0b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.718+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 shutdown_connections 2024-05-20T17:56:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.718+0000 7ff172daa640 1 -- 172.21.15.6:0/69431013 wait complete. 2024-05-20T17:56:03.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T17:56:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.855+0000 7f6f19d5e640 1 Processor -- start 2024-05-20T17:56:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.855+0000 7f6f19d5e640 1 -- start start 2024-05-20T17:56:03.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.856+0000 7f6f19d5e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f140b1e10 0x7f6f1415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:03.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.856+0000 7f6f19d5e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f140cd580 con 0x7f6f1415d530 2024-05-20T17:56:03.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.856+0000 7f6f19d5e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f140cd860 con 0x7f6f14070850 2024-05-20T17:56:03.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.856+0000 7f6f19d5e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140ce190 con 0x7f6f140b1e10 2024-05-20T17:56:03.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.856+0000 7f6f137fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6f1415d530 0x7f6f140b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47270/0 (socket says 172.21.15.6:47270) 2024-05-20T17:56:03.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.856+0000 7f6f137fe640 1 -- 172.21.15.6:0/634314324 learned_addr learned my addr 172.21.15.6:0/634314324 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416628676 0 0) 0x7f6f140cd580 con 0x7f6f1415d530 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6efc003520 con 0x7f6f1415d530 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f12ffd640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f140b1e10 0x7f6f1415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4228784623 0 0) 0x7f6efc003520 con 0x7f6f1415d530 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f140b1e10 msgr2=0x7f6f1415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f140b1e10 0x7f6f1415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 >> v1:172.21.15.171:6789/0 conn(0x7f6f14070850 legacy=0x7f6f14070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140cdb40 con 0x7f6f1415d530 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f6f04001670 con 0x7f6f1415d530 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 >> v1:172.21.15.6:6789/0 conn(0x7f6f1415d530 legacy=0x7f6f140b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6efc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6efc004800 0x7f6efc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f140b1e10 0x7f6efc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140ce190 con 0x7f6efc0039e0 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc00baf0 con 0x7f6efc004800 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6efc00bcf0 con 0x7f6f140b1e10 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f137fe640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6efc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f12ffd640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6efc004800 0x7f6efc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.857+0000 7f6f13fff640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f140b1e10 0x7f6efc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f137fe640 1 -- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f140b1e10 msgr2=0x7f6efc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f137fe640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f140b1e10 0x7f6efc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f137fe640 1 -- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6efc004800 msgr2=0x7f6efc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f137fe640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6efc004800 0x7f6efc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f137fe640 1 -- 172.21.15.6:0/634314324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc003520 con 0x7f6efc0039e0 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f137fe640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6efc003e50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6f140d29a0 tx=0x7f6efc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44aa4d9a7ef1cb31 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04007d10 con 0x7f6efc0039e0 2024-05-20T17:56:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f04005ad0 con 0x7f6efc0039e0 2024-05-20T17:56:03.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.858+0000 7f6f127fc640 1 -- 172.21.15.6:0/634314324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04007070 con 0x7f6efc0039e0 2024-05-20T17:56:03.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.859+0000 7f6f19d5e640 1 -- 172.21.15.6:0/634314324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 msgr2=0x7f6efc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:03.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.859+0000 7f6f19d5e640 1 --2- 172.21.15.6:0/634314324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6efc003e50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6f140d29a0 tx=0x7f6efc005830 comp rx=0 tx=0).stop 2024-05-20T17:56:03.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.859+0000 7f6f13fff640 1 -- 172.21.15.6:0/634314324 reap_dead start 2024-05-20T17:56:03.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.859+0000 7f6f19d5e640 1 -- 172.21.15.6:0/634314324 shutdown_connections 2024-05-20T17:56:03.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.859+0000 7f6f19d5e640 1 -- 172.21.15.6:0/634314324 >> 172.21.15.6:0/634314324 conn(0x7f6f140d29d0 msgr2=0x7f6f140d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:03.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.859+0000 7f6f19d5e640 1 -- 172.21.15.6:0/634314324 shutdown_connections 2024-05-20T17:56:03.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.859+0000 7f6f19d5e640 1 -- 172.21.15.6:0/634314324 wait complete. 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.861+0000 7f6f19d5e640 1 Processor -- start 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.861+0000 7f6f19d5e640 1 -- start start 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.862+0000 7f6f19d5e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6f141f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.862+0000 7f6f19d5e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f140cc340 0x7f6f14158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f19d5e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f14159640 0x7f6f140c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f19d5e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f14071370 con 0x7f6efc0039e0 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f19d5e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140cd230 con 0x7f6f140cc340 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f19d5e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140714f0 con 0x7f6f14159640 2024-05-20T17:56:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6f141f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6f141f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37292/0 (socket says 172.21.15.6:37292) 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 -- 172.21.15.6:0/866164722 learned_addr learned my addr 172.21.15.6:0/866164722 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f13fff640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f14159640 0x7f6f140c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f12ffd640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f140cc340 0x7f6f14158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 -- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f14159640 msgr2=0x7f6f140c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f14159640 0x7f6f140c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 -- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f140cc340 msgr2=0x7f6f14158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f140cc340 0x7f6f14158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 -- 172.21.15.6:0/866164722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140cc870 con 0x7f6efc0039e0 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f13fff640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f14159640 0x7f6f140c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f12ffd640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f140cc340 0x7f6f14158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f137fe640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6f141f3000 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400c300 tx=0x7f6f140cd750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6efbfff640 1 -- 172.21.15.6:0/866164722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04040020 con 0x7f6efc0039e0 2024-05-20T17:56:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6efbfff640 1 -- 172.21.15.6:0/866164722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f04001430 con 0x7f6efc0039e0 2024-05-20T17:56:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6efbfff640 1 -- 172.21.15.6:0/866164722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04037040 con 0x7f6efc0039e0 2024-05-20T17:56:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f140c65a0 con 0x7f6efc0039e0 2024-05-20T17:56:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.863+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f140c6b60 con 0x7f6efc0039e0 2024-05-20T17:56:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.865+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f14075b00 con 0x7f6efc0039e0 2024-05-20T17:56:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.865+0000 7f6efbfff640 1 -- 172.21.15.6:0/866164722 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f04043020 con 0x7f6efc0039e0 2024-05-20T17:56:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.865+0000 7f6efbfff640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f0006be50 0x7f6f0006e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:03.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.866+0000 7f6efbfff640 1 -- 172.21.15.6:0/866164722 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f6f040aa240 con 0x7f6efc0039e0 2024-05-20T17:56:03.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.866+0000 7f6f12ffd640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f0006be50 0x7f6f0006e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:03.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.866+0000 7f6f12ffd640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f0006be50 0x7f6f0006e360 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6f140b8180 tx=0x7f6f08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:03.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:03.870+0000 7f6efbfff640 1 -- 172.21.15.6:0/866164722 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6f04005aa0 con 0x7f6efc0039e0 2024-05-20T17:56:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.060+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f6f14070eb0 con 0x7f6efc0039e0 2024-05-20T17:56:04.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.064+0000 7f6efbfff640 1 -- 172.21.15.6:0/866164722 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f6f04078cc0 con 0x7f6efc0039e0 2024-05-20T17:56:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f0006be50 msgr2=0x7f6f0006e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f0006be50 0x7f6f0006e360 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6f140b8180 tx=0x7f6f08008040 comp rx=0 tx=0).stop 2024-05-20T17:56:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 msgr2=0x7f6f141f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6f141f3000 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400c300 tx=0x7f6f140cd750 comp rx=0 tx=0).stop 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 shutdown_connections 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6f0006be50 0x7f6f0006e360 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f14159640 0x7f6f140c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f140cc340 0x7f6f14158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 --2- 172.21.15.6:0/866164722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0039e0 0x7f6f141f3000 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 >> 172.21.15.6:0/866164722 conn(0x7f6f140d29d0 msgr2=0x7f6f140b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 shutdown_connections 2024-05-20T17:56:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.066+0000 7f6f19d5e640 1 -- 172.21.15.6:0/866164722 wait complete. 2024-05-20T17:56:04.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2024-05-20T17:56:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.192+0000 7f7d5423d640 1 Processor -- start 2024-05-20T17:56:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.193+0000 7f7d5423d640 1 -- start start 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d5423d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c162820 0x7f7d4c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d5423d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7d4c0b3e80 0x7f7d4c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d5423d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d4c06dd20 con 0x7f7d4c06d910 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d5423d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4c0d0630 con 0x7f7d4c0b3e80 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d5423d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4c0d39c0 con 0x7f7d4c162820 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d517d8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7d4c0b3e80 0x7f7d4c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d51fd9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c162820 0x7f7d4c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d517d8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7d4c0b3e80 0x7f7d4c06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:42436/0 (socket says 172.21.15.6:42436) 2024-05-20T17:56:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d51fd9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c162820 0x7f7d4c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:33944/0 (socket says 172.21.15.6:33944) 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d527da640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7d4c06d910 0x7f7d4c0d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:58878/0 (socket says 172.21.15.6:58878) 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.194+0000 7f7d51fd9640 1 -- 172.21.15.6:0/1933639635 learned_addr learned my addr 172.21.15.6:0/1933639635 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.195+0000 7f7d517d8640 1 -- 172.21.15.6:0/1933639635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c162820 msgr2=0x7f7d4c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.195+0000 7f7d517d8640 1 --2- 172.21.15.6:0/1933639635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c162820 0x7f7d4c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.195+0000 7f7d517d8640 1 -- 172.21.15.6:0/1933639635 >> v1:172.21.15.171:6789/0 conn(0x7f7d4c06d910 legacy=0x7f7d4c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.195+0000 7f7d50fd7640 1 -- 172.21.15.6:0/1933639635 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490133007 0 0) 0x7f7d44001490 con 0x7f7d4c06d910 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.195+0000 7f7d517d8640 1 -- 172.21.15.6:0/1933639635 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c0d3ca0 con 0x7f7d4c0b3e80 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.195+0000 7f7d51fd9640 1 --2- 172.21.15.6:0/1933639635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c162820 0x7f7d4c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.196+0000 7f7d517d8640 1 --2- 172.21.15.6:0/1933639635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c0b3e80 0x7f7d4c06d3d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d400097a0 tx=0x7f7d4002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4ae682bf9bc6dd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.196+0000 7f7d50fd7640 1 -- 172.21.15.6:0/1933639635 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40037070 con 0x7f7d4c0b3e80 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.196+0000 7f7d50fd7640 1 -- 172.21.15.6:0/1933639635 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d40032440 con 0x7f7d4c0b3e80 2024-05-20T17:56:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.196+0000 7f7d50fd7640 1 -- 172.21.15.6:0/1933639635 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40032810 con 0x7f7d4c0b3e80 2024-05-20T17:56:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.197+0000 7f7d5423d640 1 -- 172.21.15.6:0/1933639635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c0b3e80 msgr2=0x7f7d4c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.197+0000 7f7d5423d640 1 --2- 172.21.15.6:0/1933639635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c0b3e80 0x7f7d4c06d3d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d400097a0 tx=0x7f7d4002a180 comp rx=0 tx=0).stop 2024-05-20T17:56:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.197+0000 7f7d5423d640 1 -- 172.21.15.6:0/1933639635 shutdown_connections 2024-05-20T17:56:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.197+0000 7f7d5423d640 1 --2- 172.21.15.6:0/1933639635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c0b3e80 0x7f7d4c06d3d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.197+0000 7f7d5423d640 1 --2- 172.21.15.6:0/1933639635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c162820 0x7f7d4c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.197+0000 7f7d5423d640 1 -- 172.21.15.6:0/1933639635 >> 172.21.15.6:0/1933639635 conn(0x7f7d4c0d4bd0 msgr2=0x7f7d4c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.197+0000 7f7d5423d640 1 -- 172.21.15.6:0/1933639635 shutdown_connections 2024-05-20T17:56:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.197+0000 7f7d5423d640 1 -- 172.21.15.6:0/1933639635 wait complete. 2024-05-20T17:56:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.198+0000 7f7d5423d640 1 Processor -- start 2024-05-20T17:56:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.199+0000 7f7d5423d640 1 -- start start 2024-05-20T17:56:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d5423d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c06d910 0x7f7d4c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d5423d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c0b3e80 0x7f7d4c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d5423d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c162820 0x7f7d4c0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d5423d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c0d0300 con 0x7f7d4c162820 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d5423d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c0d4260 con 0x7f7d4c06d910 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d5423d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4c0b91a0 con 0x7f7d4c0b3e80 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d527da640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c162820 0x7f7d4c0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d527da640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c162820 0x7f7d4c0cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37304/0 (socket says 172.21.15.6:37304) 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d527da640 1 -- 172.21.15.6:0/3940174952 learned_addr learned my addr 172.21.15.6:0/3940174952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d517d8640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c0b3e80 0x7f7d4c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d51fd9640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c06d910 0x7f7d4c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d527da640 1 -- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c0b3e80 msgr2=0x7f7d4c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d527da640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c0b3e80 0x7f7d4c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d527da640 1 -- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c06d910 msgr2=0x7f7d4c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d527da640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c06d910 0x7f7d4c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.200+0000 7f7d527da640 1 -- 172.21.15.6:0/3940174952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c0ca530 con 0x7f7d4c162820 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.201+0000 7f7d527da640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c162820 0x7f7d4c0cd530 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c730 tx=0x7f7d4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.201+0000 7f7d4a7fc640 1 -- 172.21.15.6:0/3940174952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44018070 con 0x7f7d4c162820 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.201+0000 7f7d4a7fc640 1 -- 172.21.15.6:0/3940174952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4400ce40 con 0x7f7d4c162820 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.201+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4c0cbcf0 con 0x7f7d4c162820 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.201+0000 7f7d4a7fc640 1 -- 172.21.15.6:0/3940174952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400a860 con 0x7f7d4c162820 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.201+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4c0cc2b0 con 0x7f7d4c162820 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.202+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c075b00 con 0x7f7d4c162820 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.203+0000 7f7d4a7fc640 1 -- 172.21.15.6:0/3940174952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d4401b070 con 0x7f7d4c162820 2024-05-20T17:56:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.203+0000 7f7d4a7fc640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d3806be60 0x7f7d3806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.204+0000 7f7d4a7fc640 1 -- 172.21.15.6:0/3940174952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f7d4408a2c0 con 0x7f7d4c162820 2024-05-20T17:56:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.204+0000 7f7d51fd9640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d3806be60 0x7f7d3806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.204+0000 7f7d51fd9640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d3806be60 0x7f7d3806e370 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006ca0 tx=0x7f7d3c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:04.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.208+0000 7f7d4a7fc640 1 -- 172.21.15.6:0/3940174952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7d4c06dd20 con 0x7f7d4c162820 2024-05-20T17:56:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.464+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) -- 0x7f7d4c160a90 con 0x7f7d4c162820 2024-05-20T17:56:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.713+0000 7f7d4a7fc640 1 -- 172.21.15.6:0/3940174952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v177) ==== 162+0+0 (secure 0 0 0) 0x7f7d44058700 con 0x7f7d4c162820 2024-05-20T17:56:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d3806be60 msgr2=0x7f7d3806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d3806be60 0x7f7d3806e370 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006ca0 tx=0x7f7d3c009240 comp rx=0 tx=0).stop 2024-05-20T17:56:04.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c162820 msgr2=0x7f7d4c0cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c162820 0x7f7d4c0cd530 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c730 tx=0x7f7d4400cbf0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 shutdown_connections 2024-05-20T17:56:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d3806be60 0x7f7d3806e370 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d4c162820 0x7f7d4c0cd530 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4c0b3e80 0x7f7d4c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 --2- 172.21.15.6:0/3940174952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d4c06d910 0x7f7d4c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 >> 172.21.15.6:0/3940174952 conn(0x7f7d4c0d4bd0 msgr2=0x7f7d4c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 shutdown_connections 2024-05-20T17:56:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.715+0000 7f7d5423d640 1 -- 172.21.15.6:0/3940174952 wait complete. 2024-05-20T17:56:04.725 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the ... skipped 'Require FUSE client to inject client release failure' 2024-05-20T17:56:04.725 INFO:tasks.cephfs_test_runner:Starting test: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T17:56:04.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:04.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.844+0000 7f8228102640 1 Processor -- start 2024-05-20T17:56:04.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.844+0000 7f8228102640 1 -- start start 2024-05-20T17:56:04.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f8228102640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8220074bc0 0x7f82200d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f8228102640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f82200d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f8228102640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f822006b520 con 0x7f82200b25d0 2024-05-20T17:56:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f8228102640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f82200b2b20 con 0x7f8220074bc0 2024-05-20T17:56:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f8228102640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f822006b7c0 con 0x7f822015d870 2024-05-20T17:56:04.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f8225e9e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8220074bc0 0x7f82200d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f822669f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f82200d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f822569d640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f82200b25d0 0x7f822015d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:58886/0 (socket says 172.21.15.6:58886) 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f822569d640 1 -- 172.21.15.6:0/3136966973 learned_addr learned my addr 172.21.15.6:0/3136966973 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f8224e9c640 1 -- 172.21.15.6:0/3136966973 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190279869 0 0) 0x7f822006b520 con 0x7f82200b25d0 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.846+0000 7f8224e9c640 1 -- 172.21.15.6:0/3136966973 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8208003520 con 0x7f82200b25d0 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.847+0000 7f822669f640 1 -- 172.21.15.6:0/3136966973 >> v2:172.21.15.171:3300/0 conn(0x7f8220074bc0 msgr2=0x7f82200d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.847+0000 7f822669f640 1 --2- 172.21.15.6:0/3136966973 >> v2:172.21.15.171:3300/0 conn(0x7f8220074bc0 0x7f82200d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.847+0000 7f822669f640 1 -- 172.21.15.6:0/3136966973 >> v1:172.21.15.171:6789/0 conn(0x7f82200b25d0 legacy=0x7f822015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.847+0000 7f822669f640 1 -- 172.21.15.6:0/3136966973 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822006baa0 con 0x7f822015d870 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.847+0000 7f8225e9e640 1 --2- 172.21.15.6:0/3136966973 >> v2:172.21.15.171:3300/0 conn(0x7f8220074bc0 0x7f82200d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.847+0000 7f822669f640 1 --2- 172.21.15.6:0/3136966973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f82200d1570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8210009d90 tx=0x7f821002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce8a5fe6831965f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8224e9c640 1 -- 172.21.15.6:0/3136966973 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210007740 con 0x7f822015d870 2024-05-20T17:56:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8224e9c640 1 -- 172.21.15.6:0/3136966973 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82100078e0 con 0x7f822015d870 2024-05-20T17:56:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8224e9c640 1 -- 172.21.15.6:0/3136966973 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210007cb0 con 0x7f822015d870 2024-05-20T17:56:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8228102640 1 -- 172.21.15.6:0/3136966973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 msgr2=0x7f82200d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8228102640 1 --2- 172.21.15.6:0/3136966973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f82200d1570 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8210009d90 tx=0x7f821002a660 comp rx=0 tx=0).stop 2024-05-20T17:56:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8228102640 1 -- 172.21.15.6:0/3136966973 shutdown_connections 2024-05-20T17:56:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8228102640 1 --2- 172.21.15.6:0/3136966973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f82200d1570 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8228102640 1 --2- 172.21.15.6:0/3136966973 >> v2:172.21.15.171:3300/0 conn(0x7f8220074bc0 0x7f82200d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8228102640 1 -- 172.21.15.6:0/3136966973 >> 172.21.15.6:0/3136966973 conn(0x7f8220072ed0 msgr2=0x7f82200b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8228102640 1 -- 172.21.15.6:0/3136966973 shutdown_connections 2024-05-20T17:56:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.848+0000 7f8228102640 1 -- 172.21.15.6:0/3136966973 wait complete. 2024-05-20T17:56:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.850+0000 7f8228102640 1 Processor -- start 2024-05-20T17:56:04.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.850+0000 7f8228102640 1 -- start start 2024-05-20T17:56:04.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.851+0000 7f8228102640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200b25d0 0x7f822009b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.851+0000 7f8228102640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f8220154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.851+0000 7f8228102640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82201567c0 0x7f822009e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.851+0000 7f8228102640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f82200b0d50 con 0x7f82200b25d0 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.851+0000 7f8228102640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82200b0bd0 con 0x7f82201567c0 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.851+0000 7f8228102640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f82200b0ed0 con 0x7f822015d870 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200b25d0 0x7f822009b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200b25d0 0x7f822009b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37314/0 (socket says 172.21.15.6:37314) 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 -- 172.21.15.6:0/2323635582 learned_addr learned my addr 172.21.15.6:0/2323635582 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f822569d640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f8220154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f822669f640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82201567c0 0x7f822009e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 -- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 msgr2=0x7f8220154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f8220154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 -- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82201567c0 msgr2=0x7f822009e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82201567c0 0x7f822009e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 -- 172.21.15.6:0/2323635582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82201f91a0 con 0x7f82200b25d0 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8225e9e640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200b25d0 0x7f822009b230 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f821800e960 tx=0x7f821800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f821e7fc640 1 -- 172.21.15.6:0/2323635582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218017070 con 0x7f82200b25d0 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f821e7fc640 1 -- 172.21.15.6:0/2323635582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821800ca00 con 0x7f82200b25d0 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822009daa0 con 0x7f82200b25d0 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f821e7fc640 1 -- 172.21.15.6:0/2323635582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821800cdd0 con 0x7f82200b25d0 2024-05-20T17:56:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.852+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822009e060 con 0x7f82200b25d0 2024-05-20T17:56:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.853+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8220075b00 con 0x7f82200b25d0 2024-05-20T17:56:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.854+0000 7f821e7fc640 1 -- 172.21.15.6:0/2323635582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f821801a070 con 0x7f82200b25d0 2024-05-20T17:56:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.855+0000 7f821e7fc640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f820c06be60 0x7f820c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.855+0000 7f821e7fc640 1 -- 172.21.15.6:0/2323635582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f821808aeb0 con 0x7f82200b25d0 2024-05-20T17:56:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.855+0000 7f822569d640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f820c06be60 0x7f820c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:04.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.856+0000 7f822569d640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f820c06be60 0x7f820c06e370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f822015a6e0 tx=0x7f8214009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:04.859+0000 7f821e7fc640 1 -- 172.21.15.6:0/2323635582 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8218059380 con 0x7f82200b25d0 2024-05-20T17:56:05.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.043+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82200d1cd0 con 0x7f82200b25d0 2024-05-20T17:56:05.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.044+0000 7f821e7fc640 1 -- 172.21.15.6:0/2323635582 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+13243 (secure 0 0 0) 0x7f821805d680 con 0x7f82200b25d0 2024-05-20T17:56:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:05.042 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":56,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:03.706722+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1365830773":"2024-05-21T17:56:00.528086+0000","172.21.15.6:6833/1365830773":"2024-05-21T17:56:00.528086+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f820c06be60 msgr2=0x7f820c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f820c06be60 0x7f820c06e370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f822015a6e0 tx=0x7f8214009040 comp rx=0 tx=0).stop 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200b25d0 msgr2=0x7f822009b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200b25d0 0x7f822009b230 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f821800e960 tx=0x7f821800ee20 comp rx=0 tx=0).stop 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 shutdown_connections 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f820c06be60 0x7f820c06e370 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82201567c0 0x7f822009e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f822015d870 0x7f8220154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 --2- 172.21.15.6:0/2323635582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82200b25d0 0x7f822009b230 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 >> 172.21.15.6:0/2323635582 conn(0x7f8220072ed0 msgr2=0x7f8220160f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 shutdown_connections 2024-05-20T17:56:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.046+0000 7f8228102640 1 -- 172.21.15.6:0/2323635582 wait complete. 2024-05-20T17:56:05.055 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:56:05.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:56:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.175+0000 7f1c8972c640 1 Processor -- start 2024-05-20T17:56:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.175+0000 7f1c8972c640 1 -- start start 2024-05-20T17:56:05.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.176+0000 7f1c8972c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1c84163a10 0x7f1c840d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.176+0000 7f1c8972c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c840d0370 con 0x7f1c840b4010 2024-05-20T17:56:05.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.176+0000 7f1c8972c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c840d0650 con 0x7f1c840d14b0 2024-05-20T17:56:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.176+0000 7f1c8972c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1c840d3ca0 con 0x7f1c84163a10 2024-05-20T17:56:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.176+0000 7f1c827fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1c840b4010 0x7f1c840cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47284/0 (socket says 172.21.15.6:47284) 2024-05-20T17:56:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.176+0000 7f1c827fc640 1 -- 172.21.15.6:0/741842363 learned_addr learned my addr 172.21.15.6:0/741842363 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.176+0000 7f1c82ffd640 1 --2- 172.21.15.6:0/741842363 >> v2:172.21.15.171:3300/0 conn(0x7f1c84163a10 0x7f1c840d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.176+0000 7f1c81ffb640 1 -- 172.21.15.6:0/741842363 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260760727 0 0) 0x7f1c840d0370 con 0x7f1c840b4010 2024-05-20T17:56:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.177+0000 7f1c81ffb640 1 -- 172.21.15.6:0/741842363 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c70003520 con 0x7f1c840b4010 2024-05-20T17:56:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.177+0000 7f1c81ffb640 1 -- 172.21.15.6:0/741842363 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1305094083 0 0) 0x7f1c840d0650 con 0x7f1c840d14b0 2024-05-20T17:56:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.177+0000 7f1c81ffb640 1 -- 172.21.15.6:0/741842363 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c840d0370 con 0x7f1c840d14b0 2024-05-20T17:56:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.177+0000 7f1c82ffd640 1 -- 172.21.15.6:0/741842363 >> v1:172.21.15.171:6789/0 conn(0x7f1c840d14b0 legacy=0x7f1c840d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.177+0000 7f1c82ffd640 1 -- 172.21.15.6:0/741842363 >> v1:172.21.15.6:6789/0 conn(0x7f1c840b4010 legacy=0x7f1c840cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.177+0000 7f1c82ffd640 1 -- 172.21.15.6:0/741842363 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c840d3650 con 0x7f1c84163a10 2024-05-20T17:56:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.178+0000 7f1c82ffd640 1 --2- 172.21.15.6:0/741842363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c84163a10 0x7f1c840d4130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0097a0 tx=0x7f1c7c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755b9b8acd14d7ce server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.178+0000 7f1c81ffb640 1 -- 172.21.15.6:0/741842363 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c037070 con 0x7f1c84163a10 2024-05-20T17:56:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.178+0000 7f1c81ffb640 1 -- 172.21.15.6:0/741842363 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7c032440 con 0x7f1c84163a10 2024-05-20T17:56:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.178+0000 7f1c81ffb640 1 -- 172.21.15.6:0/741842363 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c032810 con 0x7f1c84163a10 2024-05-20T17:56:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.178+0000 7f1c8972c640 1 -- 172.21.15.6:0/741842363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c84163a10 msgr2=0x7f1c840d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.178+0000 7f1c8972c640 1 --2- 172.21.15.6:0/741842363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c84163a10 0x7f1c840d4130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0097a0 tx=0x7f1c7c02a230 comp rx=0 tx=0).stop 2024-05-20T17:56:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.178+0000 7f1c8972c640 1 -- 172.21.15.6:0/741842363 shutdown_connections 2024-05-20T17:56:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.178+0000 7f1c8972c640 1 --2- 172.21.15.6:0/741842363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c84163a10 0x7f1c840d4130 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.179+0000 7f1c8972c640 1 -- 172.21.15.6:0/741842363 >> 172.21.15.6:0/741842363 conn(0x7f1c8406d240 msgr2=0x7f1c8406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.179+0000 7f1c8972c640 1 -- 172.21.15.6:0/741842363 shutdown_connections 2024-05-20T17:56:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.179+0000 7f1c8972c640 1 -- 172.21.15.6:0/741842363 wait complete. 2024-05-20T17:56:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.180+0000 7f1c8972c640 1 Processor -- start 2024-05-20T17:56:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.181+0000 7f1c8972c640 1 -- start start 2024-05-20T17:56:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c8972c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c840b4010 0x7f1c84149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c8972c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c840d14b0 0x7f1c84156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c8972c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c84163a10 0x7f1c84161560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c8972c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1c840b8390 con 0x7f1c84163a10 2024-05-20T17:56:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c8972c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1c840b8210 con 0x7f1c840d14b0 2024-05-20T17:56:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c8972c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1c840b8510 con 0x7f1c840b4010 2024-05-20T17:56:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c84163a10 0x7f1c84161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c837fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c84163a10 0x7f1c84161560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37330/0 (socket says 172.21.15.6:37330) 2024-05-20T17:56:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c837fe640 1 -- 172.21.15.6:0/4020270421 learned_addr learned my addr 172.21.15.6:0/4020270421 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c827fc640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c840d14b0 0x7f1c84156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c82ffd640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c840b4010 0x7f1c84149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c837fe640 1 -- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c840b4010 msgr2=0x7f1c84149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c837fe640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c840b4010 0x7f1c84149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c837fe640 1 -- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c840d14b0 msgr2=0x7f1c84156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c837fe640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c840d14b0 0x7f1c84156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c837fe640 1 -- 172.21.15.6:0/4020270421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c841f8e00 con 0x7f1c84163a10 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c827fc640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c840d14b0 0x7f1c84156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.182+0000 7f1c82ffd640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c840b4010 0x7f1c84149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.183+0000 7f1c837fe640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c84163a10 0x7f1c84161560 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400c710 tx=0x7f1c7400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.183+0000 7f1c7b7fe640 1 -- 172.21.15.6:0/4020270421 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c74003b70 con 0x7f1c84163a10 2024-05-20T17:56:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.183+0000 7f1c7b7fe640 1 -- 172.21.15.6:0/4020270421 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c74003d10 con 0x7f1c84163a10 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.183+0000 7f1c7b7fe640 1 -- 172.21.15.6:0/4020270421 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400aa50 con 0x7f1c84163a10 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.183+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c841f90e0 con 0x7f1c84163a10 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.183+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c841f96a0 con 0x7f1c84163a10 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.184+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c841f8b50 con 0x7f1c84163a10 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.184+0000 7f1c7b7fe640 1 -- 172.21.15.6:0/4020270421 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c7400abf0 con 0x7f1c84163a10 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.185+0000 7f1c7b7fe640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c6406be60 0x7f1c6406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.185+0000 7f1c7b7fe640 1 -- 172.21.15.6:0/4020270421 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f1c7408ac10 con 0x7f1c84163a10 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.185+0000 7f1c82ffd640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c6406be60 0x7f1c6406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.186+0000 7f1c82ffd640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c6406be60 0x7f1c6406e370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c034000 tx=0x7f1c7c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.189+0000 7f1c7b7fe640 1 -- 172.21.15.6:0/4020270421 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1c7400ce20 con 0x7f1c84163a10 2024-05-20T17:56:05.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.373+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c841549e0 con 0x7f1c84163a10 2024-05-20T17:56:05.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.374+0000 7f1c7b7fe640 1 -- 172.21.15.6:0/4020270421 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) ==== 93+0+10 (secure 0 0 0) 0x7f1c74059730 con 0x7f1c84163a10 2024-05-20T17:56:05.372 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:56:05.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c6406be60 msgr2=0x7f1c6406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c6406be60 0x7f1c6406e370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c034000 tx=0x7f1c7c02e000 comp rx=0 tx=0).stop 2024-05-20T17:56:05.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c84163a10 msgr2=0x7f1c84161560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c84163a10 0x7f1c84161560 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400c710 tx=0x7f1c7400cbd0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 shutdown_connections 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c6406be60 0x7f1c6406e370 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c84163a10 0x7f1c84161560 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c840d14b0 0x7f1c84156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 --2- 172.21.15.6:0/4020270421 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1c840b4010 0x7f1c84149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 >> 172.21.15.6:0/4020270421 conn(0x7f1c8406d240 msgr2=0x7f1c840b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 shutdown_connections 2024-05-20T17:56:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.376+0000 7f1c8972c640 1 -- 172.21.15.6:0/4020270421 wait complete. 2024-05-20T17:56:05.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size' 2024-05-20T17:56:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.503+0000 7f9190d6c640 1 Processor -- start 2024-05-20T17:56:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.503+0000 7f9190d6c640 1 -- start start 2024-05-20T17:56:05.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f9190d6c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f918c162820 0x7f918c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f9190d6c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f918c0b3e80 0x7f918c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f9190d6c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f918c06dd20 con 0x7f918c06d910 2024-05-20T17:56:05.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f9190d6c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f918c0d0630 con 0x7f918c162820 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f9190d6c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f918c0d39c0 con 0x7f918c0b3e80 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f918a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f918c162820 0x7f918c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f918a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f918c162820 0x7f918c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37346/0 (socket says 172.21.15.6:37346) 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f918a59c640 1 -- 172.21.15.6:0/3029736855 learned_addr learned my addr 172.21.15.6:0/3029736855 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f9189d9b640 1 --2- 172.21.15.6:0/3029736855 >> v2:172.21.15.171:3300/0 conn(0x7f918c0b3e80 0x7f918c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f918a59c640 1 -- 172.21.15.6:0/3029736855 >> v2:172.21.15.171:3300/0 conn(0x7f918c0b3e80 msgr2=0x7f918c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f918a59c640 1 --2- 172.21.15.6:0/3029736855 >> v2:172.21.15.171:3300/0 conn(0x7f918c0b3e80 0x7f918c06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f918a59c640 1 -- 172.21.15.6:0/3029736855 >> v1:172.21.15.171:6789/0 conn(0x7f918c06d910 legacy=0x7f918c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:05.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.505+0000 7f918a59c640 1 -- 172.21.15.6:0/3029736855 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918c0d3ca0 con 0x7f918c162820 2024-05-20T17:56:05.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.506+0000 7f918a59c640 1 --2- 172.21.15.6:0/3029736855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c0b3940 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f918c0d1230 tx=0x7f917c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65add01755bb9c30 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:05.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.506+0000 7f918959a640 1 -- 172.21.15.6:0/3029736855 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c036070 con 0x7f918c162820 2024-05-20T17:56:05.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.506+0000 7f918959a640 1 -- 172.21.15.6:0/3029736855 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917c031600 con 0x7f918c162820 2024-05-20T17:56:05.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.506+0000 7f918959a640 1 -- 172.21.15.6:0/3029736855 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c0319d0 con 0x7f918c162820 2024-05-20T17:56:05.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.507+0000 7f9190d6c640 1 -- 172.21.15.6:0/3029736855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 msgr2=0x7f918c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.507+0000 7f9190d6c640 1 --2- 172.21.15.6:0/3029736855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c0b3940 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f918c0d1230 tx=0x7f917c02a6f0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.507+0000 7f9190d6c640 1 -- 172.21.15.6:0/3029736855 shutdown_connections 2024-05-20T17:56:05.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.507+0000 7f9190d6c640 1 --2- 172.21.15.6:0/3029736855 >> v2:172.21.15.171:3300/0 conn(0x7f918c0b3e80 0x7f918c06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.507+0000 7f9190d6c640 1 --2- 172.21.15.6:0/3029736855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c0b3940 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.507+0000 7f9190d6c640 1 -- 172.21.15.6:0/3029736855 >> 172.21.15.6:0/3029736855 conn(0x7f918c0d4bd0 msgr2=0x7f918c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:05.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.507+0000 7f9190d6c640 1 -- 172.21.15.6:0/3029736855 shutdown_connections 2024-05-20T17:56:05.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.507+0000 7f9190d6c640 1 -- 172.21.15.6:0/3029736855 wait complete. 2024-05-20T17:56:05.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.509+0000 7f9190d6c640 1 Processor -- start 2024-05-20T17:56:05.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.509+0000 7f9190d6c640 1 -- start start 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.510+0000 7f9190d6c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f918c06d910 0x7f918c14ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.510+0000 7f9190d6c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f918c0b3e80 0x7f918c1f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.510+0000 7f9190d6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.510+0000 7f9190d6c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f918c0d0300 con 0x7f918c162820 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.510+0000 7f9190d6c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f918c0d4260 con 0x7f918c0b3e80 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.510+0000 7f9190d6c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f918c0b91a0 con 0x7f918c06d910 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c161330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37350/0 (socket says 172.21.15.6:37350) 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 -- 172.21.15.6:0/2575271865 learned_addr learned my addr 172.21.15.6:0/2575271865 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918a59c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f918c06d910 0x7f918c14ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f9189d9b640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f918c0b3e80 0x7f918c1f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 -- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f918c06d910 msgr2=0x7f918c14ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f918c06d910 0x7f918c14ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 -- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f918c0b3e80 msgr2=0x7f918c1f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f918c0b3e80 0x7f918c1f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 -- 172.21.15.6:0/2575271865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918c1f9a00 con 0x7f918c162820 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f9189d9b640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f918c0b3e80 0x7f918c1f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f918ad9d640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c161330 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f918400b410 tx=0x7f918400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f917affd640 1 -- 172.21.15.6:0/2575271865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184015030 con 0x7f918c162820 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f917affd640 1 -- 172.21.15.6:0/2575271865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9184004020 con 0x7f918c162820 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918c14db70 con 0x7f918c162820 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f917affd640 1 -- 172.21.15.6:0/2575271865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184004410 con 0x7f918c162820 2024-05-20T17:56:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.511+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f918c14e130 con 0x7f918c162820 2024-05-20T17:56:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.512+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918c075b00 con 0x7f918c162820 2024-05-20T17:56:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.513+0000 7f917affd640 1 -- 172.21.15.6:0/2575271865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9184018070 con 0x7f918c162820 2024-05-20T17:56:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.514+0000 7f917affd640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f916c06be30 0x7f916c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.514+0000 7f917affd640 1 -- 172.21.15.6:0/2575271865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f918408a760 con 0x7f918c162820 2024-05-20T17:56:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.514+0000 7f918a59c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f916c06be30 0x7f916c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.514+0000 7f918a59c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f916c06be30 0x7f916c06e340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f917c033000 tx=0x7f917c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:05.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.518+0000 7f917affd640 1 -- 172.21.15.6:0/2575271865 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9184059280 con 0x7f918c162820 2024-05-20T17:56:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:05.779+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]} v 0) -- 0x7f918c1f9790 con 0x7f918c162820 2024-05-20T17:56:05.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:56:05.968 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:56:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.720+0000 7f917affd640 1 -- 172.21.15.6:0/2575271865 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]}]=0 v179) ==== 153+0+0 (secure 0 0 0) 0x7f9184058b80 con 0x7f918c162820 2024-05-20T17:56:06.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.723+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f916c06be30 msgr2=0x7f916c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.723+0000 7f9190d6c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f916c06be30 0x7f916c06e340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f917c033000 tx=0x7f917c009000 comp rx=0 tx=0).stop 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.723+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 msgr2=0x7f918c161330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.723+0000 7f9190d6c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c161330 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f918400b410 tx=0x7f918400b8d0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.724+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 shutdown_connections 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.724+0000 7f9190d6c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f916c06be30 0x7f916c06e340 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.724+0000 7f9190d6c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f918c162820 0x7f918c161330 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.724+0000 7f9190d6c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f918c0b3e80 0x7f918c1f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.724+0000 7f9190d6c640 1 --2- 172.21.15.6:0/2575271865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f918c06d910 0x7f918c14ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.724+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 >> 172.21.15.6:0/2575271865 conn(0x7f918c0d4bd0 msgr2=0x7f918c0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.724+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 shutdown_connections 2024-05-20T17:56:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.724+0000 7f9190d6c640 1 -- 172.21.15.6:0/2575271865 wait complete. 2024-05-20T17:56:06.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T17:56:06.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.890+0000 7f0609e51640 1 Processor -- start 2024-05-20T17:56:06.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.890+0000 7f0609e51640 1 -- start start 2024-05-20T17:56:06.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.891+0000 7f0609e51640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06040cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:06.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.891+0000 7f0609e51640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06040cf130 con 0x7f060415f220 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.891+0000 7f0609e51640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06040cda20 con 0x7f06040cf3d0 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.891+0000 7f0609e51640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f06040cdd00 con 0x7f06040ce7e0 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f06037fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f060415f220 0x7f06040d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47300/0 (socket says 172.21.15.6:47300) 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f06037fe640 1 -- 172.21.15.6:0/1022745865 learned_addr learned my addr 172.21.15.6:0/1022745865 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f0603fff640 1 --2- 172.21.15.6:0/1022745865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06040cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f06027fc640 1 -- 172.21.15.6:0/1022745865 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796948958 0 0) 0x7f06040cf130 con 0x7f060415f220 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f06027fc640 1 -- 172.21.15.6:0/1022745865 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05ec003520 con 0x7f060415f220 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f06027fc640 1 -- 172.21.15.6:0/1022745865 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334441149 0 0) 0x7f06040cda20 con 0x7f06040cf3d0 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f06027fc640 1 -- 172.21.15.6:0/1022745865 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06040cf130 con 0x7f06040cf3d0 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f0603fff640 1 -- 172.21.15.6:0/1022745865 >> v1:172.21.15.171:6789/0 conn(0x7f06040cf3d0 legacy=0x7f06040cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f06027fc640 1 -- 172.21.15.6:0/1022745865 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2414029402 0 0) 0x7f05ec003520 con 0x7f060415f220 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f0603fff640 1 -- 172.21.15.6:0/1022745865 >> v1:172.21.15.6:6789/0 conn(0x7f060415f220 legacy=0x7f06040d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:06.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.892+0000 7f0603fff640 1 -- 172.21.15.6:0/1022745865 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06040cdfe0 con 0x7f06040ce7e0 2024-05-20T17:56:06.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.893+0000 7f0603fff640 1 --2- 172.21.15.6:0/1022745865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06040cebf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009dc0 tx=0x7f05fc02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4792be2447b8b26b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.893+0000 7f06027fc640 1 -- 172.21.15.6:0/1022745865 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4001670 con 0x7f06040ce7e0 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.893+0000 7f06027fc640 1 -- 172.21.15.6:0/1022745865 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05fc007540 con 0x7f06040ce7e0 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.893+0000 7f06027fc640 1 -- 172.21.15.6:0/1022745865 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0078f0 con 0x7f06040ce7e0 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.894+0000 7f0609e51640 1 -- 172.21.15.6:0/1022745865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 msgr2=0x7f06040cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.894+0000 7f0609e51640 1 --2- 172.21.15.6:0/1022745865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06040cebf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009dc0 tx=0x7f05fc02a5d0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.894+0000 7f0609e51640 1 -- 172.21.15.6:0/1022745865 shutdown_connections 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.894+0000 7f0609e51640 1 --2- 172.21.15.6:0/1022745865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06040cebf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.894+0000 7f0609e51640 1 -- 172.21.15.6:0/1022745865 >> 172.21.15.6:0/1022745865 conn(0x7f06040b44d0 msgr2=0x7f06040b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.894+0000 7f0609e51640 1 -- 172.21.15.6:0/1022745865 shutdown_connections 2024-05-20T17:56:06.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.894+0000 7f0609e51640 1 -- 172.21.15.6:0/1022745865 wait complete. 2024-05-20T17:56:06.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.896+0000 7f0609e51640 1 Processor -- start 2024-05-20T17:56:06.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.896+0000 7f0609e51640 1 -- start start 2024-05-20T17:56:06.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0609e51640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06041f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:06.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0609e51640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06040cf3d0 0x7f06040cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:06.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0609e51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060415f220 0x7f060415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0609e51640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06040cd680 con 0x7f060415f220 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0609e51640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06040d0fd0 con 0x7f06040cf3d0 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0609e51640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f06040cd800 con 0x7f06040ce7e0 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0603fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060415f220 0x7f060415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0603fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060415f220 0x7f060415af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37352/0 (socket says 172.21.15.6:37352) 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.897+0000 7f0603fff640 1 -- 172.21.15.6:0/624723913 learned_addr learned my addr 172.21.15.6:0/624723913 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f06037fe640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06041f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0602ffd640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06040cf3d0 0x7f06040cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0603fff640 1 -- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 msgr2=0x7f06041f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0603fff640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06041f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0603fff640 1 -- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06040cf3d0 msgr2=0x7f06040cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0603fff640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06040cf3d0 0x7f06040cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:06.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0603fff640 1 -- 172.21.15.6:0/624723913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06041f8a80 con 0x7f060415f220 2024-05-20T17:56:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0602ffd640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06040cf3d0 0x7f06040cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0603fff640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060415f220 0x7f060415af40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f05fc02abc0 tx=0x7f05fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f05ebfff640 1 -- 172.21.15.6:0/624723913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc040070 con 0x7f060415f220 2024-05-20T17:56:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f05ebfff640 1 -- 172.21.15.6:0/624723913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05fc031bc0 con 0x7f060415f220 2024-05-20T17:56:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f05ebfff640 1 -- 172.21.15.6:0/624723913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc009450 con 0x7f060415f220 2024-05-20T17:56:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06040c6590 con 0x7f060415f220 2024-05-20T17:56:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.898+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06040c6b50 con 0x7f060415f220 2024-05-20T17:56:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.900+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0604075b00 con 0x7f060415f220 2024-05-20T17:56:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.900+0000 7f05ebfff640 1 -- 172.21.15.6:0/624723913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05fc039040 con 0x7f060415f220 2024-05-20T17:56:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.900+0000 7f05ebfff640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05f006be30 0x7f05f006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.901+0000 7f05ebfff640 1 -- 172.21.15.6:0/624723913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f05fc0ac440 con 0x7f060415f220 2024-05-20T17:56:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.901+0000 7f06037fe640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05f006be30 0x7f05f006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.902+0000 7f06037fe640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05f006be30 0x7f05f006e340 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f05f40017e0 tx=0x7f05f4001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:06.905+0000 7f05ebfff640 1 -- 172.21.15.6:0/624723913 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f05fc07aed0 con 0x7f060415f220 2024-05-20T17:56:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.088+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0604158f40 con 0x7f060415f220 2024-05-20T17:56:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.091+0000 7f05ebfff640 1 -- 172.21.15.6:0/624723913 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f05fc07a7d0 con 0x7f060415f220 2024-05-20T17:56:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05f006be30 msgr2=0x7f05f006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05f006be30 0x7f05f006e340 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f05f40017e0 tx=0x7f05f4001650 comp rx=0 tx=0).stop 2024-05-20T17:56:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060415f220 msgr2=0x7f060415af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060415f220 0x7f060415af40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f05fc02abc0 tx=0x7f05fc004a40 comp rx=0 tx=0).stop 2024-05-20T17:56:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 shutdown_connections 2024-05-20T17:56:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05f006be30 0x7f05f006e340 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060415f220 0x7f060415af40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06040cf3d0 0x7f06040cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 --2- 172.21.15.6:0/624723913 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06040ce7e0 0x7f06041f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 >> 172.21.15.6:0/624723913 conn(0x7f06040b44d0 msgr2=0x7f06040d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 shutdown_connections 2024-05-20T17:56:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.093+0000 7f0609e51640 1 -- 172.21.15.6:0/624723913 wait complete. 2024-05-20T17:56:07.102 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:56:07.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:56:07.141 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:56:07.187 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:56:07.187 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:07.187 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:07.203 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:56:07.203 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:07.203 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:07.223 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:56:07.223 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:07.223 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:07.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:56:07.261 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:07.261 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:07.282 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:56:07.282 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T17:56:07.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:07.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.417+0000 7f9f7a86c640 1 Processor -- start 2024-05-20T17:56:07.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.417+0000 7f9f7a86c640 1 -- start start 2024-05-20T17:56:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f7a86c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f741576d0 0x7f9f7406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f7a86c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f74157ae0 con 0x7f9f740cedd0 2024-05-20T17:56:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f7a86c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7406b900 con 0x7f9f7415d5f0 2024-05-20T17:56:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f7a86c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7406cee0 con 0x7f9f741576d0 2024-05-20T17:56:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f6bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f741576d0 0x7f9f7406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f78e09640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9f740cedd0 0x7f9f7406e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47314/0 (socket says 172.21.15.6:47314) 2024-05-20T17:56:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f78e09640 1 -- 172.21.15.6:0/1173974731 learned_addr learned my addr 172.21.15.6:0/1173974731 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f6bfff640 1 -- 172.21.15.6:0/1173974731 >> v1:172.21.15.171:6789/0 conn(0x7f9f7415d5f0 legacy=0x7f9f740ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f6bfff640 1 -- 172.21.15.6:0/1173974731 >> v1:172.21.15.6:6789/0 conn(0x7f9f740cedd0 legacy=0x7f9f7406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f6bfff640 1 -- 172.21.15.6:0/1173974731 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7406bbe0 con 0x7f9f741576d0 2024-05-20T17:56:07.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.419+0000 7f9f737fe640 1 -- 172.21.15.6:0/1173974731 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221336462 0 0) 0x7f9f74157ae0 con 0x7f9f740cedd0 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.420+0000 7f9f6bfff640 1 --2- 172.21.15.6:0/1173974731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f741576d0 0x7f9f7406c9a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0097a0 tx=0x7f9f5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799f02f4867bbd2c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.420+0000 7f9f737fe640 1 -- 172.21.15.6:0/1173974731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c037070 con 0x7f9f741576d0 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.420+0000 7f9f737fe640 1 -- 172.21.15.6:0/1173974731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f5c032440 con 0x7f9f741576d0 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.420+0000 7f9f737fe640 1 -- 172.21.15.6:0/1173974731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c032810 con 0x7f9f741576d0 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.421+0000 7f9f7a86c640 1 -- 172.21.15.6:0/1173974731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f741576d0 msgr2=0x7f9f7406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.421+0000 7f9f7a86c640 1 --2- 172.21.15.6:0/1173974731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f741576d0 0x7f9f7406c9a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0097a0 tx=0x7f9f5c02a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.421+0000 7f9f7a86c640 1 -- 172.21.15.6:0/1173974731 shutdown_connections 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.421+0000 7f9f7a86c640 1 --2- 172.21.15.6:0/1173974731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f741576d0 0x7f9f7406c9a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.421+0000 7f9f7a86c640 1 -- 172.21.15.6:0/1173974731 >> 172.21.15.6:0/1173974731 conn(0x7f9f740cd2a0 msgr2=0x7f9f740cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:07.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.421+0000 7f9f7a86c640 1 -- 172.21.15.6:0/1173974731 shutdown_connections 2024-05-20T17:56:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.421+0000 7f9f7a86c640 1 -- 172.21.15.6:0/1173974731 wait complete. 2024-05-20T17:56:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.423+0000 7f9f7a86c640 1 Processor -- start 2024-05-20T17:56:07.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.423+0000 7f9f7a86c640 1 -- start start 2024-05-20T17:56:07.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f7a86c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f740cedd0 0x7f9f741472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f7a86c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f741576d0 0x7f9f74155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f7a86c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f7415d5f0 0x7f9f7409da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f7a86c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7406c480 con 0x7f9f740cedd0 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f7a86c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7406c1a0 con 0x7f9f7415d5f0 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f7a86c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f740cf1e0 con 0x7f9f741576d0 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f740cedd0 0x7f9f741472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f740cedd0 0x7f9f741472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37362/0 (socket says 172.21.15.6:37362) 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.424+0000 7f9f73fff640 1 -- 172.21.15.6:0/2384731506 learned_addr learned my addr 172.21.15.6:0/2384731506 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f6bfff640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f741576d0 0x7f9f74155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f78e09640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f7415d5f0 0x7f9f7409da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f73fff640 1 -- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f741576d0 msgr2=0x7f9f74155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f73fff640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f741576d0 0x7f9f74155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f73fff640 1 -- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f7415d5f0 msgr2=0x7f9f7409da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f73fff640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f7415d5f0 0x7f9f7409da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f73fff640 1 -- 172.21.15.6:0/2384731506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f74151730 con 0x7f9f740cedd0 2024-05-20T17:56:07.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f78e09640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f7415d5f0 0x7f9f7409da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:07.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f73fff640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f740cedd0 0x7f9f741472b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c3f0 tx=0x7f9f6400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:07.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f717fa640 1 -- 172.21.15.6:0/2384731506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64017070 con 0x7f9f740cedd0 2024-05-20T17:56:07.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f717fa640 1 -- 172.21.15.6:0/2384731506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f640052f0 con 0x7f9f740cedd0 2024-05-20T17:56:07.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f740ad960 con 0x7f9f740cedd0 2024-05-20T17:56:07.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f717fa640 1 -- 172.21.15.6:0/2384731506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64003830 con 0x7f9f740cedd0 2024-05-20T17:56:07.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.425+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f740adf20 con 0x7f9f740cedd0 2024-05-20T17:56:07.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.426+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f74075b00 con 0x7f9f740cedd0 2024-05-20T17:56:07.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.427+0000 7f9f717fa640 1 -- 172.21.15.6:0/2384731506 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f6401a070 con 0x7f9f740cedd0 2024-05-20T17:56:07.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.427+0000 7f9f717fa640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f5406be30 0x7f9f5406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.428+0000 7f9f717fa640 1 -- 172.21.15.6:0/2384731506 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f9f6408a150 con 0x7f9f740cedd0 2024-05-20T17:56:07.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.428+0000 7f9f6bfff640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f5406be30 0x7f9f5406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.428+0000 7f9f6bfff640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f5406be30 0x7f9f5406e340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c034000 tx=0x7f9f5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:07.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.432+0000 7f9f717fa640 1 -- 172.21.15.6:0/2384731506 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f64058b40 con 0x7f9f740cedd0 2024-05-20T17:56:07.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.653+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f7415d030 con 0x7f9f740cedd0 2024-05-20T17:56:07.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.653+0000 7f9f717fa640 1 -- 172.21.15.6:0/2384731506 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3866 (secure 0 0 0) 0x7f9f64058440 con 0x7f9f740cedd0 2024-05-20T17:56:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:07.652 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/855682127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":855682127},{"type":"v1","addr":"172.21.15.171:6837","nonce":855682127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/2086456440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2086456440},{"type":"v1","addr":"172.21.15.171:6836","nonce":2086456440}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3128490033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3128490033},{"type":"v1","addr":"172.21.15.6:6834","nonce":3128490033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":6225,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/4184129920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4184129920},{"type":"v1","addr":"172.21.15.6:6835","nonce":4184129920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-05-20T17:56:07.652 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 29 2024-05-20T17:56:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f5406be30 msgr2=0x7f9f5406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f5406be30 0x7f9f5406e340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c034000 tx=0x7f9f5c02e000 comp rx=0 tx=0).stop 2024-05-20T17:56:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f740cedd0 msgr2=0x7f9f741472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f740cedd0 0x7f9f741472b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c3f0 tx=0x7f9f6400c8b0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 shutdown_connections 2024-05-20T17:56:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f5406be30 0x7f9f5406e340 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f7415d5f0 0x7f9f7409da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f741576d0 0x7f9f74155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 --2- 172.21.15.6:0/2384731506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f740cedd0 0x7f9f741472b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 >> 172.21.15.6:0/2384731506 conn(0x7f9f740cd2a0 msgr2=0x7f9f74153e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 shutdown_connections 2024-05-20T17:56:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.656+0000 7f9f7a86c640 1 -- 172.21.15.6:0/2384731506 wait complete. 2024-05-20T17:56:07.665 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T17:56:07.665 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T17:56:07.666 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T17:56:07.666 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:56:07.666 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T17:56:07.666 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T17:56:07.666 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T17:56:07.666 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:56:07.667 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T17:56:07.667 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T17:56:07.667 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T17:56:07.667 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:56:07.667 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T17:56:07.667 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T17:56:07.667 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T17:56:07.667 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:56:07.677 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T17:56:07.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T17:56:07.679 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T17:56:07.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T17:56:07.680 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T17:56:07.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T17:56:07.681 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T17:56:07.681 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T17:56:07.720 INFO:tasks.ceph.mds.c:Started 2024-05-20T17:56:07.721 DEBUG:teuthology.parallel:result is None 2024-05-20T17:56:07.722 INFO:tasks.ceph.mds.a:Started 2024-05-20T17:56:07.722 DEBUG:teuthology.parallel:result is None 2024-05-20T17:56:07.723 INFO:tasks.ceph.mds.b:Started 2024-05-20T17:56:07.723 DEBUG:teuthology.parallel:result is None 2024-05-20T17:56:07.723 INFO:tasks.ceph.mds.d:Started 2024-05-20T17:56:07.724 DEBUG:teuthology.parallel:result is None 2024-05-20T17:56:07.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T17:56:07.811 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:56:07.812 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:56:07.818 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T17:56:07.818 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T17:56:07.819 INFO:tasks.ceph.mds.b.smithi171.stderr:2024-05-20T17:56:07.820+0000 7f0f6aafd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-20T17:56:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.850+0000 7f1b92a51640 1 Processor -- start 2024-05-20T17:56:07.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.850+0000 7f1b92a51640 1 -- start start 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b92a51640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1b8c0d10e0 0x7f1b8c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b92a51640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0d14f0 0x7f1b8c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b92a51640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b8c0d1ac0 con 0x7f1b8c0cd4d0 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b92a51640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1b8c0d1da0 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b92a51640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8c0d2080 con 0x7f1b8c0d14f0 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b90fee640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1b8c0cd4d0 0x7f1b8c0cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:33268/0 (socket says 172.21.15.6:33268) 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b90fee640 1 -- 172.21.15.6:0/2446732769 learned_addr learned my addr 172.21.15.6:0/2446732769 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b8bfff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1b8c0d10e0 0x7f1b8c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.851+0000 7f1b8b7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0d14f0 0x7f1b8c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.852+0000 7f1b8affd640 1 -- 172.21.15.6:0/2446732769 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444690309 0 0) 0x7f1b8c0d1ac0 con 0x7f1b8c0cd4d0 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.852+0000 7f1b8affd640 1 -- 172.21.15.6:0/2446732769 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b74003520 con 0x7f1b8c0cd4d0 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.852+0000 7f1b8bfff640 1 -- 172.21.15.6:0/2446732769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0d14f0 msgr2=0x7f1b8c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.852+0000 7f1b8bfff640 1 --2- 172.21.15.6:0/2446732769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0d14f0 0x7f1b8c0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.852+0000 7f1b8bfff640 1 -- 172.21.15.6:0/2446732769 >> v1:172.21.15.171:6789/0 conn(0x7f1b8c0cd4d0 legacy=0x7f1b8c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.852+0000 7f1b8bfff640 1 -- 172.21.15.6:0/2446732769 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c0d2360 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.852+0000 7f1b8bfff640 1 --2- 172.21.15.6:0/2446732769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cf140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0097a0 tx=0x7f1b7c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3be269cbab96b9b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b8affd640 1 -- 172.21.15.6:0/2446732769 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c037070 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b8affd640 1 -- 172.21.15.6:0/2446732769 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7c032440 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b8affd640 1 -- 172.21.15.6:0/2446732769 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c032810 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b92a51640 1 -- 172.21.15.6:0/2446732769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d10e0 msgr2=0x7f1b8c0cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b92a51640 1 --2- 172.21.15.6:0/2446732769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cf140 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0097a0 tx=0x7f1b7c02a180 comp rx=0 tx=0).stop 2024-05-20T17:56:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b92a51640 1 -- 172.21.15.6:0/2446732769 shutdown_connections 2024-05-20T17:56:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b92a51640 1 --2- 172.21.15.6:0/2446732769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0d14f0 0x7f1b8c0cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b92a51640 1 --2- 172.21.15.6:0/2446732769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cf140 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b92a51640 1 -- 172.21.15.6:0/2446732769 >> 172.21.15.6:0/2446732769 conn(0x7f1b8c0b44d0 msgr2=0x7f1b8c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b92a51640 1 -- 172.21.15.6:0/2446732769 shutdown_connections 2024-05-20T17:56:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.853+0000 7f1b92a51640 1 -- 172.21.15.6:0/2446732769 wait complete. 2024-05-20T17:56:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.855+0000 7f1b92a51640 1 Processor -- start 2024-05-20T17:56:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.855+0000 7f1b92a51640 1 -- start start 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b92a51640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0cd4d0 0x7f1b8c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b92a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b92a51640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d14f0 0x7f1b8c06ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b92a51640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c0b8440 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b92a51640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c0b82c0 con 0x7f1b8c0d14f0 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b92a51640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8c0709f0 con 0x7f1b8c0cd4d0 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46254/0 (socket says 172.21.15.6:46254) 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 -- 172.21.15.6:0/1432191844 learned_addr learned my addr 172.21.15.6:0/1432191844 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8bfff640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0cd4d0 0x7f1b8c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b90fee640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d14f0 0x7f1b8c06ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 -- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0cd4d0 msgr2=0x7f1b8c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0cd4d0 0x7f1b8c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 -- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d14f0 msgr2=0x7f1b8c06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d14f0 0x7f1b8c06ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 -- 172.21.15.6:0/1432191844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c0cc040 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.857+0000 7f1b8b7fe640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cbb00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e8a0 tx=0x7f1b8000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.858+0000 7f1b88ff9640 1 -- 172.21.15.6:0/1432191844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80017070 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.858+0000 7f1b88ff9640 1 -- 172.21.15.6:0/1432191844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8000c940 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.858+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c0c9330 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.858+0000 7f1b88ff9640 1 -- 172.21.15.6:0/1432191844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000cd30 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.858+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c0cc5b0 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.859+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c075b00 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.859+0000 7f1b88ff9640 1 -- 172.21.15.6:0/1432191844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b8001a070 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.860+0000 7f1b88ff9640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1b7806be60 0x7f1b7806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.860+0000 7f1b88ff9640 1 -- 172.21.15.6:0/1432191844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f1b8008ac30 con 0x7f1b8c0d10e0 2024-05-20T17:56:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.860+0000 7f1b8bfff640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1b7806be60 0x7f1b7806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.861+0000 7f1b8bfff640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1b7806be60 0x7f1b7806e370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c034000 tx=0x7f1b7c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:07.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:07.864+0000 7f1b88ff9640 1 -- 172.21.15.6:0/1432191844 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1b80058f50 con 0x7f1b8c0d10e0 2024-05-20T17:56:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.064+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1b8c0b40d0 con 0x7f1b8c0d10e0 2024-05-20T17:56:08.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.738+0000 7f1b88ff9640 1 -- 172.21.15.6:0/1432191844 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) ==== 97+0+0 (secure 0 0 0) 0x7f1b8005d250 con 0x7f1b8c0d10e0 2024-05-20T17:56:08.737 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T17:56:08.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1b7806be60 msgr2=0x7f1b7806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:08.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1b7806be60 0x7f1b7806e370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c034000 tx=0x7f1b7c02e000 comp rx=0 tx=0).stop 2024-05-20T17:56:08.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b8c0d10e0 msgr2=0x7f1b8c0cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:08.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cbb00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e8a0 tx=0x7f1b8000ed60 comp rx=0 tx=0).stop 2024-05-20T17:56:08.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 shutdown_connections 2024-05-20T17:56:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1b7806be60 0x7f1b7806e370 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b8c0d14f0 0x7f1b8c06ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b8c0d10e0 0x7f1b8c0cbb00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 --2- 172.21.15.6:0/1432191844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b8c0cd4d0 0x7f1b8c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 >> 172.21.15.6:0/1432191844 conn(0x7f1b8c0b44d0 msgr2=0x7f1b8c0b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 shutdown_connections 2024-05-20T17:56:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.742+0000 7f1b92a51640 1 -- 172.21.15.6:0/1432191844 wait complete. 2024-05-20T17:56:08.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T17:56:08.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.873+0000 7f9039073640 1 Processor -- start 2024-05-20T17:56:08.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.874+0000 7f9039073640 1 -- start start 2024-05-20T17:56:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9039073640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903406d3d0 0x7f903406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9039073640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f90340b8190 0x7f90340b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9039073640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903406dd20 con 0x7f9034162820 2024-05-20T17:56:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9039073640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f90340d0630 con 0x7f90340b8190 2024-05-20T17:56:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9039073640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f90340d39c0 con 0x7f903406d3d0 2024-05-20T17:56:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9032d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9034162820 0x7f90340b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54696/0 (socket says 172.21.15.6:54696) 2024-05-20T17:56:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9032d9d640 1 -- 172.21.15.6:0/4109236982 learned_addr learned my addr 172.21.15.6:0/4109236982 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f903259c640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903406d3d0 0x7f903406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f903359e640 1 --2- 172.21.15.6:0/4109236982 >> v2:172.21.15.171:3300/0 conn(0x7f90340b8190 0x7f90340b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 999744626 0 0) 0x7f9024001490 con 0x7f9034162820 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.875+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f901c003520 con 0x7f9034162820 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3583730125 0 0) 0x7f901c003520 con 0x7f9034162820 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903406d3d0 msgr2=0x7f903406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903406d3d0 0x7f903406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 >> v2:172.21.15.171:3300/0 conn(0x7f90340b8190 msgr2=0x7f90340b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 --2- 172.21.15.6:0/4109236982 >> v2:172.21.15.171:3300/0 conn(0x7f90340b8190 0x7f90340b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90340d3ca0 con 0x7f9034162820 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f9024001bc0 con 0x7f9034162820 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 >> v1:172.21.15.6:6789/0 conn(0x7f9034162820 legacy=0x7f90340b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903406d3d0 0x7f901c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f901c003f30 0x7f901c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f901c004d40 0x7f901c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f90340d0630 con 0x7f901c003f30 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f90340d39c0 con 0x7f901c004d40 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f901c00ba10 con 0x7f903406d3d0 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f903259c640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f901c003f30 0x7f901c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f9032d9d640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903406d3d0 0x7f901c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f903359e640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f901c004d40 0x7f901c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f903259c640 1 -- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903406d3d0 msgr2=0x7f901c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f903259c640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f903406d3d0 0x7f901c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f903259c640 1 -- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f901c004d40 msgr2=0x7f901c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f903259c640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f901c004d40 0x7f901c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.876+0000 7f903259c640 1 -- 172.21.15.6:0/4109236982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c003520 con 0x7f901c003f30 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.877+0000 7f903259c640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f901c003f30 0x7f901c004800 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9028009a90 tx=0x7f901c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acdf3672317b629 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.877+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028036070 con 0x7f901c003f30 2024-05-20T17:56:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.877+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9028031400 con 0x7f901c003f30 2024-05-20T17:56:08.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.877+0000 7f9031d9b640 1 -- 172.21.15.6:0/4109236982 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028009690 con 0x7f901c003f30 2024-05-20T17:56:08.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.878+0000 7f9039073640 1 -- 172.21.15.6:0/4109236982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f901c003f30 msgr2=0x7f901c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:08.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.878+0000 7f9039073640 1 --2- 172.21.15.6:0/4109236982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f901c003f30 0x7f901c004800 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9028009a90 tx=0x7f901c005830 comp rx=0 tx=0).stop 2024-05-20T17:56:08.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.878+0000 7f903359e640 1 -- 172.21.15.6:0/4109236982 reap_dead start 2024-05-20T17:56:08.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.878+0000 7f9039073640 1 -- 172.21.15.6:0/4109236982 shutdown_connections 2024-05-20T17:56:08.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.878+0000 7f9039073640 1 -- 172.21.15.6:0/4109236982 >> 172.21.15.6:0/4109236982 conn(0x7f90340d4bd0 msgr2=0x7f90340d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:08.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.878+0000 7f9039073640 1 -- 172.21.15.6:0/4109236982 shutdown_connections 2024-05-20T17:56:08.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.878+0000 7f9039073640 1 -- 172.21.15.6:0/4109236982 wait complete. 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.880+0000 7f9039073640 1 Processor -- start 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.880+0000 7f9039073640 1 -- start start 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f9039073640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f901c003f30 0x7f90340cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f9039073640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90340cb6d0 0x7f90341555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f9039073640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90340c9090 0x7f90340cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f9039073640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f90340d0300 con 0x7f90340cb6d0 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f9039073640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f90340d4260 con 0x7f90340c9090 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f9039073640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f90340b4050 con 0x7f901c003f30 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f903259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90340cb6d0 0x7f90341555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f903259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90340cb6d0 0x7f90341555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46274/0 (socket says 172.21.15.6:46274) 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.881+0000 7f903259c640 1 -- 172.21.15.6:0/3061830915 learned_addr learned my addr 172.21.15.6:0/3061830915 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f903359e640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90340c9090 0x7f90340cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f9032d9d640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f901c003f30 0x7f90340cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f903259c640 1 -- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f901c003f30 msgr2=0x7f90340cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:08.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f903259c640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f901c003f30 0x7f90340cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f903259c640 1 -- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90340c9090 msgr2=0x7f90340cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f903259c640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90340c9090 0x7f90340cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f903259c640 1 -- 172.21.15.6:0/3061830915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9034155ae0 con 0x7f90340cb6d0 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f903359e640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90340c9090 0x7f90340cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f9032d9d640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f901c003f30 0x7f90340cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f903259c640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90340cb6d0 0x7f90341555a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9028009a90 tx=0x7f9028004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f901b7fe640 1 -- 172.21.15.6:0/3061830915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028040020 con 0x7f90340cb6d0 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f901b7fe640 1 -- 172.21.15.6:0/3061830915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9028003a40 con 0x7f90340cb6d0 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90340c8da0 con 0x7f90340cb6d0 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f901b7fe640 1 -- 172.21.15.6:0/3061830915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028036040 con 0x7f90340cb6d0 2024-05-20T17:56:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.882+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90340c8ac0 con 0x7f90340cb6d0 2024-05-20T17:56:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.883+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9034075b00 con 0x7f90340cb6d0 2024-05-20T17:56:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.884+0000 7f901b7fe640 1 -- 172.21.15.6:0/3061830915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9028043020 con 0x7f90340cb6d0 2024-05-20T17:56:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.884+0000 7f901b7fe640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f902006be30 0x7f902006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.885+0000 7f901b7fe640 1 -- 172.21.15.6:0/3061830915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f90280aaeb0 con 0x7f90340cb6d0 2024-05-20T17:56:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.885+0000 7f9032d9d640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f902006be30 0x7f902006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:08.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.885+0000 7f9032d9d640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f902006be30 0x7f902006e340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9024001670 tx=0x7f9024006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:08.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:08.889+0000 7f901b7fe640 1 -- 172.21.15.6:0/3061830915 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f902804a070 con 0x7f90340cb6d0 2024-05-20T17:56:09.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.151+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9034161190 con 0x7f90340cb6d0 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.152+0000 7f901b7fe640 1 -- 172.21.15.6:0/3061830915 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7f9034155ae0 con 0x7f90340cb6d0 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T17:56:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T17:56:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T17:56:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:56:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:56:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:56:09.163 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:56:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f902006be30 msgr2=0x7f902006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f902006be30 0x7f902006e340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9024001670 tx=0x7f9024006040 comp rx=0 tx=0).stop 2024-05-20T17:56:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90340cb6d0 msgr2=0x7f90341555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90340cb6d0 0x7f90341555a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9028009a90 tx=0x7f9028004730 comp rx=0 tx=0).stop 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 shutdown_connections 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f902006be30 0x7f902006e340 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90340c9090 0x7f90340cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90340cb6d0 0x7f90341555a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 --2- 172.21.15.6:0/3061830915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f901c003f30 0x7f90340cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 >> 172.21.15.6:0/3061830915 conn(0x7f90340d4bd0 msgr2=0x7f90340c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 shutdown_connections 2024-05-20T17:56:09.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.154+0000 7f9039073640 1 -- 172.21.15.6:0/3061830915 wait complete. 2024-05-20T17:56:09.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:09.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.282+0000 7fb5f311a640 1 Processor -- start 2024-05-20T17:56:09.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.282+0000 7fb5f311a640 1 -- start start 2024-05-20T17:56:09.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.283+0000 7fb5f311a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec0b2f10 0x7fb5ec0d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.283+0000 7fb5f311a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb5ec06d290 0x7fb5ec06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.283+0000 7fb5f311a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5ec15e6b0 con 0x7fb5ec15d940 2024-05-20T17:56:09.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.283+0000 7fb5f311a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb5ec0d2400 con 0x7fb5ec06d290 2024-05-20T17:56:09.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.283+0000 7fb5f311a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ec0d1a30 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.284+0000 7fb5f0eb6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec0b2f10 0x7fb5ec0d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.284+0000 7fb5f16b7640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb5ec15d940 0x7fb5ec15dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:33276/0 (socket says 172.21.15.6:33276) 2024-05-20T17:56:09.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.284+0000 7fb5ebfff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb5ec06d290 0x7fb5ec06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.284+0000 7fb5f16b7640 1 -- 172.21.15.6:0/591848399 learned_addr learned my addr 172.21.15.6:0/591848399 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:09.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.284+0000 7fb5f0eb6640 1 -- 172.21.15.6:0/591848399 >> v2:172.21.15.171:3300/0 conn(0x7fb5ec06d290 msgr2=0x7fb5ec06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:09.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.284+0000 7fb5f0eb6640 1 --2- 172.21.15.6:0/591848399 >> v2:172.21.15.171:3300/0 conn(0x7fb5ec06d290 0x7fb5ec06d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.284+0000 7fb5f0eb6640 1 -- 172.21.15.6:0/591848399 >> v1:172.21.15.171:6789/0 conn(0x7fb5ec15d940 legacy=0x7fb5ec15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.284+0000 7fb5f0eb6640 1 -- 172.21.15.6:0/591848399 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec0d1100 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.285+0000 7fb5f0eb6640 1 --2- 172.21.15.6:0/591848399 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec0b2f10 0x7fb5ec0d1ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00097a0 tx=0x7fb5e002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5660982466b6c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.285+0000 7fb5eb7fe640 1 -- 172.21.15.6:0/591848399 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0037070 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.285+0000 7fb5eb7fe640 1 -- 172.21.15.6:0/591848399 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e002ae50 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.285+0000 7fb5eb7fe640 1 -- 172.21.15.6:0/591848399 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0032660 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.286+0000 7fb5f311a640 1 -- 172.21.15.6:0/591848399 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec0b2f10 msgr2=0x7fb5ec0d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.286+0000 7fb5f311a640 1 --2- 172.21.15.6:0/591848399 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec0b2f10 0x7fb5ec0d1ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00097a0 tx=0x7fb5e002a100 comp rx=0 tx=0).stop 2024-05-20T17:56:09.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.286+0000 7fb5f311a640 1 -- 172.21.15.6:0/591848399 shutdown_connections 2024-05-20T17:56:09.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.286+0000 7fb5f311a640 1 --2- 172.21.15.6:0/591848399 >> v2:172.21.15.171:3300/0 conn(0x7fb5ec06d290 0x7fb5ec06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.286+0000 7fb5f311a640 1 --2- 172.21.15.6:0/591848399 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec0b2f10 0x7fb5ec0d1ec0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.286+0000 7fb5f311a640 1 -- 172.21.15.6:0/591848399 >> 172.21.15.6:0/591848399 conn(0x7fb5ec0b6670 msgr2=0x7fb5ec0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:09.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.286+0000 7fb5f311a640 1 -- 172.21.15.6:0/591848399 shutdown_connections 2024-05-20T17:56:09.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.286+0000 7fb5f311a640 1 -- 172.21.15.6:0/591848399 wait complete. 2024-05-20T17:56:09.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.288+0000 7fb5f311a640 1 Processor -- start 2024-05-20T17:56:09.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.288+0000 7fb5f311a640 1 -- start start 2024-05-20T17:56:09.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5f311a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec06d290 0x7fb5ec1475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5f311a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5ec0b2f10 0x7fb5ec14d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5f311a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5ec15d940 0x7fb5ec15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5f311a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec15e460 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5f311a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ec0b3320 con 0x7fb5ec15d940 2024-05-20T17:56:09.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5f311a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ec0d16c0 con 0x7fb5ec06d290 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5ec0b2f10 0x7fb5ec14d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5ec0b2f10 0x7fb5ec14d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46278/0 (socket says 172.21.15.6:46278) 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.289+0000 7fb5ebfff640 1 -- 172.21.15.6:0/846410061 learned_addr learned my addr 172.21.15.6:0/846410061 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5f0eb6640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec06d290 0x7fb5ec1475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5f16b7640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5ec15d940 0x7fb5ec15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5ebfff640 1 -- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec06d290 msgr2=0x7fb5ec1475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5ebfff640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec06d290 0x7fb5ec1475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5ebfff640 1 -- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5ec15d940 msgr2=0x7fb5ec15b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5ebfff640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5ec15d940 0x7fb5ec15b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5ebfff640 1 -- 172.21.15.6:0/846410061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec14dde0 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5f16b7640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5ec15d940 0x7fb5ec15b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5ebfff640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5ec0b2f10 0x7fb5ec14d2b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800e840 tx=0x7fb5d800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5e97fa640 1 -- 172.21.15.6:0/846410061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8017070 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5e97fa640 1 -- 172.21.15.6:0/846410061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d800c8e0 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ec14e0c0 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5e97fa640 1 -- 172.21.15.6:0/846410061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800ccd0 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.290+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ec0aeca0 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.291+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ec0ae7b0 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.292+0000 7fb5e97fa640 1 -- 172.21.15.6:0/846410061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5d801a070 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.292+0000 7fb5e97fa640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5d006be60 0x7fb5d006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.292+0000 7fb5e97fa640 1 -- 172.21.15.6:0/846410061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7fb5d808afe0 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.293+0000 7fb5f0eb6640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5d006be60 0x7fb5d006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.293+0000 7fb5f0eb6640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5d006be60 0x7fb5d006e370 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0034000 tx=0x7fb5e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.297+0000 7fb5e97fa640 1 -- 172.21.15.6:0/846410061 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb5d8059a80 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.481+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5ec075b00 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.482+0000 7fb5e97fa640 1 -- 172.21.15.6:0/846410061 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13116 (secure 0 0 0) 0x7fb5d8059380 con 0x7fb5ec0b2f10 2024-05-20T17:56:09.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:09.480 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":60,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:08.746699+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5d006be60 msgr2=0x7fb5d006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5d006be60 0x7fb5d006e370 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0034000 tx=0x7fb5e002e000 comp rx=0 tx=0).stop 2024-05-20T17:56:09.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5ec0b2f10 msgr2=0x7fb5ec14d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5ec0b2f10 0x7fb5ec14d2b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800e840 tx=0x7fb5d800ed00 comp rx=0 tx=0).stop 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 shutdown_connections 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5d006be60 0x7fb5d006e370 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5ec15d940 0x7fb5ec15b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5ec0b2f10 0x7fb5ec14d2b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 --2- 172.21.15.6:0/846410061 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5ec06d290 0x7fb5ec1475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 >> 172.21.15.6:0/846410061 conn(0x7fb5ec0b6670 msgr2=0x7fb5ec0d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 shutdown_connections 2024-05-20T17:56:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.484+0000 7fb5f311a640 1 -- 172.21.15.6:0/846410061 wait complete. 2024-05-20T17:56:09.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:56:09.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:56:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.614+0000 7f5317d2f640 1 Processor -- start 2024-05-20T17:56:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.614+0000 7f5317d2f640 1 -- start start 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f5317d2f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f531015d530 0x7f531015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f5317d2f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f53100b1700 0x7f53100b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f5317d2f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53100cd580 con 0x7f5310070850 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f5317d2f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f53100ce190 con 0x7f531015d530 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f5317d2f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f53100cd860 con 0x7f53100b1700 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f5315acb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f531015d530 0x7f531015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f53162cc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5310070850 0x7f5310070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54698/0 (socket says 172.21.15.6:54698) 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f5315acb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f531015d530 0x7f531015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46282/0 (socket says 172.21.15.6:46282) 2024-05-20T17:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.615+0000 7f53162cc640 1 -- 172.21.15.6:0/3279295616 learned_addr learned my addr 172.21.15.6:0/3279295616 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.616+0000 7f53152ca640 1 --2- 172.21.15.6:0/3279295616 >> v2:172.21.15.171:3300/0 conn(0x7f53100b1700 0x7f53100b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.616+0000 7f5315acb640 1 -- 172.21.15.6:0/3279295616 >> v2:172.21.15.171:3300/0 conn(0x7f53100b1700 msgr2=0x7f53100b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.616+0000 7f5315acb640 1 --2- 172.21.15.6:0/3279295616 >> v2:172.21.15.171:3300/0 conn(0x7f53100b1700 0x7f53100b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.616+0000 7f5315acb640 1 -- 172.21.15.6:0/3279295616 >> v1:172.21.15.6:6789/0 conn(0x7f5310070850 legacy=0x7f5310070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.616+0000 7f5315acb640 1 -- 172.21.15.6:0/3279295616 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53100cdb40 con 0x7f531015d530 2024-05-20T17:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.616+0000 7f53152ca640 1 --2- 172.21.15.6:0/3279295616 >> v2:172.21.15.171:3300/0 conn(0x7f53100b1700 0x7f53100b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.617+0000 7f5315acb640 1 --2- 172.21.15.6:0/3279295616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531015d530 0x7f531015aaa0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f53100d3ad0 tx=0x7f530c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db624074b17a764 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.617+0000 7f5314ac9640 1 -- 172.21.15.6:0/3279295616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c037070 con 0x7f531015d530 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.617+0000 7f5314ac9640 1 -- 172.21.15.6:0/3279295616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c032440 con 0x7f531015d530 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.617+0000 7f5314ac9640 1 -- 172.21.15.6:0/3279295616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c032810 con 0x7f531015d530 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.617+0000 7f5317d2f640 1 -- 172.21.15.6:0/3279295616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531015d530 msgr2=0x7f531015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.617+0000 7f5317d2f640 1 --2- 172.21.15.6:0/3279295616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531015d530 0x7f531015aaa0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f53100d3ad0 tx=0x7f530c02a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.618+0000 7f5317d2f640 1 -- 172.21.15.6:0/3279295616 shutdown_connections 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.618+0000 7f5317d2f640 1 --2- 172.21.15.6:0/3279295616 >> v2:172.21.15.171:3300/0 conn(0x7f53100b1700 0x7f53100b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.618+0000 7f5317d2f640 1 --2- 172.21.15.6:0/3279295616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f531015d530 0x7f531015aaa0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.618+0000 7f5317d2f640 1 -- 172.21.15.6:0/3279295616 >> 172.21.15.6:0/3279295616 conn(0x7f53100d29d0 msgr2=0x7f53100d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.618+0000 7f5317d2f640 1 -- 172.21.15.6:0/3279295616 shutdown_connections 2024-05-20T17:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.618+0000 7f5317d2f640 1 -- 172.21.15.6:0/3279295616 wait complete. 2024-05-20T17:56:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.619+0000 7f5317d2f640 1 Processor -- start 2024-05-20T17:56:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.619+0000 7f5317d2f640 1 -- start start 2024-05-20T17:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f5317d2f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5310070850 0x7f53100cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f5317d2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53100b1700 0x7f53100c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f5317d2f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531015d530 0x7f53101550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f5317d2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53100b2050 con 0x7f53100b1700 2024-05-20T17:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f5317d2f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f53100cd230 con 0x7f5310070850 2024-05-20T17:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f5317d2f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5310071370 con 0x7f531015d530 2024-05-20T17:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53100b1700 0x7f53100c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53100b1700 0x7f53100c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46290/0 (socket says 172.21.15.6:46290) 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 -- 172.21.15.6:0/2504739307 learned_addr learned my addr 172.21.15.6:0/2504739307 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f5315acb640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5310070850 0x7f53100cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53162cc640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531015d530 0x7f53101550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 -- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531015d530 msgr2=0x7f53101550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531015d530 0x7f53101550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 -- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5310070850 msgr2=0x7f53100cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5310070850 0x7f53100cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 -- 172.21.15.6:0/2504739307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53101f3e00 con 0x7f53100b1700 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.621+0000 7f53152ca640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53100b1700 0x7f53100c9350 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f530000d7d0 tx=0x7f530000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.622+0000 7f53067fc640 1 -- 172.21.15.6:0/2504739307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300004030 con 0x7f53100b1700 2024-05-20T17:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.622+0000 7f53067fc640 1 -- 172.21.15.6:0/2504739307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53000041d0 con 0x7f53100b1700 2024-05-20T17:56:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.622+0000 7f53067fc640 1 -- 172.21.15.6:0/2504739307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000096a0 con 0x7f53100b1700 2024-05-20T17:56:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.622+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53101f40e0 con 0x7f53100b1700 2024-05-20T17:56:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.622+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53100cb910 con 0x7f53100b1700 2024-05-20T17:56:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.623+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53101f3b70 con 0x7f53100b1700 2024-05-20T17:56:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.623+0000 7f53067fc640 1 -- 172.21.15.6:0/2504739307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5300009840 con 0x7f53100b1700 2024-05-20T17:56:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.624+0000 7f53067fc640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52f406be30 0x7f52f406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.624+0000 7f53067fc640 1 -- 172.21.15.6:0/2504739307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f530008aee0 con 0x7f53100b1700 2024-05-20T17:56:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.624+0000 7f5315acb640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52f406be30 0x7f52f406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.625+0000 7f5315acb640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52f406be30 0x7f52f406e340 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f530c034000 tx=0x7f530c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.629+0000 7f53067fc640 1 -- 172.21.15.6:0/2504739307 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5300059370 con 0x7f53100b1700 2024-05-20T17:56:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.814+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5310075b00 con 0x7f53100b1700 2024-05-20T17:56:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.815+0000 7f53067fc640 1 -- 172.21.15.6:0/2504739307 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f530005d670 con 0x7f53100b1700 2024-05-20T17:56:09.812 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52f406be30 msgr2=0x7f52f406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52f406be30 0x7f52f406e340 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f530c034000 tx=0x7f530c02e000 comp rx=0 tx=0).stop 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53100b1700 msgr2=0x7f53100c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53100b1700 0x7f53100c9350 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f530000d7d0 tx=0x7f530000dc90 comp rx=0 tx=0).stop 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 shutdown_connections 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52f406be30 0x7f52f406e340 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531015d530 0x7f53101550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53100b1700 0x7f53100c9350 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 --2- 172.21.15.6:0/2504739307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5310070850 0x7f53100cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.816+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 >> 172.21.15.6:0/2504739307 conn(0x7f53100d29d0 msgr2=0x7f53100c5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.817+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 shutdown_connections 2024-05-20T17:56:09.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.817+0000 7f5317d2f640 1 -- 172.21.15.6:0/2504739307 wait complete. 2024-05-20T17:56:09.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T17:56:09.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.943+0000 7f4cbb6ca640 1 Processor -- start 2024-05-20T17:56:09.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.943+0000 7f4cbb6ca640 1 -- start start 2024-05-20T17:56:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cbb6ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cb415f700 0x7f4cb415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cbb6ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4cb406c180 0x7f4cb406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cbb6ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb4160430 con 0x7f4cb40af030 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cbb6ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb406bcf0 con 0x7f4cb415f700 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cbb6ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb406b6a0 con 0x7f4cb406c180 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb8c65640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cb415f700 0x7f4cb415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb9466640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4cb40af030 0x7f4cb40af440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54704/0 (socket says 172.21.15.6:54704) 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb9466640 1 -- 172.21.15.6:0/3054108937 learned_addr learned my addr 172.21.15.6:0/3054108937 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb8c65640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cb415f700 0x7f4cb415fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46302/0 (socket says 172.21.15.6:46302) 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb9c67640 1 --2- 172.21.15.6:0/3054108937 >> v2:172.21.15.171:3300/0 conn(0x7f4cb406c180 0x7f4cb406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb8c65640 1 -- 172.21.15.6:0/3054108937 >> v2:172.21.15.171:3300/0 conn(0x7f4cb406c180 msgr2=0x7f4cb406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb8c65640 1 --2- 172.21.15.6:0/3054108937 >> v2:172.21.15.171:3300/0 conn(0x7f4cb406c180 0x7f4cb406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb8c65640 1 -- 172.21.15.6:0/3054108937 >> v1:172.21.15.6:6789/0 conn(0x7f4cb40af030 legacy=0x7f4cb40af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb8c65640 1 -- 172.21.15.6:0/3054108937 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb406b980 con 0x7f4cb415f700 2024-05-20T17:56:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.945+0000 7f4cb3fff640 1 -- 172.21.15.6:0/3054108937 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3517218434 0 0) 0x7f4cb4160430 con 0x7f4cb40af030 2024-05-20T17:56:09.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.946+0000 7f4cb8c65640 1 --2- 172.21.15.6:0/3054108937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb415fb10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4072cd0 tx=0x7f4ca802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abf0f46000da682 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.946+0000 7f4cb3fff640 1 -- 172.21.15.6:0/3054108937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8037070 con 0x7f4cb415f700 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.946+0000 7f4cb3fff640 1 -- 172.21.15.6:0/3054108937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca8032440 con 0x7f4cb415f700 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.946+0000 7f4cb3fff640 1 -- 172.21.15.6:0/3054108937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8032810 con 0x7f4cb415f700 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.947+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/3054108937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 msgr2=0x7f4cb415fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.947+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/3054108937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb415fb10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4072cd0 tx=0x7f4ca802a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.947+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/3054108937 shutdown_connections 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.947+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/3054108937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb415fb10 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.947+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/3054108937 >> v2:172.21.15.171:3300/0 conn(0x7f4cb406c180 0x7f4cb406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.947+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/3054108937 >> 172.21.15.6:0/3054108937 conn(0x7f4cb40b6620 msgr2=0x7f4cb40b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.947+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/3054108937 shutdown_connections 2024-05-20T17:56:09.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.947+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/3054108937 wait complete. 2024-05-20T17:56:09.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.949+0000 7f4cbb6ca640 1 Processor -- start 2024-05-20T17:56:09.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.949+0000 7f4cbb6ca640 1 -- start start 2024-05-20T17:56:09.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cbb6ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cb406c180 0x7f4cb414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cbb6ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40af030 0x7f4cb415a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cbb6ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb409d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cbb6ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb41601d0 con 0x7f4cb415f700 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cbb6ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb4160050 con 0x7f4cb40af030 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cbb6ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb406cad0 con 0x7f4cb406c180 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cb9c67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb409d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cb9c67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb409d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46316/0 (socket says 172.21.15.6:46316) 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.950+0000 7f4cb9c67640 1 -- 172.21.15.6:0/56984776 learned_addr learned my addr 172.21.15.6:0/56984776 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb9466640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cb406c180 0x7f4cb414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb8c65640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40af030 0x7f4cb415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb9c67640 1 -- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cb406c180 msgr2=0x7f4cb414a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb9c67640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cb406c180 0x7f4cb414a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb9c67640 1 -- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40af030 msgr2=0x7f4cb415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb9c67640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40af030 0x7f4cb415a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb9c67640 1 -- 172.21.15.6:0/56984776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb415b340 con 0x7f4cb415f700 2024-05-20T17:56:09.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb8c65640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40af030 0x7f4cb415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:09.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb9c67640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb409d100 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00d5a0 tx=0x7f4cac00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb1ffb640 1 -- 172.21.15.6:0/56984776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0125f0 con 0x7f4cb415f700 2024-05-20T17:56:09.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb1ffb640 1 -- 172.21.15.6:0/56984776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac019070 con 0x7f4cb415f700 2024-05-20T17:56:09.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb415b620 con 0x7f4cb415f700 2024-05-20T17:56:09.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cb1ffb640 1 -- 172.21.15.6:0/56984776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0129b0 con 0x7f4cb415f700 2024-05-20T17:56:09.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.951+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb415bbe0 con 0x7f4cb415f700 2024-05-20T17:56:09.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.953+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb415b090 con 0x7f4cb415f700 2024-05-20T17:56:09.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.953+0000 7f4cb1ffb640 1 -- 172.21.15.6:0/56984776 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cac012b50 con 0x7f4cb415f700 2024-05-20T17:56:09.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.953+0000 7f4cb1ffb640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca006be60 0x7f4ca006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:09.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.954+0000 7f4cb1ffb640 1 -- 172.21.15.6:0/56984776 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f4cac08aff0 con 0x7f4cb415f700 2024-05-20T17:56:09.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.954+0000 7f4cb9466640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca006be60 0x7f4ca006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:09.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.954+0000 7f4cb9466640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca006be60 0x7f4ca006e370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40012e0 tx=0x7f4ca4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:09.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:09.958+0000 7f4cb1ffb640 1 -- 172.21.15.6:0/56984776 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4cac059ae0 con 0x7f4cb415f700 2024-05-20T17:56:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.142+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4cb4075b00 con 0x7f4cb415f700 2024-05-20T17:56:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.143+0000 7f4cb1ffb640 1 -- 172.21.15.6:0/56984776 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) ==== 84+0+65 (secure 0 0 0) 0x7f4cac0593e0 con 0x7f4cb415f700 2024-05-20T17:56:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:10.141 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T17:56:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T17:56:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T17:56:10.141 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:10.141 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.144+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca006be60 msgr2=0x7f4ca006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.144+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca006be60 0x7f4ca006e370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ca40012e0 tx=0x7f4ca4009040 comp rx=0 tx=0).stop 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.144+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 msgr2=0x7f4cb409d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.144+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb409d100 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00d5a0 tx=0x7f4cac00da60 comp rx=0 tx=0).stop 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.144+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 shutdown_connections 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.144+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ca006be60 0x7f4ca006e370 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.144+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cb415f700 0x7f4cb409d100 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.145+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cb40af030 0x7f4cb415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.145+0000 7f4cbb6ca640 1 --2- 172.21.15.6:0/56984776 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cb406c180 0x7f4cb414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.145+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 >> 172.21.15.6:0/56984776 conn(0x7f4cb40b6620 msgr2=0x7f4cb4070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.145+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 shutdown_connections 2024-05-20T17:56:10.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.145+0000 7f4cbb6ca640 1 -- 172.21.15.6:0/56984776 wait complete. 2024-05-20T17:56:10.154 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T17:56:10.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T17:56:10.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.275+0000 7f8c938e7640 1 Processor -- start 2024-05-20T17:56:10.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.275+0000 7f8c938e7640 1 -- start start 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.276+0000 7f8c938e7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c8c0ce330 0x7f8c8c1686b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c938e7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c8c09c350 con 0x7f8c8c0cd810 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c938e7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c8c0cedb0 con 0x7f8c8c0b1df0 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c938e7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8c8c09bc20 con 0x7f8c8c0ce330 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c91e84640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c8c0ce330 0x7f8c8c1686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c90e82640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c8c0cd810 0x7f8c8c0cdc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54716/0 (socket says 172.21.15.6:54716) 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c91e84640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c8c0ce330 0x7f8c8c1686b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46328/0 (socket says 172.21.15.6:46328) 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c90e82640 1 -- 172.21.15.6:0/1262544498 learned_addr learned my addr 172.21.15.6:0/1262544498 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c91e84640 1 -- 172.21.15.6:0/1262544498 >> v1:172.21.15.171:6789/0 conn(0x7f8c8c0b1df0 legacy=0x7f8c8c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c91e84640 1 -- 172.21.15.6:0/1262544498 >> v1:172.21.15.6:6789/0 conn(0x7f8c8c0cd810 legacy=0x7f8c8c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.277+0000 7f8c91e84640 1 -- 172.21.15.6:0/1262544498 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c0d1a50 con 0x7f8c8c0ce330 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.278+0000 7f8c91e84640 1 --2- 172.21.15.6:0/1262544498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c1686b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009d90 tx=0x7f8c8402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4012555266f6e805 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.278+0000 7f8c7ffff640 1 -- 172.21.15.6:0/1262544498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84007740 con 0x7f8c8c0ce330 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.278+0000 7f8c7ffff640 1 -- 172.21.15.6:0/1262544498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c840078e0 con 0x7f8c8c0ce330 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.278+0000 7f8c7ffff640 1 -- 172.21.15.6:0/1262544498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84007cb0 con 0x7f8c8c0ce330 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.279+0000 7f8c938e7640 1 -- 172.21.15.6:0/1262544498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 msgr2=0x7f8c8c1686b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.279+0000 7f8c938e7640 1 --2- 172.21.15.6:0/1262544498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c1686b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009d90 tx=0x7f8c8402a660 comp rx=0 tx=0).stop 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.279+0000 7f8c938e7640 1 -- 172.21.15.6:0/1262544498 shutdown_connections 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.279+0000 7f8c938e7640 1 --2- 172.21.15.6:0/1262544498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c1686b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.279+0000 7f8c938e7640 1 -- 172.21.15.6:0/1262544498 >> 172.21.15.6:0/1262544498 conn(0x7f8c8c0cf450 msgr2=0x7f8c8c0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:10.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.279+0000 7f8c938e7640 1 -- 172.21.15.6:0/1262544498 shutdown_connections 2024-05-20T17:56:10.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.279+0000 7f8c938e7640 1 -- 172.21.15.6:0/1262544498 wait complete. 2024-05-20T17:56:10.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.281+0000 7f8c938e7640 1 Processor -- start 2024-05-20T17:56:10.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.281+0000 7f8c938e7640 1 -- start start 2024-05-20T17:56:10.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c938e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c0b1df0 0x7f8c8c0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c938e7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c0cd810 0x7f8c8c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c938e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c938e7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c0d1670 con 0x7f8c8c0ce330 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c938e7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c0b3d50 con 0x7f8c8c0b1df0 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c938e7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8c0d17f0 con 0x7f8c8c0cd810 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c91e84640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c91e84640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46342/0 (socket says 172.21.15.6:46342) 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.282+0000 7f8c91e84640 1 -- 172.21.15.6:0/3974246383 learned_addr learned my addr 172.21.15.6:0/3974246383 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c90e82640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c0cd810 0x7f8c8c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c91683640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c0b1df0 0x7f8c8c0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c91e84640 1 -- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c0cd810 msgr2=0x7f8c8c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c91e84640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c0cd810 0x7f8c8c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c91e84640 1 -- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c0b1df0 msgr2=0x7f8c8c0c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c91e84640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c0b1df0 0x7f8c8c0c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c91e84640 1 -- 172.21.15.6:0/3974246383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c09e7f0 con 0x7f8c8c0ce330 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c90e82640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c0cd810 0x7f8c8c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c91683640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c0b1df0 0x7f8c8c0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c91e84640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c0c70d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8c8402ac50 tx=0x7f8c84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c7dffb640 1 -- 172.21.15.6:0/3974246383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8403f070 con 0x7f8c8c0ce330 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c7dffb640 1 -- 172.21.15.6:0/3974246383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c84031c90 con 0x7f8c8c0ce330 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c09ead0 con 0x7f8c8c0ce330 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c7dffb640 1 -- 172.21.15.6:0/3974246383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84044680 con 0x7f8c8c0ce330 2024-05-20T17:56:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.283+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c0c7c10 con 0x7f8c8c0ce330 2024-05-20T17:56:10.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.285+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8c0690b0 con 0x7f8c8c0ce330 2024-05-20T17:56:10.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.285+0000 7f8c7dffb640 1 -- 172.21.15.6:0/3974246383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c8403b410 con 0x7f8c8c0ce330 2024-05-20T17:56:10.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.285+0000 7f8c7dffb640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c7006be30 0x7f8c7006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.286+0000 7f8c7dffb640 1 -- 172.21.15.6:0/3974246383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f8c840ac760 con 0x7f8c8c0ce330 2024-05-20T17:56:10.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.286+0000 7f8c91683640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c7006be30 0x7f8c7006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.286+0000 7f8c91683640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c7006be30 0x7f8c7006e340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8c88001690 tx=0x7f8c88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:10.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.290+0000 7f8c7dffb640 1 -- 172.21.15.6:0/3974246383 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8c8407acb0 con 0x7f8c8c0ce330 2024-05-20T17:56:10.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.474+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8c8c09e580 con 0x7f8c8c0ce330 2024-05-20T17:56:10.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.748+0000 7f8c7dffb640 1 -- 172.21.15.6:0/3974246383 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) ==== 138+0+0 (secure 0 0 0) 0x7f8c8407efb0 con 0x7f8c8c0ce330 2024-05-20T17:56:10.746 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T17:56:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c7006be30 msgr2=0x7f8c7006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c7006be30 0x7f8c7006e340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8c88001690 tx=0x7f8c88009040 comp rx=0 tx=0).stop 2024-05-20T17:56:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 msgr2=0x7f8c8c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c0c70d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8c8402ac50 tx=0x7f8c84004a40 comp rx=0 tx=0).stop 2024-05-20T17:56:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 shutdown_connections 2024-05-20T17:56:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c7006be30 0x7f8c7006e340 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c8c0ce330 0x7f8c8c0c70d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c8c0cd810 0x7f8c8c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 --2- 172.21.15.6:0/3974246383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c8c0b1df0 0x7f8c8c0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 >> 172.21.15.6:0/3974246383 conn(0x7f8c8c0cf450 msgr2=0x7f8c8c0cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 shutdown_connections 2024-05-20T17:56:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.750+0000 7f8c938e7640 1 -- 172.21.15.6:0/3974246383 wait complete. 2024-05-20T17:56:10.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T17:56:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.887+0000 7f1b187bc640 1 Processor -- start 2024-05-20T17:56:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.887+0000 7f1b187bc640 1 -- start start 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b187bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b10163c80 0x7f1b1015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b187bc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b100d05c0 con 0x7f1b1006cf20 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b187bc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1006dfe0 con 0x7f1b1015f710 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b187bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1b100d0860 con 0x7f1b10163c80 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b16d59640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1b1006cf20 0x7f1b1006d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54724/0 (socket says 172.21.15.6:54724) 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b16d59640 1 -- 172.21.15.6:0/446727592 learned_addr learned my addr 172.21.15.6:0/446727592 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049775947 0 0) 0x7f1b100d05c0 con 0x7f1b1006cf20 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1af8003520 con 0x7f1b1006cf20 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b16558640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b10163c80 0x7f1b1015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.889+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3415446611 0 0) 0x7f1af8003520 con 0x7f1b1006cf20 2024-05-20T17:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b10163c80 msgr2=0x7f1b1015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b10163c80 0x7f1b1015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 >> v1:172.21.15.171:6789/0 conn(0x7f1b1015f710 legacy=0x7f1b100b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b101631c0 con 0x7f1b1006cf20 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f1b08001690 con 0x7f1b1006cf20 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 >> v1:172.21.15.6:6789/0 conn(0x7f1b1006cf20 legacy=0x7f1b1006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af80039e0 0x7f1af8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b10163c80 0x7f1af8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af8004d40 0x7f1af8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100d0860 con 0x7f1af80039e0 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1af800ba70 con 0x7f1af8004d40 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1af800bc70 con 0x7f1b10163c80 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b16558640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af80039e0 0x7f1af8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b15d57640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b10163c80 0x7f1af8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b16d59640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af8004d40 0x7f1af8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b16558640 1 -- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b10163c80 msgr2=0x7f1af8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b16558640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b10163c80 0x7f1af8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b16558640 1 -- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af8004d40 msgr2=0x7f1af8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b16558640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af8004d40 0x7f1af8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b16558640 1 -- 172.21.15.6:0/446727592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af8003520 con 0x7f1af80039e0 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.890+0000 7f1b16d59640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af8004d40 0x7f1af8005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.891+0000 7f1b16558640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af80039e0 0x7f1af8003e10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009fc0 tx=0x7f1af8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543e1e94239befca server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.891+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00034020 con 0x7f1af80039e0 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.891+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b000305f0 con 0x7f1af80039e0 2024-05-20T17:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.891+0000 7f1b15556640 1 -- 172.21.15.6:0/446727592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00009c10 con 0x7f1af80039e0 2024-05-20T17:56:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.892+0000 7f1b187bc640 1 -- 172.21.15.6:0/446727592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af80039e0 msgr2=0x7f1af8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.892+0000 7f1b187bc640 1 --2- 172.21.15.6:0/446727592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1af80039e0 0x7f1af8003e10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009fc0 tx=0x7f1af8005830 comp rx=0 tx=0).stop 2024-05-20T17:56:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.892+0000 7f1b16d59640 1 -- 172.21.15.6:0/446727592 reap_dead start 2024-05-20T17:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.892+0000 7f1b187bc640 1 -- 172.21.15.6:0/446727592 shutdown_connections 2024-05-20T17:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.892+0000 7f1b187bc640 1 -- 172.21.15.6:0/446727592 >> 172.21.15.6:0/446727592 conn(0x7f1b100d4bd0 msgr2=0x7f1b100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.892+0000 7f1b187bc640 1 -- 172.21.15.6:0/446727592 shutdown_connections 2024-05-20T17:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.892+0000 7f1b187bc640 1 -- 172.21.15.6:0/446727592 wait complete. 2024-05-20T17:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.894+0000 7f1b187bc640 1 Processor -- start 2024-05-20T17:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.894+0000 7f1b187bc640 1 -- start start 2024-05-20T17:56:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b187bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af80039e0 0x7f1b100ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b187bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1014e200 0x7f1b100cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b187bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b1014ea50 0x7f1b1014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b187bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1b100b4040 con 0x7f1b1014e200 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b187bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1b10163780 con 0x7f1af80039e0 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b187bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1b100b41c0 con 0x7f1b1014ea50 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b15d57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1014e200 0x7f1b100cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b15d57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1014e200 0x7f1b100cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46362/0 (socket says 172.21.15.6:46362) 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b15d57640 1 -- 172.21.15.6:0/614445427 learned_addr learned my addr 172.21.15.6:0/614445427 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b16558640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af80039e0 0x7f1b100ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.895+0000 7f1b16d59640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b1014ea50 0x7f1b1014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b15d57640 1 -- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b1014ea50 msgr2=0x7f1b1014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b15d57640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b1014ea50 0x7f1b1014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b15d57640 1 -- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af80039e0 msgr2=0x7f1b100ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b15d57640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af80039e0 0x7f1b100ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b15d57640 1 -- 172.21.15.6:0/614445427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b100cd1b0 con 0x7f1b1014e200 2024-05-20T17:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b15d57640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1014e200 0x7f1b100cc390 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400f780 tx=0x7f1b0400fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b0effd640 1 -- 172.21.15.6:0/614445427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040050d0 con 0x7f1b1014e200 2024-05-20T17:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b0effd640 1 -- 172.21.15.6:0/614445427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b04018070 con 0x7f1b1014e200 2024-05-20T17:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b100cd490 con 0x7f1b1014e200 2024-05-20T17:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b0effd640 1 -- 172.21.15.6:0/614445427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400d730 con 0x7f1b1014e200 2024-05-20T17:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.896+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b100cda50 con 0x7f1b1014e200 2024-05-20T17:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.897+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b100ccf20 con 0x7f1b1014e200 2024-05-20T17:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.898+0000 7f1b0effd640 1 -- 172.21.15.6:0/614445427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b0400d8d0 con 0x7f1b1014e200 2024-05-20T17:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.899+0000 7f1b0effd640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1afc06be60 0x7f1afc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.899+0000 7f1b0effd640 1 -- 172.21.15.6:0/614445427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5619+0+0 (secure 0 0 0) 0x7f1b0408abb0 con 0x7f1b1014e200 2024-05-20T17:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.899+0000 7f1b16558640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1afc06be60 0x7f1afc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.900+0000 7f1b16558640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1afc06be60 0x7f1afc06e370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1b00035000 tx=0x7f1b0002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:10.904+0000 7f1b0effd640 1 -- 172.21.15.6:0/614445427 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1b04059640 con 0x7f1b1014e200 2024-05-20T17:56:11.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.091+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1b100690b0 con 0x7f1b1014e200 2024-05-20T17:56:11.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.759+0000 7f1b0effd640 1 -- 172.21.15.6:0/614445427 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) ==== 170+0+0 (secure 0 0 0) 0x7f1b04058f40 con 0x7f1b1014e200 2024-05-20T17:56:11.757 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1afc06be60 msgr2=0x7f1afc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1afc06be60 0x7f1afc06e370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1b00035000 tx=0x7f1b0002f000 comp rx=0 tx=0).stop 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1014e200 msgr2=0x7f1b100cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1014e200 0x7f1b100cc390 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400f780 tx=0x7f1b0400fb80 comp rx=0 tx=0).stop 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 shutdown_connections 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1afc06be60 0x7f1afc06e370 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b1014ea50 0x7f1b1014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1014e200 0x7f1b100cc390 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 --2- 172.21.15.6:0/614445427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1af80039e0 0x7f1b100ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 >> 172.21.15.6:0/614445427 conn(0x7f1b100d4bd0 msgr2=0x7f1b1015fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 shutdown_connections 2024-05-20T17:56:11.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.762+0000 7f1b187bc640 1 -- 172.21.15.6:0/614445427 wait complete. 2024-05-20T17:56:11.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T17:56:11.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.911+0000 7fe29b7b1640 1 Processor -- start 2024-05-20T17:56:11.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.911+0000 7fe29b7b1640 1 -- start start 2024-05-20T17:56:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe29b7b1640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe294162820 0x7fe2940b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe29b7b1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2940b3e80 0x7fe29406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe29b7b1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29406dd20 con 0x7fe29406d910 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe29b7b1640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe2940d0630 con 0x7fe294162820 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe29b7b1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe2940d39c0 con 0x7fe2940b3e80 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe299d4e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe29406d910 0x7fe2940d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54732/0 (socket says 172.21.15.6:54732) 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe299d4e640 1 -- 172.21.15.6:0/1085750335 learned_addr learned my addr 172.21.15.6:0/1085750335 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe29954d640 1 --2- 172.21.15.6:0/1085750335 >> v2:172.21.15.171:3300/0 conn(0x7fe294162820 0x7fe2940b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe298d4c640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2940b3e80 0x7fe29406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566963263 0 0) 0x7fe28c001490 con 0x7fe29406d910 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.913+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe280003520 con 0x7fe29406d910 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2457270844 0 0) 0x7fe280003520 con 0x7fe29406d910 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2940b3e80 msgr2=0x7fe29406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2940b3e80 0x7fe29406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 >> v2:172.21.15.171:3300/0 conn(0x7fe294162820 msgr2=0x7fe2940b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 --2- 172.21.15.6:0/1085750335 >> v2:172.21.15.171:3300/0 conn(0x7fe294162820 0x7fe2940b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2940d3ca0 con 0x7fe29406d910 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fe28c001bc0 con 0x7fe29406d910 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 >> v1:172.21.15.6:6789/0 conn(0x7fe29406d910 legacy=0x7fe2940d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2940b3e80 0x7fe2800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe280003f30 0x7fe280004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe280004d40 0x7fe280005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe2940d0630 con 0x7fe280004d40 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe2940d39c0 con 0x7fe280003f30 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe28000ba10 con 0x7fe2940b3e80 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe299d4e640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe280004d40 0x7fe280005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe29954d640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2940b3e80 0x7fe2800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe298d4c640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe280003f30 0x7fe280004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe299d4e640 1 -- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2940b3e80 msgr2=0x7fe2800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe299d4e640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2940b3e80 0x7fe2800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe299d4e640 1 -- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe280003f30 msgr2=0x7fe280004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe299d4e640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe280003f30 0x7fe280004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.914+0000 7fe299d4e640 1 -- 172.21.15.6:0/1085750335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe280003520 con 0x7fe280004d40 2024-05-20T17:56:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.915+0000 7fe299d4e640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe280004d40 0x7fe280005150 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe29408e090 tx=0x7fe280005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28f86302f2ab1ef server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.915+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00a670 con 0x7fe280004d40 2024-05-20T17:56:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.915+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c02f070 con 0x7fe280004d40 2024-05-20T17:56:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.915+0000 7fe28bfff640 1 -- 172.21.15.6:0/1085750335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c034470 con 0x7fe280004d40 2024-05-20T17:56:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.916+0000 7fe29b7b1640 1 -- 172.21.15.6:0/1085750335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe280004d40 msgr2=0x7fe280005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.916+0000 7fe29b7b1640 1 --2- 172.21.15.6:0/1085750335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe280004d40 0x7fe280005150 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe29408e090 tx=0x7fe280005830 comp rx=0 tx=0).stop 2024-05-20T17:56:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.916+0000 7fe299d4e640 1 -- 172.21.15.6:0/1085750335 reap_dead start 2024-05-20T17:56:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.916+0000 7fe29b7b1640 1 -- 172.21.15.6:0/1085750335 shutdown_connections 2024-05-20T17:56:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.916+0000 7fe29b7b1640 1 -- 172.21.15.6:0/1085750335 >> 172.21.15.6:0/1085750335 conn(0x7fe2940d4bd0 msgr2=0x7fe2940d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.916+0000 7fe29b7b1640 1 -- 172.21.15.6:0/1085750335 shutdown_connections 2024-05-20T17:56:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.916+0000 7fe29b7b1640 1 -- 172.21.15.6:0/1085750335 wait complete. 2024-05-20T17:56:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.918+0000 7fe29b7b1640 1 Processor -- start 2024-05-20T17:56:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.918+0000 7fe29b7b1640 1 -- start start 2024-05-20T17:56:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe29b7b1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe280004d40 0x7fe294150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe29b7b1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2940c8280 0x7fe29415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe29b7b1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe29415cd20 0x7fe29415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe29b7b1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe2940d0300 con 0x7fe2940c8280 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe29b7b1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe2940d4260 con 0x7fe29415cd20 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe29b7b1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe2940b91a0 con 0x7fe280004d40 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe298d4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2940c8280 0x7fe29415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe298d4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2940c8280 0x7fe29415c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46380/0 (socket says 172.21.15.6:46380) 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe298d4c640 1 -- 172.21.15.6:0/359506658 learned_addr learned my addr 172.21.15.6:0/359506658 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe29954d640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe280004d40 0x7fe294150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.919+0000 7fe299d4e640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe29415cd20 0x7fe29415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe298d4c640 1 -- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe280004d40 msgr2=0x7fe294150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe298d4c640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe280004d40 0x7fe294150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe298d4c640 1 -- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe29415cd20 msgr2=0x7fe29415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe298d4c640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe29415cd20 0x7fe29415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe298d4c640 1 -- 172.21.15.6:0/359506658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29415d130 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe299d4e640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe29415cd20 0x7fe29415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe298d4c640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2940c8280 0x7fe29415c7e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe2840118e0 tx=0x7fe284011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe289ffb640 1 -- 172.21.15.6:0/359506658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28400fa30 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe289ffb640 1 -- 172.21.15.6:0/359506658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28400fbd0 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe289ffb640 1 -- 172.21.15.6:0/359506658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284014440 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2940c8cd0 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.920+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2940c9290 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.921+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29406df00 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.922+0000 7fe289ffb640 1 -- 172.21.15.6:0/359506658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe284012040 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.923+0000 7fe289ffb640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe27806be30 0x7fe27806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.923+0000 7fe289ffb640 1 -- 172.21.15.6:0/359506658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6001+0+0 (secure 0 0 0) 0x7fe28408bc70 con 0x7fe2940c8280 2024-05-20T17:56:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.923+0000 7fe29954d640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe27806be30 0x7fe27806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.924+0000 7fe29954d640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe27806be30 0x7fe27806e340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe290009c40 tx=0x7fe290009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:11.927+0000 7fe289ffb640 1 -- 172.21.15.6:0/359506658 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe29406df00 con 0x7fe2940c8280 2024-05-20T17:56:12.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.149+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe294075b00 con 0x7fe2940c8280 2024-05-20T17:56:12.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.771+0000 7fe289ffb640 1 -- 172.21.15.6:0/359506658 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v32) ==== 173+0+0 (secure 0 0 0) 0x7fe28402b020 con 0x7fe2940c8280 2024-05-20T17:56:12.770 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 9 and data pool 10 2024-05-20T17:56:12.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.788+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe27806be30 msgr2=0x7fe27806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:12.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.788+0000 7fe29b7b1640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe27806be30 0x7fe27806e340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe290009c40 tx=0x7fe290009190 comp rx=0 tx=0).stop 2024-05-20T17:56:12.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.788+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2940c8280 msgr2=0x7fe29415c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:12.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.788+0000 7fe29b7b1640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2940c8280 0x7fe29415c7e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe2840118e0 tx=0x7fe284011ce0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.789+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 shutdown_connections 2024-05-20T17:56:12.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.789+0000 7fe29b7b1640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe27806be30 0x7fe27806e340 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.789+0000 7fe29b7b1640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe29415cd20 0x7fe29415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.789+0000 7fe29b7b1640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2940c8280 0x7fe29415c7e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.789+0000 7fe29b7b1640 1 --2- 172.21.15.6:0/359506658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe280004d40 0x7fe294150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.789+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 >> 172.21.15.6:0/359506658 conn(0x7fe2940d4bd0 msgr2=0x7fe2940b4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.789+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 shutdown_connections 2024-05-20T17:56:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.790+0000 7fe29b7b1640 1 -- 172.21.15.6:0/359506658 wait complete. 2024-05-20T17:56:12.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.929+0000 7f8d0e138640 1 Processor -- start 2024-05-20T17:56:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.929+0000 7f8d0e138640 1 -- start start 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.930+0000 7f8d0e138640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d080cf250 0x7f8d0815f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.930+0000 7f8d0e138640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080d3220 0x7f8d080d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.930+0000 7f8d0e138640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d080d0550 con 0x7f8d080b6680 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.930+0000 7f8d0e138640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8d0815f9a0 con 0x7f8d080cf250 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.930+0000 7f8d0e138640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d080d0b10 con 0x7f8d080d3220 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.930+0000 7f8d077fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d080cf250 0x7f8d0815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.930+0000 7f8d077fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d080cf250 0x7f8d0815f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46392/0 (socket says 172.21.15.6:46392) 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.930+0000 7f8d077fe640 1 -- 172.21.15.6:0/3491763375 learned_addr learned my addr 172.21.15.6:0/3491763375 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.931+0000 7f8d07fff640 1 --2- 172.21.15.6:0/3491763375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080d3220 0x7f8d080d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.931+0000 7f8d077fe640 1 -- 172.21.15.6:0/3491763375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080d3220 msgr2=0x7f8d080d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.931+0000 7f8d077fe640 1 --2- 172.21.15.6:0/3491763375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080d3220 0x7f8d080d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.931+0000 7f8d077fe640 1 -- 172.21.15.6:0/3491763375 >> v1:172.21.15.171:6789/0 conn(0x7f8d080b6680 legacy=0x7f8d080b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.931+0000 7f8d077fe640 1 -- 172.21.15.6:0/3491763375 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d080d0830 con 0x7f8d080cf250 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d077fe640 1 --2- 172.21.15.6:0/3491763375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d0815f460 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009870 tx=0x7f8cf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e17e793ee6c1a7d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d067fc640 1 -- 172.21.15.6:0/3491763375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8037070 con 0x7f8d080cf250 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d067fc640 1 -- 172.21.15.6:0/3491763375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf8032440 con 0x7f8d080cf250 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d067fc640 1 -- 172.21.15.6:0/3491763375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8032810 con 0x7f8d080cf250 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d0e138640 1 -- 172.21.15.6:0/3491763375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 msgr2=0x7f8d0815f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d0e138640 1 --2- 172.21.15.6:0/3491763375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d0815f460 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009870 tx=0x7f8cf802a270 comp rx=0 tx=0).stop 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d0e138640 1 -- 172.21.15.6:0/3491763375 shutdown_connections 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d0e138640 1 --2- 172.21.15.6:0/3491763375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080d3220 0x7f8d080d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d0e138640 1 --2- 172.21.15.6:0/3491763375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d0815f460 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.932+0000 7f8d0e138640 1 -- 172.21.15.6:0/3491763375 >> 172.21.15.6:0/3491763375 conn(0x7f8d080d1860 msgr2=0x7f8d080d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.933+0000 7f8d0e138640 1 -- 172.21.15.6:0/3491763375 shutdown_connections 2024-05-20T17:56:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.933+0000 7f8d0e138640 1 -- 172.21.15.6:0/3491763375 wait complete. 2024-05-20T17:56:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.934+0000 7f8d0e138640 1 Processor -- start 2024-05-20T17:56:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.935+0000 7f8d0e138640 1 -- start start 2024-05-20T17:56:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d0e138640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080b6680 0x7f8d08158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d0e138640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d081f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d0e138640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080d3220 0x7f8d080c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d0e138640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d080d2d00 con 0x7f8d080cf250 2024-05-20T17:56:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d0e138640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d080d27d0 con 0x7f8d080d3220 2024-05-20T17:56:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d0e138640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d080d0140 con 0x7f8d080b6680 2024-05-20T17:56:12.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d081f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d081f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46406/0 (socket says 172.21.15.6:46406) 2024-05-20T17:56:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d06ffd640 1 -- 172.21.15.6:0/944116302 learned_addr learned my addr 172.21.15.6:0/944116302 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d077fe640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080b6680 0x7f8d08158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:12.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d07fff640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080d3220 0x7f8d080c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d06ffd640 1 -- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080b6680 msgr2=0x7f8d08158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d06ffd640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080b6680 0x7f8d08158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d06ffd640 1 -- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080d3220 msgr2=0x7f8d080c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d06ffd640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080d3220 0x7f8d080c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.936+0000 7f8d06ffd640 1 -- 172.21.15.6:0/944116302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d08158f70 con 0x7f8d080cf250 2024-05-20T17:56:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.937+0000 7f8d06ffd640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d081f52c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00c3f0 tx=0x7f8cfc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.937+0000 7f8ceffff640 1 -- 172.21.15.6:0/944116302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0052d0 con 0x7f8d080cf250 2024-05-20T17:56:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.937+0000 7f8ceffff640 1 -- 172.21.15.6:0/944116302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cfc005490 con 0x7f8d080cf250 2024-05-20T17:56:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.937+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d08159250 con 0x7f8d080cf250 2024-05-20T17:56:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.937+0000 7f8ceffff640 1 -- 172.21.15.6:0/944116302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc007260 con 0x7f8d080cf250 2024-05-20T17:56:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.937+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d08153ec0 con 0x7f8d080cf250 2024-05-20T17:56:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.938+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d08075b00 con 0x7f8d080cf250 2024-05-20T17:56:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.938+0000 7f8ceffff640 1 -- 172.21.15.6:0/944116302 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cfc007400 con 0x7f8d080cf250 2024-05-20T17:56:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.939+0000 7f8ceffff640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8cf406be60 0x7f8cf406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.939+0000 7f8ceffff640 1 -- 172.21.15.6:0/944116302 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f8cfc08a520 con 0x7f8d080cf250 2024-05-20T17:56:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.939+0000 7f8d077fe640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8cf406be60 0x7f8cf406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.940+0000 7f8d077fe640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8cf406be60 0x7f8cf406e370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8034000 tx=0x7f8cf802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:12.944+0000 7f8ceffff640 1 -- 172.21.15.6:0/944116302 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8cfc0585e0 con 0x7f8d080cf250 2024-05-20T17:56:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.129+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d080b6d40 con 0x7f8d080cf250 2024-05-20T17:56:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.130+0000 7f8ceffff640 1 -- 172.21.15.6:0/944116302 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16849 (secure 0 0 0) 0x7f8cfc05c8e0 con 0x7f8d080cf250 2024-05-20T17:56:13.129 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:13.129 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:12.150410+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:10.505890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:11.122304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8cf406be60 msgr2=0x7f8cf406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8cf406be60 0x7f8cf406e370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8034000 tx=0x7f8cf802e000 comp rx=0 tx=0).stop 2024-05-20T17:56:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 msgr2=0x7f8d081f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d081f52c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00c3f0 tx=0x7f8cfc00c8b0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 shutdown_connections 2024-05-20T17:56:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8cf406be60 0x7f8cf406e370 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080d3220 0x7f8d080c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d080cf250 0x7f8d081f52c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 --2- 172.21.15.6:0/944116302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080b6680 0x7f8d08158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 >> 172.21.15.6:0/944116302 conn(0x7f8d080d1860 msgr2=0x7f8d080b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 shutdown_connections 2024-05-20T17:56:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.133+0000 7f8d0e138640 1 -- 172.21.15.6:0/944116302 wait complete. 2024-05-20T17:56:13.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.262+0000 7f9a88336640 1 Processor -- start 2024-05-20T17:56:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.262+0000 7f9a88336640 1 -- start start 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.263+0000 7f9a88336640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a801602f0 0x7f9a8009a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.263+0000 7f9a88336640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a80160700 con 0x7f9a8006da80 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.263+0000 7f9a88336640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8009ae40 con 0x7f9a8009aa30 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.263+0000 7f9a88336640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9a80159da0 con 0x7f9a801602f0 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.263+0000 7f9a860d2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9a8006da80 0x7f9a800b1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54738/0 (socket says 172.21.15.6:54738) 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.263+0000 7f9a860d2640 1 -- 172.21.15.6:0/3018617340 learned_addr learned my addr 172.21.15.6:0/3018617340 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.263+0000 7f9a858d1640 1 --2- 172.21.15.6:0/3018617340 >> v2:172.21.15.6:3300/0 conn(0x7f9a801602f0 0x7f9a8009a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.264+0000 7f9a858d1640 1 -- 172.21.15.6:0/3018617340 >> v1:172.21.15.171:6789/0 conn(0x7f9a8009aa30 legacy=0x7f9a800d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.264+0000 7f9a858d1640 1 -- 172.21.15.6:0/3018617340 >> v1:172.21.15.6:6789/0 conn(0x7f9a8006da80 legacy=0x7f9a800b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.264+0000 7f9a850d0640 1 -- 172.21.15.6:0/3018617340 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459188885 0 0) 0x7f9a70001490 con 0x7f9a8006da80 2024-05-20T17:56:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.264+0000 7f9a858d1640 1 -- 172.21.15.6:0/3018617340 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a800af9d0 con 0x7f9a801602f0 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a858d1640 1 --2- 172.21.15.6:0/3018617340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a8009a4f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009790 tx=0x7f9a7402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31d4113bec4d0b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a850d0640 1 -- 172.21.15.6:0/3018617340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a74037070 con 0x7f9a801602f0 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a850d0640 1 -- 172.21.15.6:0/3018617340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7402ae40 con 0x7f9a801602f0 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a850d0640 1 -- 172.21.15.6:0/3018617340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a74032660 con 0x7f9a801602f0 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a88336640 1 -- 172.21.15.6:0/3018617340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 msgr2=0x7f9a8009a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a88336640 1 --2- 172.21.15.6:0/3018617340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a8009a4f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009790 tx=0x7f9a7402a130 comp rx=0 tx=0).stop 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a88336640 1 -- 172.21.15.6:0/3018617340 shutdown_connections 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a88336640 1 --2- 172.21.15.6:0/3018617340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a8009a4f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.265+0000 7f9a88336640 1 -- 172.21.15.6:0/3018617340 >> 172.21.15.6:0/3018617340 conn(0x7f9a800b6670 msgr2=0x7f9a800b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.266+0000 7f9a88336640 1 -- 172.21.15.6:0/3018617340 shutdown_connections 2024-05-20T17:56:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.266+0000 7f9a88336640 1 -- 172.21.15.6:0/3018617340 wait complete. 2024-05-20T17:56:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.267+0000 7f9a88336640 1 Processor -- start 2024-05-20T17:56:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.267+0000 7f9a88336640 1 -- start start 2024-05-20T17:56:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a88336640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8006da80 0x7f9a8014a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a88336640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a8009aa30 0x7f9a8009c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a88336640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a801f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a88336640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800d17b0 con 0x7f9a801602f0 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a88336640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9a800af1c0 con 0x7f9a8006da80 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a88336640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9a800b2390 con 0x7f9a8009aa30 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a801f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a801f6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46436/0 (socket says 172.21.15.6:46436) 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 -- 172.21.15.6:0/3387718627 learned_addr learned my addr 172.21.15.6:0/3387718627 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a858d1640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a8009aa30 0x7f9a8009c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a860d2640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8006da80 0x7f9a8014a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 -- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a8009aa30 msgr2=0x7f9a8009c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a8009aa30 0x7f9a8009c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 -- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8006da80 msgr2=0x7f9a8014a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8006da80 0x7f9a8014a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 -- 172.21.15.6:0/3387718627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a801f5de0 con 0x7f9a801602f0 2024-05-20T17:56:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.269+0000 7f9a868d3640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a801f6290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800b3e0 tx=0x7f9a7800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.270+0000 7f9a7effd640 1 -- 172.21.15.6:0/3387718627 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78015030 con 0x7f9a801602f0 2024-05-20T17:56:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.270+0000 7f9a7effd640 1 -- 172.21.15.6:0/3387718627 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a78004020 con 0x7f9a801602f0 2024-05-20T17:56:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.270+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8009d510 con 0x7f9a801602f0 2024-05-20T17:56:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.270+0000 7f9a7effd640 1 -- 172.21.15.6:0/3387718627 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78004450 con 0x7f9a801602f0 2024-05-20T17:56:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.270+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8009dad0 con 0x7f9a801602f0 2024-05-20T17:56:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.271+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8009d280 con 0x7f9a801602f0 2024-05-20T17:56:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.271+0000 7f9a7effd640 1 -- 172.21.15.6:0/3387718627 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a78018070 con 0x7f9a801602f0 2024-05-20T17:56:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.272+0000 7f9a7effd640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9a6c06be30 0x7f9a6c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.272+0000 7f9a7effd640 1 -- 172.21.15.6:0/3387718627 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f9a7808a900 con 0x7f9a801602f0 2024-05-20T17:56:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.272+0000 7f9a860d2640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9a6c06be30 0x7f9a6c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.273+0000 7f9a860d2640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9a6c06be30 0x7f9a6c06e340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9a700012e0 tx=0x7f9a70001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:13.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.276+0000 7f9a7effd640 1 -- 172.21.15.6:0/3387718627 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9a78058ad0 con 0x7f9a801602f0 2024-05-20T17:56:13.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.461+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a800b0a60 con 0x7f9a801602f0 2024-05-20T17:56:13.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.462+0000 7f9a7effd640 1 -- 172.21.15.6:0/3387718627 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16849 (secure 0 0 0) 0x7f9a800b0a60 con 0x7f9a801602f0 2024-05-20T17:56:13.460 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:13.461 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:12.150410+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:10.505890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:11.122304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:13.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9a6c06be30 msgr2=0x7f9a6c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9a6c06be30 0x7f9a6c06e340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9a700012e0 tx=0x7f9a70001630 comp rx=0 tx=0).stop 2024-05-20T17:56:13.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 msgr2=0x7f9a801f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a801f6290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800b3e0 tx=0x7f9a7800b8a0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 shutdown_connections 2024-05-20T17:56:13.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9a6c06be30 0x7f9a6c06e340 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a801602f0 0x7f9a801f6290 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9a8009aa30 0x7f9a8009c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 --2- 172.21.15.6:0/3387718627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a8006da80 0x7f9a8014a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 >> 172.21.15.6:0/3387718627 conn(0x7f9a800b6670 msgr2=0x7f9a80160f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:13.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 shutdown_connections 2024-05-20T17:56:13.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.464+0000 7f9a88336640 1 -- 172.21.15.6:0/3387718627 wait complete. 2024-05-20T17:56:13.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T17:56:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.593+0000 7f07f3f72640 1 Processor -- start 2024-05-20T17:56:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.593+0000 7f07f3f72640 1 -- start start 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.594+0000 7f07f3f72640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07ec163a10 0x7f07ec0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.594+0000 7f07f3f72640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f07ec0d14b0 0x7f07ec0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.594+0000 7f07f3f72640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ec0d0370 con 0x7f07ec0b4010 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.594+0000 7f07f3f72640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f07ec0d3ca0 con 0x7f07ec163a10 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.594+0000 7f07f3f72640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f07ec0d0650 con 0x7f07ec0d14b0 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.594+0000 7f07f1d0e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07ec163a10 0x7f07ec0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.594+0000 7f07f1d0e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07ec163a10 0x7f07ec0d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46452/0 (socket says 172.21.15.6:46452) 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.594+0000 7f07f1d0e640 1 -- 172.21.15.6:0/4033815871 learned_addr learned my addr 172.21.15.6:0/4033815871 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.595+0000 7f07f250f640 1 --2- 172.21.15.6:0/4033815871 >> v2:172.21.15.171:3300/0 conn(0x7f07ec0d14b0 0x7f07ec0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.595+0000 7f07f1d0e640 1 -- 172.21.15.6:0/4033815871 >> v2:172.21.15.171:3300/0 conn(0x7f07ec0d14b0 msgr2=0x7f07ec0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.595+0000 7f07f1d0e640 1 --2- 172.21.15.6:0/4033815871 >> v2:172.21.15.171:3300/0 conn(0x7f07ec0d14b0 0x7f07ec0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.595+0000 7f07f1d0e640 1 -- 172.21.15.6:0/4033815871 >> v1:172.21.15.171:6789/0 conn(0x7f07ec0b4010 legacy=0x7f07ec0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.595+0000 7f07f1d0e640 1 -- 172.21.15.6:0/4033815871 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec0d3650 con 0x7f07ec163a10 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.595+0000 7f07f1d0e640 1 --2- 172.21.15.6:0/4033815871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec163a10 0x7f07ec0d4130 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0b4590 tx=0x7f07e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923b31590f5f3044 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f0d0c640 1 -- 172.21.15.6:0/4033815871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8037070 con 0x7f07ec163a10 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f0d0c640 1 -- 172.21.15.6:0/4033815871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e8032440 con 0x7f07ec163a10 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f0d0c640 1 -- 172.21.15.6:0/4033815871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e8032810 con 0x7f07ec163a10 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f3f72640 1 -- 172.21.15.6:0/4033815871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec163a10 msgr2=0x7f07ec0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f3f72640 1 --2- 172.21.15.6:0/4033815871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec163a10 0x7f07ec0d4130 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0b4590 tx=0x7f07e802a230 comp rx=0 tx=0).stop 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f3f72640 1 -- 172.21.15.6:0/4033815871 shutdown_connections 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f3f72640 1 --2- 172.21.15.6:0/4033815871 >> v2:172.21.15.171:3300/0 conn(0x7f07ec0d14b0 0x7f07ec0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f3f72640 1 --2- 172.21.15.6:0/4033815871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec163a10 0x7f07ec0d4130 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f3f72640 1 -- 172.21.15.6:0/4033815871 >> 172.21.15.6:0/4033815871 conn(0x7f07ec06d240 msgr2=0x7f07ec06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f3f72640 1 -- 172.21.15.6:0/4033815871 shutdown_connections 2024-05-20T17:56:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.596+0000 7f07f3f72640 1 -- 172.21.15.6:0/4033815871 wait complete. 2024-05-20T17:56:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.598+0000 7f07f3f72640 1 Processor -- start 2024-05-20T17:56:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.598+0000 7f07f3f72640 1 -- start start 2024-05-20T17:56:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.599+0000 7f07f3f72640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ec0b4010 0x7f07ec15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.599+0000 7f07f3f72640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec0d14b0 0x7f07ec158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.599+0000 7f07f3f72640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ec163a10 0x7f07ec0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f3f72640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec0b8210 con 0x7f07ec0d14b0 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f3f72640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec0d1e00 con 0x7f07ec163a10 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f3f72640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f07ec0b8390 con 0x7f07ec0b4010 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec0d14b0 0x7f07ec158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec0d14b0 0x7f07ec158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46466/0 (socket says 172.21.15.6:46466) 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 -- 172.21.15.6:0/1750477764 learned_addr learned my addr 172.21.15.6:0/1750477764 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f1d0e640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ec0b4010 0x7f07ec15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f250f640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ec163a10 0x7f07ec0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 -- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ec0b4010 msgr2=0x7f07ec15a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ec0b4010 0x7f07ec15a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 -- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ec163a10 msgr2=0x7f07ec0cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ec163a10 0x7f07ec0cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 -- 172.21.15.6:0/1750477764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec15ad00 con 0x7f07ec0d14b0 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f1d0e640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ec0b4010 0x7f07ec15a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f150d640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec0d14b0 0x7f07ec158640 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00b3f0 tx=0x7f07dc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07e27fc640 1 -- 172.21.15.6:0/1750477764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc015020 con 0x7f07ec0d14b0 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07e27fc640 1 -- 172.21.15.6:0/1750477764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc011830 con 0x7f07ec0d14b0 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ec15afe0 con 0x7f07ec0d14b0 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.600+0000 7f07e27fc640 1 -- 172.21.15.6:0/1750477764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc011c20 con 0x7f07ec0d14b0 2024-05-20T17:56:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.601+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ec15b5a0 con 0x7f07ec0d14b0 2024-05-20T17:56:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.601+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ec15aa40 con 0x7f07ec0d14b0 2024-05-20T17:56:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.602+0000 7f07e27fc640 1 -- 172.21.15.6:0/1750477764 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07dc018020 con 0x7f07ec0d14b0 2024-05-20T17:56:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.603+0000 7f07e27fc640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f07d006be30 0x7f07d006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.603+0000 7f07e27fc640 1 -- 172.21.15.6:0/1750477764 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f07dc08ae40 con 0x7f07ec0d14b0 2024-05-20T17:56:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.603+0000 7f07f1d0e640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f07d006be30 0x7f07d006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.603+0000 7f07f1d0e640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f07d006be30 0x7f07d006e340 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f07e8034000 tx=0x7f07e802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.607+0000 7f07e27fc640 1 -- 172.21.15.6:0/1750477764 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f07dc01f030 con 0x7f07ec0d14b0 2024-05-20T17:56:13.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:13.832+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f07ec075b00 con 0x7f07ec0d14b0 2024-05-20T17:56:14.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.782+0000 7f07e27fc640 1 -- 172.21.15.6:0/1750477764 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) ==== 118+0+0 (secure 0 0 0) 0x7f07dc0172c0 con 0x7f07ec0d14b0 2024-05-20T17:56:14.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f07d006be30 msgr2=0x7f07d006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:14.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f07d006be30 0x7f07d006e340 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f07e8034000 tx=0x7f07e802e000 comp rx=0 tx=0).stop 2024-05-20T17:56:14.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec0d14b0 msgr2=0x7f07ec158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:14.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec0d14b0 0x7f07ec158640 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00b3f0 tx=0x7f07dc00b8b0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 shutdown_connections 2024-05-20T17:56:14.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f07d006be30 0x7f07d006e340 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07ec163a10 0x7f07ec0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07ec0d14b0 0x7f07ec158640 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 --2- 172.21.15.6:0/1750477764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f07ec0b4010 0x7f07ec15a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 >> 172.21.15.6:0/1750477764 conn(0x7f07ec06d240 msgr2=0x7f07ec15f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:14.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 shutdown_connections 2024-05-20T17:56:14.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.785+0000 7f07f3f72640 1 -- 172.21.15.6:0/1750477764 wait complete. 2024-05-20T17:56:14.797 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T17:56:14.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T17:56:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.924+0000 7f3bcda84640 1 Processor -- start 2024-05-20T17:56:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.924+0000 7f3bcda84640 1 -- start start 2024-05-20T17:56:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bcda84640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bc8162820 0x7f3bc80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bcda84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 0x7f3bc806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bcda84640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc806dd20 con 0x7f3bc806d910 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bcda84640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3bc80d0630 con 0x7f3bc8162820 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bcda84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc80d39c0 con 0x7f3bc80b3e80 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bc8162820 0x7f3bc80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bc8162820 0x7f3bc80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46476/0 (socket says 172.21.15.6:46476) 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc77fe640 1 -- 172.21.15.6:0/3740793306 learned_addr learned my addr 172.21.15.6:0/3740793306 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc7fff640 1 --1- 172.21.15.6:0/3740793306 >> v1:172.21.15.6:6789/0 conn(0x7f3bc806d910 0x7f3bc80d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54754/0 (socket says 172.21.15.6:54754) 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc6ffd640 1 --2- 172.21.15.6:0/3740793306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 0x7f3bc806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc77fe640 1 -- 172.21.15.6:0/3740793306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 msgr2=0x7f3bc806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc77fe640 1 --2- 172.21.15.6:0/3740793306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 0x7f3bc806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc77fe640 1 -- 172.21.15.6:0/3740793306 >> v1:172.21.15.6:6789/0 conn(0x7f3bc806d910 legacy=0x7f3bc80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc77fe640 1 -- 172.21.15.6:0/3740793306 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc80d3ca0 con 0x7f3bc8162820 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.926+0000 7f3bc67fc640 1 -- 172.21.15.6:0/3740793306 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261535001 0 0) 0x7f3bc0001490 con 0x7f3bc806d910 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.927+0000 7f3bc77fe640 1 --2- 172.21.15.6:0/3740793306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80b3940 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009870 tx=0x7f3bb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4223411b28b5b3b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.927+0000 7f3bc67fc640 1 -- 172.21.15.6:0/3740793306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8037070 con 0x7f3bc8162820 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.927+0000 7f3bc67fc640 1 -- 172.21.15.6:0/3740793306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb8032440 con 0x7f3bc8162820 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.927+0000 7f3bc67fc640 1 -- 172.21.15.6:0/3740793306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8032810 con 0x7f3bc8162820 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.928+0000 7f3bcda84640 1 -- 172.21.15.6:0/3740793306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 msgr2=0x7f3bc80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.928+0000 7f3bcda84640 1 --2- 172.21.15.6:0/3740793306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80b3940 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009870 tx=0x7f3bb802a270 comp rx=0 tx=0).stop 2024-05-20T17:56:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.928+0000 7f3bcda84640 1 -- 172.21.15.6:0/3740793306 shutdown_connections 2024-05-20T17:56:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.928+0000 7f3bcda84640 1 --2- 172.21.15.6:0/3740793306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 0x7f3bc806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.928+0000 7f3bcda84640 1 --2- 172.21.15.6:0/3740793306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80b3940 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.928+0000 7f3bcda84640 1 -- 172.21.15.6:0/3740793306 >> 172.21.15.6:0/3740793306 conn(0x7f3bc80d4bd0 msgr2=0x7f3bc80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.928+0000 7f3bcda84640 1 -- 172.21.15.6:0/3740793306 shutdown_connections 2024-05-20T17:56:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.928+0000 7f3bcda84640 1 -- 172.21.15.6:0/3740793306 wait complete. 2024-05-20T17:56:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.930+0000 7f3bcda84640 1 Processor -- start 2024-05-20T17:56:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.930+0000 7f3bcda84640 1 -- start start 2024-05-20T17:56:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.931+0000 7f3bcda84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc806d910 0x7f3bc80cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.931+0000 7f3bcda84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 0x7f3bc81f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.931+0000 7f3bcda84640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.931+0000 7f3bcda84640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80d0300 con 0x7f3bc8162820 2024-05-20T17:56:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.931+0000 7f3bcda84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80d4260 con 0x7f3bc806d910 2024-05-20T17:56:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.931+0000 7f3bcda84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc80b91a0 con 0x7f3bc80b3e80 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46486/0 (socket says 172.21.15.6:46486) 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 -- 172.21.15.6:0/1479831636 learned_addr learned my addr 172.21.15.6:0/1479831636 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc6ffd640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 0x7f3bc81f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc77fe640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc806d910 0x7f3bc80cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 -- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 msgr2=0x7f3bc81f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 0x7f3bc81f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 -- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc806d910 msgr2=0x7f3bc80cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc806d910 0x7f3bc80cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 -- 172.21.15.6:0/1479831636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc80ce840 con 0x7f3bc8162820 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bc7fff640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80cbc80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c6d0 tx=0x7f3bc000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3baffff640 1 -- 172.21.15.6:0/1479831636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0018070 con 0x7f3bc8162820 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3baffff640 1 -- 172.21.15.6:0/1479831636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc0004d60 con 0x7f3bc8162820 2024-05-20T17:56:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc80ceb20 con 0x7f3bc8162820 2024-05-20T17:56:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3baffff640 1 -- 172.21.15.6:0/1479831636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000a880 con 0x7f3bc8162820 2024-05-20T17:56:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.932+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc80cf0e0 con 0x7f3bc8162820 2024-05-20T17:56:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.933+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc8075b00 con 0x7f3bc8162820 2024-05-20T17:56:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.934+0000 7f3baffff640 1 -- 172.21.15.6:0/1479831636 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bc001b070 con 0x7f3bc8162820 2024-05-20T17:56:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.934+0000 7f3baffff640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bb406be30 0x7f3bb406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.935+0000 7f3baffff640 1 -- 172.21.15.6:0/1479831636 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f3bc008a560 con 0x7f3bc8162820 2024-05-20T17:56:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.935+0000 7f3bc77fe640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bb406be30 0x7f3bb406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.935+0000 7f3bc77fe640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bb406be30 0x7f3bb406e340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8034000 tx=0x7f3bb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:14.939+0000 7f3baffff640 1 -- 172.21.15.6:0/1479831636 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3bc806dd20 con 0x7f3bc8162820 2024-05-20T17:56:15.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.161+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3bc80ba920 con 0x7f3bc8162820 2024-05-20T17:56:15.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.784+0000 7f3baffff640 1 -- 172.21.15.6:0/1479831636 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f3bc00586a0 con 0x7f3bc8162820 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bb406be30 msgr2=0x7f3bb406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bb406be30 0x7f3bb406e340 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8034000 tx=0x7f3bb802e000 comp rx=0 tx=0).stop 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 msgr2=0x7f3bc80cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80cbc80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c6d0 tx=0x7f3bc000cb90 comp rx=0 tx=0).stop 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 shutdown_connections 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bb406be30 0x7f3bb406e340 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bc8162820 0x7f3bc80cbc80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bc80b3e80 0x7f3bc81f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 --2- 172.21.15.6:0/1479831636 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bc806d910 0x7f3bc80cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 >> 172.21.15.6:0/1479831636 conn(0x7f3bc80d4bd0 msgr2=0x7f3bc80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 shutdown_connections 2024-05-20T17:56:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.787+0000 7f3bcda84640 1 -- 172.21.15.6:0/1479831636 wait complete. 2024-05-20T17:56:15.800 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T17:56:15.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.925+0000 7f9fa0db5640 1 Processor -- start 2024-05-20T17:56:15.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.925+0000 7f9fa0db5640 1 -- start start 2024-05-20T17:56:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9fa0db5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f9c162820 0x7f9f9c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9fa0db5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9f9c06dae0 0x7f9f9c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9fa0db5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f9c0d0630 con 0x7f9f9c0b3e80 2024-05-20T17:56:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9fa0db5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9f9c0d39c0 con 0x7f9f9c162820 2024-05-20T17:56:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9fa0db5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9f9c0d3ca0 con 0x7f9f9c06dae0 2024-05-20T17:56:15.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f9c162820 0x7f9f9c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f99d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9f9c0b3e80 0x7f9f9c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54760/0 (socket says 172.21.15.6:54760) 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f9c162820 0x7f9f9c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46498/0 (socket says 172.21.15.6:46498) 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f99d9b640 1 -- 172.21.15.6:0/1761592245 learned_addr learned my addr 172.21.15.6:0/1761592245 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9ad9d640 1 --2- 172.21.15.6:0/1761592245 >> v2:172.21.15.171:3300/0 conn(0x7f9f9c06dae0 0x7f9f9c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9a59c640 1 -- 172.21.15.6:0/1761592245 >> v2:172.21.15.171:3300/0 conn(0x7f9f9c06dae0 msgr2=0x7f9f9c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9a59c640 1 --2- 172.21.15.6:0/1761592245 >> v2:172.21.15.171:3300/0 conn(0x7f9f9c06dae0 0x7f9f9c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9a59c640 1 -- 172.21.15.6:0/1761592245 >> v1:172.21.15.6:6789/0 conn(0x7f9f9c0b3e80 legacy=0x7f9f9c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9a59c640 1 -- 172.21.15.6:0/1761592245 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c0d3f80 con 0x7f9f9c162820 2024-05-20T17:56:15.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9959a640 1 -- 172.21.15.6:0/1761592245 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378923399 0 0) 0x7f9f9c0d0630 con 0x7f9f9c0b3e80 2024-05-20T17:56:15.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.927+0000 7f9f9ad9d640 1 --2- 172.21.15.6:0/1761592245 >> v2:172.21.15.171:3300/0 conn(0x7f9f9c06dae0 0x7f9f9c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.928+0000 7f9f9a59c640 1 --2- 172.21.15.6:0/1761592245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c0b3940 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c08e070 tx=0x7f9f8c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab85777ae0bb37af server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.928+0000 7f9f9959a640 1 -- 172.21.15.6:0/1761592245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c037070 con 0x7f9f9c162820 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.928+0000 7f9f9959a640 1 -- 172.21.15.6:0/1761592245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f8c032440 con 0x7f9f9c162820 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.928+0000 7f9f9959a640 1 -- 172.21.15.6:0/1761592245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c032810 con 0x7f9f9c162820 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.929+0000 7f9fa0db5640 1 -- 172.21.15.6:0/1761592245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 msgr2=0x7f9f9c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.929+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/1761592245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c0b3940 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c08e070 tx=0x7f9f8c02a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.929+0000 7f9fa0db5640 1 -- 172.21.15.6:0/1761592245 shutdown_connections 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.929+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/1761592245 >> v2:172.21.15.171:3300/0 conn(0x7f9f9c06dae0 0x7f9f9c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.929+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/1761592245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c0b3940 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.929+0000 7f9fa0db5640 1 -- 172.21.15.6:0/1761592245 >> 172.21.15.6:0/1761592245 conn(0x7f9f9c0d4bd0 msgr2=0x7f9f9c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:15.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.929+0000 7f9fa0db5640 1 -- 172.21.15.6:0/1761592245 shutdown_connections 2024-05-20T17:56:15.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.929+0000 7f9fa0db5640 1 -- 172.21.15.6:0/1761592245 wait complete. 2024-05-20T17:56:15.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.931+0000 7f9fa0db5640 1 Processor -- start 2024-05-20T17:56:15.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.931+0000 7f9fa0db5640 1 -- start start 2024-05-20T17:56:15.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9fa0db5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9c0b3e80 0x7f9f9c0ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:15.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9fa0db5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9fa0db5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9c156090 0x7f9f9c0b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9fa0db5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c0d4780 con 0x7f9f9c162820 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9fa0db5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c0d0300 con 0x7f9f9c156090 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9fa0db5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f9c0d4900 con 0x7f9f9c0b3e80 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9f99d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9f99d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c14afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46504/0 (socket says 172.21.15.6:46504) 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.932+0000 7f9f99d9b640 1 -- 172.21.15.6:0/603491013 learned_addr learned my addr 172.21.15.6:0/603491013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f9a59c640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9c0b3e80 0x7f9f9c0ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f9ad9d640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9c156090 0x7f9f9c0b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f99d9b640 1 -- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9c0b3e80 msgr2=0x7f9f9c0ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f99d9b640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9c0b3e80 0x7f9f9c0ba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f99d9b640 1 -- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9c156090 msgr2=0x7f9f9c0b91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f99d9b640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9c156090 0x7f9f9c0b91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f99d9b640 1 -- 172.21.15.6:0/603491013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c0b4570 con 0x7f9f9c162820 2024-05-20T17:56:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f9ad9d640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9c156090 0x7f9f9c0b91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f99d9b640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c14afd0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c430 tx=0x7f9f9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f8affd640 1 -- 172.21.15.6:0/603491013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f900074e0 con 0x7f9f9c162820 2024-05-20T17:56:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f8affd640 1 -- 172.21.15.6:0/603491013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f900047e0 con 0x7f9f9c162820 2024-05-20T17:56:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9c0b4850 con 0x7f9f9c162820 2024-05-20T17:56:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9f8affd640 1 -- 172.21.15.6:0/603491013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90004bd0 con 0x7f9f9c162820 2024-05-20T17:56:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.933+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c0b4e10 con 0x7f9f9c162820 2024-05-20T17:56:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.934+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9c075b00 con 0x7f9f9c162820 2024-05-20T17:56:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.935+0000 7f9f8affd640 1 -- 172.21.15.6:0/603491013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f90011070 con 0x7f9f9c162820 2024-05-20T17:56:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.936+0000 7f9f8affd640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f7c06be30 0x7f9f7c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.936+0000 7f9f8affd640 1 -- 172.21.15.6:0/603491013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f9f9008ac80 con 0x7f9f9c162820 2024-05-20T17:56:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.936+0000 7f9f9a59c640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f7c06be30 0x7f9f7c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.937+0000 7f9f9a59c640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f7c06be30 0x7f9f7c06e340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c034000 tx=0x7f9f8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:15.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:15.941+0000 7f9f8affd640 1 -- 172.21.15.6:0/603491013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f90059370 con 0x7f9f9c162820 2024-05-20T17:56:16.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.162+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f9c0b3620 con 0x7f9f9c162820 2024-05-20T17:56:16.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.162+0000 7f9f8affd640 1 -- 172.21.15.6:0/603491013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5182 (secure 0 0 0) 0x7f9f90058c70 con 0x7f9f9c162820 2024-05-20T17:56:16.160 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:16.160 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2318422221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2318422221},{"type":"v1","addr":"172.21.15.6:6835","nonce":2318422221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1262536376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1262536376},{"type":"v1","addr":"172.21.15.171:6836","nonce":1262536376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2875796025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2875796025},{"type":"v1","addr":"172.21.15.171:6837","nonce":2875796025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:12.150755+0000","modified":"2024-05-20T17:56:15.161874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6297":{"gid":6297,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3730828520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3730828520},{"type":"v1","addr":"172.21.15.6:6834","nonce":3730828520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6297,"qdb_cluster":[6297]},"id":4}]} 2024-05-20T17:56:16.161 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 36 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f7c06be30 msgr2=0x7f9f7c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f7c06be30 0x7f9f7c06e340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c034000 tx=0x7f9f8c02e000 comp rx=0 tx=0).stop 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 msgr2=0x7f9f9c14afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c14afd0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c430 tx=0x7f9f9000c8f0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 shutdown_connections 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f7c06be30 0x7f9f7c06e340 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f9c156090 0x7f9f9c0b91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f9c162820 0x7f9f9c14afd0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 --2- 172.21.15.6:0/603491013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f9c0b3e80 0x7f9f9c0ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.164+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 >> 172.21.15.6:0/603491013 conn(0x7f9f9c0d4bd0 msgr2=0x7f9f9c15fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.165+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 shutdown_connections 2024-05-20T17:56:16.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.165+0000 7f9fa0db5640 1 -- 172.21.15.6:0/603491013 wait complete. 2024-05-20T17:56:16.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:16.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.292+0000 7f746f13e640 1 Processor -- start 2024-05-20T17:56:16.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.292+0000 7f746f13e640 1 -- start start 2024-05-20T17:56:16.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f746f13e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 0x7f74680b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f746f13e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74680b3e80 0x7f746806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f746f13e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f746806dd20 con 0x7f746806d910 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f746f13e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f74680d0630 con 0x7f74680b3e80 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f746f13e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74680d39c0 con 0x7f7468162820 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f7467fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74680b3e80 0x7f746806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f746d6db640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f746806d910 0x7f74680d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54774/0 (socket says 172.21.15.6:54774) 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f7467fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74680b3e80 0x7f746806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46510/0 (socket says 172.21.15.6:46510) 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f746d6db640 1 -- 172.21.15.6:0/2414228009 learned_addr learned my addr 172.21.15.6:0/2414228009 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.293+0000 7f746ceda640 1 --2- 172.21.15.6:0/2414228009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 0x7f74680b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.294+0000 7f7467fff640 1 -- 172.21.15.6:0/2414228009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 msgr2=0x7f74680b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.294+0000 7f7467fff640 1 --2- 172.21.15.6:0/2414228009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 0x7f74680b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.294+0000 7f7467fff640 1 -- 172.21.15.6:0/2414228009 >> v1:172.21.15.6:6789/0 conn(0x7f746806d910 legacy=0x7f74680d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.294+0000 7f7467fff640 1 -- 172.21.15.6:0/2414228009 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74680d3ca0 con 0x7f74680b3e80 2024-05-20T17:56:16.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.294+0000 7f74677fe640 1 -- 172.21.15.6:0/2414228009 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882738070 0 0) 0x7f7460001110 con 0x7f746806d910 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.294+0000 7f7467fff640 1 --2- 172.21.15.6:0/2414228009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74680b3e80 0x7f746806d3d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7450009d90 tx=0x7f745002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874a806f3b444367 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.294+0000 7f74677fe640 1 -- 172.21.15.6:0/2414228009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450007740 con 0x7f74680b3e80 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f74677fe640 1 -- 172.21.15.6:0/2414228009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74500078e0 con 0x7f74680b3e80 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f74677fe640 1 -- 172.21.15.6:0/2414228009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450007cb0 con 0x7f74680b3e80 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f746f13e640 1 -- 172.21.15.6:0/2414228009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74680b3e80 msgr2=0x7f746806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f746f13e640 1 --2- 172.21.15.6:0/2414228009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74680b3e80 0x7f746806d3d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7450009d90 tx=0x7f745002a660 comp rx=0 tx=0).stop 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f746f13e640 1 -- 172.21.15.6:0/2414228009 shutdown_connections 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f746f13e640 1 --2- 172.21.15.6:0/2414228009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74680b3e80 0x7f746806d3d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f746f13e640 1 --2- 172.21.15.6:0/2414228009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 0x7f74680b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f746f13e640 1 -- 172.21.15.6:0/2414228009 >> 172.21.15.6:0/2414228009 conn(0x7f74680d4bd0 msgr2=0x7f74680d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:16.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f746f13e640 1 -- 172.21.15.6:0/2414228009 shutdown_connections 2024-05-20T17:56:16.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.295+0000 7f746f13e640 1 -- 172.21.15.6:0/2414228009 wait complete. 2024-05-20T17:56:16.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.297+0000 7f746f13e640 1 Processor -- start 2024-05-20T17:56:16.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.297+0000 7f746f13e640 1 -- start start 2024-05-20T17:56:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.298+0000 7f746f13e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746806d910 0x7f74680c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.298+0000 7f746f13e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b3e80 0x7f74680cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746f13e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 0x7f74681f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746f13e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74680d0300 con 0x7f746806d910 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746f13e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74680d4260 con 0x7f74680b3e80 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746f13e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74680b91a0 con 0x7f7468162820 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746806d910 0x7f74680c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746806d910 0x7f74680c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46518/0 (socket says 172.21.15.6:46518) 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 -- 172.21.15.6:0/2178072554 learned_addr learned my addr 172.21.15.6:0/2178072554 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746d6db640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 0x7f74681f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 -- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 msgr2=0x7f74681f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f7467fff640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b3e80 0x7f74680cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 0x7f74681f5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 -- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b3e80 msgr2=0x7f74680cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b3e80 0x7f74680cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 -- 172.21.15.6:0/2178072554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74680c92e0 con 0x7f746806d910 2024-05-20T17:56:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746ceda640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746806d910 0x7f74680c8da0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f745800e870 tx=0x7f745800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f74657fa640 1 -- 172.21.15.6:0/2178072554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458017070 con 0x7f746806d910 2024-05-20T17:56:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74680ce2e0 con 0x7f746806d910 2024-05-20T17:56:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f74657fa640 1 -- 172.21.15.6:0/2178072554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745800c940 con 0x7f746806d910 2024-05-20T17:56:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f74657fa640 1 -- 172.21.15.6:0/2178072554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745800cd30 con 0x7f746806d910 2024-05-20T17:56:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.299+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74680c9a00 con 0x7f746806d910 2024-05-20T17:56:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.300+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7468075b00 con 0x7f746806d910 2024-05-20T17:56:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.301+0000 7f74657fa640 1 -- 172.21.15.6:0/2178072554 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f745801a070 con 0x7f746806d910 2024-05-20T17:56:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.301+0000 7f74657fa640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f744806be30 0x7f744806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.302+0000 7f74657fa640 1 -- 172.21.15.6:0/2178072554 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f745808afb0 con 0x7f746806d910 2024-05-20T17:56:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.302+0000 7f7467fff640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f744806be30 0x7f744806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.302+0000 7f7467fff640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f744806be30 0x7f744806e340 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7450034000 tx=0x7f7450033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.306+0000 7f74657fa640 1 -- 172.21.15.6:0/2178072554 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f74580596c0 con 0x7f746806d910 2024-05-20T17:56:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.490+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7468068a90 con 0x7f746806d910 2024-05-20T17:56:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.492+0000 7f74657fa640 1 -- 172.21.15.6:0/2178072554 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16836 (secure 0 0 0) 0x7f7458058fc0 con 0x7f746806d910 2024-05-20T17:56:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:16.490 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":64,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:13.770370+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:10.505890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:11.122304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f744806be30 msgr2=0x7f744806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f744806be30 0x7f744806e340 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7450034000 tx=0x7f7450033040 comp rx=0 tx=0).stop 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746806d910 msgr2=0x7f74680c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746806d910 0x7f74680c8da0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f745800e870 tx=0x7f745800ed30 comp rx=0 tx=0).stop 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 shutdown_connections 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f744806be30 0x7f744806e340 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468162820 0x7f74681f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b3e80 0x7f74680cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 --2- 172.21.15.6:0/2178072554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746806d910 0x7f74680c8da0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 >> 172.21.15.6:0/2178072554 conn(0x7f74680d4bd0 msgr2=0x7f746815ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 shutdown_connections 2024-05-20T17:56:16.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.494+0000 7f746f13e640 1 -- 172.21.15.6:0/2178072554 wait complete. 2024-05-20T17:56:16.503 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T17:56:16.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:56:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.621+0000 7faf988fe640 1 Processor -- start 2024-05-20T17:56:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.621+0000 7faf988fe640 1 -- start start 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf988fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 0x7faf940b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf988fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faf940b3e80 0x7faf9406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf988fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf9406d910 0x7faf940d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf988fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7faf9406dd20 con 0x7faf9406d910 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf988fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7faf940d0630 con 0x7faf940b3e80 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf988fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf940d39c0 con 0x7faf94162820 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf92d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf9406d910 0x7faf940d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf92d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf9406d910 0x7faf940d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46534/0 (socket says 172.21.15.6:46534) 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf92d9d640 1 -- 172.21.15.6:0/1067522852 learned_addr learned my addr 172.21.15.6:0/1067522852 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf8bfff640 1 --2- 172.21.15.6:0/1067522852 >> v2:172.21.15.171:3300/0 conn(0x7faf940b3e80 0x7faf9406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.622+0000 7faf9259c640 1 --2- 172.21.15.6:0/1067522852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 0x7faf940b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.623+0000 7faf92d9d640 1 -- 172.21.15.6:0/1067522852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 msgr2=0x7faf940b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:16.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.623+0000 7faf92d9d640 1 --2- 172.21.15.6:0/1067522852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 0x7faf940b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.623+0000 7faf92d9d640 1 -- 172.21.15.6:0/1067522852 >> v2:172.21.15.171:3300/0 conn(0x7faf940b3e80 msgr2=0x7faf9406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:16.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.623+0000 7faf92d9d640 1 --2- 172.21.15.6:0/1067522852 >> v2:172.21.15.171:3300/0 conn(0x7faf940b3e80 0x7faf9406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.623+0000 7faf92d9d640 1 -- 172.21.15.6:0/1067522852 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf940d3ca0 con 0x7faf9406d910 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.623+0000 7faf92d9d640 1 --2- 172.21.15.6:0/1067522852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9406d910 0x7faf940d27a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faf9408d710 tx=0x7faf8c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34137fe608166333 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf91d9b640 1 -- 172.21.15.6:0/1067522852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c036070 con 0x7faf9406d910 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf91d9b640 1 -- 172.21.15.6:0/1067522852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c031600 con 0x7faf9406d910 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf91d9b640 1 -- 172.21.15.6:0/1067522852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0319d0 con 0x7faf9406d910 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 -- 172.21.15.6:0/1067522852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9406d910 msgr2=0x7faf940d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 --2- 172.21.15.6:0/1067522852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9406d910 0x7faf940d27a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faf9408d710 tx=0x7faf8c02a6a0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 -- 172.21.15.6:0/1067522852 shutdown_connections 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 --2- 172.21.15.6:0/1067522852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf9406d910 0x7faf940d27a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 --2- 172.21.15.6:0/1067522852 >> v2:172.21.15.171:3300/0 conn(0x7faf940b3e80 0x7faf9406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 --2- 172.21.15.6:0/1067522852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 0x7faf940b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 -- 172.21.15.6:0/1067522852 >> 172.21.15.6:0/1067522852 conn(0x7faf940d4bd0 msgr2=0x7faf940d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:16.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 -- 172.21.15.6:0/1067522852 shutdown_connections 2024-05-20T17:56:16.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.624+0000 7faf988fe640 1 -- 172.21.15.6:0/1067522852 wait complete. 2024-05-20T17:56:16.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.626+0000 7faf988fe640 1 Processor -- start 2024-05-20T17:56:16.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.626+0000 7faf988fe640 1 -- start start 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf988fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf9406d910 0x7faf941f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf988fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf940b3e80 0x7faf940ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf988fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 0x7faf940caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf988fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faf940d0300 con 0x7faf940b3e80 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf988fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faf940d4260 con 0x7faf9406d910 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf988fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf940d4780 con 0x7faf94162820 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf940b3e80 0x7faf940ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf940b3e80 0x7faf940ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46540/0 (socket says 172.21.15.6:46540) 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 -- 172.21.15.6:0/3775263713 learned_addr learned my addr 172.21.15.6:0/3775263713 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:16.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf9259c640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf9406d910 0x7faf941f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf92d9d640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 0x7faf940caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 -- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 msgr2=0x7faf940caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 0x7faf940caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 -- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf9406d910 msgr2=0x7faf941f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf9406d910 0x7faf941f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 -- 172.21.15.6:0/3775263713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf940b5220 con 0x7faf940b3e80 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.628+0000 7faf8bfff640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf940b3e80 0x7faf940ca4e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00e840 tx=0x7faf7c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.629+0000 7faf8affd640 1 -- 172.21.15.6:0/3775263713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c017070 con 0x7faf940b3e80 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.629+0000 7faf8affd640 1 -- 172.21.15.6:0/3775263713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c00c730 con 0x7faf940b3e80 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.629+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf940b5500 con 0x7faf940b3e80 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.629+0000 7faf8affd640 1 -- 172.21.15.6:0/3775263713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00cb20 con 0x7faf940b3e80 2024-05-20T17:56:16.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.629+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf940b5ac0 con 0x7faf940b3e80 2024-05-20T17:56:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.630+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf94075b00 con 0x7faf940b3e80 2024-05-20T17:56:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.630+0000 7faf8affd640 1 -- 172.21.15.6:0/3775263713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf7c01a070 con 0x7faf940b3e80 2024-05-20T17:56:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.631+0000 7faf8affd640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7406be60 0x7faf7406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.631+0000 7faf8affd640 1 -- 172.21.15.6:0/3775263713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7faf7c08ad20 con 0x7faf940b3e80 2024-05-20T17:56:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.631+0000 7faf9259c640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7406be60 0x7faf7406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.632+0000 7faf9259c640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7406be60 0x7faf7406e370 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faf84009aa0 tx=0x7faf84009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:16.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.635+0000 7faf8affd640 1 -- 172.21.15.6:0/3775263713 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faf7c058ef0 con 0x7faf940b3e80 2024-05-20T17:56:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.820+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf9406d3d0 con 0x7faf7406be60 2024-05-20T17:56:16.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.827+0000 7faf8affd640 1 -- 172.21.15.6:0/3775263713 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251984 (secure 0 0 0) 0x7faf9406d3d0 con 0x7faf7406be60 2024-05-20T17:56:16.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:16.829 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:56:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7406be60 msgr2=0x7faf7406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7406be60 0x7faf7406e370 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faf84009aa0 tx=0x7faf84009190 comp rx=0 tx=0).stop 2024-05-20T17:56:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf940b3e80 msgr2=0x7faf940ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf940b3e80 0x7faf940ca4e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00e840 tx=0x7faf7c00ed00 comp rx=0 tx=0).stop 2024-05-20T17:56:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 shutdown_connections 2024-05-20T17:56:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7406be60 0x7faf7406e370 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf94162820 0x7faf940caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf940b3e80 0x7faf940ca4e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 --2- 172.21.15.6:0/3775263713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf9406d910 0x7faf941f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.830+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 >> 172.21.15.6:0/3775263713 conn(0x7faf940d4bd0 msgr2=0x7faf940b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.831+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 shutdown_connections 2024-05-20T17:56:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.831+0000 7faf988fe640 1 -- 172.21.15.6:0/3775263713 wait complete. 2024-05-20T17:56:16.840 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-05-20T17:56:16.279421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235884,"kb_used_data":7200,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738836,"statfs":{"total":773094113280,"available":772852568064,"internally_reserved":0,"allocated":7372800,"data_stored":3954188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.527130"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.787486+0000","last_change":"2024-05-20T17:56:12.783237+0000","last_active":"2024-05-20T17:56:12.787486+0000","last_peered":"2024-05-20T17:56:12.787486+0000","last_clean":"2024-05-20T17:56:12.787486+0000","last_became_active":"2024-05-20T17:56:12.782594+0000","last_became_peered":"2024-05-20T17:56:12.782594+0000","last_unstale":"2024-05-20T17:56:12.787486+0000","last_undegraded":"2024-05-20T17:56:12.787486+0000","last_fullsized":"2024-05-20T17:56:12.787486+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:34:34.049613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.786108+0000","last_change":"2024-05-20T17:56:12.781871+0000","last_active":"2024-05-20T17:56:12.786108+0000","last_peered":"2024-05-20T17:56:12.786108+0000","last_clean":"2024-05-20T17:56:12.786108+0000","last_became_active":"2024-05-20T17:56:12.779369+0000","last_became_peered":"2024-05-20T17:56:12.779369+0000","last_unstale":"2024-05-20T17:56:12.786108+0000","last_undegraded":"2024-05-20T17:56:12.786108+0000","last_fullsized":"2024-05-20T17:56:12.786108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:17.126038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.799110+0000","last_change":"2024-05-20T17:56:12.797125+0000","last_active":"2024-05-20T17:56:12.799110+0000","last_peered":"2024-05-20T17:56:12.799110+0000","last_clean":"2024-05-20T17:56:12.799110+0000","last_became_active":"2024-05-20T17:56:12.796792+0000","last_became_peered":"2024-05-20T17:56:12.796792+0000","last_unstale":"2024-05-20T17:56:12.799110+0000","last_undegraded":"2024-05-20T17:56:12.799110+0000","last_fullsized":"2024-05-20T17:56:12.799110+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:00.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780490+0000","last_change":"2024-05-20T17:56:12.774205+0000","last_active":"2024-05-20T17:56:13.780490+0000","last_peered":"2024-05-20T17:56:13.780490+0000","last_clean":"2024-05-20T17:56:13.780490+0000","last_became_active":"2024-05-20T17:56:12.773901+0000","last_became_peered":"2024-05-20T17:56:12.773901+0000","last_unstale":"2024-05-20T17:56:13.780490+0000","last_undegraded":"2024-05-20T17:56:13.780490+0000","last_fullsized":"2024-05-20T17:56:13.780490+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:34:34.049613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.780711+0000","last_change":"2024-05-20T17:56:12.778191+0000","last_active":"2024-05-20T17:56:12.780711+0000","last_peered":"2024-05-20T17:56:12.780711+0000","last_clean":"2024-05-20T17:56:12.780711+0000","last_became_active":"2024-05-20T17:56:12.777871+0000","last_became_peered":"2024-05-20T17:56:12.777871+0000","last_unstale":"2024-05-20T17:56:12.780711+0000","last_undegraded":"2024-05-20T17:56:12.780711+0000","last_fullsized":"2024-05-20T17:56:12.780711+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:16:10.631543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.782831+0000","last_change":"2024-05-20T17:56:12.776986+0000","last_active":"2024-05-20T17:56:12.782831+0000","last_peered":"2024-05-20T17:56:12.782831+0000","last_clean":"2024-05-20T17:56:12.782831+0000","last_became_active":"2024-05-20T17:56:12.776659+0000","last_became_peered":"2024-05-20T17:56:12.776659+0000","last_unstale":"2024-05-20T17:56:12.782831+0000","last_undegraded":"2024-05-20T17:56:12.782831+0000","last_fullsized":"2024-05-20T17:56:12.782831+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:29:47.605742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969150+0000","last_change":"2024-05-20T17:56:12.791412+0000","last_active":"2024-05-20T17:56:13.969150+0000","last_peered":"2024-05-20T17:56:13.969150+0000","last_clean":"2024-05-20T17:56:13.969150+0000","last_became_active":"2024-05-20T17:56:12.791054+0000","last_became_peered":"2024-05-20T17:56:12.791054+0000","last_unstale":"2024-05-20T17:56:13.969150+0000","last_undegraded":"2024-05-20T17:56:13.969150+0000","last_fullsized":"2024-05-20T17:56:13.969150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:51.163588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779152+0000","last_change":"2024-05-20T17:56:12.787597+0000","last_active":"2024-05-20T17:56:13.779152+0000","last_peered":"2024-05-20T17:56:13.779152+0000","last_clean":"2024-05-20T17:56:13.779152+0000","last_became_active":"2024-05-20T17:56:12.787265+0000","last_became_peered":"2024-05-20T17:56:12.787265+0000","last_unstale":"2024-05-20T17:56:13.779152+0000","last_undegraded":"2024-05-20T17:56:13.779152+0000","last_fullsized":"2024-05-20T17:56:13.779152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:37.994076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798179+0000","last_change":"2024-05-20T17:56:12.796401+0000","last_active":"2024-05-20T17:56:12.798179+0000","last_peered":"2024-05-20T17:56:12.798179+0000","last_clean":"2024-05-20T17:56:12.798179+0000","last_became_active":"2024-05-20T17:56:12.796066+0000","last_became_peered":"2024-05-20T17:56:12.796066+0000","last_unstale":"2024-05-20T17:56:12.798179+0000","last_undegraded":"2024-05-20T17:56:12.798179+0000","last_fullsized":"2024-05-20T17:56:12.798179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:49:49.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.797968+0000","last_change":"2024-05-20T17:56:12.795506+0000","last_active":"2024-05-20T17:56:12.797968+0000","last_peered":"2024-05-20T17:56:12.797968+0000","last_clean":"2024-05-20T17:56:12.797968+0000","last_became_active":"2024-05-20T17:56:12.795182+0000","last_became_peered":"2024-05-20T17:56:12.795182+0000","last_unstale":"2024-05-20T17:56:12.797968+0000","last_undegraded":"2024-05-20T17:56:12.797968+0000","last_fullsized":"2024-05-20T17:56:12.797968+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:23.926207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780288+0000","last_change":"2024-05-20T17:56:12.785040+0000","last_active":"2024-05-20T17:56:13.780288+0000","last_peered":"2024-05-20T17:56:13.780288+0000","last_clean":"2024-05-20T17:56:13.780288+0000","last_became_active":"2024-05-20T17:56:12.784662+0000","last_became_peered":"2024-05-20T17:56:12.784662+0000","last_unstale":"2024-05-20T17:56:13.780288+0000","last_undegraded":"2024-05-20T17:56:13.780288+0000","last_fullsized":"2024-05-20T17:56:13.780288+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:36.820883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779474+0000","last_change":"2024-05-20T17:56:12.786729+0000","last_active":"2024-05-20T17:56:13.779474+0000","last_peered":"2024-05-20T17:56:13.779474+0000","last_clean":"2024-05-20T17:56:13.779474+0000","last_became_active":"2024-05-20T17:56:12.786374+0000","last_became_peered":"2024-05-20T17:56:12.786374+0000","last_unstale":"2024-05-20T17:56:13.779474+0000","last_undegraded":"2024-05-20T17:56:13.779474+0000","last_fullsized":"2024-05-20T17:56:13.779474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:14.154819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779788+0000","last_change":"2024-05-20T17:56:12.778776+0000","last_active":"2024-05-20T17:56:13.779788+0000","last_peered":"2024-05-20T17:56:13.779788+0000","last_clean":"2024-05-20T17:56:13.779788+0000","last_became_active":"2024-05-20T17:56:12.778443+0000","last_became_peered":"2024-05-20T17:56:12.778443+0000","last_unstale":"2024-05-20T17:56:13.779788+0000","last_undegraded":"2024-05-20T17:56:13.779788+0000","last_fullsized":"2024-05-20T17:56:13.779788+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:49:46.488232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798975+0000","last_change":"2024-05-20T17:56:12.796708+0000","last_active":"2024-05-20T17:56:12.798975+0000","last_peered":"2024-05-20T17:56:12.798975+0000","last_clean":"2024-05-20T17:56:12.798975+0000","last_became_active":"2024-05-20T17:56:12.796362+0000","last_became_peered":"2024-05-20T17:56:12.796362+0000","last_unstale":"2024-05-20T17:56:12.798975+0000","last_undegraded":"2024-05-20T17:56:12.798975+0000","last_fullsized":"2024-05-20T17:56:12.798975+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:14.154819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.789225+0000","last_change":"2024-05-20T17:56:12.787407+0000","last_active":"2024-05-20T17:56:12.789225+0000","last_peered":"2024-05-20T17:56:12.789225+0000","last_clean":"2024-05-20T17:56:12.789225+0000","last_became_active":"2024-05-20T17:56:12.787112+0000","last_became_peered":"2024-05-20T17:56:12.787112+0000","last_unstale":"2024-05-20T17:56:12.789225+0000","last_undegraded":"2024-05-20T17:56:12.789225+0000","last_fullsized":"2024-05-20T17:56:12.789225+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:55.084619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969088+0000","last_change":"2024-05-20T17:56:12.784716+0000","last_active":"2024-05-20T17:56:13.969088+0000","last_peered":"2024-05-20T17:56:13.969088+0000","last_clean":"2024-05-20T17:56:13.969088+0000","last_became_active":"2024-05-20T17:56:12.784363+0000","last_became_peered":"2024-05-20T17:56:12.784363+0000","last_unstale":"2024-05-20T17:56:13.969088+0000","last_undegraded":"2024-05-20T17:56:13.969088+0000","last_fullsized":"2024-05-20T17:56:13.969088+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:47:11.707549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.787514+0000","last_change":"2024-05-20T17:56:12.783501+0000","last_active":"2024-05-20T17:56:12.787514+0000","last_peered":"2024-05-20T17:56:12.787514+0000","last_clean":"2024-05-20T17:56:12.787514+0000","last_became_active":"2024-05-20T17:56:12.782930+0000","last_became_peered":"2024-05-20T17:56:12.782930+0000","last_unstale":"2024-05-20T17:56:12.787514+0000","last_undegraded":"2024-05-20T17:56:12.787514+0000","last_fullsized":"2024-05-20T17:56:12.787514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:20.265559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780178+0000","last_change":"2024-05-20T17:56:12.772715+0000","last_active":"2024-05-20T17:56:13.780178+0000","last_peered":"2024-05-20T17:56:13.780178+0000","last_clean":"2024-05-20T17:56:13.780178+0000","last_became_active":"2024-05-20T17:56:12.772412+0000","last_became_peered":"2024-05-20T17:56:12.772412+0000","last_unstale":"2024-05-20T17:56:13.780178+0000","last_undegraded":"2024-05-20T17:56:13.780178+0000","last_fullsized":"2024-05-20T17:56:13.780178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:40.141714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.788967+0000","last_change":"2024-05-20T17:56:12.783961+0000","last_active":"2024-05-20T17:56:12.788967+0000","last_peered":"2024-05-20T17:56:12.788967+0000","last_clean":"2024-05-20T17:56:12.788967+0000","last_became_active":"2024-05-20T17:56:12.783470+0000","last_became_peered":"2024-05-20T17:56:12.783470+0000","last_unstale":"2024-05-20T17:56:12.788967+0000","last_undegraded":"2024-05-20T17:56:12.788967+0000","last_fullsized":"2024-05-20T17:56:12.788967+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:36.820883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778783+0000","last_change":"2024-05-20T17:56:12.778733+0000","last_active":"2024-05-20T17:56:13.778783+0000","last_peered":"2024-05-20T17:56:13.778783+0000","last_clean":"2024-05-20T17:56:13.778783+0000","last_became_active":"2024-05-20T17:56:12.778376+0000","last_became_peered":"2024-05-20T17:56:12.778376+0000","last_unstale":"2024-05-20T17:56:13.778783+0000","last_undegraded":"2024-05-20T17:56:13.778783+0000","last_fullsized":"2024-05-20T17:56:13.778783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:01:35.061949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779397+0000","last_change":"2024-05-20T17:56:12.779824+0000","last_active":"2024-05-20T17:56:13.779397+0000","last_peered":"2024-05-20T17:56:13.779397+0000","last_clean":"2024-05-20T17:56:13.779397+0000","last_became_active":"2024-05-20T17:56:12.779386+0000","last_became_peered":"2024-05-20T17:56:12.779386+0000","last_unstale":"2024-05-20T17:56:13.779397+0000","last_undegraded":"2024-05-20T17:56:13.779397+0000","last_fullsized":"2024-05-20T17:56:13.779397+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:49:49.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778550+0000","last_change":"2024-05-20T17:56:12.780197+0000","last_active":"2024-05-20T17:56:13.778550+0000","last_peered":"2024-05-20T17:56:13.778550+0000","last_clean":"2024-05-20T17:56:13.778550+0000","last_became_active":"2024-05-20T17:56:12.779866+0000","last_became_peered":"2024-05-20T17:56:12.779866+0000","last_unstale":"2024-05-20T17:56:13.778550+0000","last_undegraded":"2024-05-20T17:56:13.778550+0000","last_fullsized":"2024-05-20T17:56:13.778550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:12.761389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778522+0000","last_change":"2024-05-20T17:56:12.781024+0000","last_active":"2024-05-20T17:56:13.778522+0000","last_peered":"2024-05-20T17:56:13.778522+0000","last_clean":"2024-05-20T17:56:13.778522+0000","last_became_active":"2024-05-20T17:56:12.780719+0000","last_became_peered":"2024-05-20T17:56:12.780719+0000","last_unstale":"2024-05-20T17:56:13.778522+0000","last_undegraded":"2024-05-20T17:56:13.778522+0000","last_fullsized":"2024-05-20T17:56:13.778522+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:22:57.647585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.789179+0000","last_change":"2024-05-20T17:56:12.786113+0000","last_active":"2024-05-20T17:56:12.789179+0000","last_peered":"2024-05-20T17:56:12.789179+0000","last_clean":"2024-05-20T17:56:12.789179+0000","last_became_active":"2024-05-20T17:56:12.785726+0000","last_became_peered":"2024-05-20T17:56:12.785726+0000","last_unstale":"2024-05-20T17:56:12.789179+0000","last_undegraded":"2024-05-20T17:56:12.789179+0000","last_fullsized":"2024-05-20T17:56:12.789179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:15:12.065585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780615+0000","last_change":"2024-05-20T17:56:12.782347+0000","last_active":"2024-05-20T17:56:13.780615+0000","last_peered":"2024-05-20T17:56:13.780615+0000","last_clean":"2024-05-20T17:56:13.780615+0000","last_became_active":"2024-05-20T17:56:12.782009+0000","last_became_peered":"2024-05-20T17:56:12.782009+0000","last_unstale":"2024-05-20T17:56:13.780615+0000","last_undegraded":"2024-05-20T17:56:13.780615+0000","last_fullsized":"2024-05-20T17:56:13.780615+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:09.470600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779596+0000","last_change":"2024-05-20T17:56:12.792647+0000","last_active":"2024-05-20T17:56:13.779596+0000","last_peered":"2024-05-20T17:56:13.779596+0000","last_clean":"2024-05-20T17:56:13.779596+0000","last_became_active":"2024-05-20T17:56:12.792348+0000","last_became_peered":"2024-05-20T17:56:12.792348+0000","last_unstale":"2024-05-20T17:56:13.779596+0000","last_undegraded":"2024-05-20T17:56:13.779596+0000","last_fullsized":"2024-05-20T17:56:13.779596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:00.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780332+0000","last_change":"2024-05-20T17:56:12.783863+0000","last_active":"2024-05-20T17:56:13.780332+0000","last_peered":"2024-05-20T17:56:13.780332+0000","last_clean":"2024-05-20T17:56:13.780332+0000","last_became_active":"2024-05-20T17:56:12.783514+0000","last_became_peered":"2024-05-20T17:56:12.783514+0000","last_unstale":"2024-05-20T17:56:13.780332+0000","last_undegraded":"2024-05-20T17:56:13.780332+0000","last_fullsized":"2024-05-20T17:56:13.780332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:14.592909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.787521+0000","last_change":"2024-05-20T17:56:12.782741+0000","last_active":"2024-05-20T17:56:12.787521+0000","last_peered":"2024-05-20T17:56:12.787521+0000","last_clean":"2024-05-20T17:56:12.787521+0000","last_became_active":"2024-05-20T17:56:12.782297+0000","last_became_peered":"2024-05-20T17:56:12.782297+0000","last_unstale":"2024-05-20T17:56:12.787521+0000","last_undegraded":"2024-05-20T17:56:12.787521+0000","last_fullsized":"2024-05-20T17:56:12.787521+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:05.643326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.791558+0000","last_change":"2024-05-20T17:56:12.788711+0000","last_active":"2024-05-20T17:56:12.791558+0000","last_peered":"2024-05-20T17:56:12.791558+0000","last_clean":"2024-05-20T17:56:12.791558+0000","last_became_active":"2024-05-20T17:56:12.788167+0000","last_became_peered":"2024-05-20T17:56:12.788167+0000","last_unstale":"2024-05-20T17:56:12.791558+0000","last_undegraded":"2024-05-20T17:56:12.791558+0000","last_fullsized":"2024-05-20T17:56:12.791558+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:30.411831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779733+0000","last_change":"2024-05-20T17:56:12.787363+0000","last_active":"2024-05-20T17:56:13.779733+0000","last_peered":"2024-05-20T17:56:13.779733+0000","last_clean":"2024-05-20T17:56:13.779733+0000","last_became_active":"2024-05-20T17:56:12.786936+0000","last_became_peered":"2024-05-20T17:56:12.786936+0000","last_unstale":"2024-05-20T17:56:13.779733+0000","last_undegraded":"2024-05-20T17:56:13.779733+0000","last_fullsized":"2024-05-20T17:56:13.779733+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:41.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779698+0000","last_change":"2024-05-20T17:56:12.784634+0000","last_active":"2024-05-20T17:56:13.779698+0000","last_peered":"2024-05-20T17:56:13.779698+0000","last_clean":"2024-05-20T17:56:13.779698+0000","last_became_active":"2024-05-20T17:56:12.784322+0000","last_became_peered":"2024-05-20T17:56:12.784322+0000","last_unstale":"2024-05-20T17:56:13.779698+0000","last_undegraded":"2024-05-20T17:56:13.779698+0000","last_fullsized":"2024-05-20T17:56:13.779698+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:32.991681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.791235+0000","last_change":"2024-05-20T17:56:12.787860+0000","last_active":"2024-05-20T17:56:12.791235+0000","last_peered":"2024-05-20T17:56:12.791235+0000","last_clean":"2024-05-20T17:56:12.791235+0000","last_became_active":"2024-05-20T17:56:12.787414+0000","last_became_peered":"2024-05-20T17:56:12.787414+0000","last_unstale":"2024-05-20T17:56:12.791235+0000","last_undegraded":"2024-05-20T17:56:12.791235+0000","last_fullsized":"2024-05-20T17:56:12.791235+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:09.470600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.792161+0000","last_change":"2024-05-20T17:56:12.790336+0000","last_active":"2024-05-20T17:56:12.792161+0000","last_peered":"2024-05-20T17:56:12.792161+0000","last_clean":"2024-05-20T17:56:12.792161+0000","last_became_active":"2024-05-20T17:56:12.790032+0000","last_became_peered":"2024-05-20T17:56:12.790032+0000","last_unstale":"2024-05-20T17:56:12.792161+0000","last_undegraded":"2024-05-20T17:56:12.792161+0000","last_fullsized":"2024-05-20T17:56:12.792161+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:17.126038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.801063+0000","last_change":"2024-05-20T17:56:11.778666+0000","last_active":"2024-05-20T17:56:12.801063+0000","last_peered":"2024-05-20T17:56:12.801063+0000","last_clean":"2024-05-20T17:56:12.801063+0000","last_became_active":"2024-05-20T17:56:11.778312+0000","last_became_peered":"2024-05-20T17:56:11.778312+0000","last_unstale":"2024-05-20T17:56:12.801063+0000","last_undegraded":"2024-05-20T17:56:12.801063+0000","last_fullsized":"2024-05-20T17:56:12.801063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:39.175939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780474+0000","last_change":"2024-05-20T17:56:12.779759+0000","last_active":"2024-05-20T17:56:13.780474+0000","last_peered":"2024-05-20T17:56:13.780474+0000","last_clean":"2024-05-20T17:56:13.780474+0000","last_became_active":"2024-05-20T17:56:12.779419+0000","last_became_peered":"2024-05-20T17:56:12.779419+0000","last_unstale":"2024-05-20T17:56:13.780474+0000","last_undegraded":"2024-05-20T17:56:13.780474+0000","last_fullsized":"2024-05-20T17:56:13.780474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:05.643326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798505+0000","last_change":"2024-05-20T17:56:11.782771+0000","last_active":"2024-05-20T17:56:12.798505+0000","last_peered":"2024-05-20T17:56:12.798505+0000","last_clean":"2024-05-20T17:56:12.798505+0000","last_became_active":"2024-05-20T17:56:11.782396+0000","last_became_peered":"2024-05-20T17:56:11.782396+0000","last_unstale":"2024-05-20T17:56:12.798505+0000","last_undegraded":"2024-05-20T17:56:12.798505+0000","last_fullsized":"2024-05-20T17:56:12.798505+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:13.147539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.791383+0000","last_change":"2024-05-20T17:56:12.783525+0000","last_active":"2024-05-20T17:56:12.791383+0000","last_peered":"2024-05-20T17:56:12.791383+0000","last_clean":"2024-05-20T17:56:12.791383+0000","last_became_active":"2024-05-20T17:56:12.783193+0000","last_became_peered":"2024-05-20T17:56:12.783193+0000","last_unstale":"2024-05-20T17:56:12.791383+0000","last_undegraded":"2024-05-20T17:56:12.791383+0000","last_fullsized":"2024-05-20T17:56:12.791383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:11.333127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798156+0000","last_change":"2024-05-20T17:56:11.784017+0000","last_active":"2024-05-20T17:56:12.798156+0000","last_peered":"2024-05-20T17:56:12.798156+0000","last_clean":"2024-05-20T17:56:12.798156+0000","last_became_active":"2024-05-20T17:56:11.783719+0000","last_became_peered":"2024-05-20T17:56:11.783719+0000","last_unstale":"2024-05-20T17:56:12.798156+0000","last_undegraded":"2024-05-20T17:56:12.798156+0000","last_fullsized":"2024-05-20T17:56:12.798156+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:36.986797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798141+0000","last_change":"2024-05-20T17:56:12.794869+0000","last_active":"2024-05-20T17:56:12.798141+0000","last_peered":"2024-05-20T17:56:12.798141+0000","last_clean":"2024-05-20T17:56:12.798141+0000","last_became_active":"2024-05-20T17:56:12.794483+0000","last_became_peered":"2024-05-20T17:56:12.794483+0000","last_unstale":"2024-05-20T17:56:12.798141+0000","last_undegraded":"2024-05-20T17:56:12.798141+0000","last_fullsized":"2024-05-20T17:56:12.798141+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:08.520721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.797584+0000","last_change":"2024-05-20T17:56:11.785260+0000","last_active":"2024-05-20T17:56:12.797584+0000","last_peered":"2024-05-20T17:56:12.797584+0000","last_clean":"2024-05-20T17:56:12.797584+0000","last_became_active":"2024-05-20T17:56:11.784926+0000","last_became_peered":"2024-05-20T17:56:11.784926+0000","last_unstale":"2024-05-20T17:56:12.797584+0000","last_undegraded":"2024-05-20T17:56:12.797584+0000","last_fullsized":"2024-05-20T17:56:12.797584+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:51:59.378824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969127+0000","last_change":"2024-05-20T17:56:12.790786+0000","last_active":"2024-05-20T17:56:13.969127+0000","last_peered":"2024-05-20T17:56:13.969127+0000","last_clean":"2024-05-20T17:56:13.969127+0000","last_became_active":"2024-05-20T17:56:12.790301+0000","last_became_peered":"2024-05-20T17:56:12.790301+0000","last_unstale":"2024-05-20T17:56:13.969127+0000","last_undegraded":"2024-05-20T17:56:13.969127+0000","last_fullsized":"2024-05-20T17:56:13.969127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:22:15.578255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778815+0000","last_change":"2024-05-20T17:56:11.783529+0000","last_active":"2024-05-20T17:56:13.778815+0000","last_peered":"2024-05-20T17:56:13.778815+0000","last_clean":"2024-05-20T17:56:13.778815+0000","last_became_active":"2024-05-20T17:56:11.783159+0000","last_became_peered":"2024-05-20T17:56:11.783159+0000","last_unstale":"2024-05-20T17:56:13.778815+0000","last_undegraded":"2024-05-20T17:56:13.778815+0000","last_fullsized":"2024-05-20T17:56:13.778815+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:13.147539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.778525+0000","last_change":"2024-05-20T17:56:12.772855+0000","last_active":"2024-05-20T17:56:12.778525+0000","last_peered":"2024-05-20T17:56:12.778525+0000","last_clean":"2024-05-20T17:56:12.778525+0000","last_became_active":"2024-05-20T17:56:12.772477+0000","last_became_peered":"2024-05-20T17:56:12.772477+0000","last_unstale":"2024-05-20T17:56:12.778525+0000","last_undegraded":"2024-05-20T17:56:12.778525+0000","last_fullsized":"2024-05-20T17:56:12.778525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:40.141714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778671+0000","last_change":"2024-05-20T17:56:11.781438+0000","last_active":"2024-05-20T17:56:13.778671+0000","last_peered":"2024-05-20T17:56:13.778671+0000","last_clean":"2024-05-20T17:56:13.778671+0000","last_became_active":"2024-05-20T17:56:11.781067+0000","last_became_peered":"2024-05-20T17:56:11.781067+0000","last_unstale":"2024-05-20T17:56:13.778671+0000","last_undegraded":"2024-05-20T17:56:13.778671+0000","last_fullsized":"2024-05-20T17:56:13.778671+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:49:48.883238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.780459+0000","last_change":"2024-05-20T17:56:12.777691+0000","last_active":"2024-05-20T17:56:12.780459+0000","last_peered":"2024-05-20T17:56:12.780459+0000","last_clean":"2024-05-20T17:56:12.780459+0000","last_became_active":"2024-05-20T17:56:12.777349+0000","last_became_peered":"2024-05-20T17:56:12.777349+0000","last_unstale":"2024-05-20T17:56:12.780459+0000","last_undegraded":"2024-05-20T17:56:12.780459+0000","last_fullsized":"2024-05-20T17:56:12.780459+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:14:22.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778528+0000","last_change":"2024-05-20T17:56:11.775693+0000","last_active":"2024-05-20T17:56:13.778528+0000","last_peered":"2024-05-20T17:56:13.778528+0000","last_clean":"2024-05-20T17:56:13.778528+0000","last_became_active":"2024-05-20T17:56:11.775159+0000","last_became_peered":"2024-05-20T17:56:11.775159+0000","last_unstale":"2024-05-20T17:56:13.778528+0000","last_undegraded":"2024-05-20T17:56:13.778528+0000","last_fullsized":"2024-05-20T17:56:13.778528+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:22.918928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778701+0000","last_change":"2024-05-20T17:56:12.774857+0000","last_active":"2024-05-20T17:56:13.778701+0000","last_peered":"2024-05-20T17:56:13.778701+0000","last_clean":"2024-05-20T17:56:13.778701+0000","last_became_active":"2024-05-20T17:56:12.774473+0000","last_became_peered":"2024-05-20T17:56:12.774473+0000","last_unstale":"2024-05-20T17:56:13.778701+0000","last_undegraded":"2024-05-20T17:56:13.778701+0000","last_fullsized":"2024-05-20T17:56:13.778701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:51.541859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.770462+0000","last_change":"2024-05-20T17:56:11.778335+0000","last_active":"2024-05-20T17:56:12.770462+0000","last_peered":"2024-05-20T17:56:12.770462+0000","last_clean":"2024-05-20T17:56:12.770462+0000","last_became_active":"2024-05-20T17:56:11.778006+0000","last_became_peered":"2024-05-20T17:56:11.778006+0000","last_unstale":"2024-05-20T17:56:12.770462+0000","last_undegraded":"2024-05-20T17:56:12.770462+0000","last_fullsized":"2024-05-20T17:56:12.770462+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:46.902516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.789433+0000","last_change":"2024-05-20T17:56:12.787275+0000","last_active":"2024-05-20T17:56:12.789433+0000","last_peered":"2024-05-20T17:56:12.789433+0000","last_clean":"2024-05-20T17:56:12.789433+0000","last_became_active":"2024-05-20T17:56:12.786962+0000","last_became_peered":"2024-05-20T17:56:12.786962+0000","last_unstale":"2024-05-20T17:56:12.789433+0000","last_undegraded":"2024-05-20T17:56:12.789433+0000","last_fullsized":"2024-05-20T17:56:12.789433+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:22.930982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.783138+0000","last_change":"2024-05-20T17:56:11.785213+0000","last_active":"2024-05-20T17:56:12.783138+0000","last_peered":"2024-05-20T17:56:12.783138+0000","last_clean":"2024-05-20T17:56:12.783138+0000","last_became_active":"2024-05-20T17:56:11.784846+0000","last_became_peered":"2024-05-20T17:56:11.784846+0000","last_unstale":"2024-05-20T17:56:12.783138+0000","last_undegraded":"2024-05-20T17:56:12.783138+0000","last_fullsized":"2024-05-20T17:56:12.783138+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:58:19.708300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778616+0000","last_change":"2024-05-20T17:56:12.777908+0000","last_active":"2024-05-20T17:56:13.778616+0000","last_peered":"2024-05-20T17:56:13.778616+0000","last_clean":"2024-05-20T17:56:13.778616+0000","last_became_active":"2024-05-20T17:56:12.777573+0000","last_became_peered":"2024-05-20T17:56:12.777573+0000","last_unstale":"2024-05-20T17:56:13.778616+0000","last_undegraded":"2024-05-20T17:56:13.778616+0000","last_fullsized":"2024-05-20T17:56:13.778616+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:43.240247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780512+0000","last_change":"2024-05-20T17:56:11.777241+0000","last_active":"2024-05-20T17:56:13.780512+0000","last_peered":"2024-05-20T17:56:13.780512+0000","last_clean":"2024-05-20T17:56:13.780512+0000","last_became_active":"2024-05-20T17:56:11.775951+0000","last_became_peered":"2024-05-20T17:56:11.775951+0000","last_unstale":"2024-05-20T17:56:13.780512+0000","last_undegraded":"2024-05-20T17:56:13.780512+0000","last_fullsized":"2024-05-20T17:56:13.780512+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:55:04.636409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.781763+0000","last_change":"2024-05-20T17:56:12.778549+0000","last_active":"2024-05-20T17:56:12.781763+0000","last_peered":"2024-05-20T17:56:12.781763+0000","last_clean":"2024-05-20T17:56:12.781763+0000","last_became_active":"2024-05-20T17:56:12.778209+0000","last_became_peered":"2024-05-20T17:56:12.778209+0000","last_unstale":"2024-05-20T17:56:12.781763+0000","last_undegraded":"2024-05-20T17:56:12.781763+0000","last_fullsized":"2024-05-20T17:56:12.781763+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:40.183218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"63'3","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.801618+0000","last_change":"2024-05-20T17:56:11.785229+0000","last_active":"2024-05-20T17:56:12.801618+0000","last_peered":"2024-05-20T17:56:12.801618+0000","last_clean":"2024-05-20T17:56:12.801618+0000","last_became_active":"2024-05-20T17:56:11.784908+0000","last_became_peered":"2024-05-20T17:56:11.784908+0000","last_unstale":"2024-05-20T17:56:12.801618+0000","last_undegraded":"2024-05-20T17:56:12.801618+0000","last_fullsized":"2024-05-20T17:56:12.801618+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:25:08.814634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780722+0000","last_change":"2024-05-20T17:56:12.772169+0000","last_active":"2024-05-20T17:56:13.780722+0000","last_peered":"2024-05-20T17:56:13.780722+0000","last_clean":"2024-05-20T17:56:13.780722+0000","last_became_active":"2024-05-20T17:56:12.771856+0000","last_became_peered":"2024-05-20T17:56:12.771856+0000","last_unstale":"2024-05-20T17:56:13.780722+0000","last_undegraded":"2024-05-20T17:56:13.780722+0000","last_fullsized":"2024-05-20T17:56:13.780722+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:20.265559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"63'6","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.801658+0000","last_change":"2024-05-20T17:56:11.772482+0000","last_active":"2024-05-20T17:56:12.801658+0000","last_peered":"2024-05-20T17:56:12.801658+0000","last_clean":"2024-05-20T17:56:12.801658+0000","last_became_active":"2024-05-20T17:56:11.772145+0000","last_became_peered":"2024-05-20T17:56:11.772145+0000","last_unstale":"2024-05-20T17:56:12.801658+0000","last_undegraded":"2024-05-20T17:56:12.801658+0000","last_fullsized":"2024-05-20T17:56:12.801658+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:16:09.624264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780957+0000","last_change":"2024-05-20T17:56:12.790528+0000","last_active":"2024-05-20T17:56:13.780957+0000","last_peered":"2024-05-20T17:56:13.780957+0000","last_clean":"2024-05-20T17:56:13.780957+0000","last_became_active":"2024-05-20T17:56:12.790177+0000","last_became_peered":"2024-05-20T17:56:12.790177+0000","last_unstale":"2024-05-20T17:56:13.780957+0000","last_undegraded":"2024-05-20T17:56:13.780957+0000","last_fullsized":"2024-05-20T17:56:13.780957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:22.930982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.799219+0000","last_change":"2024-05-20T17:56:11.782894+0000","last_active":"2024-05-20T17:56:12.799219+0000","last_peered":"2024-05-20T17:56:12.799219+0000","last_clean":"2024-05-20T17:56:12.799219+0000","last_became_active":"2024-05-20T17:56:11.782313+0000","last_became_peered":"2024-05-20T17:56:11.782313+0000","last_unstale":"2024-05-20T17:56:12.799219+0000","last_undegraded":"2024-05-20T17:56:12.799219+0000","last_fullsized":"2024-05-20T17:56:12.799219+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:55.949092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779191+0000","last_change":"2024-05-20T17:56:12.786511+0000","last_active":"2024-05-20T17:56:13.779191+0000","last_peered":"2024-05-20T17:56:13.779191+0000","last_clean":"2024-05-20T17:56:13.779191+0000","last_became_active":"2024-05-20T17:56:12.786164+0000","last_became_peered":"2024-05-20T17:56:12.786164+0000","last_unstale":"2024-05-20T17:56:13.779191+0000","last_undegraded":"2024-05-20T17:56:13.779191+0000","last_fullsized":"2024-05-20T17:56:13.779191+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:23.926207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780002+0000","last_change":"2024-05-20T17:56:11.774682+0000","last_active":"2024-05-20T17:56:13.780002+0000","last_peered":"2024-05-20T17:56:13.780002+0000","last_clean":"2024-05-20T17:56:13.780002+0000","last_became_active":"2024-05-20T17:56:11.774195+0000","last_became_peered":"2024-05-20T17:56:11.774195+0000","last_unstale":"2024-05-20T17:56:13.780002+0000","last_undegraded":"2024-05-20T17:56:13.780002+0000","last_fullsized":"2024-05-20T17:56:13.780002+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:04.636047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.789458+0000","last_change":"2024-05-20T17:56:12.786278+0000","last_active":"2024-05-20T17:56:12.789458+0000","last_peered":"2024-05-20T17:56:12.789458+0000","last_clean":"2024-05-20T17:56:12.789458+0000","last_became_active":"2024-05-20T17:56:12.785682+0000","last_became_peered":"2024-05-20T17:56:12.785682+0000","last_unstale":"2024-05-20T17:56:12.789458+0000","last_undegraded":"2024-05-20T17:56:12.789458+0000","last_fullsized":"2024-05-20T17:56:12.789458+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:14.592909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.777350+0000","last_change":"2024-05-20T17:56:11.782668+0000","last_active":"2024-05-20T17:56:12.777350+0000","last_peered":"2024-05-20T17:56:12.777350+0000","last_clean":"2024-05-20T17:56:12.777350+0000","last_became_active":"2024-05-20T17:56:11.782162+0000","last_became_peered":"2024-05-20T17:56:11.782162+0000","last_unstale":"2024-05-20T17:56:12.777350+0000","last_undegraded":"2024-05-20T17:56:12.777350+0000","last_fullsized":"2024-05-20T17:56:12.777350+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:36.666746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.785986+0000","last_change":"2024-05-20T17:56:12.777447+0000","last_active":"2024-05-20T17:56:12.785986+0000","last_peered":"2024-05-20T17:56:12.785986+0000","last_clean":"2024-05-20T17:56:12.785986+0000","last_became_active":"2024-05-20T17:56:12.777110+0000","last_became_peered":"2024-05-20T17:56:12.777110+0000","last_unstale":"2024-05-20T17:56:12.785986+0000","last_undegraded":"2024-05-20T17:56:12.785986+0000","last_fullsized":"2024-05-20T17:56:12.785986+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:36.820883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"63'8","reported_seq":22,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780951+0000","last_change":"2024-05-20T17:56:11.777779+0000","last_active":"2024-05-20T17:56:13.780951+0000","last_peered":"2024-05-20T17:56:13.780951+0000","last_clean":"2024-05-20T17:56:13.780951+0000","last_became_active":"2024-05-20T17:56:11.777448+0000","last_became_peered":"2024-05-20T17:56:11.777448+0000","last_unstale":"2024-05-20T17:56:13.780951+0000","last_undegraded":"2024-05-20T17:56:13.780951+0000","last_fullsized":"2024-05-20T17:56:13.780951+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:00:07.196930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.797902+0000","last_change":"2024-05-20T17:56:12.795403+0000","last_active":"2024-05-20T17:56:12.797902+0000","last_peered":"2024-05-20T17:56:12.797902+0000","last_clean":"2024-05-20T17:56:12.797902+0000","last_became_active":"2024-05-20T17:56:12.795059+0000","last_became_peered":"2024-05-20T17:56:12.795059+0000","last_unstale":"2024-05-20T17:56:12.797902+0000","last_undegraded":"2024-05-20T17:56:12.797902+0000","last_fullsized":"2024-05-20T17:56:12.797902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:37.994076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780695+0000","last_change":"2024-05-20T17:56:11.774580+0000","last_active":"2024-05-20T17:56:13.780695+0000","last_peered":"2024-05-20T17:56:13.780695+0000","last_clean":"2024-05-20T17:56:13.780695+0000","last_became_active":"2024-05-20T17:56:11.774229+0000","last_became_peered":"2024-05-20T17:56:11.774229+0000","last_unstale":"2024-05-20T17:56:13.780695+0000","last_undegraded":"2024-05-20T17:56:13.780695+0000","last_fullsized":"2024-05-20T17:56:13.780695+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:34:33.042334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.781727+0000","last_change":"2024-05-20T17:56:12.778976+0000","last_active":"2024-05-20T17:56:12.781727+0000","last_peered":"2024-05-20T17:56:12.781727+0000","last_clean":"2024-05-20T17:56:12.781727+0000","last_became_active":"2024-05-20T17:56:12.778652+0000","last_became_peered":"2024-05-20T17:56:12.778652+0000","last_unstale":"2024-05-20T17:56:12.781727+0000","last_undegraded":"2024-05-20T17:56:12.781727+0000","last_fullsized":"2024-05-20T17:56:12.781727+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:32.991681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798186+0000","last_change":"2024-05-20T17:56:11.779906+0000","last_active":"2024-05-20T17:56:12.798186+0000","last_peered":"2024-05-20T17:56:12.798186+0000","last_clean":"2024-05-20T17:56:12.798186+0000","last_became_active":"2024-05-20T17:56:11.779534+0000","last_became_peered":"2024-05-20T17:56:11.779534+0000","last_unstale":"2024-05-20T17:56:12.798186+0000","last_undegraded":"2024-05-20T17:56:12.798186+0000","last_fullsized":"2024-05-20T17:56:12.798186+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:32:35.509916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780376+0000","last_change":"2024-05-20T17:56:12.777245+0000","last_active":"2024-05-20T17:56:13.780376+0000","last_peered":"2024-05-20T17:56:13.780376+0000","last_clean":"2024-05-20T17:56:13.780376+0000","last_became_active":"2024-05-20T17:56:12.776936+0000","last_became_peered":"2024-05-20T17:56:12.776936+0000","last_unstale":"2024-05-20T17:56:13.780376+0000","last_undegraded":"2024-05-20T17:56:13.780376+0000","last_fullsized":"2024-05-20T17:56:13.780376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:17.126038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.801613+0000","last_change":"2024-05-20T17:56:11.785227+0000","last_active":"2024-05-20T17:56:12.801613+0000","last_peered":"2024-05-20T17:56:12.801613+0000","last_clean":"2024-05-20T17:56:12.801613+0000","last_became_active":"2024-05-20T17:56:11.784953+0000","last_became_peered":"2024-05-20T17:56:11.784953+0000","last_unstale":"2024-05-20T17:56:12.801613+0000","last_undegraded":"2024-05-20T17:56:12.801613+0000","last_fullsized":"2024-05-20T17:56:12.801613+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:18.659442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.778757+0000","last_change":"2024-05-20T17:56:12.777140+0000","last_active":"2024-05-20T17:56:12.778757+0000","last_peered":"2024-05-20T17:56:12.778757+0000","last_clean":"2024-05-20T17:56:12.778757+0000","last_became_active":"2024-05-20T17:56:12.776813+0000","last_became_peered":"2024-05-20T17:56:12.776813+0000","last_unstale":"2024-05-20T17:56:12.778757+0000","last_undegraded":"2024-05-20T17:56:12.778757+0000","last_fullsized":"2024-05-20T17:56:12.778757+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:38.630668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778742+0000","last_change":"2024-05-20T17:56:11.781321+0000","last_active":"2024-05-20T17:56:13.778742+0000","last_peered":"2024-05-20T17:56:13.778742+0000","last_clean":"2024-05-20T17:56:13.778742+0000","last_became_active":"2024-05-20T17:56:11.780957+0000","last_became_peered":"2024-05-20T17:56:11.780957+0000","last_unstale":"2024-05-20T17:56:13.778742+0000","last_undegraded":"2024-05-20T17:56:13.778742+0000","last_fullsized":"2024-05-20T17:56:13.778742+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:40.029175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.791209+0000","last_change":"2024-05-20T17:56:12.787738+0000","last_active":"2024-05-20T17:56:12.791209+0000","last_peered":"2024-05-20T17:56:12.791209+0000","last_clean":"2024-05-20T17:56:12.791209+0000","last_became_active":"2024-05-20T17:56:12.787386+0000","last_became_peered":"2024-05-20T17:56:12.787386+0000","last_unstale":"2024-05-20T17:56:12.791209+0000","last_undegraded":"2024-05-20T17:56:12.791209+0000","last_fullsized":"2024-05-20T17:56:12.791209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:49:46.488232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.797568+0000","last_change":"2024-05-20T17:56:11.785684+0000","last_active":"2024-05-20T17:56:12.797568+0000","last_peered":"2024-05-20T17:56:12.797568+0000","last_clean":"2024-05-20T17:56:12.797568+0000","last_became_active":"2024-05-20T17:56:11.785253+0000","last_became_peered":"2024-05-20T17:56:11.785253+0000","last_unstale":"2024-05-20T17:56:12.797568+0000","last_undegraded":"2024-05-20T17:56:12.797568+0000","last_fullsized":"2024-05-20T17:56:12.797568+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:22.918928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779620+0000","last_change":"2024-05-20T17:56:12.783492+0000","last_active":"2024-05-20T17:56:13.779620+0000","last_peered":"2024-05-20T17:56:13.779620+0000","last_clean":"2024-05-20T17:56:13.779620+0000","last_became_active":"2024-05-20T17:56:12.783018+0000","last_became_peered":"2024-05-20T17:56:12.783018+0000","last_unstale":"2024-05-20T17:56:13.779620+0000","last_undegraded":"2024-05-20T17:56:13.779620+0000","last_fullsized":"2024-05-20T17:56:13.779620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:29:47.605742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779904+0000","last_change":"2024-05-20T17:56:11.774755+0000","last_active":"2024-05-20T17:56:13.779904+0000","last_peered":"2024-05-20T17:56:13.779904+0000","last_clean":"2024-05-20T17:56:13.779904+0000","last_became_active":"2024-05-20T17:56:11.774419+0000","last_became_peered":"2024-05-20T17:56:11.774419+0000","last_unstale":"2024-05-20T17:56:13.779904+0000","last_undegraded":"2024-05-20T17:56:13.779904+0000","last_fullsized":"2024-05-20T17:56:13.779904+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:19.258279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.777850+0000","last_change":"2024-05-20T17:56:12.776907+0000","last_active":"2024-05-20T17:56:12.777850+0000","last_peered":"2024-05-20T17:56:12.777850+0000","last_clean":"2024-05-20T17:56:12.777850+0000","last_became_active":"2024-05-20T17:56:12.776588+0000","last_became_peered":"2024-05-20T17:56:12.776588+0000","last_unstale":"2024-05-20T17:56:12.777850+0000","last_undegraded":"2024-05-20T17:56:12.777850+0000","last_fullsized":"2024-05-20T17:56:12.777850+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:09.464277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.767652+0000","last_change":"2024-05-20T17:56:11.783055+0000","last_active":"2024-05-20T17:56:12.767652+0000","last_peered":"2024-05-20T17:56:12.767652+0000","last_clean":"2024-05-20T17:56:12.767652+0000","last_became_active":"2024-05-20T17:56:11.782708+0000","last_became_peered":"2024-05-20T17:56:11.782708+0000","last_unstale":"2024-05-20T17:56:12.767652+0000","last_undegraded":"2024-05-20T17:56:12.767652+0000","last_fullsized":"2024-05-20T17:56:12.767652+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:07.513442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.779431+0000","last_change":"2024-05-20T17:56:12.777767+0000","last_active":"2024-05-20T17:56:12.779431+0000","last_peered":"2024-05-20T17:56:12.779431+0000","last_clean":"2024-05-20T17:56:12.779431+0000","last_became_active":"2024-05-20T17:56:12.777468+0000","last_became_peered":"2024-05-20T17:56:12.777468+0000","last_unstale":"2024-05-20T17:56:12.779431+0000","last_undegraded":"2024-05-20T17:56:12.779431+0000","last_fullsized":"2024-05-20T17:56:12.779431+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:41.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780859+0000","last_change":"2024-05-20T17:56:11.779924+0000","last_active":"2024-05-20T17:56:13.780859+0000","last_peered":"2024-05-20T17:56:13.780859+0000","last_clean":"2024-05-20T17:56:13.780859+0000","last_became_active":"2024-05-20T17:56:11.779606+0000","last_became_peered":"2024-05-20T17:56:11.779606+0000","last_unstale":"2024-05-20T17:56:13.780859+0000","last_undegraded":"2024-05-20T17:56:13.780859+0000","last_fullsized":"2024-05-20T17:56:13.780859+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:21.923702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969334+0000","last_change":"2024-05-20T17:56:12.782165+0000","last_active":"2024-05-20T17:56:13.969334+0000","last_peered":"2024-05-20T17:56:13.969334+0000","last_clean":"2024-05-20T17:56:13.969334+0000","last_became_active":"2024-05-20T17:56:12.781867+0000","last_became_peered":"2024-05-20T17:56:12.781867+0000","last_unstale":"2024-05-20T17:56:13.969334+0000","last_undegraded":"2024-05-20T17:56:13.969334+0000","last_fullsized":"2024-05-20T17:56:13.969334+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:40.571496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780027+0000","last_change":"2024-05-20T17:56:11.780823+0000","last_active":"2024-05-20T17:56:13.780027+0000","last_peered":"2024-05-20T17:56:13.780027+0000","last_clean":"2024-05-20T17:56:13.780027+0000","last_became_active":"2024-05-20T17:56:11.780406+0000","last_became_peered":"2024-05-20T17:56:11.780406+0000","last_unstale":"2024-05-20T17:56:13.780027+0000","last_undegraded":"2024-05-20T17:56:13.780027+0000","last_fullsized":"2024-05-20T17:56:13.780027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:36.666746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779776+0000","last_change":"2024-05-20T17:56:12.788369+0000","last_active":"2024-05-20T17:56:13.779776+0000","last_peered":"2024-05-20T17:56:13.779776+0000","last_clean":"2024-05-20T17:56:13.779776+0000","last_became_active":"2024-05-20T17:56:12.788053+0000","last_became_peered":"2024-05-20T17:56:12.788053+0000","last_unstale":"2024-05-20T17:56:13.779776+0000","last_undegraded":"2024-05-20T17:56:13.779776+0000","last_fullsized":"2024-05-20T17:56:13.779776+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:11.333127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.767992+0000","last_change":"2024-05-20T17:56:11.783986+0000","last_active":"2024-05-20T17:56:12.767992+0000","last_peered":"2024-05-20T17:56:12.767992+0000","last_clean":"2024-05-20T17:56:12.767992+0000","last_became_active":"2024-05-20T17:56:11.783679+0000","last_became_peered":"2024-05-20T17:56:11.783679+0000","last_unstale":"2024-05-20T17:56:12.767992+0000","last_undegraded":"2024-05-20T17:56:12.767992+0000","last_fullsized":"2024-05-20T17:56:12.767992+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:49:48.883238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.777303+0000","last_change":"2024-05-20T17:56:12.774618+0000","last_active":"2024-05-20T17:56:12.777303+0000","last_peered":"2024-05-20T17:56:12.777303+0000","last_clean":"2024-05-20T17:56:12.777303+0000","last_became_active":"2024-05-20T17:56:12.774245+0000","last_became_peered":"2024-05-20T17:56:12.774245+0000","last_unstale":"2024-05-20T17:56:12.777303+0000","last_undegraded":"2024-05-20T17:56:12.777303+0000","last_fullsized":"2024-05-20T17:56:12.777303+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:48.208929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.768317+0000","last_change":"2024-05-20T17:56:11.778973+0000","last_active":"2024-05-20T17:56:12.768317+0000","last_peered":"2024-05-20T17:56:12.768317+0000","last_clean":"2024-05-20T17:56:12.768317+0000","last_became_active":"2024-05-20T17:56:11.778631+0000","last_became_peered":"2024-05-20T17:56:11.778631+0000","last_unstale":"2024-05-20T17:56:12.768317+0000","last_undegraded":"2024-05-20T17:56:12.768317+0000","last_fullsized":"2024-05-20T17:56:12.768317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:31.984401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.788925+0000","last_change":"2024-05-20T17:56:12.782593+0000","last_active":"2024-05-20T17:56:12.788925+0000","last_peered":"2024-05-20T17:56:12.788925+0000","last_clean":"2024-05-20T17:56:12.788925+0000","last_became_active":"2024-05-20T17:56:12.781567+0000","last_became_peered":"2024-05-20T17:56:12.781567+0000","last_unstale":"2024-05-20T17:56:12.788925+0000","last_undegraded":"2024-05-20T17:56:12.788925+0000","last_fullsized":"2024-05-20T17:56:12.788925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:40.141714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.778137+0000","last_change":"2024-05-20T17:56:11.786345+0000","last_active":"2024-05-20T17:56:12.778137+0000","last_peered":"2024-05-20T17:56:12.778137+0000","last_clean":"2024-05-20T17:56:12.778137+0000","last_became_active":"2024-05-20T17:56:11.786051+0000","last_became_peered":"2024-05-20T17:56:11.786051+0000","last_unstale":"2024-05-20T17:56:12.778137+0000","last_undegraded":"2024-05-20T17:56:12.778137+0000","last_fullsized":"2024-05-20T17:56:12.778137+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:13:35.804747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779884+0000","last_change":"2024-05-20T17:56:12.776829+0000","last_active":"2024-05-20T17:56:13.779884+0000","last_peered":"2024-05-20T17:56:13.779884+0000","last_clean":"2024-05-20T17:56:13.779884+0000","last_became_active":"2024-05-20T17:56:12.776481+0000","last_became_peered":"2024-05-20T17:56:12.776481+0000","last_unstale":"2024-05-20T17:56:13.779884+0000","last_undegraded":"2024-05-20T17:56:13.779884+0000","last_fullsized":"2024-05-20T17:56:13.779884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:35.178373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778742+0000","last_change":"2024-05-20T17:56:11.782673+0000","last_active":"2024-05-20T17:56:13.778742+0000","last_peered":"2024-05-20T17:56:13.778742+0000","last_clean":"2024-05-20T17:56:13.778742+0000","last_became_active":"2024-05-20T17:56:11.782350+0000","last_became_peered":"2024-05-20T17:56:11.782350+0000","last_unstale":"2024-05-20T17:56:13.778742+0000","last_undegraded":"2024-05-20T17:56:13.778742+0000","last_fullsized":"2024-05-20T17:56:13.778742+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:29:46.598462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.786051+0000","last_change":"2024-05-20T17:56:12.778933+0000","last_active":"2024-05-20T17:56:12.786051+0000","last_peered":"2024-05-20T17:56:12.786051+0000","last_clean":"2024-05-20T17:56:12.786051+0000","last_became_active":"2024-05-20T17:56:12.778615+0000","last_became_peered":"2024-05-20T17:56:12.778615+0000","last_unstale":"2024-05-20T17:56:12.786051+0000","last_undegraded":"2024-05-20T17:56:12.786051+0000","last_fullsized":"2024-05-20T17:56:12.786051+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:14.592909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778616+0000","last_change":"2024-05-20T17:56:11.776950+0000","last_active":"2024-05-20T17:56:13.778616+0000","last_peered":"2024-05-20T17:56:13.778616+0000","last_clean":"2024-05-20T17:56:13.778616+0000","last_became_active":"2024-05-20T17:56:11.776136+0000","last_became_peered":"2024-05-20T17:56:11.776136+0000","last_unstale":"2024-05-20T17:56:13.778616+0000","last_undegraded":"2024-05-20T17:56:13.778616+0000","last_fullsized":"2024-05-20T17:56:13.778616+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:51:59.378824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969275+0000","last_change":"2024-05-20T17:56:12.780971+0000","last_active":"2024-05-20T17:56:13.969275+0000","last_peered":"2024-05-20T17:56:13.969275+0000","last_clean":"2024-05-20T17:56:13.969275+0000","last_became_active":"2024-05-20T17:56:12.780640+0000","last_became_peered":"2024-05-20T17:56:12.780640+0000","last_unstale":"2024-05-20T17:56:13.969275+0000","last_undegraded":"2024-05-20T17:56:13.969275+0000","last_fullsized":"2024-05-20T17:56:13.969275+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:48.733357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.766816+0000","last_change":"2024-05-20T17:56:11.774652+0000","last_active":"2024-05-20T17:56:12.766816+0000","last_peered":"2024-05-20T17:56:12.766816+0000","last_clean":"2024-05-20T17:56:12.766816+0000","last_became_active":"2024-05-20T17:56:11.774354+0000","last_became_peered":"2024-05-20T17:56:11.774354+0000","last_unstale":"2024-05-20T17:56:12.766816+0000","last_undegraded":"2024-05-20T17:56:12.766816+0000","last_fullsized":"2024-05-20T17:56:12.766816+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:14:21.688817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.788097+0000","last_change":"2024-05-20T17:56:12.780554+0000","last_active":"2024-05-20T17:56:12.788097+0000","last_peered":"2024-05-20T17:56:12.788097+0000","last_clean":"2024-05-20T17:56:12.788097+0000","last_became_active":"2024-05-20T17:56:12.780244+0000","last_became_peered":"2024-05-20T17:56:12.780244+0000","last_unstale":"2024-05-20T17:56:12.788097+0000","last_undegraded":"2024-05-20T17:56:12.788097+0000","last_fullsized":"2024-05-20T17:56:12.788097+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:35.178373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778432+0000","last_change":"2024-05-20T17:56:11.784093+0000","last_active":"2024-05-20T17:56:13.778432+0000","last_peered":"2024-05-20T17:56:13.778432+0000","last_clean":"2024-05-20T17:56:13.778432+0000","last_became_active":"2024-05-20T17:56:11.783784+0000","last_became_peered":"2024-05-20T17:56:11.783784+0000","last_unstale":"2024-05-20T17:56:13.778432+0000","last_undegraded":"2024-05-20T17:56:13.778432+0000","last_fullsized":"2024-05-20T17:56:13.778432+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:36.986797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.781372+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:56:12.781372+0000","last_peered":"2024-05-20T17:56:12.781372+0000","last_clean":"2024-05-20T17:56:12.781372+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:56:12.781372+0000","last_undegraded":"2024-05-20T17:56:12.781372+0000","last_fullsized":"2024-05-20T17:56:12.781372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1372160,"data_stored":935550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":344440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":344428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":346018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":774144,"data_stored":351098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":351098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":346782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":934774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:56:16.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:56:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.997+0000 7f669946c640 1 Processor -- start 2024-05-20T17:56:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.997+0000 7f669946c640 1 -- start start 2024-05-20T17:56:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f669946c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66940d4400 0x7f669415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f669946c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f66940d2780 0x7f66940d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f669946c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669408d2a0 con 0x7f669406cf00 2024-05-20T17:56:16.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f669946c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f66940d3f70 con 0x7f66940d4400 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f669946c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f66940d30d0 con 0x7f66940d2780 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f6692ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66940d4400 0x7f669415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f6692ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66940d4400 0x7f669415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46548/0 (socket says 172.21.15.6:46548) 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f6692ffd640 1 -- 172.21.15.6:0/3416353648 learned_addr learned my addr 172.21.15.6:0/3416353648 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f66937fe640 1 --2- 172.21.15.6:0/3416353648 >> v2:172.21.15.171:3300/0 conn(0x7f66940d2780 0x7f66940d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f6692ffd640 1 -- 172.21.15.6:0/3416353648 >> v2:172.21.15.171:3300/0 conn(0x7f66940d2780 msgr2=0x7f66940d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f6692ffd640 1 --2- 172.21.15.6:0/3416353648 >> v2:172.21.15.171:3300/0 conn(0x7f66940d2780 0x7f66940d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f6692ffd640 1 -- 172.21.15.6:0/3416353648 >> v1:172.21.15.171:6789/0 conn(0x7f669406cf00 legacy=0x7f669406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f6692ffd640 1 -- 172.21.15.6:0/3416353648 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66940d4810 con 0x7f66940d4400 2024-05-20T17:56:16.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:16.999+0000 7f66937fe640 1 --2- 172.21.15.6:0/3416353648 >> v2:172.21.15.171:3300/0 conn(0x7f66940d2780 0x7f66940d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.000+0000 7f6692ffd640 1 --2- 172.21.15.6:0/3416353648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d4400 0x7f669415f440 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f669408e020 tx=0x7f668402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf02f8b51c5a24d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.000+0000 7f6691ffb640 1 -- 172.21.15.6:0/3416353648 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684036070 con 0x7f66940d4400 2024-05-20T17:56:16.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.000+0000 7f6691ffb640 1 -- 172.21.15.6:0/3416353648 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6684031600 con 0x7f66940d4400 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.000+0000 7f6691ffb640 1 -- 172.21.15.6:0/3416353648 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66840319f0 con 0x7f66940d4400 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.001+0000 7f669946c640 1 -- 172.21.15.6:0/3416353648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d4400 msgr2=0x7f669415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.001+0000 7f669946c640 1 --2- 172.21.15.6:0/3416353648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d4400 0x7f669415f440 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f669408e020 tx=0x7f668402a7c0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.001+0000 7f669946c640 1 -- 172.21.15.6:0/3416353648 shutdown_connections 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.001+0000 7f669946c640 1 --2- 172.21.15.6:0/3416353648 >> v2:172.21.15.171:3300/0 conn(0x7f66940d2780 0x7f66940d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.001+0000 7f669946c640 1 --2- 172.21.15.6:0/3416353648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d4400 0x7f669415f440 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.001+0000 7f669946c640 1 -- 172.21.15.6:0/3416353648 >> 172.21.15.6:0/3416353648 conn(0x7f66940d4bb0 msgr2=0x7f66940d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.001+0000 7f669946c640 1 -- 172.21.15.6:0/3416353648 shutdown_connections 2024-05-20T17:56:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.001+0000 7f669946c640 1 -- 172.21.15.6:0/3416353648 wait complete. 2024-05-20T17:56:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.003+0000 7f669946c640 1 Processor -- start 2024-05-20T17:56:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.003+0000 7f669946c640 1 -- start start 2024-05-20T17:56:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f669946c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669406cf00 0x7f669415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f669946c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d2780 0x7f66940ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f669946c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66940d4400 0x7f669415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f669946c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66940d3920 con 0x7f66940d2780 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f669946c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66940d3640 con 0x7f669406cf00 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f669946c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66940d3c00 con 0x7f66940d4400 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f66927fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d2780 0x7f66940ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f66927fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d2780 0x7f66940ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46558/0 (socket says 172.21.15.6:46558) 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.004+0000 7f66927fc640 1 -- 172.21.15.6:0/3596475806 learned_addr learned my addr 172.21.15.6:0/3596475806 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f6692ffd640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669406cf00 0x7f669415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f66937fe640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66940d4400 0x7f669415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f66927fc640 1 -- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66940d4400 msgr2=0x7f669415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f66927fc640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66940d4400 0x7f669415b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f66927fc640 1 -- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669406cf00 msgr2=0x7f669415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f66927fc640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669406cf00 0x7f669415e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f66927fc640 1 -- 172.21.15.6:0/3596475806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669415e700 con 0x7f66940d2780 2024-05-20T17:56:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f66927fc640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d2780 0x7f66940ce560 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f668800c420 tx=0x7f668800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f667b7fe640 1 -- 172.21.15.6:0/3596475806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66880052d0 con 0x7f66940d2780 2024-05-20T17:56:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f667b7fe640 1 -- 172.21.15.6:0/3596475806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6688005490 con 0x7f66940d2780 2024-05-20T17:56:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66940ceaa0 con 0x7f66940d2780 2024-05-20T17:56:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f667b7fe640 1 -- 172.21.15.6:0/3596475806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688007260 con 0x7f66940d2780 2024-05-20T17:56:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.005+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6694142460 con 0x7f66940d2780 2024-05-20T17:56:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.006+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66940735a0 con 0x7f66940d2780 2024-05-20T17:56:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.007+0000 7f667b7fe640 1 -- 172.21.15.6:0/3596475806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6688007400 con 0x7f66940d2780 2024-05-20T17:56:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.007+0000 7f667b7fe640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f668006be60 0x7f668006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.007+0000 7f667b7fe640 1 -- 172.21.15.6:0/3596475806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f668808a440 con 0x7f66940d2780 2024-05-20T17:56:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.007+0000 7f6692ffd640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f668006be60 0x7f668006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.008+0000 7f6692ffd640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f668006be60 0x7f668006e370 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6684033000 tx=0x7f6684009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:17.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.012+0000 7f667b7fe640 1 -- 172.21.15.6:0/3596475806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f66940735a0 con 0x7f66940d2780 2024-05-20T17:56:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.192+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6694075b00 con 0x7f668006be60 2024-05-20T17:56:17.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.199+0000 7f667b7fe640 1 -- 172.21.15.6:0/3596475806 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251984 (secure 0 0 0) 0x7f6694075b00 con 0x7f668006be60 2024-05-20T17:56:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:17.200 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.202+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f668006be60 msgr2=0x7f668006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.202+0000 7f669946c640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f668006be60 0x7f668006e370 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6684033000 tx=0x7f6684009000 comp rx=0 tx=0).stop 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.202+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d2780 msgr2=0x7f66940ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.202+0000 7f669946c640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d2780 0x7f66940ce560 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f668800c420 tx=0x7f668800c8e0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.203+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 shutdown_connections 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.203+0000 7f669946c640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f668006be60 0x7f668006e370 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.203+0000 7f669946c640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66940d4400 0x7f669415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.203+0000 7f669946c640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66940d2780 0x7f66940ce560 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.203+0000 7f669946c640 1 --2- 172.21.15.6:0/3596475806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f669406cf00 0x7f669415e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.203+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 >> 172.21.15.6:0/3596475806 conn(0x7f66940d4bb0 msgr2=0x7f66940ba060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.203+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 shutdown_connections 2024-05-20T17:56:17.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.203+0000 7f669946c640 1 -- 172.21.15.6:0/3596475806 wait complete. 2024-05-20T17:56:17.212 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-05-20T17:56:16.279421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235884,"kb_used_data":7200,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738836,"statfs":{"total":773094113280,"available":772852568064,"internally_reserved":0,"allocated":7372800,"data_stored":3954188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.527130"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.787486+0000","last_change":"2024-05-20T17:56:12.783237+0000","last_active":"2024-05-20T17:56:12.787486+0000","last_peered":"2024-05-20T17:56:12.787486+0000","last_clean":"2024-05-20T17:56:12.787486+0000","last_became_active":"2024-05-20T17:56:12.782594+0000","last_became_peered":"2024-05-20T17:56:12.782594+0000","last_unstale":"2024-05-20T17:56:12.787486+0000","last_undegraded":"2024-05-20T17:56:12.787486+0000","last_fullsized":"2024-05-20T17:56:12.787486+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:34:34.049613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.786108+0000","last_change":"2024-05-20T17:56:12.781871+0000","last_active":"2024-05-20T17:56:12.786108+0000","last_peered":"2024-05-20T17:56:12.786108+0000","last_clean":"2024-05-20T17:56:12.786108+0000","last_became_active":"2024-05-20T17:56:12.779369+0000","last_became_peered":"2024-05-20T17:56:12.779369+0000","last_unstale":"2024-05-20T17:56:12.786108+0000","last_undegraded":"2024-05-20T17:56:12.786108+0000","last_fullsized":"2024-05-20T17:56:12.786108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:17.126038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.799110+0000","last_change":"2024-05-20T17:56:12.797125+0000","last_active":"2024-05-20T17:56:12.799110+0000","last_peered":"2024-05-20T17:56:12.799110+0000","last_clean":"2024-05-20T17:56:12.799110+0000","last_became_active":"2024-05-20T17:56:12.796792+0000","last_became_peered":"2024-05-20T17:56:12.796792+0000","last_unstale":"2024-05-20T17:56:12.799110+0000","last_undegraded":"2024-05-20T17:56:12.799110+0000","last_fullsized":"2024-05-20T17:56:12.799110+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:00.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780490+0000","last_change":"2024-05-20T17:56:12.774205+0000","last_active":"2024-05-20T17:56:13.780490+0000","last_peered":"2024-05-20T17:56:13.780490+0000","last_clean":"2024-05-20T17:56:13.780490+0000","last_became_active":"2024-05-20T17:56:12.773901+0000","last_became_peered":"2024-05-20T17:56:12.773901+0000","last_unstale":"2024-05-20T17:56:13.780490+0000","last_undegraded":"2024-05-20T17:56:13.780490+0000","last_fullsized":"2024-05-20T17:56:13.780490+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:34:34.049613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.780711+0000","last_change":"2024-05-20T17:56:12.778191+0000","last_active":"2024-05-20T17:56:12.780711+0000","last_peered":"2024-05-20T17:56:12.780711+0000","last_clean":"2024-05-20T17:56:12.780711+0000","last_became_active":"2024-05-20T17:56:12.777871+0000","last_became_peered":"2024-05-20T17:56:12.777871+0000","last_unstale":"2024-05-20T17:56:12.780711+0000","last_undegraded":"2024-05-20T17:56:12.780711+0000","last_fullsized":"2024-05-20T17:56:12.780711+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:16:10.631543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.782831+0000","last_change":"2024-05-20T17:56:12.776986+0000","last_active":"2024-05-20T17:56:12.782831+0000","last_peered":"2024-05-20T17:56:12.782831+0000","last_clean":"2024-05-20T17:56:12.782831+0000","last_became_active":"2024-05-20T17:56:12.776659+0000","last_became_peered":"2024-05-20T17:56:12.776659+0000","last_unstale":"2024-05-20T17:56:12.782831+0000","last_undegraded":"2024-05-20T17:56:12.782831+0000","last_fullsized":"2024-05-20T17:56:12.782831+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:29:47.605742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969150+0000","last_change":"2024-05-20T17:56:12.791412+0000","last_active":"2024-05-20T17:56:13.969150+0000","last_peered":"2024-05-20T17:56:13.969150+0000","last_clean":"2024-05-20T17:56:13.969150+0000","last_became_active":"2024-05-20T17:56:12.791054+0000","last_became_peered":"2024-05-20T17:56:12.791054+0000","last_unstale":"2024-05-20T17:56:13.969150+0000","last_undegraded":"2024-05-20T17:56:13.969150+0000","last_fullsized":"2024-05-20T17:56:13.969150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:51.163588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779152+0000","last_change":"2024-05-20T17:56:12.787597+0000","last_active":"2024-05-20T17:56:13.779152+0000","last_peered":"2024-05-20T17:56:13.779152+0000","last_clean":"2024-05-20T17:56:13.779152+0000","last_became_active":"2024-05-20T17:56:12.787265+0000","last_became_peered":"2024-05-20T17:56:12.787265+0000","last_unstale":"2024-05-20T17:56:13.779152+0000","last_undegraded":"2024-05-20T17:56:13.779152+0000","last_fullsized":"2024-05-20T17:56:13.779152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:37.994076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798179+0000","last_change":"2024-05-20T17:56:12.796401+0000","last_active":"2024-05-20T17:56:12.798179+0000","last_peered":"2024-05-20T17:56:12.798179+0000","last_clean":"2024-05-20T17:56:12.798179+0000","last_became_active":"2024-05-20T17:56:12.796066+0000","last_became_peered":"2024-05-20T17:56:12.796066+0000","last_unstale":"2024-05-20T17:56:12.798179+0000","last_undegraded":"2024-05-20T17:56:12.798179+0000","last_fullsized":"2024-05-20T17:56:12.798179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:49:49.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.797968+0000","last_change":"2024-05-20T17:56:12.795506+0000","last_active":"2024-05-20T17:56:12.797968+0000","last_peered":"2024-05-20T17:56:12.797968+0000","last_clean":"2024-05-20T17:56:12.797968+0000","last_became_active":"2024-05-20T17:56:12.795182+0000","last_became_peered":"2024-05-20T17:56:12.795182+0000","last_unstale":"2024-05-20T17:56:12.797968+0000","last_undegraded":"2024-05-20T17:56:12.797968+0000","last_fullsized":"2024-05-20T17:56:12.797968+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:23.926207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780288+0000","last_change":"2024-05-20T17:56:12.785040+0000","last_active":"2024-05-20T17:56:13.780288+0000","last_peered":"2024-05-20T17:56:13.780288+0000","last_clean":"2024-05-20T17:56:13.780288+0000","last_became_active":"2024-05-20T17:56:12.784662+0000","last_became_peered":"2024-05-20T17:56:12.784662+0000","last_unstale":"2024-05-20T17:56:13.780288+0000","last_undegraded":"2024-05-20T17:56:13.780288+0000","last_fullsized":"2024-05-20T17:56:13.780288+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:36.820883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779474+0000","last_change":"2024-05-20T17:56:12.786729+0000","last_active":"2024-05-20T17:56:13.779474+0000","last_peered":"2024-05-20T17:56:13.779474+0000","last_clean":"2024-05-20T17:56:13.779474+0000","last_became_active":"2024-05-20T17:56:12.786374+0000","last_became_peered":"2024-05-20T17:56:12.786374+0000","last_unstale":"2024-05-20T17:56:13.779474+0000","last_undegraded":"2024-05-20T17:56:13.779474+0000","last_fullsized":"2024-05-20T17:56:13.779474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:14.154819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779788+0000","last_change":"2024-05-20T17:56:12.778776+0000","last_active":"2024-05-20T17:56:13.779788+0000","last_peered":"2024-05-20T17:56:13.779788+0000","last_clean":"2024-05-20T17:56:13.779788+0000","last_became_active":"2024-05-20T17:56:12.778443+0000","last_became_peered":"2024-05-20T17:56:12.778443+0000","last_unstale":"2024-05-20T17:56:13.779788+0000","last_undegraded":"2024-05-20T17:56:13.779788+0000","last_fullsized":"2024-05-20T17:56:13.779788+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:49:46.488232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798975+0000","last_change":"2024-05-20T17:56:12.796708+0000","last_active":"2024-05-20T17:56:12.798975+0000","last_peered":"2024-05-20T17:56:12.798975+0000","last_clean":"2024-05-20T17:56:12.798975+0000","last_became_active":"2024-05-20T17:56:12.796362+0000","last_became_peered":"2024-05-20T17:56:12.796362+0000","last_unstale":"2024-05-20T17:56:12.798975+0000","last_undegraded":"2024-05-20T17:56:12.798975+0000","last_fullsized":"2024-05-20T17:56:12.798975+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:14.154819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.789225+0000","last_change":"2024-05-20T17:56:12.787407+0000","last_active":"2024-05-20T17:56:12.789225+0000","last_peered":"2024-05-20T17:56:12.789225+0000","last_clean":"2024-05-20T17:56:12.789225+0000","last_became_active":"2024-05-20T17:56:12.787112+0000","last_became_peered":"2024-05-20T17:56:12.787112+0000","last_unstale":"2024-05-20T17:56:12.789225+0000","last_undegraded":"2024-05-20T17:56:12.789225+0000","last_fullsized":"2024-05-20T17:56:12.789225+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:03:55.084619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969088+0000","last_change":"2024-05-20T17:56:12.784716+0000","last_active":"2024-05-20T17:56:13.969088+0000","last_peered":"2024-05-20T17:56:13.969088+0000","last_clean":"2024-05-20T17:56:13.969088+0000","last_became_active":"2024-05-20T17:56:12.784363+0000","last_became_peered":"2024-05-20T17:56:12.784363+0000","last_unstale":"2024-05-20T17:56:13.969088+0000","last_undegraded":"2024-05-20T17:56:13.969088+0000","last_fullsized":"2024-05-20T17:56:13.969088+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:47:11.707549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.787514+0000","last_change":"2024-05-20T17:56:12.783501+0000","last_active":"2024-05-20T17:56:12.787514+0000","last_peered":"2024-05-20T17:56:12.787514+0000","last_clean":"2024-05-20T17:56:12.787514+0000","last_became_active":"2024-05-20T17:56:12.782930+0000","last_became_peered":"2024-05-20T17:56:12.782930+0000","last_unstale":"2024-05-20T17:56:12.787514+0000","last_undegraded":"2024-05-20T17:56:12.787514+0000","last_fullsized":"2024-05-20T17:56:12.787514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:20.265559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780178+0000","last_change":"2024-05-20T17:56:12.772715+0000","last_active":"2024-05-20T17:56:13.780178+0000","last_peered":"2024-05-20T17:56:13.780178+0000","last_clean":"2024-05-20T17:56:13.780178+0000","last_became_active":"2024-05-20T17:56:12.772412+0000","last_became_peered":"2024-05-20T17:56:12.772412+0000","last_unstale":"2024-05-20T17:56:13.780178+0000","last_undegraded":"2024-05-20T17:56:13.780178+0000","last_fullsized":"2024-05-20T17:56:13.780178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:40.141714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.788967+0000","last_change":"2024-05-20T17:56:12.783961+0000","last_active":"2024-05-20T17:56:12.788967+0000","last_peered":"2024-05-20T17:56:12.788967+0000","last_clean":"2024-05-20T17:56:12.788967+0000","last_became_active":"2024-05-20T17:56:12.783470+0000","last_became_peered":"2024-05-20T17:56:12.783470+0000","last_unstale":"2024-05-20T17:56:12.788967+0000","last_undegraded":"2024-05-20T17:56:12.788967+0000","last_fullsized":"2024-05-20T17:56:12.788967+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:36.820883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778783+0000","last_change":"2024-05-20T17:56:12.778733+0000","last_active":"2024-05-20T17:56:13.778783+0000","last_peered":"2024-05-20T17:56:13.778783+0000","last_clean":"2024-05-20T17:56:13.778783+0000","last_became_active":"2024-05-20T17:56:12.778376+0000","last_became_peered":"2024-05-20T17:56:12.778376+0000","last_unstale":"2024-05-20T17:56:13.778783+0000","last_undegraded":"2024-05-20T17:56:13.778783+0000","last_fullsized":"2024-05-20T17:56:13.778783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:01:35.061949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779397+0000","last_change":"2024-05-20T17:56:12.779824+0000","last_active":"2024-05-20T17:56:13.779397+0000","last_peered":"2024-05-20T17:56:13.779397+0000","last_clean":"2024-05-20T17:56:13.779397+0000","last_became_active":"2024-05-20T17:56:12.779386+0000","last_became_peered":"2024-05-20T17:56:12.779386+0000","last_unstale":"2024-05-20T17:56:13.779397+0000","last_undegraded":"2024-05-20T17:56:13.779397+0000","last_fullsized":"2024-05-20T17:56:13.779397+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:49:49.890517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778550+0000","last_change":"2024-05-20T17:56:12.780197+0000","last_active":"2024-05-20T17:56:13.778550+0000","last_peered":"2024-05-20T17:56:13.778550+0000","last_clean":"2024-05-20T17:56:13.778550+0000","last_became_active":"2024-05-20T17:56:12.779866+0000","last_became_peered":"2024-05-20T17:56:12.779866+0000","last_unstale":"2024-05-20T17:56:13.778550+0000","last_undegraded":"2024-05-20T17:56:13.778550+0000","last_fullsized":"2024-05-20T17:56:13.778550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:12.761389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778522+0000","last_change":"2024-05-20T17:56:12.781024+0000","last_active":"2024-05-20T17:56:13.778522+0000","last_peered":"2024-05-20T17:56:13.778522+0000","last_clean":"2024-05-20T17:56:13.778522+0000","last_became_active":"2024-05-20T17:56:12.780719+0000","last_became_peered":"2024-05-20T17:56:12.780719+0000","last_unstale":"2024-05-20T17:56:13.778522+0000","last_undegraded":"2024-05-20T17:56:13.778522+0000","last_fullsized":"2024-05-20T17:56:13.778522+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:22:57.647585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.789179+0000","last_change":"2024-05-20T17:56:12.786113+0000","last_active":"2024-05-20T17:56:12.789179+0000","last_peered":"2024-05-20T17:56:12.789179+0000","last_clean":"2024-05-20T17:56:12.789179+0000","last_became_active":"2024-05-20T17:56:12.785726+0000","last_became_peered":"2024-05-20T17:56:12.785726+0000","last_unstale":"2024-05-20T17:56:12.789179+0000","last_undegraded":"2024-05-20T17:56:12.789179+0000","last_fullsized":"2024-05-20T17:56:12.789179+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:15:12.065585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780615+0000","last_change":"2024-05-20T17:56:12.782347+0000","last_active":"2024-05-20T17:56:13.780615+0000","last_peered":"2024-05-20T17:56:13.780615+0000","last_clean":"2024-05-20T17:56:13.780615+0000","last_became_active":"2024-05-20T17:56:12.782009+0000","last_became_peered":"2024-05-20T17:56:12.782009+0000","last_unstale":"2024-05-20T17:56:13.780615+0000","last_undegraded":"2024-05-20T17:56:13.780615+0000","last_fullsized":"2024-05-20T17:56:13.780615+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:09.470600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779596+0000","last_change":"2024-05-20T17:56:12.792647+0000","last_active":"2024-05-20T17:56:13.779596+0000","last_peered":"2024-05-20T17:56:13.779596+0000","last_clean":"2024-05-20T17:56:13.779596+0000","last_became_active":"2024-05-20T17:56:12.792348+0000","last_became_peered":"2024-05-20T17:56:12.792348+0000","last_unstale":"2024-05-20T17:56:13.779596+0000","last_undegraded":"2024-05-20T17:56:13.779596+0000","last_fullsized":"2024-05-20T17:56:13.779596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:00.386103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780332+0000","last_change":"2024-05-20T17:56:12.783863+0000","last_active":"2024-05-20T17:56:13.780332+0000","last_peered":"2024-05-20T17:56:13.780332+0000","last_clean":"2024-05-20T17:56:13.780332+0000","last_became_active":"2024-05-20T17:56:12.783514+0000","last_became_peered":"2024-05-20T17:56:12.783514+0000","last_unstale":"2024-05-20T17:56:13.780332+0000","last_undegraded":"2024-05-20T17:56:13.780332+0000","last_fullsized":"2024-05-20T17:56:13.780332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:14.592909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.787521+0000","last_change":"2024-05-20T17:56:12.782741+0000","last_active":"2024-05-20T17:56:12.787521+0000","last_peered":"2024-05-20T17:56:12.787521+0000","last_clean":"2024-05-20T17:56:12.787521+0000","last_became_active":"2024-05-20T17:56:12.782297+0000","last_became_peered":"2024-05-20T17:56:12.782297+0000","last_unstale":"2024-05-20T17:56:12.787521+0000","last_undegraded":"2024-05-20T17:56:12.787521+0000","last_fullsized":"2024-05-20T17:56:12.787521+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:05.643326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.791558+0000","last_change":"2024-05-20T17:56:12.788711+0000","last_active":"2024-05-20T17:56:12.791558+0000","last_peered":"2024-05-20T17:56:12.791558+0000","last_clean":"2024-05-20T17:56:12.791558+0000","last_became_active":"2024-05-20T17:56:12.788167+0000","last_became_peered":"2024-05-20T17:56:12.788167+0000","last_unstale":"2024-05-20T17:56:12.791558+0000","last_undegraded":"2024-05-20T17:56:12.791558+0000","last_fullsized":"2024-05-20T17:56:12.791558+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:30.411831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779733+0000","last_change":"2024-05-20T17:56:12.787363+0000","last_active":"2024-05-20T17:56:13.779733+0000","last_peered":"2024-05-20T17:56:13.779733+0000","last_clean":"2024-05-20T17:56:13.779733+0000","last_became_active":"2024-05-20T17:56:12.786936+0000","last_became_peered":"2024-05-20T17:56:12.786936+0000","last_unstale":"2024-05-20T17:56:13.779733+0000","last_undegraded":"2024-05-20T17:56:13.779733+0000","last_fullsized":"2024-05-20T17:56:13.779733+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:41.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779698+0000","last_change":"2024-05-20T17:56:12.784634+0000","last_active":"2024-05-20T17:56:13.779698+0000","last_peered":"2024-05-20T17:56:13.779698+0000","last_clean":"2024-05-20T17:56:13.779698+0000","last_became_active":"2024-05-20T17:56:12.784322+0000","last_became_peered":"2024-05-20T17:56:12.784322+0000","last_unstale":"2024-05-20T17:56:13.779698+0000","last_undegraded":"2024-05-20T17:56:13.779698+0000","last_fullsized":"2024-05-20T17:56:13.779698+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:32.991681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.791235+0000","last_change":"2024-05-20T17:56:12.787860+0000","last_active":"2024-05-20T17:56:12.791235+0000","last_peered":"2024-05-20T17:56:12.791235+0000","last_clean":"2024-05-20T17:56:12.791235+0000","last_became_active":"2024-05-20T17:56:12.787414+0000","last_became_peered":"2024-05-20T17:56:12.787414+0000","last_unstale":"2024-05-20T17:56:12.791235+0000","last_undegraded":"2024-05-20T17:56:12.791235+0000","last_fullsized":"2024-05-20T17:56:12.791235+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:09.470600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.792161+0000","last_change":"2024-05-20T17:56:12.790336+0000","last_active":"2024-05-20T17:56:12.792161+0000","last_peered":"2024-05-20T17:56:12.792161+0000","last_clean":"2024-05-20T17:56:12.792161+0000","last_became_active":"2024-05-20T17:56:12.790032+0000","last_became_peered":"2024-05-20T17:56:12.790032+0000","last_unstale":"2024-05-20T17:56:12.792161+0000","last_undegraded":"2024-05-20T17:56:12.792161+0000","last_fullsized":"2024-05-20T17:56:12.792161+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:17.126038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.801063+0000","last_change":"2024-05-20T17:56:11.778666+0000","last_active":"2024-05-20T17:56:12.801063+0000","last_peered":"2024-05-20T17:56:12.801063+0000","last_clean":"2024-05-20T17:56:12.801063+0000","last_became_active":"2024-05-20T17:56:11.778312+0000","last_became_peered":"2024-05-20T17:56:11.778312+0000","last_unstale":"2024-05-20T17:56:12.801063+0000","last_undegraded":"2024-05-20T17:56:12.801063+0000","last_fullsized":"2024-05-20T17:56:12.801063+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:39.175939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780474+0000","last_change":"2024-05-20T17:56:12.779759+0000","last_active":"2024-05-20T17:56:13.780474+0000","last_peered":"2024-05-20T17:56:13.780474+0000","last_clean":"2024-05-20T17:56:13.780474+0000","last_became_active":"2024-05-20T17:56:12.779419+0000","last_became_peered":"2024-05-20T17:56:12.779419+0000","last_unstale":"2024-05-20T17:56:13.780474+0000","last_undegraded":"2024-05-20T17:56:13.780474+0000","last_fullsized":"2024-05-20T17:56:13.780474+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:05.643326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798505+0000","last_change":"2024-05-20T17:56:11.782771+0000","last_active":"2024-05-20T17:56:12.798505+0000","last_peered":"2024-05-20T17:56:12.798505+0000","last_clean":"2024-05-20T17:56:12.798505+0000","last_became_active":"2024-05-20T17:56:11.782396+0000","last_became_peered":"2024-05-20T17:56:11.782396+0000","last_unstale":"2024-05-20T17:56:12.798505+0000","last_undegraded":"2024-05-20T17:56:12.798505+0000","last_fullsized":"2024-05-20T17:56:12.798505+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:13.147539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.791383+0000","last_change":"2024-05-20T17:56:12.783525+0000","last_active":"2024-05-20T17:56:12.791383+0000","last_peered":"2024-05-20T17:56:12.791383+0000","last_clean":"2024-05-20T17:56:12.791383+0000","last_became_active":"2024-05-20T17:56:12.783193+0000","last_became_peered":"2024-05-20T17:56:12.783193+0000","last_unstale":"2024-05-20T17:56:12.791383+0000","last_undegraded":"2024-05-20T17:56:12.791383+0000","last_fullsized":"2024-05-20T17:56:12.791383+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:11.333127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798156+0000","last_change":"2024-05-20T17:56:11.784017+0000","last_active":"2024-05-20T17:56:12.798156+0000","last_peered":"2024-05-20T17:56:12.798156+0000","last_clean":"2024-05-20T17:56:12.798156+0000","last_became_active":"2024-05-20T17:56:11.783719+0000","last_became_peered":"2024-05-20T17:56:11.783719+0000","last_unstale":"2024-05-20T17:56:12.798156+0000","last_undegraded":"2024-05-20T17:56:12.798156+0000","last_fullsized":"2024-05-20T17:56:12.798156+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:36.986797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798141+0000","last_change":"2024-05-20T17:56:12.794869+0000","last_active":"2024-05-20T17:56:12.798141+0000","last_peered":"2024-05-20T17:56:12.798141+0000","last_clean":"2024-05-20T17:56:12.798141+0000","last_became_active":"2024-05-20T17:56:12.794483+0000","last_became_peered":"2024-05-20T17:56:12.794483+0000","last_unstale":"2024-05-20T17:56:12.798141+0000","last_undegraded":"2024-05-20T17:56:12.798141+0000","last_fullsized":"2024-05-20T17:56:12.798141+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:08.520721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.797584+0000","last_change":"2024-05-20T17:56:11.785260+0000","last_active":"2024-05-20T17:56:12.797584+0000","last_peered":"2024-05-20T17:56:12.797584+0000","last_clean":"2024-05-20T17:56:12.797584+0000","last_became_active":"2024-05-20T17:56:11.784926+0000","last_became_peered":"2024-05-20T17:56:11.784926+0000","last_unstale":"2024-05-20T17:56:12.797584+0000","last_undegraded":"2024-05-20T17:56:12.797584+0000","last_fullsized":"2024-05-20T17:56:12.797584+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:51:59.378824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969127+0000","last_change":"2024-05-20T17:56:12.790786+0000","last_active":"2024-05-20T17:56:13.969127+0000","last_peered":"2024-05-20T17:56:13.969127+0000","last_clean":"2024-05-20T17:56:13.969127+0000","last_became_active":"2024-05-20T17:56:12.790301+0000","last_became_peered":"2024-05-20T17:56:12.790301+0000","last_unstale":"2024-05-20T17:56:13.969127+0000","last_undegraded":"2024-05-20T17:56:13.969127+0000","last_fullsized":"2024-05-20T17:56:13.969127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:22:15.578255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778815+0000","last_change":"2024-05-20T17:56:11.783529+0000","last_active":"2024-05-20T17:56:13.778815+0000","last_peered":"2024-05-20T17:56:13.778815+0000","last_clean":"2024-05-20T17:56:13.778815+0000","last_became_active":"2024-05-20T17:56:11.783159+0000","last_became_peered":"2024-05-20T17:56:11.783159+0000","last_unstale":"2024-05-20T17:56:13.778815+0000","last_undegraded":"2024-05-20T17:56:13.778815+0000","last_fullsized":"2024-05-20T17:56:13.778815+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:13.147539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.778525+0000","last_change":"2024-05-20T17:56:12.772855+0000","last_active":"2024-05-20T17:56:12.778525+0000","last_peered":"2024-05-20T17:56:12.778525+0000","last_clean":"2024-05-20T17:56:12.778525+0000","last_became_active":"2024-05-20T17:56:12.772477+0000","last_became_peered":"2024-05-20T17:56:12.772477+0000","last_unstale":"2024-05-20T17:56:12.778525+0000","last_undegraded":"2024-05-20T17:56:12.778525+0000","last_fullsized":"2024-05-20T17:56:12.778525+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:40.141714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778671+0000","last_change":"2024-05-20T17:56:11.781438+0000","last_active":"2024-05-20T17:56:13.778671+0000","last_peered":"2024-05-20T17:56:13.778671+0000","last_clean":"2024-05-20T17:56:13.778671+0000","last_became_active":"2024-05-20T17:56:11.781067+0000","last_became_peered":"2024-05-20T17:56:11.781067+0000","last_unstale":"2024-05-20T17:56:13.778671+0000","last_undegraded":"2024-05-20T17:56:13.778671+0000","last_fullsized":"2024-05-20T17:56:13.778671+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:49:48.883238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.780459+0000","last_change":"2024-05-20T17:56:12.777691+0000","last_active":"2024-05-20T17:56:12.780459+0000","last_peered":"2024-05-20T17:56:12.780459+0000","last_clean":"2024-05-20T17:56:12.780459+0000","last_became_active":"2024-05-20T17:56:12.777349+0000","last_became_peered":"2024-05-20T17:56:12.777349+0000","last_unstale":"2024-05-20T17:56:12.780459+0000","last_undegraded":"2024-05-20T17:56:12.780459+0000","last_fullsized":"2024-05-20T17:56:12.780459+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:14:22.696096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778528+0000","last_change":"2024-05-20T17:56:11.775693+0000","last_active":"2024-05-20T17:56:13.778528+0000","last_peered":"2024-05-20T17:56:13.778528+0000","last_clean":"2024-05-20T17:56:13.778528+0000","last_became_active":"2024-05-20T17:56:11.775159+0000","last_became_peered":"2024-05-20T17:56:11.775159+0000","last_unstale":"2024-05-20T17:56:13.778528+0000","last_undegraded":"2024-05-20T17:56:13.778528+0000","last_fullsized":"2024-05-20T17:56:13.778528+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:22.918928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778701+0000","last_change":"2024-05-20T17:56:12.774857+0000","last_active":"2024-05-20T17:56:13.778701+0000","last_peered":"2024-05-20T17:56:13.778701+0000","last_clean":"2024-05-20T17:56:13.778701+0000","last_became_active":"2024-05-20T17:56:12.774473+0000","last_became_peered":"2024-05-20T17:56:12.774473+0000","last_unstale":"2024-05-20T17:56:13.778701+0000","last_undegraded":"2024-05-20T17:56:13.778701+0000","last_fullsized":"2024-05-20T17:56:13.778701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:51.541859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.770462+0000","last_change":"2024-05-20T17:56:11.778335+0000","last_active":"2024-05-20T17:56:12.770462+0000","last_peered":"2024-05-20T17:56:12.770462+0000","last_clean":"2024-05-20T17:56:12.770462+0000","last_became_active":"2024-05-20T17:56:11.778006+0000","last_became_peered":"2024-05-20T17:56:11.778006+0000","last_unstale":"2024-05-20T17:56:12.770462+0000","last_undegraded":"2024-05-20T17:56:12.770462+0000","last_fullsized":"2024-05-20T17:56:12.770462+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:46.902516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.789433+0000","last_change":"2024-05-20T17:56:12.787275+0000","last_active":"2024-05-20T17:56:12.789433+0000","last_peered":"2024-05-20T17:56:12.789433+0000","last_clean":"2024-05-20T17:56:12.789433+0000","last_became_active":"2024-05-20T17:56:12.786962+0000","last_became_peered":"2024-05-20T17:56:12.786962+0000","last_unstale":"2024-05-20T17:56:12.789433+0000","last_undegraded":"2024-05-20T17:56:12.789433+0000","last_fullsized":"2024-05-20T17:56:12.789433+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:22.930982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.783138+0000","last_change":"2024-05-20T17:56:11.785213+0000","last_active":"2024-05-20T17:56:12.783138+0000","last_peered":"2024-05-20T17:56:12.783138+0000","last_clean":"2024-05-20T17:56:12.783138+0000","last_became_active":"2024-05-20T17:56:11.784846+0000","last_became_peered":"2024-05-20T17:56:11.784846+0000","last_unstale":"2024-05-20T17:56:12.783138+0000","last_undegraded":"2024-05-20T17:56:12.783138+0000","last_fullsized":"2024-05-20T17:56:12.783138+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:58:19.708300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778616+0000","last_change":"2024-05-20T17:56:12.777908+0000","last_active":"2024-05-20T17:56:13.778616+0000","last_peered":"2024-05-20T17:56:13.778616+0000","last_clean":"2024-05-20T17:56:13.778616+0000","last_became_active":"2024-05-20T17:56:12.777573+0000","last_became_peered":"2024-05-20T17:56:12.777573+0000","last_unstale":"2024-05-20T17:56:13.778616+0000","last_undegraded":"2024-05-20T17:56:13.778616+0000","last_fullsized":"2024-05-20T17:56:13.778616+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:13:43.240247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780512+0000","last_change":"2024-05-20T17:56:11.777241+0000","last_active":"2024-05-20T17:56:13.780512+0000","last_peered":"2024-05-20T17:56:13.780512+0000","last_clean":"2024-05-20T17:56:13.780512+0000","last_became_active":"2024-05-20T17:56:11.775951+0000","last_became_peered":"2024-05-20T17:56:11.775951+0000","last_unstale":"2024-05-20T17:56:13.780512+0000","last_undegraded":"2024-05-20T17:56:13.780512+0000","last_fullsized":"2024-05-20T17:56:13.780512+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:55:04.636409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.781763+0000","last_change":"2024-05-20T17:56:12.778549+0000","last_active":"2024-05-20T17:56:12.781763+0000","last_peered":"2024-05-20T17:56:12.781763+0000","last_clean":"2024-05-20T17:56:12.781763+0000","last_became_active":"2024-05-20T17:56:12.778209+0000","last_became_peered":"2024-05-20T17:56:12.778209+0000","last_unstale":"2024-05-20T17:56:12.781763+0000","last_undegraded":"2024-05-20T17:56:12.781763+0000","last_fullsized":"2024-05-20T17:56:12.781763+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:45:40.183218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"63'3","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.801618+0000","last_change":"2024-05-20T17:56:11.785229+0000","last_active":"2024-05-20T17:56:12.801618+0000","last_peered":"2024-05-20T17:56:12.801618+0000","last_clean":"2024-05-20T17:56:12.801618+0000","last_became_active":"2024-05-20T17:56:11.784908+0000","last_became_peered":"2024-05-20T17:56:11.784908+0000","last_unstale":"2024-05-20T17:56:12.801618+0000","last_undegraded":"2024-05-20T17:56:12.801618+0000","last_fullsized":"2024-05-20T17:56:12.801618+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:25:08.814634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780722+0000","last_change":"2024-05-20T17:56:12.772169+0000","last_active":"2024-05-20T17:56:13.780722+0000","last_peered":"2024-05-20T17:56:13.780722+0000","last_clean":"2024-05-20T17:56:13.780722+0000","last_became_active":"2024-05-20T17:56:12.771856+0000","last_became_peered":"2024-05-20T17:56:12.771856+0000","last_unstale":"2024-05-20T17:56:13.780722+0000","last_undegraded":"2024-05-20T17:56:13.780722+0000","last_fullsized":"2024-05-20T17:56:13.780722+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:20.265559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"63'6","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.801658+0000","last_change":"2024-05-20T17:56:11.772482+0000","last_active":"2024-05-20T17:56:12.801658+0000","last_peered":"2024-05-20T17:56:12.801658+0000","last_clean":"2024-05-20T17:56:12.801658+0000","last_became_active":"2024-05-20T17:56:11.772145+0000","last_became_peered":"2024-05-20T17:56:11.772145+0000","last_unstale":"2024-05-20T17:56:12.801658+0000","last_undegraded":"2024-05-20T17:56:12.801658+0000","last_fullsized":"2024-05-20T17:56:12.801658+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:16:09.624264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780957+0000","last_change":"2024-05-20T17:56:12.790528+0000","last_active":"2024-05-20T17:56:13.780957+0000","last_peered":"2024-05-20T17:56:13.780957+0000","last_clean":"2024-05-20T17:56:13.780957+0000","last_became_active":"2024-05-20T17:56:12.790177+0000","last_became_peered":"2024-05-20T17:56:12.790177+0000","last_unstale":"2024-05-20T17:56:13.780957+0000","last_undegraded":"2024-05-20T17:56:13.780957+0000","last_fullsized":"2024-05-20T17:56:13.780957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:22.930982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.799219+0000","last_change":"2024-05-20T17:56:11.782894+0000","last_active":"2024-05-20T17:56:12.799219+0000","last_peered":"2024-05-20T17:56:12.799219+0000","last_clean":"2024-05-20T17:56:12.799219+0000","last_became_active":"2024-05-20T17:56:11.782313+0000","last_became_peered":"2024-05-20T17:56:11.782313+0000","last_unstale":"2024-05-20T17:56:12.799219+0000","last_undegraded":"2024-05-20T17:56:12.799219+0000","last_fullsized":"2024-05-20T17:56:12.799219+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:55.949092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779191+0000","last_change":"2024-05-20T17:56:12.786511+0000","last_active":"2024-05-20T17:56:13.779191+0000","last_peered":"2024-05-20T17:56:13.779191+0000","last_clean":"2024-05-20T17:56:13.779191+0000","last_became_active":"2024-05-20T17:56:12.786164+0000","last_became_peered":"2024-05-20T17:56:12.786164+0000","last_unstale":"2024-05-20T17:56:13.779191+0000","last_undegraded":"2024-05-20T17:56:13.779191+0000","last_fullsized":"2024-05-20T17:56:13.779191+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:23.926207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780002+0000","last_change":"2024-05-20T17:56:11.774682+0000","last_active":"2024-05-20T17:56:13.780002+0000","last_peered":"2024-05-20T17:56:13.780002+0000","last_clean":"2024-05-20T17:56:13.780002+0000","last_became_active":"2024-05-20T17:56:11.774195+0000","last_became_peered":"2024-05-20T17:56:11.774195+0000","last_unstale":"2024-05-20T17:56:13.780002+0000","last_undegraded":"2024-05-20T17:56:13.780002+0000","last_fullsized":"2024-05-20T17:56:13.780002+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:04.636047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.789458+0000","last_change":"2024-05-20T17:56:12.786278+0000","last_active":"2024-05-20T17:56:12.789458+0000","last_peered":"2024-05-20T17:56:12.789458+0000","last_clean":"2024-05-20T17:56:12.789458+0000","last_became_active":"2024-05-20T17:56:12.785682+0000","last_became_peered":"2024-05-20T17:56:12.785682+0000","last_unstale":"2024-05-20T17:56:12.789458+0000","last_undegraded":"2024-05-20T17:56:12.789458+0000","last_fullsized":"2024-05-20T17:56:12.789458+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:14.592909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.777350+0000","last_change":"2024-05-20T17:56:11.782668+0000","last_active":"2024-05-20T17:56:12.777350+0000","last_peered":"2024-05-20T17:56:12.777350+0000","last_clean":"2024-05-20T17:56:12.777350+0000","last_became_active":"2024-05-20T17:56:11.782162+0000","last_became_peered":"2024-05-20T17:56:11.782162+0000","last_unstale":"2024-05-20T17:56:12.777350+0000","last_undegraded":"2024-05-20T17:56:12.777350+0000","last_fullsized":"2024-05-20T17:56:12.777350+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:36.666746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.785986+0000","last_change":"2024-05-20T17:56:12.777447+0000","last_active":"2024-05-20T17:56:12.785986+0000","last_peered":"2024-05-20T17:56:12.785986+0000","last_clean":"2024-05-20T17:56:12.785986+0000","last_became_active":"2024-05-20T17:56:12.777110+0000","last_became_peered":"2024-05-20T17:56:12.777110+0000","last_unstale":"2024-05-20T17:56:12.785986+0000","last_undegraded":"2024-05-20T17:56:12.785986+0000","last_fullsized":"2024-05-20T17:56:12.785986+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:36.820883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"63'8","reported_seq":22,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780951+0000","last_change":"2024-05-20T17:56:11.777779+0000","last_active":"2024-05-20T17:56:13.780951+0000","last_peered":"2024-05-20T17:56:13.780951+0000","last_clean":"2024-05-20T17:56:13.780951+0000","last_became_active":"2024-05-20T17:56:11.777448+0000","last_became_peered":"2024-05-20T17:56:11.777448+0000","last_unstale":"2024-05-20T17:56:13.780951+0000","last_undegraded":"2024-05-20T17:56:13.780951+0000","last_fullsized":"2024-05-20T17:56:13.780951+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:00:07.196930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.797902+0000","last_change":"2024-05-20T17:56:12.795403+0000","last_active":"2024-05-20T17:56:12.797902+0000","last_peered":"2024-05-20T17:56:12.797902+0000","last_clean":"2024-05-20T17:56:12.797902+0000","last_became_active":"2024-05-20T17:56:12.795059+0000","last_became_peered":"2024-05-20T17:56:12.795059+0000","last_unstale":"2024-05-20T17:56:12.797902+0000","last_undegraded":"2024-05-20T17:56:12.797902+0000","last_fullsized":"2024-05-20T17:56:12.797902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:37.994076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780695+0000","last_change":"2024-05-20T17:56:11.774580+0000","last_active":"2024-05-20T17:56:13.780695+0000","last_peered":"2024-05-20T17:56:13.780695+0000","last_clean":"2024-05-20T17:56:13.780695+0000","last_became_active":"2024-05-20T17:56:11.774229+0000","last_became_peered":"2024-05-20T17:56:11.774229+0000","last_unstale":"2024-05-20T17:56:13.780695+0000","last_undegraded":"2024-05-20T17:56:13.780695+0000","last_fullsized":"2024-05-20T17:56:13.780695+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:34:33.042334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.781727+0000","last_change":"2024-05-20T17:56:12.778976+0000","last_active":"2024-05-20T17:56:12.781727+0000","last_peered":"2024-05-20T17:56:12.781727+0000","last_clean":"2024-05-20T17:56:12.781727+0000","last_became_active":"2024-05-20T17:56:12.778652+0000","last_became_peered":"2024-05-20T17:56:12.778652+0000","last_unstale":"2024-05-20T17:56:12.781727+0000","last_undegraded":"2024-05-20T17:56:12.781727+0000","last_fullsized":"2024-05-20T17:56:12.781727+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:32.991681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.798186+0000","last_change":"2024-05-20T17:56:11.779906+0000","last_active":"2024-05-20T17:56:12.798186+0000","last_peered":"2024-05-20T17:56:12.798186+0000","last_clean":"2024-05-20T17:56:12.798186+0000","last_became_active":"2024-05-20T17:56:11.779534+0000","last_became_peered":"2024-05-20T17:56:11.779534+0000","last_unstale":"2024-05-20T17:56:12.798186+0000","last_undegraded":"2024-05-20T17:56:12.798186+0000","last_fullsized":"2024-05-20T17:56:12.798186+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:32:35.509916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780376+0000","last_change":"2024-05-20T17:56:12.777245+0000","last_active":"2024-05-20T17:56:13.780376+0000","last_peered":"2024-05-20T17:56:13.780376+0000","last_clean":"2024-05-20T17:56:13.780376+0000","last_became_active":"2024-05-20T17:56:12.776936+0000","last_became_peered":"2024-05-20T17:56:12.776936+0000","last_unstale":"2024-05-20T17:56:13.780376+0000","last_undegraded":"2024-05-20T17:56:13.780376+0000","last_fullsized":"2024-05-20T17:56:13.780376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:17.126038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.801613+0000","last_change":"2024-05-20T17:56:11.785227+0000","last_active":"2024-05-20T17:56:12.801613+0000","last_peered":"2024-05-20T17:56:12.801613+0000","last_clean":"2024-05-20T17:56:12.801613+0000","last_became_active":"2024-05-20T17:56:11.784953+0000","last_became_peered":"2024-05-20T17:56:11.784953+0000","last_unstale":"2024-05-20T17:56:12.801613+0000","last_undegraded":"2024-05-20T17:56:12.801613+0000","last_fullsized":"2024-05-20T17:56:12.801613+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:18.659442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.778757+0000","last_change":"2024-05-20T17:56:12.777140+0000","last_active":"2024-05-20T17:56:12.778757+0000","last_peered":"2024-05-20T17:56:12.778757+0000","last_clean":"2024-05-20T17:56:12.778757+0000","last_became_active":"2024-05-20T17:56:12.776813+0000","last_became_peered":"2024-05-20T17:56:12.776813+0000","last_unstale":"2024-05-20T17:56:12.778757+0000","last_undegraded":"2024-05-20T17:56:12.778757+0000","last_fullsized":"2024-05-20T17:56:12.778757+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:38.630668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778742+0000","last_change":"2024-05-20T17:56:11.781321+0000","last_active":"2024-05-20T17:56:13.778742+0000","last_peered":"2024-05-20T17:56:13.778742+0000","last_clean":"2024-05-20T17:56:13.778742+0000","last_became_active":"2024-05-20T17:56:11.780957+0000","last_became_peered":"2024-05-20T17:56:11.780957+0000","last_unstale":"2024-05-20T17:56:13.778742+0000","last_undegraded":"2024-05-20T17:56:13.778742+0000","last_fullsized":"2024-05-20T17:56:13.778742+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:40.029175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.791209+0000","last_change":"2024-05-20T17:56:12.787738+0000","last_active":"2024-05-20T17:56:12.791209+0000","last_peered":"2024-05-20T17:56:12.791209+0000","last_clean":"2024-05-20T17:56:12.791209+0000","last_became_active":"2024-05-20T17:56:12.787386+0000","last_became_peered":"2024-05-20T17:56:12.787386+0000","last_unstale":"2024-05-20T17:56:12.791209+0000","last_undegraded":"2024-05-20T17:56:12.791209+0000","last_fullsized":"2024-05-20T17:56:12.791209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:49:46.488232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.797568+0000","last_change":"2024-05-20T17:56:11.785684+0000","last_active":"2024-05-20T17:56:12.797568+0000","last_peered":"2024-05-20T17:56:12.797568+0000","last_clean":"2024-05-20T17:56:12.797568+0000","last_became_active":"2024-05-20T17:56:11.785253+0000","last_became_peered":"2024-05-20T17:56:11.785253+0000","last_unstale":"2024-05-20T17:56:12.797568+0000","last_undegraded":"2024-05-20T17:56:12.797568+0000","last_fullsized":"2024-05-20T17:56:12.797568+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:22.918928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779620+0000","last_change":"2024-05-20T17:56:12.783492+0000","last_active":"2024-05-20T17:56:13.779620+0000","last_peered":"2024-05-20T17:56:13.779620+0000","last_clean":"2024-05-20T17:56:13.779620+0000","last_became_active":"2024-05-20T17:56:12.783018+0000","last_became_peered":"2024-05-20T17:56:12.783018+0000","last_unstale":"2024-05-20T17:56:13.779620+0000","last_undegraded":"2024-05-20T17:56:13.779620+0000","last_fullsized":"2024-05-20T17:56:13.779620+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:29:47.605742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779904+0000","last_change":"2024-05-20T17:56:11.774755+0000","last_active":"2024-05-20T17:56:13.779904+0000","last_peered":"2024-05-20T17:56:13.779904+0000","last_clean":"2024-05-20T17:56:13.779904+0000","last_became_active":"2024-05-20T17:56:11.774419+0000","last_became_peered":"2024-05-20T17:56:11.774419+0000","last_unstale":"2024-05-20T17:56:13.779904+0000","last_undegraded":"2024-05-20T17:56:13.779904+0000","last_fullsized":"2024-05-20T17:56:13.779904+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:19.258279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.777850+0000","last_change":"2024-05-20T17:56:12.776907+0000","last_active":"2024-05-20T17:56:12.777850+0000","last_peered":"2024-05-20T17:56:12.777850+0000","last_clean":"2024-05-20T17:56:12.777850+0000","last_became_active":"2024-05-20T17:56:12.776588+0000","last_became_peered":"2024-05-20T17:56:12.776588+0000","last_unstale":"2024-05-20T17:56:12.777850+0000","last_undegraded":"2024-05-20T17:56:12.777850+0000","last_fullsized":"2024-05-20T17:56:12.777850+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:09.464277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.767652+0000","last_change":"2024-05-20T17:56:11.783055+0000","last_active":"2024-05-20T17:56:12.767652+0000","last_peered":"2024-05-20T17:56:12.767652+0000","last_clean":"2024-05-20T17:56:12.767652+0000","last_became_active":"2024-05-20T17:56:11.782708+0000","last_became_peered":"2024-05-20T17:56:11.782708+0000","last_unstale":"2024-05-20T17:56:12.767652+0000","last_undegraded":"2024-05-20T17:56:12.767652+0000","last_fullsized":"2024-05-20T17:56:12.767652+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:07.513442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.779431+0000","last_change":"2024-05-20T17:56:12.777767+0000","last_active":"2024-05-20T17:56:12.779431+0000","last_peered":"2024-05-20T17:56:12.779431+0000","last_clean":"2024-05-20T17:56:12.779431+0000","last_became_active":"2024-05-20T17:56:12.777468+0000","last_became_peered":"2024-05-20T17:56:12.777468+0000","last_unstale":"2024-05-20T17:56:12.779431+0000","last_undegraded":"2024-05-20T17:56:12.779431+0000","last_fullsized":"2024-05-20T17:56:12.779431+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:41.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780859+0000","last_change":"2024-05-20T17:56:11.779924+0000","last_active":"2024-05-20T17:56:13.780859+0000","last_peered":"2024-05-20T17:56:13.780859+0000","last_clean":"2024-05-20T17:56:13.780859+0000","last_became_active":"2024-05-20T17:56:11.779606+0000","last_became_peered":"2024-05-20T17:56:11.779606+0000","last_unstale":"2024-05-20T17:56:13.780859+0000","last_undegraded":"2024-05-20T17:56:13.780859+0000","last_fullsized":"2024-05-20T17:56:13.780859+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:21.923702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969334+0000","last_change":"2024-05-20T17:56:12.782165+0000","last_active":"2024-05-20T17:56:13.969334+0000","last_peered":"2024-05-20T17:56:13.969334+0000","last_clean":"2024-05-20T17:56:13.969334+0000","last_became_active":"2024-05-20T17:56:12.781867+0000","last_became_peered":"2024-05-20T17:56:12.781867+0000","last_unstale":"2024-05-20T17:56:13.969334+0000","last_undegraded":"2024-05-20T17:56:13.969334+0000","last_fullsized":"2024-05-20T17:56:13.969334+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:29:40.571496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.780027+0000","last_change":"2024-05-20T17:56:11.780823+0000","last_active":"2024-05-20T17:56:13.780027+0000","last_peered":"2024-05-20T17:56:13.780027+0000","last_clean":"2024-05-20T17:56:13.780027+0000","last_became_active":"2024-05-20T17:56:11.780406+0000","last_became_peered":"2024-05-20T17:56:11.780406+0000","last_unstale":"2024-05-20T17:56:13.780027+0000","last_undegraded":"2024-05-20T17:56:13.780027+0000","last_fullsized":"2024-05-20T17:56:13.780027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:36.666746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779776+0000","last_change":"2024-05-20T17:56:12.788369+0000","last_active":"2024-05-20T17:56:13.779776+0000","last_peered":"2024-05-20T17:56:13.779776+0000","last_clean":"2024-05-20T17:56:13.779776+0000","last_became_active":"2024-05-20T17:56:12.788053+0000","last_became_peered":"2024-05-20T17:56:12.788053+0000","last_unstale":"2024-05-20T17:56:13.779776+0000","last_undegraded":"2024-05-20T17:56:13.779776+0000","last_fullsized":"2024-05-20T17:56:13.779776+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:11.333127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.767992+0000","last_change":"2024-05-20T17:56:11.783986+0000","last_active":"2024-05-20T17:56:12.767992+0000","last_peered":"2024-05-20T17:56:12.767992+0000","last_clean":"2024-05-20T17:56:12.767992+0000","last_became_active":"2024-05-20T17:56:11.783679+0000","last_became_peered":"2024-05-20T17:56:11.783679+0000","last_unstale":"2024-05-20T17:56:12.767992+0000","last_undegraded":"2024-05-20T17:56:12.767992+0000","last_fullsized":"2024-05-20T17:56:12.767992+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:49:48.883238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.777303+0000","last_change":"2024-05-20T17:56:12.774618+0000","last_active":"2024-05-20T17:56:12.777303+0000","last_peered":"2024-05-20T17:56:12.777303+0000","last_clean":"2024-05-20T17:56:12.777303+0000","last_became_active":"2024-05-20T17:56:12.774245+0000","last_became_peered":"2024-05-20T17:56:12.774245+0000","last_unstale":"2024-05-20T17:56:12.777303+0000","last_undegraded":"2024-05-20T17:56:12.777303+0000","last_fullsized":"2024-05-20T17:56:12.777303+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:04:48.208929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.768317+0000","last_change":"2024-05-20T17:56:11.778973+0000","last_active":"2024-05-20T17:56:12.768317+0000","last_peered":"2024-05-20T17:56:12.768317+0000","last_clean":"2024-05-20T17:56:12.768317+0000","last_became_active":"2024-05-20T17:56:11.778631+0000","last_became_peered":"2024-05-20T17:56:11.778631+0000","last_unstale":"2024-05-20T17:56:12.768317+0000","last_undegraded":"2024-05-20T17:56:12.768317+0000","last_fullsized":"2024-05-20T17:56:12.768317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:19:31.984401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.788925+0000","last_change":"2024-05-20T17:56:12.782593+0000","last_active":"2024-05-20T17:56:12.788925+0000","last_peered":"2024-05-20T17:56:12.788925+0000","last_clean":"2024-05-20T17:56:12.788925+0000","last_became_active":"2024-05-20T17:56:12.781567+0000","last_became_peered":"2024-05-20T17:56:12.781567+0000","last_unstale":"2024-05-20T17:56:12.788925+0000","last_undegraded":"2024-05-20T17:56:12.788925+0000","last_fullsized":"2024-05-20T17:56:12.788925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:36:40.141714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.778137+0000","last_change":"2024-05-20T17:56:11.786345+0000","last_active":"2024-05-20T17:56:12.778137+0000","last_peered":"2024-05-20T17:56:12.778137+0000","last_clean":"2024-05-20T17:56:12.778137+0000","last_became_active":"2024-05-20T17:56:11.786051+0000","last_became_peered":"2024-05-20T17:56:11.786051+0000","last_unstale":"2024-05-20T17:56:12.778137+0000","last_undegraded":"2024-05-20T17:56:12.778137+0000","last_fullsized":"2024-05-20T17:56:12.778137+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:13:35.804747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.779884+0000","last_change":"2024-05-20T17:56:12.776829+0000","last_active":"2024-05-20T17:56:13.779884+0000","last_peered":"2024-05-20T17:56:13.779884+0000","last_clean":"2024-05-20T17:56:13.779884+0000","last_became_active":"2024-05-20T17:56:12.776481+0000","last_became_peered":"2024-05-20T17:56:12.776481+0000","last_unstale":"2024-05-20T17:56:13.779884+0000","last_undegraded":"2024-05-20T17:56:13.779884+0000","last_fullsized":"2024-05-20T17:56:13.779884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:35.178373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778742+0000","last_change":"2024-05-20T17:56:11.782673+0000","last_active":"2024-05-20T17:56:13.778742+0000","last_peered":"2024-05-20T17:56:13.778742+0000","last_clean":"2024-05-20T17:56:13.778742+0000","last_became_active":"2024-05-20T17:56:11.782350+0000","last_became_peered":"2024-05-20T17:56:11.782350+0000","last_unstale":"2024-05-20T17:56:13.778742+0000","last_undegraded":"2024-05-20T17:56:13.778742+0000","last_fullsized":"2024-05-20T17:56:13.778742+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:29:46.598462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.786051+0000","last_change":"2024-05-20T17:56:12.778933+0000","last_active":"2024-05-20T17:56:12.786051+0000","last_peered":"2024-05-20T17:56:12.786051+0000","last_clean":"2024-05-20T17:56:12.786051+0000","last_became_active":"2024-05-20T17:56:12.778615+0000","last_became_peered":"2024-05-20T17:56:12.778615+0000","last_unstale":"2024-05-20T17:56:12.786051+0000","last_undegraded":"2024-05-20T17:56:12.786051+0000","last_fullsized":"2024-05-20T17:56:12.786051+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:14.592909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778616+0000","last_change":"2024-05-20T17:56:11.776950+0000","last_active":"2024-05-20T17:56:13.778616+0000","last_peered":"2024-05-20T17:56:13.778616+0000","last_clean":"2024-05-20T17:56:13.778616+0000","last_became_active":"2024-05-20T17:56:11.776136+0000","last_became_peered":"2024-05-20T17:56:11.776136+0000","last_unstale":"2024-05-20T17:56:13.778616+0000","last_undegraded":"2024-05-20T17:56:13.778616+0000","last_fullsized":"2024-05-20T17:56:13.778616+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:51:59.378824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.969275+0000","last_change":"2024-05-20T17:56:12.780971+0000","last_active":"2024-05-20T17:56:13.969275+0000","last_peered":"2024-05-20T17:56:13.969275+0000","last_clean":"2024-05-20T17:56:13.969275+0000","last_became_active":"2024-05-20T17:56:12.780640+0000","last_became_peered":"2024-05-20T17:56:12.780640+0000","last_unstale":"2024-05-20T17:56:13.969275+0000","last_undegraded":"2024-05-20T17:56:13.969275+0000","last_fullsized":"2024-05-20T17:56:13.969275+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:48.733357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.766816+0000","last_change":"2024-05-20T17:56:11.774652+0000","last_active":"2024-05-20T17:56:12.766816+0000","last_peered":"2024-05-20T17:56:12.766816+0000","last_clean":"2024-05-20T17:56:12.766816+0000","last_became_active":"2024-05-20T17:56:11.774354+0000","last_became_peered":"2024-05-20T17:56:11.774354+0000","last_unstale":"2024-05-20T17:56:12.766816+0000","last_undegraded":"2024-05-20T17:56:12.766816+0000","last_fullsized":"2024-05-20T17:56:12.766816+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:14:21.688817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.788097+0000","last_change":"2024-05-20T17:56:12.780554+0000","last_active":"2024-05-20T17:56:12.788097+0000","last_peered":"2024-05-20T17:56:12.788097+0000","last_clean":"2024-05-20T17:56:12.788097+0000","last_became_active":"2024-05-20T17:56:12.780244+0000","last_became_peered":"2024-05-20T17:56:12.780244+0000","last_unstale":"2024-05-20T17:56:12.788097+0000","last_undegraded":"2024-05-20T17:56:12.788097+0000","last_fullsized":"2024-05-20T17:56:12.788097+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:11.749053+0000","last_clean_scrub_stamp":"2024-05-20T17:56:11.749053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:05:35.178373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-20T17:56:13.778432+0000","last_change":"2024-05-20T17:56:11.784093+0000","last_active":"2024-05-20T17:56:13.778432+0000","last_peered":"2024-05-20T17:56:13.778432+0000","last_clean":"2024-05-20T17:56:13.778432+0000","last_became_active":"2024-05-20T17:56:11.783784+0000","last_became_peered":"2024-05-20T17:56:11.783784+0000","last_unstale":"2024-05-20T17:56:13.778432+0000","last_undegraded":"2024-05-20T17:56:13.778432+0000","last_fullsized":"2024-05-20T17:56:13.778432+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:10.741773+0000","last_clean_scrub_stamp":"2024-05-20T17:56:10.741773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:36:36.986797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-05-20T17:56:12.781372+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:56:12.781372+0000","last_peered":"2024-05-20T17:56:12.781372+0000","last_clean":"2024-05-20T17:56:12.781372+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:56:12.781372+0000","last_undegraded":"2024-05-20T17:56:12.781372+0000","last_fullsized":"2024-05-20T17:56:12.781372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32528,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339312,"statfs":{"total":96636764160,"available":96603455488,"internally_reserved":0,"allocated":1372160,"data_stored":935550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":344440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":344428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":346018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":774144,"data_stored":351098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":351098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":346782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":934774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:56:17.215 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T17:56:17.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T17:56:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.376+0000 7f23865d5640 1 Processor -- start 2024-05-20T17:56:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.376+0000 7f23865d5640 1 -- start start 2024-05-20T17:56:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.377+0000 7f23865d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f238015f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.377+0000 7f23865d5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f238006cf00 0x7f238006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f23865d5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238008d2a0 con 0x7f23800d2780 2024-05-20T17:56:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f23865d5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f23800d3f70 con 0x7f238006cf00 2024-05-20T17:56:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f23865d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f238006d850 con 0x7f23800d4400 2024-05-20T17:56:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f2384b72640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f23800d2780 0x7f23800d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54790/0 (socket says 172.21.15.6:54790) 2024-05-20T17:56:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f2384b72640 1 -- 172.21.15.6:0/1975674556 learned_addr learned my addr 172.21.15.6:0/1975674556 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237f7fe640 1 --2- 172.21.15.6:0/1975674556 >> v2:172.21.15.171:3300/0 conn(0x7f238006cf00 0x7f238006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237ffff640 1 --2- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f238015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237effd640 1 -- 172.21.15.6:0/1975674556 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060921092 0 0) 0x7f2378001490 con 0x7f23800d2780 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237effd640 1 -- 172.21.15.6:0/1975674556 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2368003520 con 0x7f23800d2780 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237effd640 1 -- 172.21.15.6:0/1975674556 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 469921234 0 0) 0x7f2368003520 con 0x7f23800d2780 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237f7fe640 1 -- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 msgr2=0x7f238015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237f7fe640 1 --2- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f238015f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237f7fe640 1 -- 172.21.15.6:0/1975674556 >> v1:172.21.15.6:6789/0 conn(0x7f23800d2780 legacy=0x7f23800d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237f7fe640 1 -- 172.21.15.6:0/1975674556 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23800d4810 con 0x7f238006cf00 2024-05-20T17:56:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.378+0000 7f237ffff640 1 --2- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f238015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.379+0000 7f237f7fe640 1 --2- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238006cf00 0x7f238006d310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23740097a0 tx=0x7f237402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b2ebb9765816fe3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.379+0000 7f237effd640 1 -- 172.21.15.6:0/1975674556 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037070 con 0x7f238006cf00 2024-05-20T17:56:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.379+0000 7f237effd640 1 -- 172.21.15.6:0/1975674556 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237402ac30 con 0x7f238006cf00 2024-05-20T17:56:17.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.379+0000 7f237effd640 1 -- 172.21.15.6:0/1975674556 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378001bc0 con 0x7f238006cf00 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.380+0000 7f23865d5640 1 -- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238006cf00 msgr2=0x7f238006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.380+0000 7f23865d5640 1 --2- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238006cf00 0x7f238006d310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f23740097a0 tx=0x7f237402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.380+0000 7f23865d5640 1 -- 172.21.15.6:0/1975674556 shutdown_connections 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.380+0000 7f23865d5640 1 --2- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238006cf00 0x7f238006d310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.380+0000 7f23865d5640 1 --2- 172.21.15.6:0/1975674556 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f238015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.380+0000 7f23865d5640 1 -- 172.21.15.6:0/1975674556 >> 172.21.15.6:0/1975674556 conn(0x7f23800d4bb0 msgr2=0x7f23800d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.380+0000 7f23865d5640 1 -- 172.21.15.6:0/1975674556 shutdown_connections 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.380+0000 7f23865d5640 1 -- 172.21.15.6:0/1975674556 wait complete. 2024-05-20T17:56:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.382+0000 7f23865d5640 1 Processor -- start 2024-05-20T17:56:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.382+0000 7f23865d5640 1 -- start start 2024-05-20T17:56:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.383+0000 7f23865d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f238006cf00 0x7f23800b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.383+0000 7f23865d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23800d2780 0x7f23801471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.383+0000 7f23865d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f2380147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.383+0000 7f23865d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f23800d3920 con 0x7f238006cf00 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.383+0000 7f23865d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23800d3640 con 0x7f23800d2780 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.383+0000 7f23865d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f23800d3c00 con 0x7f23800d4400 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f238006cf00 0x7f23800b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f238006cf00 0x7f23800b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46568/0 (socket says 172.21.15.6:46568) 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 -- 172.21.15.6:0/2517051099 learned_addr learned my addr 172.21.15.6:0/2517051099 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f2384b72640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f2380147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237f7fe640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23800d2780 0x7f23801471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 -- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 msgr2=0x7f2380147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f2380147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 -- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23800d2780 msgr2=0x7f23801471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23800d2780 0x7f23801471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 -- 172.21.15.6:0/2517051099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2380147f60 con 0x7f238006cf00 2024-05-20T17:56:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237f7fe640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23800d2780 0x7f23801471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237ffff640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f238006cf00 0x7f23800b5d90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f237000e990 tx=0x7f237000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237cff9640 1 -- 172.21.15.6:0/2517051099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370017070 con 0x7f238006cf00 2024-05-20T17:56:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237cff9640 1 -- 172.21.15.6:0/2517051099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237000c9e0 con 0x7f238006cf00 2024-05-20T17:56:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2380148460 con 0x7f238006cf00 2024-05-20T17:56:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f237cff9640 1 -- 172.21.15.6:0/2517051099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237000cdb0 con 0x7f238006cf00 2024-05-20T17:56:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.384+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2380145360 con 0x7f238006cf00 2024-05-20T17:56:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.386+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2380148630 con 0x7f238006cf00 2024-05-20T17:56:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.386+0000 7f237cff9640 1 -- 172.21.15.6:0/2517051099 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f237001a070 con 0x7f238006cf00 2024-05-20T17:56:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.386+0000 7f237cff9640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f236c06be30 0x7f236c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.387+0000 7f237cff9640 1 -- 172.21.15.6:0/2517051099 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f237008b2c0 con 0x7f238006cf00 2024-05-20T17:56:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.387+0000 7f237f7fe640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f236c06be30 0x7f236c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.387+0000 7f237f7fe640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f236c06be30 0x7f236c06e340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2374034000 tx=0x7f237402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:17.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.391+0000 7f237cff9640 1 -- 172.21.15.6:0/2517051099 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2370059380 con 0x7f238006cf00 2024-05-20T17:56:17.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.654+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f23800735a0 con 0x7f238006cf00 2024-05-20T17:56:17.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.656+0000 7f237cff9640 1 -- 172.21.15.6:0/2517051099 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f23800735a0 con 0x7f238006cf00 2024-05-20T17:56:17.656 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T17:56:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T17:56:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T17:56:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T17:56:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T17:56:17.656 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T17:56:17.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f236c06be30 msgr2=0x7f236c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f236c06be30 0x7f236c06e340 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2374034000 tx=0x7f237402e000 comp rx=0 tx=0).stop 2024-05-20T17:56:17.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f238006cf00 msgr2=0x7f23800b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f238006cf00 0x7f23800b5d90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f237000e990 tx=0x7f237000ee50 comp rx=0 tx=0).stop 2024-05-20T17:56:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 shutdown_connections 2024-05-20T17:56:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f236c06be30 0x7f236c06e340 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23800d4400 0x7f2380147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23800d2780 0x7f23801471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 --2- 172.21.15.6:0/2517051099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f238006cf00 0x7f23800b5d90 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 >> 172.21.15.6:0/2517051099 conn(0x7f23800d4bb0 msgr2=0x7f23800ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 shutdown_connections 2024-05-20T17:56:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.659+0000 7f23865d5640 1 -- 172.21.15.6:0/2517051099 wait complete. 2024-05-20T17:56:17.669 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:17.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.786+0000 7f9f42473640 1 Processor -- start 2024-05-20T17:56:17.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.786+0000 7f9f42473640 1 -- start start 2024-05-20T17:56:17.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f42473640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f3c162820 0x7f9f3c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f42473640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c06dae0 0x7f9f3c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f42473640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c0d0630 con 0x7f9f3c0b3e80 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f42473640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9f3c0d39c0 con 0x7f9f3c162820 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f42473640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3c0d3ca0 con 0x7f9f3c06dae0 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f3bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f3c162820 0x7f9f3c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f3bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f3c162820 0x7f9f3c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39404/0 (socket says 172.21.15.6:39404) 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f3bfff640 1 -- 172.21.15.6:0/269939990 learned_addr learned my addr 172.21.15.6:0/269939990 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.787+0000 7f9f40a10640 1 --2- 172.21.15.6:0/269939990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c06dae0 0x7f9f3c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.788+0000 7f9f3bfff640 1 -- 172.21.15.6:0/269939990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c06dae0 msgr2=0x7f9f3c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.788+0000 7f9f3bfff640 1 --2- 172.21.15.6:0/269939990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c06dae0 0x7f9f3c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.788+0000 7f9f3bfff640 1 -- 172.21.15.6:0/269939990 >> v1:172.21.15.171:6789/0 conn(0x7f9f3c0b3e80 legacy=0x7f9f3c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.788+0000 7f9f3bfff640 1 -- 172.21.15.6:0/269939990 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c0d3f80 con 0x7f9f3c162820 2024-05-20T17:56:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.788+0000 7f9f40a10640 1 --2- 172.21.15.6:0/269939990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c06dae0 0x7f9f3c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.788+0000 7f9f3bfff640 1 --2- 172.21.15.6:0/269939990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c162820 0x7f9f3c0b3940 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009870 tx=0x7f9f2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8352d6cf5a0b2a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.788+0000 7f9f3affd640 1 -- 172.21.15.6:0/269939990 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c037070 con 0x7f9f3c162820 2024-05-20T17:56:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f3affd640 1 -- 172.21.15.6:0/269939990 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c032440 con 0x7f9f3c162820 2024-05-20T17:56:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f3affd640 1 -- 172.21.15.6:0/269939990 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c032810 con 0x7f9f3c162820 2024-05-20T17:56:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f42473640 1 -- 172.21.15.6:0/269939990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c162820 msgr2=0x7f9f3c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f42473640 1 --2- 172.21.15.6:0/269939990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c162820 0x7f9f3c0b3940 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009870 tx=0x7f9f2c02a270 comp rx=0 tx=0).stop 2024-05-20T17:56:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f42473640 1 -- 172.21.15.6:0/269939990 shutdown_connections 2024-05-20T17:56:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f42473640 1 --2- 172.21.15.6:0/269939990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c06dae0 0x7f9f3c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f42473640 1 --2- 172.21.15.6:0/269939990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c162820 0x7f9f3c0b3940 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f42473640 1 -- 172.21.15.6:0/269939990 >> 172.21.15.6:0/269939990 conn(0x7f9f3c0d4bd0 msgr2=0x7f9f3c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f42473640 1 -- 172.21.15.6:0/269939990 shutdown_connections 2024-05-20T17:56:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.789+0000 7f9f42473640 1 -- 172.21.15.6:0/269939990 wait complete. 2024-05-20T17:56:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.791+0000 7f9f42473640 1 Processor -- start 2024-05-20T17:56:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.791+0000 7f9f42473640 1 -- start start 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.792+0000 7f9f42473640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c0b3e80 0x7f9f3c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.792+0000 7f9f42473640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f3c162820 0x7f9f3c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.792+0000 7f9f42473640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c0cc900 0x7f9f3c0b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f42473640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c0d4780 con 0x7f9f3c0cc900 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f42473640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c0d0300 con 0x7f9f3c162820 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f42473640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3c0d4900 con 0x7f9f3c0b3e80 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c0cc900 0x7f9f3c0b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c0cc900 0x7f9f3c0b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39414/0 (socket says 172.21.15.6:39414) 2024-05-20T17:56:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 -- 172.21.15.6:0/728528332 learned_addr learned my addr 172.21.15.6:0/728528332 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f3bfff640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c0b3e80 0x7f9f3c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f3b7fe640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f3c162820 0x7f9f3c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 -- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c0b3e80 msgr2=0x7f9f3c150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c0b3e80 0x7f9f3c150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 -- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f3c162820 msgr2=0x7f9f3c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f3c162820 0x7f9f3c0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 -- 172.21.15.6:0/728528332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c150560 con 0x7f9f3c0cc900 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f3b7fe640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f3c162820 0x7f9f3c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f40a10640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c0cc900 0x7f9f3c0b5fc0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9f34007e60 tx=0x7f9f3400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f38ff9640 1 -- 172.21.15.6:0/728528332 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3401a070 con 0x7f9f3c0cc900 2024-05-20T17:56:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f38ff9640 1 -- 172.21.15.6:0/728528332 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f34015400 con 0x7f9f3c0cc900 2024-05-20T17:56:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c0cb5d0 con 0x7f9f3c0cc900 2024-05-20T17:56:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f38ff9640 1 -- 172.21.15.6:0/728528332 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f340157d0 con 0x7f9f3c0cc900 2024-05-20T17:56:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.793+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c0c9240 con 0x7f9f3c0cc900 2024-05-20T17:56:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.794+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c075b00 con 0x7f9f3c0cc900 2024-05-20T17:56:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.795+0000 7f9f38ff9640 1 -- 172.21.15.6:0/728528332 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f3401d070 con 0x7f9f3c0cc900 2024-05-20T17:56:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.796+0000 7f9f38ff9640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f2806be30 0x7f9f2806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.796+0000 7f9f38ff9640 1 -- 172.21.15.6:0/728528332 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f9f3408b1c0 con 0x7f9f3c0cc900 2024-05-20T17:56:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.796+0000 7f9f3bfff640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f2806be30 0x7f9f2806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.796+0000 7f9f3bfff640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f2806be30 0x7f9f2806e340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c034000 tx=0x7f9f2c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:17.803+0000 7f9f38ff9640 1 -- 172.21.15.6:0/728528332 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f3c150560 con 0x7f9f3c0cc900 2024-05-20T17:56:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.025+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f3c15b710 con 0x7f9f3c0cc900 2024-05-20T17:56:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.026+0000 7f9f38ff9640 1 -- 172.21.15.6:0/728528332 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5182 (secure 0 0 0) 0x7f9f34010070 con 0x7f9f3c0cc900 2024-05-20T17:56:18.025 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:18.025 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2318422221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2318422221},{"type":"v1","addr":"172.21.15.6:6835","nonce":2318422221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1262536376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1262536376},{"type":"v1","addr":"172.21.15.171:6836","nonce":1262536376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2875796025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2875796025},{"type":"v1","addr":"172.21.15.171:6837","nonce":2875796025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:12.150755+0000","modified":"2024-05-20T17:56:15.161874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6297":{"gid":6297,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3730828520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3730828520},{"type":"v1","addr":"172.21.15.6:6834","nonce":3730828520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6297,"qdb_cluster":[6297]},"id":4}]} 2024-05-20T17:56:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 36 2024-05-20T17:56:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f2806be30 msgr2=0x7f9f2806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f2806be30 0x7f9f2806e340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c034000 tx=0x7f9f2c02e000 comp rx=0 tx=0).stop 2024-05-20T17:56:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c0cc900 msgr2=0x7f9f3c0b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c0cc900 0x7f9f3c0b5fc0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9f34007e60 tx=0x7f9f3400d4a0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 shutdown_connections 2024-05-20T17:56:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f2806be30 0x7f9f2806e340 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3c0cc900 0x7f9f3c0b5fc0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f3c162820 0x7f9f3c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 --2- 172.21.15.6:0/728528332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f3c0b3e80 0x7f9f3c150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 >> 172.21.15.6:0/728528332 conn(0x7f9f3c0d4bd0 msgr2=0x7f9f3c161d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 shutdown_connections 2024-05-20T17:56:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.028+0000 7f9f42473640 1 -- 172.21.15.6:0/728528332 wait complete. 2024-05-20T17:56:18.441 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T17:56:12.150755+0000', 'modified': '2024-05-20T17:56:15.161874+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6297': {'gid': 6297, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6834/3730828520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 3730828520}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 3730828520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6297, 'qdb_cluster': [6297]} 2024-05-20T17:56:18.441 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T17:56:18.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-20T17:56:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.563+0000 7feeb7bf0640 1 Processor -- start 2024-05-20T17:56:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.563+0000 7feeb7bf0640 1 -- start start 2024-05-20T17:56:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb7bf0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7feeb006d3d0 0x7feeb006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb7bf0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feeb00b8190 0x7feeb00b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb7bf0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb006dd20 con 0x7feeb0162820 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb7bf0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7feeb00d0630 con 0x7feeb00b8190 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb7bf0640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7feeb00d39c0 con 0x7feeb006d3d0 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb618d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feeb00b8190 0x7feeb00b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb618d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feeb00b8190 0x7feeb00b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39428/0 (socket says 172.21.15.6:39428) 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb618d640 1 -- 172.21.15.6:0/3628469673 learned_addr learned my addr 172.21.15.6:0/3628469673 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb518b640 1 --2- 172.21.15.6:0/3628469673 >> v2:172.21.15.171:3300/0 conn(0x7feeb006d3d0 0x7feeb006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb618d640 1 -- 172.21.15.6:0/3628469673 >> v2:172.21.15.171:3300/0 conn(0x7feeb006d3d0 msgr2=0x7feeb006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb618d640 1 --2- 172.21.15.6:0/3628469673 >> v2:172.21.15.171:3300/0 conn(0x7feeb006d3d0 0x7feeb006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb618d640 1 -- 172.21.15.6:0/3628469673 >> v1:172.21.15.171:6789/0 conn(0x7feeb0162820 legacy=0x7feeb00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.565+0000 7feeb618d640 1 -- 172.21.15.6:0/3628469673 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb00d3ca0 con 0x7feeb00b8190 2024-05-20T17:56:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.566+0000 7feeb618d640 1 --2- 172.21.15.6:0/3628469673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb00b8190 0x7feeb00b85a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7feeb00d1230 tx=0x7feea802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e97629eaf77799 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.566+0000 7feeb498a640 1 -- 172.21.15.6:0/3628469673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8037070 con 0x7feeb00b8190 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.566+0000 7feeb498a640 1 -- 172.21.15.6:0/3628469673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8032440 con 0x7feeb00b8190 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.566+0000 7feeb498a640 1 -- 172.21.15.6:0/3628469673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8032810 con 0x7feeb00b8190 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.567+0000 7feeb7bf0640 1 -- 172.21.15.6:0/3628469673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb00b8190 msgr2=0x7feeb00b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.567+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/3628469673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb00b8190 0x7feeb00b85a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7feeb00d1230 tx=0x7feea802a230 comp rx=0 tx=0).stop 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.567+0000 7feeb7bf0640 1 -- 172.21.15.6:0/3628469673 shutdown_connections 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.567+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/3628469673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb00b8190 0x7feeb00b85a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.567+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/3628469673 >> v2:172.21.15.171:3300/0 conn(0x7feeb006d3d0 0x7feeb006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.567+0000 7feeb7bf0640 1 -- 172.21.15.6:0/3628469673 >> 172.21.15.6:0/3628469673 conn(0x7feeb00d4bd0 msgr2=0x7feeb00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.567+0000 7feeb7bf0640 1 -- 172.21.15.6:0/3628469673 shutdown_connections 2024-05-20T17:56:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.567+0000 7feeb7bf0640 1 -- 172.21.15.6:0/3628469673 wait complete. 2024-05-20T17:56:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.569+0000 7feeb7bf0640 1 Processor -- start 2024-05-20T17:56:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.569+0000 7feeb7bf0640 1 -- start start 2024-05-20T17:56:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb7bf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb006d3d0 0x7feeb01e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb7bf0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feeb00b8190 0x7feeb00b9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb7bf0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feeb0162820 0x7feeb00b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb7bf0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feeb00d0300 con 0x7feeb006d3d0 2024-05-20T17:56:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb7bf0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feeb00d4260 con 0x7feeb00b8190 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb7bf0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feeb00b4050 con 0x7feeb0162820 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb598c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb006d3d0 0x7feeb01e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb598c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb006d3d0 0x7feeb01e82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39436/0 (socket says 172.21.15.6:39436) 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb598c640 1 -- 172.21.15.6:0/2785778672 learned_addr learned my addr 172.21.15.6:0/2785778672 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb518b640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feeb00b8190 0x7feeb00b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.570+0000 7feeb618d640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feeb0162820 0x7feeb00b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb598c640 1 -- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feeb0162820 msgr2=0x7feeb00b9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb598c640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feeb0162820 0x7feeb00b9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb598c640 1 -- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feeb00b8190 msgr2=0x7feeb00b9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb598c640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feeb00b8190 0x7feeb00b9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb598c640 1 -- 172.21.15.6:0/2785778672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb014a1b0 con 0x7feeb006d3d0 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb618d640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feeb0162820 0x7feeb00b9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb518b640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feeb00b8190 0x7feeb00b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb598c640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb006d3d0 0x7feeb01e82a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7feeac00ba80 tx=0x7feeac00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feea67fc640 1 -- 172.21.15.6:0/2785778672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac00cc00 con 0x7feeb006d3d0 2024-05-20T17:56:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feea67fc640 1 -- 172.21.15.6:0/2785778672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac00cda0 con 0x7feeb006d3d0 2024-05-20T17:56:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb7bf0640 1 -- 172.21.15.6:0/2785778672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb0148390 con 0x7feeb006d3d0 2024-05-20T17:56:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feea67fc640 1 -- 172.21.15.6:0/2785778672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac003bb0 con 0x7feeb006d3d0 2024-05-20T17:56:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.571+0000 7feeb7bf0640 1 -- 172.21.15.6:0/2785778672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb0148650 con 0x7feeb006d3d0 2024-05-20T17:56:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.573+0000 7feea67fc640 1 -- 172.21.15.6:0/2785778672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feeac014440 con 0x7feeb006d3d0 2024-05-20T17:56:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.573+0000 7feea67fc640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee9406be60 0x7fee9406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.573+0000 7feea67fc640 1 -- 172.21.15.6:0/2785778672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7feeac08b040 con 0x7feeb006d3d0 2024-05-20T17:56:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.574+0000 7feeb518b640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee9406be60 0x7fee9406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.574+0000 7feeb518b640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee9406be60 0x7fee9406e370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feeb014eaa0 tx=0x7feea0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.574+0000 7feebeb68740 1 Processor -- start 2024-05-20T17:56:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.574+0000 7feebeb68740 1 -- start start 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feebeb68740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14c5270 0x5560c1890700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feebeb68740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c188d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feebeb68740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c1866360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feebeb68740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5560c17c94d0 con 0x5560c149c3b0 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feebeb68740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5560c17713e0 con 0x5560c14c5270 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feebeb68740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5560c17c5490 con 0x5560c14a4590 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c188d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c188d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39446/0 (socket says 172.21.15.6:39446) 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 -- 172.21.15.6:0/2345318995 learned_addr learned my addr 172.21.15.6:0/2345318995 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb598c640 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14c5270 0x5560c1890700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb618d640 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c1866360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 -- 172.21.15.6:0/2345318995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 msgr2=0x5560c1866360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c1866360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 -- 172.21.15.6:0/2345318995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14c5270 msgr2=0x5560c1890700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14c5270 0x5560c1890700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 -- 172.21.15.6:0/2345318995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c14dd2d0 con 0x5560c149c3b0 2024-05-20T17:56:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.576+0000 7feeb518b640 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c188d0a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7feea000fa40 tx=0x7feea0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f63799ef9feed67 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7fee937fe640 1 -- 172.21.15.6:0/2345318995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea001b050 con 0x5560c149c3b0 2024-05-20T17:56:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7fee937fe640 1 -- 172.21.15.6:0/2345318995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea0025070 con 0x5560c149c3b0 2024-05-20T17:56:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7fee937fe640 1 -- 172.21.15.6:0/2345318995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0014de0 con 0x5560c149c3b0 2024-05-20T17:56:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7feebeb68740 1 -- 172.21.15.6:0/2345318995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 msgr2=0x5560c188d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7feebeb68740 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c188d0a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7feea000fa40 tx=0x7feea0012000 comp rx=0 tx=0).stop 2024-05-20T17:56:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7feebeb68740 1 -- 172.21.15.6:0/2345318995 shutdown_connections 2024-05-20T17:56:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7feebeb68740 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c1866360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7feebeb68740 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c188d0a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7feebeb68740 1 --2- 172.21.15.6:0/2345318995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14c5270 0x5560c1890700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.577+0000 7feebeb68740 1 -- 172.21.15.6:0/2345318995 >> 172.21.15.6:0/2345318995 conn(0x5560c14b93c0 msgr2=0x5560c1865af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.578+0000 7feebeb68740 1 -- 172.21.15.6:0/2345318995 shutdown_connections 2024-05-20T17:56:18.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.578+0000 7feebeb68740 1 -- 172.21.15.6:0/2345318995 wait complete. 2024-05-20T17:56:18.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.578+0000 7feebeb68740 1 -- start start 2024-05-20T17:56:18.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.579+0000 7feebeb68740 1 Processor -- start 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feebeb68740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18aae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feebeb68740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c1892d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feebeb68740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c18bb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feebeb68740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5560c17848e0 con 0x5560c14c5270 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feebeb68740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5560c1894740 con 0x5560c149c3b0 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feebeb68740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5560c18aa9a0 con 0x5560c14a4590 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feebeb68740 10 client.0 _ll_register_callbacks cb 0x5560c17519c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb618d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c18bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb618d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c18bb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39448/0 (socket says 172.21.15.6:39448) 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb618d640 1 -- 172.21.15.6:0/1192815460 learned_addr learned my addr 172.21.15.6:0/1192815460 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb518b640 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c1892d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb598c640 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb618d640 1 -- 172.21.15.6:0/1192815460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 msgr2=0x5560c1892d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb618d640 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c1892d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb618d640 1 -- 172.21.15.6:0/1192815460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 msgr2=0x5560c18aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb618d640 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.580+0000 7feeb618d640 1 -- 172.21.15.6:0/1192815460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c15a76b0 con 0x5560c14c5270 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feeb618d640 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c18bb530 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7feea8009960 tx=0x7feea8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8e975b36aed79 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7fee90ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7fee90ff9640 1 -- 172.21.15.6:0/1192815460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8042070 con 0x5560c14c5270 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7fee90ff9640 1 -- 172.21.15.6:0/1192815460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7feea803c440 con 0x5560c14c5270 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 1 -- 172.21.15.6:0/1192815460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feea0025070 con 0x5560c14c5270 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7fee90ff9640 1 -- 172.21.15.6:0/1192815460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feea804d050 con 0x5560c14c5270 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 10 client.6441 fetch_fsmap learned FSMap version 36 2024-05-20T17:56:18.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 1 -- 172.21.15.6:0/1192815460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x5560c18bbf40 con 0x5560c14c5270 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7fee90ff9640 1 -- 172.21.15.6:0/1192815460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea0025070 con 0x5560c14c5270 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7fee90ff9640 1 -- 172.21.15.6:0/1192815460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7feea8050020 con 0x5560c14c5270 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 10 client.6441 fetch_fsmap finished waiting for FSMap version 36 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 10 client.6441 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 20 client.6441 populate_metadata read hostname 'smithi006' 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] conn(0x5560c1483e40 0x5560c18c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 4 client.6441 mds_command: new command op to 6297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.581+0000 7feebeb68740 1 -- 172.21.15.6:0/1192815460 --> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560c17d6c00 con 0x5560c1483e40 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.582+0000 7feeb598c640 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] conn(0x5560c1483e40 0x5560c18c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.582+0000 7feeb598c640 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] conn(0x5560c1483e40 0x5560c18c8160 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4fa499de408ef18 server_cookie=3a25b43c9a220f94 in_seq=0 out_seq=0 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.582+0000 7fee90ff9640 10 client.6441 ms_handle_connect on v2:172.21.15.6:6832/3730828520 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7fee90ff9640 1 -- 172.21.15.6:0/1192815460 <== mds.0 v2:172.21.15.6:6832/3730828520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5560c17d6c00 con 0x5560c1483e40 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7fee90ff9640 10 client.6441 handle_command_reply: tid=0 2024-05-20T17:56:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 client.6441 shutdown 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 -- 172.21.15.6:0/1192815460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 msgr2=0x5560c18bb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c18bb530 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7feea8009960 tx=0x7feea8004730 comp rx=0 tx=0).stop 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 -- 172.21.15.6:0/1192815460 shutdown_connections 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] conn(0x5560c1483e40 0x5560c18c8160 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c18bb530 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c1892d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 --2- 172.21.15.6:0/1192815460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 -- 172.21.15.6:0/1192815460 >> 172.21.15.6:0/1192815460 conn(0x5560c14b93c0 msgr2=0x5560c1864e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7fee90ff9640 0 client.6441 ms_handle_reset on v2:172.21.15.6:6832/3730828520 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 -- 172.21.15.6:0/1192815460 shutdown_connections 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 1 -- 172.21.15.6:0/1192815460 wait complete. 2024-05-20T17:56:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.583+0000 7feebeb68740 20 client.6441 trim_cache size 0 max 16384 2024-05-20T17:56:18.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.602+0000 7feebeb68740 1 Processor -- start 2024-05-20T17:56:18.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.602+0000 7feebeb68740 1 -- start start 2024-05-20T17:56:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.603+0000 7feebeb68740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.603+0000 7feebeb68740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c188f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.603+0000 7feebeb68740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c188fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.603+0000 7feebeb68740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7feeb0202310 con 0x5560c14c5270 2024-05-20T17:56:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.603+0000 7feebeb68740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feeb01499f0 con 0x5560c149c3b0 2024-05-20T17:56:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.603+0000 7feebeb68740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feeb014b010 con 0x5560c14a4590 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.603+0000 7feeb618d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c188fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb618d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c188fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39460/0 (socket says 172.21.15.6:39460) 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb618d640 1 -- 172.21.15.6:0/894348662 learned_addr learned my addr 172.21.15.6:0/894348662 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb618d640 1 -- 172.21.15.6:0/894348662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 msgr2=0x5560c188f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb618d640 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c188f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb618d640 1 -- 172.21.15.6:0/894348662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 msgr2=0x5560c18ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb598c640 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb618d640 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb618d640 1 -- 172.21.15.6:0/894348662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560c18c3580 con 0x5560c14c5270 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb598c640 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7feeb618d640 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c188fc20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7feea802a8e0 tx=0x7feea803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d50208159ccffd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7fee92ffd640 1 -- 172.21.15.6:0/894348662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8042040 con 0x5560c14c5270 2024-05-20T17:56:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7fee92ffd640 1 -- 172.21.15.6:0/894348662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8004030 con 0x5560c14c5270 2024-05-20T17:56:18.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.604+0000 7fee92ffd640 1 -- 172.21.15.6:0/894348662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8037040 con 0x5560c14c5270 2024-05-20T17:56:18.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 -- 172.21.15.6:0/894348662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 msgr2=0x5560c188fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c188fc20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7feea802a8e0 tx=0x7feea803c000 comp rx=0 tx=0).stop 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 -- 172.21.15.6:0/894348662 shutdown_connections 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c14c5270 0x5560c188fc20 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14a4590 0x5560c188f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 --2- 172.21.15.6:0/894348662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c149c3b0 0x5560c18ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 -- 172.21.15.6:0/894348662 >> 172.21.15.6:0/894348662 conn(0x5560c14b93c0 msgr2=0x5560c185b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 -- 172.21.15.6:0/894348662 shutdown_connections 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.605+0000 7feebeb68740 1 -- 172.21.15.6:0/894348662 wait complete. 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.606+0000 7feebeb68740 1 -- start start 2024-05-20T17:56:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.606+0000 7feebeb68740 1 Processor -- start 2024-05-20T17:56:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feebeb68740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c192b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feebeb68740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14a4590 0x5560c188fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feebeb68740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14c5270 0x5560c1893b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feebeb68740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5560c1891da0 con 0x5560c149c3b0 2024-05-20T17:56:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feebeb68740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feeb01493a0 con 0x5560c14a4590 2024-05-20T17:56:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feebeb68740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5560c1892390 con 0x5560c14c5270 2024-05-20T17:56:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feebeb68740 10 client.0 _ll_register_callbacks cb 0x7feea80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:56:18.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feeb598c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c192b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feeb598c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c192b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39462/0 (socket says 172.21.15.6:39462) 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.607+0000 7feeb598c640 1 -- 172.21.15.6:0/3737494416 learned_addr learned my addr 172.21.15.6:0/3737494416 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feeb618d640 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14c5270 0x5560c1893b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feeb518b640 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14a4590 0x5560c188fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feeb598c640 1 -- 172.21.15.6:0/3737494416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14c5270 msgr2=0x5560c1893b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feeb598c640 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14c5270 0x5560c1893b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feeb598c640 1 -- 172.21.15.6:0/3737494416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14a4590 msgr2=0x5560c188fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feeb598c640 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14a4590 0x5560c188fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feeb598c640 1 -- 172.21.15.6:0/3737494416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560c18927d0 con 0x5560c149c3b0 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feeb598c640 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c192b460 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7feeac058d30 tx=0x7feeac01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa74d8d710c8274 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7fee90ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7fee90ff9640 1 -- 172.21.15.6:0/3737494416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac057330 con 0x5560c149c3b0 2024-05-20T17:56:18.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7fee90ff9640 1 -- 172.21.15.6:0/3737494416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7feeac0556a0 con 0x5560c149c3b0 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feebeb68740 1 -- 172.21.15.6:0/3737494416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feea8004030 con 0x5560c149c3b0 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7fee90ff9640 1 -- 172.21.15.6:0/3737494416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feeac07d050 con 0x5560c149c3b0 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feebeb68740 10 client.6447 fetch_fsmap learned FSMap version 36 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feebeb68740 1 -- 172.21.15.6:0/3737494416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x5560c18ba1f0 con 0x5560c149c3b0 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7fee90ff9640 1 -- 172.21.15.6:0/3737494416 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8004030 con 0x5560c149c3b0 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7fee90ff9640 1 -- 172.21.15.6:0/3737494416 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7feeac080080 con 0x5560c149c3b0 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.608+0000 7feebeb68740 10 client.6447 fetch_fsmap finished waiting for FSMap version 36 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 10 client.6447 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 20 client.6447 populate_metadata read hostname 'smithi006' 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] conn(0x5560c18aedd0 0x5560c18b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 4 client.6447 mds_command: new command op to 6297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 -- 172.21.15.6:0/3737494416 --> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] -- command(tid 0: {"prefix": "status"}) -- 0x5560c17d0f50 con 0x5560c18aedd0 2024-05-20T17:56:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feeb518b640 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] conn(0x5560c18aedd0 0x5560c18b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7fee90ff9640 10 client.6447 ms_handle_connect on v2:172.21.15.6:6832/3730828520 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feeb518b640 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] conn(0x5560c18aedd0 0x5560c18b6a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b34c1b53c61f7a7 server_cookie=a3512824bd02fcc3 in_seq=0 out_seq=0 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7fee90ff9640 1 -- 172.21.15.6:0/3737494416 <== mds.0 v2:172.21.15.6:6832/3730828520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5560c17d0f50 con 0x5560c18aedd0 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7fee90ff9640 10 client.6447 handle_command_reply: tid=0 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 client.6447 shutdown 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 -- 172.21.15.6:0/3737494416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 msgr2=0x5560c192b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c192b460 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7feeac058d30 tx=0x7feeac01f040 comp rx=0 tx=0).stop 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 -- 172.21.15.6:0/3737494416 shutdown_connections 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.6:6832/3730828520,v1:172.21.15.6:6834/3730828520] conn(0x5560c18aedd0 0x5560c18b6a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5560c14c5270 0x5560c1893b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560c14a4590 0x5560c188fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7fee90ff9640 0 client.6447 ms_handle_reset on v2:172.21.15.6:6832/3730828520 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 --2- 172.21.15.6:0/3737494416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5560c149c3b0 0x5560c192b460 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.609+0000 7feebeb68740 1 -- 172.21.15.6:0/3737494416 >> 172.21.15.6:0/3737494416 conn(0x5560c14b93c0 msgr2=0x5560c185b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feebeb68740 1 -- 172.21.15.6:0/3737494416 shutdown_connections 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feebeb68740 1 -- 172.21.15.6:0/3737494416 wait complete. 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feebeb68740 20 client.6447 trim_cache size 0 max 16384 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6297, 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:56:18.614 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:56:18.615 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.8390941940000003, 2024-05-20T17:56:18.615 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 36, 2024-05-20T17:56:18.615 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 64, 2024-05-20T17:56:18.615 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 64, 2024-05-20T17:56:18.615 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.794699853999999 2024-05-20T17:56:18.615 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 -- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee9406be60 msgr2=0x7fee9406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee9406be60 0x7fee9406e370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feeb014eaa0 tx=0x7feea0008040 comp rx=0 tx=0).stop 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 -- 172.21.15.6:0/2785778672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb006d3d0 msgr2=0x7feeb01e82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb006d3d0 0x7feeb01e82a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7feeac00ba80 tx=0x7feeac00bf40 comp rx=0 tx=0).stop 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 -- 172.21.15.6:0/2785778672 shutdown_connections 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee9406be60 0x7fee9406e370 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feeb0162820 0x7feeb00b9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feeb00b8190 0x7feeb00b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 --2- 172.21.15.6:0/2785778672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feeb006d3d0 0x7feeb01e82a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 -- 172.21.15.6:0/2785778672 >> 172.21.15.6:0/2785778672 conn(0x7feeb00d4bd0 msgr2=0x7feeb015db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 -- 172.21.15.6:0/2785778672 shutdown_connections 2024-05-20T17:56:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.610+0000 7feeb7bf0640 1 -- 172.21.15.6:0/2785778672 wait complete. 2024-05-20T17:56:18.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:56:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.736+0000 7f6bd05ce640 1 Processor -- start 2024-05-20T17:56:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.736+0000 7f6bd05ce640 1 -- start start 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.737+0000 7f6bd05ce640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6bc8162820 0x7f6bc80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.737+0000 7f6bd05ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80b3e80 0x7f6bc806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bd05ce640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc806dd20 con 0x7f6bc806d910 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bd05ce640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc80d0630 con 0x7f6bc8162820 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bd05ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc80d39c0 con 0x7f6bc80b3e80 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bceb6b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6bc806d910 0x7f6bc80d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42044/0 (socket says 172.21.15.6:42044) 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bceb6b640 1 -- 172.21.15.6:0/2921895354 learned_addr learned my addr 172.21.15.6:0/2921895354 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcdb69640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80b3e80 0x7f6bc806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bce36a640 1 --2- 172.21.15.6:0/2921895354 >> v2:172.21.15.171:3300/0 conn(0x7f6bc8162820 0x7f6bc80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720828078 0 0) 0x7f6bc0001110 con 0x7f6bc806d910 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bb0003520 con 0x7f6bc806d910 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846794234 0 0) 0x7f6bb0003520 con 0x7f6bc806d910 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80b3e80 msgr2=0x7f6bc806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80b3e80 0x7f6bc806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 >> v2:172.21.15.171:3300/0 conn(0x7f6bc8162820 msgr2=0x7f6bc80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 --2- 172.21.15.6:0/2921895354 >> v2:172.21.15.171:3300/0 conn(0x7f6bc8162820 0x7f6bc80b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc80d3ca0 con 0x7f6bc806d910 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f6bc0001840 con 0x7f6bc806d910 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 >> v1:172.21.15.6:6789/0 conn(0x7f6bc806d910 legacy=0x7f6bc80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80b3e80 0x7f6bb00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0003f30 0x7f6bb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bb0004d40 0x7f6bb0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc80d0630 con 0x7f6bb0004d40 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc80d39c0 con 0x7f6bb0003f30 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.738+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb000ba10 con 0x7f6bc80b3e80 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.739+0000 7f6bceb6b640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bb0004d40 0x7f6bb0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.739+0000 7f6bce36a640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80b3e80 0x7f6bb00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.739+0000 7f6bcdb69640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0003f30 0x7f6bb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.739+0000 7f6bceb6b640 1 -- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80b3e80 msgr2=0x7f6bb00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.739+0000 7f6bceb6b640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80b3e80 0x7f6bb00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.739+0000 7f6bceb6b640 1 -- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0003f30 msgr2=0x7f6bb0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.739+0000 7f6bceb6b640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0003f30 0x7f6bb0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.739+0000 7f6bceb6b640 1 -- 172.21.15.6:0/2921895354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb0003520 con 0x7f6bb0004d40 2024-05-20T17:56:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.740+0000 7f6bceb6b640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bb0004d40 0x7f6bb0005150 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6bc808e090 tx=0x7f6bb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cf346e75bd714e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.740+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000c0e0 con 0x7f6bb0004d40 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.740+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc0034070 con 0x7f6bb0004d40 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.740+0000 7f6bcd368640 1 -- 172.21.15.6:0/2921895354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0005d90 con 0x7f6bb0004d40 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.740+0000 7f6bd05ce640 1 -- 172.21.15.6:0/2921895354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bb0004d40 msgr2=0x7f6bb0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.740+0000 7f6bd05ce640 1 --2- 172.21.15.6:0/2921895354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bb0004d40 0x7f6bb0005150 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6bc808e090 tx=0x7f6bb0005830 comp rx=0 tx=0).stop 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.740+0000 7f6bceb6b640 1 -- 172.21.15.6:0/2921895354 reap_dead start 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.741+0000 7f6bd05ce640 1 -- 172.21.15.6:0/2921895354 shutdown_connections 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.741+0000 7f6bd05ce640 1 -- 172.21.15.6:0/2921895354 >> 172.21.15.6:0/2921895354 conn(0x7f6bc80d4bd0 msgr2=0x7f6bc80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.741+0000 7f6bd05ce640 1 -- 172.21.15.6:0/2921895354 shutdown_connections 2024-05-20T17:56:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.741+0000 7f6bd05ce640 1 -- 172.21.15.6:0/2921895354 wait complete. 2024-05-20T17:56:18.742 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-05-20T17:56:18.742+0000 7f880626f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:56:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.742+0000 7f6bd05ce640 1 Processor -- start 2024-05-20T17:56:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.742+0000 7f6bd05ce640 1 -- start start 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bd05ce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0004d40 0x7f6bc8157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bd05ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80cbcf0 0x7f6bc80cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bd05ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bc80ce220 0x7f6bc80ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bd05ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc80d0300 con 0x7f6bc80ce220 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bd05ce640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc80d4260 con 0x7f6bb0004d40 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bd05ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc80b91a0 con 0x7f6bc80cbcf0 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bc80ce220 0x7f6bc80ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bc80ce220 0x7f6bc80ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39480/0 (socket says 172.21.15.6:39480) 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 -- 172.21.15.6:0/3867330639 learned_addr learned my addr 172.21.15.6:0/3867330639 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bcdb69640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80cbcf0 0x7f6bc80cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bce36a640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0004d40 0x7f6bc8157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 -- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80cbcf0 msgr2=0x7f6bc80cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80cbcf0 0x7f6bc80cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 -- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0004d40 msgr2=0x7f6bc8157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0004d40 0x7f6bc8157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 -- 172.21.15.6:0/3867330639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc80ceb70 con 0x7f6bc80ce220 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.744+0000 7f6bceb6b640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bc80ce220 0x7f6bc80ce630 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6bc002afb0 tx=0x7f6bc80b7a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.745+0000 7f6bc6ffd640 1 -- 172.21.15.6:0/3867330639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0001110 con 0x7f6bc80ce220 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.745+0000 7f6bc6ffd640 1 -- 172.21.15.6:0/3867330639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc0007070 con 0x7f6bc80ce220 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.745+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc80cca60 con 0x7f6bc80ce220 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.745+0000 7f6bc6ffd640 1 -- 172.21.15.6:0/3867330639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0007420 con 0x7f6bc80ce220 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.745+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc80cd020 con 0x7f6bc80ce220 2024-05-20T17:56:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.746+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc8075b00 con 0x7f6bc80ce220 2024-05-20T17:56:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.746+0000 7f6bc6ffd640 1 -- 172.21.15.6:0/3867330639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bc00075c0 con 0x7f6bc80ce220 2024-05-20T17:56:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.747+0000 7f6bc6ffd640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bb406be60 0x7f6bb406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.747+0000 7f6bc6ffd640 1 -- 172.21.15.6:0/3867330639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f6bc00ab8f0 con 0x7f6bc80ce220 2024-05-20T17:56:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.747+0000 7f6bce36a640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bb406be60 0x7f6bb406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.748+0000 7f6bce36a640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bb406be60 0x7f6bb406e370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8014510 tx=0x7f6bb800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.751+0000 7f6bc6ffd640 1 -- 172.21.15.6:0/3867330639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6bc80ceb70 con 0x7f6bc80ce220 2024-05-20T17:56:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.976+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6bc80cc7f0 con 0x7f6bc80ce220 2024-05-20T17:56:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.976+0000 7f6bc6ffd640 1 -- 172.21.15.6:0/3867330639 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7f6bc806dd20 con 0x7f6bc80ce220 2024-05-20T17:56:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:56:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bb406be60 msgr2=0x7f6bb406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bb406be60 0x7f6bb406e370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8014510 tx=0x7f6bb800b040 comp rx=0 tx=0).stop 2024-05-20T17:56:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bc80ce220 msgr2=0x7f6bc80ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bc80ce220 0x7f6bc80ce630 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6bc002afb0 tx=0x7f6bc80b7a20 comp rx=0 tx=0).stop 2024-05-20T17:56:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 shutdown_connections 2024-05-20T17:56:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bb406be60 0x7f6bb406e370 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bc80ce220 0x7f6bc80ce630 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80cbcf0 0x7f6bc80cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 --2- 172.21.15.6:0/3867330639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bb0004d40 0x7f6bc8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 >> 172.21.15.6:0/3867330639 conn(0x7f6bc80d4bd0 msgr2=0x7f6bc8161350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 shutdown_connections 2024-05-20T17:56:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:18.978+0000 7f6bd05ce640 1 -- 172.21.15.6:0/3867330639 wait complete. 2024-05-20T17:56:18.988 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:56:18.989 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:56:18.989 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:56:18.989 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T17:56:18.989 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:18.989 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:56:18.989 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:56:18.989 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:56:18.989 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:56:18.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:18.989 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:56:19.006 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:56:19.006 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:56:19.006 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:56:19.006 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:19.006 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:56:19.006 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:19.006 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:19.006 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:19.007 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T17:56:19.008 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:19.009 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:56:19.009 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T17:56:19.009 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T17:56:19.009 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:19.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:19.010 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:56:19.071 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:56:19.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:19.073 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:56:19.129 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:56:19.129 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:56:19.130 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:56:19.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:56:19.130 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:56:19.130 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:56:19.130 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:56:19.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:56:19.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:56:19.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:56:19.130 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:56:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:56:19.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:19.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:19.260 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:56:19.276 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T17:56:19.276 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T17:56:19.276 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:56:19.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:19.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:56:19.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:56:19.343 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:19.399 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:56:19.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:56:19.399 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:19.454 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T17:56:19.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:19.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:19.551 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:19.551 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:56:19.560 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:19.560 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:56:19.560 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:56:19.560 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:56:19.560 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:56:19.561 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T17:56:19.561 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:56:19.561 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:56:19.561 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:56:19.561 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:56:19.563 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:56:19.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:19.563 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:19.589 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:56:19.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:56:19.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:19.695 INFO:teuthology.orchestra.run.smithi006.stdout:client6456 2024-05-20T17:56:19.696 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:19.696 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:19.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:56:19.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.871+0000 7f7d6a977640 1 Processor -- start 2024-05-20T17:56:19.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.871+0000 7f7d6a977640 1 -- start start 2024-05-20T17:56:19.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d6a977640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 0x7f7d640d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d6a977640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d6406c880 0x7f7d6406cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d6a977640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6415d430 con 0x7f7d64156690 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d6a977640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7d640b29b0 con 0x7f7d6406c880 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d6a977640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7d640b1910 con 0x7f7d640d1610 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d68f14640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d6406c880 0x7f7d6406cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d63fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d64156690 0x7f7d6415cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42052/0 (socket says 172.21.15.6:42052) 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d63fff640 1 -- 172.21.15.6:0/3045463469 learned_addr learned my addr 172.21.15.6:0/3045463469 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.872+0000 7f7d637fe640 1 --2- 172.21.15.6:0/3045463469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 0x7f7d640d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.873+0000 7f7d68f14640 1 -- 172.21.15.6:0/3045463469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 msgr2=0x7f7d640d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.873+0000 7f7d68f14640 1 --2- 172.21.15.6:0/3045463469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 0x7f7d640d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:19.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.873+0000 7f7d68f14640 1 -- 172.21.15.6:0/3045463469 >> v1:172.21.15.6:6789/0 conn(0x7f7d64156690 legacy=0x7f7d6415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:19.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.873+0000 7f7d62ffd640 1 -- 172.21.15.6:0/3045463469 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426326208 0 0) 0x7f7d6415d430 con 0x7f7d64156690 2024-05-20T17:56:19.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.873+0000 7f7d68f14640 1 -- 172.21.15.6:0/3045463469 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d640b1bf0 con 0x7f7d6406c880 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.873+0000 7f7d68f14640 1 --2- 172.21.15.6:0/3045463469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d6406cc90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009d90 tx=0x7f7d5c02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc0b5a74aacaeec server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d62ffd640 1 -- 172.21.15.6:0/3045463469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c007740 con 0x7f7d6406c880 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d62ffd640 1 -- 172.21.15.6:0/3045463469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5c0078e0 con 0x7f7d6406c880 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d62ffd640 1 -- 172.21.15.6:0/3045463469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c007cb0 con 0x7f7d6406c880 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d6a977640 1 -- 172.21.15.6:0/3045463469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 msgr2=0x7f7d6406cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d6a977640 1 --2- 172.21.15.6:0/3045463469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d6406cc90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009d90 tx=0x7f7d5c02a530 comp rx=0 tx=0).stop 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d6a977640 1 -- 172.21.15.6:0/3045463469 shutdown_connections 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d6a977640 1 --2- 172.21.15.6:0/3045463469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d6406cc90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:19.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d6a977640 1 --2- 172.21.15.6:0/3045463469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 0x7f7d640d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:19.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d6a977640 1 -- 172.21.15.6:0/3045463469 >> 172.21.15.6:0/3045463469 conn(0x7f7d640b6670 msgr2=0x7f7d640b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:19.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d6a977640 1 -- 172.21.15.6:0/3045463469 shutdown_connections 2024-05-20T17:56:19.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.874+0000 7f7d6a977640 1 -- 172.21.15.6:0/3045463469 wait complete. 2024-05-20T17:56:19.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.876+0000 7f7d6a977640 1 Processor -- start 2024-05-20T17:56:19.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.876+0000 7f7d6a977640 1 -- start start 2024-05-20T17:56:19.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d6a977640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d641493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:19.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d6a977640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 0x7f7d6409b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:19.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d6a977640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d64156690 0x7f7d640ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:19.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d6a977640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7d640b2490 con 0x7f7d6406c880 2024-05-20T17:56:19.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d6a977640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7d640b21b0 con 0x7f7d64156690 2024-05-20T17:56:19.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d6a977640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7d640d1f60 con 0x7f7d640d1610 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d641493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d641493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39494/0 (socket says 172.21.15.6:39494) 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 -- 172.21.15.6:0/843679229 learned_addr learned my addr 172.21.15.6:0/843679229 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d637fe640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 0x7f7d6409b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d68f14640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d64156690 0x7f7d640ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 -- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 msgr2=0x7f7d6409b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 0x7f7d6409b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 -- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d64156690 msgr2=0x7f7d640ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d64156690 0x7f7d640ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 -- 172.21.15.6:0/843679229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d64149900 con 0x7f7d6406c880 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.878+0000 7f7d63fff640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d641493c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400c410 tx=0x7f7d5400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.879+0000 7f7d60ff9640 1 -- 172.21.15.6:0/843679229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d540074e0 con 0x7f7d6406c880 2024-05-20T17:56:19.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.879+0000 7f7d60ff9640 1 -- 172.21.15.6:0/843679229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d54016070 con 0x7f7d6406c880 2024-05-20T17:56:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.879+0000 7f7d60ff9640 1 -- 172.21.15.6:0/843679229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54004a20 con 0x7f7d6406c880 2024-05-20T17:56:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.879+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6409be00 con 0x7f7d6406c880 2024-05-20T17:56:19.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.879+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d64150d50 con 0x7f7d6406c880 2024-05-20T17:56:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.880+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d64075b00 con 0x7f7d6406c880 2024-05-20T17:56:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.880+0000 7f7d60ff9640 1 -- 172.21.15.6:0/843679229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d54004bc0 con 0x7f7d6406c880 2024-05-20T17:56:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.881+0000 7f7d60ff9640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d5006be30 0x7f7d5006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.881+0000 7f7d60ff9640 1 -- 172.21.15.6:0/843679229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f7d5408ca90 con 0x7f7d6406c880 2024-05-20T17:56:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.881+0000 7f7d637fe640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d5006be30 0x7f7d5006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:19.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.882+0000 7f7d637fe640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d5006be30 0x7f7d5006e340 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d640b4650 tx=0x7f7d58009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:19.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:19.886+0000 7f7d60ff9640 1 -- 172.21.15.6:0/843679229 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7d64149900 con 0x7f7d6406c880 2024-05-20T17:56:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.109+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7d640d2210 con 0x7f7d6406c880 2024-05-20T17:56:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.109+0000 7f7d60ff9640 1 -- 172.21.15.6:0/843679229 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7f7d5405abd0 con 0x7f7d6406c880 2024-05-20T17:56:20.108 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:56:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d5006be30 msgr2=0x7f7d5006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d5006be30 0x7f7d5006e340 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d640b4650 tx=0x7f7d58009110 comp rx=0 tx=0).stop 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 msgr2=0x7f7d641493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d641493c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400c410 tx=0x7f7d5400c8d0 comp rx=0 tx=0).stop 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 shutdown_connections 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d5006be30 0x7f7d5006e340 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d64156690 0x7f7d640ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d640d1610 0x7f7d6409b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 --2- 172.21.15.6:0/843679229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6406c880 0x7f7d641493c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 >> 172.21.15.6:0/843679229 conn(0x7f7d640b6670 msgr2=0x7f7d6406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 shutdown_connections 2024-05-20T17:56:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:20.111+0000 7f7d6a977640 1 -- 172.21.15.6:0/843679229 wait complete. 2024-05-20T17:56:20.121 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:56:20.122 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:56:20.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T17:56:20.122 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T17:56:20.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:20.122 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:56:20.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:56:20.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:56:20.122 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:56:20.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:20.122 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T17:56:20.142 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:56:20.142 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:56:20.142 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T17:56:20.143 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42545sec preferred_lft 42545sec 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T17:56:20.144 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T17:56:20.145 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:20.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:20.145 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:56:20.211 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T17:56:20.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:20.213 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T17:56:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T17:56:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:56:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T17:56:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T17:56:20.273 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:56:20.273 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:56:20.273 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:56:20.273 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T17:56:20.274 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T17:56:20.274 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T17:56:20.274 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:56:20.367 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:56:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:56:20.401 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:56:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:20.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:20.408 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:56:20.424 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T17:56:20.424 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T17:56:20.424 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:56:20.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:20.424 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T17:56:20.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:56:20.490 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:20.545 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:56:20.545 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:56:20.546 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:20.601 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T17:56:20.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:20.601 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:20.695 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:20.695 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:56:20.703 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:20.703 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:56:20.703 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:56:20.704 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:56:20.704 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:56:20.704 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T17:56:20.704 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:56:20.704 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:56:20.704 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:56:20.704 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:56:20.706 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:56:20.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:20.706 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:20.736 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:56:20.829 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:56:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:56:20.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:56:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:20.836 INFO:teuthology.orchestra.run.smithi171.stdout:client6076 2024-05-20T17:56:20.836 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:20.837 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:20.852 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:56:20.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:56:20.896 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:56:20.940 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:56:20.940 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:56:20.941 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:20.941 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:20.959 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:20.959 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:21.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:21.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.177+0000 7fd45d5c2640 1 Processor -- start 2024-05-20T17:56:21.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.177+0000 7fd45d5c2640 1 -- start start 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd45d5c2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4580b2f10 0x7fd4580d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd45d5c2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd45806d290 0x7fd45806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd45d5c2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45815e6b0 con 0x7fd45815d940 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd45d5c2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd4580d2400 con 0x7fd4580b2f10 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd45d5c2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4580d1a30 con 0x7fd45806d290 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd456ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4580b2f10 0x7fd4580d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd4577fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd45815d940 0x7fd45815dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42054/0 (socket says 172.21.15.6:42054) 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd4577fe640 1 -- 172.21.15.6:0/1255025323 learned_addr learned my addr 172.21.15.6:0/1255025323 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.178+0000 7fd456ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4580b2f10 0x7fd4580d1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39504/0 (socket says 172.21.15.6:39504) 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.179+0000 7fd4567fc640 1 --2- 172.21.15.6:0/1255025323 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd45806d290 0x7fd45806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.179+0000 7fd456ffd640 1 -- 172.21.15.6:0/1255025323 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd45806d290 msgr2=0x7fd45806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:21.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.179+0000 7fd456ffd640 1 --2- 172.21.15.6:0/1255025323 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd45806d290 0x7fd45806d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.179+0000 7fd456ffd640 1 -- 172.21.15.6:0/1255025323 >> v1:172.21.15.6:6789/0 conn(0x7fd45815d940 legacy=0x7fd45815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.179+0000 7fd455ffb640 1 -- 172.21.15.6:0/1255025323 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3451724280 0 0) 0x7fd45815e6b0 con 0x7fd45815d940 2024-05-20T17:56:21.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.179+0000 7fd456ffd640 1 -- 172.21.15.6:0/1255025323 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4580d1100 con 0x7fd4580b2f10 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.179+0000 7fd456ffd640 1 --2- 172.21.15.6:0/1255025323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4580b2f10 0x7fd4580d1ec0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd4480097a0 tx=0x7fd44802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9b9abe912bfc93 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd455ffb640 1 -- 172.21.15.6:0/1255025323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448037070 con 0x7fd4580b2f10 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd455ffb640 1 -- 172.21.15.6:0/1255025323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44802ae50 con 0x7fd4580b2f10 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd455ffb640 1 -- 172.21.15.6:0/1255025323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448032660 con 0x7fd4580b2f10 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd45d5c2640 1 -- 172.21.15.6:0/1255025323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4580b2f10 msgr2=0x7fd4580d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/1255025323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4580b2f10 0x7fd4580d1ec0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd4480097a0 tx=0x7fd44802a100 comp rx=0 tx=0).stop 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd45d5c2640 1 -- 172.21.15.6:0/1255025323 shutdown_connections 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/1255025323 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd45806d290 0x7fd45806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/1255025323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4580b2f10 0x7fd4580d1ec0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd45d5c2640 1 -- 172.21.15.6:0/1255025323 >> 172.21.15.6:0/1255025323 conn(0x7fd4580b6670 msgr2=0x7fd4580b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd45d5c2640 1 -- 172.21.15.6:0/1255025323 shutdown_connections 2024-05-20T17:56:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.180+0000 7fd45d5c2640 1 -- 172.21.15.6:0/1255025323 wait complete. 2024-05-20T17:56:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.182+0000 7fd45d5c2640 1 Processor -- start 2024-05-20T17:56:21.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.182+0000 7fd45d5c2640 1 -- start start 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd45d5c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45806d290 0x7fd4581524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd45d5c2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4580b2f10 0x7fd4581f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd45d5c2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd45815d940 0x7fd458157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd45d5c2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd45815e460 con 0x7fd45806d290 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd45d5c2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd4580b3320 con 0x7fd45815d940 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd45d5c2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4580d16c0 con 0x7fd4580b2f10 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45806d290 0x7fd4581524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45806d290 0x7fd4581524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39512/0 (socket says 172.21.15.6:39512) 2024-05-20T17:56:21.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 -- 172.21.15.6:0/2179070368 learned_addr learned my addr 172.21.15.6:0/2179070368 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd4567fc640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4580b2f10 0x7fd4581f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd4577fe640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd45815d940 0x7fd458157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 -- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4580b2f10 msgr2=0x7fd4581f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4580b2f10 0x7fd4581f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 -- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd45815d940 msgr2=0x7fd458157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd45815d940 0x7fd458157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 -- 172.21.15.6:0/2179070368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4581f3b50 con 0x7fd45806d290 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.184+0000 7fd456ffd640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45806d290 0x7fd4581524e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd448000c00 tx=0x7fd4480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.185+0000 7fd43f7fe640 1 -- 172.21.15.6:0/2179070368 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448041070 con 0x7fd45806d290 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.185+0000 7fd43f7fe640 1 -- 172.21.15.6:0/2179070368 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd44803c670 con 0x7fd45806d290 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.185+0000 7fd43f7fe640 1 -- 172.21.15.6:0/2179070368 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448037040 con 0x7fd45806d290 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.185+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4581f3e30 con 0x7fd45806d290 2024-05-20T17:56:21.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.185+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd45809deb0 con 0x7fd45806d290 2024-05-20T17:56:21.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.186+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd458075b00 con 0x7fd45806d290 2024-05-20T17:56:21.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.186+0000 7fd43f7fe640 1 -- 172.21.15.6:0/2179070368 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd448044070 con 0x7fd45806d290 2024-05-20T17:56:21.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.187+0000 7fd43f7fe640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd44406be30 0x7fd44406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.187+0000 7fd43f7fe640 1 -- 172.21.15.6:0/2179070368 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fd4480ab840 con 0x7fd45806d290 2024-05-20T17:56:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.187+0000 7fd4567fc640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd44406be30 0x7fd44406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.188+0000 7fd4567fc640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd44406be30 0x7fd44406e340 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd458157610 tx=0x7fd44c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.191+0000 7fd43f7fe640 1 -- 172.21.15.6:0/2179070368 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd448079bc0 con 0x7fd45806d290 2024-05-20T17:56:21.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.375+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd45815d150 con 0x7fd45806d290 2024-05-20T17:56:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.377+0000 7fd43f7fe640 1 -- 172.21.15.6:0/2179070368 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16836 (secure 0 0 0) 0x7fd44807dec0 con 0x7fd45806d290 2024-05-20T17:56:21.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:21.376 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":64,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:13.770370+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:10.505890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:11.122304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.378+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd44406be30 msgr2=0x7fd44406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.378+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd44406be30 0x7fd44406e340 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd458157610 tx=0x7fd44c008040 comp rx=0 tx=0).stop 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.378+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45806d290 msgr2=0x7fd4581524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.378+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45806d290 0x7fd4581524e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd448000c00 tx=0x7fd4480046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.379+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 shutdown_connections 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.379+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd44406be30 0x7fd44406e340 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.379+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd45815d940 0x7fd458157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.379+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4580b2f10 0x7fd4581f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.379+0000 7fd45d5c2640 1 --2- 172.21.15.6:0/2179070368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45806d290 0x7fd4581524e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.379+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 >> 172.21.15.6:0/2179070368 conn(0x7fd4580b6670 msgr2=0x7fd45806f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.379+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 shutdown_connections 2024-05-20T17:56:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.379+0000 7fd45d5c2640 1 -- 172.21.15.6:0/2179070368 wait complete. 2024-05-20T17:56:21.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:56:10.505890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:56:11.122304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:56:21.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:56:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.509+0000 7f099ee06640 1 Processor -- start 2024-05-20T17:56:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.509+0000 7f099ee06640 1 -- start start 2024-05-20T17:56:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.510+0000 7f099ee06640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0998162820 0x7f09980b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.510+0000 7f099ee06640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f09980b3e80 0x7f099806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.510+0000 7f099ee06640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099806dd20 con 0x7f099806d910 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.510+0000 7f099ee06640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f09980d0630 con 0x7f09980b3e80 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.510+0000 7f099ee06640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09980d39c0 con 0x7f0998162820 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f099cba2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0998162820 0x7f09980b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f098ffff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f09980b3e80 0x7f099806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f099cba2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0998162820 0x7f09980b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:53348/0 (socket says 172.21.15.6:53348) 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f099cba2640 1 -- 172.21.15.6:0/425694320 learned_addr learned my addr 172.21.15.6:0/425694320 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f098ffff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f09980b3e80 0x7f099806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:51276/0 (socket says 172.21.15.6:51276) 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f099d3a3640 1 --1- 172.21.15.6:0/425694320 >> v1:172.21.15.171:6789/0 conn(0x7f099806d910 0x7f09980d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:44380/0 (socket says 172.21.15.6:44380) 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f099cba2640 1 -- 172.21.15.6:0/425694320 >> v2:172.21.15.171:3300/0 conn(0x7f09980b3e80 msgr2=0x7f099806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f099cba2640 1 --2- 172.21.15.6:0/425694320 >> v2:172.21.15.171:3300/0 conn(0x7f09980b3e80 0x7f099806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f099cba2640 1 -- 172.21.15.6:0/425694320 >> v1:172.21.15.171:6789/0 conn(0x7f099806d910 legacy=0x7f09980d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f099cba2640 1 -- 172.21.15.6:0/425694320 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09980d3ca0 con 0x7f0998162820 2024-05-20T17:56:21.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.511+0000 7f098ffff640 1 --2- 172.21.15.6:0/425694320 >> v2:172.21.15.171:3300/0 conn(0x7f09980b3e80 0x7f099806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.512+0000 7f099cba2640 1 --2- 172.21.15.6:0/425694320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0998162820 0x7f09980b3940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0994009870 tx=0x7f099402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d897fb9a61b238d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.512+0000 7f098f7fe640 1 -- 172.21.15.6:0/425694320 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994037070 con 0x7f0998162820 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.512+0000 7f098f7fe640 1 -- 172.21.15.6:0/425694320 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0994032440 con 0x7f0998162820 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.512+0000 7f098f7fe640 1 -- 172.21.15.6:0/425694320 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994032810 con 0x7f0998162820 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.513+0000 7f099ee06640 1 -- 172.21.15.6:0/425694320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0998162820 msgr2=0x7f09980b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.513+0000 7f099ee06640 1 --2- 172.21.15.6:0/425694320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0998162820 0x7f09980b3940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0994009870 tx=0x7f099402a270 comp rx=0 tx=0).stop 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.513+0000 7f099ee06640 1 -- 172.21.15.6:0/425694320 shutdown_connections 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.513+0000 7f099ee06640 1 --2- 172.21.15.6:0/425694320 >> v2:172.21.15.171:3300/0 conn(0x7f09980b3e80 0x7f099806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.513+0000 7f099ee06640 1 --2- 172.21.15.6:0/425694320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0998162820 0x7f09980b3940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.513+0000 7f099ee06640 1 -- 172.21.15.6:0/425694320 >> 172.21.15.6:0/425694320 conn(0x7f09980d4bd0 msgr2=0x7f09980d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.513+0000 7f099ee06640 1 -- 172.21.15.6:0/425694320 shutdown_connections 2024-05-20T17:56:21.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.513+0000 7f099ee06640 1 -- 172.21.15.6:0/425694320 wait complete. 2024-05-20T17:56:21.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.514+0000 7f099ee06640 1 Processor -- start 2024-05-20T17:56:21.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.515+0000 7f099ee06640 1 -- start start 2024-05-20T17:56:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099ee06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f099806d910 0x7f0998153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099ee06640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09980b3e80 0x7f0998156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099ee06640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0998162820 0x7f09981f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099ee06640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f09980d0300 con 0x7f099806d910 2024-05-20T17:56:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099ee06640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f09980d4260 con 0x7f0998162820 2024-05-20T17:56:21.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099ee06640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09980b91a0 con 0x7f09980b3e80 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099cba2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f099806d910 0x7f0998153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099cba2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f099806d910 0x7f0998153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39518/0 (socket says 172.21.15.6:39518) 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099cba2640 1 -- 172.21.15.6:0/2762874401 learned_addr learned my addr 172.21.15.6:0/2762874401 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f098ffff640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09980b3e80 0x7f0998156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.516+0000 7f099d3a3640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0998162820 0x7f09981f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f099cba2640 1 -- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09980b3e80 msgr2=0x7f0998156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f099cba2640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09980b3e80 0x7f0998156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f099cba2640 1 -- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0998162820 msgr2=0x7f09981f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f099cba2640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0998162820 0x7f09981f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f099cba2640 1 -- 172.21.15.6:0/2762874401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09981577b0 con 0x7f099806d910 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f098ffff640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09980b3e80 0x7f0998156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f099cba2640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f099806d910 0x7f0998153e40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f099402a2b0 tx=0x7f09940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f098d7fa640 1 -- 172.21.15.6:0/2762874401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994037040 con 0x7f099806d910 2024-05-20T17:56:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f098d7fa640 1 -- 172.21.15.6:0/2762874401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0994042070 con 0x7f099806d910 2024-05-20T17:56:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0998157a90 con 0x7f099806d910 2024-05-20T17:56:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f098d7fa640 1 -- 172.21.15.6:0/2762874401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994030880 con 0x7f099806d910 2024-05-20T17:56:21.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.517+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0998154380 con 0x7f099806d910 2024-05-20T17:56:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.518+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0998075b00 con 0x7f099806d910 2024-05-20T17:56:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.519+0000 7f098d7fa640 1 -- 172.21.15.6:0/2762874401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0994030a20 con 0x7f099806d910 2024-05-20T17:56:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.519+0000 7f098d7fa640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f098406be60 0x7f098406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.519+0000 7f098d7fa640 1 -- 172.21.15.6:0/2762874401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f09940ab7e0 con 0x7f099806d910 2024-05-20T17:56:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.519+0000 7f098ffff640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f098406be60 0x7f098406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.520+0000 7f098ffff640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f098406be60 0x7f098406e370 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f09980d3ee0 tx=0x7f0988008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.524+0000 7f098d7fa640 1 -- 172.21.15.6:0/2762874401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0994079f80 con 0x7f099806d910 2024-05-20T17:56:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.708+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0998157c60 con 0x7f099806d910 2024-05-20T17:56:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.709+0000 7f098d7fa640 1 -- 172.21.15.6:0/2762874401 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7f0994079880 con 0x7f099806d910 2024-05-20T17:56:21.708 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:56:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.710+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f098406be60 msgr2=0x7f098406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.710+0000 7f099ee06640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f098406be60 0x7f098406e370 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f09980d3ee0 tx=0x7f0988008040 comp rx=0 tx=0).stop 2024-05-20T17:56:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f099806d910 msgr2=0x7f0998153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f099806d910 0x7f0998153e40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f099402a2b0 tx=0x7f09940046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 shutdown_connections 2024-05-20T17:56:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f098406be60 0x7f098406e370 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0998162820 0x7f09981f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09980b3e80 0x7f0998156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 --2- 172.21.15.6:0/2762874401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f099806d910 0x7f0998153e40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 >> 172.21.15.6:0/2762874401 conn(0x7f09980d4bd0 msgr2=0x7f09980d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 shutdown_connections 2024-05-20T17:56:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.711+0000 7f099ee06640 1 -- 172.21.15.6:0/2762874401 wait complete. 2024-05-20T17:56:21.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:56:21.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.841+0000 7ff1bb72f640 1 Processor -- start 2024-05-20T17:56:21.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.841+0000 7ff1bb72f640 1 -- start start 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1bb72f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b1e10 0x7ff1b415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1bb72f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1b4070850 0x7ff1b4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1bb72f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b40cd580 con 0x7ff1b415d530 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1bb72f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b40ce190 con 0x7ff1b4070850 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1bb72f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b40cd860 con 0x7ff1b40b1e10 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1b9ccc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1b4070850 0x7ff1b4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1b94cb640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff1b415d530 0x7ff1b40b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42058/0 (socket says 172.21.15.6:42058) 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1b9ccc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1b4070850 0x7ff1b4070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39530/0 (socket says 172.21.15.6:39530) 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.842+0000 7ff1b94cb640 1 -- 172.21.15.6:0/3813231620 learned_addr learned my addr 172.21.15.6:0/3813231620 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.843+0000 7ff1b8cca640 1 --2- 172.21.15.6:0/3813231620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b1e10 0x7ff1b415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.843+0000 7ff1b9ccc640 1 -- 172.21.15.6:0/3813231620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b1e10 msgr2=0x7ff1b415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.843+0000 7ff1b9ccc640 1 --2- 172.21.15.6:0/3813231620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b1e10 0x7ff1b415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.843+0000 7ff1b9ccc640 1 -- 172.21.15.6:0/3813231620 >> v1:172.21.15.6:6789/0 conn(0x7ff1b415d530 legacy=0x7ff1b40b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.843+0000 7ff1abfff640 1 -- 172.21.15.6:0/3813231620 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561822523 0 0) 0x7ff1b40cd580 con 0x7ff1b415d530 2024-05-20T17:56:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.843+0000 7ff1b9ccc640 1 -- 172.21.15.6:0/3813231620 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b40cdb40 con 0x7ff1b4070850 2024-05-20T17:56:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.843+0000 7ff1b9ccc640 1 --2- 172.21.15.6:0/3813231620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4070c60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097a0 tx=0x7ff1ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486953fdd46e50a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1abfff640 1 -- 172.21.15.6:0/3813231620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac037070 con 0x7ff1b4070850 2024-05-20T17:56:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1abfff640 1 -- 172.21.15.6:0/3813231620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ac032440 con 0x7ff1b4070850 2024-05-20T17:56:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1abfff640 1 -- 172.21.15.6:0/3813231620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac032810 con 0x7ff1b4070850 2024-05-20T17:56:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3813231620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 msgr2=0x7ff1b4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3813231620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4070c60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097a0 tx=0x7ff1ac02a180 comp rx=0 tx=0).stop 2024-05-20T17:56:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3813231620 shutdown_connections 2024-05-20T17:56:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3813231620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4070c60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3813231620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b40b1e10 0x7ff1b415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3813231620 >> 172.21.15.6:0/3813231620 conn(0x7ff1b40d29d0 msgr2=0x7ff1b40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3813231620 shutdown_connections 2024-05-20T17:56:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.844+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3813231620 wait complete. 2024-05-20T17:56:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.846+0000 7ff1bb72f640 1 Processor -- start 2024-05-20T17:56:21.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.846+0000 7ff1bb72f640 1 -- start start 2024-05-20T17:56:21.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.847+0000 7ff1bb72f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.847+0000 7ff1bb72f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b40b1e10 0x7ff1b40b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1bb72f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b415d530 0x7ff1b414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1bb72f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b40711a0 con 0x7ff1b4070850 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1bb72f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b40cd230 con 0x7ff1b40b1e10 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1bb72f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b4071320 con 0x7ff1b415d530 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39536/0 (socket says 172.21.15.6:39536) 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 -- 172.21.15.6:0/3746721924 learned_addr learned my addr 172.21.15.6:0/3746721924 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b9ccc640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b415d530 0x7ff1b414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b8cca640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b40b1e10 0x7ff1b40b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 -- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b415d530 msgr2=0x7ff1b414f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b415d530 0x7ff1b414f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 -- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b40b1e10 msgr2=0x7ff1b40b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b40b1e10 0x7ff1b40b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 -- 172.21.15.6:0/3746721924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b414f670 con 0x7ff1b4070850 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b8cca640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b40b1e10 0x7ff1b40b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b9ccc640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b415d530 0x7ff1b414f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1b94cb640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4150be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000c7b0 tx=0x7ff1b000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1a9ffb640 1 -- 172.21.15.6:0/3746721924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0018070 con 0x7ff1b4070850 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1a9ffb640 1 -- 172.21.15.6:0/3746721924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b000a640 con 0x7ff1b4070850 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b414fb40 con 0x7ff1b4070850 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.848+0000 7ff1a9ffb640 1 -- 172.21.15.6:0/3746721924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b000aa30 con 0x7ff1b4070850 2024-05-20T17:56:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.849+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b4150100 con 0x7ff1b4070850 2024-05-20T17:56:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.850+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b4075b00 con 0x7ff1b4070850 2024-05-20T17:56:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.850+0000 7ff1a9ffb640 1 -- 172.21.15.6:0/3746721924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1b000abd0 con 0x7ff1b4070850 2024-05-20T17:56:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.851+0000 7ff1a9ffb640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff19806be30 0x7ff19806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.851+0000 7ff1a9ffb640 1 -- 172.21.15.6:0/3746721924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7ff1b008a530 con 0x7ff1b4070850 2024-05-20T17:56:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.851+0000 7ff1b8cca640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff19806be30 0x7ff19806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:21.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.851+0000 7ff1b8cca640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff19806be30 0x7ff19806e340 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4151890 tx=0x7ff1a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:21.856+0000 7ff1a9ffb640 1 -- 172.21.15.6:0/3746721924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff1b0058d60 con 0x7ff1b4070850 2024-05-20T17:56:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.037+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff1b40d18c0 con 0x7ff1b4070850 2024-05-20T17:56:22.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.038+0000 7ff1a9ffb640 1 -- 172.21.15.6:0/3746721924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) ==== 104+0+11 (secure 0 0 0) 0x7ff1b0058660 con 0x7ff1b4070850 2024-05-20T17:56:22.037 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:56:22.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff19806be30 msgr2=0x7ff19806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff19806be30 0x7ff19806e340 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4151890 tx=0x7ff1a4008040 comp rx=0 tx=0).stop 2024-05-20T17:56:22.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 msgr2=0x7ff1b4150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4150be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000c7b0 tx=0x7ff1b000cc70 comp rx=0 tx=0).stop 2024-05-20T17:56:22.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 shutdown_connections 2024-05-20T17:56:22.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff19806be30 0x7ff19806e340 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1b415d530 0x7ff1b414f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1b40b1e10 0x7ff1b40b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 --2- 172.21.15.6:0/3746721924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1b4070850 0x7ff1b4150be0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 >> 172.21.15.6:0/3746721924 conn(0x7ff1b40d29d0 msgr2=0x7ff1b40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:22.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 shutdown_connections 2024-05-20T17:56:22.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.040+0000 7ff1bb72f640 1 -- 172.21.15.6:0/3746721924 wait complete. 2024-05-20T17:56:22.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:56:22.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.169+0000 7f8f46fd5640 1 Processor -- start 2024-05-20T17:56:22.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.169+0000 7f8f46fd5640 1 -- start start 2024-05-20T17:56:22.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f46fd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f46fd5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8f400b3e80 0x7f8f4006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f46fd5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4006dd20 con 0x7f8f4006d910 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f46fd5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8f400d0630 con 0x7f8f400b3e80 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f46fd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8f400d39c0 con 0x7f8f40162820 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f44d71640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f3ffff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8f400b3e80 0x7f8f4006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f44d71640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:53376/0 (socket says 172.21.15.6:53376) 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.171+0000 7f8f44d71640 1 -- 172.21.15.6:0/3742884641 learned_addr learned my addr 172.21.15.6:0/3742884641 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.172+0000 7f8f44d71640 1 -- 172.21.15.6:0/3742884641 >> v2:172.21.15.171:3300/0 conn(0x7f8f400b3e80 msgr2=0x7f8f4006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.172+0000 7f8f44d71640 1 --2- 172.21.15.6:0/3742884641 >> v2:172.21.15.171:3300/0 conn(0x7f8f400b3e80 0x7f8f4006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.172+0000 7f8f44d71640 1 -- 172.21.15.6:0/3742884641 >> v1:172.21.15.171:6789/0 conn(0x7f8f4006d910 legacy=0x7f8f400d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.172+0000 7f8f44d71640 1 -- 172.21.15.6:0/3742884641 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f400d3ca0 con 0x7f8f40162820 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.172+0000 7f8f3f7fe640 1 -- 172.21.15.6:0/3742884641 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801850439 0 0) 0x7f8f38001490 con 0x7f8f4006d910 2024-05-20T17:56:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.172+0000 7f8f3ffff640 1 --2- 172.21.15.6:0/3742884641 >> v2:172.21.15.171:3300/0 conn(0x7f8f400b3e80 0x7f8f4006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:22.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.173+0000 7f8f44d71640 1 --2- 172.21.15.6:0/3742884641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b3940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009870 tx=0x7f8f3002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5ef6b50fb222fd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.173+0000 7f8f3f7fe640 1 -- 172.21.15.6:0/3742884641 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30037070 con 0x7f8f40162820 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.173+0000 7f8f3f7fe640 1 -- 172.21.15.6:0/3742884641 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f30032440 con 0x7f8f40162820 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.173+0000 7f8f3f7fe640 1 -- 172.21.15.6:0/3742884641 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30032810 con 0x7f8f40162820 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.173+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3742884641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 msgr2=0x7f8f400b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.173+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3742884641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b3940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009870 tx=0x7f8f3002a250 comp rx=0 tx=0).stop 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.174+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3742884641 shutdown_connections 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.174+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3742884641 >> v2:172.21.15.171:3300/0 conn(0x7f8f400b3e80 0x7f8f4006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.174+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3742884641 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b3940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.174+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3742884641 >> 172.21.15.6:0/3742884641 conn(0x7f8f400d4bd0 msgr2=0x7f8f400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.174+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3742884641 shutdown_connections 2024-05-20T17:56:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.174+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3742884641 wait complete. 2024-05-20T17:56:22.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.175+0000 7f8f46fd5640 1 Processor -- start 2024-05-20T17:56:22.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.175+0000 7f8f46fd5640 1 -- start start 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f46fd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4006d910 0x7f8f400cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f46fd5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f400b3e80 0x7f8f40157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f46fd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f46fd5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400d0300 con 0x7f8f4006d910 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f46fd5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400d4260 con 0x7f8f400b3e80 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f46fd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8f400b91a0 con 0x7f8f40162820 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f44d71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4006d910 0x7f8f400cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f44d71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4006d910 0x7f8f400cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39544/0 (socket says 172.21.15.6:39544) 2024-05-20T17:56:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f44d71640 1 -- 172.21.15.6:0/3940268081 learned_addr learned my addr 172.21.15.6:0/3940268081 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f45572640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f3ffff640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f400b3e80 0x7f8f40157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f44d71640 1 -- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 msgr2=0x7f8f400b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f44d71640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f44d71640 1 -- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f400b3e80 msgr2=0x7f8f40157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f44d71640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f400b3e80 0x7f8f40157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.177+0000 7f8f44d71640 1 -- 172.21.15.6:0/3940268081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f401f8cc0 con 0x7f8f4006d910 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.178+0000 7f8f44d71640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4006d910 0x7f8f400cb030 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8f30000c00 tx=0x7f8f300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.178+0000 7f8f3d7fa640 1 -- 172.21.15.6:0/3940268081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30037040 con 0x7f8f4006d910 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.178+0000 7f8f3d7fa640 1 -- 172.21.15.6:0/3940268081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f30042070 con 0x7f8f4006d910 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.178+0000 7f8f3d7fa640 1 -- 172.21.15.6:0/3940268081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30030880 con 0x7f8f4006d910 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.178+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f401f8fa0 con 0x7f8f4006d910 2024-05-20T17:56:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.178+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f401f9560 con 0x7f8f4006d910 2024-05-20T17:56:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.179+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f40075b00 con 0x7f8f4006d910 2024-05-20T17:56:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.180+0000 7f8f3d7fa640 1 -- 172.21.15.6:0/3940268081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f30030a20 con 0x7f8f4006d910 2024-05-20T17:56:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.180+0000 7f8f3d7fa640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f2c06be30 0x7f8f2c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.180+0000 7f8f3d7fa640 1 -- 172.21.15.6:0/3940268081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f8f300ab760 con 0x7f8f4006d910 2024-05-20T17:56:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.180+0000 7f8f3ffff640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f2c06be30 0x7f8f2c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.181+0000 7f8f3ffff640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f2c06be30 0x7f8f2c06e340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8f4015d450 tx=0x7f8f34009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:22.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.185+0000 7f8f3d7fa640 1 -- 172.21.15.6:0/3940268081 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8f30079930 con 0x7f8f4006d910 2024-05-20T17:56:22.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.368+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8f4008d3d0 con 0x7f8f4006d910 2024-05-20T17:56:22.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.368+0000 7f8f3d7fa640 1 -- 172.21.15.6:0/3940268081 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) ==== 100+0+11 (secure 0 0 0) 0x7f8f3007dc30 con 0x7f8f4006d910 2024-05-20T17:56:22.367 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:56:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f2c06be30 msgr2=0x7f8f2c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f2c06be30 0x7f8f2c06e340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8f4015d450 tx=0x7f8f34009190 comp rx=0 tx=0).stop 2024-05-20T17:56:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4006d910 msgr2=0x7f8f400cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4006d910 0x7f8f400cb030 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8f30000c00 tx=0x7f8f300046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 shutdown_connections 2024-05-20T17:56:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f2c06be30 0x7f8f2c06e340 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f40162820 0x7f8f400b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f400b3e80 0x7f8f40157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 --2- 172.21.15.6:0/3940268081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4006d910 0x7f8f400cb030 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 >> 172.21.15.6:0/3940268081 conn(0x7f8f400d4bd0 msgr2=0x7f8f400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 shutdown_connections 2024-05-20T17:56:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.370+0000 7f8f46fd5640 1 -- 172.21.15.6:0/3940268081 wait complete. 2024-05-20T17:56:22.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:56:22.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.498+0000 7fd61d4f7640 1 Processor -- start 2024-05-20T17:56:22.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.498+0000 7fd61d4f7640 1 -- start start 2024-05-20T17:56:22.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd61d4f7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd6180cd1b0 0x7fd61815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd61d4f7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd618070850 0x7fd618070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd61d4f7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6180711a0 con 0x7fd618071630 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd61d4f7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd61815f790 con 0x7fd618070850 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd61d4f7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd61806e590 con 0x7fd6180cd1b0 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd6177fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd618070850 0x7fd618070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd616ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd618071630 0x7fd61806d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42070/0 (socket says 172.21.15.6:42070) 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd616ffd640 1 -- 172.21.15.6:0/1921576721 learned_addr learned my addr 172.21.15.6:0/1921576721 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.499+0000 7fd6167fc640 1 --2- 172.21.15.6:0/1921576721 >> v2:172.21.15.171:3300/0 conn(0x7fd6180cd1b0 0x7fd61815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.500+0000 7fd6177fe640 1 -- 172.21.15.6:0/1921576721 >> v2:172.21.15.171:3300/0 conn(0x7fd6180cd1b0 msgr2=0x7fd61815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.500+0000 7fd6177fe640 1 --2- 172.21.15.6:0/1921576721 >> v2:172.21.15.171:3300/0 conn(0x7fd6180cd1b0 0x7fd61815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.500+0000 7fd6177fe640 1 -- 172.21.15.6:0/1921576721 >> v1:172.21.15.6:6789/0 conn(0x7fd618071630 legacy=0x7fd61806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.500+0000 7fd6177fe640 1 -- 172.21.15.6:0/1921576721 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6180ce2b0 con 0x7fd618070850 2024-05-20T17:56:22.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.500+0000 7fd615ffb640 1 -- 172.21.15.6:0/1921576721 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361647728 0 0) 0x7fd608001110 con 0x7fd618071630 2024-05-20T17:56:22.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.500+0000 7fd6177fe640 1 --2- 172.21.15.6:0/1921576721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618070850 0x7fd618070c60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd6180ccfa0 tx=0x7fd61002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57d0b7f530b0d3e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd615ffb640 1 -- 172.21.15.6:0/1921576721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610007740 con 0x7fd618070850 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd615ffb640 1 -- 172.21.15.6:0/1921576721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6100078e0 con 0x7fd618070850 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd615ffb640 1 -- 172.21.15.6:0/1921576721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610007cb0 con 0x7fd618070850 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd61d4f7640 1 -- 172.21.15.6:0/1921576721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618070850 msgr2=0x7fd618070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/1921576721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618070850 0x7fd618070c60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd6180ccfa0 tx=0x7fd61002a5f0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd61d4f7640 1 -- 172.21.15.6:0/1921576721 shutdown_connections 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/1921576721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618070850 0x7fd618070c60 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/1921576721 >> v2:172.21.15.171:3300/0 conn(0x7fd6180cd1b0 0x7fd61815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd61d4f7640 1 -- 172.21.15.6:0/1921576721 >> 172.21.15.6:0/1921576721 conn(0x7fd6180d29d0 msgr2=0x7fd6180d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd61d4f7640 1 -- 172.21.15.6:0/1921576721 shutdown_connections 2024-05-20T17:56:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.501+0000 7fd61d4f7640 1 -- 172.21.15.6:0/1921576721 wait complete. 2024-05-20T17:56:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.503+0000 7fd61d4f7640 1 Processor -- start 2024-05-20T17:56:22.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.503+0000 7fd61d4f7640 1 -- start start 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd61d4f7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd618070850 0x7fd6181e91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd61d4f7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618071630 0x7fd618148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd61d4f7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6180cd1b0 0x7fd6180b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd61d4f7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd61806ded0 con 0x7fd618071630 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd61d4f7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd61806cfc0 con 0x7fd618070850 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd61d4f7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd61806d2a0 con 0x7fd6180cd1b0 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618071630 0x7fd618148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618071630 0x7fd618148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39560/0 (socket says 172.21.15.6:39560) 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 -- 172.21.15.6:0/272439463 learned_addr learned my addr 172.21.15.6:0/272439463 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd616ffd640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd618070850 0x7fd6181e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6177fe640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6180cd1b0 0x7fd6180b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 -- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6180cd1b0 msgr2=0x7fd6180b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6180cd1b0 0x7fd6180b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 -- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd618070850 msgr2=0x7fd6181e91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd618070850 0x7fd6181e91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 -- 172.21.15.6:0/272439463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6181e8100 con 0x7fd618071630 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd6167fc640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618071630 0x7fd618148810 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd60000d5f0 tx=0x7fd60000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.505+0000 7fd60f7fe640 1 -- 172.21.15.6:0/272439463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6000125f0 con 0x7fd618071630 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.506+0000 7fd60f7fe640 1 -- 172.21.15.6:0/272439463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd600019070 con 0x7fd618071630 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.506+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6181e83e0 con 0x7fd618071630 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.506+0000 7fd60f7fe640 1 -- 172.21.15.6:0/272439463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6000129d0 con 0x7fd618071630 2024-05-20T17:56:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.506+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6181e89a0 con 0x7fd618071630 2024-05-20T17:56:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.507+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6181e7e70 con 0x7fd618071630 2024-05-20T17:56:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.507+0000 7fd60f7fe640 1 -- 172.21.15.6:0/272439463 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd600012b70 con 0x7fd618071630 2024-05-20T17:56:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.508+0000 7fd60f7fe640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5f806be60 0x7fd5f806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.508+0000 7fd60f7fe640 1 -- 172.21.15.6:0/272439463 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fd60008b230 con 0x7fd618071630 2024-05-20T17:56:22.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.508+0000 7fd616ffd640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5f806be60 0x7fd5f806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:22.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.509+0000 7fd616ffd640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5f806be60 0x7fd5f806e370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd608007fd0 tx=0x7fd608007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.513+0000 7fd60f7fe640 1 -- 172.21.15.6:0/272439463 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd600059400 con 0x7fd618071630 2024-05-20T17:56:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.712+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd618075b00 con 0x7fd618071630 2024-05-20T17:56:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.713+0000 7fd60f7fe640 1 -- 172.21.15.6:0/272439463 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7fd60005d700 con 0x7fd618071630 2024-05-20T17:56:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:56:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5f806be60 msgr2=0x7fd5f806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5f806be60 0x7fd5f806e370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd608007fd0 tx=0x7fd608007de0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618071630 msgr2=0x7fd618148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:22.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618071630 0x7fd618148810 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd60000d5f0 tx=0x7fd60000dab0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 shutdown_connections 2024-05-20T17:56:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5f806be60 0x7fd5f806e370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd6180cd1b0 0x7fd6180b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd618071630 0x7fd618148810 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 --2- 172.21.15.6:0/272439463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd618070850 0x7fd6181e91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 >> 172.21.15.6:0/272439463 conn(0x7fd6180d29d0 msgr2=0x7fd6180d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 shutdown_connections 2024-05-20T17:56:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:22.715+0000 7fd61d4f7640 1 -- 172.21.15.6:0/272439463 wait complete. 2024-05-20T17:56:22.726 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T17:56:22.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:22.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:22.755 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:56:22.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:22.756 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T17:56:22.812 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:56:22.812 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:22.812 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:22.831 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:22.831 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:22.890 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.006+0000 7eff35bea640 1 Processor -- start 2024-05-20T17:56:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.006+0000 7eff35bea640 1 -- start start 2024-05-20T17:56:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff35bea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7eff3015f220 0x7eff300cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff35bea640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff300cfd20 con 0x7eff300cf910 2024-05-20T17:56:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff35bea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff3006d0f0 con 0x7eff300cd680 2024-05-20T17:56:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff35bea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7eff300cda90 con 0x7eff3015f220 2024-05-20T17:56:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff2ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff300cf910 0x7eff300d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42080/0 (socket says 172.21.15.6:42080) 2024-05-20T17:56:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff2ffff640 1 -- 172.21.15.6:0/967971276 learned_addr learned my addr 172.21.15.6:0/967971276 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff2effd640 1 --2- 172.21.15.6:0/967971276 >> v2:172.21.15.171:3300/0 conn(0x7eff3015f220 0x7eff300cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 138765071 0 0) 0x7eff28001490 con 0x7eff300cf910 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.008+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff18003520 con 0x7eff300cf910 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1437693801 0 0) 0x7eff18003520 con 0x7eff300cf910 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 >> v2:172.21.15.171:3300/0 conn(0x7eff3015f220 msgr2=0x7eff300cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 --2- 172.21.15.6:0/967971276 >> v2:172.21.15.171:3300/0 conn(0x7eff3015f220 0x7eff300cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 >> v1:172.21.15.171:6789/0 conn(0x7eff300cd680 legacy=0x7eff3006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3006d3d0 con 0x7eff300cf910 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7eff28001bc0 con 0x7eff300cf910 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 >> v1:172.21.15.6:6789/0 conn(0x7eff300cf910 legacy=0x7eff300d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff180039b0 0x7eff18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff18004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff18005270 0x7eff1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7eff1800c1d0 con 0x7eff18004800 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff1800c380 con 0x7eff18005270 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7eff1800c580 con 0x7eff180039b0 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2effd640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff18004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2ffff640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff18005270 0x7eff1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2f7fe640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff180039b0 0x7eff18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2effd640 1 -- 172.21.15.6:0/967971276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff180039b0 msgr2=0x7eff18003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2effd640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff180039b0 0x7eff18003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2effd640 1 -- 172.21.15.6:0/967971276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff18005270 msgr2=0x7eff1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2effd640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff18005270 0x7eff1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2effd640 1 -- 172.21.15.6:0/967971276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff18003520 con 0x7eff18004800 2024-05-20T17:56:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.009+0000 7eff2ffff640 1 -- 172.21.15.6:0/967971276 reap_dead start 2024-05-20T17:56:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.010+0000 7eff2effd640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff18004c10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7eff24009ac0 tx=0x7eff18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198e0e43145cc43b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.010+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24036070 con 0x7eff18004800 2024-05-20T17:56:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.010+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff24031400 con 0x7eff18004800 2024-05-20T17:56:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.010+0000 7eff2e7fc640 1 -- 172.21.15.6:0/967971276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24009690 con 0x7eff18004800 2024-05-20T17:56:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.011+0000 7eff35bea640 1 -- 172.21.15.6:0/967971276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 msgr2=0x7eff18004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.011+0000 7eff35bea640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff18004c10 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7eff24009ac0 tx=0x7eff18005830 comp rx=0 tx=0).stop 2024-05-20T17:56:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.011+0000 7eff35bea640 1 -- 172.21.15.6:0/967971276 shutdown_connections 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.011+0000 7eff35bea640 1 --2- 172.21.15.6:0/967971276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff18004c10 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.011+0000 7eff35bea640 1 -- 172.21.15.6:0/967971276 >> 172.21.15.6:0/967971276 conn(0x7eff300b44d0 msgr2=0x7eff300b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.011+0000 7eff35bea640 1 -- 172.21.15.6:0/967971276 shutdown_connections 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.011+0000 7eff35bea640 1 -- 172.21.15.6:0/967971276 wait complete. 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.013+0000 7eff35bea640 1 Processor -- start 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.013+0000 7eff35bea640 1 -- start start 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff35bea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff301f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff35bea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff30158d70 0x7eff3015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff35bea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3014fe30 0x7eff30153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff35bea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7eff3006d990 con 0x7eff18004800 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff35bea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff300d0b40 con 0x7eff3014fe30 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff35bea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7eff3015f630 con 0x7eff30158d70 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff301f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff301f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39576/0 (socket says 172.21.15.6:39576) 2024-05-20T17:56:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff2f7fe640 1 -- 172.21.15.6:0/738488492 learned_addr learned my addr 172.21.15.6:0/738488492 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.014+0000 7eff2effd640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff30158d70 0x7eff3015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff2ffff640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3014fe30 0x7eff30153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff2f7fe640 1 -- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff30158d70 msgr2=0x7eff3015f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff2f7fe640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff30158d70 0x7eff3015f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff2f7fe640 1 -- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3014fe30 msgr2=0x7eff30153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff2f7fe640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3014fe30 0x7eff30153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff2f7fe640 1 -- 172.21.15.6:0/738488492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3015fde0 con 0x7eff18004800 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff2f7fe640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff301f8ef0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7eff2000f830 tx=0x7eff2000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff17fff640 1 -- 172.21.15.6:0/738488492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2000fe80 con 0x7eff18004800 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff17fff640 1 -- 172.21.15.6:0/738488492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff20018070 con 0x7eff18004800 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff17fff640 1 -- 172.21.15.6:0/738488492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2000d730 con 0x7eff18004800 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff30154660 con 0x7eff18004800 2024-05-20T17:56:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.015+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff30152950 con 0x7eff18004800 2024-05-20T17:56:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.016+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff30075b00 con 0x7eff18004800 2024-05-20T17:56:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.017+0000 7eff17fff640 1 -- 172.21.15.6:0/738488492 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff2000d8d0 con 0x7eff18004800 2024-05-20T17:56:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.017+0000 7eff17fff640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff1c06be30 0x7eff1c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.017+0000 7eff17fff640 1 -- 172.21.15.6:0/738488492 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7eff2008ae90 con 0x7eff18004800 2024-05-20T17:56:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.018+0000 7eff2effd640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff1c06be30 0x7eff1c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.018+0000 7eff2effd640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff1c06be30 0x7eff1c06e340 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff24033000 tx=0x7eff24008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.022+0000 7eff17fff640 1 -- 172.21.15.6:0/738488492 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7eff200596a0 con 0x7eff18004800 2024-05-20T17:56:23.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.207+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff300b8940 con 0x7eff18004800 2024-05-20T17:56:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.208+0000 7eff17fff640 1 -- 172.21.15.6:0/738488492 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16836 (secure 0 0 0) 0x7eff2008c090 con 0x7eff18004800 2024-05-20T17:56:23.207 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:23.207 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":64,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:13.770370+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:10.505890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:11.122304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff1c06be30 msgr2=0x7eff1c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff1c06be30 0x7eff1c06e340 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff24033000 tx=0x7eff24008030 comp rx=0 tx=0).stop 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 msgr2=0x7eff301f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff301f8ef0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7eff2000f830 tx=0x7eff2000fc30 comp rx=0 tx=0).stop 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 shutdown_connections 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff1c06be30 0x7eff1c06e340 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3014fe30 0x7eff30153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff30158d70 0x7eff3015f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 --2- 172.21.15.6:0/738488492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff18004800 0x7eff301f8ef0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.210+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 >> 172.21.15.6:0/738488492 conn(0x7eff300b44d0 msgr2=0x7eff30151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.211+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 shutdown_connections 2024-05-20T17:56:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.211+0000 7eff35bea640 1 -- 172.21.15.6:0/738488492 wait complete. 2024-05-20T17:56:23.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:56:10.505890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:56:11.122304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:56:23.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:56:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.341+0000 7f4d03377640 1 Processor -- start 2024-05-20T17:56:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.341+0000 7f4d03377640 1 -- start start 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4d03377640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 0x7f4cfc169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4d03377640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cfc160430 con 0x7f4cfc0af030 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4d03377640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cfc06b6a0 con 0x7f4cfc15f700 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4d03377640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc06bcf0 con 0x7f4cfc06d190 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4d01113640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4cfc0af030 0x7f4cfc0af440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42086/0 (socket says 172.21.15.6:42086) 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4d01113640 1 -- 172.21.15.6:0/1574752272 learned_addr learned my addr 172.21.15.6:0/1574752272 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4d01914640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 0x7f4cfc169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170125404 0 0) 0x7f4cfc160430 con 0x7f4cfc0af030 2024-05-20T17:56:23.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.343+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce4003520 con 0x7f4cfc0af030 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274103929 0 0) 0x7f4cfc06b6a0 con 0x7f4cfc15f700 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cfc160430 con 0x7f4cfc15f700 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2950155712 0 0) 0x7f4ce4003520 con 0x7f4cfc0af030 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 msgr2=0x7f4cfc169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 0x7f4cfc169cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 >> v1:172.21.15.171:6789/0 conn(0x7f4cfc15f700 legacy=0x7f4cfc15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc06b980 con 0x7f4cfc0af030 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f4cec0019f0 con 0x7f4cfc0af030 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 >> v1:172.21.15.6:6789/0 conn(0x7f4cfc0af030 legacy=0x7f4cfc0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce4003b70 0x7f4ce4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 0x7f4ce4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4004d40 0x7f4ce4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc06bcf0 con 0x7f4ce4003b70 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce400bac0 con 0x7f4ce4004d40 2024-05-20T17:56:23.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce400bcc0 con 0x7f4cfc06d190 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d01113640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce4003b70 0x7f4ce4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d00912640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 0x7f4ce4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d01914640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4004d40 0x7f4ce4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d01113640 1 -- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 msgr2=0x7f4ce4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d01113640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 0x7f4ce4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d01113640 1 -- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4004d40 msgr2=0x7f4ce4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d01113640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4004d40 0x7f4ce4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d01113640 1 -- 172.21.15.6:0/1574752272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce4003520 con 0x7f4ce4003b70 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.344+0000 7f4d00912640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc06d190 0x7f4ce4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.345+0000 7f4d01113640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce4003b70 0x7f4ce4003fc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00a7e0 tx=0x7f4ce4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02b70bc67427202 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.345+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00a430 con 0x7f4ce4003b70 2024-05-20T17:56:23.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.345+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cec02f070 con 0x7f4ce4003b70 2024-05-20T17:56:23.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.345+0000 7f4cfbfff640 1 -- 172.21.15.6:0/1574752272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec02bc30 con 0x7f4ce4003b70 2024-05-20T17:56:23.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.346+0000 7f4d03377640 1 -- 172.21.15.6:0/1574752272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce4003b70 msgr2=0x7f4ce4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.346+0000 7f4d03377640 1 --2- 172.21.15.6:0/1574752272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ce4003b70 0x7f4ce4003fc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00a7e0 tx=0x7f4ce4005830 comp rx=0 tx=0).stop 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.346+0000 7f4d01914640 1 -- 172.21.15.6:0/1574752272 reap_dead start 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.346+0000 7f4d03377640 1 -- 172.21.15.6:0/1574752272 shutdown_connections 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.346+0000 7f4d03377640 1 -- 172.21.15.6:0/1574752272 >> 172.21.15.6:0/1574752272 conn(0x7f4cfc0b6620 msgr2=0x7f4cfc0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.346+0000 7f4d03377640 1 -- 172.21.15.6:0/1574752272 shutdown_connections 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.346+0000 7f4d03377640 1 -- 172.21.15.6:0/1574752272 wait complete. 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.348+0000 7f4d03377640 1 Processor -- start 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.348+0000 7f4d03377640 1 -- start start 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d03377640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4003b70 0x7f4cfc15c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d03377640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc137fc0 0x7f4cfc15e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d03377640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cfc14c0d0 0x7f4cfc14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d03377640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc167e30 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d03377640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc167cb0 con 0x7f4ce4003b70 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d03377640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc167fb0 con 0x7f4cfc137fc0 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d01914640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cfc14c0d0 0x7f4cfc14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d01914640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cfc14c0d0 0x7f4cfc14c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39586/0 (socket says 172.21.15.6:39586) 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d01914640 1 -- 172.21.15.6:0/753143900 learned_addr learned my addr 172.21.15.6:0/753143900 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d01113640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4003b70 0x7f4cfc15c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d00912640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc137fc0 0x7f4cfc15e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d01914640 1 -- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc137fc0 msgr2=0x7f4cfc15e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.349+0000 7f4d01914640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc137fc0 0x7f4cfc15e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4d01914640 1 -- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4003b70 msgr2=0x7f4cfc15c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4d01914640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4003b70 0x7f4cfc15c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4d01914640 1 -- 172.21.15.6:0/753143900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc14ca20 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4d00912640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc137fc0 0x7f4cfc15e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4d01914640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cfc14c0d0 0x7f4cfc14c4e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc072cf0 tx=0x7f4cf4011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4cf9ffb640 1 -- 172.21.15.6:0/753143900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4019020 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4cf9ffb640 1 -- 172.21.15.6:0/753143900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf4004030 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc15d500 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4cf9ffb640 1 -- 172.21.15.6:0/753143900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4004400 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.350+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc15dac0 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.351+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cfc075b00 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.352+0000 7f4cf9ffb640 1 -- 172.21.15.6:0/753143900 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cf401c020 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.352+0000 7f4cf9ffb640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce806be30 0x7f4ce806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.352+0000 7f4cf9ffb640 1 -- 172.21.15.6:0/753143900 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f4cf408b1b0 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.353+0000 7f4d01113640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce806be30 0x7f4ce806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.353+0000 7f4d01113640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce806be30 0x7f4ce806e340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4cec033000 tx=0x7f4cec007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.357+0000 7f4cf9ffb640 1 -- 172.21.15.6:0/753143900 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4cf4023020 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.539+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cfc0d1630 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.540+0000 7f4cf9ffb640 1 -- 172.21.15.6:0/753143900 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7f4cfc14ca20 con 0x7f4cfc14c0d0 2024-05-20T17:56:23.539 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:56:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce806be30 msgr2=0x7f4ce806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce806be30 0x7f4ce806e340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4cec033000 tx=0x7f4cec007000 comp rx=0 tx=0).stop 2024-05-20T17:56:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cfc14c0d0 msgr2=0x7f4cfc14c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cfc14c0d0 0x7f4cfc14c4e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc072cf0 tx=0x7f4cf4011cf0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 shutdown_connections 2024-05-20T17:56:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4ce806be30 0x7f4ce806e340 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cfc14c0d0 0x7f4cfc14c4e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cfc137fc0 0x7f4cfc15e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 --2- 172.21.15.6:0/753143900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce4003b70 0x7f4cfc15c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 >> 172.21.15.6:0/753143900 conn(0x7f4cfc0b6620 msgr2=0x7f4cfc06c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 shutdown_connections 2024-05-20T17:56:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.542+0000 7f4d03377640 1 -- 172.21.15.6:0/753143900 wait complete. 2024-05-20T17:56:23.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:56:23.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.674+0000 7f203ca73640 1 Processor -- start 2024-05-20T17:56:23.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.674+0000 7f203ca73640 1 -- start start 2024-05-20T17:56:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.675+0000 7f203ca73640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f20380af330 0x7f20380af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.675+0000 7f203ca73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380d1610 0x7f20380d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.675+0000 7f203ca73640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f203806c840 con 0x7f20380b1e50 2024-05-20T17:56:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.675+0000 7f203ca73640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f20380d20d0 con 0x7f20380af330 2024-05-20T17:56:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.675+0000 7f203ca73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f203806cae0 con 0x7f20380d1610 2024-05-20T17:56:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f203659c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f20380af330 0x7f20380af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f202ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380d1610 0x7f20380d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f2036d9d640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f20380b1e50 0x7f20380b2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:44408/0 (socket says 172.21.15.6:44408) 2024-05-20T17:56:23.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f2036d9d640 1 -- 172.21.15.6:0/2010900882 learned_addr learned my addr 172.21.15.6:0/2010900882 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:23.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f203659c640 1 -- 172.21.15.6:0/2010900882 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380d1610 msgr2=0x7f20380d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:23.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f203659c640 1 --2- 172.21.15.6:0/2010900882 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380d1610 0x7f20380d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f203659c640 1 -- 172.21.15.6:0/2010900882 >> v1:172.21.15.171:6789/0 conn(0x7f20380b1e50 legacy=0x7f20380b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f2035d9b640 1 -- 172.21.15.6:0/2010900882 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533697769 0 0) 0x7f203806c840 con 0x7f20380b1e50 2024-05-20T17:56:23.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.676+0000 7f203659c640 1 -- 172.21.15.6:0/2010900882 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203806cdc0 con 0x7f20380af330 2024-05-20T17:56:23.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.677+0000 7f203659c640 1 --2- 172.21.15.6:0/2010900882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380af330 0x7f20380af740 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f20280097a0 tx=0x7f202802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=687a6794d664a1d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.677+0000 7f2035d9b640 1 -- 172.21.15.6:0/2010900882 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028037070 con 0x7f20380af330 2024-05-20T17:56:23.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.677+0000 7f2035d9b640 1 -- 172.21.15.6:0/2010900882 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202802ae50 con 0x7f20380af330 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.677+0000 7f2035d9b640 1 -- 172.21.15.6:0/2010900882 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028032660 con 0x7f20380af330 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.678+0000 7f203ca73640 1 -- 172.21.15.6:0/2010900882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380af330 msgr2=0x7f20380af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.678+0000 7f203ca73640 1 --2- 172.21.15.6:0/2010900882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380af330 0x7f20380af740 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f20280097a0 tx=0x7f202802a100 comp rx=0 tx=0).stop 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.678+0000 7f203ca73640 1 -- 172.21.15.6:0/2010900882 shutdown_connections 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.678+0000 7f203ca73640 1 --2- 172.21.15.6:0/2010900882 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380d1610 0x7f20380d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.678+0000 7f203ca73640 1 --2- 172.21.15.6:0/2010900882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380af330 0x7f20380af740 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.678+0000 7f203ca73640 1 -- 172.21.15.6:0/2010900882 >> 172.21.15.6:0/2010900882 conn(0x7f20380b6670 msgr2=0x7f20380b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.678+0000 7f203ca73640 1 -- 172.21.15.6:0/2010900882 shutdown_connections 2024-05-20T17:56:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.678+0000 7f203ca73640 1 -- 172.21.15.6:0/2010900882 wait complete. 2024-05-20T17:56:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.680+0000 7f203ca73640 1 Processor -- start 2024-05-20T17:56:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.680+0000 7f203ca73640 1 -- start start 2024-05-20T17:56:23.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.681+0000 7f203ca73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380af330 0x7f2038155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.681+0000 7f203ca73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20380b1e50 0x7f20380b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.681+0000 7f203ca73640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380d1610 0x7f20380b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.681+0000 7f203ca73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2038159d30 con 0x7f20380b1e50 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.681+0000 7f203ca73640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f203815d350 con 0x7f20380d1610 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.681+0000 7f203ca73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2038159eb0 con 0x7f20380af330 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20380b1e50 0x7f20380b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20380b1e50 0x7f20380b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39594/0 (socket says 172.21.15.6:39594) 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 -- 172.21.15.6:0/2769895863 learned_addr learned my addr 172.21.15.6:0/2769895863 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f203659c640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380af330 0x7f2038155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f2036d9d640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380d1610 0x7f20380b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 -- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380af330 msgr2=0x7f2038155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380af330 0x7f2038155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 -- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380d1610 msgr2=0x7f20380b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380d1610 0x7f20380b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 -- 172.21.15.6:0/2769895863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2038155ea0 con 0x7f20380b1e50 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f2036d9d640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380d1610 0x7f20380b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202ffff640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20380b1e50 0x7f20380b3c40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f202000e8a0 tx=0x7f202000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202effd640 1 -- 172.21.15.6:0/2769895863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020017070 con 0x7f20380b1e50 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20380ccaa0 con 0x7f20380b1e50 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202effd640 1 -- 172.21.15.6:0/2769895863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202000c940 con 0x7f20380b1e50 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f202effd640 1 -- 172.21.15.6:0/2769895863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202000cd30 con 0x7f20380b1e50 2024-05-20T17:56:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.682+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203815d670 con 0x7f20380b1e50 2024-05-20T17:56:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.684+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2038075b00 con 0x7f20380b1e50 2024-05-20T17:56:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.684+0000 7f202effd640 1 -- 172.21.15.6:0/2769895863 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f202001a070 con 0x7f20380b1e50 2024-05-20T17:56:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.684+0000 7f202effd640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f201806be30 0x7f201806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.684+0000 7f202effd640 1 -- 172.21.15.6:0/2769895863 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f202008afd0 con 0x7f20380b1e50 2024-05-20T17:56:23.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.685+0000 7f203659c640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f201806be30 0x7f201806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:23.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.685+0000 7f203659c640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f201806be30 0x7f201806e340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2028034000 tx=0x7f202802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:23.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.689+0000 7f202effd640 1 -- 172.21.15.6:0/2769895863 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f20200596e0 con 0x7f20380b1e50 2024-05-20T17:56:23.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.873+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f20380cc7f0 con 0x7f20380b1e50 2024-05-20T17:56:23.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.873+0000 7f202effd640 1 -- 172.21.15.6:0/2769895863 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) ==== 104+0+11 (secure 0 0 0) 0x7f2020058fe0 con 0x7f20380b1e50 2024-05-20T17:56:23.872 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:56:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f201806be30 msgr2=0x7f201806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f201806be30 0x7f201806e340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2028034000 tx=0x7f202802e000 comp rx=0 tx=0).stop 2024-05-20T17:56:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20380b1e50 msgr2=0x7f20380b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:23.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20380b1e50 0x7f20380b3c40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f202000e8a0 tx=0x7f202000ed60 comp rx=0 tx=0).stop 2024-05-20T17:56:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 shutdown_connections 2024-05-20T17:56:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f201806be30 0x7f201806e340 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20380d1610 0x7f20380b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20380b1e50 0x7f20380b3c40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 --2- 172.21.15.6:0/2769895863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20380af330 0x7f2038155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 >> 172.21.15.6:0/2769895863 conn(0x7f20380b6670 msgr2=0x7f20380b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 shutdown_connections 2024-05-20T17:56:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:23.875+0000 7f203ca73640 1 -- 172.21.15.6:0/2769895863 wait complete. 2024-05-20T17:56:23.886 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:56:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.004+0000 7fe61d4fe640 1 Processor -- start 2024-05-20T17:56:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.004+0000 7fe61d4fe640 1 -- start start 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe61d4fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 0x7fe61806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe61d4fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61806dd20 con 0x7fe618162820 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe61d4fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6180d0630 con 0x7fe6180b8190 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe61d4fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe6180d39c0 con 0x7fe61806d3d0 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe616ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe618162820 0x7fe6180b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42098/0 (socket says 172.21.15.6:42098) 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe616ffd640 1 -- 172.21.15.6:0/2856491032 learned_addr learned my addr 172.21.15.6:0/2856491032 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe6167fc640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 0x7fe61806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421609011 0 0) 0x7fe608001110 con 0x7fe618162820 2024-05-20T17:56:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe600003520 con 0x7fe618162820 2024-05-20T17:56:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681141490 0 0) 0x7fe6180d0630 con 0x7fe6180b8190 2024-05-20T17:56:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe608001110 con 0x7fe6180b8190 2024-05-20T17:56:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 323711457 0 0) 0x7fe600003520 con 0x7fe618162820 2024-05-20T17:56:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 msgr2=0x7fe61806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 0x7fe61806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 >> v1:172.21.15.171:6789/0 conn(0x7fe6180b8190 legacy=0x7fe6180b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6180d3ca0 con 0x7fe618162820 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fe608001840 con 0x7fe618162820 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe6167fc640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 0x7fe61806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 >> v1:172.21.15.6:6789/0 conn(0x7fe618162820 legacy=0x7fe6180b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600003b70 0x7fe600003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe600004800 0x7fe600004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 0x7fe6000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.006+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180d39c0 con 0x7fe600004800 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe60000baa0 con 0x7fe600003b70 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe60000bca0 con 0x7fe61806d3d0 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe6167fc640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe600004800 0x7fe600004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe616ffd640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600003b70 0x7fe600003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe6177fe640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 0x7fe6000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe6167fc640 1 -- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 msgr2=0x7fe6000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe6167fc640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe61806d3d0 0x7fe6000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe6167fc640 1 -- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600003b70 msgr2=0x7fe600003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe6167fc640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600003b70 0x7fe600003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.007+0000 7fe6167fc640 1 -- 172.21.15.6:0/2856491032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe600003520 con 0x7fe600004800 2024-05-20T17:56:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.008+0000 7fe6167fc640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe600004800 0x7fe600004c10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009c60 tx=0x7fe600005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bc7ccf845ec96 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.008+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c036070 con 0x7fe600004800 2024-05-20T17:56:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.008+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c031400 con 0x7fe600004800 2024-05-20T17:56:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.008+0000 7fe615ffb640 1 -- 172.21.15.6:0/2856491032 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c009860 con 0x7fe600004800 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.009+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2856491032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe600004800 msgr2=0x7fe600004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.009+0000 7fe61d4fe640 1 --2- 172.21.15.6:0/2856491032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe600004800 0x7fe600004c10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009c60 tx=0x7fe600005830 comp rx=0 tx=0).stop 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.009+0000 7fe6177fe640 1 -- 172.21.15.6:0/2856491032 reap_dead start 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.009+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2856491032 shutdown_connections 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.009+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2856491032 >> 172.21.15.6:0/2856491032 conn(0x7fe6180d4bd0 msgr2=0x7fe6180d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.009+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2856491032 shutdown_connections 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.009+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2856491032 wait complete. 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.011+0000 7fe61d4fe640 1 Processor -- start 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.011+0000 7fe61d4fe640 1 -- start start 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe61d4fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600004800 0x7fe618152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe61d4fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6180ce620 0x7fe6180b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe61d4fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180cc890 0x7fe6180ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe61d4fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180d0300 con 0x7fe6180cc890 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe61d4fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180d4260 con 0x7fe600004800 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe61d4fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe6180b4050 con 0x7fe6180ce620 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6177fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180cc890 0x7fe6180ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6177fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180cc890 0x7fe6180ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39612/0 (socket says 172.21.15.6:39612) 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6177fe640 1 -- 172.21.15.6:0/2678992593 learned_addr learned my addr 172.21.15.6:0/2678992593 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe616ffd640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600004800 0x7fe618152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6167fc640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6180ce620 0x7fe6180b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6177fe640 1 -- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6180ce620 msgr2=0x7fe6180b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6177fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6180ce620 0x7fe6180b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6177fe640 1 -- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600004800 msgr2=0x7fe618152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6177fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600004800 0x7fe618152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.012+0000 7fe6177fe640 1 -- 172.21.15.6:0/2678992593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6180ca820 con 0x7fe6180cc890 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.013+0000 7fe6177fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180cc890 0x7fe6180ccca0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe600004780 tx=0x7fe61000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.013+0000 7fe5ff7fe640 1 -- 172.21.15.6:0/2678992593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610019070 con 0x7fe6180cc890 2024-05-20T17:56:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.013+0000 7fe5ff7fe640 1 -- 172.21.15.6:0/2678992593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe610006e20 con 0x7fe6180cc890 2024-05-20T17:56:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.013+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6180cbdb0 con 0x7fe6180cc890 2024-05-20T17:56:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.013+0000 7fe5ff7fe640 1 -- 172.21.15.6:0/2678992593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610003bb0 con 0x7fe6180cc890 2024-05-20T17:56:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.013+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6180cc370 con 0x7fe6180cc890 2024-05-20T17:56:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.014+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe618075b00 con 0x7fe6180cc890 2024-05-20T17:56:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.014+0000 7fe5ff7fe640 1 -- 172.21.15.6:0/2678992593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe61001c070 con 0x7fe6180cc890 2024-05-20T17:56:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.015+0000 7fe5ff7fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe60406be30 0x7fe60406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.015+0000 7fe5ff7fe640 1 -- 172.21.15.6:0/2678992593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fe61008a340 con 0x7fe6180cc890 2024-05-20T17:56:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.015+0000 7fe616ffd640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe60406be30 0x7fe60406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.016+0000 7fe616ffd640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe60406be30 0x7fe60406e340 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe608001050 tx=0x7fe608007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.020+0000 7fe5ff7fe640 1 -- 172.21.15.6:0/2678992593 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe610058500 con 0x7fe6180cc890 2024-05-20T17:56:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.202+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe6180ca540 con 0x7fe6180cc890 2024-05-20T17:56:24.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.202+0000 7fe5ff7fe640 1 -- 172.21.15.6:0/2678992593 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) ==== 100+0+11 (secure 0 0 0) 0x7fe61005c800 con 0x7fe6180cc890 2024-05-20T17:56:24.201 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:56:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe60406be30 msgr2=0x7fe60406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe60406be30 0x7fe60406e340 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe608001050 tx=0x7fe608007a20 comp rx=0 tx=0).stop 2024-05-20T17:56:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180cc890 msgr2=0x7fe6180ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180cc890 0x7fe6180ccca0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe600004780 tx=0x7fe61000ff70 comp rx=0 tx=0).stop 2024-05-20T17:56:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 shutdown_connections 2024-05-20T17:56:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe60406be30 0x7fe60406e340 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180cc890 0x7fe6180ccca0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6180ce620 0x7fe6180b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 --2- 172.21.15.6:0/2678992593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe600004800 0x7fe618152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 >> 172.21.15.6:0/2678992593 conn(0x7fe6180d4bd0 msgr2=0x7fe61815fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:24.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 shutdown_connections 2024-05-20T17:56:24.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.204+0000 7fe61d4fe640 1 -- 172.21.15.6:0/2678992593 wait complete. 2024-05-20T17:56:24.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:56:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.332+0000 7f484e564640 1 Processor -- start 2024-05-20T17:56:24.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.332+0000 7f484e564640 1 -- start start 2024-05-20T17:56:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.333+0000 7f484e564640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48480b4010 0x7f48480d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.333+0000 7f484e564640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48480d0370 con 0x7f48480d14b0 2024-05-20T17:56:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.333+0000 7f484e564640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48480d0650 con 0x7f4848163a10 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.333+0000 7f484e564640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48480d3ca0 con 0x7f48480b4010 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.333+0000 7f484cb01640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f48480d14b0 0x7f48480d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42104/0 (socket says 172.21.15.6:42104) 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.333+0000 7f484cb01640 1 -- 172.21.15.6:0/1696960533 learned_addr learned my addr 172.21.15.6:0/1696960533 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.333+0000 7f48477fe640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48480b4010 0x7f48480d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360666930 0 0) 0x7f48480d0370 con 0x7f48480d14b0 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4830003520 con 0x7f48480d14b0 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114408247 0 0) 0x7f48480d0650 con 0x7f4848163a10 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48480d0370 con 0x7f4848163a10 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 178620493 0 0) 0x7f4830003520 con 0x7f48480d14b0 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48480b4010 msgr2=0x7f48480d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48480b4010 0x7f48480d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 >> v1:172.21.15.171:6789/0 conn(0x7f4848163a10 legacy=0x7f48480cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48480d3650 con 0x7f48480d14b0 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f48400019f0 con 0x7f48480d14b0 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 >> v1:172.21.15.6:6789/0 conn(0x7f48480d14b0 legacy=0x7f48480d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4830003b70 0x7f4830003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48480b4010 0x7f4830004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830004d40 0x7f4830005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48480d3ca0 con 0x7f4830003b70 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f483000bac0 con 0x7f4830004d40 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f483000bcc0 con 0x7f48480b4010 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4847fff640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4830003b70 0x7f4830003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f48477fe640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48480b4010 0x7f4830004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f484cb01640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830004d40 0x7f4830005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4847fff640 1 -- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48480b4010 msgr2=0x7f4830004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4847fff640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48480b4010 0x7f4830004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4847fff640 1 -- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830004d40 msgr2=0x7f4830005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4847fff640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830004d40 0x7f4830005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.334+0000 7f4847fff640 1 -- 172.21.15.6:0/1696960533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4830003520 con 0x7f4830003b70 2024-05-20T17:56:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.335+0000 7f4847fff640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4830003b70 0x7f4830003fc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f48380018a0 tx=0x7f4830005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617020898b117070 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.335+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48380014f0 con 0x7f4830003b70 2024-05-20T17:56:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.335+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48380052d0 con 0x7f4830003b70 2024-05-20T17:56:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.335+0000 7f4846ffd640 1 -- 172.21.15.6:0/1696960533 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483802ac60 con 0x7f4830003b70 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.336+0000 7f484e564640 1 -- 172.21.15.6:0/1696960533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4830003b70 msgr2=0x7f4830003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.336+0000 7f484e564640 1 --2- 172.21.15.6:0/1696960533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4830003b70 0x7f4830003fc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f48380018a0 tx=0x7f4830005830 comp rx=0 tx=0).stop 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.336+0000 7f484cb01640 1 -- 172.21.15.6:0/1696960533 reap_dead start 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.336+0000 7f484e564640 1 -- 172.21.15.6:0/1696960533 shutdown_connections 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.336+0000 7f484e564640 1 -- 172.21.15.6:0/1696960533 >> 172.21.15.6:0/1696960533 conn(0x7f484806d240 msgr2=0x7f484806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.336+0000 7f484e564640 1 -- 172.21.15.6:0/1696960533 shutdown_connections 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.336+0000 7f484e564640 1 -- 172.21.15.6:0/1696960533 wait complete. 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.338+0000 7f484e564640 1 Processor -- start 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.338+0000 7f484e564640 1 -- start start 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.339+0000 7f484e564640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830003b70 0x7f4848157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.339+0000 7f484e564640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4848147bd0 0x7f48481ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.339+0000 7f484e564640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48481f8d50 0x7f48481f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.339+0000 7f484e564640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f48480d42b0 con 0x7f48481f8d50 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.339+0000 7f484e564640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48480d4130 con 0x7f4830003b70 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.339+0000 7f484e564640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f48480d4430 con 0x7f4848147bd0 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48481f8d50 0x7f48481f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48481f8d50 0x7f48481f9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39616/0 (socket says 172.21.15.6:39616) 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 -- 172.21.15.6:0/3661783683 learned_addr learned my addr 172.21.15.6:0/3661783683 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f48477fe640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4848147bd0 0x7f48481ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f4847fff640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830003b70 0x7f4848157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 -- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4848147bd0 msgr2=0x7f48481ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4848147bd0 0x7f48481ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 -- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830003b70 msgr2=0x7f4848157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830003b70 0x7f4848157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 -- 172.21.15.6:0/3661783683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48481581a0 con 0x7f48481f8d50 2024-05-20T17:56:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f4847fff640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830003b70 0x7f4848157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484cb01640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48481f8d50 0x7f48481f9160 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f48480d4b90 tx=0x7f484000e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f4844ff9640 1 -- 172.21.15.6:0/3661783683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484000eb70 con 0x7f48481f8d50 2024-05-20T17:56:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f4844ff9640 1 -- 172.21.15.6:0/3661783683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4840018070 con 0x7f48481f8d50 2024-05-20T17:56:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484815aac0 con 0x7f48481f8d50 2024-05-20T17:56:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f4844ff9640 1 -- 172.21.15.6:0/3661783683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840013420 con 0x7f48481f8d50 2024-05-20T17:56:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.340+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48481e9d80 con 0x7f48481f8d50 2024-05-20T17:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.341+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f484815afe0 con 0x7f48481f8d50 2024-05-20T17:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.342+0000 7f4844ff9640 1 -- 172.21.15.6:0/3661783683 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48400135c0 con 0x7f48481f8d50 2024-05-20T17:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.342+0000 7f4844ff9640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f483406be30 0x7f483406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.343+0000 7f4844ff9640 1 -- 172.21.15.6:0/3661783683 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f484008b2e0 con 0x7f48481f8d50 2024-05-20T17:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.343+0000 7f4847fff640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f483406be30 0x7f483406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.343+0000 7f4847fff640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f483406be30 0x7f483406e340 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4838032000 tx=0x7f4838009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.347+0000 7f4844ff9640 1 -- 172.21.15.6:0/3661783683 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f484815afe0 con 0x7f48481f8d50 2024-05-20T17:56:24.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.544+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4848075b00 con 0x7f48481f8d50 2024-05-20T17:56:24.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.544+0000 7f4844ff9640 1 -- 172.21.15.6:0/3661783683 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7f4840059540 con 0x7f48481f8d50 2024-05-20T17:56:24.543 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:56:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f483406be30 msgr2=0x7f483406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f483406be30 0x7f483406e340 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4838032000 tx=0x7f4838009030 comp rx=0 tx=0).stop 2024-05-20T17:56:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48481f8d50 msgr2=0x7f48481f9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48481f8d50 0x7f48481f9160 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f48480d4b90 tx=0x7f484000e160 comp rx=0 tx=0).stop 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 shutdown_connections 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f483406be30 0x7f483406e340 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48481f8d50 0x7f48481f9160 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4848147bd0 0x7f48481ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 --2- 172.21.15.6:0/3661783683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4830003b70 0x7f4848157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 >> 172.21.15.6:0/3661783683 conn(0x7f484806d240 msgr2=0x7f484815f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 shutdown_connections 2024-05-20T17:56:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.546+0000 7f484e564640 1 -- 172.21.15.6:0/3661783683 wait complete. 2024-05-20T17:56:24.557 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T17:56:24.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:24.557 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:24.592 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:56:24.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:24.592 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T17:56:24.650 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:56:24.650 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:24.650 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:24.666 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:56:24.666 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:56:24.667 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:24.667 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:24.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:56:24.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.824+0000 7fdd20945640 1 Processor -- start 2024-05-20T17:56:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.824+0000 7fdd20945640 1 -- start start 2024-05-20T17:56:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.825+0000 7fdd20945640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c15d530 0x7fdd1c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd20945640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdd1c070850 0x7fdd1c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd20945640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c0cd580 con 0x7fdd1c0b1700 2024-05-20T17:56:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd20945640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdd1c0ce190 con 0x7fdd1c070850 2024-05-20T17:56:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd20945640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c0cd860 con 0x7fdd1c15d530 2024-05-20T17:56:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1a59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c15d530 0x7fdd1c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1ad9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdd1c070850 0x7fdd1c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd19d9b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fdd1c0b1700 0x7fdd1c0b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:44420/0 (socket says 172.21.15.6:44420) 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd19d9b640 1 -- 172.21.15.6:0/3226532204 learned_addr learned my addr 172.21.15.6:0/3226532204 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1959a640 1 -- 172.21.15.6:0/3226532204 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378327578 0 0) 0x7fdd1c0cd580 con 0x7fdd1c0b1700 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1959a640 1 -- 172.21.15.6:0/3226532204 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd04003520 con 0x7fdd1c0b1700 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1ad9d640 1 -- 172.21.15.6:0/3226532204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c15d530 msgr2=0x7fdd1c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1ad9d640 1 --2- 172.21.15.6:0/3226532204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c15d530 0x7fdd1c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1ad9d640 1 -- 172.21.15.6:0/3226532204 >> v1:172.21.15.171:6789/0 conn(0x7fdd1c0b1700 legacy=0x7fdd1c0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1ad9d640 1 -- 172.21.15.6:0/3226532204 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c0cdb40 con 0x7fdd1c070850 2024-05-20T17:56:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.826+0000 7fdd1a59c640 1 --2- 172.21.15.6:0/3226532204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c15d530 0x7fdd1c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.827+0000 7fdd1ad9d640 1 --2- 172.21.15.6:0/3226532204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 0x7fdd1c070c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdd140097a0 tx=0x7fdd1402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=841f0b9713e9f1b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.827+0000 7fdd1959a640 1 -- 172.21.15.6:0/3226532204 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14037070 con 0x7fdd1c070850 2024-05-20T17:56:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.827+0000 7fdd1959a640 1 -- 172.21.15.6:0/3226532204 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd14032440 con 0x7fdd1c070850 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.827+0000 7fdd1959a640 1 -- 172.21.15.6:0/3226532204 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14032810 con 0x7fdd1c070850 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.828+0000 7fdd20945640 1 -- 172.21.15.6:0/3226532204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 msgr2=0x7fdd1c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.828+0000 7fdd20945640 1 --2- 172.21.15.6:0/3226532204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 0x7fdd1c070c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdd140097a0 tx=0x7fdd1402a180 comp rx=0 tx=0).stop 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.828+0000 7fdd20945640 1 -- 172.21.15.6:0/3226532204 shutdown_connections 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.828+0000 7fdd20945640 1 --2- 172.21.15.6:0/3226532204 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 0x7fdd1c070c60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.828+0000 7fdd20945640 1 --2- 172.21.15.6:0/3226532204 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c15d530 0x7fdd1c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.828+0000 7fdd20945640 1 -- 172.21.15.6:0/3226532204 >> 172.21.15.6:0/3226532204 conn(0x7fdd1c0d29d0 msgr2=0x7fdd1c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.828+0000 7fdd20945640 1 -- 172.21.15.6:0/3226532204 shutdown_connections 2024-05-20T17:56:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.828+0000 7fdd20945640 1 -- 172.21.15.6:0/3226532204 wait complete. 2024-05-20T17:56:24.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.830+0000 7fdd20945640 1 Processor -- start 2024-05-20T17:56:24.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.830+0000 7fdd20945640 1 -- start start 2024-05-20T17:56:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.831+0000 7fdd20945640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 0x7fdd1c14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.831+0000 7fdd20945640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0b1700 0x7fdd1c0b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.831+0000 7fdd20945640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c15d530 0x7fdd1c0b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.831+0000 7fdd20945640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0711a0 con 0x7fdd1c15d530 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.831+0000 7fdd20945640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0cd230 con 0x7fdd1c070850 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.831+0000 7fdd20945640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c071320 con 0x7fdd1c0b1700 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.831+0000 7fdd1ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c15d530 0x7fdd1c0b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.831+0000 7fdd1ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c15d530 0x7fdd1c0b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39622/0 (socket says 172.21.15.6:39622) 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd1ad9d640 1 -- 172.21.15.6:0/567820731 learned_addr learned my addr 172.21.15.6:0/567820731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd1a59c640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 0x7fdd1c14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd19d9b640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0b1700 0x7fdd1c0b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd1ad9d640 1 -- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0b1700 msgr2=0x7fdd1c0b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd1ad9d640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0b1700 0x7fdd1c0b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd1ad9d640 1 -- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 msgr2=0x7fdd1c14bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd1ad9d640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 0x7fdd1c14bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd1ad9d640 1 -- 172.21.15.6:0/567820731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c0c8b10 con 0x7fdd1c15d530 2024-05-20T17:56:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd1ad9d640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c15d530 0x7fdd1c0b7780 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fdd140098c0 tx=0x7fdd140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd0affd640 1 -- 172.21.15.6:0/567820731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14041020 con 0x7fdd1c15d530 2024-05-20T17:56:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd0affd640 1 -- 172.21.15.6:0/567820731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1403d640 con 0x7fdd1c15d530 2024-05-20T17:56:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c0c8df0 con 0x7fdd1c15d530 2024-05-20T17:56:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd0affd640 1 -- 172.21.15.6:0/567820731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14037040 con 0x7fdd1c15d530 2024-05-20T17:56:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.832+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c0c93b0 con 0x7fdd1c15d530 2024-05-20T17:56:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.833+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c075b00 con 0x7fdd1c15d530 2024-05-20T17:56:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.834+0000 7fdd0affd640 1 -- 172.21.15.6:0/567820731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd14044020 con 0x7fdd1c15d530 2024-05-20T17:56:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.834+0000 7fdd0affd640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdcfc06be60 0x7fdcfc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.834+0000 7fdd0affd640 1 -- 172.21.15.6:0/567820731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fdd140ab5d0 con 0x7fdd1c15d530 2024-05-20T17:56:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.835+0000 7fdd1a59c640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdcfc06be60 0x7fdcfc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.835+0000 7fdd1a59c640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdcfc06be60 0x7fdcfc06e370 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009bd0 tx=0x7fdd0c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:24.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:24.839+0000 7fdd0affd640 1 -- 172.21.15.6:0/567820731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdd1404b030 con 0x7fdd1c15d530 2024-05-20T17:56:25.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.064+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd1c15dc80 con 0x7fdd1c15d530 2024-05-20T17:56:25.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.064+0000 7fdd0affd640 1 -- 172.21.15.6:0/567820731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5182 (secure 0 0 0) 0x7fdd14079720 con 0x7fdd1c15d530 2024-05-20T17:56:25.063 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:25.063 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2318422221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2318422221},{"type":"v1","addr":"172.21.15.6:6835","nonce":2318422221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1262536376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1262536376},{"type":"v1","addr":"172.21.15.171:6836","nonce":1262536376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2875796025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2875796025},{"type":"v1","addr":"172.21.15.171:6837","nonce":2875796025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:12.150755+0000","modified":"2024-05-20T17:56:15.161874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6297":{"gid":6297,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3730828520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3730828520},{"type":"v1","addr":"172.21.15.6:6834","nonce":3730828520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6297,"qdb_cluster":[6297]},"id":4}]} 2024-05-20T17:56:25.064 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 36 2024-05-20T17:56:25.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdcfc06be60 msgr2=0x7fdcfc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdcfc06be60 0x7fdcfc06e370 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009bd0 tx=0x7fdd0c00b040 comp rx=0 tx=0).stop 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c15d530 msgr2=0x7fdd1c0b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c15d530 0x7fdd1c0b7780 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fdd140098c0 tx=0x7fdd140046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 shutdown_connections 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdcfc06be60 0x7fdcfc06e370 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd1c15d530 0x7fdd1c0b7780 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd1c0b1700 0x7fdd1c0b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 --2- 172.21.15.6:0/567820731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd1c070850 0x7fdd1c14bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 >> 172.21.15.6:0/567820731 conn(0x7fdd1c0d29d0 msgr2=0x7fdd1c15e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 shutdown_connections 2024-05-20T17:56:25.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.066+0000 7fdd20945640 1 -- 172.21.15.6:0/567820731 wait complete. 2024-05-20T17:56:25.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:25.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.193+0000 7f43c0ea0640 1 Processor -- start 2024-05-20T17:56:25.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.194+0000 7f43c0ea0640 1 -- start start 2024-05-20T17:56:25.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43c0ea0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43bc162820 0x7f43bc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43c0ea0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc0b3e80 0x7f43bc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43c0ea0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43bc06dd20 con 0x7f43bc06d910 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43c0ea0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f43bc0d0630 con 0x7f43bc162820 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43c0ea0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc0d39c0 con 0x7f43bc0b3e80 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43ba59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43bc162820 0x7f43bc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43ba59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43bc162820 0x7f43bc0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39634/0 (socket says 172.21.15.6:39634) 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43ba59c640 1 -- 172.21.15.6:0/4109040510 learned_addr learned my addr 172.21.15.6:0/4109040510 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43b9d9b640 1 --2- 172.21.15.6:0/4109040510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc0b3e80 0x7f43bc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.195+0000 7f43ba59c640 1 -- 172.21.15.6:0/4109040510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc0b3e80 msgr2=0x7f43bc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.196+0000 7f43ba59c640 1 --2- 172.21.15.6:0/4109040510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc0b3e80 0x7f43bc06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.196+0000 7f43ba59c640 1 -- 172.21.15.6:0/4109040510 >> v1:172.21.15.171:6789/0 conn(0x7f43bc06d910 legacy=0x7f43bc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:25.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.196+0000 7f43ba59c640 1 -- 172.21.15.6:0/4109040510 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc0d3ca0 con 0x7f43bc162820 2024-05-20T17:56:25.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.196+0000 7f43b9d9b640 1 --2- 172.21.15.6:0/4109040510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc0b3e80 0x7f43bc06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.196+0000 7f43ba59c640 1 --2- 172.21.15.6:0/4109040510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc162820 0x7f43bc0b3940 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009870 tx=0x7f43b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ccf1cb96f9b26c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.196+0000 7f43b959a640 1 -- 172.21.15.6:0/4109040510 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4037070 con 0x7f43bc162820 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43b959a640 1 -- 172.21.15.6:0/4109040510 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b4032440 con 0x7f43bc162820 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43b959a640 1 -- 172.21.15.6:0/4109040510 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4032810 con 0x7f43bc162820 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43c0ea0640 1 -- 172.21.15.6:0/4109040510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc162820 msgr2=0x7f43bc0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/4109040510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc162820 0x7f43bc0b3940 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009870 tx=0x7f43b402a270 comp rx=0 tx=0).stop 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43c0ea0640 1 -- 172.21.15.6:0/4109040510 shutdown_connections 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/4109040510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc0b3e80 0x7f43bc06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/4109040510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc162820 0x7f43bc0b3940 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43c0ea0640 1 -- 172.21.15.6:0/4109040510 >> 172.21.15.6:0/4109040510 conn(0x7f43bc0d4bd0 msgr2=0x7f43bc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43c0ea0640 1 -- 172.21.15.6:0/4109040510 shutdown_connections 2024-05-20T17:56:25.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.197+0000 7f43c0ea0640 1 -- 172.21.15.6:0/4109040510 wait complete. 2024-05-20T17:56:25.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.199+0000 7f43c0ea0640 1 Processor -- start 2024-05-20T17:56:25.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.199+0000 7f43c0ea0640 1 -- start start 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43c0ea0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc06d910 0x7f43bc1f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43c0ea0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc0b3e80 0x7f43bc1f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43c0ea0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc162820 0x7f43bc0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43c0ea0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0d0300 con 0x7f43bc0b3e80 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43c0ea0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0d4260 con 0x7f43bc06d910 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43c0ea0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc0b91a0 con 0x7f43bc162820 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43b9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc0b3e80 0x7f43bc1f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43b9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc0b3e80 0x7f43bc1f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39638/0 (socket says 172.21.15.6:39638) 2024-05-20T17:56:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43b9d9b640 1 -- 172.21.15.6:0/3013166737 learned_addr learned my addr 172.21.15.6:0/3013166737 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43ba59c640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc06d910 0x7f43bc1f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43bad9d640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc162820 0x7f43bc0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43b9d9b640 1 -- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc162820 msgr2=0x7f43bc0cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43b9d9b640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc162820 0x7f43bc0cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43b9d9b640 1 -- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc06d910 msgr2=0x7f43bc1f29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43b9d9b640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc06d910 0x7f43bc1f29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.201+0000 7f43b9d9b640 1 -- 172.21.15.6:0/3013166737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc1f64c0 con 0x7f43bc0b3e80 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.202+0000 7f43b9d9b640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc0b3e80 0x7f43bc1f5d40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c820 tx=0x7f43a400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.202+0000 7f43b2ffd640 1 -- 172.21.15.6:0/3013166737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4015070 con 0x7f43bc0b3e80 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.202+0000 7f43b2ffd640 1 -- 172.21.15.6:0/3013166737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a4007a30 con 0x7f43bc0b3e80 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.202+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43bc1f6280 con 0x7f43bc0b3e80 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.202+0000 7f43b2ffd640 1 -- 172.21.15.6:0/3013166737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4007de0 con 0x7f43bc0b3e80 2024-05-20T17:56:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.202+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43bc0b4c40 con 0x7f43bc0b3e80 2024-05-20T17:56:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.203+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43bc0b46c0 con 0x7f43bc0b3e80 2024-05-20T17:56:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.203+0000 7f43b2ffd640 1 -- 172.21.15.6:0/3013166737 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43a4018070 con 0x7f43bc0b3e80 2024-05-20T17:56:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.204+0000 7f43b2ffd640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06be60 0x7f439c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.204+0000 7f43b2ffd640 1 -- 172.21.15.6:0/3013166737 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f43a408ae00 con 0x7f43bc0b3e80 2024-05-20T17:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.205+0000 7f43ba59c640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06be60 0x7f439c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.205+0000 7f43ba59c640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06be60 0x7f439c06e370 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f43b4034000 tx=0x7f43b402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.209+0000 7f43b2ffd640 1 -- 172.21.15.6:0/3013166737 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f43bc0b46c0 con 0x7f43bc0b3e80 2024-05-20T17:56:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.391+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43bc075b00 con 0x7f43bc0b3e80 2024-05-20T17:56:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.393+0000 7f43b2ffd640 1 -- 172.21.15.6:0/3013166737 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16836 (secure 0 0 0) 0x7f43a4058f50 con 0x7f43bc0b3e80 2024-05-20T17:56:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:25.392 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":64,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:13.770370+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:10.505890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:11.122304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:25.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06be60 msgr2=0x7f439c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06be60 0x7f439c06e370 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f43b4034000 tx=0x7f43b402e000 comp rx=0 tx=0).stop 2024-05-20T17:56:25.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc0b3e80 msgr2=0x7f43bc1f5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc0b3e80 0x7f43bc1f5d40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c820 tx=0x7f43a400cce0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 shutdown_connections 2024-05-20T17:56:25.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f439c06be60 0x7f439c06e370 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f43bc162820 0x7f43bc0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43bc0b3e80 0x7f43bc1f5d40 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 --2- 172.21.15.6:0/3013166737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43bc06d910 0x7f43bc1f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 >> 172.21.15.6:0/3013166737 conn(0x7f43bc0d4bd0 msgr2=0x7f43bc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:25.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 shutdown_connections 2024-05-20T17:56:25.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.395+0000 7f43c0ea0640 1 -- 172.21.15.6:0/3013166737 wait complete. 2024-05-20T17:56:25.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:56:10.505890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:56:11.122304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:56:25.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:56:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.525+0000 7f02dab84640 1 Processor -- start 2024-05-20T17:56:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.525+0000 7f02dab84640 1 -- start start 2024-05-20T17:56:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02dab84640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02d406d3d0 0x7f02d406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02dab84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d40b8190 0x7f02d40b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02dab84640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d406dd20 con 0x7f02d4162820 2024-05-20T17:56:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02dab84640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f02d40d0630 con 0x7f02d406d3d0 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02dab84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02d40d39c0 con 0x7f02d40b8190 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02d406d3d0 0x7f02d406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02d406d3d0 0x7f02d406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39652/0 (socket says 172.21.15.6:39652) 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02d3fff640 1 -- 172.21.15.6:0/159722542 learned_addr learned my addr 172.21.15.6:0/159722542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02d9121640 1 --2- 172.21.15.6:0/159722542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d40b8190 0x7f02d40b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02d3fff640 1 -- 172.21.15.6:0/159722542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d40b8190 msgr2=0x7f02d40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02d3fff640 1 --2- 172.21.15.6:0/159722542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d40b8190 0x7f02d40b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02d3fff640 1 -- 172.21.15.6:0/159722542 >> v1:172.21.15.171:6789/0 conn(0x7f02d4162820 legacy=0x7f02d40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.527+0000 7f02d3fff640 1 -- 172.21.15.6:0/159722542 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d40d3ca0 con 0x7f02d406d3d0 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.528+0000 7f02d3fff640 1 --2- 172.21.15.6:0/159722542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d406d3d0 0x7f02d406d7e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009870 tx=0x7f02c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80942036f77a97a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.528+0000 7f02d37fe640 1 -- 172.21.15.6:0/159722542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8037070 con 0x7f02d406d3d0 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.528+0000 7f02d37fe640 1 -- 172.21.15.6:0/159722542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c8032440 con 0x7f02d406d3d0 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.528+0000 7f02d37fe640 1 -- 172.21.15.6:0/159722542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8032810 con 0x7f02d406d3d0 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.529+0000 7f02dab84640 1 -- 172.21.15.6:0/159722542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d406d3d0 msgr2=0x7f02d406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.529+0000 7f02dab84640 1 --2- 172.21.15.6:0/159722542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d406d3d0 0x7f02d406d7e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009870 tx=0x7f02c802a270 comp rx=0 tx=0).stop 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.529+0000 7f02dab84640 1 -- 172.21.15.6:0/159722542 shutdown_connections 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.529+0000 7f02dab84640 1 --2- 172.21.15.6:0/159722542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d40b8190 0x7f02d40b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.529+0000 7f02dab84640 1 --2- 172.21.15.6:0/159722542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d406d3d0 0x7f02d406d7e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.529+0000 7f02dab84640 1 -- 172.21.15.6:0/159722542 >> 172.21.15.6:0/159722542 conn(0x7f02d40d4bd0 msgr2=0x7f02d40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.529+0000 7f02dab84640 1 -- 172.21.15.6:0/159722542 shutdown_connections 2024-05-20T17:56:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.529+0000 7f02dab84640 1 -- 172.21.15.6:0/159722542 wait complete. 2024-05-20T17:56:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.531+0000 7f02dab84640 1 Processor -- start 2024-05-20T17:56:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.531+0000 7f02dab84640 1 -- start start 2024-05-20T17:56:25.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02dab84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d406d3d0 0x7f02d41f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02dab84640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40b8190 0x7f02d41583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02dab84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02d4162820 0x7f02d415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02dab84640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f02d40d0300 con 0x7f02d40b8190 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02dab84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f02d40d4260 con 0x7f02d4162820 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02dab84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02d40b4050 con 0x7f02d406d3d0 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40b8190 0x7f02d41583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40b8190 0x7f02d41583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39660/0 (socket says 172.21.15.6:39660) 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02d3fff640 1 -- 172.21.15.6:0/2263693453 learned_addr learned my addr 172.21.15.6:0/2263693453 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.532+0000 7f02d8920640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d406d3d0 0x7f02d41f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d9121640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02d4162820 0x7f02d415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d3fff640 1 -- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d406d3d0 msgr2=0x7f02d41f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d3fff640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d406d3d0 0x7f02d41f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d3fff640 1 -- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02d4162820 msgr2=0x7f02d415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d3fff640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02d4162820 0x7f02d415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d3fff640 1 -- 172.21.15.6:0/2263693453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d40cb670 con 0x7f02d40b8190 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d8920640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d406d3d0 0x7f02d41f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d3fff640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40b8190 0x7f02d41583a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f02c802a2b0 tx=0x7f02c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d17fa640 1 -- 172.21.15.6:0/2263693453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8037040 con 0x7f02d40b8190 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d17fa640 1 -- 172.21.15.6:0/2263693453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c8042070 con 0x7f02d40b8190 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d4158b80 con 0x7f02d40b8190 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02d17fa640 1 -- 172.21.15.6:0/2263693453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8030880 con 0x7f02d40b8190 2024-05-20T17:56:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.533+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d4159390 con 0x7f02d40b8190 2024-05-20T17:56:25.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.534+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d4158e20 con 0x7f02d40b8190 2024-05-20T17:56:25.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.535+0000 7f02d17fa640 1 -- 172.21.15.6:0/2263693453 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02c8030a20 con 0x7f02d40b8190 2024-05-20T17:56:25.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.535+0000 7f02d17fa640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f02c006be30 0x7f02c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.535+0000 7f02d17fa640 1 -- 172.21.15.6:0/2263693453 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f02c80ab7f0 con 0x7f02d40b8190 2024-05-20T17:56:25.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.536+0000 7f02d8920640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f02c006be30 0x7f02c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.536+0000 7f02d8920640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f02c006be30 0x7f02c006e340 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f02c4001660 tx=0x7f02c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.540+0000 7f02d17fa640 1 -- 172.21.15.6:0/2263693453 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f02d40cb670 con 0x7f02d40b8190 2024-05-20T17:56:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.723+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f02d4159d90 con 0x7f02d40b8190 2024-05-20T17:56:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.724+0000 7f02d17fa640 1 -- 172.21.15.6:0/2263693453 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7f02c807a0a0 con 0x7f02d40b8190 2024-05-20T17:56:25.723 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:56:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f02c006be30 msgr2=0x7f02c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f02c006be30 0x7f02c006e340 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f02c4001660 tx=0x7f02c4009040 comp rx=0 tx=0).stop 2024-05-20T17:56:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40b8190 msgr2=0x7f02d41583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40b8190 0x7f02d41583a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f02c802a2b0 tx=0x7f02c80046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 shutdown_connections 2024-05-20T17:56:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f02c006be30 0x7f02c006e340 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02d4162820 0x7f02d415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40b8190 0x7f02d41583a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 --2- 172.21.15.6:0/2263693453 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02d406d3d0 0x7f02d41f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 >> 172.21.15.6:0/2263693453 conn(0x7f02d40d4bd0 msgr2=0x7f02d40b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 shutdown_connections 2024-05-20T17:56:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.726+0000 7f02dab84640 1 -- 172.21.15.6:0/2263693453 wait complete. 2024-05-20T17:56:25.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:56:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.856+0000 7fdf4207a640 1 Processor -- start 2024-05-20T17:56:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.856+0000 7fdf4207a640 1 -- start start 2024-05-20T17:56:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf4207a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf3c0af030 0x7fdf3c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf4207a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdf3c15f700 0x7fdf3c15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf4207a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf3c0af980 con 0x7fdf3c09a4f0 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf4207a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdf3c06bcf0 con 0x7fdf3c0af030 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf4207a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdf3c160430 con 0x7fdf3c15f700 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf3b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf3c0af030 0x7fdf3c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf3b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf3c0af030 0x7fdf3c0af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39664/0 (socket says 172.21.15.6:39664) 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf3b7fe640 1 -- 172.21.15.6:0/3574524900 learned_addr learned my addr 172.21.15.6:0/3574524900 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.857+0000 7fdf3affd640 1 --2- 172.21.15.6:0/3574524900 >> v2:172.21.15.171:3300/0 conn(0x7fdf3c15f700 0x7fdf3c15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.858+0000 7fdf3b7fe640 1 -- 172.21.15.6:0/3574524900 >> v2:172.21.15.171:3300/0 conn(0x7fdf3c15f700 msgr2=0x7fdf3c15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.858+0000 7fdf3b7fe640 1 --2- 172.21.15.6:0/3574524900 >> v2:172.21.15.171:3300/0 conn(0x7fdf3c15f700 0x7fdf3c15fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.858+0000 7fdf3b7fe640 1 -- 172.21.15.6:0/3574524900 >> v1:172.21.15.171:6789/0 conn(0x7fdf3c09a4f0 legacy=0x7fdf3c09a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.858+0000 7fdf3b7fe640 1 -- 172.21.15.6:0/3574524900 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c06b6a0 con 0x7fdf3c0af030 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.858+0000 7fdf3b7fe640 1 --2- 172.21.15.6:0/3574524900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c0af440 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0aea40 tx=0x7fdf2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7411787e81188a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.858+0000 7fdf3a7fc640 1 -- 172.21.15.6:0/3574524900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c037070 con 0x7fdf3c0af030 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf3a7fc640 1 -- 172.21.15.6:0/3574524900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c032440 con 0x7fdf3c0af030 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf3a7fc640 1 -- 172.21.15.6:0/3574524900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c032810 con 0x7fdf3c0af030 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf4207a640 1 -- 172.21.15.6:0/3574524900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 msgr2=0x7fdf3c0af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf4207a640 1 --2- 172.21.15.6:0/3574524900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c0af440 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0aea40 tx=0x7fdf2c02a270 comp rx=0 tx=0).stop 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf4207a640 1 -- 172.21.15.6:0/3574524900 shutdown_connections 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf4207a640 1 --2- 172.21.15.6:0/3574524900 >> v2:172.21.15.171:3300/0 conn(0x7fdf3c15f700 0x7fdf3c15fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf4207a640 1 --2- 172.21.15.6:0/3574524900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c0af440 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf4207a640 1 -- 172.21.15.6:0/3574524900 >> 172.21.15.6:0/3574524900 conn(0x7fdf3c0b6620 msgr2=0x7fdf3c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf4207a640 1 -- 172.21.15.6:0/3574524900 shutdown_connections 2024-05-20T17:56:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.859+0000 7fdf4207a640 1 -- 172.21.15.6:0/3574524900 wait complete. 2024-05-20T17:56:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.861+0000 7fdf4207a640 1 Processor -- start 2024-05-20T17:56:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.861+0000 7fdf4207a640 1 -- start start 2024-05-20T17:56:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf4207a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf3c09a4f0 0x7fdf3c1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf4207a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c09a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf4207a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf3c15f700 0x7fdf3c09ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf4207a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c160050 con 0x7fdf3c0af030 2024-05-20T17:56:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf4207a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c159aa0 con 0x7fdf3c15f700 2024-05-20T17:56:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf4207a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c1601d0 con 0x7fdf3c09a4f0 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c09a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c09a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39668/0 (socket says 172.21.15.6:39668) 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 -- 172.21.15.6:0/911798142 learned_addr learned my addr 172.21.15.6:0/911798142 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3b7fe640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf3c09a4f0 0x7fdf3c1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3bfff640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf3c15f700 0x7fdf3c09ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 -- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf3c09a4f0 msgr2=0x7fdf3c1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf3c09a4f0 0x7fdf3c1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 -- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf3c15f700 msgr2=0x7fdf3c09ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf3c15f700 0x7fdf3c09ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 -- 172.21.15.6:0/911798142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c153b30 con 0x7fdf3c0af030 2024-05-20T17:56:25.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3bfff640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf3c15f700 0x7fdf3c09ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:25.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3b7fe640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf3c09a4f0 0x7fdf3c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:25.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf3affd640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c09a900 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000e8a0 tx=0x7fdf3000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf23fff640 1 -- 172.21.15.6:0/911798142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30017070 con 0x7fdf3c0af030 2024-05-20T17:56:25.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf23fff640 1 -- 172.21.15.6:0/911798142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3000c940 con 0x7fdf3c0af030 2024-05-20T17:56:25.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c15d860 con 0x7fdf3c0af030 2024-05-20T17:56:25.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.863+0000 7fdf23fff640 1 -- 172.21.15.6:0/911798142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000cd30 con 0x7fdf3c0af030 2024-05-20T17:56:25.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.864+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c15de20 con 0x7fdf3c0af030 2024-05-20T17:56:25.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.864+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3c075b00 con 0x7fdf3c0af030 2024-05-20T17:56:25.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.865+0000 7fdf23fff640 1 -- 172.21.15.6:0/911798142 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf3001a070 con 0x7fdf3c0af030 2024-05-20T17:56:25.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.865+0000 7fdf23fff640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf2806be30 0x7fdf2806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:25.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.866+0000 7fdf23fff640 1 -- 172.21.15.6:0/911798142 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fdf3008b330 con 0x7fdf3c0af030 2024-05-20T17:56:25.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.866+0000 7fdf3b7fe640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf2806be30 0x7fdf2806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:25.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.866+0000 7fdf3b7fe640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf2806be30 0x7fdf2806e340 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c034000 tx=0x7fdf2c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:25.870+0000 7fdf23fff640 1 -- 172.21.15.6:0/911798142 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdf3c153b30 con 0x7fdf3c0af030 2024-05-20T17:56:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.054+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdf3c159670 con 0x7fdf3c0af030 2024-05-20T17:56:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.054+0000 7fdf23fff640 1 -- 172.21.15.6:0/911798142 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) ==== 104+0+11 (secure 0 0 0) 0x7fdf30059a20 con 0x7fdf3c0af030 2024-05-20T17:56:26.053 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:56:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf2806be30 msgr2=0x7fdf2806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf2806be30 0x7fdf2806e340 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c034000 tx=0x7fdf2c02e000 comp rx=0 tx=0).stop 2024-05-20T17:56:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 msgr2=0x7fdf3c09a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c09a900 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000e8a0 tx=0x7fdf3000ed60 comp rx=0 tx=0).stop 2024-05-20T17:56:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 shutdown_connections 2024-05-20T17:56:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf2806be30 0x7fdf2806e340 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf3c15f700 0x7fdf3c09ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf3c0af030 0x7fdf3c09a900 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 --2- 172.21.15.6:0/911798142 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf3c09a4f0 0x7fdf3c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 >> 172.21.15.6:0/911798142 conn(0x7fdf3c0b6620 msgr2=0x7fdf3c0b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 shutdown_connections 2024-05-20T17:56:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.056+0000 7fdf4207a640 1 -- 172.21.15.6:0/911798142 wait complete. 2024-05-20T17:56:26.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:56:26.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.185+0000 7fd80194c640 1 Processor -- start 2024-05-20T17:56:26.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.185+0000 7fd80194c640 1 -- start start 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.186+0000 7fd80194c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd7fc162e00 0x7fd7fc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.186+0000 7fd80194c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7fc06c8c0 con 0x7fd7fc0cfae0 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.186+0000 7fd80194c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7fc1633e0 con 0x7fd7fc0cd710 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.186+0000 7fd80194c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd7fc0d0ba0 con 0x7fd7fc162e00 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7f3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7fc0cfae0 0x7fd7fc0d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42106/0 (socket says 172.21.15.6:42106) 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7f3fff640 1 -- 172.21.15.6:0/1557986925 learned_addr learned my addr 172.21.15.6:0/1557986925 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fb7fe640 1 --2- 172.21.15.6:0/1557986925 >> v2:172.21.15.171:3300/0 conn(0x7fd7fc162e00 0x7fd7fc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283360200 0 0) 0x7fd7fc06c8c0 con 0x7fd7fc0cfae0 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7e8003520 con 0x7fd7fc0cfae0 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2285054010 0 0) 0x7fd7e8003520 con 0x7fd7fc0cfae0 2024-05-20T17:56:26.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 >> v2:172.21.15.171:3300/0 conn(0x7fd7fc162e00 msgr2=0x7fd7fc06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 --2- 172.21.15.6:0/1557986925 >> v2:172.21.15.171:3300/0 conn(0x7fd7fc162e00 0x7fd7fc06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 >> v1:172.21.15.171:6789/0 conn(0x7fd7fc0cd710 legacy=0x7fd7fc0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7fc1636c0 con 0x7fd7fc0cfae0 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fd7e4001690 con 0x7fd7fc0cfae0 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 >> v1:172.21.15.6:6789/0 conn(0x7fd7fc0cfae0 legacy=0x7fd7fc0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7e80039b0 0x7fd7e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e8004800 0x7fd7e8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80051c0 0x7fd7e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc0d0ba0 con 0x7fd7e80051c0 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e800c160 con 0x7fd7e8004800 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.187+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e800c360 con 0x7fd7e80039b0 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7fb7fe640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80051c0 0x7fd7e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7f3fff640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e8004800 0x7fd7e8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7faffd640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7e80039b0 0x7fd7e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7fb7fe640 1 -- 172.21.15.6:0/1557986925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7e80039b0 msgr2=0x7fd7e8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7fb7fe640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7e80039b0 0x7fd7e8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7fb7fe640 1 -- 172.21.15.6:0/1557986925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e8004800 msgr2=0x7fd7e8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7fb7fe640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e8004800 0x7fd7e8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7fb7fe640 1 -- 172.21.15.6:0/1557986925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e8003520 con 0x7fd7e80051c0 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.188+0000 7fd7fb7fe640 1 -- 172.21.15.6:0/1557986925 reap_dead start 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.189+0000 7fd7fb7fe640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80051c0 0x7fd7e800b9c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009fc0 tx=0x7fd7e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29cf54e12e92aa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.189+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4009c10 con 0x7fd7e80051c0 2024-05-20T17:56:26.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.189+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f4003b90 con 0x7fd7e80051c0 2024-05-20T17:56:26.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.189+0000 7fd7fa7fc640 1 -- 172.21.15.6:0/1557986925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4004020 con 0x7fd7e80051c0 2024-05-20T17:56:26.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.189+0000 7fd80194c640 1 -- 172.21.15.6:0/1557986925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80051c0 msgr2=0x7fd7e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.189+0000 7fd80194c640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80051c0 0x7fd7e800b9c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009fc0 tx=0x7fd7e8005830 comp rx=0 tx=0).stop 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.190+0000 7fd80194c640 1 -- 172.21.15.6:0/1557986925 shutdown_connections 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.190+0000 7fd80194c640 1 --2- 172.21.15.6:0/1557986925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e80051c0 0x7fd7e800b9c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.190+0000 7fd80194c640 1 -- 172.21.15.6:0/1557986925 >> 172.21.15.6:0/1557986925 conn(0x7fd7fc0b44d0 msgr2=0x7fd7fc0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.190+0000 7fd80194c640 1 -- 172.21.15.6:0/1557986925 shutdown_connections 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.190+0000 7fd80194c640 1 -- 172.21.15.6:0/1557986925 wait complete. 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.191+0000 7fd80194c640 1 Processor -- start 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.191+0000 7fd80194c640 1 -- start start 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd80194c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e80051c0 0x7fd7fc159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd80194c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7fc0b6a00 0x7fd7fc0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd80194c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7fc0b6e10 0x7fd7fc0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd80194c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc06d6b0 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd80194c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc163c80 con 0x7fd7e80051c0 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd80194c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7fc06d830 con 0x7fd7fc0b6e10 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7fc0b6a00 0x7fd7fc0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7fc0b6a00 0x7fd7fc0cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39690/0 (socket says 172.21.15.6:39690) 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 -- 172.21.15.6:0/4094482816 learned_addr learned my addr 172.21.15.6:0/4094482816 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7fb7fe640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7fc0b6e10 0x7fd7fc0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7faffd640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e80051c0 0x7fd7fc159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 -- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7fc0b6e10 msgr2=0x7fd7fc0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7fc0b6e10 0x7fd7fc0cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 -- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e80051c0 msgr2=0x7fd7fc159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e80051c0 0x7fd7fc159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 -- 172.21.15.6:0/4094482816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7fc0b5400 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7fb7fe640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7fc0b6e10 0x7fd7fc0cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7faffd640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e80051c0 0x7fd7fc159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f3fff640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7fc0b6a00 0x7fd7fc0cb0b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4004ef0 tx=0x7fd7e4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f8ff9640 1 -- 172.21.15.6:0/4094482816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400f730 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.193+0000 7fd7f8ff9640 1 -- 172.21.15.6:0/4094482816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7e4018070 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.194+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7fc1f8bf0 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.194+0000 7fd7f8ff9640 1 -- 172.21.15.6:0/4094482816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400fb30 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.194+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7fc1f91b0 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.194+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7fc075b00 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.195+0000 7fd7f8ff9640 1 -- 172.21.15.6:0/4094482816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7e400fcd0 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.196+0000 7fd7f8ff9640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7dc06be60 0x7fd7dc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.196+0000 7fd7f8ff9640 1 -- 172.21.15.6:0/4094482816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fd7e408b010 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.196+0000 7fd7faffd640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7dc06be60 0x7fd7dc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.197+0000 7fd7faffd640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7dc06be60 0x7fd7dc06e370 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc162d60 tx=0x7fd7ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.201+0000 7fd7f8ff9640 1 -- 172.21.15.6:0/4094482816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd7e40597a0 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.383+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd7fc0b8940 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.384+0000 7fd7f8ff9640 1 -- 172.21.15.6:0/4094482816 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) ==== 100+0+11 (secure 0 0 0) 0x7fd7e40590a0 con 0x7fd7fc0b6a00 2024-05-20T17:56:26.383 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:56:26.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7dc06be60 msgr2=0x7fd7dc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7dc06be60 0x7fd7dc06e370 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc162d60 tx=0x7fd7ec009040 comp rx=0 tx=0).stop 2024-05-20T17:56:26.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7fc0b6a00 msgr2=0x7fd7fc0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7fc0b6a00 0x7fd7fc0cb0b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4004ef0 tx=0x7fd7e4007430 comp rx=0 tx=0).stop 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 shutdown_connections 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7dc06be60 0x7fd7dc06e370 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7fc0b6e10 0x7fd7fc0cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7fc0b6a00 0x7fd7fc0cb0b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 --2- 172.21.15.6:0/4094482816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7e80051c0 0x7fd7fc159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 >> 172.21.15.6:0/4094482816 conn(0x7fd7fc0b44d0 msgr2=0x7fd7fc0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 shutdown_connections 2024-05-20T17:56:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.386+0000 7fd80194c640 1 -- 172.21.15.6:0/4094482816 wait complete. 2024-05-20T17:56:26.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:26.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.512+0000 7f216f73e640 1 Processor -- start 2024-05-20T17:56:26.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.513+0000 7f216f73e640 1 -- start start 2024-05-20T17:56:26.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216f73e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2168162820 0x7f21680b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216f73e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21680b3e80 0x7f216806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216f73e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f216806d910 0x7f21680d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216f73e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f216806dd20 con 0x7f216806d910 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216f73e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f21680d0630 con 0x7f2168162820 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216f73e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21680d39c0 con 0x7f21680b3e80 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216dcdb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f216806d910 0x7f21680d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216dcdb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f216806d910 0x7f21680d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39698/0 (socket says 172.21.15.6:39698) 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216dcdb640 1 -- 172.21.15.6:0/2057918755 learned_addr learned my addr 172.21.15.6:0/2057918755 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216ccd9640 1 --2- 172.21.15.6:0/2057918755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21680b3e80 0x7f216806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216d4da640 1 --2- 172.21.15.6:0/2057918755 >> v2:172.21.15.171:3300/0 conn(0x7f2168162820 0x7f21680b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216dcdb640 1 -- 172.21.15.6:0/2057918755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21680b3e80 msgr2=0x7f216806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:26.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216dcdb640 1 --2- 172.21.15.6:0/2057918755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21680b3e80 0x7f216806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216dcdb640 1 -- 172.21.15.6:0/2057918755 >> v2:172.21.15.171:3300/0 conn(0x7f2168162820 msgr2=0x7f21680b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:26.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.514+0000 7f216dcdb640 1 --2- 172.21.15.6:0/2057918755 >> v2:172.21.15.171:3300/0 conn(0x7f2168162820 0x7f21680b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.515+0000 7f216dcdb640 1 -- 172.21.15.6:0/2057918755 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21680d3ca0 con 0x7f216806d910 2024-05-20T17:56:26.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.515+0000 7f216dcdb640 1 --2- 172.21.15.6:0/2057918755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216806d910 0x7f21680d27a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f21680b7740 tx=0x7f216002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d0ca8171fe2748 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.515+0000 7f215ffff640 1 -- 172.21.15.6:0/2057918755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160036070 con 0x7f216806d910 2024-05-20T17:56:26.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.515+0000 7f215ffff640 1 -- 172.21.15.6:0/2057918755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2160031600 con 0x7f216806d910 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.515+0000 7f215ffff640 1 -- 172.21.15.6:0/2057918755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21600319d0 con 0x7f216806d910 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 -- 172.21.15.6:0/2057918755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216806d910 msgr2=0x7f21680d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 --2- 172.21.15.6:0/2057918755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216806d910 0x7f21680d27a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f21680b7740 tx=0x7f216002a6a0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 -- 172.21.15.6:0/2057918755 shutdown_connections 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 --2- 172.21.15.6:0/2057918755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216806d910 0x7f21680d27a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 --2- 172.21.15.6:0/2057918755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f21680b3e80 0x7f216806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 --2- 172.21.15.6:0/2057918755 >> v2:172.21.15.171:3300/0 conn(0x7f2168162820 0x7f21680b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 -- 172.21.15.6:0/2057918755 >> 172.21.15.6:0/2057918755 conn(0x7f21680d4bd0 msgr2=0x7f21680d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:26.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 -- 172.21.15.6:0/2057918755 shutdown_connections 2024-05-20T17:56:26.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.516+0000 7f216f73e640 1 -- 172.21.15.6:0/2057918755 wait complete. 2024-05-20T17:56:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.518+0000 7f216f73e640 1 Processor -- start 2024-05-20T17:56:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.518+0000 7f216f73e640 1 -- start start 2024-05-20T17:56:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216f73e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216806d910 0x7f21680cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216f73e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21680b3e80 0x7f216814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216f73e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2168162820 0x7f21681f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216f73e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f21680d0300 con 0x7f21680b3e80 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216f73e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f21680d4260 con 0x7f2168162820 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216f73e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21680d4780 con 0x7f216806d910 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216ccd9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21680b3e80 0x7f216814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216ccd9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21680b3e80 0x7f216814d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39702/0 (socket says 172.21.15.6:39702) 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.519+0000 7f216ccd9640 1 -- 172.21.15.6:0/2887296364 learned_addr learned my addr 172.21.15.6:0/2887296364 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216d4da640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216806d910 0x7f21680cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216dcdb640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2168162820 0x7f21681f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216ccd9640 1 -- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216806d910 msgr2=0x7f21680cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216ccd9640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216806d910 0x7f21680cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216ccd9640 1 -- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2168162820 msgr2=0x7f21681f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216ccd9640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2168162820 0x7f21681f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216ccd9640 1 -- 172.21.15.6:0/2887296364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216814de40 con 0x7f21680b3e80 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216dcdb640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2168162820 0x7f21681f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216ccd9640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21680b3e80 0x7f216814d2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f215800e8a0 tx=0x7f215800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f215dffb640 1 -- 172.21.15.6:0/2887296364 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158017070 con 0x7f21680b3e80 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f215dffb640 1 -- 172.21.15.6:0/2887296364 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215800ee90 con 0x7f21680b3e80 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216814e120 con 0x7f21680b3e80 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f215dffb640 1 -- 172.21.15.6:0/2887296364 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215800cb80 con 0x7f21680b3e80 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.520+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216814e6e0 con 0x7f21680b3e80 2024-05-20T17:56:26.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.521+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21680c8700 con 0x7f21680b3e80 2024-05-20T17:56:26.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.522+0000 7f215dffb640 1 -- 172.21.15.6:0/2887296364 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f215801a070 con 0x7f21680b3e80 2024-05-20T17:56:26.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.523+0000 7f215dffb640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214c06be60 0x7f214c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.523+0000 7f215dffb640 1 -- 172.21.15.6:0/2887296364 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f215808b0e0 con 0x7f21680b3e80 2024-05-20T17:56:26.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.523+0000 7f216d4da640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214c06be60 0x7f214c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.523+0000 7f216d4da640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214c06be60 0x7f214c06e370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2164009aa0 tx=0x7f2164009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.527+0000 7f215dffb640 1 -- 172.21.15.6:0/2887296364 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f21580592b0 con 0x7f21680b3e80 2024-05-20T17:56:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.752+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f216814dbd0 con 0x7f21680b3e80 2024-05-20T17:56:26.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.753+0000 7f215dffb640 1 -- 172.21.15.6:0/2887296364 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5182 (secure 0 0 0) 0x7f215805d5b0 con 0x7f21680b3e80 2024-05-20T17:56:26.752 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:26.752 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2318422221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2318422221},{"type":"v1","addr":"172.21.15.6:6835","nonce":2318422221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1262536376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1262536376},{"type":"v1","addr":"172.21.15.171:6836","nonce":1262536376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2875796025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2875796025},{"type":"v1","addr":"172.21.15.171:6837","nonce":2875796025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:12.150755+0000","modified":"2024-05-20T17:56:15.161874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6297":{"gid":6297,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3730828520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3730828520},{"type":"v1","addr":"172.21.15.6:6834","nonce":3730828520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6297,"qdb_cluster":[6297]},"id":4}]} 2024-05-20T17:56:26.752 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 36 2024-05-20T17:56:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214c06be60 msgr2=0x7f214c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214c06be60 0x7f214c06e370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2164009aa0 tx=0x7f2164009190 comp rx=0 tx=0).stop 2024-05-20T17:56:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21680b3e80 msgr2=0x7f216814d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21680b3e80 0x7f216814d2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f215800e8a0 tx=0x7f215800ed60 comp rx=0 tx=0).stop 2024-05-20T17:56:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 shutdown_connections 2024-05-20T17:56:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214c06be60 0x7f214c06e370 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2168162820 0x7f21681f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21680b3e80 0x7f216814d2f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 --2- 172.21.15.6:0/2887296364 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216806d910 0x7f21680cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 >> 172.21.15.6:0/2887296364 conn(0x7f21680d4bd0 msgr2=0x7f216815f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 shutdown_connections 2024-05-20T17:56:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.755+0000 7f216f73e640 1 -- 172.21.15.6:0/2887296364 wait complete. 2024-05-20T17:56:26.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:26.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.882+0000 7f4b1edaa640 1 Processor -- start 2024-05-20T17:56:26.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.882+0000 7f4b1edaa640 1 -- start start 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.883+0000 7f4b1edaa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b180b1e10 0x7f4b1815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.883+0000 7f4b1edaa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4b18070850 0x7f4b18070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.883+0000 7f4b1edaa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b180cd580 con 0x7f4b1815d530 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.883+0000 7f4b1edaa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4b180ce190 con 0x7f4b180b1e10 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.883+0000 7f4b1edaa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4b180cd860 con 0x7f4b18070850 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.883+0000 7f4b17fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b180b1e10 0x7f4b1815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.883+0000 7f4b17fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b180b1e10 0x7f4b1815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39714/0 (socket says 172.21.15.6:39714) 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.883+0000 7f4b17fff640 1 -- 172.21.15.6:0/3843047008 learned_addr learned my addr 172.21.15.6:0/3843047008 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.884+0000 7f4b1d347640 1 --2- 172.21.15.6:0/3843047008 >> v2:172.21.15.171:3300/0 conn(0x7f4b18070850 0x7f4b18070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.884+0000 7f4b17fff640 1 -- 172.21.15.6:0/3843047008 >> v2:172.21.15.171:3300/0 conn(0x7f4b18070850 msgr2=0x7f4b18070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.884+0000 7f4b17fff640 1 --2- 172.21.15.6:0/3843047008 >> v2:172.21.15.171:3300/0 conn(0x7f4b18070850 0x7f4b18070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.884+0000 7f4b17fff640 1 -- 172.21.15.6:0/3843047008 >> v1:172.21.15.171:6789/0 conn(0x7f4b1815d530 legacy=0x7f4b180b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.884+0000 7f4b17fff640 1 -- 172.21.15.6:0/3843047008 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b180cdb40 con 0x7f4b180b1e10 2024-05-20T17:56:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.884+0000 7f4b1d347640 1 --2- 172.21.15.6:0/3843047008 >> v2:172.21.15.171:3300/0 conn(0x7f4b18070850 0x7f4b18070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b17fff640 1 --2- 172.21.15.6:0/3843047008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b180b1e10 0x7f4b1815aaa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4b180b8400 tx=0x7f4b0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b0751f4ef4164e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b177fe640 1 -- 172.21.15.6:0/3843047008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04037070 con 0x7f4b180b1e10 2024-05-20T17:56:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b177fe640 1 -- 172.21.15.6:0/3843047008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b04032440 con 0x7f4b180b1e10 2024-05-20T17:56:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b177fe640 1 -- 172.21.15.6:0/3843047008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04032810 con 0x7f4b180b1e10 2024-05-20T17:56:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b1edaa640 1 -- 172.21.15.6:0/3843047008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b180b1e10 msgr2=0x7f4b1815aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/3843047008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b180b1e10 0x7f4b1815aaa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4b180b8400 tx=0x7f4b0402a230 comp rx=0 tx=0).stop 2024-05-20T17:56:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b1edaa640 1 -- 172.21.15.6:0/3843047008 shutdown_connections 2024-05-20T17:56:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/3843047008 >> v2:172.21.15.171:3300/0 conn(0x7f4b18070850 0x7f4b18070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/3843047008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b180b1e10 0x7f4b1815aaa0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.885+0000 7f4b1edaa640 1 -- 172.21.15.6:0/3843047008 >> 172.21.15.6:0/3843047008 conn(0x7f4b180d29d0 msgr2=0x7f4b180d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.886+0000 7f4b1edaa640 1 -- 172.21.15.6:0/3843047008 shutdown_connections 2024-05-20T17:56:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.886+0000 7f4b1edaa640 1 -- 172.21.15.6:0/3843047008 wait complete. 2024-05-20T17:56:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.887+0000 7f4b1edaa640 1 Processor -- start 2024-05-20T17:56:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.887+0000 7f4b1edaa640 1 -- start start 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1edaa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b18070850 0x7f4b18158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1edaa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b180b1e10 0x7f4b180b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1edaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b1815d530 0x7f4b1815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1edaa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4b180711a0 con 0x7f4b1815d530 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1edaa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4b180cd230 con 0x7f4b18070850 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1edaa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4b18071320 con 0x7f4b180b1e10 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1d347640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b1815d530 0x7f4b1815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1d347640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b1815d530 0x7f4b1815c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39726/0 (socket says 172.21.15.6:39726) 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1d347640 1 -- 172.21.15.6:0/4226015734 learned_addr learned my addr 172.21.15.6:0/4226015734 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1cb46640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b18070850 0x7f4b18158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b17fff640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b180b1e10 0x7f4b180b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1d347640 1 -- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b180b1e10 msgr2=0x7f4b180b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1d347640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b180b1e10 0x7f4b180b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1d347640 1 -- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b18070850 msgr2=0x7f4b18158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1d347640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b18070850 0x7f4b18158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.889+0000 7f4b1d347640 1 -- 172.21.15.6:0/4226015734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b18159480 con 0x7f4b1815d530 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.890+0000 7f4b1d347640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b1815d530 0x7f4b1815c4b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000cdb0 tx=0x7f4b1000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.890+0000 7f4b157fa640 1 -- 172.21.15.6:0/4226015734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10003b90 con 0x7f4b1815d530 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.890+0000 7f4b157fa640 1 -- 172.21.15.6:0/4226015734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b10003d50 con 0x7f4b1815d530 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.890+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b180cb0b0 con 0x7f4b1815d530 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.890+0000 7f4b157fa640 1 -- 172.21.15.6:0/4226015734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10004260 con 0x7f4b1815d530 2024-05-20T17:56:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.890+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b180cb670 con 0x7f4b1815d530 2024-05-20T17:56:26.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.891+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b18075b00 con 0x7f4b1815d530 2024-05-20T17:56:26.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.892+0000 7f4b157fa640 1 -- 172.21.15.6:0/4226015734 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b10004400 con 0x7f4b1815d530 2024-05-20T17:56:26.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.892+0000 7f4b157fa640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4afc06be60 0x7f4afc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:26.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.892+0000 7f4b157fa640 1 -- 172.21.15.6:0/4226015734 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f4b1008b9b0 con 0x7f4b1815d530 2024-05-20T17:56:26.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.892+0000 7f4b1cb46640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4afc06be60 0x7f4afc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.893+0000 7f4b1cb46640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4afc06be60 0x7f4afc06e370 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c006fd0 tx=0x7f4b0c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:26.897+0000 7f4b157fa640 1 -- 172.21.15.6:0/4226015734 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4b18159480 con 0x7f4b1815d530 2024-05-20T17:56:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.083+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b180d1570 con 0x7f4b1815d530 2024-05-20T17:56:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.084+0000 7f4b157fa640 1 -- 172.21.15.6:0/4226015734 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16836 (secure 0 0 0) 0x7f4b10014030 con 0x7f4b1815d530 2024-05-20T17:56:27.083 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:27.083 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":64,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:13.770370+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:10.505890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:11.122304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4afc06be60 msgr2=0x7f4afc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4afc06be60 0x7f4afc06e370 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c006fd0 tx=0x7f4b0c009060 comp rx=0 tx=0).stop 2024-05-20T17:56:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b1815d530 msgr2=0x7f4b1815c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b1815d530 0x7f4b1815c4b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000cdb0 tx=0x7f4b1000a650 comp rx=0 tx=0).stop 2024-05-20T17:56:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 shutdown_connections 2024-05-20T17:56:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4afc06be60 0x7f4afc06e370 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b1815d530 0x7f4b1815c4b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b180b1e10 0x7f4b180b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 --2- 172.21.15.6:0/4226015734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b18070850 0x7f4b18158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 >> 172.21.15.6:0/4226015734 conn(0x7f4b180d29d0 msgr2=0x7f4b180d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 shutdown_connections 2024-05-20T17:56:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.086+0000 7f4b1edaa640 1 -- 172.21.15.6:0/4226015734 wait complete. 2024-05-20T17:56:27.097 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T17:56:27.097 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.213+0000 7ff37ac56640 1 Processor -- start 2024-05-20T17:56:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.213+0000 7ff37ac56640 1 -- start start 2024-05-20T17:56:27.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.214+0000 7ff37ac56640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff37406d3d0 0x7ff37406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.214+0000 7ff37ac56640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3740b8190 0x7ff3740b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.214+0000 7ff37ac56640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37406dd20 con 0x7ff374162820 2024-05-20T17:56:27.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.214+0000 7ff37ac56640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff3740d0630 con 0x7ff3740b8190 2024-05-20T17:56:27.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.214+0000 7ff37ac56640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff3740d39c0 con 0x7ff37406d3d0 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3791f3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3740b8190 0x7ff3740b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3789f2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff374162820 0x7ff3740b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42114/0 (socket says 172.21.15.6:42114) 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3791f3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3740b8190 0x7ff3740b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39734/0 (socket says 172.21.15.6:39734) 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3789f2640 1 -- 172.21.15.6:0/457672276 learned_addr learned my addr 172.21.15.6:0/457672276 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff373fff640 1 --2- 172.21.15.6:0/457672276 >> v2:172.21.15.171:3300/0 conn(0x7ff37406d3d0 0x7ff37406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3791f3640 1 -- 172.21.15.6:0/457672276 >> v2:172.21.15.171:3300/0 conn(0x7ff37406d3d0 msgr2=0x7ff37406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3791f3640 1 --2- 172.21.15.6:0/457672276 >> v2:172.21.15.171:3300/0 conn(0x7ff37406d3d0 0x7ff37406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3791f3640 1 -- 172.21.15.6:0/457672276 >> v1:172.21.15.6:6789/0 conn(0x7ff374162820 legacy=0x7ff3740b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3791f3640 1 -- 172.21.15.6:0/457672276 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3740d3ca0 con 0x7ff3740b8190 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff3737fe640 1 -- 172.21.15.6:0/457672276 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290853693 0 0) 0x7ff364001110 con 0x7ff374162820 2024-05-20T17:56:27.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.215+0000 7ff373fff640 1 --2- 172.21.15.6:0/457672276 >> v2:172.21.15.171:3300/0 conn(0x7ff37406d3d0 0x7ff37406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:27.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.216+0000 7ff3791f3640 1 --2- 172.21.15.6:0/457672276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff3740b85a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff3740d1230 tx=0x7ff36c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56afd5a309552f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.216+0000 7ff3737fe640 1 -- 172.21.15.6:0/457672276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c007740 con 0x7ff3740b8190 2024-05-20T17:56:27.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.216+0000 7ff3737fe640 1 -- 172.21.15.6:0/457672276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36c0078e0 con 0x7ff3740b8190 2024-05-20T17:56:27.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.216+0000 7ff3737fe640 1 -- 172.21.15.6:0/457672276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c007cb0 con 0x7ff3740b8190 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.217+0000 7ff37ac56640 1 -- 172.21.15.6:0/457672276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 msgr2=0x7ff3740b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.217+0000 7ff37ac56640 1 --2- 172.21.15.6:0/457672276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff3740b85a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff3740d1230 tx=0x7ff36c02a680 comp rx=0 tx=0).stop 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.217+0000 7ff37ac56640 1 -- 172.21.15.6:0/457672276 shutdown_connections 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.217+0000 7ff37ac56640 1 --2- 172.21.15.6:0/457672276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff3740b85a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.217+0000 7ff37ac56640 1 --2- 172.21.15.6:0/457672276 >> v2:172.21.15.171:3300/0 conn(0x7ff37406d3d0 0x7ff37406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.217+0000 7ff37ac56640 1 -- 172.21.15.6:0/457672276 >> 172.21.15.6:0/457672276 conn(0x7ff3740d4bd0 msgr2=0x7ff3740d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.217+0000 7ff37ac56640 1 -- 172.21.15.6:0/457672276 shutdown_connections 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.217+0000 7ff37ac56640 1 -- 172.21.15.6:0/457672276 wait complete. 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.219+0000 7ff37ac56640 1 Processor -- start 2024-05-20T17:56:27.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.219+0000 7ff37ac56640 1 -- start start 2024-05-20T17:56:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff37ac56640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff37406d3d0 0x7ff3740c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff37ac56640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff37414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff37ac56640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff374162820 0x7ff3740b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff37ac56640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff3740d0300 con 0x7ff3740b8190 2024-05-20T17:56:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff37ac56640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff3740d4260 con 0x7ff37406d3d0 2024-05-20T17:56:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff37ac56640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff3740b4050 con 0x7ff374162820 2024-05-20T17:56:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff373fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff37414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff373fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff37414ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39740/0 (socket says 172.21.15.6:39740) 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff373fff640 1 -- 172.21.15.6:0/1645544302 learned_addr learned my addr 172.21.15.6:0/1645544302 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff3789f2640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff37406d3d0 0x7ff3740c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff3791f3640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff374162820 0x7ff3740b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff373fff640 1 -- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff374162820 msgr2=0x7ff3740b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff373fff640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff374162820 0x7ff3740b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff373fff640 1 -- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff37406d3d0 msgr2=0x7ff3740c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.220+0000 7ff373fff640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff37406d3d0 0x7ff3740c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.221+0000 7ff373fff640 1 -- 172.21.15.6:0/1645544302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3741f8650 con 0x7ff3740b8190 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.221+0000 7ff3791f3640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff374162820 0x7ff3740b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.221+0000 7ff373fff640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff37414ee50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c820 tx=0x7ff36800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.221+0000 7ff3717fa640 1 -- 172.21.15.6:0/1645544302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368015070 con 0x7ff3740b8190 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.221+0000 7ff3717fa640 1 -- 172.21.15.6:0/1645544302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff368007a30 con 0x7ff3740b8190 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.221+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3741f6530 con 0x7ff3740b8190 2024-05-20T17:56:27.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.221+0000 7ff3717fa640 1 -- 172.21.15.6:0/1645544302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368007de0 con 0x7ff3740b8190 2024-05-20T17:56:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.221+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3741f6af0 con 0x7ff3740b8190 2024-05-20T17:56:27.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.222+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3740bab50 con 0x7ff3740b8190 2024-05-20T17:56:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.223+0000 7ff3717fa640 1 -- 172.21.15.6:0/1645544302 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff368018070 con 0x7ff3740b8190 2024-05-20T17:56:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.223+0000 7ff3717fa640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff36006be60 0x7ff36006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.223+0000 7ff3717fa640 1 -- 172.21.15.6:0/1645544302 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7ff36808ae30 con 0x7ff3740b8190 2024-05-20T17:56:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.223+0000 7ff3789f2640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff36006be60 0x7ff36006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.224+0000 7ff3789f2640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff36006be60 0x7ff36006e370 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff364007fd0 tx=0x7ff364007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.228+0000 7ff3717fa640 1 -- 172.21.15.6:0/1645544302 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff3740bab50 con 0x7ff3740b8190 2024-05-20T17:56:27.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.452+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff37415edd0 con 0x7ff3740b8190 2024-05-20T17:56:27.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.452+0000 7ff3717fa640 1 -- 172.21.15.6:0/1645544302 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5182 (secure 0 0 0) 0x7ff37415edd0 con 0x7ff3740b8190 2024-05-20T17:56:27.451 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:27.452 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2318422221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2318422221},{"type":"v1","addr":"172.21.15.6:6835","nonce":2318422221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1262536376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1262536376},{"type":"v1","addr":"172.21.15.171:6836","nonce":1262536376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2875796025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2875796025},{"type":"v1","addr":"172.21.15.171:6837","nonce":2875796025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:12.150755+0000","modified":"2024-05-20T17:56:15.161874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6297":{"gid":6297,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3730828520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3730828520},{"type":"v1","addr":"172.21.15.6:6834","nonce":3730828520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6297,"qdb_cluster":[6297]},"id":4}]} 2024-05-20T17:56:27.452 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 36 2024-05-20T17:56:27.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff36006be60 msgr2=0x7ff36006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff36006be60 0x7ff36006e370 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff364007fd0 tx=0x7ff364007de0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 msgr2=0x7ff37414ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff37414ee50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c820 tx=0x7ff36800cce0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 shutdown_connections 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff36006be60 0x7ff36006e370 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff374162820 0x7ff3740b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3740b8190 0x7ff37414ee50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 --2- 172.21.15.6:0/1645544302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff37406d3d0 0x7ff3740c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 >> 172.21.15.6:0/1645544302 conn(0x7ff3740d4bd0 msgr2=0x7ff3740d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.454+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 shutdown_connections 2024-05-20T17:56:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.455+0000 7ff37ac56640 1 -- 172.21.15.6:0/1645544302 wait complete. 2024-05-20T17:56:27.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.580+0000 7fbf71a8b640 1 Processor -- start 2024-05-20T17:56:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.580+0000 7fbf71a8b640 1 -- start start 2024-05-20T17:56:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.581+0000 7fbf71a8b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbf6c168050 0x7fbf6c16a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.581+0000 7fbf71a8b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf6c0d0630 con 0x7fbf6c162820 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.581+0000 7fbf71a8b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf6c0d39c0 con 0x7fbf6c06d3d0 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.581+0000 7fbf71a8b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbf6c0d3ca0 con 0x7fbf6c168050 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf6c162820 0x7fbf6c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42118/0 (socket says 172.21.15.6:42118) 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6b7fe640 1 -- 172.21.15.6:0/827923673 learned_addr learned my addr 172.21.15.6:0/827923673 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6bfff640 1 --2- 172.21.15.6:0/827923673 >> v2:172.21.15.171:3300/0 conn(0x7fbf6c168050 0x7fbf6c16a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229198752 0 0) 0x7fbf6c0d0630 con 0x7fbf6c162820 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf54003520 con 0x7fbf6c162820 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1195311878 0 0) 0x7fbf54003520 con 0x7fbf6c162820 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 >> v2:172.21.15.171:3300/0 conn(0x7fbf6c168050 msgr2=0x7fbf6c16a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 --2- 172.21.15.6:0/827923673 >> v2:172.21.15.171:3300/0 conn(0x7fbf6c168050 0x7fbf6c16a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 >> v1:172.21.15.171:6789/0 conn(0x7fbf6c06d3d0 legacy=0x7fbf6c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c0d3f80 con 0x7fbf6c162820 2024-05-20T17:56:27.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fbf5c001670 con 0x7fbf6c162820 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 >> v1:172.21.15.6:6789/0 conn(0x7fbf6c162820 legacy=0x7fbf6c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf540039b0 0x7fbf54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf54004800 0x7fbf54004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf540051c0 0x7fbf5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c0d3ca0 con 0x7fbf54004800 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5400c160 con 0x7fbf540039b0 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5400c360 con 0x7fbf540051c0 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.582+0000 7fbf6affd640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf54004800 0x7fbf54004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.583+0000 7fbf6b7fe640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf540039b0 0x7fbf54003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.583+0000 7fbf6bfff640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf540051c0 0x7fbf5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.583+0000 7fbf6affd640 1 -- 172.21.15.6:0/827923673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf540051c0 msgr2=0x7fbf5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.583+0000 7fbf6affd640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf540051c0 0x7fbf5400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.583+0000 7fbf6affd640 1 -- 172.21.15.6:0/827923673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf540039b0 msgr2=0x7fbf54003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.583+0000 7fbf6affd640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf540039b0 0x7fbf54003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.583+0000 7fbf6affd640 1 -- 172.21.15.6:0/827923673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf54003520 con 0x7fbf54004800 2024-05-20T17:56:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.583+0000 7fbf6bfff640 1 -- 172.21.15.6:0/827923673 reap_dead start 2024-05-20T17:56:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf6affd640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf54004800 0x7fbf54004c10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fbf60001750 tx=0x7fbf54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945e553f28e644f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf60001370 con 0x7fbf54004800 2024-05-20T17:56:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf600052d0 con 0x7fbf54004800 2024-05-20T17:56:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf6a7fc640 1 -- 172.21.15.6:0/827923673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6002abc0 con 0x7fbf54004800 2024-05-20T17:56:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf71a8b640 1 -- 172.21.15.6:0/827923673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf54004800 msgr2=0x7fbf54004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf71a8b640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf54004800 0x7fbf54004c10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fbf60001750 tx=0x7fbf54005830 comp rx=0 tx=0).stop 2024-05-20T17:56:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf71a8b640 1 -- 172.21.15.6:0/827923673 shutdown_connections 2024-05-20T17:56:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf71a8b640 1 --2- 172.21.15.6:0/827923673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf54004800 0x7fbf54004c10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf71a8b640 1 -- 172.21.15.6:0/827923673 >> 172.21.15.6:0/827923673 conn(0x7fbf6c0d4bd0 msgr2=0x7fbf6c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.584+0000 7fbf71a8b640 1 -- 172.21.15.6:0/827923673 shutdown_connections 2024-05-20T17:56:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.585+0000 7fbf71a8b640 1 -- 172.21.15.6:0/827923673 wait complete. 2024-05-20T17:56:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.586+0000 7fbf71a8b640 1 Processor -- start 2024-05-20T17:56:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.587+0000 7fbf71a8b640 1 -- start start 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf71a8b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf54004800 0x7fbf6c0c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf71a8b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c0c9880 0x7fbf6c0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf71a8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6c0ca1d0 0x7fbf6c1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf71a8b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c0d4780 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf71a8b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6c0d0300 con 0x7fbf6c0c9880 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf71a8b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6c0d4900 con 0x7fbf54004800 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6c0ca1d0 0x7fbf6c1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6c0ca1d0 0x7fbf6c1478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39746/0 (socket says 172.21.15.6:39746) 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6bfff640 1 -- 172.21.15.6:0/287778083 learned_addr learned my addr 172.21.15.6:0/287778083 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6b7fe640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf54004800 0x7fbf6c0c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6affd640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c0c9880 0x7fbf6c0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6bfff640 1 -- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf54004800 msgr2=0x7fbf6c0c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6bfff640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf54004800 0x7fbf6c0c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6bfff640 1 -- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c0c9880 msgr2=0x7fbf6c0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6bfff640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c0c9880 0x7fbf6c0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.588+0000 7fbf6bfff640 1 -- 172.21.15.6:0/287778083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6c0cbc60 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.589+0000 7fbf6bfff640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6c0ca1d0 0x7fbf6c1478c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c08d5e0 tx=0x7fbf6400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.589+0000 7fbf53fff640 1 -- 172.21.15.6:0/287778083 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6400fdb0 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.589+0000 7fbf53fff640 1 -- 172.21.15.6:0/287778083 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6401d070 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.589+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6c15d210 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.589+0000 7fbf53fff640 1 -- 172.21.15.6:0/287778083 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64015670 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.589+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6c146b00 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.590+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6c0cbe30 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.591+0000 7fbf53fff640 1 -- 172.21.15.6:0/287778083 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf64015810 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.591+0000 7fbf53fff640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf5806be30 0x7fbf5806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.591+0000 7fbf53fff640 1 -- 172.21.15.6:0/287778083 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fbf6408ba90 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.591+0000 7fbf6b7fe640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf5806be30 0x7fbf5806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.592+0000 7fbf6b7fe640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf5806be30 0x7fbf5806e340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c06a030 tx=0x7fbf5c0078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.596+0000 7fbf53fff640 1 -- 172.21.15.6:0/287778083 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbf64027020 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.820+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf6c075b00 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.821+0000 7fbf53fff640 1 -- 172.21.15.6:0/287778083 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5182 (secure 0 0 0) 0x7fbf64010040 con 0x7fbf6c0ca1d0 2024-05-20T17:56:27.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:27.820 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2318422221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2318422221},{"type":"v1","addr":"172.21.15.6:6835","nonce":2318422221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1262536376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1262536376},{"type":"v1","addr":"172.21.15.171:6836","nonce":1262536376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2875796025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2875796025},{"type":"v1","addr":"172.21.15.171:6837","nonce":2875796025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:12.150755+0000","modified":"2024-05-20T17:56:15.161874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6297":{"gid":6297,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3730828520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3730828520},{"type":"v1","addr":"172.21.15.6:6834","nonce":3730828520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6297,"qdb_cluster":[6297]},"id":4}]} 2024-05-20T17:56:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 36 2024-05-20T17:56:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf5806be30 msgr2=0x7fbf5806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf5806be30 0x7fbf5806e340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c06a030 tx=0x7fbf5c0078f0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6c0ca1d0 msgr2=0x7fbf6c1478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6c0ca1d0 0x7fbf6c1478c0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c08d5e0 tx=0x7fbf6400f580 comp rx=0 tx=0).stop 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 shutdown_connections 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf5806be30 0x7fbf5806e340 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6c0ca1d0 0x7fbf6c1478c0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf6c0c9880 0x7fbf6c0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 --2- 172.21.15.6:0/287778083 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf54004800 0x7fbf6c0c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.823+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 >> 172.21.15.6:0/287778083 conn(0x7fbf6c0d4bd0 msgr2=0x7fbf6c0b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.824+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 shutdown_connections 2024-05-20T17:56:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.824+0000 7fbf71a8b640 1 -- 172.21.15.6:0/287778083 wait complete. 2024-05-20T17:56:27.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.950+0000 7ff0a5826640 1 Processor -- start 2024-05-20T17:56:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.950+0000 7ff0a5826640 1 -- start start 2024-05-20T17:56:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff0a5826640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a0162820 0x7ff0a00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff0a5826640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff0a00b3e80 0x7ff0a006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff0a5826640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0a006d910 0x7ff0a00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff0a5826640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a006dd20 con 0x7ff0a006d910 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff0a5826640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a00d0630 con 0x7ff0a00b3e80 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff0a5826640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a00d39c0 con 0x7ff0a0162820 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0a006d910 0x7ff0a00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff0a006d910 0x7ff0a00d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60004/0 (socket says 172.21.15.6:60004) 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09f7fe640 1 -- 172.21.15.6:0/2275049363 learned_addr learned my addr 172.21.15.6:0/2275049363 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09effd640 1 --2- 172.21.15.6:0/2275049363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a0162820 0x7ff0a00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09e7fc640 1 --2- 172.21.15.6:0/2275049363 >> v2:172.21.15.171:3300/0 conn(0x7ff0a00b3e80 0x7ff0a006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09f7fe640 1 -- 172.21.15.6:0/2275049363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a0162820 msgr2=0x7ff0a00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09f7fe640 1 --2- 172.21.15.6:0/2275049363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a0162820 0x7ff0a00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09f7fe640 1 -- 172.21.15.6:0/2275049363 >> v2:172.21.15.171:3300/0 conn(0x7ff0a00b3e80 msgr2=0x7ff0a006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09f7fe640 1 --2- 172.21.15.6:0/2275049363 >> v2:172.21.15.171:3300/0 conn(0x7ff0a00b3e80 0x7ff0a006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.952+0000 7ff09f7fe640 1 -- 172.21.15.6:0/2275049363 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a00d3ca0 con 0x7ff0a006d910 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.953+0000 7ff09f7fe640 1 --2- 172.21.15.6:0/2275049363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a006d910 0x7ff0a00d27a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff0a008d710 tx=0x7ff09802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2b5834f0ad6f9a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.953+0000 7ff09dffb640 1 -- 172.21.15.6:0/2275049363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098037070 con 0x7ff0a006d910 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.953+0000 7ff09dffb640 1 -- 172.21.15.6:0/2275049363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098032440 con 0x7ff0a006d910 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.953+0000 7ff09dffb640 1 -- 172.21.15.6:0/2275049363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098032810 con 0x7ff0a006d910 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 -- 172.21.15.6:0/2275049363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a006d910 msgr2=0x7ff0a00d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2275049363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a006d910 0x7ff0a00d27a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff0a008d710 tx=0x7ff09802a1e0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 -- 172.21.15.6:0/2275049363 shutdown_connections 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2275049363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a006d910 0x7ff0a00d27a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2275049363 >> v2:172.21.15.171:3300/0 conn(0x7ff0a00b3e80 0x7ff0a006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2275049363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a0162820 0x7ff0a00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 -- 172.21.15.6:0/2275049363 >> 172.21.15.6:0/2275049363 conn(0x7ff0a00d4bd0 msgr2=0x7ff0a00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 -- 172.21.15.6:0/2275049363 shutdown_connections 2024-05-20T17:56:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.954+0000 7ff0a5826640 1 -- 172.21.15.6:0/2275049363 wait complete. 2024-05-20T17:56:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.956+0000 7ff0a5826640 1 Processor -- start 2024-05-20T17:56:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.956+0000 7ff0a5826640 1 -- start start 2024-05-20T17:56:27.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff0a5826640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a006d910 0x7ff0a014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff0a5826640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a00b3e80 0x7ff0a0154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff0a5826640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0162820 0x7ff0a0154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff0a5826640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a00d0300 con 0x7ff0a0162820 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff0a5826640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a00d4260 con 0x7ff0a00b3e80 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff0a5826640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a00d4780 con 0x7ff0a006d910 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff09f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0162820 0x7ff0a0154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff09f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0162820 0x7ff0a0154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60020/0 (socket says 172.21.15.6:60020) 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.957+0000 7ff09f7fe640 1 -- 172.21.15.6:0/2922178927 learned_addr learned my addr 172.21.15.6:0/2922178927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff09effd640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a006d910 0x7ff0a014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff09e7fc640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a00b3e80 0x7ff0a0154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff09f7fe640 1 -- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a006d910 msgr2=0x7ff0a014ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff09f7fe640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a006d910 0x7ff0a014ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff09f7fe640 1 -- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a00b3e80 msgr2=0x7ff0a0154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff09f7fe640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a00b3e80 0x7ff0a0154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff09f7fe640 1 -- 172.21.15.6:0/2922178927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a0153190 con 0x7ff0a0162820 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff09f7fe640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0162820 0x7ff0a0154770 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff09802a220 tx=0x7ff0980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff087fff640 1 -- 172.21.15.6:0/2922178927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098037040 con 0x7ff0a0162820 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff087fff640 1 -- 172.21.15.6:0/2922178927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098042070 con 0x7ff0a0162820 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a0153470 con 0x7ff0a0162820 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff087fff640 1 -- 172.21.15.6:0/2922178927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098030900 con 0x7ff0a0162820 2024-05-20T17:56:27.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.958+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a0153a30 con 0x7ff0a0162820 2024-05-20T17:56:27.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.959+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a0075b00 con 0x7ff0a0162820 2024-05-20T17:56:27.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.960+0000 7ff087fff640 1 -- 172.21.15.6:0/2922178927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff098030aa0 con 0x7ff0a0162820 2024-05-20T17:56:27.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.960+0000 7ff087fff640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff08c06be30 0x7ff08c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:27.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.961+0000 7ff087fff640 1 -- 172.21.15.6:0/2922178927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7ff0980ab8f0 con 0x7ff0a0162820 2024-05-20T17:56:27.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.961+0000 7ff09effd640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff08c06be30 0x7ff08c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:27.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.961+0000 7ff09effd640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff08c06be30 0x7ff08c06e340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff090003aa0 tx=0x7ff090009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:27.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:27.965+0000 7ff087fff640 1 -- 172.21.15.6:0/2922178927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff098079a30 con 0x7ff0a0162820 2024-05-20T17:56:28.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.151+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0a00b8cf0 con 0x7ff0a0162820 2024-05-20T17:56:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.153+0000 7ff087fff640 1 -- 172.21.15.6:0/2922178927 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16836 (secure 0 0 0) 0x7ff09807dd30 con 0x7ff0a0162820 2024-05-20T17:56:28.152 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:28.152 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":64,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:13.770370+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:10.505890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:11.122304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff08c06be30 msgr2=0x7ff08c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff08c06be30 0x7ff08c06e340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff090003aa0 tx=0x7ff090009830 comp rx=0 tx=0).stop 2024-05-20T17:56:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0162820 msgr2=0x7ff0a0154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0162820 0x7ff0a0154770 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff09802a220 tx=0x7ff0980046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 shutdown_connections 2024-05-20T17:56:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff08c06be30 0x7ff08c06e340 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a0162820 0x7ff0a0154770 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0a00b3e80 0x7ff0a0154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 --2- 172.21.15.6:0/2922178927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0a006d910 0x7ff0a014ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 >> 172.21.15.6:0/2922178927 conn(0x7ff0a00d4bd0 msgr2=0x7ff0a00b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 shutdown_connections 2024-05-20T17:56:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.155+0000 7ff0a5826640 1 -- 172.21.15.6:0/2922178927 wait complete. 2024-05-20T17:56:28.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T17:56:28.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.284+0000 7f6c1f1d5640 1 Processor -- start 2024-05-20T17:56:28.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.284+0000 7f6c1f1d5640 1 -- start start 2024-05-20T17:56:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c1f1d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806d3d0 0x7f6c1806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c1f1d5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6c180b8190 0x7f6c180b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c1f1d5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1806dd20 con 0x7f6c18162820 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c1f1d5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6c180d0630 con 0x7f6c180b8190 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c1f1d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180d39c0 con 0x7f6c1806d3d0 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c1cf71640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6c18162820 0x7f6c180b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34916/0 (socket says 172.21.15.6:34916) 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c1cf71640 1 -- 172.21.15.6:0/1934601147 learned_addr learned my addr 172.21.15.6:0/1934601147 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c17fff640 1 --2- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806d3d0 0x7f6c1806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c1d772640 1 --2- 172.21.15.6:0/1934601147 >> v2:172.21.15.171:3300/0 conn(0x7f6c180b8190 0x7f6c180b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.285+0000 7f6c177fe640 1 -- 172.21.15.6:0/1934601147 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742543984 0 0) 0x7f6c08001110 con 0x7f6c18162820 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.286+0000 7f6c177fe640 1 -- 172.21.15.6:0/1934601147 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c00003520 con 0x7f6c18162820 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.286+0000 7f6c1d772640 1 -- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806d3d0 msgr2=0x7f6c1806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.286+0000 7f6c1d772640 1 --2- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806d3d0 0x7f6c1806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.286+0000 7f6c1d772640 1 -- 172.21.15.6:0/1934601147 >> v1:172.21.15.6:6789/0 conn(0x7f6c18162820 legacy=0x7f6c180b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.286+0000 7f6c1d772640 1 -- 172.21.15.6:0/1934601147 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180d3ca0 con 0x7f6c180b8190 2024-05-20T17:56:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.286+0000 7f6c17fff640 1 --2- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806d3d0 0x7f6c1806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.287+0000 7f6c1d772640 1 --2- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b8190 0x7f6c180b85a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009d90 tx=0x7f6c1002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d48b31c6ac438e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.287+0000 7f6c177fe640 1 -- 172.21.15.6:0/1934601147 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10007740 con 0x7f6c180b8190 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.287+0000 7f6c177fe640 1 -- 172.21.15.6:0/1934601147 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c100078e0 con 0x7f6c180b8190 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.287+0000 7f6c177fe640 1 -- 172.21.15.6:0/1934601147 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10007c90 con 0x7f6c180b8190 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.288+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b8190 msgr2=0x7f6c180b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.288+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b8190 0x7f6c180b85a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009d90 tx=0x7f6c1002a660 comp rx=0 tx=0).stop 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.288+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1934601147 shutdown_connections 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.288+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c1806d3d0 0x7f6c1806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.288+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1934601147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c180b8190 0x7f6c180b85a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.288+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1934601147 >> 172.21.15.6:0/1934601147 conn(0x7f6c180d4bd0 msgr2=0x7f6c180d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.288+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1934601147 shutdown_connections 2024-05-20T17:56:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.288+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1934601147 wait complete. 2024-05-20T17:56:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.289+0000 7f6c1f1d5640 1 Processor -- start 2024-05-20T17:56:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.289+0000 7f6c1f1d5640 1 -- start start 2024-05-20T17:56:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1f1d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c1806d3d0 0x7f6c1815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1f1d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c180b8190 0x7f6c181f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1f1d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c18162820 0x7f6c180cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1f1d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180d0300 con 0x7f6c1806d3d0 2024-05-20T17:56:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1f1d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180d4260 con 0x7f6c18162820 2024-05-20T17:56:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1f1d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180b4050 con 0x7f6c180b8190 2024-05-20T17:56:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1cf71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c1806d3d0 0x7f6c1815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1cf71640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c1806d3d0 0x7f6c1815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60024/0 (socket says 172.21.15.6:60024) 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1cf71640 1 -- 172.21.15.6:0/1044976703 learned_addr learned my addr 172.21.15.6:0/1044976703 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c17fff640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c180b8190 0x7f6c181f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1d772640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c18162820 0x7f6c180cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1cf71640 1 -- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c180b8190 msgr2=0x7f6c181f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1cf71640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c180b8190 0x7f6c181f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1cf71640 1 -- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c18162820 msgr2=0x7f6c180cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1cf71640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c18162820 0x7f6c180cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.291+0000 7f6c1cf71640 1 -- 172.21.15.6:0/1044976703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1815c260 con 0x7f6c1806d3d0 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.292+0000 7f6c1cf71640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c1806d3d0 0x7f6c1815d020 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c3d0 tx=0x7f6c0800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.292+0000 7f6c157fa640 1 -- 172.21.15.6:0/1044976703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08017070 con 0x7f6c1806d3d0 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.292+0000 7f6c157fa640 1 -- 172.21.15.6:0/1044976703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c08005ce0 con 0x7f6c1806d3d0 2024-05-20T17:56:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.292+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1815c540 con 0x7f6c1806d3d0 2024-05-20T17:56:28.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.292+0000 7f6c157fa640 1 -- 172.21.15.6:0/1044976703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08007310 con 0x7f6c1806d3d0 2024-05-20T17:56:28.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.292+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c181f5130 con 0x7f6c1806d3d0 2024-05-20T17:56:28.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.293+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c18075b00 con 0x7f6c1806d3d0 2024-05-20T17:56:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.293+0000 7f6c157fa640 1 -- 172.21.15.6:0/1044976703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c0801a070 con 0x7f6c1806d3d0 2024-05-20T17:56:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.294+0000 7f6c157fa640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0406be30 0x7f6c0406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.294+0000 7f6c157fa640 1 -- 172.21.15.6:0/1044976703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f6c0808a2c0 con 0x7f6c1806d3d0 2024-05-20T17:56:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.294+0000 7f6c17fff640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0406be30 0x7f6c0406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.295+0000 7f6c17fff640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0406be30 0x7f6c0406e340 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6c181f8810 tx=0x7f6c0c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:28.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.299+0000 7f6c157fa640 1 -- 172.21.15.6:0/1044976703 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6c1806dd20 con 0x7f6c1806d3d0 2024-05-20T17:56:28.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.521+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6c18160170 con 0x7f6c1806d3d0 2024-05-20T17:56:28.520 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T17:56:28.522+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:56:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.523+0000 7f6c157fa640 1 -- 172.21.15.6:0/1044976703 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f6c0808a0e0 con 0x7f6c1806d3d0 2024-05-20T17:56:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T17:56:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0406be30 msgr2=0x7f6c0406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0406be30 0x7f6c0406e340 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6c181f8810 tx=0x7f6c0c009190 comp rx=0 tx=0).stop 2024-05-20T17:56:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c1806d3d0 msgr2=0x7f6c1815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c1806d3d0 0x7f6c1815d020 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c3d0 tx=0x7f6c0800c890 comp rx=0 tx=0).stop 2024-05-20T17:56:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 shutdown_connections 2024-05-20T17:56:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0406be30 0x7f6c0406e340 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c18162820 0x7f6c180cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c180b8190 0x7f6c181f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 --2- 172.21.15.6:0/1044976703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c1806d3d0 0x7f6c1815d020 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 >> 172.21.15.6:0/1044976703 conn(0x7f6c180d4bd0 msgr2=0x7f6c180ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 shutdown_connections 2024-05-20T17:56:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.526+0000 7f6c1f1d5640 1 -- 172.21.15.6:0/1044976703 wait complete. 2024-05-20T17:56:28.526 INFO:tasks.ceph.mds.c.smithi006.stderr: -2050> 2024-05-20T17:56:18.742+0000 7f880626f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:56:28.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T17:56:28.581 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:56:28.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.657+0000 7f6d85965640 1 Processor -- start 2024-05-20T17:56:28.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.658+0000 7f6d85965640 1 -- start start 2024-05-20T17:56:28.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d85965640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d80163a10 0x7f6d800d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d85965640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d800d0370 con 0x7f6d800d14b0 2024-05-20T17:56:28.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d85965640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d800d0650 con 0x7f6d800b4010 2024-05-20T17:56:28.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d85965640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6d800d3ca0 con 0x7f6d80163a10 2024-05-20T17:56:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d7effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d80163a10 0x7f6d800d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d7f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6d800d14b0 0x7f6d800d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34930/0 (socket says 172.21.15.6:34930) 2024-05-20T17:56:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d7effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d80163a10 0x7f6d800d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60036/0 (socket says 172.21.15.6:60036) 2024-05-20T17:56:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d7f7fe640 1 -- 172.21.15.6:0/2364640299 learned_addr learned my addr 172.21.15.6:0/2364640299 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d7effd640 1 -- 172.21.15.6:0/2364640299 >> v1:172.21.15.171:6789/0 conn(0x7f6d800b4010 legacy=0x7f6d800cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d7effd640 1 -- 172.21.15.6:0/2364640299 >> v1:172.21.15.6:6789/0 conn(0x7f6d800d14b0 legacy=0x7f6d800d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d7effd640 1 -- 172.21.15.6:0/2364640299 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d800d3650 con 0x7f6d80163a10 2024-05-20T17:56:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.659+0000 7f6d7dffb640 1 -- 172.21.15.6:0/2364640299 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134577388 0 0) 0x7f6d800d0370 con 0x7f6d800d14b0 2024-05-20T17:56:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.660+0000 7f6d7effd640 1 --2- 172.21.15.6:0/2364640299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d80163a10 0x7f6d800d4130 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6d700097a0 tx=0x7f6d7002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb7996c8096a709 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.660+0000 7f6d7dffb640 1 -- 172.21.15.6:0/2364640299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70037070 con 0x7f6d80163a10 2024-05-20T17:56:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.660+0000 7f6d7dffb640 1 -- 172.21.15.6:0/2364640299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d70032440 con 0x7f6d80163a10 2024-05-20T17:56:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.660+0000 7f6d7dffb640 1 -- 172.21.15.6:0/2364640299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70032810 con 0x7f6d80163a10 2024-05-20T17:56:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.661+0000 7f6d85965640 1 -- 172.21.15.6:0/2364640299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d80163a10 msgr2=0x7f6d800d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.661+0000 7f6d85965640 1 --2- 172.21.15.6:0/2364640299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d80163a10 0x7f6d800d4130 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6d700097a0 tx=0x7f6d7002a230 comp rx=0 tx=0).stop 2024-05-20T17:56:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.661+0000 7f6d85965640 1 -- 172.21.15.6:0/2364640299 shutdown_connections 2024-05-20T17:56:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.661+0000 7f6d85965640 1 --2- 172.21.15.6:0/2364640299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d80163a10 0x7f6d800d4130 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.661+0000 7f6d85965640 1 -- 172.21.15.6:0/2364640299 >> 172.21.15.6:0/2364640299 conn(0x7f6d8006d240 msgr2=0x7f6d8006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.661+0000 7f6d85965640 1 -- 172.21.15.6:0/2364640299 shutdown_connections 2024-05-20T17:56:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.661+0000 7f6d85965640 1 -- 172.21.15.6:0/2364640299 wait complete. 2024-05-20T17:56:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.663+0000 7f6d85965640 1 Processor -- start 2024-05-20T17:56:28.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.663+0000 7f6d85965640 1 -- start start 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.664+0000 7f6d85965640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800b4010 0x7f6d80154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.664+0000 7f6d85965640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d800d14b0 0x7f6d800cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.664+0000 7f6d85965640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d80163a10 0x7f6d8015f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.664+0000 7f6d85965640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6d800b8390 con 0x7f6d800b4010 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.664+0000 7f6d85965640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6d800b8210 con 0x7f6d800d14b0 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.664+0000 7f6d85965640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6d800b8510 con 0x7f6d80163a10 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800b4010 0x7f6d80154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800b4010 0x7f6d80154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60052/0 (socket says 172.21.15.6:60052) 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 -- 172.21.15.6:0/524079301 learned_addr learned my addr 172.21.15.6:0/524079301 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7f7fe640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d80163a10 0x7f6d8015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7e7fc640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d800d14b0 0x7f6d800cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 -- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d80163a10 msgr2=0x7f6d8015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d80163a10 0x7f6d8015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 -- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d800d14b0 msgr2=0x7f6d800cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d800d14b0 0x7f6d800cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 -- 172.21.15.6:0/524079301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d801e8fe0 con 0x7f6d800b4010 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7f7fe640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d80163a10 0x7f6d8015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7e7fc640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d800d14b0 0x7f6d800cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d7effd640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800b4010 0x7f6d80154970 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6d70035040 tx=0x7f6d700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d67fff640 1 -- 172.21.15.6:0/524079301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70037050 con 0x7f6d800b4010 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d67fff640 1 -- 172.21.15.6:0/524079301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d70038040 con 0x7f6d800b4010 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d801e92c0 con 0x7f6d800b4010 2024-05-20T17:56:28.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d67fff640 1 -- 172.21.15.6:0/524079301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70004490 con 0x7f6d800b4010 2024-05-20T17:56:28.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.665+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d801e9880 con 0x7f6d800b4010 2024-05-20T17:56:28.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.666+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d80075b00 con 0x7f6d800b4010 2024-05-20T17:56:28.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.667+0000 7f6d67fff640 1 -- 172.21.15.6:0/524079301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d70030900 con 0x7f6d800b4010 2024-05-20T17:56:28.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.667+0000 7f6d67fff640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d6c06be60 0x7f6d6c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:28.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.668+0000 7f6d67fff640 1 -- 172.21.15.6:0/524079301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6187+0+0 (secure 0 0 0) 0x7f6d700abac0 con 0x7f6d800b4010 2024-05-20T17:56:28.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.668+0000 7f6d7e7fc640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d6c06be60 0x7f6d6c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:28.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.668+0000 7f6d7e7fc640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d6c06be60 0x7f6d6c06e370 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6d80153e50 tx=0x7f6d74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:28.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.672+0000 7f6d67fff640 1 -- 172.21.15.6:0/524079301 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6d7007a290 con 0x7f6d800b4010 2024-05-20T17:56:28.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:28.896+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6d800d3050 con 0x7f6d800b4010 2024-05-20T17:56:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.525+0000 7f6d67fff640 1 -- 172.21.15.6:0/524079301 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f6d70079b90 con 0x7f6d800b4010 2024-05-20T17:56:29.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d6c06be60 msgr2=0x7f6d6c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d6c06be60 0x7f6d6c06e370 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6d80153e50 tx=0x7f6d74009040 comp rx=0 tx=0).stop 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800b4010 msgr2=0x7f6d80154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800b4010 0x7f6d80154970 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6d70035040 tx=0x7f6d700046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 shutdown_connections 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d6c06be60 0x7f6d6c06e370 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d80163a10 0x7f6d8015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d800d14b0 0x7f6d800cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 --2- 172.21.15.6:0/524079301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d800b4010 0x7f6d80154970 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 >> 172.21.15.6:0/524079301 conn(0x7f6d8006d240 msgr2=0x7f6d800cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 shutdown_connections 2024-05-20T17:56:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.527+0000 7f6d85965640 1 -- 172.21.15.6:0/524079301 wait complete. 2024-05-20T17:56:29.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T17:56:29.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.664+0000 7f2bd7291640 1 Processor -- start 2024-05-20T17:56:29.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.665+0000 7f2bd7291640 1 -- start start 2024-05-20T17:56:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd7291640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bd00d45f0 0x7f2bd006d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd7291640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd00d0450 con 0x7f2bd008bd20 2024-05-20T17:56:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd7291640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd00d3b10 con 0x7f2bd00b3860 2024-05-20T17:56:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd7291640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd00d3df0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd482c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bd00d45f0 0x7f2bd006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd482c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bd00d45f0 0x7f2bd006d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60068/0 (socket says 172.21.15.6:60068) 2024-05-20T17:56:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd582e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2bd008bd20 0x7f2bd008c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34940/0 (socket says 172.21.15.6:34940) 2024-05-20T17:56:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd482c640 1 -- 172.21.15.6:0/1550123291 learned_addr learned my addr 172.21.15.6:0/1550123291 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd482c640 1 -- 172.21.15.6:0/1550123291 >> v1:172.21.15.171:6789/0 conn(0x7f2bd00b3860 legacy=0x7f2bd015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd482c640 1 -- 172.21.15.6:0/1550123291 >> v1:172.21.15.6:6789/0 conn(0x7f2bd008bd20 legacy=0x7f2bd008c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bd482c640 1 -- 172.21.15.6:0/1550123291 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd00d40d0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.666+0000 7f2bcffff640 1 -- 172.21.15.6:0/1550123291 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093930266 0 0) 0x7f2bd00d0450 con 0x7f2bd008bd20 2024-05-20T17:56:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.667+0000 7f2bd482c640 1 --2- 172.21.15.6:0/1550123291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd006d870 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009870 tx=0x7f2bc402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc6f36aa0127d1a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.667+0000 7f2bcffff640 1 -- 172.21.15.6:0/1550123291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4037070 con 0x7f2bd00d45f0 2024-05-20T17:56:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.667+0000 7f2bcffff640 1 -- 172.21.15.6:0/1550123291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc4032440 con 0x7f2bd00d45f0 2024-05-20T17:56:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.667+0000 7f2bcffff640 1 -- 172.21.15.6:0/1550123291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4032810 con 0x7f2bd00d45f0 2024-05-20T17:56:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.668+0000 7f2bd7291640 1 -- 172.21.15.6:0/1550123291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 msgr2=0x7f2bd006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.668+0000 7f2bd7291640 1 --2- 172.21.15.6:0/1550123291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd006d870 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009870 tx=0x7f2bc402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.668+0000 7f2bd7291640 1 -- 172.21.15.6:0/1550123291 shutdown_connections 2024-05-20T17:56:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.668+0000 7f2bd7291640 1 --2- 172.21.15.6:0/1550123291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd006d870 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.668+0000 7f2bd7291640 1 -- 172.21.15.6:0/1550123291 >> 172.21.15.6:0/1550123291 conn(0x7f2bd00b6d10 msgr2=0x7f2bd006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.668+0000 7f2bd7291640 1 -- 172.21.15.6:0/1550123291 shutdown_connections 2024-05-20T17:56:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.668+0000 7f2bd7291640 1 -- 172.21.15.6:0/1550123291 wait complete. 2024-05-20T17:56:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.670+0000 7f2bd7291640 1 Processor -- start 2024-05-20T17:56:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.670+0000 7f2bd7291640 1 -- start start 2024-05-20T17:56:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd7291640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd008bd20 0x7f2bd0158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd7291640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bd00b3860 0x7f2bd00ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd7291640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd0144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd7291640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd016a0f0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd7291640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd0169f70 con 0x7f2bd008bd20 2024-05-20T17:56:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd7291640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd016a270 con 0x7f2bd00b3860 2024-05-20T17:56:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd582e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd0144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd582e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd0144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60074/0 (socket says 172.21.15.6:60074) 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.671+0000 7f2bd582e640 1 -- 172.21.15.6:0/2538383727 learned_addr learned my addr 172.21.15.6:0/2538383727 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd482c640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bd00b3860 0x7f2bd00ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd502d640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd008bd20 0x7f2bd0158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd582e640 1 -- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bd00b3860 msgr2=0x7f2bd00ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd582e640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bd00b3860 0x7f2bd00ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd582e640 1 -- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd008bd20 msgr2=0x7f2bd0158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd582e640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd008bd20 0x7f2bd0158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd582e640 1 -- 172.21.15.6:0/2538383727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd0143150 con 0x7f2bd00d45f0 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd582e640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd0144ec0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800c410 tx=0x7f2bc800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bcdffb640 1 -- 172.21.15.6:0/2538383727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80074e0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bcdffb640 1 -- 172.21.15.6:0/2538383727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc80047e0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bcdffb640 1 -- 172.21.15.6:0/2538383727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8004bd0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd0143430 con 0x7f2bd00d45f0 2024-05-20T17:56:29.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.672+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd01439f0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.674+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd0142ec0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.674+0000 7f2bcdffb640 1 -- 172.21.15.6:0/2538383727 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bc8011070 con 0x7f2bd00d45f0 2024-05-20T17:56:29.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.675+0000 7f2bcdffb640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bbc06be60 0x7f2bbc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:29.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.675+0000 7f2bcdffb640 1 -- 172.21.15.6:0/2538383727 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6187+0+0 (secure 0 0 0) 0x7f2bc808ac90 con 0x7f2bd00d45f0 2024-05-20T17:56:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.675+0000 7f2bd502d640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bbc06be60 0x7f2bbc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.675+0000 7f2bd502d640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bbc06be60 0x7f2bbc06e370 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00012e0 tx=0x7f2bc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.679+0000 7f2bcdffb640 1 -- 172.21.15.6:0/2538383727 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2bc801a2b0 con 0x7f2bd00d45f0 2024-05-20T17:56:29.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:29.862+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2bd00690b0 con 0x7f2bd00d45f0 2024-05-20T17:56:30.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.845+0000 7f2bcdffb640 1 -- 172.21.15.6:0/2538383727 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) ==== 181+0+0 (secure 0 0 0) 0x7f2bc80593d0 con 0x7f2bd00d45f0 2024-05-20T17:56:30.844 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T17:56:30.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bbc06be60 msgr2=0x7f2bbc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:30.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bbc06be60 0x7f2bbc06e370 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00012e0 tx=0x7f2bc0009040 comp rx=0 tx=0).stop 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 msgr2=0x7f2bd0144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd0144ec0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800c410 tx=0x7f2bc800c8d0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 shutdown_connections 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2bbc06be60 0x7f2bbc06e370 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bd00d45f0 0x7f2bd0144ec0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2bd00b3860 0x7f2bd00ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 --2- 172.21.15.6:0/2538383727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2bd008bd20 0x7f2bd0158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.849+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 >> 172.21.15.6:0/2538383727 conn(0x7f2bd00b6d10 msgr2=0x7f2bd015e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.850+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 shutdown_connections 2024-05-20T17:56:30.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.850+0000 7f2bd7291640 1 -- 172.21.15.6:0/2538383727 wait complete. 2024-05-20T17:56:30.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T17:56:30.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.989+0000 7f92b4a5a640 1 Processor -- start 2024-05-20T17:56:30.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.989+0000 7f92b4a5a640 1 -- start start 2024-05-20T17:56:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92b4a5a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92b00d2330 0x7f92b006d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92b4a5a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f92b00ce140 0x7f92b00d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92b4a5a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b00d2740 con 0x7f92b006d660 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92b4a5a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f92b009c3b0 con 0x7f92b00d2330 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92b4a5a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f92b006dda0 con 0x7f92b00ce140 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92ae59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92b00d2330 0x7f92b006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92add9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f92b006d660 0x7f92b00cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34952/0 (socket says 172.21.15.6:34952) 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92add9b640 1 -- 172.21.15.6:0/2862007724 learned_addr learned my addr 172.21.15.6:0/2862007724 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92ae59c640 1 -- 172.21.15.6:0/2862007724 >> v2:172.21.15.171:3300/0 conn(0x7f92b00ce140 msgr2=0x7f92b00d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92aed9d640 1 --2- 172.21.15.6:0/2862007724 >> v2:172.21.15.171:3300/0 conn(0x7f92b00ce140 0x7f92b00d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92ae59c640 1 --2- 172.21.15.6:0/2862007724 >> v2:172.21.15.171:3300/0 conn(0x7f92b00ce140 0x7f92b00d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92ad59a640 1 -- 172.21.15.6:0/2862007724 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1503545072 0 0) 0x7f92b00d2740 con 0x7f92b006d660 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92ae59c640 1 -- 172.21.15.6:0/2862007724 >> v1:172.21.15.6:6789/0 conn(0x7f92b006d660 legacy=0x7f92b00cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.991+0000 7f92ae59c640 1 -- 172.21.15.6:0/2862007724 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b00b81a0 con 0x7f92b00d2330 2024-05-20T17:56:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.992+0000 7f92ae59c640 1 --2- 172.21.15.6:0/2862007724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b006d120 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f92b00c98a0 tx=0x7f92a002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb15bdd0146e1166 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.992+0000 7f92ad59a640 1 -- 172.21.15.6:0/2862007724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0007740 con 0x7f92b00d2330 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.992+0000 7f92ad59a640 1 -- 172.21.15.6:0/2862007724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a00078e0 con 0x7f92b00d2330 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.992+0000 7f92ad59a640 1 -- 172.21.15.6:0/2862007724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0007cb0 con 0x7f92b00d2330 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.993+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2862007724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 msgr2=0x7f92b006d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.993+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2862007724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b006d120 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f92b00c98a0 tx=0x7f92a002a6c0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.993+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2862007724 shutdown_connections 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.993+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2862007724 >> v2:172.21.15.171:3300/0 conn(0x7f92b00ce140 0x7f92b00d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.993+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2862007724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b006d120 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.993+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2862007724 >> 172.21.15.6:0/2862007724 conn(0x7f92b00cf450 msgr2=0x7f92b00cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.993+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2862007724 shutdown_connections 2024-05-20T17:56:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.993+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2862007724 wait complete. 2024-05-20T17:56:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.995+0000 7f92b4a5a640 1 Processor -- start 2024-05-20T17:56:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.995+0000 7f92b4a5a640 1 -- start start 2024-05-20T17:56:30.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.996+0000 7f92b4a5a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b006d660 0x7f92b01e8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.996+0000 7f92b4a5a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b00ce140 0x7f92b015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.996+0000 7f92b4a5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b01f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.996+0000 7f92b4a5a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f92b00d3800 con 0x7f92b00d2330 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.996+0000 7f92b4a5a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92b006da70 con 0x7f92b00ce140 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.996+0000 7f92b4a5a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92b00d3980 con 0x7f92b006d660 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b01f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b01f86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60092/0 (socket says 172.21.15.6:60092) 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 -- 172.21.15.6:0/2081917482 learned_addr learned my addr 172.21.15.6:0/2081917482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92ae59c640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b006d660 0x7f92b01e8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92add9b640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b00ce140 0x7f92b015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 -- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b006d660 msgr2=0x7f92b01e8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b006d660 0x7f92b01e8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 -- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b00ce140 msgr2=0x7f92b015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b00ce140 0x7f92b015ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 -- 172.21.15.6:0/2081917482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b01e9dc0 con 0x7f92b00d2330 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92add9b640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b00ce140 0x7f92b015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92ae59c640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b006d660 0x7f92b01e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92aed9d640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b01f86e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f92a800c580 tx=0x7f92a800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f929effd640 1 -- 172.21.15.6:0/2081917482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8015070 con 0x7f92b00d2330 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f929effd640 1 -- 172.21.15.6:0/2081917482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a8004220 con 0x7f92b00d2330 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b01e9800 con 0x7f92b00d2330 2024-05-20T17:56:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f929effd640 1 -- 172.21.15.6:0/2081917482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8003610 con 0x7f92b00d2330 2024-05-20T17:56:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.997+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b00cab70 con 0x7f92b00d2330 2024-05-20T17:56:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.998+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b00690b0 con 0x7f92b00d2330 2024-05-20T17:56:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.999+0000 7f929effd640 1 -- 172.21.15.6:0/2081917482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92a80037b0 con 0x7f92b00d2330 2024-05-20T17:56:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:30.999+0000 7f929effd640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f929006be60 0x7f929006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.000+0000 7f929effd640 1 -- 172.21.15.6:0/2081917482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5749+0+0 (secure 0 0 0) 0x7f92a808ad50 con 0x7f92b00d2330 2024-05-20T17:56:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.000+0000 7f92ae59c640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f929006be60 0x7f929006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.000+0000 7f92ae59c640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f929006be60 0x7f929006e370 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f92a0034000 tx=0x7f92a0033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.004+0000 7f929effd640 1 -- 172.21.15.6:0/2081917482 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f92a80595b0 con 0x7f92b00d2330 2024-05-20T17:56:31.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.187+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f92b01e9590 con 0x7f92b00d2330 2024-05-20T17:56:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.846+0000 7f929effd640 1 -- 172.21.15.6:0/2081917482 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) ==== 169+0+0 (secure 0 0 0) 0x7f92a8058eb0 con 0x7f92b00d2330 2024-05-20T17:56:31.846 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T17:56:31.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.849+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f929006be60 msgr2=0x7f929006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.849+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f929006be60 0x7f929006e370 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f92a0034000 tx=0x7f92a0033040 comp rx=0 tx=0).stop 2024-05-20T17:56:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.849+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 msgr2=0x7f92b01f86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.849+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b01f86e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f92a800c580 tx=0x7f92a800ca40 comp rx=0 tx=0).stop 2024-05-20T17:56:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.853+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 shutdown_connections 2024-05-20T17:56:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.853+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f929006be60 0x7f929006e370 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.853+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92b00d2330 0x7f92b01f86e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.853+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92b00ce140 0x7f92b015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.853+0000 7f92b4a5a640 1 --2- 172.21.15.6:0/2081917482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92b006d660 0x7f92b01e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.853+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 >> 172.21.15.6:0/2081917482 conn(0x7f92b00cf450 msgr2=0x7f92b00716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.854+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 shutdown_connections 2024-05-20T17:56:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.854+0000 7f92b4a5a640 1 -- 172.21.15.6:0/2081917482 wait complete. 2024-05-20T17:56:31.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T17:56:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.999+0000 7f54aecd7640 1 Processor -- start 2024-05-20T17:56:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:31.999+0000 7f54aecd7640 1 -- start start 2024-05-20T17:56:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f54aecd7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54a80d1fc0 0x7f54a815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f54aecd7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a80b18f0 con 0x7f54a806d950 2024-05-20T17:56:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f54aecd7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a8160130 con 0x7f54a815bf50 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f54aecd7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f54a81609d0 con 0x7f54a80d1fc0 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f54ad274640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f54a806d950 0x7f54a80b1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34954/0 (socket says 172.21.15.6:34954) 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f54ad274640 1 -- 172.21.15.6:0/2634168277 learned_addr learned my addr 172.21.15.6:0/2634168277 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549ffff640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54a80d1fc0 0x7f54a815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995986003 0 0) 0x7f54a80b18f0 con 0x7f54a806d950 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5490003520 con 0x7f54a806d950 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3136100237 0 0) 0x7f5490003520 con 0x7f54a806d950 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54a80d1fc0 msgr2=0x7f54a815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549f7fe640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54a80d1fc0 0x7f54a815fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 >> v1:172.21.15.171:6789/0 conn(0x7f54a815bf50 legacy=0x7f54a80d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a8160410 con 0x7f54a806d950 2024-05-20T17:56:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.001+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f54a0001a10 con 0x7f54a806d950 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 >> v1:172.21.15.6:6789/0 conn(0x7f54a806d950 legacy=0x7f54a80b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f549f7fe640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54900039e0 0x7f5490003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f549f7fe640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5490004800 0x7f5490004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f549f7fe640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5490005150 0x7f549000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f54a81609d0 con 0x7f54900039e0 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f549000bf00 con 0x7f5490004800 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f549000c080 con 0x7f5490005150 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f54aca73640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54900039e0 0x7f5490003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f549ffff640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5490004800 0x7f5490004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f54ad274640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5490005150 0x7f549000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f54aca73640 1 -- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5490005150 msgr2=0x7f549000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f54aca73640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5490005150 0x7f549000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f54aca73640 1 -- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5490004800 msgr2=0x7f5490004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f54aca73640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5490004800 0x7f5490004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.002+0000 7f54aca73640 1 -- 172.21.15.6:0/2634168277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5490003520 con 0x7f54900039e0 2024-05-20T17:56:32.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.003+0000 7f54aca73640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54900039e0 0x7f5490003e10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f54a40013f0 tx=0x7f5490005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41daccca000bda8a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.003+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4039070 con 0x7f54900039e0 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.003+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a402ce10 con 0x7f54900039e0 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.003+0000 7f549f7fe640 1 -- 172.21.15.6:0/2634168277 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4001430 con 0x7f54900039e0 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.004+0000 7f54aecd7640 1 -- 172.21.15.6:0/2634168277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54900039e0 msgr2=0x7f5490003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.004+0000 7f54aecd7640 1 --2- 172.21.15.6:0/2634168277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54900039e0 0x7f5490003e10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f54a40013f0 tx=0x7f5490005830 comp rx=0 tx=0).stop 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.004+0000 7f54ad274640 1 -- 172.21.15.6:0/2634168277 reap_dead start 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.004+0000 7f54aecd7640 1 -- 172.21.15.6:0/2634168277 shutdown_connections 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.004+0000 7f54aecd7640 1 -- 172.21.15.6:0/2634168277 >> 172.21.15.6:0/2634168277 conn(0x7f54a8073770 msgr2=0x7f54a80b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.004+0000 7f54aecd7640 1 -- 172.21.15.6:0/2634168277 shutdown_connections 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.004+0000 7f54aecd7640 1 -- 172.21.15.6:0/2634168277 wait complete. 2024-05-20T17:56:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.006+0000 7f54aecd7640 1 Processor -- start 2024-05-20T17:56:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.006+0000 7f54aecd7640 1 -- start start 2024-05-20T17:56:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54aecd7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54900039e0 0x7f54a81463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54aecd7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54a809cb60 0x7f54a809d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54aecd7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a809cf70 0x7f54a809dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54aecd7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f54a80d1fc0 con 0x7f54a809cf70 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54aecd7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f54a806dd60 con 0x7f54a809cb60 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54aecd7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f54a80d2140 con 0x7f54900039e0 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54ad274640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a809cf70 0x7f54a809dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54ad274640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a809cf70 0x7f54a809dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60108/0 (socket says 172.21.15.6:60108) 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54ad274640 1 -- 172.21.15.6:0/2914827688 learned_addr learned my addr 172.21.15.6:0/2914827688 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f549ffff640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54a809cb60 0x7f54a809d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.007+0000 7f54aca73640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54900039e0 0x7f54a81463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f54ad274640 1 -- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54900039e0 msgr2=0x7f54a81463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f54ad274640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54900039e0 0x7f54a81463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f54ad274640 1 -- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54a809cb60 msgr2=0x7f54a809d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f54ad274640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54a809cb60 0x7f54a809d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f54ad274640 1 -- 172.21.15.6:0/2914827688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a81468e0 con 0x7f54a809cf70 2024-05-20T17:56:32.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f54ad274640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a809cf70 0x7f54a809dec0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f54a80b1ac0 tx=0x7f54a0007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f549d7fa640 1 -- 172.21.15.6:0/2914827688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a000aba0 con 0x7f54a809cf70 2024-05-20T17:56:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f549d7fa640 1 -- 172.21.15.6:0/2914827688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a0018070 con 0x7f54a809cf70 2024-05-20T17:56:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a815d3e0 con 0x7f54a809cf70 2024-05-20T17:56:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f549d7fa640 1 -- 172.21.15.6:0/2914827688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00133f0 con 0x7f54a809cf70 2024-05-20T17:56:32.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.008+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a815d9a0 con 0x7f54a809cf70 2024-05-20T17:56:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.009+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a806c260 con 0x7f54a809cf70 2024-05-20T17:56:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.010+0000 7f549d7fa640 1 -- 172.21.15.6:0/2914827688 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54a0013590 con 0x7f54a809cf70 2024-05-20T17:56:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.010+0000 7f549d7fa640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f549406be30 0x7f549406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.010+0000 7f549d7fa640 1 -- 172.21.15.6:0/2914827688 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f54a008b340 con 0x7f54a809cf70 2024-05-20T17:56:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.011+0000 7f54aca73640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f549406be30 0x7f549406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.011+0000 7f54aca73640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f549406be30 0x7f549406e340 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f54a4036000 tx=0x7f54a4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:32.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.015+0000 7f549d7fa640 1 -- 172.21.15.6:0/2914827688 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f54a806c260 con 0x7f54a809cf70 2024-05-20T17:56:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.202+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f54a8075b00 con 0x7f54a809cf70 2024-05-20T17:56:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.205+0000 7f549d7fa640 1 -- 172.21.15.6:0/2914827688 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f54a0059dd0 con 0x7f54a809cf70 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.207+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f549406be30 msgr2=0x7f549406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.207+0000 7f54aecd7640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f549406be30 0x7f549406e340 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f54a4036000 tx=0x7f54a4009030 comp rx=0 tx=0).stop 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.207+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a809cf70 msgr2=0x7f54a809dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.207+0000 7f54aecd7640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a809cf70 0x7f54a809dec0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f54a80b1ac0 tx=0x7f54a0007b10 comp rx=0 tx=0).stop 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.208+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 shutdown_connections 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.208+0000 7f54aecd7640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f549406be30 0x7f549406e340 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.208+0000 7f54aecd7640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a809cf70 0x7f54a809dec0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.208+0000 7f54aecd7640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54a809cb60 0x7f54a809d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.208+0000 7f54aecd7640 1 --2- 172.21.15.6:0/2914827688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54900039e0 0x7f54a81463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.208+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 >> 172.21.15.6:0/2914827688 conn(0x7f54a8073770 msgr2=0x7f54a80b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.208+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 shutdown_connections 2024-05-20T17:56:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.208+0000 7f54aecd7640 1 -- 172.21.15.6:0/2914827688 wait complete. 2024-05-20T17:56:32.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size' 2024-05-20T17:56:32.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.333+0000 7f8829044640 1 Processor -- start 2024-05-20T17:56:32.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.333+0000 7f8829044640 1 -- start start 2024-05-20T17:56:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8829044640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8824162820 0x7f88240b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8829044640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88240b3e80 0x7f882406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8829044640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882406d910 0x7f88240d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8829044640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f882406dd20 con 0x7f8824162820 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8829044640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f88240d0630 con 0x7f88240b3e80 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8829044640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f88240d39c0 con 0x7f882406d910 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8822d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8824162820 0x7f88240b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8822d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8824162820 0x7f88240b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60122/0 (socket says 172.21.15.6:60122) 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8822d9d640 1 -- 172.21.15.6:0/2505030730 learned_addr learned my addr 172.21.15.6:0/2505030730 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f881a59c640 1 --2- 172.21.15.6:0/2505030730 >> v2:172.21.15.171:3300/0 conn(0x7f88240b3e80 0x7f882406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f882359e640 1 --2- 172.21.15.6:0/2505030730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882406d910 0x7f88240d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8822d9d640 1 -- 172.21.15.6:0/2505030730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882406d910 msgr2=0x7f88240d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8822d9d640 1 --2- 172.21.15.6:0/2505030730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882406d910 0x7f88240d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8822d9d640 1 -- 172.21.15.6:0/2505030730 >> v2:172.21.15.171:3300/0 conn(0x7f88240b3e80 msgr2=0x7f882406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8822d9d640 1 --2- 172.21.15.6:0/2505030730 >> v2:172.21.15.171:3300/0 conn(0x7f88240b3e80 0x7f882406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.335+0000 7f8822d9d640 1 -- 172.21.15.6:0/2505030730 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88240d3ca0 con 0x7f8824162820 2024-05-20T17:56:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.336+0000 7f8822d9d640 1 --2- 172.21.15.6:0/2505030730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8824162820 0x7f88240b3940 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f88240d1230 tx=0x7f881402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c785cbe5242b69c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.336+0000 7f882259c640 1 -- 172.21.15.6:0/2505030730 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814037070 con 0x7f8824162820 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.336+0000 7f882259c640 1 -- 172.21.15.6:0/2505030730 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8814032440 con 0x7f8824162820 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.336+0000 7f882259c640 1 -- 172.21.15.6:0/2505030730 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814032810 con 0x7f8824162820 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 -- 172.21.15.6:0/2505030730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8824162820 msgr2=0x7f88240b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 --2- 172.21.15.6:0/2505030730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8824162820 0x7f88240b3940 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f88240d1230 tx=0x7f881402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 -- 172.21.15.6:0/2505030730 shutdown_connections 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 --2- 172.21.15.6:0/2505030730 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882406d910 0x7f88240d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 --2- 172.21.15.6:0/2505030730 >> v2:172.21.15.171:3300/0 conn(0x7f88240b3e80 0x7f882406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 --2- 172.21.15.6:0/2505030730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8824162820 0x7f88240b3940 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 -- 172.21.15.6:0/2505030730 >> 172.21.15.6:0/2505030730 conn(0x7f88240d4bd0 msgr2=0x7f88240d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 -- 172.21.15.6:0/2505030730 shutdown_connections 2024-05-20T17:56:32.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.337+0000 7f8829044640 1 -- 172.21.15.6:0/2505030730 wait complete. 2024-05-20T17:56:32.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.339+0000 7f8829044640 1 Processor -- start 2024-05-20T17:56:32.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.339+0000 7f8829044640 1 -- start start 2024-05-20T17:56:32.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f8829044640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882406d910 0x7f88240cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f8829044640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88240b3e80 0x7f882414eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f8829044640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8824162820 0x7f88240b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f8829044640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f88240d0300 con 0x7f88240b3e80 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f8829044640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f88240d4260 con 0x7f882406d910 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f8829044640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f88240d4780 con 0x7f8824162820 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f881a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88240b3e80 0x7f882414eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f881a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88240b3e80 0x7f882414eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60126/0 (socket says 172.21.15.6:60126) 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.340+0000 7f881a59c640 1 -- 172.21.15.6:0/3131216169 learned_addr learned my addr 172.21.15.6:0/3131216169 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f882359e640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8824162820 0x7f88240b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f8822d9d640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882406d910 0x7f88240cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881a59c640 1 -- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8824162820 msgr2=0x7f88240b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881a59c640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8824162820 0x7f88240b9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881a59c640 1 -- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882406d910 msgr2=0x7f88240cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881a59c640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882406d910 0x7f88240cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881a59c640 1 -- 172.21.15.6:0/3131216169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88240cba10 con 0x7f88240b3e80 2024-05-20T17:56:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f882359e640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8824162820 0x7f88240b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f8822d9d640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882406d910 0x7f88240cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881a59c640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88240b3e80 0x7f882414eef0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f880c00d5f0 tx=0x7f880c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881bfff640 1 -- 172.21.15.6:0/3131216169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c0125f0 con 0x7f88240b3e80 2024-05-20T17:56:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881bfff640 1 -- 172.21.15.6:0/3131216169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880c019070 con 0x7f88240b3e80 2024-05-20T17:56:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88241f8d40 con 0x7f88240b3e80 2024-05-20T17:56:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f881bfff640 1 -- 172.21.15.6:0/3131216169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c0129d0 con 0x7f88240b3e80 2024-05-20T17:56:32.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.341+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88241f9300 con 0x7f88240b3e80 2024-05-20T17:56:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.342+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8824075b00 con 0x7f88240b3e80 2024-05-20T17:56:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.343+0000 7f881bfff640 1 -- 172.21.15.6:0/3131216169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f880c012b70 con 0x7f88240b3e80 2024-05-20T17:56:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.343+0000 7f881bfff640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880406be30 0x7f880406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.344+0000 7f881bfff640 1 -- 172.21.15.6:0/3131216169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f880c08b1f0 con 0x7f88240b3e80 2024-05-20T17:56:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.344+0000 7f8822d9d640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880406be30 0x7f880406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.344+0000 7f8822d9d640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880406be30 0x7f880406e340 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8814034000 tx=0x7f881402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:32.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.348+0000 7f881bfff640 1 -- 172.21.15.6:0/3131216169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f880c059bf0 con 0x7f88240b3e80 2024-05-20T17:56:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.608+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]} v 0) -- 0x7f882415dab0 con 0x7f88240b3e80 2024-05-20T17:56:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.856+0000 7f881bfff640 1 -- 172.21.15.6:0/3131216169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]}]=0 v205) ==== 150+0+0 (secure 0 0 0) 0x7f880c0594f0 con 0x7f88240b3e80 2024-05-20T17:56:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880406be30 msgr2=0x7f880406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880406be30 0x7f880406e340 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8814034000 tx=0x7f881402e000 comp rx=0 tx=0).stop 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88240b3e80 msgr2=0x7f882414eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88240b3e80 0x7f882414eef0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f880c00d5f0 tx=0x7f880c00dab0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 shutdown_connections 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880406be30 0x7f880406e340 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8824162820 0x7f88240b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88240b3e80 0x7f882414eef0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 --2- 172.21.15.6:0/3131216169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882406d910 0x7f88240cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.858+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 >> 172.21.15.6:0/3131216169 conn(0x7f88240d4bd0 msgr2=0x7f88240ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.859+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 shutdown_connections 2024-05-20T17:56:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.859+0000 7f8829044640 1 -- 172.21.15.6:0/3131216169 wait complete. 2024-05-20T17:56:32.869 INFO:tasks.cephfs_test_runner:test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) ... skipped 'Require FUSE client to inject client release failure' 2024-05-20T17:56:32.870 INFO:tasks.cephfs_test_runner:Starting test: test_client_max_caps (tasks.cephfs.test_client_limits.TestClientLimits) That the MDS will not let a client sit above mds_max_caps_per_client caps. 2024-05-20T17:56:32.870 INFO:tasks.cephfs_test_runner:test_client_max_caps (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T17:56:32.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.987+0000 7f6beb6eb640 1 Processor -- start 2024-05-20T17:56:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.988+0000 7f6beb6eb640 1 -- start start 2024-05-20T17:56:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6beb6eb640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6be40af030 0x7f6be40af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6beb6eb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be415f700 0x7f6be415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6beb6eb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6be409a4f0 0x7f6be409a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6beb6eb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6be406bcf0 con 0x7f6be409a4f0 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6beb6eb640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6be40af980 con 0x7f6be40af030 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6beb6eb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6be4160430 con 0x7f6be415f700 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6be9c88640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6be409a4f0 0x7f6be409a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6be9c88640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6be409a4f0 0x7f6be409a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60140/0 (socket says 172.21.15.6:60140) 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6be9c88640 1 -- 172.21.15.6:0/4238241124 learned_addr learned my addr 172.21.15.6:0/4238241124 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6be8c86640 1 --2- 172.21.15.6:0/4238241124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be415f700 0x7f6be415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6be9487640 1 --2- 172.21.15.6:0/4238241124 >> v2:172.21.15.171:3300/0 conn(0x7f6be40af030 0x7f6be40af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6be9c88640 1 -- 172.21.15.6:0/4238241124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be415f700 msgr2=0x7f6be415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6be9c88640 1 --2- 172.21.15.6:0/4238241124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be415f700 0x7f6be415fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.989+0000 7f6be9c88640 1 -- 172.21.15.6:0/4238241124 >> v2:172.21.15.171:3300/0 conn(0x7f6be40af030 msgr2=0x7f6be40af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.990+0000 7f6be9c88640 1 --2- 172.21.15.6:0/4238241124 >> v2:172.21.15.171:3300/0 conn(0x7f6be40af030 0x7f6be40af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.990+0000 7f6be9c88640 1 -- 172.21.15.6:0/4238241124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be406b6a0 con 0x7f6be409a4f0 2024-05-20T17:56:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.990+0000 7f6be9c88640 1 --2- 172.21.15.6:0/4238241124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be409a4f0 0x7f6be409a900 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6be406f310 tx=0x7f6bdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3d096b197939d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.990+0000 7f6be3fff640 1 -- 172.21.15.6:0/4238241124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc037070 con 0x7f6be409a4f0 2024-05-20T17:56:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6be3fff640 1 -- 172.21.15.6:0/4238241124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc032440 con 0x7f6be409a4f0 2024-05-20T17:56:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6be3fff640 1 -- 172.21.15.6:0/4238241124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc032810 con 0x7f6be409a4f0 2024-05-20T17:56:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 -- 172.21.15.6:0/4238241124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be409a4f0 msgr2=0x7f6be409a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/4238241124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be409a4f0 0x7f6be409a900 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6be406f310 tx=0x7f6bdc02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 -- 172.21.15.6:0/4238241124 shutdown_connections 2024-05-20T17:56:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/4238241124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be409a4f0 0x7f6be409a900 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/4238241124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be415f700 0x7f6be415fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/4238241124 >> v2:172.21.15.171:3300/0 conn(0x7f6be40af030 0x7f6be40af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 -- 172.21.15.6:0/4238241124 >> 172.21.15.6:0/4238241124 conn(0x7f6be40b6620 msgr2=0x7f6be40b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 -- 172.21.15.6:0/4238241124 shutdown_connections 2024-05-20T17:56:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.991+0000 7f6beb6eb640 1 -- 172.21.15.6:0/4238241124 wait complete. 2024-05-20T17:56:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.993+0000 7f6beb6eb640 1 Processor -- start 2024-05-20T17:56:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.993+0000 7f6beb6eb640 1 -- start start 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.994+0000 7f6beb6eb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be409a4f0 0x7f6be415df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.994+0000 7f6beb6eb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40af030 0x7f6be415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6beb6eb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be415f700 0x7f6be414bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6beb6eb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4160050 con 0x7f6be40af030 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6beb6eb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6be4159aa0 con 0x7f6be415f700 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6beb6eb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6be41601d0 con 0x7f6be409a4f0 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40af030 0x7f6be415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40af030 0x7f6be415e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60142/0 (socket says 172.21.15.6:60142) 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 -- 172.21.15.6:0/3808441587 learned_addr learned my addr 172.21.15.6:0/3808441587 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be9487640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be409a4f0 0x7f6be415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be9c88640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be415f700 0x7f6be414bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 -- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be409a4f0 msgr2=0x7f6be415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be409a4f0 0x7f6be415df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 -- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be415f700 msgr2=0x7f6be414bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be415f700 0x7f6be414bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 -- 172.21.15.6:0/3808441587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be415f210 con 0x7f6be40af030 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be9487640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be409a4f0 0x7f6be415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be9c88640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be415f700 0x7f6be414bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be8c86640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40af030 0x7f6be415e6f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800e8a0 tx=0x7f6bd800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be1ffb640 1 -- 172.21.15.6:0/3808441587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8017070 con 0x7f6be40af030 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be1ffb640 1 -- 172.21.15.6:0/3808441587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd800c940 con 0x7f6be40af030 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be415d450 con 0x7f6be40af030 2024-05-20T17:56:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.995+0000 7f6be1ffb640 1 -- 172.21.15.6:0/3808441587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800cd30 con 0x7f6be40af030 2024-05-20T17:56:32.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.996+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be415da10 con 0x7f6be40af030 2024-05-20T17:56:32.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.997+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be4075b00 con 0x7f6be40af030 2024-05-20T17:56:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.997+0000 7f6be1ffb640 1 -- 172.21.15.6:0/3808441587 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bd801a070 con 0x7f6be40af030 2024-05-20T17:56:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.998+0000 7f6be1ffb640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bd006be30 0x7f6bd006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.998+0000 7f6be1ffb640 1 -- 172.21.15.6:0/3808441587 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f6bd808af40 con 0x7f6be40af030 2024-05-20T17:56:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.998+0000 7f6be9487640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bd006be30 0x7f6bd006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:32.998+0000 7f6be9487640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bd006be30 0x7f6bd006e340 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6be406e1f0 tx=0x7f6bd400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:33.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.002+0000 7f6be1ffb640 1 -- 172.21.15.6:0/3808441587 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6bd80599d0 con 0x7f6be40af030 2024-05-20T17:56:33.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.186+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6be415efa0 con 0x7f6be40af030 2024-05-20T17:56:33.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.187+0000 7f6be1ffb640 1 -- 172.21.15.6:0/3808441587 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+13244 (secure 0 0 0) 0x7f6bd80592d0 con 0x7f6be40af030 2024-05-20T17:56:33.186 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:33.186 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":67,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:31.846458+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/3730828520":"2024-05-21T17:56:28.523120+0000","172.21.15.6:6832/3730828520":"2024-05-21T17:56:28.523120+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:33.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bd006be30 msgr2=0x7f6bd006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bd006be30 0x7f6bd006e340 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6be406e1f0 tx=0x7f6bd400b040 comp rx=0 tx=0).stop 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40af030 msgr2=0x7f6be415e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40af030 0x7f6be415e6f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800e8a0 tx=0x7f6bd800ed60 comp rx=0 tx=0).stop 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 shutdown_connections 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6bd006be30 0x7f6bd006e340 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be415f700 0x7f6be414bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40af030 0x7f6be415e6f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 --2- 172.21.15.6:0/3808441587 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be409a4f0 0x7f6be415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 >> 172.21.15.6:0/3808441587 conn(0x7f6be40b6620 msgr2=0x7f6be40b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 shutdown_connections 2024-05-20T17:56:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.189+0000 7f6beb6eb640 1 -- 172.21.15.6:0/3808441587 wait complete. 2024-05-20T17:56:33.199 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:56:33.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:56:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.319+0000 7fbbd5206640 1 Processor -- start 2024-05-20T17:56:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.319+0000 7fbbd5206640 1 -- start start 2024-05-20T17:56:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbd5206640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd00b1cc0 0x7fbbd009a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbd5206640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbbd009aa30 0x7fbbd00d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbd5206640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd009ae40 con 0x7fbbd01599a0 2024-05-20T17:56:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbd5206640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbbd01607a0 con 0x7fbbd009aa30 2024-05-20T17:56:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbd5206640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd009b2d0 con 0x7fbbd00b1cc0 2024-05-20T17:56:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbced9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbbd01599a0 0x7fbbd006d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34966/0 (socket says 172.21.15.6:34966) 2024-05-20T17:56:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbced9d640 1 -- 172.21.15.6:0/4120169673 learned_addr learned my addr 172.21.15.6:0/4120169673 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbcf59e640 1 --2- 172.21.15.6:0/4120169673 >> v2:172.21.15.171:3300/0 conn(0x7fbbd009aa30 0x7fbbd00d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbce59c640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd00b1cc0 0x7fbbd009a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451626495 0 0) 0x7fbbc0001110 con 0x7fbbd01599a0 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.320+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb8003520 con 0x7fbbd01599a0 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2434309667 0 0) 0x7fbbb8003520 con 0x7fbbd01599a0 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd00b1cc0 msgr2=0x7fbbd009a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd00b1cc0 0x7fbbd009a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 >> v2:172.21.15.171:3300/0 conn(0x7fbbd009aa30 msgr2=0x7fbbd00d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 --2- 172.21.15.6:0/4120169673 >> v2:172.21.15.171:3300/0 conn(0x7fbbd009aa30 0x7fbbd00d18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd015fc20 con 0x7fbbd01599a0 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fbbc0001840 con 0x7fbbd01599a0 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 >> v1:172.21.15.6:6789/0 conn(0x7fbbd01599a0 legacy=0x7fbbd006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd00b1cc0 0x7fbbb80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbb8003f30 0x7fbbb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb8004d40 0x7fbbb8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01607a0 con 0x7fbbb8004d40 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd009b2d0 con 0x7fbbb8003f30 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb800bac0 con 0x7fbbd00b1cc0 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcf59e640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb8004d40 0x7fbbb8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbced9d640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd00b1cc0 0x7fbbb80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbce59c640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbb8003f30 0x7fbbb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcf59e640 1 -- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd00b1cc0 msgr2=0x7fbbb80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcf59e640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd00b1cc0 0x7fbbb80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcf59e640 1 -- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbb8003f30 msgr2=0x7fbbb8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcf59e640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbb8003f30 0x7fbbb8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.321+0000 7fbbcf59e640 1 -- 172.21.15.6:0/4120169673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb8003520 con 0x7fbbb8004d40 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.322+0000 7fbbcf59e640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb8004d40 0x7fbbb8005150 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00d1340 tx=0x7fbbb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9100c8bf50f66623 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.322+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8009c10 con 0x7fbbb8004d40 2024-05-20T17:56:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.322+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc8036070 con 0x7fbbb8004d40 2024-05-20T17:56:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.322+0000 7fbbcdd9b640 1 -- 172.21.15.6:0/4120169673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8031810 con 0x7fbbb8004d40 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.323+0000 7fbbd5206640 1 -- 172.21.15.6:0/4120169673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb8004d40 msgr2=0x7fbbb8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.323+0000 7fbbd5206640 1 --2- 172.21.15.6:0/4120169673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbb8004d40 0x7fbbb8005150 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00d1340 tx=0x7fbbb8005830 comp rx=0 tx=0).stop 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.323+0000 7fbbcf59e640 1 -- 172.21.15.6:0/4120169673 reap_dead start 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.323+0000 7fbbd5206640 1 -- 172.21.15.6:0/4120169673 shutdown_connections 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.323+0000 7fbbd5206640 1 -- 172.21.15.6:0/4120169673 >> 172.21.15.6:0/4120169673 conn(0x7fbbd00b6670 msgr2=0x7fbbd00b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.323+0000 7fbbd5206640 1 -- 172.21.15.6:0/4120169673 shutdown_connections 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.323+0000 7fbbd5206640 1 -- 172.21.15.6:0/4120169673 wait complete. 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.325+0000 7fbbd5206640 1 Processor -- start 2024-05-20T17:56:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.325+0000 7fbbd5206640 1 -- start start 2024-05-20T17:56:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.326+0000 7fbbd5206640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbb8004d40 0x7fbbd01514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.326+0000 7fbbd5206640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd01584a0 0x7fbbd01e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.326+0000 7fbbd5206640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd0159db0 0x7fbbd006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.326+0000 7fbbd5206640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01604c0 con 0x7fbbd01584a0 2024-05-20T17:56:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.326+0000 7fbbd5206640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01601e0 con 0x7fbbd0159db0 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.326+0000 7fbbd5206640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd015f7f0 con 0x7fbbb8004d40 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd01584a0 0x7fbbd01e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd01584a0 0x7fbbd01e8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60158/0 (socket says 172.21.15.6:60158) 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 -- 172.21.15.6:0/425429026 learned_addr learned my addr 172.21.15.6:0/425429026 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbced9d640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbb8004d40 0x7fbbd01514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbcf59e640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd0159db0 0x7fbbd006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 -- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbb8004d40 msgr2=0x7fbbd01514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbb8004d40 0x7fbbd01514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 -- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd0159db0 msgr2=0x7fbbd006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd0159db0 0x7fbbd006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 -- 172.21.15.6:0/425429026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd0153c20 con 0x7fbbd01584a0 2024-05-20T17:56:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbce59c640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd01584a0 0x7fbbd01e8c20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4011990 tx=0x7fbbc4011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbb77fe640 1 -- 172.21.15.6:0/425429026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4019070 con 0x7fbbd01584a0 2024-05-20T17:56:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbb77fe640 1 -- 172.21.15.6:0/425429026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc4004240 con 0x7fbbd01584a0 2024-05-20T17:56:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd0157400 con 0x7fbbd01584a0 2024-05-20T17:56:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbb77fe640 1 -- 172.21.15.6:0/425429026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400f800 con 0x7fbbd01584a0 2024-05-20T17:56:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.327+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd01579c0 con 0x7fbbd01584a0 2024-05-20T17:56:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.328+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd009a4f0 con 0x7fbbd01584a0 2024-05-20T17:56:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.329+0000 7fbbb77fe640 1 -- 172.21.15.6:0/425429026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbc401c070 con 0x7fbbd01584a0 2024-05-20T17:56:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.329+0000 7fbbb77fe640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbbc06be60 0x7fbbbc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.330+0000 7fbbb77fe640 1 -- 172.21.15.6:0/425429026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fbbc408aff0 con 0x7fbbd01584a0 2024-05-20T17:56:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.330+0000 7fbbced9d640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbbc06be60 0x7fbbbc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.330+0000 7fbbced9d640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbbc06be60 0x7fbbbc06e370 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0073480 tx=0x7fbbc0007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:33.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.334+0000 7fbbb77fe640 1 -- 172.21.15.6:0/425429026 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbbd009a4f0 con 0x7fbbd01584a0 2024-05-20T17:56:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.517+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbbd0075b00 con 0x7fbbd01584a0 2024-05-20T17:56:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.517+0000 7fbbb77fe640 1 -- 172.21.15.6:0/425429026 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7fbbc4059460 con 0x7fbbd01584a0 2024-05-20T17:56:33.516 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:56:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbbc06be60 msgr2=0x7fbbbc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbbc06be60 0x7fbbbc06e370 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0073480 tx=0x7fbbc0007aa0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd01584a0 msgr2=0x7fbbd01e8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd01584a0 0x7fbbd01e8c20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fbbc4011990 tx=0x7fbbc4011e50 comp rx=0 tx=0).stop 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 shutdown_connections 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbbc06be60 0x7fbbbc06e370 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd0159db0 0x7fbbd006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd01584a0 0x7fbbd01e8c20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 --2- 172.21.15.6:0/425429026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbb8004d40 0x7fbbd01514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 >> 172.21.15.6:0/425429026 conn(0x7fbbd00b6670 msgr2=0x7fbbd00700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 shutdown_connections 2024-05-20T17:56:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.519+0000 7fbbd5206640 1 -- 172.21.15.6:0/425429026 wait complete. 2024-05-20T17:56:33.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps' 2024-05-20T17:56:33.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.645+0000 7fd3b4408640 1 Processor -- start 2024-05-20T17:56:33.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.646+0000 7fd3b4408640 1 -- start start 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b4408640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd3ac0d14f0 0x7fd3ac0b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b4408640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3ac0d1ac0 con 0x7fd3ac0cf850 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b4408640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3ac0d1da0 con 0x7fd3ac0d10e0 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b4408640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd3ac0d2080 con 0x7fd3ac0d14f0 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b19a3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd3ac0cf850 0x7fd3ac0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34980/0 (socket says 172.21.15.6:34980) 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b19a3640 1 -- 172.21.15.6:0/3050398252 learned_addr learned my addr 172.21.15.6:0/3050398252 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b29a5640 1 --2- 172.21.15.6:0/3050398252 >> v2:172.21.15.171:3300/0 conn(0x7fd3ac0d14f0 0x7fd3ac0b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836450050 0 0) 0x7fd3ac0d1ac0 con 0x7fd3ac0cf850 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.647+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd394003520 con 0x7fd3ac0cf850 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 202142323 0 0) 0x7fd394003520 con 0x7fd3ac0cf850 2024-05-20T17:56:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 >> v2:172.21.15.171:3300/0 conn(0x7fd3ac0d14f0 msgr2=0x7fd3ac0b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 --2- 172.21.15.6:0/3050398252 >> v2:172.21.15.171:3300/0 conn(0x7fd3ac0d14f0 0x7fd3ac0b6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 >> v1:172.21.15.171:6789/0 conn(0x7fd3ac0d10e0 legacy=0x7fd3ac0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ac0d2360 con 0x7fd3ac0cf850 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fd3a0001670 con 0x7fd3ac0cf850 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 >> v1:172.21.15.6:6789/0 conn(0x7fd3ac0cf850 legacy=0x7fd3ac0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd394003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd394004800 0x7fd394004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3940051c0 0x7fd39400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac0d2080 con 0x7fd3940039b0 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd39400c160 con 0x7fd394004800 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd39400c360 con 0x7fd3940051c0 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b21a4640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd394003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b19a3640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd394004800 0x7fd394004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b29a5640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3940051c0 0x7fd39400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b21a4640 1 -- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3940051c0 msgr2=0x7fd39400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b21a4640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3940051c0 0x7fd39400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b21a4640 1 -- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd394004800 msgr2=0x7fd394004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b21a4640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd394004800 0x7fd394004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b29a5640 1 -- 172.21.15.6:0/3050398252 reap_dead start 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b21a4640 1 -- 172.21.15.6:0/3050398252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd394003520 con 0x7fd3940039b0 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.648+0000 7fd3b19a3640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd394004800 0x7fd394004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.649+0000 7fd3b21a4640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd394003e20 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4001750 tx=0x7fd394005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a391606cac7562b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.649+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4001370 con 0x7fd3940039b0 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.649+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a40052d0 con 0x7fd3940039b0 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.649+0000 7fd3b11a2640 1 -- 172.21.15.6:0/3050398252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a402ab00 con 0x7fd3940039b0 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.650+0000 7fd3b4408640 1 -- 172.21.15.6:0/3050398252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 msgr2=0x7fd394003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.650+0000 7fd3b4408640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd394003e20 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4001750 tx=0x7fd394005830 comp rx=0 tx=0).stop 2024-05-20T17:56:33.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.650+0000 7fd3b4408640 1 -- 172.21.15.6:0/3050398252 shutdown_connections 2024-05-20T17:56:33.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.650+0000 7fd3b4408640 1 --2- 172.21.15.6:0/3050398252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd394003e20 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.650+0000 7fd3b4408640 1 -- 172.21.15.6:0/3050398252 >> 172.21.15.6:0/3050398252 conn(0x7fd3ac0b44d0 msgr2=0x7fd3ac0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:33.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.650+0000 7fd3b4408640 1 -- 172.21.15.6:0/3050398252 shutdown_connections 2024-05-20T17:56:33.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.650+0000 7fd3b4408640 1 -- 172.21.15.6:0/3050398252 wait complete. 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.652+0000 7fd3b4408640 1 Processor -- start 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.652+0000 7fd3b4408640 1 -- start start 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b4408640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd3ac148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b4408640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3ac15b760 0x7fd3ac0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b4408640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3ac15bcb0 0x7fd3ac0cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b4408640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac0b8440 con 0x7fd3940039b0 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b4408640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac0b82c0 con 0x7fd3ac15bcb0 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b4408640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ac0709f0 con 0x7fd3ac15b760 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b21a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd3ac148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b21a4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd3ac148e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60174/0 (socket says 172.21.15.6:60174) 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b21a4640 1 -- 172.21.15.6:0/1629532486 learned_addr learned my addr 172.21.15.6:0/1629532486 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b19a3640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3ac15b760 0x7fd3ac0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b29a5640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3ac15bcb0 0x7fd3ac0cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b21a4640 1 -- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3ac15b760 msgr2=0x7fd3ac0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b21a4640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3ac15b760 0x7fd3ac0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b21a4640 1 -- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3ac15bcb0 msgr2=0x7fd3ac0cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b21a4640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3ac15bcb0 0x7fd3ac0cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.653+0000 7fd3b21a4640 1 -- 172.21.15.6:0/1629532486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ac149370 con 0x7fd3940039b0 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.654+0000 7fd3b21a4640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd3ac148e30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c00 tx=0x7fd3a4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.654+0000 7fd3aaffd640 1 -- 172.21.15.6:0/1629532486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a403f030 con 0x7fd3940039b0 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.654+0000 7fd3aaffd640 1 -- 172.21.15.6:0/1629532486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a4005480 con 0x7fd3940039b0 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.654+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3ac1498c0 con 0x7fd3940039b0 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.654+0000 7fd3aaffd640 1 -- 172.21.15.6:0/1629532486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4037040 con 0x7fd3940039b0 2024-05-20T17:56:33.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.654+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3ac149e80 con 0x7fd3940039b0 2024-05-20T17:56:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.655+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3ac075b00 con 0x7fd3940039b0 2024-05-20T17:56:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.656+0000 7fd3aaffd640 1 -- 172.21.15.6:0/1629532486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3a4042070 con 0x7fd3940039b0 2024-05-20T17:56:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.656+0000 7fd3aaffd640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd39806be30 0x7fd39806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.656+0000 7fd3aaffd640 1 -- 172.21.15.6:0/1629532486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fd3a40aa4d0 con 0x7fd3940039b0 2024-05-20T17:56:33.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.656+0000 7fd3b19a3640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd39806be30 0x7fd39806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:33.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.657+0000 7fd3b19a3640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd39806be30 0x7fd39806e340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac15c4a0 tx=0x7fd3a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:33.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.661+0000 7fd3aaffd640 1 -- 172.21.15.6:0/1629532486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd3a4078f60 con 0x7fd3940039b0 2024-05-20T17:56:33.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:33.915+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]} v 0) -- 0x7fd3ac070d20 con 0x7fd3940039b0 2024-05-20T17:56:34.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.863+0000 7fd3aaffd640 1 -- 172.21.15.6:0/1629532486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]}]=0 v207) ==== 151+0+0 (secure 0 0 0) 0x7fd3a4078860 con 0x7fd3940039b0 2024-05-20T17:56:34.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd39806be30 msgr2=0x7fd39806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd39806be30 0x7fd39806e340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac15c4a0 tx=0x7fd3a0009040 comp rx=0 tx=0).stop 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 msgr2=0x7fd3ac148e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd3ac148e30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c00 tx=0x7fd3a4001120 comp rx=0 tx=0).stop 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 shutdown_connections 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd39806be30 0x7fd39806e340 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3ac15bcb0 0x7fd3ac0cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3ac15b760 0x7fd3ac0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 --2- 172.21.15.6:0/1629532486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3940039b0 0x7fd3ac148e30 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 >> 172.21.15.6:0/1629532486 conn(0x7fd3ac0b44d0 msgr2=0x7fd3ac0b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 shutdown_connections 2024-05-20T17:56:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:34.867+0000 7fd3b4408640 1 -- 172.21.15.6:0/1629532486 wait complete. 2024-05-20T17:56:34.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T17:56:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.006+0000 7ff4cae06640 1 Processor -- start 2024-05-20T17:56:35.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.006+0000 7ff4cae06640 1 -- start start 2024-05-20T17:56:35.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4cae06640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff4c40cd710 0x7ff4c4162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4cae06640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4c40cfae0 0x7ff4c415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4cae06640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c406c8c0 con 0x7ff4c406d6b0 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4cae06640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c40d0ba0 con 0x7ff4c40cfae0 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4cae06640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c406dac0 con 0x7ff4c40cd710 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4c93a3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4c40cfae0 0x7ff4c415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4c93a3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4c40cfae0 0x7ff4c415f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60186/0 (socket says 172.21.15.6:60186) 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4c93a3640 1 -- 172.21.15.6:0/3815181677 learned_addr learned my addr 172.21.15.6:0/3815181677 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4c8ba2640 1 --2- 172.21.15.6:0/3815181677 >> v2:172.21.15.171:3300/0 conn(0x7ff4c40cd710 0x7ff4c4162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4c93a3640 1 -- 172.21.15.6:0/3815181677 >> v2:172.21.15.171:3300/0 conn(0x7ff4c40cd710 msgr2=0x7ff4c4162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4c93a3640 1 --2- 172.21.15.6:0/3815181677 >> v2:172.21.15.171:3300/0 conn(0x7ff4c40cd710 0x7ff4c4162e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4c93a3640 1 -- 172.21.15.6:0/3815181677 >> v1:172.21.15.171:6789/0 conn(0x7ff4c406d6b0 legacy=0x7ff4c40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.008+0000 7ff4c93a3640 1 -- 172.21.15.6:0/3815181677 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c41633e0 con 0x7ff4c40cfae0 2024-05-20T17:56:35.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.009+0000 7ff4c93a3640 1 --2- 172.21.15.6:0/3815181677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cfae0 0x7ff4c415f2b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff4c408baf0 tx=0x7ff4bc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426f91da4be60f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.009+0000 7ff4c37fe640 1 -- 172.21.15.6:0/3815181677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc036070 con 0x7ff4c40cfae0 2024-05-20T17:56:35.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.009+0000 7ff4c37fe640 1 -- 172.21.15.6:0/3815181677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4bc031600 con 0x7ff4c40cfae0 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.009+0000 7ff4c37fe640 1 -- 172.21.15.6:0/3815181677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0319d0 con 0x7ff4c40cfae0 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.010+0000 7ff4cae06640 1 -- 172.21.15.6:0/3815181677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cfae0 msgr2=0x7ff4c415f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.010+0000 7ff4cae06640 1 --2- 172.21.15.6:0/3815181677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cfae0 0x7ff4c415f2b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff4c408baf0 tx=0x7ff4bc02a730 comp rx=0 tx=0).stop 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.010+0000 7ff4cae06640 1 -- 172.21.15.6:0/3815181677 shutdown_connections 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.010+0000 7ff4cae06640 1 --2- 172.21.15.6:0/3815181677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cfae0 0x7ff4c415f2b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.010+0000 7ff4cae06640 1 --2- 172.21.15.6:0/3815181677 >> v2:172.21.15.171:3300/0 conn(0x7ff4c40cd710 0x7ff4c4162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.010+0000 7ff4cae06640 1 -- 172.21.15.6:0/3815181677 >> 172.21.15.6:0/3815181677 conn(0x7ff4c40b44d0 msgr2=0x7ff4c40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.010+0000 7ff4cae06640 1 -- 172.21.15.6:0/3815181677 shutdown_connections 2024-05-20T17:56:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.010+0000 7ff4cae06640 1 -- 172.21.15.6:0/3815181677 wait complete. 2024-05-20T17:56:35.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.012+0000 7ff4cae06640 1 Processor -- start 2024-05-20T17:56:35.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.012+0000 7ff4cae06640 1 -- start start 2024-05-20T17:56:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.013+0000 7ff4cae06640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4c406d6b0 0x7ff4c41612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.013+0000 7ff4cae06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cd710 0x7ff4c4161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.013+0000 7ff4cae06640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4c41606c0 0x7ff4c40c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.013+0000 7ff4cae06640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4163c80 con 0x7ff4c40cd710 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.013+0000 7ff4cae06640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c41639a0 con 0x7ff4c406d6b0 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.013+0000 7ff4cae06640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c40d1030 con 0x7ff4c41606c0 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.013+0000 7ff4c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cd710 0x7ff4c4161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cd710 0x7ff4c4161800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60190/0 (socket says 172.21.15.6:60190) 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c3fff640 1 -- 172.21.15.6:0/4183496493 learned_addr learned my addr 172.21.15.6:0/4183496493 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c93a3640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4c41606c0 0x7ff4c40c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c8ba2640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4c406d6b0 0x7ff4c41612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c3fff640 1 -- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4c41606c0 msgr2=0x7ff4c40c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c3fff640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4c41606c0 0x7ff4c40c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c3fff640 1 -- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4c406d6b0 msgr2=0x7ff4c41612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c3fff640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4c406d6b0 0x7ff4c41612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c3fff640 1 -- 172.21.15.6:0/4183496493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c41e96c0 con 0x7ff4c40cd710 2024-05-20T17:56:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c3fff640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cd710 0x7ff4c4161800 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c370 tx=0x7ff4ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c17fa640 1 -- 172.21.15.6:0/4183496493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac017070 con 0x7ff4c40cd710 2024-05-20T17:56:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c17fa640 1 -- 172.21.15.6:0/4183496493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0052d0 con 0x7ff4c40cd710 2024-05-20T17:56:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c41e99a0 con 0x7ff4c40cd710 2024-05-20T17:56:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4c17fa640 1 -- 172.21.15.6:0/4183496493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac003850 con 0x7ff4c40cd710 2024-05-20T17:56:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.014+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c40c8330 con 0x7ff4c40cd710 2024-05-20T17:56:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.015+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c4075b00 con 0x7ff4c40cd710 2024-05-20T17:56:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.016+0000 7ff4c17fa640 1 -- 172.21.15.6:0/4183496493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4ac01a070 con 0x7ff4c40cd710 2024-05-20T17:56:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.016+0000 7ff4c17fa640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4a406be30 0x7ff4a406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.017+0000 7ff4c17fa640 1 -- 172.21.15.6:0/4183496493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7ff4ac08a0b0 con 0x7ff4c40cd710 2024-05-20T17:56:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.017+0000 7ff4c8ba2640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4a406be30 0x7ff4a406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.017+0000 7ff4c8ba2640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4a406be30 0x7ff4a406e340 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006fd0 tx=0x7ff4b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.021+0000 7ff4c17fa640 1 -- 172.21.15.6:0/4183496493 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff4ac058ac0 con 0x7ff4c40cd710 2024-05-20T17:56:35.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.204+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff4c40b4c60 con 0x7ff4c40cd710 2024-05-20T17:56:35.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.208+0000 7ff4c17fa640 1 -- 172.21.15.6:0/4183496493 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7ff4ac0583c0 con 0x7ff4c40cd710 2024-05-20T17:56:35.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4a406be30 msgr2=0x7ff4a406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4a406be30 0x7ff4a406e340 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006fd0 tx=0x7ff4b4008040 comp rx=0 tx=0).stop 2024-05-20T17:56:35.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cd710 msgr2=0x7ff4c4161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cd710 0x7ff4c4161800 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c370 tx=0x7ff4ac00c830 comp rx=0 tx=0).stop 2024-05-20T17:56:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 shutdown_connections 2024-05-20T17:56:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4a406be30 0x7ff4a406e340 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4c41606c0 0x7ff4c40c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4c40cd710 0x7ff4c4161800 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 --2- 172.21.15.6:0/4183496493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4c406d6b0 0x7ff4c41612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 >> 172.21.15.6:0/4183496493 conn(0x7ff4c40b44d0 msgr2=0x7ff4c40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 shutdown_connections 2024-05-20T17:56:35.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.210+0000 7ff4cae06640 1 -- 172.21.15.6:0/4183496493 wait complete. 2024-05-20T17:56:35.220 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:56:35.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:56:35.265 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:56:35.316 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:56:35.317 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:35.317 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:35.333 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:56:35.333 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:35.333 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:35.351 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:56:35.351 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:35.351 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:35.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:56:35.389 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:35.389 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:35.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:56:35.408 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T17:56:35.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.544+0000 7f03f04f6640 1 Processor -- start 2024-05-20T17:56:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.544+0000 7f03f04f6640 1 -- start start 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.545+0000 7f03f04f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03e80d10e0 0x7f03e80cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.545+0000 7f03f04f6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d14f0 0x7f03e80cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.545+0000 7f03f04f6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e80d1ac0 con 0x7f03e80cd4d0 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.545+0000 7f03f04f6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f03e80d1da0 con 0x7f03e80d10e0 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.545+0000 7f03f04f6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f03e80d2080 con 0x7f03e80d14f0 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.545+0000 7f03ee292640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03e80d10e0 0x7f03e80cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.545+0000 7f03ee292640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03e80d10e0 0x7f03e80cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60192/0 (socket says 172.21.15.6:60192) 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.545+0000 7f03ee292640 1 -- 172.21.15.6:0/3132011418 learned_addr learned my addr 172.21.15.6:0/3132011418 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.546+0000 7f03eda91640 1 --2- 172.21.15.6:0/3132011418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d14f0 0x7f03e80cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.546+0000 7f03ee292640 1 -- 172.21.15.6:0/3132011418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d14f0 msgr2=0x7f03e80cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:35.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.546+0000 7f03ee292640 1 --2- 172.21.15.6:0/3132011418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d14f0 0x7f03e80cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.546+0000 7f03ee292640 1 -- 172.21.15.6:0/3132011418 >> v1:172.21.15.171:6789/0 conn(0x7f03e80cd4d0 legacy=0x7f03e80cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:35.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.546+0000 7f03ee292640 1 -- 172.21.15.6:0/3132011418 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e80d2360 con 0x7f03e80d10e0 2024-05-20T17:56:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.546+0000 7f03ee292640 1 --2- 172.21.15.6:0/3132011418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80d10e0 0x7f03e80cf140 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009870 tx=0x7f03e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20ee94259afdcae server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03ed290640 1 -- 172.21.15.6:0/3132011418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4037070 con 0x7f03e80d10e0 2024-05-20T17:56:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03ed290640 1 -- 172.21.15.6:0/3132011418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e4032440 con 0x7f03e80d10e0 2024-05-20T17:56:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03ed290640 1 -- 172.21.15.6:0/3132011418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4032810 con 0x7f03e80d10e0 2024-05-20T17:56:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03f04f6640 1 -- 172.21.15.6:0/3132011418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80d10e0 msgr2=0x7f03e80cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03f04f6640 1 --2- 172.21.15.6:0/3132011418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80d10e0 0x7f03e80cf140 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009870 tx=0x7f03e402a210 comp rx=0 tx=0).stop 2024-05-20T17:56:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03f04f6640 1 -- 172.21.15.6:0/3132011418 shutdown_connections 2024-05-20T17:56:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03f04f6640 1 --2- 172.21.15.6:0/3132011418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d14f0 0x7f03e80cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03f04f6640 1 --2- 172.21.15.6:0/3132011418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80d10e0 0x7f03e80cf140 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.547+0000 7f03f04f6640 1 -- 172.21.15.6:0/3132011418 >> 172.21.15.6:0/3132011418 conn(0x7f03e80b44d0 msgr2=0x7f03e80b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.548+0000 7f03f04f6640 1 -- 172.21.15.6:0/3132011418 shutdown_connections 2024-05-20T17:56:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.548+0000 7f03f04f6640 1 -- 172.21.15.6:0/3132011418 wait complete. 2024-05-20T17:56:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.549+0000 7f03f04f6640 1 Processor -- start 2024-05-20T17:56:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.549+0000 7f03f04f6640 1 -- start start 2024-05-20T17:56:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03f04f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80cd4d0 0x7f03e81f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03f04f6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d10e0 0x7f03e80c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03f04f6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03e80d14f0 0x7f03e8157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03f04f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f03e80b8440 con 0x7f03e80cd4d0 2024-05-20T17:56:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03f04f6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f03e80b82c0 con 0x7f03e80d14f0 2024-05-20T17:56:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03f04f6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f03e80709f0 con 0x7f03e80d10e0 2024-05-20T17:56:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80cd4d0 0x7f03e81f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80cd4d0 0x7f03e81f4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60198/0 (socket says 172.21.15.6:60198) 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 -- 172.21.15.6:0/4290811132 learned_addr learned my addr 172.21.15.6:0/4290811132 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03eda91640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d10e0 0x7f03e80c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 -- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d10e0 msgr2=0x7f03e80c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03eea93640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03e80d14f0 0x7f03e8157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d10e0 0x7f03e80c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 -- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03e80d14f0 msgr2=0x7f03e8157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03e80d14f0 0x7f03e8157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 -- 172.21.15.6:0/4290811132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e81f45a0 con 0x7f03e80cd4d0 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03eda91640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d10e0 0x7f03e80c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03eea93640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03e80d14f0 0x7f03e8157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.551+0000 7f03ee292640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80cd4d0 0x7f03e81f4060 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009870 tx=0x7f03e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.552+0000 7f03deffd640 1 -- 172.21.15.6:0/4290811132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4041020 con 0x7f03e80cd4d0 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.552+0000 7f03deffd640 1 -- 172.21.15.6:0/4290811132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e40306c0 con 0x7f03e80cd4d0 2024-05-20T17:56:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.552+0000 7f03deffd640 1 -- 172.21.15.6:0/4290811132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4037040 con 0x7f03e80cd4d0 2024-05-20T17:56:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.552+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e80c8ea0 con 0x7f03e80cd4d0 2024-05-20T17:56:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.552+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e815a6a0 con 0x7f03e80cd4d0 2024-05-20T17:56:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.553+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e8075b00 con 0x7f03e80cd4d0 2024-05-20T17:56:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.553+0000 7f03deffd640 1 -- 172.21.15.6:0/4290811132 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03e4044020 con 0x7f03e80cd4d0 2024-05-20T17:56:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.554+0000 7f03deffd640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03cc06be30 0x7f03cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.554+0000 7f03deffd640 1 -- 172.21.15.6:0/4290811132 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f03e40ab290 con 0x7f03e80cd4d0 2024-05-20T17:56:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.554+0000 7f03eda91640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03cc06be30 0x7f03cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.555+0000 7f03eda91640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03cc06be30 0x7f03cc06e340 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006fd0 tx=0x7f03d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.558+0000 7f03deffd640 1 -- 172.21.15.6:0/4290811132 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f03e404b070 con 0x7f03e80cd4d0 2024-05-20T17:56:35.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.778+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03e80ccef0 con 0x7f03e80cd4d0 2024-05-20T17:56:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.779+0000 7f03deffd640 1 -- 172.21.15.6:0/4290811132 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+3869 (secure 0 0 0) 0x7f03e81f45a0 con 0x7f03e80cd4d0 2024-05-20T17:56:35.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:35.778 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5498,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2318422221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2318422221},{"type":"v1","addr":"172.21.15.6:6835","nonce":2318422221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5501,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1262536376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1262536376},{"type":"v1","addr":"172.21.15.171:6836","nonce":1262536376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2875796025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2875796025},{"type":"v1","addr":"172.21.15.171:6837","nonce":2875796025}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6597,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/4046853035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4046853035},{"type":"v1","addr":"172.21.15.6:6834","nonce":4046853035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[]} 2024-05-20T17:56:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 38 2024-05-20T17:56:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03cc06be30 msgr2=0x7f03cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03cc06be30 0x7f03cc06e340 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f03d8006fd0 tx=0x7f03d8008040 comp rx=0 tx=0).stop 2024-05-20T17:56:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80cd4d0 msgr2=0x7f03e81f4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80cd4d0 0x7f03e81f4060 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009870 tx=0x7f03e40046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 shutdown_connections 2024-05-20T17:56:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03cc06be30 0x7f03cc06e340 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03e80d14f0 0x7f03e8157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03e80d10e0 0x7f03e80c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 --2- 172.21.15.6:0/4290811132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80cd4d0 0x7f03e81f4060 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 >> 172.21.15.6:0/4290811132 conn(0x7f03e80b44d0 msgr2=0x7f03e80cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 shutdown_connections 2024-05-20T17:56:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.781+0000 7f03f04f6640 1 -- 172.21.15.6:0/4290811132 wait complete. 2024-05-20T17:56:35.791 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T17:56:35.792 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T17:56:35.792 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T17:56:35.792 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:56:35.792 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T17:56:35.792 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T17:56:35.792 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T17:56:35.792 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:56:35.793 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T17:56:35.793 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T17:56:35.793 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T17:56:35.793 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:56:35.793 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T17:56:35.793 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T17:56:35.793 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T17:56:35.794 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:56:35.802 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T17:56:35.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T17:56:35.806 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T17:56:35.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T17:56:35.807 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T17:56:35.807 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T17:56:35.808 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T17:56:35.808 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T17:56:35.851 INFO:tasks.ceph.mds.a:Started 2024-05-20T17:56:35.851 DEBUG:teuthology.parallel:result is None 2024-05-20T17:56:35.852 INFO:tasks.ceph.mds.c:Started 2024-05-20T17:56:35.852 DEBUG:teuthology.parallel:result is None 2024-05-20T17:56:35.853 INFO:tasks.ceph.mds.b:Started 2024-05-20T17:56:35.853 DEBUG:teuthology.parallel:result is None 2024-05-20T17:56:35.854 INFO:tasks.ceph.mds.d:Started 2024-05-20T17:56:35.854 DEBUG:teuthology.parallel:result is None 2024-05-20T17:56:35.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T17:56:35.940 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:56:35.942 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:56:35.950 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T17:56:35.950 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T17:56:35.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.978+0000 7f12ffea2640 1 Processor -- start 2024-05-20T17:56:35.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.979+0000 7f12ffea2640 1 -- start start 2024-05-20T17:56:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12ffea2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f12f815d530 0x7f12f815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12ffea2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f12f80b1700 0x7f12f80b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12ffea2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f80cd580 con 0x7f12f8070850 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12ffea2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f12f80ce190 con 0x7f12f815d530 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12ffea2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f12f80cd860 con 0x7f12f80b1700 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12fdc3e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f12f815d530 0x7f12f815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12fdc3e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f12f815d530 0x7f12f815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60242/0 (socket says 172.21.15.6:60242) 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12fdc3e640 1 -- 172.21.15.6:0/2820585120 learned_addr learned my addr 172.21.15.6:0/2820585120 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.980+0000 7f12fd43d640 1 --2- 172.21.15.6:0/2820585120 >> v2:172.21.15.171:3300/0 conn(0x7f12f80b1700 0x7f12f80b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.981+0000 7f12fcc3c640 1 -- 172.21.15.6:0/2820585120 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380729437 0 0) 0x7f12f80cd580 con 0x7f12f8070850 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.981+0000 7f12fcc3c640 1 -- 172.21.15.6:0/2820585120 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12e4003520 con 0x7f12f8070850 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.981+0000 7f12fd43d640 1 -- 172.21.15.6:0/2820585120 >> v2:172.21.15.6:3300/0 conn(0x7f12f815d530 msgr2=0x7f12f815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.981+0000 7f12fd43d640 1 --2- 172.21.15.6:0/2820585120 >> v2:172.21.15.6:3300/0 conn(0x7f12f815d530 0x7f12f815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.981+0000 7f12fd43d640 1 -- 172.21.15.6:0/2820585120 >> v1:172.21.15.171:6789/0 conn(0x7f12f8070850 legacy=0x7f12f8070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.981+0000 7f12fd43d640 1 -- 172.21.15.6:0/2820585120 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f80cdb40 con 0x7f12f80b1700 2024-05-20T17:56:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.981+0000 7f12fdc3e640 1 --2- 172.21.15.6:0/2820585120 >> v2:172.21.15.6:3300/0 conn(0x7f12f815d530 0x7f12f815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.981+0000 7f12fd43d640 1 --2- 172.21.15.6:0/2820585120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f80b1700 0x7f12f80b1b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12f80d3ad0 tx=0x7f12e802e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df4373460d7fdb62 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12fcc3c640 1 -- 172.21.15.6:0/2820585120 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e803a070 con 0x7f12f80b1700 2024-05-20T17:56:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12fcc3c640 1 -- 172.21.15.6:0/2820585120 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e8033710 con 0x7f12f80b1700 2024-05-20T17:56:35.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12fcc3c640 1 -- 172.21.15.6:0/2820585120 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8033ae0 con 0x7f12f80b1700 2024-05-20T17:56:35.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12ffea2640 1 -- 172.21.15.6:0/2820585120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f80b1700 msgr2=0x7f12f80b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12ffea2640 1 --2- 172.21.15.6:0/2820585120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f80b1700 0x7f12f80b1b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12f80d3ad0 tx=0x7f12e802e4b0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12ffea2640 1 -- 172.21.15.6:0/2820585120 shutdown_connections 2024-05-20T17:56:35.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12ffea2640 1 --2- 172.21.15.6:0/2820585120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f80b1700 0x7f12f80b1b10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12ffea2640 1 --2- 172.21.15.6:0/2820585120 >> v2:172.21.15.6:3300/0 conn(0x7f12f815d530 0x7f12f815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.982+0000 7f12ffea2640 1 -- 172.21.15.6:0/2820585120 >> 172.21.15.6:0/2820585120 conn(0x7f12f80d29d0 msgr2=0x7f12f80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:35.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.983+0000 7f12ffea2640 1 -- 172.21.15.6:0/2820585120 shutdown_connections 2024-05-20T17:56:35.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.983+0000 7f12ffea2640 1 -- 172.21.15.6:0/2820585120 wait complete. 2024-05-20T17:56:35.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.984+0000 7f12ffea2640 1 Processor -- start 2024-05-20T17:56:35.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.984+0000 7f12ffea2640 1 -- start start 2024-05-20T17:56:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12ffea2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f8070850 0x7f12f8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12ffea2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f80b1700 0x7f12f81f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12ffea2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f815d530 0x7f12f81597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f815d530 0x7f12f81597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f815d530 0x7f12f81597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60244/0 (socket says 172.21.15.6:60244) 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 -- 172.21.15.6:0/90272977 learned_addr learned my addr 172.21.15.6:0/90272977 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f12f80b2050 con 0x7f12f815d530 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f12f80cd230 con 0x7f12f8070850 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f12f8071370 con 0x7f12f80b1700 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fd43d640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f80b1700 0x7f12f81f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fdc3e640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f8070850 0x7f12f8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 -- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f80b1700 msgr2=0x7f12f81f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f80b1700 0x7f12f81f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 -- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f8070850 msgr2=0x7f12f8150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f8070850 0x7f12f8150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:35.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 -- 172.21.15.6:0/90272977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f81f5280 con 0x7f12f815d530 2024-05-20T17:56:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.986+0000 7f12fe43f640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f815d530 0x7f12f81597b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c730 tx=0x7f12f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.987+0000 7f12ee7fc640 1 -- 172.21.15.6:0/90272977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0003b70 con 0x7f12f815d530 2024-05-20T17:56:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.987+0000 7f12ee7fc640 1 -- 172.21.15.6:0/90272977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f0003d30 con 0x7f12f815d530 2024-05-20T17:56:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.987+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f80b71a0 con 0x7f12f815d530 2024-05-20T17:56:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.987+0000 7f12ee7fc640 1 -- 172.21.15.6:0/90272977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0005310 con 0x7f12f815d530 2024-05-20T17:56:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.987+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f80b7760 con 0x7f12f815d530 2024-05-20T17:56:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.988+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f815fa80 con 0x7f12f815d530 2024-05-20T17:56:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.988+0000 7f12ee7fc640 1 -- 172.21.15.6:0/90272977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12f00056c0 con 0x7f12f815d530 2024-05-20T17:56:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.989+0000 7f12ee7fc640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12dc06be30 0x7f12dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.989+0000 7f12ee7fc640 1 -- 172.21.15.6:0/90272977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f12f008abc0 con 0x7f12f815d530 2024-05-20T17:56:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.989+0000 7f12fdc3e640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12dc06be30 0x7f12dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.990+0000 7f12fdc3e640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12dc06be30 0x7f12dc06e340 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f12f4006cc0 tx=0x7f12f4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:35.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:35.993+0000 7f12ee7fc640 1 -- 172.21.15.6:0/90272977 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f12f815fa80 con 0x7f12f815d530 2024-05-20T17:56:36.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:56:36.025 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:56:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.192+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f12f81f4fa0 con 0x7f12f815d530 2024-05-20T17:56:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.880+0000 7f12ee7fc640 1 -- 172.21.15.6:0/90272977 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) ==== 97+0+0 (secure 0 0 0) 0x7f12f00590a0 con 0x7f12f815d530 2024-05-20T17:56:36.879 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T17:56:36.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12dc06be30 msgr2=0x7f12dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:36.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12dc06be30 0x7f12dc06e340 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f12f4006cc0 tx=0x7f12f4009240 comp rx=0 tx=0).stop 2024-05-20T17:56:36.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f815d530 msgr2=0x7f12f81597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f815d530 0x7f12f81597b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f12f000c730 tx=0x7f12f000cbf0 comp rx=0 tx=0).stop 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 shutdown_connections 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12dc06be30 0x7f12dc06e340 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12f815d530 0x7f12f81597b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f80b1700 0x7f12f81f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 --2- 172.21.15.6:0/90272977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f8070850 0x7f12f8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 >> 172.21.15.6:0/90272977 conn(0x7f12f80d29d0 msgr2=0x7f12f80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 shutdown_connections 2024-05-20T17:56:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:36.883+0000 7f12ffea2640 1 -- 172.21.15.6:0/90272977 wait complete. 2024-05-20T17:56:36.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T17:56:37.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.021+0000 7f443940d640 1 Processor -- start 2024-05-20T17:56:37.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.021+0000 7f443940d640 1 -- start start 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f443940d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4434168050 0x7f443416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f443940d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44340d0630 con 0x7f443406d3d0 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f443940d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44340d39c0 con 0x7f4434162820 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f443940d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f44340d3ca0 con 0x7f4434168050 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f44327fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f443406d3d0 0x7f443406d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34996/0 (socket says 172.21.15.6:34996) 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f44327fc640 1 -- 172.21.15.6:0/3523192169 learned_addr learned my addr 172.21.15.6:0/3523192169 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571524448 0 0) 0x7f44340d0630 con 0x7f443406d3d0 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f44337fe640 1 --2- 172.21.15.6:0/3523192169 >> v2:172.21.15.171:3300/0 conn(0x7f4434168050 0x7f443416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4420003520 con 0x7f443406d3d0 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1356418151 0 0) 0x7f4420003520 con 0x7f443406d3d0 2024-05-20T17:56:37.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 >> v2:172.21.15.171:3300/0 conn(0x7f4434168050 msgr2=0x7f443416a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.023+0000 7f4431ffb640 1 --2- 172.21.15.6:0/3523192169 >> v2:172.21.15.171:3300/0 conn(0x7f4434168050 0x7f443416a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 >> v1:172.21.15.171:6789/0 conn(0x7f4434162820 legacy=0x7f44340b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44340d3f80 con 0x7f443406d3d0 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f441c001670 con 0x7f443406d3d0 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 >> v1:172.21.15.6:6789/0 conn(0x7f443406d3d0 legacy=0x7f443406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44200039b0 0x7f4420003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f4420004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4420005150 0x7f442000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44340d3ca0 con 0x7f4420004800 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f442000c0c0 con 0x7f4420005150 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f442000c2c0 con 0x7f44200039b0 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f44327fc640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f4420004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f44337fe640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4420005150 0x7f442000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4432ffd640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44200039b0 0x7f4420003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f44327fc640 1 -- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44200039b0 msgr2=0x7f4420003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f44327fc640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44200039b0 0x7f4420003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f44327fc640 1 -- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4420005150 msgr2=0x7f442000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f44327fc640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4420005150 0x7f442000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f44337fe640 1 -- 172.21.15.6:0/3523192169 reap_dead start 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f44327fc640 1 -- 172.21.15.6:0/3523192169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4420003520 con 0x7f4420004800 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.024+0000 7f4432ffd640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44200039b0 0x7f4420003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.025+0000 7f44327fc640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f4420004c10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c240 tx=0x7f4420005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9136e60b11cfa32 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.025+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c007d10 con 0x7f4420004800 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.025+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c005ad0 con 0x7f4420004800 2024-05-20T17:56:37.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.025+0000 7f4431ffb640 1 -- 172.21.15.6:0/3523192169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c007070 con 0x7f4420004800 2024-05-20T17:56:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.026+0000 7f443940d640 1 -- 172.21.15.6:0/3523192169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 msgr2=0x7f4420004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.026+0000 7f443940d640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f4420004c10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c240 tx=0x7f4420005830 comp rx=0 tx=0).stop 2024-05-20T17:56:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.026+0000 7f443940d640 1 -- 172.21.15.6:0/3523192169 shutdown_connections 2024-05-20T17:56:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.026+0000 7f443940d640 1 --2- 172.21.15.6:0/3523192169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f4420004c10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.026+0000 7f443940d640 1 -- 172.21.15.6:0/3523192169 >> 172.21.15.6:0/3523192169 conn(0x7f44340d4bd0 msgr2=0x7f44340d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.026+0000 7f443940d640 1 -- 172.21.15.6:0/3523192169 shutdown_connections 2024-05-20T17:56:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.026+0000 7f443940d640 1 -- 172.21.15.6:0/3523192169 wait complete. 2024-05-20T17:56:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.028+0000 7f443940d640 1 Processor -- start 2024-05-20T17:56:37.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.028+0000 7f443940d640 1 -- start start 2024-05-20T17:56:37.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f443940d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f44340ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f443940d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44340ca6f0 0x7f443415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f443940d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443415fb20 0x7f44340ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f443940d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44340d4780 con 0x7f4420004800 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f443940d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f44340d0300 con 0x7f44340ca6f0 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f443940d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44340d4900 con 0x7f443415fb20 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f4432ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f44340ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f4432ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f44340ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60270/0 (socket says 172.21.15.6:60270) 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f4432ffd640 1 -- 172.21.15.6:0/3127186603 learned_addr learned my addr 172.21.15.6:0/3127186603 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f44337fe640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443415fb20 0x7f44340ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f44327fc640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44340ca6f0 0x7f443415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f4432ffd640 1 -- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443415fb20 msgr2=0x7f44340ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f4432ffd640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443415fb20 0x7f44340ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f4432ffd640 1 -- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44340ca6f0 msgr2=0x7f443415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f4432ffd640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44340ca6f0 0x7f443415f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.029+0000 7f4432ffd640 1 -- 172.21.15.6:0/3127186603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44340c8660 con 0x7f4420004800 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.030+0000 7f4432ffd640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f44340ca1b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f442c00e8f0 tx=0x7f442c00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.030+0000 7f442b7fe640 1 -- 172.21.15.6:0/3127186603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c003b80 con 0x7f4420004800 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.030+0000 7f442b7fe640 1 -- 172.21.15.6:0/3127186603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442c018070 con 0x7f4420004800 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.030+0000 7f442b7fe640 1 -- 172.21.15.6:0/3127186603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c0050d0 con 0x7f4420004800 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.030+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44340c8940 con 0x7f4420004800 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.030+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44340c8f00 con 0x7f4420004800 2024-05-20T17:56:37.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.031+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4434075b00 con 0x7f4420004800 2024-05-20T17:56:37.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.031+0000 7f442b7fe640 1 -- 172.21.15.6:0/3127186603 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f442c005270 con 0x7f4420004800 2024-05-20T17:56:37.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.032+0000 7f442b7fe640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441406be30 0x7f441406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.032+0000 7f442b7fe640 1 -- 172.21.15.6:0/3127186603 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f442c08adb0 con 0x7f4420004800 2024-05-20T17:56:37.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.032+0000 7f44327fc640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441406be30 0x7f441406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.033+0000 7f44327fc640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441406be30 0x7f441406e340 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c210 tx=0x7f441c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.037+0000 7f442b7fe640 1 -- 172.21.15.6:0/3127186603 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f442c01a310 con 0x7f4420004800 2024-05-20T17:56:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.290+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f443408de50 con 0x7f4420004800 2024-05-20T17:56:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.291+0000 7f442b7fe640 1 -- 172.21.15.6:0/3127186603 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f442c059890 con 0x7f4420004800 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:37.290 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T17:56:37.292 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:37.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.296 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:37.297 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.298 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:56:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.300 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:56:37.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:56:37.303 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:56:37.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441406be30 msgr2=0x7f441406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441406be30 0x7f441406e340 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c210 tx=0x7f441c009030 comp rx=0 tx=0).stop 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 msgr2=0x7f44340ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f44340ca1b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f442c00e8f0 tx=0x7f442c00edb0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 shutdown_connections 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f441406be30 0x7f441406e340 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f443415fb20 0x7f44340ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44340ca6f0 0x7f443415f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 --2- 172.21.15.6:0/3127186603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4420004800 0x7f44340ca1b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 >> 172.21.15.6:0/3127186603 conn(0x7f44340d4bd0 msgr2=0x7f4434157240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 shutdown_connections 2024-05-20T17:56:37.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.293+0000 7f443940d640 1 -- 172.21.15.6:0/3127186603 wait complete. 2024-05-20T17:56:37.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.421+0000 7fd766138640 1 Processor -- start 2024-05-20T17:56:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.422+0000 7fd766138640 1 -- start start 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd766138640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd760162820 0x7fd7600b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd766138640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd7600b3e80 0x7fd76006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd766138640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76006dd20 con 0x7fd76006d910 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd766138640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd7600d0630 con 0x7fd760162820 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd766138640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd7600d39c0 con 0x7fd7600b3e80 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd760162820 0x7fd7600b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd760162820 0x7fd7600b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60284/0 (socket says 172.21.15.6:60284) 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75f7fe640 1 -- 172.21.15.6:0/3612274056 learned_addr learned my addr 172.21.15.6:0/3612274056 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75effd640 1 --2- 172.21.15.6:0/3612274056 >> v2:172.21.15.171:3300/0 conn(0x7fd7600b3e80 0x7fd76006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75f7fe640 1 -- 172.21.15.6:0/3612274056 >> v2:172.21.15.171:3300/0 conn(0x7fd7600b3e80 msgr2=0x7fd76006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75f7fe640 1 --2- 172.21.15.6:0/3612274056 >> v2:172.21.15.171:3300/0 conn(0x7fd7600b3e80 0x7fd76006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75f7fe640 1 -- 172.21.15.6:0/3612274056 >> v1:172.21.15.171:6789/0 conn(0x7fd76006d910 legacy=0x7fd7600d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75f7fe640 1 -- 172.21.15.6:0/3612274056 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7600d3ca0 con 0x7fd760162820 2024-05-20T17:56:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.423+0000 7fd75effd640 1 --2- 172.21.15.6:0/3612274056 >> v2:172.21.15.171:3300/0 conn(0x7fd7600b3e80 0x7fd76006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.424+0000 7fd75f7fe640 1 --2- 172.21.15.6:0/3612274056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760162820 0x7fd7600b3940 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd7600d1230 tx=0x7fd75002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f7a7ae6a6738b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.424+0000 7fd75e7fc640 1 -- 172.21.15.6:0/3612274056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750037070 con 0x7fd760162820 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.424+0000 7fd75e7fc640 1 -- 172.21.15.6:0/3612274056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd750032440 con 0x7fd760162820 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.424+0000 7fd75e7fc640 1 -- 172.21.15.6:0/3612274056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750032810 con 0x7fd760162820 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.425+0000 7fd766138640 1 -- 172.21.15.6:0/3612274056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760162820 msgr2=0x7fd7600b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.425+0000 7fd766138640 1 --2- 172.21.15.6:0/3612274056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760162820 0x7fd7600b3940 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd7600d1230 tx=0x7fd75002a230 comp rx=0 tx=0).stop 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.425+0000 7fd766138640 1 -- 172.21.15.6:0/3612274056 shutdown_connections 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.425+0000 7fd766138640 1 --2- 172.21.15.6:0/3612274056 >> v2:172.21.15.171:3300/0 conn(0x7fd7600b3e80 0x7fd76006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.425+0000 7fd766138640 1 --2- 172.21.15.6:0/3612274056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd760162820 0x7fd7600b3940 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.425+0000 7fd766138640 1 -- 172.21.15.6:0/3612274056 >> 172.21.15.6:0/3612274056 conn(0x7fd7600d4bd0 msgr2=0x7fd7600d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.425+0000 7fd766138640 1 -- 172.21.15.6:0/3612274056 shutdown_connections 2024-05-20T17:56:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.425+0000 7fd766138640 1 -- 172.21.15.6:0/3612274056 wait complete. 2024-05-20T17:56:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.427+0000 7fd766138640 1 Processor -- start 2024-05-20T17:56:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.427+0000 7fd766138640 1 -- start start 2024-05-20T17:56:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.428+0000 7fd766138640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd76006d910 0x7fd7600ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.428+0000 7fd766138640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600b3e80 0x7fd7600cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.428+0000 7fd766138640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd760162820 0x7fd7600cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.428+0000 7fd766138640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7600d0300 con 0x7fd7600b3e80 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.428+0000 7fd766138640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7600d4260 con 0x7fd76006d910 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.428+0000 7fd766138640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7600b91a0 con 0x7fd760162820 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600b3e80 0x7fd7600cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600b3e80 0x7fd7600cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60300/0 (socket says 172.21.15.6:60300) 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 -- 172.21.15.6:0/3594508678 learned_addr learned my addr 172.21.15.6:0/3594508678 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75f7fe640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd76006d910 0x7fd7600ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75ffff640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd760162820 0x7fd7600cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 -- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd760162820 msgr2=0x7fd7600cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd760162820 0x7fd7600cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 -- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd76006d910 msgr2=0x7fd7600ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd76006d910 0x7fd7600ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 -- 172.21.15.6:0/3594508678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7601e8fb0 con 0x7fd7600b3e80 2024-05-20T17:56:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd75effd640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600b3e80 0x7fd7600cabe0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c820 tx=0x7fd75400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd747fff640 1 -- 172.21.15.6:0/3594508678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754015070 con 0x7fd7600b3e80 2024-05-20T17:56:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd747fff640 1 -- 172.21.15.6:0/3594508678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd754007a30 con 0x7fd7600b3e80 2024-05-20T17:56:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7601e9290 con 0x7fd7600b3e80 2024-05-20T17:56:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd747fff640 1 -- 172.21.15.6:0/3594508678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754007de0 con 0x7fd7600b3e80 2024-05-20T17:56:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.429+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7601e9850 con 0x7fd7600b3e80 2024-05-20T17:56:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.431+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd76006d700 con 0x7fd7600b3e80 2024-05-20T17:56:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.431+0000 7fd747fff640 1 -- 172.21.15.6:0/3594508678 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd754018070 con 0x7fd7600b3e80 2024-05-20T17:56:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.432+0000 7fd747fff640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd74c06be30 0x7fd74c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.432+0000 7fd747fff640 1 -- 172.21.15.6:0/3594508678 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7fd75408abd0 con 0x7fd7600b3e80 2024-05-20T17:56:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.432+0000 7fd75f7fe640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd74c06be30 0x7fd74c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.432+0000 7fd75f7fe640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd74c06be30 0x7fd74c06e340 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd750034000 tx=0x7fd75002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.436+0000 7fd747fff640 1 -- 172.21.15.6:0/3594508678 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd76006d700 con 0x7fd7600b3e80 2024-05-20T17:56:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.619+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd760075b00 con 0x7fd7600b3e80 2024-05-20T17:56:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.620+0000 7fd747fff640 1 -- 172.21.15.6:0/3594508678 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+13117 (secure 0 0 0) 0x7fd754059730 con 0x7fd7600b3e80 2024-05-20T17:56:37.619 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:37.619 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":71,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:36.894494+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd74c06be30 msgr2=0x7fd74c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd74c06be30 0x7fd74c06e340 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd750034000 tx=0x7fd75002e000 comp rx=0 tx=0).stop 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600b3e80 msgr2=0x7fd7600cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600b3e80 0x7fd7600cabe0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c820 tx=0x7fd75400cce0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 shutdown_connections 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd74c06be30 0x7fd74c06e340 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd760162820 0x7fd7600cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7600b3e80 0x7fd7600cabe0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 --2- 172.21.15.6:0/3594508678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd76006d910 0x7fd7600ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 >> 172.21.15.6:0/3594508678 conn(0x7fd7600d4bd0 msgr2=0x7fd7600b9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.622+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 shutdown_connections 2024-05-20T17:56:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.623+0000 7fd766138640 1 -- 172.21.15.6:0/3594508678 wait complete. 2024-05-20T17:56:37.633 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:56:37.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:56:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.753+0000 7f531c26c640 1 Processor -- start 2024-05-20T17:56:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.753+0000 7f531c26c640 1 -- start start 2024-05-20T17:56:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531c26c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5314162820 0x7f53140b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531c26c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f53140b3e80 0x7f531406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531c26c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531406dd20 con 0x7f531406d910 2024-05-20T17:56:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531c26c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f53140d0630 con 0x7f5314162820 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531c26c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f53140d39c0 con 0x7f53140b3e80 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531a008640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5314162820 0x7f53140b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531a809640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f531406d910 0x7f53140d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54472/0 (socket says 172.21.15.6:54472) 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531a809640 1 -- 172.21.15.6:0/2905410769 learned_addr learned my addr 172.21.15.6:0/2905410769 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f5319807640 1 --2- 172.21.15.6:0/2905410769 >> v2:172.21.15.171:3300/0 conn(0x7f53140b3e80 0x7f531406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531a008640 1 -- 172.21.15.6:0/2905410769 >> v2:172.21.15.171:3300/0 conn(0x7f53140b3e80 msgr2=0x7f531406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531a008640 1 --2- 172.21.15.6:0/2905410769 >> v2:172.21.15.171:3300/0 conn(0x7f53140b3e80 0x7f531406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531a008640 1 -- 172.21.15.6:0/2905410769 >> v1:172.21.15.6:6789/0 conn(0x7f531406d910 legacy=0x7f53140d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f531a008640 1 -- 172.21.15.6:0/2905410769 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53140d3ca0 con 0x7f5314162820 2024-05-20T17:56:37.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.755+0000 7f5319006640 1 -- 172.21.15.6:0/2905410769 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077654142 0 0) 0x7f5304001490 con 0x7f531406d910 2024-05-20T17:56:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.756+0000 7f531a008640 1 --2- 172.21.15.6:0/2905410769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f53140b3940 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f53140d1230 tx=0x7f530c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6825d8d779ab8d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.756+0000 7f5319006640 1 -- 172.21.15.6:0/2905410769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c037070 con 0x7f5314162820 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.756+0000 7f5319006640 1 -- 172.21.15.6:0/2905410769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530c032440 con 0x7f5314162820 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.756+0000 7f5319006640 1 -- 172.21.15.6:0/2905410769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530c032810 con 0x7f5314162820 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.757+0000 7f531c26c640 1 -- 172.21.15.6:0/2905410769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 msgr2=0x7f53140b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.757+0000 7f531c26c640 1 --2- 172.21.15.6:0/2905410769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f53140b3940 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f53140d1230 tx=0x7f530c02a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.757+0000 7f531c26c640 1 -- 172.21.15.6:0/2905410769 shutdown_connections 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.757+0000 7f531c26c640 1 --2- 172.21.15.6:0/2905410769 >> v2:172.21.15.171:3300/0 conn(0x7f53140b3e80 0x7f531406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.757+0000 7f531c26c640 1 --2- 172.21.15.6:0/2905410769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f53140b3940 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.757+0000 7f531c26c640 1 -- 172.21.15.6:0/2905410769 >> 172.21.15.6:0/2905410769 conn(0x7f53140d4bd0 msgr2=0x7f53140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.757+0000 7f531c26c640 1 -- 172.21.15.6:0/2905410769 shutdown_connections 2024-05-20T17:56:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.757+0000 7f531c26c640 1 -- 172.21.15.6:0/2905410769 wait complete. 2024-05-20T17:56:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.759+0000 7f531c26c640 1 Processor -- start 2024-05-20T17:56:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.759+0000 7f531c26c640 1 -- start start 2024-05-20T17:56:37.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.760+0000 7f531c26c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531406d910 0x7f53141571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.760+0000 7f531c26c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53140b3e80 0x7f531415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.760+0000 7f531c26c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f531415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.760+0000 7f531c26c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53140d0300 con 0x7f5314162820 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.760+0000 7f531c26c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f53140d4260 con 0x7f53140b3e80 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.760+0000 7f531c26c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53140b91a0 con 0x7f531406d910 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.760+0000 7f531a809640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f531415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a809640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f531415e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34006/0 (socket says 172.21.15.6:34006) 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a809640 1 -- 172.21.15.6:0/4192636038 learned_addr learned my addr 172.21.15.6:0/4192636038 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a008640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531406d910 0x7f53141571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f5319807640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53140b3e80 0x7f531415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a809640 1 -- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531406d910 msgr2=0x7f53141571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a809640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531406d910 0x7f53141571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a809640 1 -- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53140b3e80 msgr2=0x7f531415a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a809640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53140b3e80 0x7f531415a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a809640 1 -- 172.21.15.6:0/4192636038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53141f5260 con 0x7f5314162820 2024-05-20T17:56:37.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531a809640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f531415e240 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f530400c730 tx=0x7f530400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f5312ffd640 1 -- 172.21.15.6:0/4192636038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304018070 con 0x7f5314162820 2024-05-20T17:56:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f5312ffd640 1 -- 172.21.15.6:0/4192636038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530400ce40 con 0x7f5314162820 2024-05-20T17:56:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53141f5540 con 0x7f5314162820 2024-05-20T17:56:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f5312ffd640 1 -- 172.21.15.6:0/4192636038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530400a860 con 0x7f5314162820 2024-05-20T17:56:37.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.761+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53141f5b00 con 0x7f5314162820 2024-05-20T17:56:37.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.762+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5314075b00 con 0x7f5314162820 2024-05-20T17:56:37.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.763+0000 7f5312ffd640 1 -- 172.21.15.6:0/4192636038 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f530401b070 con 0x7f5314162820 2024-05-20T17:56:37.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.764+0000 7f5312ffd640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f530006be30 0x7f530006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:37.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.764+0000 7f5312ffd640 1 -- 172.21.15.6:0/4192636038 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f530408a330 con 0x7f5314162820 2024-05-20T17:56:37.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.764+0000 7f531a008640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f530006be30 0x7f530006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:37.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.764+0000 7f531a008640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f530006be30 0x7f530006e340 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f530c034000 tx=0x7f530c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:37.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.768+0000 7f5312ffd640 1 -- 172.21.15.6:0/4192636038 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f531406dd20 con 0x7f5314162820 2024-05-20T17:56:37.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.955+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f53140b9540 con 0x7f5314162820 2024-05-20T17:56:37.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.956+0000 7f5312ffd640 1 -- 172.21.15.6:0/4192636038 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7f5304058720 con 0x7f5314162820 2024-05-20T17:56:37.955 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:56:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f530006be30 msgr2=0x7f530006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f530006be30 0x7f530006e340 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f530c034000 tx=0x7f530c02e000 comp rx=0 tx=0).stop 2024-05-20T17:56:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 msgr2=0x7f531415e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f531415e240 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f530400c730 tx=0x7f530400cbf0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 shutdown_connections 2024-05-20T17:56:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f530006be30 0x7f530006e340 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5314162820 0x7f531415e240 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53140b3e80 0x7f531415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 --2- 172.21.15.6:0/4192636038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f531406d910 0x7f53141571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:37.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 >> 172.21.15.6:0/4192636038 conn(0x7f53140d4bd0 msgr2=0x7f53140b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:37.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 shutdown_connections 2024-05-20T17:56:37.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:37.958+0000 7f531c26c640 1 -- 172.21.15.6:0/4192636038 wait complete. 2024-05-20T17:56:37.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T17:56:38.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.085+0000 7fb97c365640 1 Processor -- start 2024-05-20T17:56:38.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.085+0000 7fb97c365640 1 -- start start 2024-05-20T17:56:38.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.086+0000 7fb97c365640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740b2f10 0x7fb9740d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.086+0000 7fb97c365640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb97415d940 0x7fb97415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.086+0000 7fb97c365640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97415e6b0 con 0x7fb97406d290 2024-05-20T17:56:38.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.086+0000 7fb97c365640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb9740d2400 con 0x7fb97415d940 2024-05-20T17:56:38.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.086+0000 7fb97c365640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9740d1a30 con 0x7fb9740b2f10 2024-05-20T17:56:38.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb97a902640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb97415d940 0x7fb97415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb97a101640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740b2f10 0x7fb9740d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb979900640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb97406d290 0x7fb97406d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:56512/0 (socket says 172.21.15.6:56512) 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb979900640 1 -- 172.21.15.6:0/372906876 learned_addr learned my addr 172.21.15.6:0/372906876 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb9790ff640 1 -- 172.21.15.6:0/372906876 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82977961 0 0) 0x7fb97415e6b0 con 0x7fb97406d290 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb9790ff640 1 -- 172.21.15.6:0/372906876 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb960003520 con 0x7fb97406d290 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb97a902640 1 -- 172.21.15.6:0/372906876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740b2f10 msgr2=0x7fb9740d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb97a902640 1 --2- 172.21.15.6:0/372906876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740b2f10 0x7fb9740d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb97a902640 1 -- 172.21.15.6:0/372906876 >> v1:172.21.15.171:6789/0 conn(0x7fb97406d290 legacy=0x7fb97406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb97a902640 1 -- 172.21.15.6:0/372906876 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9740d1100 con 0x7fb97415d940 2024-05-20T17:56:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.087+0000 7fb97a101640 1 --2- 172.21.15.6:0/372906876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740b2f10 0x7fb9740d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.088+0000 7fb97a902640 1 --2- 172.21.15.6:0/372906876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb97415d940 0x7fb97415dd50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009d90 tx=0x7fb96c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e91145ef35ede3e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.088+0000 7fb9790ff640 1 -- 172.21.15.6:0/372906876 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c031600 con 0x7fb97415d940 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.088+0000 7fb9790ff640 1 -- 172.21.15.6:0/372906876 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96c0317a0 con 0x7fb97415d940 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.088+0000 7fb9790ff640 1 -- 172.21.15.6:0/372906876 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c031b50 con 0x7fb97415d940 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.089+0000 7fb97c365640 1 -- 172.21.15.6:0/372906876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb97415d940 msgr2=0x7fb97415dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.089+0000 7fb97c365640 1 --2- 172.21.15.6:0/372906876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb97415d940 0x7fb97415dd50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009d90 tx=0x7fb96c02a5d0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.089+0000 7fb97c365640 1 -- 172.21.15.6:0/372906876 shutdown_connections 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.089+0000 7fb97c365640 1 --2- 172.21.15.6:0/372906876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb97415d940 0x7fb97415dd50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.089+0000 7fb97c365640 1 --2- 172.21.15.6:0/372906876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740b2f10 0x7fb9740d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.089+0000 7fb97c365640 1 -- 172.21.15.6:0/372906876 >> 172.21.15.6:0/372906876 conn(0x7fb9740b6670 msgr2=0x7fb9740b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.089+0000 7fb97c365640 1 -- 172.21.15.6:0/372906876 shutdown_connections 2024-05-20T17:56:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.089+0000 7fb97c365640 1 -- 172.21.15.6:0/372906876 wait complete. 2024-05-20T17:56:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.091+0000 7fb97c365640 1 Processor -- start 2024-05-20T17:56:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.091+0000 7fb97c365640 1 -- start start 2024-05-20T17:56:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97c365640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97406d290 0x7fb9741f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97c365640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740b2f10 0x7fb9741556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97c365640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb97415d940 0x7fb97414ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97c365640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9740d16c0 con 0x7fb97406d290 2024-05-20T17:56:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97c365640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9740b3320 con 0x7fb9740b2f10 2024-05-20T17:56:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97c365640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb97415e290 con 0x7fb97415d940 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97a101640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97406d290 0x7fb9741f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97a101640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97406d290 0x7fb9741f3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34012/0 (socket says 172.21.15.6:34012) 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.092+0000 7fb97a101640 1 -- 172.21.15.6:0/1358648669 learned_addr learned my addr 172.21.15.6:0/1358648669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb979900640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740b2f10 0x7fb9741556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97a902640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb97415d940 0x7fb97414ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97a101640 1 -- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb97415d940 msgr2=0x7fb97414ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97a101640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb97415d940 0x7fb97414ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97a101640 1 -- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740b2f10 msgr2=0x7fb9741556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97a101640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740b2f10 0x7fb9741556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97a101640 1 -- 172.21.15.6:0/1358648669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97414bb70 con 0x7fb97406d290 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97a902640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb97415d940 0x7fb97414ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb979900640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740b2f10 0x7fb9741556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97a101640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97406d290 0x7fb9741f3a60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb97000e910 tx=0x7fb97000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb96affd640 1 -- 172.21.15.6:0/1358648669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970017070 con 0x7fb97406d290 2024-05-20T17:56:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb96affd640 1 -- 172.21.15.6:0/1358648669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97000ca00 con 0x7fb97406d290 2024-05-20T17:56:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb974158250 con 0x7fb97406d290 2024-05-20T17:56:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb96affd640 1 -- 172.21.15.6:0/1358648669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97000cdb0 con 0x7fb97406d290 2024-05-20T17:56:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.093+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9741f6a30 con 0x7fb97406d290 2024-05-20T17:56:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.094+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb974075b00 con 0x7fb97406d290 2024-05-20T17:56:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.095+0000 7fb96affd640 1 -- 172.21.15.6:0/1358648669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb97001a070 con 0x7fb97406d290 2024-05-20T17:56:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.095+0000 7fb96affd640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb95806be30 0x7fb95806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.095+0000 7fb96affd640 1 -- 172.21.15.6:0/1358648669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7fb97008ab60 con 0x7fb97406d290 2024-05-20T17:56:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.095+0000 7fb979900640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb95806be30 0x7fb95806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.096+0000 7fb979900640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb95806be30 0x7fb95806e340 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb974156240 tx=0x7fb964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:38.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.100+0000 7fb96affd640 1 -- 172.21.15.6:0/1358648669 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb97414bb70 con 0x7fb97406d290 2024-05-20T17:56:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.288+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb97406df40 con 0x7fb97406d290 2024-05-20T17:56:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.289+0000 7fb96affd640 1 -- 172.21.15.6:0/1358648669 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fb9700596d0 con 0x7fb97406d290 2024-05-20T17:56:38.288 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:38.288 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T17:56:38.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:56:38.288 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T17:56:38.288 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T17:56:38.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:56:38.288 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb95806be30 msgr2=0x7fb95806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb95806be30 0x7fb95806e340 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb974156240 tx=0x7fb964009040 comp rx=0 tx=0).stop 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97406d290 msgr2=0x7fb9741f3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97406d290 0x7fb9741f3a60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb97000e910 tx=0x7fb97000edd0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 shutdown_connections 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb95806be30 0x7fb95806e340 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb97415d940 0x7fb97414ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740b2f10 0x7fb9741556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 --2- 172.21.15.6:0/1358648669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97406d290 0x7fb9741f3a60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 >> 172.21.15.6:0/1358648669 conn(0x7fb9740b6670 msgr2=0x7fb9740b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 shutdown_connections 2024-05-20T17:56:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.291+0000 7fb97c365640 1 -- 172.21.15.6:0/1358648669 wait complete. 2024-05-20T17:56:38.301 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T17:56:38.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T17:56:38.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.421+0000 7ff246e7a640 1 Processor -- start 2024-05-20T17:56:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.421+0000 7ff246e7a640 1 -- start start 2024-05-20T17:56:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff246e7a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2400d2330 0x7ff24006d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff246e7a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2400ce140 0x7ff2400d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff246e7a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2400d2740 con 0x7ff24006d660 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff246e7a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff24009c3b0 con 0x7ff2400d2330 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff246e7a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff24006dda0 con 0x7ff2400ce140 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff244c16640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2400d2330 0x7ff24006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff244c16640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2400d2330 0x7ff24006d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34014/0 (socket says 172.21.15.6:34014) 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff244c16640 1 -- 172.21.15.6:0/452329926 learned_addr learned my addr 172.21.15.6:0/452329926 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.422+0000 7ff245417640 1 --2- 172.21.15.6:0/452329926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2400ce140 0x7ff2400d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.423+0000 7ff244c16640 1 -- 172.21.15.6:0/452329926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2400ce140 msgr2=0x7ff2400d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.423+0000 7ff244c16640 1 --2- 172.21.15.6:0/452329926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2400ce140 0x7ff2400d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.423+0000 7ff244c16640 1 -- 172.21.15.6:0/452329926 >> v1:172.21.15.171:6789/0 conn(0x7ff24006d660 legacy=0x7ff2400cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.423+0000 7ff244c16640 1 -- 172.21.15.6:0/452329926 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2400b81a0 con 0x7ff2400d2330 2024-05-20T17:56:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.423+0000 7ff244c16640 1 --2- 172.21.15.6:0/452329926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400d2330 0x7ff24006d120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff230009850 tx=0x7ff23002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba54509101bfacc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.423+0000 7ff23f7fe640 1 -- 172.21.15.6:0/452329926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230004030 con 0x7ff2400d2330 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff23f7fe640 1 -- 172.21.15.6:0/452329926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2300041d0 con 0x7ff2400d2330 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff23f7fe640 1 -- 172.21.15.6:0/452329926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230003610 con 0x7ff2400d2330 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff246e7a640 1 -- 172.21.15.6:0/452329926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400d2330 msgr2=0x7ff24006d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff246e7a640 1 --2- 172.21.15.6:0/452329926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400d2330 0x7ff24006d120 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7ff230009850 tx=0x7ff23002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff246e7a640 1 -- 172.21.15.6:0/452329926 shutdown_connections 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff246e7a640 1 --2- 172.21.15.6:0/452329926 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2400ce140 0x7ff2400d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff246e7a640 1 --2- 172.21.15.6:0/452329926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400d2330 0x7ff24006d120 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff246e7a640 1 -- 172.21.15.6:0/452329926 >> 172.21.15.6:0/452329926 conn(0x7ff2400cf450 msgr2=0x7ff2400cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff246e7a640 1 -- 172.21.15.6:0/452329926 shutdown_connections 2024-05-20T17:56:38.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.424+0000 7ff246e7a640 1 -- 172.21.15.6:0/452329926 wait complete. 2024-05-20T17:56:38.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.426+0000 7ff246e7a640 1 Processor -- start 2024-05-20T17:56:38.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.426+0000 7ff246e7a640 1 -- start start 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff246e7a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24006d660 0x7ff24014b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff246e7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400ce140 0x7ff2400cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff246e7a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400d2330 0x7ff24014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff246e7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2400d3800 con 0x7ff2400ce140 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff246e7a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff24006da70 con 0x7ff2400d2330 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff246e7a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2400d3980 con 0x7ff24006d660 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400ce140 0x7ff2400cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400ce140 0x7ff2400cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34016/0 (socket says 172.21.15.6:34016) 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 -- 172.21.15.6:0/2018749749 learned_addr learned my addr 172.21.15.6:0/2018749749 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff244c16640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24006d660 0x7ff24014b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff245417640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400d2330 0x7ff24014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 -- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24006d660 msgr2=0x7ff24014b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24006d660 0x7ff24014b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 -- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400d2330 msgr2=0x7ff24014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400d2330 0x7ff24014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 -- 172.21.15.6:0/2018749749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24015c340 con 0x7ff2400ce140 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23ffff640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400ce140 0x7ff2400cc190 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff23400b420 tx=0x7ff23400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.428+0000 7ff23d7fa640 1 -- 172.21.15.6:0/2018749749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234011830 con 0x7ff2400ce140 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.429+0000 7ff23d7fa640 1 -- 172.21.15.6:0/2018749749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff234016070 con 0x7ff2400ce140 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.429+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24015c620 con 0x7ff2400ce140 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.429+0000 7ff23d7fa640 1 -- 172.21.15.6:0/2018749749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234011c10 con 0x7ff2400ce140 2024-05-20T17:56:38.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.429+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24015cbe0 con 0x7ff2400ce140 2024-05-20T17:56:38.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.430+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2400690b0 con 0x7ff2400ce140 2024-05-20T17:56:38.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.430+0000 7ff23d7fa640 1 -- 172.21.15.6:0/2018749749 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff23401b460 con 0x7ff2400ce140 2024-05-20T17:56:38.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.431+0000 7ff23d7fa640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff22c06be30 0x7ff22c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:38.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.431+0000 7ff23d7fa640 1 -- 172.21.15.6:0/2018749749 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7ff23408a7f0 con 0x7ff2400ce140 2024-05-20T17:56:38.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.431+0000 7ff244c16640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff22c06be30 0x7ff22c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:38.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.432+0000 7ff244c16640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff22c06be30 0x7ff22c06e340 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff230033000 tx=0x7ff23002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:38.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.436+0000 7ff23d7fa640 1 -- 172.21.15.6:0/2018749749 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff234020020 con 0x7ff2400ce140 2024-05-20T17:56:38.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.619+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff2400b7d90 con 0x7ff2400ce140 2024-05-20T17:56:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.886+0000 7ff23d7fa640 1 -- 172.21.15.6:0/2018749749 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7ff2340592e0 con 0x7ff2400ce140 2024-05-20T17:56:38.885 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T17:56:38.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff22c06be30 msgr2=0x7ff22c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff22c06be30 0x7ff22c06e340 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff230033000 tx=0x7ff23002e000 comp rx=0 tx=0).stop 2024-05-20T17:56:38.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400ce140 msgr2=0x7ff2400cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:38.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400ce140 0x7ff2400cc190 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff23400b420 tx=0x7ff23400b8e0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 shutdown_connections 2024-05-20T17:56:38.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff22c06be30 0x7ff22c06e340 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2400d2330 0x7ff24014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2400ce140 0x7ff2400cc190 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 --2- 172.21.15.6:0/2018749749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff24006d660 0x7ff24014b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:38.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 >> 172.21.15.6:0/2018749749 conn(0x7ff2400cf450 msgr2=0x7ff240162e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:38.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 shutdown_connections 2024-05-20T17:56:38.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:38.890+0000 7ff246e7a640 1 -- 172.21.15.6:0/2018749749 wait complete. 2024-05-20T17:56:38.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T17:56:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.029+0000 7f14604fe640 1 Processor -- start 2024-05-20T17:56:39.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.029+0000 7f14604fe640 1 -- start start 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.030+0000 7f14604fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14580d46e0 0x7f14580b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f14604fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f145808c4c0 0x7f14580b8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f14604fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14580d2890 con 0x7f145815f320 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f14604fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f14580d2b70 con 0x7f14580d46e0 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f14604fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f14580d2e50 con 0x7f145808c4c0 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f145e29a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14580d46e0 0x7f14580b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f145e29a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14580d46e0 0x7f14580b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34022/0 (socket says 172.21.15.6:34022) 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f145e29a640 1 -- 172.21.15.6:0/2807275046 learned_addr learned my addr 172.21.15.6:0/2807275046 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f145ea9b640 1 --2- 172.21.15.6:0/2807275046 >> v2:172.21.15.171:3300/0 conn(0x7f145808c4c0 0x7f14580b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f145e29a640 1 -- 172.21.15.6:0/2807275046 >> v2:172.21.15.171:3300/0 conn(0x7f145808c4c0 msgr2=0x7f14580b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f145e29a640 1 --2- 172.21.15.6:0/2807275046 >> v2:172.21.15.171:3300/0 conn(0x7f145808c4c0 0x7f14580b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f145e29a640 1 -- 172.21.15.6:0/2807275046 >> v1:172.21.15.171:6789/0 conn(0x7f145815f320 legacy=0x7f145808bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.031+0000 7f145e29a640 1 -- 172.21.15.6:0/2807275046 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14580d3130 con 0x7f14580d46e0 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.032+0000 7f145e29a640 1 --2- 172.21.15.6:0/2807275046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14580d46e0 0x7f14580b3cd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f14580bad10 tx=0x7f145402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9523477f29cb0c3b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.032+0000 7f145d298640 1 -- 172.21.15.6:0/2807275046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454037070 con 0x7f14580d46e0 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.032+0000 7f145d298640 1 -- 172.21.15.6:0/2807275046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1454032440 con 0x7f14580d46e0 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.032+0000 7f145d298640 1 -- 172.21.15.6:0/2807275046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454032810 con 0x7f14580d46e0 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.033+0000 7f14604fe640 1 -- 172.21.15.6:0/2807275046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14580d46e0 msgr2=0x7f14580b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.033+0000 7f14604fe640 1 --2- 172.21.15.6:0/2807275046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14580d46e0 0x7f14580b3cd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f14580bad10 tx=0x7f145402a270 comp rx=0 tx=0).stop 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.033+0000 7f14604fe640 1 -- 172.21.15.6:0/2807275046 shutdown_connections 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.033+0000 7f14604fe640 1 --2- 172.21.15.6:0/2807275046 >> v2:172.21.15.171:3300/0 conn(0x7f145808c4c0 0x7f14580b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.033+0000 7f14604fe640 1 --2- 172.21.15.6:0/2807275046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14580d46e0 0x7f14580b3cd0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.033+0000 7f14604fe640 1 -- 172.21.15.6:0/2807275046 >> 172.21.15.6:0/2807275046 conn(0x7f14580d1cd0 msgr2=0x7f14580d4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.033+0000 7f14604fe640 1 -- 172.21.15.6:0/2807275046 shutdown_connections 2024-05-20T17:56:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.033+0000 7f14604fe640 1 -- 172.21.15.6:0/2807275046 wait complete. 2024-05-20T17:56:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.035+0000 7f14604fe640 1 Processor -- start 2024-05-20T17:56:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.035+0000 7f14604fe640 1 -- start start 2024-05-20T17:56:39.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f14604fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14580d46e0 0x7f1458150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f14604fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145815f320 0x7f14581619c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f14604fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14581f6670 0x7f1458160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f14604fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f145815f730 con 0x7f145815f320 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f14604fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f145808ddb0 con 0x7f14580d46e0 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f14604fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f14580d3930 con 0x7f14581f6670 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145da99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145815f320 0x7f14581619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145da99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145815f320 0x7f14581619c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34038/0 (socket says 172.21.15.6:34038) 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145da99640 1 -- 172.21.15.6:0/395501235 learned_addr learned my addr 172.21.15.6:0/395501235 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145ea9b640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14581f6670 0x7f1458160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145e29a640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14580d46e0 0x7f1458150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145da99640 1 -- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14581f6670 msgr2=0x7f1458160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145da99640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14581f6670 0x7f1458160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145da99640 1 -- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14580d46e0 msgr2=0x7f1458150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145da99640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14580d46e0 0x7f1458150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.036+0000 7f145da99640 1 -- 172.21.15.6:0/395501235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1458161f00 con 0x7f145815f320 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.037+0000 7f145da99640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145815f320 0x7f14581619c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f144800c3c0 tx=0x7f144800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.037+0000 7f144effd640 1 -- 172.21.15.6:0/395501235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14480052d0 con 0x7f145815f320 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.037+0000 7f144effd640 1 -- 172.21.15.6:0/395501235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1448005490 con 0x7f145815f320 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.037+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145815fc20 con 0x7f145815f320 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.037+0000 7f144effd640 1 -- 172.21.15.6:0/395501235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448007260 con 0x7f145815f320 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.037+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14581601e0 con 0x7f145815f320 2024-05-20T17:56:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.038+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14580690b0 con 0x7f145815f320 2024-05-20T17:56:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.039+0000 7f144effd640 1 -- 172.21.15.6:0/395501235 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1448007400 con 0x7f145815f320 2024-05-20T17:56:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.039+0000 7f144effd640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f143c06be30 0x7f143c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.040+0000 7f144effd640 1 -- 172.21.15.6:0/395501235 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5619+0+0 (secure 0 0 0) 0x7f144808a280 con 0x7f145815f320 2024-05-20T17:56:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.040+0000 7f145e29a640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f143c06be30 0x7f143c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.040+0000 7f145e29a640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f143c06be30 0x7f143c06e340 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1454034000 tx=0x7f145402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.044+0000 7f144effd640 1 -- 172.21.15.6:0/395501235 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1448058590 con 0x7f145815f320 2024-05-20T17:56:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.229+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f145815f970 con 0x7f145815f320 2024-05-20T17:56:39.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.889+0000 7f144effd640 1 -- 172.21.15.6:0/395501235 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f144805c890 con 0x7f145815f320 2024-05-20T17:56:39.888 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f143c06be30 msgr2=0x7f143c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f143c06be30 0x7f143c06e340 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1454034000 tx=0x7f145402e000 comp rx=0 tx=0).stop 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145815f320 msgr2=0x7f14581619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145815f320 0x7f14581619c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f144800c3c0 tx=0x7f144800c7c0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 shutdown_connections 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f143c06be30 0x7f143c06e340 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14581f6670 0x7f1458160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145815f320 0x7f14581619c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 --2- 172.21.15.6:0/395501235 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14580d46e0 0x7f1458150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:39.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 >> 172.21.15.6:0/395501235 conn(0x7f14580d1cd0 msgr2=0x7f145815d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:39.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 shutdown_connections 2024-05-20T17:56:39.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:39.893+0000 7f14604fe640 1 -- 172.21.15.6:0/395501235 wait complete. 2024-05-20T17:56:39.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T17:56:40.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.047+0000 7f36f9d65640 1 Processor -- start 2024-05-20T17:56:40.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.047+0000 7f36f9d65640 1 -- start start 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.048+0000 7f36f9d65640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36f40b4010 0x7f36f40d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.048+0000 7f36f9d65640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f36f40d14b0 0x7f36f40d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.048+0000 7f36f9d65640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f40d0370 con 0x7f36f4163a10 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.048+0000 7f36f9d65640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f36f40d3ca0 con 0x7f36f40b4010 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.048+0000 7f36f9d65640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f36f40d0650 con 0x7f36f40d14b0 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.048+0000 7f36f2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36f40b4010 0x7f36f40d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.049+0000 7f36f2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36f40b4010 0x7f36f40d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34050/0 (socket says 172.21.15.6:34050) 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.049+0000 7f36f2ffd640 1 -- 172.21.15.6:0/4211503187 learned_addr learned my addr 172.21.15.6:0/4211503187 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.049+0000 7f36f3fff640 1 --2- 172.21.15.6:0/4211503187 >> v2:172.21.15.171:3300/0 conn(0x7f36f40d14b0 0x7f36f40d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.049+0000 7f36f2ffd640 1 -- 172.21.15.6:0/4211503187 >> v2:172.21.15.171:3300/0 conn(0x7f36f40d14b0 msgr2=0x7f36f40d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:40.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.049+0000 7f36f2ffd640 1 --2- 172.21.15.6:0/4211503187 >> v2:172.21.15.171:3300/0 conn(0x7f36f40d14b0 0x7f36f40d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.049+0000 7f36f2ffd640 1 -- 172.21.15.6:0/4211503187 >> v1:172.21.15.171:6789/0 conn(0x7f36f4163a10 legacy=0x7f36f40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:40.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.049+0000 7f36f2ffd640 1 -- 172.21.15.6:0/4211503187 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f40d3650 con 0x7f36f40b4010 2024-05-20T17:56:40.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.050+0000 7f36f2ffd640 1 --2- 172.21.15.6:0/4211503187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f40b4010 0x7f36f40d4130 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f36f40b4590 tx=0x7f36e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2c9a7683f30c18 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:40.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.050+0000 7f36f27fc640 1 -- 172.21.15.6:0/4211503187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8037070 con 0x7f36f40b4010 2024-05-20T17:56:40.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.050+0000 7f36f27fc640 1 -- 172.21.15.6:0/4211503187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e8032440 con 0x7f36f40b4010 2024-05-20T17:56:40.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.050+0000 7f36f27fc640 1 -- 172.21.15.6:0/4211503187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e8032810 con 0x7f36f40b4010 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.051+0000 7f36f9d65640 1 -- 172.21.15.6:0/4211503187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f40b4010 msgr2=0x7f36f40d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.051+0000 7f36f9d65640 1 --2- 172.21.15.6:0/4211503187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f40b4010 0x7f36f40d4130 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f36f40b4590 tx=0x7f36e802a270 comp rx=0 tx=0).stop 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.051+0000 7f36f9d65640 1 -- 172.21.15.6:0/4211503187 shutdown_connections 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.051+0000 7f36f9d65640 1 --2- 172.21.15.6:0/4211503187 >> v2:172.21.15.171:3300/0 conn(0x7f36f40d14b0 0x7f36f40d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.051+0000 7f36f9d65640 1 --2- 172.21.15.6:0/4211503187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f40b4010 0x7f36f40d4130 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.051+0000 7f36f9d65640 1 -- 172.21.15.6:0/4211503187 >> 172.21.15.6:0/4211503187 conn(0x7f36f406d240 msgr2=0x7f36f406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.051+0000 7f36f9d65640 1 -- 172.21.15.6:0/4211503187 shutdown_connections 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.051+0000 7f36f9d65640 1 -- 172.21.15.6:0/4211503187 wait complete. 2024-05-20T17:56:40.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.052+0000 7f36f9d65640 1 Processor -- start 2024-05-20T17:56:40.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.053+0000 7f36f9d65640 1 -- start start 2024-05-20T17:56:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f9d65640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36f40b4010 0x7f36f41f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f9d65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36f40d14b0 0x7f36f41f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f9d65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f4163a10 0x7f36f4158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f9d65640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36f40b8210 con 0x7f36f4163a10 2024-05-20T17:56:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f9d65640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36f40d1e00 con 0x7f36f40b4010 2024-05-20T17:56:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f9d65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36f40b8390 con 0x7f36f40d14b0 2024-05-20T17:56:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f4163a10 0x7f36f4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f4163a10 0x7f36f4158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34052/0 (socket says 172.21.15.6:34052) 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f3fff640 1 -- 172.21.15.6:0/2731015742 learned_addr learned my addr 172.21.15.6:0/2731015742 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f2ffd640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36f40d14b0 0x7f36f41f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.054+0000 7f36f37fe640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36f40b4010 0x7f36f41f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36f3fff640 1 -- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36f40d14b0 msgr2=0x7f36f41f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36f3fff640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36f40d14b0 0x7f36f41f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36f3fff640 1 -- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36f40b4010 msgr2=0x7f36f41f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36f3fff640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36f40b4010 0x7f36f41f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36f3fff640 1 -- 172.21.15.6:0/2731015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f415c0c0 con 0x7f36f4163a10 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36f3fff640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f4163a10 0x7f36f4158360 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00efc0 tx=0x7f36ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36dbfff640 1 -- 172.21.15.6:0/2731015742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec018020 con 0x7f36f4163a10 2024-05-20T17:56:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36dbfff640 1 -- 172.21.15.6:0/2731015742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ec014480 con 0x7f36f4163a10 2024-05-20T17:56:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f415c3a0 con 0x7f36f4163a10 2024-05-20T17:56:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36dbfff640 1 -- 172.21.15.6:0/2731015742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec014870 con 0x7f36f4163a10 2024-05-20T17:56:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.055+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f415c960 con 0x7f36f4163a10 2024-05-20T17:56:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.056+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f415be30 con 0x7f36f4163a10 2024-05-20T17:56:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.057+0000 7f36dbfff640 1 -- 172.21.15.6:0/2731015742 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36ec005d10 con 0x7f36f4163a10 2024-05-20T17:56:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.057+0000 7f36dbfff640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36e006be30 0x7f36e006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.057+0000 7f36dbfff640 1 -- 172.21.15.6:0/2731015742 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6001+0+0 (secure 0 0 0) 0x7f36ec08bb90 con 0x7f36f4163a10 2024-05-20T17:56:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.058+0000 7f36f37fe640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36e006be30 0x7f36e006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.058+0000 7f36f37fe640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36e006be30 0x7f36e006e340 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f36e4007fd0 tx=0x7f36e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.062+0000 7f36dbfff640 1 -- 172.21.15.6:0/2731015742 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f36ec022070 con 0x7f36f4163a10 2024-05-20T17:56:40.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.284+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f36f415e620 con 0x7f36f4163a10 2024-05-20T17:56:40.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.920+0000 7f36dbfff640 1 -- 172.21.15.6:0/2731015742 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v41) ==== 174+0+0 (secure 0 0 0) 0x7f36ec010040 con 0x7f36f4163a10 2024-05-20T17:56:40.920 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 11 and data pool 12 2024-05-20T17:56:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.927+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36e006be30 msgr2=0x7f36e006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.927+0000 7f36f9d65640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36e006be30 0x7f36e006e340 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f36e4007fd0 tx=0x7f36e4009040 comp rx=0 tx=0).stop 2024-05-20T17:56:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.927+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f4163a10 msgr2=0x7f36f4158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.927+0000 7f36f9d65640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f4163a10 0x7f36f4158360 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00efc0 tx=0x7f36ec00c490 comp rx=0 tx=0).stop 2024-05-20T17:56:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.928+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 shutdown_connections 2024-05-20T17:56:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.928+0000 7f36f9d65640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36e006be30 0x7f36e006e340 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.928+0000 7f36f9d65640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f4163a10 0x7f36f4158360 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.928+0000 7f36f9d65640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36f40d14b0 0x7f36f41f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.928+0000 7f36f9d65640 1 --2- 172.21.15.6:0/2731015742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36f40b4010 0x7f36f41f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:40.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.928+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 >> 172.21.15.6:0/2731015742 conn(0x7f36f406d240 msgr2=0x7f36f415f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:40.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.929+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 shutdown_connections 2024-05-20T17:56:40.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:40.929+0000 7f36f9d65640 1 -- 172.21.15.6:0/2731015742 wait complete. 2024-05-20T17:56:40.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:41.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.074+0000 7f853199d640 1 Processor -- start 2024-05-20T17:56:41.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.074+0000 7f853199d640 1 -- start start 2024-05-20T17:56:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f853199d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c162820 0x7f852c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f853199d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f852c0b3e80 0x7f852c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f853199d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f852c06dd20 con 0x7f852c06d910 2024-05-20T17:56:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f853199d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f852c0d0630 con 0x7f852c0b3e80 2024-05-20T17:56:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f853199d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f852c0d39c0 con 0x7f852c162820 2024-05-20T17:56:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f852affd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c162820 0x7f852c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f852a7fc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f852c0b3e80 0x7f852c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f852b7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f852c06d910 0x7f852c0d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:56562/0 (socket says 172.21.15.6:56562) 2024-05-20T17:56:41.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.076+0000 7f852b7fe640 1 -- 172.21.15.6:0/3382448143 learned_addr learned my addr 172.21.15.6:0/3382448143 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.077+0000 7f8529ffb640 1 -- 172.21.15.6:0/3382448143 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589290829 0 0) 0x7f8524001110 con 0x7f852c06d910 2024-05-20T17:56:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.077+0000 7f8529ffb640 1 -- 172.21.15.6:0/3382448143 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8518003520 con 0x7f852c06d910 2024-05-20T17:56:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.077+0000 7f852a7fc640 1 -- 172.21.15.6:0/3382448143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c162820 msgr2=0x7f852c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.077+0000 7f852a7fc640 1 --2- 172.21.15.6:0/3382448143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c162820 0x7f852c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.077+0000 7f852a7fc640 1 -- 172.21.15.6:0/3382448143 >> v1:172.21.15.171:6789/0 conn(0x7f852c06d910 legacy=0x7f852c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.077+0000 7f852a7fc640 1 -- 172.21.15.6:0/3382448143 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c0d3ca0 con 0x7f852c0b3e80 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.077+0000 7f852affd640 1 --2- 172.21.15.6:0/3382448143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c162820 0x7f852c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.077+0000 7f852a7fc640 1 --2- 172.21.15.6:0/3382448143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c0b3e80 0x7f852c06d3d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85140097a0 tx=0x7f851402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca9a0d15e53d6aab server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f8529ffb640 1 -- 172.21.15.6:0/3382448143 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514037070 con 0x7f852c0b3e80 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f8529ffb640 1 -- 172.21.15.6:0/3382448143 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8514032440 con 0x7f852c0b3e80 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f8529ffb640 1 -- 172.21.15.6:0/3382448143 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514032810 con 0x7f852c0b3e80 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f853199d640 1 -- 172.21.15.6:0/3382448143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c0b3e80 msgr2=0x7f852c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f853199d640 1 --2- 172.21.15.6:0/3382448143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c0b3e80 0x7f852c06d3d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85140097a0 tx=0x7f851402a180 comp rx=0 tx=0).stop 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f853199d640 1 -- 172.21.15.6:0/3382448143 shutdown_connections 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f853199d640 1 --2- 172.21.15.6:0/3382448143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c0b3e80 0x7f852c06d3d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f853199d640 1 --2- 172.21.15.6:0/3382448143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c162820 0x7f852c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f853199d640 1 -- 172.21.15.6:0/3382448143 >> 172.21.15.6:0/3382448143 conn(0x7f852c0d4bd0 msgr2=0x7f852c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f853199d640 1 -- 172.21.15.6:0/3382448143 shutdown_connections 2024-05-20T17:56:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.078+0000 7f853199d640 1 -- 172.21.15.6:0/3382448143 wait complete. 2024-05-20T17:56:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.080+0000 7f853199d640 1 Processor -- start 2024-05-20T17:56:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.080+0000 7f853199d640 1 -- start start 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f853199d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c06d910 0x7f852c149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f853199d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c0b3e80 0x7f852c0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f853199d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f852c162820 0x7f852c159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f853199d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f852c0d0300 con 0x7f852c162820 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f853199d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f852c0d4260 con 0x7f852c06d910 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f853199d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f852c0b91a0 con 0x7f852c0b3e80 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f852c162820 0x7f852c159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f852c162820 0x7f852c159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34064/0 (socket says 172.21.15.6:34064) 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 -- 172.21.15.6:0/2836895296 learned_addr learned my addr 172.21.15.6:0/2836895296 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852affd640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c06d910 0x7f852c149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852a7fc640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c0b3e80 0x7f852c0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 -- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c0b3e80 msgr2=0x7f852c0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c0b3e80 0x7f852c0b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 -- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c06d910 msgr2=0x7f852c149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c06d910 0x7f852c149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 -- 172.21.15.6:0/2836895296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c0b4fe0 con 0x7f852c162820 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852a7fc640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c0b3e80 0x7f852c0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f852b7fe640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f852c162820 0x7f852c159700 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f852400c3d0 tx=0x7f852400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.082+0000 7f8523fff640 1 -- 172.21.15.6:0/2836895296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524017070 con 0x7f852c162820 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.083+0000 7f8523fff640 1 -- 172.21.15.6:0/2836895296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8524005ce0 con 0x7f852c162820 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.083+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852c0b52c0 con 0x7f852c162820 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.083+0000 7f8523fff640 1 -- 172.21.15.6:0/2836895296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85240072f0 con 0x7f852c162820 2024-05-20T17:56:41.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.083+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852c156080 con 0x7f852c162820 2024-05-20T17:56:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.084+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f852c0b4d40 con 0x7f852c162820 2024-05-20T17:56:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.084+0000 7f8523fff640 1 -- 172.21.15.6:0/2836895296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f852401a070 con 0x7f852c162820 2024-05-20T17:56:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.085+0000 7f8523fff640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850c06be30 0x7f850c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.085+0000 7f8523fff640 1 -- 172.21.15.6:0/2836895296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f852408a440 con 0x7f852c162820 2024-05-20T17:56:41.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.085+0000 7f852affd640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850c06be30 0x7f850c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.086+0000 7f852affd640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850c06be30 0x7f850c06e340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f851c007440 tx=0x7f851c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.089+0000 7f8523fff640 1 -- 172.21.15.6:0/2836895296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f852c0b4d40 con 0x7f852c162820 2024-05-20T17:56:41.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.274+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f852c075b00 con 0x7f852c162820 2024-05-20T17:56:41.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.275+0000 7f8523fff640 1 -- 172.21.15.6:0/2836895296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16910 (secure 0 0 0) 0x7f852c06dd20 con 0x7f852c162820 2024-05-20T17:56:41.274 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:41.274 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":74,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:40.286365+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:38.652078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:39.261578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850c06be30 msgr2=0x7f850c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850c06be30 0x7f850c06e340 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f851c007440 tx=0x7f851c00b040 comp rx=0 tx=0).stop 2024-05-20T17:56:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f852c162820 msgr2=0x7f852c159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f852c162820 0x7f852c159700 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f852400c3d0 tx=0x7f852400c890 comp rx=0 tx=0).stop 2024-05-20T17:56:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 shutdown_connections 2024-05-20T17:56:41.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850c06be30 0x7f850c06e340 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f852c162820 0x7f852c159700 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f852c0b3e80 0x7f852c0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 --2- 172.21.15.6:0/2836895296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f852c06d910 0x7f852c149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 >> 172.21.15.6:0/2836895296 conn(0x7f852c0d4bd0 msgr2=0x7f852c15d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 shutdown_connections 2024-05-20T17:56:41.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.277+0000 7f853199d640 1 -- 172.21.15.6:0/2836895296 wait complete. 2024-05-20T17:56:41.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:41.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.404+0000 7feccad02640 1 Processor -- start 2024-05-20T17:56:41.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.404+0000 7feccad02640 1 -- start start 2024-05-20T17:56:41.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7feccad02640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecc40cf3d0 0x7fecc40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7feccad02640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fecc40ce7e0 0x7fecc40cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7feccad02640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc40cfd20 con 0x7fecc415f220 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7feccad02640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fecc40cf130 con 0x7fecc40cf3d0 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7feccad02640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fecc40cda20 con 0x7fecc40ce7e0 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecc40cf3d0 0x7fecc40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc8a9e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fecc415f220 0x7fecc40d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54488/0 (socket says 172.21.15.6:54488) 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecc40cf3d0 0x7fecc40cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34070/0 (socket says 172.21.15.6:34070) 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc8a9e640 1 -- 172.21.15.6:0/1534837354 learned_addr learned my addr 172.21.15.6:0/1534837354 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc929f640 1 --2- 172.21.15.6:0/1534837354 >> v2:172.21.15.171:3300/0 conn(0x7fecc40ce7e0 0x7fecc40cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc3fff640 1 -- 172.21.15.6:0/1534837354 >> v2:172.21.15.171:3300/0 conn(0x7fecc40ce7e0 msgr2=0x7fecc40cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc3fff640 1 --2- 172.21.15.6:0/1534837354 >> v2:172.21.15.171:3300/0 conn(0x7fecc40ce7e0 0x7fecc40cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc3fff640 1 -- 172.21.15.6:0/1534837354 >> v1:172.21.15.6:6789/0 conn(0x7fecc415f220 legacy=0x7fecc40d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc37fe640 1 -- 172.21.15.6:0/1534837354 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891527006 0 0) 0x7fecb4001110 con 0x7fecc415f220 2024-05-20T17:56:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.406+0000 7fecc3fff640 1 -- 172.21.15.6:0/1534837354 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40cdd00 con 0x7fecc40cf3d0 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.407+0000 7fecc3fff640 1 --2- 172.21.15.6:0/1534837354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc40cf3d0 0x7fecc40cf7e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fecc406e3e0 tx=0x7fecb802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78860517eb5a84cf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.407+0000 7fecc37fe640 1 -- 172.21.15.6:0/1534837354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8037070 con 0x7fecc40cf3d0 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.407+0000 7fecc37fe640 1 -- 172.21.15.6:0/1534837354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8032440 con 0x7fecc40cf3d0 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.407+0000 7fecc37fe640 1 -- 172.21.15.6:0/1534837354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb802ae60 con 0x7fecc40cf3d0 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.408+0000 7feccad02640 1 -- 172.21.15.6:0/1534837354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc40cf3d0 msgr2=0x7fecc40cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.408+0000 7feccad02640 1 --2- 172.21.15.6:0/1534837354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc40cf3d0 0x7fecc40cf7e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fecc406e3e0 tx=0x7fecb802a110 comp rx=0 tx=0).stop 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.408+0000 7feccad02640 1 -- 172.21.15.6:0/1534837354 shutdown_connections 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.408+0000 7feccad02640 1 --2- 172.21.15.6:0/1534837354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc40cf3d0 0x7fecc40cf7e0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.408+0000 7feccad02640 1 --2- 172.21.15.6:0/1534837354 >> v2:172.21.15.171:3300/0 conn(0x7fecc40ce7e0 0x7fecc40cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.408+0000 7feccad02640 1 -- 172.21.15.6:0/1534837354 >> 172.21.15.6:0/1534837354 conn(0x7fecc40b44d0 msgr2=0x7fecc40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.408+0000 7feccad02640 1 -- 172.21.15.6:0/1534837354 shutdown_connections 2024-05-20T17:56:41.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.408+0000 7feccad02640 1 -- 172.21.15.6:0/1534837354 wait complete. 2024-05-20T17:56:41.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.410+0000 7feccad02640 1 Processor -- start 2024-05-20T17:56:41.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.410+0000 7feccad02640 1 -- start start 2024-05-20T17:56:41.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7feccad02640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecc40ce7e0 0x7fecc40cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7feccad02640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc40cf3d0 0x7fecc41f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7feccad02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc415f220 0x7fecc41617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7feccad02640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40d0fd0 con 0x7fecc415f220 2024-05-20T17:56:41.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7feccad02640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40ce2c0 con 0x7fecc40ce7e0 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7feccad02640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fecc40cd680 con 0x7fecc40cf3d0 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7fecc929f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc415f220 0x7fecc41617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7fecc929f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc415f220 0x7fecc41617c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34078/0 (socket says 172.21.15.6:34078) 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.411+0000 7fecc929f640 1 -- 172.21.15.6:0/2355585593 learned_addr learned my addr 172.21.15.6:0/2355585593 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc3fff640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc40cf3d0 0x7fecc41f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc8a9e640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecc40ce7e0 0x7fecc40cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc929f640 1 -- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc40cf3d0 msgr2=0x7fecc41f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc929f640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc40cf3d0 0x7fecc41f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc929f640 1 -- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecc40ce7e0 msgr2=0x7fecc40cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc929f640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecc40ce7e0 0x7fecc40cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc929f640 1 -- 172.21.15.6:0/2355585593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40cb5a0 con 0x7fecc415f220 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc3fff640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc40cf3d0 0x7fecc41f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc8a9e640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecc40ce7e0 0x7fecc40cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc929f640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc415f220 0x7fecc41617c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009d30 tx=0x7fecbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc17fa640 1 -- 172.21.15.6:0/2355585593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc018020 con 0x7fecc415f220 2024-05-20T17:56:41.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc17fa640 1 -- 172.21.15.6:0/2355585593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc014480 con 0x7fecc415f220 2024-05-20T17:56:41.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc40cbab0 con 0x7fecc415f220 2024-05-20T17:56:41.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7fecc17fa640 1 -- 172.21.15.6:0/2355585593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc014870 con 0x7fecc415f220 2024-05-20T17:56:41.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.412+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc40b5b10 con 0x7fecc415f220 2024-05-20T17:56:41.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.413+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc4075b00 con 0x7fecc415f220 2024-05-20T17:56:41.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.414+0000 7fecc17fa640 1 -- 172.21.15.6:0/2355585593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecbc005d10 con 0x7fecc415f220 2024-05-20T17:56:41.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.414+0000 7fecc17fa640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fecb006be60 0x7fecb006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.414+0000 7fecc17fa640 1 -- 172.21.15.6:0/2355585593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7fecbc08ba60 con 0x7fecc415f220 2024-05-20T17:56:41.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.415+0000 7fecc8a9e640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fecb006be60 0x7fecb006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.415+0000 7fecc8a9e640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fecb006be60 0x7fecb006e370 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fecb4000f60 tx=0x7fecb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.419+0000 7fecc17fa640 1 -- 172.21.15.6:0/2355585593 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fecbc022070 con 0x7fecc415f220 2024-05-20T17:56:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.604+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecc4162c60 con 0x7fecc415f220 2024-05-20T17:56:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.605+0000 7fecc17fa640 1 -- 172.21.15.6:0/2355585593 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+16910 (secure 0 0 0) 0x7fecbc010040 con 0x7fecc415f220 2024-05-20T17:56:41.604 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:41.605 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":74,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:40.286365+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:38.652078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:39.261578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:41.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.607+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fecb006be60 msgr2=0x7fecb006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.607+0000 7feccad02640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fecb006be60 0x7fecb006e370 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fecb4000f60 tx=0x7fecb4009040 comp rx=0 tx=0).stop 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.607+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc415f220 msgr2=0x7fecc41617c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.607+0000 7feccad02640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc415f220 0x7fecc41617c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009d30 tx=0x7fecbc00c490 comp rx=0 tx=0).stop 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.607+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 shutdown_connections 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.608+0000 7feccad02640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fecb006be60 0x7fecb006e370 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.608+0000 7feccad02640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecc415f220 0x7fecc41617c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.608+0000 7feccad02640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecc40cf3d0 0x7fecc41f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.608+0000 7feccad02640 1 --2- 172.21.15.6:0/2355585593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecc40ce7e0 0x7fecc40cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.608+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 >> 172.21.15.6:0/2355585593 conn(0x7fecc40b44d0 msgr2=0x7fecc4151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.608+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 shutdown_connections 2024-05-20T17:56:41.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.608+0000 7feccad02640 1 -- 172.21.15.6:0/2355585593 wait complete. 2024-05-20T17:56:41.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T17:56:41.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.738+0000 7f280e91d640 1 Processor -- start 2024-05-20T17:56:41.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.738+0000 7f280e91d640 1 -- start start 2024-05-20T17:56:41.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f280e91d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f280815f220 0x7f28080d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f280e91d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080d0e00 0x7f28080cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f280e91d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28080cfd20 con 0x7f28080cf910 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f280e91d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f28080cda20 con 0x7f280815f220 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f280e91d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28080cdd00 con 0x7f28080d0e00 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f2807fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f280815f220 0x7f28080d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f28077fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080d0e00 0x7f28080cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f2807fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f280815f220 0x7f28080d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:45394/0 (socket says 172.21.15.6:45394) 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f280ceba640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f28080cf910 0x7f28080ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:56566/0 (socket says 172.21.15.6:56566) 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.739+0000 7f2807fff640 1 -- 172.21.15.6:0/2923742320 learned_addr learned my addr 172.21.15.6:0/2923742320 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.740+0000 7f2807fff640 1 -- 172.21.15.6:0/2923742320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080d0e00 msgr2=0x7f28080cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.740+0000 7f2807fff640 1 --2- 172.21.15.6:0/2923742320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080d0e00 0x7f28080cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.740+0000 7f2807fff640 1 -- 172.21.15.6:0/2923742320 >> v1:172.21.15.171:6789/0 conn(0x7f28080cf910 legacy=0x7f28080ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.740+0000 7f2807fff640 1 -- 172.21.15.6:0/2923742320 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28080cdfe0 con 0x7f280815f220 2024-05-20T17:56:41.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.740+0000 7f2807fff640 1 --2- 172.21.15.6:0/2923742320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f280815f220 0x7f28080d08c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009870 tx=0x7f27f802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd3553ff7b68d5a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f2806ffd640 1 -- 172.21.15.6:0/2923742320 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8037070 con 0x7f280815f220 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f2806ffd640 1 -- 172.21.15.6:0/2923742320 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f8032440 con 0x7f280815f220 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f2806ffd640 1 -- 172.21.15.6:0/2923742320 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8032810 con 0x7f280815f220 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f280e91d640 1 -- 172.21.15.6:0/2923742320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f280815f220 msgr2=0x7f28080d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f280e91d640 1 --2- 172.21.15.6:0/2923742320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f280815f220 0x7f28080d08c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009870 tx=0x7f27f802a1c0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f280e91d640 1 -- 172.21.15.6:0/2923742320 shutdown_connections 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f280e91d640 1 --2- 172.21.15.6:0/2923742320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080d0e00 0x7f28080cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f280e91d640 1 --2- 172.21.15.6:0/2923742320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f280815f220 0x7f28080d08c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f280e91d640 1 -- 172.21.15.6:0/2923742320 >> 172.21.15.6:0/2923742320 conn(0x7f28080b44d0 msgr2=0x7f28080b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f280e91d640 1 -- 172.21.15.6:0/2923742320 shutdown_connections 2024-05-20T17:56:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.741+0000 7f280e91d640 1 -- 172.21.15.6:0/2923742320 wait complete. 2024-05-20T17:56:41.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.743+0000 7f280e91d640 1 Processor -- start 2024-05-20T17:56:41.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.743+0000 7f280e91d640 1 -- start start 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280e91d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080cf910 0x7f28080b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280e91d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28080d0e00 0x7f2808150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280e91d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f280815f220 0x7f2808161d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280e91d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28080cd800 con 0x7f280815f220 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280e91d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28080cd680 con 0x7f28080d0e00 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280e91d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f280815f630 con 0x7f28080cf910 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f280815f220 0x7f2808161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f280815f220 0x7f2808161d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34088/0 (socket says 172.21.15.6:34088) 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 -- 172.21.15.6:0/3118227814 learned_addr learned my addr 172.21.15.6:0/3118227814 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f2807fff640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080cf910 0x7f28080b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f28077fe640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28080d0e00 0x7f2808150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 -- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080cf910 msgr2=0x7f28080b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080cf910 0x7f28080b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 -- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28080d0e00 msgr2=0x7f2808150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28080d0e00 0x7f2808150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 -- 172.21.15.6:0/3118227814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2808159320 con 0x7f280815f220 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f2807fff640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080cf910 0x7f28080b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f28077fe640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28080d0e00 0x7f2808150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.745+0000 7f280ceba640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f280815f220 0x7f2808161d40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f280000c6c0 tx=0x7f280000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.746+0000 7f2804ff9640 1 -- 172.21.15.6:0/3118227814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800018070 con 0x7f280815f220 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.746+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2808152600 con 0x7f280815f220 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.746+0000 7f2804ff9640 1 -- 172.21.15.6:0/3118227814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2800004d60 con 0x7f280815f220 2024-05-20T17:56:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.746+0000 7f2804ff9640 1 -- 172.21.15.6:0/3118227814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280000a840 con 0x7f280815f220 2024-05-20T17:56:41.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.746+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280815fa70 con 0x7f280815f220 2024-05-20T17:56:41.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.747+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2808152370 con 0x7f280815f220 2024-05-20T17:56:41.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.747+0000 7f2804ff9640 1 -- 172.21.15.6:0/3118227814 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f280000a9e0 con 0x7f280815f220 2024-05-20T17:56:41.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.748+0000 7f2804ff9640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27f406be30 0x7f27f406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:41.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.748+0000 7f2804ff9640 1 -- 172.21.15.6:0/3118227814 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f280008a4d0 con 0x7f280815f220 2024-05-20T17:56:41.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.748+0000 7f2807fff640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27f406be30 0x7f27f406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:41.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.749+0000 7f2807fff640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27f406be30 0x7f27f406e340 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f27f8034000 tx=0x7f27f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:41.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.753+0000 7f2804ff9640 1 -- 172.21.15.6:0/3118227814 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f28080cfd20 con 0x7f280815f220 2024-05-20T17:56:41.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:41.981+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2808162c60 con 0x7f280815f220 2024-05-20T17:56:42.883 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-05-20T17:56:42.885+0000 7fd48ea8d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:56:42.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.927+0000 7f2804ff9640 1 -- 172.21.15.6:0/3118227814 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) ==== 118+0+0 (secure 0 0 0) 0x7f2800058580 con 0x7f280815f220 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27f406be30 msgr2=0x7f27f406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27f406be30 0x7f27f406e340 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f27f8034000 tx=0x7f27f802e000 comp rx=0 tx=0).stop 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f280815f220 msgr2=0x7f2808161d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f280815f220 0x7f2808161d40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f280000c6c0 tx=0x7f280000cb80 comp rx=0 tx=0).stop 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 shutdown_connections 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f27f406be30 0x7f27f406e340 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f280815f220 0x7f2808161d40 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28080d0e00 0x7f2808150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:42.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 --2- 172.21.15.6:0/3118227814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28080cf910 0x7f28080b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 >> 172.21.15.6:0/3118227814 conn(0x7f28080b44d0 msgr2=0x7f28080b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 shutdown_connections 2024-05-20T17:56:42.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:42.930+0000 7f280e91d640 1 -- 172.21.15.6:0/3118227814 wait complete. 2024-05-20T17:56:42.943 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T17:56:42.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T17:56:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.070+0000 7f2424f10640 1 Processor -- start 2024-05-20T17:56:43.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.070+0000 7f2424f10640 1 -- start start 2024-05-20T17:56:43.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.071+0000 7f2424f10640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f24200b1e10 0x7f242015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.071+0000 7f2424f10640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 0x7f2420070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.071+0000 7f2424f10640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24200cd580 con 0x7f242015d530 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.071+0000 7f2424f10640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f24200ce190 con 0x7f24200b1e10 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.071+0000 7f2424f10640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f24200cd860 con 0x7f2420070850 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.072+0000 7f2417fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f24200b1e10 0x7f242015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.072+0000 7f2417fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f24200b1e10 0x7f242015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34090/0 (socket says 172.21.15.6:34090) 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.072+0000 7f2417fff640 1 -- 172.21.15.6:0/2186095832 learned_addr learned my addr 172.21.15.6:0/2186095832 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.072+0000 7f241ed9d640 1 --2- 172.21.15.6:0/2186095832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 0x7f2420070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.072+0000 7f2417fff640 1 -- 172.21.15.6:0/2186095832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 msgr2=0x7f2420070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.072+0000 7f2417fff640 1 --2- 172.21.15.6:0/2186095832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 0x7f2420070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.072+0000 7f2417fff640 1 -- 172.21.15.6:0/2186095832 >> v1:172.21.15.171:6789/0 conn(0x7f242015d530 legacy=0x7f24200b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:43.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.072+0000 7f2417fff640 1 -- 172.21.15.6:0/2186095832 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24200cdb40 con 0x7f24200b1e10 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.073+0000 7f2417fff640 1 --2- 172.21.15.6:0/2186095832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f242015aaa0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2408009870 tx=0x7f240802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463b115386f20b46 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.073+0000 7f241dd9b640 1 -- 172.21.15.6:0/2186095832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408037070 con 0x7f24200b1e10 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.073+0000 7f241dd9b640 1 -- 172.21.15.6:0/2186095832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2408032440 con 0x7f24200b1e10 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.073+0000 7f241dd9b640 1 -- 172.21.15.6:0/2186095832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408032810 con 0x7f24200b1e10 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.073+0000 7f2424f10640 1 -- 172.21.15.6:0/2186095832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 msgr2=0x7f242015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.073+0000 7f2424f10640 1 --2- 172.21.15.6:0/2186095832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f242015aaa0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f2408009870 tx=0x7f240802a270 comp rx=0 tx=0).stop 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.074+0000 7f2424f10640 1 -- 172.21.15.6:0/2186095832 shutdown_connections 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.074+0000 7f2424f10640 1 --2- 172.21.15.6:0/2186095832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 0x7f2420070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.074+0000 7f2424f10640 1 --2- 172.21.15.6:0/2186095832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f242015aaa0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.074+0000 7f2424f10640 1 -- 172.21.15.6:0/2186095832 >> 172.21.15.6:0/2186095832 conn(0x7f24200d29d0 msgr2=0x7f24200d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.074+0000 7f2424f10640 1 -- 172.21.15.6:0/2186095832 shutdown_connections 2024-05-20T17:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.074+0000 7f2424f10640 1 -- 172.21.15.6:0/2186095832 wait complete. 2024-05-20T17:56:43.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.076+0000 7f2424f10640 1 Processor -- start 2024-05-20T17:56:43.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.076+0000 7f2424f10640 1 -- start start 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2424f10640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 0x7f2420157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2424f10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f24201f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2424f10640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f242015d530 0x7f24200b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2424f10640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f24200711a0 con 0x7f24200b1e10 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2424f10640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f24200cd230 con 0x7f242015d530 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2424f10640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2420071320 con 0x7f2420070850 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2417fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f24201f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2417fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f24201f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34102/0 (socket says 172.21.15.6:34102) 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2417fff640 1 -- 172.21.15.6:0/425936150 learned_addr learned my addr 172.21.15.6:0/425936150 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f241e59c640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 0x7f2420157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f241ed9d640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f242015d530 0x7f24200b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2417fff640 1 -- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 msgr2=0x7f2420157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2417fff640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 0x7f2420157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2417fff640 1 -- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f242015d530 msgr2=0x7f24200b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2417fff640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f242015d530 0x7f24200b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f2417fff640 1 -- 172.21.15.6:0/425936150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24201f4880 con 0x7f24200b1e10 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.077+0000 7f241ed9d640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f242015d530 0x7f24200b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.078+0000 7f2417fff640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f24201f4340 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2408000c00 tx=0x7f24080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.078+0000 7f2416ffd640 1 -- 172.21.15.6:0/425936150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408037040 con 0x7f24200b1e10 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.078+0000 7f2416ffd640 1 -- 172.21.15.6:0/425936150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2408042070 con 0x7f24200b1e10 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.078+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242015be20 con 0x7f24200b1e10 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.078+0000 7f2416ffd640 1 -- 172.21.15.6:0/425936150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408030880 con 0x7f24200b1e10 2024-05-20T17:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.078+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f242015c3e0 con 0x7f24200b1e10 2024-05-20T17:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.079+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242015bb80 con 0x7f24200b1e10 2024-05-20T17:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.080+0000 7f2416ffd640 1 -- 172.21.15.6:0/425936150 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2408030a20 con 0x7f24200b1e10 2024-05-20T17:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.080+0000 7f2416ffd640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240006be30 0x7f240006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.080+0000 7f2416ffd640 1 -- 172.21.15.6:0/425936150 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f24080ab7d0 con 0x7f24200b1e10 2024-05-20T17:56:43.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.081+0000 7f241e59c640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240006be30 0x7f240006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:43.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.081+0000 7f241e59c640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240006be30 0x7f240006e340 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2410007fd0 tx=0x7f2410009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:43.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.085+0000 7f2416ffd640 1 -- 172.21.15.6:0/425936150 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f242015bb80 con 0x7f24200b1e10 2024-05-20T17:56:43.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.309+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2420075b00 con 0x7f24200b1e10 2024-05-20T17:56:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.929+0000 7f2416ffd640 1 -- 172.21.15.6:0/425936150 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7f24201f4880 con 0x7f24200b1e10 2024-05-20T17:56:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240006be30 msgr2=0x7f240006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240006be30 0x7f240006e340 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2410007fd0 tx=0x7f2410009040 comp rx=0 tx=0).stop 2024-05-20T17:56:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 msgr2=0x7f24201f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f24201f4340 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2408000c00 tx=0x7f24080046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 shutdown_connections 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f240006be30 0x7f240006e340 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f242015d530 0x7f24200b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24200b1e10 0x7f24201f4340 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 --2- 172.21.15.6:0/425936150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2420070850 0x7f2420157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.931+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 >> 172.21.15.6:0/425936150 conn(0x7f24200d29d0 msgr2=0x7f24200d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.932+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 shutdown_connections 2024-05-20T17:56:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:43.932+0000 7f2424f10640 1 -- 172.21.15.6:0/425936150 wait complete. 2024-05-20T17:56:43.945 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T17:56:43.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.069+0000 7f6dfa9c7640 1 Processor -- start 2024-05-20T17:56:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.069+0000 7f6dfa9c7640 1 -- start start 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6dfa9c7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6dfa9c7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6df406dae0 0x7f6df40b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6dfa9c7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df40d0630 con 0x7f6df40b3e80 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6dfa9c7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6df40d39c0 con 0x7f6df406dae0 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6dfa9c7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6df40d3ca0 con 0x7f6df4162820 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df3fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df8f64640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6df406dae0 0x7f6df40b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df37fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f6df40b3e80 0x7f6df406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:56586/0 (socket says 172.21.15.6:56586) 2024-05-20T17:56:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df37fe640 1 -- 172.21.15.6:0/3133578575 learned_addr learned my addr 172.21.15.6:0/3133578575 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df3fff640 1 -- 172.21.15.6:0/3133578575 >> v2:172.21.15.171:3300/0 conn(0x7f6df406dae0 msgr2=0x7f6df40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df3fff640 1 --2- 172.21.15.6:0/3133578575 >> v2:172.21.15.171:3300/0 conn(0x7f6df406dae0 0x7f6df40b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df3fff640 1 -- 172.21.15.6:0/3133578575 >> v1:172.21.15.171:6789/0 conn(0x7f6df40b3e80 legacy=0x7f6df406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df3fff640 1 -- 172.21.15.6:0/3133578575 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df40d3f80 con 0x7f6df4162820 2024-05-20T17:56:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df2ffd640 1 -- 172.21.15.6:0/3133578575 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540328665 0 0) 0x7f6df40d0630 con 0x7f6df40b3e80 2024-05-20T17:56:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.071+0000 7f6df8f64640 1 --2- 172.21.15.6:0/3133578575 >> v2:172.21.15.171:3300/0 conn(0x7f6df406dae0 0x7f6df40b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.073+0000 7f6df3fff640 1 --2- 172.21.15.6:0/3133578575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df40b3940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6de40097a0 tx=0x7f6de402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65572e46e80ebc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.073+0000 7f6df2ffd640 1 -- 172.21.15.6:0/3133578575 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4037070 con 0x7f6df4162820 2024-05-20T17:56:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.073+0000 7f6df2ffd640 1 -- 172.21.15.6:0/3133578575 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de4032440 con 0x7f6df4162820 2024-05-20T17:56:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.073+0000 7f6df2ffd640 1 -- 172.21.15.6:0/3133578575 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4032810 con 0x7f6df4162820 2024-05-20T17:56:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.073+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/3133578575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 msgr2=0x7f6df40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.073+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/3133578575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df40b3940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6de40097a0 tx=0x7f6de402a180 comp rx=0 tx=0).stop 2024-05-20T17:56:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.074+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/3133578575 shutdown_connections 2024-05-20T17:56:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.074+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/3133578575 >> v2:172.21.15.171:3300/0 conn(0x7f6df406dae0 0x7f6df40b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.074+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/3133578575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df40b3940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.074+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/3133578575 >> 172.21.15.6:0/3133578575 conn(0x7f6df40d4bd0 msgr2=0x7f6df40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.074+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/3133578575 shutdown_connections 2024-05-20T17:56:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.074+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/3133578575 wait complete. 2024-05-20T17:56:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.075+0000 7f6dfa9c7640 1 Processor -- start 2024-05-20T17:56:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.076+0000 7f6dfa9c7640 1 -- start start 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6dfa9c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40b3e80 0x7f6df41f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6dfa9c7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df4159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6dfa9c7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6df40ca9c0 0x7f6df40cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6dfa9c7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6df40d4780 con 0x7f6df40b3e80 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6dfa9c7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6df40d0300 con 0x7f6df40ca9c0 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6dfa9c7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6df40d4900 con 0x7f6df4162820 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40b3e80 0x7f6df41f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40b3e80 0x7f6df41f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34104/0 (socket says 172.21.15.6:34104) 2024-05-20T17:56:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df3fff640 1 -- 172.21.15.6:0/2593845816 learned_addr learned my addr 172.21.15.6:0/2593845816 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df37fe640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df4159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df8f64640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6df40ca9c0 0x7f6df40cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df3fff640 1 -- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 msgr2=0x7f6df4159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df3fff640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df4159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df3fff640 1 -- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6df40ca9c0 msgr2=0x7f6df40cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df3fff640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6df40ca9c0 0x7f6df40cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df3fff640 1 -- 172.21.15.6:0/2593845816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df40cb310 con 0x7f6df40b3e80 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.077+0000 7f6df37fe640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df4159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.078+0000 7f6df3fff640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40b3e80 0x7f6df41f2100 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6de4000c00 tx=0x7f6de40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.078+0000 7f6df0ff9640 1 -- 172.21.15.6:0/2593845816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4037050 con 0x7f6df40b3e80 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.078+0000 7f6df0ff9640 1 -- 172.21.15.6:0/2593845816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de4038040 con 0x7f6df40b3e80 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.078+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df4159b10 con 0x7f6df40b3e80 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.078+0000 7f6df0ff9640 1 -- 172.21.15.6:0/2593845816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4004470 con 0x7f6df40b3e80 2024-05-20T17:56:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.078+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df415a0d0 con 0x7f6df40b3e80 2024-05-20T17:56:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.079+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df4075b00 con 0x7f6df40b3e80 2024-05-20T17:56:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.080+0000 7f6df0ff9640 1 -- 172.21.15.6:0/2593845816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6de4003610 con 0x7f6df40b3e80 2024-05-20T17:56:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.080+0000 7f6df0ff9640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6de006be60 0x7f6de006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.080+0000 7f6df0ff9640 1 -- 172.21.15.6:0/2593845816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f6de40ab840 con 0x7f6df40b3e80 2024-05-20T17:56:44.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.080+0000 7f6df37fe640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6de006be60 0x7f6de006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.081+0000 7f6df37fe640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6de006be60 0x7f6de006e370 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6de8007fd0 tx=0x7f6de8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.085+0000 7f6df0ff9640 1 -- 172.21.15.6:0/2593845816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6de404c020 con 0x7f6df40b3e80 2024-05-20T17:56:44.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.306+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6df415f910 con 0x7f6df40b3e80 2024-05-20T17:56:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.307+0000 7f6df0ff9640 1 -- 172.21.15.6:0/2593845816 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7f6df40cb310 con 0x7f6df40b3e80 2024-05-20T17:56:44.306 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:44.306 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:40.286706+0000","modified":"2024-05-20T17:56:43.311702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/693481794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":693481794},{"type":"v1","addr":"172.21.15.6:6835","nonce":693481794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6681,"qdb_cluster":[6681]},"id":5}]} 2024-05-20T17:56:44.306 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 44 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6de006be60 msgr2=0x7f6de006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6de006be60 0x7f6de006e370 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6de8007fd0 tx=0x7f6de8007de0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40b3e80 msgr2=0x7f6df41f2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40b3e80 0x7f6df41f2100 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f6de4000c00 tx=0x7f6de40046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 shutdown_connections 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6de006be60 0x7f6de006e370 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6df40ca9c0 0x7f6df40cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6df4162820 0x7f6df4159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 --2- 172.21.15.6:0/2593845816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6df40b3e80 0x7f6df41f2100 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 >> 172.21.15.6:0/2593845816 conn(0x7f6df40d4bd0 msgr2=0x7f6df415e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:44.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 shutdown_connections 2024-05-20T17:56:44.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.309+0000 7f6dfa9c7640 1 -- 172.21.15.6:0/2593845816 wait complete. 2024-05-20T17:56:44.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.436+0000 7f5c419c3640 1 Processor -- start 2024-05-20T17:56:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.436+0000 7f5c419c3640 1 -- start start 2024-05-20T17:56:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c419c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c3c06d3d0 0x7f5c3c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c419c3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c06dd20 con 0x7f5c3c162820 2024-05-20T17:56:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c419c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c0d0630 con 0x7f5c3c0b8190 2024-05-20T17:56:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c419c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3c0d39c0 con 0x7f5c3c06d3d0 2024-05-20T17:56:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c33fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c3c06d3d0 0x7f5c3c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c3affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5c3c162820 0x7f5c3c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54504/0 (socket says 172.21.15.6:54504) 2024-05-20T17:56:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c3affd640 1 -- 172.21.15.6:0/2647557834 learned_addr learned my addr 172.21.15.6:0/2647557834 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c33fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c3c06d3d0 0x7f5c3c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34116/0 (socket says 172.21.15.6:34116) 2024-05-20T17:56:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c33fff640 1 -- 172.21.15.6:0/2647557834 >> v1:172.21.15.171:6789/0 conn(0x7f5c3c0b8190 legacy=0x7f5c3c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c33fff640 1 -- 172.21.15.6:0/2647557834 >> v1:172.21.15.6:6789/0 conn(0x7f5c3c162820 legacy=0x7f5c3c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c33fff640 1 -- 172.21.15.6:0/2647557834 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c0d3ca0 con 0x7f5c3c06d3d0 2024-05-20T17:56:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.438+0000 7f5c3a7fc640 1 -- 172.21.15.6:0/2647557834 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266721368 0 0) 0x7f5c2c001110 con 0x7f5c3c162820 2024-05-20T17:56:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.439+0000 7f5c33fff640 1 --2- 172.21.15.6:0/2647557834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c06d3d0 0x7f5c3c06d7e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5c240097a0 tx=0x7f5c2402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b1b123670517f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.439+0000 7f5c3a7fc640 1 -- 172.21.15.6:0/2647557834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24037070 con 0x7f5c3c06d3d0 2024-05-20T17:56:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.439+0000 7f5c3a7fc640 1 -- 172.21.15.6:0/2647557834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c24032440 con 0x7f5c3c06d3d0 2024-05-20T17:56:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.439+0000 7f5c3a7fc640 1 -- 172.21.15.6:0/2647557834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24032810 con 0x7f5c3c06d3d0 2024-05-20T17:56:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.440+0000 7f5c419c3640 1 -- 172.21.15.6:0/2647557834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c06d3d0 msgr2=0x7f5c3c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.440+0000 7f5c419c3640 1 --2- 172.21.15.6:0/2647557834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c06d3d0 0x7f5c3c06d7e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5c240097a0 tx=0x7f5c2402a230 comp rx=0 tx=0).stop 2024-05-20T17:56:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.440+0000 7f5c419c3640 1 -- 172.21.15.6:0/2647557834 shutdown_connections 2024-05-20T17:56:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.440+0000 7f5c419c3640 1 --2- 172.21.15.6:0/2647557834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c06d3d0 0x7f5c3c06d7e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.440+0000 7f5c419c3640 1 -- 172.21.15.6:0/2647557834 >> 172.21.15.6:0/2647557834 conn(0x7f5c3c0d4bd0 msgr2=0x7f5c3c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.440+0000 7f5c419c3640 1 -- 172.21.15.6:0/2647557834 shutdown_connections 2024-05-20T17:56:44.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.440+0000 7f5c419c3640 1 -- 172.21.15.6:0/2647557834 wait complete. 2024-05-20T17:56:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.442+0000 7f5c419c3640 1 Processor -- start 2024-05-20T17:56:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.442+0000 7f5c419c3640 1 -- start start 2024-05-20T17:56:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c419c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c3c06d3d0 0x7f5c3c154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c419c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0b8190 0x7f5c3c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c419c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c3c162820 0x7f5c3c0b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c419c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0d0300 con 0x7f5c3c0b8190 2024-05-20T17:56:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c419c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0d42e0 con 0x7f5c3c162820 2024-05-20T17:56:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c419c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c0b4050 con 0x7f5c3c06d3d0 2024-05-20T17:56:44.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c33fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0b8190 0x7f5c3c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c33fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0b8190 0x7f5c3c0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34124/0 (socket says 172.21.15.6:34124) 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.443+0000 7f5c33fff640 1 -- 172.21.15.6:0/1537425763 learned_addr learned my addr 172.21.15.6:0/1537425763 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c3b7fe640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c3c162820 0x7f5c3c0b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c3affd640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c3c06d3d0 0x7f5c3c154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c33fff640 1 -- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c3c06d3d0 msgr2=0x7f5c3c154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c33fff640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c3c06d3d0 0x7f5c3c154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c33fff640 1 -- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c3c162820 msgr2=0x7f5c3c0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c33fff640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c3c162820 0x7f5c3c0b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c33fff640 1 -- 172.21.15.6:0/1537425763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c0ca750 con 0x7f5c3c0b8190 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c3b7fe640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c3c162820 0x7f5c3c0b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c3affd640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c3c06d3d0 0x7f5c3c154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c33fff640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0b8190 0x7f5c3c0ce7a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5c240098c0 tx=0x7f5c240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c38ff9640 1 -- 172.21.15.6:0/1537425763 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24037040 con 0x7f5c3c0b8190 2024-05-20T17:56:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c38ff9640 1 -- 172.21.15.6:0/1537425763 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c24042070 con 0x7f5c3c0b8190 2024-05-20T17:56:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c0caa30 con 0x7f5c3c0b8190 2024-05-20T17:56:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c38ff9640 1 -- 172.21.15.6:0/1537425763 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24030a70 con 0x7f5c3c0b8190 2024-05-20T17:56:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.444+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c0caff0 con 0x7f5c3c0b8190 2024-05-20T17:56:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.445+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3c075b00 con 0x7f5c3c0b8190 2024-05-20T17:56:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.446+0000 7f5c38ff9640 1 -- 172.21.15.6:0/1537425763 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c24030c10 con 0x7f5c3c0b8190 2024-05-20T17:56:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.446+0000 7f5c38ff9640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5c1c06be30 0x7f5c1c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.446+0000 7f5c38ff9640 1 -- 172.21.15.6:0/1537425763 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f5c240ab8f0 con 0x7f5c3c0b8190 2024-05-20T17:56:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.447+0000 7f5c3affd640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5c1c06be30 0x7f5c1c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.447+0000 7f5c3affd640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5c1c06be30 0x7f5c1c06e340 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c000f60 tx=0x7f5c2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.451+0000 7f5c38ff9640 1 -- 172.21.15.6:0/1537425763 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5c24045360 con 0x7f5c3c0b8190 2024-05-20T17:56:44.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.635+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c3c0d5230 con 0x7f5c3c0b8190 2024-05-20T17:56:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.636+0000 7f5c38ff9640 1 -- 172.21.15.6:0/1537425763 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16897 (secure 0 0 0) 0x7f5c2407a110 con 0x7f5c3c0b8190 2024-05-20T17:56:44.635 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:44.635 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:41.911814+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:38.652078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:39.261578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:44.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5c1c06be30 msgr2=0x7f5c1c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5c1c06be30 0x7f5c1c06e340 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c000f60 tx=0x7f5c2c009040 comp rx=0 tx=0).stop 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0b8190 msgr2=0x7f5c3c0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0b8190 0x7f5c3c0ce7a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5c240098c0 tx=0x7f5c240046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 shutdown_connections 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5c1c06be30 0x7f5c1c06e340 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c3c162820 0x7f5c3c0b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c3c0b8190 0x7f5c3c0ce7a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 --2- 172.21.15.6:0/1537425763 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c3c06d3d0 0x7f5c3c154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 >> 172.21.15.6:0/1537425763 conn(0x7f5c3c0d4bd0 msgr2=0x7f5c3c160760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 shutdown_connections 2024-05-20T17:56:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.638+0000 7f5c419c3640 1 -- 172.21.15.6:0/1537425763 wait complete. 2024-05-20T17:56:44.649 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T17:56:44.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:56:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.766+0000 7f5ba6051640 1 Processor -- start 2024-05-20T17:56:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.766+0000 7f5ba6051640 1 -- start start 2024-05-20T17:56:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.767+0000 7f5ba6051640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5ba00d14f0 0x7f5ba00b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.767+0000 7f5ba6051640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba00d1ac0 con 0x7f5ba00d10e0 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.767+0000 7f5ba6051640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba00d1da0 con 0x7f5ba00cf850 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.767+0000 7f5ba6051640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba00d2080 con 0x7f5ba00d14f0 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.767+0000 7f5b9f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ba00d10e0 0x7f5ba00cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54514/0 (socket says 172.21.15.6:54514) 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.767+0000 7f5b9f7fe640 1 -- 172.21.15.6:0/1775667922 learned_addr learned my addr 172.21.15.6:0/1775667922 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9ffff640 1 --2- 172.21.15.6:0/1775667922 >> v2:172.21.15.171:3300/0 conn(0x7f5ba00d14f0 0x7f5ba00b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819973770 0 0) 0x7f5ba00d1ac0 con 0x7f5ba00d10e0 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b88003520 con 0x7f5ba00d10e0 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2713632415 0 0) 0x7f5b88003520 con 0x7f5ba00d10e0 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 >> v2:172.21.15.171:3300/0 conn(0x7f5ba00d14f0 msgr2=0x7f5ba00b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 --2- 172.21.15.6:0/1775667922 >> v2:172.21.15.171:3300/0 conn(0x7f5ba00d14f0 0x7f5ba00b6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 >> v1:172.21.15.171:6789/0 conn(0x7f5ba00cf850 legacy=0x7f5ba00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba00d2360 con 0x7f5ba00d10e0 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5b90001670 con 0x7f5ba00d10e0 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 >> v1:172.21.15.6:6789/0 conn(0x7f5ba00d10e0 legacy=0x7f5ba00cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5b880039b0 0x7f5b88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5b88004800 0x7f5b88004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5b8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba00d2080 con 0x7f5b88005150 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8800c0c0 con 0x7f5b88004800 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8800c2c0 con 0x7f5b880039b0 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9ffff640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5b8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9f7fe640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5b880039b0 0x7f5b88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.768+0000 7f5b9effd640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5b88004800 0x7f5b88004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.769+0000 7f5b9ffff640 1 -- 172.21.15.6:0/1775667922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5b880039b0 msgr2=0x7f5b88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.769+0000 7f5b9ffff640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5b880039b0 0x7f5b88003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.769+0000 7f5b9ffff640 1 -- 172.21.15.6:0/1775667922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5b88004800 msgr2=0x7f5b88004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:44.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.769+0000 7f5b9ffff640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5b88004800 0x7f5b88004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.769+0000 7f5b9ffff640 1 -- 172.21.15.6:0/1775667922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b88003520 con 0x7f5b88005150 2024-05-20T17:56:44.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.769+0000 7f5b9ffff640 1 -- 172.21.15.6:0/1775667922 reap_dead start 2024-05-20T17:56:44.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.769+0000 7f5b9ffff640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5b8800b9c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009f90 tx=0x7f5b88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9918e2c8012dce server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.769+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b98009c10 con 0x7f5b88005150 2024-05-20T17:56:44.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b98031440 con 0x7f5b88005150 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5b9e7fc640 1 -- 172.21.15.6:0/1775667922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b980317f0 con 0x7f5b88005150 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5ba6051640 1 -- 172.21.15.6:0/1775667922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 msgr2=0x7f5b8800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5ba6051640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5b8800b9c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009f90 tx=0x7f5b88005830 comp rx=0 tx=0).stop 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5ba6051640 1 -- 172.21.15.6:0/1775667922 shutdown_connections 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5ba6051640 1 --2- 172.21.15.6:0/1775667922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5b8800b9c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5ba6051640 1 -- 172.21.15.6:0/1775667922 >> 172.21.15.6:0/1775667922 conn(0x7f5ba00b44d0 msgr2=0x7f5ba00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5ba6051640 1 -- 172.21.15.6:0/1775667922 shutdown_connections 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.770+0000 7f5ba6051640 1 -- 172.21.15.6:0/1775667922 wait complete. 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.772+0000 7f5ba6051640 1 Processor -- start 2024-05-20T17:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.772+0000 7f5ba6051640 1 -- start start 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5ba6051640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5ba015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5ba6051640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba015f9e0 0x7f5ba015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5ba6051640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ba00ccef0 0x7f5ba00cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5ba6051640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba00b8440 con 0x7f5b88005150 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5ba6051640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba00b82c0 con 0x7f5ba015f9e0 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5ba6051640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba00709f0 con 0x7f5ba00ccef0 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5ba015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5ba015bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34154/0 (socket says 172.21.15.6:34154) 2024-05-20T17:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 -- 172.21.15.6:0/1225014959 learned_addr learned my addr 172.21.15.6:0/1225014959 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9ffff640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ba00ccef0 0x7f5ba00cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 -- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ba00ccef0 msgr2=0x7f5ba00cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ba00ccef0 0x7f5ba00cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 -- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba015f9e0 msgr2=0x7f5ba015fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9effd640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba015f9e0 0x7f5ba015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba015f9e0 0x7f5ba015fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 -- 172.21.15.6:0/1225014959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba01606d0 con 0x7f5b88005150 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b9f7fe640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5ba015bf80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5b90007310 tx=0x7f5b900077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b87fff640 1 -- 172.21.15.6:0/1225014959 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9001a070 con 0x7f5b88005150 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b87fff640 1 -- 172.21.15.6:0/1225014959 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9000f8e0 con 0x7f5b88005150 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba00cd840 con 0x7f5b88005150 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5b87fff640 1 -- 172.21.15.6:0/1225014959 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000fc90 con 0x7f5b88005150 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.774+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba015ebb0 con 0x7f5b88005150 2024-05-20T17:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.775+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba0075b00 con 0x7f5b88005150 2024-05-20T17:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.776+0000 7f5b87fff640 1 -- 172.21.15.6:0/1225014959 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b9001d070 con 0x7f5b88005150 2024-05-20T17:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.776+0000 7f5b87fff640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b8c06be30 0x7f5b8c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.777+0000 7f5b87fff640 1 -- 172.21.15.6:0/1225014959 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f5b9008aaf0 con 0x7f5b88005150 2024-05-20T17:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.777+0000 7f5b9effd640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b8c06be30 0x7f5b8c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.777+0000 7f5b9effd640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b8c06be30 0x7f5b8c06e340 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00b6d50 tx=0x7f5b94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.781+0000 7f5b87fff640 1 -- 172.21.15.6:0/1225014959 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5ba00cd840 con 0x7f5b88005150 2024-05-20T17:56:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.961+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ba015c4c0 con 0x7f5b8c06be30 2024-05-20T17:56:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.968+0000 7f5b87fff640 1 -- 172.21.15.6:0/1225014959 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252073 (secure 0 0 0) 0x7f5b940014b0 con 0x7f5b8c06be30 2024-05-20T17:56:44.970 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:56:44.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b8c06be30 msgr2=0x7f5b8c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b8c06be30 0x7f5b8c06e340 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00b6d50 tx=0x7f5b94009040 comp rx=0 tx=0).stop 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 msgr2=0x7f5ba015bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5ba015bf80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5b90007310 tx=0x7f5b900077d0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 shutdown_connections 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b8c06be30 0x7f5b8c06e340 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ba00ccef0 0x7f5ba00cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ba015f9e0 0x7f5ba015fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 --2- 172.21.15.6:0/1225014959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b88005150 0x7f5ba015bf80 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 >> 172.21.15.6:0/1225014959 conn(0x7f5ba00b44d0 msgr2=0x7f5ba00b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 shutdown_connections 2024-05-20T17:56:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:44.971+0000 7f5ba6051640 1 -- 172.21.15.6:0/1225014959 wait complete. 2024-05-20T17:56:44.981 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-05-20T17:56:44.286743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237060,"kb_used_data":8392,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754737660,"statfs":{"total":773094113280,"available":772851363840,"internally_reserved":0,"allocated":8593408,"data_stored":4534436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.397606"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919643+0000","last_change":"2024-05-20T17:56:40.922340+0000","last_active":"2024-05-20T17:56:41.919643+0000","last_peered":"2024-05-20T17:56:41.919643+0000","last_clean":"2024-05-20T17:56:41.919643+0000","last_became_active":"2024-05-20T17:56:40.922036+0000","last_became_peered":"2024-05-20T17:56:40.922036+0000","last_unstale":"2024-05-20T17:56:41.919643+0000","last_undegraded":"2024-05-20T17:56:41.919643+0000","last_fullsized":"2024-05-20T17:56:41.919643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:57.545728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922564+0000","last_change":"2024-05-20T17:56:40.927034+0000","last_active":"2024-05-20T17:56:41.922564+0000","last_peered":"2024-05-20T17:56:41.922564+0000","last_clean":"2024-05-20T17:56:41.922564+0000","last_became_active":"2024-05-20T17:56:40.926707+0000","last_became_peered":"2024-05-20T17:56:40.926707+0000","last_unstale":"2024-05-20T17:56:41.922564+0000","last_undegraded":"2024-05-20T17:56:41.922564+0000","last_fullsized":"2024-05-20T17:56:41.922564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:21.339732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913461+0000","last_change":"2024-05-20T17:56:40.937785+0000","last_active":"2024-05-20T17:56:42.913461+0000","last_peered":"2024-05-20T17:56:42.913461+0000","last_clean":"2024-05-20T17:56:42.913461+0000","last_became_active":"2024-05-20T17:56:40.937466+0000","last_became_peered":"2024-05-20T17:56:40.937466+0000","last_unstale":"2024-05-20T17:56:42.913461+0000","last_undegraded":"2024-05-20T17:56:42.913461+0000","last_fullsized":"2024-05-20T17:56:42.913461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:21:13.020466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018123+0000","last_change":"2024-05-20T17:56:40.922861+0000","last_active":"2024-05-20T17:56:42.018123+0000","last_peered":"2024-05-20T17:56:42.018123+0000","last_clean":"2024-05-20T17:56:42.018123+0000","last_became_active":"2024-05-20T17:56:40.922549+0000","last_became_peered":"2024-05-20T17:56:40.922549+0000","last_unstale":"2024-05-20T17:56:42.018123+0000","last_undegraded":"2024-05-20T17:56:42.018123+0000","last_fullsized":"2024-05-20T17:56:42.018123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:56:48.250131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927029+0000","last_change":"2024-05-20T17:56:40.934778+0000","last_active":"2024-05-20T17:56:41.927029+0000","last_peered":"2024-05-20T17:56:41.927029+0000","last_clean":"2024-05-20T17:56:41.927029+0000","last_became_active":"2024-05-20T17:56:40.933766+0000","last_became_peered":"2024-05-20T17:56:40.933766+0000","last_unstale":"2024-05-20T17:56:41.927029+0000","last_undegraded":"2024-05-20T17:56:41.927029+0000","last_fullsized":"2024-05-20T17:56:41.927029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:35:02.188379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915423+0000","last_change":"2024-05-20T17:56:40.929637+0000","last_active":"2024-05-20T17:56:41.915423+0000","last_peered":"2024-05-20T17:56:41.915423+0000","last_clean":"2024-05-20T17:56:41.915423+0000","last_became_active":"2024-05-20T17:56:40.929294+0000","last_became_peered":"2024-05-20T17:56:40.929294+0000","last_unstale":"2024-05-20T17:56:41.915423+0000","last_undegraded":"2024-05-20T17:56:41.915423+0000","last_fullsized":"2024-05-20T17:56:41.915423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.026836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913751+0000","last_change":"2024-05-20T17:56:40.933365+0000","last_active":"2024-05-20T17:56:42.913751+0000","last_peered":"2024-05-20T17:56:42.913751+0000","last_clean":"2024-05-20T17:56:42.913751+0000","last_became_active":"2024-05-20T17:56:40.933037+0000","last_became_peered":"2024-05-20T17:56:40.933037+0000","last_unstale":"2024-05-20T17:56:42.913751+0000","last_undegraded":"2024-05-20T17:56:42.913751+0000","last_fullsized":"2024-05-20T17:56:42.913751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:51.966671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926748+0000","last_change":"2024-05-20T17:56:40.928673+0000","last_active":"2024-05-20T17:56:41.926748+0000","last_peered":"2024-05-20T17:56:41.926748+0000","last_clean":"2024-05-20T17:56:41.926748+0000","last_became_active":"2024-05-20T17:56:40.923768+0000","last_became_peered":"2024-05-20T17:56:40.923768+0000","last_unstale":"2024-05-20T17:56:41.926748+0000","last_undegraded":"2024-05-20T17:56:41.926748+0000","last_fullsized":"2024-05-20T17:56:41.926748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:04.959648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918773+0000","last_change":"2024-05-20T17:56:40.921801+0000","last_active":"2024-05-20T17:56:41.918773+0000","last_peered":"2024-05-20T17:56:41.918773+0000","last_clean":"2024-05-20T17:56:41.918773+0000","last_became_active":"2024-05-20T17:56:40.921503+0000","last_became_peered":"2024-05-20T17:56:40.921503+0000","last_unstale":"2024-05-20T17:56:41.918773+0000","last_undegraded":"2024-05-20T17:56:41.918773+0000","last_fullsized":"2024-05-20T17:56:41.918773+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:11.379012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018504+0000","last_change":"2024-05-20T17:56:40.920390+0000","last_active":"2024-05-20T17:56:42.018504+0000","last_peered":"2024-05-20T17:56:42.018504+0000","last_clean":"2024-05-20T17:56:42.018504+0000","last_became_active":"2024-05-20T17:56:40.920085+0000","last_became_peered":"2024-05-20T17:56:40.920085+0000","last_unstale":"2024-05-20T17:56:42.018504+0000","last_undegraded":"2024-05-20T17:56:42.018504+0000","last_fullsized":"2024-05-20T17:56:42.018504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:30:24.106840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922577+0000","last_change":"2024-05-20T17:56:40.944167+0000","last_active":"2024-05-20T17:56:41.922577+0000","last_peered":"2024-05-20T17:56:41.922577+0000","last_clean":"2024-05-20T17:56:41.922577+0000","last_became_active":"2024-05-20T17:56:40.943658+0000","last_became_peered":"2024-05-20T17:56:40.943658+0000","last_unstale":"2024-05-20T17:56:41.922577+0000","last_undegraded":"2024-05-20T17:56:41.922577+0000","last_fullsized":"2024-05-20T17:56:41.922577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:50:10.577581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018313+0000","last_change":"2024-05-20T17:56:40.920030+0000","last_active":"2024-05-20T17:56:42.018313+0000","last_peered":"2024-05-20T17:56:42.018313+0000","last_clean":"2024-05-20T17:56:42.018313+0000","last_became_active":"2024-05-20T17:56:40.919607+0000","last_became_peered":"2024-05-20T17:56:40.919607+0000","last_unstale":"2024-05-20T17:56:42.018313+0000","last_undegraded":"2024-05-20T17:56:42.018313+0000","last_fullsized":"2024-05-20T17:56:42.018313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:37:16.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927210+0000","last_change":"2024-05-20T17:56:40.933148+0000","last_active":"2024-05-20T17:56:41.927210+0000","last_peered":"2024-05-20T17:56:41.927210+0000","last_clean":"2024-05-20T17:56:41.927210+0000","last_became_active":"2024-05-20T17:56:40.932778+0000","last_became_peered":"2024-05-20T17:56:40.932778+0000","last_unstale":"2024-05-20T17:56:41.927210+0000","last_undegraded":"2024-05-20T17:56:41.927210+0000","last_fullsized":"2024-05-20T17:56:41.927210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:05.812791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915177+0000","last_change":"2024-05-20T17:56:40.927684+0000","last_active":"2024-05-20T17:56:41.915177+0000","last_peered":"2024-05-20T17:56:41.915177+0000","last_clean":"2024-05-20T17:56:41.915177+0000","last_became_active":"2024-05-20T17:56:40.927296+0000","last_became_peered":"2024-05-20T17:56:40.927296+0000","last_unstale":"2024-05-20T17:56:41.915177+0000","last_undegraded":"2024-05-20T17:56:41.915177+0000","last_fullsized":"2024-05-20T17:56:41.915177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:43.887338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922050+0000","last_change":"2024-05-20T17:56:40.914006+0000","last_active":"2024-05-20T17:56:41.922050+0000","last_peered":"2024-05-20T17:56:41.922050+0000","last_clean":"2024-05-20T17:56:41.922050+0000","last_became_active":"2024-05-20T17:56:40.913679+0000","last_became_peered":"2024-05-20T17:56:40.913679+0000","last_unstale":"2024-05-20T17:56:41.922050+0000","last_undegraded":"2024-05-20T17:56:41.922050+0000","last_fullsized":"2024-05-20T17:56:41.922050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.026836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918596+0000","last_change":"2024-05-20T17:56:40.922736+0000","last_active":"2024-05-20T17:56:41.918596+0000","last_peered":"2024-05-20T17:56:41.918596+0000","last_clean":"2024-05-20T17:56:41.918596+0000","last_became_active":"2024-05-20T17:56:40.922393+0000","last_became_peered":"2024-05-20T17:56:40.922393+0000","last_unstale":"2024-05-20T17:56:41.918596+0000","last_undegraded":"2024-05-20T17:56:41.918596+0000","last_fullsized":"2024-05-20T17:56:41.918596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:10.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927159+0000","last_change":"2024-05-20T17:56:40.937475+0000","last_active":"2024-05-20T17:56:41.927159+0000","last_peered":"2024-05-20T17:56:41.927159+0000","last_clean":"2024-05-20T17:56:41.927159+0000","last_became_active":"2024-05-20T17:56:40.937069+0000","last_became_peered":"2024-05-20T17:56:40.937069+0000","last_unstale":"2024-05-20T17:56:41.927159+0000","last_undegraded":"2024-05-20T17:56:41.927159+0000","last_fullsized":"2024-05-20T17:56:41.927159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:51.069747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913366+0000","last_change":"2024-05-20T17:56:40.925623+0000","last_active":"2024-05-20T17:56:42.913366+0000","last_peered":"2024-05-20T17:56:42.913366+0000","last_clean":"2024-05-20T17:56:42.913366+0000","last_became_active":"2024-05-20T17:56:40.925247+0000","last_became_peered":"2024-05-20T17:56:40.925247+0000","last_unstale":"2024-05-20T17:56:42.913366+0000","last_undegraded":"2024-05-20T17:56:42.913366+0000","last_fullsized":"2024-05-20T17:56:42.913366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:05.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915267+0000","last_change":"2024-05-20T17:56:40.939158+0000","last_active":"2024-05-20T17:56:41.915267+0000","last_peered":"2024-05-20T17:56:41.915267+0000","last_clean":"2024-05-20T17:56:41.915267+0000","last_became_active":"2024-05-20T17:56:40.938834+0000","last_became_peered":"2024-05-20T17:56:40.938834+0000","last_unstale":"2024-05-20T17:56:41.915267+0000","last_undegraded":"2024-05-20T17:56:41.915267+0000","last_fullsized":"2024-05-20T17:56:41.915267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:02:31.854410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927066+0000","last_change":"2024-05-20T17:56:40.933675+0000","last_active":"2024-05-20T17:56:41.927066+0000","last_peered":"2024-05-20T17:56:41.927066+0000","last_clean":"2024-05-20T17:56:41.927066+0000","last_became_active":"2024-05-20T17:56:40.932937+0000","last_became_peered":"2024-05-20T17:56:40.932937+0000","last_unstale":"2024-05-20T17:56:41.927066+0000","last_undegraded":"2024-05-20T17:56:41.927066+0000","last_fullsized":"2024-05-20T17:56:41.927066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:48.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918820+0000","last_change":"2024-05-20T17:56:40.925447+0000","last_active":"2024-05-20T17:56:41.918820+0000","last_peered":"2024-05-20T17:56:41.918820+0000","last_clean":"2024-05-20T17:56:41.918820+0000","last_became_active":"2024-05-20T17:56:40.925137+0000","last_became_peered":"2024-05-20T17:56:40.925137+0000","last_unstale":"2024-05-20T17:56:41.918820+0000","last_undegraded":"2024-05-20T17:56:41.918820+0000","last_fullsized":"2024-05-20T17:56:41.918820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:23:25.786350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926839+0000","last_change":"2024-05-20T17:56:40.934300+0000","last_active":"2024-05-20T17:56:41.926839+0000","last_peered":"2024-05-20T17:56:41.926839+0000","last_clean":"2024-05-20T17:56:41.926839+0000","last_became_active":"2024-05-20T17:56:40.933966+0000","last_became_peered":"2024-05-20T17:56:40.933966+0000","last_unstale":"2024-05-20T17:56:41.926839+0000","last_undegraded":"2024-05-20T17:56:41.926839+0000","last_fullsized":"2024-05-20T17:56:41.926839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:42.731674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918610+0000","last_change":"2024-05-20T17:56:40.917037+0000","last_active":"2024-05-20T17:56:41.918610+0000","last_peered":"2024-05-20T17:56:41.918610+0000","last_clean":"2024-05-20T17:56:41.918610+0000","last_became_active":"2024-05-20T17:56:40.916592+0000","last_became_peered":"2024-05-20T17:56:40.916592+0000","last_unstale":"2024-05-20T17:56:41.918610+0000","last_undegraded":"2024-05-20T17:56:41.918610+0000","last_fullsized":"2024-05-20T17:56:41.918610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:40.900154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922024+0000","last_change":"2024-05-20T17:56:40.932310+0000","last_active":"2024-05-20T17:56:41.922024+0000","last_peered":"2024-05-20T17:56:41.922024+0000","last_clean":"2024-05-20T17:56:41.922024+0000","last_became_active":"2024-05-20T17:56:40.931976+0000","last_became_peered":"2024-05-20T17:56:40.931976+0000","last_unstale":"2024-05-20T17:56:41.922024+0000","last_undegraded":"2024-05-20T17:56:41.922024+0000","last_fullsized":"2024-05-20T17:56:41.922024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:29:17.752942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922343+0000","last_change":"2024-05-20T17:56:40.931421+0000","last_active":"2024-05-20T17:56:41.922343+0000","last_peered":"2024-05-20T17:56:41.922343+0000","last_clean":"2024-05-20T17:56:41.922343+0000","last_became_active":"2024-05-20T17:56:40.931084+0000","last_became_peered":"2024-05-20T17:56:40.931084+0000","last_unstale":"2024-05-20T17:56:41.922343+0000","last_undegraded":"2024-05-20T17:56:41.922343+0000","last_fullsized":"2024-05-20T17:56:41.922343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:57.545728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018607+0000","last_change":"2024-05-20T17:56:40.919085+0000","last_active":"2024-05-20T17:56:42.018607+0000","last_peered":"2024-05-20T17:56:42.018607+0000","last_clean":"2024-05-20T17:56:42.018607+0000","last_became_active":"2024-05-20T17:56:40.918795+0000","last_became_peered":"2024-05-20T17:56:40.918795+0000","last_unstale":"2024-05-20T17:56:42.018607+0000","last_undegraded":"2024-05-20T17:56:42.018607+0000","last_fullsized":"2024-05-20T17:56:42.018607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:14:46.165791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919197+0000","last_change":"2024-05-20T17:56:40.920438+0000","last_active":"2024-05-20T17:56:41.919197+0000","last_peered":"2024-05-20T17:56:41.919197+0000","last_clean":"2024-05-20T17:56:41.919197+0000","last_became_active":"2024-05-20T17:56:40.920129+0000","last_became_peered":"2024-05-20T17:56:40.920129+0000","last_unstale":"2024-05-20T17:56:41.919197+0000","last_undegraded":"2024-05-20T17:56:41.919197+0000","last_fullsized":"2024-05-20T17:56:41.919197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.026836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927227+0000","last_change":"2024-05-20T17:56:40.933063+0000","last_active":"2024-05-20T17:56:41.927227+0000","last_peered":"2024-05-20T17:56:41.927227+0000","last_clean":"2024-05-20T17:56:41.927227+0000","last_became_active":"2024-05-20T17:56:40.932661+0000","last_became_peered":"2024-05-20T17:56:40.932661+0000","last_unstale":"2024-05-20T17:56:41.927227+0000","last_undegraded":"2024-05-20T17:56:41.927227+0000","last_fullsized":"2024-05-20T17:56:41.927227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:25.095137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922760+0000","last_change":"2024-05-20T17:56:40.928533+0000","last_active":"2024-05-20T17:56:41.922760+0000","last_peered":"2024-05-20T17:56:41.922760+0000","last_clean":"2024-05-20T17:56:41.922760+0000","last_became_active":"2024-05-20T17:56:40.927773+0000","last_became_peered":"2024-05-20T17:56:40.927773+0000","last_unstale":"2024-05-20T17:56:41.922760+0000","last_undegraded":"2024-05-20T17:56:41.922760+0000","last_fullsized":"2024-05-20T17:56:41.922760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:09:57.888291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918820+0000","last_change":"2024-05-20T17:56:40.930439+0000","last_active":"2024-05-20T17:56:41.918820+0000","last_peered":"2024-05-20T17:56:41.918820+0000","last_clean":"2024-05-20T17:56:41.918820+0000","last_became_active":"2024-05-20T17:56:40.930145+0000","last_became_peered":"2024-05-20T17:56:40.930145+0000","last_unstale":"2024-05-20T17:56:41.918820+0000","last_undegraded":"2024-05-20T17:56:41.918820+0000","last_fullsized":"2024-05-20T17:56:41.918820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:29:17.752942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913066+0000","last_change":"2024-05-20T17:56:40.926079+0000","last_active":"2024-05-20T17:56:42.913066+0000","last_peered":"2024-05-20T17:56:42.913066+0000","last_clean":"2024-05-20T17:56:42.913066+0000","last_became_active":"2024-05-20T17:56:40.925262+0000","last_became_peered":"2024-05-20T17:56:40.925262+0000","last_unstale":"2024-05-20T17:56:42.913066+0000","last_undegraded":"2024-05-20T17:56:42.913066+0000","last_fullsized":"2024-05-20T17:56:42.913066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:58:30.862553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918198+0000","last_change":"2024-05-20T17:56:40.926984+0000","last_active":"2024-05-20T17:56:41.918198+0000","last_peered":"2024-05-20T17:56:41.918198+0000","last_clean":"2024-05-20T17:56:41.918198+0000","last_became_active":"2024-05-20T17:56:40.926658+0000","last_became_peered":"2024-05-20T17:56:40.926658+0000","last_unstale":"2024-05-20T17:56:41.918198+0000","last_undegraded":"2024-05-20T17:56:41.918198+0000","last_fullsized":"2024-05-20T17:56:41.918198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:57.014500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913049+0000","last_change":"2024-05-20T17:56:40.920462+0000","last_active":"2024-05-20T17:56:42.913049+0000","last_peered":"2024-05-20T17:56:42.913049+0000","last_clean":"2024-05-20T17:56:42.913049+0000","last_became_active":"2024-05-20T17:56:40.920145+0000","last_became_peered":"2024-05-20T17:56:40.920145+0000","last_unstale":"2024-05-20T17:56:42.913049+0000","last_undegraded":"2024-05-20T17:56:42.913049+0000","last_fullsized":"2024-05-20T17:56:42.913049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:24:19.895498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927059+0000","last_change":"2024-05-20T17:56:39.920496+0000","last_active":"2024-05-20T17:56:41.927059+0000","last_peered":"2024-05-20T17:56:41.927059+0000","last_clean":"2024-05-20T17:56:41.927059+0000","last_became_active":"2024-05-20T17:56:39.920117+0000","last_became_peered":"2024-05-20T17:56:39.920117+0000","last_unstale":"2024-05-20T17:56:41.927059+0000","last_undegraded":"2024-05-20T17:56:41.927059+0000","last_fullsized":"2024-05-20T17:56:41.927059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:29:21.790558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922124+0000","last_change":"2024-05-20T17:56:40.918231+0000","last_active":"2024-05-20T17:56:41.922124+0000","last_peered":"2024-05-20T17:56:41.922124+0000","last_clean":"2024-05-20T17:56:41.922124+0000","last_became_active":"2024-05-20T17:56:40.917921+0000","last_became_peered":"2024-05-20T17:56:40.917921+0000","last_unstale":"2024-05-20T17:56:41.922124+0000","last_undegraded":"2024-05-20T17:56:41.922124+0000","last_fullsized":"2024-05-20T17:56:41.922124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:06:41.492721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919485+0000","last_change":"2024-05-20T17:56:39.915235+0000","last_active":"2024-05-20T17:56:41.919485+0000","last_peered":"2024-05-20T17:56:41.919485+0000","last_clean":"2024-05-20T17:56:41.919485+0000","last_became_active":"2024-05-20T17:56:39.914486+0000","last_became_peered":"2024-05-20T17:56:39.914486+0000","last_unstale":"2024-05-20T17:56:41.919485+0000","last_undegraded":"2024-05-20T17:56:41.919485+0000","last_fullsized":"2024-05-20T17:56:41.919485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:09.622712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918945+0000","last_change":"2024-05-20T17:56:40.922513+0000","last_active":"2024-05-20T17:56:41.918945+0000","last_peered":"2024-05-20T17:56:41.918945+0000","last_clean":"2024-05-20T17:56:41.918945+0000","last_became_active":"2024-05-20T17:56:40.922211+0000","last_became_peered":"2024-05-20T17:56:40.922211+0000","last_unstale":"2024-05-20T17:56:41.918945+0000","last_undegraded":"2024-05-20T17:56:41.918945+0000","last_fullsized":"2024-05-20T17:56:41.918945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:02:03.200715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919426+0000","last_change":"2024-05-20T17:56:39.911850+0000","last_active":"2024-05-20T17:56:41.919426+0000","last_peered":"2024-05-20T17:56:41.919426+0000","last_clean":"2024-05-20T17:56:41.919426+0000","last_became_active":"2024-05-20T17:56:39.911507+0000","last_became_peered":"2024-05-20T17:56:39.911507+0000","last_unstale":"2024-05-20T17:56:41.919426+0000","last_undegraded":"2024-05-20T17:56:41.919426+0000","last_fullsized":"2024-05-20T17:56:41.919426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:13.465927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919024+0000","last_change":"2024-05-20T17:56:40.925764+0000","last_active":"2024-05-20T17:56:41.919024+0000","last_peered":"2024-05-20T17:56:41.919024+0000","last_clean":"2024-05-20T17:56:41.919024+0000","last_became_active":"2024-05-20T17:56:40.925455+0000","last_became_peered":"2024-05-20T17:56:40.925455+0000","last_unstale":"2024-05-20T17:56:41.919024+0000","last_undegraded":"2024-05-20T17:56:41.919024+0000","last_fullsized":"2024-05-20T17:56:41.919024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:24:19.895498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913572+0000","last_change":"2024-05-20T17:56:39.908744+0000","last_active":"2024-05-20T17:56:42.913572+0000","last_peered":"2024-05-20T17:56:42.913572+0000","last_clean":"2024-05-20T17:56:42.913572+0000","last_became_active":"2024-05-20T17:56:39.908411+0000","last_became_peered":"2024-05-20T17:56:39.908411+0000","last_unstale":"2024-05-20T17:56:42.913572+0000","last_undegraded":"2024-05-20T17:56:42.913572+0000","last_fullsized":"2024-05-20T17:56:42.913572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:04:04.995330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922530+0000","last_change":"2024-05-20T17:56:40.943211+0000","last_active":"2024-05-20T17:56:41.922530+0000","last_peered":"2024-05-20T17:56:41.922530+0000","last_clean":"2024-05-20T17:56:41.922530+0000","last_became_active":"2024-05-20T17:56:40.942881+0000","last_became_peered":"2024-05-20T17:56:40.942881+0000","last_unstale":"2024-05-20T17:56:41.922530+0000","last_undegraded":"2024-05-20T17:56:41.922530+0000","last_fullsized":"2024-05-20T17:56:41.922530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:20:48.520463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918904+0000","last_change":"2024-05-20T17:56:39.905931+0000","last_active":"2024-05-20T17:56:41.918904+0000","last_peered":"2024-05-20T17:56:41.918904+0000","last_clean":"2024-05-20T17:56:41.918904+0000","last_became_active":"2024-05-20T17:56:39.905571+0000","last_became_peered":"2024-05-20T17:56:39.905571+0000","last_unstale":"2024-05-20T17:56:41.918904+0000","last_undegraded":"2024-05-20T17:56:41.918904+0000","last_fullsized":"2024-05-20T17:56:41.918904+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:41.286867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922720+0000","last_change":"2024-05-20T17:56:40.943996+0000","last_active":"2024-05-20T17:56:41.922720+0000","last_peered":"2024-05-20T17:56:41.922720+0000","last_clean":"2024-05-20T17:56:41.922720+0000","last_became_active":"2024-05-20T17:56:40.943192+0000","last_became_peered":"2024-05-20T17:56:40.943192+0000","last_unstale":"2024-05-20T17:56:41.922720+0000","last_undegraded":"2024-05-20T17:56:41.922720+0000","last_fullsized":"2024-05-20T17:56:41.922720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:25:46.715360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.017865+0000","last_change":"2024-05-20T17:56:39.909239+0000","last_active":"2024-05-20T17:56:42.017865+0000","last_peered":"2024-05-20T17:56:42.017865+0000","last_clean":"2024-05-20T17:56:42.017865+0000","last_became_active":"2024-05-20T17:56:39.908884+0000","last_became_peered":"2024-05-20T17:56:39.908884+0000","last_unstale":"2024-05-20T17:56:42.017865+0000","last_undegraded":"2024-05-20T17:56:42.017865+0000","last_fullsized":"2024-05-20T17:56:42.017865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:15:54.918810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919185+0000","last_change":"2024-05-20T17:56:40.925179+0000","last_active":"2024-05-20T17:56:41.919185+0000","last_peered":"2024-05-20T17:56:41.919185+0000","last_clean":"2024-05-20T17:56:41.919185+0000","last_became_active":"2024-05-20T17:56:40.924882+0000","last_became_peered":"2024-05-20T17:56:40.924882+0000","last_unstale":"2024-05-20T17:56:41.919185+0000","last_undegraded":"2024-05-20T17:56:41.919185+0000","last_fullsized":"2024-05-20T17:56:41.919185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:58:30.862553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922122+0000","last_change":"2024-05-20T17:56:39.909738+0000","last_active":"2024-05-20T17:56:41.922122+0000","last_peered":"2024-05-20T17:56:41.922122+0000","last_clean":"2024-05-20T17:56:41.922122+0000","last_became_active":"2024-05-20T17:56:39.909374+0000","last_became_peered":"2024-05-20T17:56:39.909374+0000","last_unstale":"2024-05-20T17:56:41.922122+0000","last_undegraded":"2024-05-20T17:56:41.922122+0000","last_fullsized":"2024-05-20T17:56:41.922122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:09.622712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913967+0000","last_change":"2024-05-20T17:56:40.939059+0000","last_active":"2024-05-20T17:56:42.913967+0000","last_peered":"2024-05-20T17:56:42.913967+0000","last_clean":"2024-05-20T17:56:42.913967+0000","last_became_active":"2024-05-20T17:56:40.938688+0000","last_became_peered":"2024-05-20T17:56:40.938688+0000","last_unstale":"2024-05-20T17:56:42.913967+0000","last_undegraded":"2024-05-20T17:56:42.913967+0000","last_fullsized":"2024-05-20T17:56:42.913967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:03:10.108687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926645+0000","last_change":"2024-05-20T17:56:39.916490+0000","last_active":"2024-05-20T17:56:41.926645+0000","last_peered":"2024-05-20T17:56:41.926645+0000","last_clean":"2024-05-20T17:56:41.926645+0000","last_became_active":"2024-05-20T17:56:39.916165+0000","last_became_peered":"2024-05-20T17:56:39.916165+0000","last_unstale":"2024-05-20T17:56:41.926645+0000","last_undegraded":"2024-05-20T17:56:41.926645+0000","last_fullsized":"2024-05-20T17:56:41.926645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:55:32.775737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922024+0000","last_change":"2024-05-20T17:56:40.930216+0000","last_active":"2024-05-20T17:56:41.922024+0000","last_peered":"2024-05-20T17:56:41.922024+0000","last_clean":"2024-05-20T17:56:41.922024+0000","last_became_active":"2024-05-20T17:56:40.929831+0000","last_became_peered":"2024-05-20T17:56:40.929831+0000","last_unstale":"2024-05-20T17:56:41.922024+0000","last_undegraded":"2024-05-20T17:56:41.922024+0000","last_fullsized":"2024-05-20T17:56:41.922024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:10.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919695+0000","last_change":"2024-05-20T17:56:39.913025+0000","last_active":"2024-05-20T17:56:41.919695+0000","last_peered":"2024-05-20T17:56:41.919695+0000","last_clean":"2024-05-20T17:56:41.919695+0000","last_became_active":"2024-05-20T17:56:39.911801+0000","last_became_peered":"2024-05-20T17:56:39.911801+0000","last_unstale":"2024-05-20T17:56:41.919695+0000","last_undegraded":"2024-05-20T17:56:41.919695+0000","last_fullsized":"2024-05-20T17:56:41.919695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:37:15.871693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018064+0000","last_change":"2024-05-20T17:56:40.920286+0000","last_active":"2024-05-20T17:56:42.018064+0000","last_peered":"2024-05-20T17:56:42.018064+0000","last_clean":"2024-05-20T17:56:42.018064+0000","last_became_active":"2024-05-20T17:56:40.919682+0000","last_became_peered":"2024-05-20T17:56:40.919682+0000","last_unstale":"2024-05-20T17:56:42.018064+0000","last_undegraded":"2024-05-20T17:56:42.018064+0000","last_fullsized":"2024-05-20T17:56:42.018064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:22.806604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018579+0000","last_change":"2024-05-20T17:56:39.906306+0000","last_active":"2024-05-20T17:56:42.018579+0000","last_peered":"2024-05-20T17:56:42.018579+0000","last_clean":"2024-05-20T17:56:42.018579+0000","last_became_active":"2024-05-20T17:56:39.906014+0000","last_became_peered":"2024-05-20T17:56:39.906014+0000","last_unstale":"2024-05-20T17:56:42.018579+0000","last_undegraded":"2024-05-20T17:56:42.018579+0000","last_fullsized":"2024-05-20T17:56:42.018579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:21:12.013749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915361+0000","last_change":"2024-05-20T17:56:40.935003+0000","last_active":"2024-05-20T17:56:41.915361+0000","last_peered":"2024-05-20T17:56:41.915361+0000","last_clean":"2024-05-20T17:56:41.915361+0000","last_became_active":"2024-05-20T17:56:40.934420+0000","last_became_peered":"2024-05-20T17:56:40.934420+0000","last_unstale":"2024-05-20T17:56:41.915361+0000","last_undegraded":"2024-05-20T17:56:41.915361+0000","last_fullsized":"2024-05-20T17:56:41.915361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:29:17.752942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927179+0000","last_change":"2024-05-20T17:56:39.916426+0000","last_active":"2024-05-20T17:56:41.927179+0000","last_peered":"2024-05-20T17:56:41.927179+0000","last_clean":"2024-05-20T17:56:41.927179+0000","last_became_active":"2024-05-20T17:56:39.915422+0000","last_became_peered":"2024-05-20T17:56:39.915422+0000","last_unstale":"2024-05-20T17:56:41.927179+0000","last_undegraded":"2024-05-20T17:56:41.927179+0000","last_fullsized":"2024-05-20T17:56:41.927179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:08:32.395477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913193+0000","last_change":"2024-05-20T17:56:40.917699+0000","last_active":"2024-05-20T17:56:42.913193+0000","last_peered":"2024-05-20T17:56:42.913193+0000","last_clean":"2024-05-20T17:56:42.913193+0000","last_became_active":"2024-05-20T17:56:40.917391+0000","last_became_peered":"2024-05-20T17:56:40.917391+0000","last_unstale":"2024-05-20T17:56:42.913193+0000","last_undegraded":"2024-05-20T17:56:42.913193+0000","last_fullsized":"2024-05-20T17:56:42.913193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:47:29.125688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913730+0000","last_change":"2024-05-20T17:56:39.911791+0000","last_active":"2024-05-20T17:56:42.913730+0000","last_peered":"2024-05-20T17:56:42.913730+0000","last_clean":"2024-05-20T17:56:42.913730+0000","last_became_active":"2024-05-20T17:56:39.910946+0000","last_became_peered":"2024-05-20T17:56:39.910946+0000","last_unstale":"2024-05-20T17:56:42.913730+0000","last_undegraded":"2024-05-20T17:56:42.913730+0000","last_fullsized":"2024-05-20T17:56:42.913730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:39.893437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018407+0000","last_change":"2024-05-20T17:56:40.924501+0000","last_active":"2024-05-20T17:56:42.018407+0000","last_peered":"2024-05-20T17:56:42.018407+0000","last_clean":"2024-05-20T17:56:42.018407+0000","last_became_active":"2024-05-20T17:56:40.924166+0000","last_became_peered":"2024-05-20T17:56:40.924166+0000","last_unstale":"2024-05-20T17:56:42.018407+0000","last_undegraded":"2024-05-20T17:56:42.018407+0000","last_fullsized":"2024-05-20T17:56:42.018407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:11:11.443634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.017850+0000","last_change":"2024-05-20T17:56:39.904787+0000","last_active":"2024-05-20T17:56:42.017850+0000","last_peered":"2024-05-20T17:56:42.017850+0000","last_clean":"2024-05-20T17:56:42.017850+0000","last_became_active":"2024-05-20T17:56:39.904462+0000","last_became_peered":"2024-05-20T17:56:39.904462+0000","last_unstale":"2024-05-20T17:56:42.017850+0000","last_undegraded":"2024-05-20T17:56:42.017850+0000","last_fullsized":"2024-05-20T17:56:42.017850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:04.096081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913709+0000","last_change":"2024-05-20T17:56:40.934156+0000","last_active":"2024-05-20T17:56:42.913709+0000","last_peered":"2024-05-20T17:56:42.913709+0000","last_clean":"2024-05-20T17:56:42.913709+0000","last_became_active":"2024-05-20T17:56:40.933841+0000","last_became_peered":"2024-05-20T17:56:40.933841+0000","last_unstale":"2024-05-20T17:56:42.913709+0000","last_undegraded":"2024-05-20T17:56:42.913709+0000","last_fullsized":"2024-05-20T17:56:42.913709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:21:13.020466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919033+0000","last_change":"2024-05-20T17:56:39.918155+0000","last_active":"2024-05-20T17:56:41.919033+0000","last_peered":"2024-05-20T17:56:41.919033+0000","last_clean":"2024-05-20T17:56:41.919033+0000","last_became_active":"2024-05-20T17:56:39.917525+0000","last_became_peered":"2024-05-20T17:56:39.917525+0000","last_unstale":"2024-05-20T17:56:41.919033+0000","last_undegraded":"2024-05-20T17:56:41.919033+0000","last_fullsized":"2024-05-20T17:56:41.919033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:56:47.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913840+0000","last_change":"2024-05-20T17:56:40.928778+0000","last_active":"2024-05-20T17:56:42.913840+0000","last_peered":"2024-05-20T17:56:42.913840+0000","last_clean":"2024-05-20T17:56:42.913840+0000","last_became_active":"2024-05-20T17:56:40.928004+0000","last_became_peered":"2024-05-20T17:56:40.928004+0000","last_unstale":"2024-05-20T17:56:42.913840+0000","last_undegraded":"2024-05-20T17:56:42.913840+0000","last_fullsized":"2024-05-20T17:56:42.913840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:10.629429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926712+0000","last_change":"2024-05-20T17:56:39.920567+0000","last_active":"2024-05-20T17:56:41.926712+0000","last_peered":"2024-05-20T17:56:41.926712+0000","last_clean":"2024-05-20T17:56:41.926712+0000","last_became_active":"2024-05-20T17:56:39.920201+0000","last_became_peered":"2024-05-20T17:56:39.920201+0000","last_unstale":"2024-05-20T17:56:41.926712+0000","last_undegraded":"2024-05-20T17:56:41.926712+0000","last_fullsized":"2024-05-20T17:56:41.926712+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:27:20.250897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913982+0000","last_change":"2024-05-20T17:56:40.927666+0000","last_active":"2024-05-20T17:56:42.913982+0000","last_peered":"2024-05-20T17:56:42.913982+0000","last_clean":"2024-05-20T17:56:42.913982+0000","last_became_active":"2024-05-20T17:56:40.927299+0000","last_became_peered":"2024-05-20T17:56:40.927299+0000","last_unstale":"2024-05-20T17:56:42.913982+0000","last_undegraded":"2024-05-20T17:56:42.913982+0000","last_fullsized":"2024-05-20T17:56:42.913982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:14.472644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922091+0000","last_change":"2024-05-20T17:56:39.913017+0000","last_active":"2024-05-20T17:56:41.922091+0000","last_peered":"2024-05-20T17:56:41.922091+0000","last_clean":"2024-05-20T17:56:41.922091+0000","last_became_active":"2024-05-20T17:56:39.912679+0000","last_became_peered":"2024-05-20T17:56:39.912679+0000","last_unstale":"2024-05-20T17:56:41.922091+0000","last_undegraded":"2024-05-20T17:56:41.922091+0000","last_fullsized":"2024-05-20T17:56:41.922091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:40:12.330281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915434+0000","last_change":"2024-05-20T17:56:40.934916+0000","last_active":"2024-05-20T17:56:41.915434+0000","last_peered":"2024-05-20T17:56:41.915434+0000","last_clean":"2024-05-20T17:56:41.915434+0000","last_became_active":"2024-05-20T17:56:40.934588+0000","last_became_peered":"2024-05-20T17:56:40.934588+0000","last_unstale":"2024-05-20T17:56:41.915434+0000","last_undegraded":"2024-05-20T17:56:41.915434+0000","last_fullsized":"2024-05-20T17:56:41.915434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:57.014500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919703+0000","last_change":"2024-05-20T17:56:39.913874+0000","last_active":"2024-05-20T17:56:41.919703+0000","last_peered":"2024-05-20T17:56:41.919703+0000","last_clean":"2024-05-20T17:56:41.919703+0000","last_became_active":"2024-05-20T17:56:39.913539+0000","last_became_peered":"2024-05-20T17:56:39.913539+0000","last_unstale":"2024-05-20T17:56:41.919703+0000","last_undegraded":"2024-05-20T17:56:41.919703+0000","last_fullsized":"2024-05-20T17:56:41.919703+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:11:10.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926899+0000","last_change":"2024-05-20T17:56:40.931892+0000","last_active":"2024-05-20T17:56:41.926899+0000","last_peered":"2024-05-20T17:56:41.926899+0000","last_clean":"2024-05-20T17:56:41.926899+0000","last_became_active":"2024-05-20T17:56:40.931549+0000","last_became_peered":"2024-05-20T17:56:40.931549+0000","last_unstale":"2024-05-20T17:56:41.926899+0000","last_undegraded":"2024-05-20T17:56:41.926899+0000","last_fullsized":"2024-05-20T17:56:41.926899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:33.782092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919256+0000","last_change":"2024-05-20T17:56:39.906089+0000","last_active":"2024-05-20T17:56:41.919256+0000","last_peered":"2024-05-20T17:56:41.919256+0000","last_clean":"2024-05-20T17:56:41.919256+0000","last_became_active":"2024-05-20T17:56:39.905766+0000","last_became_peered":"2024-05-20T17:56:39.905766+0000","last_unstale":"2024-05-20T17:56:41.919256+0000","last_undegraded":"2024-05-20T17:56:41.919256+0000","last_fullsized":"2024-05-20T17:56:41.919256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:50:17.022566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926843+0000","last_change":"2024-05-20T17:56:40.934583+0000","last_active":"2024-05-20T17:56:41.926843+0000","last_peered":"2024-05-20T17:56:41.926843+0000","last_clean":"2024-05-20T17:56:41.926843+0000","last_became_active":"2024-05-20T17:56:40.934233+0000","last_became_peered":"2024-05-20T17:56:40.934233+0000","last_unstale":"2024-05-20T17:56:41.926843+0000","last_undegraded":"2024-05-20T17:56:41.926843+0000","last_fullsized":"2024-05-20T17:56:41.926843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:45.264804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927258+0000","last_change":"2024-05-20T17:56:39.915992+0000","last_active":"2024-05-20T17:56:41.927258+0000","last_peered":"2024-05-20T17:56:41.927258+0000","last_clean":"2024-05-20T17:56:41.927258+0000","last_became_active":"2024-05-20T17:56:39.915500+0000","last_became_peered":"2024-05-20T17:56:39.915500+0000","last_unstale":"2024-05-20T17:56:41.927258+0000","last_undegraded":"2024-05-20T17:56:41.927258+0000","last_fullsized":"2024-05-20T17:56:41.927258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:15.041844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915328+0000","last_change":"2024-05-20T17:56:40.935628+0000","last_active":"2024-05-20T17:56:41.915328+0000","last_peered":"2024-05-20T17:56:41.915328+0000","last_clean":"2024-05-20T17:56:41.915328+0000","last_became_active":"2024-05-20T17:56:40.935320+0000","last_became_peered":"2024-05-20T17:56:40.935320+0000","last_unstale":"2024-05-20T17:56:41.915328+0000","last_undegraded":"2024-05-20T17:56:41.915328+0000","last_fullsized":"2024-05-20T17:56:41.915328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:10.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913001+0000","last_change":"2024-05-20T17:56:39.916652+0000","last_active":"2024-05-20T17:56:42.913001+0000","last_peered":"2024-05-20T17:56:42.913001+0000","last_clean":"2024-05-20T17:56:42.913001+0000","last_became_active":"2024-05-20T17:56:39.916021+0000","last_became_peered":"2024-05-20T17:56:39.916021+0000","last_unstale":"2024-05-20T17:56:42.913001+0000","last_undegraded":"2024-05-20T17:56:42.913001+0000","last_fullsized":"2024-05-20T17:56:42.913001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:36.602648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922531+0000","last_change":"2024-05-20T17:56:40.917496+0000","last_active":"2024-05-20T17:56:41.922531+0000","last_peered":"2024-05-20T17:56:41.922531+0000","last_clean":"2024-05-20T17:56:41.922531+0000","last_became_active":"2024-05-20T17:56:40.917147+0000","last_became_peered":"2024-05-20T17:56:40.917147+0000","last_unstale":"2024-05-20T17:56:41.922531+0000","last_undegraded":"2024-05-20T17:56:41.922531+0000","last_fullsized":"2024-05-20T17:56:41.922531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:21.500381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915385+0000","last_change":"2024-05-20T17:56:39.913984+0000","last_active":"2024-05-20T17:56:41.915385+0000","last_peered":"2024-05-20T17:56:41.915385+0000","last_clean":"2024-05-20T17:56:41.915385+0000","last_became_active":"2024-05-20T17:56:39.913644+0000","last_became_peered":"2024-05-20T17:56:39.913644+0000","last_unstale":"2024-05-20T17:56:41.915385+0000","last_undegraded":"2024-05-20T17:56:41.915385+0000","last_fullsized":"2024-05-20T17:56:41.915385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:21.799887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922769+0000","last_change":"2024-05-20T17:56:40.930339+0000","last_active":"2024-05-20T17:56:41.922769+0000","last_peered":"2024-05-20T17:56:41.922769+0000","last_clean":"2024-05-20T17:56:41.922769+0000","last_became_active":"2024-05-20T17:56:40.930024+0000","last_became_peered":"2024-05-20T17:56:40.930024+0000","last_unstale":"2024-05-20T17:56:41.922769+0000","last_undegraded":"2024-05-20T17:56:41.922769+0000","last_fullsized":"2024-05-20T17:56:41.922769+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:19.848028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.914984+0000","last_change":"2024-05-20T17:56:39.913015+0000","last_active":"2024-05-20T17:56:41.914984+0000","last_peered":"2024-05-20T17:56:41.914984+0000","last_clean":"2024-05-20T17:56:41.914984+0000","last_became_active":"2024-05-20T17:56:39.912553+0000","last_became_peered":"2024-05-20T17:56:39.912553+0000","last_unstale":"2024-05-20T17:56:41.914984+0000","last_undegraded":"2024-05-20T17:56:41.914984+0000","last_fullsized":"2024-05-20T17:56:41.914984+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:03:09.101970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.914152+0000","last_change":"2024-05-20T17:56:40.924668+0000","last_active":"2024-05-20T17:56:42.914152+0000","last_peered":"2024-05-20T17:56:42.914152+0000","last_clean":"2024-05-20T17:56:42.914152+0000","last_became_active":"2024-05-20T17:56:40.923769+0000","last_became_peered":"2024-05-20T17:56:40.923769+0000","last_unstale":"2024-05-20T17:56:42.914152+0000","last_undegraded":"2024-05-20T17:56:42.914152+0000","last_fullsized":"2024-05-20T17:56:42.914152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:22.806604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.914998+0000","last_change":"2024-05-20T17:56:39.911842+0000","last_active":"2024-05-20T17:56:41.914998+0000","last_peered":"2024-05-20T17:56:41.914998+0000","last_clean":"2024-05-20T17:56:41.914998+0000","last_became_active":"2024-05-20T17:56:39.911488+0000","last_became_peered":"2024-05-20T17:56:39.911488+0000","last_unstale":"2024-05-20T17:56:41.914998+0000","last_undegraded":"2024-05-20T17:56:41.914998+0000","last_fullsized":"2024-05-20T17:56:41.914998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:13.465927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918410+0000","last_change":"2024-05-20T17:56:40.920058+0000","last_active":"2024-05-20T17:56:41.918410+0000","last_peered":"2024-05-20T17:56:41.918410+0000","last_clean":"2024-05-20T17:56:41.918410+0000","last_became_active":"2024-05-20T17:56:40.919767+0000","last_became_peered":"2024-05-20T17:56:40.919767+0000","last_unstale":"2024-05-20T17:56:41.918410+0000","last_undegraded":"2024-05-20T17:56:41.918410+0000","last_fullsized":"2024-05-20T17:56:41.918410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:04:06.002047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018649+0000","last_change":"2024-05-20T17:56:39.899998+0000","last_active":"2024-05-20T17:56:42.018649+0000","last_peered":"2024-05-20T17:56:42.018649+0000","last_clean":"2024-05-20T17:56:42.018649+0000","last_became_active":"2024-05-20T17:56:39.899679+0000","last_became_peered":"2024-05-20T17:56:39.899679+0000","last_unstale":"2024-05-20T17:56:42.018649+0000","last_undegraded":"2024-05-20T17:56:42.018649+0000","last_fullsized":"2024-05-20T17:56:42.018649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:16:26.191811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913798+0000","last_change":"2024-05-20T17:56:40.925046+0000","last_active":"2024-05-20T17:56:42.913798+0000","last_peered":"2024-05-20T17:56:42.913798+0000","last_clean":"2024-05-20T17:56:42.913798+0000","last_became_active":"2024-05-20T17:56:40.923972+0000","last_became_peered":"2024-05-20T17:56:40.923972+0000","last_unstale":"2024-05-20T17:56:42.913798+0000","last_undegraded":"2024-05-20T17:56:42.913798+0000","last_fullsized":"2024-05-20T17:56:42.913798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:25:48.227620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922715+0000","last_change":"2024-05-20T17:56:39.916338+0000","last_active":"2024-05-20T17:56:41.922715+0000","last_peered":"2024-05-20T17:56:41.922715+0000","last_clean":"2024-05-20T17:56:41.922715+0000","last_became_active":"2024-05-20T17:56:39.915941+0000","last_became_peered":"2024-05-20T17:56:39.915941+0000","last_unstale":"2024-05-20T17:56:41.922715+0000","last_undegraded":"2024-05-20T17:56:41.922715+0000","last_fullsized":"2024-05-20T17:56:41.922715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:25:47.220903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918896+0000","last_change":"2024-05-20T17:56:40.923218+0000","last_active":"2024-05-20T17:56:41.918896+0000","last_peered":"2024-05-20T17:56:41.918896+0000","last_clean":"2024-05-20T17:56:41.918896+0000","last_became_active":"2024-05-20T17:56:40.922948+0000","last_became_peered":"2024-05-20T17:56:40.922948+0000","last_unstale":"2024-05-20T17:56:41.918896+0000","last_undegraded":"2024-05-20T17:56:41.918896+0000","last_fullsized":"2024-05-20T17:56:41.918896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:46:19.680624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919582+0000","last_change":"2024-05-20T17:56:39.913394+0000","last_active":"2024-05-20T17:56:41.919582+0000","last_peered":"2024-05-20T17:56:41.919582+0000","last_clean":"2024-05-20T17:56:41.919582+0000","last_became_active":"2024-05-20T17:56:39.913056+0000","last_became_peered":"2024-05-20T17:56:39.913056+0000","last_unstale":"2024-05-20T17:56:41.919582+0000","last_undegraded":"2024-05-20T17:56:41.919582+0000","last_fullsized":"2024-05-20T17:56:41.919582+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:21.799887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922709+0000","last_change":"2024-05-20T17:56:40.921424+0000","last_active":"2024-05-20T17:56:41.922709+0000","last_peered":"2024-05-20T17:56:41.922709+0000","last_clean":"2024-05-20T17:56:41.922709+0000","last_became_active":"2024-05-20T17:56:40.921085+0000","last_became_peered":"2024-05-20T17:56:40.921085+0000","last_unstale":"2024-05-20T17:56:41.922709+0000","last_undegraded":"2024-05-20T17:56:41.922709+0000","last_fullsized":"2024-05-20T17:56:41.922709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:04.558171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918187+0000","last_change":"2024-05-20T17:56:39.913006+0000","last_active":"2024-05-20T17:56:41.918187+0000","last_peered":"2024-05-20T17:56:41.918187+0000","last_clean":"2024-05-20T17:56:41.918187+0000","last_became_active":"2024-05-20T17:56:39.912386+0000","last_became_peered":"2024-05-20T17:56:39.912386+0000","last_unstale":"2024-05-20T17:56:41.918187+0000","last_undegraded":"2024-05-20T17:56:41.918187+0000","last_fullsized":"2024-05-20T17:56:41.918187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:03:09.101970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913696+0000","last_change":"2024-05-20T17:56:40.927449+0000","last_active":"2024-05-20T17:56:42.913696+0000","last_peered":"2024-05-20T17:56:42.913696+0000","last_clean":"2024-05-20T17:56:42.913696+0000","last_became_active":"2024-05-20T17:56:40.925832+0000","last_became_peered":"2024-05-20T17:56:40.925832+0000","last_unstale":"2024-05-20T17:56:42.913696+0000","last_undegraded":"2024-05-20T17:56:42.913696+0000","last_fullsized":"2024-05-20T17:56:42.913696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:18:04.892054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913409+0000","last_change":"2024-05-20T17:56:39.910720+0000","last_active":"2024-05-20T17:56:42.913409+0000","last_peered":"2024-05-20T17:56:42.913409+0000","last_clean":"2024-05-20T17:56:42.913409+0000","last_became_active":"2024-05-20T17:56:39.910419+0000","last_became_peered":"2024-05-20T17:56:39.910419+0000","last_unstale":"2024-05-20T17:56:42.913409+0000","last_undegraded":"2024-05-20T17:56:42.913409+0000","last_fullsized":"2024-05-20T17:56:42.913409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:37.049601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913797+0000","last_change":"2024-05-20T17:56:40.939244+0000","last_active":"2024-05-20T17:56:42.913797+0000","last_peered":"2024-05-20T17:56:42.913797+0000","last_clean":"2024-05-20T17:56:42.913797+0000","last_became_active":"2024-05-20T17:56:40.938834+0000","last_became_peered":"2024-05-20T17:56:40.938834+0000","last_unstale":"2024-05-20T17:56:42.913797+0000","last_undegraded":"2024-05-20T17:56:42.913797+0000","last_fullsized":"2024-05-20T17:56:42.913797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:40:13.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926925+0000","last_change":"2024-05-20T17:56:39.915927+0000","last_active":"2024-05-20T17:56:41.926925+0000","last_peered":"2024-05-20T17:56:41.926925+0000","last_clean":"2024-05-20T17:56:41.926925+0000","last_became_active":"2024-05-20T17:56:39.915475+0000","last_became_peered":"2024-05-20T17:56:39.915475+0000","last_unstale":"2024-05-20T17:56:41.926925+0000","last_undegraded":"2024-05-20T17:56:41.926925+0000","last_fullsized":"2024-05-20T17:56:41.926925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:00:35.336258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913379+0000","last_change":"2024-05-20T17:56:40.916922+0000","last_active":"2024-05-20T17:56:42.913379+0000","last_peered":"2024-05-20T17:56:42.913379+0000","last_clean":"2024-05-20T17:56:42.913379+0000","last_became_active":"2024-05-20T17:56:40.916513+0000","last_became_peered":"2024-05-20T17:56:40.916513+0000","last_unstale":"2024-05-20T17:56:42.913379+0000","last_undegraded":"2024-05-20T17:56:42.913379+0000","last_fullsized":"2024-05-20T17:56:42.913379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:15:55.925527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913825+0000","last_change":"2024-05-20T17:56:39.914907+0000","last_active":"2024-05-20T17:56:42.913825+0000","last_peered":"2024-05-20T17:56:42.913825+0000","last_clean":"2024-05-20T17:56:42.913825+0000","last_became_active":"2024-05-20T17:56:39.914495+0000","last_became_peered":"2024-05-20T17:56:39.914495+0000","last_unstale":"2024-05-20T17:56:42.913825+0000","last_undegraded":"2024-05-20T17:56:42.913825+0000","last_fullsized":"2024-05-20T17:56:42.913825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:23:24.779633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913451+0000","last_change":"2024-05-20T17:56:40.922803+0000","last_active":"2024-05-20T17:56:42.913451+0000","last_peered":"2024-05-20T17:56:42.913451+0000","last_clean":"2024-05-20T17:56:42.913451+0000","last_became_active":"2024-05-20T17:56:40.922481+0000","last_became_peered":"2024-05-20T17:56:40.922481+0000","last_unstale":"2024-05-20T17:56:42.913451+0000","last_undegraded":"2024-05-20T17:56:42.913451+0000","last_fullsized":"2024-05-20T17:56:42.913451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:16:27.198528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.912802+0000","last_change":"2024-05-20T17:56:39.906351+0000","last_active":"2024-05-20T17:56:42.912802+0000","last_peered":"2024-05-20T17:56:42.912802+0000","last_clean":"2024-05-20T17:56:42.912802+0000","last_became_active":"2024-05-20T17:56:39.905968+0000","last_became_peered":"2024-05-20T17:56:39.905968+0000","last_unstale":"2024-05-20T17:56:42.912802+0000","last_undegraded":"2024-05-20T17:56:42.912802+0000","last_fullsized":"2024-05-20T17:56:42.912802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:33:59.707803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919505+0000","last_change":"2024-05-20T17:56:40.924961+0000","last_active":"2024-05-20T17:56:41.919505+0000","last_peered":"2024-05-20T17:56:41.919505+0000","last_clean":"2024-05-20T17:56:41.919505+0000","last_became_active":"2024-05-20T17:56:40.924641+0000","last_became_peered":"2024-05-20T17:56:40.924641+0000","last_unstale":"2024-05-20T17:56:41.919505+0000","last_undegraded":"2024-05-20T17:56:41.919505+0000","last_fullsized":"2024-05-20T17:56:41.919505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:06:41.492721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915489+0000","last_change":"2024-05-20T17:56:39.912417+0000","last_active":"2024-05-20T17:56:41.915489+0000","last_peered":"2024-05-20T17:56:41.915489+0000","last_clean":"2024-05-20T17:56:41.915489+0000","last_became_active":"2024-05-20T17:56:39.912042+0000","last_became_peered":"2024-05-20T17:56:39.912042+0000","last_unstale":"2024-05-20T17:56:41.915489+0000","last_undegraded":"2024-05-20T17:56:41.915489+0000","last_fullsized":"2024-05-20T17:56:41.915489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:56:47.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":270,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918265+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:56:41.918265+0000","last_peered":"2024-05-20T17:56:41.918265+0000","last_clean":"2024-05-20T17:56:41.918265+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:56:41.918265+0000","last_undegraded":"2024-05-20T17:56:41.918265+0000","last_fullsized":"2024-05-20T17:56:41.918265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1515520,"data_stored":1009000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":420222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":921600,"data_stored":418644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":937984,"data_stored":420326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":419192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":419352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":925696,"data_stored":418722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1511424,"data_stored":1008978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:56:44.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:56:45.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.137+0000 7ff519cbc640 1 Processor -- start 2024-05-20T17:56:45.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.137+0000 7ff519cbc640 1 -- start start 2024-05-20T17:56:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff519cbc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5140af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff519cbc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff51406c180 0x7ff51406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff519cbc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5140af980 con 0x7ff51415f700 2024-05-20T17:56:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff519cbc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff51406bcf0 con 0x7ff51406c180 2024-05-20T17:56:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff519cbc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff514160430 con 0x7ff5140af030 2024-05-20T17:56:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff513fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff51406c180 0x7ff51406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff513fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff51406c180 0x7ff51406c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34166/0 (socket says 172.21.15.6:34166) 2024-05-20T17:56:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff513fff640 1 -- 172.21.15.6:0/4142153583 learned_addr learned my addr 172.21.15.6:0/4142153583 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff5137fe640 1 --2- 172.21.15.6:0/4142153583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5140af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff513fff640 1 -- 172.21.15.6:0/4142153583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 msgr2=0x7ff5140af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff513fff640 1 --2- 172.21.15.6:0/4142153583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5140af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff513fff640 1 -- 172.21.15.6:0/4142153583 >> v1:172.21.15.171:6789/0 conn(0x7ff51415f700 legacy=0x7ff51415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff513fff640 1 -- 172.21.15.6:0/4142153583 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51406b6a0 con 0x7ff51406c180 2024-05-20T17:56:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.139+0000 7ff5137fe640 1 --2- 172.21.15.6:0/4142153583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5140af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:45.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.140+0000 7ff513fff640 1 --2- 172.21.15.6:0/4142153583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51406c180 0x7ff51406c590 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009e50 tx=0x7ff50c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0689d2086ba042 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.140+0000 7ff5127fc640 1 -- 172.21.15.6:0/4142153583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c036070 con 0x7ff51406c180 2024-05-20T17:56:45.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.140+0000 7ff5127fc640 1 -- 172.21.15.6:0/4142153583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50c031600 con 0x7ff51406c180 2024-05-20T17:56:45.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.140+0000 7ff5127fc640 1 -- 172.21.15.6:0/4142153583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0319d0 con 0x7ff51406c180 2024-05-20T17:56:45.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.141+0000 7ff519cbc640 1 -- 172.21.15.6:0/4142153583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51406c180 msgr2=0x7ff51406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.141+0000 7ff519cbc640 1 --2- 172.21.15.6:0/4142153583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51406c180 0x7ff51406c590 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009e50 tx=0x7ff50c02a6d0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.141+0000 7ff519cbc640 1 -- 172.21.15.6:0/4142153583 shutdown_connections 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.141+0000 7ff519cbc640 1 --2- 172.21.15.6:0/4142153583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51406c180 0x7ff51406c590 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.141+0000 7ff519cbc640 1 --2- 172.21.15.6:0/4142153583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5140af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.141+0000 7ff519cbc640 1 -- 172.21.15.6:0/4142153583 >> 172.21.15.6:0/4142153583 conn(0x7ff5140b6620 msgr2=0x7ff5140b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.141+0000 7ff519cbc640 1 -- 172.21.15.6:0/4142153583 shutdown_connections 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.141+0000 7ff519cbc640 1 -- 172.21.15.6:0/4142153583 wait complete. 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.143+0000 7ff519cbc640 1 Processor -- start 2024-05-20T17:56:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.143+0000 7ff519cbc640 1 -- start start 2024-05-20T17:56:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff519cbc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51406c180 0x7ff514156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff519cbc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5141e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff519cbc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415f700 0x7ff5141f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff519cbc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff51406cad0 con 0x7ff51415f700 2024-05-20T17:56:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff519cbc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff514159aa0 con 0x7ff51406c180 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff519cbc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff51406cc50 con 0x7ff5140af030 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff513fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415f700 0x7ff5141f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff513fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415f700 0x7ff5141f5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34168/0 (socket says 172.21.15.6:34168) 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff513fff640 1 -- 172.21.15.6:0/3380871884 learned_addr learned my addr 172.21.15.6:0/3380871884 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff5137fe640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51406c180 0x7ff514156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.144+0000 7ff512ffd640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5141e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff513fff640 1 -- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 msgr2=0x7ff5141e7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff513fff640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5141e7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff513fff640 1 -- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51406c180 msgr2=0x7ff514156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff513fff640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51406c180 0x7ff514156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff513fff640 1 -- 172.21.15.6:0/3380871884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51415b7c0 con 0x7ff51415f700 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff512ffd640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5141e7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff513fff640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415f700 0x7ff5141f5aa0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009e50 tx=0x7ff50c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff4fbfff640 1 -- 172.21.15.6:0/3380871884 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c036050 con 0x7ff51415f700 2024-05-20T17:56:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff4fbfff640 1 -- 172.21.15.6:0/3380871884 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50c042070 con 0x7ff51415f700 2024-05-20T17:56:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51415baa0 con 0x7ff51415f700 2024-05-20T17:56:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff4fbfff640 1 -- 172.21.15.6:0/3380871884 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c009510 con 0x7ff51415f700 2024-05-20T17:56:45.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.145+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51415c060 con 0x7ff51415f700 2024-05-20T17:56:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.146+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff514075b00 con 0x7ff51415f700 2024-05-20T17:56:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.147+0000 7ff4fbfff640 1 -- 172.21.15.6:0/3380871884 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff50c007bd0 con 0x7ff51415f700 2024-05-20T17:56:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.147+0000 7ff4fbfff640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff50006be30 0x7ff50006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.147+0000 7ff4fbfff640 1 -- 172.21.15.6:0/3380871884 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7ff50c0abf50 con 0x7ff51415f700 2024-05-20T17:56:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.148+0000 7ff5137fe640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff50006be30 0x7ff50006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.148+0000 7ff5137fe640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff50006be30 0x7ff50006e340 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff51406e1f0 tx=0x7ff504008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.152+0000 7ff4fbfff640 1 -- 172.21.15.6:0/3380871884 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff5140af980 con 0x7ff51415f700 2024-05-20T17:56:45.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.333+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5140d1630 con 0x7ff50006be30 2024-05-20T17:56:45.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.340+0000 7ff4fbfff640 1 -- 172.21.15.6:0/3380871884 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252073 (secure 0 0 0) 0x7ff5140d1630 con 0x7ff50006be30 2024-05-20T17:56:45.341 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:45.342 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.342+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff50006be30 msgr2=0x7ff50006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.342+0000 7ff519cbc640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff50006be30 0x7ff50006e340 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff51406e1f0 tx=0x7ff504008040 comp rx=0 tx=0).stop 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.342+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415f700 msgr2=0x7ff5141f5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.342+0000 7ff519cbc640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415f700 0x7ff5141f5aa0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009e50 tx=0x7ff50c004a40 comp rx=0 tx=0).stop 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.343+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 shutdown_connections 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.343+0000 7ff519cbc640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff50006be30 0x7ff50006e340 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.343+0000 7ff519cbc640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415f700 0x7ff5141f5aa0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.343+0000 7ff519cbc640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140af030 0x7ff5141e7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.343+0000 7ff519cbc640 1 --2- 172.21.15.6:0/3380871884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51406c180 0x7ff514156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.343+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 >> 172.21.15.6:0/3380871884 conn(0x7ff5140b6620 msgr2=0x7ff5140707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:45.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.343+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 shutdown_connections 2024-05-20T17:56:45.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.343+0000 7ff519cbc640 1 -- 172.21.15.6:0/3380871884 wait complete. 2024-05-20T17:56:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-05-20T17:56:44.286743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237060,"kb_used_data":8392,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754737660,"statfs":{"total":773094113280,"available":772851363840,"internally_reserved":0,"allocated":8593408,"data_stored":4534436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.397606"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919643+0000","last_change":"2024-05-20T17:56:40.922340+0000","last_active":"2024-05-20T17:56:41.919643+0000","last_peered":"2024-05-20T17:56:41.919643+0000","last_clean":"2024-05-20T17:56:41.919643+0000","last_became_active":"2024-05-20T17:56:40.922036+0000","last_became_peered":"2024-05-20T17:56:40.922036+0000","last_unstale":"2024-05-20T17:56:41.919643+0000","last_undegraded":"2024-05-20T17:56:41.919643+0000","last_fullsized":"2024-05-20T17:56:41.919643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:57.545728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922564+0000","last_change":"2024-05-20T17:56:40.927034+0000","last_active":"2024-05-20T17:56:41.922564+0000","last_peered":"2024-05-20T17:56:41.922564+0000","last_clean":"2024-05-20T17:56:41.922564+0000","last_became_active":"2024-05-20T17:56:40.926707+0000","last_became_peered":"2024-05-20T17:56:40.926707+0000","last_unstale":"2024-05-20T17:56:41.922564+0000","last_undegraded":"2024-05-20T17:56:41.922564+0000","last_fullsized":"2024-05-20T17:56:41.922564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:21.339732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913461+0000","last_change":"2024-05-20T17:56:40.937785+0000","last_active":"2024-05-20T17:56:42.913461+0000","last_peered":"2024-05-20T17:56:42.913461+0000","last_clean":"2024-05-20T17:56:42.913461+0000","last_became_active":"2024-05-20T17:56:40.937466+0000","last_became_peered":"2024-05-20T17:56:40.937466+0000","last_unstale":"2024-05-20T17:56:42.913461+0000","last_undegraded":"2024-05-20T17:56:42.913461+0000","last_fullsized":"2024-05-20T17:56:42.913461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:21:13.020466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018123+0000","last_change":"2024-05-20T17:56:40.922861+0000","last_active":"2024-05-20T17:56:42.018123+0000","last_peered":"2024-05-20T17:56:42.018123+0000","last_clean":"2024-05-20T17:56:42.018123+0000","last_became_active":"2024-05-20T17:56:40.922549+0000","last_became_peered":"2024-05-20T17:56:40.922549+0000","last_unstale":"2024-05-20T17:56:42.018123+0000","last_undegraded":"2024-05-20T17:56:42.018123+0000","last_fullsized":"2024-05-20T17:56:42.018123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:56:48.250131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927029+0000","last_change":"2024-05-20T17:56:40.934778+0000","last_active":"2024-05-20T17:56:41.927029+0000","last_peered":"2024-05-20T17:56:41.927029+0000","last_clean":"2024-05-20T17:56:41.927029+0000","last_became_active":"2024-05-20T17:56:40.933766+0000","last_became_peered":"2024-05-20T17:56:40.933766+0000","last_unstale":"2024-05-20T17:56:41.927029+0000","last_undegraded":"2024-05-20T17:56:41.927029+0000","last_fullsized":"2024-05-20T17:56:41.927029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:35:02.188379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915423+0000","last_change":"2024-05-20T17:56:40.929637+0000","last_active":"2024-05-20T17:56:41.915423+0000","last_peered":"2024-05-20T17:56:41.915423+0000","last_clean":"2024-05-20T17:56:41.915423+0000","last_became_active":"2024-05-20T17:56:40.929294+0000","last_became_peered":"2024-05-20T17:56:40.929294+0000","last_unstale":"2024-05-20T17:56:41.915423+0000","last_undegraded":"2024-05-20T17:56:41.915423+0000","last_fullsized":"2024-05-20T17:56:41.915423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.026836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913751+0000","last_change":"2024-05-20T17:56:40.933365+0000","last_active":"2024-05-20T17:56:42.913751+0000","last_peered":"2024-05-20T17:56:42.913751+0000","last_clean":"2024-05-20T17:56:42.913751+0000","last_became_active":"2024-05-20T17:56:40.933037+0000","last_became_peered":"2024-05-20T17:56:40.933037+0000","last_unstale":"2024-05-20T17:56:42.913751+0000","last_undegraded":"2024-05-20T17:56:42.913751+0000","last_fullsized":"2024-05-20T17:56:42.913751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:51.966671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926748+0000","last_change":"2024-05-20T17:56:40.928673+0000","last_active":"2024-05-20T17:56:41.926748+0000","last_peered":"2024-05-20T17:56:41.926748+0000","last_clean":"2024-05-20T17:56:41.926748+0000","last_became_active":"2024-05-20T17:56:40.923768+0000","last_became_peered":"2024-05-20T17:56:40.923768+0000","last_unstale":"2024-05-20T17:56:41.926748+0000","last_undegraded":"2024-05-20T17:56:41.926748+0000","last_fullsized":"2024-05-20T17:56:41.926748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:04.959648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918773+0000","last_change":"2024-05-20T17:56:40.921801+0000","last_active":"2024-05-20T17:56:41.918773+0000","last_peered":"2024-05-20T17:56:41.918773+0000","last_clean":"2024-05-20T17:56:41.918773+0000","last_became_active":"2024-05-20T17:56:40.921503+0000","last_became_peered":"2024-05-20T17:56:40.921503+0000","last_unstale":"2024-05-20T17:56:41.918773+0000","last_undegraded":"2024-05-20T17:56:41.918773+0000","last_fullsized":"2024-05-20T17:56:41.918773+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:11.379012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018504+0000","last_change":"2024-05-20T17:56:40.920390+0000","last_active":"2024-05-20T17:56:42.018504+0000","last_peered":"2024-05-20T17:56:42.018504+0000","last_clean":"2024-05-20T17:56:42.018504+0000","last_became_active":"2024-05-20T17:56:40.920085+0000","last_became_peered":"2024-05-20T17:56:40.920085+0000","last_unstale":"2024-05-20T17:56:42.018504+0000","last_undegraded":"2024-05-20T17:56:42.018504+0000","last_fullsized":"2024-05-20T17:56:42.018504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:30:24.106840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922577+0000","last_change":"2024-05-20T17:56:40.944167+0000","last_active":"2024-05-20T17:56:41.922577+0000","last_peered":"2024-05-20T17:56:41.922577+0000","last_clean":"2024-05-20T17:56:41.922577+0000","last_became_active":"2024-05-20T17:56:40.943658+0000","last_became_peered":"2024-05-20T17:56:40.943658+0000","last_unstale":"2024-05-20T17:56:41.922577+0000","last_undegraded":"2024-05-20T17:56:41.922577+0000","last_fullsized":"2024-05-20T17:56:41.922577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:50:10.577581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018313+0000","last_change":"2024-05-20T17:56:40.920030+0000","last_active":"2024-05-20T17:56:42.018313+0000","last_peered":"2024-05-20T17:56:42.018313+0000","last_clean":"2024-05-20T17:56:42.018313+0000","last_became_active":"2024-05-20T17:56:40.919607+0000","last_became_peered":"2024-05-20T17:56:40.919607+0000","last_unstale":"2024-05-20T17:56:42.018313+0000","last_undegraded":"2024-05-20T17:56:42.018313+0000","last_fullsized":"2024-05-20T17:56:42.018313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:37:16.878410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927210+0000","last_change":"2024-05-20T17:56:40.933148+0000","last_active":"2024-05-20T17:56:41.927210+0000","last_peered":"2024-05-20T17:56:41.927210+0000","last_clean":"2024-05-20T17:56:41.927210+0000","last_became_active":"2024-05-20T17:56:40.932778+0000","last_became_peered":"2024-05-20T17:56:40.932778+0000","last_unstale":"2024-05-20T17:56:41.927210+0000","last_undegraded":"2024-05-20T17:56:41.927210+0000","last_fullsized":"2024-05-20T17:56:41.927210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:05.812791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915177+0000","last_change":"2024-05-20T17:56:40.927684+0000","last_active":"2024-05-20T17:56:41.915177+0000","last_peered":"2024-05-20T17:56:41.915177+0000","last_clean":"2024-05-20T17:56:41.915177+0000","last_became_active":"2024-05-20T17:56:40.927296+0000","last_became_peered":"2024-05-20T17:56:40.927296+0000","last_unstale":"2024-05-20T17:56:41.915177+0000","last_undegraded":"2024-05-20T17:56:41.915177+0000","last_fullsized":"2024-05-20T17:56:41.915177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:43.887338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922050+0000","last_change":"2024-05-20T17:56:40.914006+0000","last_active":"2024-05-20T17:56:41.922050+0000","last_peered":"2024-05-20T17:56:41.922050+0000","last_clean":"2024-05-20T17:56:41.922050+0000","last_became_active":"2024-05-20T17:56:40.913679+0000","last_became_peered":"2024-05-20T17:56:40.913679+0000","last_unstale":"2024-05-20T17:56:41.922050+0000","last_undegraded":"2024-05-20T17:56:41.922050+0000","last_fullsized":"2024-05-20T17:56:41.922050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.026836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918596+0000","last_change":"2024-05-20T17:56:40.922736+0000","last_active":"2024-05-20T17:56:41.918596+0000","last_peered":"2024-05-20T17:56:41.918596+0000","last_clean":"2024-05-20T17:56:41.918596+0000","last_became_active":"2024-05-20T17:56:40.922393+0000","last_became_peered":"2024-05-20T17:56:40.922393+0000","last_unstale":"2024-05-20T17:56:41.918596+0000","last_undegraded":"2024-05-20T17:56:41.918596+0000","last_fullsized":"2024-05-20T17:56:41.918596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:10.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927159+0000","last_change":"2024-05-20T17:56:40.937475+0000","last_active":"2024-05-20T17:56:41.927159+0000","last_peered":"2024-05-20T17:56:41.927159+0000","last_clean":"2024-05-20T17:56:41.927159+0000","last_became_active":"2024-05-20T17:56:40.937069+0000","last_became_peered":"2024-05-20T17:56:40.937069+0000","last_unstale":"2024-05-20T17:56:41.927159+0000","last_undegraded":"2024-05-20T17:56:41.927159+0000","last_fullsized":"2024-05-20T17:56:41.927159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:08:51.069747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913366+0000","last_change":"2024-05-20T17:56:40.925623+0000","last_active":"2024-05-20T17:56:42.913366+0000","last_peered":"2024-05-20T17:56:42.913366+0000","last_clean":"2024-05-20T17:56:42.913366+0000","last_became_active":"2024-05-20T17:56:40.925247+0000","last_became_peered":"2024-05-20T17:56:40.925247+0000","last_unstale":"2024-05-20T17:56:42.913366+0000","last_undegraded":"2024-05-20T17:56:42.913366+0000","last_fullsized":"2024-05-20T17:56:42.913366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:05.102797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915267+0000","last_change":"2024-05-20T17:56:40.939158+0000","last_active":"2024-05-20T17:56:41.915267+0000","last_peered":"2024-05-20T17:56:41.915267+0000","last_clean":"2024-05-20T17:56:41.915267+0000","last_became_active":"2024-05-20T17:56:40.938834+0000","last_became_peered":"2024-05-20T17:56:40.938834+0000","last_unstale":"2024-05-20T17:56:41.915267+0000","last_undegraded":"2024-05-20T17:56:41.915267+0000","last_fullsized":"2024-05-20T17:56:41.915267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:02:31.854410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927066+0000","last_change":"2024-05-20T17:56:40.933675+0000","last_active":"2024-05-20T17:56:41.927066+0000","last_peered":"2024-05-20T17:56:41.927066+0000","last_clean":"2024-05-20T17:56:41.927066+0000","last_became_active":"2024-05-20T17:56:40.932937+0000","last_became_peered":"2024-05-20T17:56:40.932937+0000","last_unstale":"2024-05-20T17:56:41.927066+0000","last_undegraded":"2024-05-20T17:56:41.927066+0000","last_fullsized":"2024-05-20T17:56:41.927066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:48.404324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918820+0000","last_change":"2024-05-20T17:56:40.925447+0000","last_active":"2024-05-20T17:56:41.918820+0000","last_peered":"2024-05-20T17:56:41.918820+0000","last_clean":"2024-05-20T17:56:41.918820+0000","last_became_active":"2024-05-20T17:56:40.925137+0000","last_became_peered":"2024-05-20T17:56:40.925137+0000","last_unstale":"2024-05-20T17:56:41.918820+0000","last_undegraded":"2024-05-20T17:56:41.918820+0000","last_fullsized":"2024-05-20T17:56:41.918820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:23:25.786350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926839+0000","last_change":"2024-05-20T17:56:40.934300+0000","last_active":"2024-05-20T17:56:41.926839+0000","last_peered":"2024-05-20T17:56:41.926839+0000","last_clean":"2024-05-20T17:56:41.926839+0000","last_became_active":"2024-05-20T17:56:40.933966+0000","last_became_peered":"2024-05-20T17:56:40.933966+0000","last_unstale":"2024-05-20T17:56:41.926839+0000","last_undegraded":"2024-05-20T17:56:41.926839+0000","last_fullsized":"2024-05-20T17:56:41.926839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:42.731674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918610+0000","last_change":"2024-05-20T17:56:40.917037+0000","last_active":"2024-05-20T17:56:41.918610+0000","last_peered":"2024-05-20T17:56:41.918610+0000","last_clean":"2024-05-20T17:56:41.918610+0000","last_became_active":"2024-05-20T17:56:40.916592+0000","last_became_peered":"2024-05-20T17:56:40.916592+0000","last_unstale":"2024-05-20T17:56:41.918610+0000","last_undegraded":"2024-05-20T17:56:41.918610+0000","last_fullsized":"2024-05-20T17:56:41.918610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:40.900154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922024+0000","last_change":"2024-05-20T17:56:40.932310+0000","last_active":"2024-05-20T17:56:41.922024+0000","last_peered":"2024-05-20T17:56:41.922024+0000","last_clean":"2024-05-20T17:56:41.922024+0000","last_became_active":"2024-05-20T17:56:40.931976+0000","last_became_peered":"2024-05-20T17:56:40.931976+0000","last_unstale":"2024-05-20T17:56:41.922024+0000","last_undegraded":"2024-05-20T17:56:41.922024+0000","last_fullsized":"2024-05-20T17:56:41.922024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:29:17.752942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922343+0000","last_change":"2024-05-20T17:56:40.931421+0000","last_active":"2024-05-20T17:56:41.922343+0000","last_peered":"2024-05-20T17:56:41.922343+0000","last_clean":"2024-05-20T17:56:41.922343+0000","last_became_active":"2024-05-20T17:56:40.931084+0000","last_became_peered":"2024-05-20T17:56:40.931084+0000","last_unstale":"2024-05-20T17:56:41.922343+0000","last_undegraded":"2024-05-20T17:56:41.922343+0000","last_fullsized":"2024-05-20T17:56:41.922343+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:18:57.545728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018607+0000","last_change":"2024-05-20T17:56:40.919085+0000","last_active":"2024-05-20T17:56:42.018607+0000","last_peered":"2024-05-20T17:56:42.018607+0000","last_clean":"2024-05-20T17:56:42.018607+0000","last_became_active":"2024-05-20T17:56:40.918795+0000","last_became_peered":"2024-05-20T17:56:40.918795+0000","last_unstale":"2024-05-20T17:56:42.018607+0000","last_undegraded":"2024-05-20T17:56:42.018607+0000","last_fullsized":"2024-05-20T17:56:42.018607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:14:46.165791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919197+0000","last_change":"2024-05-20T17:56:40.920438+0000","last_active":"2024-05-20T17:56:41.919197+0000","last_peered":"2024-05-20T17:56:41.919197+0000","last_clean":"2024-05-20T17:56:41.919197+0000","last_became_active":"2024-05-20T17:56:40.920129+0000","last_became_peered":"2024-05-20T17:56:40.920129+0000","last_unstale":"2024-05-20T17:56:41.919197+0000","last_undegraded":"2024-05-20T17:56:41.919197+0000","last_fullsized":"2024-05-20T17:56:41.919197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.026836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927227+0000","last_change":"2024-05-20T17:56:40.933063+0000","last_active":"2024-05-20T17:56:41.927227+0000","last_peered":"2024-05-20T17:56:41.927227+0000","last_clean":"2024-05-20T17:56:41.927227+0000","last_became_active":"2024-05-20T17:56:40.932661+0000","last_became_peered":"2024-05-20T17:56:40.932661+0000","last_unstale":"2024-05-20T17:56:41.927227+0000","last_undegraded":"2024-05-20T17:56:41.927227+0000","last_fullsized":"2024-05-20T17:56:41.927227+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:25.095137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922760+0000","last_change":"2024-05-20T17:56:40.928533+0000","last_active":"2024-05-20T17:56:41.922760+0000","last_peered":"2024-05-20T17:56:41.922760+0000","last_clean":"2024-05-20T17:56:41.922760+0000","last_became_active":"2024-05-20T17:56:40.927773+0000","last_became_peered":"2024-05-20T17:56:40.927773+0000","last_unstale":"2024-05-20T17:56:41.922760+0000","last_undegraded":"2024-05-20T17:56:41.922760+0000","last_fullsized":"2024-05-20T17:56:41.922760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:09:57.888291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918820+0000","last_change":"2024-05-20T17:56:40.930439+0000","last_active":"2024-05-20T17:56:41.918820+0000","last_peered":"2024-05-20T17:56:41.918820+0000","last_clean":"2024-05-20T17:56:41.918820+0000","last_became_active":"2024-05-20T17:56:40.930145+0000","last_became_peered":"2024-05-20T17:56:40.930145+0000","last_unstale":"2024-05-20T17:56:41.918820+0000","last_undegraded":"2024-05-20T17:56:41.918820+0000","last_fullsized":"2024-05-20T17:56:41.918820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:29:17.752942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913066+0000","last_change":"2024-05-20T17:56:40.926079+0000","last_active":"2024-05-20T17:56:42.913066+0000","last_peered":"2024-05-20T17:56:42.913066+0000","last_clean":"2024-05-20T17:56:42.913066+0000","last_became_active":"2024-05-20T17:56:40.925262+0000","last_became_peered":"2024-05-20T17:56:40.925262+0000","last_unstale":"2024-05-20T17:56:42.913066+0000","last_undegraded":"2024-05-20T17:56:42.913066+0000","last_fullsized":"2024-05-20T17:56:42.913066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:58:30.862553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918198+0000","last_change":"2024-05-20T17:56:40.926984+0000","last_active":"2024-05-20T17:56:41.918198+0000","last_peered":"2024-05-20T17:56:41.918198+0000","last_clean":"2024-05-20T17:56:41.918198+0000","last_became_active":"2024-05-20T17:56:40.926658+0000","last_became_peered":"2024-05-20T17:56:40.926658+0000","last_unstale":"2024-05-20T17:56:41.918198+0000","last_undegraded":"2024-05-20T17:56:41.918198+0000","last_fullsized":"2024-05-20T17:56:41.918198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:57.014500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913049+0000","last_change":"2024-05-20T17:56:40.920462+0000","last_active":"2024-05-20T17:56:42.913049+0000","last_peered":"2024-05-20T17:56:42.913049+0000","last_clean":"2024-05-20T17:56:42.913049+0000","last_became_active":"2024-05-20T17:56:40.920145+0000","last_became_peered":"2024-05-20T17:56:40.920145+0000","last_unstale":"2024-05-20T17:56:42.913049+0000","last_undegraded":"2024-05-20T17:56:42.913049+0000","last_fullsized":"2024-05-20T17:56:42.913049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:24:19.895498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927059+0000","last_change":"2024-05-20T17:56:39.920496+0000","last_active":"2024-05-20T17:56:41.927059+0000","last_peered":"2024-05-20T17:56:41.927059+0000","last_clean":"2024-05-20T17:56:41.927059+0000","last_became_active":"2024-05-20T17:56:39.920117+0000","last_became_peered":"2024-05-20T17:56:39.920117+0000","last_unstale":"2024-05-20T17:56:41.927059+0000","last_undegraded":"2024-05-20T17:56:41.927059+0000","last_fullsized":"2024-05-20T17:56:41.927059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:29:21.790558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922124+0000","last_change":"2024-05-20T17:56:40.918231+0000","last_active":"2024-05-20T17:56:41.922124+0000","last_peered":"2024-05-20T17:56:41.922124+0000","last_clean":"2024-05-20T17:56:41.922124+0000","last_became_active":"2024-05-20T17:56:40.917921+0000","last_became_peered":"2024-05-20T17:56:40.917921+0000","last_unstale":"2024-05-20T17:56:41.922124+0000","last_undegraded":"2024-05-20T17:56:41.922124+0000","last_fullsized":"2024-05-20T17:56:41.922124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:06:41.492721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919485+0000","last_change":"2024-05-20T17:56:39.915235+0000","last_active":"2024-05-20T17:56:41.919485+0000","last_peered":"2024-05-20T17:56:41.919485+0000","last_clean":"2024-05-20T17:56:41.919485+0000","last_became_active":"2024-05-20T17:56:39.914486+0000","last_became_peered":"2024-05-20T17:56:39.914486+0000","last_unstale":"2024-05-20T17:56:41.919485+0000","last_undegraded":"2024-05-20T17:56:41.919485+0000","last_fullsized":"2024-05-20T17:56:41.919485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:09.622712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918945+0000","last_change":"2024-05-20T17:56:40.922513+0000","last_active":"2024-05-20T17:56:41.918945+0000","last_peered":"2024-05-20T17:56:41.918945+0000","last_clean":"2024-05-20T17:56:41.918945+0000","last_became_active":"2024-05-20T17:56:40.922211+0000","last_became_peered":"2024-05-20T17:56:40.922211+0000","last_unstale":"2024-05-20T17:56:41.918945+0000","last_undegraded":"2024-05-20T17:56:41.918945+0000","last_fullsized":"2024-05-20T17:56:41.918945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:02:03.200715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919426+0000","last_change":"2024-05-20T17:56:39.911850+0000","last_active":"2024-05-20T17:56:41.919426+0000","last_peered":"2024-05-20T17:56:41.919426+0000","last_clean":"2024-05-20T17:56:41.919426+0000","last_became_active":"2024-05-20T17:56:39.911507+0000","last_became_peered":"2024-05-20T17:56:39.911507+0000","last_unstale":"2024-05-20T17:56:41.919426+0000","last_undegraded":"2024-05-20T17:56:41.919426+0000","last_fullsized":"2024-05-20T17:56:41.919426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:13.465927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919024+0000","last_change":"2024-05-20T17:56:40.925764+0000","last_active":"2024-05-20T17:56:41.919024+0000","last_peered":"2024-05-20T17:56:41.919024+0000","last_clean":"2024-05-20T17:56:41.919024+0000","last_became_active":"2024-05-20T17:56:40.925455+0000","last_became_peered":"2024-05-20T17:56:40.925455+0000","last_unstale":"2024-05-20T17:56:41.919024+0000","last_undegraded":"2024-05-20T17:56:41.919024+0000","last_fullsized":"2024-05-20T17:56:41.919024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:24:19.895498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913572+0000","last_change":"2024-05-20T17:56:39.908744+0000","last_active":"2024-05-20T17:56:42.913572+0000","last_peered":"2024-05-20T17:56:42.913572+0000","last_clean":"2024-05-20T17:56:42.913572+0000","last_became_active":"2024-05-20T17:56:39.908411+0000","last_became_peered":"2024-05-20T17:56:39.908411+0000","last_unstale":"2024-05-20T17:56:42.913572+0000","last_undegraded":"2024-05-20T17:56:42.913572+0000","last_fullsized":"2024-05-20T17:56:42.913572+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:04:04.995330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922530+0000","last_change":"2024-05-20T17:56:40.943211+0000","last_active":"2024-05-20T17:56:41.922530+0000","last_peered":"2024-05-20T17:56:41.922530+0000","last_clean":"2024-05-20T17:56:41.922530+0000","last_became_active":"2024-05-20T17:56:40.942881+0000","last_became_peered":"2024-05-20T17:56:40.942881+0000","last_unstale":"2024-05-20T17:56:41.922530+0000","last_undegraded":"2024-05-20T17:56:41.922530+0000","last_fullsized":"2024-05-20T17:56:41.922530+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:20:48.520463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918904+0000","last_change":"2024-05-20T17:56:39.905931+0000","last_active":"2024-05-20T17:56:41.918904+0000","last_peered":"2024-05-20T17:56:41.918904+0000","last_clean":"2024-05-20T17:56:41.918904+0000","last_became_active":"2024-05-20T17:56:39.905571+0000","last_became_peered":"2024-05-20T17:56:39.905571+0000","last_unstale":"2024-05-20T17:56:41.918904+0000","last_undegraded":"2024-05-20T17:56:41.918904+0000","last_fullsized":"2024-05-20T17:56:41.918904+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:41.286867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922720+0000","last_change":"2024-05-20T17:56:40.943996+0000","last_active":"2024-05-20T17:56:41.922720+0000","last_peered":"2024-05-20T17:56:41.922720+0000","last_clean":"2024-05-20T17:56:41.922720+0000","last_became_active":"2024-05-20T17:56:40.943192+0000","last_became_peered":"2024-05-20T17:56:40.943192+0000","last_unstale":"2024-05-20T17:56:41.922720+0000","last_undegraded":"2024-05-20T17:56:41.922720+0000","last_fullsized":"2024-05-20T17:56:41.922720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:25:46.715360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.017865+0000","last_change":"2024-05-20T17:56:39.909239+0000","last_active":"2024-05-20T17:56:42.017865+0000","last_peered":"2024-05-20T17:56:42.017865+0000","last_clean":"2024-05-20T17:56:42.017865+0000","last_became_active":"2024-05-20T17:56:39.908884+0000","last_became_peered":"2024-05-20T17:56:39.908884+0000","last_unstale":"2024-05-20T17:56:42.017865+0000","last_undegraded":"2024-05-20T17:56:42.017865+0000","last_fullsized":"2024-05-20T17:56:42.017865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:15:54.918810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919185+0000","last_change":"2024-05-20T17:56:40.925179+0000","last_active":"2024-05-20T17:56:41.919185+0000","last_peered":"2024-05-20T17:56:41.919185+0000","last_clean":"2024-05-20T17:56:41.919185+0000","last_became_active":"2024-05-20T17:56:40.924882+0000","last_became_peered":"2024-05-20T17:56:40.924882+0000","last_unstale":"2024-05-20T17:56:41.919185+0000","last_undegraded":"2024-05-20T17:56:41.919185+0000","last_fullsized":"2024-05-20T17:56:41.919185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:58:30.862553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922122+0000","last_change":"2024-05-20T17:56:39.909738+0000","last_active":"2024-05-20T17:56:41.922122+0000","last_peered":"2024-05-20T17:56:41.922122+0000","last_clean":"2024-05-20T17:56:41.922122+0000","last_became_active":"2024-05-20T17:56:39.909374+0000","last_became_peered":"2024-05-20T17:56:39.909374+0000","last_unstale":"2024-05-20T17:56:41.922122+0000","last_undegraded":"2024-05-20T17:56:41.922122+0000","last_fullsized":"2024-05-20T17:56:41.922122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:09.622712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913967+0000","last_change":"2024-05-20T17:56:40.939059+0000","last_active":"2024-05-20T17:56:42.913967+0000","last_peered":"2024-05-20T17:56:42.913967+0000","last_clean":"2024-05-20T17:56:42.913967+0000","last_became_active":"2024-05-20T17:56:40.938688+0000","last_became_peered":"2024-05-20T17:56:40.938688+0000","last_unstale":"2024-05-20T17:56:42.913967+0000","last_undegraded":"2024-05-20T17:56:42.913967+0000","last_fullsized":"2024-05-20T17:56:42.913967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:03:10.108687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926645+0000","last_change":"2024-05-20T17:56:39.916490+0000","last_active":"2024-05-20T17:56:41.926645+0000","last_peered":"2024-05-20T17:56:41.926645+0000","last_clean":"2024-05-20T17:56:41.926645+0000","last_became_active":"2024-05-20T17:56:39.916165+0000","last_became_peered":"2024-05-20T17:56:39.916165+0000","last_unstale":"2024-05-20T17:56:41.926645+0000","last_undegraded":"2024-05-20T17:56:41.926645+0000","last_fullsized":"2024-05-20T17:56:41.926645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:55:32.775737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922024+0000","last_change":"2024-05-20T17:56:40.930216+0000","last_active":"2024-05-20T17:56:41.922024+0000","last_peered":"2024-05-20T17:56:41.922024+0000","last_clean":"2024-05-20T17:56:41.922024+0000","last_became_active":"2024-05-20T17:56:40.929831+0000","last_became_peered":"2024-05-20T17:56:40.929831+0000","last_unstale":"2024-05-20T17:56:41.922024+0000","last_undegraded":"2024-05-20T17:56:41.922024+0000","last_fullsized":"2024-05-20T17:56:41.922024+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:10.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919695+0000","last_change":"2024-05-20T17:56:39.913025+0000","last_active":"2024-05-20T17:56:41.919695+0000","last_peered":"2024-05-20T17:56:41.919695+0000","last_clean":"2024-05-20T17:56:41.919695+0000","last_became_active":"2024-05-20T17:56:39.911801+0000","last_became_peered":"2024-05-20T17:56:39.911801+0000","last_unstale":"2024-05-20T17:56:41.919695+0000","last_undegraded":"2024-05-20T17:56:41.919695+0000","last_fullsized":"2024-05-20T17:56:41.919695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:37:15.871693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018064+0000","last_change":"2024-05-20T17:56:40.920286+0000","last_active":"2024-05-20T17:56:42.018064+0000","last_peered":"2024-05-20T17:56:42.018064+0000","last_clean":"2024-05-20T17:56:42.018064+0000","last_became_active":"2024-05-20T17:56:40.919682+0000","last_became_peered":"2024-05-20T17:56:40.919682+0000","last_unstale":"2024-05-20T17:56:42.018064+0000","last_undegraded":"2024-05-20T17:56:42.018064+0000","last_fullsized":"2024-05-20T17:56:42.018064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:22.806604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018579+0000","last_change":"2024-05-20T17:56:39.906306+0000","last_active":"2024-05-20T17:56:42.018579+0000","last_peered":"2024-05-20T17:56:42.018579+0000","last_clean":"2024-05-20T17:56:42.018579+0000","last_became_active":"2024-05-20T17:56:39.906014+0000","last_became_peered":"2024-05-20T17:56:39.906014+0000","last_unstale":"2024-05-20T17:56:42.018579+0000","last_undegraded":"2024-05-20T17:56:42.018579+0000","last_fullsized":"2024-05-20T17:56:42.018579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:21:12.013749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915361+0000","last_change":"2024-05-20T17:56:40.935003+0000","last_active":"2024-05-20T17:56:41.915361+0000","last_peered":"2024-05-20T17:56:41.915361+0000","last_clean":"2024-05-20T17:56:41.915361+0000","last_became_active":"2024-05-20T17:56:40.934420+0000","last_became_peered":"2024-05-20T17:56:40.934420+0000","last_unstale":"2024-05-20T17:56:41.915361+0000","last_undegraded":"2024-05-20T17:56:41.915361+0000","last_fullsized":"2024-05-20T17:56:41.915361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:29:17.752942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927179+0000","last_change":"2024-05-20T17:56:39.916426+0000","last_active":"2024-05-20T17:56:41.927179+0000","last_peered":"2024-05-20T17:56:41.927179+0000","last_clean":"2024-05-20T17:56:41.927179+0000","last_became_active":"2024-05-20T17:56:39.915422+0000","last_became_peered":"2024-05-20T17:56:39.915422+0000","last_unstale":"2024-05-20T17:56:41.927179+0000","last_undegraded":"2024-05-20T17:56:41.927179+0000","last_fullsized":"2024-05-20T17:56:41.927179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:08:32.395477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913193+0000","last_change":"2024-05-20T17:56:40.917699+0000","last_active":"2024-05-20T17:56:42.913193+0000","last_peered":"2024-05-20T17:56:42.913193+0000","last_clean":"2024-05-20T17:56:42.913193+0000","last_became_active":"2024-05-20T17:56:40.917391+0000","last_became_peered":"2024-05-20T17:56:40.917391+0000","last_unstale":"2024-05-20T17:56:42.913193+0000","last_undegraded":"2024-05-20T17:56:42.913193+0000","last_fullsized":"2024-05-20T17:56:42.913193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:47:29.125688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913730+0000","last_change":"2024-05-20T17:56:39.911791+0000","last_active":"2024-05-20T17:56:42.913730+0000","last_peered":"2024-05-20T17:56:42.913730+0000","last_clean":"2024-05-20T17:56:42.913730+0000","last_became_active":"2024-05-20T17:56:39.910946+0000","last_became_peered":"2024-05-20T17:56:39.910946+0000","last_unstale":"2024-05-20T17:56:42.913730+0000","last_undegraded":"2024-05-20T17:56:42.913730+0000","last_fullsized":"2024-05-20T17:56:42.913730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:39.893437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018407+0000","last_change":"2024-05-20T17:56:40.924501+0000","last_active":"2024-05-20T17:56:42.018407+0000","last_peered":"2024-05-20T17:56:42.018407+0000","last_clean":"2024-05-20T17:56:42.018407+0000","last_became_active":"2024-05-20T17:56:40.924166+0000","last_became_peered":"2024-05-20T17:56:40.924166+0000","last_unstale":"2024-05-20T17:56:42.018407+0000","last_undegraded":"2024-05-20T17:56:42.018407+0000","last_fullsized":"2024-05-20T17:56:42.018407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:11:11.443634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.017850+0000","last_change":"2024-05-20T17:56:39.904787+0000","last_active":"2024-05-20T17:56:42.017850+0000","last_peered":"2024-05-20T17:56:42.017850+0000","last_clean":"2024-05-20T17:56:42.017850+0000","last_became_active":"2024-05-20T17:56:39.904462+0000","last_became_peered":"2024-05-20T17:56:39.904462+0000","last_unstale":"2024-05-20T17:56:42.017850+0000","last_undegraded":"2024-05-20T17:56:42.017850+0000","last_fullsized":"2024-05-20T17:56:42.017850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:04.096081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913709+0000","last_change":"2024-05-20T17:56:40.934156+0000","last_active":"2024-05-20T17:56:42.913709+0000","last_peered":"2024-05-20T17:56:42.913709+0000","last_clean":"2024-05-20T17:56:42.913709+0000","last_became_active":"2024-05-20T17:56:40.933841+0000","last_became_peered":"2024-05-20T17:56:40.933841+0000","last_unstale":"2024-05-20T17:56:42.913709+0000","last_undegraded":"2024-05-20T17:56:42.913709+0000","last_fullsized":"2024-05-20T17:56:42.913709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:21:13.020466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919033+0000","last_change":"2024-05-20T17:56:39.918155+0000","last_active":"2024-05-20T17:56:41.919033+0000","last_peered":"2024-05-20T17:56:41.919033+0000","last_clean":"2024-05-20T17:56:41.919033+0000","last_became_active":"2024-05-20T17:56:39.917525+0000","last_became_peered":"2024-05-20T17:56:39.917525+0000","last_unstale":"2024-05-20T17:56:41.919033+0000","last_undegraded":"2024-05-20T17:56:41.919033+0000","last_fullsized":"2024-05-20T17:56:41.919033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:56:47.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913840+0000","last_change":"2024-05-20T17:56:40.928778+0000","last_active":"2024-05-20T17:56:42.913840+0000","last_peered":"2024-05-20T17:56:42.913840+0000","last_clean":"2024-05-20T17:56:42.913840+0000","last_became_active":"2024-05-20T17:56:40.928004+0000","last_became_peered":"2024-05-20T17:56:40.928004+0000","last_unstale":"2024-05-20T17:56:42.913840+0000","last_undegraded":"2024-05-20T17:56:42.913840+0000","last_fullsized":"2024-05-20T17:56:42.913840+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:10.629429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926712+0000","last_change":"2024-05-20T17:56:39.920567+0000","last_active":"2024-05-20T17:56:41.926712+0000","last_peered":"2024-05-20T17:56:41.926712+0000","last_clean":"2024-05-20T17:56:41.926712+0000","last_became_active":"2024-05-20T17:56:39.920201+0000","last_became_peered":"2024-05-20T17:56:39.920201+0000","last_unstale":"2024-05-20T17:56:41.926712+0000","last_undegraded":"2024-05-20T17:56:41.926712+0000","last_fullsized":"2024-05-20T17:56:41.926712+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:27:20.250897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913982+0000","last_change":"2024-05-20T17:56:40.927666+0000","last_active":"2024-05-20T17:56:42.913982+0000","last_peered":"2024-05-20T17:56:42.913982+0000","last_clean":"2024-05-20T17:56:42.913982+0000","last_became_active":"2024-05-20T17:56:40.927299+0000","last_became_peered":"2024-05-20T17:56:40.927299+0000","last_unstale":"2024-05-20T17:56:42.913982+0000","last_undegraded":"2024-05-20T17:56:42.913982+0000","last_fullsized":"2024-05-20T17:56:42.913982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:14.472644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922091+0000","last_change":"2024-05-20T17:56:39.913017+0000","last_active":"2024-05-20T17:56:41.922091+0000","last_peered":"2024-05-20T17:56:41.922091+0000","last_clean":"2024-05-20T17:56:41.922091+0000","last_became_active":"2024-05-20T17:56:39.912679+0000","last_became_peered":"2024-05-20T17:56:39.912679+0000","last_unstale":"2024-05-20T17:56:41.922091+0000","last_undegraded":"2024-05-20T17:56:41.922091+0000","last_fullsized":"2024-05-20T17:56:41.922091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:40:12.330281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915434+0000","last_change":"2024-05-20T17:56:40.934916+0000","last_active":"2024-05-20T17:56:41.915434+0000","last_peered":"2024-05-20T17:56:41.915434+0000","last_clean":"2024-05-20T17:56:41.915434+0000","last_became_active":"2024-05-20T17:56:40.934588+0000","last_became_peered":"2024-05-20T17:56:40.934588+0000","last_unstale":"2024-05-20T17:56:41.915434+0000","last_undegraded":"2024-05-20T17:56:41.915434+0000","last_fullsized":"2024-05-20T17:56:41.915434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:57.014500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919703+0000","last_change":"2024-05-20T17:56:39.913874+0000","last_active":"2024-05-20T17:56:41.919703+0000","last_peered":"2024-05-20T17:56:41.919703+0000","last_clean":"2024-05-20T17:56:41.919703+0000","last_became_active":"2024-05-20T17:56:39.913539+0000","last_became_peered":"2024-05-20T17:56:39.913539+0000","last_unstale":"2024-05-20T17:56:41.919703+0000","last_undegraded":"2024-05-20T17:56:41.919703+0000","last_fullsized":"2024-05-20T17:56:41.919703+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:11:10.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926899+0000","last_change":"2024-05-20T17:56:40.931892+0000","last_active":"2024-05-20T17:56:41.926899+0000","last_peered":"2024-05-20T17:56:41.926899+0000","last_clean":"2024-05-20T17:56:41.926899+0000","last_became_active":"2024-05-20T17:56:40.931549+0000","last_became_peered":"2024-05-20T17:56:40.931549+0000","last_unstale":"2024-05-20T17:56:41.926899+0000","last_undegraded":"2024-05-20T17:56:41.926899+0000","last_fullsized":"2024-05-20T17:56:41.926899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:33.782092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919256+0000","last_change":"2024-05-20T17:56:39.906089+0000","last_active":"2024-05-20T17:56:41.919256+0000","last_peered":"2024-05-20T17:56:41.919256+0000","last_clean":"2024-05-20T17:56:41.919256+0000","last_became_active":"2024-05-20T17:56:39.905766+0000","last_became_peered":"2024-05-20T17:56:39.905766+0000","last_unstale":"2024-05-20T17:56:41.919256+0000","last_undegraded":"2024-05-20T17:56:41.919256+0000","last_fullsized":"2024-05-20T17:56:41.919256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:50:17.022566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926843+0000","last_change":"2024-05-20T17:56:40.934583+0000","last_active":"2024-05-20T17:56:41.926843+0000","last_peered":"2024-05-20T17:56:41.926843+0000","last_clean":"2024-05-20T17:56:41.926843+0000","last_became_active":"2024-05-20T17:56:40.934233+0000","last_became_peered":"2024-05-20T17:56:40.934233+0000","last_unstale":"2024-05-20T17:56:41.926843+0000","last_undegraded":"2024-05-20T17:56:41.926843+0000","last_fullsized":"2024-05-20T17:56:41.926843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:06:45.264804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.927258+0000","last_change":"2024-05-20T17:56:39.915992+0000","last_active":"2024-05-20T17:56:41.927258+0000","last_peered":"2024-05-20T17:56:41.927258+0000","last_clean":"2024-05-20T17:56:41.927258+0000","last_became_active":"2024-05-20T17:56:39.915500+0000","last_became_peered":"2024-05-20T17:56:39.915500+0000","last_unstale":"2024-05-20T17:56:41.927258+0000","last_undegraded":"2024-05-20T17:56:41.927258+0000","last_fullsized":"2024-05-20T17:56:41.927258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:15.041844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915328+0000","last_change":"2024-05-20T17:56:40.935628+0000","last_active":"2024-05-20T17:56:41.915328+0000","last_peered":"2024-05-20T17:56:41.915328+0000","last_clean":"2024-05-20T17:56:41.915328+0000","last_became_active":"2024-05-20T17:56:40.935320+0000","last_became_peered":"2024-05-20T17:56:40.935320+0000","last_unstale":"2024-05-20T17:56:41.915328+0000","last_undegraded":"2024-05-20T17:56:41.915328+0000","last_fullsized":"2024-05-20T17:56:41.915328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:10.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913001+0000","last_change":"2024-05-20T17:56:39.916652+0000","last_active":"2024-05-20T17:56:42.913001+0000","last_peered":"2024-05-20T17:56:42.913001+0000","last_clean":"2024-05-20T17:56:42.913001+0000","last_became_active":"2024-05-20T17:56:39.916021+0000","last_became_peered":"2024-05-20T17:56:39.916021+0000","last_unstale":"2024-05-20T17:56:42.913001+0000","last_undegraded":"2024-05-20T17:56:42.913001+0000","last_fullsized":"2024-05-20T17:56:42.913001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:36.602648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922531+0000","last_change":"2024-05-20T17:56:40.917496+0000","last_active":"2024-05-20T17:56:41.922531+0000","last_peered":"2024-05-20T17:56:41.922531+0000","last_clean":"2024-05-20T17:56:41.922531+0000","last_became_active":"2024-05-20T17:56:40.917147+0000","last_became_peered":"2024-05-20T17:56:40.917147+0000","last_unstale":"2024-05-20T17:56:41.922531+0000","last_undegraded":"2024-05-20T17:56:41.922531+0000","last_fullsized":"2024-05-20T17:56:41.922531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:21.500381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915385+0000","last_change":"2024-05-20T17:56:39.913984+0000","last_active":"2024-05-20T17:56:41.915385+0000","last_peered":"2024-05-20T17:56:41.915385+0000","last_clean":"2024-05-20T17:56:41.915385+0000","last_became_active":"2024-05-20T17:56:39.913644+0000","last_became_peered":"2024-05-20T17:56:39.913644+0000","last_unstale":"2024-05-20T17:56:41.915385+0000","last_undegraded":"2024-05-20T17:56:41.915385+0000","last_fullsized":"2024-05-20T17:56:41.915385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:21.799887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922769+0000","last_change":"2024-05-20T17:56:40.930339+0000","last_active":"2024-05-20T17:56:41.922769+0000","last_peered":"2024-05-20T17:56:41.922769+0000","last_clean":"2024-05-20T17:56:41.922769+0000","last_became_active":"2024-05-20T17:56:40.930024+0000","last_became_peered":"2024-05-20T17:56:40.930024+0000","last_unstale":"2024-05-20T17:56:41.922769+0000","last_undegraded":"2024-05-20T17:56:41.922769+0000","last_fullsized":"2024-05-20T17:56:41.922769+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:19.848028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.914984+0000","last_change":"2024-05-20T17:56:39.913015+0000","last_active":"2024-05-20T17:56:41.914984+0000","last_peered":"2024-05-20T17:56:41.914984+0000","last_clean":"2024-05-20T17:56:41.914984+0000","last_became_active":"2024-05-20T17:56:39.912553+0000","last_became_peered":"2024-05-20T17:56:39.912553+0000","last_unstale":"2024-05-20T17:56:41.914984+0000","last_undegraded":"2024-05-20T17:56:41.914984+0000","last_fullsized":"2024-05-20T17:56:41.914984+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:03:09.101970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.914152+0000","last_change":"2024-05-20T17:56:40.924668+0000","last_active":"2024-05-20T17:56:42.914152+0000","last_peered":"2024-05-20T17:56:42.914152+0000","last_clean":"2024-05-20T17:56:42.914152+0000","last_became_active":"2024-05-20T17:56:40.923769+0000","last_became_peered":"2024-05-20T17:56:40.923769+0000","last_unstale":"2024-05-20T17:56:42.914152+0000","last_undegraded":"2024-05-20T17:56:42.914152+0000","last_fullsized":"2024-05-20T17:56:42.914152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:22.806604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.914998+0000","last_change":"2024-05-20T17:56:39.911842+0000","last_active":"2024-05-20T17:56:41.914998+0000","last_peered":"2024-05-20T17:56:41.914998+0000","last_clean":"2024-05-20T17:56:41.914998+0000","last_became_active":"2024-05-20T17:56:39.911488+0000","last_became_peered":"2024-05-20T17:56:39.911488+0000","last_unstale":"2024-05-20T17:56:41.914998+0000","last_undegraded":"2024-05-20T17:56:41.914998+0000","last_fullsized":"2024-05-20T17:56:41.914998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:06:13.465927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918410+0000","last_change":"2024-05-20T17:56:40.920058+0000","last_active":"2024-05-20T17:56:41.918410+0000","last_peered":"2024-05-20T17:56:41.918410+0000","last_clean":"2024-05-20T17:56:41.918410+0000","last_became_active":"2024-05-20T17:56:40.919767+0000","last_became_peered":"2024-05-20T17:56:40.919767+0000","last_unstale":"2024-05-20T17:56:41.918410+0000","last_undegraded":"2024-05-20T17:56:41.918410+0000","last_fullsized":"2024-05-20T17:56:41.918410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:04:06.002047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.018649+0000","last_change":"2024-05-20T17:56:39.899998+0000","last_active":"2024-05-20T17:56:42.018649+0000","last_peered":"2024-05-20T17:56:42.018649+0000","last_clean":"2024-05-20T17:56:42.018649+0000","last_became_active":"2024-05-20T17:56:39.899679+0000","last_became_peered":"2024-05-20T17:56:39.899679+0000","last_unstale":"2024-05-20T17:56:42.018649+0000","last_undegraded":"2024-05-20T17:56:42.018649+0000","last_fullsized":"2024-05-20T17:56:42.018649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:16:26.191811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913798+0000","last_change":"2024-05-20T17:56:40.925046+0000","last_active":"2024-05-20T17:56:42.913798+0000","last_peered":"2024-05-20T17:56:42.913798+0000","last_clean":"2024-05-20T17:56:42.913798+0000","last_became_active":"2024-05-20T17:56:40.923972+0000","last_became_peered":"2024-05-20T17:56:40.923972+0000","last_unstale":"2024-05-20T17:56:42.913798+0000","last_undegraded":"2024-05-20T17:56:42.913798+0000","last_fullsized":"2024-05-20T17:56:42.913798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:25:48.227620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922715+0000","last_change":"2024-05-20T17:56:39.916338+0000","last_active":"2024-05-20T17:56:41.922715+0000","last_peered":"2024-05-20T17:56:41.922715+0000","last_clean":"2024-05-20T17:56:41.922715+0000","last_became_active":"2024-05-20T17:56:39.915941+0000","last_became_peered":"2024-05-20T17:56:39.915941+0000","last_unstale":"2024-05-20T17:56:41.922715+0000","last_undegraded":"2024-05-20T17:56:41.922715+0000","last_fullsized":"2024-05-20T17:56:41.922715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:25:47.220903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918896+0000","last_change":"2024-05-20T17:56:40.923218+0000","last_active":"2024-05-20T17:56:41.918896+0000","last_peered":"2024-05-20T17:56:41.918896+0000","last_clean":"2024-05-20T17:56:41.918896+0000","last_became_active":"2024-05-20T17:56:40.922948+0000","last_became_peered":"2024-05-20T17:56:40.922948+0000","last_unstale":"2024-05-20T17:56:41.918896+0000","last_undegraded":"2024-05-20T17:56:41.918896+0000","last_fullsized":"2024-05-20T17:56:41.918896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:46:19.680624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919582+0000","last_change":"2024-05-20T17:56:39.913394+0000","last_active":"2024-05-20T17:56:41.919582+0000","last_peered":"2024-05-20T17:56:41.919582+0000","last_clean":"2024-05-20T17:56:41.919582+0000","last_became_active":"2024-05-20T17:56:39.913056+0000","last_became_peered":"2024-05-20T17:56:39.913056+0000","last_unstale":"2024-05-20T17:56:41.919582+0000","last_undegraded":"2024-05-20T17:56:41.919582+0000","last_fullsized":"2024-05-20T17:56:41.919582+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:15:21.799887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.922709+0000","last_change":"2024-05-20T17:56:40.921424+0000","last_active":"2024-05-20T17:56:41.922709+0000","last_peered":"2024-05-20T17:56:41.922709+0000","last_clean":"2024-05-20T17:56:41.922709+0000","last_became_active":"2024-05-20T17:56:40.921085+0000","last_became_peered":"2024-05-20T17:56:40.921085+0000","last_unstale":"2024-05-20T17:56:41.922709+0000","last_undegraded":"2024-05-20T17:56:41.922709+0000","last_fullsized":"2024-05-20T17:56:41.922709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:04.558171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918187+0000","last_change":"2024-05-20T17:56:39.913006+0000","last_active":"2024-05-20T17:56:41.918187+0000","last_peered":"2024-05-20T17:56:41.918187+0000","last_clean":"2024-05-20T17:56:41.918187+0000","last_became_active":"2024-05-20T17:56:39.912386+0000","last_became_peered":"2024-05-20T17:56:39.912386+0000","last_unstale":"2024-05-20T17:56:41.918187+0000","last_undegraded":"2024-05-20T17:56:41.918187+0000","last_fullsized":"2024-05-20T17:56:41.918187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:03:09.101970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913696+0000","last_change":"2024-05-20T17:56:40.927449+0000","last_active":"2024-05-20T17:56:42.913696+0000","last_peered":"2024-05-20T17:56:42.913696+0000","last_clean":"2024-05-20T17:56:42.913696+0000","last_became_active":"2024-05-20T17:56:40.925832+0000","last_became_peered":"2024-05-20T17:56:40.925832+0000","last_unstale":"2024-05-20T17:56:42.913696+0000","last_undegraded":"2024-05-20T17:56:42.913696+0000","last_fullsized":"2024-05-20T17:56:42.913696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:18:04.892054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913409+0000","last_change":"2024-05-20T17:56:39.910720+0000","last_active":"2024-05-20T17:56:42.913409+0000","last_peered":"2024-05-20T17:56:42.913409+0000","last_clean":"2024-05-20T17:56:42.913409+0000","last_became_active":"2024-05-20T17:56:39.910419+0000","last_became_peered":"2024-05-20T17:56:39.910419+0000","last_unstale":"2024-05-20T17:56:42.913409+0000","last_undegraded":"2024-05-20T17:56:42.913409+0000","last_fullsized":"2024-05-20T17:56:42.913409+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:37.049601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913797+0000","last_change":"2024-05-20T17:56:40.939244+0000","last_active":"2024-05-20T17:56:42.913797+0000","last_peered":"2024-05-20T17:56:42.913797+0000","last_clean":"2024-05-20T17:56:42.913797+0000","last_became_active":"2024-05-20T17:56:40.938834+0000","last_became_peered":"2024-05-20T17:56:40.938834+0000","last_unstale":"2024-05-20T17:56:42.913797+0000","last_undegraded":"2024-05-20T17:56:42.913797+0000","last_fullsized":"2024-05-20T17:56:42.913797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:40:13.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.926925+0000","last_change":"2024-05-20T17:56:39.915927+0000","last_active":"2024-05-20T17:56:41.926925+0000","last_peered":"2024-05-20T17:56:41.926925+0000","last_clean":"2024-05-20T17:56:41.926925+0000","last_became_active":"2024-05-20T17:56:39.915475+0000","last_became_peered":"2024-05-20T17:56:39.915475+0000","last_unstale":"2024-05-20T17:56:41.926925+0000","last_undegraded":"2024-05-20T17:56:41.926925+0000","last_fullsized":"2024-05-20T17:56:41.926925+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:00:35.336258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913379+0000","last_change":"2024-05-20T17:56:40.916922+0000","last_active":"2024-05-20T17:56:42.913379+0000","last_peered":"2024-05-20T17:56:42.913379+0000","last_clean":"2024-05-20T17:56:42.913379+0000","last_became_active":"2024-05-20T17:56:40.916513+0000","last_became_peered":"2024-05-20T17:56:40.916513+0000","last_unstale":"2024-05-20T17:56:42.913379+0000","last_undegraded":"2024-05-20T17:56:42.913379+0000","last_fullsized":"2024-05-20T17:56:42.913379+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:15:55.925527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913825+0000","last_change":"2024-05-20T17:56:39.914907+0000","last_active":"2024-05-20T17:56:42.913825+0000","last_peered":"2024-05-20T17:56:42.913825+0000","last_clean":"2024-05-20T17:56:42.913825+0000","last_became_active":"2024-05-20T17:56:39.914495+0000","last_became_peered":"2024-05-20T17:56:39.914495+0000","last_unstale":"2024-05-20T17:56:42.913825+0000","last_undegraded":"2024-05-20T17:56:42.913825+0000","last_fullsized":"2024-05-20T17:56:42.913825+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:23:24.779633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.913451+0000","last_change":"2024-05-20T17:56:40.922803+0000","last_active":"2024-05-20T17:56:42.913451+0000","last_peered":"2024-05-20T17:56:42.913451+0000","last_clean":"2024-05-20T17:56:42.913451+0000","last_became_active":"2024-05-20T17:56:40.922481+0000","last_became_peered":"2024-05-20T17:56:40.922481+0000","last_unstale":"2024-05-20T17:56:42.913451+0000","last_undegraded":"2024-05-20T17:56:42.913451+0000","last_fullsized":"2024-05-20T17:56:42.913451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:16:27.198528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:42.912802+0000","last_change":"2024-05-20T17:56:39.906351+0000","last_active":"2024-05-20T17:56:42.912802+0000","last_peered":"2024-05-20T17:56:42.912802+0000","last_clean":"2024-05-20T17:56:42.912802+0000","last_became_active":"2024-05-20T17:56:39.905968+0000","last_became_peered":"2024-05-20T17:56:39.905968+0000","last_unstale":"2024-05-20T17:56:42.912802+0000","last_undegraded":"2024-05-20T17:56:42.912802+0000","last_fullsized":"2024-05-20T17:56:42.912802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:33:59.707803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.919505+0000","last_change":"2024-05-20T17:56:40.924961+0000","last_active":"2024-05-20T17:56:41.919505+0000","last_peered":"2024-05-20T17:56:41.919505+0000","last_clean":"2024-05-20T17:56:41.919505+0000","last_became_active":"2024-05-20T17:56:40.924641+0000","last_became_peered":"2024-05-20T17:56:40.924641+0000","last_unstale":"2024-05-20T17:56:41.919505+0000","last_undegraded":"2024-05-20T17:56:41.919505+0000","last_fullsized":"2024-05-20T17:56:41.919505+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:39.887818+0000","last_clean_scrub_stamp":"2024-05-20T17:56:39.887818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:06:41.492721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.915489+0000","last_change":"2024-05-20T17:56:39.912417+0000","last_active":"2024-05-20T17:56:41.915489+0000","last_peered":"2024-05-20T17:56:41.915489+0000","last_clean":"2024-05-20T17:56:41.915489+0000","last_became_active":"2024-05-20T17:56:39.912042+0000","last_became_peered":"2024-05-20T17:56:39.912042+0000","last_unstale":"2024-05-20T17:56:41.915489+0000","last_undegraded":"2024-05-20T17:56:41.915489+0000","last_fullsized":"2024-05-20T17:56:41.915489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:56:38.881101+0000","last_clean_scrub_stamp":"2024-05-20T17:56:38.881101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:56:47.243414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":270,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-05-20T17:56:41.918265+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:56:41.918265+0000","last_peered":"2024-05-20T17:56:41.918265+0000","last_clean":"2024-05-20T17:56:41.918265+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:56:41.918265+0000","last_undegraded":"2024-05-20T17:56:41.918265+0000","last_fullsized":"2024-05-20T17:56:41.918265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1515520,"data_stored":1009000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":420222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":921600,"data_stored":418644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":937984,"data_stored":420326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":419192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":419352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":925696,"data_stored":418722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1511424,"data_stored":1008978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:56:45.356 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T17:56:45.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T17:56:45.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.517+0000 7f688853e640 1 Processor -- start 2024-05-20T17:56:45.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.517+0000 7f688853e640 1 -- start start 2024-05-20T17:56:45.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.518+0000 7f688853e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6880162820 0x7f68800b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.518+0000 7f688853e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f68800b3e80 0x7f688006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.518+0000 7f688853e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688006dd20 con 0x7f688006d910 2024-05-20T17:56:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.518+0000 7f688853e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f68800d0630 con 0x7f68800b3e80 2024-05-20T17:56:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.518+0000 7f688853e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68800d39c0 con 0x7f6880162820 2024-05-20T17:56:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f6885ad9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f68800b3e80 0x7f688006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f68862da640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6880162820 0x7f68800b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f6885ad9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f68800b3e80 0x7f688006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:45474/0 (socket says 172.21.15.6:45474) 2024-05-20T17:56:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f6885ad9640 1 -- 172.21.15.6:0/2663938119 learned_addr learned my addr 172.21.15.6:0/2663938119 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f68862da640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6880162820 0x7f68800b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:51708/0 (socket says 172.21.15.6:51708) 2024-05-20T17:56:45.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f6886adb640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f688006d910 0x7f68800d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:56626/0 (socket says 172.21.15.6:56626) 2024-05-20T17:56:45.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f6885ad9640 1 -- 172.21.15.6:0/2663938119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6880162820 msgr2=0x7f68800b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:45.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f6885ad9640 1 --2- 172.21.15.6:0/2663938119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6880162820 0x7f68800b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f6885ad9640 1 -- 172.21.15.6:0/2663938119 >> v1:172.21.15.171:6789/0 conn(0x7f688006d910 legacy=0x7f68800d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f68852d8640 1 -- 172.21.15.6:0/2663938119 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384885060 0 0) 0x7f6878001490 con 0x7f688006d910 2024-05-20T17:56:45.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.519+0000 7f6885ad9640 1 -- 172.21.15.6:0/2663938119 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68800d3ca0 con 0x7f68800b3e80 2024-05-20T17:56:45.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.520+0000 7f6885ad9640 1 --2- 172.21.15.6:0/2663938119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68800b3e80 0x7f688006d3d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6870009870 tx=0x7f687002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32f011b1127367b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.520+0000 7f68852d8640 1 -- 172.21.15.6:0/2663938119 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870037070 con 0x7f68800b3e80 2024-05-20T17:56:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.520+0000 7f68852d8640 1 -- 172.21.15.6:0/2663938119 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6870032440 con 0x7f68800b3e80 2024-05-20T17:56:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.520+0000 7f68852d8640 1 -- 172.21.15.6:0/2663938119 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870032810 con 0x7f68800b3e80 2024-05-20T17:56:45.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.521+0000 7f688853e640 1 -- 172.21.15.6:0/2663938119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68800b3e80 msgr2=0x7f688006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.521+0000 7f688853e640 1 --2- 172.21.15.6:0/2663938119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68800b3e80 0x7f688006d3d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6870009870 tx=0x7f687002a270 comp rx=0 tx=0).stop 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.521+0000 7f688853e640 1 -- 172.21.15.6:0/2663938119 shutdown_connections 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.521+0000 7f688853e640 1 --2- 172.21.15.6:0/2663938119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f68800b3e80 0x7f688006d3d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.521+0000 7f688853e640 1 --2- 172.21.15.6:0/2663938119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6880162820 0x7f68800b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.521+0000 7f688853e640 1 -- 172.21.15.6:0/2663938119 >> 172.21.15.6:0/2663938119 conn(0x7f68800d4bd0 msgr2=0x7f68800d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.521+0000 7f688853e640 1 -- 172.21.15.6:0/2663938119 shutdown_connections 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.521+0000 7f688853e640 1 -- 172.21.15.6:0/2663938119 wait complete. 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.523+0000 7f688853e640 1 Processor -- start 2024-05-20T17:56:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.523+0000 7f688853e640 1 -- start start 2024-05-20T17:56:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f688853e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688006d910 0x7f6880153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f688853e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68800b3e80 0x7f68800c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f688853e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6880162820 0x7f68800b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f688853e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f68800d0300 con 0x7f68800b3e80 2024-05-20T17:56:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f688853e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f68800d4260 con 0x7f6880162820 2024-05-20T17:56:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f688853e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f68800b91a0 con 0x7f688006d910 2024-05-20T17:56:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f6885ad9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68800b3e80 0x7f68800c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f6885ad9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68800b3e80 0x7f68800c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34176/0 (socket says 172.21.15.6:34176) 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f6885ad9640 1 -- 172.21.15.6:0/2488015599 learned_addr learned my addr 172.21.15.6:0/2488015599 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f68862da640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688006d910 0x7f6880153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f6886adb640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6880162820 0x7f68800b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f6885ad9640 1 -- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688006d910 msgr2=0x7f6880153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f6885ad9640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688006d910 0x7f6880153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.524+0000 7f6885ad9640 1 -- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6880162820 msgr2=0x7f68800b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.525+0000 7f6885ad9640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6880162820 0x7f68800b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.525+0000 7f6885ad9640 1 -- 172.21.15.6:0/2488015599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68800cb160 con 0x7f68800b3e80 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.525+0000 7f6885ad9640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68800b3e80 0x7f68800c90a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f68700090b0 tx=0x7f68700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.525+0000 7f6876ffd640 1 -- 172.21.15.6:0/2488015599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870037040 con 0x7f68800b3e80 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.525+0000 7f6876ffd640 1 -- 172.21.15.6:0/2488015599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6870004030 con 0x7f68800b3e80 2024-05-20T17:56:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.525+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68800cb440 con 0x7f68800b3e80 2024-05-20T17:56:45.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.525+0000 7f6876ffd640 1 -- 172.21.15.6:0/2488015599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870004420 con 0x7f68800b3e80 2024-05-20T17:56:45.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.525+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68800ce640 con 0x7f68800b3e80 2024-05-20T17:56:45.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.526+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6880075b00 con 0x7f68800b3e80 2024-05-20T17:56:45.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.527+0000 7f6876ffd640 1 -- 172.21.15.6:0/2488015599 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f687003a070 con 0x7f68800b3e80 2024-05-20T17:56:45.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.527+0000 7f6876ffd640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be60 0x7f686406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.527+0000 7f6876ffd640 1 -- 172.21.15.6:0/2488015599 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f68700ab560 con 0x7f68800b3e80 2024-05-20T17:56:45.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.527+0000 7f68862da640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be60 0x7f686406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.528+0000 7f68862da640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be60 0x7f686406e370 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f687c009aa0 tx=0x7f687c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.532+0000 7f6876ffd640 1 -- 172.21.15.6:0/2488015599 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6870041020 con 0x7f68800b3e80 2024-05-20T17:56:45.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.785+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f68800ccf00 con 0x7f68800b3e80 2024-05-20T17:56:45.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.788+0000 7f6876ffd640 1 -- 172.21.15.6:0/2488015599 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f6870079620 con 0x7f68800b3e80 2024-05-20T17:56:45.787 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T17:56:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T17:56:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T17:56:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T17:56:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T17:56:45.788 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T17:56:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be60 msgr2=0x7f686406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be60 0x7f686406e370 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f687c009aa0 tx=0x7f687c009190 comp rx=0 tx=0).stop 2024-05-20T17:56:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68800b3e80 msgr2=0x7f68800c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68800b3e80 0x7f68800c90a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f68700090b0 tx=0x7f68700046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 shutdown_connections 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f686406be60 0x7f686406e370 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6880162820 0x7f68800b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68800b3e80 0x7f68800c90a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 --2- 172.21.15.6:0/2488015599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f688006d910 0x7f6880153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 >> 172.21.15.6:0/2488015599 conn(0x7f68800d4bd0 msgr2=0x7f688015e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 shutdown_connections 2024-05-20T17:56:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.790+0000 7f688853e640 1 -- 172.21.15.6:0/2488015599 wait complete. 2024-05-20T17:56:45.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.916+0000 7f993f40d640 1 Processor -- start 2024-05-20T17:56:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.917+0000 7f993f40d640 1 -- start start 2024-05-20T17:56:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993f40d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9938162820 0x7f99380b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993f40d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f99380b3e80 0x7f993806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993f40d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993806dd20 con 0x7f993806d910 2024-05-20T17:56:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993f40d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f99380d0630 con 0x7f9938162820 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993f40d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f99380d39c0 con 0x7f99380b3e80 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993d1a9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9938162820 0x7f99380b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993d1a9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9938162820 0x7f99380b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34184/0 (socket says 172.21.15.6:34184) 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993d1a9640 1 -- 172.21.15.6:0/4157474916 learned_addr learned my addr 172.21.15.6:0/4157474916 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.918+0000 7f993c9a8640 1 --2- 172.21.15.6:0/4157474916 >> v2:172.21.15.171:3300/0 conn(0x7f99380b3e80 0x7f993806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.919+0000 7f993d1a9640 1 -- 172.21.15.6:0/4157474916 >> v2:172.21.15.171:3300/0 conn(0x7f99380b3e80 msgr2=0x7f993806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.919+0000 7f993d1a9640 1 --2- 172.21.15.6:0/4157474916 >> v2:172.21.15.171:3300/0 conn(0x7f99380b3e80 0x7f993806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.919+0000 7f993d1a9640 1 -- 172.21.15.6:0/4157474916 >> v1:172.21.15.171:6789/0 conn(0x7f993806d910 legacy=0x7f99380d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.919+0000 7f993d1a9640 1 -- 172.21.15.6:0/4157474916 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99380d3ca0 con 0x7f9938162820 2024-05-20T17:56:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.919+0000 7f993d1a9640 1 --2- 172.21.15.6:0/4157474916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9938162820 0x7f99380b3940 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f99380d1230 tx=0x7f992802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6a9b9c0475a425 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.919+0000 7f9937fff640 1 -- 172.21.15.6:0/4157474916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928036070 con 0x7f9938162820 2024-05-20T17:56:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f9937fff640 1 -- 172.21.15.6:0/4157474916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9928031600 con 0x7f9938162820 2024-05-20T17:56:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f9937fff640 1 -- 172.21.15.6:0/4157474916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99280319d0 con 0x7f9938162820 2024-05-20T17:56:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f993f40d640 1 -- 172.21.15.6:0/4157474916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9938162820 msgr2=0x7f99380b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f993f40d640 1 --2- 172.21.15.6:0/4157474916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9938162820 0x7f99380b3940 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f99380d1230 tx=0x7f992802a730 comp rx=0 tx=0).stop 2024-05-20T17:56:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f993f40d640 1 -- 172.21.15.6:0/4157474916 shutdown_connections 2024-05-20T17:56:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f993f40d640 1 --2- 172.21.15.6:0/4157474916 >> v2:172.21.15.171:3300/0 conn(0x7f99380b3e80 0x7f993806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f993f40d640 1 --2- 172.21.15.6:0/4157474916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9938162820 0x7f99380b3940 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f993f40d640 1 -- 172.21.15.6:0/4157474916 >> 172.21.15.6:0/4157474916 conn(0x7f99380d4bd0 msgr2=0x7f99380d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f993f40d640 1 -- 172.21.15.6:0/4157474916 shutdown_connections 2024-05-20T17:56:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.920+0000 7f993f40d640 1 -- 172.21.15.6:0/4157474916 wait complete. 2024-05-20T17:56:45.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.922+0000 7f993f40d640 1 Processor -- start 2024-05-20T17:56:45.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.922+0000 7f993f40d640 1 -- start start 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.923+0000 7f993f40d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f993806d910 0x7f99381f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.923+0000 7f993f40d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99380b3e80 0x7f993815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993f40d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9938162820 0x7f9938153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993f40d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f99380d0300 con 0x7f993806d910 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993f40d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f99380d4260 con 0x7f9938162820 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993f40d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f99380b91a0 con 0x7f99380b3e80 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f993806d910 0x7f99381f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f993806d910 0x7f99381f5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34196/0 (socket says 172.21.15.6:34196) 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 -- 172.21.15.6:0/713530538 learned_addr learned my addr 172.21.15.6:0/713530538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d9aa640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9938162820 0x7f9938153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993c9a8640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99380b3e80 0x7f993815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 -- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99380b3e80 msgr2=0x7f993815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99380b3e80 0x7f993815aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 -- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9938162820 msgr2=0x7f9938153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9938162820 0x7f9938153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 -- 172.21.15.6:0/713530538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99380b59a0 con 0x7f993806d910 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993d1a9640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f993806d910 0x7f99381f5520 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9928034040 tx=0x7f9928004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f9935ffb640 1 -- 172.21.15.6:0/713530538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928036050 con 0x7f993806d910 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f9935ffb640 1 -- 172.21.15.6:0/713530538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9928042070 con 0x7f993806d910 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f9935ffb640 1 -- 172.21.15.6:0/713530538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928009510 con 0x7f993806d910 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.924+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99380b5c80 con 0x7f993806d910 2024-05-20T17:56:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.925+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99380b6240 con 0x7f993806d910 2024-05-20T17:56:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.926+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9938075b00 con 0x7f993806d910 2024-05-20T17:56:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.926+0000 7f9935ffb640 1 -- 172.21.15.6:0/713530538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9928007c50 con 0x7f993806d910 2024-05-20T17:56:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.927+0000 7f9935ffb640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f992406be60 0x7f992406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.927+0000 7f9935ffb640 1 -- 172.21.15.6:0/713530538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f99280abfb0 con 0x7f993806d910 2024-05-20T17:56:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.927+0000 7f993c9a8640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f992406be60 0x7f992406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.928+0000 7f993c9a8640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f992406be60 0x7f992406e370 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f992c006fd0 tx=0x7f992c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:45.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:45.932+0000 7f9935ffb640 1 -- 172.21.15.6:0/713530538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f992807a6a0 con 0x7f993806d910 2024-05-20T17:56:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.155+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f993815aff0 con 0x7f993806d910 2024-05-20T17:56:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.156+0000 7f9935ffb640 1 -- 172.21.15.6:0/713530538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7f9928079fa0 con 0x7f993806d910 2024-05-20T17:56:46.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:46.155 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:40.286706+0000","modified":"2024-05-20T17:56:43.311702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/693481794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":693481794},{"type":"v1","addr":"172.21.15.6:6835","nonce":693481794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6681,"qdb_cluster":[6681]},"id":5}]} 2024-05-20T17:56:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 44 2024-05-20T17:56:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f992406be60 msgr2=0x7f992406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f992406be60 0x7f992406e370 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f992c006fd0 tx=0x7f992c008040 comp rx=0 tx=0).stop 2024-05-20T17:56:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f993806d910 msgr2=0x7f99381f5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f993806d910 0x7f99381f5520 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9928034040 tx=0x7f9928004a40 comp rx=0 tx=0).stop 2024-05-20T17:56:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 shutdown_connections 2024-05-20T17:56:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f992406be60 0x7f992406e370 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9938162820 0x7f9938153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99380b3e80 0x7f993815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 --2- 172.21.15.6:0/713530538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f993806d910 0x7f99381f5520 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 >> 172.21.15.6:0/713530538 conn(0x7f99380d4bd0 msgr2=0x7f99380d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 shutdown_connections 2024-05-20T17:56:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.158+0000 7f993f40d640 1 -- 172.21.15.6:0/713530538 wait complete. 2024-05-20T17:56:46.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T17:56:40.286706+0000', 'modified': '2024-05-20T17:56:43.311702+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6681}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6681': {'gid': 6681, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/693481794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 693481794}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 693481794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6681, 'qdb_cluster': [6681]} 2024-05-20T17:56:46.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T17:56:46.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-20T17:56:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.696+0000 7f85908f0640 1 Processor -- start 2024-05-20T17:56:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.696+0000 7f85908f0640 1 -- start start 2024-05-20T17:56:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f85908f0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c168050 0x7f858c16a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f85908f0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858c0d0630 con 0x7f858c162820 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f85908f0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858c0d39c0 con 0x7f858c06d3d0 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f85908f0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f858c0d3ca0 con 0x7f858c168050 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f858c162820 0x7f858c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54526/0 (socket says 172.21.15.6:54526) 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858a59c640 1 -- 172.21.15.6:0/3178012966 learned_addr learned my addr 172.21.15.6:0/3178012966 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858ad9d640 1 --2- 172.21.15.6:0/3178012966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c168050 0x7f858c16a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858959a640 1 -- 172.21.15.6:0/3178012966 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568776098 0 0) 0x7f858c0d0630 con 0x7f858c162820 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858959a640 1 -- 172.21.15.6:0/3178012966 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8574003520 con 0x7f858c162820 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858959a640 1 -- 172.21.15.6:0/3178012966 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940156660 0 0) 0x7f858c0d39c0 con 0x7f858c06d3d0 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858959a640 1 -- 172.21.15.6:0/3178012966 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f858c0d0630 con 0x7f858c06d3d0 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858ad9d640 1 -- 172.21.15.6:0/3178012966 >> v1:172.21.15.171:6789/0 conn(0x7f858c06d3d0 legacy=0x7f858c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858959a640 1 -- 172.21.15.6:0/3178012966 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 472570826 0 0) 0x7f8574003520 con 0x7f858c162820 2024-05-20T17:56:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858ad9d640 1 -- 172.21.15.6:0/3178012966 >> v1:172.21.15.6:6789/0 conn(0x7f858c162820 legacy=0x7f858c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.698+0000 7f858ad9d640 1 -- 172.21.15.6:0/3178012966 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c0d3f80 con 0x7f858c168050 2024-05-20T17:56:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.699+0000 7f858ad9d640 1 --2- 172.21.15.6:0/3178012966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c168050 0x7f858c16a470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8584009dc0 tx=0x7f858402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56bb0116439e3391 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.699+0000 7f858959a640 1 -- 172.21.15.6:0/3178012966 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c001670 con 0x7f858c168050 2024-05-20T17:56:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.699+0000 7f858959a640 1 -- 172.21.15.6:0/3178012966 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8584007540 con 0x7f858c168050 2024-05-20T17:56:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.699+0000 7f858959a640 1 -- 172.21.15.6:0/3178012966 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584007910 con 0x7f858c168050 2024-05-20T17:56:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.700+0000 7f85908f0640 1 -- 172.21.15.6:0/3178012966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c168050 msgr2=0x7f858c16a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.700+0000 7f85908f0640 1 --2- 172.21.15.6:0/3178012966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c168050 0x7f858c16a470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8584009dc0 tx=0x7f858402a660 comp rx=0 tx=0).stop 2024-05-20T17:56:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.700+0000 7f85908f0640 1 -- 172.21.15.6:0/3178012966 shutdown_connections 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.700+0000 7f85908f0640 1 --2- 172.21.15.6:0/3178012966 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c168050 0x7f858c16a470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.700+0000 7f85908f0640 1 -- 172.21.15.6:0/3178012966 >> 172.21.15.6:0/3178012966 conn(0x7f858c0d4bd0 msgr2=0x7f858c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.700+0000 7f85908f0640 1 -- 172.21.15.6:0/3178012966 shutdown_connections 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.700+0000 7f85908f0640 1 -- 172.21.15.6:0/3178012966 wait complete. 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.702+0000 7f85908f0640 1 Processor -- start 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.702+0000 7f85908f0640 1 -- start start 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.703+0000 7f85908f0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c06d3d0 0x7f858c1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.703+0000 7f85908f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c162820 0x7f858c1f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.703+0000 7f85908f0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c168050 0x7f858c1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.703+0000 7f85908f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f858c0b91a0 con 0x7f858c162820 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.703+0000 7f85908f0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f858c0d0300 con 0x7f858c168050 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.703+0000 7f85908f0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f858c0b4050 con 0x7f858c06d3d0 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c162820 0x7f858c1f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c162820 0x7f858c1f92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34204/0 (socket says 172.21.15.6:34204) 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 -- 172.21.15.6:0/3919556927 learned_addr learned my addr 172.21.15.6:0/3919556927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f858ad9d640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c168050 0x7f858c1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f858a59c640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c06d3d0 0x7f858c1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 -- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c06d3d0 msgr2=0x7f858c1538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c06d3d0 0x7f858c1538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 -- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c168050 msgr2=0x7f858c1602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c168050 0x7f858c1602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 -- 172.21.15.6:0/3919556927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c154410 con 0x7f858c162820 2024-05-20T17:56:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f8589d9b640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c162820 0x7f858c1f92f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f858000c430 tx=0x7f858000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f857affd640 1 -- 172.21.15.6:0/3919556927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580017070 con 0x7f858c162820 2024-05-20T17:56:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f857affd640 1 -- 172.21.15.6:0/3919556927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85800052f0 con 0x7f858c162820 2024-05-20T17:56:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f85908f0640 1 -- 172.21.15.6:0/3919556927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c15f510 con 0x7f858c162820 2024-05-20T17:56:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f857affd640 1 -- 172.21.15.6:0/3919556927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580003830 con 0x7f858c162820 2024-05-20T17:56:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.704+0000 7f85908f0640 1 -- 172.21.15.6:0/3919556927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c15f7d0 con 0x7f858c162820 2024-05-20T17:56:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.707+0000 7f857affd640 1 -- 172.21.15.6:0/3919556927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f858001a070 con 0x7f858c162820 2024-05-20T17:56:46.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.707+0000 7f857affd640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f856c06be60 0x7f856c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.707+0000 7f857affd640 1 -- 172.21.15.6:0/3919556927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f858008a3b0 con 0x7f858c162820 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.707+0000 7f858a59c640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f856c06be60 0x7f856c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.708+0000 7f859779a740 1 Processor -- start 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.708+0000 7f858a59c640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f856c06be60 0x7f856c06e370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f857c0011e0 tx=0x7f857c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.708+0000 7f859779a740 1 -- start start 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.709+0000 7f859779a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19991270 0x55ab19d5c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.709+0000 7f859779a740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab199683b0 0x55ab19d590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.709+0000 7f859779a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab19970590 0x55ab19d32360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.709+0000 7f859779a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ab19c954d0 con 0x55ab19991270 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.709+0000 7f859779a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ab19c3d3e0 con 0x55ab19970590 2024-05-20T17:56:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.709+0000 7f859779a740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55ab19c91490 con 0x55ab199683b0 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19991270 0x55ab19d5c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19991270 0x55ab19d5c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34220/0 (socket says 172.21.15.6:34220) 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 -- 172.21.15.6:0/2989510313 learned_addr learned my addr 172.21.15.6:0/2989510313 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f8589d9b640 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab199683b0 0x55ab19d590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858ad9d640 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab19970590 0x55ab19d32360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 -- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab199683b0 msgr2=0x55ab19d590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab199683b0 0x55ab19d590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 -- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab19970590 msgr2=0x55ab19d32360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab19970590 0x55ab19d32360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 -- 172.21.15.6:0/2989510313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab199a92d0 con 0x55ab19991270 2024-05-20T17:56:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858ad9d640 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab19970590 0x55ab19d32360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f858a59c640 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19991270 0x55ab19d5c700 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f857c005980 tx=0x7f857c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3196cf008185cdcf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f856bfff640 1 -- 172.21.15.6:0/2989510313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c005e40 con 0x55ab19991270 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f856bfff640 1 -- 172.21.15.6:0/2989510313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857c00e760 con 0x55ab19991270 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.710+0000 7f856bfff640 1 -- 172.21.15.6:0/2989510313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c00eb10 con 0x55ab19991270 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 -- 172.21.15.6:0/2989510313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19991270 msgr2=0x55ab19d5c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19991270 0x55ab19d5c700 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f857c005980 tx=0x7f857c011000 comp rx=0 tx=0).stop 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 -- 172.21.15.6:0/2989510313 shutdown_connections 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab19970590 0x55ab19d32360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab199683b0 0x55ab19d590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 --2- 172.21.15.6:0/2989510313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19991270 0x55ab19d5c700 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 -- 172.21.15.6:0/2989510313 >> 172.21.15.6:0/2989510313 conn(0x55ab199853c0 msgr2=0x55ab19d31af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 -- 172.21.15.6:0/2989510313 shutdown_connections 2024-05-20T17:56:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.711+0000 7f859779a740 1 -- 172.21.15.6:0/2989510313 wait complete. 2024-05-20T17:56:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.712+0000 7f859779a740 1 -- start start 2024-05-20T17:56:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.712+0000 7f859779a740 1 Processor -- start 2024-05-20T17:56:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f859779a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19d588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f859779a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d58df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f859779a740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d5f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f859779a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ab19c508e0 con 0x55ab19970590 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f859779a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ab19d75b50 con 0x55ab199683b0 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f859779a740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55ab19d5deb0 con 0x55ab19991270 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f859779a740 10 client.0 _ll_register_callbacks cb 0x55ab19c1d9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d58df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d58df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34234/0 (socket says 172.21.15.6:34234) 2024-05-20T17:56:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 -- 172.21.15.6:0/413338565 learned_addr learned my addr 172.21.15.6:0/413338565 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f858a59c640 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19d588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f858ad9d640 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d5f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 -- 172.21.15.6:0/413338565 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 msgr2=0x55ab19d5f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d5f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 -- 172.21.15.6:0/413338565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 msgr2=0x55ab19d588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19d588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 -- 172.21.15.6:0/413338565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab19a736b0 con 0x55ab19970590 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f8589d9b640 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d58df0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8580060b80 tx=0x7f8580058610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33eabd5da0c24e14 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.714+0000 7f85697fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f85697fa640 1 -- 172.21.15.6:0/413338565 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580056890 con 0x55ab19970590 2024-05-20T17:56:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f85697fa640 1 -- 172.21.15.6:0/413338565 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8580088b70 con 0x55ab19970590 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 1 -- 172.21.15.6:0/413338565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f857c00e760 con 0x55ab19970590 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f85697fa640 1 -- 172.21.15.6:0/413338565 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8580088d70 con 0x55ab19970590 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 10 client.6807 fetch_fsmap learned FSMap version 44 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 1 -- 172.21.15.6:0/413338565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55ab19d774d0 con 0x55ab19970590 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f85697fa640 1 -- 172.21.15.6:0/413338565 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857c00e760 con 0x55ab19970590 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f85697fa640 1 -- 172.21.15.6:0/413338565 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 44) ==== 3494+0+0 (secure 0 0 0) 0x7f8580088170 con 0x55ab19970590 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 10 client.6807 fetch_fsmap finished waiting for FSMap version 44 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 10 client.6807 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 20 client.6807 populate_metadata read hostname 'smithi006' 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] conn(0x55ab1994fe40 0x55ab19d94410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 4 client.6807 mds_command: new command op to 6681 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:56:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f859779a740 1 -- 172.21.15.6:0/413338565 --> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab19ca2c00 con 0x55ab1994fe40 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.715+0000 7f858a59c640 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] conn(0x55ab1994fe40 0x55ab19d94410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.716+0000 7f85697fa640 10 client.6807 ms_handle_connect on v2:172.21.15.6:6834/693481794 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.716+0000 7f858a59c640 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] conn(0x55ab1994fe40 0x55ab19d94410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8fda542c4e5d950 server_cookie=1dea3a16016e6cb2 in_seq=0 out_seq=0 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.716+0000 7f85697fa640 1 -- 172.21.15.6:0/413338565 <== mds.0 v2:172.21.15.6:6834/693481794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ab19ca2c00 con 0x55ab1994fe40 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.716+0000 7f85697fa640 10 client.6807 handle_command_reply: tid=0 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.716+0000 7f859779a740 1 client.6807 shutdown 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 -- 172.21.15.6:0/413338565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 msgr2=0x55ab19d58df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d58df0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8580060b80 tx=0x7f8580058610 comp rx=0 tx=0).stop 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 -- 172.21.15.6:0/413338565 shutdown_connections 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] conn(0x55ab1994fe40 0x55ab19d94410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d5f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d58df0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 --2- 172.21.15.6:0/413338565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19d588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f85697fa640 0 client.6807 ms_handle_reset on v2:172.21.15.6:6834/693481794 2024-05-20T17:56:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 -- 172.21.15.6:0/413338565 >> 172.21.15.6:0/413338565 conn(0x55ab199853c0 msgr2=0x55ab19d31af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 -- 172.21.15.6:0/413338565 shutdown_connections 2024-05-20T17:56:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 1 -- 172.21.15.6:0/413338565 wait complete. 2024-05-20T17:56:46.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.717+0000 7f859779a740 20 client.6807 trim_cache size 0 max 16384 2024-05-20T17:56:46.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.736+0000 7f859779a740 1 Processor -- start 2024-05-20T17:56:46.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.736+0000 7f859779a740 1 -- start start 2024-05-20T17:56:46.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f859779a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19d74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f859779a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d79890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f859779a740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d5e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f859779a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f858c201160 con 0x55ab19970590 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f859779a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1f5df0 con 0x55ab199683b0 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f859779a740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f858c1428e0 con 0x55ab19991270 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d79890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d79890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34246/0 (socket says 172.21.15.6:34246) 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 -- 172.21.15.6:0/2204186800 learned_addr learned my addr 172.21.15.6:0/2204186800 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 -- 172.21.15.6:0/2204186800 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 msgr2=0x55ab19d5e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 --2- 172.21.15.6:0/2204186800 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d5e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 -- 172.21.15.6:0/2204186800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 msgr2=0x55ab19d74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 --2- 172.21.15.6:0/2204186800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19d74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 -- 172.21.15.6:0/2204186800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab19d2b220 con 0x55ab19970590 2024-05-20T17:56:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f8589d9b640 1 --2- 172.21.15.6:0/2204186800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d79890 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f858000cdf0 tx=0x7f858001e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863b8bfa45d9b97f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f856b7fe640 1 -- 172.21.15.6:0/2204186800 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580088170 con 0x55ab19970590 2024-05-20T17:56:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f856b7fe640 1 -- 172.21.15.6:0/2204186800 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580054b40 con 0x55ab19970590 2024-05-20T17:56:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.738+0000 7f856b7fe640 1 -- 172.21.15.6:0/2204186800 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580057b60 con 0x55ab19970590 2024-05-20T17:56:46.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 -- 172.21.15.6:0/2204186800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 msgr2=0x55ab19d79890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 --2- 172.21.15.6:0/2204186800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d79890 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f858000cdf0 tx=0x7f858001e070 comp rx=0 tx=0).stop 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 -- 172.21.15.6:0/2204186800 shutdown_connections 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 --2- 172.21.15.6:0/2204186800 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d5e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 --2- 172.21.15.6:0/2204186800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d79890 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 --2- 172.21.15.6:0/2204186800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19d74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 -- 172.21.15.6:0/2204186800 >> 172.21.15.6:0/2204186800 conn(0x55ab199853c0 msgr2=0x55ab19d27940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 -- 172.21.15.6:0/2204186800 shutdown_connections 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.739+0000 7f859779a740 1 -- 172.21.15.6:0/2204186800 wait complete. 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.740+0000 7f859779a740 1 -- start start 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.740+0000 7f859779a740 1 Processor -- start 2024-05-20T17:56:46.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f859779a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19de10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f859779a740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d78290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f859779a740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f859779a740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55ab19d8ffb0 con 0x55ab19970590 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f859779a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ab19d605d0 con 0x55ab199683b0 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f859779a740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55ab19d905d0 con 0x55ab19991270 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f859779a740 10 client.0 _ll_register_callbacks cb 0x7f85800582a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d78290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d78290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34258/0 (socket says 172.21.15.6:34258) 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 -- 172.21.15.6:0/1462068331 learned_addr learned my addr 172.21.15.6:0/1462068331 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 -- 172.21.15.6:0/1462068331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 msgr2=0x55ab19d787d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f858ad9d640 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f858a59c640 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19de10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d787d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 -- 172.21.15.6:0/1462068331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 msgr2=0x55ab19de10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19de10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 -- 172.21.15.6:0/1462068331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab19d5ede0 con 0x55ab19970590 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f8589d9b640 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d78290 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f858000cdf0 tx=0x7f8580014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31073e02e0fe39d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f85697fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f85697fa640 1 -- 172.21.15.6:0/1462068331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858007c060 con 0x55ab19970590 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f85697fa640 1 -- 172.21.15.6:0/1462068331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8580054430 con 0x55ab19970590 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.742+0000 7f859779a740 1 -- 172.21.15.6:0/1462068331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8580054b40 con 0x55ab19970590 2024-05-20T17:56:46.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f85697fa640 1 -- 172.21.15.6:0/1462068331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8580054770 con 0x55ab19970590 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f859779a740 10 client.6813 fetch_fsmap learned FSMap version 44 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f859779a740 1 -- 172.21.15.6:0/1462068331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x55ab19d5ede0 con 0x55ab19970590 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f85697fa640 1 -- 172.21.15.6:0/1462068331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580054b40 con 0x55ab19970590 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f85697fa640 1 -- 172.21.15.6:0/1462068331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 44) ==== 3494+0+0 (secure 0 0 0) 0x7f8580057390 con 0x55ab19970590 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f859779a740 10 client.6813 fetch_fsmap finished waiting for FSMap version 44 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f859779a740 10 client.6813 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f859779a740 20 client.6813 populate_metadata read hostname 'smithi006' 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f859779a740 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] conn(0x55ab19d2b750 0x55ab19d2bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f859779a740 4 client.6813 mds_command: new command op to 6681 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f859779a740 1 -- 172.21.15.6:0/1462068331 --> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] -- command(tid 0: {"prefix": "status"}) -- 0x55ab19d2d060 con 0x55ab19d2b750 2024-05-20T17:56:46.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f858a59c640 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] conn(0x55ab19d2b750 0x55ab19d2bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.743+0000 7f85697fa640 10 client.6813 ms_handle_connect on v2:172.21.15.6:6834/693481794 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f858a59c640 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] conn(0x55ab19d2b750 0x55ab19d2bb60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b957d93587a1b44 server_cookie=88b622523838397a in_seq=0 out_seq=0 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f85697fa640 1 -- 172.21.15.6:0/1462068331 <== mds.0 v2:172.21.15.6:6834/693481794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ab19d2d060 con 0x55ab19d2b750 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f85697fa640 10 client.6813 handle_command_reply: tid=0 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 client.6813 shutdown 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 -- 172.21.15.6:0/1462068331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 msgr2=0x55ab19d78290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d78290 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f858000cdf0 tx=0x7f8580014040 comp rx=0 tx=0).stop 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 -- 172.21.15.6:0/1462068331 shutdown_connections 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.6:6834/693481794,v1:172.21.15.6:6835/693481794] conn(0x55ab19d2b750 0x55ab19d2bb60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55ab19991270 0x55ab19d787d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab19970590 0x55ab19d78290 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 --2- 172.21.15.6:0/1462068331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab199683b0 0x55ab19de10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f85697fa640 0 client.6813 ms_handle_reset on v2:172.21.15.6:6834/693481794 2024-05-20T17:56:46.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 -- 172.21.15.6:0/1462068331 >> 172.21.15.6:0/1462068331 conn(0x55ab199853c0 msgr2=0x55ab19d5d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:46.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 -- 172.21.15.6:0/1462068331 shutdown_connections 2024-05-20T17:56:46.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 1 -- 172.21.15.6:0/1462068331 wait complete. 2024-05-20T17:56:46.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.744+0000 7f859779a740 20 client.6813 trim_cache size 0 max 16384 2024-05-20T17:56:46.750 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:56:46.750 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6681, 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.8320704299999999, 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 44, 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 75, 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 75, 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.798071932999999 2024-05-20T17:56:46.751 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:56:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 -- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f856c06be60 msgr2=0x7f856c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f856c06be60 0x7f856c06e370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f857c0011e0 tx=0x7f857c009040 comp rx=0 tx=0).stop 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 -- 172.21.15.6:0/3919556927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c162820 msgr2=0x7f858c1f92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c162820 0x7f858c1f92f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f858000c430 tx=0x7f858000c8f0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 -- 172.21.15.6:0/3919556927 shutdown_connections 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f856c06be60 0x7f856c06e370 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f858c168050 0x7f858c1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f858c162820 0x7f858c1f92f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 --2- 172.21.15.6:0/3919556927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f858c06d3d0 0x7f858c1538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 -- 172.21.15.6:0/3919556927 >> 172.21.15.6:0/3919556927 conn(0x7f858c0d4bd0 msgr2=0x7f858c0ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 -- 172.21.15.6:0/3919556927 shutdown_connections 2024-05-20T17:56:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.745+0000 7f85908f0640 1 -- 172.21.15.6:0/3919556927 wait complete. 2024-05-20T17:56:46.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:56:46.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.871+0000 7f416ed9d640 1 Processor -- start 2024-05-20T17:56:46.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.871+0000 7f416ed9d640 1 -- start start 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.872+0000 7f416ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f416806d3d0 0x7f416806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.872+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41680b8190 0x7f41680b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.872+0000 7f416ed9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416806dd20 con 0x7f4168162820 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.872+0000 7f416ed9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f41680d0630 con 0x7f416806d3d0 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.872+0000 7f416ed9d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f41680d39c0 con 0x7f41680b8190 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f4167fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f416806d3d0 0x7f416806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f416cb39640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4168162820 0x7f41680b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54532/0 (socket says 172.21.15.6:54532) 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f416cb39640 1 -- 172.21.15.6:0/1178308561 learned_addr learned my addr 172.21.15.6:0/1178308561 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f416d33a640 1 --2- 172.21.15.6:0/1178308561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41680b8190 0x7f41680b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f4167fff640 1 -- 172.21.15.6:0/1178308561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41680b8190 msgr2=0x7f41680b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f4167fff640 1 --2- 172.21.15.6:0/1178308561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41680b8190 0x7f41680b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f4167fff640 1 -- 172.21.15.6:0/1178308561 >> v1:172.21.15.6:6789/0 conn(0x7f4168162820 legacy=0x7f41680b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f41677fe640 1 -- 172.21.15.6:0/1178308561 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014646175 0 0) 0x7f415c001110 con 0x7f4168162820 2024-05-20T17:56:46.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.873+0000 7f4167fff640 1 -- 172.21.15.6:0/1178308561 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41680d3ca0 con 0x7f416806d3d0 2024-05-20T17:56:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.874+0000 7f4167fff640 1 --2- 172.21.15.6:0/1178308561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f416806d3d0 0x7f416806d7e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f41540097a0 tx=0x7f415402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b24af759e9b9a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.874+0000 7f41677fe640 1 -- 172.21.15.6:0/1178308561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154037070 con 0x7f416806d3d0 2024-05-20T17:56:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.874+0000 7f41677fe640 1 -- 172.21.15.6:0/1178308561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4154032440 con 0x7f416806d3d0 2024-05-20T17:56:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.874+0000 7f41677fe640 1 -- 172.21.15.6:0/1178308561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154032810 con 0x7f416806d3d0 2024-05-20T17:56:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.874+0000 7f416ed9d640 1 -- 172.21.15.6:0/1178308561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f416806d3d0 msgr2=0x7f416806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.874+0000 7f416ed9d640 1 --2- 172.21.15.6:0/1178308561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f416806d3d0 0x7f416806d7e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f41540097a0 tx=0x7f415402a180 comp rx=0 tx=0).stop 2024-05-20T17:56:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.875+0000 7f416ed9d640 1 -- 172.21.15.6:0/1178308561 shutdown_connections 2024-05-20T17:56:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.875+0000 7f416ed9d640 1 --2- 172.21.15.6:0/1178308561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41680b8190 0x7f41680b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.875+0000 7f416ed9d640 1 --2- 172.21.15.6:0/1178308561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f416806d3d0 0x7f416806d7e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.875+0000 7f416ed9d640 1 -- 172.21.15.6:0/1178308561 >> 172.21.15.6:0/1178308561 conn(0x7f41680d4bd0 msgr2=0x7f41680d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.875+0000 7f416ed9d640 1 -- 172.21.15.6:0/1178308561 shutdown_connections 2024-05-20T17:56:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.875+0000 7f416ed9d640 1 -- 172.21.15.6:0/1178308561 wait complete. 2024-05-20T17:56:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.876+0000 7f416ed9d640 1 Processor -- start 2024-05-20T17:56:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.877+0000 7f416ed9d640 1 -- start start 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416806d3d0 0x7f4168150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680b8190 0x7f41680b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f416ed9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4168162820 0x7f41680b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f416ed9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f41680d0300 con 0x7f41680b8190 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f416ed9d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f41680d4260 con 0x7f416806d3d0 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f416ed9d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f41680b4050 con 0x7f4168162820 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f4167fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680b8190 0x7f41680b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f4167fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680b8190 0x7f41680b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34270/0 (socket says 172.21.15.6:34270) 2024-05-20T17:56:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f4167fff640 1 -- 172.21.15.6:0/2794083366 learned_addr learned my addr 172.21.15.6:0/2794083366 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f416cb39640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416806d3d0 0x7f4168150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f416d33a640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4168162820 0x7f41680b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f4167fff640 1 -- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4168162820 msgr2=0x7f41680b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f4167fff640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4168162820 0x7f41680b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f4167fff640 1 -- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416806d3d0 msgr2=0x7f4168150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f4167fff640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416806d3d0 0x7f4168150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.878+0000 7f4167fff640 1 -- 172.21.15.6:0/2794083366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41681f53b0 con 0x7f41680b8190 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.879+0000 7f4167fff640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680b8190 0x7f41680b5f30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4154000c00 tx=0x7f41540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.879+0000 7f41657fa640 1 -- 172.21.15.6:0/2794083366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154037050 con 0x7f41680b8190 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.879+0000 7f41657fa640 1 -- 172.21.15.6:0/2794083366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4154038040 con 0x7f41680b8190 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.879+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41681514c0 con 0x7f41680b8190 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.879+0000 7f41657fa640 1 -- 172.21.15.6:0/2794083366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154004470 con 0x7f41680b8190 2024-05-20T17:56:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.879+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41680cb1c0 con 0x7f41680b8190 2024-05-20T17:56:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.880+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41680d5510 con 0x7f41680b8190 2024-05-20T17:56:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.880+0000 7f41657fa640 1 -- 172.21.15.6:0/2794083366 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f415403c6d0 con 0x7f41680b8190 2024-05-20T17:56:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.881+0000 7f41657fa640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f414c06be30 0x7f414c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.881+0000 7f41657fa640 1 -- 172.21.15.6:0/2794083366 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f41540ab930 con 0x7f41680b8190 2024-05-20T17:56:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.881+0000 7f416cb39640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f414c06be30 0x7f414c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.882+0000 7f416cb39640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f414c06be30 0x7f414c06e340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f415c000f60 tx=0x7f415c007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:46.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:46.886+0000 7f41657fa640 1 -- 172.21.15.6:0/2794083366 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f41680d5510 con 0x7f41680b8190 2024-05-20T17:56:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.116+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f41680cac70 con 0x7f41680b8190 2024-05-20T17:56:47.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.116+0000 7f41657fa640 1 -- 172.21.15.6:0/2794083366 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7f41681f53b0 con 0x7f41680b8190 2024-05-20T17:56:47.115 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:56:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f414c06be30 msgr2=0x7f414c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f414c06be30 0x7f414c06e340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f415c000f60 tx=0x7f415c007c00 comp rx=0 tx=0).stop 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680b8190 msgr2=0x7f41680b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680b8190 0x7f41680b5f30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f4154000c00 tx=0x7f41540046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 shutdown_connections 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f414c06be30 0x7f414c06e340 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4168162820 0x7f41680b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680b8190 0x7f41680b5f30 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 --2- 172.21.15.6:0/2794083366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f416806d3d0 0x7f4168150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 >> 172.21.15.6:0/2794083366 conn(0x7f41680d4bd0 msgr2=0x7f416815aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 shutdown_connections 2024-05-20T17:56:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47.118+0000 7f416ed9d640 1 -- 172.21.15.6:0/2794083366 wait complete. 2024-05-20T17:56:47.128 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:56:47.129 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:56:47.129 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:56:47.129 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T17:56:47.129 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:47.129 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:56:47.129 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:56:47.129 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:56:47.129 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:56:47.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:47.129 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42507sec preferred_lft 42507sec 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:56:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T17:56:47.149 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T17:56:47.149 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:47.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:47.149 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:56:47.211 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:56:47.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:47.213 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:56:47.269 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:56:47.269 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:56:47.269 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:56:47.269 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:56:47.270 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:56:47.270 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:56:47.270 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:56:47.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:56:47.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:56:47.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:56:47.270 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:56:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:56:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:47.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:47.399 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:56:47.415 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T17:56:47.415 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T17:56:47.415 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:56:47.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:47.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:56:47.482 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:56:47.482 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:47.537 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:56:47.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:56:47.538 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:47.593 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T17:56:47.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:47.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:47.689 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:47.689 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:56:47.698 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:47.698 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:56:47.699 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:56:47.699 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:56:47.699 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:56:47.699 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T17:56:47.699 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:56:47.700 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:56:47.700 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:56:47.700 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:56:47.701 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:56:47.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:47.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:56:47.727 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:56:47.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:56:47.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:47.830 INFO:teuthology.orchestra.run.smithi006.stdout:client5855 2024-05-20T17:56:47.831 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:47.831 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:47.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:56:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.005+0000 7fda00ee9640 1 Processor -- start 2024-05-20T17:56:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.005+0000 7fda00ee9640 1 -- start start 2024-05-20T17:56:48.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.006+0000 7fda00ee9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd9fc0af030 0x7fd9fc0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:48.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fda00ee9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9fc06c180 0x7fd9fc06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:48.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fda00ee9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9fc0af980 con 0x7fd9fc15f700 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fda00ee9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc06bcf0 con 0x7fd9fc06c180 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fda00ee9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc160430 con 0x7fd9fc0af030 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9fad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9fc06c180 0x7fd9fc06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9f9d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd9fc15f700 0x7fd9fc15fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45498/0 (socket says 172.21.15.6:45498) 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9fad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9fc06c180 0x7fd9fc06c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54234/0 (socket says 172.21.15.6:54234) 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9f9d9b640 1 -- 172.21.15.6:0/1945678008 learned_addr learned my addr 172.21.15.6:0/1945678008 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9fa59c640 1 --2- 172.21.15.6:0/1945678008 >> v2:172.21.15.171:3300/0 conn(0x7fd9fc0af030 0x7fd9fc0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9fad9d640 1 -- 172.21.15.6:0/1945678008 >> v2:172.21.15.171:3300/0 conn(0x7fd9fc0af030 msgr2=0x7fd9fc0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9fad9d640 1 --2- 172.21.15.6:0/1945678008 >> v2:172.21.15.171:3300/0 conn(0x7fd9fc0af030 0x7fd9fc0af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9fad9d640 1 -- 172.21.15.6:0/1945678008 >> v1:172.21.15.6:6789/0 conn(0x7fd9fc15f700 legacy=0x7fd9fc15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9fad9d640 1 -- 172.21.15.6:0/1945678008 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc06b6a0 con 0x7fd9fc06c180 2024-05-20T17:56:48.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.007+0000 7fd9f959a640 1 -- 172.21.15.6:0/1945678008 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182077006 0 0) 0x7fd9f0001110 con 0x7fd9fc15f700 2024-05-20T17:56:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.008+0000 7fd9fad9d640 1 --2- 172.21.15.6:0/1945678008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06c180 0x7fd9fc06c590 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc06f310 tx=0x7fd9f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b1b59ad34e93da server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.008+0000 7fd9f959a640 1 -- 172.21.15.6:0/1945678008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4037070 con 0x7fd9fc06c180 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.008+0000 7fd9f959a640 1 -- 172.21.15.6:0/1945678008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f4032440 con 0x7fd9fc06c180 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.008+0000 7fd9f959a640 1 -- 172.21.15.6:0/1945678008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4032810 con 0x7fd9fc06c180 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.009+0000 7fda00ee9640 1 -- 172.21.15.6:0/1945678008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06c180 msgr2=0x7fd9fc06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.009+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1945678008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06c180 0x7fd9fc06c590 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc06f310 tx=0x7fd9f402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.009+0000 7fda00ee9640 1 -- 172.21.15.6:0/1945678008 shutdown_connections 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.009+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1945678008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc06c180 0x7fd9fc06c590 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.009+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1945678008 >> v2:172.21.15.171:3300/0 conn(0x7fd9fc0af030 0x7fd9fc0af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.009+0000 7fda00ee9640 1 -- 172.21.15.6:0/1945678008 >> 172.21.15.6:0/1945678008 conn(0x7fd9fc0b6620 msgr2=0x7fd9fc0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.009+0000 7fda00ee9640 1 -- 172.21.15.6:0/1945678008 shutdown_connections 2024-05-20T17:56:48.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.009+0000 7fda00ee9640 1 -- 172.21.15.6:0/1945678008 wait complete. 2024-05-20T17:56:48.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.011+0000 7fda00ee9640 1 Processor -- start 2024-05-20T17:56:48.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.011+0000 7fda00ee9640 1 -- start start 2024-05-20T17:56:48.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fda00ee9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9fc06c180 0x7fd9fc1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:48.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fda00ee9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9fc0af030 0x7fd9fc1e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:48.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fda00ee9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc15f700 0x7fd9fc145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:48.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fda00ee9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc06cad0 con 0x7fd9fc15f700 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fda00ee9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc159aa0 con 0x7fd9fc06c180 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fda00ee9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd9fc06cc50 con 0x7fd9fc0af030 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fd9fad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc15f700 0x7fd9fc145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fd9fad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc15f700 0x7fd9fc145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54242/0 (socket says 172.21.15.6:54242) 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fd9fad9d640 1 -- 172.21.15.6:0/1216715306 learned_addr learned my addr 172.21.15.6:0/1216715306 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fd9fa59c640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9fc06c180 0x7fd9fc1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.012+0000 7fd9f9d9b640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9fc0af030 0x7fd9fc1e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9fad9d640 1 -- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9fc0af030 msgr2=0x7fd9fc1e7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9fad9d640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9fc0af030 0x7fd9fc1e7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9fad9d640 1 -- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9fc06c180 msgr2=0x7fd9fc1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9fad9d640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9fc06c180 0x7fd9fc1442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9fad9d640 1 -- 172.21.15.6:0/1216715306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc1460e0 con 0x7fd9fc15f700 2024-05-20T17:56:48.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9fad9d640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc15f700 0x7fd9fc145ba0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4035040 tx=0x7fd9f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:48.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9eaffd640 1 -- 172.21.15.6:0/1216715306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4037040 con 0x7fd9fc15f700 2024-05-20T17:56:48.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9eaffd640 1 -- 172.21.15.6:0/1216715306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f4042070 con 0x7fd9fc15f700 2024-05-20T17:56:48.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fd9eaffd640 1 -- 172.21.15.6:0/1216715306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40308a0 con 0x7fd9fc15f700 2024-05-20T17:56:48.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9fc144b00 con 0x7fd9fc15f700 2024-05-20T17:56:48.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.013+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9fc1450c0 con 0x7fd9fc15f700 2024-05-20T17:56:48.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.014+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9fc144850 con 0x7fd9fc15f700 2024-05-20T17:56:48.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.015+0000 7fd9eaffd640 1 -- 172.21.15.6:0/1216715306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9f4030a40 con 0x7fd9fc15f700 2024-05-20T17:56:48.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.015+0000 7fd9eaffd640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd9dc06be60 0x7fd9dc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:48.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.015+0000 7fd9eaffd640 1 -- 172.21.15.6:0/1216715306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd9f40ab880 con 0x7fd9fc15f700 2024-05-20T17:56:48.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.016+0000 7fd9fa59c640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd9dc06be60 0x7fd9dc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:48.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.016+0000 7fd9fa59c640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd9dc06be60 0x7fd9dc06e370 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc06e1f0 tx=0x7fd9ec00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.020+0000 7fd9eaffd640 1 -- 172.21.15.6:0/1216715306 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd9f40799c0 con 0x7fd9fc15f700 2024-05-20T17:56:48.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.244+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd9fc0d1630 con 0x7fd9fc15f700 2024-05-20T17:56:48.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.244+0000 7fd9eaffd640 1 -- 172.21.15.6:0/1216715306 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7fd9f407dcc0 con 0x7fd9fc15f700 2024-05-20T17:56:48.243 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:56:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd9dc06be60 msgr2=0x7fd9dc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd9dc06be60 0x7fd9dc06e370 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc06e1f0 tx=0x7fd9ec00b040 comp rx=0 tx=0).stop 2024-05-20T17:56:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc15f700 msgr2=0x7fd9fc145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc15f700 0x7fd9fc145ba0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4035040 tx=0x7fd9f40046c0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 shutdown_connections 2024-05-20T17:56:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd9dc06be60 0x7fd9dc06e370 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9fc15f700 0x7fd9fc145ba0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd9fc0af030 0x7fd9fc1e7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 --2- 172.21.15.6:0/1216715306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9fc06c180 0x7fd9fc1442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:48.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 >> 172.21.15.6:0/1216715306 conn(0x7fd9fc0b6620 msgr2=0x7fd9fc0d1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:48.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 shutdown_connections 2024-05-20T17:56:48.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:48.246+0000 7fda00ee9640 1 -- 172.21.15.6:0/1216715306 wait complete. 2024-05-20T17:56:48.256 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:56:48.256 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:56:48.256 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T17:56:48.256 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T17:56:48.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:48.257 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:56:48.257 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:56:48.257 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:56:48.257 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:56:48.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:48.257 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T17:56:48.277 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:56:48.277 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:56:48.277 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:56:48.277 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:48.277 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:56:48.277 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:48.277 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:48.277 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42517sec preferred_lft 42517sec 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:48.278 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T17:56:48.279 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:56:48.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:48.280 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:56:48.346 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T17:56:48.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:48.348 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T17:56:48.405 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T17:56:48.405 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:56:48.405 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T17:56:48.405 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T17:56:48.405 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:56:48.406 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:56:48.406 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:56:48.406 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T17:56:48.406 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T17:56:48.406 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T17:56:48.406 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:56:48.499 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:56:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:56:48.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:48.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:48.539 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:56:48.555 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T17:56:48.555 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T17:56:48.555 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:56:48.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:48.555 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T17:56:48.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:56:48.620 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:48.676 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:56:48.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:56:48.676 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:48.732 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T17:56:48.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:48.733 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:48.826 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:48.826 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:56:48.834 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:56:48.835 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:56:48.835 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:56:48.835 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:56:48.835 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:56:48.837 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T17:56:48.837 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:56:48.837 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:56:48.837 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:56:48.837 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:56:48.837 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:56:48.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:56:48.837 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:56:48.867 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:56:48.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:56:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:56:48.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:48.969 INFO:teuthology.orchestra.run.smithi171.stdout:client6834 2024-05-20T17:56:48.969 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:56:48.969 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:48.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-05-20T17:56:49.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.113+0000 7ff995379640 1 Processor -- start 2024-05-20T17:56:49.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.113+0000 7ff995379640 1 -- start start 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff995379640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 0x7ff99006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff995379640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99006dd20 con 0x7ff9900b8190 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff995379640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9900d0630 con 0x7ff990162820 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff995379640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff9900d39c0 con 0x7ff99006d3d0 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff9900b8190 0x7ff9900b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45510/0 (socket says 172.21.15.6:45510) 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98f7fe640 1 -- 172.21.15.6:0/974680267 learned_addr learned my addr 172.21.15.6:0/974680267 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98e7fc640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 0x7ff99006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755841273 0 0) 0x7ff988001490 con 0x7ff9900b8190 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff97c003520 con 0x7ff9900b8190 2024-05-20T17:56:49.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847821556 0 0) 0x7ff9900d0630 con 0x7ff990162820 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff988001490 con 0x7ff990162820 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1083092574 0 0) 0x7ff97c003520 con 0x7ff9900b8190 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 msgr2=0x7ff99006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 0x7ff99006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 >> v1:172.21.15.171:6789/0 conn(0x7ff990162820 legacy=0x7ff9900b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9900d3ca0 con 0x7ff9900b8190 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ff988001bc0 con 0x7ff9900b8190 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98e7fc640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 0x7ff99006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 >> v1:172.21.15.6:6789/0 conn(0x7ff9900b8190 legacy=0x7ff9900b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.115+0000 7ff98dffb640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff97c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98dffb640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff97c004800 0x7ff97c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98dffb640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 0x7ff97c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900d39c0 con 0x7ff97c003b70 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c00baa0 con 0x7ff97c004800 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff97c00bca0 con 0x7ff99006d3d0 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98effd640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff97c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98f7fe640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 0x7ff97c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98e7fc640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff97c004800 0x7ff97c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98effd640 1 -- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 msgr2=0x7ff97c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98effd640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99006d3d0 0x7ff97c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98effd640 1 -- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff97c004800 msgr2=0x7ff97c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98effd640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff97c004800 0x7ff97c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.116+0000 7ff98effd640 1 -- 172.21.15.6:0/974680267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c003520 con 0x7ff97c003b70 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.117+0000 7ff98effd640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff97c003fc0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff9800018a0 tx=0x7ff97c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79efaeb0e5e262e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.117+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9800014f0 con 0x7ff97c003b70 2024-05-20T17:56:49.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.117+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9800052d0 con 0x7ff97c003b70 2024-05-20T17:56:49.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.117+0000 7ff98dffb640 1 -- 172.21.15.6:0/974680267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98002ac40 con 0x7ff97c003b70 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.118+0000 7ff995379640 1 -- 172.21.15.6:0/974680267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 msgr2=0x7ff97c003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.118+0000 7ff995379640 1 --2- 172.21.15.6:0/974680267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff97c003fc0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff9800018a0 tx=0x7ff97c005830 comp rx=0 tx=0).stop 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.118+0000 7ff98f7fe640 1 -- 172.21.15.6:0/974680267 reap_dead start 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.118+0000 7ff995379640 1 -- 172.21.15.6:0/974680267 shutdown_connections 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.118+0000 7ff995379640 1 -- 172.21.15.6:0/974680267 >> 172.21.15.6:0/974680267 conn(0x7ff9900d4bd0 msgr2=0x7ff9900d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.118+0000 7ff995379640 1 -- 172.21.15.6:0/974680267 shutdown_connections 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.118+0000 7ff995379640 1 -- 172.21.15.6:0/974680267 wait complete. 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.120+0000 7ff995379640 1 Processor -- start 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.120+0000 7ff995379640 1 -- start start 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff995379640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff9901eb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff995379640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99015bfe0 0x7ff99015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff995379640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9900ce0a0 0x7ff9900ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff995379640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900d0300 con 0x7ff97c003b70 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff995379640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900d4260 con 0x7ff9900ce0a0 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff995379640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff9900b4050 con 0x7ff99015bfe0 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff98effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff9901eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff98effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff9901eb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54270/0 (socket says 172.21.15.6:54270) 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff98effd640 1 -- 172.21.15.6:0/1347809684 learned_addr learned my addr 172.21.15.6:0/1347809684 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff98e7fc640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99015bfe0 0x7ff99015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.121+0000 7ff98f7fe640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9900ce0a0 0x7ff9900ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff98effd640 1 -- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99015bfe0 msgr2=0x7ff99015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff98effd640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99015bfe0 0x7ff99015c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff98effd640 1 -- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9900ce0a0 msgr2=0x7ff9900ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff98effd640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9900ce0a0 0x7ff9900ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff98effd640 1 -- 172.21.15.6:0/1347809684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9900ce9f0 con 0x7ff97c003b70 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff98e7fc640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99015bfe0 0x7ff99015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff98effd640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff9901eb540 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff9800019c0 tx=0x7ff9800012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff9877fe640 1 -- 172.21.15.6:0/1347809684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98003f020 con 0x7ff97c003b70 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff9877fe640 1 -- 172.21.15.6:0/1347809684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff980006e50 con 0x7ff97c003b70 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99015cd30 con 0x7ff97c003b70 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff9877fe640 1 -- 172.21.15.6:0/1347809684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980037040 con 0x7ff97c003b70 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.122+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9900cc100 con 0x7ff97c003b70 2024-05-20T17:56:49.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.123+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff990075b00 con 0x7ff97c003b70 2024-05-20T17:56:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.124+0000 7ff9877fe640 1 -- 172.21.15.6:0/1347809684 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff980042020 con 0x7ff97c003b70 2024-05-20T17:56:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.124+0000 7ff9877fe640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97006be60 0x7ff97006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.125+0000 7ff9877fe640 1 -- 172.21.15.6:0/1347809684 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7ff9800aad60 con 0x7ff97c003b70 2024-05-20T17:56:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.125+0000 7ff98e7fc640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97006be60 0x7ff97006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.125+0000 7ff98e7fc640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97006be60 0x7ff97006e370 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff9900ce030 tx=0x7ff978008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.129+0000 7ff9877fe640 1 -- 172.21.15.6:0/1347809684 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff980049030 con 0x7ff97c003b70 2024-05-20T17:56:49.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.314+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7ff990068a90 con 0x7ff97c003b70 2024-05-20T17:56:49.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.314+0000 7ff9877fe640 1 -- 172.21.15.6:0/1347809684 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v20) ==== 106+0+4 (secure 0 0 0) 0x7ff9900ce9f0 con 0x7ff97c003b70 2024-05-20T17:56:49.313 INFO:teuthology.orchestra.run.smithi006.stdout:100 2024-05-20T17:56:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97006be60 msgr2=0x7ff97006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97006be60 0x7ff97006e370 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff9900ce030 tx=0x7ff978008040 comp rx=0 tx=0).stop 2024-05-20T17:56:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 msgr2=0x7ff9901eb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff9901eb540 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff9800019c0 tx=0x7ff9800012d0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 shutdown_connections 2024-05-20T17:56:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff97006be60 0x7ff97006e370 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9900ce0a0 0x7ff9900ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff99015bfe0 0x7ff99015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 --2- 172.21.15.6:0/1347809684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff97c003b70 0x7ff9901eb540 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 >> 172.21.15.6:0/1347809684 conn(0x7ff9900d4bd0 msgr2=0x7ff990161c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 shutdown_connections 2024-05-20T17:56:49.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.316+0000 7ff995379640 1 -- 172.21.15.6:0/1347809684 wait complete. 2024-05-20T17:56:49.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 200 2024-05-20T17:56:49.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.445+0000 7fca8c65a640 1 Processor -- start 2024-05-20T17:56:49.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.446+0000 7fca8c65a640 1 -- start start 2024-05-20T17:56:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca8c65a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca8406d3d0 0x7fca8406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca8c65a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fca840b8190 0x7fca840b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca8c65a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca8406dd20 con 0x7fca84162820 2024-05-20T17:56:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca8c65a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fca840d0630 con 0x7fca840b8190 2024-05-20T17:56:49.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca8c65a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fca840d39c0 con 0x7fca8406d3d0 2024-05-20T17:56:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca8abf7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fca840b8190 0x7fca840b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca89bf5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca8406d3d0 0x7fca8406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca8a3f6640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fca84162820 0x7fca840b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:37610/0 (socket says 172.21.15.6:37610) 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.447+0000 7fca8a3f6640 1 -- 172.21.15.6:0/1346755552 learned_addr learned my addr 172.21.15.6:0/1346755552 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.448+0000 7fca893f4640 1 -- 172.21.15.6:0/1346755552 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057620178 0 0) 0x7fca80001490 con 0x7fca84162820 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.448+0000 7fca893f4640 1 -- 172.21.15.6:0/1346755552 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca70003520 con 0x7fca84162820 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.448+0000 7fca8abf7640 1 -- 172.21.15.6:0/1346755552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca8406d3d0 msgr2=0x7fca8406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.448+0000 7fca8abf7640 1 --2- 172.21.15.6:0/1346755552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca8406d3d0 0x7fca8406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.448+0000 7fca8abf7640 1 -- 172.21.15.6:0/1346755552 >> v1:172.21.15.171:6789/0 conn(0x7fca84162820 legacy=0x7fca840b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.448+0000 7fca8abf7640 1 -- 172.21.15.6:0/1346755552 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca840d3ca0 con 0x7fca840b8190 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.448+0000 7fca89bf5640 1 --2- 172.21.15.6:0/1346755552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca8406d3d0 0x7fca8406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.449+0000 7fca8abf7640 1 --2- 172.21.15.6:0/1346755552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca840b8190 0x7fca840b85a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0097a0 tx=0x7fca7c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b85e72099fc276e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.449+0000 7fca893f4640 1 -- 172.21.15.6:0/1346755552 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c037070 con 0x7fca840b8190 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.449+0000 7fca893f4640 1 -- 172.21.15.6:0/1346755552 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7c032440 con 0x7fca840b8190 2024-05-20T17:56:49.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.449+0000 7fca893f4640 1 -- 172.21.15.6:0/1346755552 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c032810 con 0x7fca840b8190 2024-05-20T17:56:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.449+0000 7fca8c65a640 1 -- 172.21.15.6:0/1346755552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca840b8190 msgr2=0x7fca840b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.449+0000 7fca8c65a640 1 --2- 172.21.15.6:0/1346755552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca840b8190 0x7fca840b85a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0097a0 tx=0x7fca7c02a180 comp rx=0 tx=0).stop 2024-05-20T17:56:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.450+0000 7fca8c65a640 1 -- 172.21.15.6:0/1346755552 shutdown_connections 2024-05-20T17:56:49.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.450+0000 7fca8c65a640 1 --2- 172.21.15.6:0/1346755552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca840b8190 0x7fca840b85a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.450+0000 7fca8c65a640 1 --2- 172.21.15.6:0/1346755552 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca8406d3d0 0x7fca8406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.450+0000 7fca8c65a640 1 -- 172.21.15.6:0/1346755552 >> 172.21.15.6:0/1346755552 conn(0x7fca840d4bd0 msgr2=0x7fca840d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:49.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.450+0000 7fca8c65a640 1 -- 172.21.15.6:0/1346755552 shutdown_connections 2024-05-20T17:56:49.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.450+0000 7fca8c65a640 1 -- 172.21.15.6:0/1346755552 wait complete. 2024-05-20T17:56:49.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.451+0000 7fca8c65a640 1 Processor -- start 2024-05-20T17:56:49.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.451+0000 7fca8c65a640 1 -- start start 2024-05-20T17:56:49.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8c65a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca8406d3d0 0x7fca841542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8c65a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca840b8190 0x7fca840cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8c65a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca84162820 0x7fca840cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8c65a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fca840d0300 con 0x7fca840b8190 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8c65a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fca840d4260 con 0x7fca8406d3d0 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8c65a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fca840b4050 con 0x7fca84162820 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca840b8190 0x7fca840cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca840b8190 0x7fca840cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54284/0 (socket says 172.21.15.6:54284) 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 -- 172.21.15.6:0/2166560219 learned_addr learned my addr 172.21.15.6:0/2166560219 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8abf7640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca84162820 0x7fca840cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8a3f6640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca8406d3d0 0x7fca841542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 -- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca84162820 msgr2=0x7fca840cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca84162820 0x7fca840cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 -- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca8406d3d0 msgr2=0x7fca841542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca8406d3d0 0x7fca841542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 -- 172.21.15.6:0/2166560219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca840ceb10 con 0x7fca840b8190 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca8abf7640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca84162820 0x7fca840cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.453+0000 7fca89bf5640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca840b8190 0x7fca840cd8d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e990 tx=0x7fca7400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.454+0000 7fca7affd640 1 -- 172.21.15.6:0/2166560219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74017070 con 0x7fca840b8190 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.454+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca840b6620 con 0x7fca840b8190 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.454+0000 7fca7affd640 1 -- 172.21.15.6:0/2166560219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7400c9e0 con 0x7fca840b8190 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.454+0000 7fca7affd640 1 -- 172.21.15.6:0/2166560219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7400cdb0 con 0x7fca840b8190 2024-05-20T17:56:49.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.454+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca840b6be0 con 0x7fca840b8190 2024-05-20T17:56:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.455+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca84075b00 con 0x7fca840b8190 2024-05-20T17:56:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.455+0000 7fca7affd640 1 -- 172.21.15.6:0/2166560219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca7401a070 con 0x7fca840b8190 2024-05-20T17:56:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.456+0000 7fca7affd640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca6806be60 0x7fca6806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.456+0000 7fca7affd640 1 -- 172.21.15.6:0/2166560219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fca7408b2c0 con 0x7fca840b8190 2024-05-20T17:56:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.456+0000 7fca8a3f6640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca6806be60 0x7fca6806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:49.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.456+0000 7fca8a3f6640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca6806be60 0x7fca6806e370 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fca80005c00 tx=0x7fca80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.460+0000 7fca7affd640 1 -- 172.21.15.6:0/2166560219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fca740592e0 con 0x7fca840b8190 2024-05-20T17:56:49.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.644+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) -- 0x7fca8406e0a0 con 0x7fca840b8190 2024-05-20T17:56:49.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.648+0000 7fca7affd640 1 -- 172.21.15.6:0/2166560219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v21)=0 v21) ==== 123+0+0 (secure 0 0 0) 0x7fca7405d5e0 con 0x7fca840b8190 2024-05-20T17:56:49.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca6806be60 msgr2=0x7fca6806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca6806be60 0x7fca6806e370 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fca80005c00 tx=0x7fca80009040 comp rx=0 tx=0).stop 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca840b8190 msgr2=0x7fca840cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca840b8190 0x7fca840cd8d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e990 tx=0x7fca7400ee50 comp rx=0 tx=0).stop 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 shutdown_connections 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca6806be60 0x7fca6806e370 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca84162820 0x7fca840cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca840b8190 0x7fca840cd8d0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 --2- 172.21.15.6:0/2166560219 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca8406d3d0 0x7fca841542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 >> 172.21.15.6:0/2166560219 conn(0x7fca840d4bd0 msgr2=0x7fca84160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 shutdown_connections 2024-05-20T17:56:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:49.650+0000 7fca8c65a640 1 -- 172.21.15.6:0/2166560219 wait complete. 2024-05-20T17:56:49.660 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:49.661 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:49.677 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> import uuid 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> n = 600 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = False 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> if 0 > 0: 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> create_hard_links = True 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> path = "/home/ubuntu/cephtest/mnt.0/foo/" 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:56:49.678 DEBUG:teuthology.orchestra.run.smithi006:> dpath = os.path.dirname(path) 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> fnameprefix = os.path.basename(path) 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(dpath, exist_ok=True) 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(n): 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> with open(fpath, '"'"'w'"'"') as f: 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> f.write(f"{i}") 2024-05-20T17:56:49.679 DEBUG:teuthology.orchestra.run.smithi006:> if True: 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> f.flush() 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(f.fileno()) 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> os.unlink(fpath) 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> if create_hard_links: 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> for j in range(0): 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> if False: 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> os.fsync(dirfd) 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> finally: 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> os.close(dirfd) 2024-05-20T17:56:49.680 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:56:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:52.512 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:52.512 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:52.569 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:56:52.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:56:52.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:56:52.669 INFO:teuthology.orchestra.run.smithi006.stdout:client5855 2024-05-20T17:56:52.669 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:52.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.785+0000 7f33bc764640 1 Processor -- start 2024-05-20T17:56:52.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.785+0000 7f33bc764640 1 -- start start 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33bc764640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f33b40cf3d0 0x7f33b40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33bc764640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b40cfd20 con 0x7f33b415f220 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33bc764640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b40cda20 con 0x7f33b40ce7e0 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33bc764640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f33b40cdd00 con 0x7f33b40cf3d0 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33ba500640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33b415f220 0x7f33b40d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:45514/0 (socket says 172.21.15.6:45514) 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33ba500640 1 -- 172.21.15.6:0/1564156994 learned_addr learned my addr 172.21.15.6:0/1564156994 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33b9cff640 1 --2- 172.21.15.6:0/1564156994 >> v2:172.21.15.171:3300/0 conn(0x7f33b40cf3d0 0x7f33b40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715792671 0 0) 0x7f33ac001110 con 0x7f33b415f220 2024-05-20T17:56:52.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.787+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f339c003520 con 0x7f33b415f220 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344256512 0 0) 0x7f33b40cda20 con 0x7f33b40ce7e0 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33ac001110 con 0x7f33b40ce7e0 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1195164161 0 0) 0x7f339c003520 con 0x7f33b415f220 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 >> v2:172.21.15.171:3300/0 conn(0x7f33b40cf3d0 msgr2=0x7f33b40cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 --2- 172.21.15.6:0/1564156994 >> v2:172.21.15.171:3300/0 conn(0x7f33b40cf3d0 0x7f33b40cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 >> v1:172.21.15.171:6789/0 conn(0x7f33b40ce7e0 legacy=0x7f33b40cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b40cdfe0 con 0x7f33b415f220 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f33ac0017c0 con 0x7f33b415f220 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 >> v1:172.21.15.6:6789/0 conn(0x7f33b415f220 legacy=0x7f33b40d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c003b90 0x7f339c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c004800 0x7f339c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c005280 0x7f339c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33b40cdd00 con 0x7f339c004800 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f339c00c230 con 0x7f339c005280 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f339c00c430 con 0x7f339c003b90 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b9cff640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c004800 0x7f339c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33ba500640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c003b90 0x7f339c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33bad01640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c005280 0x7f339c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b9cff640 1 -- 172.21.15.6:0/1564156994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c003b90 msgr2=0x7f339c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b9cff640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f339c003b90 0x7f339c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b9cff640 1 -- 172.21.15.6:0/1564156994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c005280 msgr2=0x7f339c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b9cff640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c005280 0x7f339c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33bad01640 1 -- 172.21.15.6:0/1564156994 reap_dead start 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.788+0000 7f33b9cff640 1 -- 172.21.15.6:0/1564156994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c003520 con 0x7f339c004800 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.789+0000 7f33b9cff640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c004800 0x7f339c004c10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f33b40b4480 tx=0x7f339c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae7e2ff1030ca05 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.789+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8036070 con 0x7f339c004800 2024-05-20T17:56:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.789+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a8031400 con 0x7f339c004800 2024-05-20T17:56:52.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.789+0000 7f33b94fe640 1 -- 172.21.15.6:0/1564156994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8009690 con 0x7f339c004800 2024-05-20T17:56:52.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.790+0000 7f33bc764640 1 -- 172.21.15.6:0/1564156994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c004800 msgr2=0x7f339c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:52.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.790+0000 7f33bc764640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c004800 0x7f339c004c10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f33b40b4480 tx=0x7f339c005830 comp rx=0 tx=0).stop 2024-05-20T17:56:52.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.790+0000 7f33bc764640 1 -- 172.21.15.6:0/1564156994 shutdown_connections 2024-05-20T17:56:52.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.790+0000 7f33bc764640 1 --2- 172.21.15.6:0/1564156994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c004800 0x7f339c004c10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:52.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.790+0000 7f33bc764640 1 -- 172.21.15.6:0/1564156994 >> 172.21.15.6:0/1564156994 conn(0x7f33b40b44d0 msgr2=0x7f33b40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:52.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.790+0000 7f33bc764640 1 -- 172.21.15.6:0/1564156994 shutdown_connections 2024-05-20T17:56:52.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.790+0000 7f33bc764640 1 -- 172.21.15.6:0/1564156994 wait complete. 2024-05-20T17:56:52.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.792+0000 7f33bc764640 1 Processor -- start 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.792+0000 7f33bc764640 1 -- start start 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33bc764640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c004800 0x7f33b414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33bc764640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b414c330 0x7f33b40b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33bc764640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33b40b5b90 0x7f33b40b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33bc764640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33b40cd800 con 0x7f33b414c330 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33bc764640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33b40cd680 con 0x7f339c004800 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33bc764640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33b415f630 con 0x7f33b40b5b90 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33b9cff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b414c330 0x7f33b40b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33b9cff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b414c330 0x7f33b40b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54302/0 (socket says 172.21.15.6:54302) 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33b9cff640 1 -- 172.21.15.6:0/1319707642 learned_addr learned my addr 172.21.15.6:0/1319707642 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33bad01640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33b40b5b90 0x7f33b40b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33ba500640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c004800 0x7f33b414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:52.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33b9cff640 1 -- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33b40b5b90 msgr2=0x7f33b40b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33b9cff640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33b40b5b90 0x7f33b40b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33b9cff640 1 -- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c004800 msgr2=0x7f33b414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33b9cff640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c004800 0x7f33b414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33b9cff640 1 -- 172.21.15.6:0/1319707642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b415e540 con 0x7f33b414c330 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33ba500640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c004800 0x7f33b414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.793+0000 7f33bad01640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33b40b5b90 0x7f33b40b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.794+0000 7f33b9cff640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b414c330 0x7f33b40b5650 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009b80 tx=0x7f33a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.794+0000 7f33b2ffd640 1 -- 172.21.15.6:0/1319707642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a803f030 con 0x7f33b414c330 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.794+0000 7f33b2ffd640 1 -- 172.21.15.6:0/1319707642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a8037040 con 0x7f33b414c330 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.794+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b415df80 con 0x7f33b414c330 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.794+0000 7f33b2ffd640 1 -- 172.21.15.6:0/1319707642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8036070 con 0x7f33b414c330 2024-05-20T17:56:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.794+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b41498b0 con 0x7f33b414c330 2024-05-20T17:56:52.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.795+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b4075b00 con 0x7f33b414c330 2024-05-20T17:56:52.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.796+0000 7f33b2ffd640 1 -- 172.21.15.6:0/1319707642 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33a8042070 con 0x7f33b414c330 2024-05-20T17:56:52.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.796+0000 7f33b2ffd640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33a006be30 0x7f33a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:52.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.796+0000 7f33b2ffd640 1 -- 172.21.15.6:0/1319707642 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f33a80aa7f0 con 0x7f33b414c330 2024-05-20T17:56:52.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.796+0000 7f33ba500640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33a006be30 0x7f33a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:52.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.797+0000 7f33ba500640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33a006be30 0x7f33a006e340 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f33ac000c00 tx=0x7f33ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:52.801+0000 7f33b2ffd640 1 -- 172.21.15.6:0/1319707642 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f33a8078f80 con 0x7f33b414c330 2024-05-20T17:56:53.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.023+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33b4162c60 con 0x7f33b414c330 2024-05-20T17:56:53.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.024+0000 7f33b2ffd640 1 -- 172.21.15.6:0/1319707642 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7f33a8078880 con 0x7f33b414c330 2024-05-20T17:56:53.023 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:53.023 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:40.286706+0000","modified":"2024-05-20T17:56:43.311702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/693481794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":693481794},{"type":"v1","addr":"172.21.15.6:6835","nonce":693481794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6681,"qdb_cluster":[6681]},"id":5}]} 2024-05-20T17:56:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 44 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33a006be30 msgr2=0x7f33a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33a006be30 0x7f33a006e340 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f33ac000c00 tx=0x7f33ac009040 comp rx=0 tx=0).stop 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b414c330 msgr2=0x7f33b40b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b414c330 0x7f33b40b5650 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009b80 tx=0x7f33a8004730 comp rx=0 tx=0).stop 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 shutdown_connections 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33a006be30 0x7f33a006e340 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33b40b5b90 0x7f33b40b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b414c330 0x7f33b40b5650 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 --2- 172.21.15.6:0/1319707642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f339c004800 0x7f33b414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 >> 172.21.15.6:0/1319707642 conn(0x7f33b40b44d0 msgr2=0x7f33b40b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:53.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 shutdown_connections 2024-05-20T17:56:53.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:53.026+0000 7f33bc764640 1 -- 172.21.15.6:0/1319707642 wait complete. 2024-05-20T17:56:53.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-20T17:56:53.170 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":6834,"entity":{"name":{"type":"client","num":6834},"addr":{"type":"any","addr":"172.21.15.171:0","nonce":2064220851}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":4.32995061,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.97454495381408,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6834 172.21.15.171:0/2064220851","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":5855,"entity":{"name":{"type":"client","num":5855},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":3423535296}},"state":"open","num_leases":1,"num_caps":602,"request_load_avg":614,"uptime":5.4659376530000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":1007.6283770123378,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":710.20357355178555,"halflife":1.5},"recall_caps_throttle2o":{"value":433.84615277908898,"halflife":0.5},"session_cache_liveness":{"value":1199.4349311356943,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":630,"last_trim_completed_flushes_tid":601,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5855 172.21.15.6:0/3423535296","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000044d","length":903}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T17:56:53.171 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.171:0", "nonce": 2064220851, "type": "any" }, "name": { "num": 6834, "type": "client" } }, "id": 6834, "inst": "client.6834 172.21.15.171:0/2064220851", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.97454495381408 }, "state": "open", "uptime": 4.32995061 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 3423535296, "type": "any" }, "name": { "num": 5855, "type": "client" } }, "id": 5855, "inst": "client.5855 172.21.15.6:0/3423535296", "last_trim_completed_flushes_tid": 601, "last_trim_completed_requests_tid": 630, "num_caps": 602, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 903, "start": "0x1000000044d" } ], "recall_caps": { "halflife": 60, "value": 1007.6283770123378 }, "recall_caps_throttle": { "halflife": 1.5, "value": 710.2035735517856 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 433.846152779089 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 614, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1199.4349311356943 }, "state": "open", "uptime": 5.465937653 } ] 2024-05-20T17:56:53.171 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-05-20T17:56:58.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:56:58.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.303+0000 7f674c5ea640 1 Processor -- start 2024-05-20T17:56:58.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.304+0000 7f674c5ea640 1 -- start start 2024-05-20T17:56:58.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f674c5ea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f67440cd680 0x7f674415f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f674c5ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f674406c6c0 0x7f674406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f674c5ea640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f674406d0f0 con 0x7f67440cf3d0 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f674c5ea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f67440cda90 con 0x7f67440cd680 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f674c5ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f674415f760 con 0x7f674406c6c0 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f674ab87640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f67440cf3d0 0x7f67440cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46948/0 (socket says 172.21.15.6:46948) 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f674ab87640 1 -- 172.21.15.6:0/2136119994 learned_addr learned my addr 172.21.15.6:0/2136119994 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f674a386640 1 --2- 172.21.15.6:0/2136119994 >> v2:172.21.15.171:3300/0 conn(0x7f67440cd680 0x7f674415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.305+0000 7f6749b85640 1 --2- 172.21.15.6:0/2136119994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f674406c6c0 0x7f674406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.306+0000 7f6749384640 1 -- 172.21.15.6:0/2136119994 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894330741 0 0) 0x7f674406d0f0 con 0x7f67440cf3d0 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.306+0000 7f6749384640 1 -- 172.21.15.6:0/2136119994 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6730003520 con 0x7f67440cf3d0 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.306+0000 7f6749384640 1 -- 172.21.15.6:0/2136119994 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3959432286 0 0) 0x7f6730003520 con 0x7f67440cf3d0 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.306+0000 7f6749b85640 1 -- 172.21.15.6:0/2136119994 >> v2:172.21.15.171:3300/0 conn(0x7f67440cd680 msgr2=0x7f674415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.306+0000 7f6749b85640 1 --2- 172.21.15.6:0/2136119994 >> v2:172.21.15.171:3300/0 conn(0x7f67440cd680 0x7f674415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.306+0000 7f6749b85640 1 -- 172.21.15.6:0/2136119994 >> v1:172.21.15.6:6789/0 conn(0x7f67440cf3d0 legacy=0x7f67440cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.306+0000 7f6749b85640 1 -- 172.21.15.6:0/2136119994 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674406d3d0 con 0x7f674406c6c0 2024-05-20T17:56:58.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.306+0000 7f674a386640 1 --2- 172.21.15.6:0/2136119994 >> v2:172.21.15.171:3300/0 conn(0x7f67440cd680 0x7f674415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:56:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.307+0000 7f6749b85640 1 --2- 172.21.15.6:0/2136119994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f674406c6c0 0x7f674406cad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67340097a0 tx=0x7f673402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78628b4d39c6b0b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.307+0000 7f6749384640 1 -- 172.21.15.6:0/2136119994 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734037070 con 0x7f674406c6c0 2024-05-20T17:56:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.307+0000 7f6749384640 1 -- 172.21.15.6:0/2136119994 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673402ab10 con 0x7f674406c6c0 2024-05-20T17:56:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.307+0000 7f6749384640 1 -- 172.21.15.6:0/2136119994 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c0019f0 con 0x7f674406c6c0 2024-05-20T17:56:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.308+0000 7f674c5ea640 1 -- 172.21.15.6:0/2136119994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f674406c6c0 msgr2=0x7f674406cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.308+0000 7f674c5ea640 1 --2- 172.21.15.6:0/2136119994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f674406c6c0 0x7f674406cad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67340097a0 tx=0x7f673402a080 comp rx=0 tx=0).stop 2024-05-20T17:56:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.308+0000 7f674c5ea640 1 -- 172.21.15.6:0/2136119994 shutdown_connections 2024-05-20T17:56:58.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.308+0000 7f674c5ea640 1 --2- 172.21.15.6:0/2136119994 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f674406c6c0 0x7f674406cad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.308+0000 7f674c5ea640 1 --2- 172.21.15.6:0/2136119994 >> v2:172.21.15.171:3300/0 conn(0x7f67440cd680 0x7f674415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.308+0000 7f674c5ea640 1 -- 172.21.15.6:0/2136119994 >> 172.21.15.6:0/2136119994 conn(0x7f67440b44d0 msgr2=0x7f67440b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:58.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.308+0000 7f674c5ea640 1 -- 172.21.15.6:0/2136119994 shutdown_connections 2024-05-20T17:56:58.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.308+0000 7f674c5ea640 1 -- 172.21.15.6:0/2136119994 wait complete. 2024-05-20T17:56:58.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.310+0000 7f674c5ea640 1 Processor -- start 2024-05-20T17:56:58.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.310+0000 7f674c5ea640 1 -- start start 2024-05-20T17:56:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674c5ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674406c6c0 0x7f67441f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674c5ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67440cd680 0x7f674415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674c5ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67440cf3d0 0x7f674415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674c5ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f674406d990 con 0x7f674406c6c0 2024-05-20T17:56:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674c5ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f67440d0b40 con 0x7f67440cd680 2024-05-20T17:56:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674c5ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f67440d2460 con 0x7f67440cf3d0 2024-05-20T17:56:58.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674a386640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674406c6c0 0x7f67441f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674a386640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674406c6c0 0x7f67441f4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45994/0 (socket says 172.21.15.6:45994) 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674a386640 1 -- 172.21.15.6:0/3774351178 learned_addr learned my addr 172.21.15.6:0/3774351178 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674ab87640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67440cf3d0 0x7f674415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f6749b85640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67440cd680 0x7f674415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674a386640 1 -- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67440cf3d0 msgr2=0x7f674415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674a386640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67440cf3d0 0x7f674415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674a386640 1 -- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67440cd680 msgr2=0x7f674415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674a386640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67440cd680 0x7f674415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f674a386640 1 -- 172.21.15.6:0/3774351178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67440c6a40 con 0x7f674406c6c0 2024-05-20T17:56:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.311+0000 7f6749b85640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67440cd680 0x7f674415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.312+0000 7f674a386640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674406c6c0 0x7f67441f4c20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f674000e910 tx=0x7f674000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.312+0000 7f673affd640 1 -- 172.21.15.6:0/3774351178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740017070 con 0x7f674406c6c0 2024-05-20T17:56:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.312+0000 7f673affd640 1 -- 172.21.15.6:0/3774351178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f674000ca00 con 0x7f674406c6c0 2024-05-20T17:56:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.312+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674415c610 con 0x7f674406c6c0 2024-05-20T17:56:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.312+0000 7f673affd640 1 -- 172.21.15.6:0/3774351178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674000cdb0 con 0x7f674406c6c0 2024-05-20T17:56:58.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.312+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674415cbd0 con 0x7f674406c6c0 2024-05-20T17:56:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.313+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6744075b00 con 0x7f674406c6c0 2024-05-20T17:56:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.314+0000 7f673affd640 1 -- 172.21.15.6:0/3774351178 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f674001a070 con 0x7f674406c6c0 2024-05-20T17:56:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.314+0000 7f673affd640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f672806be30 0x7f672806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.314+0000 7f673affd640 1 -- 172.21.15.6:0/3774351178 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f674008ae70 con 0x7f674406c6c0 2024-05-20T17:56:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.314+0000 7f6749b85640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f672806be30 0x7f672806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:58.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.315+0000 7f6749b85640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f672806be30 0x7f672806e340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6734034000 tx=0x7f673402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:58.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.319+0000 7f673affd640 1 -- 172.21.15.6:0/3774351178 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6740058fc0 con 0x7f674406c6c0 2024-05-20T17:56:58.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.540+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f674415e580 con 0x7f674406c6c0 2024-05-20T17:56:58.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.541+0000 7f673affd640 1 -- 172.21.15.6:0/3774351178 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7f674005d2c0 con 0x7f674406c6c0 2024-05-20T17:56:58.540 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:58.540 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:40.286706+0000","modified":"2024-05-20T17:56:43.311702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/693481794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":693481794},{"type":"v1","addr":"172.21.15.6:6835","nonce":693481794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6681,"qdb_cluster":[6681]},"id":5}]} 2024-05-20T17:56:58.540 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 44 2024-05-20T17:56:58.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f672806be30 msgr2=0x7f672806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f672806be30 0x7f672806e340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6734034000 tx=0x7f673402e000 comp rx=0 tx=0).stop 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674406c6c0 msgr2=0x7f67441f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674406c6c0 0x7f67441f4c20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f674000e910 tx=0x7f674000edd0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 shutdown_connections 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f672806be30 0x7f672806e340 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67440cf3d0 0x7f674415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67440cd680 0x7f674415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 --2- 172.21.15.6:0/3774351178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674406c6c0 0x7f67441f4c20 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 >> 172.21.15.6:0/3774351178 conn(0x7f67440b44d0 msgr2=0x7f67440b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 shutdown_connections 2024-05-20T17:56:58.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:58.543+0000 7f674c5ea640 1 -- 172.21.15.6:0/3774351178 wait complete. 2024-05-20T17:56:58.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-20T17:56:58.685 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":6834,"entity":{"name":{"type":"client","num":6834},"addr":{"type":"any","addr":"172.21.15.171:0","nonce":2064220851}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":9.8448877029999995,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9368831333904493,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6834 172.21.15.171:0/2064220851","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":5855,"entity":{"name":{"type":"client","num":5855},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":3423535296}},"state":"open","num_leases":1,"num_caps":135,"request_load_avg":576,"uptime":10.980874746,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":2157.3975997339212,"halflife":60},"release_caps":{"value":454.90641469392335,"halflife":60},"recall_caps_throttle":{"value":447.00363600845668,"halflife":1.5},"recall_caps_throttle2o":{"value":36.67792189778767,"halflife":0.5},"session_cache_liveness":{"value":1184.2457030273417,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":630,"last_trim_completed_flushes_tid":601,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5855 172.21.15.6:0/3423535296","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000044d","length":903}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T17:56:58.686 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.171:0", "nonce": 2064220851, "type": "any" }, "name": { "num": 6834, "type": "client" } }, "id": 6834, "inst": "client.6834 172.21.15.171:0/2064220851", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9368831333904493 }, "state": "open", "uptime": 9.844887703 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 3423535296, "type": "any" }, "name": { "num": 5855, "type": "client" } }, "id": 5855, "inst": "client.5855 172.21.15.6:0/3423535296", "last_trim_completed_flushes_tid": 601, "last_trim_completed_requests_tid": 630, "num_caps": 135, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 903, "start": "0x1000000044d" } ], "recall_caps": { "halflife": 60, "value": 2157.397599733921 }, "recall_caps_throttle": { "halflife": 1.5, "value": 447.0036360084567 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 36.67792189778767 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 454.90641469392335 }, "request_load_avg": 576, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1184.2457030273417 }, "state": "open", "uptime": 10.980874746 } ] 2024-05-20T17:56:58.686 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-05-20T17:56:58.686 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:56:58.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:56:58.724 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:56:58.781 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:56:58.781 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:56:58.782 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:58.782 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:58.798 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:56:58.798 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:56:58.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:56:59.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.010+0000 7f118fb38640 1 Processor -- start 2024-05-20T17:56:59.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.011+0000 7f118fb38640 1 -- start start 2024-05-20T17:56:59.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118fb38640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1188162820 0x7f11880b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118fb38640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f118806dae0 0x7f11880b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118fb38640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11880d0630 con 0x7f11880b3e80 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118fb38640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f11880d39c0 con 0x7f118806dae0 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118fb38640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f11880d3ca0 con 0x7f1188162820 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118e0d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f118806dae0 0x7f11880b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118e0d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f118806dae0 0x7f11880b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45998/0 (socket says 172.21.15.6:45998) 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118e0d5640 1 -- 172.21.15.6:0/928110686 learned_addr learned my addr 172.21.15.6:0/928110686 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118d8d4640 1 --2- 172.21.15.6:0/928110686 >> v2:172.21.15.171:3300/0 conn(0x7f1188162820 0x7f11880b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118e0d5640 1 -- 172.21.15.6:0/928110686 >> v2:172.21.15.171:3300/0 conn(0x7f1188162820 msgr2=0x7f11880b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118e0d5640 1 --2- 172.21.15.6:0/928110686 >> v2:172.21.15.171:3300/0 conn(0x7f1188162820 0x7f11880b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.012+0000 7f118e0d5640 1 -- 172.21.15.6:0/928110686 >> v1:172.21.15.171:6789/0 conn(0x7f11880b3e80 legacy=0x7f118806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.013+0000 7f118e0d5640 1 -- 172.21.15.6:0/928110686 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11880d3f80 con 0x7f118806dae0 2024-05-20T17:56:59.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.013+0000 7f118e0d5640 1 --2- 172.21.15.6:0/928110686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f118806dae0 0x7f11880b8190 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f11880b7740 tx=0x7f118002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fe730112680c9b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.013+0000 7f118c8d2640 1 -- 172.21.15.6:0/928110686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180036070 con 0x7f118806dae0 2024-05-20T17:56:59.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118c8d2640 1 -- 172.21.15.6:0/928110686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180031600 con 0x7f118806dae0 2024-05-20T17:56:59.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118c8d2640 1 -- 172.21.15.6:0/928110686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11800319d0 con 0x7f118806dae0 2024-05-20T17:56:59.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118fb38640 1 -- 172.21.15.6:0/928110686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f118806dae0 msgr2=0x7f11880b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118fb38640 1 --2- 172.21.15.6:0/928110686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f118806dae0 0x7f11880b8190 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f11880b7740 tx=0x7f118002a730 comp rx=0 tx=0).stop 2024-05-20T17:56:59.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118fb38640 1 -- 172.21.15.6:0/928110686 shutdown_connections 2024-05-20T17:56:59.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118fb38640 1 --2- 172.21.15.6:0/928110686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f118806dae0 0x7f11880b8190 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118fb38640 1 --2- 172.21.15.6:0/928110686 >> v2:172.21.15.171:3300/0 conn(0x7f1188162820 0x7f11880b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118fb38640 1 -- 172.21.15.6:0/928110686 >> 172.21.15.6:0/928110686 conn(0x7f11880d4bd0 msgr2=0x7f11880d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:59.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118fb38640 1 -- 172.21.15.6:0/928110686 shutdown_connections 2024-05-20T17:56:59.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.014+0000 7f118fb38640 1 -- 172.21.15.6:0/928110686 wait complete. 2024-05-20T17:56:59.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.016+0000 7f118fb38640 1 Processor -- start 2024-05-20T17:56:59.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.016+0000 7f118fb38640 1 -- start start 2024-05-20T17:56:59.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.017+0000 7f118fb38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11880b3e80 0x7f118814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.017+0000 7f118fb38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1188162820 0x7f1188150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.017+0000 7f118fb38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f118814eda0 0x7f118814f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.017+0000 7f118fb38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f11880d4780 con 0x7f11880b3e80 2024-05-20T17:56:59.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.017+0000 7f118fb38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f11880d0300 con 0x7f118814eda0 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.017+0000 7f118fb38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f11880d4900 con 0x7f1188162820 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.017+0000 7f118d8d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11880b3e80 0x7f118814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d8d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11880b3e80 0x7f118814ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46008/0 (socket says 172.21.15.6:46008) 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d8d4640 1 -- 172.21.15.6:0/3142976706 learned_addr learned my addr 172.21.15.6:0/3142976706 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118e0d5640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f118814eda0 0x7f118814f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d0d3640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1188162820 0x7f1188150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d8d4640 1 -- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1188162820 msgr2=0x7f1188150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d8d4640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1188162820 0x7f1188150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d8d4640 1 -- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f118814eda0 msgr2=0x7f118814f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d8d4640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f118814eda0 0x7f118814f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d8d4640 1 -- 172.21.15.6:0/3142976706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11880cb5d0 con 0x7f11880b3e80 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118e0d5640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f118814eda0 0x7f118814f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:56:59.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118d8d4640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11880b3e80 0x7f118814ff40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f118400e8a0 tx=0x7f118400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f117e7fc640 1 -- 172.21.15.6:0/3142976706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1184017070 con 0x7f11880b3e80 2024-05-20T17:56:59.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f117e7fc640 1 -- 172.21.15.6:0/3142976706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118400c940 con 0x7f11880b3e80 2024-05-20T17:56:59.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118814dfe0 con 0x7f11880b3e80 2024-05-20T17:56:59.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f117e7fc640 1 -- 172.21.15.6:0/3142976706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118400cd30 con 0x7f11880b3e80 2024-05-20T17:56:59.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.018+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118814e5a0 con 0x7f11880b3e80 2024-05-20T17:56:59.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.019+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11880cb7a0 con 0x7f11880b3e80 2024-05-20T17:56:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.020+0000 7f117e7fc640 1 -- 172.21.15.6:0/3142976706 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f118401a070 con 0x7f11880b3e80 2024-05-20T17:56:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.021+0000 7f117e7fc640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f116c06be30 0x7f116c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.021+0000 7f117e7fc640 1 -- 172.21.15.6:0/3142976706 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f118408add0 con 0x7f11880b3e80 2024-05-20T17:56:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.021+0000 7f118d0d3640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f116c06be30 0x7f116c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.021+0000 7f118d0d3640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f116c06be30 0x7f116c06e340 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f11880b7900 tx=0x7f1178009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.025+0000 7f117e7fc640 1 -- 172.21.15.6:0/3142976706 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1184059680 con 0x7f11880b3e80 2024-05-20T17:56:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.210+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1188075b00 con 0x7f11880b3e80 2024-05-20T17:56:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.212+0000 7f117e7fc640 1 -- 172.21.15.6:0/3142976706 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16897 (secure 0 0 0) 0x7f1184058f80 con 0x7f11880b3e80 2024-05-20T17:56:59.211 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:56:59.211 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:41.911814+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:38.652078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:39.261578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:56:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.213+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f116c06be30 msgr2=0x7f116c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.213+0000 7f118fb38640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f116c06be30 0x7f116c06e340 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f11880b7900 tx=0x7f1178009040 comp rx=0 tx=0).stop 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.213+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11880b3e80 msgr2=0x7f118814ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11880b3e80 0x7f118814ff40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f118400e8a0 tx=0x7f118400ed60 comp rx=0 tx=0).stop 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 shutdown_connections 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f116c06be30 0x7f116c06e340 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f118814eda0 0x7f118814f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1188162820 0x7f1188150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 --2- 172.21.15.6:0/3142976706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11880b3e80 0x7f118814ff40 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 >> 172.21.15.6:0/3142976706 conn(0x7f11880d4bd0 msgr2=0x7f11880b87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 shutdown_connections 2024-05-20T17:56:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.214+0000 7f118fb38640 1 -- 172.21.15.6:0/3142976706 wait complete. 2024-05-20T17:56:59.224 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:56:38.652078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:56:39.261578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:56:59.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:56:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.343+0000 7f92c856b640 1 Processor -- start 2024-05-20T17:56:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.343+0000 7f92c856b640 1 -- start start 2024-05-20T17:56:59.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.344+0000 7f92c856b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c00b4010 0x7f92c00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.344+0000 7f92c856b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c00d0370 con 0x7f92c00d14b0 2024-05-20T17:56:59.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.344+0000 7f92c856b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c00d0650 con 0x7f92c0163a10 2024-05-20T17:56:59.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.344+0000 7f92c856b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92c00d3ca0 con 0x7f92c00b4010 2024-05-20T17:56:59.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.344+0000 7f92c6b08640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f92c00d14b0 0x7f92c00d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46962/0 (socket says 172.21.15.6:46962) 2024-05-20T17:56:59.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c6b08640 1 -- 172.21.15.6:0/2899836109 learned_addr learned my addr 172.21.15.6:0/2899836109 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:59.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5b06640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c00b4010 0x7f92c00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958399192 0 0) 0x7f92c00d0370 con 0x7f92c00d14b0 2024-05-20T17:56:59.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ac003520 con 0x7f92c00d14b0 2024-05-20T17:56:59.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2756345035 0 0) 0x7f92ac003520 con 0x7f92c00d14b0 2024-05-20T17:56:59.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c00b4010 msgr2=0x7f92c00d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:59.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c00b4010 0x7f92c00d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 >> v1:172.21.15.171:6789/0 conn(0x7f92c0163a10 legacy=0x7f92c00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c00d3650 con 0x7f92c00d14b0 2024-05-20T17:56:59.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f92b80019f0 con 0x7f92c00d14b0 2024-05-20T17:56:59.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 >> v1:172.21.15.6:6789/0 conn(0x7f92c00d14b0 legacy=0x7f92c00d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac0039e0 0x7f92ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c00b4010 0x7f92ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92ac004d40 0x7f92ac005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f92c00d3ca0 con 0x7f92ac004d40 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac00ba70 con 0x7f92ac0039e0 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92ac00bc70 con 0x7f92c00b4010 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c6b08640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92ac004d40 0x7f92ac005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c5b06640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c00b4010 0x7f92ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.345+0000 7f92c6307640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac0039e0 0x7f92ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.346+0000 7f92c6b08640 1 -- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c00b4010 msgr2=0x7f92ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.346+0000 7f92c6b08640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c00b4010 0x7f92ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.346+0000 7f92c6b08640 1 -- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac0039e0 msgr2=0x7f92ac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.346+0000 7f92c6b08640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac0039e0 0x7f92ac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.346+0000 7f92c6b08640 1 -- 172.21.15.6:0/2899836109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ac003520 con 0x7f92ac004d40 2024-05-20T17:56:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.346+0000 7f92c6b08640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92ac004d40 0x7f92ac005150 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f92c00b45b0 tx=0x7f92ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d106e14cf47f8a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b800a4d0 con 0x7f92ac004d40 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b802f070 con 0x7f92ac004d40 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c5305640 1 -- 172.21.15.6:0/2899836109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b802bc50 con 0x7f92ac004d40 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c856b640 1 -- 172.21.15.6:0/2899836109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92ac004d40 msgr2=0x7f92ac005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c856b640 1 --2- 172.21.15.6:0/2899836109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92ac004d40 0x7f92ac005150 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f92c00b45b0 tx=0x7f92ac005830 comp rx=0 tx=0).stop 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c6b08640 1 -- 172.21.15.6:0/2899836109 reap_dead start 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c856b640 1 -- 172.21.15.6:0/2899836109 shutdown_connections 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c856b640 1 -- 172.21.15.6:0/2899836109 >> 172.21.15.6:0/2899836109 conn(0x7f92c006d240 msgr2=0x7f92c006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c856b640 1 -- 172.21.15.6:0/2899836109 shutdown_connections 2024-05-20T17:56:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.347+0000 7f92c856b640 1 -- 172.21.15.6:0/2899836109 wait complete. 2024-05-20T17:56:59.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.349+0000 7f92c856b640 1 Processor -- start 2024-05-20T17:56:59.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.349+0000 7f92c856b640 1 -- start start 2024-05-20T17:56:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.350+0000 7f92c856b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac004d40 0x7f92c00cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c856b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0154a20 0x7f92c01572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c856b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c0153ea0 0x7f92c0157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c856b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f92c00d42b0 con 0x7f92c0154a20 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c856b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92c00d4130 con 0x7f92ac004d40 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c856b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92c00d4430 con 0x7f92c0153ea0 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0154a20 0x7f92c01572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0154a20 0x7f92c01572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46018/0 (socket says 172.21.15.6:46018) 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 -- 172.21.15.6:0/2452593729 learned_addr learned my addr 172.21.15.6:0/2452593729 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c6b08640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c0153ea0 0x7f92c0157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c6307640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac004d40 0x7f92c00cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 -- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c0153ea0 msgr2=0x7f92c0157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c0153ea0 0x7f92c0157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 -- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac004d40 msgr2=0x7f92c00cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac004d40 0x7f92c00cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 -- 172.21.15.6:0/2452593729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c0155200 con 0x7f92c0154a20 2024-05-20T17:56:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c6b08640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c0153ea0 0x7f92c0157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c6307640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac004d40 0x7f92c00cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:56:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c5b06640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0154a20 0x7f92c01572f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f92b00119d0 tx=0x7f92b0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92b6ffd640 1 -- 172.21.15.6:0/2452593729 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000fb50 con 0x7f92c0154a20 2024-05-20T17:56:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92b6ffd640 1 -- 172.21.15.6:0/2452593729 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b000fcf0 con 0x7f92c0154a20 2024-05-20T17:56:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c01554e0 con 0x7f92c0154a20 2024-05-20T17:56:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92b6ffd640 1 -- 172.21.15.6:0/2452593729 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000fea0 con 0x7f92c0154a20 2024-05-20T17:56:59.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.351+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c0155aa0 con 0x7f92c0154a20 2024-05-20T17:56:59.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.352+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c0154f70 con 0x7f92c0154a20 2024-05-20T17:56:59.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.353+0000 7f92b6ffd640 1 -- 172.21.15.6:0/2452593729 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92b0012040 con 0x7f92c0154a20 2024-05-20T17:56:59.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.354+0000 7f92b6ffd640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f92a406be60 0x7f92a406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.354+0000 7f92b6ffd640 1 -- 172.21.15.6:0/2452593729 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f92b008b760 con 0x7f92c0154a20 2024-05-20T17:56:59.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.354+0000 7f92c6307640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f92a406be60 0x7f92a406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.355+0000 7f92c6307640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f92a406be60 0x7f92a406e370 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92c00d3020 tx=0x7f92bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.358+0000 7f92b6ffd640 1 -- 172.21.15.6:0/2452593729 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f92b0019030 con 0x7f92c0154a20 2024-05-20T17:56:59.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.540+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f92c0075b00 con 0x7f92c0154a20 2024-05-20T17:56:59.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.540+0000 7f92b6ffd640 1 -- 172.21.15.6:0/2452593729 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f92b0059ef0 con 0x7f92c0154a20 2024-05-20T17:56:59.539 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:56:59.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f92a406be60 msgr2=0x7f92a406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f92a406be60 0x7f92a406e370 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92c00d3020 tx=0x7f92bc009040 comp rx=0 tx=0).stop 2024-05-20T17:56:59.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0154a20 msgr2=0x7f92c01572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0154a20 0x7f92c01572f0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f92b00119d0 tx=0x7f92b0011e90 comp rx=0 tx=0).stop 2024-05-20T17:56:59.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 shutdown_connections 2024-05-20T17:56:59.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f92a406be60 0x7f92a406e370 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92c0153ea0 0x7f92c0157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0154a20 0x7f92c01572f0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 --2- 172.21.15.6:0/2452593729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92ac004d40 0x7f92c00cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 >> 172.21.15.6:0/2452593729 conn(0x7f92c006d240 msgr2=0x7f92c015fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:59.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 shutdown_connections 2024-05-20T17:56:59.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.542+0000 7f92c856b640 1 -- 172.21.15.6:0/2452593729 wait complete. 2024-05-20T17:56:59.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:56:59.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.671+0000 7f40d565f640 1 Processor -- start 2024-05-20T17:56:59.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.671+0000 7f40d565f640 1 -- start start 2024-05-20T17:56:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40d565f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d00b6d90 0x7f40d015f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40d565f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d00d0550 con 0x7f40d00d3220 2024-05-20T17:56:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40d565f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d00d0830 con 0x7f40d00cf250 2024-05-20T17:56:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40d565f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40d015f9a0 con 0x7f40d00b6d90 2024-05-20T17:56:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cf7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40d00d3220 0x7f40d00d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46964/0 (socket says 172.21.15.6:46964) 2024-05-20T17:56:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cf7fe640 1 -- 172.21.15.6:0/1668395833 learned_addr learned my addr 172.21.15.6:0/1668395833 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:56:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40ce7fc640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d00b6d90 0x7f40d015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001017019 0 0) 0x7f40d00d0550 con 0x7f40d00d3220 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40b8003520 con 0x7f40d00d3220 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 555902717 0 0) 0x7f40b8003520 con 0x7f40d00d3220 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d00b6d90 msgr2=0x7f40d015f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d00b6d90 0x7f40d015f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 >> v1:172.21.15.171:6789/0 conn(0x7f40d00cf250 legacy=0x7f40d00b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d00d2a20 con 0x7f40d00d3220 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f40c80019f0 con 0x7f40d00d3220 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.673+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 >> v1:172.21.15.6:6789/0 conn(0x7f40d00d3220 legacy=0x7f40d00d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40cdffb640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b80039e0 0x7f40b8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40cdffb640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b8004350 0x7f40b8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40cdffb640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8005030 0x7f40b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40d015f9a0 con 0x7f40b8004350 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40b800bf00 con 0x7f40b8005030 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40b800c100 con 0x7f40b80039e0 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40ce7fc640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b8004350 0x7f40b8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40ceffd640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b80039e0 0x7f40b8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40cf7fe640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8005030 0x7f40b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40ce7fc640 1 -- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b80039e0 msgr2=0x7f40b8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40ce7fc640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b80039e0 0x7f40b8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40ce7fc640 1 -- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8005030 msgr2=0x7f40b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40ce7fc640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8005030 0x7f40b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.674+0000 7f40ce7fc640 1 -- 172.21.15.6:0/1668395833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b8003520 con 0x7f40b8004350 2024-05-20T17:56:59.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.675+0000 7f40ce7fc640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b8004350 0x7f40b8004880 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009ac0 tx=0x7f40b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d92a8ed18d6bd24 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.675+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4036070 con 0x7f40b8004350 2024-05-20T17:56:59.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.675+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c4031400 con 0x7f40b8004350 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.675+0000 7f40cdffb640 1 -- 172.21.15.6:0/1668395833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4009690 con 0x7f40b8004350 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.676+0000 7f40d565f640 1 -- 172.21.15.6:0/1668395833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b8004350 msgr2=0x7f40b8004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.676+0000 7f40d565f640 1 --2- 172.21.15.6:0/1668395833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b8004350 0x7f40b8004880 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009ac0 tx=0x7f40b8005830 comp rx=0 tx=0).stop 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.676+0000 7f40cf7fe640 1 -- 172.21.15.6:0/1668395833 reap_dead start 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.676+0000 7f40d565f640 1 -- 172.21.15.6:0/1668395833 shutdown_connections 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.676+0000 7f40d565f640 1 -- 172.21.15.6:0/1668395833 >> 172.21.15.6:0/1668395833 conn(0x7f40d00d1860 msgr2=0x7f40d00d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.676+0000 7f40d565f640 1 -- 172.21.15.6:0/1668395833 shutdown_connections 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.676+0000 7f40d565f640 1 -- 172.21.15.6:0/1668395833 wait complete. 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.678+0000 7f40d565f640 1 Processor -- start 2024-05-20T17:56:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.678+0000 7f40d565f640 1 -- start start 2024-05-20T17:56:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40d565f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8004350 0x7f40d00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40d565f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00b57e0 0x7f40d00b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40d565f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d015fb20 0x7f40d015ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40d565f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40d00d27d0 con 0x7f40d00b57e0 2024-05-20T17:56:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40d565f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40d00d0140 con 0x7f40b8004350 2024-05-20T17:56:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40d565f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40d00d02c0 con 0x7f40d015fb20 2024-05-20T17:56:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ce7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00b57e0 0x7f40d00b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ce7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00b57e0 0x7f40d00b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46036/0 (socket says 172.21.15.6:46036) 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ce7fc640 1 -- 172.21.15.6:0/3003564075 learned_addr learned my addr 172.21.15.6:0/3003564075 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ceffd640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8004350 0x7f40d00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40cf7fe640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d015fb20 0x7f40d015ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ce7fc640 1 -- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d015fb20 msgr2=0x7f40d015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ce7fc640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d015fb20 0x7f40d015ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ce7fc640 1 -- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8004350 msgr2=0x7f40d00c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ce7fc640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8004350 0x7f40d00c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.679+0000 7f40ce7fc640 1 -- 172.21.15.6:0/3003564075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d01f94c0 con 0x7f40d00b57e0 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.680+0000 7f40ce7fc640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00b57e0 0x7f40d00b5bf0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f40c4034040 tx=0x7f40c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.680+0000 7f40b77fe640 1 -- 172.21.15.6:0/3003564075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4040020 con 0x7f40d00b57e0 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.680+0000 7f40b77fe640 1 -- 172.21.15.6:0/3003564075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c4003bc0 con 0x7f40d00b57e0 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.680+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d01f97a0 con 0x7f40d00b57e0 2024-05-20T17:56:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.680+0000 7f40b77fe640 1 -- 172.21.15.6:0/3003564075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4036040 con 0x7f40d00b57e0 2024-05-20T17:56:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.680+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d01f9d60 con 0x7f40d00b57e0 2024-05-20T17:56:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.681+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d0075b00 con 0x7f40d00b57e0 2024-05-20T17:56:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.682+0000 7f40b77fe640 1 -- 172.21.15.6:0/3003564075 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40c4043020 con 0x7f40d00b57e0 2024-05-20T17:56:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.682+0000 7f40b77fe640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40bc06be30 0x7f40bc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:56:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.682+0000 7f40b77fe640 1 -- 172.21.15.6:0/3003564075 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f40c40ab250 con 0x7f40d00b57e0 2024-05-20T17:56:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.682+0000 7f40ceffd640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40bc06be30 0x7f40bc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:56:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.683+0000 7f40ceffd640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40bc06be30 0x7f40bc06e340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f40c0001910 tx=0x7f40c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:56:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.687+0000 7f40b77fe640 1 -- 172.21.15.6:0/3003564075 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f40c404a070 con 0x7f40d00b57e0 2024-05-20T17:56:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.869+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f40d00b7440 con 0x7f40d00b57e0 2024-05-20T17:56:59.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.869+0000 7f40b77fe640 1 -- 172.21.15.6:0/3003564075 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f40c40044e0 con 0x7f40d00b57e0 2024-05-20T17:56:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40bc06be30 msgr2=0x7f40bc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40bc06be30 0x7f40bc06e340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f40c0001910 tx=0x7f40c0009040 comp rx=0 tx=0).stop 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00b57e0 msgr2=0x7f40d00b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00b57e0 0x7f40d00b5bf0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f40c4034040 tx=0x7f40c4004730 comp rx=0 tx=0).stop 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 shutdown_connections 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40bc06be30 0x7f40bc06e340 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40d015fb20 0x7f40d015ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00b57e0 0x7f40d00b5bf0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 --2- 172.21.15.6:0/3003564075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b8004350 0x7f40d00c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 >> 172.21.15.6:0/3003564075 conn(0x7f40d00d1860 msgr2=0x7f40d015d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:56:59.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 shutdown_connections 2024-05-20T17:56:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:56:59.872+0000 7f40d565f640 1 -- 172.21.15.6:0/3003564075 wait complete. 2024-05-20T17:56:59.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:57:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.002+0000 7fdac2421640 1 Processor -- start 2024-05-20T17:57:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.002+0000 7fdac2421640 1 -- start start 2024-05-20T17:57:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdac2421640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc162820 0x7fdabc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdac2421640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdabc0b3e80 0x7fdabc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdac2421640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdabc06dd20 con 0x7fdabc06d910 2024-05-20T17:57:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdac2421640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdabc0d0630 con 0x7fdabc0b3e80 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdac2421640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc0d39c0 con 0x7fdabc162820 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdab3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdabc0b3e80 0x7fdabc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdab3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdabc0b3e80 0x7fdabc06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46044/0 (socket says 172.21.15.6:46044) 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdab3fff640 1 -- 172.21.15.6:0/2927032557 learned_addr learned my addr 172.21.15.6:0/2927032557 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdabbfff640 1 --2- 172.21.15.6:0/2927032557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc162820 0x7fdabc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdab3fff640 1 -- 172.21.15.6:0/2927032557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc162820 msgr2=0x7fdabc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdab3fff640 1 --2- 172.21.15.6:0/2927032557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc162820 0x7fdabc0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdab3fff640 1 -- 172.21.15.6:0/2927032557 >> v1:172.21.15.171:6789/0 conn(0x7fdabc06d910 legacy=0x7fdabc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdab3fff640 1 -- 172.21.15.6:0/2927032557 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc0d3ca0 con 0x7fdabc0b3e80 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.004+0000 7fdabbfff640 1 --2- 172.21.15.6:0/2927032557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc162820 0x7fdabc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.005+0000 7fdab3fff640 1 --2- 172.21.15.6:0/2927032557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc0b3e80 0x7fdabc06d3d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009870 tx=0x7fdaa402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f3a077258aa315 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.005+0000 7fdabb7fe640 1 -- 172.21.15.6:0/2927032557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4037070 con 0x7fdabc0b3e80 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.005+0000 7fdabb7fe640 1 -- 172.21.15.6:0/2927032557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa4032440 con 0x7fdabc0b3e80 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.005+0000 7fdabb7fe640 1 -- 172.21.15.6:0/2927032557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4032810 con 0x7fdabc0b3e80 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.006+0000 7fdac2421640 1 -- 172.21.15.6:0/2927032557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc0b3e80 msgr2=0x7fdabc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.006+0000 7fdac2421640 1 --2- 172.21.15.6:0/2927032557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc0b3e80 0x7fdabc06d3d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009870 tx=0x7fdaa402a210 comp rx=0 tx=0).stop 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.006+0000 7fdac2421640 1 -- 172.21.15.6:0/2927032557 shutdown_connections 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.006+0000 7fdac2421640 1 --2- 172.21.15.6:0/2927032557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc0b3e80 0x7fdabc06d3d0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.006+0000 7fdac2421640 1 --2- 172.21.15.6:0/2927032557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc162820 0x7fdabc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.006+0000 7fdac2421640 1 -- 172.21.15.6:0/2927032557 >> 172.21.15.6:0/2927032557 conn(0x7fdabc0d4bd0 msgr2=0x7fdabc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.006+0000 7fdac2421640 1 -- 172.21.15.6:0/2927032557 shutdown_connections 2024-05-20T17:57:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.006+0000 7fdac2421640 1 -- 172.21.15.6:0/2927032557 wait complete. 2024-05-20T17:57:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.008+0000 7fdac2421640 1 Processor -- start 2024-05-20T17:57:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.008+0000 7fdac2421640 1 -- start start 2024-05-20T17:57:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac2421640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc06d910 0x7fdabc14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac2421640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdabc0b3e80 0x7fdabc15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac2421640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc162820 0x7fdabc0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac2421640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc0d0300 con 0x7fdabc162820 2024-05-20T17:57:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac2421640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc0d4260 con 0x7fdabc0b3e80 2024-05-20T17:57:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac2421640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc0b91a0 con 0x7fdabc06d910 2024-05-20T17:57:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac09be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc162820 0x7fdabc0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac09be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc162820 0x7fdabc0c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46054/0 (socket says 172.21.15.6:46054) 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.009+0000 7fdac09be640 1 -- 172.21.15.6:0/2614887341 learned_addr learned my addr 172.21.15.6:0/2614887341 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdabbfff640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc06d910 0x7fdabc14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdac09be640 1 -- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc06d910 msgr2=0x7fdabc14afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdab3fff640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdabc0b3e80 0x7fdabc15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdac09be640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc06d910 0x7fdabc14afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdac09be640 1 -- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdabc0b3e80 msgr2=0x7fdabc15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdac09be640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdabc0b3e80 0x7fdabc15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdac09be640 1 -- 172.21.15.6:0/2614887341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc14b510 con 0x7fdabc162820 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdabbfff640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc06d910 0x7fdabc14afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdab3fff640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdabc0b3e80 0x7fdabc15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdac09be640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc162820 0x7fdabc0c9cf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fdab400b9a0 tx=0x7fdab400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdab97fa640 1 -- 172.21.15.6:0/2614887341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4019070 con 0x7fdabc162820 2024-05-20T17:57:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdab97fa640 1 -- 172.21.15.6:0/2614887341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab400cba0 con 0x7fdabc162820 2024-05-20T17:57:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdabc0ce820 con 0x7fdabc162820 2024-05-20T17:57:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdab97fa640 1 -- 172.21.15.6:0/2614887341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4014440 con 0x7fdabc162820 2024-05-20T17:57:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.010+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdabc0cede0 con 0x7fdabc162820 2024-05-20T17:57:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.011+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdabc075b00 con 0x7fdabc162820 2024-05-20T17:57:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.012+0000 7fdab97fa640 1 -- 172.21.15.6:0/2614887341 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdab401c070 con 0x7fdabc162820 2024-05-20T17:57:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.012+0000 7fdab97fa640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda9c06be60 0x7fda9c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.012+0000 7fdab97fa640 1 -- 172.21.15.6:0/2614887341 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fdab408ad30 con 0x7fdabc162820 2024-05-20T17:57:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.012+0000 7fdabbfff640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda9c06be60 0x7fda9c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.013+0000 7fdabbfff640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda9c06be60 0x7fda9c06e370 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdaac006fd0 tx=0x7fdaac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.017+0000 7fdab97fa640 1 -- 172.21.15.6:0/2614887341 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdabc14b510 con 0x7fdabc162820 2024-05-20T17:57:00.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.201+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdabc0cb9d0 con 0x7fdabc162820 2024-05-20T17:57:00.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.201+0000 7fdab97fa640 1 -- 172.21.15.6:0/2614887341 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7fdab40594c0 con 0x7fdabc162820 2024-05-20T17:57:00.200 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda9c06be60 msgr2=0x7fda9c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda9c06be60 0x7fda9c06e370 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdaac006fd0 tx=0x7fdaac008040 comp rx=0 tx=0).stop 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc162820 msgr2=0x7fdabc0c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc162820 0x7fdabc0c9cf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fdab400b9a0 tx=0x7fdab400be60 comp rx=0 tx=0).stop 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 shutdown_connections 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fda9c06be60 0x7fda9c06e370 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdabc162820 0x7fdabc0c9cf0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdabc0b3e80 0x7fdabc15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 --2- 172.21.15.6:0/2614887341 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdabc06d910 0x7fdabc14afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 >> 172.21.15.6:0/2614887341 conn(0x7fdabc0d4bd0 msgr2=0x7fdabc0b99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:00.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 shutdown_connections 2024-05-20T17:57:00.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.204+0000 7fdac2421640 1 -- 172.21.15.6:0/2614887341 wait complete. 2024-05-20T17:57:00.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:57:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.331+0000 7f6c5f08b640 1 Processor -- start 2024-05-20T17:57:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.331+0000 7f6c5f08b640 1 -- start start 2024-05-20T17:57:00.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.332+0000 7f6c5f08b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c58163a10 0x7f6c580d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.332+0000 7f6c5f08b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6c580d14b0 0x7f6c580d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.332+0000 7f6c5f08b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c580d0370 con 0x7f6c580b4010 2024-05-20T17:57:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.332+0000 7f6c5f08b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6c580d3ca0 con 0x7f6c580d14b0 2024-05-20T17:57:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.332+0000 7f6c5f08b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6c580d0650 con 0x7f6c58163a10 2024-05-20T17:57:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5ce27640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c58163a10 0x7f6c580d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5d628640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6c580d14b0 0x7f6c580d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5ce27640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c58163a10 0x7f6c580d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:41536/0 (socket says 172.21.15.6:41536) 2024-05-20T17:57:00.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5ce27640 1 -- 172.21.15.6:0/3418316248 learned_addr learned my addr 172.21.15.6:0/3418316248 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5ce27640 1 -- 172.21.15.6:0/3418316248 >> v2:172.21.15.171:3300/0 conn(0x7f6c580d14b0 msgr2=0x7f6c580d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5ce27640 1 --2- 172.21.15.6:0/3418316248 >> v2:172.21.15.171:3300/0 conn(0x7f6c580d14b0 0x7f6c580d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5ce27640 1 -- 172.21.15.6:0/3418316248 >> v1:172.21.15.171:6789/0 conn(0x7f6c580b4010 legacy=0x7f6c580cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5ce27640 1 -- 172.21.15.6:0/3418316248 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c580d3650 con 0x7f6c58163a10 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.333+0000 7f6c5d628640 1 --2- 172.21.15.6:0/3418316248 >> v2:172.21.15.171:3300/0 conn(0x7f6c580d14b0 0x7f6c580d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.334+0000 7f6c5ce27640 1 --2- 172.21.15.6:0/3418316248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c58163a10 0x7f6c580d4130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009870 tx=0x7f6c4c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655c1884ed2cd5a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.334+0000 7f6c577fe640 1 -- 172.21.15.6:0/3418316248 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c037070 con 0x7f6c58163a10 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.334+0000 7f6c577fe640 1 -- 172.21.15.6:0/3418316248 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4c032440 con 0x7f6c58163a10 2024-05-20T17:57:00.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.334+0000 7f6c577fe640 1 -- 172.21.15.6:0/3418316248 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c032810 con 0x7f6c58163a10 2024-05-20T17:57:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.335+0000 7f6c5f08b640 1 -- 172.21.15.6:0/3418316248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c58163a10 msgr2=0x7f6c580d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.335+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/3418316248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c58163a10 0x7f6c580d4130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009870 tx=0x7f6c4c02a270 comp rx=0 tx=0).stop 2024-05-20T17:57:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.335+0000 7f6c5f08b640 1 -- 172.21.15.6:0/3418316248 shutdown_connections 2024-05-20T17:57:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.335+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/3418316248 >> v2:172.21.15.171:3300/0 conn(0x7f6c580d14b0 0x7f6c580d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.335+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/3418316248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c58163a10 0x7f6c580d4130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.335+0000 7f6c5f08b640 1 -- 172.21.15.6:0/3418316248 >> 172.21.15.6:0/3418316248 conn(0x7f6c5806d240 msgr2=0x7f6c5806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.335+0000 7f6c5f08b640 1 -- 172.21.15.6:0/3418316248 shutdown_connections 2024-05-20T17:57:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.335+0000 7f6c5f08b640 1 -- 172.21.15.6:0/3418316248 wait complete. 2024-05-20T17:57:00.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.337+0000 7f6c5f08b640 1 Processor -- start 2024-05-20T17:57:00.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.337+0000 7f6c5f08b640 1 -- start start 2024-05-20T17:57:00.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.338+0000 7f6c5f08b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c580b4010 0x7f6c5814a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.338+0000 7f6c5f08b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c580d14b0 0x7f6c58158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.338+0000 7f6c5f08b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c58163a10 0x7f6c58161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.338+0000 7f6c5f08b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6c580b8210 con 0x7f6c580b4010 2024-05-20T17:57:00.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.338+0000 7f6c5f08b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6c580d1e00 con 0x7f6c58163a10 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.338+0000 7f6c5f08b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6c580b8390 con 0x7f6c580d14b0 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c580b4010 0x7f6c5814a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c580b4010 0x7f6c5814a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46058/0 (socket says 172.21.15.6:46058) 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 -- 172.21.15.6:0/2960314557 learned_addr learned my addr 172.21.15.6:0/2960314557 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5d628640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c58163a10 0x7f6c58161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c57fff640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c580d14b0 0x7f6c58158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 -- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c580d14b0 msgr2=0x7f6c58158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c580d14b0 0x7f6c58158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 -- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c58163a10 msgr2=0x7f6c58161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c58163a10 0x7f6c58161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 -- 172.21.15.6:0/2960314557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5815f9a0 con 0x7f6c580b4010 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5ce27640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c580b4010 0x7f6c5814a480 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c000c00 tx=0x7f6c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c557fa640 1 -- 172.21.15.6:0/2960314557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c037040 con 0x7f6c580b4010 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c557fa640 1 -- 172.21.15.6:0/2960314557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4c042070 con 0x7f6c580b4010 2024-05-20T17:57:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c557fa640 1 -- 172.21.15.6:0/2960314557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c030880 con 0x7f6c580b4010 2024-05-20T17:57:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c581598f0 con 0x7f6c580b4010 2024-05-20T17:57:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.339+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5815ff20 con 0x7f6c580b4010 2024-05-20T17:57:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.340+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c58162b70 con 0x7f6c580b4010 2024-05-20T17:57:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.341+0000 7f6c557fa640 1 -- 172.21.15.6:0/2960314557 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c4c030a20 con 0x7f6c580b4010 2024-05-20T17:57:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.341+0000 7f6c557fa640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3c06be30 0x7f6c3c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.342+0000 7f6c557fa640 1 -- 172.21.15.6:0/2960314557 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f6c4c0ab860 con 0x7f6c580b4010 2024-05-20T17:57:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.342+0000 7f6c57fff640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3c06be30 0x7f6c3c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.342+0000 7f6c57fff640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3c06be30 0x7f6c3c06e340 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6c44007fd0 tx=0x7f6c44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.346+0000 7f6c557fa640 1 -- 172.21.15.6:0/2960314557 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6c4c07a080 con 0x7f6c580b4010 2024-05-20T17:57:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.546+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6c58075b00 con 0x7f6c580b4010 2024-05-20T17:57:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.546+0000 7f6c557fa640 1 -- 172.21.15.6:0/2960314557 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7f6c4c079980 con 0x7f6c580b4010 2024-05-20T17:57:00.545 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3c06be30 msgr2=0x7f6c3c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3c06be30 0x7f6c3c06e340 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6c44007fd0 tx=0x7f6c44009040 comp rx=0 tx=0).stop 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c580b4010 msgr2=0x7f6c5814a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c580b4010 0x7f6c5814a480 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c000c00 tx=0x7f6c4c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 shutdown_connections 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c3c06be30 0x7f6c3c06e340 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c58163a10 0x7f6c58161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c580d14b0 0x7f6c58158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 --2- 172.21.15.6:0/2960314557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c580b4010 0x7f6c5814a480 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 >> 172.21.15.6:0/2960314557 conn(0x7f6c5806d240 msgr2=0x7f6c580b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:00.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 shutdown_connections 2024-05-20T17:57:00.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.549+0000 7f6c5f08b640 1 -- 172.21.15.6:0/2960314557 wait complete. 2024-05-20T17:57:00.559 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T17:57:00.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:00.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T17:57:00.695 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:57:00.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:00.695 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T17:57:00.711 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:57:00.711 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:57:00.711 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:00.729 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:57:00.729 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:00.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.903+0000 7fd30b88b640 1 Processor -- start 2024-05-20T17:57:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.903+0000 7fd30b88b640 1 -- start start 2024-05-20T17:57:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd30b88b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd304162820 0x7fd3040b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd30b88b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd3040b3e80 0x7fd30406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd30b88b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30406dd20 con 0x7fd30406d910 2024-05-20T17:57:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd30b88b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd3040d0630 con 0x7fd304162820 2024-05-20T17:57:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd30b88b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd3040d39c0 con 0x7fd3040b3e80 2024-05-20T17:57:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd309627640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd304162820 0x7fd3040b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd309627640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd304162820 0x7fd3040b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46066/0 (socket says 172.21.15.6:46066) 2024-05-20T17:57:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd309627640 1 -- 172.21.15.6:0/2463395060 learned_addr learned my addr 172.21.15.6:0/2463395060 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd308e26640 1 --2- 172.21.15.6:0/2463395060 >> v2:172.21.15.171:3300/0 conn(0x7fd3040b3e80 0x7fd30406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd309627640 1 -- 172.21.15.6:0/2463395060 >> v2:172.21.15.171:3300/0 conn(0x7fd3040b3e80 msgr2=0x7fd30406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd309627640 1 --2- 172.21.15.6:0/2463395060 >> v2:172.21.15.171:3300/0 conn(0x7fd3040b3e80 0x7fd30406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd309627640 1 -- 172.21.15.6:0/2463395060 >> v1:172.21.15.171:6789/0 conn(0x7fd30406d910 legacy=0x7fd3040d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd309627640 1 -- 172.21.15.6:0/2463395060 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3040d3ca0 con 0x7fd304162820 2024-05-20T17:57:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.905+0000 7fd308e26640 1 --2- 172.21.15.6:0/2463395060 >> v2:172.21.15.171:3300/0 conn(0x7fd3040b3e80 0x7fd30406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:00.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.906+0000 7fd309627640 1 --2- 172.21.15.6:0/2463395060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd304162820 0x7fd3040b3940 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd3040d1230 tx=0x7fd30002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24be97aaa6b4bfc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.906+0000 7fd2fbfff640 1 -- 172.21.15.6:0/2463395060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300037070 con 0x7fd304162820 2024-05-20T17:57:00.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.906+0000 7fd2fbfff640 1 -- 172.21.15.6:0/2463395060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd300032440 con 0x7fd304162820 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.906+0000 7fd2fbfff640 1 -- 172.21.15.6:0/2463395060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300032810 con 0x7fd304162820 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.907+0000 7fd30b88b640 1 -- 172.21.15.6:0/2463395060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd304162820 msgr2=0x7fd3040b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.907+0000 7fd30b88b640 1 --2- 172.21.15.6:0/2463395060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd304162820 0x7fd3040b3940 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd3040d1230 tx=0x7fd30002a230 comp rx=0 tx=0).stop 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.907+0000 7fd30b88b640 1 -- 172.21.15.6:0/2463395060 shutdown_connections 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.907+0000 7fd30b88b640 1 --2- 172.21.15.6:0/2463395060 >> v2:172.21.15.171:3300/0 conn(0x7fd3040b3e80 0x7fd30406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.907+0000 7fd30b88b640 1 --2- 172.21.15.6:0/2463395060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd304162820 0x7fd3040b3940 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.907+0000 7fd30b88b640 1 -- 172.21.15.6:0/2463395060 >> 172.21.15.6:0/2463395060 conn(0x7fd3040d4bd0 msgr2=0x7fd3040d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.907+0000 7fd30b88b640 1 -- 172.21.15.6:0/2463395060 shutdown_connections 2024-05-20T17:57:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.907+0000 7fd30b88b640 1 -- 172.21.15.6:0/2463395060 wait complete. 2024-05-20T17:57:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.909+0000 7fd30b88b640 1 Processor -- start 2024-05-20T17:57:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.909+0000 7fd30b88b640 1 -- start start 2024-05-20T17:57:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd30b88b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd30406d910 0x7fd3040ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd30b88b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3040b3e80 0x7fd3040cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd30b88b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd304162820 0x7fd3040cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd30b88b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd3040d0300 con 0x7fd3040b3e80 2024-05-20T17:57:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd30b88b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3040d4260 con 0x7fd304162820 2024-05-20T17:57:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd30b88b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd3040b91a0 con 0x7fd30406d910 2024-05-20T17:57:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd308e26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3040b3e80 0x7fd3040cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd308e26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3040b3e80 0x7fd3040cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46082/0 (socket says 172.21.15.6:46082) 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd308e26640 1 -- 172.21.15.6:0/1060304089 learned_addr learned my addr 172.21.15.6:0/1060304089 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd309627640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd30406d910 0x7fd3040ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.910+0000 7fd309e28640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd304162820 0x7fd3040cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd308e26640 1 -- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd30406d910 msgr2=0x7fd3040ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd308e26640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd30406d910 0x7fd3040ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd308e26640 1 -- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd304162820 msgr2=0x7fd3040cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd308e26640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd304162820 0x7fd3040cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd308e26640 1 -- 172.21.15.6:0/1060304089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3041e8fb0 con 0x7fd3040b3e80 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd309e28640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd304162820 0x7fd3040cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd308e26640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3040b3e80 0x7fd3040cabe0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400c820 tx=0x7fd2f400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd2f9ffb640 1 -- 172.21.15.6:0/1060304089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4015070 con 0x7fd3040b3e80 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd2f9ffb640 1 -- 172.21.15.6:0/1060304089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f4007a30 con 0x7fd3040b3e80 2024-05-20T17:57:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3041e9290 con 0x7fd3040b3e80 2024-05-20T17:57:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd2f9ffb640 1 -- 172.21.15.6:0/1060304089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4007de0 con 0x7fd3040b3e80 2024-05-20T17:57:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.911+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3041e9850 con 0x7fd3040b3e80 2024-05-20T17:57:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.912+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30406d700 con 0x7fd3040b3e80 2024-05-20T17:57:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.913+0000 7fd2f9ffb640 1 -- 172.21.15.6:0/1060304089 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2f4018070 con 0x7fd3040b3e80 2024-05-20T17:57:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.913+0000 7fd2f9ffb640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e806be30 0x7fd2e806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.913+0000 7fd2f9ffb640 1 -- 172.21.15.6:0/1060304089 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd2f408af20 con 0x7fd3040b3e80 2024-05-20T17:57:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.914+0000 7fd309627640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e806be30 0x7fd2e806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.914+0000 7fd309627640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e806be30 0x7fd2e806e340 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd300034000 tx=0x7fd30002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:00.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:00.918+0000 7fd2f9ffb640 1 -- 172.21.15.6:0/1060304089 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd30406d700 con 0x7fd3040b3e80 2024-05-20T17:57:01.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.118+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd304075b00 con 0x7fd3040b3e80 2024-05-20T17:57:01.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.119+0000 7fd2f9ffb640 1 -- 172.21.15.6:0/1060304089 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16897 (secure 0 0 0) 0x7fd2f4059750 con 0x7fd3040b3e80 2024-05-20T17:57:01.118 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:01.118 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:41.911814+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:38.652078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:39.261578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:01.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e806be30 msgr2=0x7fd2e806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e806be30 0x7fd2e806e340 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd300034000 tx=0x7fd30002e000 comp rx=0 tx=0).stop 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3040b3e80 msgr2=0x7fd3040cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3040b3e80 0x7fd3040cabe0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400c820 tx=0x7fd2f400cce0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 shutdown_connections 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2e806be30 0x7fd2e806e340 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd304162820 0x7fd3040cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3040b3e80 0x7fd3040cabe0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 --2- 172.21.15.6:0/1060304089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd30406d910 0x7fd3040ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 >> 172.21.15.6:0/1060304089 conn(0x7fd3040d4bd0 msgr2=0x7fd3040b9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 shutdown_connections 2024-05-20T17:57:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.121+0000 7fd30b88b640 1 -- 172.21.15.6:0/1060304089 wait complete. 2024-05-20T17:57:01.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:56:38.652078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:56:39.261578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:57:01.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:57:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.251+0000 7faa99a7a640 1 Processor -- start 2024-05-20T17:57:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.251+0000 7faa99a7a640 1 -- start start 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.252+0000 7faa99a7a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa9415f220 0x7faa940d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.252+0000 7faa99a7a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faa940cfae0 0x7faa940ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.252+0000 7faa99a7a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa940cda20 con 0x7faa940d0e00 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.252+0000 7faa99a7a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7faa940cdd00 con 0x7faa9415f220 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.252+0000 7faa99a7a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7faa940cdfe0 con 0x7faa940cfae0 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.252+0000 7faa937fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa9415f220 0x7faa940d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.252+0000 7faa92ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faa940d0e00 0x7faa940cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46966/0 (socket says 172.21.15.6:46966) 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.252+0000 7faa92ffd640 1 -- 172.21.15.6:0/2458823630 learned_addr learned my addr 172.21.15.6:0/2458823630 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.253+0000 7faa93fff640 1 --2- 172.21.15.6:0/2458823630 >> v2:172.21.15.171:3300/0 conn(0x7faa940cfae0 0x7faa940ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.253+0000 7faa937fe640 1 -- 172.21.15.6:0/2458823630 >> v2:172.21.15.171:3300/0 conn(0x7faa940cfae0 msgr2=0x7faa940ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.253+0000 7faa937fe640 1 --2- 172.21.15.6:0/2458823630 >> v2:172.21.15.171:3300/0 conn(0x7faa940cfae0 0x7faa940ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.253+0000 7faa937fe640 1 -- 172.21.15.6:0/2458823630 >> v1:172.21.15.6:6789/0 conn(0x7faa940d0e00 legacy=0x7faa940cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.253+0000 7faa927fc640 1 -- 172.21.15.6:0/2458823630 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702447174 0 0) 0x7faa940cda20 con 0x7faa940d0e00 2024-05-20T17:57:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.253+0000 7faa937fe640 1 -- 172.21.15.6:0/2458823630 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa940ce2c0 con 0x7faa9415f220 2024-05-20T17:57:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.253+0000 7faa93fff640 1 --2- 172.21.15.6:0/2458823630 >> v2:172.21.15.171:3300/0 conn(0x7faa940cfae0 0x7faa940ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa937fe640 1 --2- 172.21.15.6:0/2458823630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa9415f220 0x7faa940d08c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7faa9406e3e0 tx=0x7faa8402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d8c15aa59ae566 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa927fc640 1 -- 172.21.15.6:0/2458823630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84037070 con 0x7faa9415f220 2024-05-20T17:57:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa927fc640 1 -- 172.21.15.6:0/2458823630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa84032440 con 0x7faa9415f220 2024-05-20T17:57:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa927fc640 1 -- 172.21.15.6:0/2458823630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8402ae60 con 0x7faa9415f220 2024-05-20T17:57:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa99a7a640 1 -- 172.21.15.6:0/2458823630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa9415f220 msgr2=0x7faa940d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa99a7a640 1 --2- 172.21.15.6:0/2458823630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa9415f220 0x7faa940d08c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7faa9406e3e0 tx=0x7faa8402a110 comp rx=0 tx=0).stop 2024-05-20T17:57:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa99a7a640 1 -- 172.21.15.6:0/2458823630 shutdown_connections 2024-05-20T17:57:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa99a7a640 1 --2- 172.21.15.6:0/2458823630 >> v2:172.21.15.171:3300/0 conn(0x7faa940cfae0 0x7faa940ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa99a7a640 1 --2- 172.21.15.6:0/2458823630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa9415f220 0x7faa940d08c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.254+0000 7faa99a7a640 1 -- 172.21.15.6:0/2458823630 >> 172.21.15.6:0/2458823630 conn(0x7faa940b44d0 msgr2=0x7faa940b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.255+0000 7faa99a7a640 1 -- 172.21.15.6:0/2458823630 shutdown_connections 2024-05-20T17:57:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.255+0000 7faa99a7a640 1 -- 172.21.15.6:0/2458823630 wait complete. 2024-05-20T17:57:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.256+0000 7faa99a7a640 1 Processor -- start 2024-05-20T17:57:01.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.256+0000 7faa99a7a640 1 -- start start 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa99a7a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa940d0e00 0x7faa94148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa99a7a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9415f220 0x7faa940b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa99a7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa940b79d0 0x7faa940b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa99a7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa9415f7b0 con 0x7faa940b79d0 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa99a7a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa9415f630 con 0x7faa9415f220 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa99a7a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa940ced20 con 0x7faa940d0e00 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa940b79d0 0x7faa940b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa940b79d0 0x7faa940b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46110/0 (socket says 172.21.15.6:46110) 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 -- 172.21.15.6:0/1788491686 learned_addr learned my addr 172.21.15.6:0/1788491686 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:01.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa937fe640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa940d0e00 0x7faa94148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa92ffd640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9415f220 0x7faa940b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 -- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa940d0e00 msgr2=0x7faa94148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa940d0e00 0x7faa94148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 -- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9415f220 msgr2=0x7faa940b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9415f220 0x7faa940b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 -- 172.21.15.6:0/1788491686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa940cae80 con 0x7faa940b79d0 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa92ffd640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9415f220 0x7faa940b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.258+0000 7faa93fff640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa940b79d0 0x7faa940b33a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00cd80 tx=0x7faa8c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.259+0000 7faa7bfff640 1 -- 172.21.15.6:0/1788491686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00f680 con 0x7faa940b79d0 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.259+0000 7faa7bfff640 1 -- 172.21.15.6:0/1788491686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c00f840 con 0x7faa940b79d0 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.259+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa940cb160 con 0x7faa940b79d0 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.259+0000 7faa7bfff640 1 -- 172.21.15.6:0/1788491686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c00fc30 con 0x7faa940b79d0 2024-05-20T17:57:01.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.259+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa940cb720 con 0x7faa940b79d0 2024-05-20T17:57:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.260+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa940cabf0 con 0x7faa940b79d0 2024-05-20T17:57:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.260+0000 7faa7bfff640 1 -- 172.21.15.6:0/1788491686 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa8c0213f0 con 0x7faa940b79d0 2024-05-20T17:57:01.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.261+0000 7faa7bfff640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8006be30 0x7faa8006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.261+0000 7faa7bfff640 1 -- 172.21.15.6:0/1788491686 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7faa8c08bdf0 con 0x7faa940b79d0 2024-05-20T17:57:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.261+0000 7faa937fe640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8006be30 0x7faa8006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.262+0000 7faa937fe640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8006be30 0x7faa8006e340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faa84034000 tx=0x7faa8402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.265+0000 7faa7bfff640 1 -- 172.21.15.6:0/1788491686 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faa8c014030 con 0x7faa940b79d0 2024-05-20T17:57:01.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.448+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa94075b00 con 0x7faa940b79d0 2024-05-20T17:57:01.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.448+0000 7faa7bfff640 1 -- 172.21.15.6:0/1788491686 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7faa8c059f30 con 0x7faa940b79d0 2024-05-20T17:57:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:57:01.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8006be30 msgr2=0x7faa8006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8006be30 0x7faa8006e340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faa84034000 tx=0x7faa8402e000 comp rx=0 tx=0).stop 2024-05-20T17:57:01.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa940b79d0 msgr2=0x7faa940b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa940b79d0 0x7faa940b33a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00cd80 tx=0x7faa8c00a650 comp rx=0 tx=0).stop 2024-05-20T17:57:01.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 shutdown_connections 2024-05-20T17:57:01.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8006be30 0x7faa8006e340 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa940b79d0 0x7faa940b33a0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9415f220 0x7faa940b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 --2- 172.21.15.6:0/1788491686 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa940d0e00 0x7faa94148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 >> 172.21.15.6:0/1788491686 conn(0x7faa940b44d0 msgr2=0x7faa9415c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 shutdown_connections 2024-05-20T17:57:01.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.450+0000 7faa99a7a640 1 -- 172.21.15.6:0/1788491686 wait complete. 2024-05-20T17:57:01.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:57:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.579+0000 7f1306f8f640 1 Processor -- start 2024-05-20T17:57:01.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.579+0000 7f1306f8f640 1 -- start start 2024-05-20T17:57:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1306f8f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1300162820 0x7f13000b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1306f8f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f13000b3e80 0x7f130006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1306f8f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130006dd20 con 0x7f130006d910 2024-05-20T17:57:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1306f8f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f13000d0630 con 0x7f1300162820 2024-05-20T17:57:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1306f8f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f13000d39c0 con 0x7f13000b3e80 2024-05-20T17:57:01.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1304d2b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1300162820 0x7f13000b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1304d2b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1300162820 0x7f13000b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46116/0 (socket says 172.21.15.6:46116) 2024-05-20T17:57:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1304d2b640 1 -- 172.21.15.6:0/1903180118 learned_addr learned my addr 172.21.15.6:0/1903180118 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f12fffff640 1 --2- 172.21.15.6:0/1903180118 >> v2:172.21.15.171:3300/0 conn(0x7f13000b3e80 0x7f130006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1304d2b640 1 -- 172.21.15.6:0/1903180118 >> v2:172.21.15.171:3300/0 conn(0x7f13000b3e80 msgr2=0x7f130006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1304d2b640 1 --2- 172.21.15.6:0/1903180118 >> v2:172.21.15.171:3300/0 conn(0x7f13000b3e80 0x7f130006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1304d2b640 1 -- 172.21.15.6:0/1903180118 >> v1:172.21.15.171:6789/0 conn(0x7f130006d910 legacy=0x7f13000d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.581+0000 7f1304d2b640 1 -- 172.21.15.6:0/1903180118 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13000d3ca0 con 0x7f1300162820 2024-05-20T17:57:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.582+0000 7f1304d2b640 1 --2- 172.21.15.6:0/1903180118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13000b3940 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f13000d1230 tx=0x7f12f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c5896bd66cb6a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.582+0000 7f12ff7fe640 1 -- 172.21.15.6:0/1903180118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0037070 con 0x7f1300162820 2024-05-20T17:57:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.582+0000 7f12ff7fe640 1 -- 172.21.15.6:0/1903180118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f0032440 con 0x7f1300162820 2024-05-20T17:57:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.582+0000 7f12ff7fe640 1 -- 172.21.15.6:0/1903180118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0032810 con 0x7f1300162820 2024-05-20T17:57:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.583+0000 7f1306f8f640 1 -- 172.21.15.6:0/1903180118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 msgr2=0x7f13000b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.583+0000 7f1306f8f640 1 --2- 172.21.15.6:0/1903180118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13000b3940 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f13000d1230 tx=0x7f12f002a270 comp rx=0 tx=0).stop 2024-05-20T17:57:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.583+0000 7f1306f8f640 1 -- 172.21.15.6:0/1903180118 shutdown_connections 2024-05-20T17:57:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.583+0000 7f1306f8f640 1 --2- 172.21.15.6:0/1903180118 >> v2:172.21.15.171:3300/0 conn(0x7f13000b3e80 0x7f130006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.583+0000 7f1306f8f640 1 --2- 172.21.15.6:0/1903180118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13000b3940 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.583+0000 7f1306f8f640 1 -- 172.21.15.6:0/1903180118 >> 172.21.15.6:0/1903180118 conn(0x7f13000d4bd0 msgr2=0x7f13000d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.583+0000 7f1306f8f640 1 -- 172.21.15.6:0/1903180118 shutdown_connections 2024-05-20T17:57:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.583+0000 7f1306f8f640 1 -- 172.21.15.6:0/1903180118 wait complete. 2024-05-20T17:57:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.585+0000 7f1306f8f640 1 Processor -- start 2024-05-20T17:57:01.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.585+0000 7f1306f8f640 1 -- start start 2024-05-20T17:57:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f1306f8f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f130006d910 0x7f130014aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f1306f8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13000b3e80 0x7f130014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f1306f8f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13001f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f1306f8f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f13000d0300 con 0x7f1300162820 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f1306f8f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f13000d4260 con 0x7f130006d910 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f1306f8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f13000b91a0 con 0x7f13000b3e80 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f130552c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13001f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f130552c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13001f8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46130/0 (socket says 172.21.15.6:46130) 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f130552c640 1 -- 172.21.15.6:0/2356254644 learned_addr learned my addr 172.21.15.6:0/2356254644 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f1304d2b640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f130006d910 0x7f130014aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.586+0000 7f12fffff640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13000b3e80 0x7f130014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f130552c640 1 -- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13000b3e80 msgr2=0x7f130014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f130552c640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13000b3e80 0x7f130014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f130552c640 1 -- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f130006d910 msgr2=0x7f130014aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f130552c640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f130006d910 0x7f130014aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f130552c640 1 -- 172.21.15.6:0/2356254644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13000c99f0 con 0x7f1300162820 2024-05-20T17:57:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f130552c640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13001f8950 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c6e0 tx=0x7f12f800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f12fd7fa640 1 -- 172.21.15.6:0/2356254644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8003b70 con 0x7f1300162820 2024-05-20T17:57:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f12fd7fa640 1 -- 172.21.15.6:0/2356254644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f8003d30 con 0x7f1300162820 2024-05-20T17:57:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13000c9cd0 con 0x7f1300162820 2024-05-20T17:57:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f12fd7fa640 1 -- 172.21.15.6:0/2356254644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f8005310 con 0x7f1300162820 2024-05-20T17:57:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.587+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13000cbd20 con 0x7f1300162820 2024-05-20T17:57:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.588+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1300075b00 con 0x7f1300162820 2024-05-20T17:57:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.589+0000 7f12fd7fa640 1 -- 172.21.15.6:0/2356254644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12f80054b0 con 0x7f1300162820 2024-05-20T17:57:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.590+0000 7f12fd7fa640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12ec06be30 0x7f12ec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.590+0000 7f12fd7fa640 1 -- 172.21.15.6:0/2356254644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f12f808ae20 con 0x7f1300162820 2024-05-20T17:57:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.590+0000 7f1304d2b640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12ec06be30 0x7f12ec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.590+0000 7f1304d2b640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12ec06be30 0x7f12ec06e340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f12f0034000 tx=0x7f12f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.594+0000 7f12fd7fa640 1 -- 172.21.15.6:0/2356254644 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f130006dd20 con 0x7f1300162820 2024-05-20T17:57:01.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.780+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f13000cc100 con 0x7f1300162820 2024-05-20T17:57:01.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.781+0000 7f12fd7fa640 1 -- 172.21.15.6:0/2356254644 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f12f8058ed0 con 0x7f1300162820 2024-05-20T17:57:01.780 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:57:01.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12ec06be30 msgr2=0x7f12ec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12ec06be30 0x7f12ec06e340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f12f0034000 tx=0x7f12f002e000 comp rx=0 tx=0).stop 2024-05-20T17:57:01.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 msgr2=0x7f13001f8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13001f8950 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c6e0 tx=0x7f12f800cba0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 shutdown_connections 2024-05-20T17:57:01.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f12ec06be30 0x7f12ec06e340 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1300162820 0x7f13001f8950 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f13000b3e80 0x7f130014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 --2- 172.21.15.6:0/2356254644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f130006d910 0x7f130014aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 >> 172.21.15.6:0/2356254644 conn(0x7f13000d4bd0 msgr2=0x7f13000b9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 shutdown_connections 2024-05-20T17:57:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.783+0000 7f1306f8f640 1 -- 172.21.15.6:0/2356254644 wait complete. 2024-05-20T17:57:01.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:57:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.912+0000 7f3619d8f640 1 Processor -- start 2024-05-20T17:57:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.912+0000 7f3619d8f640 1 -- start start 2024-05-20T17:57:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3619d8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f361406d3d0 0x7f361406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3619d8f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f36140b8190 0x7f36140b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3619d8f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f361406dd20 con 0x7f3614162820 2024-05-20T17:57:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3619d8f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f36140d0630 con 0x7f36140b8190 2024-05-20T17:57:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3619d8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36140d39c0 con 0x7f361406d3d0 2024-05-20T17:57:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3613fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f36140b8190 0x7f36140b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3612ffd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f361406d3d0 0x7f361406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f36137fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f3614162820 0x7f36140b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:43946/0 (socket says 172.21.15.6:43946) 2024-05-20T17:57:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3613fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f36140b8190 0x7f36140b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:40136/0 (socket says 172.21.15.6:40136) 2024-05-20T17:57:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f36137fe640 1 -- 172.21.15.6:0/228841553 learned_addr learned my addr 172.21.15.6:0/228841553 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3613fff640 1 -- 172.21.15.6:0/228841553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f361406d3d0 msgr2=0x7f361406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3613fff640 1 --2- 172.21.15.6:0/228841553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f361406d3d0 0x7f361406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3613fff640 1 -- 172.21.15.6:0/228841553 >> v1:172.21.15.171:6789/0 conn(0x7f3614162820 legacy=0x7f36140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f3613fff640 1 -- 172.21.15.6:0/228841553 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36140d3ca0 con 0x7f36140b8190 2024-05-20T17:57:01.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.914+0000 7f36127fc640 1 -- 172.21.15.6:0/228841553 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278499267 0 0) 0x7f3604001110 con 0x7f3614162820 2024-05-20T17:57:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.915+0000 7f3613fff640 1 --2- 172.21.15.6:0/228841553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 0x7f36140b85a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f360c009d90 tx=0x7f360c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=819a6189768b9d15 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.915+0000 7f36127fc640 1 -- 172.21.15.6:0/228841553 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c007740 con 0x7f36140b8190 2024-05-20T17:57:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.915+0000 7f36127fc640 1 -- 172.21.15.6:0/228841553 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360c0078e0 con 0x7f36140b8190 2024-05-20T17:57:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.915+0000 7f36127fc640 1 -- 172.21.15.6:0/228841553 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c007cb0 con 0x7f36140b8190 2024-05-20T17:57:01.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.916+0000 7f3619d8f640 1 -- 172.21.15.6:0/228841553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 msgr2=0x7f36140b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.916+0000 7f3619d8f640 1 --2- 172.21.15.6:0/228841553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 0x7f36140b85a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f360c009d90 tx=0x7f360c02a660 comp rx=0 tx=0).stop 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.916+0000 7f3619d8f640 1 -- 172.21.15.6:0/228841553 shutdown_connections 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.916+0000 7f3619d8f640 1 --2- 172.21.15.6:0/228841553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 0x7f36140b85a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.916+0000 7f3619d8f640 1 --2- 172.21.15.6:0/228841553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f361406d3d0 0x7f361406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.916+0000 7f3619d8f640 1 -- 172.21.15.6:0/228841553 >> 172.21.15.6:0/228841553 conn(0x7f36140d4bd0 msgr2=0x7f36140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.916+0000 7f3619d8f640 1 -- 172.21.15.6:0/228841553 shutdown_connections 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.916+0000 7f3619d8f640 1 -- 172.21.15.6:0/228841553 wait complete. 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.918+0000 7f3619d8f640 1 Processor -- start 2024-05-20T17:57:01.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.918+0000 7f3619d8f640 1 -- start start 2024-05-20T17:57:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f3619d8f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f361406d3d0 0x7f3614159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f3619d8f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 0x7f36140b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f3619d8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3614162820 0x7f36140ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f3619d8f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36140d0300 con 0x7f361406d3d0 2024-05-20T17:57:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f3619d8f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36140d4260 con 0x7f36140b8190 2024-05-20T17:57:01.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f3619d8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36140b4050 con 0x7f3614162820 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f36137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f361406d3d0 0x7f3614159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f36137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f361406d3d0 0x7f3614159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46146/0 (socket says 172.21.15.6:46146) 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.919+0000 7f36137fe640 1 -- 172.21.15.6:0/1734527410 learned_addr learned my addr 172.21.15.6:0/1734527410 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f3613fff640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3614162820 0x7f36140ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f3612ffd640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 0x7f36140b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f36137fe640 1 -- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3614162820 msgr2=0x7f36140ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f36137fe640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3614162820 0x7f36140ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f36137fe640 1 -- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 msgr2=0x7f36140b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f36137fe640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 0x7f36140b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f36137fe640 1 -- 172.21.15.6:0/1734527410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3614159ab0 con 0x7f361406d3d0 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f3613fff640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3614162820 0x7f36140ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f3612ffd640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 0x7f36140b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f36137fe640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f361406d3d0 0x7f3614159570 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f360400c460 tx=0x7f360400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f35fbfff640 1 -- 172.21.15.6:0/1734527410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604018070 con 0x7f361406d3d0 2024-05-20T17:57:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f35fbfff640 1 -- 172.21.15.6:0/1734527410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3604007500 con 0x7f361406d3d0 2024-05-20T17:57:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f35fbfff640 1 -- 172.21.15.6:0/1734527410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604004a20 con 0x7f361406d3d0 2024-05-20T17:57:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.920+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36140b7530 con 0x7f361406d3d0 2024-05-20T17:57:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.921+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36140b6770 con 0x7f361406d3d0 2024-05-20T17:57:01.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.922+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3614075b00 con 0x7f361406d3d0 2024-05-20T17:57:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.922+0000 7f35fbfff640 1 -- 172.21.15.6:0/1734527410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f360401b070 con 0x7f361406d3d0 2024-05-20T17:57:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.923+0000 7f35fbfff640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f360006be60 0x7f360006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.923+0000 7f35fbfff640 1 -- 172.21.15.6:0/1734527410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f360408a250 con 0x7f361406d3d0 2024-05-20T17:57:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.923+0000 7f3612ffd640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f360006be60 0x7f360006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.923+0000 7f3612ffd640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f360006be60 0x7f360006e370 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f36140b5f80 tx=0x7f3608008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:01.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:01.927+0000 7f35fbfff640 1 -- 172.21.15.6:0/1734527410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f361406dd20 con 0x7f361406d3d0 2024-05-20T17:57:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.112+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f361406e260 con 0x7f361406d3d0 2024-05-20T17:57:02.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.113+0000 7f35fbfff640 1 -- 172.21.15.6:0/1734527410 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f3604058a70 con 0x7f361406d3d0 2024-05-20T17:57:02.112 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:57:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f360006be60 msgr2=0x7f360006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f360006be60 0x7f360006e370 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f36140b5f80 tx=0x7f3608008040 comp rx=0 tx=0).stop 2024-05-20T17:57:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f361406d3d0 msgr2=0x7f3614159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f361406d3d0 0x7f3614159570 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f360400c460 tx=0x7f360400c920 comp rx=0 tx=0).stop 2024-05-20T17:57:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 shutdown_connections 2024-05-20T17:57:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f360006be60 0x7f360006e370 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3614162820 0x7f36140ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36140b8190 0x7f36140b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 --2- 172.21.15.6:0/1734527410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f361406d3d0 0x7f3614159570 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 >> 172.21.15.6:0/1734527410 conn(0x7f36140d4bd0 msgr2=0x7f361415d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 shutdown_connections 2024-05-20T17:57:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.115+0000 7f3619d8f640 1 -- 172.21.15.6:0/1734527410 wait complete. 2024-05-20T17:57:02.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:57:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.243+0000 7f1ebda73640 1 Processor -- start 2024-05-20T17:57:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.243+0000 7f1ebda73640 1 -- start start 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.244+0000 7f1ebda73640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1eb80cd710 0x7f1eb8162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.244+0000 7f1ebda73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.244+0000 7f1ebda73640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1eb80cf3d0 0x7f1eb80cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.244+0000 7f1ebda73640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1eb80d0ba0 con 0x7f1eb80cd710 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.244+0000 7f1ebda73640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1eb80cfd20 con 0x7f1eb80cf3d0 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.244+0000 7f1ebda73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb806c8c0 con 0x7f1eb806d6b0 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1eb80cd710 0x7f1eb8162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1eb80cd710 0x7f1eb8162e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46162/0 (socket says 172.21.15.6:46162) 2024-05-20T17:57:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb77fe640 1 -- 172.21.15.6:0/993658700 learned_addr learned my addr 172.21.15.6:0/993658700 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb6ffd640 1 --2- 172.21.15.6:0/993658700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb7fff640 1 --2- 172.21.15.6:0/993658700 >> v2:172.21.15.171:3300/0 conn(0x7f1eb80cf3d0 0x7f1eb80cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb77fe640 1 -- 172.21.15.6:0/993658700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 msgr2=0x7f1eb815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb77fe640 1 --2- 172.21.15.6:0/993658700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb77fe640 1 -- 172.21.15.6:0/993658700 >> v2:172.21.15.171:3300/0 conn(0x7f1eb80cf3d0 msgr2=0x7f1eb80cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb77fe640 1 --2- 172.21.15.6:0/993658700 >> v2:172.21.15.171:3300/0 conn(0x7f1eb80cf3d0 0x7f1eb80cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb77fe640 1 -- 172.21.15.6:0/993658700 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb806dac0 con 0x7f1eb80cd710 2024-05-20T17:57:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.245+0000 7f1eb7fff640 1 --2- 172.21.15.6:0/993658700 >> v2:172.21.15.171:3300/0 conn(0x7f1eb80cf3d0 0x7f1eb80cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.246+0000 7f1eb77fe640 1 --2- 172.21.15.6:0/993658700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb8162e00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f1eb806dc90 tx=0x7f1ea802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ae7583a29305f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.246+0000 7f1eb67fc640 1 -- 172.21.15.6:0/993658700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8037070 con 0x7f1eb80cd710 2024-05-20T17:57:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.246+0000 7f1eb67fc640 1 -- 172.21.15.6:0/993658700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea8032440 con 0x7f1eb80cd710 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.246+0000 7f1eb67fc640 1 -- 172.21.15.6:0/993658700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8032810 con 0x7f1eb80cd710 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 -- 172.21.15.6:0/993658700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 msgr2=0x7f1eb8162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 --2- 172.21.15.6:0/993658700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb8162e00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f1eb806dc90 tx=0x7f1ea802a1c0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 -- 172.21.15.6:0/993658700 shutdown_connections 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 --2- 172.21.15.6:0/993658700 >> v2:172.21.15.171:3300/0 conn(0x7f1eb80cf3d0 0x7f1eb80cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 --2- 172.21.15.6:0/993658700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 --2- 172.21.15.6:0/993658700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb8162e00 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 -- 172.21.15.6:0/993658700 >> 172.21.15.6:0/993658700 conn(0x7f1eb80b44d0 msgr2=0x7f1eb80b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 -- 172.21.15.6:0/993658700 shutdown_connections 2024-05-20T17:57:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.247+0000 7f1ebda73640 1 -- 172.21.15.6:0/993658700 wait complete. 2024-05-20T17:57:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.249+0000 7f1ebda73640 1 Processor -- start 2024-05-20T17:57:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.249+0000 7f1ebda73640 1 -- start start 2024-05-20T17:57:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1ebda73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb8159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1ebda73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb81f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1ebda73640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb80cf3d0 0x7f1eb80c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1ebda73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb81639a0 con 0x7f1eb80cd710 2024-05-20T17:57:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1ebda73640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb81636c0 con 0x7f1eb80cf3d0 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1ebda73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb8163c80 con 0x7f1eb806d6b0 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1eb6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb81f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1eb6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb81f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46174/0 (socket says 172.21.15.6:46174) 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1eb6ffd640 1 -- 172.21.15.6:0/3504190661 learned_addr learned my addr 172.21.15.6:0/3504190661 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1eb77fe640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb8159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.250+0000 7f1eb7fff640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb80cf3d0 0x7f1eb80c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1eb6ffd640 1 -- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 msgr2=0x7f1eb8159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1eb6ffd640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb8159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1eb6ffd640 1 -- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb80cf3d0 msgr2=0x7f1eb80c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1eb6ffd640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb80cf3d0 0x7f1eb80c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1eb6ffd640 1 -- 172.21.15.6:0/3504190661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb8157ec0 con 0x7f1eb80cd710 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1eb77fe640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb8159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1eb7fff640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb80cf3d0 0x7f1eb80c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1eb6ffd640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb81f5430 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00e870 tx=0x7f1eac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1e9ffff640 1 -- 172.21.15.6:0/3504190661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac017070 con 0x7f1eb80cd710 2024-05-20T17:57:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1e9ffff640 1 -- 172.21.15.6:0/3504190661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eac00ee60 con 0x7f1eb80cd710 2024-05-20T17:57:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb81581a0 con 0x7f1eb80cd710 2024-05-20T17:57:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1e9ffff640 1 -- 172.21.15.6:0/3504190661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac00cb80 con 0x7f1eb80cd710 2024-05-20T17:57:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.251+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb8158760 con 0x7f1eb80cd710 2024-05-20T17:57:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.252+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb8075b00 con 0x7f1eb80cd710 2024-05-20T17:57:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.253+0000 7f1e9ffff640 1 -- 172.21.15.6:0/3504190661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1eac01a070 con 0x7f1eb80cd710 2024-05-20T17:57:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.253+0000 7f1e9ffff640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ea406be30 0x7f1ea406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.253+0000 7f1e9ffff640 1 -- 172.21.15.6:0/3504190661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f1eac08b200 con 0x7f1eb80cd710 2024-05-20T17:57:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.253+0000 7f1eb77fe640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ea406be30 0x7f1ea406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.254+0000 7f1eb77fe640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ea406be30 0x7f1ea406e340 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8034000 tx=0x7f1ea802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.258+0000 7f1e9ffff640 1 -- 172.21.15.6:0/3504190661 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1eac059a20 con 0x7f1eb80cd710 2024-05-20T17:57:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.455+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1eb80b8940 con 0x7f1eb80cd710 2024-05-20T17:57:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.455+0000 7f1e9ffff640 1 -- 172.21.15.6:0/3504190661 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7f1eac059320 con 0x7f1eb80cd710 2024-05-20T17:57:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:57:02.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ea406be30 msgr2=0x7f1ea406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ea406be30 0x7f1ea406e340 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8034000 tx=0x7f1ea802e000 comp rx=0 tx=0).stop 2024-05-20T17:57:02.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 msgr2=0x7f1eb81f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb81f5430 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00e870 tx=0x7f1eac00ed30 comp rx=0 tx=0).stop 2024-05-20T17:57:02.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 shutdown_connections 2024-05-20T17:57:02.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ea406be30 0x7f1ea406e340 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb80cf3d0 0x7f1eb80c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1eb80cd710 0x7f1eb81f5430 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 --2- 172.21.15.6:0/3504190661 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1eb806d6b0 0x7f1eb8159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 >> 172.21.15.6:0/3504190661 conn(0x7f1eb80b44d0 msgr2=0x7f1eb81618c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:02.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 shutdown_connections 2024-05-20T17:57:02.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.457+0000 7f1ebda73640 1 -- 172.21.15.6:0/3504190661 wait complete. 2024-05-20T17:57:02.467 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T17:57:02.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:02.467 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T17:57:02.502 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:57:02.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:02.502 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T17:57:02.560 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:57:02.560 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:57:02.560 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:02.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:57:02.577 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:57:02.577 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:57:02.577 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:02.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:57:02.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:57:02.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.734+0000 7ff5e85aa640 1 Processor -- start 2024-05-20T17:57:02.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.734+0000 7ff5e85aa640 1 -- start start 2024-05-20T17:57:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.735+0000 7ff5e85aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.735+0000 7ff5e85aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5e00b3e80 0x7ff5e006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.735+0000 7ff5e85aa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff5e006d910 0x7ff5e00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e85aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e006dd20 con 0x7ff5e00b3e80 2024-05-20T17:57:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e85aa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e00d0630 con 0x7ff5e006d910 2024-05-20T17:57:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e85aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e00d39c0 con 0x7ff5e0162820 2024-05-20T17:57:02.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e5b45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5e00b3e80 0x7ff5e006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e5b45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5e00b3e80 0x7ff5e006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46190/0 (socket says 172.21.15.6:46190) 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e5b45640 1 -- 172.21.15.6:0/3031927499 learned_addr learned my addr 172.21.15.6:0/3031927499 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e6346640 1 --2- 172.21.15.6:0/3031927499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e6b47640 1 --2- 172.21.15.6:0/3031927499 >> v2:172.21.15.171:3300/0 conn(0x7ff5e006d910 0x7ff5e00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e5b45640 1 -- 172.21.15.6:0/3031927499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 msgr2=0x7ff5e00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e5b45640 1 --2- 172.21.15.6:0/3031927499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e5b45640 1 -- 172.21.15.6:0/3031927499 >> v2:172.21.15.171:3300/0 conn(0x7ff5e006d910 msgr2=0x7ff5e00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e5b45640 1 --2- 172.21.15.6:0/3031927499 >> v2:172.21.15.171:3300/0 conn(0x7ff5e006d910 0x7ff5e00d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.736+0000 7ff5e5b45640 1 -- 172.21.15.6:0/3031927499 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e00d3ca0 con 0x7ff5e00b3e80 2024-05-20T17:57:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.737+0000 7ff5e5b45640 1 --2- 172.21.15.6:0/3031927499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e00b3e80 0x7ff5e006d3d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff5e006ce40 tx=0x7ff5d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3def32edce3545a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.737+0000 7ff5e5344640 1 -- 172.21.15.6:0/3031927499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0037070 con 0x7ff5e00b3e80 2024-05-20T17:57:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.737+0000 7ff5e5344640 1 -- 172.21.15.6:0/3031927499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d0032440 con 0x7ff5e00b3e80 2024-05-20T17:57:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.737+0000 7ff5e5344640 1 -- 172.21.15.6:0/3031927499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0032810 con 0x7ff5e00b3e80 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3031927499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e00b3e80 msgr2=0x7ff5e006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3031927499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e00b3e80 0x7ff5e006d3d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff5e006ce40 tx=0x7ff5d002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3031927499 shutdown_connections 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3031927499 >> v2:172.21.15.171:3300/0 conn(0x7ff5e006d910 0x7ff5e00d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3031927499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e00b3e80 0x7ff5e006d3d0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3031927499 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3031927499 >> 172.21.15.6:0/3031927499 conn(0x7ff5e00d4bd0 msgr2=0x7ff5e00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3031927499 shutdown_connections 2024-05-20T17:57:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.738+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3031927499 wait complete. 2024-05-20T17:57:02.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.739+0000 7ff5e85aa640 1 Processor -- start 2024-05-20T17:57:02.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.740+0000 7ff5e85aa640 1 -- start start 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e85aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e006d910 0x7ff5e01567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e85aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5e00b3e80 0x7ff5e01f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e85aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e01f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e85aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00d0300 con 0x7ff5e006d910 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e85aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00d4260 con 0x7ff5e00b3e80 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e85aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e00d4780 con 0x7ff5e0162820 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e006d910 0x7ff5e01567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e006d910 0x7ff5e01567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46202/0 (socket says 172.21.15.6:46202) 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 -- 172.21.15.6:0/3617884808 learned_addr learned my addr 172.21.15.6:0/3617884808 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e5b45640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5e00b3e80 0x7ff5e01f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6b47640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e01f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 -- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 msgr2=0x7ff5e01f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e01f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 -- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5e00b3e80 msgr2=0x7ff5e01f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5e00b3e80 0x7ff5e01f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 -- 172.21.15.6:0/3617884808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e01570b0 con 0x7ff5e006d910 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6b47640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e01f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e5b45640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5e00b3e80 0x7ff5e01f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.741+0000 7ff5e6346640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e006d910 0x7ff5e01567b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00d5f0 tx=0x7ff5dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.742+0000 7ff5d6ffd640 1 -- 172.21.15.6:0/3617884808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0125f0 con 0x7ff5e006d910 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.742+0000 7ff5d6ffd640 1 -- 172.21.15.6:0/3617884808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5dc019070 con 0x7ff5e006d910 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.742+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e0157390 con 0x7ff5e006d910 2024-05-20T17:57:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.742+0000 7ff5d6ffd640 1 -- 172.21.15.6:0/3617884808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0129d0 con 0x7ff5e006d910 2024-05-20T17:57:02.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.742+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e01f5570 con 0x7ff5e006d910 2024-05-20T17:57:02.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.743+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e0075b00 con 0x7ff5e006d910 2024-05-20T17:57:02.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.743+0000 7ff5d6ffd640 1 -- 172.21.15.6:0/3617884808 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5dc012b70 con 0x7ff5e006d910 2024-05-20T17:57:02.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.744+0000 7ff5d6ffd640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5c406be60 0x7ff5c406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:02.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.744+0000 7ff5d6ffd640 1 -- 172.21.15.6:0/3617884808 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7ff5dc08b460 con 0x7ff5e006d910 2024-05-20T17:57:02.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.744+0000 7ff5e5b45640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5c406be60 0x7ff5c406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:02.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.745+0000 7ff5e5b45640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5c406be60 0x7ff5c406e370 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0034000 tx=0x7ff5d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:02.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.748+0000 7ff5d6ffd640 1 -- 172.21.15.6:0/3617884808 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff5dc059bf0 con 0x7ff5e006d910 2024-05-20T17:57:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.969+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5e00cf300 con 0x7ff5e006d910 2024-05-20T17:57:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.969+0000 7ff5d6ffd640 1 -- 172.21.15.6:0/3617884808 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7ff5dc0594f0 con 0x7ff5e006d910 2024-05-20T17:57:02.968 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:02.968 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:40.286706+0000","modified":"2024-05-20T17:56:43.311702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/693481794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":693481794},{"type":"v1","addr":"172.21.15.6:6835","nonce":693481794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6681,"qdb_cluster":[6681]},"id":5}]} 2024-05-20T17:57:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 44 2024-05-20T17:57:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5c406be60 msgr2=0x7ff5c406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5c406be60 0x7ff5c406e370 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0034000 tx=0x7ff5d002e000 comp rx=0 tx=0).stop 2024-05-20T17:57:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e006d910 msgr2=0x7ff5e01567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e006d910 0x7ff5e01567b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00d5f0 tx=0x7ff5dc00dab0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 shutdown_connections 2024-05-20T17:57:02.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff5c406be60 0x7ff5c406e370 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5e0162820 0x7ff5e01f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5e00b3e80 0x7ff5e01f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 --2- 172.21.15.6:0/3617884808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5e006d910 0x7ff5e01567b0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 >> 172.21.15.6:0/3617884808 conn(0x7ff5e00d4bd0 msgr2=0x7ff5e015f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 shutdown_connections 2024-05-20T17:57:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:02.971+0000 7ff5e85aa640 1 -- 172.21.15.6:0/3617884808 wait complete. 2024-05-20T17:57:02.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.097+0000 7f21a3dd5640 1 Processor -- start 2024-05-20T17:57:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.098+0000 7f21a3dd5640 1 -- start start 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a3dd5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f219c162820 0x7f219c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a3dd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c06dae0 0x7f219c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a3dd5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f219c0d0630 con 0x7f219c0b3e80 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a3dd5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f219c0d39c0 con 0x7f219c162820 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a3dd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f219c0d3ca0 con 0x7f219c06dae0 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a1370640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f219c0b3e80 0x7f219c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46968/0 (socket says 172.21.15.6:46968) 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a1370640 1 -- 172.21.15.6:0/2413261572 learned_addr learned my addr 172.21.15.6:0/2413261572 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2413261572 >> v2:172.21.15.171:3300/0 conn(0x7f219c162820 0x7f219c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749175819 0 0) 0x7f219c0d0630 con 0x7f219c0b3e80 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a2372640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c06dae0 0x7f219c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.099+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2184003520 con 0x7f219c0b3e80 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 860828409 0 0) 0x7f2184003520 con 0x7f219c0b3e80 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c06dae0 msgr2=0x7f219c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c06dae0 0x7f219c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 >> v2:172.21.15.171:3300/0 conn(0x7f219c162820 msgr2=0x7f219c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 --2- 172.21.15.6:0/2413261572 >> v2:172.21.15.171:3300/0 conn(0x7f219c162820 0x7f219c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c0d3f80 con 0x7f219c0b3e80 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f2190001670 con 0x7f219c0b3e80 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 >> v1:172.21.15.6:6789/0 conn(0x7f219c0b3e80 legacy=0x7f219c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21840039b0 0x7f2184003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2184004800 0x7f2184004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2184005150 0x7f218400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f219c0d39c0 con 0x7f21840039b0 2024-05-20T17:57:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f219c0d3ca0 con 0x7f2184004800 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f218400bf00 con 0x7f2184005150 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21840039b0 0x7f2184003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a2372640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2184005150 0x7f218400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a1370640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2184004800 0x7f2184004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a1b71640 1 -- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2184005150 msgr2=0x7f218400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2184005150 0x7f218400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a1b71640 1 -- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2184004800 msgr2=0x7f2184004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2184004800 0x7f2184004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a1b71640 1 -- 172.21.15.6:0/2413261572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2184003520 con 0x7f21840039b0 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.100+0000 7f21a1370640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2184004800 0x7f2184004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.101+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21840039b0 0x7f2184003e20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f218c009fc0 tx=0x7f2184005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b08c7e24ed30c5b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.101+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c009c10 con 0x7f21840039b0 2024-05-20T17:57:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.101+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f218c036070 con 0x7f21840039b0 2024-05-20T17:57:03.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.101+0000 7f21a0b6f640 1 -- 172.21.15.6:0/2413261572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c02d070 con 0x7f21840039b0 2024-05-20T17:57:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.102+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2413261572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21840039b0 msgr2=0x7f2184003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.102+0000 7f21a3dd5640 1 --2- 172.21.15.6:0/2413261572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21840039b0 0x7f2184003e20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f218c009fc0 tx=0x7f2184005830 comp rx=0 tx=0).stop 2024-05-20T17:57:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.102+0000 7f21a2372640 1 -- 172.21.15.6:0/2413261572 reap_dead start 2024-05-20T17:57:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.102+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2413261572 shutdown_connections 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.102+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2413261572 >> 172.21.15.6:0/2413261572 conn(0x7f219c0d4bd0 msgr2=0x7f219c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.102+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2413261572 shutdown_connections 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.102+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2413261572 wait complete. 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.104+0000 7f21a3dd5640 1 Processor -- start 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.104+0000 7f21a3dd5640 1 -- start start 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a3dd5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f219c0b5b10 0x7f219c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a3dd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c1f87d0 0x7f219c1f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a3dd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f219c1f9120 0x7f219c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a3dd5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f219c0d4780 con 0x7f219c1f9120 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a3dd5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f219c0d0300 con 0x7f219c0b5b10 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a3dd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f219c0d4900 con 0x7f219c1f87d0 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a2372640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f219c1f9120 0x7f219c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a2372640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f219c1f9120 0x7f219c157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46220/0 (socket says 172.21.15.6:46220) 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.105+0000 7f21a2372640 1 -- 172.21.15.6:0/2926408441 learned_addr learned my addr 172.21.15.6:0/2926408441 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a1370640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c1f87d0 0x7f219c1f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f219c0b5b10 0x7f219c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a2372640 1 -- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c1f87d0 msgr2=0x7f219c1f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a2372640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c1f87d0 0x7f219c1f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a2372640 1 -- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f219c0b5b10 msgr2=0x7f219c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a2372640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f219c0b5b10 0x7f219c0ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a2372640 1 -- 172.21.15.6:0/2926408441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c0b60f0 con 0x7f219c1f9120 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a1370640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c1f87d0 0x7f219c1f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f219c0b5b10 0x7f219c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a2372640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f219c1f9120 0x7f219c157be0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f219c08e090 tx=0x7f2194011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f219a7fc640 1 -- 172.21.15.6:0/2926408441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194019020 con 0x7f219c1f9120 2024-05-20T17:57:03.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f219a7fc640 1 -- 172.21.15.6:0/2926408441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2194004240 con 0x7f219c1f9120 2024-05-20T17:57:03.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c0b63d0 con 0x7f219c1f9120 2024-05-20T17:57:03.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f219a7fc640 1 -- 172.21.15.6:0/2926408441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219400f770 con 0x7f219c1f9120 2024-05-20T17:57:03.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.106+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c0b6990 con 0x7f219c1f9120 2024-05-20T17:57:03.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.107+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c075b00 con 0x7f219c1f9120 2024-05-20T17:57:03.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.108+0000 7f219a7fc640 1 -- 172.21.15.6:0/2926408441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f219401c020 con 0x7f219c1f9120 2024-05-20T17:57:03.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.108+0000 7f219a7fc640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f218806be60 0x7f218806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.108+0000 7f219a7fc640 1 -- 172.21.15.6:0/2926408441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f219408b2f0 con 0x7f219c1f9120 2024-05-20T17:57:03.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.108+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f218806be60 0x7f218806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.109+0000 7f21a1b71640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f218806be60 0x7f218806e370 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f218c035000 tx=0x7f218c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.113+0000 7f219a7fc640 1 -- 172.21.15.6:0/2926408441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2194023020 con 0x7f219c1f9120 2024-05-20T17:57:03.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.296+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f219c1e8cf0 con 0x7f219c1f9120 2024-05-20T17:57:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.297+0000 7f219a7fc640 1 -- 172.21.15.6:0/2926408441 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16897 (secure 0 0 0) 0x7f2194059ba0 con 0x7f219c1f9120 2024-05-20T17:57:03.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:03.296 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:41.911814+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:38.652078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:39.261578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f218806be60 msgr2=0x7f218806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f218806be60 0x7f218806e370 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f218c035000 tx=0x7f218c02f000 comp rx=0 tx=0).stop 2024-05-20T17:57:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f219c1f9120 msgr2=0x7f219c157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f219c1f9120 0x7f219c157be0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f219c08e090 tx=0x7f2194011cf0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 shutdown_connections 2024-05-20T17:57:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f218806be60 0x7f218806e370 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f219c1f9120 0x7f219c157be0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f219c1f87d0 0x7f219c1f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 --2- 172.21.15.6:0/2926408441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f219c0b5b10 0x7f219c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 >> 172.21.15.6:0/2926408441 conn(0x7f219c0d4bd0 msgr2=0x7f219c06da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 shutdown_connections 2024-05-20T17:57:03.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.299+0000 7f21a3dd5640 1 -- 172.21.15.6:0/2926408441 wait complete. 2024-05-20T17:57:03.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:56:38.652078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:56:39.261578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:57:03.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:57:03.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.429+0000 7efdba921640 1 Processor -- start 2024-05-20T17:57:03.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.429+0000 7efdba921640 1 -- start start 2024-05-20T17:57:03.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.430+0000 7efdba921640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb406cf00 0x7efdb406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.430+0000 7efdba921640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb40d2780 0x7efdb40d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.430+0000 7efdba921640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb408d2a0 con 0x7efdb40d4400 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.430+0000 7efdba921640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7efdb40d3f70 con 0x7efdb40d2780 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.430+0000 7efdba921640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efdb406d850 con 0x7efdb406cf00 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.430+0000 7efdb8ebe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb40d2780 0x7efdb40d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.430+0000 7efdb8ebe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb40d2780 0x7efdb40d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46232/0 (socket says 172.21.15.6:46232) 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.430+0000 7efdb8ebe640 1 -- 172.21.15.6:0/1118019479 learned_addr learned my addr 172.21.15.6:0/1118019479 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.431+0000 7efdabfff640 1 --2- 172.21.15.6:0/1118019479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb406cf00 0x7efdb406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.431+0000 7efdb8ebe640 1 -- 172.21.15.6:0/1118019479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb406cf00 msgr2=0x7efdb406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.431+0000 7efdb8ebe640 1 --2- 172.21.15.6:0/1118019479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb406cf00 0x7efdb406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.431+0000 7efdb8ebe640 1 -- 172.21.15.6:0/1118019479 >> v1:172.21.15.171:6789/0 conn(0x7efdb40d4400 legacy=0x7efdb415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.431+0000 7efdb8ebe640 1 -- 172.21.15.6:0/1118019479 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb40d30d0 con 0x7efdb40d2780 2024-05-20T17:57:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.431+0000 7efdb8ebe640 1 --2- 172.21.15.6:0/1118019479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb40d2b90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7efdac009e50 tx=0x7efdac02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5116c3b016ee519 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdb37fe640 1 -- 172.21.15.6:0/1118019479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac036070 con 0x7efdb40d2780 2024-05-20T17:57:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdb37fe640 1 -- 172.21.15.6:0/1118019479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac031600 con 0x7efdb40d2780 2024-05-20T17:57:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdb37fe640 1 -- 172.21.15.6:0/1118019479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac0319d0 con 0x7efdb40d2780 2024-05-20T17:57:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdba921640 1 -- 172.21.15.6:0/1118019479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 msgr2=0x7efdb40d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdba921640 1 --2- 172.21.15.6:0/1118019479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb40d2b90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7efdac009e50 tx=0x7efdac02a7a0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdba921640 1 -- 172.21.15.6:0/1118019479 shutdown_connections 2024-05-20T17:57:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdba921640 1 --2- 172.21.15.6:0/1118019479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb40d2b90 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdba921640 1 --2- 172.21.15.6:0/1118019479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb406cf00 0x7efdb406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.432+0000 7efdba921640 1 -- 172.21.15.6:0/1118019479 >> 172.21.15.6:0/1118019479 conn(0x7efdb40d4bb0 msgr2=0x7efdb40d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.433+0000 7efdba921640 1 -- 172.21.15.6:0/1118019479 shutdown_connections 2024-05-20T17:57:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.433+0000 7efdba921640 1 -- 172.21.15.6:0/1118019479 wait complete. 2024-05-20T17:57:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.434+0000 7efdba921640 1 Processor -- start 2024-05-20T17:57:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.434+0000 7efdba921640 1 -- start start 2024-05-20T17:57:03.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdba921640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdb406cf00 0x7efdb4151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdba921640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb4146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdba921640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb40d4400 0x7efdb4159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdba921640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efdb40d3640 con 0x7efdb40d2780 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdba921640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efdb40d3360 con 0x7efdb406cf00 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdba921640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efdb40d3920 con 0x7efdb40d4400 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb4146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb4146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46240/0 (socket says 172.21.15.6:46240) 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 -- 172.21.15.6:0/1920951755 learned_addr learned my addr 172.21.15.6:0/1920951755 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdb8ebe640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb40d4400 0x7efdb4159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdb3fff640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdb406cf00 0x7efdb4151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 -- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb40d4400 msgr2=0x7efdb4159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb40d4400 0x7efdb4159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 -- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdb406cf00 msgr2=0x7efdb4151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdb406cf00 0x7efdb4151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 -- 172.21.15.6:0/1920951755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb415b500 con 0x7efdb40d2780 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdb3fff640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdb406cf00 0x7efdb4151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdabfff640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb4146c90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00e8a0 tx=0x7efd9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdb17fa640 1 -- 172.21.15.6:0/1920951755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c017070 con 0x7efdb40d2780 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.436+0000 7efdb17fa640 1 -- 172.21.15.6:0/1920951755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9c00c940 con 0x7efdb40d2780 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.437+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb4159610 con 0x7efdb40d2780 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.437+0000 7efdb17fa640 1 -- 172.21.15.6:0/1920951755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00cd30 con 0x7efdb40d2780 2024-05-20T17:57:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.437+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb4151f40 con 0x7efdb40d2780 2024-05-20T17:57:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.438+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb40735a0 con 0x7efdb40d2780 2024-05-20T17:57:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.438+0000 7efdb17fa640 1 -- 172.21.15.6:0/1920951755 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd9c01a070 con 0x7efdb40d2780 2024-05-20T17:57:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.439+0000 7efdb17fa640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd9406be30 0x7efd9406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.439+0000 7efdb17fa640 1 -- 172.21.15.6:0/1920951755 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7efd9c08b1e0 con 0x7efdb40d2780 2024-05-20T17:57:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.439+0000 7efdb3fff640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd9406be30 0x7efd9406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.440+0000 7efdb3fff640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd9406be30 0x7efd9406e340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efda4001660 tx=0x7efda4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.443+0000 7efdb17fa640 1 -- 172.21.15.6:0/1920951755 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efdb40735a0 con 0x7efdb40d2780 2024-05-20T17:57:03.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.627+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efdb415be70 con 0x7efdb40d2780 2024-05-20T17:57:03.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.628+0000 7efdb17fa640 1 -- 172.21.15.6:0/1920951755 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7efd9c059320 con 0x7efdb40d2780 2024-05-20T17:57:03.627 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd9406be30 msgr2=0x7efd9406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd9406be30 0x7efd9406e340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7efda4001660 tx=0x7efda4009040 comp rx=0 tx=0).stop 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 msgr2=0x7efdb4146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb4146c90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00e8a0 tx=0x7efd9c00ed60 comp rx=0 tx=0).stop 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 shutdown_connections 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd9406be30 0x7efd9406e340 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efdb40d4400 0x7efdb4159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb40d2780 0x7efdb4146c90 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 --2- 172.21.15.6:0/1920951755 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdb406cf00 0x7efdb4151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 >> 172.21.15.6:0/1920951755 conn(0x7efdb40d4bb0 msgr2=0x7efdb41623d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 shutdown_connections 2024-05-20T17:57:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.630+0000 7efdba921640 1 -- 172.21.15.6:0/1920951755 wait complete. 2024-05-20T17:57:03.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:57:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.758+0000 7faacf977640 1 Processor -- start 2024-05-20T17:57:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.759+0000 7faacf977640 1 -- start start 2024-05-20T17:57:03.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faacf977640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac806d3d0 0x7faac806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faacf977640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac806dd20 con 0x7faac8162820 2024-05-20T17:57:03.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faacf977640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac80d0630 con 0x7faac80b8190 2024-05-20T17:57:03.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faacf977640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faac80d39c0 con 0x7faac806d3d0 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faacd713640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faac8162820 0x7faac80b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46978/0 (socket says 172.21.15.6:46978) 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faacd713640 1 -- 172.21.15.6:0/1706551561 learned_addr learned my addr 172.21.15.6:0/1706551561 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faaccf12640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac806d3d0 0x7faac806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066188409 0 0) 0x7faac4001110 con 0x7faac8162820 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.760+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faab4003520 con 0x7faac8162820 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2457235451 0 0) 0x7faab4003520 con 0x7faac8162820 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac806d3d0 msgr2=0x7faac806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac806d3d0 0x7faac806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 >> v1:172.21.15.171:6789/0 conn(0x7faac80b8190 legacy=0x7faac80b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac80d3ca0 con 0x7faac8162820 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7faac4001840 con 0x7faac8162820 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 >> v1:172.21.15.6:6789/0 conn(0x7faac8162820 legacy=0x7faac80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab40039e0 0x7faab4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faab4004800 0x7faab4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faab4005150 0x7faab400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faac80d39c0 con 0x7faab4004800 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faab400c110 con 0x7faab4005150 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faab400c310 con 0x7faab40039e0 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faaccf12640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faac806d3d0 0x7faac806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faacd713640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab40039e0 0x7faab4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faaccf12640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faab4004800 0x7faab4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faacdf14640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faab4005150 0x7faab400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faaccf12640 1 -- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab40039e0 msgr2=0x7faab4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faaccf12640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab40039e0 0x7faab4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faaccf12640 1 -- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faab4005150 msgr2=0x7faab400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faaccf12640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faab4005150 0x7faab400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.761+0000 7faaccf12640 1 -- 172.21.15.6:0/1706551561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab4003520 con 0x7faab4004800 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.762+0000 7faaccf12640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faab4004800 0x7faab4004c10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7faac804f770 tx=0x7faab4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a328edbd1b8f0a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.762+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8036070 con 0x7faab4004800 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.762+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8004030 con 0x7faab4004800 2024-05-20T17:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.762+0000 7faabffff640 1 -- 172.21.15.6:0/1706551561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80097d0 con 0x7faab4004800 2024-05-20T17:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.763+0000 7faacf977640 1 -- 172.21.15.6:0/1706551561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faab4004800 msgr2=0x7faab4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.763+0000 7faacf977640 1 --2- 172.21.15.6:0/1706551561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faab4004800 0x7faab4004c10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7faac804f770 tx=0x7faab4005830 comp rx=0 tx=0).stop 2024-05-20T17:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.763+0000 7faacdf14640 1 -- 172.21.15.6:0/1706551561 reap_dead start 2024-05-20T17:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.763+0000 7faacf977640 1 -- 172.21.15.6:0/1706551561 shutdown_connections 2024-05-20T17:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.763+0000 7faacf977640 1 -- 172.21.15.6:0/1706551561 >> 172.21.15.6:0/1706551561 conn(0x7faac80d4bd0 msgr2=0x7faac80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.763+0000 7faacf977640 1 -- 172.21.15.6:0/1706551561 shutdown_connections 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.763+0000 7faacf977640 1 -- 172.21.15.6:0/1706551561 wait complete. 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.765+0000 7faacf977640 1 Processor -- start 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.765+0000 7faacf977640 1 -- start start 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.766+0000 7faacf977640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab4004800 0x7faac8156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.766+0000 7faacf977640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faac815c890 0x7faac815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.766+0000 7faacf977640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac8158170 0x7faac8158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.766+0000 7faacf977640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faac80d0300 con 0x7faac815c890 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.766+0000 7faacf977640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faac80d4260 con 0x7faac8158170 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.766+0000 7faacf977640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faac80b4050 con 0x7faab4004800 2024-05-20T17:57:03.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faac815c890 0x7faac815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faac815c890 0x7faac815cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46250/0 (socket says 172.21.15.6:46250) 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 -- 172.21.15.6:0/1150597435 learned_addr learned my addr 172.21.15.6:0/1150597435 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faacd713640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab4004800 0x7faac8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faacdf14640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac8158170 0x7faac8158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 -- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab4004800 msgr2=0x7faac8156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab4004800 0x7faac8156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 -- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac8158170 msgr2=0x7faac8158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac8158170 0x7faac8158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 -- 172.21.15.6:0/1150597435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac815d1e0 con 0x7faac815c890 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faacd713640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab4004800 0x7faac8156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faacdf14640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac8158170 0x7faac8158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:03.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faaccf12640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faac815c890 0x7faac815cca0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7faab8009bf0 tx=0x7faab8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faabdffb640 1 -- 172.21.15.6:0/1150597435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8040020 con 0x7faac815c890 2024-05-20T17:57:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faabdffb640 1 -- 172.21.15.6:0/1150597435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8003c40 con 0x7faac815c890 2024-05-20T17:57:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faabdffb640 1 -- 172.21.15.6:0/1150597435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8036040 con 0x7faac815c890 2024-05-20T17:57:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.767+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac80ca030 con 0x7faac815c890 2024-05-20T17:57:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.768+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac80c9790 con 0x7faac815c890 2024-05-20T17:57:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.768+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac8075b00 con 0x7faac815c890 2024-05-20T17:57:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.769+0000 7faabdffb640 1 -- 172.21.15.6:0/1150597435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faab8043020 con 0x7faac815c890 2024-05-20T17:57:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.770+0000 7faabdffb640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faaac06be30 0x7faaac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.770+0000 7faabdffb640 1 -- 172.21.15.6:0/1150597435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7faab80ab1e0 con 0x7faac815c890 2024-05-20T17:57:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.770+0000 7faacd713640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faaac06be30 0x7faaac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:03.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.771+0000 7faacd713640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faaac06be30 0x7faaac06e340 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faac4001640 tx=0x7faac4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:03.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.775+0000 7faabdffb640 1 -- 172.21.15.6:0/1150597435 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faab804a070 con 0x7faac815c890 2024-05-20T17:57:03.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.959+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faac80b7140 con 0x7faac815c890 2024-05-20T17:57:03.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.959+0000 7faabdffb640 1 -- 172.21.15.6:0/1150597435 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7faac815d1e0 con 0x7faac815c890 2024-05-20T17:57:03.958 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:57:03.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faaac06be30 msgr2=0x7faaac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faaac06be30 0x7faaac06e340 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faac4001640 tx=0x7faac4009040 comp rx=0 tx=0).stop 2024-05-20T17:57:03.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faac815c890 msgr2=0x7faac815cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:03.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faac815c890 0x7faac815cca0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7faab8009bf0 tx=0x7faab8004730 comp rx=0 tx=0).stop 2024-05-20T17:57:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 shutdown_connections 2024-05-20T17:57:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faaac06be30 0x7faaac06e340 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faac8158170 0x7faac8158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faac815c890 0x7faac815cca0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 --2- 172.21.15.6:0/1150597435 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faab4004800 0x7faac8156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 >> 172.21.15.6:0/1150597435 conn(0x7faac80d4bd0 msgr2=0x7faac80675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 shutdown_connections 2024-05-20T17:57:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:03.961+0000 7faacf977640 1 -- 172.21.15.6:0/1150597435 wait complete. 2024-05-20T17:57:03.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:57:04.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.090+0000 7fcd117f5640 1 Processor -- start 2024-05-20T17:57:04.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.090+0000 7fcd117f5640 1 -- start start 2024-05-20T17:57:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd117f5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcd0c0afad0 0x7fcd0c0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd117f5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd0c0afee0 0x7fcd0c0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd117f5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd0c0b3aa0 con 0x7fcd0c15ca50 2024-05-20T17:57:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd117f5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c0b3850 con 0x7fcd0c0afee0 2024-05-20T17:57:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd117f5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0c0703e0 con 0x7fcd0c0afad0 2024-05-20T17:57:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd0a7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd0c0afee0 0x7fcd0c0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd0b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcd0c15ca50 0x7fcd0c15ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46982/0 (socket says 172.21.15.6:46982) 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd0b7fe640 1 -- 172.21.15.6:0/3040085156 learned_addr learned my addr 172.21.15.6:0/3040085156 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd0affd640 1 --2- 172.21.15.6:0/3040085156 >> v2:172.21.15.171:3300/0 conn(0x7fcd0c0afad0 0x7fcd0c0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd0a7fc640 1 -- 172.21.15.6:0/3040085156 >> v2:172.21.15.171:3300/0 conn(0x7fcd0c0afad0 msgr2=0x7fcd0c0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd0a7fc640 1 --2- 172.21.15.6:0/3040085156 >> v2:172.21.15.171:3300/0 conn(0x7fcd0c0afad0 0x7fcd0c0b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd0a7fc640 1 -- 172.21.15.6:0/3040085156 >> v1:172.21.15.6:6789/0 conn(0x7fcd0c15ca50 legacy=0x7fcd0c15ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd0a7fc640 1 -- 172.21.15.6:0/3040085156 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c0b3d80 con 0x7fcd0c0afee0 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.092+0000 7fcd09ffb640 1 -- 172.21.15.6:0/3040085156 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363793929 0 0) 0x7fcd0c0b3aa0 con 0x7fcd0c15ca50 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.093+0000 7fcd0a7fc640 1 --2- 172.21.15.6:0/3040085156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c0afee0 0x7fcd0c0b5720 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c06cf20 tx=0x7fcd0002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f8bae62b8cc301 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.093+0000 7fcd09ffb640 1 -- 172.21.15.6:0/3040085156 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00037070 con 0x7fcd0c0afee0 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.093+0000 7fcd09ffb640 1 -- 172.21.15.6:0/3040085156 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd00032440 con 0x7fcd0c0afee0 2024-05-20T17:57:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.093+0000 7fcd09ffb640 1 -- 172.21.15.6:0/3040085156 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00032810 con 0x7fcd0c0afee0 2024-05-20T17:57:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.094+0000 7fcd117f5640 1 -- 172.21.15.6:0/3040085156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c0afee0 msgr2=0x7fcd0c0b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.094+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3040085156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c0afee0 0x7fcd0c0b5720 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c06cf20 tx=0x7fcd0002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.094+0000 7fcd117f5640 1 -- 172.21.15.6:0/3040085156 shutdown_connections 2024-05-20T17:57:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.094+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3040085156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c0afee0 0x7fcd0c0b5720 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.094+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3040085156 >> v2:172.21.15.171:3300/0 conn(0x7fcd0c0afad0 0x7fcd0c0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.094+0000 7fcd117f5640 1 -- 172.21.15.6:0/3040085156 >> 172.21.15.6:0/3040085156 conn(0x7fcd0c0cd2a0 msgr2=0x7fcd0c0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.094+0000 7fcd117f5640 1 -- 172.21.15.6:0/3040085156 shutdown_connections 2024-05-20T17:57:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.094+0000 7fcd117f5640 1 -- 172.21.15.6:0/3040085156 wait complete. 2024-05-20T17:57:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.096+0000 7fcd117f5640 1 Processor -- start 2024-05-20T17:57:04.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.096+0000 7fcd117f5640 1 -- start start 2024-05-20T17:57:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.097+0000 7fcd117f5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0c0afad0 0x7fcd0c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.097+0000 7fcd117f5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0c0afee0 0x7fcd0c154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.097+0000 7fcd117f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c15ca50 0x7fcd0c156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.097+0000 7fcd117f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c0b4860 con 0x7fcd0c15ca50 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd117f5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c0b4340 con 0x7fcd0c0afee0 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd117f5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0c15f080 con 0x7fcd0c0afad0 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c15ca50 0x7fcd0c156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c15ca50 0x7fcd0c156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46270/0 (socket says 172.21.15.6:46270) 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 -- 172.21.15.6:0/3672267253 learned_addr learned my addr 172.21.15.6:0/3672267253 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0a7fc640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0c0afee0 0x7fcd0c154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0affd640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0c0afad0 0x7fcd0c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 -- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0c0afad0 msgr2=0x7fcd0c1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0c0afad0 0x7fcd0c1536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 -- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0c0afee0 msgr2=0x7fcd0c154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0c0afee0 0x7fcd0c154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 -- 172.21.15.6:0/3672267253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c1f3c00 con 0x7fcd0c15ca50 2024-05-20T17:57:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd0b7fe640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c15ca50 0x7fcd0c156920 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400c410 tx=0x7fcd0400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fccf37fe640 1 -- 172.21.15.6:0/3672267253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd040074e0 con 0x7fcd0c15ca50 2024-05-20T17:57:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fccf37fe640 1 -- 172.21.15.6:0/3672267253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd040047e0 con 0x7fcd0c15ca50 2024-05-20T17:57:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0c155040 con 0x7fcd0c15ca50 2024-05-20T17:57:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fccf37fe640 1 -- 172.21.15.6:0/3672267253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04004bd0 con 0x7fcd0c15ca50 2024-05-20T17:57:04.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.098+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c155600 con 0x7fcd0c15ca50 2024-05-20T17:57:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.100+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c0b6b40 con 0x7fcd0c15ca50 2024-05-20T17:57:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.100+0000 7fccf37fe640 1 -- 172.21.15.6:0/3672267253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd04011070 con 0x7fcd0c15ca50 2024-05-20T17:57:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.100+0000 7fccf37fe640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccf806be30 0x7fccf806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.100+0000 7fccf37fe640 1 -- 172.21.15.6:0/3672267253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fcd0408ab80 con 0x7fcd0c15ca50 2024-05-20T17:57:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.101+0000 7fcd0affd640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccf806be30 0x7fccf806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.101+0000 7fcd0affd640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccf806be30 0x7fccf806e340 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c071be0 tx=0x7fccfc003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.105+0000 7fccf37fe640 1 -- 172.21.15.6:0/3672267253 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcd0c0b6b40 con 0x7fcd0c15ca50 2024-05-20T17:57:04.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.288+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcd0c154dd0 con 0x7fcd0c15ca50 2024-05-20T17:57:04.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.288+0000 7fccf37fe640 1 -- 172.21.15.6:0/3672267253 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7fcd0c1f3c00 con 0x7fcd0c15ca50 2024-05-20T17:57:04.287 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccf806be30 msgr2=0x7fccf806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccf806be30 0x7fccf806e340 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c071be0 tx=0x7fccfc003990 comp rx=0 tx=0).stop 2024-05-20T17:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c15ca50 msgr2=0x7fcd0c156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c15ca50 0x7fcd0c156920 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400c410 tx=0x7fcd0400c8d0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 shutdown_connections 2024-05-20T17:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccf806be30 0x7fccf806e340 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0c15ca50 0x7fcd0c156920 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd0c0afee0 0x7fcd0c154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 --2- 172.21.15.6:0/3672267253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd0c0afad0 0x7fcd0c1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 >> 172.21.15.6:0/3672267253 conn(0x7fcd0c0cd2a0 msgr2=0x7fcd0c0ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:04.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 shutdown_connections 2024-05-20T17:57:04.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.291+0000 7fcd117f5640 1 -- 172.21.15.6:0/3672267253 wait complete. 2024-05-20T17:57:04.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:57:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.417+0000 7f4aff2eb640 1 Processor -- start 2024-05-20T17:57:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.417+0000 7f4aff2eb640 1 -- start start 2024-05-20T17:57:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aff2eb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 0x7f4af80cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aff2eb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af80ce2f0 con 0x7f4af80b7210 2024-05-20T17:57:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aff2eb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af80d1ac0 con 0x7f4af80d14f0 2024-05-20T17:57:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aff2eb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4af80d1da0 con 0x7f4af80d10e0 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4afd888640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4af80b7210 0x7f4af80cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46994/0 (socket says 172.21.15.6:46994) 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4afd888640 1 -- 172.21.15.6:0/1820909238 learned_addr learned my addr 172.21.15.6:0/1820909238 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262861738 0 0) 0x7f4af80ce2f0 con 0x7f4af80b7210 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4afd087640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 0x7f4af80cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ae4003520 con 0x7f4af80b7210 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 451632331 0 0) 0x7f4ae4003520 con 0x7f4af80b7210 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 msgr2=0x7f4af80cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 0x7f4af80cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 >> v1:172.21.15.171:6789/0 conn(0x7f4af80d14f0 legacy=0x7f4af80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af80d2080 con 0x7f4af80b7210 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f4af00019f0 con 0x7f4af80b7210 2024-05-20T17:57:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 >> v1:172.21.15.6:6789/0 conn(0x7f4af80b7210 legacy=0x7f4af80cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4ae4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ae4004800 0x7f4ae4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.419+0000 7f4aeffff640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 0x7f4ae4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4af80d1da0 con 0x7f4ae40039e0 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae400baf0 con 0x7f4ae4004800 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae400bcf0 con 0x7f4af80d10e0 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afd087640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4ae4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afd888640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 0x7f4ae4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afc886640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ae4004800 0x7f4ae4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afd087640 1 -- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 msgr2=0x7f4ae4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afd087640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 0x7f4ae4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afd087640 1 -- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ae4004800 msgr2=0x7f4ae4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afd087640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ae4004800 0x7f4ae4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afd087640 1 -- 172.21.15.6:0/1820909238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae4003520 con 0x7f4ae40039e0 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afd888640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af80d10e0 0x7f4ae4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.420+0000 7f4afc886640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ae4004800 0x7f4ae4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4afd087640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4ae4003e50 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009a90 tx=0x7f4ae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc952ff81ae1fee server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4036070 con 0x7f4ae40039e0 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af4031400 con 0x7f4ae40039e0 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4aeffff640 1 -- 172.21.15.6:0/1820909238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4009690 con 0x7f4ae40039e0 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4aff2eb640 1 -- 172.21.15.6:0/1820909238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 msgr2=0x7f4ae4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4aff2eb640 1 --2- 172.21.15.6:0/1820909238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4ae4003e50 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009a90 tx=0x7f4ae4005830 comp rx=0 tx=0).stop 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4afd888640 1 -- 172.21.15.6:0/1820909238 reap_dead start 2024-05-20T17:57:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4aff2eb640 1 -- 172.21.15.6:0/1820909238 shutdown_connections 2024-05-20T17:57:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.421+0000 7f4aff2eb640 1 -- 172.21.15.6:0/1820909238 >> 172.21.15.6:0/1820909238 conn(0x7f4af80b44d0 msgr2=0x7f4af80b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.422+0000 7f4aff2eb640 1 -- 172.21.15.6:0/1820909238 shutdown_connections 2024-05-20T17:57:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.422+0000 7f4aff2eb640 1 -- 172.21.15.6:0/1820909238 wait complete. 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.423+0000 7f4aff2eb640 1 Processor -- start 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.423+0000 7f4aff2eb640 1 -- start start 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4aff2eb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4af8155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4aff2eb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4af8158130 0x7f4af81f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4aff2eb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af81f6e30 0x7f4af80cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4aff2eb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4af80b82c0 con 0x7f4ae40039e0 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4aff2eb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4af80d2640 con 0x7f4af8158130 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4aff2eb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4af80b8440 con 0x7f4af81f6e30 2024-05-20T17:57:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4af8155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4af8155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46288/0 (socket says 172.21.15.6:46288) 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 -- 172.21.15.6:0/238273466 learned_addr learned my addr 172.21.15.6:0/238273466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afc886640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4af8158130 0x7f4af81f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd888640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af81f6e30 0x7f4af80cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 -- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af81f6e30 msgr2=0x7f4af80cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af81f6e30 0x7f4af80cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 -- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4af8158130 msgr2=0x7f4af81f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4af8158130 0x7f4af81f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 -- 172.21.15.6:0/238273466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af81f7240 con 0x7f4ae40039e0 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4afd087640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4af8155f90 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f4af4034040 tx=0x7f4af4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.425+0000 7f4aedffb640 1 -- 172.21.15.6:0/238273466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4040020 con 0x7f4ae40039e0 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.426+0000 7f4aedffb640 1 -- 172.21.15.6:0/238273466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af4003bc0 con 0x7f4ae40039e0 2024-05-20T17:57:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.426+0000 7f4aedffb640 1 -- 172.21.15.6:0/238273466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4036040 con 0x7f4ae40039e0 2024-05-20T17:57:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.426+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af8158b70 con 0x7f4ae40039e0 2024-05-20T17:57:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.426+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af80cacd0 con 0x7f4ae40039e0 2024-05-20T17:57:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.427+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af8075b00 con 0x7f4ae40039e0 2024-05-20T17:57:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.427+0000 7f4aedffb640 1 -- 172.21.15.6:0/238273466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4af4043020 con 0x7f4ae40039e0 2024-05-20T17:57:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.428+0000 7f4aedffb640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4adc06be30 0x7f4adc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.428+0000 7f4aedffb640 1 -- 172.21.15.6:0/238273466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f4af40ab240 con 0x7f4ae40039e0 2024-05-20T17:57:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.428+0000 7f4afc886640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4adc06be30 0x7f4adc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.429+0000 7f4afc886640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4adc06be30 0x7f4adc06e340 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4af815d920 tx=0x7f4ae8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.433+0000 7f4aedffb640 1 -- 172.21.15.6:0/238273466 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4af404a070 con 0x7f4ae40039e0 2024-05-20T17:57:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.659+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4af80b1a20 con 0x7f4ae40039e0 2024-05-20T17:57:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.660+0000 7f4aedffb640 1 -- 172.21.15.6:0/238273466 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7f4af81f7240 con 0x7f4ae40039e0 2024-05-20T17:57:04.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:04.659 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:40.286706+0000","modified":"2024-05-20T17:56:43.311702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/693481794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":693481794},{"type":"v1","addr":"172.21.15.6:6835","nonce":693481794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6681,"qdb_cluster":[6681]},"id":5}]} 2024-05-20T17:57:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 44 2024-05-20T17:57:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4adc06be30 msgr2=0x7f4adc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4adc06be30 0x7f4adc06e340 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4af815d920 tx=0x7f4ae8009040 comp rx=0 tx=0).stop 2024-05-20T17:57:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 msgr2=0x7f4af8155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4af8155f90 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f4af4034040 tx=0x7f4af4004730 comp rx=0 tx=0).stop 2024-05-20T17:57:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 shutdown_connections 2024-05-20T17:57:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4adc06be30 0x7f4adc06e340 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4af81f6e30 0x7f4af80cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4af8158130 0x7f4af81f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 --2- 172.21.15.6:0/238273466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae40039e0 0x7f4af8155f90 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 >> 172.21.15.6:0/238273466 conn(0x7f4af80b44d0 msgr2=0x7f4af80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 shutdown_connections 2024-05-20T17:57:04.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.662+0000 7f4aff2eb640 1 -- 172.21.15.6:0/238273466 wait complete. 2024-05-20T17:57:04.672 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.788+0000 7f22e751a640 1 Processor -- start 2024-05-20T17:57:04.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.788+0000 7f22e751a640 1 -- start start 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.789+0000 7f22e751a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f22e015d530 0x7f22e015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.789+0000 7f22e751a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22e0070850 0x7f22e0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.789+0000 7f22e751a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e00cd580 con 0x7f22e00b1700 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.789+0000 7f22e751a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f22e00ce190 con 0x7f22e0070850 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.789+0000 7f22e751a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f22e00cd860 con 0x7f22e015d530 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.790+0000 7f22e5ab7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22e0070850 0x7f22e0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.790+0000 7f22e5ab7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22e0070850 0x7f22e0070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46304/0 (socket says 172.21.15.6:46304) 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.790+0000 7f22e5ab7640 1 -- 172.21.15.6:0/939414001 learned_addr learned my addr 172.21.15.6:0/939414001 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.790+0000 7f22e52b6640 1 --2- 172.21.15.6:0/939414001 >> v2:172.21.15.171:3300/0 conn(0x7f22e015d530 0x7f22e015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.790+0000 7f22e5ab7640 1 -- 172.21.15.6:0/939414001 >> v2:172.21.15.171:3300/0 conn(0x7f22e015d530 msgr2=0x7f22e015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:04.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.790+0000 7f22e5ab7640 1 --2- 172.21.15.6:0/939414001 >> v2:172.21.15.171:3300/0 conn(0x7f22e015d530 0x7f22e015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.790+0000 7f22e5ab7640 1 -- 172.21.15.6:0/939414001 >> v1:172.21.15.171:6789/0 conn(0x7f22e00b1700 legacy=0x7f22e00b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:04.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.790+0000 7f22e5ab7640 1 -- 172.21.15.6:0/939414001 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e00cdb40 con 0x7f22e0070850 2024-05-20T17:57:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.791+0000 7f22e5ab7640 1 --2- 172.21.15.6:0/939414001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e0070c60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f22e004f790 tx=0x7f22d802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81c1242d578fe88 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.791+0000 7f22d7fff640 1 -- 172.21.15.6:0/939414001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8036070 con 0x7f22e0070850 2024-05-20T17:57:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.791+0000 7f22d7fff640 1 -- 172.21.15.6:0/939414001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d8031600 con 0x7f22e0070850 2024-05-20T17:57:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.791+0000 7f22d7fff640 1 -- 172.21.15.6:0/939414001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d80319d0 con 0x7f22e0070850 2024-05-20T17:57:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.792+0000 7f22e751a640 1 -- 172.21.15.6:0/939414001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 msgr2=0x7f22e0070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.792+0000 7f22e751a640 1 --2- 172.21.15.6:0/939414001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e0070c60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f22e004f790 tx=0x7f22d802a6f0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.792+0000 7f22e751a640 1 -- 172.21.15.6:0/939414001 shutdown_connections 2024-05-20T17:57:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.792+0000 7f22e751a640 1 --2- 172.21.15.6:0/939414001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e0070c60 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.792+0000 7f22e751a640 1 --2- 172.21.15.6:0/939414001 >> v2:172.21.15.171:3300/0 conn(0x7f22e015d530 0x7f22e015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.792+0000 7f22e751a640 1 -- 172.21.15.6:0/939414001 >> 172.21.15.6:0/939414001 conn(0x7f22e00d29d0 msgr2=0x7f22e00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:04.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.792+0000 7f22e751a640 1 -- 172.21.15.6:0/939414001 shutdown_connections 2024-05-20T17:57:04.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.792+0000 7f22e751a640 1 -- 172.21.15.6:0/939414001 wait complete. 2024-05-20T17:57:04.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.793+0000 7f22e751a640 1 Processor -- start 2024-05-20T17:57:04.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.794+0000 7f22e751a640 1 -- start start 2024-05-20T17:57:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e751a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e00c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e751a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e00b1700 0x7f22e00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e751a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e015d530 0x7f22e00ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e751a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22e00711a0 con 0x7f22e0070850 2024-05-20T17:57:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e751a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22e00cd230 con 0x7f22e00b1700 2024-05-20T17:57:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e751a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22e0071320 con 0x7f22e015d530 2024-05-20T17:57:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e00c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e00c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46314/0 (socket says 172.21.15.6:46314) 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 -- 172.21.15.6:0/2313400550 learned_addr learned my addr 172.21.15.6:0/2313400550 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e5ab7640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e015d530 0x7f22e00ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 -- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e015d530 msgr2=0x7f22e00ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e015d530 0x7f22e00ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 -- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e00b1700 msgr2=0x7f22e00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e4ab5640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e00b1700 0x7f22e00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e00b1700 0x7f22e00c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 -- 172.21.15.6:0/2313400550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e00c6a40 con 0x7f22e0070850 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.795+0000 7f22e52b6640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e00c6500 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00d600 tx=0x7f22dc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.796+0000 7f22d5ffb640 1 -- 172.21.15.6:0/2313400550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc004240 con 0x7f22e0070850 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.796+0000 7f22d5ffb640 1 -- 172.21.15.6:0/2313400550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22dc0043e0 con 0x7f22e0070850 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.796+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e00c6f50 con 0x7f22e0070850 2024-05-20T17:57:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.796+0000 7f22d5ffb640 1 -- 172.21.15.6:0/2313400550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc003830 con 0x7f22e0070850 2024-05-20T17:57:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.796+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e00c7510 con 0x7f22e0070850 2024-05-20T17:57:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.797+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e0075b00 con 0x7f22e0070850 2024-05-20T17:57:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.797+0000 7f22d5ffb640 1 -- 172.21.15.6:0/2313400550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22dc0039d0 con 0x7f22e0070850 2024-05-20T17:57:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.798+0000 7f22d5ffb640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22c406be30 0x7f22c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.798+0000 7f22d5ffb640 1 -- 172.21.15.6:0/2313400550 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f22dc08b380 con 0x7f22e0070850 2024-05-20T17:57:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.798+0000 7f22e4ab5640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22c406be30 0x7f22c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.799+0000 7f22e4ab5640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22c406be30 0x7f22c406e340 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f22e015e560 tx=0x7f22d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.803+0000 7f22d5ffb640 1 -- 172.21.15.6:0/2313400550 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f22dc01c360 con 0x7f22e0070850 2024-05-20T17:57:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.991+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22e00d2100 con 0x7f22e0070850 2024-05-20T17:57:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.992+0000 7f22d5ffb640 1 -- 172.21.15.6:0/2313400550 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16897 (secure 0 0 0) 0x7f22dc059b10 con 0x7f22e0070850 2024-05-20T17:57:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:04.992 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:41.911814+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:38.652078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:39.261578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22c406be30 msgr2=0x7f22c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22c406be30 0x7f22c406e340 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f22e015e560 tx=0x7f22d0008040 comp rx=0 tx=0).stop 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 msgr2=0x7f22e00c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e00c6500 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f22dc00d600 tx=0x7f22dc00dac0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 shutdown_connections 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f22c406be30 0x7f22c406e340 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22e015d530 0x7f22e00ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22e00b1700 0x7f22e00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 --2- 172.21.15.6:0/2313400550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22e0070850 0x7f22e00c6500 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 >> 172.21.15.6:0/2313400550 conn(0x7f22e00d29d0 msgr2=0x7f22e00b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 shutdown_connections 2024-05-20T17:57:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:04.995+0000 7f22e751a640 1 -- 172.21.15.6:0/2313400550 wait complete. 2024-05-20T17:57:05.005 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T17:57:05.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:57:05.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.121+0000 7fbfa98f9640 1 Processor -- start 2024-05-20T17:57:05.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.121+0000 7fbfa98f9640 1 -- start start 2024-05-20T17:57:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.122+0000 7fbfa98f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfa406cf00 0x7fbfa406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.122+0000 7fbfa98f9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa408d2a0 con 0x7fbfa40d2780 2024-05-20T17:57:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.122+0000 7fbfa98f9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa406d850 con 0x7fbfa40d4400 2024-05-20T17:57:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.122+0000 7fbfa98f9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa40d3f70 con 0x7fbfa406cf00 2024-05-20T17:57:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.122+0000 7fbfa27fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfa406cf00 0x7fbfa406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.122+0000 7fbfa27fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfa406cf00 0x7fbfa406d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46320/0 (socket says 172.21.15.6:46320) 2024-05-20T17:57:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.122+0000 7fbfa37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbfa40d2780 0x7fbfa40d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47010/0 (socket says 172.21.15.6:47010) 2024-05-20T17:57:05.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.122+0000 7fbfa27fc640 1 -- 172.21.15.6:0/3518568824 learned_addr learned my addr 172.21.15.6:0/3518568824 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.123+0000 7fbfa27fc640 1 -- 172.21.15.6:0/3518568824 >> v1:172.21.15.171:6789/0 conn(0x7fbfa40d4400 legacy=0x7fbfa415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.123+0000 7fbfa27fc640 1 -- 172.21.15.6:0/3518568824 >> v1:172.21.15.6:6789/0 conn(0x7fbfa40d2780 legacy=0x7fbfa40d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.123+0000 7fbfa27fc640 1 -- 172.21.15.6:0/3518568824 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa40d4810 con 0x7fbfa406cf00 2024-05-20T17:57:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.123+0000 7fbfa1ffb640 1 -- 172.21.15.6:0/3518568824 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248415169 0 0) 0x7fbf94001110 con 0x7fbfa40d2780 2024-05-20T17:57:05.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.123+0000 7fbfa27fc640 1 --2- 172.21.15.6:0/3518568824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa406d310 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40d40f0 tx=0x7fbf8c02a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68aa1b694d345af4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.124+0000 7fbfa1ffb640 1 -- 172.21.15.6:0/3518568824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c037070 con 0x7fbfa406cf00 2024-05-20T17:57:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.124+0000 7fbfa1ffb640 1 -- 172.21.15.6:0/3518568824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c032640 con 0x7fbfa406cf00 2024-05-20T17:57:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.124+0000 7fbfa1ffb640 1 -- 172.21.15.6:0/3518568824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c032a10 con 0x7fbfa406cf00 2024-05-20T17:57:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.124+0000 7fbfa98f9640 1 -- 172.21.15.6:0/3518568824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 msgr2=0x7fbfa406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.124+0000 7fbfa98f9640 1 --2- 172.21.15.6:0/3518568824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa406d310 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40d40f0 tx=0x7fbf8c02a320 comp rx=0 tx=0).stop 2024-05-20T17:57:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.124+0000 7fbfa98f9640 1 -- 172.21.15.6:0/3518568824 shutdown_connections 2024-05-20T17:57:05.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.124+0000 7fbfa98f9640 1 --2- 172.21.15.6:0/3518568824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa406d310 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.124+0000 7fbfa98f9640 1 -- 172.21.15.6:0/3518568824 >> 172.21.15.6:0/3518568824 conn(0x7fbfa40d4bb0 msgr2=0x7fbfa40d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.125+0000 7fbfa98f9640 1 -- 172.21.15.6:0/3518568824 shutdown_connections 2024-05-20T17:57:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.125+0000 7fbfa98f9640 1 -- 172.21.15.6:0/3518568824 wait complete. 2024-05-20T17:57:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.126+0000 7fbfa98f9640 1 Processor -- start 2024-05-20T17:57:05.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.127+0000 7fbfa98f9640 1 -- start start 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa98f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa40ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa98f9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfa40d2780 0x7fbfa40b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa98f9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfa40d4400 0x7fbfa40b9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa98f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa40d3920 con 0x7fbfa406cf00 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa98f9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa40d3680 con 0x7fbfa40d4400 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa98f9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa40d3c00 con 0x7fbfa40d2780 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa40ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa40ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46336/0 (socket says 172.21.15.6:46336) 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 -- 172.21.15.6:0/1839653243 learned_addr learned my addr 172.21.15.6:0/1839653243 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa27fc640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfa40d2780 0x7fbfa40b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa37fe640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfa40d4400 0x7fbfa40b9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 -- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfa40d2780 msgr2=0x7fbfa40b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfa40d2780 0x7fbfa40b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 -- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfa40d4400 msgr2=0x7fbfa40b9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfa40d4400 0x7fbfa40b9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 -- 172.21.15.6:0/1839653243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa41e92f0 con 0x7fbfa406cf00 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.128+0000 7fbfa2ffd640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa40ca7b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00ba80 tx=0x7fbf9c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.129+0000 7fbf9bfff640 1 -- 172.21.15.6:0/1839653243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00cba0 con 0x7fbfa406cf00 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.129+0000 7fbf9bfff640 1 -- 172.21.15.6:0/1839653243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00cd40 con 0x7fbfa406cf00 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.129+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa41e8250 con 0x7fbfa406cf00 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.129+0000 7fbf9bfff640 1 -- 172.21.15.6:0/1839653243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c003bb0 con 0x7fbfa406cf00 2024-05-20T17:57:05.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.129+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa41e8810 con 0x7fbfa406cf00 2024-05-20T17:57:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.130+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa408cf70 con 0x7fbfa406cf00 2024-05-20T17:57:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.130+0000 7fbf9bfff640 1 -- 172.21.15.6:0/1839653243 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf9c014440 con 0x7fbfa406cf00 2024-05-20T17:57:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.131+0000 7fbf9bfff640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf8406be30 0x7fbf8406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.131+0000 7fbf9bfff640 1 -- 172.21.15.6:0/1839653243 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fbf9c08ae60 con 0x7fbfa406cf00 2024-05-20T17:57:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.131+0000 7fbfa27fc640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf8406be30 0x7fbf8406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.132+0000 7fbfa27fc640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf8406be30 0x7fbf8406e340 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c034000 tx=0x7fbf8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.136+0000 7fbf9bfff640 1 -- 172.21.15.6:0/1839653243 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbfa408cf70 con 0x7fbfa406cf00 2024-05-20T17:57:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.361+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfa40735a0 con 0x7fbfa406cf00 2024-05-20T17:57:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.362+0000 7fbf9bfff640 1 -- 172.21.15.6:0/1839653243 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7fbfa40735a0 con 0x7fbfa406cf00 2024-05-20T17:57:05.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:05.361 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:40.286706+0000","modified":"2024-05-20T17:56:43.311702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/693481794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":693481794},{"type":"v1","addr":"172.21.15.6:6835","nonce":693481794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6681,"qdb_cluster":[6681]},"id":5}]} 2024-05-20T17:57:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 44 2024-05-20T17:57:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf8406be30 msgr2=0x7fbf8406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf8406be30 0x7fbf8406e340 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c034000 tx=0x7fbf8c02e000 comp rx=0 tx=0).stop 2024-05-20T17:57:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 msgr2=0x7fbfa40ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa40ca7b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00ba80 tx=0x7fbf9c00bf40 comp rx=0 tx=0).stop 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 shutdown_connections 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbf8406be30 0x7fbf8406e340 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfa40d4400 0x7fbfa40b9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfa40d2780 0x7fbfa40b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 --2- 172.21.15.6:0/1839653243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa406cf00 0x7fbfa40ca7b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 >> 172.21.15.6:0/1839653243 conn(0x7fbfa40d4bb0 msgr2=0x7fbfa4161c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 shutdown_connections 2024-05-20T17:57:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.364+0000 7fbfa98f9640 1 -- 172.21.15.6:0/1839653243 wait complete. 2024-05-20T17:57:05.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:57:05.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.491+0000 7f74cc0a0640 1 Processor -- start 2024-05-20T17:57:05.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.491+0000 7f74cc0a0640 1 -- start start 2024-05-20T17:57:05.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.492+0000 7f74cc0a0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f74c40b47b0 0x7f74c40afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.492+0000 7f74cc0a0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40b39f0 con 0x7f74c415d060 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.492+0000 7f74cc0a0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40b3cd0 con 0x7f74c40b58f0 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.492+0000 7f74cc0a0640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f74c40b3fb0 con 0x7f74c40b47b0 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c963b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74c415d060 0x7f74c40b51e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47026/0 (socket says 172.21.15.6:47026) 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c963b640 1 -- 172.21.15.6:0/1373457566 learned_addr learned my addr 172.21.15.6:0/1373457566 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c9e3c640 1 --2- 172.21.15.6:0/1373457566 >> v2:172.21.15.171:3300/0 conn(0x7f74c40b47b0 0x7f74c40afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693249143 0 0) 0x7f74c40b39f0 con 0x7f74c415d060 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74b0003520 con 0x7f74c415d060 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2067110415 0 0) 0x7f74b0003520 con 0x7f74c415d060 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 >> v2:172.21.15.171:3300/0 conn(0x7f74c40b47b0 msgr2=0x7f74c40afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 --2- 172.21.15.6:0/1373457566 >> v2:172.21.15.171:3300/0 conn(0x7f74c40b47b0 0x7f74c40afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 >> v1:172.21.15.171:6789/0 conn(0x7f74c40b58f0 legacy=0x7f74c406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c40b4290 con 0x7f74c415d060 2024-05-20T17:57:05.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f74b4001670 con 0x7f74c415d060 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 >> v1:172.21.15.6:6789/0 conn(0x7f74c415d060 legacy=0x7f74c40b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b00039b0 0x7f74b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b0004800 0x7f74b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40b3fb0 con 0x7f74b00051c0 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74b000c160 con 0x7f74b0004800 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74b000c360 con 0x7f74b00039b0 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.493+0000 7f74ca63d640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.494+0000 7f74c9e3c640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b00039b0 0x7f74b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.494+0000 7f74c963b640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b0004800 0x7f74b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.494+0000 7f74ca63d640 1 -- 172.21.15.6:0/1373457566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b00039b0 msgr2=0x7f74b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.494+0000 7f74ca63d640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74b00039b0 0x7f74b0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.494+0000 7f74ca63d640 1 -- 172.21.15.6:0/1373457566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b0004800 msgr2=0x7f74b0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:05.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.494+0000 7f74ca63d640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74b0004800 0x7f74b0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.494+0000 7f74ca63d640 1 -- 172.21.15.6:0/1373457566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b0003520 con 0x7f74b00051c0 2024-05-20T17:57:05.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.494+0000 7f74ca63d640 1 -- 172.21.15.6:0/1373457566 reap_dead start 2024-05-20T17:57:05.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74ca63d640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74b000b9c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f74bc001f60 tx=0x7f74b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b1b78b6e4e8659 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc001b30 con 0x7f74b00051c0 2024-05-20T17:57:05.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74bc003b90 con 0x7f74b00051c0 2024-05-20T17:57:05.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74c8e3a640 1 -- 172.21.15.6:0/1373457566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74bc005110 con 0x7f74b00051c0 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74cc0a0640 1 -- 172.21.15.6:0/1373457566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 msgr2=0x7f74b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74cc0a0640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74b000b9c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f74bc001f60 tx=0x7f74b0005830 comp rx=0 tx=0).stop 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74cc0a0640 1 -- 172.21.15.6:0/1373457566 shutdown_connections 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74cc0a0640 1 --2- 172.21.15.6:0/1373457566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74b000b9c0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.495+0000 7f74cc0a0640 1 -- 172.21.15.6:0/1373457566 >> 172.21.15.6:0/1373457566 conn(0x7f74c40cd2a0 msgr2=0x7f74c40cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.496+0000 7f74cc0a0640 1 -- 172.21.15.6:0/1373457566 shutdown_connections 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.496+0000 7f74cc0a0640 1 -- 172.21.15.6:0/1373457566 wait complete. 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.497+0000 7f74cc0a0640 1 Processor -- start 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.497+0000 7f74cc0a0640 1 -- start start 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74cc0a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74c409af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74cc0a0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74c41f29e0 0x7f74c414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74cc0a0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74c409cca0 0x7f74c409d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74cc0a0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40b47b0 con 0x7f74b00051c0 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74cc0a0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74c4159e70 con 0x7f74c41f29e0 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74cc0a0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74c40b4930 con 0x7f74c409cca0 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74c409af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74c409af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46356/0 (socket says 172.21.15.6:46356) 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 -- 172.21.15.6:0/2608522598 learned_addr learned my addr 172.21.15.6:0/2608522598 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74ca63d640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74c409cca0 0x7f74c409d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c963b640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74c41f29e0 0x7f74c414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 -- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74c409cca0 msgr2=0x7f74c409d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74c409cca0 0x7f74c409d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 -- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74c41f29e0 msgr2=0x7f74c414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74c41f29e0 0x7f74c414eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 -- 172.21.15.6:0/2608522598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c409d5f0 con 0x7f74b00051c0 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74ca63d640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74c409cca0 0x7f74c409d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c963b640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74c41f29e0 0x7f74c414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74c9e3c640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74c409af00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f74c0011930 tx=0x7f74c0011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74ba7fc640 1 -- 172.21.15.6:0/2608522598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c000fa30 con 0x7f74b00051c0 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74ba7fc640 1 -- 172.21.15.6:0/2608522598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c000fbd0 con 0x7f74b00051c0 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.499+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c409bc00 con 0x7f74b00051c0 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.500+0000 7f74ba7fc640 1 -- 172.21.15.6:0/2608522598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0014440 con 0x7f74b00051c0 2024-05-20T17:57:05.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.500+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c409c1c0 con 0x7f74b00051c0 2024-05-20T17:57:05.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.501+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c4075b00 con 0x7f74b00051c0 2024-05-20T17:57:05.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.501+0000 7f74ba7fc640 1 -- 172.21.15.6:0/2608522598 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74c0012040 con 0x7f74b00051c0 2024-05-20T17:57:05.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.502+0000 7f74ba7fc640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74a806be60 0x7f74a806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.502+0000 7f74ba7fc640 1 -- 172.21.15.6:0/2608522598 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f74c008b630 con 0x7f74b00051c0 2024-05-20T17:57:05.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.502+0000 7f74c963b640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74a806be60 0x7f74a806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.503+0000 7f74c963b640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74a806be60 0x7f74a806e370 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f74c40b5220 tx=0x7f74b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.507+0000 7f74ba7fc640 1 -- 172.21.15.6:0/2608522598 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f74c0019030 con 0x7f74b00051c0 2024-05-20T17:57:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.730+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74c40ce1f0 con 0x7f74b00051c0 2024-05-20T17:57:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.731+0000 7f74ba7fc640 1 -- 172.21.15.6:0/2608522598 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5180 (secure 0 0 0) 0x7f74c0059e50 con 0x7f74b00051c0 2024-05-20T17:57:05.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:05.730 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:56:40.286706+0000","modified":"2024-05-20T17:56:43.311702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/693481794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":693481794},{"type":"v1","addr":"172.21.15.6:6835","nonce":693481794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6681,"qdb_cluster":[6681]},"id":5}]} 2024-05-20T17:57:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 44 2024-05-20T17:57:05.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74a806be60 msgr2=0x7f74a806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74a806be60 0x7f74a806e370 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f74c40b5220 tx=0x7f74b4009040 comp rx=0 tx=0).stop 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 msgr2=0x7f74c409af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74c409af00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f74c0011930 tx=0x7f74c0011df0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 shutdown_connections 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74a806be60 0x7f74a806e370 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74c409cca0 0x7f74c409d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74c41f29e0 0x7f74c414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 --2- 172.21.15.6:0/2608522598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74b00051c0 0x7f74c409af00 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 >> 172.21.15.6:0/2608522598 conn(0x7f74c40cd2a0 msgr2=0x7f74c415ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 shutdown_connections 2024-05-20T17:57:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.733+0000 7f74cc0a0640 1 -- 172.21.15.6:0/2608522598 wait complete. 2024-05-20T17:57:05.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.860+0000 7f607a5d7640 1 Processor -- start 2024-05-20T17:57:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.860+0000 7f607a5d7640 1 -- start start 2024-05-20T17:57:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.861+0000 7f607a5d7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60740b2f10 0x7f60740d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.861+0000 7f607a5d7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607415d940 0x7f607415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.861+0000 7f607a5d7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607415e6b0 con 0x7f607406d290 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.861+0000 7f607a5d7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f60740d2400 con 0x7f60740b2f10 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.861+0000 7f607a5d7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f60740d1a30 con 0x7f607415d940 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.861+0000 7f6073fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f60740b2f10 0x7f60740d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.861+0000 7f60737fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f607406d290 0x7f607406d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47030/0 (socket says 172.21.15.6:47030) 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.861+0000 7f60737fe640 1 -- 172.21.15.6:0/1690228267 learned_addr learned my addr 172.21.15.6:0/1690228267 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.862+0000 7f6078b74640 1 --2- 172.21.15.6:0/1690228267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607415d940 0x7f607415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.862+0000 7f6073fff640 1 -- 172.21.15.6:0/1690228267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607415d940 msgr2=0x7f607415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.862+0000 7f6073fff640 1 --2- 172.21.15.6:0/1690228267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607415d940 0x7f607415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.862+0000 7f6073fff640 1 -- 172.21.15.6:0/1690228267 >> v1:172.21.15.6:6789/0 conn(0x7f607406d290 legacy=0x7f607406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.862+0000 7f6073fff640 1 -- 172.21.15.6:0/1690228267 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60740d1100 con 0x7f60740b2f10 2024-05-20T17:57:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.862+0000 7f6072ffd640 1 -- 172.21.15.6:0/1690228267 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040866928 0 0) 0x7f607415e6b0 con 0x7f607406d290 2024-05-20T17:57:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f6073fff640 1 --2- 172.21.15.6:0/1690228267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60740b2f10 0x7f60740d1ec0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f60640097a0 tx=0x7f606402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3127fd93ac90cd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f6072ffd640 1 -- 172.21.15.6:0/1690228267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064037070 con 0x7f60740b2f10 2024-05-20T17:57:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f6072ffd640 1 -- 172.21.15.6:0/1690228267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606402ae50 con 0x7f60740b2f10 2024-05-20T17:57:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f6072ffd640 1 -- 172.21.15.6:0/1690228267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064032660 con 0x7f60740b2f10 2024-05-20T17:57:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f607a5d7640 1 -- 172.21.15.6:0/1690228267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60740b2f10 msgr2=0x7f60740d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f607a5d7640 1 --2- 172.21.15.6:0/1690228267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60740b2f10 0x7f60740d1ec0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f60640097a0 tx=0x7f606402a100 comp rx=0 tx=0).stop 2024-05-20T17:57:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f607a5d7640 1 -- 172.21.15.6:0/1690228267 shutdown_connections 2024-05-20T17:57:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f607a5d7640 1 --2- 172.21.15.6:0/1690228267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f607415d940 0x7f607415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f607a5d7640 1 --2- 172.21.15.6:0/1690228267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60740b2f10 0x7f60740d1ec0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f607a5d7640 1 -- 172.21.15.6:0/1690228267 >> 172.21.15.6:0/1690228267 conn(0x7f60740b6670 msgr2=0x7f60740b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.863+0000 7f607a5d7640 1 -- 172.21.15.6:0/1690228267 shutdown_connections 2024-05-20T17:57:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.864+0000 7f607a5d7640 1 -- 172.21.15.6:0/1690228267 wait complete. 2024-05-20T17:57:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.865+0000 7f607a5d7640 1 Processor -- start 2024-05-20T17:57:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.865+0000 7f607a5d7640 1 -- start start 2024-05-20T17:57:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f607a5d7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607406d290 0x7f60740cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f607a5d7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60740b2f10 0x7f607409ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f607a5d7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607415d940 0x7f607409f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f607a5d7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f60740d16c0 con 0x7f607406d290 2024-05-20T17:57:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f607a5d7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f60740b3320 con 0x7f607415d940 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f607a5d7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f607415e290 con 0x7f60740b2f10 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607406d290 0x7f60740cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607406d290 0x7f60740cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46378/0 (socket says 172.21.15.6:46378) 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 -- 172.21.15.6:0/2153650545 learned_addr learned my addr 172.21.15.6:0/2153650545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f60737fe640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60740b2f10 0x7f607409ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6078b74640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607415d940 0x7f607409f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 -- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60740b2f10 msgr2=0x7f607409ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60740b2f10 0x7f607409ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 -- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607415d940 msgr2=0x7f607409f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607415d940 0x7f607409f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 -- 172.21.15.6:0/2153650545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60741f3260 con 0x7f607406d290 2024-05-20T17:57:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6078b74640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607415d940 0x7f607409f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6073fff640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607406d290 0x7f60740cf680 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6064035040 tx=0x7f60640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.867+0000 7f6070ff9640 1 -- 172.21.15.6:0/2153650545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064037040 con 0x7f607406d290 2024-05-20T17:57:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.868+0000 7f6070ff9640 1 -- 172.21.15.6:0/2153650545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6064004030 con 0x7f607406d290 2024-05-20T17:57:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.868+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60741f3520 con 0x7f607406d290 2024-05-20T17:57:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.868+0000 7f6070ff9640 1 -- 172.21.15.6:0/2153650545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064004400 con 0x7f607406d290 2024-05-20T17:57:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.868+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60741f3ae0 con 0x7f607406d290 2024-05-20T17:57:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.868+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6074075b00 con 0x7f607406d290 2024-05-20T17:57:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.869+0000 7f6070ff9640 1 -- 172.21.15.6:0/2153650545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6064003610 con 0x7f607406d290 2024-05-20T17:57:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.870+0000 7f6070ff9640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f606006be30 0x7f606006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.870+0000 7f6070ff9640 1 -- 172.21.15.6:0/2153650545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f60640aba40 con 0x7f607406d290 2024-05-20T17:57:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.870+0000 7f60737fe640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f606006be30 0x7f606006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.870+0000 7f60737fe640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f606006be30 0x7f606006e340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f60740ce000 tx=0x7f6068009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:05.874+0000 7f6070ff9640 1 -- 172.21.15.6:0/2153650545 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f606407a260 con 0x7f607406d290 2024-05-20T17:57:06.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.061+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60740b1cd0 con 0x7f607406d290 2024-05-20T17:57:06.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.062+0000 7f6070ff9640 1 -- 172.21.15.6:0/2153650545 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16897 (secure 0 0 0) 0x7f6064079b60 con 0x7f607406d290 2024-05-20T17:57:06.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:06.061 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:56:41.911814+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:56:38.652078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-05-20T17:56:39.261578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f606006be30 msgr2=0x7f606006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f606006be30 0x7f606006e340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f60740ce000 tx=0x7f6068009040 comp rx=0 tx=0).stop 2024-05-20T17:57:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607406d290 msgr2=0x7f60740cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607406d290 0x7f60740cf680 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6064035040 tx=0x7f60640046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 shutdown_connections 2024-05-20T17:57:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f606006be30 0x7f606006e340 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f607415d940 0x7f607409f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f60740b2f10 0x7f607409ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 --2- 172.21.15.6:0/2153650545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f607406d290 0x7f60740cf680 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 >> 172.21.15.6:0/2153650545 conn(0x7f60740b6670 msgr2=0x7f607406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 shutdown_connections 2024-05-20T17:57:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.064+0000 7f607a5d7640 1 -- 172.21.15.6:0/2153650545 wait complete. 2024-05-20T17:57:06.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T17:57:06.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:57:06.120 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:57:06.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.193+0000 7f37e7d6b640 1 Processor -- start 2024-05-20T17:57:06.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.194+0000 7f37e7d6b640 1 -- start start 2024-05-20T17:57:06.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.195+0000 7f37e7d6b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f37e006d3d0 0x7f37e006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.195+0000 7f37e7d6b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e00b8190 0x7f37e00b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.195+0000 7f37e7d6b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e006dd20 con 0x7f37e0162820 2024-05-20T17:57:06.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.195+0000 7f37e7d6b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f37e00d0630 con 0x7f37e006d3d0 2024-05-20T17:57:06.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.195+0000 7f37e7d6b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f37e00d39c0 con 0x7f37e00b8190 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e5306640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f37e006d3d0 0x7f37e006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e6308640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e00b8190 0x7f37e00b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e5306640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f37e006d3d0 0x7f37e006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:40316/0 (socket says 172.21.15.6:40316) 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e5b07640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f37e0162820 0x7f37e00b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:44020/0 (socket says 172.21.15.6:44020) 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e5306640 1 -- 172.21.15.6:0/3268601649 learned_addr learned my addr 172.21.15.6:0/3268601649 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e5306640 1 -- 172.21.15.6:0/3268601649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e00b8190 msgr2=0x7f37e00b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e5306640 1 --2- 172.21.15.6:0/3268601649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e00b8190 0x7f37e00b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e5306640 1 -- 172.21.15.6:0/3268601649 >> v1:172.21.15.171:6789/0 conn(0x7f37e0162820 legacy=0x7f37e00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e5306640 1 -- 172.21.15.6:0/3268601649 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e00d3ca0 con 0x7f37e006d3d0 2024-05-20T17:57:06.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e4b05640 1 -- 172.21.15.6:0/3268601649 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1692104835 0 0) 0x7f37dc001110 con 0x7f37e0162820 2024-05-20T17:57:06.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.196+0000 7f37e6308640 1 --2- 172.21.15.6:0/3268601649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e00b8190 0x7f37e00b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.197+0000 7f37e5306640 1 --2- 172.21.15.6:0/3268601649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e006d3d0 0x7f37e006d7e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009870 tx=0x7f37d002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12bf3b7046b214e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.197+0000 7f37e4b05640 1 -- 172.21.15.6:0/3268601649 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0037070 con 0x7f37e006d3d0 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.197+0000 7f37e4b05640 1 -- 172.21.15.6:0/3268601649 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d0032440 con 0x7f37e006d3d0 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.197+0000 7f37e4b05640 1 -- 172.21.15.6:0/3268601649 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0032810 con 0x7f37e006d3d0 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.198+0000 7f37e7d6b640 1 -- 172.21.15.6:0/3268601649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e006d3d0 msgr2=0x7f37e006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.198+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/3268601649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e006d3d0 0x7f37e006d7e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009870 tx=0x7f37d002a270 comp rx=0 tx=0).stop 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.198+0000 7f37e7d6b640 1 -- 172.21.15.6:0/3268601649 shutdown_connections 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.198+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/3268601649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e00b8190 0x7f37e00b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.198+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/3268601649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e006d3d0 0x7f37e006d7e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.198+0000 7f37e7d6b640 1 -- 172.21.15.6:0/3268601649 >> 172.21.15.6:0/3268601649 conn(0x7f37e00d4bd0 msgr2=0x7f37e00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.198+0000 7f37e7d6b640 1 -- 172.21.15.6:0/3268601649 shutdown_connections 2024-05-20T17:57:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.198+0000 7f37e7d6b640 1 -- 172.21.15.6:0/3268601649 wait complete. 2024-05-20T17:57:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.200+0000 7f37e7d6b640 1 Processor -- start 2024-05-20T17:57:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.200+0000 7f37e7d6b640 1 -- start start 2024-05-20T17:57:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e7d6b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e006d3d0 0x7f37e00ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e7d6b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e00b8190 0x7f37e0159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e7d6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37e0162820 0x7f37e00ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e7d6b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f37e00d0300 con 0x7f37e0162820 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e7d6b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f37e00d4260 con 0x7f37e00b8190 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e7d6b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f37e00b4050 con 0x7f37e006d3d0 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e6308640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37e0162820 0x7f37e00ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e6308640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37e0162820 0x7f37e00ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46382/0 (socket says 172.21.15.6:46382) 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e6308640 1 -- 172.21.15.6:0/1885815343 learned_addr learned my addr 172.21.15.6:0/1885815343 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e5b07640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e006d3d0 0x7f37e00ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.201+0000 7f37e5306640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e00b8190 0x7f37e0159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e6308640 1 -- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e006d3d0 msgr2=0x7f37e00ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e6308640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e006d3d0 0x7f37e00ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e6308640 1 -- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e00b8190 msgr2=0x7f37e0159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e6308640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e00b8190 0x7f37e0159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e6308640 1 -- 172.21.15.6:0/1885815343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e00cec60 con 0x7f37e0162820 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e5306640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e00b8190 0x7f37e0159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e6308640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37e0162820 0x7f37e00ca8d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009e00 tx=0x7f37d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37d67fc640 1 -- 172.21.15.6:0/1885815343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8018020 con 0x7f37e0162820 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e00cef40 con 0x7f37e0162820 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37d67fc640 1 -- 172.21.15.6:0/1885815343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8014480 con 0x7f37e0162820 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37d67fc640 1 -- 172.21.15.6:0/1885815343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8014870 con 0x7f37e0162820 2024-05-20T17:57:06.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.202+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e00b44e0 con 0x7f37e0162820 2024-05-20T17:57:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.203+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e00d5510 con 0x7f37e0162820 2024-05-20T17:57:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.204+0000 7f37d67fc640 1 -- 172.21.15.6:0/1885815343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37d8005d10 con 0x7f37e0162820 2024-05-20T17:57:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.204+0000 7f37d67fc640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f37c406be60 0x7f37c406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.204+0000 7f37d67fc640 1 -- 172.21.15.6:0/1885815343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f37d808bd80 con 0x7f37e0162820 2024-05-20T17:57:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.205+0000 7f37e5b07640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f37c406be60 0x7f37c406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.205+0000 7f37e5b07640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f37c406be60 0x7f37c406e370 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f37dc007fd0 tx=0x7f37dc007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.209+0000 7f37d67fc640 1 -- 172.21.15.6:0/1885815343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f37e00d5510 con 0x7f37e0162820 2024-05-20T17:57:06.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.431+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f37e00cf460 con 0x7f37e0162820 2024-05-20T17:57:06.430 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T17:57:06.432+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:57:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.434+0000 7f37d67fc640 1 -- 172.21.15.6:0/1885815343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) ==== 161+0+0 (secure 0 0 0) 0x7f37d8022030 con 0x7f37e0162820 2024-05-20T17:57:06.432 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T17:57:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f37c406be60 msgr2=0x7f37c406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f37c406be60 0x7f37c406e370 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f37dc007fd0 tx=0x7f37dc007de0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37e0162820 msgr2=0x7f37e00ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37e0162820 0x7f37e00ca8d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009e00 tx=0x7f37d800c490 comp rx=0 tx=0).stop 2024-05-20T17:57:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 shutdown_connections 2024-05-20T17:57:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f37c406be60 0x7f37c406e370 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37e0162820 0x7f37e00ca8d0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37e00b8190 0x7f37e0159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 --2- 172.21.15.6:0/1885815343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37e006d3d0 0x7f37e00ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 >> 172.21.15.6:0/1885815343 conn(0x7f37e00d4bd0 msgr2=0x7f37e015fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 shutdown_connections 2024-05-20T17:57:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.437+0000 7f37e7d6b640 1 -- 172.21.15.6:0/1885815343 wait complete. 2024-05-20T17:57:06.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T17:57:06.503 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:57:06.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.572+0000 7f7a0d432640 1 Processor -- start 2024-05-20T17:57:06.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.572+0000 7f7a0d432640 1 -- start start 2024-05-20T17:57:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a0d432640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a080b1e10 0x7f7a0815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a0d432640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7a08070850 0x7f7a08070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a0d432640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a080cd580 con 0x7f7a0815d530 2024-05-20T17:57:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a0d432640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7a080ce190 con 0x7f7a08070850 2024-05-20T17:57:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a0d432640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a080cd860 con 0x7f7a080b1e10 2024-05-20T17:57:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a067fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a080b1e10 0x7f7a0815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a077fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7a08070850 0x7f7a08070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a06ffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7a0815d530 0x7f7a080b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:44034/0 (socket says 172.21.15.6:44034) 2024-05-20T17:57:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a067fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a080b1e10 0x7f7a0815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:41812/0 (socket says 172.21.15.6:41812) 2024-05-20T17:57:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.573+0000 7f7a06ffd640 1 -- 172.21.15.6:0/2290516544 learned_addr learned my addr 172.21.15.6:0/2290516544 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.574+0000 7f7a067fc640 1 -- 172.21.15.6:0/2290516544 >> v2:172.21.15.171:3300/0 conn(0x7f7a08070850 msgr2=0x7f7a08070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.574+0000 7f7a067fc640 1 --2- 172.21.15.6:0/2290516544 >> v2:172.21.15.171:3300/0 conn(0x7f7a08070850 0x7f7a08070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.574+0000 7f7a05ffb640 1 -- 172.21.15.6:0/2290516544 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477436045 0 0) 0x7f7a080cd580 con 0x7f7a0815d530 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.574+0000 7f7a067fc640 1 -- 172.21.15.6:0/2290516544 >> v1:172.21.15.171:6789/0 conn(0x7f7a0815d530 legacy=0x7f7a080b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.574+0000 7f7a067fc640 1 -- 172.21.15.6:0/2290516544 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a080cdb40 con 0x7f7a080b1e10 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.574+0000 7f7a067fc640 1 --2- 172.21.15.6:0/2290516544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a080b1e10 0x7f7a0815aaa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79f00097a0 tx=0x7f79f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55605753fa8a9874 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a05ffb640 1 -- 172.21.15.6:0/2290516544 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0037070 con 0x7f7a080b1e10 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a05ffb640 1 -- 172.21.15.6:0/2290516544 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f0032440 con 0x7f7a080b1e10 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a05ffb640 1 -- 172.21.15.6:0/2290516544 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0032810 con 0x7f7a080b1e10 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a0d432640 1 -- 172.21.15.6:0/2290516544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a080b1e10 msgr2=0x7f7a0815aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a0d432640 1 --2- 172.21.15.6:0/2290516544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a080b1e10 0x7f7a0815aaa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79f00097a0 tx=0x7f79f002a180 comp rx=0 tx=0).stop 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a0d432640 1 -- 172.21.15.6:0/2290516544 shutdown_connections 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a0d432640 1 --2- 172.21.15.6:0/2290516544 >> v2:172.21.15.171:3300/0 conn(0x7f7a08070850 0x7f7a08070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a0d432640 1 --2- 172.21.15.6:0/2290516544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a080b1e10 0x7f7a0815aaa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a0d432640 1 -- 172.21.15.6:0/2290516544 >> 172.21.15.6:0/2290516544 conn(0x7f7a080d29d0 msgr2=0x7f7a080d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a0d432640 1 -- 172.21.15.6:0/2290516544 shutdown_connections 2024-05-20T17:57:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.575+0000 7f7a0d432640 1 -- 172.21.15.6:0/2290516544 wait complete. 2024-05-20T17:57:06.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.577+0000 7f7a0d432640 1 Processor -- start 2024-05-20T17:57:06.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.577+0000 7f7a0d432640 1 -- start start 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.578+0000 7f7a0d432640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a08070850 0x7f7a080cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a0d432640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a080b1e10 0x7f7a080b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a0d432640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0815d530 0x7f7a080c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a0d432640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7a080711a0 con 0x7f7a08070850 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a0d432640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a080cd230 con 0x7f7a080b1e10 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a0d432640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a08071320 con 0x7f7a0815d530 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a08070850 0x7f7a080cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a08070850 0x7f7a080cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46408/0 (socket says 172.21.15.6:46408) 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 -- 172.21.15.6:0/3529817788 learned_addr learned my addr 172.21.15.6:0/3529817788 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a067fc640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a080b1e10 0x7f7a080b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a077fe640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0815d530 0x7f7a080c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 -- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0815d530 msgr2=0x7f7a080c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0815d530 0x7f7a080c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 -- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a080b1e10 msgr2=0x7f7a080b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a080b1e10 0x7f7a080b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 -- 172.21.15.6:0/3529817788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a080ccd50 con 0x7f7a08070850 2024-05-20T17:57:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a06ffd640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a08070850 0x7f7a080cc220 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c440 tx=0x7f79f800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f79ff7fe640 1 -- 172.21.15.6:0/3529817788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f80074e0 con 0x7f7a08070850 2024-05-20T17:57:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f79ff7fe640 1 -- 172.21.15.6:0/3529817788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f80047e0 con 0x7f7a08070850 2024-05-20T17:57:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f79ff7fe640 1 -- 172.21.15.6:0/3529817788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8004bd0 con 0x7f7a08070850 2024-05-20T17:57:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.579+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a081f66a0 con 0x7f7a08070850 2024-05-20T17:57:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.580+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a081f6940 con 0x7f7a08070850 2024-05-20T17:57:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.581+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a08075b00 con 0x7f7a08070850 2024-05-20T17:57:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.581+0000 7f79ff7fe640 1 -- 172.21.15.6:0/3529817788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79f8011070 con 0x7f7a08070850 2024-05-20T17:57:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.581+0000 7f79ff7fe640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f79e806be60 0x7f79e806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.582+0000 7f79ff7fe640 1 -- 172.21.15.6:0/3529817788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f79f808acf0 con 0x7f7a08070850 2024-05-20T17:57:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.582+0000 7f7a067fc640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f79e806be60 0x7f79e806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.582+0000 7f7a067fc640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f79e806be60 0x7f79e806e370 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f79f0034000 tx=0x7f79f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.586+0000 7f79ff7fe640 1 -- 172.21.15.6:0/3529817788 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f79f808f070 con 0x7f7a08070850 2024-05-20T17:57:06.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:06.812+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7a080c9760 con 0x7f7a08070850 2024-05-20T17:57:07.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.435+0000 7f79ff7fe640 1 -- 172.21.15.6:0/3529817788 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) ==== 104+0+0 (secure 0 0 0) 0x7f79f800e280 con 0x7f7a08070850 2024-05-20T17:57:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f79e806be60 msgr2=0x7f79e806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f79e806be60 0x7f79e806e370 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f79f0034000 tx=0x7f79f002e000 comp rx=0 tx=0).stop 2024-05-20T17:57:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a08070850 msgr2=0x7f7a080cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a08070850 0x7f7a080cc220 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c440 tx=0x7f79f800c900 comp rx=0 tx=0).stop 2024-05-20T17:57:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 shutdown_connections 2024-05-20T17:57:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f79e806be60 0x7f79e806e370 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0815d530 0x7f7a080c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a080b1e10 0x7f7a080b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 --2- 172.21.15.6:0/3529817788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a08070850 0x7f7a080cc220 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 >> 172.21.15.6:0/3529817788 conn(0x7f7a080d29d0 msgr2=0x7f7a080b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 shutdown_connections 2024-05-20T17:57:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.438+0000 7f7a0d432640 1 -- 172.21.15.6:0/3529817788 wait complete. 2024-05-20T17:57:07.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T17:57:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.579+0000 7efd50537640 1 Processor -- start 2024-05-20T17:57:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.579+0000 7efd50537640 1 -- start start 2024-05-20T17:57:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd50537640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efd480d45f0 0x7efd4806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd50537640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd480d0450 con 0x7efd4808bd20 2024-05-20T17:57:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd50537640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd480d3b10 con 0x7efd480b3860 2024-05-20T17:57:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd50537640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efd480d3df0 con 0x7efd480d45f0 2024-05-20T17:57:07.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4ead4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efd4808bd20 0x7efd4808c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47060/0 (socket says 172.21.15.6:47060) 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4ead4640 1 -- 172.21.15.6:0/2518256391 learned_addr learned my addr 172.21.15.6:0/2518256391 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4dad2640 1 --2- 172.21.15.6:0/2518256391 >> v2:172.21.15.171:3300/0 conn(0x7efd480d45f0 0x7efd4806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4d2d1640 1 -- 172.21.15.6:0/2518256391 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184502239 0 0) 0x7efd480d0450 con 0x7efd4808bd20 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4d2d1640 1 -- 172.21.15.6:0/2518256391 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd30003520 con 0x7efd4808bd20 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4d2d1640 1 -- 172.21.15.6:0/2518256391 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812945521 0 0) 0x7efd480d3b10 con 0x7efd480b3860 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4d2d1640 1 -- 172.21.15.6:0/2518256391 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd480d0450 con 0x7efd480b3860 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4d2d1640 1 -- 172.21.15.6:0/2518256391 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3631204137 0 0) 0x7efd30003520 con 0x7efd4808bd20 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4dad2640 1 -- 172.21.15.6:0/2518256391 >> v1:172.21.15.171:6789/0 conn(0x7efd480b3860 legacy=0x7efd4815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4dad2640 1 -- 172.21.15.6:0/2518256391 >> v1:172.21.15.6:6789/0 conn(0x7efd4808bd20 legacy=0x7efd4808c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:07.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.581+0000 7efd4dad2640 1 -- 172.21.15.6:0/2518256391 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd480d40d0 con 0x7efd480d45f0 2024-05-20T17:57:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.582+0000 7efd4dad2640 1 --2- 172.21.15.6:0/2518256391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 0x7efd4806d870 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0097a0 tx=0x7efd3c02a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac507015789e24a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.582+0000 7efd4d2d1640 1 -- 172.21.15.6:0/2518256391 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c037070 con 0x7efd480d45f0 2024-05-20T17:57:07.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd4d2d1640 1 -- 172.21.15.6:0/2518256391 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3c02ab30 con 0x7efd480d45f0 2024-05-20T17:57:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd4d2d1640 1 -- 172.21.15.6:0/2518256391 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd380019f0 con 0x7efd480d45f0 2024-05-20T17:57:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd50537640 1 -- 172.21.15.6:0/2518256391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 msgr2=0x7efd4806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd50537640 1 --2- 172.21.15.6:0/2518256391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 0x7efd4806d870 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0097a0 tx=0x7efd3c02a0a0 comp rx=0 tx=0).stop 2024-05-20T17:57:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd50537640 1 -- 172.21.15.6:0/2518256391 shutdown_connections 2024-05-20T17:57:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd50537640 1 --2- 172.21.15.6:0/2518256391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 0x7efd4806d870 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd50537640 1 -- 172.21.15.6:0/2518256391 >> 172.21.15.6:0/2518256391 conn(0x7efd480b6d10 msgr2=0x7efd4806d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd50537640 1 -- 172.21.15.6:0/2518256391 shutdown_connections 2024-05-20T17:57:07.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.583+0000 7efd50537640 1 -- 172.21.15.6:0/2518256391 wait complete. 2024-05-20T17:57:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.585+0000 7efd50537640 1 Processor -- start 2024-05-20T17:57:07.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.585+0000 7efd50537640 1 -- start start 2024-05-20T17:57:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.586+0000 7efd50537640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd4808bd20 0x7efd4815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.586+0000 7efd50537640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd480b3860 0x7efd4814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:07.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.586+0000 7efd50537640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 0x7efd4815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.586+0000 7efd50537640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd4816a0f0 con 0x7efd4808bd20 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.586+0000 7efd50537640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efd48169f70 con 0x7efd480d45f0 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.586+0000 7efd50537640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd4816a270 con 0x7efd480b3860 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.586+0000 7efd4e2d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd4808bd20 0x7efd4815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4e2d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd4808bd20 0x7efd4815a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46414/0 (socket says 172.21.15.6:46414) 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4e2d3640 1 -- 172.21.15.6:0/1997820645 learned_addr learned my addr 172.21.15.6:0/1997820645 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4dad2640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd480b3860 0x7efd4814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4ead4640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 0x7efd4815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4e2d3640 1 -- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd480b3860 msgr2=0x7efd4814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4e2d3640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd480b3860 0x7efd4814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4e2d3640 1 -- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 msgr2=0x7efd4815bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:07.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4e2d3640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 0x7efd4815bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4e2d3640 1 -- 172.21.15.6:0/1997820645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd48157360 con 0x7efd4808bd20 2024-05-20T17:57:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4ead4640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 0x7efd4815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd4e2d3640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd4808bd20 0x7efd4815a070 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c3c0 tx=0x7efd4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd46ffd640 1 -- 172.21.15.6:0/1997820645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40017070 con 0x7efd4808bd20 2024-05-20T17:57:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd46ffd640 1 -- 172.21.15.6:0/1997820645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd400052f0 con 0x7efd4808bd20 2024-05-20T17:57:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4815cbe0 con 0x7efd4808bd20 2024-05-20T17:57:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd46ffd640 1 -- 172.21.15.6:0/1997820645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40003830 con 0x7efd4808bd20 2024-05-20T17:57:07.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.587+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd48157900 con 0x7efd4808bd20 2024-05-20T17:57:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.588+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd480690b0 con 0x7efd4808bd20 2024-05-20T17:57:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.589+0000 7efd46ffd640 1 -- 172.21.15.6:0/1997820645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd4001a070 con 0x7efd4808bd20 2024-05-20T17:57:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.589+0000 7efd46ffd640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd3406be30 0x7efd3406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.590+0000 7efd46ffd640 1 -- 172.21.15.6:0/1997820645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7efd4008a340 con 0x7efd4808bd20 2024-05-20T17:57:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.590+0000 7efd4dad2640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd3406be30 0x7efd3406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:07.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.590+0000 7efd4dad2640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd3406be30 0x7efd3406e340 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efd3c034000 tx=0x7efd3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:07.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.594+0000 7efd46ffd640 1 -- 172.21.15.6:0/1997820645 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd40058580 con 0x7efd4808bd20 2024-05-20T17:57:07.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:07.780+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7efd480c8300 con 0x7efd4808bd20 2024-05-20T17:57:08.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.439+0000 7efd46ffd640 1 -- 172.21.15.6:0/1997820645 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7efd4005c880 con 0x7efd4808bd20 2024-05-20T17:57:08.438 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd3406be30 msgr2=0x7efd3406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd3406be30 0x7efd3406e340 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efd3c034000 tx=0x7efd3c02e000 comp rx=0 tx=0).stop 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd4808bd20 msgr2=0x7efd4815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd4808bd20 0x7efd4815a070 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c3c0 tx=0x7efd4000c880 comp rx=0 tx=0).stop 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 shutdown_connections 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efd3406be30 0x7efd3406e340 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd480d45f0 0x7efd4815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd480b3860 0x7efd4814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 --2- 172.21.15.6:0/1997820645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd4808bd20 0x7efd4815a070 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:08.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 >> 172.21.15.6:0/1997820645 conn(0x7efd480b6d10 msgr2=0x7efd4815f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:08.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 shutdown_connections 2024-05-20T17:57:08.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.442+0000 7efd50537640 1 -- 172.21.15.6:0/1997820645 wait complete. 2024-05-20T17:57:08.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T17:57:08.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.585+0000 7fefbaab6640 1 Processor -- start 2024-05-20T17:57:08.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.585+0000 7fefbaab6640 1 -- start start 2024-05-20T17:57:08.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.586+0000 7fefbaab6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fefb408c430 0x7fefb406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:08.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.586+0000 7fefbaab6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb40d0450 con 0x7fefb40d45f0 2024-05-20T17:57:08.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.586+0000 7fefbaab6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb40d3b10 con 0x7fefb40b3860 2024-05-20T17:57:08.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.586+0000 7fefbaab6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fefb40d3df0 con 0x7fefb408c430 2024-05-20T17:57:08.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.586+0000 7fefb9053640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fefb408c430 0x7fefb406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:08.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.586+0000 7fefabfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fefb40d45f0 0x7fefb408bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38674/0 (socket says 172.21.15.6:38674) 2024-05-20T17:57:08.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.586+0000 7fefb9053640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fefb408c430 0x7fefb406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44654/0 (socket says 172.21.15.6:44654) 2024-05-20T17:57:08.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.586+0000 7fefabfff640 1 -- 172.21.15.6:0/913254443 learned_addr learned my addr 172.21.15.6:0/913254443 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:08.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.587+0000 7fefb9053640 1 -- 172.21.15.6:0/913254443 >> v1:172.21.15.171:6789/0 conn(0x7fefb40b3860 legacy=0x7fefb415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:08.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.587+0000 7fefb9053640 1 -- 172.21.15.6:0/913254443 >> v1:172.21.15.6:6789/0 conn(0x7fefb40d45f0 legacy=0x7fefb408bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:08.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.587+0000 7fefab7fe640 1 -- 172.21.15.6:0/913254443 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604500752 0 0) 0x7fefb40d0450 con 0x7fefb40d45f0 2024-05-20T17:57:08.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.587+0000 7fefb9053640 1 -- 172.21.15.6:0/913254443 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb40d40d0 con 0x7fefb408c430 2024-05-20T17:57:08.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefb9053640 1 --2- 172.21.15.6:0/913254443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb408c430 0x7fefb406d870 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fefac009d90 tx=0x7fefac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d961bac0d8d42e42 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:08.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefab7fe640 1 -- 172.21.15.6:0/913254443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac031600 con 0x7fefb408c430 2024-05-20T17:57:08.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefab7fe640 1 -- 172.21.15.6:0/913254443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefac0317a0 con 0x7fefb408c430 2024-05-20T17:57:08.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefab7fe640 1 -- 172.21.15.6:0/913254443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac031b70 con 0x7fefb408c430 2024-05-20T17:57:08.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefbaab6640 1 -- 172.21.15.6:0/913254443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb408c430 msgr2=0x7fefb406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:08.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefbaab6640 1 --2- 172.21.15.6:0/913254443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb408c430 0x7fefb406d870 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fefac009d90 tx=0x7fefac02a5d0 comp rx=0 tx=0).stop 2024-05-20T17:57:08.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefbaab6640 1 -- 172.21.15.6:0/913254443 shutdown_connections 2024-05-20T17:57:08.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefbaab6640 1 --2- 172.21.15.6:0/913254443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb408c430 0x7fefb406d870 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:08.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.588+0000 7fefbaab6640 1 -- 172.21.15.6:0/913254443 >> 172.21.15.6:0/913254443 conn(0x7fefb40b6d10 msgr2=0x7fefb406d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:08.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.589+0000 7fefbaab6640 1 -- 172.21.15.6:0/913254443 shutdown_connections 2024-05-20T17:57:08.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.589+0000 7fefbaab6640 1 -- 172.21.15.6:0/913254443 wait complete. 2024-05-20T17:57:08.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.590+0000 7fefbaab6640 1 Processor -- start 2024-05-20T17:57:08.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.590+0000 7fefbaab6640 1 -- start start 2024-05-20T17:57:08.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefbaab6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40b3860 0x7fefb414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefbaab6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb40d45f0 0x7fefb413c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefbaab6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb414d570 0x7fefb413cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefbaab6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fefb416a0f0 con 0x7fefb40b3860 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefbaab6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fefb4169f70 con 0x7fefb40d45f0 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefbaab6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fefb416a270 con 0x7fefb414d570 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40b3860 0x7fefb414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40b3860 0x7fefb414a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44660/0 (socket says 172.21.15.6:44660) 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 -- 172.21.15.6:0/151582490 learned_addr learned my addr 172.21.15.6:0/151582490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefabfff640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb40d45f0 0x7fefb413c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb9053640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb414d570 0x7fefb413cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 -- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb414d570 msgr2=0x7fefb413cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb414d570 0x7fefb413cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 -- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb40d45f0 msgr2=0x7fefb413c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb40d45f0 0x7fefb413c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 -- 172.21.15.6:0/151582490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb414adf0 con 0x7fefb40b3860 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefabfff640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb40d45f0 0x7fefb413c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.592+0000 7fefb8852640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40b3860 0x7fefb414a8b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fefb000c3f0 tx=0x7fefb000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.593+0000 7fefa97fa640 1 -- 172.21.15.6:0/151582490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0017070 con 0x7fefb40b3860 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.593+0000 7fefa97fa640 1 -- 172.21.15.6:0/151582490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb00052f0 con 0x7fefb40b3860 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.593+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb413d3e0 con 0x7fefb40b3860 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.593+0000 7fefa97fa640 1 -- 172.21.15.6:0/151582490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0003830 con 0x7fefb40b3860 2024-05-20T17:57:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.593+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb4150610 con 0x7fefb40b3860 2024-05-20T17:57:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.594+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb40690b0 con 0x7fefb40b3860 2024-05-20T17:57:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.594+0000 7fefa97fa640 1 -- 172.21.15.6:0/151582490 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefb001a070 con 0x7fefb40b3860 2024-05-20T17:57:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.595+0000 7fefa97fa640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefa006be30 0x7fefa006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.595+0000 7fefa97fa640 1 -- 172.21.15.6:0/151582490 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5749+0+0 (secure 0 0 0) 0x7fefb008a280 con 0x7fefb40b3860 2024-05-20T17:57:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.595+0000 7fefabfff640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefa006be30 0x7fefa006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.596+0000 7fefabfff640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefa006be30 0x7fefa006e340 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fefb40b37d0 tx=0x7fefa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.599+0000 7fefa97fa640 1 -- 172.21.15.6:0/151582490 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fefb0058b70 con 0x7fefb40b3860 2024-05-20T17:57:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:08.783+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fefb406d910 con 0x7fefb40b3860 2024-05-20T17:57:09.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.441+0000 7fefa97fa640 1 -- 172.21.15.6:0/151582490 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7fefb0058470 con 0x7fefb40b3860 2024-05-20T17:57:09.440 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T17:57:09.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefa006be30 msgr2=0x7fefa006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefa006be30 0x7fefa006e340 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fefb40b37d0 tx=0x7fefa4009040 comp rx=0 tx=0).stop 2024-05-20T17:57:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40b3860 msgr2=0x7fefb414a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40b3860 0x7fefb414a8b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fefb000c3f0 tx=0x7fefb000c8b0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 shutdown_connections 2024-05-20T17:57:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fefa006be30 0x7fefa006e340 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fefb414d570 0x7fefb413cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb40d45f0 0x7fefb413c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 --2- 172.21.15.6:0/151582490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40b3860 0x7fefb414a8b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 >> 172.21.15.6:0/151582490 conn(0x7fefb40b6d10 msgr2=0x7fefb41545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.445+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 shutdown_connections 2024-05-20T17:57:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.446+0000 7fefbaab6640 1 -- 172.21.15.6:0/151582490 wait complete. 2024-05-20T17:57:09.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T17:57:09.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.586+0000 7f5fe48f9640 1 Processor -- start 2024-05-20T17:57:09.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.586+0000 7f5fe48f9640 1 -- start start 2024-05-20T17:57:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fe48f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5fe0162820 0x7f5fe00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fe48f9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5fe00b3e80 0x7f5fe006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fe48f9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe006dd20 con 0x7f5fe006d910 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fe48f9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5fe00d0630 con 0x7f5fe0162820 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fe48f9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5fe00d39c0 con 0x7f5fe00b3e80 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fde59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5fe0162820 0x7f5fe00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fde59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5fe0162820 0x7f5fe00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44670/0 (socket says 172.21.15.6:44670) 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fde59c640 1 -- 172.21.15.6:0/1495196127 learned_addr learned my addr 172.21.15.6:0/1495196127 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fddd9b640 1 --2- 172.21.15.6:0/1495196127 >> v2:172.21.15.171:3300/0 conn(0x7f5fe00b3e80 0x7f5fe006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fde59c640 1 -- 172.21.15.6:0/1495196127 >> v2:172.21.15.171:3300/0 conn(0x7f5fe00b3e80 msgr2=0x7f5fe006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fde59c640 1 --2- 172.21.15.6:0/1495196127 >> v2:172.21.15.171:3300/0 conn(0x7f5fe00b3e80 0x7f5fe006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fde59c640 1 -- 172.21.15.6:0/1495196127 >> v1:172.21.15.171:6789/0 conn(0x7f5fe006d910 legacy=0x7f5fe00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:09.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.588+0000 7f5fde59c640 1 -- 172.21.15.6:0/1495196127 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe00d3ca0 con 0x7f5fe0162820 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.589+0000 7f5fde59c640 1 --2- 172.21.15.6:0/1495196127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe0162820 0x7f5fe00b3940 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00d1230 tx=0x7f5fd002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7e38cdc991a9a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.589+0000 7f5fdd59a640 1 -- 172.21.15.6:0/1495196127 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0036070 con 0x7f5fe0162820 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.589+0000 7f5fdd59a640 1 -- 172.21.15.6:0/1495196127 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd0031600 con 0x7f5fe0162820 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.589+0000 7f5fdd59a640 1 -- 172.21.15.6:0/1495196127 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00319d0 con 0x7f5fe0162820 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.590+0000 7f5fe48f9640 1 -- 172.21.15.6:0/1495196127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe0162820 msgr2=0x7f5fe00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.590+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/1495196127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe0162820 0x7f5fe00b3940 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00d1230 tx=0x7f5fd002a6f0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.590+0000 7f5fe48f9640 1 -- 172.21.15.6:0/1495196127 shutdown_connections 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.590+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/1495196127 >> v2:172.21.15.171:3300/0 conn(0x7f5fe00b3e80 0x7f5fe006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.590+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/1495196127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe0162820 0x7f5fe00b3940 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.590+0000 7f5fe48f9640 1 -- 172.21.15.6:0/1495196127 >> 172.21.15.6:0/1495196127 conn(0x7f5fe00d4bd0 msgr2=0x7f5fe00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.590+0000 7f5fe48f9640 1 -- 172.21.15.6:0/1495196127 shutdown_connections 2024-05-20T17:57:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.590+0000 7f5fe48f9640 1 -- 172.21.15.6:0/1495196127 wait complete. 2024-05-20T17:57:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.592+0000 7f5fe48f9640 1 Processor -- start 2024-05-20T17:57:09.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.592+0000 7f5fe48f9640 1 -- start start 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.593+0000 7f5fe48f9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fe006d910 0x7f5fe00c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.593+0000 7f5fe48f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe00b3e80 0x7f5fe014b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fe48f9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fe0162820 0x7f5fe01e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fe48f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe00d0300 con 0x7f5fe00b3e80 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fe48f9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe00d4260 con 0x7f5fe006d910 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fe48f9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe00b91a0 con 0x7f5fe0162820 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe00b3e80 0x7f5fe014b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe00b3e80 0x7f5fe014b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44686/0 (socket says 172.21.15.6:44686) 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 -- 172.21.15.6:0/97046580 learned_addr learned my addr 172.21.15.6:0/97046580 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fde59c640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fe006d910 0x7f5fe00c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fded9d640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fe0162820 0x7f5fe01e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 -- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fe0162820 msgr2=0x7f5fe01e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fe0162820 0x7f5fe01e79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 -- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fe006d910 msgr2=0x7f5fe00c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fe006d910 0x7f5fe00c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 -- 172.21.15.6:0/97046580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe014a2b0 con 0x7f5fe00b3e80 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fde59c640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fe006d910 0x7f5fe00c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fded9d640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fe0162820 0x7f5fe01e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fddd9b640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe00b3e80 0x7f5fe014b350 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800c7f0 tx=0x7f5fc800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fd6ffd640 1 -- 172.21.15.6:0/97046580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8015070 con 0x7f5fe00b3e80 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fd6ffd640 1 -- 172.21.15.6:0/97046580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc8004220 con 0x7f5fe00b3e80 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe014a590 con 0x7f5fe00b3e80 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.594+0000 7f5fd6ffd640 1 -- 172.21.15.6:0/97046580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8007620 con 0x7f5fe00b3e80 2024-05-20T17:57:09.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.595+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe014ab50 con 0x7f5fe00b3e80 2024-05-20T17:57:09.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.595+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe014a020 con 0x7f5fe00b3e80 2024-05-20T17:57:09.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.596+0000 7f5fd6ffd640 1 -- 172.21.15.6:0/97046580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fc80077c0 con 0x7f5fe00b3e80 2024-05-20T17:57:09.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.596+0000 7f5fd6ffd640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5fc006be60 0x7f5fc006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.597+0000 7f5fd6ffd640 1 -- 172.21.15.6:0/97046580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f5fc808ab50 con 0x7f5fe00b3e80 2024-05-20T17:57:09.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.597+0000 7f5fde59c640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5fc006be60 0x7f5fc006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.598+0000 7f5fde59c640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5fc006be60 0x7f5fc006e370 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0033000 tx=0x7f5fd0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:09.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.601+0000 7f5fd6ffd640 1 -- 172.21.15.6:0/97046580 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5fc80595f0 con 0x7f5fe00b3e80 2024-05-20T17:57:09.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.788+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5fe0075b00 con 0x7f5fe00b3e80 2024-05-20T17:57:09.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.792+0000 7f5fd6ffd640 1 -- 172.21.15.6:0/97046580 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7f5fc8058ef0 con 0x7f5fe00b3e80 2024-05-20T17:57:09.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5fc006be60 msgr2=0x7f5fc006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5fc006be60 0x7f5fc006e370 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0033000 tx=0x7f5fd0009000 comp rx=0 tx=0).stop 2024-05-20T17:57:09.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe00b3e80 msgr2=0x7f5fe014b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe00b3e80 0x7f5fe014b350 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f5fc800c7f0 tx=0x7f5fc800ccb0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 shutdown_connections 2024-05-20T17:57:09.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5fc006be60 0x7f5fc006e370 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fe0162820 0x7f5fe01e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fe00b3e80 0x7f5fe014b350 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 --2- 172.21.15.6:0/97046580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fe006d910 0x7f5fe00c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 >> 172.21.15.6:0/97046580 conn(0x7f5fe00d4bd0 msgr2=0x7f5fe00b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:09.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 shutdown_connections 2024-05-20T17:57:09.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.794+0000 7f5fe48f9640 1 -- 172.21.15.6:0/97046580 wait complete. 2024-05-20T17:57:09.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_caps_per_client 2024-05-20T17:57:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.922+0000 7f6b0b4fe640 1 Processor -- start 2024-05-20T17:57:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.922+0000 7f6b0b4fe640 1 -- start start 2024-05-20T17:57:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b0b4fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0415f220 0x7f6b040d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b0b4fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b040d0e00 0x7f6b040cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b0b4fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6b040cf910 0x7f6b040ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b0b4fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6b040cfd20 con 0x7f6b040d0e00 2024-05-20T17:57:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b0b4fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6b040cda20 con 0x7f6b040cf910 2024-05-20T17:57:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b0b4fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6b040cdd00 con 0x7f6b0415f220 2024-05-20T17:57:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b08a99640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b040d0e00 0x7f6b040cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b08a99640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b040d0e00 0x7f6b040cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44702/0 (socket says 172.21.15.6:44702) 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b08a99640 1 -- 172.21.15.6:0/1809465598 learned_addr learned my addr 172.21.15.6:0/1809465598 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b0929a640 1 --2- 172.21.15.6:0/1809465598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0415f220 0x7f6b040d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b09a9b640 1 --2- 172.21.15.6:0/1809465598 >> v2:172.21.15.171:3300/0 conn(0x7f6b040cf910 0x7f6b040ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b08a99640 1 -- 172.21.15.6:0/1809465598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0415f220 msgr2=0x7f6b040d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b08a99640 1 --2- 172.21.15.6:0/1809465598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0415f220 0x7f6b040d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b08a99640 1 -- 172.21.15.6:0/1809465598 >> v2:172.21.15.171:3300/0 conn(0x7f6b040cf910 msgr2=0x7f6b040ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b08a99640 1 --2- 172.21.15.6:0/1809465598 >> v2:172.21.15.171:3300/0 conn(0x7f6b040cf910 0x7f6b040ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.924+0000 7f6b08a99640 1 -- 172.21.15.6:0/1809465598 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b040cdfe0 con 0x7f6b040d0e00 2024-05-20T17:57:09.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.925+0000 7f6b08a99640 1 --2- 172.21.15.6:0/1809465598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040d0e00 0x7f6b040cf3d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6b0406ce40 tx=0x7f6af402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5821dbf84d5b2055 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:09.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.925+0000 7f6afbfff640 1 -- 172.21.15.6:0/1809465598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4037070 con 0x7f6b040d0e00 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.925+0000 7f6afbfff640 1 -- 172.21.15.6:0/1809465598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af4032440 con 0x7f6b040d0e00 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.925+0000 7f6afbfff640 1 -- 172.21.15.6:0/1809465598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4032810 con 0x7f6b040d0e00 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/1809465598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040d0e00 msgr2=0x7f6b040cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/1809465598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040d0e00 0x7f6b040cf3d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6b0406ce40 tx=0x7f6af402a140 comp rx=0 tx=0).stop 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/1809465598 shutdown_connections 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/1809465598 >> v2:172.21.15.171:3300/0 conn(0x7f6b040cf910 0x7f6b040ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/1809465598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040d0e00 0x7f6b040cf3d0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/1809465598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b0415f220 0x7f6b040d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/1809465598 >> 172.21.15.6:0/1809465598 conn(0x7f6b040b44d0 msgr2=0x7f6b040b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/1809465598 shutdown_connections 2024-05-20T17:57:09.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.926+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/1809465598 wait complete. 2024-05-20T17:57:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.928+0000 7f6b0b4fe640 1 Processor -- start 2024-05-20T17:57:09.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.928+0000 7f6b0b4fe640 1 -- start start 2024-05-20T17:57:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0b4fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040cf910 0x7f6b041f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0b4fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b040d0e00 0x7f6b0414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0b4fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b0415f220 0x7f6b0414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0b4fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6b040cd800 con 0x7f6b040cf910 2024-05-20T17:57:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0b4fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6b040cd680 con 0x7f6b0415f220 2024-05-20T17:57:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0b4fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0415f630 con 0x7f6b040d0e00 2024-05-20T17:57:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0929a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040cf910 0x7f6b041f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0929a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040cf910 0x7f6b041f63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44714/0 (socket says 172.21.15.6:44714) 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0929a640 1 -- 172.21.15.6:0/4103417147 learned_addr learned my addr 172.21.15.6:0/4103417147 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b08a99640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b040d0e00 0x7f6b0414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b09a9b640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b0415f220 0x7f6b0414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0929a640 1 -- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b040d0e00 msgr2=0x7f6b0414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0929a640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b040d0e00 0x7f6b0414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0929a640 1 -- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b0415f220 msgr2=0x7f6b0414ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0929a640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b0415f220 0x7f6b0414ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.929+0000 7f6b0929a640 1 -- 172.21.15.6:0/4103417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b041f5820 con 0x7f6b040cf910 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.930+0000 7f6b0929a640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040cf910 0x7f6b041f63d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000d600 tx=0x7f6b0000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.930+0000 7f6af9ffb640 1 -- 172.21.15.6:0/4103417147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00004240 con 0x7f6b040cf910 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.930+0000 7f6af9ffb640 1 -- 172.21.15.6:0/4103417147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b000043e0 con 0x7f6b040cf910 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.930+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0415d340 con 0x7f6b040cf910 2024-05-20T17:57:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.930+0000 7f6af9ffb640 1 -- 172.21.15.6:0/4103417147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00003830 con 0x7f6b040cf910 2024-05-20T17:57:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.930+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0415d900 con 0x7f6b040cf910 2024-05-20T17:57:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.931+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b04075b00 con 0x7f6b040cf910 2024-05-20T17:57:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.932+0000 7f6af9ffb640 1 -- 172.21.15.6:0/4103417147 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b000039d0 con 0x7f6b040cf910 2024-05-20T17:57:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.932+0000 7f6af9ffb640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ae806be60 0x7f6ae806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.932+0000 7f6af9ffb640 1 -- 172.21.15.6:0/4103417147 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f6b0008af40 con 0x7f6b040cf910 2024-05-20T17:57:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.933+0000 7f6b08a99640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ae806be60 0x7f6ae806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.933+0000 7f6b08a99640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ae806be60 0x7f6ae806e370 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6af4034000 tx=0x7f6af402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:09.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:09.937+0000 7f6af9ffb640 1 -- 172.21.15.6:0/4103417147 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6b000599d0 con 0x7f6b040cf910 2024-05-20T17:57:10.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.121+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"} v 0) -- 0x7f6b04162c60 con 0x7f6b040cf910 2024-05-20T17:57:10.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.126+0000 7f6af9ffb640 1 -- 172.21.15.6:0/4103417147 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"}]=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7f6b000592d0 con 0x7f6b040cf910 2024-05-20T17:57:10.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ae806be60 msgr2=0x7f6ae806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:10.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ae806be60 0x7f6ae806e370 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6af4034000 tx=0x7f6af402e000 comp rx=0 tx=0).stop 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040cf910 msgr2=0x7f6b041f63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040cf910 0x7f6b041f63d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000d600 tx=0x7f6b0000dac0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 shutdown_connections 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ae806be60 0x7f6ae806e370 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b0415f220 0x7f6b0414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b040d0e00 0x7f6b0414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 --2- 172.21.15.6:0/4103417147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b040cf910 0x7f6b041f63d0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.128+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 >> 172.21.15.6:0/4103417147 conn(0x7f6b040b44d0 msgr2=0x7f6b040d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.129+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 shutdown_connections 2024-05-20T17:57:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.129+0000 7f6b0b4fe640 1 -- 172.21.15.6:0/4103417147 wait complete. 2024-05-20T17:57:10.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps' 2024-05-20T17:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.254+0000 7fbdd0832640 1 Processor -- start 2024-05-20T17:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.254+0000 7fbdd0832640 1 -- start start 2024-05-20T17:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdd0832640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdcc162820 0x7fbdcc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdd0832640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdcc0d0630 con 0x7fbdcc06dae0 2024-05-20T17:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdd0832640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdcc0d39c0 con 0x7fbdcc0b3e80 2024-05-20T17:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdd0832640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbdcc0d3ca0 con 0x7fbdcc162820 2024-05-20T17:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdca59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdcc162820 0x7fbdcc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdcad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbdcc06dae0 0x7fbdcc0b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38684/0 (socket says 172.21.15.6:38684) 2024-05-20T17:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdcad9d640 1 -- 172.21.15.6:0/2367541947 learned_addr learned my addr 172.21.15.6:0/2367541947 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdca59c640 1 -- 172.21.15.6:0/2367541947 >> v1:172.21.15.171:6789/0 conn(0x7fbdcc0b3e80 legacy=0x7fbdcc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdca59c640 1 -- 172.21.15.6:0/2367541947 >> v1:172.21.15.6:6789/0 conn(0x7fbdcc06dae0 legacy=0x7fbdcc0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdc959a640 1 -- 172.21.15.6:0/2367541947 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710504014 0 0) 0x7fbdcc0d0630 con 0x7fbdcc06dae0 2024-05-20T17:57:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.256+0000 7fbdca59c640 1 -- 172.21.15.6:0/2367541947 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdcc0d3f80 con 0x7fbdcc162820 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.257+0000 7fbdca59c640 1 --2- 172.21.15.6:0/2367541947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc162820 0x7fbdcc0b3940 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d90 tx=0x7fbdc402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7255de657da1f75d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.257+0000 7fbdc959a640 1 -- 172.21.15.6:0/2367541947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4007740 con 0x7fbdcc162820 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.257+0000 7fbdc959a640 1 -- 172.21.15.6:0/2367541947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc40078e0 con 0x7fbdcc162820 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.257+0000 7fbdc959a640 1 -- 172.21.15.6:0/2367541947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4007cb0 con 0x7fbdcc162820 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.258+0000 7fbdd0832640 1 -- 172.21.15.6:0/2367541947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc162820 msgr2=0x7fbdcc0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.258+0000 7fbdd0832640 1 --2- 172.21.15.6:0/2367541947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc162820 0x7fbdcc0b3940 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d90 tx=0x7fbdc402a6a0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.258+0000 7fbdd0832640 1 -- 172.21.15.6:0/2367541947 shutdown_connections 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.258+0000 7fbdd0832640 1 --2- 172.21.15.6:0/2367541947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc162820 0x7fbdcc0b3940 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.258+0000 7fbdd0832640 1 -- 172.21.15.6:0/2367541947 >> 172.21.15.6:0/2367541947 conn(0x7fbdcc0d4bd0 msgr2=0x7fbdcc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:10.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.258+0000 7fbdd0832640 1 -- 172.21.15.6:0/2367541947 shutdown_connections 2024-05-20T17:57:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.258+0000 7fbdd0832640 1 -- 172.21.15.6:0/2367541947 wait complete. 2024-05-20T17:57:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.260+0000 7fbdd0832640 1 Processor -- start 2024-05-20T17:57:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.260+0000 7fbdd0832640 1 -- start start 2024-05-20T17:57:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.261+0000 7fbdd0832640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdcc0b3e80 0x7fbdcc0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.261+0000 7fbdd0832640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdcc162820 0x7fbdcc0c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.261+0000 7fbdd0832640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc0b5290 0x7fbdcc0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.261+0000 7fbdd0832640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc0d4780 con 0x7fbdcc0b5290 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.261+0000 7fbdd0832640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc0d0300 con 0x7fbdcc0b3e80 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.261+0000 7fbdd0832640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbdcc0d4900 con 0x7fbdcc162820 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc0b5290 0x7fbdcc0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc0b5290 0x7fbdcc0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44726/0 (socket says 172.21.15.6:44726) 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 -- 172.21.15.6:0/1253069868 learned_addr learned my addr 172.21.15.6:0/1253069868 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdca59c640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdcc0b3e80 0x7fbdcc0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdc9d9b640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdcc162820 0x7fbdcc0c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 -- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdcc162820 msgr2=0x7fbdcc0c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdcc162820 0x7fbdcc0c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 -- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdcc0b3e80 msgr2=0x7fbdcc0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdcc0b3e80 0x7fbdcc0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 -- 172.21.15.6:0/1253069868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdcc156460 con 0x7fbdcc0b5290 2024-05-20T17:57:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdcad9d640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc0b5290 0x7fbdcc0caca0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00c440 tx=0x7fbdbc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdc2ffd640 1 -- 172.21.15.6:0/1253069868 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0074e0 con 0x7fbdcc0b5290 2024-05-20T17:57:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdc2ffd640 1 -- 172.21.15.6:0/1253069868 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdbc0047e0 con 0x7fbdcc0b5290 2024-05-20T17:57:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdcc0cc8e0 con 0x7fbdcc0b5290 2024-05-20T17:57:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.262+0000 7fbdc2ffd640 1 -- 172.21.15.6:0/1253069868 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004bd0 con 0x7fbdcc0b5290 2024-05-20T17:57:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.263+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdcc0b59e0 con 0x7fbdcc0b5290 2024-05-20T17:57:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.263+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdcc0b5c40 con 0x7fbdcc0b5290 2024-05-20T17:57:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.264+0000 7fbdc2ffd640 1 -- 172.21.15.6:0/1253069868 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdbc011070 con 0x7fbdcc0b5290 2024-05-20T17:57:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.265+0000 7fbdc2ffd640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdac06be30 0x7fbdac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.265+0000 7fbdc2ffd640 1 -- 172.21.15.6:0/1253069868 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fbdbc08a6d0 con 0x7fbdcc0b5290 2024-05-20T17:57:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.265+0000 7fbdca59c640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdac06be30 0x7fbdac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.265+0000 7fbdca59c640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdac06be30 0x7fbdac06e340 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4034000 tx=0x7fbdc402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.269+0000 7fbdc2ffd640 1 -- 172.21.15.6:0/1253069868 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbdcc156460 con 0x7fbdcc0b5290 2024-05-20T17:57:10.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:10.539+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]} v 0) -- 0x7fbdcc0ca2a0 con 0x7fbdcc0b5290 2024-05-20T17:57:11.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.454+0000 7fbdc2ffd640 1 -- 172.21.15.6:0/1253069868 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]}]=0 v239) ==== 148+0+0 (secure 0 0 0) 0x7fbdbc058ba0 con 0x7fbdcc0b5290 2024-05-20T17:57:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdac06be30 msgr2=0x7fbdac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdac06be30 0x7fbdac06e340 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4034000 tx=0x7fbdc402f000 comp rx=0 tx=0).stop 2024-05-20T17:57:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc0b5290 msgr2=0x7fbdcc0caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc0b5290 0x7fbdcc0caca0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00c440 tx=0x7fbdbc00c900 comp rx=0 tx=0).stop 2024-05-20T17:57:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 shutdown_connections 2024-05-20T17:57:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdac06be30 0x7fbdac06e340 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdcc0b5290 0x7fbdcc0caca0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdcc162820 0x7fbdcc0c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 --2- 172.21.15.6:0/1253069868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdcc0b3e80 0x7fbdcc0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 >> 172.21.15.6:0/1253069868 conn(0x7fbdcc0d4bd0 msgr2=0x7fbdcc0ba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 shutdown_connections 2024-05-20T17:57:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.457+0000 7fbdd0832640 1 -- 172.21.15.6:0/1253069868 wait complete. 2024-05-20T17:57:11.470 INFO:tasks.cephfs_test_runner:That the MDS will not let a client sit above mds_max_caps_per_client caps. ... ok 2024-05-20T17:57:11.470 INFO:tasks.cephfs_test_runner:Starting test: test_client_min_caps_working_set (tasks.cephfs.test_client_limits.TestClientLimits) When a client has inodes pinned in its cache (open files), that the MDS 2024-05-20T17:57:11.470 INFO:tasks.cephfs_test_runner:test_client_min_caps_working_set (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T17:57:11.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:11.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.594+0000 7fcf1852f640 1 Processor -- start 2024-05-20T17:57:11.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.594+0000 7fcf1852f640 1 -- start start 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf1852f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf100b6d90 0x7fcf1015f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf1852f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf100d0550 con 0x7fcf100cf250 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf1852f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf100d0830 con 0x7fcf100d3220 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf1852f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1015f9a0 con 0x7fcf100b6d90 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf162cb640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcf100cf250 0x7fcf100b6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38698/0 (socket says 172.21.15.6:38698) 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf162cb640 1 -- 172.21.15.6:0/2851888180 learned_addr learned my addr 172.21.15.6:0/2851888180 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf15aca640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf100b6d90 0x7fcf1015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3458519807 0 0) 0x7fcf100d0550 con 0x7fcf100cf250 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcefc003520 con 0x7fcf100cf250 2024-05-20T17:57:11.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2065519886 0 0) 0x7fcefc003520 con 0x7fcf100cf250 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf100b6d90 msgr2=0x7fcf1015f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf100b6d90 0x7fcf1015f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 >> v1:172.21.15.171:6789/0 conn(0x7fcf100d3220 legacy=0x7fcf100d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf100d2a20 con 0x7fcf100cf250 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fcf0c001670 con 0x7fcf100cf250 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 >> v1:172.21.15.6:6789/0 conn(0x7fcf100cf250 legacy=0x7fcf100b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcefc0039e0 0x7fcefc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcefc004800 0x7fcefc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcefc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1015f9a0 con 0x7fcefc005150 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.596+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc00bf30 con 0x7fcefc0039e0 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcefc00c130 con 0x7fcefc004800 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf16acc640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcefc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf162cb640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcefc0039e0 0x7fcefc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf15aca640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcefc004800 0x7fcefc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf16acc640 1 -- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcefc004800 msgr2=0x7fcefc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:11.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf16acc640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcefc004800 0x7fcefc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf16acc640 1 -- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcefc0039e0 msgr2=0x7fcefc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:11.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf16acc640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcefc0039e0 0x7fcefc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.597+0000 7fcf16acc640 1 -- 172.21.15.6:0/2851888180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcefc003520 con 0x7fcefc005150 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.598+0000 7fcf16acc640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcefc00b9c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcf08001e20 tx=0x7fcefc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da76ad57e10e4c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.598+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08001a70 con 0x7fcefc005150 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.598+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0802ae40 con 0x7fcefc005150 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.598+0000 7fcf152c9640 1 -- 172.21.15.6:0/2851888180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08003bb0 con 0x7fcefc005150 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.599+0000 7fcf1852f640 1 -- 172.21.15.6:0/2851888180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 msgr2=0x7fcefc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.599+0000 7fcf1852f640 1 --2- 172.21.15.6:0/2851888180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcefc00b9c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcf08001e20 tx=0x7fcefc005830 comp rx=0 tx=0).stop 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.599+0000 7fcf16acc640 1 -- 172.21.15.6:0/2851888180 reap_dead start 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.599+0000 7fcf1852f640 1 -- 172.21.15.6:0/2851888180 shutdown_connections 2024-05-20T17:57:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.599+0000 7fcf1852f640 1 -- 172.21.15.6:0/2851888180 >> 172.21.15.6:0/2851888180 conn(0x7fcf100d1860 msgr2=0x7fcf100d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.599+0000 7fcf1852f640 1 -- 172.21.15.6:0/2851888180 shutdown_connections 2024-05-20T17:57:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.599+0000 7fcf1852f640 1 -- 172.21.15.6:0/2851888180 wait complete. 2024-05-20T17:57:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.600+0000 7fcf1852f640 1 Processor -- start 2024-05-20T17:57:11.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.601+0000 7fcf1852f640 1 -- start start 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf1852f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcf101eb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf1852f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf101475e0 0x7fcf10146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf1852f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf10148dd0 0x7fcf101e8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf1852f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcf100d27d0 con 0x7fcefc005150 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf1852f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcf100d0140 con 0x7fcf10148dd0 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf1852f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcf100d02c0 con 0x7fcf101475e0 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf162cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcf101eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf162cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcf101eb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44756/0 (socket says 172.21.15.6:44756) 2024-05-20T17:57:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf162cb640 1 -- 172.21.15.6:0/1196263706 learned_addr learned my addr 172.21.15.6:0/1196263706 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf15aca640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf101475e0 0x7fcf10146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf16acc640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf10148dd0 0x7fcf101e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf162cb640 1 -- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf101475e0 msgr2=0x7fcf10146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf162cb640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf101475e0 0x7fcf10146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf162cb640 1 -- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf10148dd0 msgr2=0x7fcf101e8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf162cb640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf10148dd0 0x7fcf101e8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.602+0000 7fcf162cb640 1 -- 172.21.15.6:0/1196263706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf10147d30 con 0x7fcefc005150 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.603+0000 7fcf162cb640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcf101eb090 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c007340 tx=0x7fcf0c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.603+0000 7fcf06ffd640 1 -- 172.21.15.6:0/1196263706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c00f8e0 con 0x7fcefc005150 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.603+0000 7fcf06ffd640 1 -- 172.21.15.6:0/1196263706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0c018070 con 0x7fcefc005150 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.603+0000 7fcf06ffd640 1 -- 172.21.15.6:0/1196263706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c00fcc0 con 0x7fcefc005150 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.603+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf10148010 con 0x7fcefc005150 2024-05-20T17:57:11.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.603+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf101485d0 con 0x7fcefc005150 2024-05-20T17:57:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.604+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf10075b00 con 0x7fcefc005150 2024-05-20T17:57:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.604+0000 7fcf06ffd640 1 -- 172.21.15.6:0/1196263706 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf0c01d460 con 0x7fcefc005150 2024-05-20T17:57:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.605+0000 7fcf06ffd640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef406be60 0x7fcef406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.605+0000 7fcf06ffd640 1 -- 172.21.15.6:0/1196263706 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fcf0c08adf0 con 0x7fcefc005150 2024-05-20T17:57:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.605+0000 7fcf15aca640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef406be60 0x7fcef406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.606+0000 7fcf15aca640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef406be60 0x7fcef406e370 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcf1015b650 tx=0x7fcf00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:11.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.610+0000 7fcf06ffd640 1 -- 172.21.15.6:0/1196263706 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcf0c00fe60 con 0x7fcefc005150 2024-05-20T17:57:11.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.793+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf100b7440 con 0x7fcefc005150 2024-05-20T17:57:11.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.793+0000 7fcf06ffd640 1 -- 172.21.15.6:0/1196263706 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13242 (secure 0 0 0) 0x7fcf0c059230 con 0x7fcefc005150 2024-05-20T17:57:11.792 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:11.792 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:09.440395+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/693481794":"2024-05-21T17:57:06.433347+0000","172.21.15.6:6834/693481794":"2024-05-21T17:57:06.433347+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:11.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.795+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef406be60 msgr2=0x7fcef406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.795+0000 7fcf1852f640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef406be60 0x7fcef406e370 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcf1015b650 tx=0x7fcf00008040 comp rx=0 tx=0).stop 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.795+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 msgr2=0x7fcf101eb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.795+0000 7fcf1852f640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcf101eb090 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c007340 tx=0x7fcf0c007800 comp rx=0 tx=0).stop 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.795+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 shutdown_connections 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.796+0000 7fcf1852f640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef406be60 0x7fcef406e370 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.796+0000 7fcf1852f640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf10148dd0 0x7fcf101e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.796+0000 7fcf1852f640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf101475e0 0x7fcf10146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.796+0000 7fcf1852f640 1 --2- 172.21.15.6:0/1196263706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcefc005150 0x7fcf101eb090 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.796+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 >> 172.21.15.6:0/1196263706 conn(0x7fcf100d1860 msgr2=0x7fcf100d4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.796+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 shutdown_connections 2024-05-20T17:57:11.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.796+0000 7fcf1852f640 1 -- 172.21.15.6:0/1196263706 wait complete. 2024-05-20T17:57:11.805 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:57:11.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:57:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.924+0000 7f581b12f640 1 Processor -- start 2024-05-20T17:57:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.924+0000 7f581b12f640 1 -- start start 2024-05-20T17:57:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f581b12f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f581406d3d0 0x7f581406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f581b12f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58140b8190 0x7f58140b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f581b12f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581406dd20 con 0x7f5814162820 2024-05-20T17:57:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f581b12f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f58140d0630 con 0x7f581406d3d0 2024-05-20T17:57:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f581b12f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58140d39c0 con 0x7f58140b8190 2024-05-20T17:57:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f5818ecb640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5814162820 0x7f58140b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38702/0 (socket says 172.21.15.6:38702) 2024-05-20T17:57:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f5818ecb640 1 -- 172.21.15.6:0/2136951883 learned_addr learned my addr 172.21.15.6:0/2136951883 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f5813fff640 1 --2- 172.21.15.6:0/2136951883 >> v2:172.21.15.171:3300/0 conn(0x7f581406d3d0 0x7f581406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f58196cc640 1 --2- 172.21.15.6:0/2136951883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58140b8190 0x7f58140b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f58137fe640 1 -- 172.21.15.6:0/2136951883 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584781802 0 0) 0x7f5804001110 con 0x7f5814162820 2024-05-20T17:57:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f58137fe640 1 -- 172.21.15.6:0/2136951883 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57fc003520 con 0x7f5814162820 2024-05-20T17:57:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f5813fff640 1 -- 172.21.15.6:0/2136951883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58140b8190 msgr2=0x7f58140b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f5813fff640 1 --2- 172.21.15.6:0/2136951883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58140b8190 0x7f58140b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f5813fff640 1 -- 172.21.15.6:0/2136951883 >> v1:172.21.15.6:6789/0 conn(0x7f5814162820 legacy=0x7f58140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.926+0000 7f5813fff640 1 -- 172.21.15.6:0/2136951883 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58140d3ca0 con 0x7f581406d3d0 2024-05-20T17:57:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.927+0000 7f5813fff640 1 --2- 172.21.15.6:0/2136951883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f581406d3d0 0x7f581406d7e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f58080097a0 tx=0x7f580802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f297bc6fc566734 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f58137fe640 1 -- 172.21.15.6:0/2136951883 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808037070 con 0x7f581406d3d0 2024-05-20T17:57:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f58137fe640 1 -- 172.21.15.6:0/2136951883 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5808032440 con 0x7f581406d3d0 2024-05-20T17:57:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f58137fe640 1 -- 172.21.15.6:0/2136951883 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808032810 con 0x7f581406d3d0 2024-05-20T17:57:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f581b12f640 1 -- 172.21.15.6:0/2136951883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f581406d3d0 msgr2=0x7f581406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f581b12f640 1 --2- 172.21.15.6:0/2136951883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f581406d3d0 0x7f581406d7e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f58080097a0 tx=0x7f580802a180 comp rx=0 tx=0).stop 2024-05-20T17:57:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f581b12f640 1 -- 172.21.15.6:0/2136951883 shutdown_connections 2024-05-20T17:57:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f581b12f640 1 --2- 172.21.15.6:0/2136951883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58140b8190 0x7f58140b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f581b12f640 1 --2- 172.21.15.6:0/2136951883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f581406d3d0 0x7f581406d7e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f581b12f640 1 -- 172.21.15.6:0/2136951883 >> 172.21.15.6:0/2136951883 conn(0x7f58140d4bd0 msgr2=0x7f58140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f581b12f640 1 -- 172.21.15.6:0/2136951883 shutdown_connections 2024-05-20T17:57:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.928+0000 7f581b12f640 1 -- 172.21.15.6:0/2136951883 wait complete. 2024-05-20T17:57:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.930+0000 7f581b12f640 1 Processor -- start 2024-05-20T17:57:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.930+0000 7f581b12f640 1 -- start start 2024-05-20T17:57:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.931+0000 7f581b12f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f581406d3d0 0x7f581414bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.931+0000 7f581b12f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58140b8190 0x7f58141e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f581b12f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5814162820 0x7f58141f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f581b12f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f58140d0300 con 0x7f5814162820 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f581b12f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58140d4260 con 0x7f58140b8190 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f581b12f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58140b4050 con 0x7f581406d3d0 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5814162820 0x7f58141f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5814162820 0x7f58141f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44764/0 (socket says 172.21.15.6:44764) 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 -- 172.21.15.6:0/3298247159 learned_addr learned my addr 172.21.15.6:0/3298247159 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f5818ecb640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f581406d3d0 0x7f581414bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f5813fff640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58140b8190 0x7f58141e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 -- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f581406d3d0 msgr2=0x7f581414bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f581406d3d0 0x7f581414bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 -- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58140b8190 msgr2=0x7f58141e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58140b8190 0x7f58141e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 -- 172.21.15.6:0/3298247159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58140cd150 con 0x7f5814162820 2024-05-20T17:57:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58196cc640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5814162820 0x7f58141f8ed0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f580c00efc0 tx=0x7f580c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58117fa640 1 -- 172.21.15.6:0/3298247159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c018020 con 0x7f5814162820 2024-05-20T17:57:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58117fa640 1 -- 172.21.15.6:0/3298247159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c014480 con 0x7f5814162820 2024-05-20T17:57:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.932+0000 7f58117fa640 1 -- 172.21.15.6:0/3298247159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c009e60 con 0x7f5814162820 2024-05-20T17:57:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.933+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58140cd430 con 0x7f5814162820 2024-05-20T17:57:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.933+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58141e90c0 con 0x7f5814162820 2024-05-20T17:57:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.933+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5814075b00 con 0x7f5814162820 2024-05-20T17:57:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.934+0000 7f58117fa640 1 -- 172.21.15.6:0/3298247159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f580c005d10 con 0x7f5814162820 2024-05-20T17:57:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.935+0000 7f58117fa640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f580006be60 0x7f580006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.935+0000 7f58117fa640 1 -- 172.21.15.6:0/3298247159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f580c08b810 con 0x7f5814162820 2024-05-20T17:57:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.935+0000 7f5818ecb640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f580006be60 0x7f580006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.936+0000 7f5818ecb640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f580006be60 0x7f580006e370 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5804005880 tx=0x7f5804009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:11.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:11.939+0000 7f58117fa640 1 -- 172.21.15.6:0/3298247159 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f580c022030 con 0x7f5814162820 2024-05-20T17:57:12.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.122+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5814068770 con 0x7f5814162820 2024-05-20T17:57:12.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.123+0000 7f58117fa640 1 -- 172.21.15.6:0/3298247159 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f580c010040 con 0x7f5814162820 2024-05-20T17:57:12.122 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:57:12.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f580006be60 msgr2=0x7f580006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f580006be60 0x7f580006e370 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5804005880 tx=0x7f5804009040 comp rx=0 tx=0).stop 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5814162820 msgr2=0x7f58141f8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5814162820 0x7f58141f8ed0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f580c00efc0 tx=0x7f580c00c490 comp rx=0 tx=0).stop 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 shutdown_connections 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f580006be60 0x7f580006e370 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5814162820 0x7f58141f8ed0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58140b8190 0x7f58141e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 --2- 172.21.15.6:0/3298247159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f581406d3d0 0x7f581414bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 >> 172.21.15.6:0/3298247159 conn(0x7f58140d4bd0 msgr2=0x7f58140b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 shutdown_connections 2024-05-20T17:57:12.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.125+0000 7f581b12f640 1 -- 172.21.15.6:0/3298247159 wait complete. 2024-05-20T17:57:12.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set' 2024-05-20T17:57:12.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.251+0000 7fd2493d5640 1 Processor -- start 2024-05-20T17:57:12.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.251+0000 7fd2493d5640 1 -- start start 2024-05-20T17:57:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.252+0000 7fd2493d5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd24415d060 0x7fd2440b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.252+0000 7fd2493d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2440b5720 0x7fd24406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.252+0000 7fd2493d5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2440b5b30 con 0x7fd2440b47b0 2024-05-20T17:57:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2493d5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd2440b39f0 con 0x7fd24415d060 2024-05-20T17:57:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2493d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd2440b3cd0 con 0x7fd2440b5720 2024-05-20T17:57:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd242ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd2440b47b0 0x7fd2440afad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38704/0 (socket says 172.21.15.6:38704) 2024-05-20T17:57:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd242ffd640 1 -- 172.21.15.6:0/4099042951 learned_addr learned my addr 172.21.15.6:0/4099042951 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2427fc640 1 --2- 172.21.15.6:0/4099042951 >> v2:172.21.15.171:3300/0 conn(0x7fd24415d060 0x7fd2440b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2437fe640 1 --2- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2440b5720 0x7fd24406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd241ffb640 1 -- 172.21.15.6:0/4099042951 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917002929 0 0) 0x7fd234001490 con 0x7fd2440b47b0 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd241ffb640 1 -- 172.21.15.6:0/4099042951 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd230003520 con 0x7fd2440b47b0 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd241ffb640 1 -- 172.21.15.6:0/4099042951 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4046010698 0 0) 0x7fd230003520 con 0x7fd2440b47b0 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2427fc640 1 -- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2440b5720 msgr2=0x7fd24406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2427fc640 1 --2- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2440b5720 0x7fd24406f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2427fc640 1 -- 172.21.15.6:0/4099042951 >> v1:172.21.15.6:6789/0 conn(0x7fd2440b47b0 legacy=0x7fd2440afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2427fc640 1 -- 172.21.15.6:0/4099042951 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2440b3fb0 con 0x7fd24415d060 2024-05-20T17:57:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.253+0000 7fd2437fe640 1 --2- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2440b5720 0x7fd24406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:12.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.254+0000 7fd2427fc640 1 --2- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 0x7fd2440b51e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0097a0 tx=0x7fd22c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b8b2d308e5c359b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:12.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.254+0000 7fd241ffb640 1 -- 172.21.15.6:0/4099042951 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c037070 con 0x7fd24415d060 2024-05-20T17:57:12.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.254+0000 7fd241ffb640 1 -- 172.21.15.6:0/4099042951 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c02aba0 con 0x7fd24415d060 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.254+0000 7fd241ffb640 1 -- 172.21.15.6:0/4099042951 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234001bc0 con 0x7fd24415d060 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.255+0000 7fd2493d5640 1 -- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 msgr2=0x7fd2440b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.255+0000 7fd2493d5640 1 --2- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 0x7fd2440b51e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0097a0 tx=0x7fd22c02a110 comp rx=0 tx=0).stop 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.255+0000 7fd2493d5640 1 -- 172.21.15.6:0/4099042951 shutdown_connections 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.255+0000 7fd2493d5640 1 --2- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2440b5720 0x7fd24406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.255+0000 7fd2493d5640 1 --2- 172.21.15.6:0/4099042951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 0x7fd2440b51e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.255+0000 7fd2493d5640 1 -- 172.21.15.6:0/4099042951 >> 172.21.15.6:0/4099042951 conn(0x7fd2440cd2a0 msgr2=0x7fd2440cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.255+0000 7fd2493d5640 1 -- 172.21.15.6:0/4099042951 shutdown_connections 2024-05-20T17:57:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.255+0000 7fd2493d5640 1 -- 172.21.15.6:0/4099042951 wait complete. 2024-05-20T17:57:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.257+0000 7fd2493d5640 1 Processor -- start 2024-05-20T17:57:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.257+0000 7fd2493d5640 1 -- start start 2024-05-20T17:57:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.258+0000 7fd2493d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2440b5720 0x7fd2440c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.258+0000 7fd2493d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 0x7fd244157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.258+0000 7fd2493d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd244148970 0x7fd2441490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd2493d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd244159de0 con 0x7fd2440b5720 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd2493d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd244159c60 con 0x7fd24415d060 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd2493d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd24406f910 con 0x7fd244148970 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2440b5720 0x7fd2440c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2440b5720 0x7fd2440c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44774/0 (socket says 172.21.15.6:44774) 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 -- 172.21.15.6:0/3038300306 learned_addr learned my addr 172.21.15.6:0/3038300306 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd2437fe640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd244148970 0x7fd2441490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd2427fc640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 0x7fd244157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 -- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd244148970 msgr2=0x7fd2441490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd244148970 0x7fd2441490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 -- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 msgr2=0x7fd244157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 0x7fd244157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 -- 172.21.15.6:0/3038300306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2441569b0 con 0x7fd2440b5720 2024-05-20T17:57:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd242ffd640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2440b5720 0x7fd2440c57c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd23400cc90 tx=0x7fd23400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd23b7fe640 1 -- 172.21.15.6:0/3038300306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234017070 con 0x7fd2440b5720 2024-05-20T17:57:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd23b7fe640 1 -- 172.21.15.6:0/3038300306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd234012400 con 0x7fd2440b5720 2024-05-20T17:57:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24415d910 con 0x7fd2440b5720 2024-05-20T17:57:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd23b7fe640 1 -- 172.21.15.6:0/3038300306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2340127f0 con 0x7fd2440b5720 2024-05-20T17:57:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.259+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24415dbf0 con 0x7fd2440b5720 2024-05-20T17:57:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.260+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd244075b00 con 0x7fd2440b5720 2024-05-20T17:57:12.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.261+0000 7fd23b7fe640 1 -- 172.21.15.6:0/3038300306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd23401a070 con 0x7fd2440b5720 2024-05-20T17:57:12.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.262+0000 7fd23b7fe640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd22406be30 0x7fd22406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:12.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.262+0000 7fd23b7fe640 1 -- 172.21.15.6:0/3038300306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fd23408ab80 con 0x7fd2440b5720 2024-05-20T17:57:12.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.262+0000 7fd2427fc640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd22406be30 0x7fd22406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:12.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.262+0000 7fd2427fc640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd22406be30 0x7fd22406e340 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd22c034000 tx=0x7fd22c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.266+0000 7fd23b7fe640 1 -- 172.21.15.6:0/3038300306 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd2440b5b30 con 0x7fd2440b5720 2024-05-20T17:57:12.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:12.520+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]} v 0) -- 0x7fd24415aa50 con 0x7fd2440b5720 2024-05-20T17:57:13.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.462+0000 7fd23b7fe640 1 -- 172.21.15.6:0/3038300306 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]}]=0 v241) ==== 163+0+0 (secure 0 0 0) 0x7fd234058fc0 con 0x7fd2440b5720 2024-05-20T17:57:13.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd22406be30 msgr2=0x7fd22406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd22406be30 0x7fd22406e340 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd22c034000 tx=0x7fd22c02e000 comp rx=0 tx=0).stop 2024-05-20T17:57:13.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2440b5720 msgr2=0x7fd2440c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2440b5720 0x7fd2440c57c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd23400cc90 tx=0x7fd23400a430 comp rx=0 tx=0).stop 2024-05-20T17:57:13.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 shutdown_connections 2024-05-20T17:57:13.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd22406be30 0x7fd22406e340 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd244148970 0x7fd2441490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd24415d060 0x7fd244157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 --2- 172.21.15.6:0/3038300306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2440b5720 0x7fd2440c57c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 >> 172.21.15.6:0/3038300306 conn(0x7fd2440cd2a0 msgr2=0x7fd24415a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:13.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 shutdown_connections 2024-05-20T17:57:13.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.465+0000 7fd2493d5640 1 -- 172.21.15.6:0/3038300306 wait complete. 2024-05-20T17:57:13.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T17:57:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.607+0000 7f5a8e14c640 1 Processor -- start 2024-05-20T17:57:13.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.607+0000 7f5a8e14c640 1 -- start start 2024-05-20T17:57:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.608+0000 7f5a8e14c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a880d17f0 0x7f5a8815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.608+0000 7f5a8e14c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a880cd580 con 0x7f5a880b1e10 2024-05-20T17:57:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.608+0000 7f5a8e14c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a880cd860 con 0x7f5a8815d530 2024-05-20T17:57:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.608+0000 7f5a8e14c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5a880ce190 con 0x7f5a880d17f0 2024-05-20T17:57:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.608+0000 7f5a86ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5a880b1e10 0x7f5a88070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38714/0 (socket says 172.21.15.6:38714) 2024-05-20T17:57:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.608+0000 7f5a86ffd640 1 -- 172.21.15.6:0/3992383301 learned_addr learned my addr 172.21.15.6:0/3992383301 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a87fff640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a880d17f0 0x7f5a8815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495755485 0 0) 0x7f5a880cd580 con 0x7f5a880b1e10 2024-05-20T17:57:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a70003520 con 0x7f5a880b1e10 2024-05-20T17:57:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2129583242 0 0) 0x7f5a70003520 con 0x7f5a880b1e10 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a880d17f0 msgr2=0x7f5a8815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a880d17f0 0x7f5a8815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 >> v1:172.21.15.171:6789/0 conn(0x7f5a8815d530 legacy=0x7f5a880b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a880cdb40 con 0x7f5a880b1e10 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5a7c001670 con 0x7f5a880b1e10 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 >> v1:172.21.15.6:6789/0 conn(0x7f5a880b1e10 legacy=0x7f5a88070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a70003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a880d17f0 0x7f5a70004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a70004d40 0x7f5a70005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880ce190 con 0x7f5a700039e0 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7000ba70 con 0x7f5a70004d40 2024-05-20T17:57:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7000bc70 con 0x7f5a880d17f0 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a877fe640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a70003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a87fff640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a70004d40 0x7f5a70005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.609+0000 7f5a86ffd640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a880d17f0 0x7f5a70004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.610+0000 7f5a877fe640 1 -- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a880d17f0 msgr2=0x7f5a70004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.610+0000 7f5a877fe640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a880d17f0 0x7f5a70004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.610+0000 7f5a877fe640 1 -- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a70004d40 msgr2=0x7f5a70005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.610+0000 7f5a877fe640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a70004d40 0x7f5a70005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.610+0000 7f5a877fe640 1 -- 172.21.15.6:0/3992383301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a70003520 con 0x7f5a700039e0 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.610+0000 7f5a877fe640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a70003e10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5a78001830 tx=0x7f5a70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1012ec2a545255ed server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78037070 con 0x7f5a700039e0 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7802abf0 con 0x7f5a700039e0 2024-05-20T17:57:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a867fc640 1 -- 172.21.15.6:0/3992383301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78001430 con 0x7f5a700039e0 2024-05-20T17:57:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a8e14c640 1 -- 172.21.15.6:0/3992383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 msgr2=0x7f5a70003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a8e14c640 1 --2- 172.21.15.6:0/3992383301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a70003e10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f5a78001830 tx=0x7f5a70005830 comp rx=0 tx=0).stop 2024-05-20T17:57:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a87fff640 1 -- 172.21.15.6:0/3992383301 reap_dead start 2024-05-20T17:57:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a8e14c640 1 -- 172.21.15.6:0/3992383301 shutdown_connections 2024-05-20T17:57:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a8e14c640 1 -- 172.21.15.6:0/3992383301 >> 172.21.15.6:0/3992383301 conn(0x7f5a880d29d0 msgr2=0x7f5a880d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a8e14c640 1 -- 172.21.15.6:0/3992383301 shutdown_connections 2024-05-20T17:57:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.611+0000 7f5a8e14c640 1 -- 172.21.15.6:0/3992383301 wait complete. 2024-05-20T17:57:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.613+0000 7f5a8e14c640 1 Processor -- start 2024-05-20T17:57:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.613+0000 7f5a8e14c640 1 -- start start 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a8e14c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a880c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a8e14c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a8814ccf0 0x7f5a8815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a8e14c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a881f3350 0x7f5a880c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a8e14c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8815aaa0 con 0x7f5a700039e0 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a8e14c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880cd230 con 0x7f5a8814ccf0 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a8e14c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8815ac20 con 0x7f5a881f3350 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a880c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a880c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44792/0 (socket says 172.21.15.6:44792) 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 -- 172.21.15.6:0/1507767500 learned_addr learned my addr 172.21.15.6:0/1507767500 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a86ffd640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a8814ccf0 0x7f5a8815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a87fff640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a881f3350 0x7f5a880c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 -- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a881f3350 msgr2=0x7f5a880c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a881f3350 0x7f5a880c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 -- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a8814ccf0 msgr2=0x7f5a8815c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a8814ccf0 0x7f5a8815c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 -- 172.21.15.6:0/1507767500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a880c9690 con 0x7f5a700039e0 2024-05-20T17:57:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.615+0000 7f5a877fe640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a880c6500 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5a78001950 tx=0x7f5a78001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.616+0000 7f5a6ffff640 1 -- 172.21.15.6:0/1507767500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7803f020 con 0x7f5a700039e0 2024-05-20T17:57:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.616+0000 7f5a6ffff640 1 -- 172.21.15.6:0/1507767500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a78005270 con 0x7f5a700039e0 2024-05-20T17:57:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.616+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8815b650 con 0x7f5a700039e0 2024-05-20T17:57:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.616+0000 7f5a6ffff640 1 -- 172.21.15.6:0/1507767500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78037040 con 0x7f5a700039e0 2024-05-20T17:57:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.616+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8815bc10 con 0x7f5a700039e0 2024-05-20T17:57:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.617+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a88075b00 con 0x7f5a700039e0 2024-05-20T17:57:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.617+0000 7f5a6ffff640 1 -- 172.21.15.6:0/1507767500 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a78042020 con 0x7f5a700039e0 2024-05-20T17:57:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.618+0000 7f5a6ffff640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5a7406be30 0x7f5a7406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.618+0000 7f5a6ffff640 1 -- 172.21.15.6:0/1507767500 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f5a780aaa10 con 0x7f5a700039e0 2024-05-20T17:57:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.618+0000 7f5a86ffd640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5a7406be30 0x7f5a7406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.619+0000 7f5a86ffd640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5a7406be30 0x7f5a7406e340 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c001200 tx=0x7f5a7c001110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.622+0000 7f5a6ffff640 1 -- 172.21.15.6:0/1507767500 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5a78049030 con 0x7f5a700039e0 2024-05-20T17:57:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.805+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5a880c6a40 con 0x7f5a700039e0 2024-05-20T17:57:13.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.808+0000 7f5a6ffff640 1 -- 172.21.15.6:0/1507767500 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f5a78078ee0 con 0x7f5a700039e0 2024-05-20T17:57:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.810+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5a7406be30 msgr2=0x7f5a7406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.810+0000 7f5a8e14c640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5a7406be30 0x7f5a7406e340 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c001200 tx=0x7f5a7c001110 comp rx=0 tx=0).stop 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.810+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 msgr2=0x7f5a880c6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.810+0000 7f5a8e14c640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a880c6500 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5a78001950 tx=0x7f5a78001230 comp rx=0 tx=0).stop 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.811+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 shutdown_connections 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.811+0000 7f5a8e14c640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5a7406be30 0x7f5a7406e340 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.811+0000 7f5a8e14c640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a881f3350 0x7f5a880c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.811+0000 7f5a8e14c640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a8814ccf0 0x7f5a8815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.811+0000 7f5a8e14c640 1 --2- 172.21.15.6:0/1507767500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a700039e0 0x7f5a880c6500 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.811+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 >> 172.21.15.6:0/1507767500 conn(0x7f5a880d29d0 msgr2=0x7f5a8815f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.811+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 shutdown_connections 2024-05-20T17:57:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:13.811+0000 7f5a8e14c640 1 -- 172.21.15.6:0/1507767500 wait complete. 2024-05-20T17:57:13.821 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:57:13.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:57:13.867 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:57:13.917 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:57:13.918 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:57:13.918 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:13.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:57:13.934 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:57:13.934 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:13.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:57:13.952 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:57:13.952 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:13.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:57:13.989 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:57:13.989 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:14.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:57:14.010 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T17:57:14.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:57:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.146+0000 7f2057061640 1 Processor -- start 2024-05-20T17:57:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.146+0000 7f2057061640 1 -- start start 2024-05-20T17:57:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.147+0000 7f2057061640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f20500cf3d0 0x7f20500cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.147+0000 7f2057061640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f2057061640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20500cfd20 con 0x7f205015f220 2024-05-20T17:57:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f2057061640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f20500cf130 con 0x7f20500cf3d0 2024-05-20T17:57:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f2057061640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f20500cda20 con 0x7f20500ce7e0 2024-05-20T17:57:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f20555fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f204ffff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f20500cf3d0 0x7f20500cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f2054dfd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f205015f220 0x7f20500d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:38004/0 (socket says 172.21.15.6:38004) 2024-05-20T17:57:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f2054dfd640 1 -- 172.21.15.6:0/2561470937 learned_addr learned my addr 172.21.15.6:0/2561470937 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f204f7fe640 1 -- 172.21.15.6:0/2561470937 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386239692 0 0) 0x7f2040001110 con 0x7f205015f220 2024-05-20T17:57:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f204f7fe640 1 -- 172.21.15.6:0/2561470937 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2038003520 con 0x7f205015f220 2024-05-20T17:57:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f20555fe640 1 -- 172.21.15.6:0/2561470937 >> v2:172.21.15.171:3300/0 conn(0x7f20500cf3d0 msgr2=0x7f20500cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f20555fe640 1 --2- 172.21.15.6:0/2561470937 >> v2:172.21.15.171:3300/0 conn(0x7f20500cf3d0 0x7f20500cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f20555fe640 1 -- 172.21.15.6:0/2561470937 >> v1:172.21.15.171:6789/0 conn(0x7f205015f220 legacy=0x7f20500d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f20555fe640 1 -- 172.21.15.6:0/2561470937 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20500cdd00 con 0x7f20500ce7e0 2024-05-20T17:57:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.148+0000 7f204ffff640 1 --2- 172.21.15.6:0/2561470937 >> v2:172.21.15.171:3300/0 conn(0x7f20500cf3d0 0x7f20500cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.149+0000 7f20555fe640 1 --2- 172.21.15.6:0/2561470937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500cebf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2048009d90 tx=0x7f204802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48560698ee3f8406 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.149+0000 7f204f7fe640 1 -- 172.21.15.6:0/2561470937 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048031600 con 0x7f20500ce7e0 2024-05-20T17:57:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.149+0000 7f204f7fe640 1 -- 172.21.15.6:0/2561470937 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20480317a0 con 0x7f20500ce7e0 2024-05-20T17:57:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.149+0000 7f204f7fe640 1 -- 172.21.15.6:0/2561470937 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048031b50 con 0x7f20500ce7e0 2024-05-20T17:57:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.150+0000 7f2057061640 1 -- 172.21.15.6:0/2561470937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 msgr2=0x7f20500cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.150+0000 7f2057061640 1 --2- 172.21.15.6:0/2561470937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500cebf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2048009d90 tx=0x7f204802a5d0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.150+0000 7f2057061640 1 -- 172.21.15.6:0/2561470937 shutdown_connections 2024-05-20T17:57:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.150+0000 7f2057061640 1 --2- 172.21.15.6:0/2561470937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500cebf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.150+0000 7f2057061640 1 --2- 172.21.15.6:0/2561470937 >> v2:172.21.15.171:3300/0 conn(0x7f20500cf3d0 0x7f20500cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.150+0000 7f2057061640 1 -- 172.21.15.6:0/2561470937 >> 172.21.15.6:0/2561470937 conn(0x7f20500b44d0 msgr2=0x7f20500b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.150+0000 7f2057061640 1 -- 172.21.15.6:0/2561470937 shutdown_connections 2024-05-20T17:57:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.150+0000 7f2057061640 1 -- 172.21.15.6:0/2561470937 wait complete. 2024-05-20T17:57:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.152+0000 7f2057061640 1 Processor -- start 2024-05-20T17:57:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.152+0000 7f2057061640 1 -- start start 2024-05-20T17:57:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.153+0000 7f2057061640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.153+0000 7f2057061640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20500cf3d0 0x7f205015bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.153+0000 7f2057061640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f205015f220 0x7f2050160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.153+0000 7f2057061640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f20500d0fd0 con 0x7f20500cf3d0 2024-05-20T17:57:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.153+0000 7f2057061640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20500ce2c0 con 0x7f205015f220 2024-05-20T17:57:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.153+0000 7f2057061640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f20500cd680 con 0x7f20500ce7e0 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20500cf3d0 0x7f205015bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20500cf3d0 0x7f205015bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44804/0 (socket says 172.21.15.6:44804) 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 -- 172.21.15.6:0/764206546 learned_addr learned my addr 172.21.15.6:0/764206546 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f2054dfd640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f20555fe640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f205015f220 0x7f2050160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 -- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 msgr2=0x7f20500b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 -- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f205015f220 msgr2=0x7f2050160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f205015f220 0x7f2050160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 -- 172.21.15.6:0/764206546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205015aab0 con 0x7f20500cf3d0 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f20555fe640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f205015f220 0x7f2050160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204ffff640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20500cf3d0 0x7f205015bb50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f204400e8d0 tx=0x7f204400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204d7fa640 1 -- 172.21.15.6:0/764206546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044017070 con 0x7f20500cf3d0 2024-05-20T17:57:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204d7fa640 1 -- 172.21.15.6:0/764206546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204400c940 con 0x7f20500cf3d0 2024-05-20T17:57:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205015ad90 con 0x7f20500cf3d0 2024-05-20T17:57:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.154+0000 7f204d7fa640 1 -- 172.21.15.6:0/764206546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204400cd30 con 0x7f20500cf3d0 2024-05-20T17:57:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.155+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205015b350 con 0x7f20500cf3d0 2024-05-20T17:57:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.155+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2050075b00 con 0x7f20500cf3d0 2024-05-20T17:57:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.156+0000 7f204d7fa640 1 -- 172.21.15.6:0/764206546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f204401a070 con 0x7f20500cf3d0 2024-05-20T17:57:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.157+0000 7f204d7fa640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f203c06be30 0x7f203c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.157+0000 7f204d7fa640 1 -- 172.21.15.6:0/764206546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f204408a7f0 con 0x7f20500cf3d0 2024-05-20T17:57:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.157+0000 7f2054dfd640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f203c06be30 0x7f203c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.158+0000 7f2054dfd640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f203c06be30 0x7f203c06e340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2040005880 tx=0x7f2040009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.161+0000 7f204d7fa640 1 -- 172.21.15.6:0/764206546 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2044058b90 con 0x7f20500cf3d0 2024-05-20T17:57:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.388+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2050162c60 con 0x7f20500cf3d0 2024-05-20T17:57:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.389+0000 7f204d7fa640 1 -- 172.21.15.6:0/764206546 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+3866 (secure 0 0 0) 0x7f204405ce90 con 0x7f20500cf3d0 2024-05-20T17:57:14.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:14.388 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2390071400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2390071400},{"type":"v1","addr":"172.21.15.6:6833","nonce":2390071400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/2452270322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":2452270322},{"type":"v1","addr":"172.21.15.171:6837","nonce":2452270322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6280,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1659202936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1659202936},{"type":"v1","addr":"172.21.15.171:6836","nonce":1659202936}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6993,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/899195983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":899195983},{"type":"v1","addr":"172.21.15.6:6835","nonce":899195983}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":46}],"filesystems":[]} 2024-05-20T17:57:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 46 2024-05-20T17:57:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f203c06be30 msgr2=0x7f203c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f203c06be30 0x7f203c06e340 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2040005880 tx=0x7f2040009040 comp rx=0 tx=0).stop 2024-05-20T17:57:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20500cf3d0 msgr2=0x7f205015bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20500cf3d0 0x7f205015bb50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f204400e8d0 tx=0x7f204400ed90 comp rx=0 tx=0).stop 2024-05-20T17:57:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 shutdown_connections 2024-05-20T17:57:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f203c06be30 0x7f203c06e340 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f205015f220 0x7f2050160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20500cf3d0 0x7f205015bb50 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 --2- 172.21.15.6:0/764206546 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20500ce7e0 0x7f20500b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 >> 172.21.15.6:0/764206546 conn(0x7f20500b44d0 msgr2=0x7f20500b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 shutdown_connections 2024-05-20T17:57:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.391+0000 7f2057061640 1 -- 172.21.15.6:0/764206546 wait complete. 2024-05-20T17:57:14.402 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T17:57:14.402 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T17:57:14.402 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T17:57:14.402 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:57:14.402 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T17:57:14.402 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T17:57:14.402 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T17:57:14.403 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:57:14.403 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T17:57:14.403 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T17:57:14.403 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T17:57:14.403 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:57:14.403 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T17:57:14.403 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T17:57:14.403 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T17:57:14.404 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T17:57:14.413 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T17:57:14.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T17:57:14.416 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T17:57:14.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T17:57:14.417 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T17:57:14.417 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T17:57:14.417 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T17:57:14.418 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T17:57:14.457 INFO:tasks.ceph.mds.a:Started 2024-05-20T17:57:14.458 DEBUG:teuthology.parallel:result is None 2024-05-20T17:57:14.459 INFO:tasks.ceph.mds.c:Started 2024-05-20T17:57:14.459 DEBUG:teuthology.parallel:result is None 2024-05-20T17:57:14.460 INFO:tasks.ceph.mds.b:Started 2024-05-20T17:57:14.460 DEBUG:teuthology.parallel:result is None 2024-05-20T17:57:14.461 INFO:tasks.ceph.mds.d:Started 2024-05-20T17:57:14.461 DEBUG:teuthology.parallel:result is None 2024-05-20T17:57:14.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T17:57:14.548 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T17:57:14.550 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:57:14.558 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T17:57:14.558 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T17:57:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.586+0000 7f09f9a34640 1 Processor -- start 2024-05-20T17:57:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.586+0000 7f09f9a34640 1 -- start start 2024-05-20T17:57:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.587+0000 7f09f9a34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09f40b6d90 0x7f09f415f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.587+0000 7f09f9a34640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f40d0550 con 0x7f09f40cf250 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.587+0000 7f09f9a34640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f40d0830 con 0x7f09f40d3220 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.587+0000 7f09f9a34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f09f415f9a0 con 0x7f09f40b6d90 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.587+0000 7f09ebfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09f40b6d90 0x7f09f415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.587+0000 7f09ebfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09f40b6d90 0x7f09f415f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44844/0 (socket says 172.21.15.6:44844) 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.587+0000 7f09f2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f09f40cf250 0x7f09f40b6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38748/0 (socket says 172.21.15.6:38748) 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.587+0000 7f09ebfff640 1 -- 172.21.15.6:0/80428630 learned_addr learned my addr 172.21.15.6:0/80428630 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.588+0000 7f09ebfff640 1 -- 172.21.15.6:0/80428630 >> v1:172.21.15.171:6789/0 conn(0x7f09f40d3220 legacy=0x7f09f40d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.588+0000 7f09ebfff640 1 -- 172.21.15.6:0/80428630 >> v1:172.21.15.6:6789/0 conn(0x7f09f40cf250 legacy=0x7f09f40b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.588+0000 7f09f27fc640 1 -- 172.21.15.6:0/80428630 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3061192022 0 0) 0x7f09f40d0550 con 0x7f09f40cf250 2024-05-20T17:57:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.588+0000 7f09ebfff640 1 -- 172.21.15.6:0/80428630 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f40d2a20 con 0x7f09f40b6d90 2024-05-20T17:57:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.588+0000 7f09ebfff640 1 --2- 172.21.15.6:0/80428630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b6d90 0x7f09f415f460 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009870 tx=0x7f09dc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedcc471a45af684 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f27fc640 1 -- 172.21.15.6:0/80428630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc037070 con 0x7f09f40b6d90 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f27fc640 1 -- 172.21.15.6:0/80428630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09dc032440 con 0x7f09f40b6d90 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f27fc640 1 -- 172.21.15.6:0/80428630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc037070 con 0x7f09f40b6d90 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f9a34640 1 -- 172.21.15.6:0/80428630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b6d90 msgr2=0x7f09f415f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f9a34640 1 --2- 172.21.15.6:0/80428630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b6d90 0x7f09f415f460 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009870 tx=0x7f09dc02a2a0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f9a34640 1 -- 172.21.15.6:0/80428630 shutdown_connections 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f9a34640 1 --2- 172.21.15.6:0/80428630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b6d90 0x7f09f415f460 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f9a34640 1 -- 172.21.15.6:0/80428630 >> 172.21.15.6:0/80428630 conn(0x7f09f40d1860 msgr2=0x7f09f40d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f9a34640 1 -- 172.21.15.6:0/80428630 shutdown_connections 2024-05-20T17:57:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.589+0000 7f09f9a34640 1 -- 172.21.15.6:0/80428630 wait complete. 2024-05-20T17:57:14.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.591+0000 7f09f9a34640 1 Processor -- start 2024-05-20T17:57:14.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.591+0000 7f09f9a34640 1 -- start start 2024-05-20T17:57:14.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f9a34640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f40cf250 0x7f09f4148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f9a34640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f40d3220 0x7f09f4160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f9a34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f4067490 0x7f09f40678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f9a34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40d27d0 con 0x7f09f4067490 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f9a34640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40d0140 con 0x7f09f40d3220 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f9a34640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09f40d02c0 con 0x7f09f40cf250 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f4067490 0x7f09f40678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f2ffd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f40cf250 0x7f09f4148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09ebfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f40d3220 0x7f09f4160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f4067490 0x7f09f40678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44858/0 (socket says 172.21.15.6:44858) 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 -- 172.21.15.6:0/754246054 learned_addr learned my addr 172.21.15.6:0/754246054 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 -- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f40cf250 msgr2=0x7f09f4148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f40cf250 0x7f09f4148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 -- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f40d3220 msgr2=0x7f09f4160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f40d3220 0x7f09f4160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:14.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 -- 172.21.15.6:0/754246054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f4067de0 con 0x7f09f4067490 2024-05-20T17:57:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09ebfff640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f40d3220 0x7f09f4160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f37fe640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f4067490 0x7f09f40678a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00b9a0 tx=0x7f09ec00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.593+0000 7f09f0ff9640 1 -- 172.21.15.6:0/754246054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec019070 con 0x7f09f4067490 2024-05-20T17:57:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.594+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f4161ae0 con 0x7f09f4067490 2024-05-20T17:57:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.594+0000 7f09f0ff9640 1 -- 172.21.15.6:0/754246054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec00cb40 con 0x7f09f4067490 2024-05-20T17:57:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.594+0000 7f09f0ff9640 1 -- 172.21.15.6:0/754246054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec019070 con 0x7f09f4067490 2024-05-20T17:57:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.594+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f41620a0 con 0x7f09f4067490 2024-05-20T17:57:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.595+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f4075b00 con 0x7f09f4067490 2024-05-20T17:57:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.595+0000 7f09f0ff9640 1 -- 172.21.15.6:0/754246054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09ec01c070 con 0x7f09f4067490 2024-05-20T17:57:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.596+0000 7f09f0ff9640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d406c030 0x7f09d406e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.596+0000 7f09f0ff9640 1 -- 172.21.15.6:0/754246054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f09ec08a600 con 0x7f09f4067490 2024-05-20T17:57:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.596+0000 7f09f2ffd640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d406c030 0x7f09d406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.596+0000 7f09f2ffd640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d406c030 0x7f09d406e540 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f09e4007fd0 tx=0x7f09e4007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.600+0000 7f09f0ff9640 1 -- 172.21.15.6:0/754246054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f09f4067de0 con 0x7f09f4067490 2024-05-20T17:57:14.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:14.795+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f09f40cf030 con 0x7f09f4067490 2024-05-20T17:57:15.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.821+0000 7f09f0ff9640 1 -- 172.21.15.6:0/754246054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) ==== 97+0+0 (secure 0 0 0) 0x7f09ec0589c0 con 0x7f09f4067490 2024-05-20T17:57:15.820 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T17:57:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d406c030 msgr2=0x7f09d406e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d406c030 0x7f09d406e540 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f09e4007fd0 tx=0x7f09e4007de0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f4067490 msgr2=0x7f09f40678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f4067490 0x7f09f40678a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00b9a0 tx=0x7f09ec00be60 comp rx=0 tx=0).stop 2024-05-20T17:57:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 shutdown_connections 2024-05-20T17:57:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f09d406c030 0x7f09d406e540 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f4067490 0x7f09f40678a0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09f40d3220 0x7f09f4160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 --2- 172.21.15.6:0/754246054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09f40cf250 0x7f09f4148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 >> 172.21.15.6:0/754246054 conn(0x7f09f40d1860 msgr2=0x7f09f415a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 shutdown_connections 2024-05-20T17:57:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.824+0000 7f09f9a34640 1 -- 172.21.15.6:0/754246054 wait complete. 2024-05-20T17:57:15.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T17:57:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.960+0000 7faaa2109640 1 Processor -- start 2024-05-20T17:57:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.961+0000 7faaa2109640 1 -- start start 2024-05-20T17:57:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faaa2109640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faa9c162820 0x7faa9c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faaa2109640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa9c0d0630 con 0x7faa9c0b3e80 2024-05-20T17:57:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faaa2109640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa9c0d39c0 con 0x7faa9c06dae0 2024-05-20T17:57:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faaa2109640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7faa9c0d3ca0 con 0x7faa9c162820 2024-05-20T17:57:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faa9affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faa9c0b3e80 0x7faa9c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38752/0 (socket says 172.21.15.6:38752) 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faa9affd640 1 -- 172.21.15.6:0/2894097595 learned_addr learned my addr 172.21.15.6:0/2894097595 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faa9b7fe640 1 --2- 172.21.15.6:0/2894097595 >> v2:172.21.15.171:3300/0 conn(0x7faa9c162820 0x7faa9c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392506342 0 0) 0x7faa9c0d0630 con 0x7faa9c0b3e80 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.962+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa84003520 con 0x7faa9c0b3e80 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 755586266 0 0) 0x7faa9c0d39c0 con 0x7faa9c06dae0 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa9c0d0630 con 0x7faa9c06dae0 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2614581614 0 0) 0x7faa84003520 con 0x7faa9c0b3e80 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 >> v2:172.21.15.171:3300/0 conn(0x7faa9c162820 msgr2=0x7faa9c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 --2- 172.21.15.6:0/2894097595 >> v2:172.21.15.171:3300/0 conn(0x7faa9c162820 0x7faa9c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 >> v1:172.21.15.171:6789/0 conn(0x7faa9c06dae0 legacy=0x7faa9c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c0d3f80 con 0x7faa9c0b3e80 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7faa90001670 con 0x7faa9c0b3e80 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 >> v1:172.21.15.6:6789/0 conn(0x7faa9c0b3e80 legacy=0x7faa9c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:15.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa84003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa84004800 0x7faa84004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840051a0 0x7faa8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c0d3ca0 con 0x7faa84003b40 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa8400c140 con 0x7faa84004800 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa8400c340 con 0x7faa840051a0 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9b7fe640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa84003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9affd640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa84004800 0x7faa84004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9bfff640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840051a0 0x7faa8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9b7fe640 1 -- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840051a0 msgr2=0x7faa8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9b7fe640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840051a0 0x7faa8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9b7fe640 1 -- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa84004800 msgr2=0x7faa84004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9b7fe640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa84004800 0x7faa84004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9b7fe640 1 -- 172.21.15.6:0/2894097595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa84003520 con 0x7faa84003b40 2024-05-20T17:57:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9bfff640 1 -- 172.21.15.6:0/2894097595 reap_dead start 2024-05-20T17:57:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.963+0000 7faa9affd640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa84004800 0x7faa84004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.964+0000 7faa9b7fe640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa84003f90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7faa840057e0 tx=0x7faa84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8e184e95853eec server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.964+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c036070 con 0x7faa84003b40 2024-05-20T17:57:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.964+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c031400 con 0x7faa84003b40 2024-05-20T17:57:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.964+0000 7faa9a7fc640 1 -- 172.21.15.6:0/2894097595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c009690 con 0x7faa84003b40 2024-05-20T17:57:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.965+0000 7faaa2109640 1 -- 172.21.15.6:0/2894097595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 msgr2=0x7faa84003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.965+0000 7faaa2109640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa84003f90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7faa840057e0 tx=0x7faa84005830 comp rx=0 tx=0).stop 2024-05-20T17:57:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.965+0000 7faaa2109640 1 -- 172.21.15.6:0/2894097595 shutdown_connections 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.965+0000 7faaa2109640 1 --2- 172.21.15.6:0/2894097595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa84003f90 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.965+0000 7faaa2109640 1 -- 172.21.15.6:0/2894097595 >> 172.21.15.6:0/2894097595 conn(0x7faa9c0d4bd0 msgr2=0x7faa9c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.965+0000 7faaa2109640 1 -- 172.21.15.6:0/2894097595 shutdown_connections 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.965+0000 7faaa2109640 1 -- 172.21.15.6:0/2894097595 wait complete. 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.967+0000 7faaa2109640 1 Processor -- start 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.967+0000 7faaa2109640 1 -- start start 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faaa2109640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa9c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faaa2109640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9c158610 0x7faa9c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faaa2109640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa9c0cce90 0x7faa9c0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faaa2109640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c0d4780 con 0x7faa84003b40 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faaa2109640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c0d0300 con 0x7faa9c158610 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faaa2109640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa9c0d4900 con 0x7faa9c0cce90 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faa9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa9c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faa9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa9c155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44876/0 (socket says 172.21.15.6:44876) 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.968+0000 7faa9b7fe640 1 -- 172.21.15.6:0/347206439 learned_addr learned my addr 172.21.15.6:0/347206439 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa9affd640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9c158610 0x7faa9c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa9b7fe640 1 -- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa9c0cce90 msgr2=0x7faa9c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa9b7fe640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa9c0cce90 0x7faa9c0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa9b7fe640 1 -- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9c158610 msgr2=0x7faa9c0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa9b7fe640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9c158610 0x7faa9c0cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa9b7fe640 1 -- 172.21.15.6:0/347206439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c1f4920 con 0x7faa84003b40 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa9b7fe640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa9c155c50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7faa8c02ab40 tx=0x7faa8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa83fff640 1 -- 172.21.15.6:0/347206439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c03f020 con 0x7faa84003b40 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa83fff640 1 -- 172.21.15.6:0/347206439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c037040 con 0x7faa84003b40 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faa83fff640 1 -- 172.21.15.6:0/347206439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c036070 con 0x7faa84003b40 2024-05-20T17:57:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9c0cab00 con 0x7faa84003b40 2024-05-20T17:57:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.969+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9c0ce640 con 0x7faa84003b40 2024-05-20T17:57:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.970+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9c075b00 con 0x7faa84003b40 2024-05-20T17:57:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.971+0000 7faa83fff640 1 -- 172.21.15.6:0/347206439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa8c042020 con 0x7faa84003b40 2024-05-20T17:57:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.971+0000 7faa83fff640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8806be30 0x7faa8806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.972+0000 7faa83fff640 1 -- 172.21.15.6:0/347206439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7faa8c0aab20 con 0x7faa84003b40 2024-05-20T17:57:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.972+0000 7faa9affd640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8806be30 0x7faa8806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.972+0000 7faa9affd640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8806be30 0x7faa8806e340 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faa90001400 tx=0x7faa90001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:15.976+0000 7faa83fff640 1 -- 172.21.15.6:0/347206439 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faa8c049070 con 0x7faa84003b40 2024-05-20T17:57:16.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.236+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7faa9c0b49c0 con 0x7faa84003b40 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.237+0000 7faa83fff640 1 -- 172.21.15.6:0/347206439 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7faa9c0cab00 con 0x7faa84003b40 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.236 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:57:16.237 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.240 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T17:57:16.242 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T17:57:16.244 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T17:57:16.245 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T17:57:16.247 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T17:57:16.248 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T17:57:16.249 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T17:57:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T17:57:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T17:57:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T17:57:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:16.250 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T17:57:16.250 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:57:16.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8806be30 msgr2=0x7faa8806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8806be30 0x7faa8806e340 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faa90001400 tx=0x7faa90001370 comp rx=0 tx=0).stop 2024-05-20T17:57:16.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 msgr2=0x7faa9c155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa9c155c50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7faa8c02ab40 tx=0x7faa8c004730 comp rx=0 tx=0).stop 2024-05-20T17:57:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 shutdown_connections 2024-05-20T17:57:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faa8806be30 0x7faa8806e340 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa9c0cce90 0x7faa9c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa9c158610 0x7faa9c0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 --2- 172.21.15.6:0/347206439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa84003b40 0x7faa9c155c50 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 >> 172.21.15.6:0/347206439 conn(0x7faa9c0d4bd0 msgr2=0x7faa9c0c7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 shutdown_connections 2024-05-20T17:57:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.239+0000 7faaa2109640 1 -- 172.21.15.6:0/347206439 wait complete. 2024-05-20T17:57:16.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.369+0000 7f907487a640 1 Processor -- start 2024-05-20T17:57:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.369+0000 7f907487a640 1 -- start start 2024-05-20T17:57:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f907487a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cd680 0x7f907015f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f907487a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f907006c6c0 0x7f907006cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f907487a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f90700cf3d0 0x7f90700cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f907487a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f90700cda90 con 0x7f907006c6c0 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f907487a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f907015f760 con 0x7f90700cf3d0 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f907487a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f90700cfd20 con 0x7f90700cd680 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f9065d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f907006c6c0 0x7f907006cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f9065d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f907006c6c0 0x7f907006cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44884/0 (socket says 172.21.15.6:44884) 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.370+0000 7f9065d9b640 1 -- 172.21.15.6:0/93896503 learned_addr learned my addr 172.21.15.6:0/93896503 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.371+0000 7f906ed9d640 1 --2- 172.21.15.6:0/93896503 >> v2:172.21.15.171:3300/0 conn(0x7f90700cf3d0 0x7f90700cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.371+0000 7f906e59c640 1 --2- 172.21.15.6:0/93896503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cd680 0x7f907015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.371+0000 7f9065d9b640 1 -- 172.21.15.6:0/93896503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cd680 msgr2=0x7f907015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.371+0000 7f9065d9b640 1 --2- 172.21.15.6:0/93896503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cd680 0x7f907015f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.371+0000 7f9065d9b640 1 -- 172.21.15.6:0/93896503 >> v2:172.21.15.171:3300/0 conn(0x7f90700cf3d0 msgr2=0x7f90700cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.371+0000 7f9065d9b640 1 --2- 172.21.15.6:0/93896503 >> v2:172.21.15.171:3300/0 conn(0x7f90700cf3d0 0x7f90700cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.371+0000 7f9065d9b640 1 -- 172.21.15.6:0/93896503 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907006d0f0 con 0x7f907006c6c0 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f9065d9b640 1 --2- 172.21.15.6:0/93896503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f907006cad0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f907006e7f0 tx=0x7f905802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec16c479e54f5ac server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f906dd9b640 1 -- 172.21.15.6:0/93896503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058037070 con 0x7f907006c6c0 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f906dd9b640 1 -- 172.21.15.6:0/93896503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9058032440 con 0x7f907006c6c0 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f906dd9b640 1 -- 172.21.15.6:0/93896503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058032810 con 0x7f907006c6c0 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 -- 172.21.15.6:0/93896503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 msgr2=0x7f907006cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 --2- 172.21.15.6:0/93896503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f907006cad0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f907006e7f0 tx=0x7f905802a140 comp rx=0 tx=0).stop 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 -- 172.21.15.6:0/93896503 shutdown_connections 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 --2- 172.21.15.6:0/93896503 >> v2:172.21.15.171:3300/0 conn(0x7f90700cf3d0 0x7f90700cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 --2- 172.21.15.6:0/93896503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f907006cad0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 --2- 172.21.15.6:0/93896503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cd680 0x7f907015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 -- 172.21.15.6:0/93896503 >> 172.21.15.6:0/93896503 conn(0x7f90700b44d0 msgr2=0x7f90700b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 -- 172.21.15.6:0/93896503 shutdown_connections 2024-05-20T17:57:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.372+0000 7f907487a640 1 -- 172.21.15.6:0/93896503 wait complete. 2024-05-20T17:57:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.375+0000 7f907487a640 1 Processor -- start 2024-05-20T17:57:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.375+0000 7f907487a640 1 -- start start 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f907487a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f90701520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f907487a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90700cd680 0x7f90700b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f907487a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cf3d0 0x7f907015d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f907487a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f90700d0b40 con 0x7f907006c6c0 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f907487a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f907006d450 con 0x7f90700cd680 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f907487a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f907006d990 con 0x7f90700cf3d0 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f90701520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f90701520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44894/0 (socket says 172.21.15.6:44894) 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906e59c640 1 -- 172.21.15.6:0/1913603922 learned_addr learned my addr 172.21.15.6:0/1913603922 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906ed9d640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cf3d0 0x7f907015d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f9065d9b640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90700cd680 0x7f90700b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906e59c640 1 -- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cf3d0 msgr2=0x7f907015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906e59c640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cf3d0 0x7f907015d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906e59c640 1 -- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90700cd680 msgr2=0x7f90700b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906e59c640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90700cd680 0x7f90700b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.376+0000 7f906e59c640 1 -- 172.21.15.6:0/1913603922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90700b62d0 con 0x7f907006c6c0 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.377+0000 7f906e59c640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f90701520a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f906000d5f0 tx=0x7f906000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.377+0000 7f90677fe640 1 -- 172.21.15.6:0/1913603922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060004240 con 0x7f907006c6c0 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.377+0000 7f90677fe640 1 -- 172.21.15.6:0/1913603922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90600043e0 con 0x7f907006c6c0 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.377+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90701525e0 con 0x7f907006c6c0 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.377+0000 7f90677fe640 1 -- 172.21.15.6:0/1913603922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060003610 con 0x7f907006c6c0 2024-05-20T17:57:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.377+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90700b6890 con 0x7f907006c6c0 2024-05-20T17:57:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.378+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9070075b00 con 0x7f907006c6c0 2024-05-20T17:57:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.378+0000 7f90677fe640 1 -- 172.21.15.6:0/1913603922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f906001b020 con 0x7f907006c6c0 2024-05-20T17:57:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.379+0000 7f90677fe640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f905006be30 0x7f905006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.379+0000 7f90677fe640 1 -- 172.21.15.6:0/1913603922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f906008a900 con 0x7f907006c6c0 2024-05-20T17:57:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.379+0000 7f9065d9b640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f905006be30 0x7f905006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.380+0000 7f9065d9b640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f905006be30 0x7f905006e340 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9058034000 tx=0x7f905802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.383+0000 7f90677fe640 1 -- 172.21.15.6:0/1913603922 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9060058d90 con 0x7f907006c6c0 2024-05-20T17:57:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.572+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90700b8940 con 0x7f907006c6c0 2024-05-20T17:57:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.573+0000 7f90677fe640 1 -- 172.21.15.6:0/1913603922 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+13117 (secure 0 0 0) 0x7f906005d090 con 0x7f907006c6c0 2024-05-20T17:57:16.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:16.572 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:15.820444+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:16.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f905006be30 msgr2=0x7f905006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f905006be30 0x7f905006e340 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9058034000 tx=0x7f905802e000 comp rx=0 tx=0).stop 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 msgr2=0x7f90701520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f90701520a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f906000d5f0 tx=0x7f906000dab0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 shutdown_connections 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f905006be30 0x7f905006e340 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90700cf3d0 0x7f907015d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90700cd680 0x7f90700b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 --2- 172.21.15.6:0/1913603922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f907006c6c0 0x7f90701520a0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 >> 172.21.15.6:0/1913603922 conn(0x7f90700b44d0 msgr2=0x7f90700b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 shutdown_connections 2024-05-20T17:57:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.575+0000 7f907487a640 1 -- 172.21.15.6:0/1913603922 wait complete. 2024-05-20T17:57:16.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:57:16.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:57:16.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.707+0000 7fa1de91a640 1 Processor -- start 2024-05-20T17:57:16.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.707+0000 7fa1de91a640 1 -- start start 2024-05-20T17:57:16.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.708+0000 7fa1de91a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa1d80b1e10 0x7fa1d815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.708+0000 7fa1de91a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1d8070850 0x7fa1d8070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.708+0000 7fa1de91a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d80cd580 con 0x7fa1d815d530 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.708+0000 7fa1de91a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d80ce190 con 0x7fa1d8070850 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.708+0000 7fa1de91a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d80cd860 con 0x7fa1d80b1e10 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.708+0000 7fa1dceb7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1d8070850 0x7fa1d8070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.708+0000 7fa1dceb7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1d8070850 0x7fa1d8070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44910/0 (socket says 172.21.15.6:44910) 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.708+0000 7fa1dceb7640 1 -- 172.21.15.6:0/926089227 learned_addr learned my addr 172.21.15.6:0/926089227 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.709+0000 7fa1dceb7640 1 -- 172.21.15.6:0/926089227 >> v2:172.21.15.171:3300/0 conn(0x7fa1d80b1e10 msgr2=0x7fa1d815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.709+0000 7fa1d77fe640 1 --2- 172.21.15.6:0/926089227 >> v2:172.21.15.171:3300/0 conn(0x7fa1d80b1e10 0x7fa1d815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.709+0000 7fa1dceb7640 1 --2- 172.21.15.6:0/926089227 >> v2:172.21.15.171:3300/0 conn(0x7fa1d80b1e10 0x7fa1d815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.709+0000 7fa1dceb7640 1 -- 172.21.15.6:0/926089227 >> v1:172.21.15.171:6789/0 conn(0x7fa1d815d530 legacy=0x7fa1d80b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:16.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.709+0000 7fa1dceb7640 1 -- 172.21.15.6:0/926089227 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d80cdb40 con 0x7fa1d8070850 2024-05-20T17:57:16.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.709+0000 7fa1dceb7640 1 --2- 172.21.15.6:0/926089227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d8070850 0x7fa1d8070c60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80d3ad0 tx=0x7fa1d002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e097475a5547cfc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1d6ffd640 1 -- 172.21.15.6:0/926089227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0036070 con 0x7fa1d8070850 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1d6ffd640 1 -- 172.21.15.6:0/926089227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d0031600 con 0x7fa1d8070850 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1d6ffd640 1 -- 172.21.15.6:0/926089227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00319d0 con 0x7fa1d8070850 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1de91a640 1 -- 172.21.15.6:0/926089227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d8070850 msgr2=0x7fa1d8070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1de91a640 1 --2- 172.21.15.6:0/926089227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d8070850 0x7fa1d8070c60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80d3ad0 tx=0x7fa1d002a6f0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1de91a640 1 -- 172.21.15.6:0/926089227 shutdown_connections 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1de91a640 1 --2- 172.21.15.6:0/926089227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d8070850 0x7fa1d8070c60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1de91a640 1 --2- 172.21.15.6:0/926089227 >> v2:172.21.15.171:3300/0 conn(0x7fa1d80b1e10 0x7fa1d815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1de91a640 1 -- 172.21.15.6:0/926089227 >> 172.21.15.6:0/926089227 conn(0x7fa1d80d29d0 msgr2=0x7fa1d80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1de91a640 1 -- 172.21.15.6:0/926089227 shutdown_connections 2024-05-20T17:57:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.710+0000 7fa1de91a640 1 -- 172.21.15.6:0/926089227 wait complete. 2024-05-20T17:57:16.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.712+0000 7fa1de91a640 1 Processor -- start 2024-05-20T17:57:16.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.712+0000 7fa1de91a640 1 -- start start 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1de91a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d8070850 0x7fa1d80c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1de91a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d80b1e10 0x7fa1d80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1de91a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d815d530 0x7fa1d814ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1de91a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d80711a0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1de91a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d80cd230 con 0x7fa1d815d530 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1de91a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d8071320 con 0x7fa1d8070850 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d80b1e10 0x7fa1d80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d80b1e10 0x7fa1d80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44926/0 (socket says 172.21.15.6:44926) 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 -- 172.21.15.6:0/2609305023 learned_addr learned my addr 172.21.15.6:0/2609305023 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1dceb7640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d815d530 0x7fa1d814ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d7fff640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d8070850 0x7fa1d80c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 -- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d8070850 msgr2=0x7fa1d80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d8070850 0x7fa1d80c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 -- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d815d530 msgr2=0x7fa1d814ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d815d530 0x7fa1d814ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 -- 172.21.15.6:0/2609305023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d80c71f0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d7fff640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d8070850 0x7fa1d80c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.714+0000 7fa1d77fe640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d80b1e10 0x7fa1d80cb970 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c820 tx=0x7fa1cc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.715+0000 7fa1d4ff9640 1 -- 172.21.15.6:0/2609305023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc015070 con 0x7fa1d80b1e10 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.715+0000 7fa1d4ff9640 1 -- 172.21.15.6:0/2609305023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc004020 con 0x7fa1d80b1e10 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.715+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d80cbeb0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.715+0000 7fa1d4ff9640 1 -- 172.21.15.6:0/2609305023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0043f0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.715+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d80c74d0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.716+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d80c7ed0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.716+0000 7fa1d4ff9640 1 -- 172.21.15.6:0/2609305023 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1cc007830 con 0x7fa1d80b1e10 2024-05-20T17:57:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.717+0000 7fa1d4ff9640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa1c406be30 0x7fa1c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.717+0000 7fa1d4ff9640 1 -- 172.21.15.6:0/2609305023 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7fa1cc08a9d0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.717+0000 7fa1d7fff640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa1c406be30 0x7fa1c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.718+0000 7fa1d7fff640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa1c406be30 0x7fa1c406e340 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8006fd0 tx=0x7fa1c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:16.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.721+0000 7fa1d4ff9640 1 -- 172.21.15.6:0/2609305023 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa1cc058ee0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.905+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa1d8075b00 con 0x7fa1d80b1e10 2024-05-20T17:57:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.906+0000 7fa1d4ff9640 1 -- 172.21.15.6:0/2609305023 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7fa1cc05d1e0 con 0x7fa1d80b1e10 2024-05-20T17:57:16.905 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa1c406be30 msgr2=0x7fa1c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa1c406be30 0x7fa1c406e340 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8006fd0 tx=0x7fa1c8008040 comp rx=0 tx=0).stop 2024-05-20T17:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d80b1e10 msgr2=0x7fa1d80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d80b1e10 0x7fa1d80cb970 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c820 tx=0x7fa1cc00cce0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 shutdown_connections 2024-05-20T17:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa1c406be30 0x7fa1c406e340 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1d815d530 0x7fa1d814ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1d80b1e10 0x7fa1d80cb970 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 --2- 172.21.15.6:0/2609305023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1d8070850 0x7fa1d80c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 >> 172.21.15.6:0/2609305023 conn(0x7fa1d80d29d0 msgr2=0x7fa1d80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 shutdown_connections 2024-05-20T17:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:16.908+0000 7fa1de91a640 1 -- 172.21.15.6:0/2609305023 wait complete. 2024-05-20T17:57:16.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T17:57:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.035+0000 7f29bc123640 1 Processor -- start 2024-05-20T17:57:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.035+0000 7f29bc123640 1 -- start start 2024-05-20T17:57:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.036+0000 7f29bc123640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 0x7f29b41576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.036+0000 7f29bc123640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29b406c9a0 0x7f29b40ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.036+0000 7f29bc123640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b406b900 con 0x7f29b40cec00 2024-05-20T17:57:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.036+0000 7f29bc123640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f29b406bbe0 con 0x7f29b406c9a0 2024-05-20T17:57:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.036+0000 7f29bc123640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f29b406bec0 con 0x7f29b415d5f0 2024-05-20T17:57:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.037+0000 7f29b96be640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29b406c9a0 0x7f29b40ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.037+0000 7f29b96be640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f29b406c9a0 0x7f29b40ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44942/0 (socket says 172.21.15.6:44942) 2024-05-20T17:57:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.037+0000 7f29b96be640 1 -- 172.21.15.6:0/2336600557 learned_addr learned my addr 172.21.15.6:0/2336600557 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.037+0000 7f29b9ebf640 1 --2- 172.21.15.6:0/2336600557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 0x7f29b41576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.037+0000 7f29b96be640 1 -- 172.21.15.6:0/2336600557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 msgr2=0x7f29b41576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.037+0000 7f29b96be640 1 --2- 172.21.15.6:0/2336600557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 0x7f29b41576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.037+0000 7f29b96be640 1 -- 172.21.15.6:0/2336600557 >> v1:172.21.15.171:6789/0 conn(0x7f29b40cec00 legacy=0x7f29b406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.037+0000 7f29b96be640 1 -- 172.21.15.6:0/2336600557 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b406c1a0 con 0x7f29b406c9a0 2024-05-20T17:57:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.038+0000 7f29b96be640 1 --2- 172.21.15.6:0/2336600557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b406c9a0 0x7f29b40ce6c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009870 tx=0x7f29a402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc50d48a0c23805e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:17.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.038+0000 7f29b8ebd640 1 -- 172.21.15.6:0/2336600557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4037070 con 0x7f29b406c9a0 2024-05-20T17:57:17.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.038+0000 7f29b8ebd640 1 -- 172.21.15.6:0/2336600557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a4032440 con 0x7f29b406c9a0 2024-05-20T17:57:17.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.038+0000 7f29b8ebd640 1 -- 172.21.15.6:0/2336600557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4032810 con 0x7f29b406c9a0 2024-05-20T17:57:17.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.039+0000 7f29bc123640 1 -- 172.21.15.6:0/2336600557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b406c9a0 msgr2=0x7f29b40ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.039+0000 7f29bc123640 1 --2- 172.21.15.6:0/2336600557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b406c9a0 0x7f29b40ce6c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009870 tx=0x7f29a402a1c0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.039+0000 7f29bc123640 1 -- 172.21.15.6:0/2336600557 shutdown_connections 2024-05-20T17:57:17.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.039+0000 7f29bc123640 1 --2- 172.21.15.6:0/2336600557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b406c9a0 0x7f29b40ce6c0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.039+0000 7f29bc123640 1 --2- 172.21.15.6:0/2336600557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 0x7f29b41576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.039+0000 7f29bc123640 1 -- 172.21.15.6:0/2336600557 >> 172.21.15.6:0/2336600557 conn(0x7f29b40cd2a0 msgr2=0x7f29b40cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:17.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.039+0000 7f29bc123640 1 -- 172.21.15.6:0/2336600557 shutdown_connections 2024-05-20T17:57:17.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.039+0000 7f29bc123640 1 -- 172.21.15.6:0/2336600557 wait complete. 2024-05-20T17:57:17.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.040+0000 7f29bc123640 1 Processor -- start 2024-05-20T17:57:17.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.041+0000 7f29bc123640 1 -- start start 2024-05-20T17:57:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29bc123640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29b406c9a0 0x7f29b41606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29bc123640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b40cec00 0x7f29b41e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29bc123640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 0x7f29b409d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29bc123640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f29b406b520 con 0x7f29b40cec00 2024-05-20T17:57:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29bc123640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f29b406cdb0 con 0x7f29b406c9a0 2024-05-20T17:57:17.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29bc123640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f29b406b6a0 con 0x7f29b415d5f0 2024-05-20T17:57:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b40cec00 0x7f29b41e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b40cec00 0x7f29b41e8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44944/0 (socket says 172.21.15.6:44944) 2024-05-20T17:57:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 -- 172.21.15.6:0/3644531609 learned_addr learned my addr 172.21.15.6:0/3644531609 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b9ebf640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29b406c9a0 0x7f29b41606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29ba6c0640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 0x7f29b409d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 -- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 msgr2=0x7f29b409d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 0x7f29b409d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 -- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29b406c9a0 msgr2=0x7f29b41606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29b406c9a0 0x7f29b41606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 -- 172.21.15.6:0/3644531609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b41e9360 con 0x7f29b40cec00 2024-05-20T17:57:17.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.042+0000 7f29b96be640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b40cec00 0x7f29b41e8e20 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f29a4000c00 tx=0x7f29a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.043+0000 7f29aa7fc640 1 -- 172.21.15.6:0/3644531609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4041020 con 0x7f29b40cec00 2024-05-20T17:57:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.043+0000 7f29aa7fc640 1 -- 172.21.15.6:0/3644531609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a40306c0 con 0x7f29b40cec00 2024-05-20T17:57:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.043+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b409e390 con 0x7f29b40cec00 2024-05-20T17:57:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.043+0000 7f29aa7fc640 1 -- 172.21.15.6:0/3644531609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4037040 con 0x7f29b40cec00 2024-05-20T17:57:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.043+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b415fbf0 con 0x7f29b40cec00 2024-05-20T17:57:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.044+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b4075b00 con 0x7f29b40cec00 2024-05-20T17:57:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.044+0000 7f29aa7fc640 1 -- 172.21.15.6:0/3644531609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29a4044020 con 0x7f29b40cec00 2024-05-20T17:57:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.045+0000 7f29aa7fc640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f299806be30 0x7f299806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.045+0000 7f29aa7fc640 1 -- 172.21.15.6:0/3644531609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f29a40ab470 con 0x7f29b40cec00 2024-05-20T17:57:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.045+0000 7f29b9ebf640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f299806be30 0x7f299806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.046+0000 7f29b9ebf640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f299806be30 0x7f299806e340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f29b40b0490 tx=0x7f29b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.050+0000 7f29aa7fc640 1 -- 172.21.15.6:0/3644531609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f29a404b030 con 0x7f29b40cec00 2024-05-20T17:57:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.235+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f29b40734d0 con 0x7f29b40cec00 2024-05-20T17:57:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.235+0000 7f29aa7fc640 1 -- 172.21.15.6:0/3644531609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) ==== 84+0+65 (secure 0 0 0) 0x7f29a407ee20 con 0x7f29b40cec00 2024-05-20T17:57:17.234 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:17.235 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T17:57:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T17:57:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T17:57:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T17:57:17.235 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T17:57:17.235 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T17:57:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f299806be30 msgr2=0x7f299806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f299806be30 0x7f299806e340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f29b40b0490 tx=0x7f29b0008040 comp rx=0 tx=0).stop 2024-05-20T17:57:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b40cec00 msgr2=0x7f29b41e8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b40cec00 0x7f29b41e8e20 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f29a4000c00 tx=0x7f29a40046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 shutdown_connections 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f299806be30 0x7f299806e340 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29b415d5f0 0x7f29b409d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29b40cec00 0x7f29b41e8e20 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 --2- 172.21.15.6:0/3644531609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29b406c9a0 0x7f29b41606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 >> 172.21.15.6:0/3644531609 conn(0x7f29b40cd2a0 msgr2=0x7f29b40cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 shutdown_connections 2024-05-20T17:57:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.237+0000 7f29bc123640 1 -- 172.21.15.6:0/3644531609 wait complete. 2024-05-20T17:57:17.247 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T17:57:17.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T17:57:17.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.367+0000 7f4406873640 1 Processor -- start 2024-05-20T17:57:17.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.367+0000 7f4406873640 1 -- start start 2024-05-20T17:57:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f4406873640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f440015b7f0 0x7f44000afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f4406873640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f440006edd0 0x7f4400072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f4406873640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4400073420 con 0x7f4400073010 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f4406873640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f44000b01c0 con 0x7f440015b7f0 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f4406873640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f44000b5d60 con 0x7f440006edd0 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f43fffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f440015b7f0 0x7f44000afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f4404e10640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4400073010 0x7f44000b3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38754/0 (socket says 172.21.15.6:38754) 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f4404e10640 1 -- 172.21.15.6:0/2654349863 learned_addr learned my addr 172.21.15.6:0/2654349863 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f43f7fff640 1 --2- 172.21.15.6:0/2654349863 >> v2:172.21.15.171:3300/0 conn(0x7f440006edd0 0x7f4400072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f43fffff640 1 -- 172.21.15.6:0/2654349863 >> v2:172.21.15.171:3300/0 conn(0x7f440006edd0 msgr2=0x7f4400072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f43fffff640 1 --2- 172.21.15.6:0/2654349863 >> v2:172.21.15.171:3300/0 conn(0x7f440006edd0 0x7f4400072ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f43fffff640 1 -- 172.21.15.6:0/2654349863 >> v1:172.21.15.6:6789/0 conn(0x7f4400073010 legacy=0x7f44000b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f43fffff640 1 -- 172.21.15.6:0/2654349863 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44000aef00 con 0x7f440015b7f0 2024-05-20T17:57:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.369+0000 7f43ff7fe640 1 -- 172.21.15.6:0/2654349863 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699816628 0 0) 0x7f43f8001490 con 0x7f4400073010 2024-05-20T17:57:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.370+0000 7f43fffff640 1 --2- 172.21.15.6:0/2654349863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440015b7f0 0x7f44000afc80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f44000b0470 tx=0x7f43f002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b9e48f93b44586 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.370+0000 7f43ff7fe640 1 -- 172.21.15.6:0/2654349863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f0037070 con 0x7f440015b7f0 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.370+0000 7f43ff7fe640 1 -- 172.21.15.6:0/2654349863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f0032440 con 0x7f440015b7f0 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.370+0000 7f43ff7fe640 1 -- 172.21.15.6:0/2654349863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f002ae60 con 0x7f440015b7f0 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.371+0000 7f4406873640 1 -- 172.21.15.6:0/2654349863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440015b7f0 msgr2=0x7f44000afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.371+0000 7f4406873640 1 --2- 172.21.15.6:0/2654349863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440015b7f0 0x7f44000afc80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f44000b0470 tx=0x7f43f002a110 comp rx=0 tx=0).stop 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.371+0000 7f4406873640 1 -- 172.21.15.6:0/2654349863 shutdown_connections 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.371+0000 7f4406873640 1 --2- 172.21.15.6:0/2654349863 >> v2:172.21.15.171:3300/0 conn(0x7f440006edd0 0x7f4400072ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.371+0000 7f4406873640 1 --2- 172.21.15.6:0/2654349863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f440015b7f0 0x7f44000afc80 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.371+0000 7f4406873640 1 -- 172.21.15.6:0/2654349863 >> 172.21.15.6:0/2654349863 conn(0x7f44000d0e10 msgr2=0x7f44000723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.371+0000 7f4406873640 1 -- 172.21.15.6:0/2654349863 shutdown_connections 2024-05-20T17:57:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.371+0000 7f4406873640 1 -- 172.21.15.6:0/2654349863 wait complete. 2024-05-20T17:57:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.373+0000 7f4406873640 1 Processor -- start 2024-05-20T17:57:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.373+0000 7f4406873640 1 -- start start 2024-05-20T17:57:17.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f4406873640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f440006edd0 0x7f4400145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f4406873640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400073010 0x7f440016a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f4406873640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440015b7f0 0x7f440014de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f4406873640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44000af1a0 con 0x7f4400073010 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f4406873640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f44000af7f0 con 0x7f440015b7f0 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f4406873640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44000af480 con 0x7f440006edd0 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f43f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400073010 0x7f440016a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f43f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400073010 0x7f440016a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44962/0 (socket says 172.21.15.6:44962) 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.374+0000 7f43f7fff640 1 -- 172.21.15.6:0/2017016857 learned_addr learned my addr 172.21.15.6:0/2017016857 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f4404e10640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440015b7f0 0x7f440014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43fffff640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f440006edd0 0x7f4400145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43f7fff640 1 -- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f440006edd0 msgr2=0x7f4400145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43f7fff640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f440006edd0 0x7f4400145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43f7fff640 1 -- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440015b7f0 msgr2=0x7f440014de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43f7fff640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440015b7f0 0x7f440014de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43f7fff640 1 -- 172.21.15.6:0/2017016857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4400145a30 con 0x7f4400073010 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43f7fff640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400073010 0x7f440016a1a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f43e800d5f0 tx=0x7f43e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43fd7fa640 1 -- 172.21.15.6:0/2017016857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80125f0 con 0x7f4400073010 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43fd7fa640 1 -- 172.21.15.6:0/2017016857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e8019070 con 0x7f4400073010 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440014b980 con 0x7f4400073010 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f43fd7fa640 1 -- 172.21.15.6:0/2017016857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80129d0 con 0x7f4400073010 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.375+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440014bf40 con 0x7f4400073010 2024-05-20T17:57:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.376+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44000690b0 con 0x7f4400073010 2024-05-20T17:57:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.377+0000 7f43fd7fa640 1 -- 172.21.15.6:0/2017016857 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43e8012b70 con 0x7f4400073010 2024-05-20T17:57:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.377+0000 7f43fd7fa640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43e006be30 0x7f43e006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.378+0000 7f43fd7fa640 1 -- 172.21.15.6:0/2017016857 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f43e808b180 con 0x7f4400073010 2024-05-20T17:57:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.378+0000 7f43fffff640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43e006be30 0x7f43e006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.378+0000 7f43fffff640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43e006be30 0x7f43e006e340 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f43f0034000 tx=0x7f43f002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.382+0000 7f43fd7fa640 1 -- 172.21.15.6:0/2017016857 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f43e8059bc0 con 0x7f4400073010 2024-05-20T17:57:17.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:17.565+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f440014b710 con 0x7f4400073010 2024-05-20T17:57:18.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.478+0000 7f43fd7fa640 1 -- 172.21.15.6:0/2017016857 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) ==== 138+0+0 (secure 0 0 0) 0x7f43e80594c0 con 0x7f4400073010 2024-05-20T17:57:18.477 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T17:57:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43e006be30 msgr2=0x7f43e006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43e006be30 0x7f43e006e340 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f43f0034000 tx=0x7f43f002e000 comp rx=0 tx=0).stop 2024-05-20T17:57:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400073010 msgr2=0x7f440016a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400073010 0x7f440016a1a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f43e800d5f0 tx=0x7f43e800dab0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 shutdown_connections 2024-05-20T17:57:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f43e006be30 0x7f43e006e340 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440015b7f0 0x7f440014de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4400073010 0x7f440016a1a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 --2- 172.21.15.6:0/2017016857 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f440006edd0 0x7f4400145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 >> 172.21.15.6:0/2017016857 conn(0x7f44000d0e10 msgr2=0x7f44000b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 shutdown_connections 2024-05-20T17:57:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.481+0000 7f4406873640 1 -- 172.21.15.6:0/2017016857 wait complete. 2024-05-20T17:57:18.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T17:57:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.628+0000 7f9e91efe640 1 Processor -- start 2024-05-20T17:57:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.628+0000 7f9e91efe640 1 -- start start 2024-05-20T17:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.629+0000 7f9e91efe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9e8c0cd4c0 0x7f9e8c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.629+0000 7f9e91efe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e8c0cf3c0 0x7f9e8c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.629+0000 7f9e91efe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8c0cfd10 con 0x7f9e8c0d1410 2024-05-20T17:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.629+0000 7f9e91efe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8c0b6310 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.629+0000 7f9e91efe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8c071140 con 0x7f9e8c0cd4c0 2024-05-20T17:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e8c0cf3c0 0x7f9e8c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9e8c0d1410 0x7f9e8c0d1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34960/0 (socket says 172.21.15.6:34960) 2024-05-20T17:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8bfff640 1 -- 172.21.15.6:0/1025118295 learned_addr learned my addr 172.21.15.6:0/1025118295 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8b7fe640 1 --2- 172.21.15.6:0/1025118295 >> v2:172.21.15.171:3300/0 conn(0x7f9e8c0cd4c0 0x7f9e8c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8affd640 1 -- 172.21.15.6:0/1025118295 >> v2:172.21.15.171:3300/0 conn(0x7f9e8c0cd4c0 msgr2=0x7f9e8c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8affd640 1 --2- 172.21.15.6:0/1025118295 >> v2:172.21.15.171:3300/0 conn(0x7f9e8c0cd4c0 0x7f9e8c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8affd640 1 -- 172.21.15.6:0/1025118295 >> v1:172.21.15.6:6789/0 conn(0x7f9e8c0d1410 legacy=0x7f9e8c0d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8a7fc640 1 -- 172.21.15.6:0/1025118295 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178326455 0 0) 0x7f9e84001490 con 0x7f9e8c0d1410 2024-05-20T17:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.630+0000 7f9e8affd640 1 -- 172.21.15.6:0/1025118295 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c071420 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.631+0000 7f9e8affd640 1 --2- 172.21.15.6:0/1025118295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c0cf7d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0cf390 tx=0x7f9e8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3799c5cfc2ad5a75 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.631+0000 7f9e8a7fc640 1 -- 172.21.15.6:0/1025118295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80037070 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.631+0000 7f9e8a7fc640 1 -- 172.21.15.6:0/1025118295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e80032440 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.631+0000 7f9e8a7fc640 1 -- 172.21.15.6:0/1025118295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80032810 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.632+0000 7f9e91efe640 1 -- 172.21.15.6:0/1025118295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 msgr2=0x7f9e8c0cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.632+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1025118295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c0cf7d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0cf390 tx=0x7f9e8002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.632+0000 7f9e91efe640 1 -- 172.21.15.6:0/1025118295 shutdown_connections 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.632+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1025118295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c0cf7d0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.632+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1025118295 >> v2:172.21.15.171:3300/0 conn(0x7f9e8c0cd4c0 0x7f9e8c0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.632+0000 7f9e91efe640 1 -- 172.21.15.6:0/1025118295 >> 172.21.15.6:0/1025118295 conn(0x7f9e8c0b4540 msgr2=0x7f9e8c0b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.632+0000 7f9e91efe640 1 -- 172.21.15.6:0/1025118295 shutdown_connections 2024-05-20T17:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.632+0000 7f9e91efe640 1 -- 172.21.15.6:0/1025118295 wait complete. 2024-05-20T17:57:18.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.633+0000 7f9e91efe640 1 Processor -- start 2024-05-20T17:57:18.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.634+0000 7f9e91efe640 1 -- start start 2024-05-20T17:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e91efe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8c0cd4c0 0x7f9e8c143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e91efe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c1e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e91efe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e8c0d1410 0x7f9e8c0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e91efe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c070e30 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e91efe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c0b5fa0 con 0x7f9e8c0d1410 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e91efe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c0b1f40 con 0x7f9e8c0cd4c0 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c1e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c1e7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35790/0 (socket says 172.21.15.6:35790) 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8affd640 1 -- 172.21.15.6:0/1725441940 learned_addr learned my addr 172.21.15.6:0/1725441940 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8b7fe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8c0cd4c0 0x7f9e8c143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8bfff640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e8c0d1410 0x7f9e8c0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8affd640 1 -- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8c0cd4c0 msgr2=0x7f9e8c143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8affd640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8c0cd4c0 0x7f9e8c143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8affd640 1 -- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e8c0d1410 msgr2=0x7f9e8c0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8affd640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e8c0d1410 0x7f9e8c0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8affd640 1 -- 172.21.15.6:0/1725441940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c1e8520 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.635+0000 7f9e8bfff640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e8c0d1410 0x7f9e8c0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.636+0000 7f9e8affd640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c1e7fe0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9e80000c00 tx=0x7f9e800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.636+0000 7f9e73fff640 1 -- 172.21.15.6:0/1725441940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80037040 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.636+0000 7f9e73fff640 1 -- 172.21.15.6:0/1725441940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e80042070 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.636+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8c15d8c0 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.636+0000 7f9e73fff640 1 -- 172.21.15.6:0/1725441940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80030bd0 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.636+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8c15de80 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.637+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8c0690b0 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.638+0000 7f9e73fff640 1 -- 172.21.15.6:0/1725441940 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e80047460 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.638+0000 7f9e73fff640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e7806be30 0x7f9e7806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:18.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.638+0000 7f9e73fff640 1 -- 172.21.15.6:0/1725441940 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5619+0+0 (secure 0 0 0) 0x7f9e800ab8c0 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.638+0000 7f9e8b7fe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e7806be30 0x7f9e7806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:18.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.639+0000 7f9e8b7fe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e7806be30 0x7f9e7806e340 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0b8830 tx=0x7f9e7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:18.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.643+0000 7f9e73fff640 1 -- 172.21.15.6:0/1725441940 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9e8004c020 con 0x7f9e8c0cf3c0 2024-05-20T17:57:18.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:18.830+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9e8c0b3b80 con 0x7f9e8c0cf3c0 2024-05-20T17:57:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.480+0000 7f9e73fff640 1 -- 172.21.15.6:0/1725441940 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7f9e80032e20 con 0x7f9e8c0cf3c0 2024-05-20T17:57:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T17:57:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.484+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e7806be30 msgr2=0x7f9e7806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.484+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e7806be30 0x7f9e7806e340 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0b8830 tx=0x7f9e7c008040 comp rx=0 tx=0).stop 2024-05-20T17:57:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.484+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 msgr2=0x7f9e8c1e7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.484+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c1e7fe0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9e80000c00 tx=0x7f9e800046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.485+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 shutdown_connections 2024-05-20T17:57:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.485+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e7806be30 0x7f9e7806e340 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.485+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e8c0d1410 0x7f9e8c0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.485+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8c0cf3c0 0x7f9e8c1e7fe0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.485+0000 7f9e91efe640 1 --2- 172.21.15.6:0/1725441940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8c0cd4c0 0x7f9e8c143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.485+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 >> 172.21.15.6:0/1725441940 conn(0x7f9e8c0b4540 msgr2=0x7f9e8c0b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.486+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 shutdown_connections 2024-05-20T17:57:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.486+0000 7f9e91efe640 1 -- 172.21.15.6:0/1725441940 wait complete. 2024-05-20T17:57:19.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T17:57:19.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.633+0000 7f662611d640 1 Processor -- start 2024-05-20T17:57:19.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.633+0000 7f662611d640 1 -- start start 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f662611d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f662006d3d0 0x7f662006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f662611d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 0x7f66200b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f662611d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662006dd20 con 0x7f6620162820 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f662611d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f66200d0630 con 0x7f662006d3d0 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f662611d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66200d39c0 con 0x7f66200b8190 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f661effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f662006d3d0 0x7f662006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f661f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6620162820 0x7f66200b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34968/0 (socket says 172.21.15.6:34968) 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f661f7fe640 1 -- 172.21.15.6:0/278620240 learned_addr learned my addr 172.21.15.6:0/278620240 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:19.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f661effd640 1 -- 172.21.15.6:0/278620240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 msgr2=0x7f66200b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:19.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f661effd640 1 --2- 172.21.15.6:0/278620240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 0x7f66200b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f661effd640 1 -- 172.21.15.6:0/278620240 >> v1:172.21.15.6:6789/0 conn(0x7f6620162820 legacy=0x7f66200b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:19.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f661effd640 1 -- 172.21.15.6:0/278620240 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66200d3ca0 con 0x7f662006d3d0 2024-05-20T17:57:19.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.635+0000 7f661e7fc640 1 -- 172.21.15.6:0/278620240 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507831129 0 0) 0x7f6610001110 con 0x7f6620162820 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.636+0000 7f661effd640 1 --2- 172.21.15.6:0/278620240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f662006d7e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f66140097a0 tx=0x7f661402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ac9f4641688076 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.636+0000 7f661e7fc640 1 -- 172.21.15.6:0/278620240 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614037070 con 0x7f662006d3d0 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.636+0000 7f661e7fc640 1 -- 172.21.15.6:0/278620240 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6614032440 con 0x7f662006d3d0 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.636+0000 7f661e7fc640 1 -- 172.21.15.6:0/278620240 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614032810 con 0x7f662006d3d0 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.637+0000 7f662611d640 1 -- 172.21.15.6:0/278620240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 msgr2=0x7f662006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.637+0000 7f662611d640 1 --2- 172.21.15.6:0/278620240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f662006d7e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f66140097a0 tx=0x7f661402a1a0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.637+0000 7f662611d640 1 -- 172.21.15.6:0/278620240 shutdown_connections 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.637+0000 7f662611d640 1 --2- 172.21.15.6:0/278620240 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 0x7f66200b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.637+0000 7f662611d640 1 --2- 172.21.15.6:0/278620240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f662006d7e0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.637+0000 7f662611d640 1 -- 172.21.15.6:0/278620240 >> 172.21.15.6:0/278620240 conn(0x7f66200d4bd0 msgr2=0x7f66200d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:19.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.637+0000 7f662611d640 1 -- 172.21.15.6:0/278620240 shutdown_connections 2024-05-20T17:57:19.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.637+0000 7f662611d640 1 -- 172.21.15.6:0/278620240 wait complete. 2024-05-20T17:57:19.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.639+0000 7f662611d640 1 Processor -- start 2024-05-20T17:57:19.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.639+0000 7f662611d640 1 -- start start 2024-05-20T17:57:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f662611d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f6620159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f662611d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 0x7f66200c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f662611d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6620162820 0x7f66200c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f662611d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66200d0300 con 0x7f662006d3d0 2024-05-20T17:57:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f662611d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66200d4260 con 0x7f6620162820 2024-05-20T17:57:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f662611d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66200b4050 con 0x7f66200b8190 2024-05-20T17:57:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f6620159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f6620159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35812/0 (socket says 172.21.15.6:35812) 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 -- 172.21.15.6:0/1511929082 learned_addr learned my addr 172.21.15.6:0/1511929082 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661effd640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 0x7f66200c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661ffff640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6620162820 0x7f66200c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 -- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 msgr2=0x7f66200c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 0x7f66200c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 -- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6620162820 msgr2=0x7f66200c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6620162820 0x7f66200c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 -- 172.21.15.6:0/1511929082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66200c95c0 con 0x7f662006d3d0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f661f7fe640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f6620159cd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f661000c460 tx=0x7f661000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f6607fff640 1 -- 172.21.15.6:0/1511929082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610018070 con 0x7f662006d3d0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f6607fff640 1 -- 172.21.15.6:0/1511929082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6610007500 con 0x7f662006d3d0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66200c98a0 con 0x7f662006d3d0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f6607fff640 1 -- 172.21.15.6:0/1511929082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610004a20 con 0x7f662006d3d0 2024-05-20T17:57:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.641+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66200c9e60 con 0x7f662006d3d0 2024-05-20T17:57:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.642+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6620075b00 con 0x7f662006d3d0 2024-05-20T17:57:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.643+0000 7f6607fff640 1 -- 172.21.15.6:0/1511929082 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f661001b070 con 0x7f662006d3d0 2024-05-20T17:57:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.644+0000 7f6607fff640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f660c06be30 0x7f660c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.644+0000 7f6607fff640 1 -- 172.21.15.6:0/1511929082 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6001+0+0 (secure 0 0 0) 0x7f661008a300 con 0x7f662006d3d0 2024-05-20T17:57:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.644+0000 7f661effd640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f660c06be30 0x7f660c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.644+0000 7f661effd640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f660c06be30 0x7f660c06e340 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6614034000 tx=0x7f661402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:19.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.650+0000 7f6607fff640 1 -- 172.21.15.6:0/1511929082 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f662006dd20 con 0x7f662006d3d0 2024-05-20T17:57:19.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:19.871+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f662015d0e0 con 0x7f662006d3d0 2024-05-20T17:57:20.506 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 13 and data pool 14 2024-05-20T17:57:20.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.507+0000 7f6607fff640 1 -- 172.21.15.6:0/1511929082 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v48) ==== 174+0+0 (secure 0 0 0) 0x7f6610058af0 con 0x7f662006d3d0 2024-05-20T17:57:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.513+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f660c06be30 msgr2=0x7f660c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.513+0000 7f662611d640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f660c06be30 0x7f660c06e340 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6614034000 tx=0x7f661402e000 comp rx=0 tx=0).stop 2024-05-20T17:57:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.513+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 msgr2=0x7f6620159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.513+0000 7f662611d640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f6620159cd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f661000c460 tx=0x7f661000c920 comp rx=0 tx=0).stop 2024-05-20T17:57:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.514+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 shutdown_connections 2024-05-20T17:57:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.514+0000 7f662611d640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f660c06be30 0x7f660c06e340 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.514+0000 7f662611d640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6620162820 0x7f66200c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.514+0000 7f662611d640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66200b8190 0x7f66200c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.514+0000 7f662611d640 1 --2- 172.21.15.6:0/1511929082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f662006d3d0 0x7f6620159cd0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.514+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 >> 172.21.15.6:0/1511929082 conn(0x7f66200d4bd0 msgr2=0x7f66200ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:20.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.515+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 shutdown_connections 2024-05-20T17:57:20.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.516+0000 7f662611d640 1 -- 172.21.15.6:0/1511929082 wait complete. 2024-05-20T17:57:20.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:20.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.660+0000 7f70663b5640 1 Processor -- start 2024-05-20T17:57:20.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.660+0000 7f70663b5640 1 -- start start 2024-05-20T17:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.661+0000 7f70663b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f70600b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.661+0000 7f70663b5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70600b3e80 0x7f706006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f70663b5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f706006d910 0x7f70600d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f70663b5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f706006dd20 con 0x7f70600b3e80 2024-05-20T17:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f70663b5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f70600d0630 con 0x7f706006d910 2024-05-20T17:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f70663b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f70600d39c0 con 0x7f7060162820 2024-05-20T17:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70600b3e80 0x7f706006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f70600b3e80 0x7f706006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35826/0 (socket says 172.21.15.6:35826) 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705f7fe640 1 -- 172.21.15.6:0/4020598888 learned_addr learned my addr 172.21.15.6:0/4020598888 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f7064952640 1 --2- 172.21.15.6:0/4020598888 >> v2:172.21.15.171:3300/0 conn(0x7f706006d910 0x7f70600d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705ffff640 1 --2- 172.21.15.6:0/4020598888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f70600b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705f7fe640 1 -- 172.21.15.6:0/4020598888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 msgr2=0x7f70600b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705f7fe640 1 --2- 172.21.15.6:0/4020598888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f70600b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705f7fe640 1 -- 172.21.15.6:0/4020598888 >> v2:172.21.15.171:3300/0 conn(0x7f706006d910 msgr2=0x7f70600d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705f7fe640 1 --2- 172.21.15.6:0/4020598888 >> v2:172.21.15.171:3300/0 conn(0x7f706006d910 0x7f70600d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.662+0000 7f705f7fe640 1 -- 172.21.15.6:0/4020598888 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70600d3ca0 con 0x7f70600b3e80 2024-05-20T17:57:20.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.663+0000 7f705f7fe640 1 --2- 172.21.15.6:0/4020598888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f706006d3d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f706006ce40 tx=0x7f705402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d787ff0ee4e1104 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:20.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.663+0000 7f705effd640 1 -- 172.21.15.6:0/4020598888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054037070 con 0x7f70600b3e80 2024-05-20T17:57:20.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.663+0000 7f705effd640 1 -- 172.21.15.6:0/4020598888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7054032440 con 0x7f70600b3e80 2024-05-20T17:57:20.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.663+0000 7f705effd640 1 -- 172.21.15.6:0/4020598888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054032810 con 0x7f70600b3e80 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 -- 172.21.15.6:0/4020598888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 msgr2=0x7f706006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 --2- 172.21.15.6:0/4020598888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f706006d3d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f706006ce40 tx=0x7f705402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 -- 172.21.15.6:0/4020598888 shutdown_connections 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 --2- 172.21.15.6:0/4020598888 >> v2:172.21.15.171:3300/0 conn(0x7f706006d910 0x7f70600d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 --2- 172.21.15.6:0/4020598888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f706006d3d0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 --2- 172.21.15.6:0/4020598888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f70600b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 -- 172.21.15.6:0/4020598888 >> 172.21.15.6:0/4020598888 conn(0x7f70600d4bd0 msgr2=0x7f70600d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 -- 172.21.15.6:0/4020598888 shutdown_connections 2024-05-20T17:57:20.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.664+0000 7f70663b5640 1 -- 172.21.15.6:0/4020598888 wait complete. 2024-05-20T17:57:20.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.666+0000 7f70663b5640 1 Processor -- start 2024-05-20T17:57:20.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.666+0000 7f70663b5640 1 -- start start 2024-05-20T17:57:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f70663b5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706006d910 0x7f7060157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f70663b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f70601f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f70663b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f7060158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f70663b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f70600d0300 con 0x7f70600b3e80 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f70663b5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f70600d4260 con 0x7f706006d910 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f70663b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f70600d4780 con 0x7f7060162820 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f705f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f70601f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f705f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f70601f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35836/0 (socket says 172.21.15.6:35836) 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f705f7fe640 1 -- 172.21.15.6:0/1670578583 learned_addr learned my addr 172.21.15.6:0/1670578583 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f705ffff640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706006d910 0x7f7060157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f7064952640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f7060158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.667+0000 7f705f7fe640 1 -- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 msgr2=0x7f7060158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f7060158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705f7fe640 1 -- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706006d910 msgr2=0x7f7060157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706006d910 0x7f7060157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705f7fe640 1 -- 172.21.15.6:0/1670578583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70601f9c80 con 0x7f70600b3e80 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705ffff640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706006d910 0x7f7060157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f7064952640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f7060158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705f7fe640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f70601f5030 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f7054000c00 tx=0x7f70540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705cff9640 1 -- 172.21.15.6:0/1670578583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054041020 con 0x7f70600b3e80 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705cff9640 1 -- 172.21.15.6:0/1670578583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70540306c0 con 0x7f70600b3e80 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f705cff9640 1 -- 172.21.15.6:0/1670578583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7054037040 con 0x7f70600b3e80 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7060156cc0 con 0x7f70600b3e80 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.668+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7060156f60 con 0x7f70600b3e80 2024-05-20T17:57:20.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.669+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7060075b00 con 0x7f70600b3e80 2024-05-20T17:57:20.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.670+0000 7f705cff9640 1 -- 172.21.15.6:0/1670578583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7054044020 con 0x7f70600b3e80 2024-05-20T17:57:20.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.670+0000 7f705cff9640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f704c06be30 0x7f704c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.670+0000 7f705cff9640 1 -- 172.21.15.6:0/1670578583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f70540ab880 con 0x7f70600b3e80 2024-05-20T17:57:20.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.670+0000 7f705ffff640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f704c06be30 0x7f704c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.671+0000 7f705ffff640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f704c06be30 0x7f704c06e340 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7050006fd0 tx=0x7f7050008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:20.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.675+0000 7f705cff9640 1 -- 172.21.15.6:0/1670578583 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f705404b030 con 0x7f70600b3e80 2024-05-20T17:57:20.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.860+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7060068a90 con 0x7f70600b3e80 2024-05-20T17:57:20.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.861+0000 7f705cff9640 1 -- 172.21.15.6:0/1670578583 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16850 (secure 0 0 0) 0x7f705407a0a0 con 0x7f70600b3e80 2024-05-20T17:57:20.859 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:20.859 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:19.873502+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:57:17.597397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-20T17:57:18.862392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f704c06be30 msgr2=0x7f704c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f704c06be30 0x7f704c06e340 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7050006fd0 tx=0x7f7050008040 comp rx=0 tx=0).stop 2024-05-20T17:57:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 msgr2=0x7f70601f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f70601f5030 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f7054000c00 tx=0x7f70540046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 shutdown_connections 2024-05-20T17:57:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f704c06be30 0x7f704c06e340 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7060162820 0x7f7060158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70600b3e80 0x7f70601f5030 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 --2- 172.21.15.6:0/1670578583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f706006d910 0x7f7060157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 >> 172.21.15.6:0/1670578583 conn(0x7f70600d4bd0 msgr2=0x7f70600b8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 shutdown_connections 2024-05-20T17:57:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.863+0000 7f70663b5640 1 -- 172.21.15.6:0/1670578583 wait complete. 2024-05-20T17:57:20.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.990+0000 7fdd9857e640 1 Processor -- start 2024-05-20T17:57:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.990+0000 7fdd9857e640 1 -- start start 2024-05-20T17:57:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.991+0000 7fdd9857e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd9015d060 0x7fdd900b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.991+0000 7fdd9857e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd900b5720 0x7fdd9006f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.991+0000 7fdd9857e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd900b5b30 con 0x7fdd900b47b0 2024-05-20T17:57:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.991+0000 7fdd9857e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdd900b39f0 con 0x7fdd900b5720 2024-05-20T17:57:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.991+0000 7fdd9857e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd900b3cd0 con 0x7fdd9015d060 2024-05-20T17:57:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.991+0000 7fdd96b1b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd900b5720 0x7fdd9006f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.991+0000 7fdd9631a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdd900b47b0 0x7fdd900afad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34978/0 (socket says 172.21.15.6:34978) 2024-05-20T17:57:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.991+0000 7fdd9631a640 1 -- 172.21.15.6:0/1808645852 learned_addr learned my addr 172.21.15.6:0/1808645852 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.992+0000 7fdd95b19640 1 --2- 172.21.15.6:0/1808645852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd9015d060 0x7fdd900b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.992+0000 7fdd96b1b640 1 -- 172.21.15.6:0/1808645852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd9015d060 msgr2=0x7fdd900b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.992+0000 7fdd96b1b640 1 --2- 172.21.15.6:0/1808645852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd9015d060 0x7fdd900b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.992+0000 7fdd96b1b640 1 -- 172.21.15.6:0/1808645852 >> v1:172.21.15.6:6789/0 conn(0x7fdd900b47b0 legacy=0x7fdd900afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.992+0000 7fdd95318640 1 -- 172.21.15.6:0/1808645852 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264122383 0 0) 0x7fdd80001490 con 0x7fdd900b47b0 2024-05-20T17:57:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.992+0000 7fdd96b1b640 1 -- 172.21.15.6:0/1808645852 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd900b3fb0 con 0x7fdd900b5720 2024-05-20T17:57:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.992+0000 7fdd95b19640 1 --2- 172.21.15.6:0/1808645852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd9015d060 0x7fdd900b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.992+0000 7fdd96b1b640 1 --2- 172.21.15.6:0/1808645852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900b5720 0x7fdd9006f3d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fdd880097a0 tx=0x7fdd8802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6a70bc64787d8b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd95318640 1 -- 172.21.15.6:0/1808645852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88037070 con 0x7fdd900b5720 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd95318640 1 -- 172.21.15.6:0/1808645852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd88032440 con 0x7fdd900b5720 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd95318640 1 -- 172.21.15.6:0/1808645852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88032810 con 0x7fdd900b5720 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd9857e640 1 -- 172.21.15.6:0/1808645852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900b5720 msgr2=0x7fdd9006f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd9857e640 1 --2- 172.21.15.6:0/1808645852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900b5720 0x7fdd9006f3d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fdd880097a0 tx=0x7fdd8802a180 comp rx=0 tx=0).stop 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd9857e640 1 -- 172.21.15.6:0/1808645852 shutdown_connections 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd9857e640 1 --2- 172.21.15.6:0/1808645852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900b5720 0x7fdd9006f3d0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd9857e640 1 --2- 172.21.15.6:0/1808645852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd9015d060 0x7fdd900b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd9857e640 1 -- 172.21.15.6:0/1808645852 >> 172.21.15.6:0/1808645852 conn(0x7fdd900cd2a0 msgr2=0x7fdd900cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.993+0000 7fdd9857e640 1 -- 172.21.15.6:0/1808645852 shutdown_connections 2024-05-20T17:57:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.994+0000 7fdd9857e640 1 -- 172.21.15.6:0/1808645852 wait complete. 2024-05-20T17:57:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.995+0000 7fdd9857e640 1 Processor -- start 2024-05-20T17:57:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.995+0000 7fdd9857e640 1 -- start start 2024-05-20T17:57:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd9857e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd900b5720 0x7fdd901f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd9857e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd9015d060 0x7fdd9006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd9857e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c4d0 0x7fdd9015ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd9857e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdd90159de0 con 0x7fdd9006c4d0 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd9857e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd90159c60 con 0x7fdd9015d060 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd9857e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9006f910 con 0x7fdd900b5720 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c4d0 0x7fdd9015ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c4d0 0x7fdd9015ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35852/0 (socket says 172.21.15.6:35852) 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 -- 172.21.15.6:0/3109412717 learned_addr learned my addr 172.21.15.6:0/3109412717 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd9631a640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd900b5720 0x7fdd901f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd95b19640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd9015d060 0x7fdd9006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 -- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd900b5720 msgr2=0x7fdd901f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd900b5720 0x7fdd901f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 -- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd9015d060 msgr2=0x7fdd9006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd9015d060 0x7fdd9006bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 -- 172.21.15.6:0/3109412717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd901f65c0 con 0x7fdd9006c4d0 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd96b1b640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c4d0 0x7fdd9015ffd0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fdd880098c0 tx=0x7fdd880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd8effd640 1 -- 172.21.15.6:0/3109412717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88037040 con 0x7fdd9006c4d0 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd8effd640 1 -- 172.21.15.6:0/3109412717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd88042070 con 0x7fdd9006c4d0 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd901f6ad0 con 0x7fdd9006c4d0 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.997+0000 7fdd8effd640 1 -- 172.21.15.6:0/3109412717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88030b30 con 0x7fdd9006c4d0 2024-05-20T17:57:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.998+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9009c880 con 0x7fdd9006c4d0 2024-05-20T17:57:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.998+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd901f6840 con 0x7fdd9006c4d0 2024-05-20T17:57:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:20.999+0000 7fdd8effd640 1 -- 172.21.15.6:0/3109412717 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd88030cd0 con 0x7fdd9006c4d0 2024-05-20T17:57:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.000+0000 7fdd8effd640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd7c06be30 0x7fdd7c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.000+0000 7fdd8effd640 1 -- 172.21.15.6:0/3109412717 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fdd880abc00 con 0x7fdd9006c4d0 2024-05-20T17:57:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.000+0000 7fdd9631a640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd7c06be30 0x7fdd7c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.001+0000 7fdd9631a640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd7c06be30 0x7fdd7c06e340 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdd80007ed0 tx=0x7fdd80007e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.004+0000 7fdd8effd640 1 -- 172.21.15.6:0/3109412717 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdd8804c020 con 0x7fdd9006c4d0 2024-05-20T17:57:21.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.192+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd90075b00 con 0x7fdd9006c4d0 2024-05-20T17:57:21.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.193+0000 7fdd8effd640 1 -- 172.21.15.6:0/3109412717 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16850 (secure 0 0 0) 0x7fdd8807a2f0 con 0x7fdd9006c4d0 2024-05-20T17:57:21.191 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:21.191 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:19.873502+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:57:17.597397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-20T17:57:18.862392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd7c06be30 msgr2=0x7fdd7c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd7c06be30 0x7fdd7c06e340 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdd80007ed0 tx=0x7fdd80007e60 comp rx=0 tx=0).stop 2024-05-20T17:57:21.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c4d0 msgr2=0x7fdd9015ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c4d0 0x7fdd9015ffd0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fdd880098c0 tx=0x7fdd880046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 shutdown_connections 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd7c06be30 0x7fdd7c06e340 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9006c4d0 0x7fdd9015ffd0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd9015d060 0x7fdd9006bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 --2- 172.21.15.6:0/3109412717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd900b5720 0x7fdd901f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 >> 172.21.15.6:0/3109412717 conn(0x7fdd900cd2a0 msgr2=0x7fdd900b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 shutdown_connections 2024-05-20T17:57:21.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.195+0000 7fdd9857e640 1 -- 172.21.15.6:0/3109412717 wait complete. 2024-05-20T17:57:21.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T17:57:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.325+0000 7fdd49ad7640 1 Processor -- start 2024-05-20T17:57:21.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.326+0000 7fdd49ad7640 1 -- start start 2024-05-20T17:57:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd49ad7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415d460 0x7fdd4406b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd49ad7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4415d870 con 0x7fdd440d1780 2024-05-20T17:57:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd49ad7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4415dae0 con 0x7fdd440b17f0 2024-05-20T17:57:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd49ad7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4415ddc0 con 0x7fdd4415d460 2024-05-20T17:57:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd42ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdd440d1780 0x7fdd440d1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34982/0 (socket says 172.21.15.6:34982) 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd42ffd640 1 -- 172.21.15.6:0/2325787613 learned_addr learned my addr 172.21.15.6:0/2325787613 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd437fe640 1 --2- 172.21.15.6:0/2325787613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415d460 0x7fdd4406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd427fc640 1 -- 172.21.15.6:0/2325787613 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431819164 0 0) 0x7fdd4415d870 con 0x7fdd440d1780 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.327+0000 7fdd427fc640 1 -- 172.21.15.6:0/2325787613 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2c003520 con 0x7fdd440d1780 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.328+0000 7fdd427fc640 1 -- 172.21.15.6:0/2325787613 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082282836 0 0) 0x7fdd4415dae0 con 0x7fdd440b17f0 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.328+0000 7fdd427fc640 1 -- 172.21.15.6:0/2325787613 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd4415d870 con 0x7fdd440b17f0 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.328+0000 7fdd437fe640 1 -- 172.21.15.6:0/2325787613 >> v1:172.21.15.171:6789/0 conn(0x7fdd440b17f0 legacy=0x7fdd440b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.328+0000 7fdd437fe640 1 -- 172.21.15.6:0/2325787613 >> v1:172.21.15.6:6789/0 conn(0x7fdd440d1780 legacy=0x7fdd440d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:21.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.328+0000 7fdd437fe640 1 -- 172.21.15.6:0/2325787613 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4415e0a0 con 0x7fdd4415d460 2024-05-20T17:57:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd437fe640 1 --2- 172.21.15.6:0/2325787613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415d460 0x7fdd4406b870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdd340097d0 tx=0x7fdd3402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470cf175a94e3bf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd427fc640 1 -- 172.21.15.6:0/2325787613 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34037070 con 0x7fdd4415d460 2024-05-20T17:57:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd427fc640 1 -- 172.21.15.6:0/2325787613 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34032440 con 0x7fdd4415d460 2024-05-20T17:57:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd427fc640 1 -- 172.21.15.6:0/2325787613 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd340327f0 con 0x7fdd4415d460 2024-05-20T17:57:21.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd49ad7640 1 -- 172.21.15.6:0/2325787613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415d460 msgr2=0x7fdd4406b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:21.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd49ad7640 1 --2- 172.21.15.6:0/2325787613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415d460 0x7fdd4406b870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdd340097d0 tx=0x7fdd3402a230 comp rx=0 tx=0).stop 2024-05-20T17:57:21.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd49ad7640 1 -- 172.21.15.6:0/2325787613 shutdown_connections 2024-05-20T17:57:21.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd49ad7640 1 --2- 172.21.15.6:0/2325787613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4415d460 0x7fdd4406b870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:21.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.329+0000 7fdd49ad7640 1 -- 172.21.15.6:0/2325787613 >> 172.21.15.6:0/2325787613 conn(0x7fdd440b6620 msgr2=0x7fdd440b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:21.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.330+0000 7fdd49ad7640 1 -- 172.21.15.6:0/2325787613 shutdown_connections 2024-05-20T17:57:21.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.330+0000 7fdd49ad7640 1 -- 172.21.15.6:0/2325787613 wait complete. 2024-05-20T17:57:21.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.331+0000 7fdd49ad7640 1 Processor -- start 2024-05-20T17:57:21.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.331+0000 7fdd49ad7640 1 -- start start 2024-05-20T17:57:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd49ad7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd440b17f0 0x7fdd441442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd49ad7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd440d1780 0x7fdd4415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd49ad7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415d460 0x7fdd44145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd49ad7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4415e380 con 0x7fdd440b17f0 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd49ad7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4406bdb0 con 0x7fdd4415d460 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd49ad7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd440b2310 con 0x7fdd440d1780 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd440b17f0 0x7fdd441442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd440b17f0 0x7fdd441442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35868/0 (socket says 172.21.15.6:35868) 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 -- 172.21.15.6:0/310204698 learned_addr learned my addr 172.21.15.6:0/310204698 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd42ffd640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd440d1780 0x7fdd4415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd43fff640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415d460 0x7fdd44145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 -- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd440d1780 msgr2=0x7fdd4415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:21.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd440d1780 0x7fdd4415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 -- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415d460 msgr2=0x7fdd44145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415d460 0x7fdd44145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 -- 172.21.15.6:0/310204698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd44144800 con 0x7fdd440b17f0 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd42ffd640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd440d1780 0x7fdd4415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.333+0000 7fdd437fe640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd440b17f0 0x7fdd441442c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fdd34035040 tx=0x7fdd340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.334+0000 7fdd2bfff640 1 -- 172.21.15.6:0/310204698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34037050 con 0x7fdd440b17f0 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.334+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd44144d10 con 0x7fdd440b17f0 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.334+0000 7fdd2bfff640 1 -- 172.21.15.6:0/310204698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34043070 con 0x7fdd440b17f0 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.334+0000 7fdd2bfff640 1 -- 172.21.15.6:0/310204698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34032a50 con 0x7fdd440b17f0 2024-05-20T17:57:21.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.334+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd440ce730 con 0x7fdd440b17f0 2024-05-20T17:57:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.335+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd44075b00 con 0x7fdd440b17f0 2024-05-20T17:57:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.335+0000 7fdd2bfff640 1 -- 172.21.15.6:0/310204698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd34032bf0 con 0x7fdd440b17f0 2024-05-20T17:57:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.336+0000 7fdd2bfff640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd3006be60 0x7fdd3006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.336+0000 7fdd2bfff640 1 -- 172.21.15.6:0/310204698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fdd340abbe0 con 0x7fdd440b17f0 2024-05-20T17:57:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.336+0000 7fdd42ffd640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd3006be60 0x7fdd3006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:21.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.337+0000 7fdd42ffd640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd3006be60 0x7fdd3006e370 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd440b2230 tx=0x7fdd38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:21.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.341+0000 7fdd2bfff640 1 -- 172.21.15.6:0/310204698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdd3404d020 con 0x7fdd440b17f0 2024-05-20T17:57:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:21.564+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdd440ce250 con 0x7fdd440b17f0 2024-05-20T17:57:22.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.510+0000 7fdd2bfff640 1 -- 172.21.15.6:0/310204698 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) ==== 118+0+0 (secure 0 0 0) 0x7fdd3407a4a0 con 0x7fdd440b17f0 2024-05-20T17:57:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd3006be60 msgr2=0x7fdd3006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd3006be60 0x7fdd3006e370 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd440b2230 tx=0x7fdd38009040 comp rx=0 tx=0).stop 2024-05-20T17:57:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd440b17f0 msgr2=0x7fdd441442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd440b17f0 0x7fdd441442c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fdd34035040 tx=0x7fdd340046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 shutdown_connections 2024-05-20T17:57:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd3006be60 0x7fdd3006e370 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4415d460 0x7fdd44145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd440d1780 0x7fdd4415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 --2- 172.21.15.6:0/310204698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd440b17f0 0x7fdd441442c0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 >> 172.21.15.6:0/310204698 conn(0x7fdd440b6620 msgr2=0x7fdd44142270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:22.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 shutdown_connections 2024-05-20T17:57:22.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.513+0000 7fdd49ad7640 1 -- 172.21.15.6:0/310204698 wait complete. 2024-05-20T17:57:22.525 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T17:57:22.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T17:57:22.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.654+0000 7f2eba157640 1 Processor -- start 2024-05-20T17:57:22.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.654+0000 7f2eba157640 1 -- start start 2024-05-20T17:57:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.655+0000 7f2eba157640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2eb406d3d0 0x7f2eb406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.655+0000 7f2eba157640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb40b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.655+0000 7f2eba157640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb406dd20 con 0x7f2eb4162820 2024-05-20T17:57:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.655+0000 7f2eba157640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb40d0630 con 0x7f2eb406d3d0 2024-05-20T17:57:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.655+0000 7f2eba157640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb40d39c0 con 0x7f2eb40b8190 2024-05-20T17:57:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb40b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eb37fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2eb4162820 0x7f2eb40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:37594/0 (socket says 172.21.15.6:37594) 2024-05-20T17:57:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eb37fe640 1 -- 172.21.15.6:0/2703789759 learned_addr learned my addr 172.21.15.6:0/2703789759 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eabfff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2eb406d3d0 0x7f2eb406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eb2ffd640 1 -- 172.21.15.6:0/2703789759 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114651821 0 0) 0x7f2ea4001110 con 0x7f2eb4162820 2024-05-20T17:57:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eb2ffd640 1 -- 172.21.15.6:0/2703789759 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ea0003520 con 0x7f2eb4162820 2024-05-20T17:57:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eabfff640 1 -- 172.21.15.6:0/2703789759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 msgr2=0x7f2eb40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:22.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eabfff640 1 --2- 172.21.15.6:0/2703789759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb40b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eabfff640 1 -- 172.21.15.6:0/2703789759 >> v1:172.21.15.171:6789/0 conn(0x7f2eb4162820 legacy=0x7f2eb40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eabfff640 1 -- 172.21.15.6:0/2703789759 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb40d3ca0 con 0x7f2eb406d3d0 2024-05-20T17:57:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.656+0000 7f2eb3fff640 1 --2- 172.21.15.6:0/2703789759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb40b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.657+0000 7f2eabfff640 1 --2- 172.21.15.6:0/2703789759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 0x7f2eb406d7e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0097a0 tx=0x7f2e9c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be401307c85f0d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.657+0000 7f2eb2ffd640 1 -- 172.21.15.6:0/2703789759 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c037070 con 0x7f2eb406d3d0 2024-05-20T17:57:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.657+0000 7f2eb2ffd640 1 -- 172.21.15.6:0/2703789759 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c032440 con 0x7f2eb406d3d0 2024-05-20T17:57:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.657+0000 7f2eb2ffd640 1 -- 172.21.15.6:0/2703789759 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c032810 con 0x7f2eb406d3d0 2024-05-20T17:57:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.658+0000 7f2eba157640 1 -- 172.21.15.6:0/2703789759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 msgr2=0x7f2eb406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.658+0000 7f2eba157640 1 --2- 172.21.15.6:0/2703789759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 0x7f2eb406d7e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0097a0 tx=0x7f2e9c02a180 comp rx=0 tx=0).stop 2024-05-20T17:57:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.658+0000 7f2eba157640 1 -- 172.21.15.6:0/2703789759 shutdown_connections 2024-05-20T17:57:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.658+0000 7f2eba157640 1 --2- 172.21.15.6:0/2703789759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb40b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.658+0000 7f2eba157640 1 --2- 172.21.15.6:0/2703789759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 0x7f2eb406d7e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.658+0000 7f2eba157640 1 -- 172.21.15.6:0/2703789759 >> 172.21.15.6:0/2703789759 conn(0x7f2eb40d4bd0 msgr2=0x7f2eb40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:22.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.658+0000 7f2eba157640 1 -- 172.21.15.6:0/2703789759 shutdown_connections 2024-05-20T17:57:22.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.658+0000 7f2eba157640 1 -- 172.21.15.6:0/2703789759 wait complete. 2024-05-20T17:57:22.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.660+0000 7f2eba157640 1 Processor -- start 2024-05-20T17:57:22.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.660+0000 7f2eba157640 1 -- start start 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eba157640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 0x7f2eb414bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eba157640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb41e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eba157640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4162820 0x7f2eb41f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eba157640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40d0300 con 0x7f2eb4162820 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eba157640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb40d4260 con 0x7f2eb406d3d0 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eba157640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb40b4050 con 0x7f2eb40b8190 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4162820 0x7f2eb41f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4162820 0x7f2eb41f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35876/0 (socket says 172.21.15.6:35876) 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eb3fff640 1 -- 172.21.15.6:0/3190335208 learned_addr learned my addr 172.21.15.6:0/3190335208 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.661+0000 7f2eb37fe640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 0x7f2eb414bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eabfff640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb41e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb3fff640 1 -- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 msgr2=0x7f2eb41e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb3fff640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb41e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb3fff640 1 -- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 msgr2=0x7f2eb414bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb3fff640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 0x7f2eb414bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb3fff640 1 -- 172.21.15.6:0/3190335208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb40cd150 con 0x7f2eb4162820 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb3fff640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4162820 0x7f2eb41f8ed0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009e00 tx=0x7f2eac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb0ff9640 1 -- 172.21.15.6:0/3190335208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac018020 con 0x7f2eb4162820 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb0ff9640 1 -- 172.21.15.6:0/3190335208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac014480 con 0x7f2eb4162820 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb40cd430 con 0x7f2eb4162820 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eb0ff9640 1 -- 172.21.15.6:0/3190335208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac014870 con 0x7f2eb4162820 2024-05-20T17:57:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.662+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb41e90c0 con 0x7f2eb4162820 2024-05-20T17:57:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.663+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb4075b00 con 0x7f2eb4162820 2024-05-20T17:57:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.664+0000 7f2eb0ff9640 1 -- 172.21.15.6:0/3190335208 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2eac005d10 con 0x7f2eb4162820 2024-05-20T17:57:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.664+0000 7f2eb0ff9640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e9406be60 0x7f2e9406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.664+0000 7f2eb0ff9640 1 -- 172.21.15.6:0/3190335208 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f2eac08bd50 con 0x7f2eb4162820 2024-05-20T17:57:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.664+0000 7f2eb37fe640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e9406be60 0x7f2e9406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:22.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.665+0000 7f2eb37fe640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e9406be60 0x7f2e9406e370 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4007fd0 tx=0x7f2ea4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:22.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.669+0000 7f2eb0ff9640 1 -- 172.21.15.6:0/3190335208 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2eac08f030 con 0x7f2eb4162820 2024-05-20T17:57:22.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:22.889+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2eb4068770 con 0x7f2eb4162820 2024-05-20T17:57:23.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.512+0000 7f2eb0ff9640 1 -- 172.21.15.6:0/3190335208 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f2eac022030 con 0x7f2eb4162820 2024-05-20T17:57:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e9406be60 msgr2=0x7f2e9406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e9406be60 0x7f2e9406e370 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4007fd0 tx=0x7f2ea4009040 comp rx=0 tx=0).stop 2024-05-20T17:57:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4162820 msgr2=0x7f2eb41f8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4162820 0x7f2eb41f8ed0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009e00 tx=0x7f2eac00c490 comp rx=0 tx=0).stop 2024-05-20T17:57:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 shutdown_connections 2024-05-20T17:57:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e9406be60 0x7f2e9406e370 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4162820 0x7f2eb41f8ed0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2eb40b8190 0x7f2eb41e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 --2- 172.21.15.6:0/3190335208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2eb406d3d0 0x7f2eb414bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 >> 172.21.15.6:0/3190335208 conn(0x7f2eb40d4bd0 msgr2=0x7f2eb40b9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 shutdown_connections 2024-05-20T17:57:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.515+0000 7f2eba157640 1 -- 172.21.15.6:0/3190335208 wait complete. 2024-05-20T17:57:23.527 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T17:57:23.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:57:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.651+0000 7f0a582a8640 1 Processor -- start 2024-05-20T17:57:23.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.651+0000 7f0a582a8640 1 -- start start 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.652+0000 7f0a582a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 0x7f0a500d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.652+0000 7f0a582a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a500d14b0 0x7f0a500d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.652+0000 7f0a582a8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a500d0370 con 0x7f0a50163a10 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.652+0000 7f0a582a8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0a500d3ca0 con 0x7f0a500d14b0 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.652+0000 7f0a582a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0a500d0650 con 0x7f0a500b4010 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.653+0000 7f0a56845640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a500d14b0 0x7f0a500d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.653+0000 7f0a56845640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0a500d14b0 0x7f0a500d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35884/0 (socket says 172.21.15.6:35884) 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.653+0000 7f0a56845640 1 -- 172.21.15.6:0/4172666051 learned_addr learned my addr 172.21.15.6:0/4172666051 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.653+0000 7f0a55843640 1 --2- 172.21.15.6:0/4172666051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 0x7f0a500d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.653+0000 7f0a56845640 1 -- 172.21.15.6:0/4172666051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 msgr2=0x7f0a500d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.653+0000 7f0a56845640 1 --2- 172.21.15.6:0/4172666051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 0x7f0a500d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.653+0000 7f0a56845640 1 -- 172.21.15.6:0/4172666051 >> v1:172.21.15.171:6789/0 conn(0x7f0a50163a10 legacy=0x7f0a500cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.653+0000 7f0a56845640 1 -- 172.21.15.6:0/4172666051 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a500d3650 con 0x7f0a500d14b0 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.654+0000 7f0a56845640 1 --2- 172.21.15.6:0/4172666051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500d14b0 0x7f0a500d18c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009e50 tx=0x7f0a4802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0efa9a86924110 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.654+0000 7f0a55042640 1 -- 172.21.15.6:0/4172666051 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48036070 con 0x7f0a500d14b0 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.654+0000 7f0a55042640 1 -- 172.21.15.6:0/4172666051 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a48031600 con 0x7f0a500d14b0 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.654+0000 7f0a55042640 1 -- 172.21.15.6:0/4172666051 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a480319d0 con 0x7f0a500d14b0 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.654+0000 7f0a582a8640 1 -- 172.21.15.6:0/4172666051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500d14b0 msgr2=0x7f0a500d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.654+0000 7f0a582a8640 1 --2- 172.21.15.6:0/4172666051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500d14b0 0x7f0a500d18c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009e50 tx=0x7f0a4802a6c0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.655+0000 7f0a582a8640 1 -- 172.21.15.6:0/4172666051 shutdown_connections 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.655+0000 7f0a582a8640 1 --2- 172.21.15.6:0/4172666051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a500d14b0 0x7f0a500d18c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.655+0000 7f0a582a8640 1 --2- 172.21.15.6:0/4172666051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 0x7f0a500d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.655+0000 7f0a582a8640 1 -- 172.21.15.6:0/4172666051 >> 172.21.15.6:0/4172666051 conn(0x7f0a5006d240 msgr2=0x7f0a5006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.655+0000 7f0a582a8640 1 -- 172.21.15.6:0/4172666051 shutdown_connections 2024-05-20T17:57:23.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.655+0000 7f0a582a8640 1 -- 172.21.15.6:0/4172666051 wait complete. 2024-05-20T17:57:23.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.656+0000 7f0a582a8640 1 Processor -- start 2024-05-20T17:57:23.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.657+0000 7f0a582a8640 1 -- start start 2024-05-20T17:57:23.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a582a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 0x7f0a50155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a582a8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a500d14b0 0x7f0a500b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a582a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a50163a10 0x7f0a5015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a582a8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0a500b8210 con 0x7f0a50163a10 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a582a8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0a500d1e00 con 0x7f0a500d14b0 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a582a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0a500b8390 con 0x7f0a500b4010 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56845640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a50163a10 0x7f0a5015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56845640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a50163a10 0x7f0a5015aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35888/0 (socket says 172.21.15.6:35888) 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56845640 1 -- 172.21.15.6:0/3363976034 learned_addr learned my addr 172.21.15.6:0/3363976034 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a55843640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a500d14b0 0x7f0a500b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56044640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 0x7f0a50155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56845640 1 -- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 msgr2=0x7f0a50155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56845640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 0x7f0a50155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56845640 1 -- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a500d14b0 msgr2=0x7f0a500b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56845640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a500d14b0 0x7f0a500b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.658+0000 7f0a56845640 1 -- 172.21.15.6:0/3363976034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a50156010 con 0x7f0a50163a10 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.659+0000 7f0a56845640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a50163a10 0x7f0a5015aca0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009e50 tx=0x7f0a48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.659+0000 7f0a46ffd640 1 -- 172.21.15.6:0/3363976034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48036050 con 0x7f0a50163a10 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.659+0000 7f0a46ffd640 1 -- 172.21.15.6:0/3363976034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a48042070 con 0x7f0a50163a10 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.659+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a50159c00 con 0x7f0a50163a10 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.659+0000 7f0a46ffd640 1 -- 172.21.15.6:0/3363976034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48009510 con 0x7f0a50163a10 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.659+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5015a1c0 con 0x7f0a50163a10 2024-05-20T17:57:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.660+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a50075b00 con 0x7f0a50163a10 2024-05-20T17:57:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.660+0000 7f0a46ffd640 1 -- 172.21.15.6:0/3363976034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a48007bf0 con 0x7f0a50163a10 2024-05-20T17:57:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.661+0000 7f0a46ffd640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a3406be30 0x7f0a3406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.661+0000 7f0a46ffd640 1 -- 172.21.15.6:0/3363976034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f0a480abf00 con 0x7f0a50163a10 2024-05-20T17:57:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.661+0000 7f0a56044640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a3406be30 0x7f0a3406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.662+0000 7f0a56044640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a3406be30 0x7f0a3406e340 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c006fd0 tx=0x7f0a4c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.666+0000 7f0a46ffd640 1 -- 172.21.15.6:0/3363976034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0a4807a1f0 con 0x7f0a50163a10 2024-05-20T17:57:23.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.886+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a500d3050 con 0x7f0a50163a10 2024-05-20T17:57:23.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.887+0000 7f0a46ffd640 1 -- 172.21.15.6:0/3363976034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5183 (secure 0 0 0) 0x7f0a4807e4f0 con 0x7f0a50163a10 2024-05-20T17:57:23.885 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:23.885 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/4216834090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":4216834090},{"type":"v1","addr":"172.21.15.171:6836","nonce":4216834090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1870629940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1870629940},{"type":"v1","addr":"172.21.15.171:6837","nonce":1870629940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3012084004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3012084004},{"type":"v1","addr":"172.21.15.6:6833","nonce":3012084004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:57:19.873838+0000","modified":"2024-05-20T17:57:22.890340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7074":{"gid":7074,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3379618192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3379618192},{"type":"v1","addr":"172.21.15.6:6835","nonce":3379618192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7074,"qdb_cluster":[7074]},"id":6}]} 2024-05-20T17:57:23.885 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2024-05-20T17:57:23.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a3406be30 msgr2=0x7f0a3406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:23.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a3406be30 0x7f0a3406e340 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c006fd0 tx=0x7f0a4c009060 comp rx=0 tx=0).stop 2024-05-20T17:57:23.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a50163a10 msgr2=0x7f0a5015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:23.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a50163a10 0x7f0a5015aca0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009e50 tx=0x7f0a48004a40 comp rx=0 tx=0).stop 2024-05-20T17:57:23.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 shutdown_connections 2024-05-20T17:57:23.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0a3406be30 0x7f0a3406e340 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a50163a10 0x7f0a5015aca0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a500d14b0 0x7f0a500b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 --2- 172.21.15.6:0/3363976034 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a500b4010 0x7f0a50155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:23.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 >> 172.21.15.6:0/3363976034 conn(0x7f0a5006d240 msgr2=0x7f0a500b8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:23.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 shutdown_connections 2024-05-20T17:57:23.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:23.889+0000 7f0a582a8640 1 -- 172.21.15.6:0/3363976034 wait complete. 2024-05-20T17:57:23.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:57:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.015+0000 7fcebd15e640 1 Processor -- start 2024-05-20T17:57:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.015+0000 7fcebd15e640 1 -- start start 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.016+0000 7fcebd15e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fceb806c4c0 0x7fceb815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fcebd15e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceb80b51c0 con 0x7fceb80b0020 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fcebd15e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceb815bf20 con 0x7fceb815ca00 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fcebd15e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fceb815c200 con 0x7fceb806c4c0 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fceaffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fceb806c4c0 0x7fceb815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fceb6d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fceb80b0020 0x7fceb806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34994/0 (socket says 172.21.15.6:34994) 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fceb6d9d640 1 -- 172.21.15.6:0/3823472216 learned_addr learned my addr 172.21.15.6:0/3823472216 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fceaffff640 1 -- 172.21.15.6:0/3823472216 >> v1:172.21.15.171:6789/0 conn(0x7fceb815ca00 legacy=0x7fceb80b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fceaffff640 1 -- 172.21.15.6:0/3823472216 >> v1:172.21.15.6:6789/0 conn(0x7fceb80b0020 legacy=0x7fceb806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fceaffff640 1 -- 172.21.15.6:0/3823472216 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb815c4e0 con 0x7fceb806c4c0 2024-05-20T17:57:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.017+0000 7fceb659c640 1 -- 172.21.15.6:0/3823472216 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692788574 0 0) 0x7fceb80b51c0 con 0x7fceb80b0020 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.018+0000 7fceaffff640 1 --2- 172.21.15.6:0/3823472216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb806c4c0 0x7fceb815fd80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fcea00097a0 tx=0x7fcea002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3808efcac93933 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.018+0000 7fceb659c640 1 -- 172.21.15.6:0/3823472216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0037070 con 0x7fceb806c4c0 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.018+0000 7fceb659c640 1 -- 172.21.15.6:0/3823472216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea002ae50 con 0x7fceb806c4c0 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.018+0000 7fceb659c640 1 -- 172.21.15.6:0/3823472216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0032660 con 0x7fceb806c4c0 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.019+0000 7fcebd15e640 1 -- 172.21.15.6:0/3823472216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb806c4c0 msgr2=0x7fceb815fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.019+0000 7fcebd15e640 1 --2- 172.21.15.6:0/3823472216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb806c4c0 0x7fceb815fd80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fcea00097a0 tx=0x7fcea002a140 comp rx=0 tx=0).stop 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.019+0000 7fcebd15e640 1 -- 172.21.15.6:0/3823472216 shutdown_connections 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.019+0000 7fcebd15e640 1 --2- 172.21.15.6:0/3823472216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb806c4c0 0x7fceb815fd80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.019+0000 7fcebd15e640 1 -- 172.21.15.6:0/3823472216 >> 172.21.15.6:0/3823472216 conn(0x7fceb80cd2a0 msgr2=0x7fceb80cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.019+0000 7fcebd15e640 1 -- 172.21.15.6:0/3823472216 shutdown_connections 2024-05-20T17:57:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.019+0000 7fcebd15e640 1 -- 172.21.15.6:0/3823472216 wait complete. 2024-05-20T17:57:24.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.021+0000 7fcebd15e640 1 Processor -- start 2024-05-20T17:57:24.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.021+0000 7fcebd15e640 1 -- start start 2024-05-20T17:57:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fcebd15e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fceb80b0020 0x7fceb815e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fcebd15e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb815ca00 0x7fceb809a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fcebd15e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fceb809adb0 0x7fceb809c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fcebd15e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fceb80b4c00 con 0x7fceb815ca00 2024-05-20T17:57:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fcebd15e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fceb80b54a0 con 0x7fceb809adb0 2024-05-20T17:57:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fcebd15e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fceb80b4d80 con 0x7fceb80b0020 2024-05-20T17:57:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fceaffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb815ca00 0x7fceb809a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fceaffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb815ca00 0x7fceb809a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35908/0 (socket says 172.21.15.6:35908) 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fceaffff640 1 -- 172.21.15.6:0/2401712339 learned_addr learned my addr 172.21.15.6:0/2401712339 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fceb6d9d640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fceb80b0020 0x7fceb815e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fceb759e640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fceb809adb0 0x7fceb809c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fceaffff640 1 -- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fceb80b0020 msgr2=0x7fceb815e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.022+0000 7fceaffff640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fceb80b0020 0x7fceb815e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fceaffff640 1 -- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fceb809adb0 msgr2=0x7fceb809c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fceaffff640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fceb809adb0 0x7fceb809c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fceaffff640 1 -- 172.21.15.6:0/2401712339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb809d590 con 0x7fceb815ca00 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fceb759e640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fceb809adb0 0x7fceb809c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fceaffff640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb815ca00 0x7fceb809a870 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fcea00097a0 tx=0x7fcea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fceaf7fe640 1 -- 172.21.15.6:0/2401712339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0042070 con 0x7fceb815ca00 2024-05-20T17:57:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fceaf7fe640 1 -- 172.21.15.6:0/2401712339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea003e670 con 0x7fceb815ca00 2024-05-20T17:57:24.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb809d870 con 0x7fceb815ca00 2024-05-20T17:57:24.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fceaf7fe640 1 -- 172.21.15.6:0/2401712339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0037040 con 0x7fceb815ca00 2024-05-20T17:57:24.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.023+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb815e810 con 0x7fceb815ca00 2024-05-20T17:57:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.024+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb809d300 con 0x7fceb815ca00 2024-05-20T17:57:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.025+0000 7fceaf7fe640 1 -- 172.21.15.6:0/2401712339 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcea0045070 con 0x7fceb815ca00 2024-05-20T17:57:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.025+0000 7fceaf7fe640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fce9806be30 0x7fce9806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.025+0000 7fceaf7fe640 1 -- 172.21.15.6:0/2401712339 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fcea00ab800 con 0x7fceb815ca00 2024-05-20T17:57:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.025+0000 7fceb6d9d640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fce9806be30 0x7fce9806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.026+0000 7fceb6d9d640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fce9806be30 0x7fce9806e340 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000f60 tx=0x7fcea8007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.030+0000 7fceaf7fe640 1 -- 172.21.15.6:0/2401712339 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcea007a140 con 0x7fceb815ca00 2024-05-20T17:57:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.214+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fceb8075b00 con 0x7fceb815ca00 2024-05-20T17:57:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.215+0000 7fceaf7fe640 1 -- 172.21.15.6:0/2401712339 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16837 (secure 0 0 0) 0x7fcea0079a40 con 0x7fceb815ca00 2024-05-20T17:57:24.213 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:24.213 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":87,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:21.499949+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:57:17.597397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-20T17:57:18.862392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:57:24.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fce9806be30 msgr2=0x7fce9806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fce9806be30 0x7fce9806e340 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000f60 tx=0x7fcea8007c00 comp rx=0 tx=0).stop 2024-05-20T17:57:24.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb815ca00 msgr2=0x7fceb809a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb815ca00 0x7fceb809a870 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fcea00097a0 tx=0x7fcea00046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 shutdown_connections 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fce9806be30 0x7fce9806e340 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fceb809adb0 0x7fceb809c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fceb815ca00 0x7fceb809a870 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 --2- 172.21.15.6:0/2401712339 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fceb80b0020 0x7fceb815e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.217+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 >> 172.21.15.6:0/2401712339 conn(0x7fceb80cd2a0 msgr2=0x7fceb806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.218+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 shutdown_connections 2024-05-20T17:57:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.218+0000 7fcebd15e640 1 -- 172.21.15.6:0/2401712339 wait complete. 2024-05-20T17:57:24.227 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T17:57:24.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:57:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.345+0000 7f51e908b640 1 Processor -- start 2024-05-20T17:57:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.345+0000 7f51e908b640 1 -- start start 2024-05-20T17:57:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e908b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e415f220 0x7f51e40d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e908b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51e40cfae0 0x7f51e40ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e908b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e40cda20 con 0x7f51e40d0e00 2024-05-20T17:57:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e908b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f51e40cdd00 con 0x7f51e40cfae0 2024-05-20T17:57:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e908b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51e40cdfe0 con 0x7f51e415f220 2024-05-20T17:57:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51e40cfae0 0x7f51e40ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51e40cfae0 0x7f51e40ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35912/0 (socket says 172.21.15.6:35912) 2024-05-20T17:57:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e359e640 1 -- 172.21.15.6:0/2991498643 learned_addr learned my addr 172.21.15.6:0/2991498643 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e2d9d640 1 --2- 172.21.15.6:0/2991498643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e415f220 0x7f51e40d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e359e640 1 -- 172.21.15.6:0/2991498643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e415f220 msgr2=0x7f51e40d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e359e640 1 --2- 172.21.15.6:0/2991498643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e415f220 0x7f51e40d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.346+0000 7f51e359e640 1 -- 172.21.15.6:0/2991498643 >> v1:172.21.15.171:6789/0 conn(0x7f51e40d0e00 legacy=0x7f51e40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.347+0000 7f51e359e640 1 -- 172.21.15.6:0/2991498643 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e40ce2c0 con 0x7f51e40cfae0 2024-05-20T17:57:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.347+0000 7f51e359e640 1 --2- 172.21.15.6:0/2991498643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e40cfae0 0x7f51e40ce7e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009e50 tx=0x7f51dc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b27114597229036 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.347+0000 7f51e1d9b640 1 -- 172.21.15.6:0/2991498643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc036070 con 0x7f51e40cfae0 2024-05-20T17:57:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.347+0000 7f51e1d9b640 1 -- 172.21.15.6:0/2991498643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51dc031600 con 0x7f51e40cfae0 2024-05-20T17:57:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.347+0000 7f51e1d9b640 1 -- 172.21.15.6:0/2991498643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0319d0 con 0x7f51e40cfae0 2024-05-20T17:57:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.348+0000 7f51e908b640 1 -- 172.21.15.6:0/2991498643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e40cfae0 msgr2=0x7f51e40ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.348+0000 7f51e908b640 1 --2- 172.21.15.6:0/2991498643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e40cfae0 0x7f51e40ce7e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009e50 tx=0x7f51dc02a680 comp rx=0 tx=0).stop 2024-05-20T17:57:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.348+0000 7f51e908b640 1 -- 172.21.15.6:0/2991498643 shutdown_connections 2024-05-20T17:57:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.348+0000 7f51e908b640 1 --2- 172.21.15.6:0/2991498643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e40cfae0 0x7f51e40ce7e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.348+0000 7f51e908b640 1 --2- 172.21.15.6:0/2991498643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e415f220 0x7f51e40d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.348+0000 7f51e908b640 1 -- 172.21.15.6:0/2991498643 >> 172.21.15.6:0/2991498643 conn(0x7f51e40b44d0 msgr2=0x7f51e40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.348+0000 7f51e908b640 1 -- 172.21.15.6:0/2991498643 shutdown_connections 2024-05-20T17:57:24.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.348+0000 7f51e908b640 1 -- 172.21.15.6:0/2991498643 wait complete. 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.350+0000 7f51e908b640 1 Processor -- start 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.350+0000 7f51e908b640 1 -- start start 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e908b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e40d0e00 0x7f51e4151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e908b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e415f220 0x7f51e40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e908b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51e40b7600 0x7f51e40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e908b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51e415f7b0 con 0x7f51e415f220 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e908b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51e415f630 con 0x7f51e40b7600 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e908b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51e40ced20 con 0x7f51e40d0e00 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e415f220 0x7f51e40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e415f220 0x7f51e40b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35926/0 (socket says 172.21.15.6:35926) 2024-05-20T17:57:24.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 -- 172.21.15.6:0/3175718238 learned_addr learned my addr 172.21.15.6:0/3175718238 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e2d9d640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e40d0e00 0x7f51e4151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e359e640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51e40b7600 0x7f51e40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 -- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e40d0e00 msgr2=0x7f51e4151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e40d0e00 0x7f51e4151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 -- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51e40b7600 msgr2=0x7f51e40b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51e40b7600 0x7f51e40b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 -- 172.21.15.6:0/3175718238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e40b5780 con 0x7f51e415f220 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e2d9d640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e40d0e00 0x7f51e4151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51e259c640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e415f220 0x7f51e40b70c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00c3f0 tx=0x7f51cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51db7fe640 1 -- 172.21.15.6:0/3175718238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc0052d0 con 0x7f51e415f220 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51db7fe640 1 -- 172.21.15.6:0/3175718238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51cc005490 con 0x7f51e415f220 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.352+0000 7f51db7fe640 1 -- 172.21.15.6:0/3175718238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc007260 con 0x7f51e415f220 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.353+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e40b5a60 con 0x7f51e415f220 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.353+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e40c8190 con 0x7f51e415f220 2024-05-20T17:57:24.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.354+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e40b7ba0 con 0x7f51e415f220 2024-05-20T17:57:24.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.354+0000 7f51db7fe640 1 -- 172.21.15.6:0/3175718238 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f51cc007400 con 0x7f51e415f220 2024-05-20T17:57:24.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.355+0000 7f51db7fe640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51c406be30 0x7f51c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.355+0000 7f51db7fe640 1 -- 172.21.15.6:0/3175718238 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f51cc08a430 con 0x7f51e415f220 2024-05-20T17:57:24.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.355+0000 7f51e2d9d640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51c406be30 0x7f51c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.356+0000 7f51e2d9d640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51c406be30 0x7f51c406e340 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f51d4006fd0 tx=0x7f51d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.360+0000 7f51db7fe640 1 -- 172.21.15.6:0/3175718238 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f51cc058600 con 0x7f51e415f220 2024-05-20T17:57:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.541+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51e4075b00 con 0x7f51c406be30 2024-05-20T17:57:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.547+0000 7f51db7fe640 1 -- 172.21.15.6:0/3175718238 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252074 (secure 0 0 0) 0x7f51e4075b00 con 0x7f51c406be30 2024-05-20T17:57:24.548 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:24.549 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.550+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51c406be30 msgr2=0x7f51c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.550+0000 7f51e908b640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51c406be30 0x7f51c406e340 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f51d4006fd0 tx=0x7f51d4008040 comp rx=0 tx=0).stop 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.550+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e415f220 msgr2=0x7f51e40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.550+0000 7f51e908b640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e415f220 0x7f51e40b70c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00c3f0 tx=0x7f51cc00c8b0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.551+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 shutdown_connections 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.551+0000 7f51e908b640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51c406be30 0x7f51c406e340 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.551+0000 7f51e908b640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51e40b7600 0x7f51e40b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.551+0000 7f51e908b640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51e415f220 0x7f51e40b70c0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.551+0000 7f51e908b640 1 --2- 172.21.15.6:0/3175718238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51e40d0e00 0x7f51e4151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.551+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 >> 172.21.15.6:0/3175718238 conn(0x7f51e40b44d0 msgr2=0x7f51e40b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.551+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 shutdown_connections 2024-05-20T17:57:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.551+0000 7f51e908b640 1 -- 172.21.15.6:0/3175718238 wait complete. 2024-05-20T17:57:24.560 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-05-20T17:57:24.297218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259100,"kb_used_data":9608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715620,"statfs":{"total":773094113280,"available":772828794880,"internally_reserved":0,"allocated":9838592,"data_stored":5120188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.816647"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507408+0000","last_change":"2024-05-20T17:57:20.522673+0000","last_active":"2024-05-20T17:57:21.507408+0000","last_peered":"2024-05-20T17:57:21.507408+0000","last_clean":"2024-05-20T17:57:21.507408+0000","last_became_active":"2024-05-20T17:57:20.522345+0000","last_became_peered":"2024-05-20T17:57:20.522345+0000","last_unstale":"2024-05-20T17:57:21.507408+0000","last_undegraded":"2024-05-20T17:57:21.507408+0000","last_fullsized":"2024-05-20T17:57:21.507408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:12:31.776003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514680+0000","last_change":"2024-05-20T17:57:20.515259+0000","last_active":"2024-05-20T17:57:21.514680+0000","last_peered":"2024-05-20T17:57:21.514680+0000","last_clean":"2024-05-20T17:57:21.514680+0000","last_became_active":"2024-05-20T17:57:20.514926+0000","last_became_peered":"2024-05-20T17:57:20.514926+0000","last_unstale":"2024-05-20T17:57:21.514680+0000","last_undegraded":"2024-05-20T17:57:21.514680+0000","last_fullsized":"2024-05-20T17:57:21.514680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:14:55.691160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507240+0000","last_change":"2024-05-20T17:57:20.502178+0000","last_active":"2024-05-20T17:57:21.507240+0000","last_peered":"2024-05-20T17:57:21.507240+0000","last_clean":"2024-05-20T17:57:21.507240+0000","last_became_active":"2024-05-20T17:57:20.501838+0000","last_became_peered":"2024-05-20T17:57:20.501838+0000","last_unstale":"2024-05-20T17:57:21.507240+0000","last_undegraded":"2024-05-20T17:57:21.507240+0000","last_fullsized":"2024-05-20T17:57:21.507240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:40:05.914975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991963+0000","last_change":"2024-05-20T17:57:20.524359+0000","last_active":"2024-05-20T17:57:21.991963+0000","last_peered":"2024-05-20T17:57:21.991963+0000","last_clean":"2024-05-20T17:57:21.991963+0000","last_became_active":"2024-05-20T17:57:20.523840+0000","last_became_peered":"2024-05-20T17:57:20.523840+0000","last_unstale":"2024-05-20T17:57:21.991963+0000","last_undegraded":"2024-05-20T17:57:21.991963+0000","last_fullsized":"2024-05-20T17:57:21.991963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:41:03.109825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508737+0000","last_change":"2024-05-20T17:57:20.502962+0000","last_active":"2024-05-20T17:57:21.508737+0000","last_peered":"2024-05-20T17:57:21.508737+0000","last_clean":"2024-05-20T17:57:21.508737+0000","last_became_active":"2024-05-20T17:57:20.502294+0000","last_became_peered":"2024-05-20T17:57:20.502294+0000","last_unstale":"2024-05-20T17:57:21.508737+0000","last_undegraded":"2024-05-20T17:57:21.508737+0000","last_fullsized":"2024-05-20T17:57:21.508737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:40:52.078803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990539+0000","last_change":"2024-05-20T17:57:20.527795+0000","last_active":"2024-05-20T17:57:21.990539+0000","last_peered":"2024-05-20T17:57:21.990539+0000","last_clean":"2024-05-20T17:57:21.990539+0000","last_became_active":"2024-05-20T17:57:20.527467+0000","last_became_peered":"2024-05-20T17:57:20.527467+0000","last_unstale":"2024-05-20T17:57:21.990539+0000","last_undegraded":"2024-05-20T17:57:21.990539+0000","last_fullsized":"2024-05-20T17:57:21.990539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:27:14.396518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507731+0000","last_change":"2024-05-20T17:57:20.524220+0000","last_active":"2024-05-20T17:57:21.507731+0000","last_peered":"2024-05-20T17:57:21.507731+0000","last_clean":"2024-05-20T17:57:21.507731+0000","last_became_active":"2024-05-20T17:57:20.523910+0000","last_became_peered":"2024-05-20T17:57:20.523910+0000","last_unstale":"2024-05-20T17:57:21.507731+0000","last_undegraded":"2024-05-20T17:57:21.507731+0000","last_fullsized":"2024-05-20T17:57:21.507731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:11.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991312+0000","last_change":"2024-05-20T17:57:20.509910+0000","last_active":"2024-05-20T17:57:21.991312+0000","last_peered":"2024-05-20T17:57:21.991312+0000","last_clean":"2024-05-20T17:57:21.991312+0000","last_became_active":"2024-05-20T17:57:20.507312+0000","last_became_peered":"2024-05-20T17:57:20.507312+0000","last_unstale":"2024-05-20T17:57:21.991312+0000","last_undegraded":"2024-05-20T17:57:21.991312+0000","last_fullsized":"2024-05-20T17:57:21.991312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:59.439817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508514+0000","last_change":"2024-05-20T17:57:20.510598+0000","last_active":"2024-05-20T17:57:21.508514+0000","last_peered":"2024-05-20T17:57:21.508514+0000","last_clean":"2024-05-20T17:57:21.508514+0000","last_became_active":"2024-05-20T17:57:20.510187+0000","last_became_peered":"2024-05-20T17:57:20.510187+0000","last_unstale":"2024-05-20T17:57:21.508514+0000","last_undegraded":"2024-05-20T17:57:21.508514+0000","last_fullsized":"2024-05-20T17:57:21.508514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:41:03.109825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990219+0000","last_change":"2024-05-20T17:57:20.530790+0000","last_active":"2024-05-20T17:57:21.990219+0000","last_peered":"2024-05-20T17:57:21.990219+0000","last_clean":"2024-05-20T17:57:21.990219+0000","last_became_active":"2024-05-20T17:57:20.530451+0000","last_became_peered":"2024-05-20T17:57:20.530451+0000","last_unstale":"2024-05-20T17:57:21.990219+0000","last_undegraded":"2024-05-20T17:57:21.990219+0000","last_fullsized":"2024-05-20T17:57:21.990219+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:02:42.792503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509367+0000","last_change":"2024-05-20T17:57:20.519891+0000","last_active":"2024-05-20T17:57:21.509367+0000","last_peered":"2024-05-20T17:57:21.509367+0000","last_clean":"2024-05-20T17:57:21.509367+0000","last_became_active":"2024-05-20T17:57:20.519479+0000","last_became_peered":"2024-05-20T17:57:20.519479+0000","last_unstale":"2024-05-20T17:57:21.509367+0000","last_undegraded":"2024-05-20T17:57:21.509367+0000","last_fullsized":"2024-05-20T17:57:21.509367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:11.472158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990775+0000","last_change":"2024-05-20T17:57:20.525339+0000","last_active":"2024-05-20T17:57:21.990775+0000","last_peered":"2024-05-20T17:57:21.990775+0000","last_clean":"2024-05-20T17:57:21.990775+0000","last_became_active":"2024-05-20T17:57:20.524951+0000","last_became_peered":"2024-05-20T17:57:20.524951+0000","last_unstale":"2024-05-20T17:57:21.990775+0000","last_undegraded":"2024-05-20T17:57:21.990775+0000","last_fullsized":"2024-05-20T17:57:21.990775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:08.717476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991546+0000","last_change":"2024-05-20T17:57:20.522706+0000","last_active":"2024-05-20T17:57:21.991546+0000","last_peered":"2024-05-20T17:57:21.991546+0000","last_clean":"2024-05-20T17:57:21.991546+0000","last_became_active":"2024-05-20T17:57:20.518464+0000","last_became_peered":"2024-05-20T17:57:20.518464+0000","last_unstale":"2024-05-20T17:57:21.991546+0000","last_undegraded":"2024-05-20T17:57:21.991546+0000","last_fullsized":"2024-05-20T17:57:21.991546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:34:32.888977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507622+0000","last_change":"2024-05-20T17:57:20.525945+0000","last_active":"2024-05-20T17:57:21.507622+0000","last_peered":"2024-05-20T17:57:21.507622+0000","last_clean":"2024-05-20T17:57:21.507622+0000","last_became_active":"2024-05-20T17:57:20.525637+0000","last_became_peered":"2024-05-20T17:57:20.525637+0000","last_unstale":"2024-05-20T17:57:21.507622+0000","last_undegraded":"2024-05-20T17:57:21.507622+0000","last_fullsized":"2024-05-20T17:57:21.507622+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:37.480080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991410+0000","last_change":"2024-05-20T17:57:20.522514+0000","last_active":"2024-05-20T17:57:21.991410+0000","last_peered":"2024-05-20T17:57:21.991410+0000","last_clean":"2024-05-20T17:57:21.991410+0000","last_became_active":"2024-05-20T17:57:20.516947+0000","last_became_peered":"2024-05-20T17:57:20.516947+0000","last_unstale":"2024-05-20T17:57:21.991410+0000","last_undegraded":"2024-05-20T17:57:21.991410+0000","last_fullsized":"2024-05-20T17:57:21.991410+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:02:09.154196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990451+0000","last_change":"2024-05-20T17:57:20.526450+0000","last_active":"2024-05-20T17:57:21.990451+0000","last_peered":"2024-05-20T17:57:21.990451+0000","last_clean":"2024-05-20T17:57:21.990451+0000","last_became_active":"2024-05-20T17:57:20.526109+0000","last_became_peered":"2024-05-20T17:57:20.526109+0000","last_unstale":"2024-05-20T17:57:21.990451+0000","last_undegraded":"2024-05-20T17:57:21.990451+0000","last_fullsized":"2024-05-20T17:57:21.990451+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:53:16.382127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990602+0000","last_change":"2024-05-20T17:57:20.525608+0000","last_active":"2024-05-20T17:57:21.990602+0000","last_peered":"2024-05-20T17:57:21.990602+0000","last_clean":"2024-05-20T17:57:21.990602+0000","last_became_active":"2024-05-20T17:57:20.524963+0000","last_became_peered":"2024-05-20T17:57:20.524963+0000","last_unstale":"2024-05-20T17:57:21.990602+0000","last_undegraded":"2024-05-20T17:57:21.990602+0000","last_fullsized":"2024-05-20T17:57:21.990602+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:09:50.957394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507241+0000","last_change":"2024-05-20T17:57:20.509934+0000","last_active":"2024-05-20T17:57:21.507241+0000","last_peered":"2024-05-20T17:57:21.507241+0000","last_clean":"2024-05-20T17:57:21.507241+0000","last_became_active":"2024-05-20T17:57:20.509600+0000","last_became_peered":"2024-05-20T17:57:20.509600+0000","last_unstale":"2024-05-20T17:57:21.507241+0000","last_undegraded":"2024-05-20T17:57:21.507241+0000","last_fullsized":"2024-05-20T17:57:21.507241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:42:14.649342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509554+0000","last_change":"2024-05-20T17:57:20.519641+0000","last_active":"2024-05-20T17:57:21.509554+0000","last_peered":"2024-05-20T17:57:21.509554+0000","last_clean":"2024-05-20T17:57:21.509554+0000","last_became_active":"2024-05-20T17:57:20.518486+0000","last_became_peered":"2024-05-20T17:57:20.518486+0000","last_unstale":"2024-05-20T17:57:21.509554+0000","last_undegraded":"2024-05-20T17:57:21.509554+0000","last_fullsized":"2024-05-20T17:57:21.509554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:21:29.069394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.992049+0000","last_change":"2024-05-20T17:57:20.524200+0000","last_active":"2024-05-20T17:57:21.992049+0000","last_peered":"2024-05-20T17:57:21.992049+0000","last_clean":"2024-05-20T17:57:21.992049+0000","last_became_active":"2024-05-20T17:57:20.523726+0000","last_became_peered":"2024-05-20T17:57:20.523726+0000","last_unstale":"2024-05-20T17:57:21.992049+0000","last_undegraded":"2024-05-20T17:57:21.992049+0000","last_fullsized":"2024-05-20T17:57:21.992049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:40:52.078803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508492+0000","last_change":"2024-05-20T17:57:20.505011+0000","last_active":"2024-05-20T17:57:21.508492+0000","last_peered":"2024-05-20T17:57:21.508492+0000","last_clean":"2024-05-20T17:57:21.508492+0000","last_became_active":"2024-05-20T17:57:20.504702+0000","last_became_peered":"2024-05-20T17:57:20.504702+0000","last_unstale":"2024-05-20T17:57:21.508492+0000","last_undegraded":"2024-05-20T17:57:21.508492+0000","last_fullsized":"2024-05-20T17:57:21.508492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:20.300544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507794+0000","last_change":"2024-05-20T17:57:20.525883+0000","last_active":"2024-05-20T17:57:21.507794+0000","last_peered":"2024-05-20T17:57:21.507794+0000","last_clean":"2024-05-20T17:57:21.507794+0000","last_became_active":"2024-05-20T17:57:20.525598+0000","last_became_peered":"2024-05-20T17:57:20.525598+0000","last_unstale":"2024-05-20T17:57:21.507794+0000","last_undegraded":"2024-05-20T17:57:21.507794+0000","last_fullsized":"2024-05-20T17:57:21.507794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:59.439817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.989925+0000","last_change":"2024-05-20T17:57:20.520520+0000","last_active":"2024-05-20T17:57:21.989925+0000","last_peered":"2024-05-20T17:57:21.989925+0000","last_clean":"2024-05-20T17:57:21.989925+0000","last_became_active":"2024-05-20T17:57:20.520263+0000","last_became_peered":"2024-05-20T17:57:20.520263+0000","last_unstale":"2024-05-20T17:57:21.989925+0000","last_undegraded":"2024-05-20T17:57:21.989925+0000","last_fullsized":"2024-05-20T17:57:21.989925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:41:03.109825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507011+0000","last_change":"2024-05-20T17:57:20.511820+0000","last_active":"2024-05-20T17:57:21.507011+0000","last_peered":"2024-05-20T17:57:21.507011+0000","last_clean":"2024-05-20T17:57:21.507011+0000","last_became_active":"2024-05-20T17:57:20.511504+0000","last_became_peered":"2024-05-20T17:57:20.511504+0000","last_unstale":"2024-05-20T17:57:21.507011+0000","last_undegraded":"2024-05-20T17:57:21.507011+0000","last_fullsized":"2024-05-20T17:57:21.507011+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:39:35.347348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514706+0000","last_change":"2024-05-20T17:57:20.508139+0000","last_active":"2024-05-20T17:57:21.514706+0000","last_peered":"2024-05-20T17:57:21.514706+0000","last_clean":"2024-05-20T17:57:21.514706+0000","last_became_active":"2024-05-20T17:57:20.507853+0000","last_became_peered":"2024-05-20T17:57:20.507853+0000","last_unstale":"2024-05-20T17:57:21.514706+0000","last_undegraded":"2024-05-20T17:57:21.514706+0000","last_fullsized":"2024-05-20T17:57:21.514706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:39:35.347348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508997+0000","last_change":"2024-05-20T17:57:20.525495+0000","last_active":"2024-05-20T17:57:21.508997+0000","last_peered":"2024-05-20T17:57:21.508997+0000","last_clean":"2024-05-20T17:57:21.508997+0000","last_became_active":"2024-05-20T17:57:20.525158+0000","last_became_peered":"2024-05-20T17:57:20.525158+0000","last_unstale":"2024-05-20T17:57:21.508997+0000","last_undegraded":"2024-05-20T17:57:21.508997+0000","last_fullsized":"2024-05-20T17:57:21.508997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:03.219310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990378+0000","last_change":"2024-05-20T17:57:20.508813+0000","last_active":"2024-05-20T17:57:21.990378+0000","last_peered":"2024-05-20T17:57:21.990378+0000","last_clean":"2024-05-20T17:57:21.990378+0000","last_became_active":"2024-05-20T17:57:20.508306+0000","last_became_peered":"2024-05-20T17:57:20.508306+0000","last_unstale":"2024-05-20T17:57:21.990378+0000","last_undegraded":"2024-05-20T17:57:21.990378+0000","last_fullsized":"2024-05-20T17:57:21.990378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:24:59.487287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.992152+0000","last_change":"2024-05-20T17:57:20.524065+0000","last_active":"2024-05-20T17:57:21.992152+0000","last_peered":"2024-05-20T17:57:21.992152+0000","last_clean":"2024-05-20T17:57:21.992152+0000","last_became_active":"2024-05-20T17:57:20.523371+0000","last_became_peered":"2024-05-20T17:57:20.523371+0000","last_unstale":"2024-05-20T17:57:21.992152+0000","last_undegraded":"2024-05-20T17:57:21.992152+0000","last_fullsized":"2024-05-20T17:57:21.992152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:03.219310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508474+0000","last_change":"2024-05-20T17:57:20.509902+0000","last_active":"2024-05-20T17:57:21.508474+0000","last_peered":"2024-05-20T17:57:21.508474+0000","last_clean":"2024-05-20T17:57:21.508474+0000","last_became_active":"2024-05-20T17:57:20.509590+0000","last_became_peered":"2024-05-20T17:57:20.509590+0000","last_unstale":"2024-05-20T17:57:21.508474+0000","last_undegraded":"2024-05-20T17:57:21.508474+0000","last_fullsized":"2024-05-20T17:57:21.508474+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:04:52.678042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508446+0000","last_change":"2024-05-20T17:57:20.508771+0000","last_active":"2024-05-20T17:57:21.508446+0000","last_peered":"2024-05-20T17:57:21.508446+0000","last_clean":"2024-05-20T17:57:21.508446+0000","last_became_active":"2024-05-20T17:57:20.508213+0000","last_became_peered":"2024-05-20T17:57:20.508213+0000","last_unstale":"2024-05-20T17:57:21.508446+0000","last_undegraded":"2024-05-20T17:57:21.508446+0000","last_fullsized":"2024-05-20T17:57:21.508446+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:34:32.888977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514455+0000","last_change":"2024-05-20T17:57:20.530790+0000","last_active":"2024-05-20T17:57:21.514455+0000","last_peered":"2024-05-20T17:57:21.514455+0000","last_clean":"2024-05-20T17:57:21.514455+0000","last_became_active":"2024-05-20T17:57:20.530480+0000","last_became_peered":"2024-05-20T17:57:20.530480+0000","last_unstale":"2024-05-20T17:57:21.514455+0000","last_undegraded":"2024-05-20T17:57:21.514455+0000","last_fullsized":"2024-05-20T17:57:21.514455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:11.472158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990538+0000","last_change":"2024-05-20T17:57:20.525292+0000","last_active":"2024-05-20T17:57:21.990538+0000","last_peered":"2024-05-20T17:57:21.990538+0000","last_clean":"2024-05-20T17:57:21.990538+0000","last_became_active":"2024-05-20T17:57:20.524937+0000","last_became_peered":"2024-05-20T17:57:20.524937+0000","last_unstale":"2024-05-20T17:57:21.990538+0000","last_undegraded":"2024-05-20T17:57:21.990538+0000","last_fullsized":"2024-05-20T17:57:21.990538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:04:52.875144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991072+0000","last_change":"2024-05-20T17:57:20.515811+0000","last_active":"2024-05-20T17:57:21.991072+0000","last_peered":"2024-05-20T17:57:21.991072+0000","last_clean":"2024-05-20T17:57:21.991072+0000","last_became_active":"2024-05-20T17:57:20.515470+0000","last_became_peered":"2024-05-20T17:57:20.515470+0000","last_unstale":"2024-05-20T17:57:21.991072+0000","last_undegraded":"2024-05-20T17:57:21.991072+0000","last_fullsized":"2024-05-20T17:57:21.991072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:32:28.497894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990209+0000","last_change":"2024-05-20T17:57:19.502280+0000","last_active":"2024-05-20T17:57:21.990209+0000","last_peered":"2024-05-20T17:57:21.990209+0000","last_clean":"2024-05-20T17:57:21.990209+0000","last_became_active":"2024-05-20T17:57:19.501792+0000","last_became_peered":"2024-05-20T17:57:19.501792+0000","last_unstale":"2024-05-20T17:57:21.990209+0000","last_undegraded":"2024-05-20T17:57:21.990209+0000","last_fullsized":"2024-05-20T17:57:21.990209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:21:27.106947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991484+0000","last_change":"2024-05-20T17:57:20.517975+0000","last_active":"2024-05-20T17:57:21.991484+0000","last_peered":"2024-05-20T17:57:21.991484+0000","last_clean":"2024-05-20T17:57:21.991484+0000","last_became_active":"2024-05-20T17:57:20.517655+0000","last_became_peered":"2024-05-20T17:57:20.517655+0000","last_unstale":"2024-05-20T17:57:21.991484+0000","last_undegraded":"2024-05-20T17:57:21.991484+0000","last_fullsized":"2024-05-20T17:57:21.991484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:50:04.709447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508445+0000","last_change":"2024-05-20T17:57:19.501859+0000","last_active":"2024-05-20T17:57:21.508445+0000","last_peered":"2024-05-20T17:57:21.508445+0000","last_clean":"2024-05-20T17:57:21.508445+0000","last_became_active":"2024-05-20T17:57:19.501376+0000","last_became_peered":"2024-05-20T17:57:19.501376+0000","last_unstale":"2024-05-20T17:57:21.508445+0000","last_undegraded":"2024-05-20T17:57:21.508445+0000","last_fullsized":"2024-05-20T17:57:21.508445+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:37.432484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507732+0000","last_change":"2024-05-20T17:57:20.525720+0000","last_active":"2024-05-20T17:57:21.507732+0000","last_peered":"2024-05-20T17:57:21.507732+0000","last_clean":"2024-05-20T17:57:21.507732+0000","last_became_active":"2024-05-20T17:57:20.525201+0000","last_became_peered":"2024-05-20T17:57:20.525201+0000","last_unstale":"2024-05-20T17:57:21.507732+0000","last_undegraded":"2024-05-20T17:57:21.507732+0000","last_fullsized":"2024-05-20T17:57:21.507732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:53.404580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507741+0000","last_change":"2024-05-20T17:57:19.503167+0000","last_active":"2024-05-20T17:57:21.507741+0000","last_peered":"2024-05-20T17:57:21.507741+0000","last_clean":"2024-05-20T17:57:21.507741+0000","last_became_active":"2024-05-20T17:57:19.502834+0000","last_became_peered":"2024-05-20T17:57:19.502834+0000","last_unstale":"2024-05-20T17:57:21.507741+0000","last_undegraded":"2024-05-20T17:57:21.507741+0000","last_fullsized":"2024-05-20T17:57:21.507741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:42:13.644037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990817+0000","last_change":"2024-05-20T17:57:20.516279+0000","last_active":"2024-05-20T17:57:21.990817+0000","last_peered":"2024-05-20T17:57:21.990817+0000","last_clean":"2024-05-20T17:57:21.990817+0000","last_became_active":"2024-05-20T17:57:20.515779+0000","last_became_peered":"2024-05-20T17:57:20.515779+0000","last_unstale":"2024-05-20T17:57:21.990817+0000","last_undegraded":"2024-05-20T17:57:21.990817+0000","last_fullsized":"2024-05-20T17:57:21.990817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:46.995694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990205+0000","last_change":"2024-05-20T17:57:19.505340+0000","last_active":"2024-05-20T17:57:21.990205+0000","last_peered":"2024-05-20T17:57:21.990205+0000","last_clean":"2024-05-20T17:57:21.990205+0000","last_became_active":"2024-05-20T17:57:19.504359+0000","last_became_peered":"2024-05-20T17:57:19.504359+0000","last_unstale":"2024-05-20T17:57:21.990205+0000","last_undegraded":"2024-05-20T17:57:21.990205+0000","last_fullsized":"2024-05-20T17:57:21.990205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:26:25.301844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991517+0000","last_change":"2024-05-20T17:57:20.510662+0000","last_active":"2024-05-20T17:57:21.991517+0000","last_peered":"2024-05-20T17:57:21.991517+0000","last_clean":"2024-05-20T17:57:21.991517+0000","last_became_active":"2024-05-20T17:57:20.510335+0000","last_became_peered":"2024-05-20T17:57:20.510335+0000","last_unstale":"2024-05-20T17:57:21.991517+0000","last_undegraded":"2024-05-20T17:57:21.991517+0000","last_fullsized":"2024-05-20T17:57:21.991517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:06:49.558913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508799+0000","last_change":"2024-05-20T17:57:19.497558+0000","last_active":"2024-05-20T17:57:21.508799+0000","last_peered":"2024-05-20T17:57:21.508799+0000","last_clean":"2024-05-20T17:57:21.508799+0000","last_became_active":"2024-05-20T17:57:19.497220+0000","last_became_peered":"2024-05-20T17:57:19.497220+0000","last_unstale":"2024-05-20T17:57:21.508799+0000","last_undegraded":"2024-05-20T17:57:21.508799+0000","last_fullsized":"2024-05-20T17:57:21.508799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:03:10.440894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990044+0000","last_change":"2024-05-20T17:57:20.517392+0000","last_active":"2024-05-20T17:57:21.990044+0000","last_peered":"2024-05-20T17:57:21.990044+0000","last_clean":"2024-05-20T17:57:21.990044+0000","last_became_active":"2024-05-20T17:57:20.516925+0000","last_became_peered":"2024-05-20T17:57:20.516925+0000","last_unstale":"2024-05-20T17:57:21.990044+0000","last_undegraded":"2024-05-20T17:57:21.990044+0000","last_fullsized":"2024-05-20T17:57:21.990044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:03.219310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991896+0000","last_change":"2024-05-20T17:57:19.497798+0000","last_active":"2024-05-20T17:57:21.991896+0000","last_peered":"2024-05-20T17:57:21.991896+0000","last_clean":"2024-05-20T17:57:21.991896+0000","last_became_active":"2024-05-20T17:57:19.496804+0000","last_became_peered":"2024-05-20T17:57:19.496804+0000","last_unstale":"2024-05-20T17:57:21.991896+0000","last_undegraded":"2024-05-20T17:57:21.991896+0000","last_fullsized":"2024-05-20T17:57:21.991896+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:03:10.440894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990503+0000","last_change":"2024-05-20T17:57:20.527055+0000","last_active":"2024-05-20T17:57:21.990503+0000","last_peered":"2024-05-20T17:57:21.990503+0000","last_clean":"2024-05-20T17:57:21.990503+0000","last_became_active":"2024-05-20T17:57:20.526702+0000","last_became_peered":"2024-05-20T17:57:20.526702+0000","last_unstale":"2024-05-20T17:57:21.990503+0000","last_undegraded":"2024-05-20T17:57:21.990503+0000","last_fullsized":"2024-05-20T17:57:21.990503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:28:50.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507007+0000","last_change":"2024-05-20T17:57:19.502239+0000","last_active":"2024-05-20T17:57:21.507007+0000","last_peered":"2024-05-20T17:57:21.507007+0000","last_clean":"2024-05-20T17:57:21.507007+0000","last_became_active":"2024-05-20T17:57:19.501919+0000","last_became_peered":"2024-05-20T17:57:19.501919+0000","last_unstale":"2024-05-20T17:57:21.507007+0000","last_undegraded":"2024-05-20T17:57:21.507007+0000","last_fullsized":"2024-05-20T17:57:21.507007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:19.295239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991901+0000","last_change":"2024-05-20T17:57:20.518985+0000","last_active":"2024-05-20T17:57:21.991901+0000","last_peered":"2024-05-20T17:57:21.991901+0000","last_clean":"2024-05-20T17:57:21.991901+0000","last_became_active":"2024-05-20T17:57:20.518653+0000","last_became_peered":"2024-05-20T17:57:20.518653+0000","last_unstale":"2024-05-20T17:57:21.991901+0000","last_undegraded":"2024-05-20T17:57:21.991901+0000","last_fullsized":"2024-05-20T17:57:21.991901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:20.300544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507450+0000","last_change":"2024-05-20T17:57:19.505806+0000","last_active":"2024-05-20T17:57:21.507450+0000","last_peered":"2024-05-20T17:57:21.507450+0000","last_clean":"2024-05-20T17:57:21.507450+0000","last_became_active":"2024-05-20T17:57:19.505460+0000","last_became_peered":"2024-05-20T17:57:19.505460+0000","last_unstale":"2024-05-20T17:57:21.507450+0000","last_undegraded":"2024-05-20T17:57:21.507450+0000","last_fullsized":"2024-05-20T17:57:21.507450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:21:28.064090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508482+0000","last_change":"2024-05-20T17:57:20.518137+0000","last_active":"2024-05-20T17:57:21.508482+0000","last_peered":"2024-05-20T17:57:21.508482+0000","last_clean":"2024-05-20T17:57:21.508482+0000","last_became_active":"2024-05-20T17:57:20.517708+0000","last_became_peered":"2024-05-20T17:57:20.517708+0000","last_unstale":"2024-05-20T17:57:21.508482+0000","last_undegraded":"2024-05-20T17:57:21.508482+0000","last_fullsized":"2024-05-20T17:57:21.508482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:31:17.493977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514756+0000","last_change":"2024-05-20T17:57:19.502766+0000","last_active":"2024-05-20T17:57:21.514756+0000","last_peered":"2024-05-20T17:57:21.514756+0000","last_clean":"2024-05-20T17:57:21.514756+0000","last_became_active":"2024-05-20T17:57:19.502433+0000","last_became_peered":"2024-05-20T17:57:19.502433+0000","last_unstale":"2024-05-20T17:57:21.514756+0000","last_undegraded":"2024-05-20T17:57:21.514756+0000","last_fullsized":"2024-05-20T17:57:21.514756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:58.434512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507657+0000","last_change":"2024-05-20T17:57:20.507873+0000","last_active":"2024-05-20T17:57:21.507657+0000","last_peered":"2024-05-20T17:57:21.507657+0000","last_clean":"2024-05-20T17:57:21.507657+0000","last_became_active":"2024-05-20T17:57:20.507540+0000","last_became_peered":"2024-05-20T17:57:20.507540+0000","last_unstale":"2024-05-20T17:57:21.507657+0000","last_undegraded":"2024-05-20T17:57:21.507657+0000","last_fullsized":"2024-05-20T17:57:21.507657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:09:49.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507313+0000","last_change":"2024-05-20T17:57:19.505781+0000","last_active":"2024-05-20T17:57:21.507313+0000","last_peered":"2024-05-20T17:57:21.507313+0000","last_clean":"2024-05-20T17:57:21.507313+0000","last_became_active":"2024-05-20T17:57:19.505456+0000","last_became_peered":"2024-05-20T17:57:19.505456+0000","last_unstale":"2024-05-20T17:57:21.507313+0000","last_undegraded":"2024-05-20T17:57:21.507313+0000","last_fullsized":"2024-05-20T17:57:21.507313+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:41:02.104520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507265+0000","last_change":"2024-05-20T17:57:20.521078+0000","last_active":"2024-05-20T17:57:21.507265+0000","last_peered":"2024-05-20T17:57:21.507265+0000","last_clean":"2024-05-20T17:57:21.507265+0000","last_became_active":"2024-05-20T17:57:20.520669+0000","last_became_peered":"2024-05-20T17:57:20.520669+0000","last_unstale":"2024-05-20T17:57:21.507265+0000","last_undegraded":"2024-05-20T17:57:21.507265+0000","last_fullsized":"2024-05-20T17:57:21.507265+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:24:39.346848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509621+0000","last_change":"2024-05-20T17:57:19.502942+0000","last_active":"2024-05-20T17:57:21.509621+0000","last_peered":"2024-05-20T17:57:21.509621+0000","last_clean":"2024-05-20T17:57:21.509621+0000","last_became_active":"2024-05-20T17:57:19.501038+0000","last_became_peered":"2024-05-20T17:57:19.501038+0000","last_unstale":"2024-05-20T17:57:21.509621+0000","last_undegraded":"2024-05-20T17:57:21.509621+0000","last_fullsized":"2024-05-20T17:57:21.509621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:31:02.693324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.992226+0000","last_change":"2024-05-20T17:57:20.517917+0000","last_active":"2024-05-20T17:57:21.992226+0000","last_peered":"2024-05-20T17:57:21.992226+0000","last_clean":"2024-05-20T17:57:21.992226+0000","last_became_active":"2024-05-20T17:57:20.517612+0000","last_became_peered":"2024-05-20T17:57:20.517612+0000","last_unstale":"2024-05-20T17:57:21.992226+0000","last_undegraded":"2024-05-20T17:57:21.992226+0000","last_fullsized":"2024-05-20T17:57:21.992226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:11.472158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"86'6","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991368+0000","last_change":"2024-05-20T17:57:19.502222+0000","last_active":"2024-05-20T17:57:21.991368+0000","last_peered":"2024-05-20T17:57:21.991368+0000","last_clean":"2024-05-20T17:57:21.991368+0000","last_became_active":"2024-05-20T17:57:19.501878+0000","last_became_peered":"2024-05-20T17:57:19.501878+0000","last_unstale":"2024-05-20T17:57:21.991368+0000","last_undegraded":"2024-05-20T17:57:21.991368+0000","last_fullsized":"2024-05-20T17:57:21.991368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:24:38.341543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991651+0000","last_change":"2024-05-20T17:57:20.507832+0000","last_active":"2024-05-20T17:57:21.991651+0000","last_peered":"2024-05-20T17:57:21.991651+0000","last_clean":"2024-05-20T17:57:21.991651+0000","last_became_active":"2024-05-20T17:57:20.506942+0000","last_became_peered":"2024-05-20T17:57:20.506942+0000","last_unstale":"2024-05-20T17:57:21.991651+0000","last_undegraded":"2024-05-20T17:57:21.991651+0000","last_fullsized":"2024-05-20T17:57:21.991651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:31:17.493977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508356+0000","last_change":"2024-05-20T17:57:19.505005+0000","last_active":"2024-05-20T17:57:21.508356+0000","last_peered":"2024-05-20T17:57:21.508356+0000","last_clean":"2024-05-20T17:57:21.508356+0000","last_became_active":"2024-05-20T17:57:19.504685+0000","last_became_peered":"2024-05-20T17:57:19.504685+0000","last_unstale":"2024-05-20T17:57:21.508356+0000","last_undegraded":"2024-05-20T17:57:21.508356+0000","last_fullsized":"2024-05-20T17:57:21.508356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:40:04.909670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508044+0000","last_change":"2024-05-20T17:57:20.502363+0000","last_active":"2024-05-20T17:57:21.508044+0000","last_peered":"2024-05-20T17:57:21.508044+0000","last_clean":"2024-05-20T17:57:21.508044+0000","last_became_active":"2024-05-20T17:57:20.501578+0000","last_became_peered":"2024-05-20T17:57:20.501578+0000","last_unstale":"2024-05-20T17:57:21.508044+0000","last_undegraded":"2024-05-20T17:57:21.508044+0000","last_fullsized":"2024-05-20T17:57:21.508044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:02:09.154196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990579+0000","last_change":"2024-05-20T17:57:19.503324+0000","last_active":"2024-05-20T17:57:21.990579+0000","last_peered":"2024-05-20T17:57:21.990579+0000","last_clean":"2024-05-20T17:57:21.990579+0000","last_became_active":"2024-05-20T17:57:19.503001+0000","last_became_peered":"2024-05-20T17:57:19.503001+0000","last_unstale":"2024-05-20T17:57:21.990579+0000","last_undegraded":"2024-05-20T17:57:21.990579+0000","last_fullsized":"2024-05-20T17:57:21.990579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:42:13.644037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990056+0000","last_change":"2024-05-20T17:57:20.530952+0000","last_active":"2024-05-20T17:57:21.990056+0000","last_peered":"2024-05-20T17:57:21.990056+0000","last_clean":"2024-05-20T17:57:21.990056+0000","last_became_active":"2024-05-20T17:57:20.530595+0000","last_became_peered":"2024-05-20T17:57:20.530595+0000","last_unstale":"2024-05-20T17:57:21.990056+0000","last_undegraded":"2024-05-20T17:57:21.990056+0000","last_fullsized":"2024-05-20T17:57:21.990056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:46:59.272413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991382+0000","last_change":"2024-05-20T17:57:19.504013+0000","last_active":"2024-05-20T17:57:21.991382+0000","last_peered":"2024-05-20T17:57:21.991382+0000","last_clean":"2024-05-20T17:57:21.991382+0000","last_became_active":"2024-05-20T17:57:19.503711+0000","last_became_peered":"2024-05-20T17:57:19.503711+0000","last_unstale":"2024-05-20T17:57:21.991382+0000","last_undegraded":"2024-05-20T17:57:21.991382+0000","last_fullsized":"2024-05-20T17:57:21.991382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:07:20.079205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990669+0000","last_change":"2024-05-20T17:57:20.513499+0000","last_active":"2024-05-20T17:57:21.990669+0000","last_peered":"2024-05-20T17:57:21.990669+0000","last_clean":"2024-05-20T17:57:21.990669+0000","last_became_active":"2024-05-20T17:57:20.513109+0000","last_became_peered":"2024-05-20T17:57:20.513109+0000","last_unstale":"2024-05-20T17:57:21.990669+0000","last_undegraded":"2024-05-20T17:57:21.990669+0000","last_fullsized":"2024-05-20T17:57:21.990669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:59:10.454342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"86'8","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991589+0000","last_change":"2024-05-20T17:57:19.493807+0000","last_active":"2024-05-20T17:57:21.991589+0000","last_peered":"2024-05-20T17:57:21.991589+0000","last_clean":"2024-05-20T17:57:21.991589+0000","last_became_active":"2024-05-20T17:57:19.493468+0000","last_became_peered":"2024-05-20T17:57:19.493468+0000","last_unstale":"2024-05-20T17:57:21.991589+0000","last_undegraded":"2024-05-20T17:57:21.991589+0000","last_fullsized":"2024-05-20T17:57:21.991589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:27:35.600984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991302+0000","last_change":"2024-05-20T17:57:20.516615+0000","last_active":"2024-05-20T17:57:21.991302+0000","last_peered":"2024-05-20T17:57:21.991302+0000","last_clean":"2024-05-20T17:57:21.991302+0000","last_became_active":"2024-05-20T17:57:20.516197+0000","last_became_peered":"2024-05-20T17:57:20.516197+0000","last_unstale":"2024-05-20T17:57:21.991302+0000","last_undegraded":"2024-05-20T17:57:21.991302+0000","last_fullsized":"2024-05-20T17:57:21.991302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:23:49.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990296+0000","last_change":"2024-05-20T17:57:19.501125+0000","last_active":"2024-05-20T17:57:21.990296+0000","last_peered":"2024-05-20T17:57:21.990296+0000","last_clean":"2024-05-20T17:57:21.990296+0000","last_became_active":"2024-05-20T17:57:19.500800+0000","last_became_peered":"2024-05-20T17:57:19.500800+0000","last_unstale":"2024-05-20T17:57:21.990296+0000","last_undegraded":"2024-05-20T17:57:21.990296+0000","last_fullsized":"2024-05-20T17:57:21.990296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:50:49.164065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990187+0000","last_change":"2024-05-20T17:57:20.508481+0000","last_active":"2024-05-20T17:57:21.990187+0000","last_peered":"2024-05-20T17:57:21.990187+0000","last_clean":"2024-05-20T17:57:21.990187+0000","last_became_active":"2024-05-20T17:57:20.508162+0000","last_became_peered":"2024-05-20T17:57:20.508162+0000","last_unstale":"2024-05-20T17:57:21.990187+0000","last_undegraded":"2024-05-20T17:57:21.990187+0000","last_fullsized":"2024-05-20T17:57:21.990187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:11.472158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507669+0000","last_change":"2024-05-20T17:57:19.502879+0000","last_active":"2024-05-20T17:57:21.507669+0000","last_peered":"2024-05-20T17:57:21.507669+0000","last_clean":"2024-05-20T17:57:21.507669+0000","last_became_active":"2024-05-20T17:57:19.502561+0000","last_became_peered":"2024-05-20T17:57:19.502561+0000","last_unstale":"2024-05-20T17:57:21.507669+0000","last_undegraded":"2024-05-20T17:57:21.507669+0000","last_fullsized":"2024-05-20T17:57:21.507669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:14:54.685856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508359+0000","last_change":"2024-05-20T17:57:20.511092+0000","last_active":"2024-05-20T17:57:21.508359+0000","last_peered":"2024-05-20T17:57:21.508359+0000","last_clean":"2024-05-20T17:57:21.508359+0000","last_became_active":"2024-05-20T17:57:20.510479+0000","last_became_peered":"2024-05-20T17:57:20.510479+0000","last_unstale":"2024-05-20T17:57:21.508359+0000","last_undegraded":"2024-05-20T17:57:21.508359+0000","last_fullsized":"2024-05-20T17:57:21.508359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:06:49.558913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509674+0000","last_change":"2024-05-20T17:57:19.500207+0000","last_active":"2024-05-20T17:57:21.509674+0000","last_peered":"2024-05-20T17:57:21.509674+0000","last_clean":"2024-05-20T17:57:21.509674+0000","last_became_active":"2024-05-20T17:57:19.499868+0000","last_became_peered":"2024-05-20T17:57:19.499868+0000","last_unstale":"2024-05-20T17:57:21.509674+0000","last_undegraded":"2024-05-20T17:57:21.509674+0000","last_fullsized":"2024-05-20T17:57:21.509674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:24.752275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990743+0000","last_change":"2024-05-20T17:57:20.527238+0000","last_active":"2024-05-20T17:57:21.990743+0000","last_peered":"2024-05-20T17:57:21.990743+0000","last_clean":"2024-05-20T17:57:21.990743+0000","last_became_active":"2024-05-20T17:57:20.526842+0000","last_became_peered":"2024-05-20T17:57:20.526842+0000","last_unstale":"2024-05-20T17:57:21.990743+0000","last_undegraded":"2024-05-20T17:57:21.990743+0000","last_fullsized":"2024-05-20T17:57:21.990743+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:48:36.505363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514291+0000","last_change":"2024-05-20T17:57:19.499775+0000","last_active":"2024-05-20T17:57:21.514291+0000","last_peered":"2024-05-20T17:57:21.514291+0000","last_clean":"2024-05-20T17:57:21.514291+0000","last_became_active":"2024-05-20T17:57:19.499443+0000","last_became_peered":"2024-05-20T17:57:19.499443+0000","last_unstale":"2024-05-20T17:57:21.514291+0000","last_undegraded":"2024-05-20T17:57:21.514291+0000","last_fullsized":"2024-05-20T17:57:21.514291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:36.474775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514527+0000","last_change":"2024-05-20T17:57:20.516005+0000","last_active":"2024-05-20T17:57:21.514527+0000","last_peered":"2024-05-20T17:57:21.514527+0000","last_clean":"2024-05-20T17:57:21.514527+0000","last_became_active":"2024-05-20T17:57:20.515713+0000","last_became_peered":"2024-05-20T17:57:20.515713+0000","last_unstale":"2024-05-20T17:57:21.514527+0000","last_undegraded":"2024-05-20T17:57:21.514527+0000","last_fullsized":"2024-05-20T17:57:21.514527+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:11:34.775105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990040+0000","last_change":"2024-05-20T17:57:19.501848+0000","last_active":"2024-05-20T17:57:21.990040+0000","last_peered":"2024-05-20T17:57:21.990040+0000","last_clean":"2024-05-20T17:57:21.990040+0000","last_became_active":"2024-05-20T17:57:19.501522+0000","last_became_peered":"2024-05-20T17:57:19.501522+0000","last_unstale":"2024-05-20T17:57:21.990040+0000","last_undegraded":"2024-05-20T17:57:21.990040+0000","last_fullsized":"2024-05-20T17:57:21.990040+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:50:53.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514448+0000","last_change":"2024-05-20T17:57:20.530807+0000","last_active":"2024-05-20T17:57:21.514448+0000","last_peered":"2024-05-20T17:57:21.514448+0000","last_clean":"2024-05-20T17:57:21.514448+0000","last_became_active":"2024-05-20T17:57:20.530494+0000","last_became_peered":"2024-05-20T17:57:20.530494+0000","last_unstale":"2024-05-20T17:57:21.514448+0000","last_undegraded":"2024-05-20T17:57:21.514448+0000","last_fullsized":"2024-05-20T17:57:21.514448+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:21:29.069394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514539+0000","last_change":"2024-05-20T17:57:19.505045+0000","last_active":"2024-05-20T17:57:21.514539+0000","last_peered":"2024-05-20T17:57:21.514539+0000","last_clean":"2024-05-20T17:57:21.514539+0000","last_became_active":"2024-05-20T17:57:19.504699+0000","last_became_peered":"2024-05-20T17:57:19.504699+0000","last_unstale":"2024-05-20T17:57:21.514539+0000","last_undegraded":"2024-05-20T17:57:21.514539+0000","last_fullsized":"2024-05-20T17:57:21.514539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:06:48.553608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991100+0000","last_change":"2024-05-20T17:57:20.516908+0000","last_active":"2024-05-20T17:57:21.991100+0000","last_peered":"2024-05-20T17:57:21.991100+0000","last_clean":"2024-05-20T17:57:21.991100+0000","last_became_active":"2024-05-20T17:57:20.516598+0000","last_became_peered":"2024-05-20T17:57:20.516598+0000","last_unstale":"2024-05-20T17:57:21.991100+0000","last_undegraded":"2024-05-20T17:57:21.991100+0000","last_fullsized":"2024-05-20T17:57:21.991100+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:34:56.585482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.989904+0000","last_change":"2024-05-20T17:57:19.501140+0000","last_active":"2024-05-20T17:57:21.989904+0000","last_peered":"2024-05-20T17:57:21.989904+0000","last_clean":"2024-05-20T17:57:21.989904+0000","last_became_active":"2024-05-20T17:57:19.500507+0000","last_became_peered":"2024-05-20T17:57:19.500507+0000","last_unstale":"2024-05-20T17:57:21.989904+0000","last_undegraded":"2024-05-20T17:57:21.989904+0000","last_fullsized":"2024-05-20T17:57:21.989904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:18.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990269+0000","last_change":"2024-05-20T17:57:20.504813+0000","last_active":"2024-05-20T17:57:21.990269+0000","last_peered":"2024-05-20T17:57:21.990269+0000","last_clean":"2024-05-20T17:57:21.990269+0000","last_became_active":"2024-05-20T17:57:20.504045+0000","last_became_peered":"2024-05-20T17:57:20.504045+0000","last_unstale":"2024-05-20T17:57:21.990269+0000","last_undegraded":"2024-05-20T17:57:21.990269+0000","last_fullsized":"2024-05-20T17:57:21.990269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:21:29.069394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507785+0000","last_change":"2024-05-20T17:57:19.503995+0000","last_active":"2024-05-20T17:57:21.507785+0000","last_peered":"2024-05-20T17:57:21.507785+0000","last_clean":"2024-05-20T17:57:21.507785+0000","last_became_active":"2024-05-20T17:57:19.503655+0000","last_became_peered":"2024-05-20T17:57:19.503655+0000","last_unstale":"2024-05-20T17:57:21.507785+0000","last_undegraded":"2024-05-20T17:57:21.507785+0000","last_fullsized":"2024-05-20T17:57:21.507785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:39:34.342043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991679+0000","last_change":"2024-05-20T17:57:20.516256+0000","last_active":"2024-05-20T17:57:21.991679+0000","last_peered":"2024-05-20T17:57:21.991679+0000","last_clean":"2024-05-20T17:57:21.991679+0000","last_became_active":"2024-05-20T17:57:20.515904+0000","last_became_peered":"2024-05-20T17:57:20.515904+0000","last_unstale":"2024-05-20T17:57:21.991679+0000","last_undegraded":"2024-05-20T17:57:21.991679+0000","last_fullsized":"2024-05-20T17:57:21.991679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:12.453203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"87'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508603+0000","last_change":"2024-05-20T17:57:19.498591+0000","last_active":"2024-05-20T17:57:21.508603+0000","last_peered":"2024-05-20T17:57:21.508603+0000","last_clean":"2024-05-20T17:57:21.508603+0000","last_became_active":"2024-05-20T17:57:19.498220+0000","last_became_peered":"2024-05-20T17:57:19.498220+0000","last_unstale":"2024-05-20T17:57:21.508603+0000","last_undegraded":"2024-05-20T17:57:21.508603+0000","last_fullsized":"2024-05-20T17:57:21.508603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:42:22.473822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990883+0000","last_change":"2024-05-20T17:57:20.516781+0000","last_active":"2024-05-20T17:57:21.990883+0000","last_peered":"2024-05-20T17:57:21.990883+0000","last_clean":"2024-05-20T17:57:21.990883+0000","last_became_active":"2024-05-20T17:57:20.515704+0000","last_became_peered":"2024-05-20T17:57:20.515704+0000","last_unstale":"2024-05-20T17:57:21.990883+0000","last_undegraded":"2024-05-20T17:57:21.990883+0000","last_fullsized":"2024-05-20T17:57:21.990883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:09:34.697097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509761+0000","last_change":"2024-05-20T17:57:19.501313+0000","last_active":"2024-05-20T17:57:21.509761+0000","last_peered":"2024-05-20T17:57:21.509761+0000","last_clean":"2024-05-20T17:57:21.509761+0000","last_became_active":"2024-05-20T17:57:19.500592+0000","last_became_peered":"2024-05-20T17:57:19.500592+0000","last_unstale":"2024-05-20T17:57:21.509761+0000","last_undegraded":"2024-05-20T17:57:21.509761+0000","last_fullsized":"2024-05-20T17:57:21.509761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:25:49.614172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514732+0000","last_change":"2024-05-20T17:57:20.508514+0000","last_active":"2024-05-20T17:57:21.514732+0000","last_peered":"2024-05-20T17:57:21.514732+0000","last_clean":"2024-05-20T17:57:21.514732+0000","last_became_active":"2024-05-20T17:57:20.507928+0000","last_became_peered":"2024-05-20T17:57:20.507928+0000","last_unstale":"2024-05-20T17:57:21.514732+0000","last_undegraded":"2024-05-20T17:57:21.514732+0000","last_fullsized":"2024-05-20T17:57:21.514732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:40:05.914975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990337+0000","last_change":"2024-05-20T17:57:19.499777+0000","last_active":"2024-05-20T17:57:21.990337+0000","last_peered":"2024-05-20T17:57:21.990337+0000","last_clean":"2024-05-20T17:57:21.990337+0000","last_became_active":"2024-05-20T17:57:19.499390+0000","last_became_peered":"2024-05-20T17:57:19.499390+0000","last_unstale":"2024-05-20T17:57:21.990337+0000","last_undegraded":"2024-05-20T17:57:21.990337+0000","last_fullsized":"2024-05-20T17:57:21.990337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:43.144655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.989950+0000","last_change":"2024-05-20T17:57:20.521165+0000","last_active":"2024-05-20T17:57:21.989950+0000","last_peered":"2024-05-20T17:57:21.989950+0000","last_clean":"2024-05-20T17:57:21.989950+0000","last_became_active":"2024-05-20T17:57:20.520836+0000","last_became_peered":"2024-05-20T17:57:20.520836+0000","last_unstale":"2024-05-20T17:57:21.989950+0000","last_undegraded":"2024-05-20T17:57:21.989950+0000","last_fullsized":"2024-05-20T17:57:21.989950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:50.970801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991164+0000","last_change":"2024-05-20T17:57:19.503288+0000","last_active":"2024-05-20T17:57:21.991164+0000","last_peered":"2024-05-20T17:57:21.991164+0000","last_clean":"2024-05-20T17:57:21.991164+0000","last_became_active":"2024-05-20T17:57:19.502974+0000","last_became_peered":"2024-05-20T17:57:19.502974+0000","last_unstale":"2024-05-20T17:57:21.991164+0000","last_undegraded":"2024-05-20T17:57:21.991164+0000","last_fullsized":"2024-05-20T17:57:21.991164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:45:56.876242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507309+0000","last_change":"2024-05-20T17:57:20.512371+0000","last_active":"2024-05-20T17:57:21.507309+0000","last_peered":"2024-05-20T17:57:21.507309+0000","last_clean":"2024-05-20T17:57:21.507309+0000","last_became_active":"2024-05-20T17:57:20.511367+0000","last_became_peered":"2024-05-20T17:57:20.511367+0000","last_unstale":"2024-05-20T17:57:21.507309+0000","last_undegraded":"2024-05-20T17:57:21.507309+0000","last_fullsized":"2024-05-20T17:57:21.507309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:45:57.881547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514359+0000","last_change":"2024-05-20T17:57:19.499207+0000","last_active":"2024-05-20T17:57:21.514359+0000","last_peered":"2024-05-20T17:57:21.514359+0000","last_clean":"2024-05-20T17:57:21.514359+0000","last_became_active":"2024-05-20T17:57:19.498832+0000","last_became_peered":"2024-05-20T17:57:19.498832+0000","last_unstale":"2024-05-20T17:57:21.514359+0000","last_undegraded":"2024-05-20T17:57:21.514359+0000","last_fullsized":"2024-05-20T17:57:21.514359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:02:08.148891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.989982+0000","last_change":"2024-05-20T17:57:20.523814+0000","last_active":"2024-05-20T17:57:21.989982+0000","last_peered":"2024-05-20T17:57:21.989982+0000","last_clean":"2024-05-20T17:57:21.989982+0000","last_became_active":"2024-05-20T17:57:20.523475+0000","last_became_peered":"2024-05-20T17:57:20.523475+0000","last_unstale":"2024-05-20T17:57:21.989982+0000","last_undegraded":"2024-05-20T17:57:21.989982+0000","last_fullsized":"2024-05-20T17:57:21.989982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:40:52.078803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990123+0000","last_change":"2024-05-20T17:57:19.500207+0000","last_active":"2024-05-20T17:57:21.990123+0000","last_peered":"2024-05-20T17:57:21.990123+0000","last_clean":"2024-05-20T17:57:21.990123+0000","last_became_active":"2024-05-20T17:57:19.499909+0000","last_became_peered":"2024-05-20T17:57:19.499909+0000","last_unstale":"2024-05-20T17:57:21.990123+0000","last_undegraded":"2024-05-20T17:57:21.990123+0000","last_fullsized":"2024-05-20T17:57:21.990123+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:36.474775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991795+0000","last_change":"2024-05-20T17:57:20.526490+0000","last_active":"2024-05-20T17:57:21.991795+0000","last_peered":"2024-05-20T17:57:21.991795+0000","last_clean":"2024-05-20T17:57:21.991795+0000","last_became_active":"2024-05-20T17:57:20.526130+0000","last_became_peered":"2024-05-20T17:57:20.526130+0000","last_unstale":"2024-05-20T17:57:21.991795+0000","last_undegraded":"2024-05-20T17:57:21.991795+0000","last_fullsized":"2024-05-20T17:57:21.991795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:06:36.427964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507601+0000","last_change":"2024-05-20T17:57:19.506295+0000","last_active":"2024-05-20T17:57:21.507601+0000","last_peered":"2024-05-20T17:57:21.507601+0000","last_clean":"2024-05-20T17:57:21.507601+0000","last_became_active":"2024-05-20T17:57:19.506033+0000","last_became_peered":"2024-05-20T17:57:19.506033+0000","last_unstale":"2024-05-20T17:57:21.507601+0000","last_undegraded":"2024-05-20T17:57:21.507601+0000","last_fullsized":"2024-05-20T17:57:21.507601+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:11:33.769801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507899+0000","last_change":"2024-05-20T17:57:20.524060+0000","last_active":"2024-05-20T17:57:21.507899+0000","last_peered":"2024-05-20T17:57:21.507899+0000","last_clean":"2024-05-20T17:57:21.507899+0000","last_became_active":"2024-05-20T17:57:20.523756+0000","last_became_peered":"2024-05-20T17:57:20.523756+0000","last_unstale":"2024-05-20T17:57:21.507899+0000","last_undegraded":"2024-05-20T17:57:21.507899+0000","last_fullsized":"2024-05-20T17:57:21.507899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:12:31.366934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.992120+0000","last_change":"2024-05-20T17:57:19.501230+0000","last_active":"2024-05-20T17:57:21.992120+0000","last_peered":"2024-05-20T17:57:21.992120+0000","last_clean":"2024-05-20T17:57:21.992120+0000","last_became_active":"2024-05-20T17:57:19.499814+0000","last_became_peered":"2024-05-20T17:57:19.499814+0000","last_unstale":"2024-05-20T17:57:21.992120+0000","last_undegraded":"2024-05-20T17:57:21.992120+0000","last_fullsized":"2024-05-20T17:57:21.992120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:48.588031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":292,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507841+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:57:21.507841+0000","last_peered":"2024-05-20T17:57:21.507841+0000","last_clean":"2024-05-20T17:57:21.507841+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:57:21.507841+0000","last_undegraded":"2024-05-20T17:57:21.507841+0000","last_fullsized":"2024-05-20T17:57:21.507841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1675264,"data_stored":1082253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":494045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":491829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":491989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":491829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":491829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":491899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1691648,"data_stored":1084515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:57:24.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T17:57:24.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.718+0000 7f0d7c2c3640 1 Processor -- start 2024-05-20T17:57:24.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.718+0000 7f0d7c2c3640 1 -- start start 2024-05-20T17:57:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.719+0000 7f0d7c2c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d74163a10 0x7f0d740d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.719+0000 7f0d7c2c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d740b4010 0x7f0d740cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.719+0000 7f0d7c2c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d740d0370 con 0x7f0d740d14b0 2024-05-20T17:57:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.719+0000 7f0d7c2c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0d740d3ca0 con 0x7f0d740b4010 2024-05-20T17:57:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.719+0000 7f0d7c2c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0d740d0650 con 0x7f0d74163a10 2024-05-20T17:57:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.719+0000 7f0d7985e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d740b4010 0x7f0d740cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.719+0000 7f0d7985e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d740b4010 0x7f0d740cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35942/0 (socket says 172.21.15.6:35942) 2024-05-20T17:57:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.719+0000 7f0d7985e640 1 -- 172.21.15.6:0/3726719807 learned_addr learned my addr 172.21.15.6:0/3726719807 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.720+0000 7f0d7a05f640 1 --2- 172.21.15.6:0/3726719807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d74163a10 0x7f0d740d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.720+0000 7f0d7985e640 1 -- 172.21.15.6:0/3726719807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d74163a10 msgr2=0x7f0d740d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.720+0000 7f0d7985e640 1 --2- 172.21.15.6:0/3726719807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d74163a10 0x7f0d740d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.720+0000 7f0d7985e640 1 -- 172.21.15.6:0/3726719807 >> v1:172.21.15.171:6789/0 conn(0x7f0d740d14b0 legacy=0x7f0d740d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.720+0000 7f0d7985e640 1 -- 172.21.15.6:0/3726719807 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d740d3650 con 0x7f0d740b4010 2024-05-20T17:57:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.720+0000 7f0d7a05f640 1 --2- 172.21.15.6:0/3726719807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d74163a10 0x7f0d740d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.721+0000 7f0d7985e640 1 --2- 172.21.15.6:0/3726719807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d740b4010 0x7f0d740cfb00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009870 tx=0x7f0d6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e07599991349d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.721+0000 7f0d7905d640 1 -- 172.21.15.6:0/3726719807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64037070 con 0x7f0d740b4010 2024-05-20T17:57:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.721+0000 7f0d7905d640 1 -- 172.21.15.6:0/3726719807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d64032440 con 0x7f0d740b4010 2024-05-20T17:57:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.721+0000 7f0d7905d640 1 -- 172.21.15.6:0/3726719807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64032810 con 0x7f0d740b4010 2024-05-20T17:57:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.721+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/3726719807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d740b4010 msgr2=0x7f0d740cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.721+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/3726719807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d740b4010 0x7f0d740cfb00 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009870 tx=0x7f0d6402a270 comp rx=0 tx=0).stop 2024-05-20T17:57:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.722+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/3726719807 shutdown_connections 2024-05-20T17:57:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.722+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/3726719807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d740b4010 0x7f0d740cfb00 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.722+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/3726719807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d74163a10 0x7f0d740d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.722+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/3726719807 >> 172.21.15.6:0/3726719807 conn(0x7f0d7406d240 msgr2=0x7f0d7406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.722+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/3726719807 shutdown_connections 2024-05-20T17:57:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.722+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/3726719807 wait complete. 2024-05-20T17:57:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.723+0000 7f0d7c2c3640 1 Processor -- start 2024-05-20T17:57:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.723+0000 7f0d7c2c3640 1 -- start start 2024-05-20T17:57:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7c2c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d740b4010 0x7f0d740ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7c2c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d740d14b0 0x7f0d74162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7c2c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d74163a10 0x7f0d74159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7c2c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740b8210 con 0x7f0d74163a10 2024-05-20T17:57:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7c2c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740d0040 con 0x7f0d740b4010 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7c2c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0d740b8390 con 0x7f0d740d14b0 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d74163a10 0x7f0d74159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d74163a10 0x7f0d74159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35946/0 (socket says 172.21.15.6:35946) 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 -- 172.21.15.6:0/696134412 learned_addr learned my addr 172.21.15.6:0/696134412 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7985e640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d740d14b0 0x7f0d74162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a05f640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d740b4010 0x7f0d740ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 -- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d740d14b0 msgr2=0x7f0d74162240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d740d14b0 0x7f0d74162240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 -- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d740b4010 msgr2=0x7f0d740ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d740b4010 0x7f0d740ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 -- 172.21.15.6:0/696134412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d741607f0 con 0x7f0d74163a10 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a05f640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d740b4010 0x7f0d740ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.725+0000 7f0d7a860640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d74163a10 0x7f0d74159bb0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c6e0 tx=0x7f0d6c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.726+0000 7f0d6affd640 1 -- 172.21.15.6:0/696134412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c003b70 con 0x7f0d74163a10 2024-05-20T17:57:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.726+0000 7f0d6affd640 1 -- 172.21.15.6:0/696134412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c003d30 con 0x7f0d74163a10 2024-05-20T17:57:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.726+0000 7f0d6affd640 1 -- 172.21.15.6:0/696134412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c005310 con 0x7f0d74163a10 2024-05-20T17:57:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.726+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d74160ad0 con 0x7f0d74163a10 2024-05-20T17:57:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.726+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d74161090 con 0x7f0d74163a10 2024-05-20T17:57:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.727+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d74075b00 con 0x7f0d74163a10 2024-05-20T17:57:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.727+0000 7f0d6affd640 1 -- 172.21.15.6:0/696134412 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d6c0054b0 con 0x7f0d74163a10 2024-05-20T17:57:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.728+0000 7f0d6affd640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0d5806be30 0x7f0d5806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.728+0000 7f0d6affd640 1 -- 172.21.15.6:0/696134412 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f0d6c08aea0 con 0x7f0d74163a10 2024-05-20T17:57:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.728+0000 7f0d7a05f640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0d5806be30 0x7f0d5806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.729+0000 7f0d7a05f640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0d5806be30 0x7f0d5806e340 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0d70006fd0 tx=0x7f0d70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:24.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.732+0000 7f0d6affd640 1 -- 172.21.15.6:0/696134412 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0d6c059630 con 0x7f0d74163a10 2024-05-20T17:57:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.914+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d74075180 con 0x7f0d5806be30 2024-05-20T17:57:24.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.920+0000 7f0d6affd640 1 -- 172.21.15.6:0/696134412 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252074 (secure 0 0 0) 0x7f0d74075180 con 0x7f0d5806be30 2024-05-20T17:57:24.920 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:24.922 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T17:57:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0d5806be30 msgr2=0x7f0d5806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0d5806be30 0x7f0d5806e340 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0d70006fd0 tx=0x7f0d70008040 comp rx=0 tx=0).stop 2024-05-20T17:57:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d74163a10 msgr2=0x7f0d74159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d74163a10 0x7f0d74159bb0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c6e0 tx=0x7f0d6c00cba0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 shutdown_connections 2024-05-20T17:57:24.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0d5806be30 0x7f0d5806e340 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d74163a10 0x7f0d74159bb0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d740d14b0 0x7f0d74162240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 --2- 172.21.15.6:0/696134412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d740b4010 0x7f0d740ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:24.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 >> 172.21.15.6:0/696134412 conn(0x7f0d7406d240 msgr2=0x7f0d740b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:24.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 shutdown_connections 2024-05-20T17:57:24.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:24.924+0000 7f0d7c2c3640 1 -- 172.21.15.6:0/696134412 wait complete. 2024-05-20T17:57:24.933 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-05-20T17:57:24.297218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259100,"kb_used_data":9608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715620,"statfs":{"total":773094113280,"available":772828794880,"internally_reserved":0,"allocated":9838592,"data_stored":5120188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.816647"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507408+0000","last_change":"2024-05-20T17:57:20.522673+0000","last_active":"2024-05-20T17:57:21.507408+0000","last_peered":"2024-05-20T17:57:21.507408+0000","last_clean":"2024-05-20T17:57:21.507408+0000","last_became_active":"2024-05-20T17:57:20.522345+0000","last_became_peered":"2024-05-20T17:57:20.522345+0000","last_unstale":"2024-05-20T17:57:21.507408+0000","last_undegraded":"2024-05-20T17:57:21.507408+0000","last_fullsized":"2024-05-20T17:57:21.507408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:12:31.776003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514680+0000","last_change":"2024-05-20T17:57:20.515259+0000","last_active":"2024-05-20T17:57:21.514680+0000","last_peered":"2024-05-20T17:57:21.514680+0000","last_clean":"2024-05-20T17:57:21.514680+0000","last_became_active":"2024-05-20T17:57:20.514926+0000","last_became_peered":"2024-05-20T17:57:20.514926+0000","last_unstale":"2024-05-20T17:57:21.514680+0000","last_undegraded":"2024-05-20T17:57:21.514680+0000","last_fullsized":"2024-05-20T17:57:21.514680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:14:55.691160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507240+0000","last_change":"2024-05-20T17:57:20.502178+0000","last_active":"2024-05-20T17:57:21.507240+0000","last_peered":"2024-05-20T17:57:21.507240+0000","last_clean":"2024-05-20T17:57:21.507240+0000","last_became_active":"2024-05-20T17:57:20.501838+0000","last_became_peered":"2024-05-20T17:57:20.501838+0000","last_unstale":"2024-05-20T17:57:21.507240+0000","last_undegraded":"2024-05-20T17:57:21.507240+0000","last_fullsized":"2024-05-20T17:57:21.507240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:40:05.914975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991963+0000","last_change":"2024-05-20T17:57:20.524359+0000","last_active":"2024-05-20T17:57:21.991963+0000","last_peered":"2024-05-20T17:57:21.991963+0000","last_clean":"2024-05-20T17:57:21.991963+0000","last_became_active":"2024-05-20T17:57:20.523840+0000","last_became_peered":"2024-05-20T17:57:20.523840+0000","last_unstale":"2024-05-20T17:57:21.991963+0000","last_undegraded":"2024-05-20T17:57:21.991963+0000","last_fullsized":"2024-05-20T17:57:21.991963+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:41:03.109825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508737+0000","last_change":"2024-05-20T17:57:20.502962+0000","last_active":"2024-05-20T17:57:21.508737+0000","last_peered":"2024-05-20T17:57:21.508737+0000","last_clean":"2024-05-20T17:57:21.508737+0000","last_became_active":"2024-05-20T17:57:20.502294+0000","last_became_peered":"2024-05-20T17:57:20.502294+0000","last_unstale":"2024-05-20T17:57:21.508737+0000","last_undegraded":"2024-05-20T17:57:21.508737+0000","last_fullsized":"2024-05-20T17:57:21.508737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:40:52.078803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990539+0000","last_change":"2024-05-20T17:57:20.527795+0000","last_active":"2024-05-20T17:57:21.990539+0000","last_peered":"2024-05-20T17:57:21.990539+0000","last_clean":"2024-05-20T17:57:21.990539+0000","last_became_active":"2024-05-20T17:57:20.527467+0000","last_became_peered":"2024-05-20T17:57:20.527467+0000","last_unstale":"2024-05-20T17:57:21.990539+0000","last_undegraded":"2024-05-20T17:57:21.990539+0000","last_fullsized":"2024-05-20T17:57:21.990539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:27:14.396518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507731+0000","last_change":"2024-05-20T17:57:20.524220+0000","last_active":"2024-05-20T17:57:21.507731+0000","last_peered":"2024-05-20T17:57:21.507731+0000","last_clean":"2024-05-20T17:57:21.507731+0000","last_became_active":"2024-05-20T17:57:20.523910+0000","last_became_peered":"2024-05-20T17:57:20.523910+0000","last_unstale":"2024-05-20T17:57:21.507731+0000","last_undegraded":"2024-05-20T17:57:21.507731+0000","last_fullsized":"2024-05-20T17:57:21.507731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:11.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991312+0000","last_change":"2024-05-20T17:57:20.509910+0000","last_active":"2024-05-20T17:57:21.991312+0000","last_peered":"2024-05-20T17:57:21.991312+0000","last_clean":"2024-05-20T17:57:21.991312+0000","last_became_active":"2024-05-20T17:57:20.507312+0000","last_became_peered":"2024-05-20T17:57:20.507312+0000","last_unstale":"2024-05-20T17:57:21.991312+0000","last_undegraded":"2024-05-20T17:57:21.991312+0000","last_fullsized":"2024-05-20T17:57:21.991312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:59.439817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508514+0000","last_change":"2024-05-20T17:57:20.510598+0000","last_active":"2024-05-20T17:57:21.508514+0000","last_peered":"2024-05-20T17:57:21.508514+0000","last_clean":"2024-05-20T17:57:21.508514+0000","last_became_active":"2024-05-20T17:57:20.510187+0000","last_became_peered":"2024-05-20T17:57:20.510187+0000","last_unstale":"2024-05-20T17:57:21.508514+0000","last_undegraded":"2024-05-20T17:57:21.508514+0000","last_fullsized":"2024-05-20T17:57:21.508514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:41:03.109825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990219+0000","last_change":"2024-05-20T17:57:20.530790+0000","last_active":"2024-05-20T17:57:21.990219+0000","last_peered":"2024-05-20T17:57:21.990219+0000","last_clean":"2024-05-20T17:57:21.990219+0000","last_became_active":"2024-05-20T17:57:20.530451+0000","last_became_peered":"2024-05-20T17:57:20.530451+0000","last_unstale":"2024-05-20T17:57:21.990219+0000","last_undegraded":"2024-05-20T17:57:21.990219+0000","last_fullsized":"2024-05-20T17:57:21.990219+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:02:42.792503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509367+0000","last_change":"2024-05-20T17:57:20.519891+0000","last_active":"2024-05-20T17:57:21.509367+0000","last_peered":"2024-05-20T17:57:21.509367+0000","last_clean":"2024-05-20T17:57:21.509367+0000","last_became_active":"2024-05-20T17:57:20.519479+0000","last_became_peered":"2024-05-20T17:57:20.519479+0000","last_unstale":"2024-05-20T17:57:21.509367+0000","last_undegraded":"2024-05-20T17:57:21.509367+0000","last_fullsized":"2024-05-20T17:57:21.509367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:11.472158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990775+0000","last_change":"2024-05-20T17:57:20.525339+0000","last_active":"2024-05-20T17:57:21.990775+0000","last_peered":"2024-05-20T17:57:21.990775+0000","last_clean":"2024-05-20T17:57:21.990775+0000","last_became_active":"2024-05-20T17:57:20.524951+0000","last_became_peered":"2024-05-20T17:57:20.524951+0000","last_unstale":"2024-05-20T17:57:21.990775+0000","last_undegraded":"2024-05-20T17:57:21.990775+0000","last_fullsized":"2024-05-20T17:57:21.990775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:08.717476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991546+0000","last_change":"2024-05-20T17:57:20.522706+0000","last_active":"2024-05-20T17:57:21.991546+0000","last_peered":"2024-05-20T17:57:21.991546+0000","last_clean":"2024-05-20T17:57:21.991546+0000","last_became_active":"2024-05-20T17:57:20.518464+0000","last_became_peered":"2024-05-20T17:57:20.518464+0000","last_unstale":"2024-05-20T17:57:21.991546+0000","last_undegraded":"2024-05-20T17:57:21.991546+0000","last_fullsized":"2024-05-20T17:57:21.991546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:34:32.888977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507622+0000","last_change":"2024-05-20T17:57:20.525945+0000","last_active":"2024-05-20T17:57:21.507622+0000","last_peered":"2024-05-20T17:57:21.507622+0000","last_clean":"2024-05-20T17:57:21.507622+0000","last_became_active":"2024-05-20T17:57:20.525637+0000","last_became_peered":"2024-05-20T17:57:20.525637+0000","last_unstale":"2024-05-20T17:57:21.507622+0000","last_undegraded":"2024-05-20T17:57:21.507622+0000","last_fullsized":"2024-05-20T17:57:21.507622+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:37.480080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991410+0000","last_change":"2024-05-20T17:57:20.522514+0000","last_active":"2024-05-20T17:57:21.991410+0000","last_peered":"2024-05-20T17:57:21.991410+0000","last_clean":"2024-05-20T17:57:21.991410+0000","last_became_active":"2024-05-20T17:57:20.516947+0000","last_became_peered":"2024-05-20T17:57:20.516947+0000","last_unstale":"2024-05-20T17:57:21.991410+0000","last_undegraded":"2024-05-20T17:57:21.991410+0000","last_fullsized":"2024-05-20T17:57:21.991410+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:02:09.154196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990451+0000","last_change":"2024-05-20T17:57:20.526450+0000","last_active":"2024-05-20T17:57:21.990451+0000","last_peered":"2024-05-20T17:57:21.990451+0000","last_clean":"2024-05-20T17:57:21.990451+0000","last_became_active":"2024-05-20T17:57:20.526109+0000","last_became_peered":"2024-05-20T17:57:20.526109+0000","last_unstale":"2024-05-20T17:57:21.990451+0000","last_undegraded":"2024-05-20T17:57:21.990451+0000","last_fullsized":"2024-05-20T17:57:21.990451+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:53:16.382127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990602+0000","last_change":"2024-05-20T17:57:20.525608+0000","last_active":"2024-05-20T17:57:21.990602+0000","last_peered":"2024-05-20T17:57:21.990602+0000","last_clean":"2024-05-20T17:57:21.990602+0000","last_became_active":"2024-05-20T17:57:20.524963+0000","last_became_peered":"2024-05-20T17:57:20.524963+0000","last_unstale":"2024-05-20T17:57:21.990602+0000","last_undegraded":"2024-05-20T17:57:21.990602+0000","last_fullsized":"2024-05-20T17:57:21.990602+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:09:50.957394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507241+0000","last_change":"2024-05-20T17:57:20.509934+0000","last_active":"2024-05-20T17:57:21.507241+0000","last_peered":"2024-05-20T17:57:21.507241+0000","last_clean":"2024-05-20T17:57:21.507241+0000","last_became_active":"2024-05-20T17:57:20.509600+0000","last_became_peered":"2024-05-20T17:57:20.509600+0000","last_unstale":"2024-05-20T17:57:21.507241+0000","last_undegraded":"2024-05-20T17:57:21.507241+0000","last_fullsized":"2024-05-20T17:57:21.507241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:42:14.649342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509554+0000","last_change":"2024-05-20T17:57:20.519641+0000","last_active":"2024-05-20T17:57:21.509554+0000","last_peered":"2024-05-20T17:57:21.509554+0000","last_clean":"2024-05-20T17:57:21.509554+0000","last_became_active":"2024-05-20T17:57:20.518486+0000","last_became_peered":"2024-05-20T17:57:20.518486+0000","last_unstale":"2024-05-20T17:57:21.509554+0000","last_undegraded":"2024-05-20T17:57:21.509554+0000","last_fullsized":"2024-05-20T17:57:21.509554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:21:29.069394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.992049+0000","last_change":"2024-05-20T17:57:20.524200+0000","last_active":"2024-05-20T17:57:21.992049+0000","last_peered":"2024-05-20T17:57:21.992049+0000","last_clean":"2024-05-20T17:57:21.992049+0000","last_became_active":"2024-05-20T17:57:20.523726+0000","last_became_peered":"2024-05-20T17:57:20.523726+0000","last_unstale":"2024-05-20T17:57:21.992049+0000","last_undegraded":"2024-05-20T17:57:21.992049+0000","last_fullsized":"2024-05-20T17:57:21.992049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:40:52.078803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508492+0000","last_change":"2024-05-20T17:57:20.505011+0000","last_active":"2024-05-20T17:57:21.508492+0000","last_peered":"2024-05-20T17:57:21.508492+0000","last_clean":"2024-05-20T17:57:21.508492+0000","last_became_active":"2024-05-20T17:57:20.504702+0000","last_became_peered":"2024-05-20T17:57:20.504702+0000","last_unstale":"2024-05-20T17:57:21.508492+0000","last_undegraded":"2024-05-20T17:57:21.508492+0000","last_fullsized":"2024-05-20T17:57:21.508492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:20.300544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507794+0000","last_change":"2024-05-20T17:57:20.525883+0000","last_active":"2024-05-20T17:57:21.507794+0000","last_peered":"2024-05-20T17:57:21.507794+0000","last_clean":"2024-05-20T17:57:21.507794+0000","last_became_active":"2024-05-20T17:57:20.525598+0000","last_became_peered":"2024-05-20T17:57:20.525598+0000","last_unstale":"2024-05-20T17:57:21.507794+0000","last_undegraded":"2024-05-20T17:57:21.507794+0000","last_fullsized":"2024-05-20T17:57:21.507794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:59.439817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.989925+0000","last_change":"2024-05-20T17:57:20.520520+0000","last_active":"2024-05-20T17:57:21.989925+0000","last_peered":"2024-05-20T17:57:21.989925+0000","last_clean":"2024-05-20T17:57:21.989925+0000","last_became_active":"2024-05-20T17:57:20.520263+0000","last_became_peered":"2024-05-20T17:57:20.520263+0000","last_unstale":"2024-05-20T17:57:21.989925+0000","last_undegraded":"2024-05-20T17:57:21.989925+0000","last_fullsized":"2024-05-20T17:57:21.989925+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:41:03.109825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507011+0000","last_change":"2024-05-20T17:57:20.511820+0000","last_active":"2024-05-20T17:57:21.507011+0000","last_peered":"2024-05-20T17:57:21.507011+0000","last_clean":"2024-05-20T17:57:21.507011+0000","last_became_active":"2024-05-20T17:57:20.511504+0000","last_became_peered":"2024-05-20T17:57:20.511504+0000","last_unstale":"2024-05-20T17:57:21.507011+0000","last_undegraded":"2024-05-20T17:57:21.507011+0000","last_fullsized":"2024-05-20T17:57:21.507011+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:39:35.347348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514706+0000","last_change":"2024-05-20T17:57:20.508139+0000","last_active":"2024-05-20T17:57:21.514706+0000","last_peered":"2024-05-20T17:57:21.514706+0000","last_clean":"2024-05-20T17:57:21.514706+0000","last_became_active":"2024-05-20T17:57:20.507853+0000","last_became_peered":"2024-05-20T17:57:20.507853+0000","last_unstale":"2024-05-20T17:57:21.514706+0000","last_undegraded":"2024-05-20T17:57:21.514706+0000","last_fullsized":"2024-05-20T17:57:21.514706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:39:35.347348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508997+0000","last_change":"2024-05-20T17:57:20.525495+0000","last_active":"2024-05-20T17:57:21.508997+0000","last_peered":"2024-05-20T17:57:21.508997+0000","last_clean":"2024-05-20T17:57:21.508997+0000","last_became_active":"2024-05-20T17:57:20.525158+0000","last_became_peered":"2024-05-20T17:57:20.525158+0000","last_unstale":"2024-05-20T17:57:21.508997+0000","last_undegraded":"2024-05-20T17:57:21.508997+0000","last_fullsized":"2024-05-20T17:57:21.508997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:03.219310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990378+0000","last_change":"2024-05-20T17:57:20.508813+0000","last_active":"2024-05-20T17:57:21.990378+0000","last_peered":"2024-05-20T17:57:21.990378+0000","last_clean":"2024-05-20T17:57:21.990378+0000","last_became_active":"2024-05-20T17:57:20.508306+0000","last_became_peered":"2024-05-20T17:57:20.508306+0000","last_unstale":"2024-05-20T17:57:21.990378+0000","last_undegraded":"2024-05-20T17:57:21.990378+0000","last_fullsized":"2024-05-20T17:57:21.990378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:24:59.487287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.992152+0000","last_change":"2024-05-20T17:57:20.524065+0000","last_active":"2024-05-20T17:57:21.992152+0000","last_peered":"2024-05-20T17:57:21.992152+0000","last_clean":"2024-05-20T17:57:21.992152+0000","last_became_active":"2024-05-20T17:57:20.523371+0000","last_became_peered":"2024-05-20T17:57:20.523371+0000","last_unstale":"2024-05-20T17:57:21.992152+0000","last_undegraded":"2024-05-20T17:57:21.992152+0000","last_fullsized":"2024-05-20T17:57:21.992152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:03.219310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508474+0000","last_change":"2024-05-20T17:57:20.509902+0000","last_active":"2024-05-20T17:57:21.508474+0000","last_peered":"2024-05-20T17:57:21.508474+0000","last_clean":"2024-05-20T17:57:21.508474+0000","last_became_active":"2024-05-20T17:57:20.509590+0000","last_became_peered":"2024-05-20T17:57:20.509590+0000","last_unstale":"2024-05-20T17:57:21.508474+0000","last_undegraded":"2024-05-20T17:57:21.508474+0000","last_fullsized":"2024-05-20T17:57:21.508474+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:04:52.678042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508446+0000","last_change":"2024-05-20T17:57:20.508771+0000","last_active":"2024-05-20T17:57:21.508446+0000","last_peered":"2024-05-20T17:57:21.508446+0000","last_clean":"2024-05-20T17:57:21.508446+0000","last_became_active":"2024-05-20T17:57:20.508213+0000","last_became_peered":"2024-05-20T17:57:20.508213+0000","last_unstale":"2024-05-20T17:57:21.508446+0000","last_undegraded":"2024-05-20T17:57:21.508446+0000","last_fullsized":"2024-05-20T17:57:21.508446+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:34:32.888977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514455+0000","last_change":"2024-05-20T17:57:20.530790+0000","last_active":"2024-05-20T17:57:21.514455+0000","last_peered":"2024-05-20T17:57:21.514455+0000","last_clean":"2024-05-20T17:57:21.514455+0000","last_became_active":"2024-05-20T17:57:20.530480+0000","last_became_peered":"2024-05-20T17:57:20.530480+0000","last_unstale":"2024-05-20T17:57:21.514455+0000","last_undegraded":"2024-05-20T17:57:21.514455+0000","last_fullsized":"2024-05-20T17:57:21.514455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:11.472158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990538+0000","last_change":"2024-05-20T17:57:20.525292+0000","last_active":"2024-05-20T17:57:21.990538+0000","last_peered":"2024-05-20T17:57:21.990538+0000","last_clean":"2024-05-20T17:57:21.990538+0000","last_became_active":"2024-05-20T17:57:20.524937+0000","last_became_peered":"2024-05-20T17:57:20.524937+0000","last_unstale":"2024-05-20T17:57:21.990538+0000","last_undegraded":"2024-05-20T17:57:21.990538+0000","last_fullsized":"2024-05-20T17:57:21.990538+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:04:52.875144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991072+0000","last_change":"2024-05-20T17:57:20.515811+0000","last_active":"2024-05-20T17:57:21.991072+0000","last_peered":"2024-05-20T17:57:21.991072+0000","last_clean":"2024-05-20T17:57:21.991072+0000","last_became_active":"2024-05-20T17:57:20.515470+0000","last_became_peered":"2024-05-20T17:57:20.515470+0000","last_unstale":"2024-05-20T17:57:21.991072+0000","last_undegraded":"2024-05-20T17:57:21.991072+0000","last_fullsized":"2024-05-20T17:57:21.991072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:32:28.497894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990209+0000","last_change":"2024-05-20T17:57:19.502280+0000","last_active":"2024-05-20T17:57:21.990209+0000","last_peered":"2024-05-20T17:57:21.990209+0000","last_clean":"2024-05-20T17:57:21.990209+0000","last_became_active":"2024-05-20T17:57:19.501792+0000","last_became_peered":"2024-05-20T17:57:19.501792+0000","last_unstale":"2024-05-20T17:57:21.990209+0000","last_undegraded":"2024-05-20T17:57:21.990209+0000","last_fullsized":"2024-05-20T17:57:21.990209+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:21:27.106947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991484+0000","last_change":"2024-05-20T17:57:20.517975+0000","last_active":"2024-05-20T17:57:21.991484+0000","last_peered":"2024-05-20T17:57:21.991484+0000","last_clean":"2024-05-20T17:57:21.991484+0000","last_became_active":"2024-05-20T17:57:20.517655+0000","last_became_peered":"2024-05-20T17:57:20.517655+0000","last_unstale":"2024-05-20T17:57:21.991484+0000","last_undegraded":"2024-05-20T17:57:21.991484+0000","last_fullsized":"2024-05-20T17:57:21.991484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:50:04.709447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508445+0000","last_change":"2024-05-20T17:57:19.501859+0000","last_active":"2024-05-20T17:57:21.508445+0000","last_peered":"2024-05-20T17:57:21.508445+0000","last_clean":"2024-05-20T17:57:21.508445+0000","last_became_active":"2024-05-20T17:57:19.501376+0000","last_became_peered":"2024-05-20T17:57:19.501376+0000","last_unstale":"2024-05-20T17:57:21.508445+0000","last_undegraded":"2024-05-20T17:57:21.508445+0000","last_fullsized":"2024-05-20T17:57:21.508445+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:37.432484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507732+0000","last_change":"2024-05-20T17:57:20.525720+0000","last_active":"2024-05-20T17:57:21.507732+0000","last_peered":"2024-05-20T17:57:21.507732+0000","last_clean":"2024-05-20T17:57:21.507732+0000","last_became_active":"2024-05-20T17:57:20.525201+0000","last_became_peered":"2024-05-20T17:57:20.525201+0000","last_unstale":"2024-05-20T17:57:21.507732+0000","last_undegraded":"2024-05-20T17:57:21.507732+0000","last_fullsized":"2024-05-20T17:57:21.507732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:53.404580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507741+0000","last_change":"2024-05-20T17:57:19.503167+0000","last_active":"2024-05-20T17:57:21.507741+0000","last_peered":"2024-05-20T17:57:21.507741+0000","last_clean":"2024-05-20T17:57:21.507741+0000","last_became_active":"2024-05-20T17:57:19.502834+0000","last_became_peered":"2024-05-20T17:57:19.502834+0000","last_unstale":"2024-05-20T17:57:21.507741+0000","last_undegraded":"2024-05-20T17:57:21.507741+0000","last_fullsized":"2024-05-20T17:57:21.507741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:42:13.644037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990817+0000","last_change":"2024-05-20T17:57:20.516279+0000","last_active":"2024-05-20T17:57:21.990817+0000","last_peered":"2024-05-20T17:57:21.990817+0000","last_clean":"2024-05-20T17:57:21.990817+0000","last_became_active":"2024-05-20T17:57:20.515779+0000","last_became_peered":"2024-05-20T17:57:20.515779+0000","last_unstale":"2024-05-20T17:57:21.990817+0000","last_undegraded":"2024-05-20T17:57:21.990817+0000","last_fullsized":"2024-05-20T17:57:21.990817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:46.995694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990205+0000","last_change":"2024-05-20T17:57:19.505340+0000","last_active":"2024-05-20T17:57:21.990205+0000","last_peered":"2024-05-20T17:57:21.990205+0000","last_clean":"2024-05-20T17:57:21.990205+0000","last_became_active":"2024-05-20T17:57:19.504359+0000","last_became_peered":"2024-05-20T17:57:19.504359+0000","last_unstale":"2024-05-20T17:57:21.990205+0000","last_undegraded":"2024-05-20T17:57:21.990205+0000","last_fullsized":"2024-05-20T17:57:21.990205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:26:25.301844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991517+0000","last_change":"2024-05-20T17:57:20.510662+0000","last_active":"2024-05-20T17:57:21.991517+0000","last_peered":"2024-05-20T17:57:21.991517+0000","last_clean":"2024-05-20T17:57:21.991517+0000","last_became_active":"2024-05-20T17:57:20.510335+0000","last_became_peered":"2024-05-20T17:57:20.510335+0000","last_unstale":"2024-05-20T17:57:21.991517+0000","last_undegraded":"2024-05-20T17:57:21.991517+0000","last_fullsized":"2024-05-20T17:57:21.991517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:06:49.558913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508799+0000","last_change":"2024-05-20T17:57:19.497558+0000","last_active":"2024-05-20T17:57:21.508799+0000","last_peered":"2024-05-20T17:57:21.508799+0000","last_clean":"2024-05-20T17:57:21.508799+0000","last_became_active":"2024-05-20T17:57:19.497220+0000","last_became_peered":"2024-05-20T17:57:19.497220+0000","last_unstale":"2024-05-20T17:57:21.508799+0000","last_undegraded":"2024-05-20T17:57:21.508799+0000","last_fullsized":"2024-05-20T17:57:21.508799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:03:10.440894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990044+0000","last_change":"2024-05-20T17:57:20.517392+0000","last_active":"2024-05-20T17:57:21.990044+0000","last_peered":"2024-05-20T17:57:21.990044+0000","last_clean":"2024-05-20T17:57:21.990044+0000","last_became_active":"2024-05-20T17:57:20.516925+0000","last_became_peered":"2024-05-20T17:57:20.516925+0000","last_unstale":"2024-05-20T17:57:21.990044+0000","last_undegraded":"2024-05-20T17:57:21.990044+0000","last_fullsized":"2024-05-20T17:57:21.990044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:03.219310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991896+0000","last_change":"2024-05-20T17:57:19.497798+0000","last_active":"2024-05-20T17:57:21.991896+0000","last_peered":"2024-05-20T17:57:21.991896+0000","last_clean":"2024-05-20T17:57:21.991896+0000","last_became_active":"2024-05-20T17:57:19.496804+0000","last_became_peered":"2024-05-20T17:57:19.496804+0000","last_unstale":"2024-05-20T17:57:21.991896+0000","last_undegraded":"2024-05-20T17:57:21.991896+0000","last_fullsized":"2024-05-20T17:57:21.991896+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:03:10.440894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990503+0000","last_change":"2024-05-20T17:57:20.527055+0000","last_active":"2024-05-20T17:57:21.990503+0000","last_peered":"2024-05-20T17:57:21.990503+0000","last_clean":"2024-05-20T17:57:21.990503+0000","last_became_active":"2024-05-20T17:57:20.526702+0000","last_became_peered":"2024-05-20T17:57:20.526702+0000","last_unstale":"2024-05-20T17:57:21.990503+0000","last_undegraded":"2024-05-20T17:57:21.990503+0000","last_fullsized":"2024-05-20T17:57:21.990503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:28:50.136477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507007+0000","last_change":"2024-05-20T17:57:19.502239+0000","last_active":"2024-05-20T17:57:21.507007+0000","last_peered":"2024-05-20T17:57:21.507007+0000","last_clean":"2024-05-20T17:57:21.507007+0000","last_became_active":"2024-05-20T17:57:19.501919+0000","last_became_peered":"2024-05-20T17:57:19.501919+0000","last_unstale":"2024-05-20T17:57:21.507007+0000","last_undegraded":"2024-05-20T17:57:21.507007+0000","last_fullsized":"2024-05-20T17:57:21.507007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:19.295239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991901+0000","last_change":"2024-05-20T17:57:20.518985+0000","last_active":"2024-05-20T17:57:21.991901+0000","last_peered":"2024-05-20T17:57:21.991901+0000","last_clean":"2024-05-20T17:57:21.991901+0000","last_became_active":"2024-05-20T17:57:20.518653+0000","last_became_peered":"2024-05-20T17:57:20.518653+0000","last_unstale":"2024-05-20T17:57:21.991901+0000","last_undegraded":"2024-05-20T17:57:21.991901+0000","last_fullsized":"2024-05-20T17:57:21.991901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:38:20.300544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507450+0000","last_change":"2024-05-20T17:57:19.505806+0000","last_active":"2024-05-20T17:57:21.507450+0000","last_peered":"2024-05-20T17:57:21.507450+0000","last_clean":"2024-05-20T17:57:21.507450+0000","last_became_active":"2024-05-20T17:57:19.505460+0000","last_became_peered":"2024-05-20T17:57:19.505460+0000","last_unstale":"2024-05-20T17:57:21.507450+0000","last_undegraded":"2024-05-20T17:57:21.507450+0000","last_fullsized":"2024-05-20T17:57:21.507450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:21:28.064090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508482+0000","last_change":"2024-05-20T17:57:20.518137+0000","last_active":"2024-05-20T17:57:21.508482+0000","last_peered":"2024-05-20T17:57:21.508482+0000","last_clean":"2024-05-20T17:57:21.508482+0000","last_became_active":"2024-05-20T17:57:20.517708+0000","last_became_peered":"2024-05-20T17:57:20.517708+0000","last_unstale":"2024-05-20T17:57:21.508482+0000","last_undegraded":"2024-05-20T17:57:21.508482+0000","last_fullsized":"2024-05-20T17:57:21.508482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:31:17.493977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514756+0000","last_change":"2024-05-20T17:57:19.502766+0000","last_active":"2024-05-20T17:57:21.514756+0000","last_peered":"2024-05-20T17:57:21.514756+0000","last_clean":"2024-05-20T17:57:21.514756+0000","last_became_active":"2024-05-20T17:57:19.502433+0000","last_became_peered":"2024-05-20T17:57:19.502433+0000","last_unstale":"2024-05-20T17:57:21.514756+0000","last_undegraded":"2024-05-20T17:57:21.514756+0000","last_fullsized":"2024-05-20T17:57:21.514756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:50:58.434512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507657+0000","last_change":"2024-05-20T17:57:20.507873+0000","last_active":"2024-05-20T17:57:21.507657+0000","last_peered":"2024-05-20T17:57:21.507657+0000","last_clean":"2024-05-20T17:57:21.507657+0000","last_became_active":"2024-05-20T17:57:20.507540+0000","last_became_peered":"2024-05-20T17:57:20.507540+0000","last_unstale":"2024-05-20T17:57:21.507657+0000","last_undegraded":"2024-05-20T17:57:21.507657+0000","last_fullsized":"2024-05-20T17:57:21.507657+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:09:49.915041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507313+0000","last_change":"2024-05-20T17:57:19.505781+0000","last_active":"2024-05-20T17:57:21.507313+0000","last_peered":"2024-05-20T17:57:21.507313+0000","last_clean":"2024-05-20T17:57:21.507313+0000","last_became_active":"2024-05-20T17:57:19.505456+0000","last_became_peered":"2024-05-20T17:57:19.505456+0000","last_unstale":"2024-05-20T17:57:21.507313+0000","last_undegraded":"2024-05-20T17:57:21.507313+0000","last_fullsized":"2024-05-20T17:57:21.507313+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:41:02.104520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507265+0000","last_change":"2024-05-20T17:57:20.521078+0000","last_active":"2024-05-20T17:57:21.507265+0000","last_peered":"2024-05-20T17:57:21.507265+0000","last_clean":"2024-05-20T17:57:21.507265+0000","last_became_active":"2024-05-20T17:57:20.520669+0000","last_became_peered":"2024-05-20T17:57:20.520669+0000","last_unstale":"2024-05-20T17:57:21.507265+0000","last_undegraded":"2024-05-20T17:57:21.507265+0000","last_fullsized":"2024-05-20T17:57:21.507265+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:24:39.346848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509621+0000","last_change":"2024-05-20T17:57:19.502942+0000","last_active":"2024-05-20T17:57:21.509621+0000","last_peered":"2024-05-20T17:57:21.509621+0000","last_clean":"2024-05-20T17:57:21.509621+0000","last_became_active":"2024-05-20T17:57:19.501038+0000","last_became_peered":"2024-05-20T17:57:19.501038+0000","last_unstale":"2024-05-20T17:57:21.509621+0000","last_undegraded":"2024-05-20T17:57:21.509621+0000","last_fullsized":"2024-05-20T17:57:21.509621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:31:02.693324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.992226+0000","last_change":"2024-05-20T17:57:20.517917+0000","last_active":"2024-05-20T17:57:21.992226+0000","last_peered":"2024-05-20T17:57:21.992226+0000","last_clean":"2024-05-20T17:57:21.992226+0000","last_became_active":"2024-05-20T17:57:20.517612+0000","last_became_peered":"2024-05-20T17:57:20.517612+0000","last_unstale":"2024-05-20T17:57:21.992226+0000","last_undegraded":"2024-05-20T17:57:21.992226+0000","last_fullsized":"2024-05-20T17:57:21.992226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:11.472158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"86'6","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991368+0000","last_change":"2024-05-20T17:57:19.502222+0000","last_active":"2024-05-20T17:57:21.991368+0000","last_peered":"2024-05-20T17:57:21.991368+0000","last_clean":"2024-05-20T17:57:21.991368+0000","last_became_active":"2024-05-20T17:57:19.501878+0000","last_became_peered":"2024-05-20T17:57:19.501878+0000","last_unstale":"2024-05-20T17:57:21.991368+0000","last_undegraded":"2024-05-20T17:57:21.991368+0000","last_fullsized":"2024-05-20T17:57:21.991368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:24:38.341543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991651+0000","last_change":"2024-05-20T17:57:20.507832+0000","last_active":"2024-05-20T17:57:21.991651+0000","last_peered":"2024-05-20T17:57:21.991651+0000","last_clean":"2024-05-20T17:57:21.991651+0000","last_became_active":"2024-05-20T17:57:20.506942+0000","last_became_peered":"2024-05-20T17:57:20.506942+0000","last_unstale":"2024-05-20T17:57:21.991651+0000","last_undegraded":"2024-05-20T17:57:21.991651+0000","last_fullsized":"2024-05-20T17:57:21.991651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:31:17.493977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508356+0000","last_change":"2024-05-20T17:57:19.505005+0000","last_active":"2024-05-20T17:57:21.508356+0000","last_peered":"2024-05-20T17:57:21.508356+0000","last_clean":"2024-05-20T17:57:21.508356+0000","last_became_active":"2024-05-20T17:57:19.504685+0000","last_became_peered":"2024-05-20T17:57:19.504685+0000","last_unstale":"2024-05-20T17:57:21.508356+0000","last_undegraded":"2024-05-20T17:57:21.508356+0000","last_fullsized":"2024-05-20T17:57:21.508356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:40:04.909670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508044+0000","last_change":"2024-05-20T17:57:20.502363+0000","last_active":"2024-05-20T17:57:21.508044+0000","last_peered":"2024-05-20T17:57:21.508044+0000","last_clean":"2024-05-20T17:57:21.508044+0000","last_became_active":"2024-05-20T17:57:20.501578+0000","last_became_peered":"2024-05-20T17:57:20.501578+0000","last_unstale":"2024-05-20T17:57:21.508044+0000","last_undegraded":"2024-05-20T17:57:21.508044+0000","last_fullsized":"2024-05-20T17:57:21.508044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:02:09.154196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990579+0000","last_change":"2024-05-20T17:57:19.503324+0000","last_active":"2024-05-20T17:57:21.990579+0000","last_peered":"2024-05-20T17:57:21.990579+0000","last_clean":"2024-05-20T17:57:21.990579+0000","last_became_active":"2024-05-20T17:57:19.503001+0000","last_became_peered":"2024-05-20T17:57:19.503001+0000","last_unstale":"2024-05-20T17:57:21.990579+0000","last_undegraded":"2024-05-20T17:57:21.990579+0000","last_fullsized":"2024-05-20T17:57:21.990579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:42:13.644037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990056+0000","last_change":"2024-05-20T17:57:20.530952+0000","last_active":"2024-05-20T17:57:21.990056+0000","last_peered":"2024-05-20T17:57:21.990056+0000","last_clean":"2024-05-20T17:57:21.990056+0000","last_became_active":"2024-05-20T17:57:20.530595+0000","last_became_peered":"2024-05-20T17:57:20.530595+0000","last_unstale":"2024-05-20T17:57:21.990056+0000","last_undegraded":"2024-05-20T17:57:21.990056+0000","last_fullsized":"2024-05-20T17:57:21.990056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:46:59.272413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991382+0000","last_change":"2024-05-20T17:57:19.504013+0000","last_active":"2024-05-20T17:57:21.991382+0000","last_peered":"2024-05-20T17:57:21.991382+0000","last_clean":"2024-05-20T17:57:21.991382+0000","last_became_active":"2024-05-20T17:57:19.503711+0000","last_became_peered":"2024-05-20T17:57:19.503711+0000","last_unstale":"2024-05-20T17:57:21.991382+0000","last_undegraded":"2024-05-20T17:57:21.991382+0000","last_fullsized":"2024-05-20T17:57:21.991382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:07:20.079205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990669+0000","last_change":"2024-05-20T17:57:20.513499+0000","last_active":"2024-05-20T17:57:21.990669+0000","last_peered":"2024-05-20T17:57:21.990669+0000","last_clean":"2024-05-20T17:57:21.990669+0000","last_became_active":"2024-05-20T17:57:20.513109+0000","last_became_peered":"2024-05-20T17:57:20.513109+0000","last_unstale":"2024-05-20T17:57:21.990669+0000","last_undegraded":"2024-05-20T17:57:21.990669+0000","last_fullsized":"2024-05-20T17:57:21.990669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T17:59:10.454342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"86'8","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991589+0000","last_change":"2024-05-20T17:57:19.493807+0000","last_active":"2024-05-20T17:57:21.991589+0000","last_peered":"2024-05-20T17:57:21.991589+0000","last_clean":"2024-05-20T17:57:21.991589+0000","last_became_active":"2024-05-20T17:57:19.493468+0000","last_became_peered":"2024-05-20T17:57:19.493468+0000","last_unstale":"2024-05-20T17:57:21.991589+0000","last_undegraded":"2024-05-20T17:57:21.991589+0000","last_fullsized":"2024-05-20T17:57:21.991589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:27:35.600984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991302+0000","last_change":"2024-05-20T17:57:20.516615+0000","last_active":"2024-05-20T17:57:21.991302+0000","last_peered":"2024-05-20T17:57:21.991302+0000","last_clean":"2024-05-20T17:57:21.991302+0000","last_became_active":"2024-05-20T17:57:20.516197+0000","last_became_peered":"2024-05-20T17:57:20.516197+0000","last_unstale":"2024-05-20T17:57:21.991302+0000","last_undegraded":"2024-05-20T17:57:21.991302+0000","last_fullsized":"2024-05-20T17:57:21.991302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:23:49.992596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990296+0000","last_change":"2024-05-20T17:57:19.501125+0000","last_active":"2024-05-20T17:57:21.990296+0000","last_peered":"2024-05-20T17:57:21.990296+0000","last_clean":"2024-05-20T17:57:21.990296+0000","last_became_active":"2024-05-20T17:57:19.500800+0000","last_became_peered":"2024-05-20T17:57:19.500800+0000","last_unstale":"2024-05-20T17:57:21.990296+0000","last_undegraded":"2024-05-20T17:57:21.990296+0000","last_fullsized":"2024-05-20T17:57:21.990296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:50:49.164065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990187+0000","last_change":"2024-05-20T17:57:20.508481+0000","last_active":"2024-05-20T17:57:21.990187+0000","last_peered":"2024-05-20T17:57:21.990187+0000","last_clean":"2024-05-20T17:57:21.990187+0000","last_became_active":"2024-05-20T17:57:20.508162+0000","last_became_peered":"2024-05-20T17:57:20.508162+0000","last_unstale":"2024-05-20T17:57:21.990187+0000","last_undegraded":"2024-05-20T17:57:21.990187+0000","last_fullsized":"2024-05-20T17:57:21.990187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:11.472158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507669+0000","last_change":"2024-05-20T17:57:19.502879+0000","last_active":"2024-05-20T17:57:21.507669+0000","last_peered":"2024-05-20T17:57:21.507669+0000","last_clean":"2024-05-20T17:57:21.507669+0000","last_became_active":"2024-05-20T17:57:19.502561+0000","last_became_peered":"2024-05-20T17:57:19.502561+0000","last_unstale":"2024-05-20T17:57:21.507669+0000","last_undegraded":"2024-05-20T17:57:21.507669+0000","last_fullsized":"2024-05-20T17:57:21.507669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:14:54.685856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508359+0000","last_change":"2024-05-20T17:57:20.511092+0000","last_active":"2024-05-20T17:57:21.508359+0000","last_peered":"2024-05-20T17:57:21.508359+0000","last_clean":"2024-05-20T17:57:21.508359+0000","last_became_active":"2024-05-20T17:57:20.510479+0000","last_became_peered":"2024-05-20T17:57:20.510479+0000","last_unstale":"2024-05-20T17:57:21.508359+0000","last_undegraded":"2024-05-20T17:57:21.508359+0000","last_fullsized":"2024-05-20T17:57:21.508359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:06:49.558913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509674+0000","last_change":"2024-05-20T17:57:19.500207+0000","last_active":"2024-05-20T17:57:21.509674+0000","last_peered":"2024-05-20T17:57:21.509674+0000","last_clean":"2024-05-20T17:57:21.509674+0000","last_became_active":"2024-05-20T17:57:19.499868+0000","last_became_peered":"2024-05-20T17:57:19.499868+0000","last_unstale":"2024-05-20T17:57:21.509674+0000","last_undegraded":"2024-05-20T17:57:21.509674+0000","last_fullsized":"2024-05-20T17:57:21.509674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:24.752275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990743+0000","last_change":"2024-05-20T17:57:20.527238+0000","last_active":"2024-05-20T17:57:21.990743+0000","last_peered":"2024-05-20T17:57:21.990743+0000","last_clean":"2024-05-20T17:57:21.990743+0000","last_became_active":"2024-05-20T17:57:20.526842+0000","last_became_peered":"2024-05-20T17:57:20.526842+0000","last_unstale":"2024-05-20T17:57:21.990743+0000","last_undegraded":"2024-05-20T17:57:21.990743+0000","last_fullsized":"2024-05-20T17:57:21.990743+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:48:36.505363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514291+0000","last_change":"2024-05-20T17:57:19.499775+0000","last_active":"2024-05-20T17:57:21.514291+0000","last_peered":"2024-05-20T17:57:21.514291+0000","last_clean":"2024-05-20T17:57:21.514291+0000","last_became_active":"2024-05-20T17:57:19.499443+0000","last_became_peered":"2024-05-20T17:57:19.499443+0000","last_unstale":"2024-05-20T17:57:21.514291+0000","last_undegraded":"2024-05-20T17:57:21.514291+0000","last_fullsized":"2024-05-20T17:57:21.514291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:36.474775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514527+0000","last_change":"2024-05-20T17:57:20.516005+0000","last_active":"2024-05-20T17:57:21.514527+0000","last_peered":"2024-05-20T17:57:21.514527+0000","last_clean":"2024-05-20T17:57:21.514527+0000","last_became_active":"2024-05-20T17:57:20.515713+0000","last_became_peered":"2024-05-20T17:57:20.515713+0000","last_unstale":"2024-05-20T17:57:21.514527+0000","last_undegraded":"2024-05-20T17:57:21.514527+0000","last_fullsized":"2024-05-20T17:57:21.514527+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:11:34.775105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990040+0000","last_change":"2024-05-20T17:57:19.501848+0000","last_active":"2024-05-20T17:57:21.990040+0000","last_peered":"2024-05-20T17:57:21.990040+0000","last_clean":"2024-05-20T17:57:21.990040+0000","last_became_active":"2024-05-20T17:57:19.501522+0000","last_became_peered":"2024-05-20T17:57:19.501522+0000","last_unstale":"2024-05-20T17:57:21.990040+0000","last_undegraded":"2024-05-20T17:57:21.990040+0000","last_fullsized":"2024-05-20T17:57:21.990040+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:50:53.213482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514448+0000","last_change":"2024-05-20T17:57:20.530807+0000","last_active":"2024-05-20T17:57:21.514448+0000","last_peered":"2024-05-20T17:57:21.514448+0000","last_clean":"2024-05-20T17:57:21.514448+0000","last_became_active":"2024-05-20T17:57:20.530494+0000","last_became_peered":"2024-05-20T17:57:20.530494+0000","last_unstale":"2024-05-20T17:57:21.514448+0000","last_undegraded":"2024-05-20T17:57:21.514448+0000","last_fullsized":"2024-05-20T17:57:21.514448+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:21:29.069394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514539+0000","last_change":"2024-05-20T17:57:19.505045+0000","last_active":"2024-05-20T17:57:21.514539+0000","last_peered":"2024-05-20T17:57:21.514539+0000","last_clean":"2024-05-20T17:57:21.514539+0000","last_became_active":"2024-05-20T17:57:19.504699+0000","last_became_peered":"2024-05-20T17:57:19.504699+0000","last_unstale":"2024-05-20T17:57:21.514539+0000","last_undegraded":"2024-05-20T17:57:21.514539+0000","last_fullsized":"2024-05-20T17:57:21.514539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:06:48.553608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991100+0000","last_change":"2024-05-20T17:57:20.516908+0000","last_active":"2024-05-20T17:57:21.991100+0000","last_peered":"2024-05-20T17:57:21.991100+0000","last_clean":"2024-05-20T17:57:21.991100+0000","last_became_active":"2024-05-20T17:57:20.516598+0000","last_became_peered":"2024-05-20T17:57:20.516598+0000","last_unstale":"2024-05-20T17:57:21.991100+0000","last_undegraded":"2024-05-20T17:57:21.991100+0000","last_fullsized":"2024-05-20T17:57:21.991100+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:34:56.585482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.989904+0000","last_change":"2024-05-20T17:57:19.501140+0000","last_active":"2024-05-20T17:57:21.989904+0000","last_peered":"2024-05-20T17:57:21.989904+0000","last_clean":"2024-05-20T17:57:21.989904+0000","last_became_active":"2024-05-20T17:57:19.500507+0000","last_became_peered":"2024-05-20T17:57:19.500507+0000","last_unstale":"2024-05-20T17:57:21.989904+0000","last_undegraded":"2024-05-20T17:57:21.989904+0000","last_fullsized":"2024-05-20T17:57:21.989904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:18.058376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990269+0000","last_change":"2024-05-20T17:57:20.504813+0000","last_active":"2024-05-20T17:57:21.990269+0000","last_peered":"2024-05-20T17:57:21.990269+0000","last_clean":"2024-05-20T17:57:21.990269+0000","last_became_active":"2024-05-20T17:57:20.504045+0000","last_became_peered":"2024-05-20T17:57:20.504045+0000","last_unstale":"2024-05-20T17:57:21.990269+0000","last_undegraded":"2024-05-20T17:57:21.990269+0000","last_fullsized":"2024-05-20T17:57:21.990269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:21:29.069394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507785+0000","last_change":"2024-05-20T17:57:19.503995+0000","last_active":"2024-05-20T17:57:21.507785+0000","last_peered":"2024-05-20T17:57:21.507785+0000","last_clean":"2024-05-20T17:57:21.507785+0000","last_became_active":"2024-05-20T17:57:19.503655+0000","last_became_peered":"2024-05-20T17:57:19.503655+0000","last_unstale":"2024-05-20T17:57:21.507785+0000","last_undegraded":"2024-05-20T17:57:21.507785+0000","last_fullsized":"2024-05-20T17:57:21.507785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:39:34.342043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991679+0000","last_change":"2024-05-20T17:57:20.516256+0000","last_active":"2024-05-20T17:57:21.991679+0000","last_peered":"2024-05-20T17:57:21.991679+0000","last_clean":"2024-05-20T17:57:21.991679+0000","last_became_active":"2024-05-20T17:57:20.515904+0000","last_became_peered":"2024-05-20T17:57:20.515904+0000","last_unstale":"2024-05-20T17:57:21.991679+0000","last_undegraded":"2024-05-20T17:57:21.991679+0000","last_fullsized":"2024-05-20T17:57:21.991679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:12.453203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"87'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.508603+0000","last_change":"2024-05-20T17:57:19.498591+0000","last_active":"2024-05-20T17:57:21.508603+0000","last_peered":"2024-05-20T17:57:21.508603+0000","last_clean":"2024-05-20T17:57:21.508603+0000","last_became_active":"2024-05-20T17:57:19.498220+0000","last_became_peered":"2024-05-20T17:57:19.498220+0000","last_unstale":"2024-05-20T17:57:21.508603+0000","last_undegraded":"2024-05-20T17:57:21.508603+0000","last_fullsized":"2024-05-20T17:57:21.508603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:42:22.473822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990883+0000","last_change":"2024-05-20T17:57:20.516781+0000","last_active":"2024-05-20T17:57:21.990883+0000","last_peered":"2024-05-20T17:57:21.990883+0000","last_clean":"2024-05-20T17:57:21.990883+0000","last_became_active":"2024-05-20T17:57:20.515704+0000","last_became_peered":"2024-05-20T17:57:20.515704+0000","last_unstale":"2024-05-20T17:57:21.990883+0000","last_undegraded":"2024-05-20T17:57:21.990883+0000","last_fullsized":"2024-05-20T17:57:21.990883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:09:34.697097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.509761+0000","last_change":"2024-05-20T17:57:19.501313+0000","last_active":"2024-05-20T17:57:21.509761+0000","last_peered":"2024-05-20T17:57:21.509761+0000","last_clean":"2024-05-20T17:57:21.509761+0000","last_became_active":"2024-05-20T17:57:19.500592+0000","last_became_peered":"2024-05-20T17:57:19.500592+0000","last_unstale":"2024-05-20T17:57:21.509761+0000","last_undegraded":"2024-05-20T17:57:21.509761+0000","last_fullsized":"2024-05-20T17:57:21.509761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:25:49.614172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514732+0000","last_change":"2024-05-20T17:57:20.508514+0000","last_active":"2024-05-20T17:57:21.514732+0000","last_peered":"2024-05-20T17:57:21.514732+0000","last_clean":"2024-05-20T17:57:21.514732+0000","last_became_active":"2024-05-20T17:57:20.507928+0000","last_became_peered":"2024-05-20T17:57:20.507928+0000","last_unstale":"2024-05-20T17:57:21.514732+0000","last_undegraded":"2024-05-20T17:57:21.514732+0000","last_fullsized":"2024-05-20T17:57:21.514732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:40:05.914975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990337+0000","last_change":"2024-05-20T17:57:19.499777+0000","last_active":"2024-05-20T17:57:21.990337+0000","last_peered":"2024-05-20T17:57:21.990337+0000","last_clean":"2024-05-20T17:57:21.990337+0000","last_became_active":"2024-05-20T17:57:19.499390+0000","last_became_peered":"2024-05-20T17:57:19.499390+0000","last_unstale":"2024-05-20T17:57:21.990337+0000","last_undegraded":"2024-05-20T17:57:21.990337+0000","last_fullsized":"2024-05-20T17:57:21.990337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:43.144655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.989950+0000","last_change":"2024-05-20T17:57:20.521165+0000","last_active":"2024-05-20T17:57:21.989950+0000","last_peered":"2024-05-20T17:57:21.989950+0000","last_clean":"2024-05-20T17:57:21.989950+0000","last_became_active":"2024-05-20T17:57:20.520836+0000","last_became_peered":"2024-05-20T17:57:20.520836+0000","last_unstale":"2024-05-20T17:57:21.989950+0000","last_undegraded":"2024-05-20T17:57:21.989950+0000","last_fullsized":"2024-05-20T17:57:21.989950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:14:50.970801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991164+0000","last_change":"2024-05-20T17:57:19.503288+0000","last_active":"2024-05-20T17:57:21.991164+0000","last_peered":"2024-05-20T17:57:21.991164+0000","last_clean":"2024-05-20T17:57:21.991164+0000","last_became_active":"2024-05-20T17:57:19.502974+0000","last_became_peered":"2024-05-20T17:57:19.502974+0000","last_unstale":"2024-05-20T17:57:21.991164+0000","last_undegraded":"2024-05-20T17:57:21.991164+0000","last_fullsized":"2024-05-20T17:57:21.991164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:45:56.876242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507309+0000","last_change":"2024-05-20T17:57:20.512371+0000","last_active":"2024-05-20T17:57:21.507309+0000","last_peered":"2024-05-20T17:57:21.507309+0000","last_clean":"2024-05-20T17:57:21.507309+0000","last_became_active":"2024-05-20T17:57:20.511367+0000","last_became_peered":"2024-05-20T17:57:20.511367+0000","last_unstale":"2024-05-20T17:57:21.507309+0000","last_undegraded":"2024-05-20T17:57:21.507309+0000","last_fullsized":"2024-05-20T17:57:21.507309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:45:57.881547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.514359+0000","last_change":"2024-05-20T17:57:19.499207+0000","last_active":"2024-05-20T17:57:21.514359+0000","last_peered":"2024-05-20T17:57:21.514359+0000","last_clean":"2024-05-20T17:57:21.514359+0000","last_became_active":"2024-05-20T17:57:19.498832+0000","last_became_peered":"2024-05-20T17:57:19.498832+0000","last_unstale":"2024-05-20T17:57:21.514359+0000","last_undegraded":"2024-05-20T17:57:21.514359+0000","last_fullsized":"2024-05-20T17:57:21.514359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:02:08.148891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.989982+0000","last_change":"2024-05-20T17:57:20.523814+0000","last_active":"2024-05-20T17:57:21.989982+0000","last_peered":"2024-05-20T17:57:21.989982+0000","last_clean":"2024-05-20T17:57:21.989982+0000","last_became_active":"2024-05-20T17:57:20.523475+0000","last_became_peered":"2024-05-20T17:57:20.523475+0000","last_unstale":"2024-05-20T17:57:21.989982+0000","last_undegraded":"2024-05-20T17:57:21.989982+0000","last_fullsized":"2024-05-20T17:57:21.989982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:40:52.078803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.990123+0000","last_change":"2024-05-20T17:57:19.500207+0000","last_active":"2024-05-20T17:57:21.990123+0000","last_peered":"2024-05-20T17:57:21.990123+0000","last_clean":"2024-05-20T17:57:21.990123+0000","last_became_active":"2024-05-20T17:57:19.499909+0000","last_became_peered":"2024-05-20T17:57:19.499909+0000","last_unstale":"2024-05-20T17:57:21.990123+0000","last_undegraded":"2024-05-20T17:57:21.990123+0000","last_fullsized":"2024-05-20T17:57:21.990123+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:10:36.474775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.991795+0000","last_change":"2024-05-20T17:57:20.526490+0000","last_active":"2024-05-20T17:57:21.991795+0000","last_peered":"2024-05-20T17:57:21.991795+0000","last_clean":"2024-05-20T17:57:21.991795+0000","last_became_active":"2024-05-20T17:57:20.526130+0000","last_became_peered":"2024-05-20T17:57:20.526130+0000","last_unstale":"2024-05-20T17:57:21.991795+0000","last_undegraded":"2024-05-20T17:57:21.991795+0000","last_fullsized":"2024-05-20T17:57:21.991795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:06:36.427964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507601+0000","last_change":"2024-05-20T17:57:19.506295+0000","last_active":"2024-05-20T17:57:21.507601+0000","last_peered":"2024-05-20T17:57:21.507601+0000","last_clean":"2024-05-20T17:57:21.507601+0000","last_became_active":"2024-05-20T17:57:19.506033+0000","last_became_peered":"2024-05-20T17:57:19.506033+0000","last_unstale":"2024-05-20T17:57:21.507601+0000","last_undegraded":"2024-05-20T17:57:21.507601+0000","last_fullsized":"2024-05-20T17:57:21.507601+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:11:33.769801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507899+0000","last_change":"2024-05-20T17:57:20.524060+0000","last_active":"2024-05-20T17:57:21.507899+0000","last_peered":"2024-05-20T17:57:21.507899+0000","last_clean":"2024-05-20T17:57:21.507899+0000","last_became_active":"2024-05-20T17:57:20.523756+0000","last_became_peered":"2024-05-20T17:57:20.523756+0000","last_unstale":"2024-05-20T17:57:21.507899+0000","last_undegraded":"2024-05-20T17:57:21.507899+0000","last_fullsized":"2024-05-20T17:57:21.507899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:19.479607+0000","last_clean_scrub_stamp":"2024-05-20T17:57:19.479607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:12:31.366934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.992120+0000","last_change":"2024-05-20T17:57:19.501230+0000","last_active":"2024-05-20T17:57:21.992120+0000","last_peered":"2024-05-20T17:57:21.992120+0000","last_clean":"2024-05-20T17:57:21.992120+0000","last_became_active":"2024-05-20T17:57:19.499814+0000","last_became_peered":"2024-05-20T17:57:19.499814+0000","last_unstale":"2024-05-20T17:57:21.992120+0000","last_undegraded":"2024-05-20T17:57:21.992120+0000","last_fullsized":"2024-05-20T17:57:21.992120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:57:18.474302+0000","last_clean_scrub_stamp":"2024-05-20T17:57:18.474302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:48.588031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":292,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-20T17:57:21.507841+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T17:57:21.507841+0000","last_peered":"2024-05-20T17:57:21.507841+0000","last_clean":"2024-05-20T17:57:21.507841+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T17:57:21.507841+0000","last_undegraded":"2024-05-20T17:57:21.507841+0000","last_fullsized":"2024-05-20T17:57:21.507841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1675264,"data_stored":1082253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1093632,"data_stored":494045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":491829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":491989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":491829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":491829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":491899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1691648,"data_stored":1084515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T17:57:24.936 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T17:57:24.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T17:57:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.098+0000 7f0ffad45640 1 Processor -- start 2024-05-20T17:57:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.098+0000 7f0ffad45640 1 -- start start 2024-05-20T17:57:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ffad45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ff40d10e0 0x7f0ff40cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ffad45640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0ff40b7210 0x7f0ff40cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ffad45640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff40d1ac0 con 0x7f0ff40d14f0 2024-05-20T17:57:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ffad45640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff40d1da0 con 0x7f0ff40d10e0 2024-05-20T17:57:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ffad45640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff40d2080 con 0x7f0ff40b7210 2024-05-20T17:57:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ff8ae1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ff40d10e0 0x7f0ff40cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0febfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0ff40d14f0 0x7f0ff40cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35002/0 (socket says 172.21.15.6:35002) 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0febfff640 1 -- 172.21.15.6:0/1436574418 learned_addr learned my addr 172.21.15.6:0/1436574418 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ff92e2640 1 --2- 172.21.15.6:0/1436574418 >> v2:172.21.15.171:3300/0 conn(0x7f0ff40b7210 0x7f0ff40cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ff8ae1640 1 -- 172.21.15.6:0/1436574418 >> v2:172.21.15.171:3300/0 conn(0x7f0ff40b7210 msgr2=0x7f0ff40cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ff8ae1640 1 --2- 172.21.15.6:0/1436574418 >> v2:172.21.15.171:3300/0 conn(0x7f0ff40b7210 0x7f0ff40cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ff8ae1640 1 -- 172.21.15.6:0/1436574418 >> v1:172.21.15.6:6789/0 conn(0x7f0ff40d14f0 legacy=0x7f0ff40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ff8ae1640 1 -- 172.21.15.6:0/1436574418 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff40d2360 con 0x7f0ff40d10e0 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0feb7fe640 1 -- 172.21.15.6:0/1436574418 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872087403 0 0) 0x7f0ff40d1ac0 con 0x7f0ff40d14f0 2024-05-20T17:57:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.100+0000 7f0ff92e2640 1 --2- 172.21.15.6:0/1436574418 >> v2:172.21.15.171:3300/0 conn(0x7f0ff40b7210 0x7f0ff40cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.101+0000 7f0ff8ae1640 1 --2- 172.21.15.6:0/1436574418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff40cf140 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40b58a0 tx=0x7f0ff002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622a6e3e96af8681 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.101+0000 7f0feb7fe640 1 -- 172.21.15.6:0/1436574418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0037070 con 0x7f0ff40d10e0 2024-05-20T17:57:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.101+0000 7f0feb7fe640 1 -- 172.21.15.6:0/1436574418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff0032440 con 0x7f0ff40d10e0 2024-05-20T17:57:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.101+0000 7f0feb7fe640 1 -- 172.21.15.6:0/1436574418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0032810 con 0x7f0ff40d10e0 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.102+0000 7f0ffad45640 1 -- 172.21.15.6:0/1436574418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 msgr2=0x7f0ff40cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.102+0000 7f0ffad45640 1 --2- 172.21.15.6:0/1436574418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff40cf140 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40b58a0 tx=0x7f0ff002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.102+0000 7f0ffad45640 1 -- 172.21.15.6:0/1436574418 shutdown_connections 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.102+0000 7f0ffad45640 1 --2- 172.21.15.6:0/1436574418 >> v2:172.21.15.171:3300/0 conn(0x7f0ff40b7210 0x7f0ff40cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.102+0000 7f0ffad45640 1 --2- 172.21.15.6:0/1436574418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff40cf140 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.102+0000 7f0ffad45640 1 -- 172.21.15.6:0/1436574418 >> 172.21.15.6:0/1436574418 conn(0x7f0ff40b44d0 msgr2=0x7f0ff40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.102+0000 7f0ffad45640 1 -- 172.21.15.6:0/1436574418 shutdown_connections 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.102+0000 7f0ffad45640 1 -- 172.21.15.6:0/1436574418 wait complete. 2024-05-20T17:57:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.104+0000 7f0ffad45640 1 Processor -- start 2024-05-20T17:57:25.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.104+0000 7f0ffad45640 1 -- start start 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0ffad45640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ff40b7210 0x7f0ff40c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0ffad45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff41f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0ffad45640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ff40d14f0 0x7f0ff41f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0ffad45640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40b8440 con 0x7f0ff40d10e0 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0ffad45640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff40b82c0 con 0x7f0ff40d14f0 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0ffad45640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff40709f0 con 0x7f0ff40b7210 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0febfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff41f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0febfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff41f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35958/0 (socket says 172.21.15.6:35958) 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.105+0000 7f0febfff640 1 -- 172.21.15.6:0/889013397 learned_addr learned my addr 172.21.15.6:0/889013397 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0ff92e2640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ff40d14f0 0x7f0ff41f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0ff8ae1640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ff40b7210 0x7f0ff40c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0febfff640 1 -- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ff40b7210 msgr2=0x7f0ff40c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0febfff640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ff40b7210 0x7f0ff40c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0febfff640 1 -- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ff40d14f0 msgr2=0x7f0ff41f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0febfff640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ff40d14f0 0x7f0ff41f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0febfff640 1 -- 172.21.15.6:0/889013397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff40c7f70 con 0x7f0ff40d10e0 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0ff92e2640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ff40d14f0 0x7f0ff41f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0ff8ae1640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ff40b7210 0x7f0ff40c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0febfff640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff41f66e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c460 tx=0x7f0fe400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0fe97fa640 1 -- 172.21.15.6:0/889013397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4018070 con 0x7f0ff40d10e0 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0fe97fa640 1 -- 172.21.15.6:0/889013397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe4007500 con 0x7f0ff40d10e0 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff40c8250 con 0x7f0ff40d10e0 2024-05-20T17:57:25.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0fe97fa640 1 -- 172.21.15.6:0/889013397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4004a20 con 0x7f0ff40d10e0 2024-05-20T17:57:25.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.106+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff40c8810 con 0x7f0ff40d10e0 2024-05-20T17:57:25.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.107+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff4075b00 con 0x7f0ff40d10e0 2024-05-20T17:57:25.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.108+0000 7f0fe97fa640 1 -- 172.21.15.6:0/889013397 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fe401b070 con 0x7f0ff40d10e0 2024-05-20T17:57:25.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.108+0000 7f0fe97fa640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe006be30 0x7f0fe006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.108+0000 7f0fe97fa640 1 -- 172.21.15.6:0/889013397 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f0fe408a2d0 con 0x7f0ff40d10e0 2024-05-20T17:57:25.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.108+0000 7f0ff8ae1640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe006be30 0x7f0fe006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.109+0000 7f0ff8ae1640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe006be30 0x7f0fe006e340 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0034000 tx=0x7f0ff002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:25.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.113+0000 7f0fe97fa640 1 -- 172.21.15.6:0/889013397 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0fe4058af0 con 0x7f0ff40d10e0 2024-05-20T17:57:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.367+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0ff40b19b0 con 0x7f0ff40d10e0 2024-05-20T17:57:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.370+0000 7f0fe97fa640 1 -- 172.21.15.6:0/889013397 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f0fe40583f0 con 0x7f0ff40d10e0 2024-05-20T17:57:25.368 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T17:57:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T17:57:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T17:57:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T17:57:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T17:57:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T17:57:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe006be30 msgr2=0x7f0fe006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe006be30 0x7f0fe006e340 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0034000 tx=0x7f0ff002e000 comp rx=0 tx=0).stop 2024-05-20T17:57:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 msgr2=0x7f0ff41f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff41f66e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c460 tx=0x7f0fe400c920 comp rx=0 tx=0).stop 2024-05-20T17:57:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 shutdown_connections 2024-05-20T17:57:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe006be30 0x7f0fe006e340 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ff40d14f0 0x7f0ff41f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ff40d10e0 0x7f0ff41f66e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 --2- 172.21.15.6:0/889013397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ff40b7210 0x7f0ff40c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 >> 172.21.15.6:0/889013397 conn(0x7f0ff40b44d0 msgr2=0x7f0ff40b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 shutdown_connections 2024-05-20T17:57:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.372+0000 7f0ffad45640 1 -- 172.21.15.6:0/889013397 wait complete. 2024-05-20T17:57:25.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:57:25.475 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-05-20T17:57:25.478+0000 7fcab8511640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T17:57:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.499+0000 7fd47783d640 1 Processor -- start 2024-05-20T17:57:25.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.499+0000 7fd47783d640 1 -- start start 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd47783d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4700cf3d0 0x7fd4700cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd47783d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd4700ce7e0 0x7fd4700cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd47783d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4700cfd20 con 0x7fd47015f220 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd47783d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd4700cf130 con 0x7fd4700cf3d0 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd47783d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd4700cda20 con 0x7fd4700ce7e0 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd474dd8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4700cf3d0 0x7fd4700cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd4755d9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd47015f220 0x7fd4700d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35008/0 (socket says 172.21.15.6:35008) 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd4755d9640 1 -- 172.21.15.6:0/396151883 learned_addr learned my addr 172.21.15.6:0/396151883 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd475dda640 1 --2- 172.21.15.6:0/396151883 >> v2:172.21.15.171:3300/0 conn(0x7fd4700ce7e0 0x7fd4700cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd474dd8640 1 -- 172.21.15.6:0/396151883 >> v2:172.21.15.171:3300/0 conn(0x7fd4700ce7e0 msgr2=0x7fd4700cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:25.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd474dd8640 1 --2- 172.21.15.6:0/396151883 >> v2:172.21.15.171:3300/0 conn(0x7fd4700ce7e0 0x7fd4700cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd474dd8640 1 -- 172.21.15.6:0/396151883 >> v1:172.21.15.6:6789/0 conn(0x7fd47015f220 legacy=0x7fd4700d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.501+0000 7fd474dd8640 1 -- 172.21.15.6:0/396151883 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4700cdd00 con 0x7fd4700cf3d0 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.502+0000 7fd474dd8640 1 --2- 172.21.15.6:0/396151883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4700cf7e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd47006e3e0 tx=0x7fd46002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4d0a9564b1fc9c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.502+0000 7fd467fff640 1 -- 172.21.15.6:0/396151883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460037070 con 0x7fd4700cf3d0 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.502+0000 7fd467fff640 1 -- 172.21.15.6:0/396151883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd460032440 con 0x7fd4700cf3d0 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.502+0000 7fd467fff640 1 -- 172.21.15.6:0/396151883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46002ae60 con 0x7fd4700cf3d0 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.503+0000 7fd47783d640 1 -- 172.21.15.6:0/396151883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 msgr2=0x7fd4700cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.503+0000 7fd47783d640 1 --2- 172.21.15.6:0/396151883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4700cf7e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd47006e3e0 tx=0x7fd46002a110 comp rx=0 tx=0).stop 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.503+0000 7fd47783d640 1 -- 172.21.15.6:0/396151883 shutdown_connections 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.503+0000 7fd47783d640 1 --2- 172.21.15.6:0/396151883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4700cf7e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.503+0000 7fd47783d640 1 --2- 172.21.15.6:0/396151883 >> v2:172.21.15.171:3300/0 conn(0x7fd4700ce7e0 0x7fd4700cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.503+0000 7fd47783d640 1 -- 172.21.15.6:0/396151883 >> 172.21.15.6:0/396151883 conn(0x7fd4700b44d0 msgr2=0x7fd4700b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.503+0000 7fd47783d640 1 -- 172.21.15.6:0/396151883 shutdown_connections 2024-05-20T17:57:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.503+0000 7fd47783d640 1 -- 172.21.15.6:0/396151883 wait complete. 2024-05-20T17:57:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.505+0000 7fd47783d640 1 Processor -- start 2024-05-20T17:57:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.505+0000 7fd47783d640 1 -- start start 2024-05-20T17:57:25.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd47783d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4700ce7e0 0x7fd4700b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd47783d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4701620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd47783d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd47015f220 0x7fd4701f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd47783d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd4700d0fd0 con 0x7fd4700cf3d0 2024-05-20T17:57:25.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd47783d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd4700ce2c0 con 0x7fd4700ce7e0 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd47783d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4700cd680 con 0x7fd47015f220 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd474dd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4701620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd474dd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4701620f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35974/0 (socket says 172.21.15.6:35974) 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.506+0000 7fd474dd8640 1 -- 172.21.15.6:0/2941010897 learned_addr learned my addr 172.21.15.6:0/2941010897 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd475dda640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd47015f220 0x7fd4701f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd4755d9640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4700ce7e0 0x7fd4700b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd474dd8640 1 -- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd47015f220 msgr2=0x7fd4701f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd474dd8640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd47015f220 0x7fd4701f9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd474dd8640 1 -- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4700ce7e0 msgr2=0x7fd4700b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd474dd8640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4700ce7e0 0x7fd4700b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd474dd8640 1 -- 172.21.15.6:0/2941010897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4700caa10 con 0x7fd4700cf3d0 2024-05-20T17:57:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd475dda640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd47015f220 0x7fd4701f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd474dd8640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4701620f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd460009890 tx=0x7fd4600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd465ffb640 1 -- 172.21.15.6:0/2941010897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460037040 con 0x7fd4700cf3d0 2024-05-20T17:57:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd465ffb640 1 -- 172.21.15.6:0/2941010897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd460042070 con 0x7fd4700cf3d0 2024-05-20T17:57:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4700cacf0 con 0x7fd4700cf3d0 2024-05-20T17:57:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd465ffb640 1 -- 172.21.15.6:0/2941010897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd460030bd0 con 0x7fd4700cf3d0 2024-05-20T17:57:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.507+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4700b8460 con 0x7fd4700cf3d0 2024-05-20T17:57:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.508+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd470075b00 con 0x7fd4700cf3d0 2024-05-20T17:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.509+0000 7fd465ffb640 1 -- 172.21.15.6:0/2941010897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd460047460 con 0x7fd4700cf3d0 2024-05-20T17:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.510+0000 7fd465ffb640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd45406be60 0x7fd45406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.510+0000 7fd465ffb640 1 -- 172.21.15.6:0/2941010897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fd4600abb00 con 0x7fd4700cf3d0 2024-05-20T17:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.510+0000 7fd4755d9640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd45406be60 0x7fd45406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.511+0000 7fd4755d9640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd45406be60 0x7fd45406e370 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000f60 tx=0x7fd46c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:25.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.515+0000 7fd465ffb640 1 -- 172.21.15.6:0/2941010897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd46004c020 con 0x7fd4700cf3d0 2024-05-20T17:57:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.736+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4701525e0 con 0x7fd4700cf3d0 2024-05-20T17:57:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.737+0000 7fd465ffb640 1 -- 172.21.15.6:0/2941010897 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5183 (secure 0 0 0) 0x7fd460032e20 con 0x7fd4700cf3d0 2024-05-20T17:57:25.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:25.735 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/4216834090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":4216834090},{"type":"v1","addr":"172.21.15.171:6836","nonce":4216834090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1870629940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1870629940},{"type":"v1","addr":"172.21.15.171:6837","nonce":1870629940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3012084004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3012084004},{"type":"v1","addr":"172.21.15.6:6833","nonce":3012084004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:57:19.873838+0000","modified":"2024-05-20T17:57:22.890340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7074":{"gid":7074,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3379618192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3379618192},{"type":"v1","addr":"172.21.15.6:6835","nonce":3379618192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7074,"qdb_cluster":[7074]},"id":6}]} 2024-05-20T17:57:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2024-05-20T17:57:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd45406be60 msgr2=0x7fd45406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd45406be60 0x7fd45406e370 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000f60 tx=0x7fd46c009040 comp rx=0 tx=0).stop 2024-05-20T17:57:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 msgr2=0x7fd4701620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4701620f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd460009890 tx=0x7fd4600046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 shutdown_connections 2024-05-20T17:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd45406be60 0x7fd45406e370 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd47015f220 0x7fd4701f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4700cf3d0 0x7fd4701620f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 --2- 172.21.15.6:0/2941010897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4700ce7e0 0x7fd4700b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 >> 172.21.15.6:0/2941010897 conn(0x7fd4700b44d0 msgr2=0x7fd4700d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 shutdown_connections 2024-05-20T17:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:25.739+0000 7fd47783d640 1 -- 172.21.15.6:0/2941010897 wait complete. 2024-05-20T17:57:26.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T17:57:19.873838+0000', 'modified': '2024-05-20T17:57:22.890340+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7074}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7074': {'gid': 7074, 'name': 'c', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/3379618192', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 3379618192}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 3379618192}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7074, 'qdb_cluster': [7074]} 2024-05-20T17:57:26.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T17:57:26.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-20T17:57:26.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.275+0000 7f8cb9faa640 1 Processor -- start 2024-05-20T17:57:26.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.275+0000 7f8cb9faa640 1 -- start start 2024-05-20T17:57:26.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb9faa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8cb4162820 0x7f8cb40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb9faa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb40d0630 con 0x7f8cb40b3e80 2024-05-20T17:57:26.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb9faa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb40d39c0 con 0x7f8cb406dae0 2024-05-20T17:57:26.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb9faa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb40d3ca0 con 0x7f8cb4162820 2024-05-20T17:57:26.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8cb4162820 0x7f8cb40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8cb40b3e80 0x7f8cb406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35018/0 (socket says 172.21.15.6:35018) 2024-05-20T17:57:26.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1551016999 learned_addr learned my addr 172.21.15.6:0/1551016999 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:26.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb37fe640 1 -- 172.21.15.6:0/1551016999 >> v1:172.21.15.171:6789/0 conn(0x7f8cb406dae0 legacy=0x7f8cb40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb37fe640 1 -- 172.21.15.6:0/1551016999 >> v1:172.21.15.6:6789/0 conn(0x7f8cb40b3e80 legacy=0x7f8cb406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.277+0000 7f8cb37fe640 1 -- 172.21.15.6:0/1551016999 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb40d3f80 con 0x7f8cb4162820 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.278+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/1551016999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb40b3940 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40097a0 tx=0x7f8ca402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1b177710da635c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.278+0000 7f8cb27fc640 1 -- 172.21.15.6:0/1551016999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4037070 con 0x7f8cb4162820 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.278+0000 7f8cb27fc640 1 -- 172.21.15.6:0/1551016999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca4032440 con 0x7f8cb4162820 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.278+0000 7f8cb27fc640 1 -- 172.21.15.6:0/1551016999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4032810 con 0x7f8cb4162820 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.279+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1551016999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 msgr2=0x7f8cb40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.279+0000 7f8cb9faa640 1 --2- 172.21.15.6:0/1551016999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb40b3940 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40097a0 tx=0x7f8ca402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.279+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1551016999 shutdown_connections 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.279+0000 7f8cb9faa640 1 --2- 172.21.15.6:0/1551016999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb40b3940 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.279+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1551016999 >> 172.21.15.6:0/1551016999 conn(0x7f8cb40d4bd0 msgr2=0x7f8cb40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.279+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1551016999 shutdown_connections 2024-05-20T17:57:26.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.279+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1551016999 wait complete. 2024-05-20T17:57:26.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.281+0000 7f8cb9faa640 1 Processor -- start 2024-05-20T17:57:26.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.281+0000 7f8cb9faa640 1 -- start start 2024-05-20T17:57:26.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.282+0000 7f8cb9faa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cb40b3e80 0x7f8cb41531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.282+0000 7f8cb9faa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.282+0000 7f8cb9faa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8cb40c90f0 0x7f8cb40b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.282+0000 7f8cb9faa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb40d4780 con 0x7f8cb4162820 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.282+0000 7f8cb9faa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb40d0300 con 0x7f8cb40b3e80 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.282+0000 7f8cb9faa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb40d4900 con 0x7f8cb40c90f0 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.282+0000 7f8cb2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb415b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35988/0 (socket says 172.21.15.6:35988) 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1510358134 learned_addr learned my addr 172.21.15.6:0/1510358134 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cb40b3e80 0x7f8cb41531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb3fff640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8cb40c90f0 0x7f8cb40b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8cb40c90f0 msgr2=0x7f8cb40b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8cb40c90f0 0x7f8cb40b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cb40b3e80 msgr2=0x7f8cb41531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cb40b3e80 0x7f8cb41531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1510358134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb415a6e0 con 0x7f8cb4162820 2024-05-20T17:57:26.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb415b780 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c3f0 tx=0x7f8ca800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8c9bfff640 1 -- 172.21.15.6:0/1510358134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8017070 con 0x7f8cb4162820 2024-05-20T17:57:26.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8c9bfff640 1 -- 172.21.15.6:0/1510358134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca8005ce0 con 0x7f8cb4162820 2024-05-20T17:57:26.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1510358134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb415a9c0 con 0x7f8cb4162820 2024-05-20T17:57:26.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8c9bfff640 1 -- 172.21.15.6:0/1510358134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80072f0 con 0x7f8cb4162820 2024-05-20T17:57:26.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.283+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1510358134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb415af80 con 0x7f8cb4162820 2024-05-20T17:57:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.285+0000 7f8c9bfff640 1 -- 172.21.15.6:0/1510358134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ca801a070 con 0x7f8cb4162820 2024-05-20T17:57:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.285+0000 7f8c9bfff640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ca006be60 0x7f8ca006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.285+0000 7f8c9bfff640 1 -- 172.21.15.6:0/1510358134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f8ca808a3d0 con 0x7f8cb4162820 2024-05-20T17:57:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.286+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ca006be60 0x7f8ca006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.286+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ca006be60 0x7f8ca006e370 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4034000 tx=0x7f8ca402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.286+0000 7f8cc0e4c740 1 Processor -- start 2024-05-20T17:57:26.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.287+0000 7f8cc0e4c740 1 -- start start 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f6450700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f644d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f6426360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5580f63894d0 con 0x5580f605c3b0 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5580f63313e0 con 0x5580f6064590 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5580f6385490 con 0x5580f6085270 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f644d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f644d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35996/0 (socket says 172.21.15.6:35996) 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/2941088307 learned_addr learned my addr 172.21.15.6:0/2941088307 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:26.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f6450700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb3fff640 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f6426360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/2941088307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 msgr2=0x5580f6450700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f6450700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/2941088307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 msgr2=0x5580f6426360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f6426360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.288+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/2941088307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580f609d2d0 con 0x5580f605c3b0 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.289+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f644d0a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8060b00 tx=0x7f8ca80585b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e15f14facd57ab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.289+0000 7f8c997fa640 1 -- 172.21.15.6:0/2941088307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8056770 con 0x5580f605c3b0 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.289+0000 7f8c997fa640 1 -- 172.21.15.6:0/2941088307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca808a070 con 0x5580f605c3b0 2024-05-20T17:57:26.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.289+0000 7f8c997fa640 1 -- 172.21.15.6:0/2941088307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8007490 con 0x5580f605c3b0 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2941088307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 msgr2=0x5580f644d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f644d0a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8060b00 tx=0x7f8ca80585b0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2941088307 shutdown_connections 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f6426360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f644d0a0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2941088307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f6450700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2941088307 >> 172.21.15.6:0/2941088307 conn(0x5580f60793c0 msgr2=0x5580f6425af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2941088307 shutdown_connections 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.290+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2941088307 wait complete. 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.291+0000 7f8cc0e4c740 1 -- start start 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.291+0000 7f8cc0e4c740 1 Processor -- start 2024-05-20T17:57:26.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6469e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6064590 0x5580f6479c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f64622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5580f63448e0 con 0x5580f6064590 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5580f643cce0 con 0x5580f605c3b0 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5580f646a7c0 con 0x5580f6085270 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cc0e4c740 10 client.0 _ll_register_callbacks cb 0x5580f63119c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6064590 0x5580f6479c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6064590 0x5580f6479c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36004/0 (socket says 172.21.15.6:36004) 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1605278241 learned_addr learned my addr 172.21.15.6:0/1605278241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6469e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb3fff640 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f64622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 msgr2=0x5580f64622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f64622b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 msgr2=0x5580f6469e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6469e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb2ffd640 1 -- 172.21.15.6:0/1605278241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580f61676b0 con 0x5580f6064590 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.292+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6469e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6064590 0x5580f6479c20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000f30 tx=0x7f8ca8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2f56c48b1767e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8c927fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8c927fc640 1 -- 172.21.15.6:0/1605278241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8075020 con 0x5580f6064590 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8c927fc640 1 -- 172.21.15.6:0/1605278241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f8ca80882a0 con 0x5580f6064590 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/1605278241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca808a070 con 0x5580f6064590 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8c927fc640 1 -- 172.21.15.6:0/1605278241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8ca8085030 con 0x5580f6064590 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 10 client.7227 fetch_fsmap learned FSMap version 52 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/1605278241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5580f646a340 con 0x5580f6064590 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8c927fc640 1 -- 172.21.15.6:0/1605278241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca808a070 con 0x5580f6064590 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8c927fc640 1 -- 172.21.15.6:0/1605278241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f8ca80772a0 con 0x5580f6064590 2024-05-20T17:57:26.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 10 client.7227 fetch_fsmap finished waiting for FSMap version 52 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 10 client.7227 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 20 client.7227 populate_metadata read hostname 'smithi006' 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] conn(0x5580f6043e40 0x5580f643da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 4 client.7227 mds_command: new command op to 7074 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/1605278241 --> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580f6396c00 con 0x5580f6043e40 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.293+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] conn(0x5580f6043e40 0x5580f643da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.294+0000 7f8c927fc640 10 client.7227 ms_handle_connect on v2:172.21.15.6:6834/3379618192 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.294+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] conn(0x5580f6043e40 0x5580f643da60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c4208671563d378 server_cookie=3e3b508fd75fbcc2 in_seq=0 out_seq=0 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.294+0000 7f8c927fc640 1 -- 172.21.15.6:0/1605278241 <== mds.0 v2:172.21.15.6:6834/3379618192 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5580f6396c00 con 0x5580f6043e40 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.294+0000 7f8c927fc640 10 client.7227 handle_command_reply: tid=0 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 client.7227 shutdown 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/1605278241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6064590 msgr2=0x5580f6479c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6064590 0x5580f6479c20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000f30 tx=0x7f8ca8000bc0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/1605278241 shutdown_connections 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] conn(0x5580f6043e40 0x5580f643da60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f64622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6064590 0x5580f6479c20 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/1605278241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6469e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8c927fc640 0 client.7227 ms_handle_reset on v2:172.21.15.6:6834/3379618192 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/1605278241 >> 172.21.15.6:0/1605278241 conn(0x5580f60793c0 msgr2=0x5580f6425af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/1605278241 shutdown_connections 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/1605278241 wait complete. 2024-05-20T17:57:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.295+0000 7f8cc0e4c740 20 client.7227 trim_cache size 0 max 16384 2024-05-20T17:57:26.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.314+0000 7f8cc0e4c740 1 Processor -- start 2024-05-20T17:57:26.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.314+0000 7f8cc0e4c740 1 -- start start 2024-05-20T17:57:26.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.315+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6450700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.315+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6064590 0x5580f648f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.315+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6085270 0x5580f643ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.315+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4201480 con 0x5580f6085270 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.315+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb40ca650 con 0x5580f605c3b0 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.315+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb4200e60 con 0x5580f6064590 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6085270 0x5580f643ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6085270 0x5580f643ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36016/0 (socket says 172.21.15.6:36016) 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 -- 172.21.15.6:0/4278368449 learned_addr learned my addr 172.21.15.6:0/4278368449 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6450700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6064590 0x5580f648f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 -- 172.21.15.6:0/4278368449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6064590 msgr2=0x5580f648f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6064590 0x5580f648f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 -- 172.21.15.6:0/4278368449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 msgr2=0x5580f6450700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6450700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 -- 172.21.15.6:0/4278368449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580f64212b0 con 0x5580f6085270 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8cb3fff640 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6085270 0x5580f643ce70 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00a530 tx=0x7f8cac009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97864f8a87894481 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8c98ff9640 1 -- 172.21.15.6:0/4278368449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac01b070 con 0x5580f6085270 2024-05-20T17:57:26.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8c98ff9640 1 -- 172.21.15.6:0/4278368449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac017840 con 0x5580f6085270 2024-05-20T17:57:26.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.316+0000 7f8c98ff9640 1 -- 172.21.15.6:0/4278368449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac017c30 con 0x5580f6085270 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/4278368449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6085270 msgr2=0x5580f643ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6085270 0x5580f643ce70 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00a530 tx=0x7f8cac009650 comp rx=0 tx=0).stop 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/4278368449 shutdown_connections 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f6085270 0x5580f643ce70 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6064590 0x5580f648f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/4278368449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f605c3b0 0x5580f6450700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/4278368449 >> 172.21.15.6:0/4278368449 conn(0x5580f60793c0 msgr2=0x5580f6453dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/4278368449 shutdown_connections 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.317+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/4278368449 wait complete. 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.318+0000 7f8cc0e4c740 1 -- start start 2024-05-20T17:57:26.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.318+0000 7f8cc0e4c740 1 Processor -- start 2024-05-20T17:57:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f643ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f643d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cc0e4c740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f643bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5580f647a200 con 0x5580f605c3b0 2024-05-20T17:57:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5580f63448e0 con 0x5580f6064590 2024-05-20T17:57:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cc0e4c740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5580f647e0e0 con 0x5580f6085270 2024-05-20T17:57:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cc0e4c740 10 client.0 _ll_register_callbacks cb 0x7f8cac0099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T17:57:26.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f643ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f643ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36028/0 (socket says 172.21.15.6:36028) 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 -- 172.21.15.6:0/2236882867 learned_addr learned my addr 172.21.15.6:0/2236882867 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb3fff640 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f643bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f643d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 -- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 msgr2=0x5580f643bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f643bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 -- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 msgr2=0x5580f643d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f643d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 -- 172.21.15.6:0/2236882867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580f646f270 con 0x5580f605c3b0 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f643d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cb37fe640 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f643ce70 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009560 tx=0x7f8ca4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adff1d37d7bd0ea server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8c927fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8c927fc640 1 -- 172.21.15.6:0/2236882867 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4037040 con 0x5580f605c3b0 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8c927fc640 1 -- 172.21.15.6:0/2236882867 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f8ca4055c50 con 0x5580f605c3b0 2024-05-20T17:57:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.320+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2236882867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cac017840 con 0x5580f605c3b0 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8c927fc640 1 -- 172.21.15.6:0/2236882867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8ca4055e50 con 0x5580f605c3b0 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cc0e4c740 10 client.7233 fetch_fsmap learned FSMap version 52 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2236882867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5580f646c700 con 0x5580f605c3b0 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8c927fc640 1 -- 172.21.15.6:0/2236882867 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac017840 con 0x5580f605c3b0 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8c927fc640 1 -- 172.21.15.6:0/2236882867 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 52) ==== 3494+0+0 (secure 0 0 0) 0x7f8ca403c5c0 con 0x5580f605c3b0 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cc0e4c740 10 client.7233 fetch_fsmap finished waiting for FSMap version 52 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cc0e4c740 10 client.7233 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cc0e4c740 20 client.7233 populate_metadata read hostname 'smithi006' 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] conn(0x5580f6460b90 0x5580f6460fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cc0e4c740 4 client.7233 mds_command: new command op to 7074 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2236882867 --> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] -- command(tid 0: {"prefix": "status"}) -- 0x5580f6421060 con 0x5580f6460b90 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] conn(0x5580f6460b90 0x5580f6460fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8c927fc640 10 client.7233 ms_handle_connect on v2:172.21.15.6:6834/3379618192 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.321+0000 7f8cb2ffd640 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] conn(0x5580f6460b90 0x5580f6460fa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25021870c51d4b47 server_cookie=d19f3f55957476b9 in_seq=0 out_seq=0 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8c927fc640 1 -- 172.21.15.6:0/2236882867 <== mds.0 v2:172.21.15.6:6834/3379618192 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5580f6421060 con 0x5580f6460b90 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8c927fc640 10 client.7233 handle_command_reply: tid=0 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 client.7233 shutdown 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2236882867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 msgr2=0x5580f643ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f643ce70 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009560 tx=0x7f8ca4004730 comp rx=0 tx=0).stop 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2236882867 shutdown_connections 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.6:6834/3379618192,v1:172.21.15.6:6835/3379618192] conn(0x5580f6460b90 0x5580f6460fa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5580f6085270 0x5580f643bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5580f6064590 0x5580f643d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8c927fc640 0 client.7233 ms_handle_reset on v2:172.21.15.6:6834/3379618192 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 --2- 172.21.15.6:0/2236882867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580f605c3b0 0x5580f643ce70 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2236882867 >> 172.21.15.6:0/2236882867 conn(0x5580f60793c0 msgr2=0x5580f6453dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2236882867 shutdown_connections 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 1 -- 172.21.15.6:0/2236882867 wait complete. 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cc0e4c740 20 client.7233 trim_cache size 0 max 16384 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7074, 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T17:57:26.325 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T17:57:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.8207328379999996, 2024-05-20T17:57:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 52, 2024-05-20T17:57:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 87, 2024-05-20T17:57:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 87, 2024-05-20T17:57:26.326 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 11.767754021 2024-05-20T17:57:26.326 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.322+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ca006be60 msgr2=0x7f8ca006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ca006be60 0x7f8ca006e370 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4034000 tx=0x7f8ca402e000 comp rx=0 tx=0).stop 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1510358134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 msgr2=0x7f8cb415b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb415b780 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800c3f0 tx=0x7f8ca800c8b0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1510358134 shutdown_connections 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ca006be60 0x7f8ca006e370 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8cb40c90f0 0x7f8cb40b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cb4162820 0x7f8cb415b780 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 --2- 172.21.15.6:0/1510358134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8cb40b3e80 0x7f8cb41531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1510358134 >> 172.21.15.6:0/1510358134 conn(0x7f8cb40d4bd0 msgr2=0x7f8cb4160300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1510358134 shutdown_connections 2024-05-20T17:57:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.323+0000 7f8cb9faa640 1 -- 172.21.15.6:0/1510358134 wait complete. 2024-05-20T17:57:26.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:57:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.449+0000 7f3310037640 1 Processor -- start 2024-05-20T17:57:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.449+0000 7f3310037640 1 -- start start 2024-05-20T17:57:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.450+0000 7f3310037640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3308162820 0x7f33080b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.450+0000 7f3310037640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33080b3e80 0x7f330806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f3310037640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f330806dd20 con 0x7f330806d910 2024-05-20T17:57:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f3310037640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f33080d0630 con 0x7f3308162820 2024-05-20T17:57:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f3310037640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33080d39c0 con 0x7f33080b3e80 2024-05-20T17:57:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f330ddd3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3308162820 0x7f33080b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f330ddd3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3308162820 0x7f33080b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36032/0 (socket says 172.21.15.6:36032) 2024-05-20T17:57:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f330ddd3640 1 -- 172.21.15.6:0/4160412463 learned_addr learned my addr 172.21.15.6:0/4160412463 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f330d5d2640 1 --2- 172.21.15.6:0/4160412463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33080b3e80 0x7f330806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f330ddd3640 1 -- 172.21.15.6:0/4160412463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33080b3e80 msgr2=0x7f330806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f330ddd3640 1 --2- 172.21.15.6:0/4160412463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33080b3e80 0x7f330806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f330ddd3640 1 -- 172.21.15.6:0/4160412463 >> v1:172.21.15.171:6789/0 conn(0x7f330806d910 legacy=0x7f33080d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.451+0000 7f330ddd3640 1 -- 172.21.15.6:0/4160412463 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33080d3ca0 con 0x7f3308162820 2024-05-20T17:57:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.452+0000 7f330ddd3640 1 --2- 172.21.15.6:0/4160412463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3308162820 0x7f33080b3940 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009870 tx=0x7f32fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75edc6e3c383eb1e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.452+0000 7f330cdd1640 1 -- 172.21.15.6:0/4160412463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc037070 con 0x7f3308162820 2024-05-20T17:57:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.452+0000 7f330cdd1640 1 -- 172.21.15.6:0/4160412463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc032440 con 0x7f3308162820 2024-05-20T17:57:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.452+0000 7f330cdd1640 1 -- 172.21.15.6:0/4160412463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc032810 con 0x7f3308162820 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.453+0000 7f3310037640 1 -- 172.21.15.6:0/4160412463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3308162820 msgr2=0x7f33080b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.453+0000 7f3310037640 1 --2- 172.21.15.6:0/4160412463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3308162820 0x7f33080b3940 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009870 tx=0x7f32fc02a270 comp rx=0 tx=0).stop 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.453+0000 7f3310037640 1 -- 172.21.15.6:0/4160412463 shutdown_connections 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.453+0000 7f3310037640 1 --2- 172.21.15.6:0/4160412463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33080b3e80 0x7f330806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.453+0000 7f3310037640 1 --2- 172.21.15.6:0/4160412463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3308162820 0x7f33080b3940 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.453+0000 7f3310037640 1 -- 172.21.15.6:0/4160412463 >> 172.21.15.6:0/4160412463 conn(0x7f33080d4bd0 msgr2=0x7f33080d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.453+0000 7f3310037640 1 -- 172.21.15.6:0/4160412463 shutdown_connections 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.453+0000 7f3310037640 1 -- 172.21.15.6:0/4160412463 wait complete. 2024-05-20T17:57:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.455+0000 7f3310037640 1 Processor -- start 2024-05-20T17:57:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.455+0000 7f3310037640 1 -- start start 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f3310037640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f330806d910 0x7f330814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f3310037640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33080b3e80 0x7f330815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f3310037640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3308162820 0x7f330815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f3310037640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33080d0300 con 0x7f330806d910 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f3310037640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33080d4260 con 0x7f33080b3e80 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f3310037640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33080b91a0 con 0x7f3308162820 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330ddd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f330806d910 0x7f330814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330ddd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f330806d910 0x7f330814e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36048/0 (socket says 172.21.15.6:36048) 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330ddd3640 1 -- 172.21.15.6:0/3177549104 learned_addr learned my addr 172.21.15.6:0/3177549104 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330d5d2640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33080b3e80 0x7f330815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330e5d4640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3308162820 0x7f330815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330ddd3640 1 -- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3308162820 msgr2=0x7f330815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330ddd3640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3308162820 0x7f330815ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330ddd3640 1 -- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33080b3e80 msgr2=0x7f330815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330ddd3640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33080b3e80 0x7f330815e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330ddd3640 1 -- 172.21.15.6:0/3177549104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330815f2e0 con 0x7f330806d910 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.456+0000 7f330e5d4640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3308162820 0x7f330815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.457+0000 7f330ddd3640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f330806d910 0x7f330814e100 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f32fc000c00 tx=0x7f32fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.457+0000 7f32fa7fc640 1 -- 172.21.15.6:0/3177549104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc041020 con 0x7f330806d910 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.457+0000 7f32fa7fc640 1 -- 172.21.15.6:0/3177549104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc0306c0 con 0x7f330806d910 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.457+0000 7f32fa7fc640 1 -- 172.21.15.6:0/3177549104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc037040 con 0x7f330806d910 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.457+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33080c8700 con 0x7f330806d910 2024-05-20T17:57:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.457+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33080c8cc0 con 0x7f330806d910 2024-05-20T17:57:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.458+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3308075b00 con 0x7f330806d910 2024-05-20T17:57:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.459+0000 7f32fa7fc640 1 -- 172.21.15.6:0/3177549104 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32fc044020 con 0x7f330806d910 2024-05-20T17:57:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.459+0000 7f32fa7fc640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32ec06be60 0x7f32ec06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.459+0000 7f32fa7fc640 1 -- 172.21.15.6:0/3177549104 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f32fc0ab7b0 con 0x7f330806d910 2024-05-20T17:57:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.460+0000 7f330d5d2640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32ec06be60 0x7f32ec06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.460+0000 7f330d5d2640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32ec06be60 0x7f32ec06e370 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f330815c7b0 tx=0x7f3304008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:26.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.464+0000 7f32fa7fc640 1 -- 172.21.15.6:0/3177549104 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f32fc04b030 con 0x7f330806d910 2024-05-20T17:57:26.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.689+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f330806e110 con 0x7f330806d910 2024-05-20T17:57:26.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.689+0000 7f32fa7fc640 1 -- 172.21.15.6:0/3177549104 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7f32fc079f40 con 0x7f330806d910 2024-05-20T17:57:26.687 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:57:26.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32ec06be60 msgr2=0x7f32ec06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32ec06be60 0x7f32ec06e370 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f330815c7b0 tx=0x7f3304008040 comp rx=0 tx=0).stop 2024-05-20T17:57:26.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f330806d910 msgr2=0x7f330814e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:26.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f330806d910 0x7f330814e100 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f32fc000c00 tx=0x7f32fc0046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 shutdown_connections 2024-05-20T17:57:26.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32ec06be60 0x7f32ec06e370 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3308162820 0x7f330815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33080b3e80 0x7f330815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 --2- 172.21.15.6:0/3177549104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f330806d910 0x7f330814e100 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:26.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 >> 172.21.15.6:0/3177549104 conn(0x7f33080d4bd0 msgr2=0x7f33080d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:26.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 shutdown_connections 2024-05-20T17:57:26.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26.691+0000 7f3310037640 1 -- 172.21.15.6:0/3177549104 wait complete. 2024-05-20T17:57:26.700 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:57:26.700 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:57:26.700 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T17:57:26.700 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T17:57:26.701 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T17:57:26.701 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:57:26.701 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:57:26.701 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:57:26.701 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:57:26.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:26.701 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:26.718 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42467sec preferred_lft 42467sec 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:26.719 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:26.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:26.720 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:57:26.783 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T17:57:26.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:26.784 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T17:57:26.841 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T17:57:26.841 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:57:26.841 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T17:57:26.841 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T17:57:26.841 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:57:26.841 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:57:26.842 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T17:57:26.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T17:57:26.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T17:57:26.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T17:57:26.842 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T17:57:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:57:26.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:57:26.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:26.972 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T17:57:26.987 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T17:57:26.988 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T17:57:26.988 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:57:26.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:26.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T17:57:27.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:57:27.054 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T17:57:27.109 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T17:57:27.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:57:27.110 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:57:27.165 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T17:57:27.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:27.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:57:27.261 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:57:27.261 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:57:27.270 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:57:27.270 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:57:27.270 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:57:27.270 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:57:27.270 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:57:27.270 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T17:57:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:57:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:57:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:57:27.271 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:57:27.272 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:57:27.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:27.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T17:57:27.299 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:57:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:57:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:57:27.403 INFO:teuthology.orchestra.run.smithi006.stdout:client6113 2024-05-20T17:57:27.403 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:57:27.403 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:27.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T17:57:27.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.578+0000 7ff73ba92640 1 Processor -- start 2024-05-20T17:57:27.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.579+0000 7ff73ba92640 1 -- start start 2024-05-20T17:57:27.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.580+0000 7ff73ba92640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff734162820 0x7ff7340b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:27.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.580+0000 7ff73ba92640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff7340b3e80 0x7ff73406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:27.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.580+0000 7ff73ba92640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff73406dd20 con 0x7ff73406d910 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.580+0000 7ff73ba92640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff7340d0630 con 0x7ff734162820 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.580+0000 7ff73ba92640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff7340d39c0 con 0x7ff7340b3e80 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.580+0000 7ff73982e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff734162820 0x7ff7340b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.580+0000 7ff73a02f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff73406d910 0x7ff7340d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35026/0 (socket says 172.21.15.6:35026) 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.580+0000 7ff73a02f640 1 -- 172.21.15.6:0/448099420 learned_addr learned my addr 172.21.15.6:0/448099420 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.581+0000 7ff73982e640 1 -- 172.21.15.6:0/448099420 >> v2:172.21.15.171:3300/0 conn(0x7ff7340b3e80 msgr2=0x7ff73406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.581+0000 7ff73982e640 1 --2- 172.21.15.6:0/448099420 >> v2:172.21.15.171:3300/0 conn(0x7ff7340b3e80 0x7ff73406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.581+0000 7ff73982e640 1 -- 172.21.15.6:0/448099420 >> v1:172.21.15.6:6789/0 conn(0x7ff73406d910 legacy=0x7ff7340d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.581+0000 7ff73882c640 1 -- 172.21.15.6:0/448099420 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178434859 0 0) 0x7ff72c001490 con 0x7ff73406d910 2024-05-20T17:57:27.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.581+0000 7ff73982e640 1 -- 172.21.15.6:0/448099420 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7340d3ca0 con 0x7ff734162820 2024-05-20T17:57:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.581+0000 7ff73982e640 1 --2- 172.21.15.6:0/448099420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7340b3940 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff7340d1230 tx=0x7ff73002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8da3bb93ba84cfd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73882c640 1 -- 172.21.15.6:0/448099420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730037070 con 0x7ff734162820 2024-05-20T17:57:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73882c640 1 -- 172.21.15.6:0/448099420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff730032440 con 0x7ff734162820 2024-05-20T17:57:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73882c640 1 -- 172.21.15.6:0/448099420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730032810 con 0x7ff734162820 2024-05-20T17:57:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73ba92640 1 -- 172.21.15.6:0/448099420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 msgr2=0x7ff7340b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73ba92640 1 --2- 172.21.15.6:0/448099420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7340b3940 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff7340d1230 tx=0x7ff73002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73ba92640 1 -- 172.21.15.6:0/448099420 shutdown_connections 2024-05-20T17:57:27.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73ba92640 1 --2- 172.21.15.6:0/448099420 >> v2:172.21.15.171:3300/0 conn(0x7ff7340b3e80 0x7ff73406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73ba92640 1 --2- 172.21.15.6:0/448099420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7340b3940 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73ba92640 1 -- 172.21.15.6:0/448099420 >> 172.21.15.6:0/448099420 conn(0x7ff7340d4bd0 msgr2=0x7ff7340d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73ba92640 1 -- 172.21.15.6:0/448099420 shutdown_connections 2024-05-20T17:57:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.582+0000 7ff73ba92640 1 -- 172.21.15.6:0/448099420 wait complete. 2024-05-20T17:57:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.584+0000 7ff73ba92640 1 Processor -- start 2024-05-20T17:57:27.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.584+0000 7ff73ba92640 1 -- start start 2024-05-20T17:57:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.585+0000 7ff73ba92640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff73406d910 0x7ff7341f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.585+0000 7ff73ba92640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7340b3e80 0x7ff7340b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.585+0000 7ff73ba92640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7341e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:27.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73ba92640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff7340d0300 con 0x7ff734162820 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73ba92640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff7340d4260 con 0x7ff7340b3e80 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73ba92640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff7340b91a0 con 0x7ff73406d910 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7341e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7341e89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36068/0 (socket says 172.21.15.6:36068) 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 -- 172.21.15.6:0/1721505205 learned_addr learned my addr 172.21.15.6:0/1721505205 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73902d640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7340b3e80 0x7ff7340b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73982e640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff73406d910 0x7ff7341f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 -- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff73406d910 msgr2=0x7ff7341f82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff73406d910 0x7ff7341f82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 -- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7340b3e80 msgr2=0x7ff7340b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7340b3e80 0x7ff7340b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 -- 172.21.15.6:0/1721505205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7341451c0 con 0x7ff734162820 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73902d640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7340b3e80 0x7ff7340b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:27.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73a02f640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7341e89c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c700 tx=0x7ff72c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff72a7fc640 1 -- 172.21.15.6:0/1721505205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c018070 con 0x7ff734162820 2024-05-20T17:57:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff72a7fc640 1 -- 172.21.15.6:0/1721505205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72c004d60 con 0x7ff734162820 2024-05-20T17:57:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7341454a0 con 0x7ff734162820 2024-05-20T17:57:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff72a7fc640 1 -- 172.21.15.6:0/1721505205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00a820 con 0x7ff734162820 2024-05-20T17:57:27.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.586+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff734145a60 con 0x7ff734162820 2024-05-20T17:57:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.587+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff734075b00 con 0x7ff734162820 2024-05-20T17:57:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.588+0000 7ff72a7fc640 1 -- 172.21.15.6:0/1721505205 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff72c01b070 con 0x7ff734162820 2024-05-20T17:57:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.589+0000 7ff72a7fc640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff71806be60 0x7ff71806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.589+0000 7ff72a7fc640 1 -- 172.21.15.6:0/1721505205 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7ff72c08a530 con 0x7ff734162820 2024-05-20T17:57:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.589+0000 7ff73982e640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff71806be60 0x7ff71806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.589+0000 7ff73982e640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff71806be60 0x7ff71806e370 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff730034000 tx=0x7ff73002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.593+0000 7ff72a7fc640 1 -- 172.21.15.6:0/1721505205 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff73406dd20 con 0x7ff734162820 2024-05-20T17:57:27.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.815+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff73406d6f0 con 0x7ff734162820 2024-05-20T17:57:27.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.816+0000 7ff72a7fc640 1 -- 172.21.15.6:0/1721505205 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7ff72c058cc0 con 0x7ff734162820 2024-05-20T17:57:27.814 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T17:57:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff71806be60 msgr2=0x7ff71806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff71806be60 0x7ff71806e370 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff730034000 tx=0x7ff73002e000 comp rx=0 tx=0).stop 2024-05-20T17:57:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 msgr2=0x7ff7341e89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7341e89c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c700 tx=0x7ff72c00cbc0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 shutdown_connections 2024-05-20T17:57:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff71806be60 0x7ff71806e370 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff734162820 0x7ff7341e89c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7340b3e80 0x7ff7340b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 --2- 172.21.15.6:0/1721505205 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff73406d910 0x7ff7341f82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 >> 172.21.15.6:0/1721505205 conn(0x7ff7340d4bd0 msgr2=0x7ff7340ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 shutdown_connections 2024-05-20T17:57:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:27.818+0000 7ff73ba92640 1 -- 172.21.15.6:0/1721505205 wait complete. 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T17:57:27.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:57:27.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:27.828 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T17:57:27.847 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T17:57:27.847 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T17:57:27.847 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T17:57:27.847 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:27.847 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T17:57:27.847 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:27.847 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42477sec preferred_lft 42477sec 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:27.848 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T17:57:27.849 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T17:57:27.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:27.850 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T17:57:27.916 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T17:57:27.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:27.918 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T17:57:27.976 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T17:57:27.976 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T17:57:27.976 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T17:57:27.976 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T17:57:27.976 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T17:57:27.976 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T17:57:27.976 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T17:57:27.976 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T17:57:27.977 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T17:57:27.977 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T17:57:27.977 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T17:57:28.071 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:57:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T17:57:28.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:57:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:57:28.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:28.113 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T17:57:28.129 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T17:57:28.129 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T17:57:28.129 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:57:28.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:28.129 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T17:57:28.194 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:57:28.194 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T17:57:28.250 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T17:57:28.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T17:57:28.250 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:57:28.306 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T17:57:28.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:28.306 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:57:28.401 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:57:28.401 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:57:28.416 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T17:57:28.416 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T17:57:28.416 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T17:57:28.416 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T17:57:28.417 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T17:57:28.417 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T17:57:28.417 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T17:57:28.417 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T17:57:28.418 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T17:57:28.418 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T17:57:28.419 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T17:57:28.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:57:28.419 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T17:57:28.443 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:57:28.538 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:57:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:57:28.539 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T17:57:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:57:28.545 INFO:teuthology.orchestra.run.smithi171.stdout:client7251 2024-05-20T17:57:28.546 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:57:28.546 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:28.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-05-20T17:57:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.691+0000 7f74365b7640 1 Processor -- start 2024-05-20T17:57:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.691+0000 7f74365b7640 1 -- start start 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f74365b7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f743006d3d0 0x7f743006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f74365b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74300b8190 0x7f74300b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f74365b7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743006dd20 con 0x7f7430162820 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f74365b7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f74300d0630 con 0x7f743006d3d0 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f74365b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74300d39c0 con 0x7f74300b8190 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f742f7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f743006d3d0 0x7f743006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f7434b54640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74300b8190 0x7f74300b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f742ffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7430162820 0x7f74300b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:36274/0 (socket says 172.21.15.6:36274) 2024-05-20T17:57:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f742ffff640 1 -- 172.21.15.6:0/2319097954 learned_addr learned my addr 172.21.15.6:0/2319097954 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f742f7fe640 1 -- 172.21.15.6:0/2319097954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74300b8190 msgr2=0x7f74300b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f742f7fe640 1 --2- 172.21.15.6:0/2319097954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74300b8190 0x7f74300b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f742f7fe640 1 -- 172.21.15.6:0/2319097954 >> v1:172.21.15.171:6789/0 conn(0x7f7430162820 legacy=0x7f74300b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f742f7fe640 1 -- 172.21.15.6:0/2319097954 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74300d3ca0 con 0x7f743006d3d0 2024-05-20T17:57:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.693+0000 7f742effd640 1 -- 172.21.15.6:0/2319097954 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712503456 0 0) 0x7f7420001110 con 0x7f7430162820 2024-05-20T17:57:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.694+0000 7f7434b54640 1 --2- 172.21.15.6:0/2319097954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74300b8190 0x7f74300b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.694+0000 7f742f7fe640 1 --2- 172.21.15.6:0/2319097954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 0x7f743006d7e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f74240097a0 tx=0x7f742402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80dc0181d498f1a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.694+0000 7f742effd640 1 -- 172.21.15.6:0/2319097954 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424037070 con 0x7f743006d3d0 2024-05-20T17:57:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f742effd640 1 -- 172.21.15.6:0/2319097954 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7424032440 con 0x7f743006d3d0 2024-05-20T17:57:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f742effd640 1 -- 172.21.15.6:0/2319097954 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424032810 con 0x7f743006d3d0 2024-05-20T17:57:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f74365b7640 1 -- 172.21.15.6:0/2319097954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 msgr2=0x7f743006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f74365b7640 1 --2- 172.21.15.6:0/2319097954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 0x7f743006d7e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f74240097a0 tx=0x7f742402a180 comp rx=0 tx=0).stop 2024-05-20T17:57:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f74365b7640 1 -- 172.21.15.6:0/2319097954 shutdown_connections 2024-05-20T17:57:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f74365b7640 1 --2- 172.21.15.6:0/2319097954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74300b8190 0x7f74300b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f74365b7640 1 --2- 172.21.15.6:0/2319097954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 0x7f743006d7e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f74365b7640 1 -- 172.21.15.6:0/2319097954 >> 172.21.15.6:0/2319097954 conn(0x7f74300d4bd0 msgr2=0x7f74300d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f74365b7640 1 -- 172.21.15.6:0/2319097954 shutdown_connections 2024-05-20T17:57:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.695+0000 7f74365b7640 1 -- 172.21.15.6:0/2319097954 wait complete. 2024-05-20T17:57:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.697+0000 7f74365b7640 1 Processor -- start 2024-05-20T17:57:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.697+0000 7f74365b7640 1 -- start start 2024-05-20T17:57:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f74365b7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 0x7f743014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f74365b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74300b8190 0x7f743014c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f74365b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7430162820 0x7f743014c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f74365b7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74300d0300 con 0x7f74300b8190 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f74365b7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74300d4260 con 0x7f743006d3d0 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f74365b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74300b4050 con 0x7f7430162820 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74300b8190 0x7f743014c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74300b8190 0x7f743014c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55660/0 (socket says 172.21.15.6:55660) 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742f7fe640 1 -- 172.21.15.6:0/334014968 learned_addr learned my addr 172.21.15.6:0/334014968 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742ffff640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 0x7f743014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f7434b54640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7430162820 0x7f743014c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742f7fe640 1 -- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7430162820 msgr2=0x7f743014c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742f7fe640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7430162820 0x7f743014c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742f7fe640 1 -- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 msgr2=0x7f743014b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742f7fe640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 0x7f743014b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.699+0000 7f742f7fe640 1 -- 172.21.15.6:0/334014968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74300ca570 con 0x7f74300b8190 2024-05-20T17:57:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.700+0000 7f742f7fe640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74300b8190 0x7f743014c490 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7424035040 tx=0x7f74240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.700+0000 7f742cff9640 1 -- 172.21.15.6:0/334014968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424037050 con 0x7f74300b8190 2024-05-20T17:57:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.700+0000 7f742cff9640 1 -- 172.21.15.6:0/334014968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7424038040 con 0x7f74300b8190 2024-05-20T17:57:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.700+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74300ca290 con 0x7f74300b8190 2024-05-20T17:57:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.700+0000 7f742cff9640 1 -- 172.21.15.6:0/334014968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424004470 con 0x7f74300b8190 2024-05-20T17:57:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.700+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743014bc90 con 0x7f74300b8190 2024-05-20T17:57:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.701+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7430075b00 con 0x7f74300b8190 2024-05-20T17:57:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.702+0000 7f742cff9640 1 -- 172.21.15.6:0/334014968 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f742403c6d0 con 0x7f74300b8190 2024-05-20T17:57:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.702+0000 7f742cff9640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f741c06be60 0x7f741c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.702+0000 7f742cff9640 1 -- 172.21.15.6:0/334014968 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f74240ab700 con 0x7f74300b8190 2024-05-20T17:57:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.702+0000 7f742ffff640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f741c06be60 0x7f741c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.703+0000 7f742ffff640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f741c06be60 0x7f741c06e370 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7420007fd0 tx=0x7f7420007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.707+0000 7f742cff9640 1 -- 172.21.15.6:0/334014968 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7424079960 con 0x7f74300b8190 2024-05-20T17:57:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.889+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f7430161dd0 con 0x7f74300b8190 2024-05-20T17:57:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.893+0000 7f742cff9640 1 -- 172.21.15.6:0/334014968 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f742407dc60 con 0x7f74300b8190 2024-05-20T17:57:28.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f741c06be60 msgr2=0x7f741c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:28.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f741c06be60 0x7f741c06e370 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7420007fd0 tx=0x7f7420007de0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74300b8190 msgr2=0x7f743014c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:28.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74300b8190 0x7f743014c490 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7424035040 tx=0x7f74240046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 shutdown_connections 2024-05-20T17:57:28.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f741c06be60 0x7f741c06e370 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7430162820 0x7f743014c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74300b8190 0x7f743014c490 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 --2- 172.21.15.6:0/334014968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f743006d3d0 0x7f743014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:28.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 >> 172.21.15.6:0/334014968 conn(0x7f74300d4bd0 msgr2=0x7f743015da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:28.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 shutdown_connections 2024-05-20T17:57:28.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:28.895+0000 7f74365b7640 1 -- 172.21.15.6:0/334014968 wait complete. 2024-05-20T17:57:28.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 200 2024-05-20T17:57:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.025+0000 7fd2d174c640 1 Processor -- start 2024-05-20T17:57:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.025+0000 7fd2d174c640 1 -- start start 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.026+0000 7fd2d174c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2cc06d3d0 0x7fd2cc06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.026+0000 7fd2d174c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd2cc0b8190 0x7fd2cc0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.026+0000 7fd2d174c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2cc06dd20 con 0x7fd2cc162820 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2d174c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd2cc0d0630 con 0x7fd2cc06d3d0 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2d174c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd2cc0d39c0 con 0x7fd2cc0b8190 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2ca7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2cc06d3d0 0x7fd2cc06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2ca7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2cc06d3d0 0x7fd2cc06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55662/0 (socket says 172.21.15.6:55662) 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2ca7fc640 1 -- 172.21.15.6:0/1633680674 learned_addr learned my addr 172.21.15.6:0/1633680674 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2cb7fe640 1 --2- 172.21.15.6:0/1633680674 >> v2:172.21.15.171:3300/0 conn(0x7fd2cc0b8190 0x7fd2cc0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2ca7fc640 1 -- 172.21.15.6:0/1633680674 >> v2:172.21.15.171:3300/0 conn(0x7fd2cc0b8190 msgr2=0x7fd2cc0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2ca7fc640 1 --2- 172.21.15.6:0/1633680674 >> v2:172.21.15.171:3300/0 conn(0x7fd2cc0b8190 0x7fd2cc0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2ca7fc640 1 -- 172.21.15.6:0/1633680674 >> v1:172.21.15.171:6789/0 conn(0x7fd2cc162820 legacy=0x7fd2cc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.027+0000 7fd2ca7fc640 1 -- 172.21.15.6:0/1633680674 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc0d3ca0 con 0x7fd2cc06d3d0 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.028+0000 7fd2ca7fc640 1 --2- 172.21.15.6:0/1633680674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc06d3d0 0x7fd2cc06d7e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc08e070 tx=0x7fd2c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c82716addc0e59a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.028+0000 7fd2c9ffb640 1 -- 172.21.15.6:0/1633680674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0037070 con 0x7fd2cc06d3d0 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.028+0000 7fd2c9ffb640 1 -- 172.21.15.6:0/1633680674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0032440 con 0x7fd2cc06d3d0 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.028+0000 7fd2c9ffb640 1 -- 172.21.15.6:0/1633680674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0032810 con 0x7fd2cc06d3d0 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.029+0000 7fd2d174c640 1 -- 172.21.15.6:0/1633680674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc06d3d0 msgr2=0x7fd2cc06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.029+0000 7fd2d174c640 1 --2- 172.21.15.6:0/1633680674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc06d3d0 0x7fd2cc06d7e0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc08e070 tx=0x7fd2c002a270 comp rx=0 tx=0).stop 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.029+0000 7fd2d174c640 1 -- 172.21.15.6:0/1633680674 shutdown_connections 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.029+0000 7fd2d174c640 1 --2- 172.21.15.6:0/1633680674 >> v2:172.21.15.171:3300/0 conn(0x7fd2cc0b8190 0x7fd2cc0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.029+0000 7fd2d174c640 1 --2- 172.21.15.6:0/1633680674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc06d3d0 0x7fd2cc06d7e0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.029+0000 7fd2d174c640 1 -- 172.21.15.6:0/1633680674 >> 172.21.15.6:0/1633680674 conn(0x7fd2cc0d4bd0 msgr2=0x7fd2cc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.029+0000 7fd2d174c640 1 -- 172.21.15.6:0/1633680674 shutdown_connections 2024-05-20T17:57:29.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.029+0000 7fd2d174c640 1 -- 172.21.15.6:0/1633680674 wait complete. 2024-05-20T17:57:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.031+0000 7fd2d174c640 1 Processor -- start 2024-05-20T17:57:29.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.031+0000 7fd2d174c640 1 -- start start 2024-05-20T17:57:29.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2d174c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2cc06d3d0 0x7fd2cc14e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2d174c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc0b8190 0x7fd2cc0b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2d174c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2cc162820 0x7fd2cc14afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2d174c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0d0300 con 0x7fd2cc0b8190 2024-05-20T17:57:29.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2d174c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0d4260 con 0x7fd2cc06d3d0 2024-05-20T17:57:29.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2d174c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc0b4050 con 0x7fd2cc162820 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2ca7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc0b8190 0x7fd2cc0b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2ca7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc0b8190 0x7fd2cc0b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55674/0 (socket says 172.21.15.6:55674) 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2ca7fc640 1 -- 172.21.15.6:0/3811253214 learned_addr learned my addr 172.21.15.6:0/3811253214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2caffd640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2cc06d3d0 0x7fd2cc14e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.032+0000 7fd2cb7fe640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2cc162820 0x7fd2cc14afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2ca7fc640 1 -- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2cc162820 msgr2=0x7fd2cc14afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2ca7fc640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2cc162820 0x7fd2cc14afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2ca7fc640 1 -- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2cc06d3d0 msgr2=0x7fd2cc14e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2ca7fc640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2cc06d3d0 0x7fd2cc14e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2ca7fc640 1 -- 172.21.15.6:0/3811253214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc14b4f0 con 0x7fd2cc0b8190 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2caffd640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2cc06d3d0 0x7fd2cc14e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2ca7fc640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc0b8190 0x7fd2cc0b5d60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0000c00 tx=0x7fd2c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2b37fe640 1 -- 172.21.15.6:0/3811253214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0037040 con 0x7fd2cc0b8190 2024-05-20T17:57:29.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2b37fe640 1 -- 172.21.15.6:0/3811253214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0042070 con 0x7fd2cc0b8190 2024-05-20T17:57:29.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2b37fe640 1 -- 172.21.15.6:0/3811253214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0030880 con 0x7fd2cc0b8190 2024-05-20T17:57:29.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2cc0b6600 con 0x7fd2cc0b8190 2024-05-20T17:57:29.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.033+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2cc0b6bc0 con 0x7fd2cc0b8190 2024-05-20T17:57:29.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.034+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2cc075b00 con 0x7fd2cc0b8190 2024-05-20T17:57:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.035+0000 7fd2b37fe640 1 -- 172.21.15.6:0/3811253214 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2c0030a20 con 0x7fd2cc0b8190 2024-05-20T17:57:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.035+0000 7fd2b37fe640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2b806be30 0x7fd2b806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.035+0000 7fd2b37fe640 1 -- 172.21.15.6:0/3811253214 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fd2c00ab7d0 con 0x7fd2cc0b8190 2024-05-20T17:57:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.036+0000 7fd2caffd640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2b806be30 0x7fd2b806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.036+0000 7fd2caffd640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2b806be30 0x7fd2b806e340 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc001ad0 tx=0x7fd2bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.040+0000 7fd2b37fe640 1 -- 172.21.15.6:0/3811253214 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd2c0079910 con 0x7fd2cc0b8190 2024-05-20T17:57:29.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.225+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7fd2cc08dab0 con 0x7fd2cc0b8190 2024-05-20T17:57:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.228+0000 7fd2b37fe640 1 -- 172.21.15.6:0/3811253214 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7fd2c007dc10 con 0x7fd2cc0b8190 2024-05-20T17:57:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2b806be30 msgr2=0x7fd2b806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2b806be30 0x7fd2b806e340 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc001ad0 tx=0x7fd2bc009040 comp rx=0 tx=0).stop 2024-05-20T17:57:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc0b8190 msgr2=0x7fd2cc0b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc0b8190 0x7fd2cc0b5d60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0000c00 tx=0x7fd2c00046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 shutdown_connections 2024-05-20T17:57:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd2b806be30 0x7fd2b806e340 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2cc162820 0x7fd2cc14afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2cc0b8190 0x7fd2cc0b5d60 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 --2- 172.21.15.6:0/3811253214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2cc06d3d0 0x7fd2cc14e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 >> 172.21.15.6:0/3811253214 conn(0x7fd2cc0d4bd0 msgr2=0x7fd2cc15e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:29.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 shutdown_connections 2024-05-20T17:57:29.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.231+0000 7fd2d174c640 1 -- 172.21.15.6:0/3811253214 wait complete. 2024-05-20T17:57:29.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 400 2024-05-20T17:57:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.363+0000 7f3be35e3640 1 Processor -- start 2024-05-20T17:57:29.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.363+0000 7f3be35e3640 1 -- start start 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be35e3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3bdc163800 0x7f3bdc0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be35e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bdc0cf8d0 0x7f3bdc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be35e3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bdc0cfce0 con 0x7f3bdc06c630 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be35e3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc0b20a0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be35e3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc06caf0 con 0x7f3bdc163800 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be1b80640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bdc0cf8d0 0x7f3bdc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be137f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3bdc06c630 0x7f3bdc15f1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44920/0 (socket says 172.21.15.6:44920) 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be137f640 1 -- 172.21.15.6:0/3210133744 learned_addr learned my addr 172.21.15.6:0/3210133744 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be0b7e640 1 --2- 172.21.15.6:0/3210133744 >> v2:172.21.15.171:3300/0 conn(0x7f3bdc163800 0x7f3bdc0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be1b80640 1 -- 172.21.15.6:0/3210133744 >> v2:172.21.15.171:3300/0 conn(0x7f3bdc163800 msgr2=0x7f3bdc0cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be1b80640 1 --2- 172.21.15.6:0/3210133744 >> v2:172.21.15.171:3300/0 conn(0x7f3bdc163800 0x7f3bdc0cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be1b80640 1 -- 172.21.15.6:0/3210133744 >> v1:172.21.15.6:6789/0 conn(0x7f3bdc06c630 legacy=0x7f3bdc15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be1b80640 1 -- 172.21.15.6:0/3210133744 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc06cdd0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3bd3fff640 1 -- 172.21.15.6:0/3210133744 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882702582 0 0) 0x7f3bd8001110 con 0x7f3bdc06c630 2024-05-20T17:57:29.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.365+0000 7f3be0b7e640 1 --2- 172.21.15.6:0/3210133744 >> v2:172.21.15.171:3300/0 conn(0x7f3bdc163800 0x7f3bdc0cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.366+0000 7f3be1b80640 1 --2- 172.21.15.6:0/3210133744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0cd7c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc08bdc0 tx=0x7f3bd402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d19431976a52a06 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.366+0000 7f3bd3fff640 1 -- 172.21.15.6:0/3210133744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4007740 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.366+0000 7f3bd3fff640 1 -- 172.21.15.6:0/3210133744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd40078e0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.366+0000 7f3bd3fff640 1 -- 172.21.15.6:0/3210133744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4007cb0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.367+0000 7f3be35e3640 1 -- 172.21.15.6:0/3210133744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 msgr2=0x7f3bdc0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.367+0000 7f3be35e3640 1 --2- 172.21.15.6:0/3210133744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0cd7c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc08bdc0 tx=0x7f3bd402a680 comp rx=0 tx=0).stop 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.367+0000 7f3be35e3640 1 -- 172.21.15.6:0/3210133744 shutdown_connections 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.367+0000 7f3be35e3640 1 --2- 172.21.15.6:0/3210133744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0cd7c0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.367+0000 7f3be35e3640 1 --2- 172.21.15.6:0/3210133744 >> v2:172.21.15.171:3300/0 conn(0x7f3bdc163800 0x7f3bdc0cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.367+0000 7f3be35e3640 1 -- 172.21.15.6:0/3210133744 >> 172.21.15.6:0/3210133744 conn(0x7f3bdc0b4540 msgr2=0x7f3bdc0b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:29.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.367+0000 7f3be35e3640 1 -- 172.21.15.6:0/3210133744 shutdown_connections 2024-05-20T17:57:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.367+0000 7f3be35e3640 1 -- 172.21.15.6:0/3210133744 wait complete. 2024-05-20T17:57:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.369+0000 7f3be35e3640 1 Processor -- start 2024-05-20T17:57:29.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.369+0000 7f3be35e3640 1 -- start start 2024-05-20T17:57:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be35e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be35e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bdc163800 0x7f3bdc0c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be35e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bdc0b7af0 0x7f3bdc0b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be35e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc06d670 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be35e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc06d390 con 0x7f3bdc0b7af0 2024-05-20T17:57:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be35e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3bdc163c10 con 0x7f3bdc163800 2024-05-20T17:57:29.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be137f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be137f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55684/0 (socket says 172.21.15.6:55684) 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be137f640 1 -- 172.21.15.6:0/2938219538 learned_addr learned my addr 172.21.15.6:0/2938219538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.370+0000 7f3be1b80640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bdc0b7af0 0x7f3bdc0b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be0b7e640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bdc163800 0x7f3bdc0c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be137f640 1 -- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bdc163800 msgr2=0x7f3bdc0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be137f640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bdc163800 0x7f3bdc0c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be137f640 1 -- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bdc0b7af0 msgr2=0x7f3bdc0b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be137f640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bdc0b7af0 0x7f3bdc0b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be137f640 1 -- 172.21.15.6:0/2938219538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc0b8440 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be1b80640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bdc0b7af0 0x7f3bdc0b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be137f640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0caab0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800c430 tx=0x7f3bd800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3bd1ffb640 1 -- 172.21.15.6:0/2938219538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80074e0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3bd1ffb640 1 -- 172.21.15.6:0/2938219538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd80047e0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3bd1ffb640 1 -- 172.21.15.6:0/2938219538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8004bd0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bdc0cb450 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.371+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bdc0cba10 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.372+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bdc0690b0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.373+0000 7f3bd1ffb640 1 -- 172.21.15.6:0/2938219538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bd8011070 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.373+0000 7f3bd1ffb640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bc006be30 0x7f3bc006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.373+0000 7f3bd1ffb640 1 -- 172.21.15.6:0/2938219538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f3bd808ac60 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.373+0000 7f3be0b7e640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bc006be30 0x7f3bc006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.374+0000 7f3be0b7e640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bc006be30 0x7f3bc006e340 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0cd010 tx=0x7f3bcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.378+0000 7f3bd1ffb640 1 -- 172.21.15.6:0/2938219538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3bdc0b8440 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.560+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f3bdc0d0ba0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.564+0000 7f3bd1ffb640 1 -- 172.21.15.6:0/2938219538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v27)=0 v27) ==== 128+0+0 (secure 0 0 0) 0x7f3bdc0cfce0 con 0x7f3bdc0cf8d0 2024-05-20T17:57:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bc006be30 msgr2=0x7f3bc006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bc006be30 0x7f3bc006e340 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0cd010 tx=0x7f3bcc008040 comp rx=0 tx=0).stop 2024-05-20T17:57:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 msgr2=0x7f3bdc0caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0caab0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800c430 tx=0x7f3bd800c8f0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 shutdown_connections 2024-05-20T17:57:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3bc006be30 0x7f3bc006e340 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3bdc0b7af0 0x7f3bdc0b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3bdc163800 0x7f3bdc0c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 --2- 172.21.15.6:0/2938219538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bdc0cf8d0 0x7f3bdc0caab0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 >> 172.21.15.6:0/2938219538 conn(0x7f3bdc0b4540 msgr2=0x7f3bdc0b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 shutdown_connections 2024-05-20T17:57:29.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.566+0000 7f3be35e3640 1 -- 172.21.15.6:0/2938219538 wait complete. 2024-05-20T17:57:29.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 800 2024-05-20T17:57:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.696+0000 7fb7b12bc640 1 Processor -- start 2024-05-20T17:57:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.696+0000 7fb7b12bc640 1 -- start start 2024-05-20T17:57:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7b12bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 0x7fb7ac0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7b12bc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb7ac0b4010 0x7fb7ac0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7b12bc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7ac0d14b0 0x7fb7ac0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7b12bc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ac0d3ca0 con 0x7fb7ac0d14b0 2024-05-20T17:57:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7b12bc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ac0d0370 con 0x7fb7ac0b4010 2024-05-20T17:57:29.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7b12bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ac0d0650 con 0x7fb7ac163a10 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7ab7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7ac0d14b0 0x7fb7ac0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7ab7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7ac0d14b0 0x7fb7ac0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55690/0 (socket says 172.21.15.6:55690) 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7ab7fe640 1 -- 172.21.15.6:0/53977604 learned_addr learned my addr 172.21.15.6:0/53977604 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7aaffd640 1 --2- 172.21.15.6:0/53977604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 0x7fb7ac0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7aa7fc640 1 --2- 172.21.15.6:0/53977604 >> v2:172.21.15.171:3300/0 conn(0x7fb7ac0b4010 0x7fb7ac0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7ab7fe640 1 -- 172.21.15.6:0/53977604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 msgr2=0x7fb7ac0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7ab7fe640 1 --2- 172.21.15.6:0/53977604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 0x7fb7ac0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7ab7fe640 1 -- 172.21.15.6:0/53977604 >> v2:172.21.15.171:3300/0 conn(0x7fb7ac0b4010 msgr2=0x7fb7ac0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7ab7fe640 1 --2- 172.21.15.6:0/53977604 >> v2:172.21.15.171:3300/0 conn(0x7fb7ac0b4010 0x7fb7ac0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.697+0000 7fb7ab7fe640 1 -- 172.21.15.6:0/53977604 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac0d3650 con 0x7fb7ac0d14b0 2024-05-20T17:57:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.698+0000 7fb7ab7fe640 1 --2- 172.21.15.6:0/53977604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0d14b0 0x7fb7ac0d18c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0b7710 tx=0x7fb7a402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a844253e02c437b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.698+0000 7fb7a9ffb640 1 -- 172.21.15.6:0/53977604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4036070 con 0x7fb7ac0d14b0 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.698+0000 7fb7a9ffb640 1 -- 172.21.15.6:0/53977604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a4031600 con 0x7fb7ac0d14b0 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.698+0000 7fb7a9ffb640 1 -- 172.21.15.6:0/53977604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40319d0 con 0x7fb7ac0d14b0 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 -- 172.21.15.6:0/53977604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0d14b0 msgr2=0x7fb7ac0d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/53977604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0d14b0 0x7fb7ac0d18c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0b7710 tx=0x7fb7a402a6a0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 -- 172.21.15.6:0/53977604 shutdown_connections 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/53977604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0d14b0 0x7fb7ac0d18c0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/53977604 >> v2:172.21.15.171:3300/0 conn(0x7fb7ac0b4010 0x7fb7ac0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/53977604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 0x7fb7ac0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 -- 172.21.15.6:0/53977604 >> 172.21.15.6:0/53977604 conn(0x7fb7ac06d240 msgr2=0x7fb7ac06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 -- 172.21.15.6:0/53977604 shutdown_connections 2024-05-20T17:57:29.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.699+0000 7fb7b12bc640 1 -- 172.21.15.6:0/53977604 wait complete. 2024-05-20T17:57:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.701+0000 7fb7b12bc640 1 Processor -- start 2024-05-20T17:57:29.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.701+0000 7fb7b12bc640 1 -- start start 2024-05-20T17:57:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.702+0000 7fb7b12bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0b4010 0x7fb7ac143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.702+0000 7fb7b12bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ac0d14b0 0x7fb7ac143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.702+0000 7fb7b12bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 0x7fb7ac158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.702+0000 7fb7b12bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac0d1e00 con 0x7fb7ac0b4010 2024-05-20T17:57:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.702+0000 7fb7b12bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac0d0040 con 0x7fb7ac0d14b0 2024-05-20T17:57:29.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.702+0000 7fb7b12bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ac0b8210 con 0x7fb7ac163a10 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0b4010 0x7fb7ac143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0b4010 0x7fb7ac143900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55700/0 (socket says 172.21.15.6:55700) 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 -- 172.21.15.6:0/83465671 learned_addr learned my addr 172.21.15.6:0/83465671 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7ab7fe640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 0x7fb7ac158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aa7fc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ac0d14b0 0x7fb7ac143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 -- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 msgr2=0x7fb7ac158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 0x7fb7ac158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 -- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ac0d14b0 msgr2=0x7fb7ac143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ac0d14b0 0x7fb7ac143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 -- 172.21.15.6:0/83465671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac1ea390 con 0x7fb7ac0b4010 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7aaffd640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0b4010 0x7fb7ac143900 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00d600 tx=0x7fb79c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7937fe640 1 -- 172.21.15.6:0/83465671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c004240 con 0x7fb7ac0b4010 2024-05-20T17:57:29.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7937fe640 1 -- 172.21.15.6:0/83465671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c0043e0 con 0x7fb7ac0b4010 2024-05-20T17:57:29.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7937fe640 1 -- 172.21.15.6:0/83465671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c003830 con 0x7fb7ac0b4010 2024-05-20T17:57:29.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ac157e10 con 0x7fb7ac0b4010 2024-05-20T17:57:29.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.703+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ac1583d0 con 0x7fb7ac0b4010 2024-05-20T17:57:29.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.704+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ac06d860 con 0x7fb7ac0b4010 2024-05-20T17:57:29.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.705+0000 7fb7937fe640 1 -- 172.21.15.6:0/83465671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb79c0039d0 con 0x7fb7ac0b4010 2024-05-20T17:57:29.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.706+0000 7fb7937fe640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb79806be30 0x7fb79806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:29.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.706+0000 7fb7937fe640 1 -- 172.21.15.6:0/83465671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fb79c08b390 con 0x7fb7ac0b4010 2024-05-20T17:57:29.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.706+0000 7fb7aa7fc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb79806be30 0x7fb79806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:29.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.707+0000 7fb7aa7fc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb79806be30 0x7fb79806e340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0006fd0 tx=0x7fb7a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:29.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.711+0000 7fb7937fe640 1 -- 172.21.15.6:0/83465671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb7ac06d860 con 0x7fb7ac0b4010 2024-05-20T17:57:29.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.897+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7fb7ac075b00 con 0x7fb7ac0b4010 2024-05-20T17:57:29.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.900+0000 7fb7937fe640 1 -- 172.21.15.6:0/83465671 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v28)=0 v28) ==== 124+0+0 (secure 0 0 0) 0x7fb79c059b20 con 0x7fb7ac0b4010 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb79806be30 msgr2=0x7fb79806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb79806be30 0x7fb79806e340 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0006fd0 tx=0x7fb7a0008040 comp rx=0 tx=0).stop 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0b4010 msgr2=0x7fb7ac143900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0b4010 0x7fb7ac143900 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00d600 tx=0x7fb79c00dac0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 shutdown_connections 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb79806be30 0x7fb79806e340 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7ac163a10 0x7fb7ac158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7ac0d14b0 0x7fb7ac143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 --2- 172.21.15.6:0/83465671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7ac0b4010 0x7fb7ac143900 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 >> 172.21.15.6:0/83465671 conn(0x7fb7ac06d240 msgr2=0x7fb7ac160360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 shutdown_connections 2024-05-20T17:57:29.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:29.902+0000 7fb7b12bc640 1 -- 172.21.15.6:0/83465671 wait complete. 2024-05-20T17:57:29.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-05-20T17:57:30.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.030+0000 7f32112e2640 1 Processor -- start 2024-05-20T17:57:30.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.030+0000 7f32112e2640 1 -- start start 2024-05-20T17:57:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.031+0000 7f32112e2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f320c162820 0x7f320c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.031+0000 7f32112e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f320c06dae0 0x7f320c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.031+0000 7f32112e2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c0d0630 con 0x7f320c0b3e80 2024-05-20T17:57:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.031+0000 7f32112e2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f320c0d39c0 con 0x7f320c162820 2024-05-20T17:57:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.031+0000 7f32112e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f320c0d3ca0 con 0x7f320c06dae0 2024-05-20T17:57:30.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f320a7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f320c0b3e80 0x7f320c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44928/0 (socket says 172.21.15.6:44928) 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f320a7fc640 1 -- 172.21.15.6:0/1590888124 learned_addr learned my addr 172.21.15.6:0/1590888124 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f320affd640 1 --2- 172.21.15.6:0/1590888124 >> v2:172.21.15.171:3300/0 conn(0x7f320c162820 0x7f320c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f320b7fe640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f320c06dae0 0x7f320c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021855129 0 0) 0x7f320c0d0630 con 0x7f320c0b3e80 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31f4003520 con 0x7f320c0b3e80 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4086084270 0 0) 0x7f31f4003520 con 0x7f320c0b3e80 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f320c06dae0 msgr2=0x7f320c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f320c06dae0 0x7f320c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 >> v2:172.21.15.171:3300/0 conn(0x7f320c162820 msgr2=0x7f320c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 --2- 172.21.15.6:0/1590888124 >> v2:172.21.15.171:3300/0 conn(0x7f320c162820 0x7f320c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c0d3f80 con 0x7f320c0b3e80 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f3200001670 con 0x7f320c0b3e80 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 >> v1:172.21.15.6:6789/0 conn(0x7f320c0b3e80 legacy=0x7f320c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40039b0 0x7f31f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f4004800 0x7f31f4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f4005150 0x7f31f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0d39c0 con 0x7f31f40039b0 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0d3ca0 con 0x7f31f4004800 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f31f400bf00 con 0x7f31f4005150 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f320affd640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40039b0 0x7f31f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f320a7fc640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f4004800 0x7f31f4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.032+0000 7f320b7fe640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f4005150 0x7f31f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.033+0000 7f320affd640 1 -- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f4005150 msgr2=0x7f31f400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.033+0000 7f320affd640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f4005150 0x7f31f400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.033+0000 7f320affd640 1 -- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f4004800 msgr2=0x7f31f4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.033+0000 7f320affd640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f4004800 0x7f31f4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.033+0000 7f320affd640 1 -- 172.21.15.6:0/1590888124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f4003520 con 0x7f31f40039b0 2024-05-20T17:57:30.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.033+0000 7f320affd640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40039b0 0x7f31f4003e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009ac0 tx=0x7f31f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7844434bb26a659 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.033+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc036070 con 0x7f31f40039b0 2024-05-20T17:57:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.033+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31fc031400 con 0x7f31f40039b0 2024-05-20T17:57:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.034+0000 7f3209ffb640 1 -- 172.21.15.6:0/1590888124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc009690 con 0x7f31f40039b0 2024-05-20T17:57:30.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.034+0000 7f32112e2640 1 -- 172.21.15.6:0/1590888124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40039b0 msgr2=0x7f31f4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.034+0000 7f32112e2640 1 --2- 172.21.15.6:0/1590888124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31f40039b0 0x7f31f4003e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009ac0 tx=0x7f31f4005830 comp rx=0 tx=0).stop 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.034+0000 7f320b7fe640 1 -- 172.21.15.6:0/1590888124 reap_dead start 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.034+0000 7f32112e2640 1 -- 172.21.15.6:0/1590888124 shutdown_connections 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.034+0000 7f32112e2640 1 -- 172.21.15.6:0/1590888124 >> 172.21.15.6:0/1590888124 conn(0x7f320c0d4bd0 msgr2=0x7f320c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.034+0000 7f32112e2640 1 -- 172.21.15.6:0/1590888124 shutdown_connections 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.034+0000 7f32112e2640 1 -- 172.21.15.6:0/1590888124 wait complete. 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.036+0000 7f32112e2640 1 Processor -- start 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.036+0000 7f32112e2640 1 -- start start 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.037+0000 7f32112e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f40039b0 0x7f320c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.037+0000 7f32112e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c155720 0x7f320c0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f32112e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f320c0ccfb0 0x7f320c157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f32112e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0d4780 con 0x7f320c155720 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f32112e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0d0300 con 0x7f320c0ccfb0 2024-05-20T17:57:30.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f32112e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f320c0d4900 con 0x7f31f40039b0 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c155720 0x7f320c0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c155720 0x7f320c0cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55718/0 (socket says 172.21.15.6:55718) 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 -- 172.21.15.6:0/2147615363 learned_addr learned my addr 172.21.15.6:0/2147615363 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320b7fe640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f320c0ccfb0 0x7f320c157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320affd640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f40039b0 0x7f320c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 -- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f40039b0 msgr2=0x7f320c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f40039b0 0x7f320c0cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 -- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f320c0ccfb0 msgr2=0x7f320c157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f320c0ccfb0 0x7f320c157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 -- 172.21.15.6:0/2147615363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c0cd3c0 con 0x7f320c155720 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320affd640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f40039b0 0x7f320c0cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320b7fe640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f320c0ccfb0 0x7f320c157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f320a7fc640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c155720 0x7f320c0cca70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3200007370 tx=0x7f3200007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f31f37fe640 1 -- 172.21.15.6:0/2147615363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320001a070 con 0x7f320c155720 2024-05-20T17:57:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f31f37fe640 1 -- 172.21.15.6:0/2147615363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320000f9c0 con 0x7f320c155720 2024-05-20T17:57:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320c0b5e70 con 0x7f320c155720 2024-05-20T17:57:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.038+0000 7f31f37fe640 1 -- 172.21.15.6:0/2147615363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320000fd90 con 0x7f320c155720 2024-05-20T17:57:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.039+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320c0b6430 con 0x7f320c155720 2024-05-20T17:57:30.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.039+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f320c0d5250 con 0x7f320c155720 2024-05-20T17:57:30.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.040+0000 7f31f37fe640 1 -- 172.21.15.6:0/2147615363 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f320001d360 con 0x7f320c155720 2024-05-20T17:57:30.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.041+0000 7f31f37fe640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31f806be30 0x7f31f806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.041+0000 7f31f37fe640 1 -- 172.21.15.6:0/2147615363 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f320008aac0 con 0x7f320c155720 2024-05-20T17:57:30.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.041+0000 7f320affd640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31f806be30 0x7f31f806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.041+0000 7f320affd640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31f806be30 0x7f31f806e340 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f31fc033000 tx=0x7f31fc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.045+0000 7f31f37fe640 1 -- 172.21.15.6:0/2147615363 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f320c0d5250 con 0x7f320c155720 2024-05-20T17:57:30.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.229+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f320c075b00 con 0x7f320c155720 2024-05-20T17:57:30.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.230+0000 7f31f37fe640 1 -- 172.21.15.6:0/2147615363 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v28) ==== 106+0+4 (secure 0 0 0) 0x7f3200059280 con 0x7f320c155720 2024-05-20T17:57:30.227 INFO:teuthology.orchestra.run.smithi006.stdout:100 2024-05-20T17:57:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31f806be30 msgr2=0x7f31f806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31f806be30 0x7f31f806e340 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f31fc033000 tx=0x7f31fc008030 comp rx=0 tx=0).stop 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c155720 msgr2=0x7f320c0cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c155720 0x7f320c0cca70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3200007370 tx=0x7f3200007830 comp rx=0 tx=0).stop 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 shutdown_connections 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f31f806be30 0x7f31f806e340 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f320c0ccfb0 0x7f320c157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c155720 0x7f320c0cca70 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.231+0000 7f32112e2640 1 --2- 172.21.15.6:0/2147615363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f40039b0 0x7f320c0cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.232+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 >> 172.21.15.6:0/2147615363 conn(0x7f320c0d4bd0 msgr2=0x7f320c15fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.232+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 shutdown_connections 2024-05-20T17:57:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.232+0000 7f32112e2640 1 -- 172.21.15.6:0/2147615363 wait complete. 2024-05-20T17:57:30.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-05-20T17:57:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.360+0000 7fee648fe640 1 Processor -- start 2024-05-20T17:57:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.360+0000 7fee648fe640 1 -- start start 2024-05-20T17:57:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee648fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cfae0 0x7fee60162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee648fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6006c8c0 con 0x7fee6006d6b0 2024-05-20T17:57:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee648fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6006dac0 con 0x7fee600cd710 2024-05-20T17:57:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee648fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fee600d0ba0 con 0x7fee600cfae0 2024-05-20T17:57:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fee6006d6b0 0x7fee600d1030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44938/0 (socket says 172.21.15.6:44938) 2024-05-20T17:57:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5ed9d640 1 -- 172.21.15.6:0/2642667539 learned_addr learned my addr 172.21.15.6:0/2642667539 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5dd9b640 1 --2- 172.21.15.6:0/2642667539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cfae0 0x7fee60162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5d59a640 1 -- 172.21.15.6:0/2642667539 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817915030 0 0) 0x7fee6006c8c0 con 0x7fee6006d6b0 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5d59a640 1 -- 172.21.15.6:0/2642667539 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee4c003520 con 0x7fee6006d6b0 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5d59a640 1 -- 172.21.15.6:0/2642667539 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4792178 0 0) 0x7fee6006dac0 con 0x7fee600cd710 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5d59a640 1 -- 172.21.15.6:0/2642667539 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6006c8c0 con 0x7fee600cd710 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5d59a640 1 -- 172.21.15.6:0/2642667539 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3067783335 0 0) 0x7fee4c003520 con 0x7fee6006d6b0 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5dd9b640 1 -- 172.21.15.6:0/2642667539 >> v1:172.21.15.171:6789/0 conn(0x7fee600cd710 legacy=0x7fee600cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.362+0000 7fee5dd9b640 1 -- 172.21.15.6:0/2642667539 >> v1:172.21.15.6:6789/0 conn(0x7fee6006d6b0 legacy=0x7fee600d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.363+0000 7fee5dd9b640 1 -- 172.21.15.6:0/2642667539 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee601633e0 con 0x7fee600cfae0 2024-05-20T17:57:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.363+0000 7fee5dd9b640 1 --2- 172.21.15.6:0/2642667539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cfae0 0x7fee60162e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee600d0d20 tx=0x7fee4802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e2a538a00fd7d23 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee5d59a640 1 -- 172.21.15.6:0/2642667539 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48037070 con 0x7fee600cfae0 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee5d59a640 1 -- 172.21.15.6:0/2642667539 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee4802ac10 con 0x7fee600cfae0 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee5d59a640 1 -- 172.21.15.6:0/2642667539 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58001a10 con 0x7fee600cfae0 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee648fe640 1 -- 172.21.15.6:0/2642667539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cfae0 msgr2=0x7fee60162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee648fe640 1 --2- 172.21.15.6:0/2642667539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cfae0 0x7fee60162e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee600d0d20 tx=0x7fee4802a180 comp rx=0 tx=0).stop 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee648fe640 1 -- 172.21.15.6:0/2642667539 shutdown_connections 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee648fe640 1 --2- 172.21.15.6:0/2642667539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cfae0 0x7fee60162e00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee648fe640 1 -- 172.21.15.6:0/2642667539 >> 172.21.15.6:0/2642667539 conn(0x7fee600b44d0 msgr2=0x7fee600b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee648fe640 1 -- 172.21.15.6:0/2642667539 shutdown_connections 2024-05-20T17:57:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.364+0000 7fee648fe640 1 -- 172.21.15.6:0/2642667539 wait complete. 2024-05-20T17:57:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.366+0000 7fee648fe640 1 Processor -- start 2024-05-20T17:57:30.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.366+0000 7fee648fe640 1 -- start start 2024-05-20T17:57:30.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee648fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6006d6b0 0x7fee600c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee648fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cd710 0x7fee600ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee648fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee601590c0 0x7fee600ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee648fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fee60163c80 con 0x7fee601590c0 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee648fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fee601639a0 con 0x7fee6006d6b0 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee648fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fee6015f2b0 con 0x7fee600cd710 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee601590c0 0x7fee600ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee601590c0 0x7fee600ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55730/0 (socket says 172.21.15.6:55730) 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 -- 172.21.15.6:0/3612016018 learned_addr learned my addr 172.21.15.6:0/3612016018 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5dd9b640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cd710 0x7fee600ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5e59c640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6006d6b0 0x7fee600c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 -- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cd710 msgr2=0x7fee600ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cd710 0x7fee600ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 -- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6006d6b0 msgr2=0x7fee600c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6006d6b0 0x7fee600c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 -- 172.21.15.6:0/3612016018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee600c7220 con 0x7fee601590c0 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5e59c640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6006d6b0 0x7fee600c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee5ed9d640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee601590c0 0x7fee600ceb80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fee5800c7d0 tx=0x7fee5800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.368+0000 7fee56ffd640 1 -- 172.21.15.6:0/3612016018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58018070 con 0x7fee601590c0 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.369+0000 7fee56ffd640 1 -- 172.21.15.6:0/3612016018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5800a640 con 0x7fee601590c0 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.369+0000 7fee56ffd640 1 -- 172.21.15.6:0/3612016018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5800aa30 con 0x7fee601590c0 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.369+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee600c7500 con 0x7fee601590c0 2024-05-20T17:57:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.369+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee600c7ac0 con 0x7fee601590c0 2024-05-20T17:57:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.370+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6006c2d0 con 0x7fee601590c0 2024-05-20T17:57:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.370+0000 7fee56ffd640 1 -- 172.21.15.6:0/3612016018 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee5801b070 con 0x7fee601590c0 2024-05-20T17:57:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.371+0000 7fee56ffd640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee4006be60 0x7fee4006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.371+0000 7fee56ffd640 1 -- 172.21.15.6:0/3612016018 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fee5808a510 con 0x7fee601590c0 2024-05-20T17:57:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.371+0000 7fee5e59c640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee4006be60 0x7fee4006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.372+0000 7fee5e59c640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee4006be60 0x7fee4006e370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fee500011e0 tx=0x7fee50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.375+0000 7fee56ffd640 1 -- 172.21.15.6:0/3612016018 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fee6006c2d0 con 0x7fee601590c0 2024-05-20T17:57:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.561+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7fee600c6fb0 con 0x7fee601590c0 2024-05-20T17:57:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.562+0000 7fee56ffd640 1 -- 172.21.15.6:0/3612016018 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v28) ==== 112+0+10 (secure 0 0 0) 0x7fee58058770 con 0x7fee601590c0 2024-05-20T17:57:30.560 INFO:teuthology.orchestra.run.smithi006.stdout:60.000000 2024-05-20T17:57:30.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee4006be60 msgr2=0x7fee4006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee4006be60 0x7fee4006e370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fee500011e0 tx=0x7fee50009040 comp rx=0 tx=0).stop 2024-05-20T17:57:30.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee601590c0 msgr2=0x7fee600ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee601590c0 0x7fee600ceb80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fee5800c7d0 tx=0x7fee5800cc90 comp rx=0 tx=0).stop 2024-05-20T17:57:30.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 shutdown_connections 2024-05-20T17:57:30.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee4006be60 0x7fee4006e370 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee601590c0 0x7fee600ceb80 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee600cd710 0x7fee600ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 --2- 172.21.15.6:0/3612016018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee6006d6b0 0x7fee600c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 >> 172.21.15.6:0/3612016018 conn(0x7fee600b44d0 msgr2=0x7fee601616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:30.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 shutdown_connections 2024-05-20T17:57:30.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.564+0000 7fee648fe640 1 -- 172.21.15.6:0/3612016018 wait complete. 2024-05-20T17:57:30.573 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:57:30.573 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:30.590 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T17:57:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T17:57:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:57:30.688 INFO:teuthology.orchestra.run.smithi006.stdout:client6113 2024-05-20T17:57:30.688 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:57:30.689 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> import fcntl 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> import time 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> n = 400 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-05-20T17:57:30.705 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> if not os.path.exists(abs_path): 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(abs_path) 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> handles = [] 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(0, n): 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> fname = "file_"+str(i) 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> path = os.path.join(abs_path, fname) 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> handles.append(open(path, '"'"'w'"'"')) 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> print("waiting with handles open", file=sys.stderr) 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> while True: 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> print("open_n_background: keeping files open", file=sys.stderr) 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> if os.read(0, 4096) == b"": 2024-05-20T17:57:30.706 DEBUG:teuthology.orchestra.run.smithi006:> break 2024-05-20T17:57:30.707 DEBUG:teuthology.orchestra.run.smithi006:> except BlockingIOError: 2024-05-20T17:57:30.707 DEBUG:teuthology.orchestra.run.smithi006:> pass 2024-05-20T17:57:30.707 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(2) 2024-05-20T17:57:30.707 DEBUG:teuthology.orchestra.run.smithi006:> print("stdin closed, goodbye!", file=sys.stderr) 2024-05-20T17:57:30.707 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T17:57:30.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:57:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.868+0000 7ff559de3640 1 Processor -- start 2024-05-20T17:57:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.868+0000 7ff559de3640 1 -- start start 2024-05-20T17:57:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff559de3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff554160100 0x7ff5540b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff559de3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff554160510 0x7ff5540b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff559de3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55406cac0 con 0x7ff554152e50 2024-05-20T17:57:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff559de3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff5540b43a0 con 0x7ff554160100 2024-05-20T17:57:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff559de3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff5540b4680 con 0x7ff554160510 2024-05-20T17:57:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff54bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff554160100 0x7ff5540b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff5537fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff554152e50 0x7ff55415f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44940/0 (socket says 172.21.15.6:44940) 2024-05-20T17:57:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff5537fe640 1 -- 172.21.15.6:0/1585757753 learned_addr learned my addr 172.21.15.6:0/1585757753 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff553fff640 1 --2- 172.21.15.6:0/1585757753 >> v2:172.21.15.171:3300/0 conn(0x7ff554160510 0x7ff5540b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff54bfff640 1 -- 172.21.15.6:0/1585757753 >> v2:172.21.15.171:3300/0 conn(0x7ff554160510 msgr2=0x7ff5540b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff54bfff640 1 --2- 172.21.15.6:0/1585757753 >> v2:172.21.15.171:3300/0 conn(0x7ff554160510 0x7ff5540b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff54bfff640 1 -- 172.21.15.6:0/1585757753 >> v1:172.21.15.6:6789/0 conn(0x7ff554152e50 legacy=0x7ff55415f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff552ffd640 1 -- 172.21.15.6:0/1585757753 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997722261 0 0) 0x7ff55406cac0 con 0x7ff554152e50 2024-05-20T17:57:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.871+0000 7ff54bfff640 1 -- 172.21.15.6:0/1585757753 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5540b4960 con 0x7ff554160100 2024-05-20T17:57:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.872+0000 7ff54bfff640 1 --2- 172.21.15.6:0/1585757753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540b4e80 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00ba40 tx=0x7ff53c02c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f992c8bc4144f99 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.872+0000 7ff552ffd640 1 -- 172.21.15.6:0/1585757753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c03a070 con 0x7ff554160100 2024-05-20T17:57:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.872+0000 7ff552ffd640 1 -- 172.21.15.6:0/1585757753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c031070 con 0x7ff554160100 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.872+0000 7ff552ffd640 1 -- 172.21.15.6:0/1585757753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0328f0 con 0x7ff554160100 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.873+0000 7ff559de3640 1 -- 172.21.15.6:0/1585757753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 msgr2=0x7ff5540b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.873+0000 7ff559de3640 1 --2- 172.21.15.6:0/1585757753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540b4e80 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00ba40 tx=0x7ff53c02c810 comp rx=0 tx=0).stop 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.873+0000 7ff559de3640 1 -- 172.21.15.6:0/1585757753 shutdown_connections 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.873+0000 7ff559de3640 1 --2- 172.21.15.6:0/1585757753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540b4e80 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.873+0000 7ff559de3640 1 --2- 172.21.15.6:0/1585757753 >> v2:172.21.15.171:3300/0 conn(0x7ff554160510 0x7ff5540b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.873+0000 7ff559de3640 1 -- 172.21.15.6:0/1585757753 >> 172.21.15.6:0/1585757753 conn(0x7ff55406ee50 msgr2=0x7ff55406f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.874+0000 7ff559de3640 1 -- 172.21.15.6:0/1585757753 shutdown_connections 2024-05-20T17:57:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.874+0000 7ff559de3640 1 -- 172.21.15.6:0/1585757753 wait complete. 2024-05-20T17:57:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.876+0000 7ff559de3640 1 Processor -- start 2024-05-20T17:57:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.876+0000 7ff559de3640 1 -- start start 2024-05-20T17:57:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff559de3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff554152e50 0x7ff5541f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff559de3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff559de3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff554160510 0x7ff5540ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff559de3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff55415d5c0 con 0x7ff554160100 2024-05-20T17:57:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff559de3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5540b0ae0 con 0x7ff554152e50 2024-05-20T17:57:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff559de3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff55415e9e0 con 0x7ff554160510 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff54bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff54bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55754/0 (socket says 172.21.15.6:55754) 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff54bfff640 1 -- 172.21.15.6:0/1743751742 learned_addr learned my addr 172.21.15.6:0/1743751742 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff5537fe640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff554152e50 0x7ff5541f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.877+0000 7ff553fff640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff554160510 0x7ff5540ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff54bfff640 1 -- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff554160510 msgr2=0x7ff5540ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff54bfff640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff554160510 0x7ff5540ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff54bfff640 1 -- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff554152e50 msgr2=0x7ff5541f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff54bfff640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff554152e50 0x7ff5541f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff54bfff640 1 -- 172.21.15.6:0/1743751742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5541f9a80 con 0x7ff554160100 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff5537fe640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff554152e50 0x7ff5541f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff54bfff640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540af1b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff53c038040 tx=0x7ff53c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff550ff9640 1 -- 172.21.15.6:0/1743751742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c03a040 con 0x7ff554160100 2024-05-20T17:57:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff550ff9640 1 -- 172.21.15.6:0/1743751742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c045070 con 0x7ff554160100 2024-05-20T17:57:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5541f8cc0 con 0x7ff554160100 2024-05-20T17:57:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff550ff9640 1 -- 172.21.15.6:0/1743751742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0358e0 con 0x7ff554160100 2024-05-20T17:57:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.878+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5541f9280 con 0x7ff554160100 2024-05-20T17:57:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.880+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff554074d00 con 0x7ff554160100 2024-05-20T17:57:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.880+0000 7ff550ff9640 1 -- 172.21.15.6:0/1743751742 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff53c033070 con 0x7ff554160100 2024-05-20T17:57:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.880+0000 7ff550ff9640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff53406be30 0x7ff53406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.880+0000 7ff550ff9640 1 -- 172.21.15.6:0/1743751742 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7ff53c0abb10 con 0x7ff554160100 2024-05-20T17:57:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.881+0000 7ff5537fe640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff53406be30 0x7ff53406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.881+0000 7ff5537fe640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff53406be30 0x7ff53406e340 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff544000f60 tx=0x7ff544007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:30.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:30.885+0000 7ff550ff9640 1 -- 172.21.15.6:0/1743751742 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff554074d00 con 0x7ff554160100 2024-05-20T17:57:31.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.116+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff554075b00 con 0x7ff554160100 2024-05-20T17:57:31.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.116+0000 7ff550ff9640 1 -- 172.21.15.6:0/1743751742 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5183 (secure 0 0 0) 0x7ff53c050060 con 0x7ff554160100 2024-05-20T17:57:31.114 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:31.114 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/4216834090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":4216834090},{"type":"v1","addr":"172.21.15.171:6836","nonce":4216834090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1870629940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1870629940},{"type":"v1","addr":"172.21.15.171:6837","nonce":1870629940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3012084004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3012084004},{"type":"v1","addr":"172.21.15.6:6833","nonce":3012084004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:57:19.873838+0000","modified":"2024-05-20T17:57:22.890340+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7074":{"gid":7074,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/3379618192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3379618192},{"type":"v1","addr":"172.21.15.6:6835","nonce":3379618192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7074,"qdb_cluster":[7074]},"id":6}]} 2024-05-20T17:57:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 52 2024-05-20T17:57:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff53406be30 msgr2=0x7ff53406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff53406be30 0x7ff53406e340 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff544000f60 tx=0x7ff544007ca0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 msgr2=0x7ff5540af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540af1b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff53c038040 tx=0x7ff53c004730 comp rx=0 tx=0).stop 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 shutdown_connections 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff53406be30 0x7ff53406e340 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff554160510 0x7ff5540ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554160100 0x7ff5540af1b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 --2- 172.21.15.6:0/1743751742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff554152e50 0x7ff5541f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 >> 172.21.15.6:0/1743751742 conn(0x7ff55406ee50 msgr2=0x7ff55414c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 shutdown_connections 2024-05-20T17:57:31.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.119+0000 7ff559de3640 1 -- 172.21.15.6:0/1743751742 wait complete. 2024-05-20T17:57:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:waiting with handles open 2024-05-20T17:57:31.125 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:31.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-20T17:57:31.261 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":7251,"entity":{"name":{"type":"client","num":7251},"addr":{"type":"any","addr":"172.21.15.171:0","nonce":3102365760}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.8389676160000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9914529383015438,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7251 172.21.15.171:0/3102365760","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":6113,"entity":{"name":{"type":"client","num":6113},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":3761500605}},"state":"open","num_leases":1,"num_caps":402,"request_load_avg":425,"uptime":3.9859545330000001,"requests_in_flight":400,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":804.46670015677512,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6113 172.21.15.6:0/3761500605","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T17:57:31.261 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.171:0", "nonce": 3102365760, "type": "any" }, "name": { "num": 7251, "type": "client" } }, "id": 7251, "inst": "client.7251 172.21.15.171:0/3102365760", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.991452938301544 }, "state": "open", "uptime": 2.838967616 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 3761500605, "type": "any" }, "name": { "num": 6113, "type": "client" } }, "id": 6113, "inst": "client.6113 172.21.15.6:0/3761500605", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 402, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 425, "requests_in_flight": 400, "session_cache_liveness": { "halflife": 300, "value": 804.4667001567751 }, "state": "open", "uptime": 3.985954533 } ] 2024-05-20T17:57:31.261 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-05-20T17:57:31.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:57:31.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.378+0000 7fac417ff640 1 Processor -- start 2024-05-20T17:57:31.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.378+0000 7fac417ff640 1 -- start start 2024-05-20T17:57:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.379+0000 7fac417ff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0b7f70 0x7fac3c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac417ff640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac3c0d26b0 con 0x7fac3c0b3880 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac417ff640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac3c0d2990 con 0x7fac3c0d1ad0 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac417ff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac3c08d600 con 0x7fac3c0b7f70 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac3a7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac3c0b3880 0x7fac3c0d13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44942/0 (socket says 172.21.15.6:44942) 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac3a7fc640 1 -- 172.21.15.6:0/1862689719 learned_addr learned my addr 172.21.15.6:0/1862689719 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac3affd640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0b7f70 0x7fac3c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196752351 0 0) 0x7fac3c0d26b0 con 0x7fac3c0b3880 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac24003520 con 0x7fac3c0b3880 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712794862 0 0) 0x7fac3c0d2990 con 0x7fac3c0d1ad0 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac3c0d26b0 con 0x7fac3c0d1ad0 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1087357556 0 0) 0x7fac24003520 con 0x7fac3c0b3880 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0b7f70 msgr2=0x7fac3c15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0b7f70 0x7fac3c15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 >> v1:172.21.15.171:6789/0 conn(0x7fac3c0d1ad0 legacy=0x7fac3c0d3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c0d2c70 con 0x7fac3c0b3880 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fac30001670 con 0x7fac3c0b3880 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 >> v1:172.21.15.6:6789/0 conn(0x7fac3c0b3880 legacy=0x7fac3c0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac24003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac24004800 0x7fac24004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0b7f70 0x7fac2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c08d600 con 0x7fac24003b70 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fac24005560 con 0x7fac24004800 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac2400bf00 con 0x7fac3c0b7f70 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.380+0000 7fac3affd640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac24003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.381+0000 7fac3a7fc640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac24004800 0x7fac24004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.381+0000 7fac3b7fe640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0b7f70 0x7fac2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.381+0000 7fac3affd640 1 -- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0b7f70 msgr2=0x7fac2400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:31.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.381+0000 7fac3affd640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0b7f70 0x7fac2400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.381+0000 7fac3affd640 1 -- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac24004800 msgr2=0x7fac24004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.381+0000 7fac3affd640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac24004800 0x7fac24004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.381+0000 7fac3affd640 1 -- 172.21.15.6:0/1862689719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac24003520 con 0x7fac24003b70 2024-05-20T17:57:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac3affd640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac24003fc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009fc0 tx=0x7fac24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540280149044e032 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c034020 con 0x7fac24003b70 2024-05-20T17:57:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac2c0305f0 con 0x7fac24003b70 2024-05-20T17:57:31.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac39ffb640 1 -- 172.21.15.6:0/1862689719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c009c10 con 0x7fac24003b70 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac417ff640 1 -- 172.21.15.6:0/1862689719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 msgr2=0x7fac24003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac417ff640 1 --2- 172.21.15.6:0/1862689719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac24003fc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009fc0 tx=0x7fac24005830 comp rx=0 tx=0).stop 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac3b7fe640 1 -- 172.21.15.6:0/1862689719 reap_dead start 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac417ff640 1 -- 172.21.15.6:0/1862689719 shutdown_connections 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.382+0000 7fac417ff640 1 -- 172.21.15.6:0/1862689719 >> 172.21.15.6:0/1862689719 conn(0x7fac3c08c2c0 msgr2=0x7fac3c0b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.383+0000 7fac417ff640 1 -- 172.21.15.6:0/1862689719 shutdown_connections 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.383+0000 7fac417ff640 1 -- 172.21.15.6:0/1862689719 wait complete. 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.384+0000 7fac417ff640 1 Processor -- start 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.384+0000 7fac417ff640 1 -- start start 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac417ff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac3c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac417ff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3c0ccca0 0x7fac3c0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:31.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac417ff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0cee10 0x7fac3c0cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac417ff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c0b3d60 con 0x7fac24003b70 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac417ff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c0d2fe0 con 0x7fac3c0ccca0 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac417ff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac3c0b3ee0 con 0x7fac3c0cee10 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac3c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac3c14fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55776/0 (socket says 172.21.15.6:55776) 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 -- 172.21.15.6:0/2163707761 learned_addr learned my addr 172.21.15.6:0/2163707761 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3a7fc640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3c0ccca0 0x7fac3c0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3b7fe640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0cee10 0x7fac3c0cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 -- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0cee10 msgr2=0x7fac3c0cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0cee10 0x7fac3c0cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 -- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3c0ccca0 msgr2=0x7fac3c0cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3c0ccca0 0x7fac3c0cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 -- 172.21.15.6:0/2163707761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c15acb0 con 0x7fac24003b70 2024-05-20T17:57:31.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.386+0000 7fac3affd640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac3c14fe00 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fac2c033040 tx=0x7fac2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:31.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.387+0000 7fac237fe640 1 -- 172.21.15.6:0/2163707761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c040070 con 0x7fac24003b70 2024-05-20T17:57:31.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.387+0000 7fac237fe640 1 -- 172.21.15.6:0/2163707761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac2c003990 con 0x7fac24003b70 2024-05-20T17:57:31.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.387+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c15af90 con 0x7fac24003b70 2024-05-20T17:57:31.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.387+0000 7fac237fe640 1 -- 172.21.15.6:0/2163707761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c034040 con 0x7fac24003b70 2024-05-20T17:57:31.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.387+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c1f5730 con 0x7fac24003b70 2024-05-20T17:57:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.388+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3c075980 con 0x7fac24003b70 2024-05-20T17:57:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.388+0000 7fac237fe640 1 -- 172.21.15.6:0/2163707761 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac2c037020 con 0x7fac24003b70 2024-05-20T17:57:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.389+0000 7fac237fe640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac2806be30 0x7fac2806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.389+0000 7fac237fe640 1 -- 172.21.15.6:0/2163707761 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fac2c0abb30 con 0x7fac24003b70 2024-05-20T17:57:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.389+0000 7fac3a7fc640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac2806be30 0x7fac2806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.389+0000 7fac3a7fc640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac2806be30 0x7fac2806e340 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fac3c1f8860 tx=0x7fac300078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.393+0000 7fac237fe640 1 -- 172.21.15.6:0/2163707761 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fac2c079c70 con 0x7fac24003b70 2024-05-20T17:57:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.618+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fac3c0b6e10 con 0x7fac24003b70 2024-05-20T17:57:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.619+0000 7fac237fe640 1 -- 172.21.15.6:0/2163707761 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fac2c07df70 con 0x7fac24003b70 2024-05-20T17:57:31.617 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:31.617 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-20T17:57:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac2806be30 msgr2=0x7fac2806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac2806be30 0x7fac2806e340 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fac3c1f8860 tx=0x7fac300078f0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 msgr2=0x7fac3c14fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac3c14fe00 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fac2c033040 tx=0x7fac2c009750 comp rx=0 tx=0).stop 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 shutdown_connections 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fac2806be30 0x7fac2806e340 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac3c0cee10 0x7fac3c0cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac3c0ccca0 0x7fac3c0cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 --2- 172.21.15.6:0/2163707761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac24003b70 0x7fac3c14fe00 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.620+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 >> 172.21.15.6:0/2163707761 conn(0x7fac3c08c2c0 msgr2=0x7fac3c0b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.621+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 shutdown_connections 2024-05-20T17:57:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:31.621+0000 7fac417ff640 1 -- 172.21.15.6:0/2163707761 wait complete. 2024-05-20T17:57:31.629 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-05-20T17:57:31.629 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:57:33.127 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:36.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:57:36.345 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:57:36.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:57:36.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.760+0000 7f7bad74c640 1 Processor -- start 2024-05-20T17:57:36.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.760+0000 7f7bad74c640 1 -- start start 2024-05-20T17:57:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7bad74c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80b4070 0x7f7ba80ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7bad74c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ba806dae0 0x7f7ba80b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7bad74c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ba815fa90 con 0x7f7ba80d0560 2024-05-20T17:57:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7bad74c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7ba80b8490 con 0x7f7ba806dae0 2024-05-20T17:57:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7bad74c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba80d3f00 con 0x7f7ba80b4070 2024-05-20T17:57:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7ba77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ba806dae0 0x7f7ba80b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7ba77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ba806dae0 0x7f7ba80b8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55784/0 (socket says 172.21.15.6:55784) 2024-05-20T17:57:36.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7ba77fe640 1 -- 172.21.15.6:0/4180839049 learned_addr learned my addr 172.21.15.6:0/4180839049 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7ba6ffd640 1 --2- 172.21.15.6:0/4180839049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80b4070 0x7f7ba80ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7ba77fe640 1 -- 172.21.15.6:0/4180839049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80b4070 msgr2=0x7f7ba80ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7ba77fe640 1 --2- 172.21.15.6:0/4180839049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80b4070 0x7f7ba80ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7ba77fe640 1 -- 172.21.15.6:0/4180839049 >> v1:172.21.15.171:6789/0 conn(0x7f7ba80d0560 legacy=0x7f7ba806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:36.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.762+0000 7f7ba77fe640 1 -- 172.21.15.6:0/4180839049 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba80d41e0 con 0x7f7ba806dae0 2024-05-20T17:57:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.763+0000 7f7ba77fe640 1 --2- 172.21.15.6:0/4180839049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba806dae0 0x7f7ba80b8920 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009870 tx=0x7f7ba002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a313d9564fb3a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.763+0000 7f7ba5ffb640 1 -- 172.21.15.6:0/4180839049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0037070 con 0x7f7ba806dae0 2024-05-20T17:57:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.763+0000 7f7ba5ffb640 1 -- 172.21.15.6:0/4180839049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba0032440 con 0x7f7ba806dae0 2024-05-20T17:57:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.763+0000 7f7ba5ffb640 1 -- 172.21.15.6:0/4180839049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0032810 con 0x7f7ba806dae0 2024-05-20T17:57:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.764+0000 7f7bad74c640 1 -- 172.21.15.6:0/4180839049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba806dae0 msgr2=0x7f7ba80b8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.764+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4180839049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba806dae0 0x7f7ba80b8920 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009870 tx=0x7f7ba002a210 comp rx=0 tx=0).stop 2024-05-20T17:57:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.764+0000 7f7bad74c640 1 -- 172.21.15.6:0/4180839049 shutdown_connections 2024-05-20T17:57:36.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.764+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4180839049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba806dae0 0x7f7ba80b8920 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.764+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4180839049 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80b4070 0x7f7ba80ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.764+0000 7f7bad74c640 1 -- 172.21.15.6:0/4180839049 >> 172.21.15.6:0/4180839049 conn(0x7f7ba80d4c10 msgr2=0x7f7ba80d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.764+0000 7f7bad74c640 1 -- 172.21.15.6:0/4180839049 shutdown_connections 2024-05-20T17:57:36.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.764+0000 7f7bad74c640 1 -- 172.21.15.6:0/4180839049 wait complete. 2024-05-20T17:57:36.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.766+0000 7f7bad74c640 1 Processor -- start 2024-05-20T17:57:36.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.766+0000 7f7bad74c640 1 -- start start 2024-05-20T17:57:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.767+0000 7f7bad74c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba80b4070 0x7f7ba8154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.767+0000 7f7bad74c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80d0560 0x7f7ba814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.767+0000 7f7bad74c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba8158120 0x7f7ba8158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.767+0000 7f7bad74c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba80bab00 con 0x7f7ba80b4070 2024-05-20T17:57:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.767+0000 7f7bad74c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba80d47a0 con 0x7f7ba8158120 2024-05-20T17:57:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.767+0000 7f7bad74c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba80d3b20 con 0x7f7ba80d0560 2024-05-20T17:57:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba80b4070 0x7f7ba8154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba80b4070 0x7f7ba8154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55790/0 (socket says 172.21.15.6:55790) 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 -- 172.21.15.6:0/4162924734 learned_addr learned my addr 172.21.15.6:0/4162924734 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba77fe640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba8158120 0x7f7ba8158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba67fc640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80d0560 0x7f7ba814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 -- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80d0560 msgr2=0x7f7ba814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80d0560 0x7f7ba814ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 -- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba8158120 msgr2=0x7f7ba8158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba8158120 0x7f7ba8158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 -- 172.21.15.6:0/4162924734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba8158a70 con 0x7f7ba80b4070 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7ba6ffd640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba80b4070 0x7f7ba8154620 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7b98007e70 tx=0x7f7b9800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7b8f7fe640 1 -- 172.21.15.6:0/4162924734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98014620 con 0x7f7ba80b4070 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7b8f7fe640 1 -- 172.21.15.6:0/4162924734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b98019070 con 0x7f7ba80b4070 2024-05-20T17:57:36.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7b8f7fe640 1 -- 172.21.15.6:0/4162924734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98014a00 con 0x7f7ba80b4070 2024-05-20T17:57:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba8161b90 con 0x7f7ba80b4070 2024-05-20T17:57:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.768+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba8162150 con 0x7f7ba80b4070 2024-05-20T17:57:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.769+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba80b5ad0 con 0x7f7ba80b4070 2024-05-20T17:57:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.770+0000 7f7b8f7fe640 1 -- 172.21.15.6:0/4162924734 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b98014ba0 con 0x7f7ba80b4070 2024-05-20T17:57:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.771+0000 7f7b8f7fe640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b9406be30 0x7f7b9406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.771+0000 7f7b8f7fe640 1 -- 172.21.15.6:0/4162924734 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f7b9808b910 con 0x7f7ba80b4070 2024-05-20T17:57:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.771+0000 7f7ba67fc640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b9406be30 0x7f7b9406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:36.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.772+0000 7f7ba67fc640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b9406be30 0x7f7b9406e340 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c006fd0 tx=0x7f7b9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:36.776+0000 7f7b8f7fe640 1 -- 172.21.15.6:0/4162924734 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7ba80b5ad0 con 0x7f7ba80b4070 2024-05-20T17:57:36.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.001+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ba80b3e20 con 0x7f7ba80b4070 2024-05-20T17:57:36.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.002+0000 7f7b8f7fe640 1 -- 172.21.15.6:0/4162924734 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f7ba80b3e20 con 0x7f7ba80b4070 2024-05-20T17:57:36.999 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:36.999 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b9406be30 msgr2=0x7f7b9406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b9406be30 0x7f7b9406e340 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c006fd0 tx=0x7f7b9c008040 comp rx=0 tx=0).stop 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba80b4070 msgr2=0x7f7ba8154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba80b4070 0x7f7ba8154620 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7b98007e70 tx=0x7f7b9800e4b0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 shutdown_connections 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b9406be30 0x7f7b9406e340 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ba8158120 0x7f7ba8158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ba80d0560 0x7f7ba814ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 --2- 172.21.15.6:0/4162924734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba80b4070 0x7f7ba8154620 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 >> 172.21.15.6:0/4162924734 conn(0x7f7ba80d4c10 msgr2=0x7f7ba815f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 shutdown_connections 2024-05-20T17:57:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.004+0000 7f7bad74c640 1 -- 172.21.15.6:0/4162924734 wait complete. 2024-05-20T17:57:37.013 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-05-20T17:57:37.013 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-05-20T17:57:37.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:57:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.129+0000 7fa72f83d640 1 Processor -- start 2024-05-20T17:57:37.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.129+0000 7fa72f83d640 1 -- start start 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.130+0000 7fa72f83d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa7280b4370 0x7fa7280ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.130+0000 7fa72f83d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72815c340 con 0x7fa7280b4b70 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.130+0000 7fa72f83d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72806f900 con 0x7fa7280b3f60 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.130+0000 7fa72f83d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa72806fbe0 con 0x7fa7280b4370 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa72d5d9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa7280b4b70 0x7fa7280b3850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44956/0 (socket says 172.21.15.6:44956) 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa72d5d9640 1 -- 172.21.15.6:0/4243082380 learned_addr learned my addr 172.21.15.6:0/4243082380 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa72ddda640 1 --2- 172.21.15.6:0/4243082380 >> v2:172.21.15.171:3300/0 conn(0x7fa7280b4370 0x7fa7280ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1978408862 0 0) 0x7fa72815c340 con 0x7fa7280b4b70 2024-05-20T17:57:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa714003520 con 0x7fa7280b4b70 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 508407797 0 0) 0x7fa72806f900 con 0x7fa7280b3f60 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa72815c340 con 0x7fa7280b3f60 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2259891656 0 0) 0x7fa714003520 con 0x7fa7280b4b70 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 >> v2:172.21.15.171:3300/0 conn(0x7fa7280b4370 msgr2=0x7fa7280ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 --2- 172.21.15.6:0/4243082380 >> v2:172.21.15.171:3300/0 conn(0x7fa7280b4370 0x7fa7280ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 >> v1:172.21.15.171:6789/0 conn(0x7fa7280b3f60 legacy=0x7fa7280ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72806fec0 con 0x7fa7280b4b70 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fa724001670 con 0x7fa7280b4b70 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 >> v1:172.21.15.6:6789/0 conn(0x7fa7280b4b70 legacy=0x7fa7280b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa714003b40 0x7fa714003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa714004800 0x7fa714004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7140051a0 0x7fa71400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa72806fbe0 con 0x7fa714004800 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa71400c140 con 0x7fa7140051a0 2024-05-20T17:57:37.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa71400c340 con 0x7fa714003b40 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa72ddda640 1 --2- 172.21.15.6:0/4243082380 >> v2:172.21.15.171:3300/0 conn(0x7fa7280b4370 0x7fa7280ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.131+0000 7fa72cdd8640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa714004800 0x7fa714004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.132+0000 7fa72d5d9640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa714003b40 0x7fa714003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.132+0000 7fa72ddda640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7140051a0 0x7fa71400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.132+0000 7fa72cdd8640 1 -- 172.21.15.6:0/4243082380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa714003b40 msgr2=0x7fa714003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.132+0000 7fa72cdd8640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa714003b40 0x7fa714003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.132+0000 7fa72cdd8640 1 -- 172.21.15.6:0/4243082380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7140051a0 msgr2=0x7fa71400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.132+0000 7fa72cdd8640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7140051a0 0x7fa71400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.132+0000 7fa72ddda640 1 -- 172.21.15.6:0/4243082380 reap_dead start 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.132+0000 7fa72cdd8640 1 -- 172.21.15.6:0/4243082380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa714003520 con 0x7fa714004800 2024-05-20T17:57:37.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa72cdd8640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa714004800 0x7fa714004c10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa714004780 tx=0x7fa714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf42cbe877ddcac server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7180014e0 con 0x7fa714004800 2024-05-20T17:57:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7180052f0 con 0x7fa714004800 2024-05-20T17:57:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa71ffff640 1 -- 172.21.15.6:0/4243082380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71802ac00 con 0x7fa714004800 2024-05-20T17:57:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa72f83d640 1 -- 172.21.15.6:0/4243082380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa714004800 msgr2=0x7fa714004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa72f83d640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa714004800 0x7fa714004c10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa714004780 tx=0x7fa714005830 comp rx=0 tx=0).stop 2024-05-20T17:57:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa72f83d640 1 -- 172.21.15.6:0/4243082380 shutdown_connections 2024-05-20T17:57:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa72f83d640 1 --2- 172.21.15.6:0/4243082380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa714004800 0x7fa714004c10 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.133+0000 7fa72f83d640 1 -- 172.21.15.6:0/4243082380 >> 172.21.15.6:0/4243082380 conn(0x7fa7280cd2a0 msgr2=0x7fa7280cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:37.134 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.134+0000 7fa72f83d640 1 -- 172.21.15.6:0/4243082380 shutdown_connections 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.134+0000 7fa72f83d640 1 -- 172.21.15.6:0/4243082380 wait complete. 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.135+0000 7fa72f83d640 1 Processor -- start 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.135+0000 7fa72f83d640 1 -- start start 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72f83d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa714004800 0x7fa72814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72f83d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728154b00 0x7fa7280b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72f83d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7280b19c0 0x7fa72815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72f83d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa72806f4b0 con 0x7fa7280b19c0 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72f83d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa728070480 con 0x7fa714004800 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72f83d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa72806f630 con 0x7fa728154b00 2024-05-20T17:57:37.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7280b19c0 0x7fa72815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7280b19c0 0x7fa72815e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55812/0 (socket says 172.21.15.6:55812) 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 -- 172.21.15.6:0/228815044 learned_addr learned my addr 172.21.15.6:0/228815044 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72cdd8640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728154b00 0x7fa7280b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72d5d9640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa714004800 0x7fa72814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 -- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728154b00 msgr2=0x7fa7280b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728154b00 0x7fa7280b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 -- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa714004800 msgr2=0x7fa72814fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa714004800 0x7fa72814fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 -- 172.21.15.6:0/228815044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7280b1dd0 con 0x7fa7280b19c0 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.137+0000 7fa72ddda640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7280b19c0 0x7fa72815e970 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa7280cddc0 tx=0x7fa720011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.138+0000 7fa71dffb640 1 -- 172.21.15.6:0/228815044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720003990 con 0x7fa7280b19c0 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.138+0000 7fa71dffb640 1 -- 172.21.15.6:0/228815044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa720003b30 con 0x7fa7280b19c0 2024-05-20T17:57:37.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.138+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa728152320 con 0x7fa7280b19c0 2024-05-20T17:57:37.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.138+0000 7fa71dffb640 1 -- 172.21.15.6:0/228815044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720010740 con 0x7fa7280b19c0 2024-05-20T17:57:37.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.138+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa728150900 con 0x7fa7280b19c0 2024-05-20T17:57:37.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.139+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72806f900 con 0x7fa7280b19c0 2024-05-20T17:57:37.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.139+0000 7fa71dffb640 1 -- 172.21.15.6:0/228815044 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7200108e0 con 0x7fa7280b19c0 2024-05-20T17:57:37.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.140+0000 7fa71dffb640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa70c06be30 0x7fa70c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:37.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.140+0000 7fa71dffb640 1 -- 172.21.15.6:0/228815044 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fa72008dd00 con 0x7fa7280b19c0 2024-05-20T17:57:37.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.140+0000 7fa72d5d9640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa70c06be30 0x7fa70c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:37.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.141+0000 7fa72d5d9640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa70c06be30 0x7fa70c06e340 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa724001050 tx=0x7fa724001e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:37.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.144+0000 7fa71dffb640 1 -- 172.21.15.6:0/228815044 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa72806f900 con 0x7fa7280b19c0 2024-05-20T17:57:37.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.371+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa7280690b0 con 0x7fa7280b19c0 2024-05-20T17:57:37.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.371+0000 7fa71dffb640 1 -- 172.21.15.6:0/228815044 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fa7280b1dd0 con 0x7fa7280b19c0 2024-05-20T17:57:37.369 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:37.369 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:57:37.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.373+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa70c06be30 msgr2=0x7fa70c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.373+0000 7fa72f83d640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa70c06be30 0x7fa70c06e340 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa724001050 tx=0x7fa724001e40 comp rx=0 tx=0).stop 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.373+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7280b19c0 msgr2=0x7fa72815e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.373+0000 7fa72f83d640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7280b19c0 0x7fa72815e970 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa7280cddc0 tx=0x7fa720011a80 comp rx=0 tx=0).stop 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.374+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 shutdown_connections 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.374+0000 7fa72f83d640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa70c06be30 0x7fa70c06e340 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.374+0000 7fa72f83d640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7280b19c0 0x7fa72815e970 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.374+0000 7fa72f83d640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa728154b00 0x7fa7280b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.374+0000 7fa72f83d640 1 --2- 172.21.15.6:0/228815044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa714004800 0x7fa72814fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.374+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 >> 172.21.15.6:0/228815044 conn(0x7fa7280cd2a0 msgr2=0x7fa72806c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.374+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 shutdown_connections 2024-05-20T17:57:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:37.374+0000 7fa72f83d640 1 -- 172.21.15.6:0/228815044 wait complete. 2024-05-20T17:57:37.382 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:57:37.383 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:57:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:42.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:57:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.515+0000 7f164c779640 1 Processor -- start 2024-05-20T17:57:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.515+0000 7f164c779640 1 -- start start 2024-05-20T17:57:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.516+0000 7f164c779640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16440b3e40 0x7f16440d4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.516+0000 7f164c779640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f164415f4a0 0x7f164406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.516+0000 7f164c779640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164406d840 con 0x7f164406d430 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.516+0000 7f164c779640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f16440cfa10 con 0x7f16440b3e40 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.516+0000 7f164c779640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f16440b8220 con 0x7f164415f4a0 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.516+0000 7f164a515640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16440b3e40 0x7f16440d4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.516+0000 7f164a515640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f16440b3e40 0x7f16440d4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34412/0 (socket says 172.21.15.6:34412) 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.516+0000 7f164a515640 1 -- 172.21.15.6:0/2092088729 learned_addr learned my addr 172.21.15.6:0/2092088729 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.517+0000 7f164a515640 1 -- 172.21.15.6:0/2092088729 >> v2:172.21.15.171:3300/0 conn(0x7f164415f4a0 msgr2=0x7f164406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.517+0000 7f1649d14640 1 --2- 172.21.15.6:0/2092088729 >> v2:172.21.15.171:3300/0 conn(0x7f164415f4a0 0x7f164406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.517+0000 7f164a515640 1 --2- 172.21.15.6:0/2092088729 >> v2:172.21.15.171:3300/0 conn(0x7f164415f4a0 0x7f164406cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.517+0000 7f164a515640 1 -- 172.21.15.6:0/2092088729 >> v1:172.21.15.171:6789/0 conn(0x7f164406d430 legacy=0x7f16440d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.517+0000 7f164a515640 1 -- 172.21.15.6:0/2092088729 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164415f8b0 con 0x7f16440b3e40 2024-05-20T17:57:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.517+0000 7f1649d14640 1 --2- 172.21.15.6:0/2092088729 >> v2:172.21.15.171:3300/0 conn(0x7f164415f4a0 0x7f164406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.518+0000 7f164a515640 1 --2- 172.21.15.6:0/2092088729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16440b3e40 0x7f16440d4690 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f1644162f10 tx=0x7f163402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0cb7e6bbcc3587 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.518+0000 7f1649513640 1 -- 172.21.15.6:0/2092088729 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634037070 con 0x7f16440b3e40 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.518+0000 7f1649513640 1 -- 172.21.15.6:0/2092088729 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1634032440 con 0x7f16440b3e40 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.518+0000 7f1649513640 1 -- 172.21.15.6:0/2092088729 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634032810 con 0x7f16440b3e40 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.518+0000 7f164c779640 1 -- 172.21.15.6:0/2092088729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16440b3e40 msgr2=0x7f16440d4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.518+0000 7f164c779640 1 --2- 172.21.15.6:0/2092088729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16440b3e40 0x7f16440d4690 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f1644162f10 tx=0x7f163402a230 comp rx=0 tx=0).stop 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.519+0000 7f164c779640 1 -- 172.21.15.6:0/2092088729 shutdown_connections 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.519+0000 7f164c779640 1 --2- 172.21.15.6:0/2092088729 >> v2:172.21.15.171:3300/0 conn(0x7f164415f4a0 0x7f164406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.519+0000 7f164c779640 1 --2- 172.21.15.6:0/2092088729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16440b3e40 0x7f16440d4690 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.519+0000 7f164c779640 1 -- 172.21.15.6:0/2092088729 >> 172.21.15.6:0/2092088729 conn(0x7f16440d4bd0 msgr2=0x7f16440d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.519+0000 7f164c779640 1 -- 172.21.15.6:0/2092088729 shutdown_connections 2024-05-20T17:57:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.519+0000 7f164c779640 1 -- 172.21.15.6:0/2092088729 wait complete. 2024-05-20T17:57:42.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.521+0000 7f164c779640 1 Processor -- start 2024-05-20T17:57:42.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.521+0000 7f164c779640 1 -- start start 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164c779640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164406d430 0x7f16441e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164c779640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16440b3e40 0x7f16440c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164c779640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f164415f4a0 0x7f164414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164c779640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f16440d0270 con 0x7f164406d430 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164c779640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16440cff90 con 0x7f16440b3e40 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164c779640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16440d0550 con 0x7f164415f4a0 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164a515640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164406d430 0x7f16441e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164a515640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164406d430 0x7f16441e7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34426/0 (socket says 172.21.15.6:34426) 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164a515640 1 -- 172.21.15.6:0/3490588450 learned_addr learned my addr 172.21.15.6:0/3490588450 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f1649d14640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16440b3e40 0x7f16440c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164ad16640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f164415f4a0 0x7f164414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164a515640 1 -- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f164415f4a0 msgr2=0x7f164414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164a515640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f164415f4a0 0x7f164414b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164a515640 1 -- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16440b3e40 msgr2=0x7f16440c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164a515640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16440b3e40 0x7f16440c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f164a515640 1 -- 172.21.15.6:0/3490588450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16441e7f40 con 0x7f164406d430 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.522+0000 7f1649d14640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16440b3e40 0x7f16440c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.523+0000 7f164a515640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164406d430 0x7f16441e7a00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f163402a270 tx=0x7f16340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.523+0000 7f1642ffd640 1 -- 172.21.15.6:0/3490588450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634041070 con 0x7f164406d430 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.523+0000 7f1642ffd640 1 -- 172.21.15.6:0/3490588450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163403c870 con 0x7f164406d430 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.523+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1644149150 con 0x7f164406d430 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.523+0000 7f1642ffd640 1 -- 172.21.15.6:0/3490588450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634037040 con 0x7f164406d430 2024-05-20T17:57:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.523+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1644149710 con 0x7f164406d430 2024-05-20T17:57:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.524+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16440690b0 con 0x7f164406d430 2024-05-20T17:57:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.525+0000 7f1642ffd640 1 -- 172.21.15.6:0/3490588450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1634044070 con 0x7f164406d430 2024-05-20T17:57:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.525+0000 7f1642ffd640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f163006be30 0x7f163006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.525+0000 7f1642ffd640 1 -- 172.21.15.6:0/3490588450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f16340abc10 con 0x7f164406d430 2024-05-20T17:57:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.525+0000 7f1649d14640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f163006be30 0x7f163006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.526+0000 7f1649d14640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f163006be30 0x7f163006e340 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f16440d47b0 tx=0x7f16380074d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.530+0000 7f1642ffd640 1 -- 172.21.15.6:0/3490588450 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f164406d840 con 0x7f164406d430 2024-05-20T17:57:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.752+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f164415d090 con 0x7f164406d430 2024-05-20T17:57:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.752+0000 7f1642ffd640 1 -- 172.21.15.6:0/3490588450 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f163407a430 con 0x7f164406d430 2024-05-20T17:57:42.750 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:42.750 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:57:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f163006be30 msgr2=0x7f163006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f163006be30 0x7f163006e340 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f16440d47b0 tx=0x7f16380074d0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164406d430 msgr2=0x7f16441e7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164406d430 0x7f16441e7a00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f163402a270 tx=0x7f16340046c0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 shutdown_connections 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f163006be30 0x7f163006e340 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f164415f4a0 0x7f164414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16440b3e40 0x7f16440c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 --2- 172.21.15.6:0/3490588450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f164406d430 0x7f16441e7a00 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.754+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 >> 172.21.15.6:0/3490588450 conn(0x7f16440d4bd0 msgr2=0x7f164415c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.755+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 shutdown_connections 2024-05-20T17:57:42.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:42.755+0000 7f164c779640 1 -- 172.21.15.6:0/3490588450 wait complete. 2024-05-20T17:57:42.763 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:57:42.763 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:57:43.136 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:47.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:57:47.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.894+0000 7ff43abb7640 1 Processor -- start 2024-05-20T17:57:47.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.894+0000 7ff43abb7640 1 -- start start 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.895+0000 7ff43abb7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4340b81e0 0x7ff4340d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.895+0000 7ff43abb7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4340d13c0 0x7ff4340d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.895+0000 7ff43abb7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4340b41f0 con 0x7ff43408bba0 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.895+0000 7ff43abb7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff4340b3000 con 0x7ff4340d13c0 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.895+0000 7ff43abb7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff43408ce70 con 0x7ff4340b81e0 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.895+0000 7ff42bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4340d13c0 0x7ff4340d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.895+0000 7ff439154640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff43408bba0 0x7ff43408bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36694/0 (socket says 172.21.15.6:36694) 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.895+0000 7ff439154640 1 -- 172.21.15.6:0/227362237 learned_addr learned my addr 172.21.15.6:0/227362237 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:57:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.896+0000 7ff438953640 1 --2- 172.21.15.6:0/227362237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4340b81e0 0x7ff4340d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.896+0000 7ff42bfff640 1 -- 172.21.15.6:0/227362237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4340b81e0 msgr2=0x7ff4340d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.896+0000 7ff42bfff640 1 --2- 172.21.15.6:0/227362237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4340b81e0 0x7ff4340d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.896+0000 7ff42bfff640 1 -- 172.21.15.6:0/227362237 >> v1:172.21.15.6:6789/0 conn(0x7ff43408bba0 legacy=0x7ff43408bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.896+0000 7ff42b7fe640 1 -- 172.21.15.6:0/227362237 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288907445 0 0) 0x7ff4340b41f0 con 0x7ff43408bba0 2024-05-20T17:57:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.896+0000 7ff42bfff640 1 -- 172.21.15.6:0/227362237 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4340b2c90 con 0x7ff4340d13c0 2024-05-20T17:57:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.897+0000 7ff42bfff640 1 --2- 172.21.15.6:0/227362237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4340d17d0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff4240097a0 tx=0x7ff42402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f1ce422c752f63 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.897+0000 7ff42b7fe640 1 -- 172.21.15.6:0/227362237 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424037070 con 0x7ff4340d13c0 2024-05-20T17:57:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.897+0000 7ff42b7fe640 1 -- 172.21.15.6:0/227362237 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff424032440 con 0x7ff4340d13c0 2024-05-20T17:57:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.897+0000 7ff42b7fe640 1 -- 172.21.15.6:0/227362237 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424032810 con 0x7ff4340d13c0 2024-05-20T17:57:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.898+0000 7ff43abb7640 1 -- 172.21.15.6:0/227362237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 msgr2=0x7ff4340d17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.898+0000 7ff43abb7640 1 --2- 172.21.15.6:0/227362237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4340d17d0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff4240097a0 tx=0x7ff42402a180 comp rx=0 tx=0).stop 2024-05-20T17:57:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.898+0000 7ff43abb7640 1 -- 172.21.15.6:0/227362237 shutdown_connections 2024-05-20T17:57:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.898+0000 7ff43abb7640 1 --2- 172.21.15.6:0/227362237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4340d17d0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.898+0000 7ff43abb7640 1 --2- 172.21.15.6:0/227362237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff4340b81e0 0x7ff4340d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.898+0000 7ff43abb7640 1 -- 172.21.15.6:0/227362237 >> 172.21.15.6:0/227362237 conn(0x7ff4340b44f0 msgr2=0x7ff4340b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.898+0000 7ff43abb7640 1 -- 172.21.15.6:0/227362237 shutdown_connections 2024-05-20T17:57:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.898+0000 7ff43abb7640 1 -- 172.21.15.6:0/227362237 wait complete. 2024-05-20T17:57:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.900+0000 7ff43abb7640 1 Processor -- start 2024-05-20T17:57:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.900+0000 7ff43abb7640 1 -- start start 2024-05-20T17:57:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff43abb7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43408bba0 0x7ff4341d3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff43abb7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340b81e0 0x7ff4341d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff43abb7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4341e8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff43abb7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff4340b3490 con 0x7ff4340d13c0 2024-05-20T17:57:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff43abb7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff43408c6c0 con 0x7ff4340b81e0 2024-05-20T17:57:47.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff43abb7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff4341d7d00 con 0x7ff43408bba0 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff439154640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4341e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff439154640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4341e8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51140/0 (socket says 172.21.15.6:51140) 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff439154640 1 -- 172.21.15.6:0/2311878981 learned_addr learned my addr 172.21.15.6:0/2311878981 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.901+0000 7ff438953640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43408bba0 0x7ff4341d3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff42bfff640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340b81e0 0x7ff4341d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff439154640 1 -- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43408bba0 msgr2=0x7ff4341d3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff439154640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43408bba0 0x7ff4341d3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff439154640 1 -- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340b81e0 msgr2=0x7ff4341d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff439154640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340b81e0 0x7ff4341d29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff439154640 1 -- 172.21.15.6:0/2311878981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4341d2ee0 con 0x7ff4340d13c0 2024-05-20T17:57:47.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff439154640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4341e8300 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c700 tx=0x7ff42c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff4297fa640 1 -- 172.21.15.6:0/2311878981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c018070 con 0x7ff4340d13c0 2024-05-20T17:57:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff4297fa640 1 -- 172.21.15.6:0/2311878981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff42c00ce10 con 0x7ff4340d13c0 2024-05-20T17:57:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4341d43c0 con 0x7ff4340d13c0 2024-05-20T17:57:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff4297fa640 1 -- 172.21.15.6:0/2311878981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00a860 con 0x7ff4340d13c0 2024-05-20T17:57:47.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.902+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4341d4980 con 0x7ff4340d13c0 2024-05-20T17:57:47.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.903+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4340690b0 con 0x7ff4340d13c0 2024-05-20T17:57:47.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.904+0000 7ff4297fa640 1 -- 172.21.15.6:0/2311878981 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff42c00aa00 con 0x7ff4340d13c0 2024-05-20T17:57:47.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.904+0000 7ff4297fa640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff42006be30 0x7ff42006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:47.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.904+0000 7ff4297fa640 1 -- 172.21.15.6:0/2311878981 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7ff42c08a700 con 0x7ff4340d13c0 2024-05-20T17:57:47.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.905+0000 7ff438953640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff42006be30 0x7ff42006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:47.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.905+0000 7ff438953640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff42006be30 0x7ff42006e340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff434070430 tx=0x7ff430008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:47.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:47.909+0000 7ff4297fa640 1 -- 172.21.15.6:0/2311878981 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff42c058e10 con 0x7ff4340d13c0 2024-05-20T17:57:48.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.138+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff4340b24f0 con 0x7ff4340d13c0 2024-05-20T17:57:48.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.138+0000 7ff4297fa640 1 -- 172.21.15.6:0/2311878981 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ff42c058710 con 0x7ff4340d13c0 2024-05-20T17:57:48.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:48.137 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:57:48.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.140+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff42006be30 msgr2=0x7ff42006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:48.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.140+0000 7ff43abb7640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff42006be30 0x7ff42006e340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff434070430 tx=0x7ff430008040 comp rx=0 tx=0).stop 2024-05-20T17:57:48.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.140+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 msgr2=0x7ff4341e8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:48.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.140+0000 7ff43abb7640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4341e8300 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c700 tx=0x7ff42c00cbc0 comp rx=0 tx=0).stop 2024-05-20T17:57:48.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.141+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 shutdown_connections 2024-05-20T17:57:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.141+0000 7ff43abb7640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff42006be30 0x7ff42006e340 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.141+0000 7ff43abb7640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4340d13c0 0x7ff4341e8300 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.141+0000 7ff43abb7640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff4340b81e0 0x7ff4341d29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.141+0000 7ff43abb7640 1 --2- 172.21.15.6:0/2311878981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff43408bba0 0x7ff4341d3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.141+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 >> 172.21.15.6:0/2311878981 conn(0x7ff4340b44f0 msgr2=0x7ff4340b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.141+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 shutdown_connections 2024-05-20T17:57:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:48.141+0000 7ff43abb7640 1 -- 172.21.15.6:0/2311878981 wait complete. 2024-05-20T17:57:48.150 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:57:48.150 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:57:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:51.143 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:53.146 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:53.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:57:53.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.281+0000 7fdd833e3640 1 Processor -- start 2024-05-20T17:57:53.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.281+0000 7fdd833e3640 1 -- start start 2024-05-20T17:57:53.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.282+0000 7fdd833e3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdd7c1636f0 0x7fdd7c15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:53.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd833e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd7c15fc90 0x7fdd7c0d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:53.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd833e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c0d1bb0 0x7fdd7c0d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd833e3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7c0d1fc0 con 0x7fdd7c15fc90 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd833e3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7c162f10 con 0x7fdd7c1636f0 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd833e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7c160260 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8097e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd7c15fc90 0x7fdd7c0d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8097e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd7c15fc90 0x7fdd7c0d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51150/0 (socket says 172.21.15.6:51150) 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8097e640 1 -- 172.21.15.6:0/2094074265 learned_addr learned my addr 172.21.15.6:0/2094074265 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8117f640 1 --2- 172.21.15.6:0/2094074265 >> v2:172.21.15.171:3300/0 conn(0x7fdd7c1636f0 0x7fdd7c15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd81980640 1 --2- 172.21.15.6:0/2094074265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c0d1bb0 0x7fdd7c0d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8097e640 1 -- 172.21.15.6:0/2094074265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c0d1bb0 msgr2=0x7fdd7c0d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8097e640 1 --2- 172.21.15.6:0/2094074265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c0d1bb0 0x7fdd7c0d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8097e640 1 -- 172.21.15.6:0/2094074265 >> v2:172.21.15.171:3300/0 conn(0x7fdd7c1636f0 msgr2=0x7fdd7c15f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8097e640 1 --2- 172.21.15.6:0/2094074265 >> v2:172.21.15.171:3300/0 conn(0x7fdd7c1636f0 0x7fdd7c15f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8097e640 1 -- 172.21.15.6:0/2094074265 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c160540 con 0x7fdd7c15fc90 2024-05-20T17:57:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd8117f640 1 --2- 172.21.15.6:0/2094074265 >> v2:172.21.15.171:3300/0 conn(0x7fdd7c1636f0 0x7fdd7c15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.283+0000 7fdd81980640 1 --2- 172.21.15.6:0/2094074265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c0d1bb0 0x7fdd7c0d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:57:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.284+0000 7fdd8097e640 1 --2- 172.21.15.6:0/2094074265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c15fc90 0x7fdd7c0d1670 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c06e150 tx=0x7fdd6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce77f8711310939 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.284+0000 7fdd73fff640 1 -- 172.21.15.6:0/2094074265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c037070 con 0x7fdd7c15fc90 2024-05-20T17:57:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.284+0000 7fdd73fff640 1 -- 172.21.15.6:0/2094074265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6c032440 con 0x7fdd7c15fc90 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.284+0000 7fdd73fff640 1 -- 172.21.15.6:0/2094074265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c032810 con 0x7fdd7c15fc90 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 -- 172.21.15.6:0/2094074265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c15fc90 msgr2=0x7fdd7c0d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2094074265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c15fc90 0x7fdd7c0d1670 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c06e150 tx=0x7fdd6c02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 -- 172.21.15.6:0/2094074265 shutdown_connections 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2094074265 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c0d1bb0 0x7fdd7c0d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2094074265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c15fc90 0x7fdd7c0d1670 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2094074265 >> v2:172.21.15.171:3300/0 conn(0x7fdd7c1636f0 0x7fdd7c15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 -- 172.21.15.6:0/2094074265 >> 172.21.15.6:0/2094074265 conn(0x7fdd7c0b6790 msgr2=0x7fdd7c0b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 -- 172.21.15.6:0/2094074265 shutdown_connections 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.285+0000 7fdd833e3640 1 -- 172.21.15.6:0/2094074265 wait complete. 2024-05-20T17:57:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.287+0000 7fdd833e3640 1 Processor -- start 2024-05-20T17:57:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.287+0000 7fdd833e3640 1 -- start start 2024-05-20T17:57:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd833e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0d1bb0 0x7fdd7c155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd833e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c15fc90 0x7fdd7c0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd833e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd7c1636f0 0x7fdd7c0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd833e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c15d200 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd833e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c15d080 con 0x7fdd7c1636f0 2024-05-20T17:57:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd833e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7c0cfaa0 con 0x7fdd7c15fc90 2024-05-20T17:57:53.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd8117f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0d1bb0 0x7fdd7c155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd8117f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0d1bb0 0x7fdd7c155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51152/0 (socket says 172.21.15.6:51152) 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.288+0000 7fdd8117f640 1 -- 172.21.15.6:0/2516894779 learned_addr learned my addr 172.21.15.6:0/2516894779 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd8097e640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c15fc90 0x7fdd7c0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd81980640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd7c1636f0 0x7fdd7c0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd8117f640 1 -- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c15fc90 msgr2=0x7fdd7c0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd8117f640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c15fc90 0x7fdd7c0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd8117f640 1 -- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd7c1636f0 msgr2=0x7fdd7c0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd8117f640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd7c1636f0 0x7fdd7c0ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd8117f640 1 -- 172.21.15.6:0/2516894779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c156510 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd8117f640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0d1bb0 0x7fdd7c155fd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c7c0 tx=0x7fdd7800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:53.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd71ffb640 1 -- 172.21.15.6:0/2516894779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78015070 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd71ffb640 1 -- 172.21.15.6:0/2516894779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd78007820 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7c0cd840 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.289+0000 7fdd71ffb640 1 -- 172.21.15.6:0/2516894779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78007bf0 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.290+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7c0cca80 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.290+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd7c0690b0 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.291+0000 7fdd71ffb640 1 -- 172.21.15.6:0/2516894779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd78018070 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.292+0000 7fdd71ffb640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd6006be60 0x7fdd6006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.292+0000 7fdd71ffb640 1 -- 172.21.15.6:0/2516894779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fdd7808ae60 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.292+0000 7fdd8097e640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd6006be60 0x7fdd6006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.293+0000 7fdd8097e640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd6006be60 0x7fdd6006e370 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c034000 tx=0x7fdd6c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.296+0000 7fdd71ffb640 1 -- 172.21.15.6:0/2516894779 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdd7c156510 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.521+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdd7c0d3060 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.521+0000 7fdd71ffb640 1 -- 172.21.15.6:0/2516894779 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fdd78058f30 con 0x7fdd7c0d1bb0 2024-05-20T17:57:53.520 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:57:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd6006be60 msgr2=0x7fdd6006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd6006be60 0x7fdd6006e370 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c034000 tx=0x7fdd6c02e000 comp rx=0 tx=0).stop 2024-05-20T17:57:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0d1bb0 msgr2=0x7fdd7c155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0d1bb0 0x7fdd7c155fd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c7c0 tx=0x7fdd7800cc80 comp rx=0 tx=0).stop 2024-05-20T17:57:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 shutdown_connections 2024-05-20T17:57:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdd6006be60 0x7fdd6006e370 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd7c1636f0 0x7fdd7c0ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd7c15fc90 0x7fdd7c0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 --2- 172.21.15.6:0/2516894779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd7c0d1bb0 0x7fdd7c155fd0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 >> 172.21.15.6:0/2516894779 conn(0x7fdd7c0b6790 msgr2=0x7fdd7c0b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 shutdown_connections 2024-05-20T17:57:53.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:53.523+0000 7fdd833e3640 1 -- 172.21.15.6:0/2516894779 wait complete. 2024-05-20T17:57:53.533 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:57:53.533 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:57:55.148 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:57:58.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:57:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.664+0000 7fc077ee9640 1 Processor -- start 2024-05-20T17:57:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.665+0000 7fc077ee9640 1 -- start start 2024-05-20T17:57:58.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc077ee9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc070162f80 0x7fc07006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:58.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc077ee9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0700d0fc0 0x7fc07015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc077ee9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700b4480 0x7fc0700b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc077ee9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc07015f830 con 0x7fc0700d0fc0 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc077ee9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc0700b4dd0 con 0x7fc070162f80 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc077ee9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc070163480 con 0x7fc0700b4480 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc075484640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0700d0fc0 0x7fc07015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc075484640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0700d0fc0 0x7fc07015f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60248/0 (socket says 172.21.15.6:60248) 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.666+0000 7fc075484640 1 -- 172.21.15.6:0/2651799932 learned_addr learned my addr 172.21.15.6:0/2651799932 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.667+0000 7fc076486640 1 --2- 172.21.15.6:0/2651799932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700b4480 0x7fc0700b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.667+0000 7fc075c85640 1 --2- 172.21.15.6:0/2651799932 >> v2:172.21.15.171:3300/0 conn(0x7fc070162f80 0x7fc07006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.667+0000 7fc075484640 1 -- 172.21.15.6:0/2651799932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700b4480 msgr2=0x7fc0700b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.667+0000 7fc075484640 1 --2- 172.21.15.6:0/2651799932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700b4480 0x7fc0700b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.667+0000 7fc075484640 1 -- 172.21.15.6:0/2651799932 >> v2:172.21.15.171:3300/0 conn(0x7fc070162f80 msgr2=0x7fc07006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:57:58.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.667+0000 7fc075484640 1 --2- 172.21.15.6:0/2651799932 >> v2:172.21.15.171:3300/0 conn(0x7fc070162f80 0x7fc07006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.667+0000 7fc075484640 1 -- 172.21.15.6:0/2651799932 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc070163760 con 0x7fc0700d0fc0 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.667+0000 7fc075484640 1 --2- 172.21.15.6:0/2651799932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700d0fc0 0x7fc07015f2f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc0700719f0 tx=0x7fc06c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c002f4a98410caf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc074c83640 1 -- 172.21.15.6:0/2651799932 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c037070 con 0x7fc0700d0fc0 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc074c83640 1 -- 172.21.15.6:0/2651799932 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c032440 con 0x7fc0700d0fc0 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc074c83640 1 -- 172.21.15.6:0/2651799932 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c032810 con 0x7fc0700d0fc0 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc077ee9640 1 -- 172.21.15.6:0/2651799932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700d0fc0 msgr2=0x7fc07015f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc077ee9640 1 --2- 172.21.15.6:0/2651799932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700d0fc0 0x7fc07015f2f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc0700719f0 tx=0x7fc06c02a140 comp rx=0 tx=0).stop 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc077ee9640 1 -- 172.21.15.6:0/2651799932 shutdown_connections 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc077ee9640 1 --2- 172.21.15.6:0/2651799932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700b4480 0x7fc0700b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc077ee9640 1 --2- 172.21.15.6:0/2651799932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700d0fc0 0x7fc07015f2f0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc077ee9640 1 --2- 172.21.15.6:0/2651799932 >> v2:172.21.15.171:3300/0 conn(0x7fc070162f80 0x7fc07006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.668+0000 7fc077ee9640 1 -- 172.21.15.6:0/2651799932 >> 172.21.15.6:0/2651799932 conn(0x7fc0700cf480 msgr2=0x7fc0700cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.669+0000 7fc077ee9640 1 -- 172.21.15.6:0/2651799932 shutdown_connections 2024-05-20T17:57:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.669+0000 7fc077ee9640 1 -- 172.21.15.6:0/2651799932 wait complete. 2024-05-20T17:57:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.670+0000 7fc077ee9640 1 Processor -- start 2024-05-20T17:57:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.670+0000 7fc077ee9640 1 -- start start 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc077ee9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700b4480 0x7fc0700b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc077ee9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700d0fc0 0x7fc070162460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc077ee9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070162f80 0x7fc0701e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc077ee9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700cd710 con 0x7fc0700b4480 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc077ee9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc070163d20 con 0x7fc070162f80 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc077ee9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc0700cd890 con 0x7fc0700d0fc0 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700b4480 0x7fc0700b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700b4480 0x7fc0700b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60254/0 (socket says 172.21.15.6:60254) 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 -- 172.21.15.6:0/3611095485 learned_addr learned my addr 172.21.15.6:0/3611095485 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc076486640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070162f80 0x7fc0701e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075484640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700d0fc0 0x7fc070162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 -- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700d0fc0 msgr2=0x7fc070162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700d0fc0 0x7fc070162460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 -- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070162f80 msgr2=0x7fc0701e91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070162f80 0x7fc0701e91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 -- 172.21.15.6:0/3611095485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0700b8410 con 0x7fc0700b4480 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.672+0000 7fc075c85640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700b4480 0x7fc0700b7d60 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc06400d620 tx=0x7fc06400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.673+0000 7fc0627fc640 1 -- 172.21.15.6:0/3611095485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06400b620 con 0x7fc0700b4480 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.673+0000 7fc0627fc640 1 -- 172.21.15.6:0/3611095485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc064019070 con 0x7fc0700b4480 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.673+0000 7fc0627fc640 1 -- 172.21.15.6:0/3611095485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06400ba00 con 0x7fc0700b4480 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.673+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0700b60b0 con 0x7fc0700b4480 2024-05-20T17:57:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.673+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0700b6630 con 0x7fc0700b4480 2024-05-20T17:57:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.674+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0700690b0 con 0x7fc0700b4480 2024-05-20T17:57:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.675+0000 7fc0627fc640 1 -- 172.21.15.6:0/3611095485 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc06400bba0 con 0x7fc0700b4480 2024-05-20T17:57:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.675+0000 7fc0627fc640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc05406be60 0x7fc05406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:57:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.675+0000 7fc0627fc640 1 -- 172.21.15.6:0/3611095485 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fc06408b2f0 con 0x7fc0700b4480 2024-05-20T17:57:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.675+0000 7fc075484640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc05406be60 0x7fc05406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:57:58.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.676+0000 7fc075484640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc05406be60 0x7fc05406e370 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc06c034000 tx=0x7fc06c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:57:58.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.680+0000 7fc0627fc640 1 -- 172.21.15.6:0/3611095485 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc0700b60b0 con 0x7fc0700b4480 2024-05-20T17:57:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.905+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc0700b8630 con 0x7fc0700b4480 2024-05-20T17:57:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.905+0000 7fc0627fc640 1 -- 172.21.15.6:0/3611095485 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fc064059450 con 0x7fc0700b4480 2024-05-20T17:57:58.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:57:58.904 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:57:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc05406be60 msgr2=0x7fc05406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc05406be60 0x7fc05406e370 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc06c034000 tx=0x7fc06c02e000 comp rx=0 tx=0).stop 2024-05-20T17:57:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700b4480 msgr2=0x7fc0700b7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:57:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700b4480 0x7fc0700b7d60 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc06400d620 tx=0x7fc06400dae0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 shutdown_connections 2024-05-20T17:57:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc05406be60 0x7fc05406e370 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc070162f80 0x7fc0701e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0700d0fc0 0x7fc070162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 --2- 172.21.15.6:0/3611095485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0700b4480 0x7fc0700b7d60 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:57:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 >> 172.21.15.6:0/3611095485 conn(0x7fc0700cf480 msgr2=0x7fc0700b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:57:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 shutdown_connections 2024-05-20T17:57:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:57:58.907+0000 7fc077ee9640 1 -- 172.21.15.6:0/3611095485 wait complete. 2024-05-20T17:57:58.917 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:57:58.917 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:57:59.152 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:01.154 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:03.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.048+0000 7fca482a2640 1 Processor -- start 2024-05-20T17:58:04.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.048+0000 7fca482a2640 1 -- start start 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca482a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca400d4120 0x7fca400d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca482a2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca400d5440 con 0x7fca400d5030 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca482a2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca40160380 con 0x7fca4015fe30 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca482a2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fca40160660 con 0x7fca400d4120 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca4603e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fca400d4120 0x7fca400d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca4583d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fca400d5030 0x7fca4015f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38182/0 (socket says 172.21.15.6:38182) 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca4583d640 1 -- 172.21.15.6:0/1692532750 learned_addr learned my addr 172.21.15.6:0/1692532750 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca4503c640 1 -- 172.21.15.6:0/1692532750 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394628684 0 0) 0x7fca34001110 con 0x7fca400d5030 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca4503c640 1 -- 172.21.15.6:0/1692532750 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca2c003520 con 0x7fca400d5030 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca4603e640 1 -- 172.21.15.6:0/1692532750 >> v1:172.21.15.171:6789/0 conn(0x7fca4015fe30 legacy=0x7fca40160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca4603e640 1 -- 172.21.15.6:0/1692532750 >> v1:172.21.15.6:6789/0 conn(0x7fca400d5030 legacy=0x7fca4015f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.050+0000 7fca4603e640 1 -- 172.21.15.6:0/1692532750 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca400d3640 con 0x7fca400d4120 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.051+0000 7fca4603e640 1 --2- 172.21.15.6:0/1692532750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d4120 0x7fca400d4af0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0097a0 tx=0x7fca3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f64fb11bfdf39c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.051+0000 7fca4503c640 1 -- 172.21.15.6:0/1692532750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c037070 con 0x7fca400d4120 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.051+0000 7fca4503c640 1 -- 172.21.15.6:0/1692532750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3c032440 con 0x7fca400d4120 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.051+0000 7fca4503c640 1 -- 172.21.15.6:0/1692532750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c032810 con 0x7fca400d4120 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.052+0000 7fca482a2640 1 -- 172.21.15.6:0/1692532750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d4120 msgr2=0x7fca400d4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.052+0000 7fca482a2640 1 --2- 172.21.15.6:0/1692532750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d4120 0x7fca400d4af0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0097a0 tx=0x7fca3c02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.052+0000 7fca482a2640 1 -- 172.21.15.6:0/1692532750 shutdown_connections 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.052+0000 7fca482a2640 1 --2- 172.21.15.6:0/1692532750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d4120 0x7fca400d4af0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.052+0000 7fca482a2640 1 -- 172.21.15.6:0/1692532750 >> 172.21.15.6:0/1692532750 conn(0x7fca4006b520 msgr2=0x7fca4006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.052+0000 7fca482a2640 1 -- 172.21.15.6:0/1692532750 shutdown_connections 2024-05-20T17:58:04.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.052+0000 7fca482a2640 1 -- 172.21.15.6:0/1692532750 wait complete. 2024-05-20T17:58:04.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.054+0000 7fca482a2640 1 Processor -- start 2024-05-20T17:58:04.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.054+0000 7fca482a2640 1 -- start start 2024-05-20T17:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.055+0000 7fca482a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca400d4120 0x7fca40156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.055+0000 7fca482a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d5030 0x7fca4015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.055+0000 7fca482a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca4015fe30 0x7fca40157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.055+0000 7fca482a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fca400d4530 con 0x7fca400d5030 2024-05-20T17:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.055+0000 7fca482a2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fca400d31a0 con 0x7fca400d4120 2024-05-20T17:58:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.055+0000 7fca482a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fca400d46b0 con 0x7fca4015fe30 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d5030 0x7fca4015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d5030 0x7fca4015b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60274/0 (socket says 172.21.15.6:60274) 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 -- 172.21.15.6:0/2911480372 learned_addr learned my addr 172.21.15.6:0/2911480372 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4603e640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca400d4120 0x7fca40156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 -- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca4015fe30 msgr2=0x7fca40157510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca4015fe30 0x7fca40157510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 -- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca400d4120 msgr2=0x7fca40156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca400d4120 0x7fca40156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 -- 172.21.15.6:0/2911480372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca401e7330 con 0x7fca400d5030 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4603e640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca400d4120 0x7fca40156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca4583d640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d5030 0x7fca4015b240 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c3d0 tx=0x7fca3400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca32ffd640 1 -- 172.21.15.6:0/2911480372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34017070 con 0x7fca400d5030 2024-05-20T17:58:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca32ffd640 1 -- 172.21.15.6:0/2911480372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca34005ce0 con 0x7fca400d5030 2024-05-20T17:58:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca401e7610 con 0x7fca400d5030 2024-05-20T17:58:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca32ffd640 1 -- 172.21.15.6:0/2911480372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34007310 con 0x7fca400d5030 2024-05-20T17:58:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.056+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca401e7bd0 con 0x7fca400d5030 2024-05-20T17:58:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.057+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca400690b0 con 0x7fca400d5030 2024-05-20T17:58:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.058+0000 7fca32ffd640 1 -- 172.21.15.6:0/2911480372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca3401a070 con 0x7fca400d5030 2024-05-20T17:58:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.058+0000 7fca32ffd640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca2406be60 0x7fca2406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.058+0000 7fca32ffd640 1 -- 172.21.15.6:0/2911480372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fca3408a4d0 con 0x7fca400d5030 2024-05-20T17:58:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.060+0000 7fca4603e640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca2406be60 0x7fca2406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:04.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.061+0000 7fca4603e640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca2406be60 0x7fca2406e370 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fca3c034000 tx=0x7fca3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:04.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.063+0000 7fca32ffd640 1 -- 172.21.15.6:0/2911480372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fca400d5440 con 0x7fca400d5030 2024-05-20T17:58:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.285+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fca4015bcc0 con 0x7fca400d5030 2024-05-20T17:58:04.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.285+0000 7fca32ffd640 1 -- 172.21.15.6:0/2911480372 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fca34058bf0 con 0x7fca400d5030 2024-05-20T17:58:04.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:04.284 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca2406be60 msgr2=0x7fca2406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca2406be60 0x7fca2406e370 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fca3c034000 tx=0x7fca3c02e000 comp rx=0 tx=0).stop 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d5030 msgr2=0x7fca4015b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d5030 0x7fca4015b240 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c3d0 tx=0x7fca3400c890 comp rx=0 tx=0).stop 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 shutdown_connections 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fca2406be60 0x7fca2406e370 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca4015fe30 0x7fca40157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca400d5030 0x7fca4015b240 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:04.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 --2- 172.21.15.6:0/2911480372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca400d4120 0x7fca40156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:04.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 >> 172.21.15.6:0/2911480372 conn(0x7fca4006b520 msgr2=0x7fca400cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:04.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 shutdown_connections 2024-05-20T17:58:04.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:04.287+0000 7fca482a2640 1 -- 172.21.15.6:0/2911480372 wait complete. 2024-05-20T17:58:04.297 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:04.297 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:06.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:58:06.483 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:58:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:09.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.428+0000 7f2e98577640 1 Processor -- start 2024-05-20T17:58:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.428+0000 7f2e98577640 1 -- start start 2024-05-20T17:58:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e98577640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2e90162f80 0x7f2e9006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e98577640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e900d0fc0 0x7f2e9015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e98577640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4480 0x7f2e900b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e98577640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f2e9015f830 con 0x7f2e900d0fc0 2024-05-20T17:58:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e98577640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2e900b4dd0 con 0x7f2e90162f80 2024-05-20T17:58:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e98577640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2e90163480 con 0x7f2e900b4480 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e95b12640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e900d0fc0 0x7f2e9015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e95b12640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e900d0fc0 0x7f2e9015f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48392/0 (socket says 172.21.15.6:48392) 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e95b12640 1 -- 172.21.15.6:0/2652769184 learned_addr learned my addr 172.21.15.6:0/2652769184 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e96313640 1 --2- 172.21.15.6:0/2652769184 >> v2:172.21.15.171:3300/0 conn(0x7f2e90162f80 0x7f2e9006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e96b14640 1 --2- 172.21.15.6:0/2652769184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4480 0x7f2e900b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e95b12640 1 -- 172.21.15.6:0/2652769184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4480 msgr2=0x7f2e900b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e95b12640 1 --2- 172.21.15.6:0/2652769184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4480 0x7f2e900b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e95b12640 1 -- 172.21.15.6:0/2652769184 >> v2:172.21.15.171:3300/0 conn(0x7f2e90162f80 msgr2=0x7f2e9006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e95b12640 1 --2- 172.21.15.6:0/2652769184 >> v2:172.21.15.171:3300/0 conn(0x7f2e90162f80 0x7f2e9006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e95b12640 1 -- 172.21.15.6:0/2652769184 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e90163760 con 0x7f2e900d0fc0 2024-05-20T17:58:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.430+0000 7f2e96313640 1 --2- 172.21.15.6:0/2652769184 >> v2:172.21.15.171:3300/0 conn(0x7f2e90162f80 0x7f2e9006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:58:09.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.431+0000 7f2e95b12640 1 --2- 172.21.15.6:0/2652769184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900d0fc0 0x7f2e9015f2f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2e900719f0 tx=0x7f2e8402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9461a470dc287d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:09.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.431+0000 7f2e95311640 1 -- 172.21.15.6:0/2652769184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84037070 con 0x7f2e900d0fc0 2024-05-20T17:58:09.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.431+0000 7f2e95311640 1 -- 172.21.15.6:0/2652769184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e84032440 con 0x7f2e900d0fc0 2024-05-20T17:58:09.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.431+0000 7f2e95311640 1 -- 172.21.15.6:0/2652769184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84032810 con 0x7f2e900d0fc0 2024-05-20T17:58:09.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 -- 172.21.15.6:0/2652769184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900d0fc0 msgr2=0x7f2e9015f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 --2- 172.21.15.6:0/2652769184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900d0fc0 0x7f2e9015f2f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f2e900719f0 tx=0x7f2e8402a140 comp rx=0 tx=0).stop 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 -- 172.21.15.6:0/2652769184 shutdown_connections 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 --2- 172.21.15.6:0/2652769184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e900b4480 0x7f2e900b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 --2- 172.21.15.6:0/2652769184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900d0fc0 0x7f2e9015f2f0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 --2- 172.21.15.6:0/2652769184 >> v2:172.21.15.171:3300/0 conn(0x7f2e90162f80 0x7f2e9006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 -- 172.21.15.6:0/2652769184 >> 172.21.15.6:0/2652769184 conn(0x7f2e900cf480 msgr2=0x7f2e900cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 -- 172.21.15.6:0/2652769184 shutdown_connections 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.432+0000 7f2e98577640 1 -- 172.21.15.6:0/2652769184 wait complete. 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.434+0000 7f2e98577640 1 Processor -- start 2024-05-20T17:58:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.434+0000 7f2e98577640 1 -- start start 2024-05-20T17:58:09.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.435+0000 7f2e98577640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900b4480 0x7f2e901f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:09.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.435+0000 7f2e98577640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900d0fc0 0x7f2e901e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:09.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.435+0000 7f2e98577640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e90162f80 0x7f2e901e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:09.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.435+0000 7f2e98577640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900cd710 con 0x7f2e900b4480 2024-05-20T17:58:09.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.435+0000 7f2e98577640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90163d20 con 0x7f2e900d0fc0 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.435+0000 7f2e98577640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2e900cd890 con 0x7f2e90162f80 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900b4480 0x7f2e901f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900b4480 0x7f2e901f52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48394/0 (socket says 172.21.15.6:48394) 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 -- 172.21.15.6:0/1798696273 learned_addr learned my addr 172.21.15.6:0/1798696273 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e95b12640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900d0fc0 0x7f2e901e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96b14640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e90162f80 0x7f2e901e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 -- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e90162f80 msgr2=0x7f2e901e92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e90162f80 0x7f2e901e92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 -- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900d0fc0 msgr2=0x7f2e901e8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900d0fc0 0x7f2e901e8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 -- 172.21.15.6:0/1798696273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e901f5830 con 0x7f2e900b4480 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e96313640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900b4480 0x7f2e901f52f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c007f20 tx=0x7f2e8c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e82ffd640 1 -- 172.21.15.6:0/1798696273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c01a070 con 0x7f2e900b4480 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e82ffd640 1 -- 172.21.15.6:0/1798696273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c003b90 con 0x7f2e900b4480 2024-05-20T17:58:09.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e82ffd640 1 -- 172.21.15.6:0/1798696273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c004030 con 0x7f2e900b4480 2024-05-20T17:58:09.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e900b6360 con 0x7f2e900b4480 2024-05-20T17:58:09.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.436+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e900b6920 con 0x7f2e900b4480 2024-05-20T17:58:09.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.437+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e900690b0 con 0x7f2e900b4480 2024-05-20T17:58:09.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.438+0000 7f2e82ffd640 1 -- 172.21.15.6:0/1798696273 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e8c01d070 con 0x7f2e900b4480 2024-05-20T17:58:09.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.439+0000 7f2e82ffd640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e7406be60 0x7f2e7406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:09.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.439+0000 7f2e82ffd640 1 -- 172.21.15.6:0/1798696273 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f2e8c08b280 con 0x7f2e900b4480 2024-05-20T17:58:09.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.439+0000 7f2e95b12640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e7406be60 0x7f2e7406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:09.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.439+0000 7f2e95b12640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e7406be60 0x7f2e7406e370 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2e84034000 tx=0x7f2e8402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:09.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.443+0000 7f2e82ffd640 1 -- 172.21.15.6:0/1798696273 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2e8c010070 con 0x7f2e900b4480 2024-05-20T17:58:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.665+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e900b8630 con 0x7f2e900b4480 2024-05-20T17:58:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.666+0000 7f2e82ffd640 1 -- 172.21.15.6:0/1798696273 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f2e8c0592b0 con 0x7f2e900b4480 2024-05-20T17:58:09.664 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:09.664 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e7406be60 msgr2=0x7f2e7406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e7406be60 0x7f2e7406e370 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2e84034000 tx=0x7f2e8402e000 comp rx=0 tx=0).stop 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900b4480 msgr2=0x7f2e901f52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900b4480 0x7f2e901f52f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c007f20 tx=0x7f2e8c00d560 comp rx=0 tx=0).stop 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 shutdown_connections 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2e7406be60 0x7f2e7406e370 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2e90162f80 0x7f2e901e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e900d0fc0 0x7f2e901e8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 --2- 172.21.15.6:0/1798696273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e900b4480 0x7f2e901f52f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 >> 172.21.15.6:0/1798696273 conn(0x7f2e900cf480 msgr2=0x7f2e900b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 shutdown_connections 2024-05-20T17:58:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:09.668+0000 7f2e98577640 1 -- 172.21.15.6:0/1798696273 wait complete. 2024-05-20T17:58:09.678 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:09.678 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:11.165 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:13.167 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:14.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:14.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.808+0000 7f56eca5f640 1 Processor -- start 2024-05-20T17:58:14.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.808+0000 7f56eca5f640 1 -- start start 2024-05-20T17:58:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56eca5f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e815f520 0x7f56e806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56eca5f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56e80b4b90 0x7f56e80d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56eca5f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e80b20c0 con 0x7f56e80d0af0 2024-05-20T17:58:14.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56eca5f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f56e8163e80 con 0x7f56e80b4b90 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56eca5f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56e81639f0 con 0x7f56e815f520 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56e6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56e80b4b90 0x7f56e80d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56e6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56e80b4b90 0x7f56e80d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48398/0 (socket says 172.21.15.6:48398) 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56e6d9d640 1 -- 172.21.15.6:0/878467672 learned_addr learned my addr 172.21.15.6:0/878467672 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.810+0000 7f56e659c640 1 --2- 172.21.15.6:0/878467672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e815f520 0x7f56e806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.811+0000 7f56e6d9d640 1 -- 172.21.15.6:0/878467672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e815f520 msgr2=0x7f56e806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.811+0000 7f56e6d9d640 1 --2- 172.21.15.6:0/878467672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e815f520 0x7f56e806c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.811+0000 7f56e6d9d640 1 -- 172.21.15.6:0/878467672 >> v1:172.21.15.171:6789/0 conn(0x7f56e80d0af0 legacy=0x7f56e80b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.811+0000 7f56e6d9d640 1 -- 172.21.15.6:0/878467672 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e80d11f0 con 0x7f56e80b4b90 2024-05-20T17:58:14.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.811+0000 7f56e659c640 1 --2- 172.21.15.6:0/878467672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e815f520 0x7f56e806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:58:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.811+0000 7f56e6d9d640 1 --2- 172.21.15.6:0/878467672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e80b4b90 0x7f56e80d1480 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009870 tx=0x7f56e002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5c0d86598971b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:14.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56e559a640 1 -- 172.21.15.6:0/878467672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0037070 con 0x7f56e80b4b90 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56e559a640 1 -- 172.21.15.6:0/878467672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0032440 con 0x7f56e80b4b90 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56e559a640 1 -- 172.21.15.6:0/878467672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0032810 con 0x7f56e80b4b90 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56eca5f640 1 -- 172.21.15.6:0/878467672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e80b4b90 msgr2=0x7f56e80d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56eca5f640 1 --2- 172.21.15.6:0/878467672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e80b4b90 0x7f56e80d1480 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009870 tx=0x7f56e002a130 comp rx=0 tx=0).stop 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56eca5f640 1 -- 172.21.15.6:0/878467672 shutdown_connections 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56eca5f640 1 --2- 172.21.15.6:0/878467672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e80b4b90 0x7f56e80d1480 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56eca5f640 1 --2- 172.21.15.6:0/878467672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e815f520 0x7f56e806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56eca5f640 1 -- 172.21.15.6:0/878467672 >> 172.21.15.6:0/878467672 conn(0x7f56e80cf480 msgr2=0x7f56e80cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56eca5f640 1 -- 172.21.15.6:0/878467672 shutdown_connections 2024-05-20T17:58:14.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.812+0000 7f56eca5f640 1 -- 172.21.15.6:0/878467672 wait complete. 2024-05-20T17:58:14.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.814+0000 7f56eca5f640 1 Processor -- start 2024-05-20T17:58:14.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.814+0000 7f56eca5f640 1 -- start start 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56eca5f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e80d0af0 0x7f56e815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56eca5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e815f520 0x7f56e8150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56eca5f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e80b7f50 0x7f56e8150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56eca5f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8163680 con 0x7f56e815f520 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56eca5f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81633a0 con 0x7f56e80b7f50 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56eca5f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56e80d0f00 con 0x7f56e80d0af0 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e815f520 0x7f56e8150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e815f520 0x7f56e8150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48402/0 (socket says 172.21.15.6:48402) 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 -- 172.21.15.6:0/3305047927 learned_addr learned my addr 172.21.15.6:0/3305047927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e659c640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e80d0af0 0x7f56e815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:14.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e6d9d640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e80b7f50 0x7f56e8150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 -- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e80d0af0 msgr2=0x7f56e815e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e80d0af0 0x7f56e815e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 -- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e80b7f50 msgr2=0x7f56e8150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e80b7f50 0x7f56e8150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 -- 172.21.15.6:0/3305047927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e8153db0 con 0x7f56e815f520 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.816+0000 7f56e5d9b640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e815f520 0x7f56e8150a70 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c3f0 tx=0x7f56d800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.817+0000 7f56deffd640 1 -- 172.21.15.6:0/3305047927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d80052d0 con 0x7f56e815f520 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.817+0000 7f56deffd640 1 -- 172.21.15.6:0/3305047927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d8005490 con 0x7f56e815f520 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.817+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e80b6eb0 con 0x7f56e815f520 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.817+0000 7f56deffd640 1 -- 172.21.15.6:0/3305047927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8007260 con 0x7f56e815f520 2024-05-20T17:58:14.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.817+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e80b7470 con 0x7f56e815f520 2024-05-20T17:58:14.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.818+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e80b6c20 con 0x7f56e815f520 2024-05-20T17:58:14.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.818+0000 7f56deffd640 1 -- 172.21.15.6:0/3305047927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56d8007400 con 0x7f56e815f520 2024-05-20T17:58:14.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.819+0000 7f56deffd640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c806be30 0x7f56c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.819+0000 7f56deffd640 1 -- 172.21.15.6:0/3305047927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f56d808a450 con 0x7f56e815f520 2024-05-20T17:58:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.819+0000 7f56e659c640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c806be30 0x7f56c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:14.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.820+0000 7f56e659c640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c806be30 0x7f56c806e340 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f56e80cecb0 tx=0x7f56d0009870 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:14.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:14.824+0000 7f56deffd640 1 -- 172.21.15.6:0/3305047927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f56e80b20c0 con 0x7f56e815f520 2024-05-20T17:58:15.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.046+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f56e80690b0 con 0x7f56e815f520 2024-05-20T17:58:15.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.046+0000 7f56deffd640 1 -- 172.21.15.6:0/3305047927 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f56d80585a0 con 0x7f56e815f520 2024-05-20T17:58:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:15.045 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c806be30 msgr2=0x7f56c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c806be30 0x7f56c806e340 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f56e80cecb0 tx=0x7f56d0009870 comp rx=0 tx=0).stop 2024-05-20T17:58:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e815f520 msgr2=0x7f56e8150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e815f520 0x7f56e8150a70 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c3f0 tx=0x7f56d800c7f0 comp rx=0 tx=0).stop 2024-05-20T17:58:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 shutdown_connections 2024-05-20T17:58:15.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f56c806be30 0x7f56c806e340 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56e80b7f50 0x7f56e8150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56e815f520 0x7f56e8150a70 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 --2- 172.21.15.6:0/3305047927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56e80d0af0 0x7f56e815e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 >> 172.21.15.6:0/3305047927 conn(0x7f56e80cf480 msgr2=0x7f56e80b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 shutdown_connections 2024-05-20T17:58:15.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:15.049+0000 7f56eca5f640 1 -- 172.21.15.6:0/3305047927 wait complete. 2024-05-20T17:58:15.059 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:15.059 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:15.169 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:20.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:20.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.190+0000 7fe5698e2640 1 Processor -- start 2024-05-20T17:58:20.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.190+0000 7fe5698e2640 1 -- start start 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5698e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5640cf8c0 0x7fe56415d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5698e2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe56415dd90 0x7fe564166c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5698e2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56415d470 con 0x7fe56406e760 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5698e2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe56406bf30 con 0x7fe56415dd90 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5698e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe56406c180 con 0x7fe5640cf8c0 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5637fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe56415dd90 0x7fe564166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe562ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe56406e760 0x7fe56406eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34848/0 (socket says 172.21.15.6:34848) 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe562ffd640 1 -- 172.21.15.6:0/3286587495 learned_addr learned my addr 172.21.15.6:0/3286587495 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5627fc640 1 --2- 172.21.15.6:0/3286587495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5640cf8c0 0x7fe56415d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5637fe640 1 -- 172.21.15.6:0/3286587495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5640cf8c0 msgr2=0x7fe56415d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5637fe640 1 --2- 172.21.15.6:0/3286587495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5640cf8c0 0x7fe56415d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5637fe640 1 -- 172.21.15.6:0/3286587495 >> v1:172.21.15.6:6789/0 conn(0x7fe56406e760 legacy=0x7fe56406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe561ffb640 1 -- 172.21.15.6:0/3286587495 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514535292 0 0) 0x7fe56415d470 con 0x7fe56406e760 2024-05-20T17:58:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.192+0000 7fe5637fe640 1 -- 172.21.15.6:0/3286587495 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56406c460 con 0x7fe56415dd90 2024-05-20T17:58:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.193+0000 7fe5637fe640 1 --2- 172.21.15.6:0/3286587495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56415dd90 0x7fe564166c20 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009d90 tx=0x7fe55c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995f4f229b0e31fc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.193+0000 7fe561ffb640 1 -- 172.21.15.6:0/3286587495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c007740 con 0x7fe56415dd90 2024-05-20T17:58:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.193+0000 7fe561ffb640 1 -- 172.21.15.6:0/3286587495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c0078e0 con 0x7fe56415dd90 2024-05-20T17:58:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.193+0000 7fe561ffb640 1 -- 172.21.15.6:0/3286587495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c007cb0 con 0x7fe56415dd90 2024-05-20T17:58:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.194+0000 7fe5698e2640 1 -- 172.21.15.6:0/3286587495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56415dd90 msgr2=0x7fe564166c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.194+0000 7fe5698e2640 1 --2- 172.21.15.6:0/3286587495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56415dd90 0x7fe564166c20 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009d90 tx=0x7fe55c02a660 comp rx=0 tx=0).stop 2024-05-20T17:58:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.194+0000 7fe5698e2640 1 -- 172.21.15.6:0/3286587495 shutdown_connections 2024-05-20T17:58:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.194+0000 7fe5698e2640 1 --2- 172.21.15.6:0/3286587495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56415dd90 0x7fe564166c20 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.194+0000 7fe5698e2640 1 --2- 172.21.15.6:0/3286587495 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe5640cf8c0 0x7fe56415d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.194+0000 7fe5698e2640 1 -- 172.21.15.6:0/3286587495 >> 172.21.15.6:0/3286587495 conn(0x7fe5640cd2a0 msgr2=0x7fe5640cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.194+0000 7fe5698e2640 1 -- 172.21.15.6:0/3286587495 shutdown_connections 2024-05-20T17:58:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.194+0000 7fe5698e2640 1 -- 172.21.15.6:0/3286587495 wait complete. 2024-05-20T17:58:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.196+0000 7fe5698e2640 1 Processor -- start 2024-05-20T17:58:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.196+0000 7fe5698e2640 1 -- start start 2024-05-20T17:58:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe5698e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56406e760 0x7fe5640b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe5698e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5640cf8c0 0x7fe5640b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe5698e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56415dd90 0x7fe564148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe5698e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe56415e1a0 con 0x7fe56406e760 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe5698e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe56406ca20 con 0x7fe5640cf8c0 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe5698e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe56415e320 con 0x7fe56415dd90 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56406e760 0x7fe5640b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56406e760 0x7fe5640b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38504/0 (socket says 172.21.15.6:38504) 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 -- 172.21.15.6:0/1804130144 learned_addr learned my addr 172.21.15.6:0/1804130144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe5637fe640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56415dd90 0x7fe564148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe5627fc640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5640cf8c0 0x7fe5640b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 -- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56415dd90 msgr2=0x7fe564148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56415dd90 0x7fe564148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 -- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5640cf8c0 msgr2=0x7fe5640b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5640cf8c0 0x7fe5640b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 -- 172.21.15.6:0/1804130144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5640b42c0 con 0x7fe56406e760 2024-05-20T17:58:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe562ffd640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56406e760 0x7fe5640b3950 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c430 tx=0x7fe55400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe54bfff640 1 -- 172.21.15.6:0/1804130144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554017070 con 0x7fe56406e760 2024-05-20T17:58:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe54bfff640 1 -- 172.21.15.6:0/1804130144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe554005ce0 con 0x7fe56406e760 2024-05-20T17:58:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.198+0000 7fe54bfff640 1 -- 172.21.15.6:0/1804130144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554007310 con 0x7fe56406e760 2024-05-20T17:58:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.199+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5640b45a0 con 0x7fe56406e760 2024-05-20T17:58:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.199+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5640b4b60 con 0x7fe56406e760 2024-05-20T17:58:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.200+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5640690b0 con 0x7fe56406e760 2024-05-20T17:58:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.200+0000 7fe54bfff640 1 -- 172.21.15.6:0/1804130144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe55401a070 con 0x7fe56406e760 2024-05-20T17:58:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.201+0000 7fe54bfff640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe55006be30 0x7fe55006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.201+0000 7fe54bfff640 1 -- 172.21.15.6:0/1804130144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fe55408a4d0 con 0x7fe56406e760 2024-05-20T17:58:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.201+0000 7fe5627fc640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe55006be30 0x7fe55006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.201+0000 7fe5627fc640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe55006be30 0x7fe55006e340 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe558006fd0 tx=0x7fe558008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.206+0000 7fe54bfff640 1 -- 172.21.15.6:0/1804130144 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe554058bf0 con 0x7fe56406e760 2024-05-20T17:58:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.426+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe564070730 con 0x7fe56406e760 2024-05-20T17:58:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.427+0000 7fe54bfff640 1 -- 172.21.15.6:0/1804130144 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fe5540584f0 con 0x7fe56406e760 2024-05-20T17:58:20.426 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:20.426 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe55006be30 msgr2=0x7fe55006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe55006be30 0x7fe55006e340 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe558006fd0 tx=0x7fe558008040 comp rx=0 tx=0).stop 2024-05-20T17:58:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56406e760 msgr2=0x7fe5640b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56406e760 0x7fe5640b3950 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c430 tx=0x7fe55400c8f0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 shutdown_connections 2024-05-20T17:58:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe55006be30 0x7fe55006e340 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56415dd90 0x7fe564148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5640cf8c0 0x7fe5640b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 --2- 172.21.15.6:0/1804130144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56406e760 0x7fe5640b3950 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 >> 172.21.15.6:0/1804130144 conn(0x7fe5640cd2a0 msgr2=0x7fe56406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 shutdown_connections 2024-05-20T17:58:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:20.429+0000 7fe5698e2640 1 -- 172.21.15.6:0/1804130144 wait complete. 2024-05-20T17:58:20.439 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:20.439 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:21.175 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:23.177 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:25.179 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:25.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.569+0000 7fc93c6ca640 1 Processor -- start 2024-05-20T17:58:25.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.569+0000 7fc93c6ca640 1 -- start start 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc93c6ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc93406c7c0 0x7fc93415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc93c6ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9340b4480 0x7fc9340b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc93c6ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9340b4dd0 con 0x7fc934162ff0 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc93c6ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc9340cdc20 con 0x7fc9340b4480 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc93c6ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340d11e0 con 0x7fc93406c7c0 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc939c65640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc934162ff0 0x7fc9340d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34854/0 (socket says 172.21.15.6:34854) 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc939c65640 1 -- 172.21.15.6:0/2000665912 learned_addr learned my addr 172.21.15.6:0/2000665912 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc93ac67640 1 --2- 172.21.15.6:0/2000665912 >> v2:172.21.15.171:3300/0 conn(0x7fc9340b4480 0x7fc9340b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc93a466640 1 --2- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc93406c7c0 0x7fc93415f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc939464640 1 -- 172.21.15.6:0/2000665912 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817932688 0 0) 0x7fc928001110 con 0x7fc934162ff0 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.571+0000 7fc939464640 1 -- 172.21.15.6:0/2000665912 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc920003520 con 0x7fc934162ff0 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.572+0000 7fc939464640 1 -- 172.21.15.6:0/2000665912 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3769520308 0 0) 0x7fc920003520 con 0x7fc934162ff0 2024-05-20T17:58:25.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.572+0000 7fc93ac67640 1 -- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc93406c7c0 msgr2=0x7fc93415f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:25.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.572+0000 7fc93ac67640 1 --2- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc93406c7c0 0x7fc93415f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.572+0000 7fc93ac67640 1 -- 172.21.15.6:0/2000665912 >> v1:172.21.15.6:6789/0 conn(0x7fc934162ff0 legacy=0x7fc9340d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:25.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.572+0000 7fc93ac67640 1 -- 172.21.15.6:0/2000665912 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc934163840 con 0x7fc9340b4480 2024-05-20T17:58:25.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.572+0000 7fc93a466640 1 --2- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc93406c7c0 0x7fc93415f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.573+0000 7fc93ac67640 1 --2- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9340b4480 0x7fc9340b4890 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb229ff3efdf7963 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.573+0000 7fc939464640 1 -- 172.21.15.6:0/2000665912 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c037070 con 0x7fc9340b4480 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.573+0000 7fc939464640 1 -- 172.21.15.6:0/2000665912 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c02ab10 con 0x7fc9340b4480 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.573+0000 7fc939464640 1 -- 172.21.15.6:0/2000665912 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928001840 con 0x7fc9340b4480 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.574+0000 7fc93c6ca640 1 -- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9340b4480 msgr2=0x7fc9340b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.574+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9340b4480 0x7fc9340b4890 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c02a080 comp rx=0 tx=0).stop 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.574+0000 7fc93c6ca640 1 -- 172.21.15.6:0/2000665912 shutdown_connections 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.574+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9340b4480 0x7fc9340b4890 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.574+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/2000665912 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc93406c7c0 0x7fc93415f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.574+0000 7fc93c6ca640 1 -- 172.21.15.6:0/2000665912 >> 172.21.15.6:0/2000665912 conn(0x7fc9340cf480 msgr2=0x7fc9340cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.574+0000 7fc93c6ca640 1 -- 172.21.15.6:0/2000665912 shutdown_connections 2024-05-20T17:58:25.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.574+0000 7fc93c6ca640 1 -- 172.21.15.6:0/2000665912 wait complete. 2024-05-20T17:58:25.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.576+0000 7fc93c6ca640 1 Processor -- start 2024-05-20T17:58:25.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.576+0000 7fc93c6ca640 1 -- start start 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93c6ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc93406c7c0 0x7fc9340ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93c6ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9340b4480 0x7fc93415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93c6ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934162ff0 0x7fc9340b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93c6ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc93415f830 con 0x7fc934162ff0 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93c6ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340cd8b0 con 0x7fc93406c7c0 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93c6ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc934163e00 con 0x7fc9340b4480 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93ac67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934162ff0 0x7fc9340b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93ac67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934162ff0 0x7fc9340b77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38518/0 (socket says 172.21.15.6:38518) 2024-05-20T17:58:25.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93ac67640 1 -- 172.21.15.6:0/1518915534 learned_addr learned my addr 172.21.15.6:0/1518915534 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93a466640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc93406c7c0 0x7fc9340ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc939c65640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9340b4480 0x7fc93415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93ac67640 1 -- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9340b4480 msgr2=0x7fc93415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93ac67640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9340b4480 0x7fc93415a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93ac67640 1 -- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc93406c7c0 msgr2=0x7fc9340ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93ac67640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc93406c7c0 0x7fc9340ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93ac67640 1 -- 172.21.15.6:0/1518915534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9340b0290 con 0x7fc934162ff0 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc93a466640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc93406c7c0 0x7fc9340ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.577+0000 7fc939c65640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9340b4480 0x7fc93415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.578+0000 7fc93ac67640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934162ff0 0x7fc9340b77b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.578+0000 7fc926ffd640 1 -- 172.21.15.6:0/1518915534 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c037050 con 0x7fc934162ff0 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.578+0000 7fc926ffd640 1 -- 172.21.15.6:0/1518915534 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c038040 con 0x7fc934162ff0 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.578+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9340b0570 con 0x7fc934162ff0 2024-05-20T17:58:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.578+0000 7fc926ffd640 1 -- 172.21.15.6:0/1518915534 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c006e10 con 0x7fc934162ff0 2024-05-20T17:58:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.578+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9340b0b30 con 0x7fc934162ff0 2024-05-20T17:58:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.579+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9340690b0 con 0x7fc934162ff0 2024-05-20T17:58:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.580+0000 7fc926ffd640 1 -- 172.21.15.6:0/1518915534 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc92c003610 con 0x7fc934162ff0 2024-05-20T17:58:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.580+0000 7fc926ffd640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc91806be30 0x7fc91806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.580+0000 7fc926ffd640 1 -- 172.21.15.6:0/1518915534 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fc92c0ab830 con 0x7fc934162ff0 2024-05-20T17:58:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.580+0000 7fc93a466640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc91806be30 0x7fc91806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:25.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.581+0000 7fc93a466640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc91806be30 0x7fc91806e340 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc934073b20 tx=0x7fc93000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:25.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.585+0000 7fc926ffd640 1 -- 172.21.15.6:0/1518915534 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc92c079f50 con 0x7fc934162ff0 2024-05-20T17:58:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.807+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc9340cfb40 con 0x7fc934162ff0 2024-05-20T17:58:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.808+0000 7fc926ffd640 1 -- 172.21.15.6:0/1518915534 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fc92c079850 con 0x7fc934162ff0 2024-05-20T17:58:25.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:25.807 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc91806be30 msgr2=0x7fc91806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc91806be30 0x7fc91806e340 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc934073b20 tx=0x7fc93000b040 comp rx=0 tx=0).stop 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934162ff0 msgr2=0x7fc9340b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934162ff0 0x7fc9340b77b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c0046c0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 shutdown_connections 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc91806be30 0x7fc91806e340 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc934162ff0 0x7fc9340b77b0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9340b4480 0x7fc93415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 --2- 172.21.15.6:0/1518915534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc93406c7c0 0x7fc9340ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 >> 172.21.15.6:0/1518915534 conn(0x7fc9340cf480 msgr2=0x7fc9340b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 shutdown_connections 2024-05-20T17:58:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:25.810+0000 7fc93c6ca640 1 -- 172.21.15.6:0/1518915534 wait complete. 2024-05-20T17:58:25.819 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:25.819 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:27.182 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:29.183 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:30.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.950+0000 7f9ff54ca640 1 Processor -- start 2024-05-20T17:58:30.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.950+0000 7f9ff54ca640 1 -- start start 2024-05-20T17:58:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9ff54ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ff00b4070 0x7f9ff00ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9ff54ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9ff00d0560 0x7f9ff006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9ff54ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff006d910 0x7f9ff00d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9ff54ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff00b8490 con 0x7f9ff00b4070 2024-05-20T17:58:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9ff54ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff006dd20 con 0x7f9ff00d0560 2024-05-20T17:58:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9ff54ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff015fa90 con 0x7f9ff006d910 2024-05-20T17:58:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9feeffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ff00b4070 0x7f9ff00ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:30.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9feeffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9ff00b4070 0x7f9ff00ba5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48496/0 (socket says 172.21.15.6:48496) 2024-05-20T17:58:30.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9feeffd640 1 -- 172.21.15.6:0/48517503 learned_addr learned my addr 172.21.15.6:0/48517503 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:30.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9fee7fc640 1 --2- 172.21.15.6:0/48517503 >> v2:172.21.15.171:3300/0 conn(0x7f9ff00d0560 0x7f9ff006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:30.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9fef7fe640 1 --2- 172.21.15.6:0/48517503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff006d910 0x7f9ff00d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:30.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9feeffd640 1 -- 172.21.15.6:0/48517503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff006d910 msgr2=0x7f9ff00d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:30.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9feeffd640 1 --2- 172.21.15.6:0/48517503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff006d910 0x7f9ff00d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:30.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9feeffd640 1 -- 172.21.15.6:0/48517503 >> v2:172.21.15.171:3300/0 conn(0x7f9ff00d0560 msgr2=0x7f9ff006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:30.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9feeffd640 1 --2- 172.21.15.6:0/48517503 >> v2:172.21.15.171:3300/0 conn(0x7f9ff00d0560 0x7f9ff006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:30.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.952+0000 7f9feeffd640 1 -- 172.21.15.6:0/48517503 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff00d3f00 con 0x7f9ff00b4070 2024-05-20T17:58:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.953+0000 7f9feeffd640 1 --2- 172.21.15.6:0/48517503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff00b4070 0x7f9ff00ba5c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00d5d10 tx=0x7f9fe002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9cadd2263d67d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:30.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.953+0000 7f9fedffb640 1 -- 172.21.15.6:0/48517503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0037070 con 0x7f9ff00b4070 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.953+0000 7f9fedffb640 1 -- 172.21.15.6:0/48517503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe0032440 con 0x7f9ff00b4070 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.953+0000 7f9fedffb640 1 -- 172.21.15.6:0/48517503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0032810 con 0x7f9ff00b4070 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 -- 172.21.15.6:0/48517503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff00b4070 msgr2=0x7f9ff00ba5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/48517503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff00b4070 0x7f9ff00ba5c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00d5d10 tx=0x7f9fe002a1e0 comp rx=0 tx=0).stop 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 -- 172.21.15.6:0/48517503 shutdown_connections 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/48517503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff006d910 0x7f9ff00d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/48517503 >> v2:172.21.15.171:3300/0 conn(0x7f9ff00d0560 0x7f9ff006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/48517503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff00b4070 0x7f9ff00ba5c0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 -- 172.21.15.6:0/48517503 >> 172.21.15.6:0/48517503 conn(0x7f9ff00d4c10 msgr2=0x7f9ff00d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 -- 172.21.15.6:0/48517503 shutdown_connections 2024-05-20T17:58:30.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.954+0000 7f9ff54ca640 1 -- 172.21.15.6:0/48517503 wait complete. 2024-05-20T17:58:30.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.956+0000 7f9ff54ca640 1 Processor -- start 2024-05-20T17:58:30.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.956+0000 7f9ff54ca640 1 -- start start 2024-05-20T17:58:30.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.957+0000 7f9ff54ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff006d910 0x7f9ff015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:30.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.957+0000 7f9ff54ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ff00b4070 0x7f9ff0161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:30.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.957+0000 7f9ff54ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff00d0560 0x7f9ff0162090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:30.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.957+0000 7f9ff54ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff00d47a0 con 0x7f9ff006d910 2024-05-20T17:58:30.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.957+0000 7f9ff54ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff00d44c0 con 0x7f9ff00b4070 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.957+0000 7f9ff54ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff00bab00 con 0x7f9ff00d0560 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.957+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff006d910 0x7f9ff015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.957+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff006d910 0x7f9ff015b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48508/0 (socket says 172.21.15.6:48508) 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9feeffd640 1 -- 172.21.15.6:0/3620583549 learned_addr learned my addr 172.21.15.6:0/3620583549 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9fee7fc640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ff00b4070 0x7f9ff0161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9fef7fe640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff00d0560 0x7f9ff0162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9feeffd640 1 -- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff00d0560 msgr2=0x7f9ff0162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9feeffd640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff00d0560 0x7f9ff0162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9feeffd640 1 -- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ff00b4070 msgr2=0x7f9ff0161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9feeffd640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ff00b4070 0x7f9ff0161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9feeffd640 1 -- 172.21.15.6:0/3620583549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff00ac5e0 con 0x7f9ff006d910 2024-05-20T17:58:30.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9feeffd640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff006d910 0x7f9ff015b110 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0000c00 tx=0x7f9fe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:30.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9fd77fe640 1 -- 172.21.15.6:0/3620583549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0041020 con 0x7f9ff006d910 2024-05-20T17:58:30.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9fd77fe640 1 -- 172.21.15.6:0/3620583549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe00306c0 con 0x7f9ff006d910 2024-05-20T17:58:30.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff01f53a0 con 0x7f9ff006d910 2024-05-20T17:58:30.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9fd77fe640 1 -- 172.21.15.6:0/3620583549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0037040 con 0x7f9ff006d910 2024-05-20T17:58:30.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.958+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff00ac300 con 0x7f9ff006d910 2024-05-20T17:58:30.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.959+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff00690b0 con 0x7f9ff006d910 2024-05-20T17:58:30.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.960+0000 7f9fd77fe640 1 -- 172.21.15.6:0/3620583549 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fe0044020 con 0x7f9ff006d910 2024-05-20T17:58:30.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.960+0000 7f9fd77fe640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fdc06be30 0x7f9fdc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:30.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.961+0000 7f9fd77fe640 1 -- 172.21.15.6:0/3620583549 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f9fe00ab980 con 0x7f9ff006d910 2024-05-20T17:58:30.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.961+0000 7f9fee7fc640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fdc06be30 0x7f9fdc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:30.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.961+0000 7f9fee7fc640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fdc06be30 0x7f9fdc06e340 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00d0000 tx=0x7f9fe4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:30.965+0000 7f9fd77fe640 1 -- 172.21.15.6:0/3620583549 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9fe004b030 con 0x7f9ff006d910 2024-05-20T17:58:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.190+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9ff00b7020 con 0x7f9ff006d910 2024-05-20T17:58:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.191+0000 7f9fd77fe640 1 -- 172.21.15.6:0/3620583549 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f9fe007a010 con 0x7f9ff006d910 2024-05-20T17:58:31.189 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:31.189 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fdc06be30 msgr2=0x7f9fdc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fdc06be30 0x7f9fdc06e340 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00d0000 tx=0x7f9fe4008040 comp rx=0 tx=0).stop 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff006d910 msgr2=0x7f9ff015b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff006d910 0x7f9ff015b110 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0000c00 tx=0x7f9fe00046c0 comp rx=0 tx=0).stop 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 shutdown_connections 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fdc06be30 0x7f9fdc06e340 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ff00d0560 0x7f9ff0162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ff00b4070 0x7f9ff0161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 --2- 172.21.15.6:0/3620583549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ff006d910 0x7f9ff015b110 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 >> 172.21.15.6:0/3620583549 conn(0x7f9ff00d4c10 msgr2=0x7f9ff00b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 shutdown_connections 2024-05-20T17:58:31.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:31.193+0000 7f9ff54ca640 1 -- 172.21.15.6:0/3620583549 wait complete. 2024-05-20T17:58:31.203 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:31.203 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:33.187 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:35.189 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:36.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:36.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.335+0000 7f3a39d65640 1 Processor -- start 2024-05-20T17:58:36.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.335+0000 7f3a39d65640 1 -- start start 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a39d65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a39d65640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3a340b5e10 0x7f3a340b6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a39d65640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a340b4860 con 0x7f3a340d1740 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a39d65640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3a340b4b40 con 0x7f3a340b5e10 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a39d65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3a340b4e20 con 0x7f3a3415d040 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a32ffd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3a340b5e10 0x7f3a340b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a337fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a32ffd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3a340b5e10 0x7f3a340b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:49026/0 (socket says 172.21.15.6:49026) 2024-05-20T17:58:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a33fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f3a340d1740 0x7f3a340d1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:55218/0 (socket says 172.21.15.6:55218) 2024-05-20T17:58:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a337fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:54790/0 (socket says 172.21.15.6:54790) 2024-05-20T17:58:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.336+0000 7f3a32ffd640 1 -- 172.21.15.6:0/581807533 learned_addr learned my addr 172.21.15.6:0/581807533 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.337+0000 7f3a337fe640 1 -- 172.21.15.6:0/581807533 >> v2:172.21.15.171:3300/0 conn(0x7f3a340b5e10 msgr2=0x7f3a340b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.337+0000 7f3a337fe640 1 --2- 172.21.15.6:0/581807533 >> v2:172.21.15.171:3300/0 conn(0x7f3a340b5e10 0x7f3a340b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.337+0000 7f3a337fe640 1 -- 172.21.15.6:0/581807533 >> v1:172.21.15.171:6789/0 conn(0x7f3a340d1740 legacy=0x7f3a340d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.337+0000 7f3a337fe640 1 -- 172.21.15.6:0/581807533 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a340d1220 con 0x7f3a3415d040 2024-05-20T17:58:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.337+0000 7f3a32ffd640 1 --2- 172.21.15.6:0/581807533 >> v2:172.21.15.171:3300/0 conn(0x7f3a340b5e10 0x7f3a340b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:58:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.338+0000 7f3a337fe640 1 --2- 172.21.15.6:0/581807533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340712e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097a0 tx=0x7f3a2402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c283ec9f3c3b1af9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.338+0000 7f3a327fc640 1 -- 172.21.15.6:0/581807533 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24037070 con 0x7f3a3415d040 2024-05-20T17:58:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.338+0000 7f3a327fc640 1 -- 172.21.15.6:0/581807533 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24032440 con 0x7f3a3415d040 2024-05-20T17:58:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.338+0000 7f3a327fc640 1 -- 172.21.15.6:0/581807533 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24032810 con 0x7f3a3415d040 2024-05-20T17:58:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.339+0000 7f3a39d65640 1 -- 172.21.15.6:0/581807533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 msgr2=0x7f3a340712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.339+0000 7f3a39d65640 1 --2- 172.21.15.6:0/581807533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340712e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097a0 tx=0x7f3a2402a180 comp rx=0 tx=0).stop 2024-05-20T17:58:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.339+0000 7f3a39d65640 1 -- 172.21.15.6:0/581807533 shutdown_connections 2024-05-20T17:58:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.339+0000 7f3a39d65640 1 --2- 172.21.15.6:0/581807533 >> v2:172.21.15.171:3300/0 conn(0x7f3a340b5e10 0x7f3a340b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.339+0000 7f3a39d65640 1 --2- 172.21.15.6:0/581807533 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340712e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.339+0000 7f3a39d65640 1 -- 172.21.15.6:0/581807533 >> 172.21.15.6:0/581807533 conn(0x7f3a340cf480 msgr2=0x7f3a340cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.339+0000 7f3a39d65640 1 -- 172.21.15.6:0/581807533 shutdown_connections 2024-05-20T17:58:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.339+0000 7f3a39d65640 1 -- 172.21.15.6:0/581807533 wait complete. 2024-05-20T17:58:36.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.341+0000 7f3a39d65640 1 Processor -- start 2024-05-20T17:58:36.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.341+0000 7f3a39d65640 1 -- start start 2024-05-20T17:58:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a39d65640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a340b5e10 0x7f3a341587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a39d65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a340d1740 0x7f3a340cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a39d65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a39d65640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340b4480 con 0x7f3a340d1740 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a39d65640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3415d450 con 0x7f3a340b5e10 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a39d65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3a340b4600 con 0x7f3a3415d040 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a32ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a340d1740 0x7f3a340cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a32ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a340d1740 0x7f3a340cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48524/0 (socket says 172.21.15.6:48524) 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a32ffd640 1 -- 172.21.15.6:0/1824261418 learned_addr learned my addr 172.21.15.6:0/1824261418 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a33fff640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.342+0000 7f3a337fe640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a340b5e10 0x7f3a341587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a32ffd640 1 -- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 msgr2=0x7f3a340cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a32ffd640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a32ffd640 1 -- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a340b5e10 msgr2=0x7f3a341587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a32ffd640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a340b5e10 0x7f3a341587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a32ffd640 1 -- 172.21.15.6:0/1824261418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a340a9720 con 0x7f3a340d1740 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a32ffd640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a340d1740 0x7f3a340cd7f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800e8d0 tx=0x7f3a2800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a1bfff640 1 -- 172.21.15.6:0/1824261418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28004030 con 0x7f3a340d1740 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a1bfff640 1 -- 172.21.15.6:0/1824261418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a280041d0 con 0x7f3a340d1740 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a1bfff640 1 -- 172.21.15.6:0/1824261418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2800c940 con 0x7f3a340d1740 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a341f9430 con 0x7f3a340d1740 2024-05-20T17:58:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.343+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a341f99f0 con 0x7f3a340d1740 2024-05-20T17:58:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.344+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a340b86e0 con 0x7f3a340d1740 2024-05-20T17:58:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.345+0000 7f3a1bfff640 1 -- 172.21.15.6:0/1824261418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a2800cae0 con 0x7f3a340d1740 2024-05-20T17:58:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.345+0000 7f3a1bfff640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3a2006be60 0x7f3a2006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.346+0000 7f3a1bfff640 1 -- 172.21.15.6:0/1824261418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f3a2808af50 con 0x7f3a340d1740 2024-05-20T17:58:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.346+0000 7f3a337fe640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3a2006be60 0x7f3a2006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.346+0000 7f3a337fe640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3a2006be60 0x7f3a2006e370 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3a24034000 tx=0x7f3a2402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.350+0000 7f3a1bfff640 1 -- 172.21.15.6:0/1824261418 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3a340b86e0 con 0x7f3a340d1740 2024-05-20T17:58:36.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.573+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3a340690b0 con 0x7f3a340d1740 2024-05-20T17:58:36.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.574+0000 7f3a1bfff640 1 -- 172.21.15.6:0/1824261418 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f3a28017020 con 0x7f3a340d1740 2024-05-20T17:58:36.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:36.573 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3a2006be60 msgr2=0x7f3a2006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3a2006be60 0x7f3a2006e370 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3a24034000 tx=0x7f3a2402e000 comp rx=0 tx=0).stop 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a340d1740 msgr2=0x7f3a340cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a340d1740 0x7f3a340cd7f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800e8d0 tx=0x7f3a2800ed90 comp rx=0 tx=0).stop 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 shutdown_connections 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3a2006be60 0x7f3a2006e370 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a3415d040 0x7f3a340cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a340d1740 0x7f3a340cd7f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 --2- 172.21.15.6:0/1824261418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a340b5e10 0x7f3a341587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 >> 172.21.15.6:0/1824261418 conn(0x7f3a340cf480 msgr2=0x7f3a3415b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 shutdown_connections 2024-05-20T17:58:36.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:36.576+0000 7f3a39d65640 1 -- 172.21.15.6:0/1824261418 wait complete. 2024-05-20T17:58:36.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:58:36.582 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:58:36.586 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:36.586 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:39.193 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:41.195 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:41.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:41.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.717+0000 7f7841537640 1 Processor -- start 2024-05-20T17:58:41.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.717+0000 7f7841537640 1 -- start start 2024-05-20T17:58:41.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.718+0000 7f7841537640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f783c06dae0 0x7f783c16a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:41.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.718+0000 7f7841537640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c15fa90 con 0x7f783c0d0560 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.718+0000 7f7841537640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c0d3f00 con 0x7f783c0b4070 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.718+0000 7f7841537640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f783c0b8490 con 0x7f783c06dae0 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f783a7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f783c0d0560 0x7f783c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41700/0 (socket says 172.21.15.6:41700) 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f783a7fc640 1 -- 172.21.15.6:0/2561655751 learned_addr learned my addr 172.21.15.6:0/2561655751 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f783b7fe640 1 --2- 172.21.15.6:0/2561655751 >> v2:172.21.15.171:3300/0 conn(0x7f783c06dae0 0x7f783c16a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078714847 0 0) 0x7f783c15fa90 con 0x7f783c0d0560 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7828003520 con 0x7f783c0d0560 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380643507 0 0) 0x7f783c0d3f00 con 0x7f783c0b4070 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f783c15fa90 con 0x7f783c0b4070 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3897193164 0 0) 0x7f7828003520 con 0x7f783c0d0560 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 >> v2:172.21.15.171:3300/0 conn(0x7f783c06dae0 msgr2=0x7f783c16a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 --2- 172.21.15.6:0/2561655751 >> v2:172.21.15.171:3300/0 conn(0x7f783c06dae0 0x7f783c16a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 >> v1:172.21.15.171:6789/0 conn(0x7f783c0b4070 legacy=0x7f783c0ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:41.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c0d41e0 con 0x7f783c0d0560 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f7824001670 con 0x7f783c0d0560 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f783b7fe640 1 --2- 172.21.15.6:0/2561655751 >> v2:172.21.15.171:3300/0 conn(0x7f783c06dae0 0x7f783c16a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 >> v1:172.21.15.6:6789/0 conn(0x7f783c0d0560 legacy=0x7f783c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7828003b40 0x7f7828003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7828004800 0x7f7828004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f782800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0b8490 con 0x7f7828005260 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f782800c1c0 con 0x7f7828004800 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.719+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f782800c3c0 con 0x7f7828003b40 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.720+0000 7f783b7fe640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f782800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.720+0000 7f783a7fc640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7828004800 0x7f7828004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.720+0000 7f783affd640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7828003b40 0x7f7828003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.720+0000 7f783b7fe640 1 -- 172.21.15.6:0/2561655751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7828003b40 msgr2=0x7f7828003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:41.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.720+0000 7f783b7fe640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7828003b40 0x7f7828003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.720+0000 7f783b7fe640 1 -- 172.21.15.6:0/2561655751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7828004800 msgr2=0x7f7828004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:41.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.720+0000 7f783b7fe640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7828004800 0x7f7828004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.720+0000 7f783b7fe640 1 -- 172.21.15.6:0/2561655751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7828003520 con 0x7f7828005260 2024-05-20T17:58:41.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.721+0000 7f783b7fe640 1 -- 172.21.15.6:0/2561655751 reap_dead start 2024-05-20T17:58:41.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.721+0000 7f783b7fe640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f782800b9c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f783400e350 tx=0x7f7828005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc9709ea6dfc065 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:41.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.721+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834009de0 con 0x7f7828005260 2024-05-20T17:58:41.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.721+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834003bd0 con 0x7f7828005260 2024-05-20T17:58:41.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.721+0000 7f7839ffb640 1 -- 172.21.15.6:0/2561655751 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834004020 con 0x7f7828005260 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.721+0000 7f7841537640 1 -- 172.21.15.6:0/2561655751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 msgr2=0x7f782800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.721+0000 7f7841537640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f782800b9c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f783400e350 tx=0x7f7828005830 comp rx=0 tx=0).stop 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.722+0000 7f7841537640 1 -- 172.21.15.6:0/2561655751 shutdown_connections 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.722+0000 7f7841537640 1 --2- 172.21.15.6:0/2561655751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f782800b9c0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.722+0000 7f7841537640 1 -- 172.21.15.6:0/2561655751 >> 172.21.15.6:0/2561655751 conn(0x7f783c0d4c10 msgr2=0x7f783c0d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.722+0000 7f7841537640 1 -- 172.21.15.6:0/2561655751 shutdown_connections 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.722+0000 7f7841537640 1 -- 172.21.15.6:0/2561655751 wait complete. 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.724+0000 7f7841537640 1 Processor -- start 2024-05-20T17:58:41.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.724+0000 7f7841537640 1 -- start start 2024-05-20T17:58:41.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f7841537640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f783c0b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:41.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f7841537640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f783c1527a0 0x7f783c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f7841537640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f783c0d27e0 0x7f783c0d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f7841537640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0d3b20 con 0x7f7828005260 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f7841537640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0d47a0 con 0x7f783c0d27e0 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f7841537640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f783c0d3ca0 con 0x7f783c1527a0 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f783affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f783c0b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f783affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f783c0b6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42262/0 (socket says 172.21.15.6:42262) 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f783affd640 1 -- 172.21.15.6:0/1140446077 learned_addr learned my addr 172.21.15.6:0/1140446077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f783a7fc640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f783c1527a0 0x7f783c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.725+0000 7f783b7fe640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f783c0d27e0 0x7f783c0d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f783affd640 1 -- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f783c1527a0 msgr2=0x7f783c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f783affd640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f783c1527a0 0x7f783c152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f783affd640 1 -- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f783c0d27e0 msgr2=0x7f783c0d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:41.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f783affd640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f783c0d27e0 0x7f783c0d2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f783affd640 1 -- 172.21.15.6:0/1140446077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c0d3130 con 0x7f7828005260 2024-05-20T17:58:41.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f783affd640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f783c0b6f60 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f782c00f7d0 tx=0x7f782c00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:41.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f78337fe640 1 -- 172.21.15.6:0/1140446077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c01a070 con 0x7f7828005260 2024-05-20T17:58:41.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f78337fe640 1 -- 172.21.15.6:0/1140446077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c00fe80 con 0x7f7828005260 2024-05-20T17:58:41.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f78337fe640 1 -- 172.21.15.6:0/1140446077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c007050 con 0x7f7828005260 2024-05-20T17:58:41.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c1f8670 con 0x7f7828005260 2024-05-20T17:58:41.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.726+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c1f8c30 con 0x7f7828005260 2024-05-20T17:58:41.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.727+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783c0690b0 con 0x7f7828005260 2024-05-20T17:58:41.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.728+0000 7f78337fe640 1 -- 172.21.15.6:0/1140446077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f782c0071f0 con 0x7f7828005260 2024-05-20T17:58:41.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.728+0000 7f78337fe640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f781c06be30 0x7f781c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:41.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.728+0000 7f78337fe640 1 -- 172.21.15.6:0/1140446077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f782c08a710 con 0x7f7828005260 2024-05-20T17:58:41.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.729+0000 7f783a7fc640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f781c06be30 0x7f781c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:41.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.729+0000 7f783a7fc640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f781c06be30 0x7f781c06e340 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f783c0b9ef0 tx=0x7f7824001e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:41.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.733+0000 7f78337fe640 1 -- 172.21.15.6:0/1140446077 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f783c0d3130 con 0x7f7828005260 2024-05-20T17:58:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.958+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f783c0008d0 con 0x7f7828005260 2024-05-20T17:58:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.959+0000 7f78337fe640 1 -- 172.21.15.6:0/1140446077 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f782c058860 con 0x7f7828005260 2024-05-20T17:58:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:41.957 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f781c06be30 msgr2=0x7f781c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f781c06be30 0x7f781c06e340 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f783c0b9ef0 tx=0x7f7824001e20 comp rx=0 tx=0).stop 2024-05-20T17:58:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 msgr2=0x7f783c0b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f783c0b6f60 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f782c00f7d0 tx=0x7f782c00fc90 comp rx=0 tx=0).stop 2024-05-20T17:58:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 shutdown_connections 2024-05-20T17:58:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f781c06be30 0x7f781c06e340 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f783c0d27e0 0x7f783c0d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f783c1527a0 0x7f783c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 --2- 172.21.15.6:0/1140446077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828005260 0x7f783c0b6f60 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 >> 172.21.15.6:0/1140446077 conn(0x7f783c0d4c10 msgr2=0x7f783c15d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 shutdown_connections 2024-05-20T17:58:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:41.961+0000 7f7841537640 1 -- 172.21.15.6:0/1140446077 wait complete. 2024-05-20T17:58:41.970 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:41.970 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:43.197 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:45.199 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:46.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.102+0000 7fbddcfb5640 1 Processor -- start 2024-05-20T17:58:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.102+0000 7fbddcfb5640 1 -- start start 2024-05-20T17:58:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.103+0000 7fbddcfb5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbdd806bc30 0x7fbdd8159940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.103+0000 7fbddcfb5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd80b1820 con 0x7fbdd809a4f0 2024-05-20T17:58:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.103+0000 7fbddcfb5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd815fc40 con 0x7fbdd80b10a0 2024-05-20T17:58:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.103+0000 7fbddcfb5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd815ff20 con 0x7fbdd806bc30 2024-05-20T17:58:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.103+0000 7fbdd659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbdd809a4f0 0x7fbdd806b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41706/0 (socket says 172.21.15.6:41706) 2024-05-20T17:58:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.103+0000 7fbdd659c640 1 -- 172.21.15.6:0/359113352 learned_addr learned my addr 172.21.15.6:0/359113352 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:58:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdcffff640 1 --2- 172.21.15.6:0/359113352 >> v2:172.21.15.171:3300/0 conn(0x7fbdd806bc30 0x7fbdd8159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2603682598 0 0) 0x7fbdd80b1820 con 0x7fbdd809a4f0 2024-05-20T17:58:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc4003520 con 0x7fbdd809a4f0 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1256470699 0 0) 0x7fbdc4003520 con 0x7fbdd809a4f0 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 >> v2:172.21.15.171:3300/0 conn(0x7fbdd806bc30 msgr2=0x7fbdd8159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 --2- 172.21.15.6:0/359113352 >> v2:172.21.15.171:3300/0 conn(0x7fbdd806bc30 0x7fbdd8159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 >> v1:172.21.15.171:6789/0 conn(0x7fbdd80b10a0 legacy=0x7fbdd8160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd8160200 con 0x7fbdd809a4f0 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fbdc8001670 con 0x7fbdd809a4f0 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 >> v1:172.21.15.6:6789/0 conn(0x7fbdd809a4f0 legacy=0x7fbdd806b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdc4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdc4004800 0x7fbdc4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdc4005150 0x7fbdc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd815ff20 con 0x7fbdc40039b0 2024-05-20T17:58:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc400c0c0 con 0x7fbdc4004800 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc400c2c0 con 0x7fbdc4005150 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd659c640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdc4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdcffff640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdc4004800 0x7fbdc4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd6d9d640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdc4005150 0x7fbdc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd659c640 1 -- 172.21.15.6:0/359113352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdc4005150 msgr2=0x7fbdc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd659c640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdc4005150 0x7fbdc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.104+0000 7fbdd659c640 1 -- 172.21.15.6:0/359113352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdc4004800 msgr2=0x7fbdc4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.105+0000 7fbdd659c640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdc4004800 0x7fbdc4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.105+0000 7fbdd659c640 1 -- 172.21.15.6:0/359113352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc4003520 con 0x7fbdc40039b0 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.105+0000 7fbdd6d9d640 1 -- 172.21.15.6:0/359113352 reap_dead start 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.105+0000 7fbdd659c640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdc4003de0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c240 tx=0x7fbdc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8333645f3d105e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.105+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8007d10 con 0x7fbdc40039b0 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.105+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc80058d0 con 0x7fbdc40039b0 2024-05-20T17:58:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.106+0000 7fbdd5d9b640 1 -- 172.21.15.6:0/359113352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8005d20 con 0x7fbdc40039b0 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.106+0000 7fbddcfb5640 1 -- 172.21.15.6:0/359113352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 msgr2=0x7fbdc4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.106+0000 7fbddcfb5640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdc4003de0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c240 tx=0x7fbdc4005830 comp rx=0 tx=0).stop 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.106+0000 7fbddcfb5640 1 -- 172.21.15.6:0/359113352 shutdown_connections 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.106+0000 7fbddcfb5640 1 --2- 172.21.15.6:0/359113352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdc4003de0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.106+0000 7fbddcfb5640 1 -- 172.21.15.6:0/359113352 >> 172.21.15.6:0/359113352 conn(0x7fbdd8072a70 msgr2=0x7fbdd80b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.106+0000 7fbddcfb5640 1 -- 172.21.15.6:0/359113352 shutdown_connections 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.106+0000 7fbddcfb5640 1 -- 172.21.15.6:0/359113352 wait complete. 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.109+0000 7fbddcfb5640 1 Processor -- start 2024-05-20T17:58:47.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.109+0000 7fbddcfb5640 1 -- start start 2024-05-20T17:58:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbddcfb5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdd815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbddcfb5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdd809e840 0x7fbdd81527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbddcfb5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdd8152d00 0x7fbdd8162050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbddcfb5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8160720 con 0x7fbdc40039b0 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbddcfb5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd80b14b0 con 0x7fbdd8152d00 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbddcfb5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd81608a0 con 0x7fbdd809e840 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdd815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdd815a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42280/0 (socket says 172.21.15.6:42280) 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 -- 172.21.15.6:0/1092782380 learned_addr learned my addr 172.21.15.6:0/1092782380 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdcffff640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdd809e840 0x7fbdd81527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd6d9d640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdd8152d00 0x7fbdd8162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 -- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdd809e840 msgr2=0x7fbdd81527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdd809e840 0x7fbdd81527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 -- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdd8152d00 msgr2=0x7fbdd8162050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdd8152d00 0x7fbdd8162050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 -- 172.21.15.6:0/1092782380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd809d7a0 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdd659c640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdd815a620 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c240 tx=0x7fbdd81603d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdceffd640 1 -- 172.21.15.6:0/1092782380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8038040 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdceffd640 1 -- 172.21.15.6:0/1092782380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc8004c10 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd809da80 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.110+0000 7fbdceffd640 1 -- 172.21.15.6:0/1092782380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8007d10 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.111+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd809e040 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.112+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd80690b0 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.112+0000 7fbdceffd640 1 -- 172.21.15.6:0/1092782380 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdc8007070 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.113+0000 7fbdceffd640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdb806be30 0x7fbdb806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.113+0000 7fbdceffd640 1 -- 172.21.15.6:0/1092782380 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fbdc80aae50 con 0x7fbdc40039b0 2024-05-20T17:58:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.113+0000 7fbdcffff640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdb806be30 0x7fbdb806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:47.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.113+0000 7fbdcffff640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdb806be30 0x7fbdb806e340 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00090e0 tx=0x7fbdc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.118+0000 7fbdceffd640 1 -- 172.21.15.6:0/1092782380 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbdc80795e0 con 0x7fbdc40039b0 2024-05-20T17:58:47.201 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:47.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.346+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbdd80680f0 con 0x7fbdc40039b0 2024-05-20T17:58:47.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.346+0000 7fbdceffd640 1 -- 172.21.15.6:0/1092782380 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fbdc8078ee0 con 0x7fbdc40039b0 2024-05-20T17:58:47.345 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:47.345 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:47.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.348+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdb806be30 msgr2=0x7fbdb806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:47.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.348+0000 7fbddcfb5640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdb806be30 0x7fbdb806e340 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00090e0 tx=0x7fbdc0008040 comp rx=0 tx=0).stop 2024-05-20T17:58:47.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.348+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 msgr2=0x7fbdd815a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:47.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.348+0000 7fbddcfb5640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdd815a620 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800c240 tx=0x7fbdd81603d0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.349+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 shutdown_connections 2024-05-20T17:58:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.349+0000 7fbddcfb5640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbdb806be30 0x7fbdb806e340 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.349+0000 7fbddcfb5640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdd8152d00 0x7fbdd8162050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.349+0000 7fbddcfb5640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdd809e840 0x7fbdd81527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.349+0000 7fbddcfb5640 1 --2- 172.21.15.6:0/1092782380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc40039b0 0x7fbdd815a620 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.349+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 >> 172.21.15.6:0/1092782380 conn(0x7fbdd8072a70 msgr2=0x7fbdd80b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.349+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 shutdown_connections 2024-05-20T17:58:47.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:47.349+0000 7fbddcfb5640 1 -- 172.21.15.6:0/1092782380 wait complete. 2024-05-20T17:58:47.358 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:47.358 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:51.206 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:52.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:52.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.491+0000 7fbbaa59d640 1 Processor -- start 2024-05-20T17:58:52.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.491+0000 7fbbaa59d640 1 -- start start 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.492+0000 7fbbaa59d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 0x7fbba408bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.492+0000 7fbbaa59d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba40d1190 con 0x7fbba408c2c0 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.492+0000 7fbbaa59d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba408cc90 con 0x7fbba4164230 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.492+0000 7fbbaa59d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbba40b18d0 con 0x7fbba40b1e20 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbba408c2c0 0x7fbba4163b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33282/0 (socket says 172.21.15.6:33282) 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba37fe640 1 -- 172.21.15.6:0/3603998856 learned_addr learned my addr 172.21.15.6:0/3603998856 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82976274 0 0) 0x7fbba40d1190 con 0x7fbba408c2c0 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba3fff640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 0x7fbba408bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb8c003520 con 0x7fbba408c2c0 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1668218930 0 0) 0x7fbb8c003520 con 0x7fbba408c2c0 2024-05-20T17:58:52.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 msgr2=0x7fbba408bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 0x7fbba408bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 >> v1:172.21.15.171:6789/0 conn(0x7fbba4164230 legacy=0x7fbba406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba40b3da0 con 0x7fbba408c2c0 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fbb98001670 con 0x7fbba408c2c0 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 >> v1:172.21.15.6:6789/0 conn(0x7fbba408c2c0 legacy=0x7fbba4163b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb8c0039e0 0x7fbb8c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 0x7fbb8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb8c004d40 0x7fbb8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbba40b18d0 con 0x7fbb8c004d40 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c00bbd0 con 0x7fbb8c0039e0 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.493+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c00bdd0 con 0x7fbba40b1e20 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.494+0000 7fbba3fff640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb8c0039e0 0x7fbb8c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.494+0000 7fbba37fe640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 0x7fbb8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:52.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.494+0000 7fbba8b3a640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb8c004d40 0x7fbb8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.494+0000 7fbba37fe640 1 -- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb8c0039e0 msgr2=0x7fbb8c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.494+0000 7fbba37fe640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb8c0039e0 0x7fbb8c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.494+0000 7fbba37fe640 1 -- 172.21.15.6:0/3603998856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb8c004d40 msgr2=0x7fbb8c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.494+0000 7fbba37fe640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb8c004d40 0x7fbb8c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.494+0000 7fbba37fe640 1 -- 172.21.15.6:0/3603998856 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c003520 con 0x7fbba40b1e20 2024-05-20T17:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.495+0000 7fbba37fe640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 0x7fbb8c004800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb98007fd0 tx=0x7fbb8c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49d712fc6710e55 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.495+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98007d50 con 0x7fbba40b1e20 2024-05-20T17:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.495+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb98005af0 con 0x7fbba40b1e20 2024-05-20T17:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.495+0000 7fbba2ffd640 1 -- 172.21.15.6:0/3603998856 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98007070 con 0x7fbba40b1e20 2024-05-20T17:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.496+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 msgr2=0x7fbb8c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.496+0000 7fbbaa59d640 1 --2- 172.21.15.6:0/3603998856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba40b1e20 0x7fbb8c004800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb98007fd0 tx=0x7fbb8c005830 comp rx=0 tx=0).stop 2024-05-20T17:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.496+0000 7fbba8b3a640 1 -- 172.21.15.6:0/3603998856 reap_dead start 2024-05-20T17:58:52.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.496+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3603998856 shutdown_connections 2024-05-20T17:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.496+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3603998856 >> 172.21.15.6:0/3603998856 conn(0x7fbba40b44f0 msgr2=0x7fbba40b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.496+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3603998856 shutdown_connections 2024-05-20T17:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.496+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3603998856 wait complete. 2024-05-20T17:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.498+0000 7fbbaa59d640 1 Processor -- start 2024-05-20T17:58:52.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.498+0000 7fbbaa59d640 1 -- start start 2024-05-20T17:58:52.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.499+0000 7fbbaa59d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbba40b1e20 0x7fbba4161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.499+0000 7fbbaa59d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba4156a00 0x7fbba41f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.499+0000 7fbbaa59d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbba41f9710 0x7fbba409c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.499+0000 7fbbaa59d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbba40b3370 con 0x7fbba40b1e20 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.499+0000 7fbbaa59d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbba408c800 con 0x7fbba41f9710 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.499+0000 7fbbaa59d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbba40b3a50 con 0x7fbba4156a00 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.499+0000 7fbba3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbba40b1e20 0x7fbba4161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbba40b1e20 0x7fbba4161140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37974/0 (socket says 172.21.15.6:37974) 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba3fff640 1 -- 172.21.15.6:0/3626511491 learned_addr learned my addr 172.21.15.6:0/3626511491 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba37fe640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba4156a00 0x7fbba41f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba8b3a640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbba41f9710 0x7fbba409c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba3fff640 1 -- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba4156a00 msgr2=0x7fbba41f91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba3fff640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba4156a00 0x7fbba41f91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba3fff640 1 -- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbba41f9710 msgr2=0x7fbba409c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba3fff640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbba41f9710 0x7fbba409c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba3fff640 1 -- 172.21.15.6:0/3626511491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba4157450 con 0x7fbba40b1e20 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba37fe640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba4156a00 0x7fbba41f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba3fff640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbba40b1e20 0x7fbba4161140 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fbb94011930 tx=0x7fbb94011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba0ff9640 1 -- 172.21.15.6:0/3626511491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94005ba0 con 0x7fbba40b1e20 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba0ff9640 1 -- 172.21.15.6:0/3626511491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94005d40 con 0x7fbba40b1e20 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba40ca9f0 con 0x7fbba40b1e20 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbba0ff9640 1 -- 172.21.15.6:0/3626511491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94004220 con 0x7fbba40b1e20 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.500+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba40ca710 con 0x7fbba40b1e20 2024-05-20T17:58:52.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.501+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba40690b0 con 0x7fbba40b1e20 2024-05-20T17:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.502+0000 7fbba0ff9640 1 -- 172.21.15.6:0/3626511491 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb94012040 con 0x7fbba40b1e20 2024-05-20T17:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.503+0000 7fbba0ff9640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb9006be30 0x7fbb9006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.503+0000 7fbba0ff9640 1 -- 172.21.15.6:0/3626511491 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fbb9408b680 con 0x7fbba40b1e20 2024-05-20T17:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.503+0000 7fbba37fe640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb9006be30 0x7fbb9006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:52.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.503+0000 7fbba37fe640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb9006be30 0x7fbb9006e340 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbb98033000 tx=0x7fbb9802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:52.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.507+0000 7fbba0ff9640 1 -- 172.21.15.6:0/3626511491 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbb94018030 con 0x7fbba40b1e20 2024-05-20T17:58:52.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.732+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbba408ce70 con 0x7fbba40b1e20 2024-05-20T17:58:52.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.733+0000 7fbba0ff9640 1 -- 172.21.15.6:0/3626511491 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fbb940597d0 con 0x7fbba40b1e20 2024-05-20T17:58:52.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:52.731 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:52.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb9006be30 msgr2=0x7fbb9006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:52.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb9006be30 0x7fbb9006e340 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbb98033000 tx=0x7fbb9802e000 comp rx=0 tx=0).stop 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbba40b1e20 msgr2=0x7fbba4161140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbba40b1e20 0x7fbba4161140 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fbb94011930 tx=0x7fbb94011df0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 shutdown_connections 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb9006be30 0x7fbb9006e340 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbba41f9710 0x7fbba409c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbba4156a00 0x7fbba41f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 --2- 172.21.15.6:0/3626511491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbba40b1e20 0x7fbba4161140 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 >> 172.21.15.6:0/3626511491 conn(0x7fbba40b44f0 msgr2=0x7fbba4071520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 shutdown_connections 2024-05-20T17:58:52.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:52.735+0000 7fbbaa59d640 1 -- 172.21.15.6:0/3626511491 wait complete. 2024-05-20T17:58:52.743 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:52.743 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:53.208 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:58:57.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:58:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.875+0000 7f216b028640 1 Processor -- start 2024-05-20T17:58:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.875+0000 7f216b028640 1 -- start start 2024-05-20T17:58:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f216b028640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216406e760 0x7f216406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f216b028640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f216415d850 0x7f216415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f216b028640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f216415e1a0 0x7f21640ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f216b028640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f216406bf30 con 0x7f216415e1a0 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f216b028640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f216415d470 con 0x7f216415d850 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f216b028640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f216406f0b0 con 0x7f216406e760 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f21695c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f216415e1a0 0x7f21640ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f21695c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f216415e1a0 0x7f21640ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41576/0 (socket says 172.21.15.6:41576) 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f21695c5640 1 -- 172.21.15.6:0/1081604515 learned_addr learned my addr 172.21.15.6:0/1081604515 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f2163fff640 1 --2- 172.21.15.6:0/1081604515 >> v2:172.21.15.171:3300/0 conn(0x7f216415d850 0x7f216415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f2168dc4640 1 --2- 172.21.15.6:0/1081604515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216406e760 0x7f216406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f21695c5640 1 -- 172.21.15.6:0/1081604515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216406e760 msgr2=0x7f216406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f21695c5640 1 --2- 172.21.15.6:0/1081604515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216406e760 0x7f216406eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:57.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f21695c5640 1 -- 172.21.15.6:0/1081604515 >> v2:172.21.15.171:3300/0 conn(0x7f216415d850 msgr2=0x7f216415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:58:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f21695c5640 1 --2- 172.21.15.6:0/1081604515 >> v2:172.21.15.171:3300/0 conn(0x7f216415d850 0x7f216415dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.877+0000 7f21695c5640 1 -- 172.21.15.6:0/1081604515 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216406c180 con 0x7f216415e1a0 2024-05-20T17:58:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.878+0000 7f21695c5640 1 --2- 172.21.15.6:0/1081604515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415e1a0 0x7f21640ce8b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f21640ce5d0 tx=0x7f215c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610d0aeaba5cd314 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.878+0000 7f21637fe640 1 -- 172.21.15.6:0/1081604515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c036070 con 0x7f216415e1a0 2024-05-20T17:58:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.878+0000 7f21637fe640 1 -- 172.21.15.6:0/1081604515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215c031600 con 0x7f216415e1a0 2024-05-20T17:58:57.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.878+0000 7f21637fe640 1 -- 172.21.15.6:0/1081604515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c0319d0 con 0x7f216415e1a0 2024-05-20T17:58:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 -- 172.21.15.6:0/1081604515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415e1a0 msgr2=0x7f21640ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 --2- 172.21.15.6:0/1081604515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415e1a0 0x7f21640ce8b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f21640ce5d0 tx=0x7f215c02a6a0 comp rx=0 tx=0).stop 2024-05-20T17:58:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 -- 172.21.15.6:0/1081604515 shutdown_connections 2024-05-20T17:58:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 --2- 172.21.15.6:0/1081604515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415e1a0 0x7f21640ce8b0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 --2- 172.21.15.6:0/1081604515 >> v2:172.21.15.171:3300/0 conn(0x7f216415d850 0x7f216415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:57.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 --2- 172.21.15.6:0/1081604515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216406e760 0x7f216406eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 -- 172.21.15.6:0/1081604515 >> 172.21.15.6:0/1081604515 conn(0x7f21640cd2a0 msgr2=0x7f21640cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:57.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 -- 172.21.15.6:0/1081604515 shutdown_connections 2024-05-20T17:58:57.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.879+0000 7f216b028640 1 -- 172.21.15.6:0/1081604515 wait complete. 2024-05-20T17:58:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.881+0000 7f216b028640 1 Processor -- start 2024-05-20T17:58:57.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.881+0000 7f216b028640 1 -- start start 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.882+0000 7f216b028640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f216406e760 0x7f21641f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.882+0000 7f216b028640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415d850 0x7f2164147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.882+0000 7f216b028640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216415e1a0 0x7f2164148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.882+0000 7f216b028640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f216406ca20 con 0x7f216415d850 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.882+0000 7f216b028640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f216406c740 con 0x7f216406e760 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.882+0000 7f216b028640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f21640cedf0 con 0x7f216415e1a0 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415d850 0x7f2164147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415d850 0x7f2164147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41584/0 (socket says 172.21.15.6:41584) 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 -- 172.21.15.6:0/1096388579 learned_addr learned my addr 172.21.15.6:0/1096388579 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2168dc4640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f216406e760 0x7f21641f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:57.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f21695c5640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216415e1a0 0x7f2164148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 -- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216415e1a0 msgr2=0x7f2164148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216415e1a0 0x7f2164148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 -- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f216406e760 msgr2=0x7f21641f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f216406e760 0x7f21641f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 -- 172.21.15.6:0/1096388579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21641f4400 con 0x7f216415d850 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f2163fff640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415d850 0x7f2164147bd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f215000e8a0 tx=0x7f215000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f21617fa640 1 -- 172.21.15.6:0/1096388579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150017070 con 0x7f216415d850 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f21617fa640 1 -- 172.21.15.6:0/1096388579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215000ee90 con 0x7f216415d850 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f21617fa640 1 -- 172.21.15.6:0/1096388579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215000cb60 con 0x7f216415d850 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.883+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21641e4a70 con 0x7f216415d850 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.884+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21641e5030 con 0x7f216415d850 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.884+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216406cd00 con 0x7f216415d850 2024-05-20T17:58:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.885+0000 7f21617fa640 1 -- 172.21.15.6:0/1096388579 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f215001a070 con 0x7f216415d850 2024-05-20T17:58:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.886+0000 7f21617fa640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214806be30 0x7f214806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:58:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.886+0000 7f21617fa640 1 -- 172.21.15.6:0/1096388579 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f215008ade0 con 0x7f216415d850 2024-05-20T17:58:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.886+0000 7f2168dc4640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214806be30 0x7f214806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:58:57.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.887+0000 7f2168dc4640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214806be30 0x7f214806e340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2158009aa0 tx=0x7f2158009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:58:57.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:57.891+0000 7f21617fa640 1 -- 172.21.15.6:0/1096388579 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f216406cd00 con 0x7f216415d850 2024-05-20T17:58:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.114+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f21641e4800 con 0x7f216415d850 2024-05-20T17:58:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.115+0000 7f21617fa640 1 -- 172.21.15.6:0/1096388579 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f21641f4400 con 0x7f216415d850 2024-05-20T17:58:58.112 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:58:58.112 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:58:58.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.116+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214806be30 msgr2=0x7f214806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.116+0000 7f216b028640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214806be30 0x7f214806e340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2158009aa0 tx=0x7f2158009190 comp rx=0 tx=0).stop 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415d850 msgr2=0x7f2164147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415d850 0x7f2164147bd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f215000e8a0 tx=0x7f215000ed60 comp rx=0 tx=0).stop 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 shutdown_connections 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f214806be30 0x7f214806e340 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f216415e1a0 0x7f2164148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f216415d850 0x7f2164147bd0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 --2- 172.21.15.6:0/1096388579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f216406e760 0x7f21641f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 >> 172.21.15.6:0/1096388579 conn(0x7f21640cd2a0 msgr2=0x7f21640adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 shutdown_connections 2024-05-20T17:58:58.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:58:58.117+0000 7f216b028640 1 -- 172.21.15.6:0/1096388579 wait complete. 2024-05-20T17:58:58.125 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:58:58.125 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:58:59.214 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:01.216 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:03.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.256+0000 7fbbf50f0640 1 Processor -- start 2024-05-20T17:59:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.256+0000 7fbbf50f0640 1 -- start start 2024-05-20T17:59:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbf50f0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00cc660 0x7fbbf0169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbf50f0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf015f7b0 con 0x7fbbf00cea10 2024-05-20T17:59:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbf50f0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbf00cef40 con 0x7fbbf00b2240 2024-05-20T17:59:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbf50f0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf00b2c70 con 0x7fbbf00cc660 2024-05-20T17:59:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbee59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbbf00cea10 0x7fbbf00cbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41442/0 (socket says 172.21.15.6:41442) 2024-05-20T17:59:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbee59c640 1 -- 172.21.15.6:0/2739442925 learned_addr learned my addr 172.21.15.6:0/2739442925 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbef59e640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00cc660 0x7fbbf0169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232921539 0 0) 0x7fbbf015f7b0 con 0x7fbbf00cea10 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbd8003520 con 0x7fbbf00cea10 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2254538604 0 0) 0x7fbbd8003520 con 0x7fbbf00cea10 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00cc660 msgr2=0x7fbbf0169ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.258+0000 7fbbedd9b640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00cc660 0x7fbbf0169ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 >> v1:172.21.15.171:6789/0 conn(0x7fbbf00b2240 legacy=0x7fbbf009adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf00b2f50 con 0x7fbbf00cea10 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fbbe4001670 con 0x7fbbf00cea10 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 >> v1:172.21.15.6:6789/0 conn(0x7fbbf00cea10 legacy=0x7fbbf00cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbd8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd8004800 0x7fbbd8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd8005150 0x7fbbd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf00b2c70 con 0x7fbbd80039e0 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd800bf00 con 0x7fbbd8004800 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd800c080 con 0x7fbbd8005150 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbeed9d640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbd8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbee59c640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd8004800 0x7fbbd8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbef59e640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd8005150 0x7fbbd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbeed9d640 1 -- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd8005150 msgr2=0x7fbbd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbeed9d640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbd8005150 0x7fbbd800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbeed9d640 1 -- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd8004800 msgr2=0x7fbbd8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbeed9d640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbd8004800 0x7fbbd8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.259+0000 7fbbeed9d640 1 -- 172.21.15.6:0/2739442925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd8003520 con 0x7fbbd80039e0 2024-05-20T17:59:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.260+0000 7fbbeed9d640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbd8003e10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0001940 tx=0x7fbbd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79d76e8a76063e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.260+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0037070 con 0x7fbbd80039e0 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.260+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe002ac90 con 0x7fbbd80039e0 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.260+0000 7fbbedd9b640 1 -- 172.21.15.6:0/2739442925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00014e0 con 0x7fbbd80039e0 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.261+0000 7fbbf50f0640 1 -- 172.21.15.6:0/2739442925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 msgr2=0x7fbbd8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.261+0000 7fbbf50f0640 1 --2- 172.21.15.6:0/2739442925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbd8003e10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0001940 tx=0x7fbbd8005830 comp rx=0 tx=0).stop 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.261+0000 7fbbef59e640 1 -- 172.21.15.6:0/2739442925 reap_dead start 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.261+0000 7fbbf50f0640 1 -- 172.21.15.6:0/2739442925 shutdown_connections 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.261+0000 7fbbf50f0640 1 -- 172.21.15.6:0/2739442925 >> 172.21.15.6:0/2739442925 conn(0x7fbbf00b6620 msgr2=0x7fbbf00b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.261+0000 7fbbf50f0640 1 -- 172.21.15.6:0/2739442925 shutdown_connections 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.261+0000 7fbbf50f0640 1 -- 172.21.15.6:0/2739442925 wait complete. 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.263+0000 7fbbf50f0640 1 Processor -- start 2024-05-20T17:59:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.263+0000 7fbbf50f0640 1 -- start start 2024-05-20T17:59:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.264+0000 7fbbf50f0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbf0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.264+0000 7fbbf50f0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00c7bf0 0x7fbbf00c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.264+0000 7fbbf50f0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf00c70d0 0x7fbbf00c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.264+0000 7fbbf50f0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf00cc7e0 con 0x7fbbd80039e0 2024-05-20T17:59:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.264+0000 7fbbf50f0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf00cc660 con 0x7fbbf00c70d0 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.264+0000 7fbbf50f0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf00d1ef0 con 0x7fbbf00c7bf0 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbf0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbf0157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41602/0 (socket says 172.21.15.6:41602) 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 -- 172.21.15.6:0/4106558635 learned_addr learned my addr 172.21.15.6:0/4106558635 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbef59e640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf00c70d0 0x7fbbf00c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbee59c640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00c7bf0 0x7fbbf00c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 -- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00c7bf0 msgr2=0x7fbbf00c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00c7bf0 0x7fbbf00c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 -- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf00c70d0 msgr2=0x7fbbf00c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf00c70d0 0x7fbbf00c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 -- 172.21.15.6:0/4106558635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf00b1120 con 0x7fbbd80039e0 2024-05-20T17:59:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbef59e640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf00c70d0 0x7fbbf00c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbeed9d640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbf0157e70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00018e0 tx=0x7fbbe00012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbd77fe640 1 -- 172.21.15.6:0/4106558635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0037040 con 0x7fbbd80039e0 2024-05-20T17:59:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.265+0000 7fbbd77fe640 1 -- 172.21.15.6:0/4106558635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe00052e0 con 0x7fbbd80039e0 2024-05-20T17:59:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.266+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf00b1400 con 0x7fbbd80039e0 2024-05-20T17:59:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.266+0000 7fbbd77fe640 1 -- 172.21.15.6:0/4106558635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0007260 con 0x7fbbd80039e0 2024-05-20T17:59:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.266+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf01583b0 con 0x7fbbd80039e0 2024-05-20T17:59:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.267+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf00d0230 con 0x7fbbd80039e0 2024-05-20T17:59:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.267+0000 7fbbd77fe640 1 -- 172.21.15.6:0/4106558635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbe003a070 con 0x7fbbd80039e0 2024-05-20T17:59:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.268+0000 7fbbd77fe640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbdc06be30 0x7fbbdc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.268+0000 7fbbd77fe640 1 -- 172.21.15.6:0/4106558635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fbbe00ab100 con 0x7fbbd80039e0 2024-05-20T17:59:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.268+0000 7fbbee59c640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbdc06be30 0x7fbbdc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.269+0000 7fbbee59c640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbdc06be30 0x7fbbdc06e340 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbbf01f8380 tx=0x7fbbe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.272+0000 7fbbd77fe640 1 -- 172.21.15.6:0/4106558635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbbf00d0230 con 0x7fbbd80039e0 2024-05-20T17:59:03.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.501+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbbf00690b0 con 0x7fbbd80039e0 2024-05-20T17:59:03.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.501+0000 7fbbd77fe640 1 -- 172.21.15.6:0/4106558635 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fbbe0079820 con 0x7fbbd80039e0 2024-05-20T17:59:03.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:03.499 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.503+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbdc06be30 msgr2=0x7fbbdc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.503+0000 7fbbf50f0640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbdc06be30 0x7fbbdc06e340 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbbf01f8380 tx=0x7fbbe4009040 comp rx=0 tx=0).stop 2024-05-20T17:59:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 msgr2=0x7fbbf0157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbf0157e70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00018e0 tx=0x7fbbe00012b0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 shutdown_connections 2024-05-20T17:59:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbbdc06be30 0x7fbbdc06e340 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbbf00c70d0 0x7fbbf00c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbbf00c7bf0 0x7fbbf00c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 --2- 172.21.15.6:0/4106558635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbd80039e0 0x7fbbf0157e70 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 >> 172.21.15.6:0/4106558635 conn(0x7fbbf00b6620 msgr2=0x7fbbf006d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 shutdown_connections 2024-05-20T17:59:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:03.504+0000 7fbbf50f0640 1 -- 172.21.15.6:0/4106558635 wait complete. 2024-05-20T17:59:03.513 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:03.513 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:59:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:06.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:59:06.650 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:59:07.222 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:08.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:08.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.644+0000 7f8dc83fc640 1 Processor -- start 2024-05-20T17:59:08.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.644+0000 7f8dc83fc640 1 -- start start 2024-05-20T17:59:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc83fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc00d0560 0x7f8dc006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc83fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dc006d910 0x7f8dc00b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc83fc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc006dd20 con 0x7f8dc00b4070 2024-05-20T17:59:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc83fc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc00b8490 con 0x7f8dc006d910 2024-05-20T17:59:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc83fc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc015fa90 con 0x7f8dc00d0560 2024-05-20T17:59:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc6999640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dc006d910 0x7f8dc00b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc6198640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8dc00b4070 0x7f8dc00ba5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55834/0 (socket says 172.21.15.6:55834) 2024-05-20T17:59:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc6198640 1 -- 172.21.15.6:0/342499972 learned_addr learned my addr 172.21.15.6:0/342499972 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc5997640 1 --2- 172.21.15.6:0/342499972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc00d0560 0x7f8dc006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc6999640 1 -- 172.21.15.6:0/342499972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc00d0560 msgr2=0x7f8dc006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc6999640 1 --2- 172.21.15.6:0/342499972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc00d0560 0x7f8dc006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.647+0000 7f8dc6999640 1 -- 172.21.15.6:0/342499972 >> v1:172.21.15.6:6789/0 conn(0x7f8dc00b4070 legacy=0x7f8dc00ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.647+0000 7f8dc6999640 1 -- 172.21.15.6:0/342499972 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc00d3f00 con 0x7f8dc006d910 2024-05-20T17:59:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.646+0000 7f8dc5196640 1 -- 172.21.15.6:0/342499972 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135384740 0 0) 0x7f8dbc001110 con 0x7f8dc00b4070 2024-05-20T17:59:08.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.647+0000 7f8dc6999640 1 --2- 172.21.15.6:0/342499972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc006d910 0x7f8dc00b8920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009d90 tx=0x7f8db802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65563cdcec145f13 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:08.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc5196640 1 -- 172.21.15.6:0/342499972 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8007740 con 0x7f8dc006d910 2024-05-20T17:59:08.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc5196640 1 -- 172.21.15.6:0/342499972 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db80078e0 con 0x7f8dc006d910 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc5196640 1 -- 172.21.15.6:0/342499972 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8007cb0 con 0x7f8dc006d910 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc83fc640 1 -- 172.21.15.6:0/342499972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc006d910 msgr2=0x7f8dc00b8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/342499972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc006d910 0x7f8dc00b8920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009d90 tx=0x7f8db802a660 comp rx=0 tx=0).stop 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc83fc640 1 -- 172.21.15.6:0/342499972 shutdown_connections 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/342499972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc006d910 0x7f8dc00b8920 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/342499972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc00d0560 0x7f8dc006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc83fc640 1 -- 172.21.15.6:0/342499972 >> 172.21.15.6:0/342499972 conn(0x7f8dc00d4c10 msgr2=0x7f8dc00d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc83fc640 1 -- 172.21.15.6:0/342499972 shutdown_connections 2024-05-20T17:59:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.648+0000 7f8dc83fc640 1 -- 172.21.15.6:0/342499972 wait complete. 2024-05-20T17:59:08.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.650+0000 7f8dc83fc640 1 Processor -- start 2024-05-20T17:59:08.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.650+0000 7f8dc83fc640 1 -- start start 2024-05-20T17:59:08.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.651+0000 7f8dc83fc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc006d910 0x7f8dc014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:08.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.651+0000 7f8dc83fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc00b4070 0x7f8dc00ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:08.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.651+0000 7f8dc83fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc00d0560 0x7f8dc00cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc83fc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc00d47a0 con 0x7f8dc00d0560 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc83fc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc00d44c0 con 0x7f8dc00b4070 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc83fc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc00d3b20 con 0x7f8dc006d910 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc00d0560 0x7f8dc00cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc00d0560 0x7f8dc00cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57744/0 (socket says 172.21.15.6:57744) 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 -- 172.21.15.6:0/3018530094 learned_addr learned my addr 172.21.15.6:0/3018530094 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6198640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc006d910 0x7f8dc014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc5997640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc00b4070 0x7f8dc00ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 -- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc006d910 msgr2=0x7f8dc014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc006d910 0x7f8dc014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 -- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc00b4070 msgr2=0x7f8dc00ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:08.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc00b4070 0x7f8dc00ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 -- 172.21.15.6:0/3018530094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc00c8b80 con 0x7f8dc00d0560 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6198640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc006d910 0x7f8dc014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc5997640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc00b4070 0x7f8dc00ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8dc6999640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc00d0560 0x7f8dc00cad70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009d90 tx=0x7f8db8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.652+0000 7f8db6ffd640 1 -- 172.21.15.6:0/3018530094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db803f070 con 0x7f8dc00d0560 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.653+0000 7f8db6ffd640 1 -- 172.21.15.6:0/3018530094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db8031bc0 con 0x7f8dc00d0560 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.653+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc00c8e60 con 0x7f8dc00d0560 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.653+0000 7f8db6ffd640 1 -- 172.21.15.6:0/3018530094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8009450 con 0x7f8dc00d0560 2024-05-20T17:59:08.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.653+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc00c9420 con 0x7f8dc00d0560 2024-05-20T17:59:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.654+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc00690b0 con 0x7f8dc00d0560 2024-05-20T17:59:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.654+0000 7f8db6ffd640 1 -- 172.21.15.6:0/3018530094 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8db803b410 con 0x7f8dc00d0560 2024-05-20T17:59:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.655+0000 7f8db6ffd640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8da406be30 0x7f8da406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.655+0000 7f8db6ffd640 1 -- 172.21.15.6:0/3018530094 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f8db80ac560 con 0x7f8dc00d0560 2024-05-20T17:59:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.655+0000 7f8dc6198640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8da406be30 0x7f8da406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:08.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.656+0000 7f8dc6198640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8da406be30 0x7f8da406e340 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc000f60 tx=0x7f8dbc007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:08.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.660+0000 7f8db6ffd640 1 -- 172.21.15.6:0/3018530094 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8db807ac80 con 0x7f8dc00d0560 2024-05-20T17:59:08.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.882+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8dc00b4a80 con 0x7f8dc00d0560 2024-05-20T17:59:08.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.882+0000 7f8db6ffd640 1 -- 172.21.15.6:0/3018530094 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f8db807a580 con 0x7f8dc00d0560 2024-05-20T17:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:08.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.884+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8da406be30 msgr2=0x7f8da406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.884+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8da406be30 0x7f8da406e340 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc000f60 tx=0x7f8dbc007ca0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.884+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc00d0560 msgr2=0x7f8dc00cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.884+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc00d0560 0x7f8dc00cad70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009d90 tx=0x7f8db8004a40 comp rx=0 tx=0).stop 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.885+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 shutdown_connections 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.885+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8da406be30 0x7f8da406e340 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.885+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dc00d0560 0x7f8dc00cad70 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.885+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dc00b4070 0x7f8dc00ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.885+0000 7f8dc83fc640 1 --2- 172.21.15.6:0/3018530094 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dc006d910 0x7f8dc014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.885+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 >> 172.21.15.6:0/3018530094 conn(0x7f8dc00d4c10 msgr2=0x7f8dc00cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.885+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 shutdown_connections 2024-05-20T17:59:08.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:08.885+0000 7f8dc83fc640 1 -- 172.21.15.6:0/3018530094 wait complete. 2024-05-20T17:59:08.893 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:08.893 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:59:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:11.227 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:13.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:14.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.024+0000 7f8825110640 1 Processor -- start 2024-05-20T17:59:14.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.024+0000 7f8825110640 1 -- start start 2024-05-20T17:59:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.025+0000 7f8825110640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88200d0560 0x7f882006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.025+0000 7f8825110640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882006dd20 con 0x7f882006d910 2024-05-20T17:59:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.025+0000 7f8825110640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882015fa90 con 0x7f88200b4070 2024-05-20T17:59:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.025+0000 7f8825110640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f88200b8490 con 0x7f88200d0560 2024-05-20T17:59:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.025+0000 7f881f59e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f882006d910 0x7f88200b8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55842/0 (socket says 172.21.15.6:55842) 2024-05-20T17:59:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881f59e640 1 -- 172.21.15.6:0/1276703762 learned_addr learned my addr 172.21.15.6:0/1276703762 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:14.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881659c640 1 --2- 172.21.15.6:0/1276703762 >> v2:172.21.15.171:3300/0 conn(0x7f88200d0560 0x7f882006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741167824 0 0) 0x7f8818001490 con 0x7f882006d910 2024-05-20T17:59:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f880c003520 con 0x7f882006d910 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 477551083 0 0) 0x7f882015fa90 con 0x7f88200b4070 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8818001490 con 0x7f88200b4070 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4204746192 0 0) 0x7f880c003520 con 0x7f882006d910 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 >> v2:172.21.15.171:3300/0 conn(0x7f88200d0560 msgr2=0x7f882006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 --2- 172.21.15.6:0/1276703762 >> v2:172.21.15.171:3300/0 conn(0x7f88200d0560 0x7f882006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 >> v1:172.21.15.171:6789/0 conn(0x7f88200b4070 legacy=0x7f88200ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88200d3f00 con 0x7f882006d910 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f8818001b40 con 0x7f882006d910 2024-05-20T17:59:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 >> v1:172.21.15.6:6789/0 conn(0x7f882006d910 legacy=0x7f88200b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c003b90 0x7f880c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c004800 0x7f880c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f880c005280 0x7f880c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f88200b8490 con 0x7f880c004800 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f880c00c230 con 0x7f880c003b90 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f880c00c430 con 0x7f880c005280 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.026+0000 7f881659c640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c004800 0x7f880c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.027+0000 7f881ed9d640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c003b90 0x7f880c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.027+0000 7f881f59e640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f880c005280 0x7f880c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.027+0000 7f881659c640 1 -- 172.21.15.6:0/1276703762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f880c005280 msgr2=0x7f880c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.027+0000 7f881659c640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f880c005280 0x7f880c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.027+0000 7f881659c640 1 -- 172.21.15.6:0/1276703762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c003b90 msgr2=0x7f880c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.027+0000 7f881659c640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c003b90 0x7f880c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.027+0000 7f881659c640 1 -- 172.21.15.6:0/1276703762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c003520 con 0x7f880c004800 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.027+0000 7f881f59e640 1 -- 172.21.15.6:0/1276703762 reap_dead start 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f881659c640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c004800 0x7f880c004c10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f8820074770 tx=0x7f880c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdec2ff042d0bd06 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8808036070 con 0x7f880c004800 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8808031400 con 0x7f880c004800 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f881e59c640 1 -- 172.21.15.6:0/1276703762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8808009690 con 0x7f880c004800 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f8825110640 1 -- 172.21.15.6:0/1276703762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c004800 msgr2=0x7f880c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f8825110640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c004800 0x7f880c004c10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f8820074770 tx=0x7f880c005830 comp rx=0 tx=0).stop 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f8825110640 1 -- 172.21.15.6:0/1276703762 shutdown_connections 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f8825110640 1 --2- 172.21.15.6:0/1276703762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f880c004800 0x7f880c004c10 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.028+0000 7f8825110640 1 -- 172.21.15.6:0/1276703762 >> 172.21.15.6:0/1276703762 conn(0x7f88200d4c10 msgr2=0x7f88200d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.029+0000 7f8825110640 1 -- 172.21.15.6:0/1276703762 shutdown_connections 2024-05-20T17:59:14.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.029+0000 7f8825110640 1 -- 172.21.15.6:0/1276703762 wait complete. 2024-05-20T17:59:14.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.031+0000 7f8825110640 1 Processor -- start 2024-05-20T17:59:14.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.031+0000 7f8825110640 1 -- start start 2024-05-20T17:59:14.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f8825110640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c004800 0x7f88200b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:14.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f8825110640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200cadb0 0x7f88200b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:14.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f8825110640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820153e10 0x7f8820161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:14.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f8825110640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f88200d47a0 con 0x7f8820153e10 2024-05-20T17:59:14.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f8825110640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f88200d44c0 con 0x7f880c004800 2024-05-20T17:59:14.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f8825110640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f88200d3b20 con 0x7f88200cadb0 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f881f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820153e10 0x7f8820161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f881f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820153e10 0x7f8820161c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57754/0 (socket says 172.21.15.6:57754) 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f881f59e640 1 -- 172.21.15.6:0/2924328972 learned_addr learned my addr 172.21.15.6:0/2924328972 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f881ed9d640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c004800 0x7f88200b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.032+0000 7f881659c640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200cadb0 0x7f88200b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f881f59e640 1 -- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200cadb0 msgr2=0x7f88200b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f881f59e640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200cadb0 0x7f88200b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f881f59e640 1 -- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c004800 msgr2=0x7f88200b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f881f59e640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c004800 0x7f88200b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f881f59e640 1 -- 172.21.15.6:0/2924328972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88200c9d10 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f881f59e640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820153e10 0x7f8820161c90 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f882004f820 tx=0x7f8818007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f8817fff640 1 -- 172.21.15.6:0/2924328972 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881800ab60 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f8817fff640 1 -- 172.21.15.6:0/2924328972 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818019070 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88200c9ff0 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f8817fff640 1 -- 172.21.15.6:0/2924328972 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88180133f0 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.033+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88200ca5b0 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.034+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88200690b0 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.035+0000 7f8817fff640 1 -- 172.21.15.6:0/2924328972 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8818013590 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.036+0000 7f8817fff640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880006be30 0x7f880006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.036+0000 7f8817fff640 1 -- 172.21.15.6:0/2924328972 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f881808b620 con 0x7f8820153e10 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.036+0000 7f881ed9d640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880006be30 0x7f880006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:14.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.037+0000 7f881ed9d640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880006be30 0x7f880006e340 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8810001850 tx=0x7f8810009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:14.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.041+0000 7f8817fff640 1 -- 172.21.15.6:0/2924328972 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f882006dd20 con 0x7f8820153e10 2024-05-20T17:59:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.264+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f88200c9aa0 con 0x7f8820153e10 2024-05-20T17:59:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.265+0000 7f8817fff640 1 -- 172.21.15.6:0/2924328972 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f8818059cc0 con 0x7f8820153e10 2024-05-20T17:59:14.263 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:14.263 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:14.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.266+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880006be30 msgr2=0x7f880006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:14.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.266+0000 7f8825110640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880006be30 0x7f880006e340 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8810001850 tx=0x7f8810009040 comp rx=0 tx=0).stop 2024-05-20T17:59:14.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820153e10 msgr2=0x7f8820161c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:14.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820153e10 0x7f8820161c90 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f882004f820 tx=0x7f8818007b10 comp rx=0 tx=0).stop 2024-05-20T17:59:14.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 shutdown_connections 2024-05-20T17:59:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880006be30 0x7f880006e340 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820153e10 0x7f8820161c90 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200cadb0 0x7f88200b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 --2- 172.21.15.6:0/2924328972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c004800 0x7f88200b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 >> 172.21.15.6:0/2924328972 conn(0x7f88200d4c10 msgr2=0x7f882015efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 shutdown_connections 2024-05-20T17:59:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:14.267+0000 7f8825110640 1 -- 172.21.15.6:0/2924328972 wait complete. 2024-05-20T17:59:14.276 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:14.276 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:59:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:19.235 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:19.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.408+0000 7fa729f21640 1 Processor -- start 2024-05-20T17:59:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.408+0000 7fa729f21640 1 -- start start 2024-05-20T17:59:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa729f21640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7240d1590 0x7fa7240cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa729f21640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 0x7fa7240ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa729f21640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7240b41f0 con 0x7fa7240b81e0 2024-05-20T17:59:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa729f21640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa7240b3000 con 0x7fa7240d1590 2024-05-20T17:59:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa729f21640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa72408cbb0 con 0x7fa7240cddc0 2024-05-20T17:59:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa722ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7240d1590 0x7fa7240cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa7237fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa7240b81e0 0x7fa7240d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58960/0 (socket says 172.21.15.6:58960) 2024-05-20T17:59:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa7237fe640 1 -- 172.21.15.6:0/1047089976 learned_addr learned my addr 172.21.15.6:0/1047089976 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.409+0000 7fa723fff640 1 --2- 172.21.15.6:0/1047089976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 0x7fa7240ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.410+0000 7fa7227fc640 1 -- 172.21.15.6:0/1047089976 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125769091 0 0) 0x7fa7240b41f0 con 0x7fa7240b81e0 2024-05-20T17:59:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.410+0000 7fa7227fc640 1 -- 172.21.15.6:0/1047089976 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa70c003520 con 0x7fa7240b81e0 2024-05-20T17:59:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.410+0000 7fa722ffd640 1 -- 172.21.15.6:0/1047089976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 msgr2=0x7fa7240ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.410+0000 7fa722ffd640 1 --2- 172.21.15.6:0/1047089976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 0x7fa7240ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.410+0000 7fa722ffd640 1 -- 172.21.15.6:0/1047089976 >> v1:172.21.15.6:6789/0 conn(0x7fa7240b81e0 legacy=0x7fa7240d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.410+0000 7fa722ffd640 1 -- 172.21.15.6:0/1047089976 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72408ce70 con 0x7fa7240d1590 2024-05-20T17:59:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.410+0000 7fa722ffd640 1 --2- 172.21.15.6:0/1047089976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7240cd880 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fa7180097a0 tx=0x7fa71802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b08725de2f7e906 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa7227fc640 1 -- 172.21.15.6:0/1047089976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718037070 con 0x7fa7240d1590 2024-05-20T17:59:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa7227fc640 1 -- 172.21.15.6:0/1047089976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa718032440 con 0x7fa7240d1590 2024-05-20T17:59:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa7227fc640 1 -- 172.21.15.6:0/1047089976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718032810 con 0x7fa7240d1590 2024-05-20T17:59:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa729f21640 1 -- 172.21.15.6:0/1047089976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 msgr2=0x7fa7240cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa729f21640 1 --2- 172.21.15.6:0/1047089976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7240cd880 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fa7180097a0 tx=0x7fa71802a180 comp rx=0 tx=0).stop 2024-05-20T17:59:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa729f21640 1 -- 172.21.15.6:0/1047089976 shutdown_connections 2024-05-20T17:59:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa729f21640 1 --2- 172.21.15.6:0/1047089976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 0x7fa7240ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa729f21640 1 --2- 172.21.15.6:0/1047089976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7240cd880 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa729f21640 1 -- 172.21.15.6:0/1047089976 >> 172.21.15.6:0/1047089976 conn(0x7fa7240b44f0 msgr2=0x7fa7240b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa729f21640 1 -- 172.21.15.6:0/1047089976 shutdown_connections 2024-05-20T17:59:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.411+0000 7fa729f21640 1 -- 172.21.15.6:0/1047089976 wait complete. 2024-05-20T17:59:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.413+0000 7fa729f21640 1 Processor -- start 2024-05-20T17:59:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.414+0000 7fa729f21640 1 -- start start 2024-05-20T17:59:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa729f21640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7240b81e0 0x7fa7241ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa729f21640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 0x7fa7241ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa729f21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7241cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa729f21640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7240b3490 con 0x7fa7240d1590 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa729f21640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7240d19a0 con 0x7fa7240b81e0 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa729f21640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa7241d0300 con 0x7fa7240cddc0 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa723fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7241cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa723fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7241cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50854/0 (socket says 172.21.15.6:50854) 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa723fff640 1 -- 172.21.15.6:0/3925025467 learned_addr learned my addr 172.21.15.6:0/3925025467 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa722ffd640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 0x7fa7241ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa7237fe640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7240b81e0 0x7fa7241ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa723fff640 1 -- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 msgr2=0x7fa7241ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa723fff640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 0x7fa7241ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa723fff640 1 -- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7240b81e0 msgr2=0x7fa7241ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa723fff640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7240b81e0 0x7fa7241ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa723fff640 1 -- 172.21.15.6:0/3925025467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7240b72c0 con 0x7fa7240d1590 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.415+0000 7fa7237fe640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7240b81e0 0x7fa7241ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.416+0000 7fa723fff640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7241cf140 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00efc0 tx=0x7fa71c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.416+0000 7fa70bfff640 1 -- 172.21.15.6:0/3925025467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c018020 con 0x7fa7240d1590 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.416+0000 7fa70bfff640 1 -- 172.21.15.6:0/3925025467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71c00ccd0 con 0x7fa7240d1590 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.416+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7240b6500 con 0x7fa7240d1590 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.416+0000 7fa70bfff640 1 -- 172.21.15.6:0/3925025467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c0146a0 con 0x7fa7240d1590 2024-05-20T17:59:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.416+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7240b6ac0 con 0x7fa7240d1590 2024-05-20T17:59:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.417+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7240690b0 con 0x7fa7240d1590 2024-05-20T17:59:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.417+0000 7fa70bfff640 1 -- 172.21.15.6:0/3925025467 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa71c01b020 con 0x7fa7240d1590 2024-05-20T17:59:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.418+0000 7fa70bfff640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71006be60 0x7fa71006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.418+0000 7fa70bfff640 1 -- 172.21.15.6:0/3925025467 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fa71c08bdb0 con 0x7fa7240d1590 2024-05-20T17:59:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.418+0000 7fa7237fe640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71006be60 0x7fa71006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:19.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.419+0000 7fa7237fe640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71006be60 0x7fa71006e370 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa714001360 tx=0x7fa714009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.423+0000 7fa70bfff640 1 -- 172.21.15.6:0/3925025467 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa71c022020 con 0x7fa7240d1590 2024-05-20T17:59:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.647+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa7240d0f20 con 0x7fa7240d1590 2024-05-20T17:59:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.648+0000 7fa70bfff640 1 -- 172.21.15.6:0/3925025467 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fa71c010040 con 0x7fa7240d1590 2024-05-20T17:59:19.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:19.646 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71006be60 msgr2=0x7fa71006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71006be60 0x7fa71006e370 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa714001360 tx=0x7fa714009040 comp rx=0 tx=0).stop 2024-05-20T17:59:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 msgr2=0x7fa7241cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7241cf140 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00efc0 tx=0x7fa71c00c490 comp rx=0 tx=0).stop 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 shutdown_connections 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa71006be60 0x7fa71006e370 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7240d1590 0x7fa7241cf140 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7240cddc0 0x7fa7241ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 --2- 172.21.15.6:0/3925025467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7240b81e0 0x7fa7241ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.649+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 >> 172.21.15.6:0/3925025467 conn(0x7fa7240b44f0 msgr2=0x7fa72408ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.650+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 shutdown_connections 2024-05-20T17:59:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:19.650+0000 7fa729f21640 1 -- 172.21.15.6:0/3925025467 wait complete. 2024-05-20T17:59:19.659 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:19.660 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:59:21.237 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:23.239 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:24.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:24.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.791+0000 7fd671621640 1 Processor -- start 2024-05-20T17:59:24.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.791+0000 7fd671621640 1 -- start start 2024-05-20T17:59:24.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.792+0000 7fd671621640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd66c0b4070 0x7fd66c0ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:24.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.792+0000 7fd671621640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd66c06dae0 0x7fd66c0b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:24.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.792+0000 7fd671621640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c15fa90 con 0x7fd66c0d0560 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.792+0000 7fd671621640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd66c0b8490 con 0x7fd66c06dae0 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.792+0000 7fd671621640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd66c0d3f00 con 0x7fd66c0b4070 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd66b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd66c06dae0 0x7fd66c0b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd66b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd66c06dae0 0x7fd66c0b8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50862/0 (socket says 172.21.15.6:50862) 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd66b7fe640 1 -- 172.21.15.6:0/2231827181 learned_addr learned my addr 172.21.15.6:0/2231827181 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd66affd640 1 --2- 172.21.15.6:0/2231827181 >> v2:172.21.15.171:3300/0 conn(0x7fd66c0b4070 0x7fd66c0ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd66b7fe640 1 -- 172.21.15.6:0/2231827181 >> v2:172.21.15.171:3300/0 conn(0x7fd66c0b4070 msgr2=0x7fd66c0ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd66b7fe640 1 --2- 172.21.15.6:0/2231827181 >> v2:172.21.15.171:3300/0 conn(0x7fd66c0b4070 0x7fd66c0ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd66b7fe640 1 -- 172.21.15.6:0/2231827181 >> v1:172.21.15.171:6789/0 conn(0x7fd66c0d0560 legacy=0x7fd66c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd66b7fe640 1 -- 172.21.15.6:0/2231827181 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c0d41e0 con 0x7fd66c06dae0 2024-05-20T17:59:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.793+0000 7fd669ffb640 1 -- 172.21.15.6:0/2231827181 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059730826 0 0) 0x7fd66c15fa90 con 0x7fd66c0d0560 2024-05-20T17:59:24.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.794+0000 7fd66b7fe640 1 --2- 172.21.15.6:0/2231827181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c06dae0 0x7fd66c0b8920 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd66c08d250 tx=0x7fd66402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d487be10e5830e68 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:24.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.794+0000 7fd669ffb640 1 -- 172.21.15.6:0/2231827181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664036070 con 0x7fd66c06dae0 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.794+0000 7fd669ffb640 1 -- 172.21.15.6:0/2231827181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd664031600 con 0x7fd66c06dae0 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.794+0000 7fd669ffb640 1 -- 172.21.15.6:0/2231827181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6640319d0 con 0x7fd66c06dae0 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.795+0000 7fd671621640 1 -- 172.21.15.6:0/2231827181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c06dae0 msgr2=0x7fd66c0b8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.795+0000 7fd671621640 1 --2- 172.21.15.6:0/2231827181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c06dae0 0x7fd66c0b8920 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd66c08d250 tx=0x7fd66402a6a0 comp rx=0 tx=0).stop 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.795+0000 7fd671621640 1 -- 172.21.15.6:0/2231827181 shutdown_connections 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.795+0000 7fd671621640 1 --2- 172.21.15.6:0/2231827181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c06dae0 0x7fd66c0b8920 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.795+0000 7fd671621640 1 --2- 172.21.15.6:0/2231827181 >> v2:172.21.15.171:3300/0 conn(0x7fd66c0b4070 0x7fd66c0ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.795+0000 7fd671621640 1 -- 172.21.15.6:0/2231827181 >> 172.21.15.6:0/2231827181 conn(0x7fd66c0d4c10 msgr2=0x7fd66c0d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.795+0000 7fd671621640 1 -- 172.21.15.6:0/2231827181 shutdown_connections 2024-05-20T17:59:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.795+0000 7fd671621640 1 -- 172.21.15.6:0/2231827181 wait complete. 2024-05-20T17:59:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.797+0000 7fd671621640 1 Processor -- start 2024-05-20T17:59:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.797+0000 7fd671621640 1 -- start start 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd671621640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c0b4070 0x7fd66c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd671621640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd66c0d0560 0x7fd66c0b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd671621640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd66c158c10 0x7fd66c0b9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd671621640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c0bab00 con 0x7fd66c0b4070 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd671621640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c0d47a0 con 0x7fd66c0d0560 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd671621640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd66c0d3b20 con 0x7fd66c158c10 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd66affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c0b4070 0x7fd66c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd66affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c0b4070 0x7fd66c0cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50870/0 (socket says 172.21.15.6:50870) 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd66affd640 1 -- 172.21.15.6:0/3741603194 learned_addr learned my addr 172.21.15.6:0/3741603194 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.798+0000 7fd66b7fe640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd66c158c10 0x7fd66c0b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd66a7fc640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd66c0d0560 0x7fd66c0b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd66affd640 1 -- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd66c158c10 msgr2=0x7fd66c0b9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd66affd640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd66c158c10 0x7fd66c0b9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd66affd640 1 -- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd66c0d0560 msgr2=0x7fd66c0b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd66affd640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd66c0d0560 0x7fd66c0b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd66affd640 1 -- 172.21.15.6:0/3741603194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c0cc6d0 con 0x7fd66c0b4070 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd66a7fc640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd66c0d0560 0x7fd66c0b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd66affd640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c0b4070 0x7fd66c0cc190 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00e870 tx=0x7fd65c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd6537fe640 1 -- 172.21.15.6:0/3741603194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c017070 con 0x7fd66c0b4070 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd6537fe640 1 -- 172.21.15.6:0/3741603194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65c00ee60 con 0x7fd66c0b4070 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66c0c97c0 con 0x7fd66c0b4070 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd6537fe640 1 -- 172.21.15.6:0/3741603194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00cb00 con 0x7fd66c0b4070 2024-05-20T17:59:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.799+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66c0c9d80 con 0x7fd66c0b4070 2024-05-20T17:59:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.800+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd66c0690b0 con 0x7fd66c0b4070 2024-05-20T17:59:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.801+0000 7fd6537fe640 1 -- 172.21.15.6:0/3741603194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd65c01a070 con 0x7fd66c0b4070 2024-05-20T17:59:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.801+0000 7fd6537fe640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd65806be30 0x7fd65806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.801+0000 7fd6537fe640 1 -- 172.21.15.6:0/3741603194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fd65c08b2e0 con 0x7fd66c0b4070 2024-05-20T17:59:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.802+0000 7fd66a7fc640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd65806be30 0x7fd65806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.802+0000 7fd66a7fc640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd65806be30 0x7fd65806e340 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd66c15eb20 tx=0x7fd660009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:24.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:24.806+0000 7fd6537fe640 1 -- 172.21.15.6:0/3741603194 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd65c059a00 con 0x7fd66c0b4070 2024-05-20T17:59:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.030+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd66c0cfe80 con 0x7fd66c0b4070 2024-05-20T17:59:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.030+0000 7fd6537fe640 1 -- 172.21.15.6:0/3741603194 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fd65c059300 con 0x7fd66c0b4070 2024-05-20T17:59:25.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:25.029 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd65806be30 msgr2=0x7fd65806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd65806be30 0x7fd65806e340 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd66c15eb20 tx=0x7fd660009040 comp rx=0 tx=0).stop 2024-05-20T17:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c0b4070 msgr2=0x7fd66c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c0b4070 0x7fd66c0cc190 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00e870 tx=0x7fd65c00ed30 comp rx=0 tx=0).stop 2024-05-20T17:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 shutdown_connections 2024-05-20T17:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd65806be30 0x7fd65806e340 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd66c158c10 0x7fd66c0b9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd66c0d0560 0x7fd66c0b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 --2- 172.21.15.6:0/3741603194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66c0b4070 0x7fd66c0cc190 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 >> 172.21.15.6:0/3741603194 conn(0x7fd66c0d4c10 msgr2=0x7fd66c0b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 shutdown_connections 2024-05-20T17:59:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:25.032+0000 7fd671621640 1 -- 172.21.15.6:0/3741603194 wait complete. 2024-05-20T17:59:25.042 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:25.042 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:59:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:29.245 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:30.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.173+0000 7f511e385640 1 Processor -- start 2024-05-20T17:59:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.174+0000 7f511e385640 1 -- start start 2024-05-20T17:59:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f511e385640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180b4070 0x7f51180ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f511e385640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f511806dae0 0x7f51180b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:30.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f511e385640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511815fa90 con 0x7f51180d0560 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f511e385640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f51180b8490 con 0x7f511806dae0 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f511e385640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51180d3f00 con 0x7f51180b4070 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f511c922640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f511806dae0 0x7f51180b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f51177fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51180d0560 0x7f511806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46482/0 (socket says 172.21.15.6:46482) 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f51177fe640 1 -- 172.21.15.6:0/1392448120 learned_addr learned my addr 172.21.15.6:0/1392448120 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.175+0000 7f5117fff640 1 --2- 172.21.15.6:0/1392448120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180b4070 0x7f51180ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.176+0000 7f511c922640 1 -- 172.21.15.6:0/1392448120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180b4070 msgr2=0x7f51180ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.176+0000 7f511c922640 1 --2- 172.21.15.6:0/1392448120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180b4070 0x7f51180ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.176+0000 7f511c922640 1 -- 172.21.15.6:0/1392448120 >> v1:172.21.15.6:6789/0 conn(0x7f51180d0560 legacy=0x7f511806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.176+0000 7f5116ffd640 1 -- 172.21.15.6:0/1392448120 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291236860 0 0) 0x7f511815fa90 con 0x7f51180d0560 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.176+0000 7f511c922640 1 -- 172.21.15.6:0/1392448120 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51180d41e0 con 0x7f511806dae0 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.176+0000 7f511c922640 1 --2- 172.21.15.6:0/1392448120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511806dae0 0x7f51180b8920 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f5110009d90 tx=0x7f511002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c131a872419c297 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:30.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f5116ffd640 1 -- 172.21.15.6:0/1392448120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110007740 con 0x7f511806dae0 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f5116ffd640 1 -- 172.21.15.6:0/1392448120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51100078e0 con 0x7f511806dae0 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f5116ffd640 1 -- 172.21.15.6:0/1392448120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110007cb0 con 0x7f511806dae0 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f511e385640 1 -- 172.21.15.6:0/1392448120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511806dae0 msgr2=0x7f51180b8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f511e385640 1 --2- 172.21.15.6:0/1392448120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511806dae0 0x7f51180b8920 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f5110009d90 tx=0x7f511002a680 comp rx=0 tx=0).stop 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f511e385640 1 -- 172.21.15.6:0/1392448120 shutdown_connections 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f511e385640 1 --2- 172.21.15.6:0/1392448120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511806dae0 0x7f51180b8920 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f511e385640 1 --2- 172.21.15.6:0/1392448120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180b4070 0x7f51180ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f511e385640 1 -- 172.21.15.6:0/1392448120 >> 172.21.15.6:0/1392448120 conn(0x7f51180d4c10 msgr2=0x7f51180d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f511e385640 1 -- 172.21.15.6:0/1392448120 shutdown_connections 2024-05-20T17:59:30.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.177+0000 7f511e385640 1 -- 172.21.15.6:0/1392448120 wait complete. 2024-05-20T17:59:30.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.179+0000 7f511e385640 1 Processor -- start 2024-05-20T17:59:30.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.179+0000 7f511e385640 1 -- start start 2024-05-20T17:59:30.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511e385640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51180b4070 0x7f51180ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:30.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511e385640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180d0560 0x7f5118162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511e385640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51180ccf90 0x7f51180cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511e385640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51180bab00 con 0x7f51180ccf90 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511e385640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51180d47a0 con 0x7f51180b4070 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511e385640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51180d3b20 con 0x7f51180d0560 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511c922640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51180ccf90 0x7f51180cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511c922640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51180ccf90 0x7f51180cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42966/0 (socket says 172.21.15.6:42966) 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511c922640 1 -- 172.21.15.6:0/183936974 learned_addr learned my addr 172.21.15.6:0/183936974 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f51177fe640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180d0560 0x7f5118162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f5117fff640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51180b4070 0x7f51180ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511c922640 1 -- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180d0560 msgr2=0x7f5118162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511c922640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180d0560 0x7f5118162710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511c922640 1 -- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51180b4070 msgr2=0x7f51180ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511c922640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51180b4070 0x7f51180ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f511c922640 1 -- 172.21.15.6:0/183936974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51180cd8e0 con 0x7f51180ccf90 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f51177fe640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180d0560 0x7f5118162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.181+0000 7f5117fff640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51180b4070 0x7f51180ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.182+0000 7f511c922640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51180ccf90 0x7f51180cd3a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5110009eb0 tx=0x7f5110004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.182+0000 7f5114ff9640 1 -- 172.21.15.6:0/183936974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511003f070 con 0x7f51180ccf90 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.182+0000 7f5114ff9640 1 -- 172.21.15.6:0/183936974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5110031c40 con 0x7f51180ccf90 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.182+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5118162c50 con 0x7f51180ccf90 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.182+0000 7f5114ff9640 1 -- 172.21.15.6:0/183936974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110009410 con 0x7f51180ccf90 2024-05-20T17:59:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.182+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51180c89d0 con 0x7f51180ccf90 2024-05-20T17:59:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.183+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51180b5bf0 con 0x7f51180ccf90 2024-05-20T17:59:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.183+0000 7f5114ff9640 1 -- 172.21.15.6:0/183936974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5110003990 con 0x7f51180ccf90 2024-05-20T17:59:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.184+0000 7f5114ff9640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510406be30 0x7f510406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.184+0000 7f5114ff9640 1 -- 172.21.15.6:0/183936974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f51100abec0 con 0x7f51180ccf90 2024-05-20T17:59:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.185+0000 7f5117fff640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510406be30 0x7f510406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.185+0000 7f5117fff640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510406be30 0x7f510406e340 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5108009af0 tx=0x7f5108008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.189+0000 7f5114ff9640 1 -- 172.21.15.6:0/183936974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f51180b5bf0 con 0x7f51180ccf90 2024-05-20T17:59:30.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.414+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f51180690b0 con 0x7f51180ccf90 2024-05-20T17:59:30.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.415+0000 7f5114ff9640 1 -- 172.21.15.6:0/183936974 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f51180cd8e0 con 0x7f51180ccf90 2024-05-20T17:59:30.413 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:30.413 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:30.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510406be30 msgr2=0x7f510406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:30.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510406be30 0x7f510406e340 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5108009af0 tx=0x7f5108008040 comp rx=0 tx=0).stop 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51180ccf90 msgr2=0x7f51180cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51180ccf90 0x7f51180cd3a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5110009eb0 tx=0x7f5110004a40 comp rx=0 tx=0).stop 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 shutdown_connections 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510406be30 0x7f510406e340 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51180ccf90 0x7f51180cd3a0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51180d0560 0x7f5118162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 --2- 172.21.15.6:0/183936974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51180b4070 0x7f51180ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 >> 172.21.15.6:0/183936974 conn(0x7f51180d4c10 msgr2=0x7f51180b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 shutdown_connections 2024-05-20T17:59:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:30.417+0000 7f511e385640 1 -- 172.21.15.6:0/183936974 wait complete. 2024-05-20T17:59:30.426 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:30.426 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:59:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:35.252 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:35.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:35.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.559+0000 7f3eaa323640 1 Processor -- start 2024-05-20T17:59:35.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.559+0000 7f3eaa323640 1 -- start start 2024-05-20T17:59:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3eaa323640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40d0560 0x7f3ea406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3eaa323640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ea406d910 0x7f3ea40b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:35.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3eaa323640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea406dd20 con 0x7f3ea40b4070 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3eaa323640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3ea40b8490 con 0x7f3ea406d910 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3eaa323640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea415fa90 con 0x7f3ea40d0560 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea88c0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ea406d910 0x7f3ea40b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3ea40b4070 0x7f3ea40ba5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46488/0 (socket says 172.21.15.6:46488) 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea3fff640 1 -- 172.21.15.6:0/2871451342 learned_addr learned my addr 172.21.15.6:0/2871451342 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea37fe640 1 --2- 172.21.15.6:0/2871451342 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40d0560 0x7f3ea406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea88c0640 1 -- 172.21.15.6:0/2871451342 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40d0560 msgr2=0x7f3ea406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea88c0640 1 --2- 172.21.15.6:0/2871451342 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40d0560 0x7f3ea406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea88c0640 1 -- 172.21.15.6:0/2871451342 >> v1:172.21.15.6:6789/0 conn(0x7f3ea40b4070 legacy=0x7f3ea40ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea88c0640 1 -- 172.21.15.6:0/2871451342 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea40d3f00 con 0x7f3ea406d910 2024-05-20T17:59:35.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.561+0000 7f3ea2ffd640 1 -- 172.21.15.6:0/2871451342 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337680513 0 0) 0x7f3e94001110 con 0x7f3ea40b4070 2024-05-20T17:59:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.562+0000 7f3ea88c0640 1 --2- 172.21.15.6:0/2871451342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea40b8920 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009d90 tx=0x7f3e9c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f2ffcb7b24731c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.562+0000 7f3ea2ffd640 1 -- 172.21.15.6:0/2871451342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c007740 con 0x7f3ea406d910 2024-05-20T17:59:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.562+0000 7f3ea2ffd640 1 -- 172.21.15.6:0/2871451342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9c0078e0 con 0x7f3ea406d910 2024-05-20T17:59:35.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.562+0000 7f3ea2ffd640 1 -- 172.21.15.6:0/2871451342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c007cb0 con 0x7f3ea406d910 2024-05-20T17:59:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.563+0000 7f3eaa323640 1 -- 172.21.15.6:0/2871451342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 msgr2=0x7f3ea40b8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.563+0000 7f3eaa323640 1 --2- 172.21.15.6:0/2871451342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea40b8920 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009d90 tx=0x7f3e9c02a660 comp rx=0 tx=0).stop 2024-05-20T17:59:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.563+0000 7f3eaa323640 1 -- 172.21.15.6:0/2871451342 shutdown_connections 2024-05-20T17:59:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.563+0000 7f3eaa323640 1 --2- 172.21.15.6:0/2871451342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea40b8920 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.563+0000 7f3eaa323640 1 --2- 172.21.15.6:0/2871451342 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40d0560 0x7f3ea406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.563+0000 7f3eaa323640 1 -- 172.21.15.6:0/2871451342 >> 172.21.15.6:0/2871451342 conn(0x7f3ea40d4c10 msgr2=0x7f3ea40d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.563+0000 7f3eaa323640 1 -- 172.21.15.6:0/2871451342 shutdown_connections 2024-05-20T17:59:35.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.563+0000 7f3eaa323640 1 -- 172.21.15.6:0/2871451342 wait complete. 2024-05-20T17:59:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.565+0000 7f3eaa323640 1 Processor -- start 2024-05-20T17:59:35.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.565+0000 7f3eaa323640 1 -- start start 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3eaa323640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea414ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3eaa323640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40b4070 0x7f3ea40ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3eaa323640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ea40d0560 0x7f3ea40cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3eaa323640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40d47a0 con 0x7f3ea406d910 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3eaa323640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40d44c0 con 0x7f3ea40d0560 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3eaa323640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea40d3b20 con 0x7f3ea40b4070 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea414ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea414ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42982/0 (socket says 172.21.15.6:42982) 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.566+0000 7f3ea3fff640 1 -- 172.21.15.6:0/3042660622 learned_addr learned my addr 172.21.15.6:0/3042660622 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea37fe640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40b4070 0x7f3ea40ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:35.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea88c0640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ea40d0560 0x7f3ea40cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea3fff640 1 -- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40b4070 msgr2=0x7f3ea40ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea3fff640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40b4070 0x7f3ea40ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea3fff640 1 -- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ea40d0560 msgr2=0x7f3ea40cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea3fff640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ea40d0560 0x7f3ea40cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea3fff640 1 -- 172.21.15.6:0/3042660622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea40c8b80 con 0x7f3ea406d910 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea37fe640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40b4070 0x7f3ea40ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea3fff640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea414ce50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400c430 tx=0x7f3e9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea0ff9640 1 -- 172.21.15.6:0/3042660622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e940074e0 con 0x7f3ea406d910 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea0ff9640 1 -- 172.21.15.6:0/3042660622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e940047e0 con 0x7f3ea406d910 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3ea0ff9640 1 -- 172.21.15.6:0/3042660622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94004bd0 con 0x7f3ea406d910 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea40c8e60 con 0x7f3ea406d910 2024-05-20T17:59:35.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.567+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea40c9420 con 0x7f3ea406d910 2024-05-20T17:59:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.568+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea40690b0 con 0x7f3ea406d910 2024-05-20T17:59:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.569+0000 7f3ea0ff9640 1 -- 172.21.15.6:0/3042660622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e94011070 con 0x7f3ea406d910 2024-05-20T17:59:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.569+0000 7f3ea0ff9640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e9006be30 0x7f3e9006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.570+0000 7f3ea0ff9640 1 -- 172.21.15.6:0/3042660622 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f3e9408ad60 con 0x7f3ea406d910 2024-05-20T17:59:35.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.570+0000 7f3ea37fe640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e9006be30 0x7f3e9006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:35.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.570+0000 7f3ea37fe640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e9006be30 0x7f3e9006e340 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40ba330 tx=0x7f3e98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:35.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.574+0000 7f3ea0ff9640 1 -- 172.21.15.6:0/3042660622 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3ea406dd20 con 0x7f3ea406d910 2024-05-20T17:59:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.800+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ea40b4a80 con 0x7f3ea406d910 2024-05-20T17:59:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.801+0000 7f3ea0ff9640 1 -- 172.21.15.6:0/3042660622 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f3e94059480 con 0x7f3ea406d910 2024-05-20T17:59:35.799 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:35.799 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e9006be30 msgr2=0x7f3e9006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e9006be30 0x7f3e9006e340 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40ba330 tx=0x7f3e98008040 comp rx=0 tx=0).stop 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 msgr2=0x7f3ea414ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea414ce50 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400c430 tx=0x7f3e9400c8f0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 shutdown_connections 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e9006be30 0x7f3e9006e340 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ea40d0560 0x7f3ea40cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ea40b4070 0x7f3ea40ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 --2- 172.21.15.6:0/3042660622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea406d910 0x7f3ea414ce50 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 >> 172.21.15.6:0/3042660622 conn(0x7f3ea40d4c10 msgr2=0x7f3ea40cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 shutdown_connections 2024-05-20T17:59:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:35.803+0000 7f3eaa323640 1 -- 172.21.15.6:0/3042660622 wait complete. 2024-05-20T17:59:35.813 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:35.813 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:59:36.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:59:36.794 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T17:59:37.254 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:39.256 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:40.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.944+0000 7f1113177640 1 Processor -- start 2024-05-20T17:59:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.944+0000 7f1113177640 1 -- start start 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.945+0000 7f1113177640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f110c15d040 0x7f110c0712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.945+0000 7f1113177640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110c0b4860 con 0x7f110c0d1e50 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.945+0000 7f1113177640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110c0b4b40 con 0x7f110c0b5e10 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.945+0000 7f1113177640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f110c0b4e20 con 0x7f110c15d040 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.945+0000 7f1111714640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f110c0d1e50 0x7f110c0cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39270/0 (socket says 172.21.15.6:39270) 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.945+0000 7f1111714640 1 -- 172.21.15.6:0/3840001672 learned_addr learned my addr 172.21.15.6:0/3840001672 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.945+0000 7f1110f13640 1 --2- 172.21.15.6:0/3840001672 >> v2:172.21.15.171:3300/0 conn(0x7f110c15d040 0x7f110c0712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.945+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640369099 0 0) 0x7f110c0b4860 con 0x7f110c0d1e50 2024-05-20T17:59:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f4003520 con 0x7f110c0d1e50 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3384319589 0 0) 0x7f10f4003520 con 0x7f110c0d1e50 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 >> v2:172.21.15.171:3300/0 conn(0x7f110c15d040 msgr2=0x7f110c0712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 --2- 172.21.15.6:0/3840001672 >> v2:172.21.15.171:3300/0 conn(0x7f110c15d040 0x7f110c0712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 >> v1:172.21.15.171:6789/0 conn(0x7f110c0b5e10 legacy=0x7f110c0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110c0d1220 con 0x7f110c0d1e50 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f11040019f0 con 0x7f110c0d1e50 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 >> v1:172.21.15.6:6789/0 conn(0x7f110c0d1e50 legacy=0x7f110c0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10f40039b0 0x7f10f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f4004800 0x7f10f4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10f40051c0 0x7f10f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f110c0b4e20 con 0x7f10f40051c0 2024-05-20T17:59:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f10f400c160 con 0x7f10f40039b0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f10f400c360 con 0x7f10f4004800 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f1111714640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10f40051c0 0x7f10f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f1110f13640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10f40039b0 0x7f10f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f110bfff640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f4004800 0x7f10f4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f1111714640 1 -- 172.21.15.6:0/3840001672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f4004800 msgr2=0x7f10f4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f1111714640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f4004800 0x7f10f4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f1111714640 1 -- 172.21.15.6:0/3840001672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10f40039b0 msgr2=0x7f10f4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f1111714640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10f40039b0 0x7f10f4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.946+0000 7f1111714640 1 -- 172.21.15.6:0/3840001672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f4003520 con 0x7f10f40051c0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.947+0000 7f1111714640 1 -- 172.21.15.6:0/3840001672 reap_dead start 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.947+0000 7f1111714640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10f40051c0 0x7f10f400b9c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f110400a830 tx=0x7f10f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ceb85aa017c591c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.947+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110400a480 con 0x7f10f40051c0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.947+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110402f070 con 0x7f10f40051c0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.947+0000 7f110b7fe640 1 -- 172.21.15.6:0/3840001672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110402bbc0 con 0x7f10f40051c0 2024-05-20T17:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.948+0000 7f1113177640 1 -- 172.21.15.6:0/3840001672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10f40051c0 msgr2=0x7f10f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.948+0000 7f1113177640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10f40051c0 0x7f10f400b9c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f110400a830 tx=0x7f10f4005830 comp rx=0 tx=0).stop 2024-05-20T17:59:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.948+0000 7f1113177640 1 -- 172.21.15.6:0/3840001672 shutdown_connections 2024-05-20T17:59:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.948+0000 7f1113177640 1 --2- 172.21.15.6:0/3840001672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10f40051c0 0x7f10f400b9c0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.948+0000 7f1113177640 1 -- 172.21.15.6:0/3840001672 >> 172.21.15.6:0/3840001672 conn(0x7f110c0cf480 msgr2=0x7f110c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.948+0000 7f1113177640 1 -- 172.21.15.6:0/3840001672 shutdown_connections 2024-05-20T17:59:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.948+0000 7f1113177640 1 -- 172.21.15.6:0/3840001672 wait complete. 2024-05-20T17:59:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.950+0000 7f1113177640 1 Processor -- start 2024-05-20T17:59:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.950+0000 7f1113177640 1 -- start start 2024-05-20T17:59:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f1113177640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f40051c0 0x7f110c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f1113177640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c155c50 0x7f110c156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f1113177640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f110c06cfd0 0x7f110c0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f1113177640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f110c0b4600 con 0x7f110c155c50 2024-05-20T17:59:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f1113177640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f110c0b4480 con 0x7f110c06cfd0 2024-05-20T17:59:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f1113177640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f110c0b6220 con 0x7f10f40051c0 2024-05-20T17:59:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c155c50 0x7f110c156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c155c50 0x7f110c156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45556/0 (socket says 172.21.15.6:45556) 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 -- 172.21.15.6:0/2817045538 learned_addr learned my addr 172.21.15.6:0/2817045538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f1110f13640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f40051c0 0x7f110c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f1111714640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f110c06cfd0 0x7f110c0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 -- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f40051c0 msgr2=0x7f110c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f40051c0 0x7f110c06e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 -- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f110c06cfd0 msgr2=0x7f110c0708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f110c06cfd0 0x7f110c0708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 -- 172.21.15.6:0/2817045538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110c160060 con 0x7f110c155c50 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f110bfff640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c155c50 0x7f110c156e00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f110000f5f0 tx=0x7f110000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f11097fa640 1 -- 172.21.15.6:0/2817045538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11000052e0 con 0x7f110c155c50 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.952+0000 7f11097fa640 1 -- 172.21.15.6:0/2817045538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1100018070 con 0x7f110c155c50 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.953+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f110c160340 con 0x7f110c155c50 2024-05-20T17:59:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.953+0000 7f11097fa640 1 -- 172.21.15.6:0/2817045538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100003810 con 0x7f110c155c50 2024-05-20T17:59:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.953+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f110c06cab0 con 0x7f110c155c50 2024-05-20T17:59:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.954+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f110c1566d0 con 0x7f110c155c50 2024-05-20T17:59:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.954+0000 7f11097fa640 1 -- 172.21.15.6:0/2817045538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11000039b0 con 0x7f110c155c50 2024-05-20T17:59:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.955+0000 7f11097fa640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10f806be30 0x7f10f806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.955+0000 7f11097fa640 1 -- 172.21.15.6:0/2817045538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f110008ada0 con 0x7f110c155c50 2024-05-20T17:59:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.955+0000 7f1110f13640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10f806be30 0x7f10f806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.956+0000 7f1110f13640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10f806be30 0x7f10f806e340 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f110c160c20 tx=0x7f10fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:40.960+0000 7f11097fa640 1 -- 172.21.15.6:0/2817045538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f11000594c0 con 0x7f110c155c50 2024-05-20T17:59:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.181+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f110c0690b0 con 0x7f110c155c50 2024-05-20T17:59:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.182+0000 7f11097fa640 1 -- 172.21.15.6:0/2817045538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f1100058dc0 con 0x7f110c155c50 2024-05-20T17:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10f806be30 msgr2=0x7f10f806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10f806be30 0x7f10f806e340 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f110c160c20 tx=0x7f10fc009190 comp rx=0 tx=0).stop 2024-05-20T17:59:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c155c50 msgr2=0x7f110c156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c155c50 0x7f110c156e00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f110000f5f0 tx=0x7f110000f9f0 comp rx=0 tx=0).stop 2024-05-20T17:59:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 shutdown_connections 2024-05-20T17:59:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f10f806be30 0x7f10f806e340 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f110c06cfd0 0x7f110c0708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c155c50 0x7f110c156e00 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 --2- 172.21.15.6:0/2817045538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10f40051c0 0x7f110c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 >> 172.21.15.6:0/2817045538 conn(0x7f110c0cf480 msgr2=0x7f110c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 shutdown_connections 2024-05-20T17:59:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:41.184+0000 7f1113177640 1 -- 172.21.15.6:0/2817045538 wait complete. 2024-05-20T17:59:41.194 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:41.194 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T17:59:41.258 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:43.260 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:45.262 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:46.194 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T17:59:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.324+0000 7fdfb7028640 1 Processor -- start 2024-05-20T17:59:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.324+0000 7fdfb7028640 1 -- start start 2024-05-20T17:59:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfb7028640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdfb00b4070 0x7fdfb00ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfb7028640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb006dae0 0x7fdfb00b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfb7028640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb015fa90 con 0x7fdfb00d0560 2024-05-20T17:59:46.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfb7028640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb00b8490 con 0x7fdfb00b4070 2024-05-20T17:59:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfb7028640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb00d3f00 con 0x7fdfb006dae0 2024-05-20T17:59:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfaffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdfb00d0560 0x7fdfb006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39282/0 (socket says 172.21.15.6:39282) 2024-05-20T17:59:46.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfaffff640 1 -- 172.21.15.6:0/280619802 learned_addr learned my addr 172.21.15.6:0/280619802 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:46.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395480797 0 0) 0x7fdfb015fa90 con 0x7fdfb00d0560 2024-05-20T17:59:46.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfb55c5640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb006dae0 0x7fdfb00b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfa0003520 con 0x7fdfb00d0560 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.326+0000 7fdfb4dc4640 1 --2- 172.21.15.6:0/280619802 >> v2:172.21.15.171:3300/0 conn(0x7fdfb00b4070 0x7fdfb00ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1968955272 0 0) 0x7fdfa0003520 con 0x7fdfb00d0560 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb006dae0 msgr2=0x7fdfb00b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb006dae0 0x7fdfb00b8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 >> v2:172.21.15.171:3300/0 conn(0x7fdfb00b4070 msgr2=0x7fdfb00ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/280619802 >> v2:172.21.15.171:3300/0 conn(0x7fdfb00b4070 0x7fdfb00ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb00d41e0 con 0x7fdfb00d0560 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fdf9c001670 con 0x7fdfb00d0560 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 >> v1:172.21.15.6:6789/0 conn(0x7fdfb00d0560 legacy=0x7fdfb006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa00039b0 0x7fdfa0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa0004800 0x7fdfa0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfa0005150 0x7fdfa000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb00b8490 con 0x7fdfa0004800 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb00d3f00 con 0x7fdfa00039b0 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa000bf00 con 0x7fdfa0005150 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaffff640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa0004800 0x7fdfa0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfb4dc4640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa00039b0 0x7fdfa0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfb55c5640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfa0005150 0x7fdfa000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaffff640 1 -- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfa0005150 msgr2=0x7fdfa000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaffff640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfa0005150 0x7fdfa000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaffff640 1 -- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa00039b0 msgr2=0x7fdfa0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaffff640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa00039b0 0x7fdfa0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.327+0000 7fdfaffff640 1 -- 172.21.15.6:0/280619802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa0003520 con 0x7fdfa0004800 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.328+0000 7fdfaffff640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa0004800 0x7fdfa0004c10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00cf380 tx=0x7fdfa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f034329224fb1cba server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.328+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c007d50 con 0x7fdfa0004800 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.328+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf9c005ad0 con 0x7fdfa0004800 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.328+0000 7fdfaf7fe640 1 -- 172.21.15.6:0/280619802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c007070 con 0x7fdfa0004800 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.329+0000 7fdfb7028640 1 -- 172.21.15.6:0/280619802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa0004800 msgr2=0x7fdfa0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.329+0000 7fdfb7028640 1 --2- 172.21.15.6:0/280619802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfa0004800 0x7fdfa0004c10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00cf380 tx=0x7fdfa0005830 comp rx=0 tx=0).stop 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.329+0000 7fdfb55c5640 1 -- 172.21.15.6:0/280619802 reap_dead start 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.329+0000 7fdfb7028640 1 -- 172.21.15.6:0/280619802 shutdown_connections 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.329+0000 7fdfb7028640 1 -- 172.21.15.6:0/280619802 >> 172.21.15.6:0/280619802 conn(0x7fdfb00d4c10 msgr2=0x7fdfb00d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.329+0000 7fdfb7028640 1 -- 172.21.15.6:0/280619802 shutdown_connections 2024-05-20T17:59:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.329+0000 7fdfb7028640 1 -- 172.21.15.6:0/280619802 wait complete. 2024-05-20T17:59:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.331+0000 7fdfb7028640 1 Processor -- start 2024-05-20T17:59:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.331+0000 7fdfb7028640 1 -- start start 2024-05-20T17:59:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.332+0000 7fdfb7028640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa0004800 0x7fdfb00c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.332+0000 7fdfb7028640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb01626d0 0x7fdfb01f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.332+0000 7fdfb7028640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb01f4b10 0x7fdfb01f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.332+0000 7fdfb7028640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb00bab00 con 0x7fdfb01626d0 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.332+0000 7fdfb7028640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb00d47a0 con 0x7fdfa0004800 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.332+0000 7fdfb7028640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb00d3b20 con 0x7fdfb01f4b10 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb01626d0 0x7fdfb01f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb01626d0 0x7fdfb01f45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45578/0 (socket says 172.21.15.6:45578) 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 -- 172.21.15.6:0/223485476 learned_addr learned my addr 172.21.15.6:0/223485476 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfb4dc4640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa0004800 0x7fdfb00c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfb55c5640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb01f4b10 0x7fdfb01f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 -- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb01f4b10 msgr2=0x7fdfb01f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb01f4b10 0x7fdfb01f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 -- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa0004800 msgr2=0x7fdfb00c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa0004800 0x7fdfb00c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 -- 172.21.15.6:0/223485476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb01f8b20 con 0x7fdfb01626d0 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfb55c5640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb01f4b10 0x7fdfb01f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfaffff640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb01626d0 0x7fdfb01f45d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c02add0 tx=0x7fdfb00d43b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfad7fa640 1 -- 172.21.15.6:0/223485476 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c001630 con 0x7fdfb01626d0 2024-05-20T17:59:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfad7fa640 1 -- 172.21.15.6:0/223485476 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf9c042070 con 0x7fdfb01626d0 2024-05-20T17:59:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb01f8e00 con 0x7fdfb01626d0 2024-05-20T17:59:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfad7fa640 1 -- 172.21.15.6:0/223485476 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c007270 con 0x7fdfb01626d0 2024-05-20T17:59:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.333+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb01f5040 con 0x7fdfb01626d0 2024-05-20T17:59:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.335+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb01f8890 con 0x7fdfb01626d0 2024-05-20T17:59:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.335+0000 7fdfad7fa640 1 -- 172.21.15.6:0/223485476 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf9c007410 con 0x7fdfb01626d0 2024-05-20T17:59:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.336+0000 7fdfad7fa640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf9406be30 0x7fdf9406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.336+0000 7fdfad7fa640 1 -- 172.21.15.6:0/223485476 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fdf9c0ab160 con 0x7fdfb01626d0 2024-05-20T17:59:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.336+0000 7fdfb4dc4640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf9406be30 0x7fdf9406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.336+0000 7fdfb4dc4640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf9406be30 0x7fdf9406e340 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009b00 tx=0x7fdfa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.340+0000 7fdfad7fa640 1 -- 172.21.15.6:0/223485476 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdf9c079880 con 0x7fdfb01626d0 2024-05-20T17:59:46.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.565+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdfb00690b0 con 0x7fdfb01626d0 2024-05-20T17:59:46.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.567+0000 7fdfad7fa640 1 -- 172.21.15.6:0/223485476 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fdf9c005aa0 con 0x7fdfb01626d0 2024-05-20T17:59:46.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:46.565 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-05-20T17:59:46.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf9406be30 msgr2=0x7fdf9406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:46.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf9406be30 0x7fdf9406e340 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009b00 tx=0x7fdfa4008040 comp rx=0 tx=0).stop 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb01626d0 msgr2=0x7fdfb01f45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb01626d0 0x7fdfb01f45d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c02add0 tx=0x7fdfb00d43b0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 shutdown_connections 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf9406be30 0x7fdf9406e340 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdfb01f4b10 0x7fdfb01f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfb01626d0 0x7fdfb01f45d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 --2- 172.21.15.6:0/223485476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfa0004800 0x7fdfb00c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 >> 172.21.15.6:0/223485476 conn(0x7fdfb00d4c10 msgr2=0x7fdfb015f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 shutdown_connections 2024-05-20T17:59:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46.569+0000 7fdfb7028640 1 -- 172.21.15.6:0/223485476 wait complete. 2024-05-20T17:59:46.578 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-05-20T17:59:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:46 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-05-20T17:59:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T17:59:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:stdin closed, goodbye! 2024-05-20T17:59:47.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T17:59:47.286 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T17:59:47.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:59:47.370 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T17:59:47.421 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T17:59:47.421 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:59:47.421 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 400\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi006') 2024-05-20T17:59:47.421 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:59:47.421 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:59:47.440 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:59:47.440 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:59:47.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:59:47.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.664+0000 7fa358537640 1 Processor -- start 2024-05-20T17:59:47.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.664+0000 7fa358537640 1 -- start start 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.665+0000 7fa358537640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa35015f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.665+0000 7fa358537640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa350070850 0x7fa350070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.665+0000 7fa358537640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3500711a0 con 0x7fa3500cd1b0 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.665+0000 7fa358537640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa35015f790 con 0x7fa350070850 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.665+0000 7fa358537640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa35006e590 con 0x7fa350071630 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa3562d3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa35015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa356ad4640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa350070850 0x7fa350070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa3562d3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa35015f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:54746/0 (socket says 172.21.15.6:54746) 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa355ad2640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa3500cd1b0 0x7fa35006d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:50628/0 (socket says 172.21.15.6:50628) 2024-05-20T17:59:47.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa3562d3640 1 -- 172.21.15.6:0/2921718134 learned_addr learned my addr 172.21.15.6:0/2921718134 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:47.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa3552d1640 1 -- 172.21.15.6:0/2921718134 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263908297 0 0) 0x7fa340001110 con 0x7fa3500cd1b0 2024-05-20T17:59:47.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa3562d3640 1 -- 172.21.15.6:0/2921718134 >> v2:172.21.15.171:3300/0 conn(0x7fa350070850 msgr2=0x7fa350070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:47.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa3562d3640 1 --2- 172.21.15.6:0/2921718134 >> v2:172.21.15.171:3300/0 conn(0x7fa350070850 0x7fa350070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa3562d3640 1 -- 172.21.15.6:0/2921718134 >> v1:172.21.15.171:6789/0 conn(0x7fa3500cd1b0 legacy=0x7fa35006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:47.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.666+0000 7fa3562d3640 1 -- 172.21.15.6:0/2921718134 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3500ce2b0 con 0x7fa350071630 2024-05-20T17:59:47.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.667+0000 7fa3562d3640 1 --2- 172.21.15.6:0/2921718134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa35015f250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009870 tx=0x7fa34c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d35eea9f2b829843 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:47.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.667+0000 7fa3552d1640 1 -- 172.21.15.6:0/2921718134 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c037070 con 0x7fa350071630 2024-05-20T17:59:47.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.667+0000 7fa3552d1640 1 -- 172.21.15.6:0/2921718134 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34c032440 con 0x7fa350071630 2024-05-20T17:59:47.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.667+0000 7fa3552d1640 1 -- 172.21.15.6:0/2921718134 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34c032810 con 0x7fa350071630 2024-05-20T17:59:47.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.668+0000 7fa358537640 1 -- 172.21.15.6:0/2921718134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 msgr2=0x7fa35015f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:47.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.668+0000 7fa358537640 1 --2- 172.21.15.6:0/2921718134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa35015f250 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009870 tx=0x7fa34c02a1c0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.668+0000 7fa358537640 1 -- 172.21.15.6:0/2921718134 shutdown_connections 2024-05-20T17:59:47.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.668+0000 7fa358537640 1 --2- 172.21.15.6:0/2921718134 >> v2:172.21.15.171:3300/0 conn(0x7fa350070850 0x7fa350070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.668+0000 7fa358537640 1 --2- 172.21.15.6:0/2921718134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa35015f250 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.668+0000 7fa358537640 1 -- 172.21.15.6:0/2921718134 >> 172.21.15.6:0/2921718134 conn(0x7fa3500d29d0 msgr2=0x7fa3500d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:47.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.668+0000 7fa358537640 1 -- 172.21.15.6:0/2921718134 shutdown_connections 2024-05-20T17:59:47.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.668+0000 7fa358537640 1 -- 172.21.15.6:0/2921718134 wait complete. 2024-05-20T17:59:47.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.670+0000 7fa358537640 1 Processor -- start 2024-05-20T17:59:47.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.670+0000 7fa358537640 1 -- start start 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa358537640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa350070850 0x7fa3500b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa358537640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa350154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa358537640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3500cd1b0 0x7fa3501eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa358537640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa35006ded0 con 0x7fa3500cd1b0 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa358537640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa35006cfc0 con 0x7fa350070850 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa358537640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa35006d2a0 con 0x7fa350071630 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa356ad4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3500cd1b0 0x7fa3501eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa356ad4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3500cd1b0 0x7fa3501eabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45582/0 (socket says 172.21.15.6:45582) 2024-05-20T17:59:47.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.671+0000 7fa356ad4640 1 -- 172.21.15.6:0/3772504891 learned_addr learned my addr 172.21.15.6:0/3772504891 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa355ad2640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa350154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa3562d3640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa350070850 0x7fa3500b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa356ad4640 1 -- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 msgr2=0x7fa350154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa356ad4640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa350154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa356ad4640 1 -- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa350070850 msgr2=0x7fa3500b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa356ad4640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa350070850 0x7fa3500b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa356ad4640 1 -- 172.21.15.6:0/3772504891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3501f6a20 con 0x7fa3500cd1b0 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa3562d3640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa350070850 0x7fa3500b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa355ad2640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa350154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa356ad4640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3500cd1b0 0x7fa3501eabc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa34800efc0 tx=0x7fa34800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa346ffd640 1 -- 172.21.15.6:0/3772504891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348018020 con 0x7fa3500cd1b0 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa346ffd640 1 -- 172.21.15.6:0/3772504891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa348014480 con 0x7fa3500cd1b0 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3500b66d0 con 0x7fa3500cd1b0 2024-05-20T17:59:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa346ffd640 1 -- 172.21.15.6:0/3772504891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348009e60 con 0x7fa3500cd1b0 2024-05-20T17:59:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.672+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3500b56b0 con 0x7fa3500cd1b0 2024-05-20T17:59:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.673+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa350075b00 con 0x7fa3500cd1b0 2024-05-20T17:59:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.674+0000 7fa346ffd640 1 -- 172.21.15.6:0/3772504891 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa348005d10 con 0x7fa3500cd1b0 2024-05-20T17:59:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.674+0000 7fa346ffd640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa33406be60 0x7fa33406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:47.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.675+0000 7fa346ffd640 1 -- 172.21.15.6:0/3772504891 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fa34808bf10 con 0x7fa3500cd1b0 2024-05-20T17:59:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.675+0000 7fa3562d3640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa33406be60 0x7fa33406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:47.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.675+0000 7fa3562d3640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa33406be60 0x7fa33406e370 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa34c034000 tx=0x7fa34c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:47.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.679+0000 7fa346ffd640 1 -- 172.21.15.6:0/3772504891 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa348022030 con 0x7fa3500cd1b0 2024-05-20T17:59:47.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.863+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa350071410 con 0x7fa3500cd1b0 2024-05-20T17:59:47.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.864+0000 7fa346ffd640 1 -- 172.21.15.6:0/3772504891 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17030 (secure 0 0 0) 0x7fa348010040 con 0x7fa3500cd1b0 2024-05-20T17:59:47.863 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:47.863 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":89,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:48.988398+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:57:17.597397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-20T17:57:18.862392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":5}]},{"pgid":"14.24","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:59:47.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa33406be60 msgr2=0x7fa33406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:47.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa33406be60 0x7fa33406e370 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa34c034000 tx=0x7fa34c02e000 comp rx=0 tx=0).stop 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3500cd1b0 msgr2=0x7fa3501eabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3500cd1b0 0x7fa3501eabc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa34800efc0 tx=0x7fa34800c490 comp rx=0 tx=0).stop 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 shutdown_connections 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa33406be60 0x7fa33406e370 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3500cd1b0 0x7fa3501eabc0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa350071630 0x7fa350154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 --2- 172.21.15.6:0/3772504891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa350070850 0x7fa3500b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 >> 172.21.15.6:0/3772504891 conn(0x7fa3500d29d0 msgr2=0x7fa35015e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 shutdown_connections 2024-05-20T17:59:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.866+0000 7fa358537640 1 -- 172.21.15.6:0/3772504891 wait complete. 2024-05-20T17:59:47.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:57:17.597397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:57:18.862392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:59:47.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:59:47.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.995+0000 7f88322af640 1 Processor -- start 2024-05-20T17:59:47.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.995+0000 7f88322af640 1 -- start start 2024-05-20T17:59:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f88322af640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f882c162820 0x7f882c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f88322af640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c0b3e80 0x7f882c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f88322af640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f882c06dd20 con 0x7f882c06d910 2024-05-20T17:59:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f88322af640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f882c0d0630 con 0x7f882c162820 2024-05-20T17:59:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f88322af640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f882c0d39c0 con 0x7f882c0b3e80 2024-05-20T17:59:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f882bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f882c162820 0x7f882c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f882bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f882c162820 0x7f882c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50750/0 (socket says 172.21.15.6:50750) 2024-05-20T17:59:47.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f882bfff640 1 -- 172.21.15.6:0/48421753 learned_addr learned my addr 172.21.15.6:0/48421753 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f882bfff640 1 -- 172.21.15.6:0/48421753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c0b3e80 msgr2=0x7f882c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f882bfff640 1 --2- 172.21.15.6:0/48421753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c0b3e80 0x7f882c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f882bfff640 1 -- 172.21.15.6:0/48421753 >> v1:172.21.15.171:6789/0 conn(0x7f882c06d910 legacy=0x7f882c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:47.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.997+0000 7f882bfff640 1 -- 172.21.15.6:0/48421753 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c0d3ca0 con 0x7f882c162820 2024-05-20T17:59:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.998+0000 7f882bfff640 1 --2- 172.21.15.6:0/48421753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c162820 0x7f882c0b3940 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f881c009870 tx=0x7f881c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1a5d12c742802 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.998+0000 7f882b7fe640 1 -- 172.21.15.6:0/48421753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c037070 con 0x7f882c162820 2024-05-20T17:59:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.998+0000 7f882b7fe640 1 -- 172.21.15.6:0/48421753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881c032440 con 0x7f882c162820 2024-05-20T17:59:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.998+0000 7f882b7fe640 1 -- 172.21.15.6:0/48421753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c032810 con 0x7f882c162820 2024-05-20T17:59:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.999+0000 7f88322af640 1 -- 172.21.15.6:0/48421753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c162820 msgr2=0x7f882c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.999+0000 7f88322af640 1 --2- 172.21.15.6:0/48421753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c162820 0x7f882c0b3940 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f881c009870 tx=0x7f881c02a210 comp rx=0 tx=0).stop 2024-05-20T17:59:47.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.999+0000 7f88322af640 1 -- 172.21.15.6:0/48421753 shutdown_connections 2024-05-20T17:59:47.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.999+0000 7f88322af640 1 --2- 172.21.15.6:0/48421753 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c0b3e80 0x7f882c06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.999+0000 7f88322af640 1 --2- 172.21.15.6:0/48421753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c162820 0x7f882c0b3940 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:47.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.999+0000 7f88322af640 1 -- 172.21.15.6:0/48421753 >> 172.21.15.6:0/48421753 conn(0x7f882c0d4bd0 msgr2=0x7f882c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:47.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.999+0000 7f88322af640 1 -- 172.21.15.6:0/48421753 shutdown_connections 2024-05-20T17:59:47.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:47.999+0000 7f88322af640 1 -- 172.21.15.6:0/48421753 wait complete. 2024-05-20T17:59:47.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.001+0000 7f88322af640 1 Processor -- start 2024-05-20T17:59:47.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.001+0000 7f88322af640 1 -- start start 2024-05-20T17:59:48.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.002+0000 7f88322af640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882c06d910 0x7f882c0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.002+0000 7f88322af640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c0b3e80 0x7f882c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.002+0000 7f88322af640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c162820 0x7f882c0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.002+0000 7f88322af640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f882c0d0300 con 0x7f882c0b3e80 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.002+0000 7f88322af640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f882c0d4260 con 0x7f882c06d910 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.002+0000 7f88322af640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f882c0b91a0 con 0x7f882c162820 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.002+0000 7f8823fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c0b3e80 0x7f882c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f8823fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c0b3e80 0x7f882c14ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50760/0 (socket says 172.21.15.6:50760) 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f8823fff640 1 -- 172.21.15.6:0/1022986953 learned_addr learned my addr 172.21.15.6:0/1022986953 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f883084c640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c162820 0x7f882c0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f882bfff640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882c06d910 0x7f882c0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f8823fff640 1 -- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c162820 msgr2=0x7f882c0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f8823fff640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c162820 0x7f882c0cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f8823fff640 1 -- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882c06d910 msgr2=0x7f882c0c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f8823fff640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882c06d910 0x7f882c0c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f8823fff640 1 -- 172.21.15.6:0/1022986953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c0c9c80 con 0x7f882c0b3e80 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f8823fff640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c0b3e80 0x7f882c14ff70 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f881400b440 tx=0x7f881400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f88297fa640 1 -- 172.21.15.6:0/1022986953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814015020 con 0x7f882c0b3e80 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f88297fa640 1 -- 172.21.15.6:0/1022986953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8814011890 con 0x7f882c0b3e80 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f88297fa640 1 -- 172.21.15.6:0/1022986953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814011c80 con 0x7f882c0b3e80 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c0c9f60 con 0x7f882c0b3e80 2024-05-20T17:59:48.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.003+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c0ca520 con 0x7f882c0b3e80 2024-05-20T17:59:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.004+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882c075b00 con 0x7f882c0b3e80 2024-05-20T17:59:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.005+0000 7f88297fa640 1 -- 172.21.15.6:0/1022986953 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8814018020 con 0x7f882c0b3e80 2024-05-20T17:59:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.005+0000 7f88297fa640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.006+0000 7f88297fa640 1 -- 172.21.15.6:0/1022986953 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f881408b220 con 0x7f882c0b3e80 2024-05-20T17:59:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.006+0000 7f882bfff640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.006+0000 7f882bfff640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f881c034000 tx=0x7f881c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.010+0000 7f88297fa640 1 -- 172.21.15.6:0/1022986953 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f881401f020 con 0x7f882c0b3e80 2024-05-20T17:59:48.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.192+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f882c0c99a0 con 0x7f882c0b3e80 2024-05-20T17:59:48.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.193+0000 7f88297fa640 1 -- 172.21.15.6:0/1022986953 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f881400d040 con 0x7f882c0b3e80 2024-05-20T17:59:48.191 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:59:48.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 msgr2=0x7f880c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f881c034000 tx=0x7f881c02e000 comp rx=0 tx=0).stop 2024-05-20T17:59:48.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c0b3e80 msgr2=0x7f882c14ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c0b3e80 0x7f882c14ff70 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f881400b440 tx=0x7f881400b900 comp rx=0 tx=0).stop 2024-05-20T17:59:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 shutdown_connections 2024-05-20T17:59:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f882c162820 0x7f882c0cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f882c0b3e80 0x7f882c14ff70 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 --2- 172.21.15.6:0/1022986953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f882c06d910 0x7f882c0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 >> 172.21.15.6:0/1022986953 conn(0x7f882c0d4bd0 msgr2=0x7f882c0ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 shutdown_connections 2024-05-20T17:59:48.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.195+0000 7f88322af640 1 -- 172.21.15.6:0/1022986953 wait complete. 2024-05-20T17:59:48.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:59:48.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.324+0000 7fdf5fbe2640 1 Processor -- start 2024-05-20T17:59:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.324+0000 7fdf5fbe2640 1 -- start start 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5fbe2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf58162820 0x7fdf580b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5fbe2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdf580b3e80 0x7fdf5806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5fbe2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf5806d910 0x7fdf580d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5fbe2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdf5806dd20 con 0x7fdf58162820 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5fbe2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdf580d0630 con 0x7fdf580b3e80 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5fbe2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdf580d39c0 con 0x7fdf5806d910 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d97e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf58162820 0x7fdf580b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d97e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf58162820 0x7fdf580b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50776/0 (socket says 172.21.15.6:50776) 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d97e640 1 -- 172.21.15.6:0/142103033 learned_addr learned my addr 172.21.15.6:0/142103033 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d97e640 1 -- 172.21.15.6:0/142103033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf5806d910 msgr2=0x7fdf580d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:48.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5e17f640 1 --2- 172.21.15.6:0/142103033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf5806d910 0x7fdf580d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d17d640 1 --2- 172.21.15.6:0/142103033 >> v2:172.21.15.171:3300/0 conn(0x7fdf580b3e80 0x7fdf5806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d97e640 1 --2- 172.21.15.6:0/142103033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf5806d910 0x7fdf580d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d97e640 1 -- 172.21.15.6:0/142103033 >> v2:172.21.15.171:3300/0 conn(0x7fdf580b3e80 msgr2=0x7fdf5806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d97e640 1 --2- 172.21.15.6:0/142103033 >> v2:172.21.15.171:3300/0 conn(0x7fdf580b3e80 0x7fdf5806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d97e640 1 -- 172.21.15.6:0/142103033 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580d3ca0 con 0x7fdf58162820 2024-05-20T17:59:48.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.326+0000 7fdf5d17d640 1 --2- 172.21.15.6:0/142103033 >> v2:172.21.15.171:3300/0 conn(0x7fdf580b3e80 0x7fdf5806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:48.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.327+0000 7fdf5d97e640 1 --2- 172.21.15.6:0/142103033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf58162820 0x7fdf580b3940 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fdf580d1230 tx=0x7fdf5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8ddf96ce704b03 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.327+0000 7fdf5c97c640 1 -- 172.21.15.6:0/142103033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54037070 con 0x7fdf58162820 2024-05-20T17:59:48.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.327+0000 7fdf5c97c640 1 -- 172.21.15.6:0/142103033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf54032440 con 0x7fdf58162820 2024-05-20T17:59:48.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.327+0000 7fdf5c97c640 1 -- 172.21.15.6:0/142103033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54032810 con 0x7fdf58162820 2024-05-20T17:59:48.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/142103033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf58162820 msgr2=0x7fdf580b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/142103033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf58162820 0x7fdf580b3940 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fdf580d1230 tx=0x7fdf5402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/142103033 shutdown_connections 2024-05-20T17:59:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/142103033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf5806d910 0x7fdf580d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/142103033 >> v2:172.21.15.171:3300/0 conn(0x7fdf580b3e80 0x7fdf5806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/142103033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf58162820 0x7fdf580b3940 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/142103033 >> 172.21.15.6:0/142103033 conn(0x7fdf580d4bd0 msgr2=0x7fdf580d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/142103033 shutdown_connections 2024-05-20T17:59:48.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.328+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/142103033 wait complete. 2024-05-20T17:59:48.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.330+0000 7fdf5fbe2640 1 Processor -- start 2024-05-20T17:59:48.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.330+0000 7fdf5fbe2640 1 -- start start 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5fbe2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf5806d910 0x7fdf580cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5fbe2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf580b3e80 0x7fdf580b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5fbe2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf58162820 0x7fdf580b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5fbe2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580d0300 con 0x7fdf5806d910 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5fbe2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580d4260 con 0x7fdf58162820 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5fbe2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdf580d4780 con 0x7fdf580b3e80 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5d97e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf5806d910 0x7fdf580cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5d97e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf5806d910 0x7fdf580cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50790/0 (socket says 172.21.15.6:50790) 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.331+0000 7fdf5d97e640 1 -- 172.21.15.6:0/2747170865 learned_addr learned my addr 172.21.15.6:0/2747170865 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5e17f640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf58162820 0x7fdf580b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5d17d640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf580b3e80 0x7fdf580b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5d97e640 1 -- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf580b3e80 msgr2=0x7fdf580b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5d97e640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf580b3e80 0x7fdf580b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5d97e640 1 -- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf58162820 msgr2=0x7fdf580b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5d97e640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf58162820 0x7fdf580b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5d97e640 1 -- 172.21.15.6:0/2747170865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580b4290 con 0x7fdf5806d910 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5d97e640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf5806d910 0x7fdf580cbc80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fdf54000c00 tx=0x7fdf540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf4e7fc640 1 -- 172.21.15.6:0/2747170865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54037040 con 0x7fdf5806d910 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf4e7fc640 1 -- 172.21.15.6:0/2747170865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf54042070 con 0x7fdf5806d910 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf580cc540 con 0x7fdf5806d910 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf4e7fc640 1 -- 172.21.15.6:0/2747170865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54030bb0 con 0x7fdf5806d910 2024-05-20T17:59:48.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.332+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf580ccb00 con 0x7fdf5806d910 2024-05-20T17:59:48.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.333+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf58075b00 con 0x7fdf5806d910 2024-05-20T17:59:48.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.334+0000 7fdf4e7fc640 1 -- 172.21.15.6:0/2747170865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf54047460 con 0x7fdf5806d910 2024-05-20T17:59:48.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.334+0000 7fdf4e7fc640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf3c06be60 0x7fdf3c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.335+0000 7fdf4e7fc640 1 -- 172.21.15.6:0/2747170865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fdf540abc30 con 0x7fdf5806d910 2024-05-20T17:59:48.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.335+0000 7fdf5d17d640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf3c06be60 0x7fdf3c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.335+0000 7fdf5d17d640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf3c06be60 0x7fdf3c06e370 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdf581f87d0 tx=0x7fdf48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.339+0000 7fdf4e7fc640 1 -- 172.21.15.6:0/2747170865 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdf5407a3e0 con 0x7fdf5806d910 2024-05-20T17:59:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.523+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdf580b3b50 con 0x7fdf5806d910 2024-05-20T17:59:48.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.523+0000 7fdf4e7fc640 1 -- 172.21.15.6:0/2747170865 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fdf54079ce0 con 0x7fdf5806d910 2024-05-20T17:59:48.522 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:59:48.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf3c06be60 msgr2=0x7fdf3c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf3c06be60 0x7fdf3c06e370 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdf581f87d0 tx=0x7fdf48008040 comp rx=0 tx=0).stop 2024-05-20T17:59:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf5806d910 msgr2=0x7fdf580cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf5806d910 0x7fdf580cbc80 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fdf54000c00 tx=0x7fdf540046c0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 shutdown_connections 2024-05-20T17:59:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf3c06be60 0x7fdf3c06e370 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf58162820 0x7fdf580b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf580b3e80 0x7fdf580b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 --2- 172.21.15.6:0/2747170865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf5806d910 0x7fdf580cbc80 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 >> 172.21.15.6:0/2747170865 conn(0x7fdf580d4bd0 msgr2=0x7fdf580cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 shutdown_connections 2024-05-20T17:59:48.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.525+0000 7fdf5fbe2640 1 -- 172.21.15.6:0/2747170865 wait complete. 2024-05-20T17:59:48.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:59:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.658+0000 7f7251673640 1 Processor -- start 2024-05-20T17:59:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.658+0000 7f7251673640 1 -- start start 2024-05-20T17:59:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f7251673640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f724c0af330 0x7f724c0af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f7251673640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f724c0d1610 0x7f724c0d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f7251673640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0b1e50 0x7f724c0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f7251673640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f724c06c840 con 0x7f724c0af330 2024-05-20T17:59:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f7251673640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f724c0d20d0 con 0x7f724c0d1610 2024-05-20T17:59:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f7251673640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f724c06cae0 con 0x7f724c0b1e50 2024-05-20T17:59:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f724affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f724c0af330 0x7f724c0af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f724affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f724c0af330 0x7f724c0af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50802/0 (socket says 172.21.15.6:50802) 2024-05-20T17:59:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f724affd640 1 -- 172.21.15.6:0/2567992172 learned_addr learned my addr 172.21.15.6:0/2567992172 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f724b7fe640 1 --2- 172.21.15.6:0/2567992172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0b1e50 0x7f724c0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.659+0000 7f724a7fc640 1 --2- 172.21.15.6:0/2567992172 >> v2:172.21.15.171:3300/0 conn(0x7f724c0d1610 0x7f724c0d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f724affd640 1 -- 172.21.15.6:0/2567992172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0b1e50 msgr2=0x7f724c0b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f724affd640 1 --2- 172.21.15.6:0/2567992172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0b1e50 0x7f724c0b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f724affd640 1 -- 172.21.15.6:0/2567992172 >> v2:172.21.15.171:3300/0 conn(0x7f724c0d1610 msgr2=0x7f724c0d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f724affd640 1 --2- 172.21.15.6:0/2567992172 >> v2:172.21.15.171:3300/0 conn(0x7f724c0d1610 0x7f724c0d1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f724affd640 1 -- 172.21.15.6:0/2567992172 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c06cdc0 con 0x7f724c0af330 2024-05-20T17:59:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f724affd640 1 --2- 172.21.15.6:0/2567992172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0af330 0x7f724c0af740 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f724c073280 tx=0x7f723c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c378eac9e11c53bd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f7249ffb640 1 -- 172.21.15.6:0/2567992172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c036070 con 0x7f724c0af330 2024-05-20T17:59:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f7249ffb640 1 -- 172.21.15.6:0/2567992172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f723c031600 con 0x7f724c0af330 2024-05-20T17:59:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.660+0000 7f7249ffb640 1 -- 172.21.15.6:0/2567992172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c0319d0 con 0x7f724c0af330 2024-05-20T17:59:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 -- 172.21.15.6:0/2567992172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0af330 msgr2=0x7f724c0af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 --2- 172.21.15.6:0/2567992172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0af330 0x7f724c0af740 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f724c073280 tx=0x7f723c02a610 comp rx=0 tx=0).stop 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 -- 172.21.15.6:0/2567992172 shutdown_connections 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 --2- 172.21.15.6:0/2567992172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0b1e50 0x7f724c0b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 --2- 172.21.15.6:0/2567992172 >> v2:172.21.15.171:3300/0 conn(0x7f724c0d1610 0x7f724c0d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 --2- 172.21.15.6:0/2567992172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0af330 0x7f724c0af740 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 -- 172.21.15.6:0/2567992172 >> 172.21.15.6:0/2567992172 conn(0x7f724c0b6670 msgr2=0x7f724c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 -- 172.21.15.6:0/2567992172 shutdown_connections 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.661+0000 7f7251673640 1 -- 172.21.15.6:0/2567992172 wait complete. 2024-05-20T17:59:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.663+0000 7f7251673640 1 Processor -- start 2024-05-20T17:59:48.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.663+0000 7f7251673640 1 -- start start 2024-05-20T17:59:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.664+0000 7f7251673640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f724c0af330 0x7f724c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f7251673640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0b1e50 0x7f724c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f7251673640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0d1610 0x7f724c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f7251673640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f724c15d350 con 0x7f724c0b1e50 2024-05-20T17:59:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f7251673640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f724c0b27a0 con 0x7f724c0af330 2024-05-20T17:59:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f7251673640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f724c159d30 con 0x7f724c0d1610 2024-05-20T17:59:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0b1e50 0x7f724c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0b1e50 0x7f724c15a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50808/0 (socket says 172.21.15.6:50808) 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 -- 172.21.15.6:0/3116255013 learned_addr learned my addr 172.21.15.6:0/3116255013 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724affd640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f724c0af330 0x7f724c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724b7fe640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0d1610 0x7f724c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 -- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0d1610 msgr2=0x7f724c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0d1610 0x7f724c15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 -- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f724c0af330 msgr2=0x7f724c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f724c0af330 0x7f724c0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 -- 172.21.15.6:0/3116255013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c0d0580 con 0x7f724c0b1e50 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724b7fe640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0d1610 0x7f724c15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f724a7fc640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0b1e50 0x7f724c15a970 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f724000c7c0 tx=0x7f724000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f72337fe640 1 -- 172.21.15.6:0/3116255013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240015070 con 0x7f724c0b1e50 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f72337fe640 1 -- 172.21.15.6:0/3116255013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7240007820 con 0x7f724c0b1e50 2024-05-20T17:59:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c0d0860 con 0x7f724c0b1e50 2024-05-20T17:59:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f72337fe640 1 -- 172.21.15.6:0/3116255013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240007bd0 con 0x7f724c0b1e50 2024-05-20T17:59:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.665+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c0d0b40 con 0x7f724c0b1e50 2024-05-20T17:59:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.667+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724c075b00 con 0x7f724c0b1e50 2024-05-20T17:59:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.667+0000 7f72337fe640 1 -- 172.21.15.6:0/3116255013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7240018070 con 0x7f724c0b1e50 2024-05-20T17:59:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.668+0000 7f72337fe640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f723806be30 0x7f723806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.668+0000 7f72337fe640 1 -- 172.21.15.6:0/3116255013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f724008ad80 con 0x7f724c0b1e50 2024-05-20T17:59:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.668+0000 7f724affd640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f723806be30 0x7f723806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.668+0000 7f724affd640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f723806be30 0x7f723806e340 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f723c033000 tx=0x7f723c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.672+0000 7f72337fe640 1 -- 172.21.15.6:0/3116255013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7240058f70 con 0x7f724c0b1e50 2024-05-20T17:59:48.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.860+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f724c158fe0 con 0x7f724c0b1e50 2024-05-20T17:59:48.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.860+0000 7f72337fe640 1 -- 172.21.15.6:0/3116255013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f724005d270 con 0x7f724c0b1e50 2024-05-20T17:59:48.859 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:59:48.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f723806be30 msgr2=0x7f723806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f723806be30 0x7f723806e340 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f723c033000 tx=0x7f723c009000 comp rx=0 tx=0).stop 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0b1e50 msgr2=0x7f724c15a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0b1e50 0x7f724c15a970 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f724000c7c0 tx=0x7f724000cc80 comp rx=0 tx=0).stop 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 shutdown_connections 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f723806be30 0x7f723806e340 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f724c0d1610 0x7f724c15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f724c0b1e50 0x7f724c15a970 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 --2- 172.21.15.6:0/3116255013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f724c0af330 0x7f724c0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 >> 172.21.15.6:0/3116255013 conn(0x7f724c0b6670 msgr2=0x7f724c0b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 shutdown_connections 2024-05-20T17:59:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.862+0000 7f7251673640 1 -- 172.21.15.6:0/3116255013 wait complete. 2024-05-20T17:59:48.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:59:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.990+0000 7f5471cca640 1 Processor -- start 2024-05-20T17:59:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.990+0000 7f5471cca640 1 -- start start 2024-05-20T17:59:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f5471cca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c06d3d0 0x7f546c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f5471cca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546c06dd20 con 0x7f546c0b8190 2024-05-20T17:59:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f5471cca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546c0d0630 con 0x7f546c162820 2024-05-20T17:59:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f5471cca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f546c0d39c0 con 0x7f546c06d3d0 2024-05-20T17:59:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f546bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f546c0b8190 0x7f546c0b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51582/0 (socket says 172.21.15.6:51582) 2024-05-20T17:59:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f546bfff640 1 -- 172.21.15.6:0/3250045806 learned_addr learned my addr 172.21.15.6:0/3250045806 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f546affd640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c06d3d0 0x7f546c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193438798 0 0) 0x7f5464001490 con 0x7f546c0b8190 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.991+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5454003520 con 0x7f546c0b8190 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2738893571 0 0) 0x7f5454003520 con 0x7f546c0b8190 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c06d3d0 msgr2=0x7f546c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c06d3d0 0x7f546c06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 >> v1:172.21.15.171:6789/0 conn(0x7f546c162820 legacy=0x7f546c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c0d3ca0 con 0x7f546c0b8190 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5464001bc0 con 0x7f546c0b8190 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 >> v1:172.21.15.6:6789/0 conn(0x7f546c0b8190 legacy=0x7f546c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c06d3d0 0x7f54540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454003f40 0x7f5454004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5454004d40 0x7f5454005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f546c0d39c0 con 0x7f5454004d40 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f545400bad0 con 0x7f5454003f40 2024-05-20T17:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f545400bcd0 con 0x7f546c06d3d0 2024-05-20T17:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546bfff640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5454004d40 0x7f5454005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546b7fe640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c06d3d0 0x7f54540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546affd640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454003f40 0x7f5454004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546bfff640 1 -- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c06d3d0 msgr2=0x7f54540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546bfff640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c06d3d0 0x7f54540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546bfff640 1 -- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454003f40 msgr2=0x7f5454004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546bfff640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454003f40 0x7f5454004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.992+0000 7f546bfff640 1 -- 172.21.15.6:0/3250045806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5454003520 con 0x7f5454004d40 2024-05-20T17:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.993+0000 7f546bfff640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5454004d40 0x7f5454005150 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f546400aa00 tx=0x7f5454005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72615c58e267fa4c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.993+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546400a650 con 0x7f5454004d40 2024-05-20T17:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.993+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546402f070 con 0x7f5454004d40 2024-05-20T17:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.993+0000 7f546a7fc640 1 -- 172.21.15.6:0/3250045806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546402be40 con 0x7f5454004d40 2024-05-20T17:59:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.994+0000 7f5471cca640 1 -- 172.21.15.6:0/3250045806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5454004d40 msgr2=0x7f5454005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.994+0000 7f5471cca640 1 --2- 172.21.15.6:0/3250045806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5454004d40 0x7f5454005150 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f546400aa00 tx=0x7f5454005830 comp rx=0 tx=0).stop 2024-05-20T17:59:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.994+0000 7f546bfff640 1 -- 172.21.15.6:0/3250045806 reap_dead start 2024-05-20T17:59:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.994+0000 7f5471cca640 1 -- 172.21.15.6:0/3250045806 shutdown_connections 2024-05-20T17:59:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.994+0000 7f5471cca640 1 -- 172.21.15.6:0/3250045806 >> 172.21.15.6:0/3250045806 conn(0x7f546c0d4bd0 msgr2=0x7f546c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:48.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.994+0000 7f5471cca640 1 -- 172.21.15.6:0/3250045806 shutdown_connections 2024-05-20T17:59:48.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.994+0000 7f5471cca640 1 -- 172.21.15.6:0/3250045806 wait complete. 2024-05-20T17:59:48.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.996+0000 7f5471cca640 1 Processor -- start 2024-05-20T17:59:48.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.996+0000 7f5471cca640 1 -- start start 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.997+0000 7f5471cca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454004d40 0x7f546c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.997+0000 7f5471cca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c15d180 0x7f546c0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.997+0000 7f5471cca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0b2ea0 0x7f546c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.997+0000 7f5471cca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f546c0d0300 con 0x7f546c15d180 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.997+0000 7f5471cca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f546c0d4260 con 0x7f5454004d40 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.997+0000 7f5471cca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f546c0b4050 con 0x7f546c0b2ea0 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c15d180 0x7f546c0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c15d180 0x7f546c0b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50826/0 (socket says 172.21.15.6:50826) 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 -- 172.21.15.6:0/3857430841 learned_addr learned my addr 172.21.15.6:0/3857430841 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546bfff640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0b2ea0 0x7f546c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546b7fe640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454004d40 0x7f546c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 -- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0b2ea0 msgr2=0x7f546c0c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0b2ea0 0x7f546c0c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 -- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454004d40 msgr2=0x7f546c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454004d40 0x7f546c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 -- 172.21.15.6:0/3857430841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c0b32b0 con 0x7f546c15d180 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546bfff640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0b2ea0 0x7f546c0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f546affd640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c15d180 0x7f546c0b2960 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f54600119a0 tx=0x7f5460011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f5453fff640 1 -- 172.21.15.6:0/3857430841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546000faf0 con 0x7f546c15d180 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f5453fff640 1 -- 172.21.15.6:0/3857430841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546000fc90 con 0x7f546c15d180 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f5453fff640 1 -- 172.21.15.6:0/3857430841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460014440 con 0x7f546c15d180 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546c0cb800 con 0x7f546c15d180 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.998+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546c0c8700 con 0x7f546c15d180 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:48.999+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546c075b00 con 0x7f546c15d180 2024-05-20T17:59:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.000+0000 7f5453fff640 1 -- 172.21.15.6:0/3857430841 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5460012040 con 0x7f546c15d180 2024-05-20T17:59:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.001+0000 7f5453fff640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545806be30 0x7f545806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.001+0000 7f5453fff640 1 -- 172.21.15.6:0/3857430841 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f546008b730 con 0x7f546c15d180 2024-05-20T17:59:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.001+0000 7f546b7fe640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545806be30 0x7f545806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.001+0000 7f546b7fe640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545806be30 0x7f545806e340 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f545c003700 tx=0x7f545c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.005+0000 7f5453fff640 1 -- 172.21.15.6:0/3857430841 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f546c0b32b0 con 0x7f546c15d180 2024-05-20T17:59:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.203+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f546c0cb590 con 0x7f546c15d180 2024-05-20T17:59:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.203+0000 7f5453fff640 1 -- 172.21.15.6:0/3857430841 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) ==== 80+0+0 (secure 0 0 0) 0x7f5460019030 con 0x7f546c15d180 2024-05-20T17:59:49.202 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545806be30 msgr2=0x7f545806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545806be30 0x7f545806e340 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f545c003700 tx=0x7f545c009040 comp rx=0 tx=0).stop 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c15d180 msgr2=0x7f546c0b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c15d180 0x7f546c0b2960 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f54600119a0 tx=0x7f5460011e60 comp rx=0 tx=0).stop 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 shutdown_connections 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545806be30 0x7f545806e340 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0b2ea0 0x7f546c0c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c15d180 0x7f546c0b2960 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 --2- 172.21.15.6:0/3857430841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5454004d40 0x7f546c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 >> 172.21.15.6:0/3857430841 conn(0x7f546c0d4bd0 msgr2=0x7f546c15eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 shutdown_connections 2024-05-20T17:59:49.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.205+0000 7f5471cca640 1 -- 172.21.15.6:0/3857430841 wait complete. 2024-05-20T17:59:49.215 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T17:59:49.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:59:49.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T17:59:49.255 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T17:59:49.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:59:49.255 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T17:59:49.312 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:59:49.312 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:59:49.312 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:59:49.331 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:59:49.331 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:59:49.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:59:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.507+0000 7fd0c964a640 1 Processor -- start 2024-05-20T17:59:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.507+0000 7fd0c964a640 1 -- start start 2024-05-20T17:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.508+0000 7fd0c964a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0c4168050 0x7fd0c416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.508+0000 7fd0c964a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c40d0630 con 0x7fd0c4162820 2024-05-20T17:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c964a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c40d39c0 con 0x7fd0c406d3d0 2024-05-20T17:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c964a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c40d3ca0 con 0x7fd0c4168050 2024-05-20T17:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0c4168050 0x7fd0c416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd0c4162820 0x7fd0c40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51584/0 (socket says 172.21.15.6:51584) 2024-05-20T17:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c2ffd640 1 -- 172.21.15.6:0/390982164 learned_addr learned my addr 172.21.15.6:0/390982164 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c37fe640 1 --2- 172.21.15.6:0/390982164 >> v2:172.21.15.6:3300/0 conn(0x7fd0c4168050 0x7fd0c416a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50834/0 (socket says 172.21.15.6:50834) 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c37fe640 1 -- 172.21.15.6:0/390982164 >> v1:172.21.15.171:6789/0 conn(0x7fd0c406d3d0 legacy=0x7fd0c406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c37fe640 1 -- 172.21.15.6:0/390982164 >> v1:172.21.15.6:6789/0 conn(0x7fd0c4162820 legacy=0x7fd0c40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c37fe640 1 -- 172.21.15.6:0/390982164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c40d3f80 con 0x7fd0c4168050 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.509+0000 7fd0c1ffb640 1 -- 172.21.15.6:0/390982164 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017226509 0 0) 0x7fd0c40d0630 con 0x7fd0c4162820 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.510+0000 7fd0c37fe640 1 --2- 172.21.15.6:0/390982164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4168050 0x7fd0c416a470 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009d90 tx=0x7fd0bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acdbc7046ea1f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.510+0000 7fd0c1ffb640 1 -- 172.21.15.6:0/390982164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc007740 con 0x7fd0c4168050 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.510+0000 7fd0c1ffb640 1 -- 172.21.15.6:0/390982164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0bc0078e0 con 0x7fd0c4168050 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.510+0000 7fd0c1ffb640 1 -- 172.21.15.6:0/390982164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc007cb0 con 0x7fd0c4168050 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.511+0000 7fd0c964a640 1 -- 172.21.15.6:0/390982164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4168050 msgr2=0x7fd0c416a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.511+0000 7fd0c964a640 1 --2- 172.21.15.6:0/390982164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4168050 0x7fd0c416a470 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009d90 tx=0x7fd0bc02a6f0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.511+0000 7fd0c964a640 1 -- 172.21.15.6:0/390982164 shutdown_connections 2024-05-20T17:59:49.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.511+0000 7fd0c964a640 1 --2- 172.21.15.6:0/390982164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4168050 0x7fd0c416a470 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.511+0000 7fd0c964a640 1 -- 172.21.15.6:0/390982164 >> 172.21.15.6:0/390982164 conn(0x7fd0c40d4bd0 msgr2=0x7fd0c40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:49.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.511+0000 7fd0c964a640 1 -- 172.21.15.6:0/390982164 shutdown_connections 2024-05-20T17:59:49.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.511+0000 7fd0c964a640 1 -- 172.21.15.6:0/390982164 wait complete. 2024-05-20T17:59:49.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.513+0000 7fd0c964a640 1 Processor -- start 2024-05-20T17:59:49.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.513+0000 7fd0c964a640 1 -- start start 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c964a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0c406d3d0 0x7fd0c40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c964a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4162820 0x7fd0c414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c964a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0c4168050 0x7fd0c41560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c964a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c40b91a0 con 0x7fd0c4162820 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c964a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c40d0300 con 0x7fd0c4168050 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c964a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c40b4050 con 0x7fd0c406d3d0 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4162820 0x7fd0c414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4162820 0x7fd0c414f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50842/0 (socket says 172.21.15.6:50842) 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c27fc640 1 -- 172.21.15.6:0/3152719439 learned_addr learned my addr 172.21.15.6:0/3152719439 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c37fe640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0c4168050 0x7fd0c41560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c2ffd640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0c406d3d0 0x7fd0c40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c27fc640 1 -- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0c406d3d0 msgr2=0x7fd0c40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c27fc640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0c406d3d0 0x7fd0c40c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c27fc640 1 -- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0c4168050 msgr2=0x7fd0c41560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c27fc640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0c4168050 0x7fd0c41560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c27fc640 1 -- 172.21.15.6:0/3152719439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c4153640 con 0x7fd0c4162820 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.514+0000 7fd0c2ffd640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0c406d3d0 0x7fd0c40c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.515+0000 7fd0c27fc640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4162820 0x7fd0c414f070 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c400 tx=0x7fd0b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.515+0000 7fd0ab7fe640 1 -- 172.21.15.6:0/3152719439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8017070 con 0x7fd0c4162820 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.515+0000 7fd0ab7fe640 1 -- 172.21.15.6:0/3152719439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b80052d0 con 0x7fd0c4162820 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.515+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c4153920 con 0x7fd0c4162820 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.515+0000 7fd0ab7fe640 1 -- 172.21.15.6:0/3152719439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8003830 con 0x7fd0c4162820 2024-05-20T17:59:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.515+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c4153ee0 con 0x7fd0c4162820 2024-05-20T17:59:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.516+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c4075b00 con 0x7fd0c4162820 2024-05-20T17:59:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.516+0000 7fd0ab7fe640 1 -- 172.21.15.6:0/3152719439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0b801a070 con 0x7fd0c4162820 2024-05-20T17:59:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.517+0000 7fd0ab7fe640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0b006be30 0x7fd0b006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.517+0000 7fd0ab7fe640 1 -- 172.21.15.6:0/3152719439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fd0b808a470 con 0x7fd0c4162820 2024-05-20T17:59:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.517+0000 7fd0c2ffd640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0b006be30 0x7fd0b006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.518+0000 7fd0c2ffd640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0b006be30 0x7fd0b006e340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4000f60 tx=0x7fd0b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.522+0000 7fd0ab7fe640 1 -- 172.21.15.6:0/3152719439 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd0b8058b90 con 0x7fd0c4162820 2024-05-20T17:59:49.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.711+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0c415b100 con 0x7fd0c4162820 2024-05-20T17:59:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.712+0000 7fd0ab7fe640 1 -- 172.21.15.6:0/3152719439 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17030 (secure 0 0 0) 0x7fd0b8058490 con 0x7fd0c4162820 2024-05-20T17:59:49.711 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:49.711 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":89,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:48.988398+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:57:17.597397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-20T17:57:18.862392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":5}]},{"pgid":"14.24","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:59:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0b006be30 msgr2=0x7fd0b006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0b006be30 0x7fd0b006e340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4000f60 tx=0x7fd0b4009040 comp rx=0 tx=0).stop 2024-05-20T17:59:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4162820 msgr2=0x7fd0c414f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4162820 0x7fd0c414f070 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c400 tx=0x7fd0b800c8c0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 shutdown_connections 2024-05-20T17:59:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0b006be30 0x7fd0b006e340 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0c4168050 0x7fd0c41560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c4162820 0x7fd0c414f070 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 --2- 172.21.15.6:0/3152719439 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0c406d3d0 0x7fd0c40c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 >> 172.21.15.6:0/3152719439 conn(0x7fd0c40d4bd0 msgr2=0x7fd0c4067520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 shutdown_connections 2024-05-20T17:59:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.714+0000 7fd0c964a640 1 -- 172.21.15.6:0/3152719439 wait complete. 2024-05-20T17:59:49.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:57:17.597397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:57:18.862392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:59:49.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:59:49.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.846+0000 7fc0e3ce2640 1 Processor -- start 2024-05-20T17:59:49.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.846+0000 7fc0e3ce2640 1 -- start start 2024-05-20T17:59:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e3ce2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc0dc163a10 0x7fc0dc0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e3ce2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 0x7fc0dc0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e3ce2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0dc0d14b0 0x7fc0dc0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e3ce2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc0dc0d3ca0 con 0x7fc0dc0d14b0 2024-05-20T17:59:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e3ce2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc0dc0d0370 con 0x7fc0dc163a10 2024-05-20T17:59:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e3ce2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc0dc0d0650 con 0x7fc0dc0b4010 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e227f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0dc0d14b0 0x7fc0dc0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e227f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc0dc0d14b0 0x7fc0dc0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50848/0 (socket says 172.21.15.6:50848) 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.847+0000 7fc0e227f640 1 -- 172.21.15.6:0/777758703 learned_addr learned my addr 172.21.15.6:0/777758703 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.848+0000 7fc0e1a7e640 1 --2- 172.21.15.6:0/777758703 >> v2:172.21.15.171:3300/0 conn(0x7fc0dc163a10 0x7fc0dc0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.848+0000 7fc0e127d640 1 --2- 172.21.15.6:0/777758703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 0x7fc0dc0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.848+0000 7fc0e227f640 1 -- 172.21.15.6:0/777758703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 msgr2=0x7fc0dc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.848+0000 7fc0e227f640 1 --2- 172.21.15.6:0/777758703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 0x7fc0dc0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.848+0000 7fc0e227f640 1 -- 172.21.15.6:0/777758703 >> v2:172.21.15.171:3300/0 conn(0x7fc0dc163a10 msgr2=0x7fc0dc0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.848+0000 7fc0e227f640 1 --2- 172.21.15.6:0/777758703 >> v2:172.21.15.171:3300/0 conn(0x7fc0dc163a10 0x7fc0dc0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.848+0000 7fc0e227f640 1 -- 172.21.15.6:0/777758703 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc0d3650 con 0x7fc0dc0d14b0 2024-05-20T17:59:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.848+0000 7fc0e227f640 1 --2- 172.21.15.6:0/777758703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc0d14b0 0x7fc0dc0d18c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0cf1c0 tx=0x7fc0d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce30a3dc7e17edd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e0a7c640 1 -- 172.21.15.6:0/777758703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4037070 con 0x7fc0dc0d14b0 2024-05-20T17:59:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e0a7c640 1 -- 172.21.15.6:0/777758703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4032440 con 0x7fc0dc0d14b0 2024-05-20T17:59:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e0a7c640 1 -- 172.21.15.6:0/777758703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4032810 con 0x7fc0dc0d14b0 2024-05-20T17:59:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/777758703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc0d14b0 msgr2=0x7fc0dc0d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/777758703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc0d14b0 0x7fc0dc0d18c0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0cf1c0 tx=0x7fc0d402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/777758703 shutdown_connections 2024-05-20T17:59:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/777758703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc0d14b0 0x7fc0dc0d18c0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/777758703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 0x7fc0dc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/777758703 >> v2:172.21.15.171:3300/0 conn(0x7fc0dc163a10 0x7fc0dc0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/777758703 >> 172.21.15.6:0/777758703 conn(0x7fc0dc06d240 msgr2=0x7fc0dc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/777758703 shutdown_connections 2024-05-20T17:59:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.849+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/777758703 wait complete. 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.851+0000 7fc0e3ce2640 1 Processor -- start 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.851+0000 7fc0e3ce2640 1 -- start start 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e3ce2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 0x7fc0dc0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e3ce2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0dc0d14b0 0x7fc0dc0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e3ce2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc163a10 0x7fc0dc1eac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e3ce2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0d1e00 con 0x7fc0dc163a10 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e3ce2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0d0040 con 0x7fc0dc0d14b0 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e3ce2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc0dc0b8210 con 0x7fc0dc0b4010 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc163a10 0x7fc0dc1eac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc163a10 0x7fc0dc1eac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50856/0 (socket says 172.21.15.6:50856) 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 -- 172.21.15.6:0/803112480 learned_addr learned my addr 172.21.15.6:0/803112480 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e1a7e640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 0x7fc0dc0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e127d640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0dc0d14b0 0x7fc0dc0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 -- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 msgr2=0x7fc0dc0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 0x7fc0dc0adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 -- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0dc0d14b0 msgr2=0x7fc0dc0b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0dc0d14b0 0x7fc0dc0b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 -- 172.21.15.6:0/803112480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc0ac690 con 0x7fc0dc163a10 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e127d640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0dc0d14b0 0x7fc0dc0b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e227f640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc163a10 0x7fc0dc1eac10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc0d402a220 tx=0x7fc0d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0da7fc640 1 -- 172.21.15.6:0/803112480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4037040 con 0x7fc0dc163a10 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0da7fc640 1 -- 172.21.15.6:0/803112480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4042070 con 0x7fc0dc163a10 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc0ac970 con 0x7fc0dc163a10 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.853+0000 7fc0da7fc640 1 -- 172.21.15.6:0/803112480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4030920 con 0x7fc0dc163a10 2024-05-20T17:59:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.854+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc0acf30 con 0x7fc0dc163a10 2024-05-20T17:59:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.854+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0dc075b00 con 0x7fc0dc163a10 2024-05-20T17:59:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.855+0000 7fc0da7fc640 1 -- 172.21.15.6:0/803112480 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0d4030ac0 con 0x7fc0dc163a10 2024-05-20T17:59:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.856+0000 7fc0da7fc640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc0c806be60 0x7fc0c806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.856+0000 7fc0da7fc640 1 -- 172.21.15.6:0/803112480 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fc0d40aba30 con 0x7fc0dc163a10 2024-05-20T17:59:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.856+0000 7fc0e1a7e640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc0c806be60 0x7fc0c806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.857+0000 7fc0e1a7e640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc0c806be60 0x7fc0c806e370 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0d3020 tx=0x7fc0cc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:49.860+0000 7fc0da7fc640 1 -- 172.21.15.6:0/803112480 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc0d4079a80 con 0x7fc0dc163a10 2024-05-20T17:59:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.046+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc0dc0ac420 con 0x7fc0dc163a10 2024-05-20T17:59:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.047+0000 7fc0da7fc640 1 -- 172.21.15.6:0/803112480 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7fc0d407dd80 con 0x7fc0dc163a10 2024-05-20T17:59:50.045 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:59:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc0c806be60 msgr2=0x7fc0c806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc0c806be60 0x7fc0c806e370 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0d3020 tx=0x7fc0cc00b040 comp rx=0 tx=0).stop 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc163a10 msgr2=0x7fc0dc1eac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc163a10 0x7fc0dc1eac10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc0d402a220 tx=0x7fc0d40046c0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 shutdown_connections 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc0c806be60 0x7fc0c806e370 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0dc163a10 0x7fc0dc1eac10 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0dc0d14b0 0x7fc0dc0b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 --2- 172.21.15.6:0/803112480 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0dc0b4010 0x7fc0dc0adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 >> 172.21.15.6:0/803112480 conn(0x7fc0dc06d240 msgr2=0x7fc0dc0ba310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 shutdown_connections 2024-05-20T17:59:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.049+0000 7fc0e3ce2640 1 -- 172.21.15.6:0/803112480 wait complete. 2024-05-20T17:59:50.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:59:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.177+0000 7f7d47738640 1 Processor -- start 2024-05-20T17:59:50.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.177+0000 7f7d47738640 1 -- start start 2024-05-20T17:59:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.178+0000 7f7d47738640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7d4006d3d0 0x7f7d4006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.178+0000 7f7d47738640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 0x7f7d400b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.178+0000 7f7d47738640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d4006dd20 con 0x7f7d40162820 2024-05-20T17:59:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.178+0000 7f7d47738640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7d400d0630 con 0x7f7d4006d3d0 2024-05-20T17:59:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.178+0000 7f7d47738640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7d400d39c0 con 0x7f7d400b8190 2024-05-20T17:59:50.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d454d4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d40162820 0x7f7d400b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51588/0 (socket says 172.21.15.6:51588) 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d454d4640 1 -- 172.21.15.6:0/375950878 learned_addr learned my addr 172.21.15.6:0/375950878 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d45cd5640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 0x7f7d400b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d44cd3640 1 --2- 172.21.15.6:0/375950878 >> v2:172.21.15.171:3300/0 conn(0x7f7d4006d3d0 0x7f7d4006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668376681 0 0) 0x7f7d3c001110 con 0x7f7d40162820 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d2c003520 con 0x7f7d40162820 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1101396397 0 0) 0x7f7d2c003520 con 0x7f7d40162820 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 msgr2=0x7f7d400b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 0x7f7d400b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 >> v2:172.21.15.171:3300/0 conn(0x7f7d4006d3d0 msgr2=0x7f7d4006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 --2- 172.21.15.6:0/375950878 >> v2:172.21.15.171:3300/0 conn(0x7f7d4006d3d0 0x7f7d4006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d400d3ca0 con 0x7f7d40162820 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f7d3c001840 con 0x7f7d40162820 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d45cd5640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 0x7f7d400b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:59:50.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 >> v1:172.21.15.6:6789/0 conn(0x7f7d40162820 legacy=0x7f7d400b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 0x7f7d2c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2c003f10 0x7f7d2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c004d40 0x7f7d2c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400d0630 con 0x7f7d2c003f10 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400d39c0 con 0x7f7d2c004d40 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7d2c00b9f0 con 0x7f7d400b8190 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d44cd3640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2c003f10 0x7f7d2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.179+0000 7f7d454d4640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 0x7f7d2c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.180+0000 7f7d45cd5640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c004d40 0x7f7d2c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.180+0000 7f7d44cd3640 1 -- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 msgr2=0x7f7d2c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.180+0000 7f7d44cd3640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d400b8190 0x7f7d2c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.180+0000 7f7d44cd3640 1 -- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c004d40 msgr2=0x7f7d2c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.180+0000 7f7d44cd3640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c004d40 0x7f7d2c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.180+0000 7f7d44cd3640 1 -- 172.21.15.6:0/375950878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c003520 con 0x7f7d2c003f10 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.180+0000 7f7d44cd3640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2c003f10 0x7f7d2c004800 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009ac0 tx=0x7f7d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a169853a27afe386 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30036070 con 0x7f7d2c003f10 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d30031400 con 0x7f7d2c003f10 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d37fff640 1 -- 172.21.15.6:0/375950878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30009690 con 0x7f7d2c003f10 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d47738640 1 -- 172.21.15.6:0/375950878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2c003f10 msgr2=0x7f7d2c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d47738640 1 --2- 172.21.15.6:0/375950878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2c003f10 0x7f7d2c004800 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009ac0 tx=0x7f7d2c005830 comp rx=0 tx=0).stop 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d45cd5640 1 -- 172.21.15.6:0/375950878 reap_dead start 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d47738640 1 -- 172.21.15.6:0/375950878 shutdown_connections 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d47738640 1 -- 172.21.15.6:0/375950878 >> 172.21.15.6:0/375950878 conn(0x7f7d400d4bd0 msgr2=0x7f7d400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d47738640 1 -- 172.21.15.6:0/375950878 shutdown_connections 2024-05-20T17:59:50.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.181+0000 7f7d47738640 1 -- 172.21.15.6:0/375950878 wait complete. 2024-05-20T17:59:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.183+0000 7f7d47738640 1 Processor -- start 2024-05-20T17:59:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.183+0000 7f7d47738640 1 -- start start 2024-05-20T17:59:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d47738640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c003f10 0x7f7d400c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d47738640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4014f1a0 0x7f7d400cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d47738640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d400ce3b0 0x7f7d401f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d47738640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400d0300 con 0x7f7d400ce3b0 2024-05-20T17:59:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d47738640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400d4260 con 0x7f7d2c003f10 2024-05-20T17:59:50.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d47738640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7d400b4050 con 0x7f7d4014f1a0 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d400ce3b0 0x7f7d401f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d400ce3b0 0x7f7d401f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50876/0 (socket says 172.21.15.6:50876) 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 -- 172.21.15.6:0/3702185542 learned_addr learned my addr 172.21.15.6:0/3702185542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d454d4640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c003f10 0x7f7d400c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d44cd3640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4014f1a0 0x7f7d400cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 -- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4014f1a0 msgr2=0x7f7d400cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4014f1a0 0x7f7d400cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 -- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c003f10 msgr2=0x7f7d400c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c003f10 0x7f7d400c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 -- 172.21.15.6:0/3702185542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d400ce7c0 con 0x7f7d400ce3b0 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d45cd5640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d400ce3b0 0x7f7d401f5090 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7d400cbc50 tx=0x7f7d3800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.185+0000 7f7d35ffb640 1 -- 172.21.15.6:0/3702185542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800fe10 con 0x7f7d400ce3b0 2024-05-20T17:59:50.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.186+0000 7f7d35ffb640 1 -- 172.21.15.6:0/3702185542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d38015430 con 0x7f7d400ce3b0 2024-05-20T17:59:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.186+0000 7f7d35ffb640 1 -- 172.21.15.6:0/3702185542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d38015820 con 0x7f7d400ce3b0 2024-05-20T17:59:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.186+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d400c9180 con 0x7f7d400ce3b0 2024-05-20T17:59:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.186+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d400c9740 con 0x7f7d400ce3b0 2024-05-20T17:59:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.187+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d40075b00 con 0x7f7d400ce3b0 2024-05-20T17:59:50.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.187+0000 7f7d35ffb640 1 -- 172.21.15.6:0/3702185542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d380159c0 con 0x7f7d400ce3b0 2024-05-20T17:59:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.188+0000 7f7d35ffb640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d2406be60 0x7f7d2406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.188+0000 7f7d35ffb640 1 -- 172.21.15.6:0/3702185542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f7d3808b6d0 con 0x7f7d400ce3b0 2024-05-20T17:59:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.188+0000 7f7d454d4640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d2406be60 0x7f7d2406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.189+0000 7f7d454d4640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d2406be60 0x7f7d2406e370 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0017e0 tx=0x7f7d3c007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.192+0000 7f7d35ffb640 1 -- 172.21.15.6:0/3702185542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7d38024070 con 0x7f7d400ce3b0 2024-05-20T17:59:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.374+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7d400c7e00 con 0x7f7d400ce3b0 2024-05-20T17:59:50.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.374+0000 7f7d35ffb640 1 -- 172.21.15.6:0/3702185542 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f7d400ce7c0 con 0x7f7d400ce3b0 2024-05-20T17:59:50.373 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:59:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.376+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d2406be60 msgr2=0x7f7d2406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.376+0000 7f7d47738640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d2406be60 0x7f7d2406e370 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0017e0 tx=0x7f7d3c007aa0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.376+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d400ce3b0 msgr2=0x7f7d401f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.376+0000 7f7d47738640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d400ce3b0 0x7f7d401f5090 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7d400cbc50 tx=0x7f7d3800f580 comp rx=0 tx=0).stop 2024-05-20T17:59:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.377+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 shutdown_connections 2024-05-20T17:59:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.377+0000 7f7d47738640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7d2406be60 0x7f7d2406e370 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.377+0000 7f7d47738640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d400ce3b0 0x7f7d401f5090 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.377+0000 7f7d47738640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7d4014f1a0 0x7f7d400cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.377+0000 7f7d47738640 1 --2- 172.21.15.6:0/3702185542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d2c003f10 0x7f7d400c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.377+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 >> 172.21.15.6:0/3702185542 conn(0x7f7d400d4bd0 msgr2=0x7f7d4015f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.377+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 shutdown_connections 2024-05-20T17:59:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.377+0000 7f7d47738640 1 -- 172.21.15.6:0/3702185542 wait complete. 2024-05-20T17:59:50.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:59:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.505+0000 7fce14b1d640 1 Processor -- start 2024-05-20T17:59:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.505+0000 7fce14b1d640 1 -- start start 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce14b1d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fce10168050 0x7fce1016a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce14b1d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce100d0630 con 0x7fce1006d3d0 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce14b1d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce100d39c0 con 0x7fce10162820 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce14b1d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fce100d3ca0 con 0x7fce10168050 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0dd9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fce1006d3d0 0x7fce1006d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51598/0 (socket says 172.21.15.6:51598) 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0dd9b640 1 -- 172.21.15.6:0/3859173444 learned_addr learned my addr 172.21.15.6:0/3859173444 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0ed9d640 1 --2- 172.21.15.6:0/3859173444 >> v2:172.21.15.171:3300/0 conn(0x7fce10168050 0x7fce1016a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0d59a640 1 -- 172.21.15.6:0/3859173444 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547884354 0 0) 0x7fce100d0630 con 0x7fce1006d3d0 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0d59a640 1 -- 172.21.15.6:0/3859173444 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdf8003520 con 0x7fce1006d3d0 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0d59a640 1 -- 172.21.15.6:0/3859173444 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1992364333 0 0) 0x7fce100d39c0 con 0x7fce10162820 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0d59a640 1 -- 172.21.15.6:0/3859173444 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce100d0630 con 0x7fce10162820 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0ed9d640 1 -- 172.21.15.6:0/3859173444 >> v1:172.21.15.171:6789/0 conn(0x7fce10162820 legacy=0x7fce100b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0d59a640 1 -- 172.21.15.6:0/3859173444 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2508460944 0 0) 0x7fcdf8003520 con 0x7fce1006d3d0 2024-05-20T17:59:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0ed9d640 1 -- 172.21.15.6:0/3859173444 >> v1:172.21.15.6:6789/0 conn(0x7fce1006d3d0 legacy=0x7fce1006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.507+0000 7fce0ed9d640 1 -- 172.21.15.6:0/3859173444 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100d3f80 con 0x7fce10168050 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.508+0000 7fce0ed9d640 1 --2- 172.21.15.6:0/3859173444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 0x7fce1016a470 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fce08009d90 tx=0x7fce0802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b15297da85be30b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.508+0000 7fce0d59a640 1 -- 172.21.15.6:0/3859173444 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04001670 con 0x7fce10168050 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.508+0000 7fce0d59a640 1 -- 172.21.15.6:0/3859173444 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce08007540 con 0x7fce10168050 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.508+0000 7fce0d59a640 1 -- 172.21.15.6:0/3859173444 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce080078f0 con 0x7fce10168050 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.509+0000 7fce14b1d640 1 -- 172.21.15.6:0/3859173444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 msgr2=0x7fce1016a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.509+0000 7fce14b1d640 1 --2- 172.21.15.6:0/3859173444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 0x7fce1016a470 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fce08009d90 tx=0x7fce0802a680 comp rx=0 tx=0).stop 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.509+0000 7fce14b1d640 1 -- 172.21.15.6:0/3859173444 shutdown_connections 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.509+0000 7fce14b1d640 1 --2- 172.21.15.6:0/3859173444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 0x7fce1016a470 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.509+0000 7fce14b1d640 1 -- 172.21.15.6:0/3859173444 >> 172.21.15.6:0/3859173444 conn(0x7fce100d4bd0 msgr2=0x7fce100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.509+0000 7fce14b1d640 1 -- 172.21.15.6:0/3859173444 shutdown_connections 2024-05-20T17:59:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.509+0000 7fce14b1d640 1 -- 172.21.15.6:0/3859173444 wait complete. 2024-05-20T17:59:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.511+0000 7fce14b1d640 1 Processor -- start 2024-05-20T17:59:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.511+0000 7fce14b1d640 1 -- start start 2024-05-20T17:59:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce14b1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce10152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce14b1d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 0x7fce100c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce14b1d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 0x7fce100c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce14b1d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fce100b91a0 con 0x7fce1006d3d0 2024-05-20T17:59:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce14b1d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fce100d0300 con 0x7fce10168050 2024-05-20T17:59:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce14b1d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fce100b4050 con 0x7fce10162820 2024-05-20T17:59:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce10152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce10152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50884/0 (socket says 172.21.15.6:50884) 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 -- 172.21.15.6:0/581750666 learned_addr learned my addr 172.21.15.6:0/581750666 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0dd9b640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 0x7fce100c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0ed9d640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 0x7fce100c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 -- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 msgr2=0x7fce100c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 0x7fce100c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 -- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 msgr2=0x7fce100c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 0x7fce100c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 -- 172.21.15.6:0/581750666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100ce910 con 0x7fce1006d3d0 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.513+0000 7fce0e59c640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce10152b50 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fce0000c460 tx=0x7fce0000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.514+0000 7fcdfeffd640 1 -- 172.21.15.6:0/581750666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce000052d0 con 0x7fce1006d3d0 2024-05-20T17:59:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.514+0000 7fcdfeffd640 1 -- 172.21.15.6:0/581750666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce00005490 con 0x7fce1006d3d0 2024-05-20T17:59:50.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.514+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce100c88a0 con 0x7fce1006d3d0 2024-05-20T17:59:50.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.514+0000 7fcdfeffd640 1 -- 172.21.15.6:0/581750666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00012870 con 0x7fce1006d3d0 2024-05-20T17:59:50.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.514+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce100c8e60 con 0x7fce1006d3d0 2024-05-20T17:59:50.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.515+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce10075b00 con 0x7fce1006d3d0 2024-05-20T17:59:50.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.515+0000 7fcdfeffd640 1 -- 172.21.15.6:0/581750666 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce00012a10 con 0x7fce1006d3d0 2024-05-20T17:59:50.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.516+0000 7fcdfeffd640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf006be60 0x7fcdf006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.516+0000 7fcdfeffd640 1 -- 172.21.15.6:0/581750666 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fce0008ab50 con 0x7fce1006d3d0 2024-05-20T17:59:50.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.516+0000 7fce0dd9b640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf006be60 0x7fcdf006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.517+0000 7fce0dd9b640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf006be60 0x7fcdf006e370 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fce100cd770 tx=0x7fce04001610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.520+0000 7fcdfeffd640 1 -- 172.21.15.6:0/581750666 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fce00058c30 con 0x7fce1006d3d0 2024-05-20T17:59:50.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.703+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fce1015d5e0 con 0x7fce1006d3d0 2024-05-20T17:59:50.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.704+0000 7fcdfeffd640 1 -- 172.21.15.6:0/581750666 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7fce0005cf30 con 0x7fce1006d3d0 2024-05-20T17:59:50.702 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:59:50.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf006be60 msgr2=0x7fcdf006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf006be60 0x7fcdf006e370 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fce100cd770 tx=0x7fce04001610 comp rx=0 tx=0).stop 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 msgr2=0x7fce10152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce10152b50 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fce0000c460 tx=0x7fce0000c920 comp rx=0 tx=0).stop 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 shutdown_connections 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcdf006be60 0x7fcdf006e370 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce10168050 0x7fce100c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce10162820 0x7fce100c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 --2- 172.21.15.6:0/581750666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce1006d3d0 0x7fce10152b50 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 >> 172.21.15.6:0/581750666 conn(0x7fce100d4bd0 msgr2=0x7fce1008d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 shutdown_connections 2024-05-20T17:59:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.706+0000 7fce14b1d640 1 -- 172.21.15.6:0/581750666 wait complete. 2024-05-20T17:59:50.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T17:59:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.833+0000 7f67e0d96640 1 Processor -- start 2024-05-20T17:59:50.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.833+0000 7f67e0d96640 1 -- start start 2024-05-20T17:59:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.834+0000 7f67e0d96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc162820 0x7f67dc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.834+0000 7f67e0d96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67dc06dae0 0x7f67dc0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.834+0000 7f67e0d96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0d0630 con 0x7f67dc0b3e80 2024-05-20T17:59:50.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.834+0000 7f67e0d96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f67dc0d39c0 con 0x7f67dc06dae0 2024-05-20T17:59:50.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.834+0000 7f67e0d96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f67dc0d3ca0 con 0x7f67dc162820 2024-05-20T17:59:50.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.834+0000 7f67dad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67dc06dae0 0x7f67dc0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.834+0000 7f67d9d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f67dc0b3e80 0x7f67dc06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51606/0 (socket says 172.21.15.6:51606) 2024-05-20T17:59:50.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.834+0000 7f67d9d9b640 1 -- 172.21.15.6:0/2050793755 learned_addr learned my addr 172.21.15.6:0/2050793755 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:50.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.835+0000 7f67da59c640 1 --2- 172.21.15.6:0/2050793755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc162820 0x7f67dc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.835+0000 7f67dad9d640 1 -- 172.21.15.6:0/2050793755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc162820 msgr2=0x7f67dc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:50.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.835+0000 7f67dad9d640 1 --2- 172.21.15.6:0/2050793755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc162820 0x7f67dc0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.835+0000 7f67dad9d640 1 -- 172.21.15.6:0/2050793755 >> v1:172.21.15.6:6789/0 conn(0x7f67dc0b3e80 legacy=0x7f67dc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.835+0000 7f67dad9d640 1 -- 172.21.15.6:0/2050793755 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc0d3f80 con 0x7f67dc06dae0 2024-05-20T17:59:50.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.835+0000 7f67dad9d640 1 --2- 172.21.15.6:0/2050793755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc06dae0 0x7f67dc0b8190 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f67d40097a0 tx=0x7f67d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570a53c9f1ddf645 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.835+0000 7f67d959a640 1 -- 172.21.15.6:0/2050793755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d4037070 con 0x7f67dc06dae0 2024-05-20T17:59:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67d959a640 1 -- 172.21.15.6:0/2050793755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d4032440 con 0x7f67dc06dae0 2024-05-20T17:59:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67d959a640 1 -- 172.21.15.6:0/2050793755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d4032810 con 0x7f67dc06dae0 2024-05-20T17:59:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67e0d96640 1 -- 172.21.15.6:0/2050793755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc06dae0 msgr2=0x7f67dc0b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2050793755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc06dae0 0x7f67dc0b8190 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f67d40097a0 tx=0x7f67d402a180 comp rx=0 tx=0).stop 2024-05-20T17:59:50.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67e0d96640 1 -- 172.21.15.6:0/2050793755 shutdown_connections 2024-05-20T17:59:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2050793755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc06dae0 0x7f67dc0b8190 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2050793755 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc162820 0x7f67dc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67e0d96640 1 -- 172.21.15.6:0/2050793755 >> 172.21.15.6:0/2050793755 conn(0x7f67dc0d4bd0 msgr2=0x7f67dc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67e0d96640 1 -- 172.21.15.6:0/2050793755 shutdown_connections 2024-05-20T17:59:50.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.836+0000 7f67e0d96640 1 -- 172.21.15.6:0/2050793755 wait complete. 2024-05-20T17:59:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.838+0000 7f67e0d96640 1 Processor -- start 2024-05-20T17:59:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.838+0000 7f67e0d96640 1 -- start start 2024-05-20T17:59:50.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67e0d96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc0b3e80 0x7f67dc0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67e0d96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc162820 0x7f67dc0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67e0d96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67dc0c9250 0x7f67dc155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67e0d96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc0d4780 con 0x7f67dc162820 2024-05-20T17:59:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67e0d96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f67dc0d0300 con 0x7f67dc0c9250 2024-05-20T17:59:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67e0d96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f67dc0d4900 con 0x7f67dc0b3e80 2024-05-20T17:59:50.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc162820 0x7f67dc0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc162820 0x7f67dc0caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50914/0 (socket says 172.21.15.6:50914) 2024-05-20T17:59:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 -- 172.21.15.6:0/2484371383 learned_addr learned my addr 172.21.15.6:0/2484371383 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67da59c640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc0b3e80 0x7f67dc0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67dad9d640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67dc0c9250 0x7f67dc155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 -- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc0b3e80 msgr2=0x7f67dc0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc0b3e80 0x7f67dc0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 -- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67dc0c9250 msgr2=0x7f67dc155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:50.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67dc0c9250 0x7f67dc155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:50.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 -- 172.21.15.6:0/2484371383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc15ee30 con 0x7f67dc162820 2024-05-20T17:59:50.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67da59c640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc0b3e80 0x7f67dc0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:50.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d9d9b640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc162820 0x7f67dc0caea0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c440 tx=0x7f67c400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.840+0000 7f67d2ffd640 1 -- 172.21.15.6:0/2484371383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4017070 con 0x7f67dc162820 2024-05-20T17:59:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.841+0000 7f67d2ffd640 1 -- 172.21.15.6:0/2484371383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67c4005ce0 con 0x7f67dc162820 2024-05-20T17:59:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.841+0000 7f67d2ffd640 1 -- 172.21.15.6:0/2484371383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c40072f0 con 0x7f67dc162820 2024-05-20T17:59:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.841+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67dc15f110 con 0x7f67dc162820 2024-05-20T17:59:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.841+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67dc15f6d0 con 0x7f67dc162820 2024-05-20T17:59:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.842+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67dc15eba0 con 0x7f67dc162820 2024-05-20T17:59:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.842+0000 7f67d2ffd640 1 -- 172.21.15.6:0/2484371383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67c401a070 con 0x7f67dc162820 2024-05-20T17:59:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.843+0000 7f67d2ffd640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f67bc06be60 0x7f67bc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.843+0000 7f67d2ffd640 1 -- 172.21.15.6:0/2484371383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f67c408a3c0 con 0x7f67dc162820 2024-05-20T17:59:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.843+0000 7f67da59c640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f67bc06be60 0x7f67bc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.844+0000 7f67da59c640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f67bc06be60 0x7f67bc06e370 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f67cc007fc0 tx=0x7f67cc0075b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:50.847+0000 7f67d2ffd640 1 -- 172.21.15.6:0/2484371383 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f67c4058b70 con 0x7f67dc162820 2024-05-20T17:59:51.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.042+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f67dc0d5510 con 0x7f67dc162820 2024-05-20T17:59:51.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.042+0000 7f67d2ffd640 1 -- 172.21.15.6:0/2484371383 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) ==== 80+0+0 (secure 0 0 0) 0x7f67dc0d5510 con 0x7f67dc162820 2024-05-20T17:59:51.041 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f67bc06be60 msgr2=0x7f67bc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f67bc06be60 0x7f67bc06e370 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f67cc007fc0 tx=0x7f67cc0075b0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc162820 msgr2=0x7f67dc0caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc162820 0x7f67dc0caea0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c440 tx=0x7f67c400c900 comp rx=0 tx=0).stop 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 shutdown_connections 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f67bc06be60 0x7f67bc06e370 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67dc0c9250 0x7f67dc155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67dc162820 0x7f67dc0caea0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 --2- 172.21.15.6:0/2484371383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f67dc0b3e80 0x7f67dc0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 >> 172.21.15.6:0/2484371383 conn(0x7f67dc0d4bd0 msgr2=0x7f67dc161120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 shutdown_connections 2024-05-20T17:59:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.044+0000 7f67e0d96640 1 -- 172.21.15.6:0/2484371383 wait complete. 2024-05-20T17:59:51.054 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T17:59:51.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:59:51.054 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T17:59:51.087 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T17:59:51.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T17:59:51.088 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T17:59:51.146 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:59:51.146 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T17:59:51.146 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:59:51.162 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T17:59:51.162 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T17:59:51.162 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T17:59:51.162 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T17:59:51.204 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T17:59:51.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:59:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.320+0000 7f4f2c00d640 1 Processor -- start 2024-05-20T17:59:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.320+0000 7f4f2c00d640 1 -- start start 2024-05-20T17:59:51.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.321+0000 7f4f2c00d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f241576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.321+0000 7f4f2c00d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4f2406c9a0 0x7f4f240ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.321+0000 7f4f2c00d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f240cec00 0x7f4f2406e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.321+0000 7f4f2c00d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2406b900 con 0x7f4f240cec00 2024-05-20T17:59:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.321+0000 7f4f2c00d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2406bbe0 con 0x7f4f2406c9a0 2024-05-20T17:59:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.321+0000 7f4f2c00d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2406bec0 con 0x7f4f2415d5f0 2024-05-20T17:59:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f2a5aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f240cec00 0x7f4f2406e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f2a5aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f240cec00 0x7f4f2406e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50918/0 (socket says 172.21.15.6:50918) 2024-05-20T17:59:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f2a5aa640 1 -- 172.21.15.6:0/3998897381 learned_addr learned my addr 172.21.15.6:0/3998897381 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f295a8640 1 --2- 172.21.15.6:0/3998897381 >> v2:172.21.15.171:3300/0 conn(0x7f4f2406c9a0 0x7f4f240ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f29da9640 1 --2- 172.21.15.6:0/3998897381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f241576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f2a5aa640 1 -- 172.21.15.6:0/3998897381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 msgr2=0x7f4f241576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f2a5aa640 1 --2- 172.21.15.6:0/3998897381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f241576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f2a5aa640 1 -- 172.21.15.6:0/3998897381 >> v2:172.21.15.171:3300/0 conn(0x7f4f2406c9a0 msgr2=0x7f4f240ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f2a5aa640 1 --2- 172.21.15.6:0/3998897381 >> v2:172.21.15.171:3300/0 conn(0x7f4f2406c9a0 0x7f4f240ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f2a5aa640 1 -- 172.21.15.6:0/3998897381 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2406c1a0 con 0x7f4f240cec00 2024-05-20T17:59:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.322+0000 7f4f295a8640 1 --2- 172.21.15.6:0/3998897381 >> v2:172.21.15.171:3300/0 conn(0x7f4f2406c9a0 0x7f4f240ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.323+0000 7f4f2a5aa640 1 --2- 172.21.15.6:0/3998897381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f2406e3a0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4f2406bdf0 tx=0x7f4f1c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0c9c98edc7f0ba server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.323+0000 7f4f28da7640 1 -- 172.21.15.6:0/3998897381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c036070 con 0x7f4f240cec00 2024-05-20T17:59:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.323+0000 7f4f28da7640 1 -- 172.21.15.6:0/3998897381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1c031600 con 0x7f4f240cec00 2024-05-20T17:59:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.323+0000 7f4f28da7640 1 -- 172.21.15.6:0/3998897381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0319d0 con 0x7f4f240cec00 2024-05-20T17:59:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 -- 172.21.15.6:0/3998897381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 msgr2=0x7f4f2406e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/3998897381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f2406e3a0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4f2406bdf0 tx=0x7f4f1c02a5f0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 -- 172.21.15.6:0/3998897381 shutdown_connections 2024-05-20T17:59:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/3998897381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f2406e3a0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/3998897381 >> v2:172.21.15.171:3300/0 conn(0x7f4f2406c9a0 0x7f4f240ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/3998897381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f241576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 -- 172.21.15.6:0/3998897381 >> 172.21.15.6:0/3998897381 conn(0x7f4f240cd2a0 msgr2=0x7f4f240cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 -- 172.21.15.6:0/3998897381 shutdown_connections 2024-05-20T17:59:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.324+0000 7f4f2c00d640 1 -- 172.21.15.6:0/3998897381 wait complete. 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.326+0000 7f4f2c00d640 1 Processor -- start 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.326+0000 7f4f2c00d640 1 -- start start 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f2c00d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f2406c9a0 0x7f4f2414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f2c00d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f240b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f2c00d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f24150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f2c00d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2406b520 con 0x7f4f240cec00 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f2c00d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2406cdb0 con 0x7f4f2406c9a0 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f2c00d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2406b6a0 con 0x7f4f2415d5f0 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f295a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f240b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f295a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f240b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50928/0 (socket says 172.21.15.6:50928) 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f295a8640 1 -- 172.21.15.6:0/91174296 learned_addr learned my addr 172.21.15.6:0/91174296 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f29da9640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f2406c9a0 0x7f4f2414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f2a5aa640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f24150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f295a8640 1 -- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 msgr2=0x7f4f24150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f295a8640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f24150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f295a8640 1 -- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f2406c9a0 msgr2=0x7f4f2414ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f295a8640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f2406c9a0 0x7f4f2414ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f295a8640 1 -- 172.21.15.6:0/91174296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f240b3e90 con 0x7f4f240cec00 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.327+0000 7f4f2a5aa640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f24150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.328+0000 7f4f295a8640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f240b3950 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400d800 tx=0x7f4f1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.328+0000 7f4f1a7fc640 1 -- 172.21.15.6:0/91174296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14018030 con 0x7f4f240cec00 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.328+0000 7f4f1a7fc640 1 -- 172.21.15.6:0/91174296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f140096a0 con 0x7f4f240cec00 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.328+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f241f57b0 con 0x7f4f240cec00 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.328+0000 7f4f1a7fc640 1 -- 172.21.15.6:0/91174296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14009870 con 0x7f4f240cec00 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.328+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f240b4680 con 0x7f4f240cec00 2024-05-20T17:59:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.329+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f240b4110 con 0x7f4f240cec00 2024-05-20T17:59:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.329+0000 7f4f1a7fc640 1 -- 172.21.15.6:0/91174296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f1401b070 con 0x7f4f240cec00 2024-05-20T17:59:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.330+0000 7f4f1a7fc640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f0806be60 0x7f4f0806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.330+0000 7f4f1a7fc640 1 -- 172.21.15.6:0/91174296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f4f1408b1b0 con 0x7f4f240cec00 2024-05-20T17:59:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.330+0000 7f4f29da9640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f0806be60 0x7f4f0806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.331+0000 7f4f29da9640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f0806be60 0x7f4f0806e370 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4f240b0490 tx=0x7f4f20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.334+0000 7f4f1a7fc640 1 -- 172.21.15.6:0/91174296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4f14059950 con 0x7f4f240cec00 2024-05-20T17:59:51.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.558+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f24075b00 con 0x7f4f240cec00 2024-05-20T17:59:51.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.559+0000 7f4f1a7fc640 1 -- 172.21.15.6:0/91174296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5184 (secure 0 0 0) 0x7f4f14059250 con 0x7f4f240cec00 2024-05-20T17:59:51.557 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:51.557 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/4216834090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":4216834090},{"type":"v1","addr":"172.21.15.171:6836","nonce":4216834090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1870629940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1870629940},{"type":"v1","addr":"172.21.15.171:6837","nonce":1870629940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3012084004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3012084004},{"type":"v1","addr":"172.21.15.6:6833","nonce":3012084004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:57:19.873838+0000","modified":"2024-05-20T17:58:40.546536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7074":{"gid":7074,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":23,"addr":"172.21.15.6:6835/3379618192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3379618192},{"type":"v1","addr":"172.21.15.6:6835","nonce":3379618192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7074,"qdb_cluster":[7074]},"id":6}]} 2024-05-20T17:59:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 56 2024-05-20T17:59:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f0806be60 msgr2=0x7f4f0806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f0806be60 0x7f4f0806e370 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4f240b0490 tx=0x7f4f20008040 comp rx=0 tx=0).stop 2024-05-20T17:59:51.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 msgr2=0x7f4f240b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f240b3950 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400d800 tx=0x7f4f1400dcc0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 shutdown_connections 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f0806be60 0x7f4f0806e370 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f2415d5f0 0x7f4f24150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240cec00 0x7f4f240b3950 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 --2- 172.21.15.6:0/91174296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f2406c9a0 0x7f4f2414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 >> 172.21.15.6:0/91174296 conn(0x7f4f240cd2a0 msgr2=0x7f4f2406e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 shutdown_connections 2024-05-20T17:59:51.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.561+0000 7f4f2c00d640 1 -- 172.21.15.6:0/91174296 wait complete. 2024-05-20T17:59:51.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:59:51.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.687+0000 7f0c474c3640 1 Processor -- start 2024-05-20T17:59:51.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.687+0000 7f0c474c3640 1 -- start start 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c474c3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0c4006d3d0 0x7f0c4006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c474c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c400b8190 0x7f0c400b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c474c3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4006dd20 con 0x7f0c40162820 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c474c3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0c400d0630 con 0x7f0c4006d3d0 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c474c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0c400d39c0 con 0x7f0c400b8190 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c4525f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c40162820 0x7f0c400b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51622/0 (socket says 172.21.15.6:51622) 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c4525f640 1 -- 172.21.15.6:0/66475717 learned_addr learned my addr 172.21.15.6:0/66475717 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c44a5e640 1 --2- 172.21.15.6:0/66475717 >> v2:172.21.15.171:3300/0 conn(0x7f0c4006d3d0 0x7f0c4006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c45a60640 1 --2- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c400b8190 0x7f0c400b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c3ffff640 1 -- 172.21.15.6:0/66475717 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2251663184 0 0) 0x7f0c30001490 con 0x7f0c40162820 2024-05-20T17:59:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.689+0000 7f0c3ffff640 1 -- 172.21.15.6:0/66475717 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c28003520 con 0x7f0c40162820 2024-05-20T17:59:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.690+0000 7f0c44a5e640 1 -- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c400b8190 msgr2=0x7f0c400b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.690+0000 7f0c44a5e640 1 --2- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c400b8190 0x7f0c400b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.690+0000 7f0c44a5e640 1 -- 172.21.15.6:0/66475717 >> v1:172.21.15.6:6789/0 conn(0x7f0c40162820 legacy=0x7f0c400b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.690+0000 7f0c44a5e640 1 -- 172.21.15.6:0/66475717 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c400d3ca0 con 0x7f0c4006d3d0 2024-05-20T17:59:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.690+0000 7f0c45a60640 1 --2- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c400b8190 0x7f0c400b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.690+0000 7f0c44a5e640 1 --2- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c4006d3d0 0x7f0c4006d7e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0c340097a0 tx=0x7f0c3402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d52fdc7d1ef871 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.690+0000 7f0c3ffff640 1 -- 172.21.15.6:0/66475717 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34037070 con 0x7f0c4006d3d0 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c3ffff640 1 -- 172.21.15.6:0/66475717 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c34032440 con 0x7f0c4006d3d0 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c3ffff640 1 -- 172.21.15.6:0/66475717 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c340327f0 con 0x7f0c4006d3d0 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c474c3640 1 -- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c4006d3d0 msgr2=0x7f0c4006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c474c3640 1 --2- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c4006d3d0 0x7f0c4006d7e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0c340097a0 tx=0x7f0c3402a180 comp rx=0 tx=0).stop 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c474c3640 1 -- 172.21.15.6:0/66475717 shutdown_connections 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c474c3640 1 --2- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c400b8190 0x7f0c400b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c474c3640 1 --2- 172.21.15.6:0/66475717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c4006d3d0 0x7f0c4006d7e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c474c3640 1 -- 172.21.15.6:0/66475717 >> 172.21.15.6:0/66475717 conn(0x7f0c400d4bd0 msgr2=0x7f0c400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c474c3640 1 -- 172.21.15.6:0/66475717 shutdown_connections 2024-05-20T17:59:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.691+0000 7f0c474c3640 1 -- 172.21.15.6:0/66475717 wait complete. 2024-05-20T17:59:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.693+0000 7f0c474c3640 1 Processor -- start 2024-05-20T17:59:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.693+0000 7f0c474c3640 1 -- start start 2024-05-20T17:59:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.694+0000 7f0c474c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c4006d3d0 0x7f0c401e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.694+0000 7f0c474c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c400b8190 0x7f0c4014c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.694+0000 7f0c474c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40162820 0x7f0c400c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.694+0000 7f0c474c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0c400d0300 con 0x7f0c40162820 2024-05-20T17:59:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.694+0000 7f0c474c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0c400d4260 con 0x7f0c400b8190 2024-05-20T17:59:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.694+0000 7f0c474c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0c400b4050 con 0x7f0c4006d3d0 2024-05-20T17:59:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40162820 0x7f0c400c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40162820 0x7f0c400c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50938/0 (socket says 172.21.15.6:50938) 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 -- 172.21.15.6:0/2816596806 learned_addr learned my addr 172.21.15.6:0/2816596806 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c44a5e640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c400b8190 0x7f0c4014c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c4525f640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c4006d3d0 0x7f0c401e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 -- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c4006d3d0 msgr2=0x7f0c401e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c4006d3d0 0x7f0c401e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 -- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c400b8190 msgr2=0x7f0c4014c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c400b8190 0x7f0c4014c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 -- 172.21.15.6:0/2816596806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c400cbd20 con 0x7f0c40162820 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c44a5e640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c400b8190 0x7f0c4014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c4525f640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c4006d3d0 0x7f0c401e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c45a60640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40162820 0x7f0c400c6e70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800e860 tx=0x7f0c3800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c3dffb640 1 -- 172.21.15.6:0/2816596806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38017070 con 0x7f0c40162820 2024-05-20T17:59:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c3dffb640 1 -- 172.21.15.6:0/2816596806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3800c940 con 0x7f0c40162820 2024-05-20T17:59:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c400cc000 con 0x7f0c40162820 2024-05-20T17:59:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.695+0000 7f0c3dffb640 1 -- 172.21.15.6:0/2816596806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800cd10 con 0x7f0c40162820 2024-05-20T17:59:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.696+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c400cf3a0 con 0x7f0c40162820 2024-05-20T17:59:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.696+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c400cf110 con 0x7f0c40162820 2024-05-20T17:59:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.697+0000 7f0c3dffb640 1 -- 172.21.15.6:0/2816596806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c3801a070 con 0x7f0c40162820 2024-05-20T17:59:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.697+0000 7f0c3dffb640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c2c06be30 0x7f0c2c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.698+0000 7f0c3dffb640 1 -- 172.21.15.6:0/2816596806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f0c3808b2b0 con 0x7f0c40162820 2024-05-20T17:59:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.698+0000 7f0c4525f640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c2c06be30 0x7f0c2c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.698+0000 7f0c4525f640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c2c06be30 0x7f0c2c06e340 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0c30001630 tx=0x7f0c30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.702+0000 7f0c3dffb640 1 -- 172.21.15.6:0/2816596806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0c38059a70 con 0x7f0c40162820 2024-05-20T17:59:51.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.889+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c40075b00 con 0x7f0c40162820 2024-05-20T17:59:51.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.890+0000 7f0c3dffb640 1 -- 172.21.15.6:0/2816596806 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17030 (secure 0 0 0) 0x7f0c38059370 con 0x7f0c40162820 2024-05-20T17:59:51.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:51.889 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":89,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:48.988398+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:57:17.597397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-20T17:57:18.862392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":5}]},{"pgid":"14.24","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c2c06be30 msgr2=0x7f0c2c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c2c06be30 0x7f0c2c06e340 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f0c30001630 tx=0x7f0c30009040 comp rx=0 tx=0).stop 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40162820 msgr2=0x7f0c400c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40162820 0x7f0c400c6e70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800e860 tx=0x7f0c3800ed20 comp rx=0 tx=0).stop 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 shutdown_connections 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c2c06be30 0x7f0c2c06e340 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c40162820 0x7f0c400c6e70 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c400b8190 0x7f0c4014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 --2- 172.21.15.6:0/2816596806 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0c4006d3d0 0x7f0c401e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 >> 172.21.15.6:0/2816596806 conn(0x7f0c400d4bd0 msgr2=0x7f0c4015ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 shutdown_connections 2024-05-20T17:59:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:51.892+0000 7f0c474c3640 1 -- 172.21.15.6:0/2816596806 wait complete. 2024-05-20T17:59:51.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T17:57:17.597397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T17:57:18.862392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T17:59:51.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T17:59:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.022+0000 7f9ff192c640 1 Processor -- start 2024-05-20T17:59:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.022+0000 7f9ff192c640 1 -- start start 2024-05-20T17:59:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.023+0000 7f9ff192c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9fec161350 0x7f9fec161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.023+0000 7f9ff192c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fec160b90 con 0x7f9fec0d1830 2024-05-20T17:59:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.023+0000 7f9ff192c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fec15de60 con 0x7f9fec06b520 2024-05-20T17:59:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.023+0000 7f9ff192c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9fec15e140 con 0x7f9fec161350 2024-05-20T17:59:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.023+0000 7f9fe3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9fec161350 0x7f9fec161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.024+0000 7f9feb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9fec0d1830 0x7f9fec0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51628/0 (socket says 172.21.15.6:51628) 2024-05-20T17:59:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.024+0000 7f9feb7fe640 1 -- 172.21.15.6:0/101825780 learned_addr learned my addr 172.21.15.6:0/101825780 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.024+0000 7f9fe3fff640 1 -- 172.21.15.6:0/101825780 >> v1:172.21.15.171:6789/0 conn(0x7f9fec06b520 legacy=0x7f9fec15d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.024+0000 7f9fe3fff640 1 -- 172.21.15.6:0/101825780 >> v1:172.21.15.6:6789/0 conn(0x7f9fec0d1830 legacy=0x7f9fec0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.024+0000 7f9fe3fff640 1 -- 172.21.15.6:0/101825780 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec15e420 con 0x7f9fec161350 2024-05-20T17:59:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.024+0000 7f9fea7fc640 1 -- 172.21.15.6:0/101825780 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063455384 0 0) 0x7f9fec160b90 con 0x7f9fec0d1830 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.025+0000 7f9fe3fff640 1 --2- 172.21.15.6:0/101825780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec161760 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40097a0 tx=0x7f9fd402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc550aa5f53f24b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.025+0000 7f9fea7fc640 1 -- 172.21.15.6:0/101825780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4037070 con 0x7f9fec161350 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.025+0000 7f9fea7fc640 1 -- 172.21.15.6:0/101825780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd4032440 con 0x7f9fec161350 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.025+0000 7f9fea7fc640 1 -- 172.21.15.6:0/101825780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4032810 con 0x7f9fec161350 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.025+0000 7f9ff192c640 1 -- 172.21.15.6:0/101825780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 msgr2=0x7f9fec161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.025+0000 7f9ff192c640 1 --2- 172.21.15.6:0/101825780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec161760 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40097a0 tx=0x7f9fd402a230 comp rx=0 tx=0).stop 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.026+0000 7f9ff192c640 1 -- 172.21.15.6:0/101825780 shutdown_connections 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.026+0000 7f9ff192c640 1 --2- 172.21.15.6:0/101825780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec161760 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.026+0000 7f9ff192c640 1 -- 172.21.15.6:0/101825780 >> 172.21.15.6:0/101825780 conn(0x7f9fec0b6670 msgr2=0x7f9fec0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.026+0000 7f9ff192c640 1 -- 172.21.15.6:0/101825780 shutdown_connections 2024-05-20T17:59:52.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.026+0000 7f9ff192c640 1 -- 172.21.15.6:0/101825780 wait complete. 2024-05-20T17:59:52.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.027+0000 7f9ff192c640 1 Processor -- start 2024-05-20T17:59:52.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.027+0000 7f9ff192c640 1 -- start start 2024-05-20T17:59:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9ff192c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fec06b520 0x7f9fec1e7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9ff192c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fec0d1830 0x7f9fec157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9ff192c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec13e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9ff192c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec15e970 con 0x7f9fec161350 2024-05-20T17:59:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9ff192c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec143740 con 0x7f9fec06b520 2024-05-20T17:59:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9ff192c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9fec15eaf0 con 0x7f9fec0d1830 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec13e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec13e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50948/0 (socket says 172.21.15.6:50948) 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 -- 172.21.15.6:0/1034639128 learned_addr learned my addr 172.21.15.6:0/1034639128 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feaffd640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fec06b520 0x7f9fec1e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9fe3fff640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fec0d1830 0x7f9fec157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 -- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fec0d1830 msgr2=0x7f9fec157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fec0d1830 0x7f9fec157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 -- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fec06b520 msgr2=0x7f9fec1e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fec06b520 0x7f9fec1e7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 -- 172.21.15.6:0/1034639128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec1e7a00 con 0x7f9fec161350 2024-05-20T17:59:52.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9fe3fff640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fec0d1830 0x7f9fec157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:52.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9feb7fe640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec13e350 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400caf0 tx=0x7f9fe4002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9fe8ff9640 1 -- 172.21.15.6:0/1034639128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400abd0 con 0x7f9fec161350 2024-05-20T17:59:52.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9fe8ff9640 1 -- 172.21.15.6:0/1034639128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe400ad70 con 0x7f9fec161350 2024-05-20T17:59:52.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fec1e7ce0 con 0x7f9fec161350 2024-05-20T17:59:52.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.029+0000 7f9fe8ff9640 1 -- 172.21.15.6:0/1034639128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4012640 con 0x7f9fec161350 2024-05-20T17:59:52.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.030+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fec0b30f0 con 0x7f9fec161350 2024-05-20T17:59:52.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.031+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fec1e7770 con 0x7f9fec161350 2024-05-20T17:59:52.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.031+0000 7f9fe8ff9640 1 -- 172.21.15.6:0/1034639128 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9fe40127e0 con 0x7f9fec161350 2024-05-20T17:59:52.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.031+0000 7f9fe8ff9640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fcc06be30 0x7f9fcc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.032+0000 7f9fe8ff9640 1 -- 172.21.15.6:0/1034639128 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f9fe408b590 con 0x7f9fec161350 2024-05-20T17:59:52.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.032+0000 7f9feaffd640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fcc06be30 0x7f9fcc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.032+0000 7f9feaffd640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fcc06be30 0x7f9fcc06e340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc000f60 tx=0x7f9fdc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.036+0000 7f9fe8ff9640 1 -- 172.21.15.6:0/1034639128 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9fe4059dd0 con 0x7f9fec161350 2024-05-20T17:59:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.219+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9fec0b3350 con 0x7f9fec161350 2024-05-20T17:59:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.220+0000 7f9fe8ff9640 1 -- 172.21.15.6:0/1034639128 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f9fe40596d0 con 0x7f9fec161350 2024-05-20T17:59:52.218 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T17:59:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fcc06be30 msgr2=0x7f9fcc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fcc06be30 0x7f9fcc06e340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc000f60 tx=0x7f9fdc009040 comp rx=0 tx=0).stop 2024-05-20T17:59:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 msgr2=0x7f9fec13e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec13e350 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400caf0 tx=0x7f9fe4002190 comp rx=0 tx=0).stop 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 shutdown_connections 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9fcc06be30 0x7f9fcc06e340 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fec161350 0x7f9fec13e350 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9fec0d1830 0x7f9fec157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 --2- 172.21.15.6:0/1034639128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9fec06b520 0x7f9fec1e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 >> 172.21.15.6:0/1034639128 conn(0x7f9fec0b6670 msgr2=0x7f9fec067490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 shutdown_connections 2024-05-20T17:59:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.222+0000 7f9ff192c640 1 -- 172.21.15.6:0/1034639128 wait complete. 2024-05-20T17:59:52.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T17:59:52.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.351+0000 7f7757c06640 1 Processor -- start 2024-05-20T17:59:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.351+0000 7f7757c06640 1 -- start start 2024-05-20T17:59:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f7757c06640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77500af030 0x7f77500af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f7757c06640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77500af980 con 0x7f775015f700 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f7757c06640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750160430 con 0x7f775006c180 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f7757c06640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f775006bcf0 con 0x7f77500af030 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f77559a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77500af030 0x7f77500af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f77551a1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f775015f700 0x7f775015fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51638/0 (socket says 172.21.15.6:51638) 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f77551a1640 1 -- 172.21.15.6:0/1713937265 learned_addr learned my addr 172.21.15.6:0/1713937265 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f77559a2640 1 -- 172.21.15.6:0/1713937265 >> v1:172.21.15.171:6789/0 conn(0x7f775006c180 legacy=0x7f775006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f77559a2640 1 -- 172.21.15.6:0/1713937265 >> v1:172.21.15.6:6789/0 conn(0x7f775015f700 legacy=0x7f775015fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f77559a2640 1 -- 172.21.15.6:0/1713937265 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775006b6a0 con 0x7f77500af030 2024-05-20T17:59:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.353+0000 7f77549a0640 1 -- 172.21.15.6:0/1713937265 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955502957 0 0) 0x7f774c001110 con 0x7f775015f700 2024-05-20T17:59:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.354+0000 7f77559a2640 1 --2- 172.21.15.6:0/1713937265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77500af030 0x7f77500af440 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f77440097a0 tx=0x7f774402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6614cdc8278dc19 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.354+0000 7f77549a0640 1 -- 172.21.15.6:0/1713937265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744037070 con 0x7f77500af030 2024-05-20T17:59:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.354+0000 7f77549a0640 1 -- 172.21.15.6:0/1713937265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744032440 con 0x7f77500af030 2024-05-20T17:59:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.354+0000 7f77549a0640 1 -- 172.21.15.6:0/1713937265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744032810 con 0x7f77500af030 2024-05-20T17:59:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.355+0000 7f7757c06640 1 -- 172.21.15.6:0/1713937265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77500af030 msgr2=0x7f77500af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.355+0000 7f7757c06640 1 --2- 172.21.15.6:0/1713937265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77500af030 0x7f77500af440 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f77440097a0 tx=0x7f774402a1e0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.355+0000 7f7757c06640 1 -- 172.21.15.6:0/1713937265 shutdown_connections 2024-05-20T17:59:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.355+0000 7f7757c06640 1 --2- 172.21.15.6:0/1713937265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77500af030 0x7f77500af440 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.355+0000 7f7757c06640 1 -- 172.21.15.6:0/1713937265 >> 172.21.15.6:0/1713937265 conn(0x7f77500b6620 msgr2=0x7f77500b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.355+0000 7f7757c06640 1 -- 172.21.15.6:0/1713937265 shutdown_connections 2024-05-20T17:59:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.355+0000 7f7757c06640 1 -- 172.21.15.6:0/1713937265 wait complete. 2024-05-20T17:59:52.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.357+0000 7f7757c06640 1 Processor -- start 2024-05-20T17:59:52.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.357+0000 7f7757c06640 1 -- start start 2024-05-20T17:59:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f7757c06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f775006c180 0x7f775015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f7757c06640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77500af030 0x7f775009dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f7757c06640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f775015f700 0x7f775009bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f7757c06640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f775006cca0 con 0x7f775006c180 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f7757c06640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7750159aa0 con 0x7f775015f700 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f7757c06640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f775006ce20 con 0x7f77500af030 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77559a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f775006c180 0x7f775015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77559a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f775006c180 0x7f775015c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50966/0 (socket says 172.21.15.6:50966) 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77559a2640 1 -- 172.21.15.6:0/114164082 learned_addr learned my addr 172.21.15.6:0/114164082 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77561a3640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f775015f700 0x7f775009bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77551a1640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77500af030 0x7f775009dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77559a2640 1 -- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77500af030 msgr2=0x7f775009dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77559a2640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77500af030 0x7f775009dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77559a2640 1 -- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f775015f700 msgr2=0x7f775009bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77559a2640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f775015f700 0x7f775009bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.358+0000 7f77559a2640 1 -- 172.21.15.6:0/114164082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775015c650 con 0x7f775006c180 2024-05-20T17:59:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.359+0000 7f77559a2640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f775006c180 0x7f775015c110 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f77440098c0 tx=0x7f77440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.359+0000 7f77427fc640 1 -- 172.21.15.6:0/114164082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744041070 con 0x7f775006c180 2024-05-20T17:59:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.359+0000 7f77427fc640 1 -- 172.21.15.6:0/114164082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774403c870 con 0x7f775006c180 2024-05-20T17:59:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.359+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775009e6d0 con 0x7f775006c180 2024-05-20T17:59:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.359+0000 7f77427fc640 1 -- 172.21.15.6:0/114164082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744037040 con 0x7f775006c180 2024-05-20T17:59:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.359+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775009ec90 con 0x7f775006c180 2024-05-20T17:59:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.360+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7750075b00 con 0x7f775006c180 2024-05-20T17:59:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.361+0000 7f77427fc640 1 -- 172.21.15.6:0/114164082 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7744044070 con 0x7f775006c180 2024-05-20T17:59:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.361+0000 7f77427fc640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f773406be60 0x7f773406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.361+0000 7f77427fc640 1 -- 172.21.15.6:0/114164082 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f77440aba30 con 0x7f775006c180 2024-05-20T17:59:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.361+0000 7f77551a1640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f773406be60 0x7f773406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.362+0000 7f77551a1640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f773406be60 0x7f773406e370 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7750159080 tx=0x7f774c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.366+0000 7f77427fc640 1 -- 172.21.15.6:0/114164082 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f774407a0b0 con 0x7f775006c180 2024-05-20T17:59:52.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.550+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f77500d1630 con 0x7f775006c180 2024-05-20T17:59:52.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.551+0000 7f77427fc640 1 -- 172.21.15.6:0/114164082 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f77440799b0 con 0x7f775006c180 2024-05-20T17:59:52.549 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T17:59:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f773406be60 msgr2=0x7f773406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f773406be60 0x7f773406e370 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7750159080 tx=0x7f774c009040 comp rx=0 tx=0).stop 2024-05-20T17:59:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f775006c180 msgr2=0x7f775015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f775006c180 0x7f775015c110 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f77440098c0 tx=0x7f77440046c0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 shutdown_connections 2024-05-20T17:59:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f773406be60 0x7f773406e370 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f775015f700 0x7f775009bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77500af030 0x7f775009dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 --2- 172.21.15.6:0/114164082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f775006c180 0x7f775015c110 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 >> 172.21.15.6:0/114164082 conn(0x7f77500b6620 msgr2=0x7f7750070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 shutdown_connections 2024-05-20T17:59:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.553+0000 7f7757c06640 1 -- 172.21.15.6:0/114164082 wait complete. 2024-05-20T17:59:52.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T17:59:52.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.682+0000 7fa0bc292640 1 Processor -- start 2024-05-20T17:59:52.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.682+0000 7fa0bc292640 1 -- start start 2024-05-20T17:59:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0bc292640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 0x7fa0b40af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0bc292640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa0b415f700 0x7fa0b415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0bc292640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0b409a4f0 0x7fa0b409a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0bc292640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b406bcf0 con 0x7fa0b409a4f0 2024-05-20T17:59:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0bc292640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b40af980 con 0x7fa0b415f700 2024-05-20T17:59:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0bc292640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b4160430 con 0x7fa0b40af030 2024-05-20T17:59:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba82f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0b409a4f0 0x7fa0b409a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba82f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0b409a4f0 0x7fa0b409a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50978/0 (socket says 172.21.15.6:50978) 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba82f640 1 -- 172.21.15.6:0/2841625668 learned_addr learned my addr 172.21.15.6:0/2841625668 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0b982d640 1 --2- 172.21.15.6:0/2841625668 >> v2:172.21.15.171:3300/0 conn(0x7fa0b415f700 0x7fa0b415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba02e640 1 --2- 172.21.15.6:0/2841625668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 0x7fa0b40af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba82f640 1 -- 172.21.15.6:0/2841625668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 msgr2=0x7fa0b40af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba82f640 1 --2- 172.21.15.6:0/2841625668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 0x7fa0b40af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba82f640 1 -- 172.21.15.6:0/2841625668 >> v2:172.21.15.171:3300/0 conn(0x7fa0b415f700 msgr2=0x7fa0b415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba82f640 1 --2- 172.21.15.6:0/2841625668 >> v2:172.21.15.171:3300/0 conn(0x7fa0b415f700 0x7fa0b415fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba82f640 1 -- 172.21.15.6:0/2841625668 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b406b6a0 con 0x7fa0b409a4f0 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0b982d640 1 --2- 172.21.15.6:0/2841625668 >> v2:172.21.15.171:3300/0 conn(0x7fa0b415f700 0x7fa0b415fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:52.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.684+0000 7fa0ba02e640 1 --2- 172.21.15.6:0/2841625668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 0x7fa0b40af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:52.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.685+0000 7fa0ba82f640 1 --2- 172.21.15.6:0/2841625668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b409a4f0 0x7fa0b409a900 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa0b406f340 tx=0x7fa0ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b32a8c909056bb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.685+0000 7fa0b902c640 1 -- 172.21.15.6:0/2841625668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac037070 con 0x7fa0b409a4f0 2024-05-20T17:59:52.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.685+0000 7fa0b902c640 1 -- 172.21.15.6:0/2841625668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ac032440 con 0x7fa0b409a4f0 2024-05-20T17:59:52.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.685+0000 7fa0b902c640 1 -- 172.21.15.6:0/2841625668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac032810 con 0x7fa0b409a4f0 2024-05-20T17:59:52.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 -- 172.21.15.6:0/2841625668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b409a4f0 msgr2=0x7fa0b409a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 --2- 172.21.15.6:0/2841625668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b409a4f0 0x7fa0b409a900 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa0b406f340 tx=0x7fa0ac02a1e0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 -- 172.21.15.6:0/2841625668 shutdown_connections 2024-05-20T17:59:52.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 --2- 172.21.15.6:0/2841625668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b409a4f0 0x7fa0b409a900 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 --2- 172.21.15.6:0/2841625668 >> v2:172.21.15.171:3300/0 conn(0x7fa0b415f700 0x7fa0b415fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 --2- 172.21.15.6:0/2841625668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 0x7fa0b40af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 -- 172.21.15.6:0/2841625668 >> 172.21.15.6:0/2841625668 conn(0x7fa0b40b6620 msgr2=0x7fa0b40b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:52.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 -- 172.21.15.6:0/2841625668 shutdown_connections 2024-05-20T17:59:52.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.686+0000 7fa0bc292640 1 -- 172.21.15.6:0/2841625668 wait complete. 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.688+0000 7fa0bc292640 1 Processor -- start 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.688+0000 7fa0bc292640 1 -- start start 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0bc292640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b409a4f0 0x7fa0b4157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0bc292640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 0x7fa0b409e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0bc292640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b415f700 0x7fa0b409ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0bc292640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4160050 con 0x7fa0b415f700 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0bc292640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4159aa0 con 0x7fa0b409a4f0 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0bc292640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b41601d0 con 0x7fa0b40af030 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0ba82f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b415f700 0x7fa0b409ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0ba82f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b415f700 0x7fa0b409ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50994/0 (socket says 172.21.15.6:50994) 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.689+0000 7fa0ba82f640 1 -- 172.21.15.6:0/1869949946 learned_addr learned my addr 172.21.15.6:0/1869949946 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0ba82f640 1 -- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 msgr2=0x7fa0b409e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0ba82f640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 0x7fa0b409e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0ba82f640 1 -- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b409a4f0 msgr2=0x7fa0b4157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0ba82f640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b409a4f0 0x7fa0b4157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0ba82f640 1 -- 172.21.15.6:0/1869949946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b409c450 con 0x7fa0b415f700 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0ba82f640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b415f700 0x7fa0b409ee60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac02a220 tx=0x7fa0ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0aaffd640 1 -- 172.21.15.6:0/1869949946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac037040 con 0x7fa0b415f700 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0aaffd640 1 -- 172.21.15.6:0/1869949946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ac042070 con 0x7fa0b415f700 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b4158740 con 0x7fa0b415f700 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0aaffd640 1 -- 172.21.15.6:0/1869949946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac030920 con 0x7fa0b415f700 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.690+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b409e120 con 0x7fa0b415f700 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.691+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b41584b0 con 0x7fa0b415f700 2024-05-20T17:59:52.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.692+0000 7fa0aaffd640 1 -- 172.21.15.6:0/1869949946 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0ac030ac0 con 0x7fa0b415f700 2024-05-20T17:59:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.692+0000 7fa0aaffd640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa09806be60 0x7fa09806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.692+0000 7fa0aaffd640 1 -- 172.21.15.6:0/1869949946 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fa0ac0abad0 con 0x7fa0b415f700 2024-05-20T17:59:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.693+0000 7fa0ba02e640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa09806be60 0x7fa09806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.693+0000 7fa0ba02e640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa09806be60 0x7fa09806e370 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa0b406e1f0 tx=0x7fa0b00094c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:52.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.697+0000 7fa0aaffd640 1 -- 172.21.15.6:0/1869949946 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa0ac079ba0 con 0x7fa0b415f700 2024-05-20T17:59:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.878+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa0b4075b00 con 0x7fa0b415f700 2024-05-20T17:59:52.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.879+0000 7fa0aaffd640 1 -- 172.21.15.6:0/1869949946 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7fa0ac07dea0 con 0x7fa0b415f700 2024-05-20T17:59:52.878 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T17:59:52.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa09806be60 msgr2=0x7fa09806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa09806be60 0x7fa09806e370 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa0b406e1f0 tx=0x7fa0b00094c0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b415f700 msgr2=0x7fa0b409ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b415f700 0x7fa0b409ee60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac02a220 tx=0x7fa0ac0046c0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 shutdown_connections 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa09806be60 0x7fa09806e370 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0b415f700 0x7fa0b409ee60 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0b40af030 0x7fa0b409e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 --2- 172.21.15.6:0/1869949946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0b409a4f0 0x7fa0b4157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 >> 172.21.15.6:0/1869949946 conn(0x7fa0b40b6620 msgr2=0x7fa0b406f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 shutdown_connections 2024-05-20T17:59:52.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:52.881+0000 7fa0bc292640 1 -- 172.21.15.6:0/1869949946 wait complete. 2024-05-20T17:59:52.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:59:53.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.007+0000 7f98edd8b640 1 Processor -- start 2024-05-20T17:59:53.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.008+0000 7f98edd8b640 1 -- start start 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98edd8b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98e806d3d0 0x7f98e806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98edd8b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e80b8190 0x7f98e80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98edd8b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e806dd20 con 0x7f98e8162820 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98edd8b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f98e80d0630 con 0x7f98e806d3d0 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98edd8b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f98e80d39c0 con 0x7f98e80b8190 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e6ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98e806d3d0 0x7f98e806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f98e8162820 0x7f98e80b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51652/0 (socket says 172.21.15.6:51652) 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e77fe640 1 -- 172.21.15.6:0/1327049171 learned_addr learned my addr 172.21.15.6:0/1327049171 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e7fff640 1 --2- 172.21.15.6:0/1327049171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e80b8190 0x7f98e80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e6ffd640 1 -- 172.21.15.6:0/1327049171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e80b8190 msgr2=0x7f98e80b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e6ffd640 1 --2- 172.21.15.6:0/1327049171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e80b8190 0x7f98e80b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e6ffd640 1 -- 172.21.15.6:0/1327049171 >> v1:172.21.15.6:6789/0 conn(0x7f98e8162820 legacy=0x7f98e80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e6ffd640 1 -- 172.21.15.6:0/1327049171 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e80d3ca0 con 0x7f98e806d3d0 2024-05-20T17:59:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e67fc640 1 -- 172.21.15.6:0/1327049171 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256231135 0 0) 0x7f98d8001110 con 0x7f98e8162820 2024-05-20T17:59:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.009+0000 7f98e7fff640 1 --2- 172.21.15.6:0/1327049171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e80b8190 0x7f98e80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.010+0000 7f98e6ffd640 1 --2- 172.21.15.6:0/1327049171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e806d3d0 0x7f98e806d7e0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0097a0 tx=0x7f98dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37175704de7fdcf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.010+0000 7f98e67fc640 1 -- 172.21.15.6:0/1327049171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc037070 con 0x7f98e806d3d0 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.010+0000 7f98e67fc640 1 -- 172.21.15.6:0/1327049171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc032440 con 0x7f98e806d3d0 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.010+0000 7f98e67fc640 1 -- 172.21.15.6:0/1327049171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc032810 con 0x7f98e806d3d0 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.011+0000 7f98edd8b640 1 -- 172.21.15.6:0/1327049171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e806d3d0 msgr2=0x7f98e806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.011+0000 7f98edd8b640 1 --2- 172.21.15.6:0/1327049171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e806d3d0 0x7f98e806d7e0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0097a0 tx=0x7f98dc02a180 comp rx=0 tx=0).stop 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.011+0000 7f98edd8b640 1 -- 172.21.15.6:0/1327049171 shutdown_connections 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.011+0000 7f98edd8b640 1 --2- 172.21.15.6:0/1327049171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e80b8190 0x7f98e80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.011+0000 7f98edd8b640 1 --2- 172.21.15.6:0/1327049171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e806d3d0 0x7f98e806d7e0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.011+0000 7f98edd8b640 1 -- 172.21.15.6:0/1327049171 >> 172.21.15.6:0/1327049171 conn(0x7f98e80d4bd0 msgr2=0x7f98e80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.011+0000 7f98edd8b640 1 -- 172.21.15.6:0/1327049171 shutdown_connections 2024-05-20T17:59:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.011+0000 7f98edd8b640 1 -- 172.21.15.6:0/1327049171 wait complete. 2024-05-20T17:59:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.013+0000 7f98edd8b640 1 Processor -- start 2024-05-20T17:59:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.013+0000 7f98edd8b640 1 -- start start 2024-05-20T17:59:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.014+0000 7f98edd8b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e806d3d0 0x7f98e80c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.014+0000 7f98edd8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80b8190 0x7f98e8149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.014+0000 7f98edd8b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e8162820 0x7f98e8149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98edd8b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f98e80d0300 con 0x7f98e80b8190 2024-05-20T17:59:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98edd8b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f98e80d4260 con 0x7f98e8162820 2024-05-20T17:59:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98edd8b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f98e80b4050 con 0x7f98e806d3d0 2024-05-20T17:59:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80b8190 0x7f98e8149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80b8190 0x7f98e8149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51016/0 (socket says 172.21.15.6:51016) 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 -- 172.21.15.6:0/4055468778 learned_addr learned my addr 172.21.15.6:0/4055468778 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e77fe640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e806d3d0 0x7f98e80c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e7fff640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e8162820 0x7f98e8149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 -- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e806d3d0 msgr2=0x7f98e80c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e806d3d0 0x7f98e80c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 -- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e8162820 msgr2=0x7f98e8149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e8162820 0x7f98e8149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 -- 172.21.15.6:0/4055468778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e80b8980 con 0x7f98e80b8190 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e77fe640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e806d3d0 0x7f98e80c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e7fff640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e8162820 0x7f98e8149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98e6ffd640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80b8190 0x7f98e8149a70 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098c0 tx=0x7f98dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98cffff640 1 -- 172.21.15.6:0/4055468778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc037040 con 0x7f98e80b8190 2024-05-20T17:59:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98cffff640 1 -- 172.21.15.6:0/4055468778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc042070 con 0x7f98e80b8190 2024-05-20T17:59:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98cffff640 1 -- 172.21.15.6:0/4055468778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc030bb0 con 0x7f98e80b8190 2024-05-20T17:59:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e80caff0 con 0x7f98e80b8190 2024-05-20T17:59:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.015+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e80cacf0 con 0x7f98e80b8190 2024-05-20T17:59:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.017+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e8073a00 con 0x7f98e80b8190 2024-05-20T17:59:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.017+0000 7f98cffff640 1 -- 172.21.15.6:0/4055468778 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98dc047460 con 0x7f98e80b8190 2024-05-20T17:59:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.018+0000 7f98cffff640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98d406be30 0x7f98d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.018+0000 7f98cffff640 1 -- 172.21.15.6:0/4055468778 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f98dc0abc90 con 0x7f98e80b8190 2024-05-20T17:59:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.018+0000 7f98e77fe640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98d406be30 0x7f98d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.018+0000 7f98e77fe640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98d406be30 0x7f98d406e340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f98d8000f60 tx=0x7f98d8007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.022+0000 7f98cffff640 1 -- 172.21.15.6:0/4055468778 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f98e8073a00 con 0x7f98e80b8190 2024-05-20T17:59:53.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.243+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98e8075b00 con 0x7f98e80b8190 2024-05-20T17:59:53.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.243+0000 7f98cffff640 1 -- 172.21.15.6:0/4055468778 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5184 (secure 0 0 0) 0x7f98dc032e20 con 0x7f98e80b8190 2024-05-20T17:59:53.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:53.242 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/4216834090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":4216834090},{"type":"v1","addr":"172.21.15.171:6836","nonce":4216834090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1870629940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1870629940},{"type":"v1","addr":"172.21.15.171:6837","nonce":1870629940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3012084004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3012084004},{"type":"v1","addr":"172.21.15.6:6833","nonce":3012084004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:57:19.873838+0000","modified":"2024-05-20T17:59:52.552431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7074":{"gid":7074,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":41,"addr":"172.21.15.6:6835/3379618192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3379618192},{"type":"v1","addr":"172.21.15.6:6835","nonce":3379618192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7074,"qdb_cluster":[7074]},"id":6}]} 2024-05-20T17:59:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 57 2024-05-20T17:59:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98d406be30 msgr2=0x7f98d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98d406be30 0x7f98d406e340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f98d8000f60 tx=0x7f98d8007ca0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80b8190 msgr2=0x7f98e8149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80b8190 0x7f98e8149a70 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098c0 tx=0x7f98dc0046c0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 shutdown_connections 2024-05-20T17:59:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98d406be30 0x7f98d406e340 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e8162820 0x7f98e8149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80b8190 0x7f98e8149a70 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 --2- 172.21.15.6:0/4055468778 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e806d3d0 0x7f98e80c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.245+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 >> 172.21.15.6:0/4055468778 conn(0x7f98e80d4bd0 msgr2=0x7f98e815fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.246+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 shutdown_connections 2024-05-20T17:59:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.246+0000 7f98edd8b640 1 -- 172.21.15.6:0/4055468778 wait complete. 2024-05-20T17:59:53.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:59:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.371+0000 7ff3e5c56640 1 Processor -- start 2024-05-20T17:59:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.372+0000 7ff3e5c56640 1 -- start start 2024-05-20T17:59:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3e5c56640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3e00ce7e0 0x7ff3e00cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3e5c56640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e00cf130 con 0x7ff3e00cf3d0 2024-05-20T17:59:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3e5c56640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e00cda20 con 0x7ff3e015f220 2024-05-20T17:59:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3e5c56640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e00cdd00 con 0x7ff3e00ce7e0 2024-05-20T17:59:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3deffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff3e00cf3d0 0x7ff3e00cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51664/0 (socket says 172.21.15.6:51664) 2024-05-20T17:59:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff3e00ce7e0 0x7ff3e00cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3deffd640 1 -- 172.21.15.6:0/98184466 learned_addr learned my addr 172.21.15.6:0/98184466 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3dffff640 1 -- 172.21.15.6:0/98184466 >> v1:172.21.15.171:6789/0 conn(0x7ff3e015f220 legacy=0x7ff3e00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3dffff640 1 -- 172.21.15.6:0/98184466 >> v1:172.21.15.6:6789/0 conn(0x7ff3e00cf3d0 legacy=0x7ff3e00cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3de7fc640 1 -- 172.21.15.6:0/98184466 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146488753 0 0) 0x7ff3e00cf130 con 0x7ff3e00cf3d0 2024-05-20T17:59:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.373+0000 7ff3dffff640 1 -- 172.21.15.6:0/98184466 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e00cdfe0 con 0x7ff3e00ce7e0 2024-05-20T17:59:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.374+0000 7ff3dffff640 1 --2- 172.21.15.6:0/98184466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e00ce7e0 0x7ff3e00cebf0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009d90 tx=0x7ff3d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a12755b7b9cc7b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.374+0000 7ff3de7fc640 1 -- 172.21.15.6:0/98184466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8007740 con 0x7ff3e00ce7e0 2024-05-20T17:59:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.374+0000 7ff3de7fc640 1 -- 172.21.15.6:0/98184466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d80078e0 con 0x7ff3e00ce7e0 2024-05-20T17:59:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.374+0000 7ff3de7fc640 1 -- 172.21.15.6:0/98184466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8007cb0 con 0x7ff3e00ce7e0 2024-05-20T17:59:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.375+0000 7ff3e5c56640 1 -- 172.21.15.6:0/98184466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e00ce7e0 msgr2=0x7ff3e00cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.375+0000 7ff3e5c56640 1 --2- 172.21.15.6:0/98184466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e00ce7e0 0x7ff3e00cebf0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009d90 tx=0x7ff3d802a660 comp rx=0 tx=0).stop 2024-05-20T17:59:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.375+0000 7ff3e5c56640 1 -- 172.21.15.6:0/98184466 shutdown_connections 2024-05-20T17:59:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.375+0000 7ff3e5c56640 1 --2- 172.21.15.6:0/98184466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e00ce7e0 0x7ff3e00cebf0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.375+0000 7ff3e5c56640 1 -- 172.21.15.6:0/98184466 >> 172.21.15.6:0/98184466 conn(0x7ff3e00b44d0 msgr2=0x7ff3e00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.375+0000 7ff3e5c56640 1 -- 172.21.15.6:0/98184466 shutdown_connections 2024-05-20T17:59:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.375+0000 7ff3e5c56640 1 -- 172.21.15.6:0/98184466 wait complete. 2024-05-20T17:59:53.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.377+0000 7ff3e5c56640 1 Processor -- start 2024-05-20T17:59:53.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.377+0000 7ff3e5c56640 1 -- start start 2024-05-20T17:59:53.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3e5c56640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3e00ce7e0 0x7ff3e0161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3e5c56640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3e00cf3d0 0x7ff3e0161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3e5c56640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e015f220 0x7ff3e01f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3e5c56640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e00cd680 con 0x7ff3e015f220 2024-05-20T17:59:53.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3e5c56640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e00d0fd0 con 0x7ff3e00cf3d0 2024-05-20T17:59:53.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3e5c56640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e00cd800 con 0x7ff3e00ce7e0 2024-05-20T17:59:53.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e015f220 0x7ff3e01f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e015f220 0x7ff3e01f8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51026/0 (socket says 172.21.15.6:51026) 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 -- 172.21.15.6:0/523144406 learned_addr learned my addr 172.21.15.6:0/523144406 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3deffd640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3e00cf3d0 0x7ff3e0161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3df7fe640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3e00ce7e0 0x7ff3e0161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 -- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3e00ce7e0 msgr2=0x7ff3e0161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3e00ce7e0 0x7ff3e0161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 -- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3e00cf3d0 msgr2=0x7ff3e0161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3e00cf3d0 0x7ff3e0161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 -- 172.21.15.6:0/523144406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e00c8140 con 0x7ff3e015f220 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.379+0000 7ff3dffff640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e015f220 0x7ff3e01f8ea0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009eb0 tx=0x7ff3d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.380+0000 7ff3c7fff640 1 -- 172.21.15.6:0/523144406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8040070 con 0x7ff3e015f220 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.380+0000 7ff3c7fff640 1 -- 172.21.15.6:0/523144406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d8031c90 con 0x7ff3e015f220 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.380+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e00c8670 con 0x7ff3e015f220 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.380+0000 7ff3c7fff640 1 -- 172.21.15.6:0/523144406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8045680 con 0x7ff3e015f220 2024-05-20T17:59:53.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.380+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e00c8c30 con 0x7ff3e015f220 2024-05-20T17:59:53.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.381+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e0075b00 con 0x7ff3e015f220 2024-05-20T17:59:53.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.381+0000 7ff3c7fff640 1 -- 172.21.15.6:0/523144406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3d8039040 con 0x7ff3e015f220 2024-05-20T17:59:53.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.382+0000 7ff3c7fff640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff3cc06be30 0x7ff3cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.382+0000 7ff3c7fff640 1 -- 172.21.15.6:0/523144406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7ff3d80ac960 con 0x7ff3e015f220 2024-05-20T17:59:53.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.382+0000 7ff3df7fe640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff3cc06be30 0x7ff3cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.383+0000 7ff3df7fe640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff3cc06be30 0x7ff3cc06e340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0000f60 tx=0x7ff3d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.386+0000 7ff3c7fff640 1 -- 172.21.15.6:0/523144406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff3d807aaf0 con 0x7ff3e015f220 2024-05-20T17:59:53.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.573+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3e0158420 con 0x7ff3e015f220 2024-05-20T17:59:53.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.575+0000 7ff3c7fff640 1 -- 172.21.15.6:0/523144406 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17030 (secure 0 0 0) 0x7ff3d807edf0 con 0x7ff3e015f220 2024-05-20T17:59:53.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":89,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:48.988398+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:57:17.597397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-20T17:57:18.862392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":5}]},{"pgid":"14.24","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:59:53.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff3cc06be30 msgr2=0x7ff3cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff3cc06be30 0x7ff3cc06e340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0000f60 tx=0x7ff3d0009040 comp rx=0 tx=0).stop 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e015f220 msgr2=0x7ff3e01f8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e015f220 0x7ff3e01f8ea0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009eb0 tx=0x7ff3d8004a40 comp rx=0 tx=0).stop 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 shutdown_connections 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff3cc06be30 0x7ff3cc06e340 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3e015f220 0x7ff3e01f8ea0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3e00cf3d0 0x7ff3e0161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 --2- 172.21.15.6:0/523144406 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3e00ce7e0 0x7ff3e0161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 >> 172.21.15.6:0/523144406 conn(0x7ff3e00b44d0 msgr2=0x7ff3e00d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 shutdown_connections 2024-05-20T17:59:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.577+0000 7ff3e5c56640 1 -- 172.21.15.6:0/523144406 wait complete. 2024-05-20T17:59:53.587 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T17:59:53.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:59:53.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.703+0000 7f0451b02640 1 Processor -- start 2024-05-20T17:59:53.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.703+0000 7f0451b02640 1 -- start start 2024-05-20T17:59:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f0451b02640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f044c06d3d0 0x7f044c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f0451b02640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f044c0b8190 0x7f044c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f0451b02640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044c06dd20 con 0x7f044c162820 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f0451b02640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f044c0d0630 con 0x7f044c06d3d0 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f0451b02640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f044c0d39c0 con 0x7f044c0b8190 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f044c06d3d0 0x7f044c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f044c162820 0x7f044c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51674/0 (socket says 172.21.15.6:51674) 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044b7fe640 1 -- 172.21.15.6:0/4054456197 learned_addr learned my addr 172.21.15.6:0/4054456197 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044bfff640 1 --2- 172.21.15.6:0/4054456197 >> v2:172.21.15.171:3300/0 conn(0x7f044c0b8190 0x7f044c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044affd640 1 -- 172.21.15.6:0/4054456197 >> v2:172.21.15.171:3300/0 conn(0x7f044c0b8190 msgr2=0x7f044c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044affd640 1 --2- 172.21.15.6:0/4054456197 >> v2:172.21.15.171:3300/0 conn(0x7f044c0b8190 0x7f044c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044affd640 1 -- 172.21.15.6:0/4054456197 >> v1:172.21.15.6:6789/0 conn(0x7f044c162820 legacy=0x7f044c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044a7fc640 1 -- 172.21.15.6:0/4054456197 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716760778 0 0) 0x7f043c001110 con 0x7f044c162820 2024-05-20T17:59:53.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.705+0000 7f044affd640 1 -- 172.21.15.6:0/4054456197 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c0d3ca0 con 0x7f044c06d3d0 2024-05-20T17:59:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.706+0000 7f044affd640 1 --2- 172.21.15.6:0/4054456197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c06d3d0 0x7f044c06d7e0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f044c08e070 tx=0x7f044002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82618e139c15fc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.706+0000 7f044a7fc640 1 -- 172.21.15.6:0/4054456197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440037070 con 0x7f044c06d3d0 2024-05-20T17:59:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.706+0000 7f044a7fc640 1 -- 172.21.15.6:0/4054456197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0440032440 con 0x7f044c06d3d0 2024-05-20T17:59:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.706+0000 7f044a7fc640 1 -- 172.21.15.6:0/4054456197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440032810 con 0x7f044c06d3d0 2024-05-20T17:59:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.707+0000 7f0451b02640 1 -- 172.21.15.6:0/4054456197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c06d3d0 msgr2=0x7f044c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.707+0000 7f0451b02640 1 --2- 172.21.15.6:0/4054456197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c06d3d0 0x7f044c06d7e0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f044c08e070 tx=0x7f044002a1a0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.707+0000 7f0451b02640 1 -- 172.21.15.6:0/4054456197 shutdown_connections 2024-05-20T17:59:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.707+0000 7f0451b02640 1 --2- 172.21.15.6:0/4054456197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c06d3d0 0x7f044c06d7e0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.707+0000 7f0451b02640 1 --2- 172.21.15.6:0/4054456197 >> v2:172.21.15.171:3300/0 conn(0x7f044c0b8190 0x7f044c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.707+0000 7f0451b02640 1 -- 172.21.15.6:0/4054456197 >> 172.21.15.6:0/4054456197 conn(0x7f044c0d4bd0 msgr2=0x7f044c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.707+0000 7f0451b02640 1 -- 172.21.15.6:0/4054456197 shutdown_connections 2024-05-20T17:59:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.707+0000 7f0451b02640 1 -- 172.21.15.6:0/4054456197 wait complete. 2024-05-20T17:59:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.709+0000 7f0451b02640 1 Processor -- start 2024-05-20T17:59:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.709+0000 7f0451b02640 1 -- start start 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.710+0000 7f0451b02640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f044c06d3d0 0x7f044c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.710+0000 7f0451b02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0b8190 0x7f044c0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.710+0000 7f0451b02640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f044c162820 0x7f044c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.710+0000 7f0451b02640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f044c0d0300 con 0x7f044c0b8190 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.710+0000 7f0451b02640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f044c0d4260 con 0x7f044c162820 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.710+0000 7f0451b02640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f044c0b4050 con 0x7f044c06d3d0 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.710+0000 7f044affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0b8190 0x7f044c0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0b8190 0x7f044c0cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51032/0 (socket says 172.21.15.6:51032) 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044affd640 1 -- 172.21.15.6:0/32194081 learned_addr learned my addr 172.21.15.6:0/32194081 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044b7fe640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f044c06d3d0 0x7f044c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044affd640 1 -- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f044c06d3d0 msgr2=0x7f044c0c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044affd640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f044c06d3d0 0x7f044c0c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044bfff640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f044c162820 0x7f044c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044affd640 1 -- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f044c162820 msgr2=0x7f044c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044affd640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f044c162820 0x7f044c14ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044affd640 1 -- 172.21.15.6:0/32194081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c14f170 con 0x7f044c0b8190 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f044affd640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0b8190 0x7f044c0cac60 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0440009890 tx=0x7f04400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f0433fff640 1 -- 172.21.15.6:0/32194081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440037040 con 0x7f044c0b8190 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f0433fff640 1 -- 172.21.15.6:0/32194081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0440042070 con 0x7f044c0b8190 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c0c8ec0 con 0x7f044c0b8190 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f0433fff640 1 -- 172.21.15.6:0/32194081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440030bd0 con 0x7f044c0b8190 2024-05-20T17:59:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.711+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c0c9480 con 0x7f044c0b8190 2024-05-20T17:59:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.712+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c075b00 con 0x7f044c0b8190 2024-05-20T17:59:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.713+0000 7f0433fff640 1 -- 172.21.15.6:0/32194081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0440047460 con 0x7f044c0b8190 2024-05-20T17:59:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.713+0000 7f0433fff640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f043806be30 0x7f043806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.714+0000 7f0433fff640 1 -- 172.21.15.6:0/32194081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f04400abc50 con 0x7f044c0b8190 2024-05-20T17:59:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.714+0000 7f044b7fe640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f043806be30 0x7f043806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:53.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.714+0000 7f044b7fe640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f043806be30 0x7f043806e340 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f043c000f60 tx=0x7f043c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:53.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.718+0000 7f0433fff640 1 -- 172.21.15.6:0/32194081 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f04400b1020 con 0x7f044c0b8190 2024-05-20T17:59:53.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.940+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f044c0c8c50 con 0x7f044c0b8190 2024-05-20T17:59:53.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.941+0000 7f0433fff640 1 -- 172.21.15.6:0/32194081 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5184 (secure 0 0 0) 0x7f0440032e20 con 0x7f044c0b8190 2024-05-20T17:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/4216834090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":4216834090},{"type":"v1","addr":"172.21.15.171:6836","nonce":4216834090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1870629940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1870629940},{"type":"v1","addr":"172.21.15.171:6837","nonce":1870629940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3012084004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3012084004},{"type":"v1","addr":"172.21.15.6:6833","nonce":3012084004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:57:19.873838+0000","modified":"2024-05-20T17:59:52.552431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7074":{"gid":7074,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":41,"addr":"172.21.15.6:6835/3379618192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3379618192},{"type":"v1","addr":"172.21.15.6:6835","nonce":3379618192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7074,"qdb_cluster":[7074]},"id":6}]} 2024-05-20T17:59:53.940 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 57 2024-05-20T17:59:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f043806be30 msgr2=0x7f043806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f043806be30 0x7f043806e340 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f043c000f60 tx=0x7f043c009040 comp rx=0 tx=0).stop 2024-05-20T17:59:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0b8190 msgr2=0x7f044c0cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0b8190 0x7f044c0cac60 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0440009890 tx=0x7f04400046c0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 shutdown_connections 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f043806be30 0x7f043806e340 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f044c162820 0x7f044c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0b8190 0x7f044c0cac60 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 --2- 172.21.15.6:0/32194081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f044c06d3d0 0x7f044c0c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 >> 172.21.15.6:0/32194081 conn(0x7f044c0d4bd0 msgr2=0x7f044c0b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 shutdown_connections 2024-05-20T17:59:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:53.943+0000 7f0451b02640 1 -- 172.21.15.6:0/32194081 wait complete. 2024-05-20T17:59:53.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T17:59:54.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.069+0000 7fd7cda3d640 1 Processor -- start 2024-05-20T17:59:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.069+0000 7fd7cda3d640 1 -- start start 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7cda3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c8168050 0x7fd7c816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7cda3d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c80d0630 con 0x7fd7c8162820 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7cda3d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c80d39c0 con 0x7fd7c806d3d0 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7cda3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c80d3ca0 con 0x7fd7c8168050 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c6ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7c8162820 0x7fd7c80b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51688/0 (socket says 172.21.15.6:51688) 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c6ffd640 1 -- 172.21.15.6:0/4137291403 learned_addr learned my addr 172.21.15.6:0/4137291403 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c77fe640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c8168050 0x7fd7c816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543329105 0 0) 0x7fd7c80d0630 con 0x7fd7c8162820 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7b4003520 con 0x7fd7c8162820 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2744828929 0 0) 0x7fd7b4003520 con 0x7fd7c8162820 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c8168050 msgr2=0x7fd7c816a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c8168050 0x7fd7c816a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 >> v1:172.21.15.171:6789/0 conn(0x7fd7c806d3d0 legacy=0x7fd7c806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c80d3f80 con 0x7fd7c8162820 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fd7b80019f0 con 0x7fd7c8162820 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 >> v1:172.21.15.6:6789/0 conn(0x7fd7c8162820 legacy=0x7fd7c80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7b4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.071+0000 7fd7c5ffb640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b4004800 0x7fd7b4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c5ffb640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c8168050 0x7fd7b4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80d3ca0 con 0x7fd7b40039e0 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b400baf0 con 0x7fd7b4004800 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b400bcf0 con 0x7fd7c8168050 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c6ffd640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7b4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c67fc640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b4004800 0x7fd7b4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c6ffd640 1 -- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c8168050 msgr2=0x7fd7b4005200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-20T17:59:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c6ffd640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c8168050 0x7fd7b4005200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c6ffd640 1 -- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b4004800 msgr2=0x7fd7b4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c6ffd640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b4004800 0x7fd7b4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c6ffd640 1 -- 172.21.15.6:0/4137291403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b4003520 con 0x7fd7b40039e0 2024-05-20T17:59:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.072+0000 7fd7c67fc640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7b4004800 0x7fd7b4004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.073+0000 7fd7c6ffd640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7b4003e50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800a810 tx=0x7fd7b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57679e2f4a11b88 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.073+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800a460 con 0x7fd7b40039e0 2024-05-20T17:59:54.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.073+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b802f070 con 0x7fd7b40039e0 2024-05-20T17:59:54.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.073+0000 7fd7c5ffb640 1 -- 172.21.15.6:0/4137291403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b802bc90 con 0x7fd7b40039e0 2024-05-20T17:59:54.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.074+0000 7fd7cda3d640 1 -- 172.21.15.6:0/4137291403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 msgr2=0x7fd7b4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.074+0000 7fd7cda3d640 1 --2- 172.21.15.6:0/4137291403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7b4003e50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800a810 tx=0x7fd7b4005830 comp rx=0 tx=0).stop 2024-05-20T17:59:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.074+0000 7fd7c77fe640 1 -- 172.21.15.6:0/4137291403 reap_dead start 2024-05-20T17:59:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.074+0000 7fd7cda3d640 1 -- 172.21.15.6:0/4137291403 shutdown_connections 2024-05-20T17:59:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.074+0000 7fd7cda3d640 1 -- 172.21.15.6:0/4137291403 >> 172.21.15.6:0/4137291403 conn(0x7fd7c80d4bd0 msgr2=0x7fd7c80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.074+0000 7fd7cda3d640 1 -- 172.21.15.6:0/4137291403 shutdown_connections 2024-05-20T17:59:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.074+0000 7fd7cda3d640 1 -- 172.21.15.6:0/4137291403 wait complete. 2024-05-20T17:59:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.075+0000 7fd7cda3d640 1 Processor -- start 2024-05-20T17:59:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.076+0000 7fd7cda3d640 1 -- start start 2024-05-20T17:59:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7cda3d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7c81556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7cda3d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80b6ae0 0x7fd7c815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7cda3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80b6ef0 0x7fd7c815f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7cda3d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80b91a0 con 0x7fd7b40039e0 2024-05-20T17:59:54.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7cda3d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80d0300 con 0x7fd7c80b6ae0 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7cda3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c80b4050 con 0x7fd7c80b6ef0 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7c81556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7c81556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51058/0 (socket says 172.21.15.6:51058) 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c6ffd640 1 -- 172.21.15.6:0/330538813 learned_addr learned my addr 172.21.15.6:0/330538813 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c67fc640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80b6ae0 0x7fd7c815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c77fe640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80b6ef0 0x7fd7c815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c6ffd640 1 -- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80b6ef0 msgr2=0x7fd7c815f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c6ffd640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80b6ef0 0x7fd7c815f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c6ffd640 1 -- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80b6ae0 msgr2=0x7fd7c815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c6ffd640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80b6ae0 0x7fd7c815eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.077+0000 7fd7c6ffd640 1 -- 172.21.15.6:0/330538813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c81560a0 con 0x7fd7b40039e0 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.078+0000 7fd7c6ffd640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7c81556c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800a810 tx=0x7fd7c80b7a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.078+0000 7fd7bffff640 1 -- 172.21.15.6:0/330538813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b802bc40 con 0x7fd7b40039e0 2024-05-20T17:59:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.078+0000 7fd7bffff640 1 -- 172.21.15.6:0/330538813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b802bde0 con 0x7fd7b40039e0 2024-05-20T17:59:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.078+0000 7fd7bffff640 1 -- 172.21.15.6:0/330538813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8034690 con 0x7fd7b40039e0 2024-05-20T17:59:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.078+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c8156380 con 0x7fd7b40039e0 2024-05-20T17:59:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.078+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c8156940 con 0x7fd7b40039e0 2024-05-20T17:59:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.079+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c8075b00 con 0x7fd7b40039e0 2024-05-20T17:59:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.080+0000 7fd7bffff640 1 -- 172.21.15.6:0/330538813 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7b8034830 con 0x7fd7b40039e0 2024-05-20T17:59:54.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.080+0000 7fd7bffff640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.080+0000 7fd7bffff640 1 -- 172.21.15.6:0/330538813 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fd7b80ab600 con 0x7fd7b40039e0 2024-05-20T17:59:54.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.080+0000 7fd7c67fc640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.081+0000 7fd7c67fc640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd7c81f8b20 tx=0x7fd7b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.085+0000 7fd7bffff640 1 -- 172.21.15.6:0/330538813 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd7b80796d0 con 0x7fd7b40039e0 2024-05-20T17:59:54.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.306+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7c8068a90 con 0x7fd7b40039e0 2024-05-20T17:59:54.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.306+0000 7fd7bffff640 1 -- 172.21.15.6:0/330538813 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5184 (secure 0 0 0) 0x7fd7b807d9d0 con 0x7fd7b40039e0 2024-05-20T17:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/4216834090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":4216834090},{"type":"v1","addr":"172.21.15.171:6836","nonce":4216834090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1870629940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1870629940},{"type":"v1","addr":"172.21.15.171:6837","nonce":1870629940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3012084004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3012084004},{"type":"v1","addr":"172.21.15.6:6833","nonce":3012084004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T17:57:19.873838+0000","modified":"2024-05-20T17:59:52.552431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7074":{"gid":7074,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":41,"addr":"172.21.15.6:6835/3379618192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3379618192},{"type":"v1","addr":"172.21.15.6:6835","nonce":3379618192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7074,"qdb_cluster":[7074]},"id":6}]} 2024-05-20T17:59:54.305 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 57 2024-05-20T17:59:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 msgr2=0x7fd7a806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd7c81f8b20 tx=0x7fd7b0009040 comp rx=0 tx=0).stop 2024-05-20T17:59:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 msgr2=0x7fd7c81556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7c81556c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800a810 tx=0x7fd7c80b7a20 comp rx=0 tx=0).stop 2024-05-20T17:59:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 shutdown_connections 2024-05-20T17:59:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd7a806be30 0x7fd7a806e340 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7c80b6ef0 0x7fd7c815f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7c80b6ae0 0x7fd7c815eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 --2- 172.21.15.6:0/330538813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7b40039e0 0x7fd7c81556c0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 >> 172.21.15.6:0/330538813 conn(0x7fd7c80d4bd0 msgr2=0x7fd7c815b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 shutdown_connections 2024-05-20T17:59:54.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.308+0000 7fd7cda3d640 1 -- 172.21.15.6:0/330538813 wait complete. 2024-05-20T17:59:54.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T17:59:54.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.435+0000 7ff5b7092640 1 Processor -- start 2024-05-20T17:59:54.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.435+0000 7ff5b7092640 1 -- start start 2024-05-20T17:59:54.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.436+0000 7ff5b7092640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b00cd1b0 0x7ff5b015f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.436+0000 7ff5b7092640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b00ce2b0 con 0x7ff5b0070850 2024-05-20T17:59:54.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.436+0000 7ff5b7092640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b006cce0 con 0x7ff5b0071630 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.436+0000 7ff5b7092640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b015f790 con 0x7ff5b00cd1b0 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.436+0000 7ff5b562f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff5b0070850 0x7ff5b0070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51704/0 (socket says 172.21.15.6:51704) 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.436+0000 7ff5b562f640 1 -- 172.21.15.6:0/1995607180 learned_addr learned my addr 172.21.15.6:0/1995607180 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.437+0000 7ff5affff640 1 --2- 172.21.15.6:0/1995607180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b00cd1b0 0x7ff5b015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.437+0000 7ff5af7fe640 1 -- 172.21.15.6:0/1995607180 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849353146 0 0) 0x7ff5b00ce2b0 con 0x7ff5b0070850 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.437+0000 7ff5af7fe640 1 -- 172.21.15.6:0/1995607180 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff59c003520 con 0x7ff5b0070850 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.437+0000 7ff5affff640 1 -- 172.21.15.6:0/1995607180 >> v1:172.21.15.171:6789/0 conn(0x7ff5b0071630 legacy=0x7ff5b006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.437+0000 7ff5af7fe640 1 -- 172.21.15.6:0/1995607180 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266940173 0 0) 0x7ff5b006cce0 con 0x7ff5b0071630 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.437+0000 7ff5affff640 1 -- 172.21.15.6:0/1995607180 >> v1:172.21.15.6:6789/0 conn(0x7ff5b0070850 legacy=0x7ff5b0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.437+0000 7ff5affff640 1 -- 172.21.15.6:0/1995607180 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b006cfc0 con 0x7ff5b00cd1b0 2024-05-20T17:59:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.438+0000 7ff5affff640 1 --2- 172.21.15.6:0/1995607180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b00cd1b0 0x7ff5b015f250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009dc0 tx=0x7ff5a002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e0be37d04d97c13 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.438+0000 7ff5af7fe640 1 -- 172.21.15.6:0/1995607180 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a002ae60 con 0x7ff5b00cd1b0 2024-05-20T17:59:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.438+0000 7ff5af7fe640 1 -- 172.21.15.6:0/1995607180 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a0007740 con 0x7ff5b00cd1b0 2024-05-20T17:59:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.438+0000 7ff5af7fe640 1 -- 172.21.15.6:0/1995607180 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0007b10 con 0x7ff5b00cd1b0 2024-05-20T17:59:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.439+0000 7ff5b7092640 1 -- 172.21.15.6:0/1995607180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b00cd1b0 msgr2=0x7ff5b015f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.439+0000 7ff5b7092640 1 --2- 172.21.15.6:0/1995607180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b00cd1b0 0x7ff5b015f250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009dc0 tx=0x7ff5a002a640 comp rx=0 tx=0).stop 2024-05-20T17:59:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.439+0000 7ff5b7092640 1 -- 172.21.15.6:0/1995607180 shutdown_connections 2024-05-20T17:59:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.439+0000 7ff5b7092640 1 --2- 172.21.15.6:0/1995607180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b00cd1b0 0x7ff5b015f250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.439+0000 7ff5b7092640 1 -- 172.21.15.6:0/1995607180 >> 172.21.15.6:0/1995607180 conn(0x7ff5b00d29d0 msgr2=0x7ff5b00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.439+0000 7ff5b7092640 1 -- 172.21.15.6:0/1995607180 shutdown_connections 2024-05-20T17:59:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.439+0000 7ff5b7092640 1 -- 172.21.15.6:0/1995607180 wait complete. 2024-05-20T17:59:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.441+0000 7ff5b7092640 1 Processor -- start 2024-05-20T17:59:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.441+0000 7ff5b7092640 1 -- start start 2024-05-20T17:59:54.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5b7092640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b0070850 0x7ff5b015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5b7092640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5b0071630 0x7ff5b00ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5b7092640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5b00cd1b0 0x7ff5b01f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5b7092640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b006ded0 con 0x7ff5b0071630 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5b7092640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b006c990 con 0x7ff5b00cd1b0 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5b7092640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b00ae510 con 0x7ff5b0070850 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5affff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5b0071630 0x7ff5b00ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5affff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5b0071630 0x7ff5b00ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51068/0 (socket says 172.21.15.6:51068) 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5affff640 1 -- 172.21.15.6:0/4143321487 learned_addr learned my addr 172.21.15.6:0/4143321487 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5b562f640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5b00cd1b0 0x7ff5b01f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.442+0000 7ff5b4e2e640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b0070850 0x7ff5b015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5affff640 1 -- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b0070850 msgr2=0x7ff5b015aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5affff640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b0070850 0x7ff5b015aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5affff640 1 -- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5b00cd1b0 msgr2=0x7ff5b01f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5affff640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5b00cd1b0 0x7ff5b01f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5affff640 1 -- 172.21.15.6:0/4143321487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b00b1250 con 0x7ff5b0071630 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5affff640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5b0071630 0x7ff5b00ada90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff5a002ac30 tx=0x7ff5a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5ad7fa640 1 -- 172.21.15.6:0/4143321487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a003f070 con 0x7ff5b0071630 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5ad7fa640 1 -- 172.21.15.6:0/4143321487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a0031a40 con 0x7ff5b0071630 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b00b1530 con 0x7ff5b0071630 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5ad7fa640 1 -- 172.21.15.6:0/4143321487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0031c10 con 0x7ff5b0071630 2024-05-20T17:59:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.443+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b00adfd0 con 0x7ff5b0071630 2024-05-20T17:59:54.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.444+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b0075b00 con 0x7ff5b0071630 2024-05-20T17:59:54.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.445+0000 7ff5ad7fa640 1 -- 172.21.15.6:0/4143321487 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5a003b410 con 0x7ff5b0071630 2024-05-20T17:59:54.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.445+0000 7ff5ad7fa640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff59006be60 0x7ff59006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.446+0000 7ff5ad7fa640 1 -- 172.21.15.6:0/4143321487 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7ff5a00ac320 con 0x7ff5b0071630 2024-05-20T17:59:54.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.446+0000 7ff5b4e2e640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff59006be60 0x7ff59006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.446+0000 7ff5b4e2e640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff59006be60 0x7ff59006e370 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff598000f60 tx=0x7ff598009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.450+0000 7ff5ad7fa640 1 -- 172.21.15.6:0/4143321487 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff5a0049060 con 0x7ff5b0071630 2024-05-20T17:59:54.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.639+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5b0071410 con 0x7ff5b0071630 2024-05-20T17:59:54.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.640+0000 7ff5ad7fa640 1 -- 172.21.15.6:0/4143321487 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17030 (secure 0 0 0) 0x7ff5a00ac0e0 con 0x7ff5b0071630 2024-05-20T17:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T17:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":89,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:57:48.988398+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-05-20T17:57:17.597397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-05-20T17:57:18.862392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":5}]},{"pgid":"14.24","mappings":[{"from":1,"to":2}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff59006be60 msgr2=0x7ff59006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff59006be60 0x7ff59006e370 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff598000f60 tx=0x7ff598009040 comp rx=0 tx=0).stop 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5b0071630 msgr2=0x7ff5b00ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5b0071630 0x7ff5b00ada90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ff5a002ac30 tx=0x7ff5a0004a40 comp rx=0 tx=0).stop 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 shutdown_connections 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff59006be60 0x7ff59006e370 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5b00cd1b0 0x7ff5b01f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5b0071630 0x7ff5b00ada90 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 --2- 172.21.15.6:0/4143321487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5b0070850 0x7ff5b015aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 >> 172.21.15.6:0/4143321487 conn(0x7ff5b00d29d0 msgr2=0x7ff5b015e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 shutdown_connections 2024-05-20T17:59:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.642+0000 7ff5b7092640 1 -- 172.21.15.6:0/4143321487 wait complete. 2024-05-20T17:59:54.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T17:59:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.769+0000 7f2272e79640 1 Processor -- start 2024-05-20T17:59:54.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.769+0000 7f2272e79640 1 -- start start 2024-05-20T17:59:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2272e79640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f226c162820 0x7f226c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2272e79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c06dae0 0x7f226c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2272e79640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f226c0d0630 con 0x7f226c0b3e80 2024-05-20T17:59:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2272e79640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f226c0d39c0 con 0x7f226c162820 2024-05-20T17:59:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2272e79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f226c0d3ca0 con 0x7f226c06dae0 2024-05-20T17:59:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2270c15640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f226c162820 0x7f226c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2270c15640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f226c162820 0x7f226c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51076/0 (socket says 172.21.15.6:51076) 2024-05-20T17:59:54.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2270c15640 1 -- 172.21.15.6:0/2130757989 learned_addr learned my addr 172.21.15.6:0/2130757989 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:54.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2270c15640 1 -- 172.21.15.6:0/2130757989 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c06dae0 msgr2=0x7f226c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:54.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2271416640 1 --2- 172.21.15.6:0/2130757989 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c06dae0 0x7f226c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2270c15640 1 --2- 172.21.15.6:0/2130757989 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c06dae0 0x7f226c0b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2270c15640 1 -- 172.21.15.6:0/2130757989 >> v1:172.21.15.171:6789/0 conn(0x7f226c0b3e80 legacy=0x7f226c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:54.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.771+0000 7f2270c15640 1 -- 172.21.15.6:0/2130757989 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c0d3f80 con 0x7f226c162820 2024-05-20T17:59:54.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.772+0000 7f2270c15640 1 --2- 172.21.15.6:0/2130757989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c0b3940 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f225c009870 tx=0x7f225c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe39baae073b18da server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.772+0000 7f226b7fe640 1 -- 172.21.15.6:0/2130757989 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c037070 con 0x7f226c162820 2024-05-20T17:59:54.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.772+0000 7f226b7fe640 1 -- 172.21.15.6:0/2130757989 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c032440 con 0x7f226c162820 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.772+0000 7f226b7fe640 1 -- 172.21.15.6:0/2130757989 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c032810 con 0x7f226c162820 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.773+0000 7f2272e79640 1 -- 172.21.15.6:0/2130757989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 msgr2=0x7f226c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.773+0000 7f2272e79640 1 --2- 172.21.15.6:0/2130757989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c0b3940 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f225c009870 tx=0x7f225c02a210 comp rx=0 tx=0).stop 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.773+0000 7f2272e79640 1 -- 172.21.15.6:0/2130757989 shutdown_connections 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.773+0000 7f2272e79640 1 --2- 172.21.15.6:0/2130757989 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c06dae0 0x7f226c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.773+0000 7f2272e79640 1 --2- 172.21.15.6:0/2130757989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c0b3940 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.773+0000 7f2272e79640 1 -- 172.21.15.6:0/2130757989 >> 172.21.15.6:0/2130757989 conn(0x7f226c0d4bd0 msgr2=0x7f226c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.773+0000 7f2272e79640 1 -- 172.21.15.6:0/2130757989 shutdown_connections 2024-05-20T17:59:54.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.773+0000 7f2272e79640 1 -- 172.21.15.6:0/2130757989 wait complete. 2024-05-20T17:59:54.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.775+0000 7f2272e79640 1 Processor -- start 2024-05-20T17:59:54.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.775+0000 7f2272e79640 1 -- start start 2024-05-20T17:59:54.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f2272e79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c0b3e80 0x7f226c0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f2272e79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f2272e79640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226c0b68c0 0x7f226c0b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f2272e79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f226c0d4780 con 0x7f226c162820 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f2272e79640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f226c0d0300 con 0x7f226c0b68c0 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f2272e79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f226c0d4900 con 0x7f226c0b3e80 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f226bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f226bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51078/0 (socket says 172.21.15.6:51078) 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.776+0000 7f226bfff640 1 -- 172.21.15.6:0/2618881135 learned_addr learned my addr 172.21.15.6:0/2618881135 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f226bfff640 1 -- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c0b3e80 msgr2=0x7f226c0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f226bfff640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c0b3e80 0x7f226c0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f226bfff640 1 -- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226c0b68c0 msgr2=0x7f226c0b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f2271416640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226c0b68c0 0x7f226c0b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f226bfff640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226c0b68c0 0x7f226c0b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:54.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f226bfff640 1 -- 172.21.15.6:0/2618881135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c0b3c80 con 0x7f226c162820 2024-05-20T17:59:54.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f2271416640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226c0b68c0 0x7f226c0b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T17:59:54.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f226bfff640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c159020 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f226000b420 tx=0x7f226000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f22697fa640 1 -- 172.21.15.6:0/2618881135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260011830 con 0x7f226c162820 2024-05-20T17:59:54.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f22697fa640 1 -- 172.21.15.6:0/2618881135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2260016070 con 0x7f226c162820 2024-05-20T17:59:54.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c0b7210 con 0x7f226c162820 2024-05-20T17:59:54.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f22697fa640 1 -- 172.21.15.6:0/2618881135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260011c10 con 0x7f226c162820 2024-05-20T17:59:54.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.777+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c0b8790 con 0x7f226c162820 2024-05-20T17:59:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.778+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f226c075b00 con 0x7f226c162820 2024-05-20T17:59:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.779+0000 7f22697fa640 1 -- 172.21.15.6:0/2618881135 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f226001b460 con 0x7f226c162820 2024-05-20T17:59:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.780+0000 7f22697fa640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f225806be30 0x7f225806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.780+0000 7f22697fa640 1 -- 172.21.15.6:0/2618881135 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f226008aaf0 con 0x7f226c162820 2024-05-20T17:59:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.780+0000 7f2270c15640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f225806be30 0x7f225806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:54.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.780+0000 7f2270c15640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f225806be30 0x7f225806e340 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f225c034000 tx=0x7f225c02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:54.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:54.784+0000 7f22697fa640 1 -- 172.21.15.6:0/2618881135 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2260020020 con 0x7f226c162820 2024-05-20T17:59:55.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.004+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f226c1e99f0 con 0x7f226c162820 2024-05-20T17:59:55.003 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T17:59:55.005+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T17:59:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.008+0000 7f22697fa640 1 -- 172.21.15.6:0/2618881135 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) ==== 161+0+0 (secure 0 0 0) 0x7f226c0b7210 con 0x7f226c162820 2024-05-20T17:59:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f225806be30 msgr2=0x7f225806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f225806be30 0x7f225806e340 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f225c034000 tx=0x7f225c02c000 comp rx=0 tx=0).stop 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 msgr2=0x7f226c159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c159020 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f226000b420 tx=0x7f226000b8e0 comp rx=0 tx=0).stop 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 shutdown_connections 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f225806be30 0x7f225806e340 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f226c0b68c0 0x7f226c0b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c162820 0x7f226c159020 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 --2- 172.21.15.6:0/2618881135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f226c0b3e80 0x7f226c0b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 >> 172.21.15.6:0/2618881135 conn(0x7f226c0d4bd0 msgr2=0x7f226c15da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 shutdown_connections 2024-05-20T17:59:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.010+0000 7f2272e79640 1 -- 172.21.15.6:0/2618881135 wait complete. 2024-05-20T17:59:55.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T17:59:55.076 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T17:59:55.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.145+0000 7f2f47338640 1 Processor -- start 2024-05-20T17:59:55.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.145+0000 7f2f47338640 1 -- start start 2024-05-20T17:59:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.146+0000 7f2f47338640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2f400d2780 0x7f2f400d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.146+0000 7f2f47338640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f4008d2a0 con 0x7f2f400d4400 2024-05-20T17:59:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.146+0000 7f2f47338640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f400d30d0 con 0x7f2f4006cf00 2024-05-20T17:59:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.146+0000 7f2f47338640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f2f400d3f70 con 0x7f2f400d2780 2024-05-20T17:59:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.147+0000 7f2f458d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2f400d2780 0x7f2f400d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.147+0000 7f2f450d4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f400d4400 0x7f2f4015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51730/0 (socket says 172.21.15.6:51730) 2024-05-20T17:59:55.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.147+0000 7f2f450d4640 1 -- 172.21.15.6:0/773263370 learned_addr learned my addr 172.21.15.6:0/773263370 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:55.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.147+0000 7f2f458d5640 1 -- 172.21.15.6:0/773263370 >> v1:172.21.15.171:6789/0 conn(0x7f2f4006cf00 legacy=0x7f2f4006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:55.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.147+0000 7f2f458d5640 1 -- 172.21.15.6:0/773263370 >> v1:172.21.15.6:6789/0 conn(0x7f2f400d4400 legacy=0x7f2f4015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:55.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.147+0000 7f2f37fff640 1 -- 172.21.15.6:0/773263370 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180568191 0 0) 0x7f2f3c001110 con 0x7f2f400d4400 2024-05-20T17:59:55.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.147+0000 7f2f458d5640 1 -- 172.21.15.6:0/773263370 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f400d4810 con 0x7f2f400d2780 2024-05-20T17:59:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.148+0000 7f2f458d5640 1 --2- 172.21.15.6:0/773263370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d2780 0x7f2f400d2b90 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009d90 tx=0x7f2f3802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a11fffd3f33142c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.148+0000 7f2f37fff640 1 -- 172.21.15.6:0/773263370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38037070 con 0x7f2f400d2780 2024-05-20T17:59:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.148+0000 7f2f37fff640 1 -- 172.21.15.6:0/773263370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f38007740 con 0x7f2f400d2780 2024-05-20T17:59:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.148+0000 7f2f37fff640 1 -- 172.21.15.6:0/773263370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38007b10 con 0x7f2f400d2780 2024-05-20T17:59:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.149+0000 7f2f47338640 1 -- 172.21.15.6:0/773263370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d2780 msgr2=0x7f2f400d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.149+0000 7f2f47338640 1 --2- 172.21.15.6:0/773263370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d2780 0x7f2f400d2b90 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009d90 tx=0x7f2f3802a780 comp rx=0 tx=0).stop 2024-05-20T17:59:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.149+0000 7f2f47338640 1 -- 172.21.15.6:0/773263370 shutdown_connections 2024-05-20T17:59:55.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.149+0000 7f2f47338640 1 --2- 172.21.15.6:0/773263370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d2780 0x7f2f400d2b90 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:55.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.149+0000 7f2f47338640 1 -- 172.21.15.6:0/773263370 >> 172.21.15.6:0/773263370 conn(0x7f2f400d4bb0 msgr2=0x7f2f400d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:55.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.149+0000 7f2f47338640 1 -- 172.21.15.6:0/773263370 shutdown_connections 2024-05-20T17:59:55.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.149+0000 7f2f47338640 1 -- 172.21.15.6:0/773263370 wait complete. 2024-05-20T17:59:55.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.151+0000 7f2f47338640 1 Processor -- start 2024-05-20T17:59:55.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.151+0000 7f2f47338640 1 -- start start 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f47338640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f4006cf00 0x7f2f401f9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f47338640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f400d2780 0x7f2f40150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f47338640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d4400 0x7f2f40161de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f47338640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2f400d3920 con 0x7f2f400d4400 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f47338640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2f400d3680 con 0x7f2f4006cf00 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f47338640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2f400d3c00 con 0x7f2f400d2780 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f458d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d4400 0x7f2f40161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f458d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d4400 0x7f2f40161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51102/0 (socket says 172.21.15.6:51102) 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f458d5640 1 -- 172.21.15.6:0/2736783172 learned_addr learned my addr 172.21.15.6:0/2736783172 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f448d3640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f400d2780 0x7f2f40150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.152+0000 7f2f450d4640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f4006cf00 0x7f2f401f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f458d5640 1 -- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f400d2780 msgr2=0x7f2f40150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f458d5640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f400d2780 0x7f2f40150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f458d5640 1 -- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f4006cf00 msgr2=0x7f2f401f9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f458d5640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f4006cf00 0x7f2f401f9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f458d5640 1 -- 172.21.15.6:0/2736783172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f40154190 con 0x7f2f400d4400 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f458d5640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d4400 0x7f2f40161de0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009eb0 tx=0x7f2f38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f35ffb640 1 -- 172.21.15.6:0/2736783172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38042020 con 0x7f2f400d4400 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f35ffb640 1 -- 172.21.15.6:0/2736783172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f38032990 con 0x7f2f400d4400 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f401559d0 con 0x7f2f400d4400 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f35ffb640 1 -- 172.21.15.6:0/2736783172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38037040 con 0x7f2f400d4400 2024-05-20T17:59:55.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.153+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f400ca230 con 0x7f2f400d4400 2024-05-20T17:59:55.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.154+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f400735a0 con 0x7f2f400d4400 2024-05-20T17:59:55.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.155+0000 7f2f35ffb640 1 -- 172.21.15.6:0/2736783172 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f38045020 con 0x7f2f400d4400 2024-05-20T17:59:55.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.155+0000 7f2f35ffb640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f2406be30 0x7f2f2406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:55.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.156+0000 7f2f35ffb640 1 -- 172.21.15.6:0/2736783172 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f2f380ac2b0 con 0x7f2f400d4400 2024-05-20T17:59:55.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.156+0000 7f2f450d4640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f2406be30 0x7f2f2406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:55.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.156+0000 7f2f450d4640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f2406be30 0x7f2f2406e340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c000f60 tx=0x7f2f3c007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:55.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.160+0000 7f2f35ffb640 1 -- 172.21.15.6:0/2736783172 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2f400735a0 con 0x7f2f400d4400 2024-05-20T17:59:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:55.382+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2f4006dc90 con 0x7f2f400d4400 2024-05-20T17:59:56.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.010+0000 7f2f35ffb640 1 -- 172.21.15.6:0/2736783172 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) ==== 104+0+0 (secure 0 0 0) 0x7f2f3804c030 con 0x7f2f400d4400 2024-05-20T17:59:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f2406be30 msgr2=0x7f2f2406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f2406be30 0x7f2f2406e340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c000f60 tx=0x7f2f3c007e40 comp rx=0 tx=0).stop 2024-05-20T17:59:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d4400 msgr2=0x7f2f40161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d4400 0x7f2f40161de0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009eb0 tx=0x7f2f38004a40 comp rx=0 tx=0).stop 2024-05-20T17:59:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 shutdown_connections 2024-05-20T17:59:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f2406be30 0x7f2f2406e340 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400d4400 0x7f2f40161de0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f400d2780 0x7f2f40150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 --2- 172.21.15.6:0/2736783172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f4006cf00 0x7f2f401f9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.012+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 >> 172.21.15.6:0/2736783172 conn(0x7f2f400d4bb0 msgr2=0x7f2f40158110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.013+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 shutdown_connections 2024-05-20T17:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.013+0000 7f2f47338640 1 -- 172.21.15.6:0/2736783172 wait complete. 2024-05-20T17:59:56.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.149+0000 7f9cd8fd5640 1 Processor -- start 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.150+0000 7f9cd8fd5640 1 -- start start 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.151+0000 7f9cd8fd5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9cd409e740 0x7f9cd415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.151+0000 7f9cd8fd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd4070010 0x7f9cd415c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.151+0000 7f9cd8fd5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd40b00f0 con 0x7f9cd40af730 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.151+0000 7f9cd8fd5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd40ad8d0 con 0x7f9cd409e740 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.151+0000 7f9cd8fd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd40adbb0 con 0x7f9cd4070010 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.151+0000 7f9cd1d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9cd40af730 0x7f9cd406f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51732/0 (socket says 172.21.15.6:51732) 2024-05-20T17:59:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.151+0000 7f9cd1d9b640 1 -- 172.21.15.6:0/2885762082 learned_addr learned my addr 172.21.15.6:0/2885762082 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd2d9d640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd4070010 0x7f9cd415c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd259c640 1 --2- 172.21.15.6:0/2885762082 >> v2:172.21.15.171:3300/0 conn(0x7f9cd409e740 0x7f9cd415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087178557 0 0) 0x7f9cd40b00f0 con 0x7f9cd40af730 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cbc003520 con 0x7f9cd40af730 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2097348047 0 0) 0x7f9cbc003520 con 0x7f9cd40af730 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd4070010 msgr2=0x7f9cd415c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd4070010 0x7f9cd415c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 >> v2:172.21.15.171:3300/0 conn(0x7f9cd409e740 msgr2=0x7f9cd415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 --2- 172.21.15.6:0/2885762082 >> v2:172.21.15.171:3300/0 conn(0x7f9cd409e740 0x7f9cd415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd40ade90 con 0x7f9cd40af730 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f9cc8001670 con 0x7f9cd40af730 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 >> v1:172.21.15.6:6789/0 conn(0x7f9cd40af730 legacy=0x7f9cd406f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc0039b0 0x7f9cbc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc004800 0x7f9cbc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cbc005150 0x7f9cbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40ad8d0 con 0x7f9cbc005150 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40adbb0 con 0x7f9cbc0039b0 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc00bf00 con 0x7f9cbc004800 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd2d9d640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cbc005150 0x7f9cbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd259c640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc0039b0 0x7f9cbc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd1d9b640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc004800 0x7f9cbc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd2d9d640 1 -- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc004800 msgr2=0x7f9cbc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd2d9d640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc004800 0x7f9cbc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd2d9d640 1 -- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc0039b0 msgr2=0x7f9cbc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd2d9d640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc0039b0 0x7f9cbc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd2d9d640 1 -- 172.21.15.6:0/2885762082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc003520 con 0x7f9cbc005150 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.152+0000 7f9cd1d9b640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc004800 0x7f9cbc004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.153+0000 7f9cd2d9d640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cbc005150 0x7f9cbc00b9c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009ac0 tx=0x7f9cbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203789cd3b92609a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.153+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc036070 con 0x7f9cbc005150 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.153+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc031400 con 0x7f9cbc005150 2024-05-20T17:59:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.153+0000 7f9cd159a640 1 -- 172.21.15.6:0/2885762082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc009690 con 0x7f9cbc005150 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.154+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/2885762082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cbc005150 msgr2=0x7f9cbc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.154+0000 7f9cd8fd5640 1 --2- 172.21.15.6:0/2885762082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cbc005150 0x7f9cbc00b9c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009ac0 tx=0x7f9cbc005830 comp rx=0 tx=0).stop 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.154+0000 7f9cd2d9d640 1 -- 172.21.15.6:0/2885762082 reap_dead start 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.154+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/2885762082 shutdown_connections 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.154+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/2885762082 >> 172.21.15.6:0/2885762082 conn(0x7f9cd40d0e10 msgr2=0x7f9cd40723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.154+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/2885762082 shutdown_connections 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.154+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/2885762082 wait complete. 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.156+0000 7f9cd8fd5640 1 Processor -- start 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.156+0000 7f9cd8fd5640 1 -- start start 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.157+0000 7f9cd8fd5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc005150 0x7f9cd414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.157+0000 7f9cd8fd5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd40ced30 0x7f9cd40cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.157+0000 7f9cd8fd5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd40b42b0 0x7f9cd40b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.157+0000 7f9cd8fd5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40cff50 con 0x7f9cd40b42b0 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.157+0000 7f9cd8fd5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40cfdd0 con 0x7f9cbc005150 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.157+0000 7f9cd8fd5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd4070010 con 0x7f9cd40ced30 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd40b42b0 0x7f9cd40b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd40b42b0 0x7f9cd40b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51124/0 (socket says 172.21.15.6:51124) 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 -- 172.21.15.6:0/508114512 learned_addr learned my addr 172.21.15.6:0/508114512 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd259c640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc005150 0x7f9cd414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd1d9b640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd40ced30 0x7f9cd40cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 -- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd40ced30 msgr2=0x7f9cd40cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd40ced30 0x7f9cd40cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 -- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc005150 msgr2=0x7f9cd414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc005150 0x7f9cd414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 -- 172.21.15.6:0/508114512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd40b4c00 con 0x7f9cd40b42b0 2024-05-20T17:59:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd259c640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc005150 0x7f9cd414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd2d9d640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd40b42b0 0x7f9cd40b46c0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc034040 tx=0x7f9ccc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cc2ffd640 1 -- 172.21.15.6:0/508114512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc036040 con 0x7f9cd40b42b0 2024-05-20T17:59:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cc2ffd640 1 -- 172.21.15.6:0/508114512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc041070 con 0x7f9cd40b42b0 2024-05-20T17:59:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cc2ffd640 1 -- 172.21.15.6:0/508114512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc009690 con 0x7f9cd40b42b0 2024-05-20T17:59:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd414bae0 con 0x7f9cd40b42b0 2024-05-20T17:59:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.158+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd40cdf70 con 0x7f9cd40b42b0 2024-05-20T17:59:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.159+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd40ccfb0 con 0x7f9cd40b42b0 2024-05-20T17:59:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.160+0000 7f9cc2ffd640 1 -- 172.21.15.6:0/508114512 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ccc004250 con 0x7f9cd40b42b0 2024-05-20T17:59:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.160+0000 7f9cc2ffd640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9cb406be60 0x7f9cb406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.161+0000 7f9cc2ffd640 1 -- 172.21.15.6:0/508114512 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f9ccc0aab50 con 0x7f9cd40b42b0 2024-05-20T17:59:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.161+0000 7f9cd259c640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9cb406be60 0x7f9cb406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.161+0000 7f9cd259c640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9cb406be60 0x7f9cb406e370 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40715d0 tx=0x7f9cc400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.165+0000 7f9cc2ffd640 1 -- 172.21.15.6:0/508114512 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9cd40ccfb0 con 0x7f9cd40b42b0 2024-05-20T17:59:56.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:56.350+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9cd40690b0 con 0x7f9cd40b42b0 2024-05-20T17:59:57.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.018+0000 7f9cc2ffd640 1 -- 172.21.15.6:0/508114512 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7f9ccc04a020 con 0x7f9cd40b42b0 2024-05-20T17:59:57.017 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T17:59:57.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9cb406be60 msgr2=0x7f9cb406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9cb406be60 0x7f9cb406e370 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40715d0 tx=0x7f9cc400b040 comp rx=0 tx=0).stop 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd40b42b0 msgr2=0x7f9cd40b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd40b42b0 0x7f9cd40b46c0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc034040 tx=0x7f9ccc004730 comp rx=0 tx=0).stop 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 shutdown_connections 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9cb406be60 0x7f9cb406e370 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9cd40b42b0 0x7f9cd40b46c0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cd40ced30 0x7f9cd40cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 --2- 172.21.15.6:0/508114512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9cbc005150 0x7f9cd414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 >> 172.21.15.6:0/508114512 conn(0x7f9cd40d0e10 msgr2=0x7f9cd4158160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 shutdown_connections 2024-05-20T17:59:57.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.021+0000 7f9cd8fd5640 1 -- 172.21.15.6:0/508114512 wait complete. 2024-05-20T17:59:57.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T17:59:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.163+0000 7ff3a7a61640 1 Processor -- start 2024-05-20T17:59:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.163+0000 7ff3a7a61640 1 -- start start 2024-05-20T17:59:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a7a61640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff3a00b1df0 0x7ff3a00d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a7a61640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3a00d14a0 0x7ff3a00b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a7a61640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a009c350 con 0x7ff3a00b3280 2024-05-20T17:59:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a7a61640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a009bc20 con 0x7ff3a00b1df0 2024-05-20T17:59:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a7a61640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a00cedb0 con 0x7ff3a00d14a0 2024-05-20T17:59:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a5ffe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff3a00b3280 0x7ff3a00b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51744/0 (socket says 172.21.15.6:51744) 2024-05-20T17:59:57.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/1032314447 learned_addr learned my addr 172.21.15.6:0/1032314447 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528250162 0 0) 0x7ff398001490 con 0x7ff3a00b3280 2024-05-20T17:59:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a4ffc640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3a00d14a0 0x7ff3a00b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff38c003520 con 0x7ff3a00b3280 2024-05-20T17:59:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff3a57fd640 1 --2- 172.21.15.6:0/1032314447 >> v2:172.21.15.171:3300/0 conn(0x7ff3a00b1df0 0x7ff3a00d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.165+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2017913010 0 0) 0x7ff38c003520 con 0x7ff3a00b3280 2024-05-20T17:59:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3a00d14a0 msgr2=0x7ff3a00b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3a00d14a0 0x7ff3a00b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 >> v2:172.21.15.171:3300/0 conn(0x7ff3a00b1df0 msgr2=0x7ff3a00d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 --2- 172.21.15.6:0/1032314447 >> v2:172.21.15.171:3300/0 conn(0x7ff3a00b1df0 0x7ff3a00d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a00d1a50 con 0x7ff3a00b3280 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ff398001bc0 con 0x7ff3a00b3280 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a57fd640 1 --2- 172.21.15.6:0/1032314447 >> v2:172.21.15.171:3300/0 conn(0x7ff3a00b1df0 0x7ff3a00d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 >> v1:172.21.15.6:6789/0 conn(0x7ff3a00b3280 legacy=0x7ff3a00b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff38c0039b0 0x7ff38c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3a00d14a0 0x7ff38c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff38c004d40 0x7ff38c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a009bc20 con 0x7ff38c004d40 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00cedb0 con 0x7ff38c0039b0 2024-05-20T17:59:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff38c00baf0 con 0x7ff3a00d14a0 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a5ffe640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff38c004d40 0x7ff38c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a57fd640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff38c0039b0 0x7ff38c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a4ffc640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3a00d14a0 0x7ff38c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3a00d14a0 msgr2=0x7ff38c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a5ffe640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3a00d14a0 0x7ff38c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff38c0039b0 msgr2=0x7ff38c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a5ffe640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff38c0039b0 0x7ff38c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.166+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/1032314447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c003520 con 0x7ff38c004d40 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.167+0000 7ff3a5ffe640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff38c004d40 0x7ff38c005150 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff39800aa40 tx=0x7ff38c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858f437deaf550f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.167+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39800a690 con 0x7ff38c004d40 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.167+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39802f070 con 0x7ff38c004d40 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.167+0000 7ff397fff640 1 -- 172.21.15.6:0/1032314447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398034470 con 0x7ff38c004d40 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.168+0000 7ff3a7a61640 1 -- 172.21.15.6:0/1032314447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff38c004d40 msgr2=0x7ff38c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.168+0000 7ff3a7a61640 1 --2- 172.21.15.6:0/1032314447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff38c004d40 0x7ff38c005150 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff39800aa40 tx=0x7ff38c005830 comp rx=0 tx=0).stop 2024-05-20T17:59:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.168+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/1032314447 reap_dead start 2024-05-20T17:59:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.168+0000 7ff3a7a61640 1 -- 172.21.15.6:0/1032314447 shutdown_connections 2024-05-20T17:59:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.168+0000 7ff3a7a61640 1 -- 172.21.15.6:0/1032314447 >> 172.21.15.6:0/1032314447 conn(0x7ff3a00cf450 msgr2=0x7ff3a00cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.168+0000 7ff3a7a61640 1 -- 172.21.15.6:0/1032314447 shutdown_connections 2024-05-20T17:59:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.168+0000 7ff3a7a61640 1 -- 172.21.15.6:0/1032314447 wait complete. 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.170+0000 7ff3a7a61640 1 Processor -- start 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.170+0000 7ff3a7a61640 1 -- start start 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a7a61640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff38c004d40 0x7ff3a01e3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a7a61640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3a01e3540 0x7ff3a01d1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a7a61640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a01e1070 0x7ff3a01d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a7a61640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00ce820 con 0x7ff3a01e1070 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a7a61640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00b3da0 con 0x7ff3a01e3540 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a7a61640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a00d0650 con 0x7ff38c004d40 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a5ffe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a01e1070 0x7ff3a01d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a5ffe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a01e1070 0x7ff3a01d1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51134/0 (socket says 172.21.15.6:51134) 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/3813865108 learned_addr learned my addr 172.21.15.6:0/3813865108 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff38c004d40 msgr2=0x7ff3a01e3000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.171+0000 7ff3a5ffe640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff38c004d40 0x7ff3a01e3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3a01e3540 msgr2=0x7ff3a01d1710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff3a5ffe640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3a01e3540 0x7ff3a01d1710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff3a5ffe640 1 -- 172.21.15.6:0/3813865108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a009fdd0 con 0x7ff3a01e1070 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff3a5ffe640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a01e1070 0x7ff3a01d1c50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff39800a150 tx=0x7ff398001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff395ffb640 1 -- 172.21.15.6:0/3813865108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398039070 con 0x7ff3a01e1070 2024-05-20T17:59:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff395ffb640 1 -- 172.21.15.6:0/3813865108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff398001bb0 con 0x7ff3a01e1070 2024-05-20T17:59:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a00a00b0 con 0x7ff3a01e1070 2024-05-20T17:59:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff395ffb640 1 -- 172.21.15.6:0/3813865108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39800a690 con 0x7ff3a01e1070 2024-05-20T17:59:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.172+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a01d3e00 con 0x7ff3a01e1070 2024-05-20T17:59:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.173+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a00690b0 con 0x7ff3a01e1070 2024-05-20T17:59:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.174+0000 7ff395ffb640 1 -- 172.21.15.6:0/3813865108 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff398044060 con 0x7ff3a01e1070 2024-05-20T17:59:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.174+0000 7ff395ffb640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff38406be30 0x7ff38406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.174+0000 7ff395ffb640 1 -- 172.21.15.6:0/3813865108 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5865+0+0 (secure 0 0 0) 0x7ff3980aacb0 con 0x7ff3a01e1070 2024-05-20T17:59:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.174+0000 7ff3a57fd640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff38406be30 0x7ff38406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.175+0000 7ff3a57fd640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff38406be30 0x7ff38406e340 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0097b0 tx=0x7ff39c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.179+0000 7ff395ffb640 1 -- 172.21.15.6:0/3813865108 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff3a009c350 con 0x7ff3a01e1070 2024-05-20T17:59:57.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:57.373+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff3a009fb60 con 0x7ff3a01e1070 2024-05-20T17:59:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.020+0000 7ff395ffb640 1 -- 172.21.15.6:0/3813865108 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7ff398079650 con 0x7ff3a01e1070 2024-05-20T17:59:58.019 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T17:59:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff38406be30 msgr2=0x7ff38406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff38406be30 0x7ff38406e340 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0097b0 tx=0x7ff39c008040 comp rx=0 tx=0).stop 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a01e1070 msgr2=0x7ff3a01d1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a01e1070 0x7ff3a01d1c50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff39800a150 tx=0x7ff398001f90 comp rx=0 tx=0).stop 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 shutdown_connections 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff38406be30 0x7ff38406e340 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a01e1070 0x7ff3a01d1c50 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3a01e3540 0x7ff3a01d1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 --2- 172.21.15.6:0/3813865108 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff38c004d40 0x7ff3a01e3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 >> 172.21.15.6:0/3813865108 conn(0x7ff3a00cf450 msgr2=0x7ff3a00b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 shutdown_connections 2024-05-20T17:59:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.023+0000 7ff3a7a61640 1 -- 172.21.15.6:0/3813865108 wait complete. 2024-05-20T17:59:58.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-05-20T17:59:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.164+0000 7fa6a383d640 1 Processor -- start 2024-05-20T17:59:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.165+0000 7fa6a383d640 1 -- start start 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.166+0000 7fa6a383d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa69c15f700 0x7fa69c15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.166+0000 7fa6a383d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c160430 con 0x7fa69c06c180 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.166+0000 7fa6a383d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c06b6a0 con 0x7fa69c0af030 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.166+0000 7fa6a383d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa69c06bcf0 con 0x7fa69c15f700 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.166+0000 7fa6a1dda640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa69c06c180 0x7fa69c06c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48826/0 (socket says 172.21.15.6:48826) 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.166+0000 7fa6a1dda640 1 -- 172.21.15.6:0/3450287968 learned_addr learned my addr 172.21.15.6:0/3450287968 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa6a0dd8640 1 --2- 172.21.15.6:0/3450287968 >> v2:172.21.15.171:3300/0 conn(0x7fa69c15f700 0x7fa69c15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377603995 0 0) 0x7fa69c160430 con 0x7fa69c06c180 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa688003520 con 0x7fa69c06c180 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522263360 0 0) 0x7fa69c06b6a0 con 0x7fa69c0af030 2024-05-20T17:59:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa69c160430 con 0x7fa69c0af030 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 66405640 0 0) 0x7fa688003520 con 0x7fa69c06c180 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 >> v2:172.21.15.171:3300/0 conn(0x7fa69c15f700 msgr2=0x7fa69c15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 --2- 172.21.15.6:0/3450287968 >> v2:172.21.15.171:3300/0 conn(0x7fa69c15f700 0x7fa69c15fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 >> v1:172.21.15.171:6789/0 conn(0x7fa69c0af030 legacy=0x7fa69c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c06b980 con 0x7fa69c06c180 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fa694001a10 con 0x7fa69c06c180 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 >> v1:172.21.15.6:6789/0 conn(0x7fa69c06c180 legacy=0x7fa69c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa688003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa688004800 0x7fa688004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6880051a0 0x7fa68800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c06bcf0 con 0x7fa688003b40 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa68800c140 con 0x7fa688004800 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa68800c340 con 0x7fa6880051a0 2024-05-20T17:59:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa6a15d9640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa688003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa6a0dd8640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa688004800 0x7fa688004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa6a1dda640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6880051a0 0x7fa68800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.167+0000 7fa6a15d9640 1 -- 172.21.15.6:0/3450287968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6880051a0 msgr2=0x7fa68800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.168+0000 7fa6a15d9640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6880051a0 0x7fa68800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.168+0000 7fa6a15d9640 1 -- 172.21.15.6:0/3450287968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa688004800 msgr2=0x7fa688004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.168+0000 7fa6a15d9640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa688004800 0x7fa688004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.168+0000 7fa6a1dda640 1 -- 172.21.15.6:0/3450287968 reap_dead start 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.168+0000 7fa6a15d9640 1 -- 172.21.15.6:0/3450287968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa688003520 con 0x7fa688003b40 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.168+0000 7fa6a15d9640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa688003f90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fa6880057e0 tx=0x7fa688005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839a11ea61b63e2c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.168+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698012a30 con 0x7fa688003b40 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6980052f0 con 0x7fa688003b40 2024-05-20T17:59:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa693fff640 1 -- 172.21.15.6:0/3450287968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698012310 con 0x7fa688003b40 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa6a383d640 1 -- 172.21.15.6:0/3450287968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 msgr2=0x7fa688003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa6a383d640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa688003f90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fa6880057e0 tx=0x7fa688005830 comp rx=0 tx=0).stop 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa6a383d640 1 -- 172.21.15.6:0/3450287968 shutdown_connections 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa6a383d640 1 --2- 172.21.15.6:0/3450287968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa688003f90 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa6a383d640 1 -- 172.21.15.6:0/3450287968 >> 172.21.15.6:0/3450287968 conn(0x7fa69c0b6620 msgr2=0x7fa69c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa6a383d640 1 -- 172.21.15.6:0/3450287968 shutdown_connections 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.169+0000 7fa6a383d640 1 -- 172.21.15.6:0/3450287968 wait complete. 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.171+0000 7fa6a383d640 1 Processor -- start 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.171+0000 7fa6a383d640 1 -- start start 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.172+0000 7fa6a383d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa69c152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.172+0000 7fa6a383d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa69c152860 0x7fa69c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.172+0000 7fa6a383d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa69c14f410 0x7fa69c14e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.172+0000 7fa6a383d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c0af5c0 con 0x7fa688003b40 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.172+0000 7fa6a383d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c0af440 con 0x7fa69c14f410 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.172+0000 7fa6a383d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa69c0af740 con 0x7fa69c152860 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa69c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa69c152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53084/0 (socket says 172.21.15.6:53084) 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 -- 172.21.15.6:0/3424377581 learned_addr learned my addr 172.21.15.6:0/3424377581 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a1dda640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa69c14f410 0x7fa69c14e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a0dd8640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa69c152860 0x7fa69c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 -- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa69c152860 msgr2=0x7fa69c14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa69c152860 0x7fa69c14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 -- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa69c14f410 msgr2=0x7fa69c14e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa69c14f410 0x7fa69c14e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 -- 172.21.15.6:0/3424377581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c153b40 con 0x7fa688003b40 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a0dd8640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa69c152860 0x7fa69c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a1dda640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa69c14f410 0x7fa69c14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a15d9640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa69c152320 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fa69c06e1f0 tx=0x7fa6980012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa691ffb640 1 -- 172.21.15.6:0/3424377581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69804a070 con 0x7fa688003b40 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa691ffb640 1 -- 172.21.15.6:0/3424377581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6980054a0 con 0x7fa688003b40 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c1568f0 con 0x7fa688003b40 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.173+0000 7fa691ffb640 1 -- 172.21.15.6:0/3424377581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6980067d0 con 0x7fa688003b40 2024-05-20T17:59:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.174+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c1533a0 con 0x7fa688003b40 2024-05-20T17:59:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.175+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa69c075b00 con 0x7fa688003b40 2024-05-20T17:59:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.175+0000 7fa691ffb640 1 -- 172.21.15.6:0/3424377581 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa69804d070 con 0x7fa688003b40 2024-05-20T17:59:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.176+0000 7fa691ffb640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa68006be30 0x7fa68006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.176+0000 7fa691ffb640 1 -- 172.21.15.6:0/3424377581 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7fa6980b2d40 con 0x7fa688003b40 2024-05-20T17:59:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.176+0000 7fa6a0dd8640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa68006be30 0x7fa68006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.177+0000 7fa6a0dd8640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa68006be30 0x7fa68006e340 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa69c158da0 tx=0x7fa68c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.181+0000 7fa691ffb640 1 -- 172.21.15.6:0/3424377581 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa6980817e0 con 0x7fa688003b40 2024-05-20T17:59:58.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.365+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7fa69c0d1630 con 0x7fa688003b40 2024-05-20T17:59:58.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.368+0000 7fa691ffb640 1 -- 172.21.15.6:0/3424377581 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v29) ==== 107+0+0 (secure 0 0 0) 0x7fa6980810e0 con 0x7fa688003b40 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.370+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa68006be30 msgr2=0x7fa68006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.370+0000 7fa6a383d640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa68006be30 0x7fa68006e340 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa69c158da0 tx=0x7fa68c008040 comp rx=0 tx=0).stop 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.370+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 msgr2=0x7fa69c152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.370+0000 7fa6a383d640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa69c152320 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fa69c06e1f0 tx=0x7fa6980012d0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.371+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 shutdown_connections 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.371+0000 7fa6a383d640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa68006be30 0x7fa68006e340 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.371+0000 7fa6a383d640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa69c14f410 0x7fa69c14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.371+0000 7fa6a383d640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa69c152860 0x7fa69c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.371+0000 7fa6a383d640 1 --2- 172.21.15.6:0/3424377581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa688003b40 0x7fa69c152320 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.371+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 >> 172.21.15.6:0/3424377581 conn(0x7fa69c0b6620 msgr2=0x7fa69c0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:58.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.371+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 shutdown_connections 2024-05-20T17:59:58.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.371+0000 7fa6a383d640 1 -- 172.21.15.6:0/3424377581 wait complete. 2024-05-20T17:59:58.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-05-20T17:59:58.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.507+0000 7f5dc586c640 1 Processor -- start 2024-05-20T17:59:58.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.507+0000 7f5dc586c640 1 -- start start 2024-05-20T17:59:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dc586c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dc00b4010 0x7f5dc00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dc586c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc00d14b0 0x7f5dc00d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dc586c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc00d0370 con 0x7f5dc0163a10 2024-05-20T17:59:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dc586c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc00d3ca0 con 0x7f5dc00b4010 2024-05-20T17:59:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dc586c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc00d0650 con 0x7f5dc00d14b0 2024-05-20T17:59:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dbe7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5dc00b4010 0x7f5dc00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dbeffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5dc0163a10 0x7f5dc00cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48832/0 (socket says 172.21.15.6:48832) 2024-05-20T17:59:58.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dbeffd640 1 -- 172.21.15.6:0/95786774 learned_addr learned my addr 172.21.15.6:0/95786774 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:58.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dbe7fc640 1 -- 172.21.15.6:0/95786774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc00d14b0 msgr2=0x7f5dc00d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:58.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dbe7fc640 1 --2- 172.21.15.6:0/95786774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc00d14b0 0x7f5dc00d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dbe7fc640 1 -- 172.21.15.6:0/95786774 >> v1:172.21.15.6:6789/0 conn(0x7f5dc0163a10 legacy=0x7f5dc00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dbdffb640 1 -- 172.21.15.6:0/95786774 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732194336 0 0) 0x7f5dc00d0370 con 0x7f5dc0163a10 2024-05-20T17:59:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.509+0000 7f5dbe7fc640 1 -- 172.21.15.6:0/95786774 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc00d3650 con 0x7f5dc00b4010 2024-05-20T17:59:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.510+0000 7f5dbe7fc640 1 --2- 172.21.15.6:0/95786774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc00d4130 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5db40097a0 tx=0x7f5db402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87f5005bac3a24c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.510+0000 7f5dbdffb640 1 -- 172.21.15.6:0/95786774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4037070 con 0x7f5dc00b4010 2024-05-20T17:59:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.510+0000 7f5dbdffb640 1 -- 172.21.15.6:0/95786774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db4032440 con 0x7f5dc00b4010 2024-05-20T17:59:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.510+0000 7f5dbdffb640 1 -- 172.21.15.6:0/95786774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4032810 con 0x7f5dc00b4010 2024-05-20T17:59:58.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.511+0000 7f5dc586c640 1 -- 172.21.15.6:0/95786774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 msgr2=0x7f5dc00d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.511+0000 7f5dc586c640 1 --2- 172.21.15.6:0/95786774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc00d4130 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5db40097a0 tx=0x7f5db402a180 comp rx=0 tx=0).stop 2024-05-20T17:59:58.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.511+0000 7f5dc586c640 1 -- 172.21.15.6:0/95786774 shutdown_connections 2024-05-20T17:59:58.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.511+0000 7f5dc586c640 1 --2- 172.21.15.6:0/95786774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc00d14b0 0x7f5dc00d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.511+0000 7f5dc586c640 1 --2- 172.21.15.6:0/95786774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc00d4130 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.511+0000 7f5dc586c640 1 -- 172.21.15.6:0/95786774 >> 172.21.15.6:0/95786774 conn(0x7f5dc006d240 msgr2=0x7f5dc006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:58.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.511+0000 7f5dc586c640 1 -- 172.21.15.6:0/95786774 shutdown_connections 2024-05-20T17:59:58.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.511+0000 7f5dc586c640 1 -- 172.21.15.6:0/95786774 wait complete. 2024-05-20T17:59:58.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.513+0000 7f5dc586c640 1 Processor -- start 2024-05-20T17:59:58.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.513+0000 7f5dc586c640 1 -- start start 2024-05-20T17:59:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dc586c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc0157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dc586c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dc00d14b0 0x7f5dc0159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dc586c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc0163a10 0x7f5dc00cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dc586c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc00b8210 con 0x7f5dc00b4010 2024-05-20T17:59:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dc586c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc00d1e00 con 0x7f5dc00d14b0 2024-05-20T17:59:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dc586c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc00b8390 con 0x7f5dc0163a10 2024-05-20T17:59:58.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dbeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc0157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dbeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc0157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53098/0 (socket says 172.21.15.6:53098) 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dbeffd640 1 -- 172.21.15.6:0/3691700893 learned_addr learned my addr 172.21.15.6:0/3691700893 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dbe7fc640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dc00d14b0 0x7f5dc0159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.514+0000 7f5dbf7fe640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc0163a10 0x7f5dc00cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5dbeffd640 1 -- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc0163a10 msgr2=0x7f5dc00cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5dbeffd640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc0163a10 0x7f5dc00cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5dbeffd640 1 -- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dc00d14b0 msgr2=0x7f5dc0159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5dbeffd640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dc00d14b0 0x7f5dc0159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5dbeffd640 1 -- 172.21.15.6:0/3691700893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc0157a40 con 0x7f5dc00b4010 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5dbeffd640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc0157180 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f5db000c410 tx=0x7f5db000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5da7fff640 1 -- 172.21.15.6:0/3691700893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db00074e0 con 0x7f5dc00b4010 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5da7fff640 1 -- 172.21.15.6:0/3691700893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db00047e0 con 0x7f5dc00b4010 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc0159f10 con 0x7f5dc00b4010 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5da7fff640 1 -- 172.21.15.6:0/3691700893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0004bd0 con 0x7f5dc00b4010 2024-05-20T17:59:58.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.515+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc015a4d0 con 0x7f5dc00b4010 2024-05-20T17:59:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.516+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc0075b00 con 0x7f5dc00b4010 2024-05-20T17:59:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.516+0000 7f5da7fff640 1 -- 172.21.15.6:0/3691700893 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5db0011070 con 0x7f5dc00b4010 2024-05-20T17:59:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.517+0000 7f5da7fff640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dac06be30 0x7f5dac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.517+0000 7f5da7fff640 1 -- 172.21.15.6:0/3691700893 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f5db008a9d0 con 0x7f5dc00b4010 2024-05-20T17:59:58.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.517+0000 7f5dbe7fc640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dac06be30 0x7f5dac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.518+0000 7f5dbe7fc640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dac06be30 0x7f5dac06e340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5db4034000 tx=0x7f5db402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.522+0000 7f5da7fff640 1 -- 172.21.15.6:0/3691700893 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5db000e280 con 0x7f5dc00b4010 2024-05-20T17:59:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.710+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7f5dc00b6ee0 con 0x7f5dc00b4010 2024-05-20T17:59:58.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.713+0000 7f5da7fff640 1 -- 172.21.15.6:0/3691700893 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v30) ==== 105+0+0 (secure 0 0 0) 0x7f5db0059460 con 0x7f5dc00b4010 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dac06be30 msgr2=0x7f5dac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dac06be30 0x7f5dac06e340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5db4034000 tx=0x7f5db402e000 comp rx=0 tx=0).stop 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 msgr2=0x7f5dc0157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc0157180 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f5db000c410 tx=0x7f5db000c8d0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 shutdown_connections 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5dac06be30 0x7f5dac06e340 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5dc0163a10 0x7f5dc00cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5dc00d14b0 0x7f5dc0159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 --2- 172.21.15.6:0/3691700893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5dc00b4010 0x7f5dc0157180 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 >> 172.21.15.6:0/3691700893 conn(0x7f5dc006d240 msgr2=0x7f5dc015f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:58.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 shutdown_connections 2024-05-20T17:59:58.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.716+0000 7f5dc586c640 1 -- 172.21.15.6:0/3691700893 wait complete. 2024-05-20T17:59:58.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-05-20T17:59:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.844+0000 7f7ae6b2c640 1 Processor -- start 2024-05-20T17:59:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.844+0000 7f7ae6b2c640 1 -- start start 2024-05-20T17:59:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae6b2c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ae0162820 0x7f7ae00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae6b2c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7ae006dae0 0x7f7ae00b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae6b2c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae00d0630 con 0x7f7ae00b3e80 2024-05-20T17:59:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae6b2c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae00d39c0 con 0x7f7ae0162820 2024-05-20T17:59:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae6b2c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae00d3ca0 con 0x7f7ae006dae0 2024-05-20T17:59:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae48c8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ae0162820 0x7f7ae00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae48c8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7ae0162820 0x7f7ae00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53100/0 (socket says 172.21.15.6:53100) 2024-05-20T17:59:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae48c8640 1 -- 172.21.15.6:0/1320588122 learned_addr learned my addr 172.21.15.6:0/1320588122 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae48c8640 1 -- 172.21.15.6:0/1320588122 >> v2:172.21.15.171:3300/0 conn(0x7f7ae006dae0 msgr2=0x7f7ae00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae48c8640 1 --2- 172.21.15.6:0/1320588122 >> v2:172.21.15.171:3300/0 conn(0x7f7ae006dae0 0x7f7ae00b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae48c8640 1 -- 172.21.15.6:0/1320588122 >> v1:172.21.15.171:6789/0 conn(0x7f7ae00b3e80 legacy=0x7f7ae006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.846+0000 7f7ae48c8640 1 -- 172.21.15.6:0/1320588122 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae00d3f80 con 0x7f7ae0162820 2024-05-20T17:59:58.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.847+0000 7f7ae48c8640 1 --2- 172.21.15.6:0/1320588122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae0162820 0x7f7ae00b3940 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f7ae008e070 tx=0x7f7ad002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e2c4d4b4464c0f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.847+0000 7f7adf7fe640 1 -- 172.21.15.6:0/1320588122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0037070 con 0x7f7ae0162820 2024-05-20T17:59:58.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.847+0000 7f7adf7fe640 1 -- 172.21.15.6:0/1320588122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad0032440 con 0x7f7ae0162820 2024-05-20T17:59:58.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.847+0000 7f7adf7fe640 1 -- 172.21.15.6:0/1320588122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0032810 con 0x7f7ae0162820 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.848+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/1320588122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae0162820 msgr2=0x7f7ae00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.848+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/1320588122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae0162820 0x7f7ae00b3940 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f7ae008e070 tx=0x7f7ad002a230 comp rx=0 tx=0).stop 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.848+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/1320588122 shutdown_connections 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.848+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/1320588122 >> v2:172.21.15.171:3300/0 conn(0x7f7ae006dae0 0x7f7ae00b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.848+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/1320588122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae0162820 0x7f7ae00b3940 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.848+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/1320588122 >> 172.21.15.6:0/1320588122 conn(0x7f7ae00d4bd0 msgr2=0x7f7ae00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.848+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/1320588122 shutdown_connections 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.848+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/1320588122 wait complete. 2024-05-20T17:59:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.849+0000 7f7ae6b2c640 1 Processor -- start 2024-05-20T17:59:58.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.850+0000 7f7ae6b2c640 1 -- start start 2024-05-20T17:59:58.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae6b2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae00b3e80 0x7f7ae01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae6b2c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ae0162820 0x7f7ae0147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae6b2c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ae015c020 0x7f7ae01e8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae6b2c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00d4780 con 0x7f7ae00b3e80 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae6b2c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00d0300 con 0x7f7ae015c020 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae6b2c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae00d4900 con 0x7f7ae0162820 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae48c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae00b3e80 0x7f7ae01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae48c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae00b3e80 0x7f7ae01596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53110/0 (socket says 172.21.15.6:53110) 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae48c8640 1 -- 172.21.15.6:0/688614836 learned_addr learned my addr 172.21.15.6:0/688614836 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7adffff640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ae0162820 0x7f7ae0147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae50c9640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ae015c020 0x7f7ae01e8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae48c8640 1 -- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ae0162820 msgr2=0x7f7ae0147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae48c8640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ae0162820 0x7f7ae0147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae48c8640 1 -- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ae015c020 msgr2=0x7f7ae01e8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae48c8640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ae015c020 0x7f7ae01e8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae48c8640 1 -- 172.21.15.6:0/688614836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae015b280 con 0x7f7ae00b3e80 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7adffff640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ae0162820 0x7f7ae0147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.851+0000 7f7ae50c9640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ae015c020 0x7f7ae01e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.852+0000 7f7ae48c8640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae00b3e80 0x7f7ae01596a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0000c00 tx=0x7f7ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.852+0000 7f7add7fa640 1 -- 172.21.15.6:0/688614836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0041070 con 0x7f7ae00b3e80 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.852+0000 7f7add7fa640 1 -- 172.21.15.6:0/688614836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad003c870 con 0x7f7ae00b3e80 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.852+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae015b540 con 0x7f7ae00b3e80 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.852+0000 7f7add7fa640 1 -- 172.21.15.6:0/688614836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0037040 con 0x7f7ae00b3e80 2024-05-20T17:59:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.852+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae015bb00 con 0x7f7ae00b3e80 2024-05-20T17:59:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.853+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae0075b00 con 0x7f7ae00b3e80 2024-05-20T17:59:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.854+0000 7f7add7fa640 1 -- 172.21.15.6:0/688614836 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ad0044070 con 0x7f7ae00b3e80 2024-05-20T17:59:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.854+0000 7f7add7fa640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7acc06be30 0x7f7acc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.854+0000 7f7add7fa640 1 -- 172.21.15.6:0/688614836 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f7ad00ab850 con 0x7f7ae00b3e80 2024-05-20T17:59:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.855+0000 7f7adffff640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7acc06be30 0x7f7acc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.855+0000 7f7adffff640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7acc06be30 0x7f7acc06e340 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4006fd0 tx=0x7f7ad4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:58.859+0000 7f7add7fa640 1 -- 172.21.15.6:0/688614836 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7ad007a400 con 0x7f7ae00b3e80 2024-05-20T17:59:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.044+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7f7ae00b3620 con 0x7f7ae00b3e80 2024-05-20T17:59:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.049+0000 7f7add7fa640 1 -- 172.21.15.6:0/688614836 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v31) ==== 111+0+0 (secure 0 0 0) 0x7f7ad0079d00 con 0x7f7ae00b3e80 2024-05-20T17:59:59.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7acc06be30 msgr2=0x7f7acc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7acc06be30 0x7f7acc06e340 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4006fd0 tx=0x7f7ad4008040 comp rx=0 tx=0).stop 2024-05-20T17:59:59.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae00b3e80 msgr2=0x7f7ae01596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae00b3e80 0x7f7ae01596a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0000c00 tx=0x7f7ad00046c0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 shutdown_connections 2024-05-20T17:59:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7acc06be30 0x7f7acc06e340 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ae015c020 0x7f7ae01e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ae0162820 0x7f7ae0147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 --2- 172.21.15.6:0/688614836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae00b3e80 0x7f7ae01596a0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 >> 172.21.15.6:0/688614836 conn(0x7f7ae00d4bd0 msgr2=0x7f7ae015ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 shutdown_connections 2024-05-20T17:59:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.052+0000 7f7ae6b2c640 1 -- 172.21.15.6:0/688614836 wait complete. 2024-05-20T17:59:59.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T17:59:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.179+0000 7ff2c858f640 1 Processor -- start 2024-05-20T17:59:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.179+0000 7ff2c858f640 1 -- start start 2024-05-20T17:59:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c858f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2c00d2780 0x7ff2c00d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c858f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c008d2a0 con 0x7ff2c006cf00 2024-05-20T17:59:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c858f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c00d30d0 con 0x7ff2c00d4400 2024-05-20T17:59:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c858f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c00d3f70 con 0x7ff2c00d2780 2024-05-20T17:59:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c6b2c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2c00d2780 0x7ff2c00d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c5b2a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff2c006cf00 0x7ff2c006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48848/0 (socket says 172.21.15.6:48848) 2024-05-20T17:59:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c6b2c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff2c00d2780 0x7ff2c00d2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53112/0 (socket says 172.21.15.6:53112) 2024-05-20T17:59:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c5b2a640 1 -- 172.21.15.6:0/1899766519 learned_addr learned my addr 172.21.15.6:0/1899766519 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c6b2c640 1 -- 172.21.15.6:0/1899766519 >> v1:172.21.15.171:6789/0 conn(0x7ff2c00d4400 legacy=0x7ff2c015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c6b2c640 1 -- 172.21.15.6:0/1899766519 >> v1:172.21.15.6:6789/0 conn(0x7ff2c006cf00 legacy=0x7ff2c006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c5329640 1 -- 172.21.15.6:0/1899766519 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459114387 0 0) 0x7ff2b4001110 con 0x7ff2c006cf00 2024-05-20T17:59:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.181+0000 7ff2c6b2c640 1 -- 172.21.15.6:0/1899766519 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c00d4810 con 0x7ff2c00d2780 2024-05-20T17:59:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.182+0000 7ff2c6b2c640 1 --2- 172.21.15.6:0/1899766519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c00d2780 0x7ff2c00d2b90 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80097a0 tx=0x7ff2b802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8940ffedefc31d21 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.182+0000 7ff2c5329640 1 -- 172.21.15.6:0/1899766519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8037070 con 0x7ff2c00d2780 2024-05-20T17:59:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.182+0000 7ff2c5329640 1 -- 172.21.15.6:0/1899766519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b8032640 con 0x7ff2c00d2780 2024-05-20T17:59:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.182+0000 7ff2c5329640 1 -- 172.21.15.6:0/1899766519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8032a10 con 0x7ff2c00d2780 2024-05-20T17:59:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.183+0000 7ff2c858f640 1 -- 172.21.15.6:0/1899766519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c00d2780 msgr2=0x7ff2c00d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.183+0000 7ff2c858f640 1 --2- 172.21.15.6:0/1899766519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c00d2780 0x7ff2c00d2b90 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80097a0 tx=0x7ff2b802a2c0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.183+0000 7ff2c858f640 1 -- 172.21.15.6:0/1899766519 shutdown_connections 2024-05-20T17:59:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.183+0000 7ff2c858f640 1 --2- 172.21.15.6:0/1899766519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c00d2780 0x7ff2c00d2b90 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.183+0000 7ff2c858f640 1 -- 172.21.15.6:0/1899766519 >> 172.21.15.6:0/1899766519 conn(0x7ff2c00d4bb0 msgr2=0x7ff2c00d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.183+0000 7ff2c858f640 1 -- 172.21.15.6:0/1899766519 shutdown_connections 2024-05-20T17:59:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.183+0000 7ff2c858f640 1 -- 172.21.15.6:0/1899766519 wait complete. 2024-05-20T17:59:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.185+0000 7ff2c858f640 1 Processor -- start 2024-05-20T17:59:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.185+0000 7ff2c858f640 1 -- start start 2024-05-20T17:59:59.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c858f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c006cf00 0x7ff2c01f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c858f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00d2780 0x7ff2c0151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c858f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c00d4400 0x7ff2c01531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c858f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00d3920 con 0x7ff2c006cf00 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c858f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00d3680 con 0x7ff2c00d2780 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c858f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c00d3c00 con 0x7ff2c00d4400 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c632b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c006cf00 0x7ff2c01f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c632b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c006cf00 0x7ff2c01f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53124/0 (socket says 172.21.15.6:53124) 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c632b640 1 -- 172.21.15.6:0/2519258325 learned_addr learned my addr 172.21.15.6:0/2519258325 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c5b2a640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00d2780 0x7ff2c0151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.186+0000 7ff2c6b2c640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c00d4400 0x7ff2c01531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2c632b640 1 -- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c00d4400 msgr2=0x7ff2c01531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2c632b640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c00d4400 0x7ff2c01531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2c632b640 1 -- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00d2780 msgr2=0x7ff2c0151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2c632b640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00d2780 0x7ff2c0151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2c632b640 1 -- 172.21.15.6:0/2519258325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c0161b10 con 0x7ff2c006cf00 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2c632b640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c006cf00 0x7ff2c01f5360 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c730 tx=0x7ff2b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2beffd640 1 -- 172.21.15.6:0/2519258325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0003b70 con 0x7ff2c006cf00 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2beffd640 1 -- 172.21.15.6:0/2519258325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b0003d30 con 0x7ff2c006cf00 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c0161df0 con 0x7ff2c006cf00 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2beffd640 1 -- 172.21.15.6:0/2519258325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b000aa90 con 0x7ff2c006cf00 2024-05-20T17:59:59.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.187+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c01620d0 con 0x7ff2c006cf00 2024-05-20T17:59:59.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.188+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c00735a0 con 0x7ff2c006cf00 2024-05-20T17:59:59.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.189+0000 7ff2beffd640 1 -- 172.21.15.6:0/2519258325 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2b000ac30 con 0x7ff2c006cf00 2024-05-20T17:59:59.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.189+0000 7ff2beffd640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2ac06be60 0x7ff2ac06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.189+0000 7ff2beffd640 1 -- 172.21.15.6:0/2519258325 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7ff2b008aad0 con 0x7ff2c006cf00 2024-05-20T17:59:59.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.190+0000 7ff2c5b2a640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2ac06be60 0x7ff2ac06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.191+0000 7ff2c5b2a640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2ac06be60 0x7ff2ac06e370 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0162c70 tx=0x7ff2b4007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.194+0000 7ff2beffd640 1 -- 172.21.15.6:0/2519258325 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff2c00735a0 con 0x7ff2c006cf00 2024-05-20T17:59:59.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.379+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff2c0075b00 con 0x7ff2c006cf00 2024-05-20T17:59:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.385+0000 7ff2beffd640 1 -- 172.21.15.6:0/2519258325 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7ff2b0058fa0 con 0x7ff2c006cf00 2024-05-20T17:59:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2ac06be60 msgr2=0x7ff2ac06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2ac06be60 0x7ff2ac06e370 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0162c70 tx=0x7ff2b4007e40 comp rx=0 tx=0).stop 2024-05-20T17:59:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c006cf00 msgr2=0x7ff2c01f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c006cf00 0x7ff2c01f5360 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c730 tx=0x7ff2b000cbf0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 shutdown_connections 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2ac06be60 0x7ff2ac06e370 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c00d4400 0x7ff2c01531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00d2780 0x7ff2c0151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 --2- 172.21.15.6:0/2519258325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c006cf00 0x7ff2c01f5360 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 >> 172.21.15.6:0/2519258325 conn(0x7ff2c00d4bb0 msgr2=0x7ff2c00cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 shutdown_connections 2024-05-20T17:59:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.387+0000 7ff2c858f640 1 -- 172.21.15.6:0/2519258325 wait complete. 2024-05-20T17:59:59.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-05-20T17:59:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.514+0000 7f44d9910640 1 Processor -- start 2024-05-20T17:59:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.514+0000 7f44d9910640 1 -- start start 2024-05-20T17:59:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d9910640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 0x7f44d406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d9910640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d406dd20 con 0x7f44d4162820 2024-05-20T17:59:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d9910640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d40d0630 con 0x7f44d40b8190 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d9910640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44d40d39c0 con 0x7f44d406d3d0 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f44d4162820 0x7f44d40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48856/0 (socket says 172.21.15.6:48856) 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d2ffd640 1 -- 172.21.15.6:0/335693111 learned_addr learned my addr 172.21.15.6:0/335693111 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d27fc640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 0x7f44d406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280186592 0 0) 0x7f44c4001110 con 0x7f44d4162820 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.516+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44bc003520 con 0x7f44d4162820 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37265098 0 0) 0x7f44d40d0630 con 0x7f44d40b8190 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c4001110 con 0x7f44d40b8190 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3490564671 0 0) 0x7f44bc003520 con 0x7f44d4162820 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 msgr2=0x7f44d406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 0x7f44d406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 >> v1:172.21.15.171:6789/0 conn(0x7f44d40b8190 legacy=0x7f44d40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d40d3ca0 con 0x7f44d4162820 2024-05-20T17:59:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f44c4001840 con 0x7f44d4162820 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 >> v1:172.21.15.6:6789/0 conn(0x7f44d4162820 legacy=0x7f44d40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc003b70 0x7f44bc003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44bc004800 0x7f44bc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 0x7f44bc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44d40d39c0 con 0x7f44bc003b70 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc00bad0 con 0x7f44bc004800 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44bc00bcd0 con 0x7f44d406d3d0 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d2ffd640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc003b70 0x7f44bc003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d27fc640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44bc004800 0x7f44bc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d37fe640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 0x7f44bc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d2ffd640 1 -- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 msgr2=0x7f44bc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d2ffd640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 0x7f44bc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d2ffd640 1 -- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44bc004800 msgr2=0x7f44bc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d2ffd640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44bc004800 0x7f44bc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d2ffd640 1 -- 172.21.15.6:0/335693111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc003520 con 0x7f44bc003b70 2024-05-20T17:59:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.517+0000 7f44d37fe640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44d406d3d0 0x7f44bc005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.518+0000 7f44d2ffd640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc003b70 0x7f44bc003fc0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c4c0 tx=0x7f44bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500538294d40d12d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.518+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4035070 con 0x7f44bc003b70 2024-05-20T17:59:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.518+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c402c040 con 0x7f44bc003b70 2024-05-20T17:59:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.518+0000 7f44d1ffb640 1 -- 172.21.15.6:0/335693111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c400c0e0 con 0x7f44bc003b70 2024-05-20T17:59:59.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.519+0000 7f44d9910640 1 -- 172.21.15.6:0/335693111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc003b70 msgr2=0x7f44bc003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.519+0000 7f44d9910640 1 --2- 172.21.15.6:0/335693111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc003b70 0x7f44bc003fc0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f44c400c4c0 tx=0x7f44bc005830 comp rx=0 tx=0).stop 2024-05-20T17:59:59.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.519+0000 7f44d37fe640 1 -- 172.21.15.6:0/335693111 reap_dead start 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.519+0000 7f44d9910640 1 -- 172.21.15.6:0/335693111 shutdown_connections 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.519+0000 7f44d9910640 1 -- 172.21.15.6:0/335693111 >> 172.21.15.6:0/335693111 conn(0x7f44d40d4bd0 msgr2=0x7f44d40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.519+0000 7f44d9910640 1 -- 172.21.15.6:0/335693111 shutdown_connections 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.519+0000 7f44d9910640 1 -- 172.21.15.6:0/335693111 wait complete. 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.521+0000 7f44d9910640 1 Processor -- start 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.521+0000 7f44d9910640 1 -- start start 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d9910640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44bc003b70 0x7f44d41561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d9910640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44d41f8d10 0x7f44d41f9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d9910640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44d40caa60 0x7f44d40cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d9910640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f44d40d0300 con 0x7f44d40caa60 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d9910640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f44d40d4260 con 0x7f44d41f8d10 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d9910640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44d40b4050 con 0x7f44bc003b70 2024-05-20T17:59:59.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44d40caa60 0x7f44d40cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44d40caa60 0x7f44d40cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53134/0 (socket says 172.21.15.6:53134) 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d37fe640 1 -- 172.21.15.6:0/1636760766 learned_addr learned my addr 172.21.15.6:0/1636760766 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d2ffd640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44bc003b70 0x7f44d41561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d27fc640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44d41f8d10 0x7f44d41f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d37fe640 1 -- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44bc003b70 msgr2=0x7f44d41561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.522+0000 7f44d37fe640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44bc003b70 0x7f44d41561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44d37fe640 1 -- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44d41f8d10 msgr2=0x7f44d41f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44d37fe640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44d41f8d10 0x7f44d41f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44d37fe640 1 -- 172.21.15.6:0/1636760766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d414bf60 con 0x7f44d40caa60 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44d27fc640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44d41f8d10 0x7f44d41f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44d37fe640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44d40caa60 0x7f44d40cae70 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001330 tx=0x7f44cc00ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44bbfff640 1 -- 172.21.15.6:0/1636760766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc019070 con 0x7f44d40caa60 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44bbfff640 1 -- 172.21.15.6:0/1636760766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc006b50 con 0x7f44d40caa60 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44bbfff640 1 -- 172.21.15.6:0/1636760766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc003970 con 0x7f44d40caa60 2024-05-20T17:59:59.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d41f9660 con 0x7f44d40caa60 2024-05-20T17:59:59.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.523+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d4158bb0 con 0x7f44d40caa60 2024-05-20T17:59:59.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.524+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d4075b00 con 0x7f44d40caa60 2024-05-20T17:59:59.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.525+0000 7f44bbfff640 1 -- 172.21.15.6:0/1636760766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44cc01c070 con 0x7f44d40caa60 2024-05-20T17:59:59.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.525+0000 7f44bbfff640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44c006be60 0x7f44c006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.525+0000 7f44bbfff640 1 -- 172.21.15.6:0/1636760766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f44cc089f70 con 0x7f44d40caa60 2024-05-20T17:59:59.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.526+0000 7f44d2ffd640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44c006be60 0x7f44c006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.526+0000 7f44d2ffd640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44c006be60 0x7f44c006e370 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f44c4032000 tx=0x7f44c4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.530+0000 7f44bbfff640 1 -- 172.21.15.6:0/1636760766 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f44d41f9660 con 0x7f44d40caa60 2024-05-20T17:59:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.718+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7f44d40b5fa0 con 0x7f44d40caa60 2024-05-20T17:59:59.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.723+0000 7f44bbfff640 1 -- 172.21.15.6:0/1636760766 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v33) ==== 102+0+0 (secure 0 0 0) 0x7f44d414bf60 con 0x7f44d40caa60 2024-05-20T17:59:59.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44c006be60 msgr2=0x7f44c006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44c006be60 0x7f44c006e370 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f44c4032000 tx=0x7f44c4009030 comp rx=0 tx=0).stop 2024-05-20T17:59:59.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44d40caa60 msgr2=0x7f44d40cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44d40caa60 0x7f44d40cae70 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001330 tx=0x7f44cc00ebe0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 shutdown_connections 2024-05-20T17:59:59.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f44c006be60 0x7f44c006e370 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44d40caa60 0x7f44d40cae70 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44d41f8d10 0x7f44d41f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 --2- 172.21.15.6:0/1636760766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44bc003b70 0x7f44d41561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 >> 172.21.15.6:0/1636760766 conn(0x7f44d40d4bd0 msgr2=0x7f44d40b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:59.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 shutdown_connections 2024-05-20T17:59:59.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.726+0000 7f44d9910640 1 -- 172.21.15.6:0/1636760766 wait complete. 2024-05-20T17:59:59.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set' 2024-05-20T17:59:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.852+0000 7f0f8f56c640 1 Processor -- start 2024-05-20T17:59:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.853+0000 7f0f8f56c640 1 -- start start 2024-05-20T17:59:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.854+0000 7f0f8f56c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f8806d3d0 0x7f0f8806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.854+0000 7f0f8f56c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0f880b8190 0x7f0f880b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.854+0000 7f0f8f56c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8806dd20 con 0x7f0f88162820 2024-05-20T17:59:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.854+0000 7f0f8f56c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0f880d0630 con 0x7f0f880b8190 2024-05-20T17:59:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.854+0000 7f0f8f56c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880d39c0 con 0x7f0f8806d3d0 2024-05-20T17:59:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.854+0000 7f0f8cb07640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f8806d3d0 0x7f0f8806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.854+0000 7f0f8d308640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0f88162820 0x7f0f880b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:34600/0 (socket says 172.21.15.6:34600) 2024-05-20T17:59:59.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.854+0000 7f0f8db09640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0f880b8190 0x7f0f880b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.855+0000 7f0f8d308640 1 -- 172.21.15.6:0/1877648566 learned_addr learned my addr 172.21.15.6:0/1877648566 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T17:59:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.855+0000 7f0f8cb07640 1 -- 172.21.15.6:0/1877648566 >> v2:172.21.15.171:3300/0 conn(0x7f0f880b8190 msgr2=0x7f0f880b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T17:59:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.855+0000 7f0f8cb07640 1 --2- 172.21.15.6:0/1877648566 >> v2:172.21.15.171:3300/0 conn(0x7f0f880b8190 0x7f0f880b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.855+0000 7f0f8cb07640 1 -- 172.21.15.6:0/1877648566 >> v1:172.21.15.171:6789/0 conn(0x7f0f88162820 legacy=0x7f0f880b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.855+0000 7f0f87fff640 1 -- 172.21.15.6:0/1877648566 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590672253 0 0) 0x7f0f80001110 con 0x7f0f88162820 2024-05-20T17:59:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.855+0000 7f0f8cb07640 1 -- 172.21.15.6:0/1877648566 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f880d3ca0 con 0x7f0f8806d3d0 2024-05-20T17:59:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.855+0000 7f0f8db09640 1 --2- 172.21.15.6:0/1877648566 >> v2:172.21.15.171:3300/0 conn(0x7f0f880b8190 0x7f0f880b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T17:59:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.856+0000 7f0f8cb07640 1 --2- 172.21.15.6:0/1877648566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f8806d3d0 0x7f0f8806d7e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0097a0 tx=0x7f0f7c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b9cf0970a80f3c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.856+0000 7f0f87fff640 1 -- 172.21.15.6:0/1877648566 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c037070 con 0x7f0f8806d3d0 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.856+0000 7f0f87fff640 1 -- 172.21.15.6:0/1877648566 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c032440 con 0x7f0f8806d3d0 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.856+0000 7f0f87fff640 1 -- 172.21.15.6:0/1877648566 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c032810 con 0x7f0f8806d3d0 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.857+0000 7f0f8f56c640 1 -- 172.21.15.6:0/1877648566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f8806d3d0 msgr2=0x7f0f8806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.857+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/1877648566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f8806d3d0 0x7f0f8806d7e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0097a0 tx=0x7f0f7c02a180 comp rx=0 tx=0).stop 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.857+0000 7f0f8f56c640 1 -- 172.21.15.6:0/1877648566 shutdown_connections 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.857+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/1877648566 >> v2:172.21.15.171:3300/0 conn(0x7f0f880b8190 0x7f0f880b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.857+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/1877648566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f8806d3d0 0x7f0f8806d7e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.857+0000 7f0f8f56c640 1 -- 172.21.15.6:0/1877648566 >> 172.21.15.6:0/1877648566 conn(0x7f0f880d4bd0 msgr2=0x7f0f880d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.857+0000 7f0f8f56c640 1 -- 172.21.15.6:0/1877648566 shutdown_connections 2024-05-20T17:59:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.857+0000 7f0f8f56c640 1 -- 172.21.15.6:0/1877648566 wait complete. 2024-05-20T17:59:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.859+0000 7f0f8f56c640 1 Processor -- start 2024-05-20T17:59:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.859+0000 7f0f8f56c640 1 -- start start 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8f56c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f8806d3d0 0x7f0f8815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8f56c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b8190 0x7f0f881f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8f56c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f88162820 0x7f0f880cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8f56c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880d0300 con 0x7f0f880b8190 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8f56c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880d4260 con 0x7f0f8806d3d0 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8f56c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880b4050 con 0x7f0f88162820 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8cb07640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b8190 0x7f0f881f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8cb07640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b8190 0x7f0f881f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53136/0 (socket says 172.21.15.6:53136) 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8cb07640 1 -- 172.21.15.6:0/221185670 learned_addr learned my addr 172.21.15.6:0/221185670 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8db09640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f88162820 0x7f0f880cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.860+0000 7f0f8d308640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f8806d3d0 0x7f0f8815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f8cb07640 1 -- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f88162820 msgr2=0x7f0f880cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f8cb07640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f88162820 0x7f0f880cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f8cb07640 1 -- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f8806d3d0 msgr2=0x7f0f8815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f8cb07640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f8806d3d0 0x7f0f8815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f8cb07640 1 -- 172.21.15.6:0/221185670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f881f54f0 con 0x7f0f880b8190 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f8cb07640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b8190 0x7f0f881f4fb0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0097a0 tx=0x7f0f7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f85ffb640 1 -- 172.21.15.6:0/221185670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c037050 con 0x7f0f880b8190 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f85ffb640 1 -- 172.21.15.6:0/221185670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c038040 con 0x7f0f880b8190 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f880ca3d0 con 0x7f0f880b8190 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f85ffb640 1 -- 172.21.15.6:0/221185670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c004490 con 0x7f0f880b8190 2024-05-20T17:59:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.861+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f881e84d0 con 0x7f0f880b8190 2024-05-20T17:59:59.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.862+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8815cf00 con 0x7f0f880b8190 2024-05-20T17:59:59.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.863+0000 7f0f85ffb640 1 -- 172.21.15.6:0/221185670 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f7c03c6d0 con 0x7f0f880b8190 2024-05-20T17:59:59.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.863+0000 7f0f85ffb640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0f7406be60 0x7f0f7406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T17:59:59.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.864+0000 7f0f85ffb640 1 -- 172.21.15.6:0/221185670 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f0f7c0ab480 con 0x7f0f880b8190 2024-05-20T17:59:59.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.864+0000 7f0f8d308640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0f7406be60 0x7f0f7406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T17:59:59.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.864+0000 7f0f8d308640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0f7406be60 0x7f0f7406e370 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007fd0 tx=0x7f0f80007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T17:59:59.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T17:59:59.868+0000 7f0f85ffb640 1 -- 172.21.15.6:0/221185670 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0f8815cf00 con 0x7f0f880b8190 2024-05-20T18:00:00.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:00.125+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]} v 0) -- 0x7f0f880ca5d0 con 0x7f0f880b8190 2024-05-20T18:00:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.043+0000 7f0f85ffb640 1 -- 172.21.15.6:0/221185670 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]}]=0 v354) ==== 160+0+0 (secure 0 0 0) 0x7f0f7c04c020 con 0x7f0f880b8190 2024-05-20T18:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0f7406be60 msgr2=0x7f0f7406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0f7406be60 0x7f0f7406e370 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007fd0 tx=0x7f0f80007de0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b8190 msgr2=0x7f0f881f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b8190 0x7f0f881f4fb0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0097a0 tx=0x7f0f7c0046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 shutdown_connections 2024-05-20T18:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0f7406be60 0x7f0f7406e370 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f88162820 0x7f0f880cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f880b8190 0x7f0f881f4fb0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 --2- 172.21.15.6:0/221185670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f8806d3d0 0x7f0f8815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 >> 172.21.15.6:0/221185670 conn(0x7f0f880d4bd0 msgr2=0x7f0f8815e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 shutdown_connections 2024-05-20T18:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.047+0000 7f0f8f56c640 1 -- 172.21.15.6:0/221185670 wait complete. 2024-05-20T18:00:01.059 INFO:tasks.cephfs_test_runner:When a client has inodes pinned in its cache (open files), that the MDS ... ok 2024-05-20T18:00:01.059 INFO:tasks.cephfs_test_runner:Starting test: test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) When a client does not advance its oldest tid, the MDS should notice that 2024-05-20T18:00:01.059 INFO:tasks.cephfs_test_runner:test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T18:00:01.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.185+0000 7fbe621e0640 1 Processor -- start 2024-05-20T18:00:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.185+0000 7fbe621e0640 1 -- start start 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe621e0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 0x7fbe5c15fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe621e0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbe5c15ca00 0x7fbe5c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe621e0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe5c0b4c00 0x7fbe5c06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe621e0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbe5c0b51c0 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe621e0640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbe5c15bf20 con 0x7fbe5c15ca00 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe621e0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5c15c200 con 0x7fbe5c0b0020 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe5c0b4c00 0x7fbe5c06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe5c0b4c00 0x7fbe5c06c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53152/0 (socket says 172.21.15.6:53152) 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5bfff640 1 -- 172.21.15.6:0/3347808343 learned_addr learned my addr 172.21.15.6:0/3347808343 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5b7fe640 1 --2- 172.21.15.6:0/3347808343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 0x7fbe5c15fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5affd640 1 --2- 172.21.15.6:0/3347808343 >> v2:172.21.15.171:3300/0 conn(0x7fbe5c15ca00 0x7fbe5c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5bfff640 1 -- 172.21.15.6:0/3347808343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 msgr2=0x7fbe5c15fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5bfff640 1 --2- 172.21.15.6:0/3347808343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 0x7fbe5c15fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5bfff640 1 -- 172.21.15.6:0/3347808343 >> v2:172.21.15.171:3300/0 conn(0x7fbe5c15ca00 msgr2=0x7fbe5c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5bfff640 1 --2- 172.21.15.6:0/3347808343 >> v2:172.21.15.171:3300/0 conn(0x7fbe5c15ca00 0x7fbe5c06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.187+0000 7fbe5bfff640 1 -- 172.21.15.6:0/3347808343 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c15c4e0 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.188+0000 7fbe5bfff640 1 --2- 172.21.15.6:0/3347808343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c06c2f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c15c130 tx=0x7fbe5402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f6b2c60ecdb28f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.188+0000 7fbe5a7fc640 1 -- 172.21.15.6:0/3347808343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54036070 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.188+0000 7fbe5a7fc640 1 -- 172.21.15.6:0/3347808343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe54031600 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.188+0000 7fbe5a7fc640 1 -- 172.21.15.6:0/3347808343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe540319d0 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 -- 172.21.15.6:0/3347808343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 msgr2=0x7fbe5c06c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 --2- 172.21.15.6:0/3347808343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c06c2f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c15c130 tx=0x7fbe5402a5f0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 -- 172.21.15.6:0/3347808343 shutdown_connections 2024-05-20T18:00:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 --2- 172.21.15.6:0/3347808343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c06c2f0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 --2- 172.21.15.6:0/3347808343 >> v2:172.21.15.171:3300/0 conn(0x7fbe5c15ca00 0x7fbe5c06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 --2- 172.21.15.6:0/3347808343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 0x7fbe5c15fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 -- 172.21.15.6:0/3347808343 >> 172.21.15.6:0/3347808343 conn(0x7fbe5c0cd2a0 msgr2=0x7fbe5c0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 -- 172.21.15.6:0/3347808343 shutdown_connections 2024-05-20T18:00:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.189+0000 7fbe621e0640 1 -- 172.21.15.6:0/3347808343 wait complete. 2024-05-20T18:00:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.191+0000 7fbe621e0640 1 Processor -- start 2024-05-20T18:00:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.191+0000 7fbe621e0640 1 -- start start 2024-05-20T18:00:01.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe621e0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 0x7fbe5c1f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe621e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe621e0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe5c15ca00 0x7fbe5c1f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe621e0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c06b520 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe621e0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c0b54a0 con 0x7fbe5c15ca00 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe621e0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5c06b6a0 con 0x7fbe5c0b0020 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe5affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe5affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c1564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53156/0 (socket says 172.21.15.6:53156) 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.192+0000 7fbe5affd640 1 -- 172.21.15.6:0/1475794011 learned_addr learned my addr 172.21.15.6:0/1475794011 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe5bfff640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe5c15ca00 0x7fbe5c1f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe5b7fe640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 0x7fbe5c1f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe5affd640 1 -- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 msgr2=0x7fbe5c1f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe5affd640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 0x7fbe5c1f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe5affd640 1 -- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe5c15ca00 msgr2=0x7fbe5c1f1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe5affd640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe5c15ca00 0x7fbe5c1f1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe5affd640 1 -- 172.21.15.6:0/1475794011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c1f4790 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe5affd640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c1564a0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000f950 tx=0x7fbe5000fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe43fff640 1 -- 172.21.15.6:0/1475794011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5000b040 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe43fff640 1 -- 172.21.15.6:0/1475794011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5000dc50 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5c15ec70 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe43fff640 1 -- 172.21.15.6:0/1475794011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50012460 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.193+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5c1f4d10 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.194+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5c075b00 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.195+0000 7fbe43fff640 1 -- 172.21.15.6:0/1475794011 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe50012600 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.196+0000 7fbe43fff640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbe4806be60 0x7fbe4806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.196+0000 7fbe43fff640 1 -- 172.21.15.6:0/1475794011 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7fbe5008c4e0 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.196+0000 7fbe5b7fe640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbe4806be60 0x7fbe4806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.196+0000 7fbe5b7fe640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbe4806be60 0x7fbe4806e370 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0098f0 tx=0x7fbe4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.200+0000 7fbe43fff640 1 -- 172.21.15.6:0/1475794011 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbe50017030 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.386+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe5c06cd30 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.387+0000 7fbe43fff640 1 -- 172.21.15.6:0/1475794011 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+13244 (secure 0 0 0) 0x7fbe5005b000 con 0x7fbe5c0b4c00 2024-05-20T18:00:01.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":92,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T17:59:58.019865+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/3379618192":"2024-05-21T17:59:55.006316+0000","172.21.15.6:6834/3379618192":"2024-05-21T17:59:55.006316+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbe4806be60 msgr2=0x7fbe4806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbe4806be60 0x7fbe4806e370 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0098f0 tx=0x7fbe4c008040 comp rx=0 tx=0).stop 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 msgr2=0x7fbe5c1564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c1564a0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000f950 tx=0x7fbe5000fe10 comp rx=0 tx=0).stop 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 shutdown_connections 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbe4806be60 0x7fbe4806e370 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe5c15ca00 0x7fbe5c1f1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5c0b4c00 0x7fbe5c1564a0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 --2- 172.21.15.6:0/1475794011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbe5c0b0020 0x7fbe5c1f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 >> 172.21.15.6:0/1475794011 conn(0x7fbe5c0cd2a0 msgr2=0x7fbe5c06ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 shutdown_connections 2024-05-20T18:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.389+0000 7fbe621e0640 1 -- 172.21.15.6:0/1475794011 wait complete. 2024-05-20T18:00:01.399 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:00:01.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:00:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.519+0000 7ff1064a6640 1 Processor -- start 2024-05-20T18:00:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.519+0000 7ff1064a6640 1 -- start start 2024-05-20T18:00:01.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.520+0000 7ff1064a6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff1000b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.520+0000 7ff1064a6640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff1000b2390 0x7ff10006d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.520+0000 7ff1064a6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff10006c840 con 0x7ff1000af330 2024-05-20T18:00:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.520+0000 7ff1064a6640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff1000afb50 con 0x7ff1000b2390 2024-05-20T18:00:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.520+0000 7ff1064a6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1000d20d0 con 0x7ff1000af740 2024-05-20T18:00:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff0fffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff1000af330 0x7ff1000d1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:34614/0 (socket says 172.21.15.6:34614) 2024-05-20T18:00:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff0fffff640 1 -- 172.21.15.6:0/1007276672 learned_addr learned my addr 172.21.15.6:0/1007276672 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff0ff7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff1000b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff104a43640 1 --2- 172.21.15.6:0/1007276672 >> v2:172.21.15.171:3300/0 conn(0x7ff1000b2390 0x7ff10006d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff0ff7fe640 1 -- 172.21.15.6:0/1007276672 >> v2:172.21.15.171:3300/0 conn(0x7ff1000b2390 msgr2=0x7ff10006d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff0ff7fe640 1 --2- 172.21.15.6:0/1007276672 >> v2:172.21.15.171:3300/0 conn(0x7ff1000b2390 0x7ff10006d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff0ff7fe640 1 -- 172.21.15.6:0/1007276672 >> v1:172.21.15.171:6789/0 conn(0x7ff1000af330 legacy=0x7ff1000d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff0ff7fe640 1 -- 172.21.15.6:0/1007276672 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10006cae0 con 0x7ff1000af740 2024-05-20T18:00:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.521+0000 7ff0feffd640 1 -- 172.21.15.6:0/1007276672 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251234695 0 0) 0x7ff10006c840 con 0x7ff1000af330 2024-05-20T18:00:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.522+0000 7ff0ff7fe640 1 --2- 172.21.15.6:0/1007276672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff1000b1e50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40097a0 tx=0x7ff0f402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb1cb86048a97a84 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.522+0000 7ff0feffd640 1 -- 172.21.15.6:0/1007276672 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4037070 con 0x7ff1000af740 2024-05-20T18:00:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.522+0000 7ff0feffd640 1 -- 172.21.15.6:0/1007276672 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f4032440 con 0x7ff1000af740 2024-05-20T18:00:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.522+0000 7ff0feffd640 1 -- 172.21.15.6:0/1007276672 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4032810 con 0x7ff1000af740 2024-05-20T18:00:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.523+0000 7ff1064a6640 1 -- 172.21.15.6:0/1007276672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 msgr2=0x7ff1000b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.523+0000 7ff1064a6640 1 --2- 172.21.15.6:0/1007276672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff1000b1e50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40097a0 tx=0x7ff0f402a180 comp rx=0 tx=0).stop 2024-05-20T18:00:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.523+0000 7ff1064a6640 1 -- 172.21.15.6:0/1007276672 shutdown_connections 2024-05-20T18:00:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.523+0000 7ff1064a6640 1 --2- 172.21.15.6:0/1007276672 >> v2:172.21.15.171:3300/0 conn(0x7ff1000b2390 0x7ff10006d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.523+0000 7ff1064a6640 1 --2- 172.21.15.6:0/1007276672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff1000b1e50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.523+0000 7ff1064a6640 1 -- 172.21.15.6:0/1007276672 >> 172.21.15.6:0/1007276672 conn(0x7ff1000b6670 msgr2=0x7ff1000b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.523+0000 7ff1064a6640 1 -- 172.21.15.6:0/1007276672 shutdown_connections 2024-05-20T18:00:01.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.523+0000 7ff1064a6640 1 -- 172.21.15.6:0/1007276672 wait complete. 2024-05-20T18:00:01.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.525+0000 7ff1064a6640 1 Processor -- start 2024-05-20T18:00:01.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.525+0000 7ff1064a6640 1 -- start start 2024-05-20T18:00:01.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff1064a6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1000af330 0x7ff1001507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff1064a6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff100155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff1064a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000b2390 0x7ff10015ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff1064a6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1000b27a0 con 0x7ff1000b2390 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff1064a6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff10006d0a0 con 0x7ff1000af330 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff1064a6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff10015d350 con 0x7ff1000af740 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff104a43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000b2390 0x7ff10015ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff104a43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000b2390 0x7ff10015ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53158/0 (socket says 172.21.15.6:53158) 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.526+0000 7ff104a43640 1 -- 172.21.15.6:0/3763398246 learned_addr learned my addr 172.21.15.6:0/3763398246 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff0fffff640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1000af330 0x7ff1001507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff0ff7fe640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff100155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff104a43640 1 -- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 msgr2=0x7ff100155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff104a43640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff100155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff104a43640 1 -- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1000af330 msgr2=0x7ff1001507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff104a43640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1000af330 0x7ff1001507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff104a43640 1 -- 172.21.15.6:0/3763398246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1000ceb50 con 0x7ff1000b2390 2024-05-20T18:00:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff104a43640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000b2390 0x7ff10015ec00 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8009d30 tx=0x7ff0f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff0fcff9640 1 -- 172.21.15.6:0/3763398246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8018020 con 0x7ff1000b2390 2024-05-20T18:00:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff0fcff9640 1 -- 172.21.15.6:0/3763398246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f8014480 con 0x7ff1000b2390 2024-05-20T18:00:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff0fcff9640 1 -- 172.21.15.6:0/3763398246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8014870 con 0x7ff1000b2390 2024-05-20T18:00:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1001f6a20 con 0x7ff1000b2390 2024-05-20T18:00:01.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.527+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1001f6fe0 con 0x7ff1000b2390 2024-05-20T18:00:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.528+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1001f6770 con 0x7ff1000b2390 2024-05-20T18:00:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.529+0000 7ff0fcff9640 1 -- 172.21.15.6:0/3763398246 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0f8005d10 con 0x7ff1000b2390 2024-05-20T18:00:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.529+0000 7ff0fcff9640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0ec06be60 0x7ff0ec06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.529+0000 7ff0fcff9640 1 -- 172.21.15.6:0/3763398246 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7ff0f808b800 con 0x7ff1000b2390 2024-05-20T18:00:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.530+0000 7ff0fffff640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0ec06be60 0x7ff0ec06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.530+0000 7ff0fffff640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0ec06be60 0x7ff0ec06e370 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0000f60 tx=0x7ff0f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.534+0000 7ff0fcff9640 1 -- 172.21.15.6:0/3763398246 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff0f8022070 con 0x7ff1000b2390 2024-05-20T18:00:01.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.720+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff100075b00 con 0x7ff1000b2390 2024-05-20T18:00:01.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.720+0000 7ff0fcff9640 1 -- 172.21.15.6:0/3763398246 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7ff1000ceb50 con 0x7ff1000b2390 2024-05-20T18:00:01.719 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:00:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.722+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0ec06be60 msgr2=0x7ff0ec06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.722+0000 7ff1064a6640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0ec06be60 0x7ff0ec06e370 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0000f60 tx=0x7ff0f0009040 comp rx=0 tx=0).stop 2024-05-20T18:00:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.722+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000b2390 msgr2=0x7ff10015ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.722+0000 7ff1064a6640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000b2390 0x7ff10015ec00 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8009d30 tx=0x7ff0f800c490 comp rx=0 tx=0).stop 2024-05-20T18:00:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.722+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 shutdown_connections 2024-05-20T18:00:01.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.722+0000 7ff1064a6640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0ec06be60 0x7ff0ec06e370 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.722+0000 7ff1064a6640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1000b2390 0x7ff10015ec00 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.722+0000 7ff1064a6640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1000af740 0x7ff100155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.723+0000 7ff1064a6640 1 --2- 172.21.15.6:0/3763398246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1000af330 0x7ff1001507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.723+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 >> 172.21.15.6:0/3763398246 conn(0x7ff1000b6670 msgr2=0x7ff1000b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.723+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 shutdown_connections 2024-05-20T18:00:01.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.723+0000 7ff1064a6640 1 -- 172.21.15.6:0/3763398246 wait complete. 2024-05-20T18:00:01.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid' 2024-05-20T18:00:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.850+0000 7f0b0a83d640 1 Processor -- start 2024-05-20T18:00:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.850+0000 7f0b0a83d640 1 -- start start 2024-05-20T18:00:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.851+0000 7f0b0a83d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0b04162820 0x7f0b040b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b0a83d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b0406dae0 0x7f0b040b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b0a83d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b040d0630 con 0x7f0b040b3e80 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b0a83d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0b040d39c0 con 0x7f0b04162820 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b0a83d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0b040d3ca0 con 0x7f0b0406dae0 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b03fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0b04162820 0x7f0b040b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b08dda640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b0406dae0 0x7f0b040b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0afbfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0b040b3e80 0x7f0b0406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:34624/0 (socket says 172.21.15.6:34624) 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0afbfff640 1 -- 172.21.15.6:0/3761067698 learned_addr learned my addr 172.21.15.6:0/3761067698 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b03fff640 1 -- 172.21.15.6:0/3761067698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b0406dae0 msgr2=0x7f0b040b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b03fff640 1 --2- 172.21.15.6:0/3761067698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b0406dae0 0x7f0b040b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b03fff640 1 -- 172.21.15.6:0/3761067698 >> v1:172.21.15.171:6789/0 conn(0x7f0b040b3e80 legacy=0x7f0b0406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.852+0000 7f0b03fff640 1 -- 172.21.15.6:0/3761067698 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b040d3f80 con 0x7f0b04162820 2024-05-20T18:00:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.853+0000 7f0b03fff640 1 --2- 172.21.15.6:0/3761067698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 0x7f0b040b3940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0af40097a0 tx=0x7f0af402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c8bdd059289bdbc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.853+0000 7f0b037fe640 1 -- 172.21.15.6:0/3761067698 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4037070 con 0x7f0b04162820 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.853+0000 7f0b037fe640 1 -- 172.21.15.6:0/3761067698 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af4032440 con 0x7f0b04162820 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.853+0000 7f0b037fe640 1 -- 172.21.15.6:0/3761067698 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4032810 con 0x7f0b04162820 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.854+0000 7f0b0a83d640 1 -- 172.21.15.6:0/3761067698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 msgr2=0x7f0b040b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.854+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/3761067698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 0x7f0b040b3940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0af40097a0 tx=0x7f0af402a180 comp rx=0 tx=0).stop 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.854+0000 7f0b0a83d640 1 -- 172.21.15.6:0/3761067698 shutdown_connections 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.854+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/3761067698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b0406dae0 0x7f0b040b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.854+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/3761067698 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 0x7f0b040b3940 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.854+0000 7f0b0a83d640 1 -- 172.21.15.6:0/3761067698 >> 172.21.15.6:0/3761067698 conn(0x7f0b040d4bd0 msgr2=0x7f0b040d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.854+0000 7f0b0a83d640 1 -- 172.21.15.6:0/3761067698 shutdown_connections 2024-05-20T18:00:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.854+0000 7f0b0a83d640 1 -- 172.21.15.6:0/3761067698 wait complete. 2024-05-20T18:00:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.856+0000 7f0b0a83d640 1 Processor -- start 2024-05-20T18:00:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.856+0000 7f0b0a83d640 1 -- start start 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b0a83d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b040b3e80 0x7f0b04150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b0a83d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 0x7f0b040c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b0a83d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b040cc900 0x7f0b040b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b0a83d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040d4780 con 0x7f0b040cc900 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b0a83d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040d0300 con 0x7f0b04162820 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b0a83d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0b040d4900 con 0x7f0b040b3e80 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b08dda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b040cc900 0x7f0b040b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b08dda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b040cc900 0x7f0b040b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53166/0 (socket says 172.21.15.6:53166) 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.857+0000 7f0b08dda640 1 -- 172.21.15.6:0/693996194 learned_addr learned my addr 172.21.15.6:0/693996194 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0afbfff640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 0x7f0b040c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b03fff640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b040b3e80 0x7f0b04150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b08dda640 1 -- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b040b3e80 msgr2=0x7f0b04150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b08dda640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b040b3e80 0x7f0b04150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b08dda640 1 -- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 msgr2=0x7f0b040c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b08dda640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 0x7f0b040c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b08dda640 1 -- 172.21.15.6:0/693996194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b04150560 con 0x7f0b040cc900 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b08dda640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b040cc900 0x7f0b040b5fc0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00efc0 tx=0x7f0afc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b017fa640 1 -- 172.21.15.6:0/693996194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc018020 con 0x7f0b040cc900 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b040cb5d0 con 0x7f0b040cc900 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b017fa640 1 -- 172.21.15.6:0/693996194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc014480 con 0x7f0b040cc900 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b017fa640 1 -- 172.21.15.6:0/693996194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc009e60 con 0x7f0b040cc900 2024-05-20T18:00:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.858+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b040c9240 con 0x7f0b040cc900 2024-05-20T18:00:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.859+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b04075b00 con 0x7f0b040cc900 2024-05-20T18:00:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.860+0000 7f0b017fa640 1 -- 172.21.15.6:0/693996194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0afc005d10 con 0x7f0b040cc900 2024-05-20T18:00:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.860+0000 7f0b017fa640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0ae406be30 0x7f0ae406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.860+0000 7f0b017fa640 1 -- 172.21.15.6:0/693996194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f0afc08ba90 con 0x7f0b040cc900 2024-05-20T18:00:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.861+0000 7f0b03fff640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0ae406be30 0x7f0ae406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.861+0000 7f0b03fff640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0ae406be30 0x7f0ae406e340 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0af4034000 tx=0x7f0af402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:01.865+0000 7f0b017fa640 1 -- 172.21.15.6:0/693996194 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0afc022030 con 0x7f0b040cc900 2024-05-20T18:00:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:02.120+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]} v 0) -- 0x7f0b0415b710 con 0x7f0b040cc900 2024-05-20T18:00:03.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.052+0000 7f0b017fa640 1 -- 172.21.15.6:0/693996194 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]}]=0 v356) ==== 153+0+0 (secure 0 0 0) 0x7f0b04150560 con 0x7f0b040cc900 2024-05-20T18:00:03.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0ae406be30 msgr2=0x7f0ae406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0ae406be30 0x7f0ae406e340 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0af4034000 tx=0x7f0af402e000 comp rx=0 tx=0).stop 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b040cc900 msgr2=0x7f0b040b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b040cc900 0x7f0b040b5fc0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00efc0 tx=0x7f0afc00c490 comp rx=0 tx=0).stop 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 shutdown_connections 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0ae406be30 0x7f0ae406e340 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b040cc900 0x7f0b040b5fc0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b04162820 0x7f0b040c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 --2- 172.21.15.6:0/693996194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b040b3e80 0x7f0b04150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 >> 172.21.15.6:0/693996194 conn(0x7f0b040d4bd0 msgr2=0x7f0b04161d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 shutdown_connections 2024-05-20T18:00:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.055+0000 7f0b0a83d640 1 -- 172.21.15.6:0/693996194 wait complete. 2024-05-20T18:00:03.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T18:00:03.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.194+0000 7f81f687a640 1 Processor -- start 2024-05-20T18:00:03.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.194+0000 7f81f687a640 1 -- start start 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.195+0000 7f81f687a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f015f700 0x7f81f015fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.195+0000 7f81f687a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f0160430 con 0x7f81f006c180 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.195+0000 7f81f687a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f006b6a0 con 0x7f81f00af030 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.195+0000 7f81f687a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81f006bcf0 con 0x7f81f015f700 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81f4e17640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81f006c180 0x7f81f006c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48864/0 (socket says 172.21.15.6:48864) 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81f4e17640 1 -- 172.21.15.6:0/4082780482 learned_addr learned my addr 172.21.15.6:0/4082780482 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81ef7fe640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f015f700 0x7f81f015fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1782147354 0 0) 0x7f81f0160430 con 0x7f81f006c180 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81d8003520 con 0x7f81f006c180 2024-05-20T18:00:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2400723583 0 0) 0x7f81d8003520 con 0x7f81f006c180 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f015f700 msgr2=0x7f81f015fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f015f700 0x7f81f015fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 >> v1:172.21.15.171:6789/0 conn(0x7f81f00af030 legacy=0x7f81f00af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f006b980 con 0x7f81f006c180 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f81e80019f0 con 0x7f81f006c180 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 >> v1:172.21.15.6:6789/0 conn(0x7f81f006c180 legacy=0x7f81f006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d80039e0 0x7f81d8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81d8004800 0x7f81d8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f015f700 0x7f81d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f81f006bcf0 con 0x7f81d80039e0 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81d800baf0 con 0x7f81d8004800 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81d800bcf0 con 0x7f81f015f700 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.196+0000 7f81effff640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d80039e0 0x7f81d8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.197+0000 7f81ef7fe640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81d8004800 0x7f81d8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.197+0000 7f81f4e17640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f015f700 0x7f81d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.197+0000 7f81effff640 1 -- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f015f700 msgr2=0x7f81d8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.197+0000 7f81effff640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f015f700 0x7f81d8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.197+0000 7f81effff640 1 -- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81d8004800 msgr2=0x7f81d8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.197+0000 7f81effff640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81d8004800 0x7f81d8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.197+0000 7f81effff640 1 -- 172.21.15.6:0/4082780482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d8003520 con 0x7f81d80039e0 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.197+0000 7f81ef7fe640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81d8004800 0x7f81d8004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81effff640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d80039e0 0x7f81d8003e50 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f81f006e1f0 tx=0x7f81d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fbc8429e4554a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0001370 con 0x7f81d80039e0 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e00052d0 con 0x7f81d80039e0 2024-05-20T18:00:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81eeffd640 1 -- 172.21.15.6:0/4082780482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e002ab90 con 0x7f81d80039e0 2024-05-20T18:00:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81f687a640 1 -- 172.21.15.6:0/4082780482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d80039e0 msgr2=0x7f81d8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81f687a640 1 --2- 172.21.15.6:0/4082780482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81d80039e0 0x7f81d8003e50 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f81f006e1f0 tx=0x7f81d8005830 comp rx=0 tx=0).stop 2024-05-20T18:00:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81f4e17640 1 -- 172.21.15.6:0/4082780482 reap_dead start 2024-05-20T18:00:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81f687a640 1 -- 172.21.15.6:0/4082780482 shutdown_connections 2024-05-20T18:00:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.198+0000 7f81f687a640 1 -- 172.21.15.6:0/4082780482 >> 172.21.15.6:0/4082780482 conn(0x7f81f00b6620 msgr2=0x7f81f00b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.199+0000 7f81f687a640 1 -- 172.21.15.6:0/4082780482 shutdown_connections 2024-05-20T18:00:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.199+0000 7f81f687a640 1 -- 172.21.15.6:0/4082780482 wait complete. 2024-05-20T18:00:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.200+0000 7f81f687a640 1 Processor -- start 2024-05-20T18:00:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.201+0000 7f81f687a640 1 -- start start 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81f687a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81d80039e0 0x7f81f0161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81f687a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f0144500 0x7f81f01f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81f687a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f0141aa0 0x7f81f0141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81f687a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f81f015fc90 con 0x7f81f0144500 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81f687a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81f015fb10 con 0x7f81f0141aa0 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81f687a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81f015fe10 con 0x7f81d80039e0 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f0144500 0x7f81f01f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f0144500 0x7f81f01f4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53186/0 (socket says 172.21.15.6:53186) 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 -- 172.21.15.6:0/566862249 learned_addr learned my addr 172.21.15.6:0/566862249 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81f4e17640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f0141aa0 0x7f81f0141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81effff640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81d80039e0 0x7f81f0161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 -- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81d80039e0 msgr2=0x7f81f0161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81d80039e0 0x7f81f0161c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 -- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f0141aa0 msgr2=0x7f81f0141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f0141aa0 0x7f81f0141eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 -- 172.21.15.6:0/566862249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f01478f0 con 0x7f81f0144500 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ef7fe640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f0144500 0x7f81f01f4f90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f81e4011700 tx=0x7f81e4011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.202+0000 7f81ecff9640 1 -- 172.21.15.6:0/566862249 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e400f9c0 con 0x7f81f0144500 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.203+0000 7f81ecff9640 1 -- 172.21.15.6:0/566862249 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e400fb60 con 0x7f81f0144500 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.203+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f0160bd0 con 0x7f81f0144500 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.203+0000 7f81ecff9640 1 -- 172.21.15.6:0/566862249 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4015460 con 0x7f81f0144500 2024-05-20T18:00:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.203+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f0161190 con 0x7f81f0144500 2024-05-20T18:00:03.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.204+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f0075b00 con 0x7f81f0144500 2024-05-20T18:00:03.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.204+0000 7f81ecff9640 1 -- 172.21.15.6:0/566862249 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81e4015600 con 0x7f81f0144500 2024-05-20T18:00:03.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.205+0000 7f81ecff9640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81dc06be30 0x7f81dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.205+0000 7f81ecff9640 1 -- 172.21.15.6:0/566862249 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f81e408b7a0 con 0x7f81f0144500 2024-05-20T18:00:03.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.205+0000 7f81effff640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81dc06be30 0x7f81dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.205+0000 7f81effff640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81dc06be30 0x7f81dc06e340 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f81e0032000 tx=0x7f81e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:03.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.209+0000 7f81ecff9640 1 -- 172.21.15.6:0/566862249 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f81f01478f0 con 0x7f81f0144500 2024-05-20T18:00:03.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.391+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f81f00d1630 con 0x7f81f0144500 2024-05-20T18:00:03.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.395+0000 7f81ecff9640 1 -- 172.21.15.6:0/566862249 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f81e4019030 con 0x7f81f0144500 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81dc06be30 msgr2=0x7f81dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81dc06be30 0x7f81dc06e340 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f81e0032000 tx=0x7f81e002e000 comp rx=0 tx=0).stop 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f0144500 msgr2=0x7f81f01f4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f0144500 0x7f81f01f4f90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f81e4011700 tx=0x7f81e4011bc0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 shutdown_connections 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81dc06be30 0x7f81dc06e340 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f0141aa0 0x7f81f0141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f0144500 0x7f81f01f4f90 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 --2- 172.21.15.6:0/566862249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81d80039e0 0x7f81f0161c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 >> 172.21.15.6:0/566862249 conn(0x7f81f00b6620 msgr2=0x7f81f00d1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 shutdown_connections 2024-05-20T18:00:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.397+0000 7f81f687a640 1 -- 172.21.15.6:0/566862249 wait complete. 2024-05-20T18:00:03.407 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:00:03.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:00:03.443 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:00:03.487 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:00:03.487 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:03.487 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:03.503 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:00:03.503 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:03.503 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:03.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 none /run/credentials/systemd-tmpfiles-clean.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 2024-05-20T18:00:03.547 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:03.547 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:03.562 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:00:03.563 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:03.563 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:03.604 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:00:03.604 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T18:00:03.604 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:03.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.721+0000 7f5e0f087640 1 Processor -- start 2024-05-20T18:00:03.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.721+0000 7f5e0f087640 1 -- start start 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.722+0000 7f5e0f087640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e080cd1b0 0x7f5e0815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.722+0000 7f5e0f087640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e080ce2b0 con 0x7f5e08071630 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.722+0000 7f5e0f087640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e0806cce0 con 0x7f5e08070850 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.722+0000 7f5e0f087640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5e0815f790 con 0x7f5e080cd1b0 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.722+0000 7f5e0ce23640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5e08071630 0x7f5e0806d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48870/0 (socket says 172.21.15.6:48870) 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.722+0000 7f5e0ce23640 1 -- 172.21.15.6:0/3402073180 learned_addr learned my addr 172.21.15.6:0/3402073180 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dfffff640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e080cd1b0 0x7f5e0815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053803018 0 0) 0x7f5e080ce2b0 con 0x7f5e08071630 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df0003520 con 0x7f5e08071630 2024-05-20T18:00:03.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239113710 0 0) 0x7f5e0806cce0 con 0x7f5e08070850 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e080ce2b0 con 0x7f5e08070850 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1067232072 0 0) 0x7f5df0003520 con 0x7f5e08071630 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e080cd1b0 msgr2=0x7f5e0815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e080cd1b0 0x7f5e0815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 >> v1:172.21.15.171:6789/0 conn(0x7f5e08070850 legacy=0x7f5e08070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0806cfc0 con 0x7f5e08071630 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5e040019f0 con 0x7f5e08071630 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 >> v1:172.21.15.6:6789/0 conn(0x7f5e08071630 legacy=0x7f5e0806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5df0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e080cd1b0 0x7f5df0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5df0004d40 0x7f5df0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0815f790 con 0x7f5df0003b70 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5df000bbb0 con 0x7f5df0004d40 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5df000bdb0 con 0x7f5e080cd1b0 2024-05-20T18:00:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5e0ce23640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5df0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5dfffff640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e080cd1b0 0x7f5df0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.723+0000 7f5e0d624640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5df0004d40 0x7f5df0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.724+0000 7f5e0ce23640 1 -- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e080cd1b0 msgr2=0x7f5df0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.724+0000 7f5e0ce23640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e080cd1b0 0x7f5df0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.724+0000 7f5e0ce23640 1 -- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5df0004d40 msgr2=0x7f5df0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.724+0000 7f5e0ce23640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5df0004d40 0x7f5df0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.724+0000 7f5e0ce23640 1 -- 172.21.15.6:0/3402073180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df0003520 con 0x7f5df0003b70 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.724+0000 7f5e0ce23640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5df0003fc0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400a810 tx=0x7f5df0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f17f8e5414ccafb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400a430 con 0x7f5df0003b70 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0402f070 con 0x7f5df0003b70 2024-05-20T18:00:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5dff7fe640 1 -- 172.21.15.6:0/3402073180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0402bc70 con 0x7f5df0003b70 2024-05-20T18:00:03.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5e0f087640 1 -- 172.21.15.6:0/3402073180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 msgr2=0x7f5df0003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5e0f087640 1 --2- 172.21.15.6:0/3402073180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5df0003fc0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400a810 tx=0x7f5df0005830 comp rx=0 tx=0).stop 2024-05-20T18:00:03.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5e0d624640 1 -- 172.21.15.6:0/3402073180 reap_dead start 2024-05-20T18:00:03.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5e0f087640 1 -- 172.21.15.6:0/3402073180 shutdown_connections 2024-05-20T18:00:03.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5e0f087640 1 -- 172.21.15.6:0/3402073180 >> 172.21.15.6:0/3402073180 conn(0x7f5e080d29d0 msgr2=0x7f5e080d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5e0f087640 1 -- 172.21.15.6:0/3402073180 shutdown_connections 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.725+0000 7f5e0f087640 1 -- 172.21.15.6:0/3402073180 wait complete. 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.727+0000 7f5e0f087640 1 Processor -- start 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.727+0000 7f5e0f087640 1 -- start start 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.728+0000 7f5e0f087640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5e081e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0f087640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e080b6db0 0x7f5e081e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0f087640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e081e81d0 0x7f5e081f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0f087640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0806ded0 con 0x7f5df0003b70 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0f087640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0806c990 con 0x7f5e080b6db0 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0f087640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5e081f6730 con 0x7f5e081e81d0 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5e081e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5e081e9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53214/0 (socket says 172.21.15.6:53214) 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 -- 172.21.15.6:0/1704609455 learned_addr learned my addr 172.21.15.6:0/1704609455 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0d624640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e081e81d0 0x7f5e081f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5dfffff640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e080b6db0 0x7f5e081e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 -- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e081e81d0 msgr2=0x7f5e081f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e081e81d0 0x7f5e081f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 -- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e080b6db0 msgr2=0x7f5e081e7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e080b6db0 0x7f5e081e7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 -- 172.21.15.6:0/1704609455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e081ea300 con 0x7f5df0003b70 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0ce23640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5e081e9dc0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400a930 tx=0x7f5e0806ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5dfd7fa640 1 -- 172.21.15.6:0/1704609455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04045070 con 0x7f5df0003b70 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5dfd7fa640 1 -- 172.21.15.6:0/1704609455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0402bc20 con 0x7f5df0003b70 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e080b5d10 con 0x7f5df0003b70 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5dfd7fa640 1 -- 172.21.15.6:0/1704609455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04034470 con 0x7f5df0003b70 2024-05-20T18:00:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.729+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e080b62d0 con 0x7f5df0003b70 2024-05-20T18:00:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.731+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e08075b00 con 0x7f5df0003b70 2024-05-20T18:00:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.731+0000 7f5dfd7fa640 1 -- 172.21.15.6:0/1704609455 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e04048070 con 0x7f5df0003b70 2024-05-20T18:00:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.732+0000 7f5dfd7fa640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5df406be60 0x7f5df406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.732+0000 7f5dfd7fa640 1 -- 172.21.15.6:0/1704609455 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f5e040aae50 con 0x7f5df0003b70 2024-05-20T18:00:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.732+0000 7f5dfffff640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5df406be60 0x7f5df406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.732+0000 7f5dfffff640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5df406be60 0x7f5df406e370 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5e080b8680 tx=0x7f5df8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:03.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.736+0000 7f5dfd7fa640 1 -- 172.21.15.6:0/1704609455 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5e04079470 con 0x7f5df0003b70 2024-05-20T18:00:03.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.965+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e08071410 con 0x7f5df0003b70 2024-05-20T18:00:03.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.965+0000 7f5dfd7fa640 1 -- 172.21.15.6:0/1704609455 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+3866 (secure 0 0 0) 0x7f5e0407d770 con 0x7f5df0003b70 2024-05-20T18:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/4216834090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":4216834090},{"type":"v1","addr":"172.21.15.171:6836","nonce":4216834090}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":6631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1870629940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1870629940},{"type":"v1","addr":"172.21.15.171:6837","nonce":1870629940}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7071,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/3012084004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3012084004},{"type":"v1","addr":"172.21.15.6:6833","nonce":3012084004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":47},{"gid":7629,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/605227627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":605227627},{"type":"v1","addr":"172.21.15.6:6835","nonce":605227627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[]} 2024-05-20T18:00:03.964 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 59 2024-05-20T18:00:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.967+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5df406be60 msgr2=0x7f5df406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.967+0000 7f5e0f087640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5df406be60 0x7f5df406e370 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5e080b8680 tx=0x7f5df8009190 comp rx=0 tx=0).stop 2024-05-20T18:00:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 msgr2=0x7f5e081e9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5e081e9dc0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400a930 tx=0x7f5e0806ceb0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 shutdown_connections 2024-05-20T18:00:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5df406be60 0x7f5df406e370 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e081e81d0 0x7f5e081f5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e080b6db0 0x7f5e081e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 --2- 172.21.15.6:0/1704609455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5df0003b70 0x7f5e081e9dc0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 >> 172.21.15.6:0/1704609455 conn(0x7f5e080d29d0 msgr2=0x7f5e080d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 shutdown_connections 2024-05-20T18:00:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:03.968+0000 7f5e0f087640 1 -- 172.21.15.6:0/1704609455 wait complete. 2024-05-20T18:00:03.977 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T18:00:03.978 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T18:00:03.978 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T18:00:03.978 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:00:03.978 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T18:00:03.978 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T18:00:03.978 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T18:00:03.979 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:00:03.979 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T18:00:03.979 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T18:00:03.979 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T18:00:03.979 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:00:03.979 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T18:00:03.979 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T18:00:03.980 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T18:00:03.980 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:00:03.988 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T18:00:03.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T18:00:03.990 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T18:00:03.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T18:00:03.992 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T18:00:03.992 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T18:00:04.032 INFO:tasks.ceph.mds.a:Started 2024-05-20T18:00:04.032 DEBUG:teuthology.parallel:result is None 2024-05-20T18:00:04.033 INFO:tasks.ceph.mds.c:Started 2024-05-20T18:00:04.034 DEBUG:teuthology.parallel:result is None 2024-05-20T18:00:04.034 INFO:tasks.ceph.mds.d:Started 2024-05-20T18:00:04.035 DEBUG:teuthology.parallel:result is None 2024-05-20T18:00:04.120 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T18:00:04.120 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T18:00:04.130 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T18:00:06.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:00:06.916 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:00:08.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-20T18:00:09.992 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T18:00:09.992 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T18:00:09.995 INFO:tasks.ceph.mds.b:Started 2024-05-20T18:00:09.995 DEBUG:teuthology.parallel:result is None 2024-05-20T18:00:09.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T18:00:10.092 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T18:00:10.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.130+0000 7f530c7f5640 1 Processor -- start 2024-05-20T18:00:10.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.130+0000 7f530c7f5640 1 -- start start 2024-05-20T18:00:10.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530c7f5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5304162820 0x7f53040b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530c7f5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53040d0630 con 0x7f53040b3e80 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530c7f5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53040d39c0 con 0x7f530406dae0 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530c7f5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53040d3ca0 con 0x7f5304162820 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f5309d90640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f53040b3e80 0x7f530406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37980/0 (socket says 172.21.15.6:37980) 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f5309d90640 1 -- 172.21.15.6:0/1210206126 learned_addr learned my addr 172.21.15.6:0/1210206126 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530a591640 1 --2- 172.21.15.6:0/1210206126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5304162820 0x7f53040b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530958f640 1 -- 172.21.15.6:0/1210206126 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518249967 0 0) 0x7f53040d0630 con 0x7f53040b3e80 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530958f640 1 -- 172.21.15.6:0/1210206126 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52f0003520 con 0x7f53040b3e80 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530958f640 1 -- 172.21.15.6:0/1210206126 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666565238 0 0) 0x7f53040d39c0 con 0x7f530406dae0 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530958f640 1 -- 172.21.15.6:0/1210206126 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53040d0630 con 0x7f530406dae0 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530a591640 1 -- 172.21.15.6:0/1210206126 >> v1:172.21.15.171:6789/0 conn(0x7f530406dae0 legacy=0x7f53040b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530a591640 1 -- 172.21.15.6:0/1210206126 >> v1:172.21.15.6:6789/0 conn(0x7f53040b3e80 legacy=0x7f530406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:10.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.132+0000 7f530a591640 1 -- 172.21.15.6:0/1210206126 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53040d3f80 con 0x7f5304162820 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.133+0000 7f530a591640 1 --2- 172.21.15.6:0/1210206126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5304162820 0x7f53040b3940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53000097d0 tx=0x7f530002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ee1ad92e926e1d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.133+0000 7f530958f640 1 -- 172.21.15.6:0/1210206126 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300037070 con 0x7f5304162820 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.133+0000 7f530958f640 1 -- 172.21.15.6:0/1210206126 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5300032440 con 0x7f5304162820 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.133+0000 7f530958f640 1 -- 172.21.15.6:0/1210206126 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300032810 con 0x7f5304162820 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.134+0000 7f530c7f5640 1 -- 172.21.15.6:0/1210206126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5304162820 msgr2=0x7f53040b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.134+0000 7f530c7f5640 1 --2- 172.21.15.6:0/1210206126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5304162820 0x7f53040b3940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53000097d0 tx=0x7f530002a210 comp rx=0 tx=0).stop 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.134+0000 7f530c7f5640 1 -- 172.21.15.6:0/1210206126 shutdown_connections 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.134+0000 7f530c7f5640 1 --2- 172.21.15.6:0/1210206126 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5304162820 0x7f53040b3940 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.134+0000 7f530c7f5640 1 -- 172.21.15.6:0/1210206126 >> 172.21.15.6:0/1210206126 conn(0x7f53040d4bd0 msgr2=0x7f53040d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.134+0000 7f530c7f5640 1 -- 172.21.15.6:0/1210206126 shutdown_connections 2024-05-20T18:00:10.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.134+0000 7f530c7f5640 1 -- 172.21.15.6:0/1210206126 wait complete. 2024-05-20T18:00:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.136+0000 7f530c7f5640 1 Processor -- start 2024-05-20T18:00:10.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.136+0000 7f530c7f5640 1 -- start start 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.137+0000 7f530c7f5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53040b3e80 0x7f5304149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.137+0000 7f530c7f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5304162820 0x7f530415c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.137+0000 7f530c7f5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53041563b0 0x7f530415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.137+0000 7f530c7f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53040d4780 con 0x7f5304162820 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.137+0000 7f530c7f5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f53040d0300 con 0x7f53040b3e80 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.137+0000 7f530c7f5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53040d4900 con 0x7f53041563b0 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5304162820 0x7f530415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5304162820 0x7f530415c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42570/0 (socket says 172.21.15.6:42570) 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 -- 172.21.15.6:0/483186074 learned_addr learned my addr 172.21.15.6:0/483186074 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f530a591640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53040b3e80 0x7f5304149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:10.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f530ad92640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53041563b0 0x7f530415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 -- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53041563b0 msgr2=0x7f530415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53041563b0 0x7f530415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 -- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53040b3e80 msgr2=0x7f5304149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53040b3e80 0x7f5304149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 -- 172.21.15.6:0/483186074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5304156c30 con 0x7f5304162820 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f530ad92640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53041563b0 0x7f530415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f5309d90640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5304162820 0x7f530415c290 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c3e0 tx=0x7f52f400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f52faffd640 1 -- 172.21.15.6:0/483186074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4017070 con 0x7f5304162820 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f52faffd640 1 -- 172.21.15.6:0/483186074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f4005ce0 con 0x7f5304162820 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5304156f10 con 0x7f5304162820 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f52faffd640 1 -- 172.21.15.6:0/483186074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40072d0 con 0x7f5304162820 2024-05-20T18:00:10.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.138+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53041574d0 con 0x7f5304162820 2024-05-20T18:00:10.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.139+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5304075b00 con 0x7f5304162820 2024-05-20T18:00:10.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.140+0000 7f52faffd640 1 -- 172.21.15.6:0/483186074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52f401a070 con 0x7f5304162820 2024-05-20T18:00:10.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.141+0000 7f52faffd640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52e806be30 0x7f52e806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:10.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.141+0000 7f52faffd640 1 -- 172.21.15.6:0/483186074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5335+0+0 (secure 0 0 0) 0x7f52f408a0b0 con 0x7f5304162820 2024-05-20T18:00:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.141+0000 7f530a591640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52e806be30 0x7f52e806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:10.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.141+0000 7f530a591640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52e806be30 0x7f52e806e340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5300034000 tx=0x7f530002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:10.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.146+0000 7f52faffd640 1 -- 172.21.15.6:0/483186074 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f52f40584f0 con 0x7f5304162820 2024-05-20T18:00:10.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:10.343+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5304161330 con 0x7f5304162820 2024-05-20T18:00:12.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.081+0000 7f52faffd640 1 -- 172.21.15.6:0/483186074 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) ==== 97+0+0 (secure 0 0 0) 0x7f52f405c7f0 con 0x7f5304162820 2024-05-20T18:00:12.079 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T18:00:12.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52e806be30 msgr2=0x7f52e806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52e806be30 0x7f52e806e340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5300034000 tx=0x7f530002e000 comp rx=0 tx=0).stop 2024-05-20T18:00:12.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5304162820 msgr2=0x7f530415c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5304162820 0x7f530415c290 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c3e0 tx=0x7f52f400c8a0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 shutdown_connections 2024-05-20T18:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f52e806be30 0x7f52e806e340 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53041563b0 0x7f530415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5304162820 0x7f530415c290 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 --2- 172.21.15.6:0/483186074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53040b3e80 0x7f5304149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 >> 172.21.15.6:0/483186074 conn(0x7f53040d4bd0 msgr2=0x7f530415e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 shutdown_connections 2024-05-20T18:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.084+0000 7f530c7f5640 1 -- 172.21.15.6:0/483186074 wait complete. 2024-05-20T18:00:12.097 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T18:00:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.221+0000 7fef84061640 1 Processor -- start 2024-05-20T18:00:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.221+0000 7fef84061640 1 -- start start 2024-05-20T18:00:12.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.222+0000 7fef84061640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fef7c0d10e0 0x7fef7c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.222+0000 7fef84061640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef7c0d14f0 0x7fef7c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.222+0000 7fef84061640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7c0d1ac0 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.222+0000 7fef84061640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fef7c0d1da0 con 0x7fef7c0d14f0 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.222+0000 7fef84061640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fef7c0d2080 con 0x7fef7c0d10e0 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef815fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef7c0d14f0 0x7fef7c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef825fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef7c0cd4d0 0x7fef7c0cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37990/0 (socket says 172.21.15.6:37990) 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef825fe640 1 -- 172.21.15.6:0/642041762 learned_addr learned my addr 172.21.15.6:0/642041762 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef81dfd640 1 --2- 172.21.15.6:0/642041762 >> v2:172.21.15.171:3300/0 conn(0x7fef7c0d10e0 0x7fef7c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef815fc640 1 -- 172.21.15.6:0/642041762 >> v2:172.21.15.171:3300/0 conn(0x7fef7c0d10e0 msgr2=0x7fef7c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef815fc640 1 --2- 172.21.15.6:0/642041762 >> v2:172.21.15.171:3300/0 conn(0x7fef7c0d10e0 0x7fef7c0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef815fc640 1 -- 172.21.15.6:0/642041762 >> v1:172.21.15.6:6789/0 conn(0x7fef7c0cd4d0 legacy=0x7fef7c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef80dfb640 1 -- 172.21.15.6:0/642041762 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652116021 0 0) 0x7fef7c0d1ac0 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.223+0000 7fef815fc640 1 -- 172.21.15.6:0/642041762 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c0d2360 con 0x7fef7c0d14f0 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.224+0000 7fef815fc640 1 --2- 172.21.15.6:0/642041762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0d14f0 0x7fef7c0cf680 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0ccfc0 tx=0x7fef6c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13814bfecd43ca5f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.224+0000 7fef80dfb640 1 -- 172.21.15.6:0/642041762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c037070 con 0x7fef7c0d14f0 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.224+0000 7fef80dfb640 1 -- 172.21.15.6:0/642041762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6c032440 con 0x7fef7c0d14f0 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.224+0000 7fef80dfb640 1 -- 172.21.15.6:0/642041762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c032810 con 0x7fef7c0d14f0 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.225+0000 7fef84061640 1 -- 172.21.15.6:0/642041762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0d14f0 msgr2=0x7fef7c0cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.225+0000 7fef84061640 1 --2- 172.21.15.6:0/642041762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0d14f0 0x7fef7c0cf680 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0ccfc0 tx=0x7fef6c02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.225+0000 7fef84061640 1 -- 172.21.15.6:0/642041762 shutdown_connections 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.225+0000 7fef84061640 1 --2- 172.21.15.6:0/642041762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0d14f0 0x7fef7c0cf680 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.225+0000 7fef84061640 1 --2- 172.21.15.6:0/642041762 >> v2:172.21.15.171:3300/0 conn(0x7fef7c0d10e0 0x7fef7c0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.225+0000 7fef84061640 1 -- 172.21.15.6:0/642041762 >> 172.21.15.6:0/642041762 conn(0x7fef7c0b44d0 msgr2=0x7fef7c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.225+0000 7fef84061640 1 -- 172.21.15.6:0/642041762 shutdown_connections 2024-05-20T18:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.225+0000 7fef84061640 1 -- 172.21.15.6:0/642041762 wait complete. 2024-05-20T18:00:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.227+0000 7fef84061640 1 Processor -- start 2024-05-20T18:00:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.227+0000 7fef84061640 1 -- start start 2024-05-20T18:00:12.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef84061640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0cd4d0 0x7fef7c155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef84061640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef7c0d10e0 0x7fef7c0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef84061640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef7c0d14f0 0x7fef7c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef84061640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0b8440 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef84061640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0b82c0 con 0x7fef7c0d10e0 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef84061640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c0709f0 con 0x7fef7c0d14f0 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef81dfd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0cd4d0 0x7fef7c155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef81dfd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0cd4d0 0x7fef7c155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42588/0 (socket says 172.21.15.6:42588) 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef81dfd640 1 -- 172.21.15.6:0/1390233722 learned_addr learned my addr 172.21.15.6:0/1390233722 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef815fc640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef7c0d10e0 0x7fef7c0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef825fe640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef7c0d14f0 0x7fef7c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef81dfd640 1 -- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef7c0d14f0 msgr2=0x7fef7c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef81dfd640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef7c0d14f0 0x7fef7c0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef81dfd640 1 -- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef7c0d10e0 msgr2=0x7fef7c0c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef81dfd640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef7c0d10e0 0x7fef7c0c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef81dfd640 1 -- 172.21.15.6:0/1390233722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c0c7080 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.228+0000 7fef815fc640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef7c0d10e0 0x7fef7c0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.229+0000 7fef81dfd640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0cd4d0 0x7fef7c155d90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fef7800d5f0 tx=0x7fef7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.229+0000 7fef727fc640 1 -- 172.21.15.6:0/1390233722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef780125f0 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.229+0000 7fef727fc640 1 -- 172.21.15.6:0/1390233722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef78019070 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.229+0000 7fef727fc640 1 -- 172.21.15.6:0/1390233722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef780129d0 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.229+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c0c7360 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.229+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c0c7920 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.230+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7c075b00 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.231+0000 7fef727fc640 1 -- 172.21.15.6:0/1390233722 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef78012b70 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.231+0000 7fef727fc640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef6006be30 0x7fef6006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.231+0000 7fef727fc640 1 -- 172.21.15.6:0/1390233722 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5249+0+0 (secure 0 0 0) 0x7fef7808b050 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.231+0000 7fef815fc640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef6006be30 0x7fef6006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.232+0000 7fef815fc640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef6006be30 0x7fef6006e340 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fef6c034000 tx=0x7fef6c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.236+0000 7fef727fc640 1 -- 172.21.15.6:0/1390233722 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fef78059bc0 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.490+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fef7c0c7d00 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.491+0000 7fef727fc640 1 -- 172.21.15.6:0/1390233722 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fef780594c0 con 0x7fef7c0cd4d0 2024-05-20T18:00:12.489 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:12.489 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:00:12.489 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T18:00:12.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T18:00:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T18:00:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T18:00:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T18:00:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T18:00:12.503 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:00:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef6006be30 msgr2=0x7fef6006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef6006be30 0x7fef6006e340 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fef6c034000 tx=0x7fef6c02e000 comp rx=0 tx=0).stop 2024-05-20T18:00:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0cd4d0 msgr2=0x7fef7c155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0cd4d0 0x7fef7c155d90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fef7800d5f0 tx=0x7fef7800dab0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 shutdown_connections 2024-05-20T18:00:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef6006be30 0x7fef6006e340 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef7c0d14f0 0x7fef7c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef7c0d10e0 0x7fef7c0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 --2- 172.21.15.6:0/1390233722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef7c0cd4d0 0x7fef7c155d90 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 >> 172.21.15.6:0/1390233722 conn(0x7fef7c0b44d0 msgr2=0x7fef7c0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 shutdown_connections 2024-05-20T18:00:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.493+0000 7fef84061640 1 -- 172.21.15.6:0/1390233722 wait complete. 2024-05-20T18:00:12.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.622+0000 7fb68212f640 1 Processor -- start 2024-05-20T18:00:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.622+0000 7fb68212f640 1 -- start start 2024-05-20T18:00:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb68212f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb68212f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb67c06dae0 0x7fb67c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb68212f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c0d0630 con 0x7fb67c0b3e80 2024-05-20T18:00:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb68212f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb67c0d39c0 con 0x7fb67c06dae0 2024-05-20T18:00:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb68212f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb67c0d3ca0 con 0x7fb67c162820 2024-05-20T18:00:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb67c06dae0 0x7fb67c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb67c06dae0 0x7fb67c0b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42602/0 (socket says 172.21.15.6:42602) 2024-05-20T18:00:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67bfff640 1 -- 172.21.15.6:0/822506177 learned_addr learned my addr 172.21.15.6:0/822506177 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/822506177 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67bfff640 1 -- 172.21.15.6:0/822506177 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 msgr2=0x7fb67c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67bfff640 1 --2- 172.21.15.6:0/822506177 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67bfff640 1 -- 172.21.15.6:0/822506177 >> v1:172.21.15.171:6789/0 conn(0x7fb67c0b3e80 legacy=0x7fb67c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67bfff640 1 -- 172.21.15.6:0/822506177 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c0d3f80 con 0x7fb67c06dae0 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.624+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/822506177 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.625+0000 7fb67bfff640 1 --2- 172.21.15.6:0/822506177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c06dae0 0x7fb67c0b8190 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb674009e50 tx=0x7fb67402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6a0b9bc49a9c1b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.625+0000 7fb67a7fc640 1 -- 172.21.15.6:0/822506177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674036070 con 0x7fb67c06dae0 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.625+0000 7fb67a7fc640 1 -- 172.21.15.6:0/822506177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb674031600 con 0x7fb67c06dae0 2024-05-20T18:00:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.625+0000 7fb67a7fc640 1 -- 172.21.15.6:0/822506177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6740319d0 con 0x7fb67c06dae0 2024-05-20T18:00:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.626+0000 7fb68212f640 1 -- 172.21.15.6:0/822506177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c06dae0 msgr2=0x7fb67c0b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.626+0000 7fb68212f640 1 --2- 172.21.15.6:0/822506177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c06dae0 0x7fb67c0b8190 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb674009e50 tx=0x7fb67402a710 comp rx=0 tx=0).stop 2024-05-20T18:00:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.626+0000 7fb68212f640 1 -- 172.21.15.6:0/822506177 shutdown_connections 2024-05-20T18:00:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.626+0000 7fb68212f640 1 --2- 172.21.15.6:0/822506177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c06dae0 0x7fb67c0b8190 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.626+0000 7fb68212f640 1 --2- 172.21.15.6:0/822506177 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.626+0000 7fb68212f640 1 -- 172.21.15.6:0/822506177 >> 172.21.15.6:0/822506177 conn(0x7fb67c0d4bd0 msgr2=0x7fb67c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.626+0000 7fb68212f640 1 -- 172.21.15.6:0/822506177 shutdown_connections 2024-05-20T18:00:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.626+0000 7fb68212f640 1 -- 172.21.15.6:0/822506177 wait complete. 2024-05-20T18:00:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.628+0000 7fb68212f640 1 Processor -- start 2024-05-20T18:00:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.628+0000 7fb68212f640 1 -- start start 2024-05-20T18:00:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb68212f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb67c0b3e80 0x7fb67c1f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb68212f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c1f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb68212f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c158940 0x7fb67c1f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb68212f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c0d4780 con 0x7fb67c158940 2024-05-20T18:00:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb68212f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c0d0300 con 0x7fb67c0b3e80 2024-05-20T18:00:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb68212f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb67c0d4900 con 0x7fb67c162820 2024-05-20T18:00:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb67bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c158940 0x7fb67c1f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb67bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c158940 0x7fb67c1f91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42612/0 (socket says 172.21.15.6:42612) 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.629+0000 7fb67bfff640 1 -- 172.21.15.6:0/217891031 learned_addr learned my addr 172.21.15.6:0/217891031 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67affd640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c1f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb67c0b3e80 0x7fb67c1f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67bfff640 1 -- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 msgr2=0x7fb67c1f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67bfff640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c1f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67bfff640 1 -- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb67c0b3e80 msgr2=0x7fb67c1f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67bfff640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb67c0b3e80 0x7fb67c1f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67bfff640 1 -- 172.21.15.6:0/217891031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c159050 con 0x7fb67c158940 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb67c0b3e80 0x7fb67c1f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb67bfff640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c158940 0x7fb67c1f91a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb674034040 tx=0x7fb674004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb663fff640 1 -- 172.21.15.6:0/217891031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674036050 con 0x7fb67c158940 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb663fff640 1 -- 172.21.15.6:0/217891031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb674042070 con 0x7fb67c158940 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c159330 con 0x7fb67c158940 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb663fff640 1 -- 172.21.15.6:0/217891031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674009510 con 0x7fb67c158940 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.630+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67c1598f0 con 0x7fb67c158940 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.631+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c075b00 con 0x7fb67c158940 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.632+0000 7fb663fff640 1 -- 172.21.15.6:0/217891031 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb674007bd0 con 0x7fb67c158940 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.632+0000 7fb663fff640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb66806be30 0x7fb66806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.632+0000 7fb663fff640 1 -- 172.21.15.6:0/217891031 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5249+0+0 (secure 0 0 0) 0x7fb6740abc00 con 0x7fb67c158940 2024-05-20T18:00:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.632+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb66806be30 0x7fb66806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.633+0000 7fb67b7fe640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb66806be30 0x7fb66806e340 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb66c006fd0 tx=0x7fb66c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.637+0000 7fb663fff640 1 -- 172.21.15.6:0/217891031 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb6740b2080 con 0x7fb67c158940 2024-05-20T18:00:12.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.822+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb67c158de0 con 0x7fb67c158940 2024-05-20T18:00:12.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.823+0000 7fb663fff640 1 -- 172.21.15.6:0/217891031 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+13117 (secure 0 0 0) 0x7fb674045360 con 0x7fb67c158940 2024-05-20T18:00:12.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:12.821 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":97,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:12.080686+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb66806be30 msgr2=0x7fb66806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb66806be30 0x7fb66806e340 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb66c006fd0 tx=0x7fb66c008040 comp rx=0 tx=0).stop 2024-05-20T18:00:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c158940 msgr2=0x7fb67c1f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c158940 0x7fb67c1f91a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb674034040 tx=0x7fb674004a40 comp rx=0 tx=0).stop 2024-05-20T18:00:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 shutdown_connections 2024-05-20T18:00:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb66806be30 0x7fb66806e340 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb67c158940 0x7fb67c1f91a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb67c162820 0x7fb67c1f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 --2- 172.21.15.6:0/217891031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb67c0b3e80 0x7fb67c1f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 >> 172.21.15.6:0/217891031 conn(0x7fb67c0d4bd0 msgr2=0x7fb67c15e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 shutdown_connections 2024-05-20T18:00:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.825+0000 7fb68212f640 1 -- 172.21.15.6:0/217891031 wait complete. 2024-05-20T18:00:12.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:00:12.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:00:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.954+0000 7f4b37684640 1 Processor -- start 2024-05-20T18:00:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.954+0000 7f4b37684640 1 -- start start 2024-05-20T18:00:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b37684640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 0x7f4b30162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b37684640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b3006d6b0 0x7f4b3015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b37684640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b3006c8c0 con 0x7f4b300cf3d0 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b37684640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4b300d0ba0 con 0x7f4b3006d6b0 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b37684640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3006dac0 con 0x7f4b300cd710 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b34c1f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b3006d6b0 0x7f4b3015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b35c21640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4b300cf3d0 0x7f4b300cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38000/0 (socket says 172.21.15.6:38000) 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b35c21640 1 -- 172.21.15.6:0/2969132702 learned_addr learned my addr 172.21.15.6:0/2969132702 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b35420640 1 --2- 172.21.15.6:0/2969132702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 0x7f4b30162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b34c1f640 1 -- 172.21.15.6:0/2969132702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 msgr2=0x7f4b30162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b34c1f640 1 --2- 172.21.15.6:0/2969132702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 0x7f4b30162e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b34c1f640 1 -- 172.21.15.6:0/2969132702 >> v1:172.21.15.6:6789/0 conn(0x7f4b300cf3d0 legacy=0x7f4b300cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b27fff640 1 -- 172.21.15.6:0/2969132702 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2389484142 0 0) 0x7f4b3006c8c0 con 0x7f4b300cf3d0 2024-05-20T18:00:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.956+0000 7f4b34c1f640 1 -- 172.21.15.6:0/2969132702 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b301633e0 con 0x7f4b3006d6b0 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.957+0000 7f4b34c1f640 1 --2- 172.21.15.6:0/2969132702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3006d6b0 0x7f4b3015f2b0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4b300d0d20 tx=0x7f4b2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d91306637bd85a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.957+0000 7f4b27fff640 1 -- 172.21.15.6:0/2969132702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20037070 con 0x7f4b3006d6b0 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.957+0000 7f4b27fff640 1 -- 172.21.15.6:0/2969132702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b20032440 con 0x7f4b3006d6b0 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.957+0000 7f4b27fff640 1 -- 172.21.15.6:0/2969132702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20032810 con 0x7f4b3006d6b0 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.958+0000 7f4b37684640 1 -- 172.21.15.6:0/2969132702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3006d6b0 msgr2=0x7f4b3015f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.958+0000 7f4b37684640 1 --2- 172.21.15.6:0/2969132702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3006d6b0 0x7f4b3015f2b0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4b300d0d20 tx=0x7f4b2002a180 comp rx=0 tx=0).stop 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.958+0000 7f4b37684640 1 -- 172.21.15.6:0/2969132702 shutdown_connections 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.958+0000 7f4b37684640 1 --2- 172.21.15.6:0/2969132702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b3006d6b0 0x7f4b3015f2b0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.958+0000 7f4b37684640 1 --2- 172.21.15.6:0/2969132702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 0x7f4b30162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.958+0000 7f4b37684640 1 -- 172.21.15.6:0/2969132702 >> 172.21.15.6:0/2969132702 conn(0x7f4b300b44d0 msgr2=0x7f4b300b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.958+0000 7f4b37684640 1 -- 172.21.15.6:0/2969132702 shutdown_connections 2024-05-20T18:00:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.958+0000 7f4b37684640 1 -- 172.21.15.6:0/2969132702 wait complete. 2024-05-20T18:00:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.960+0000 7f4b37684640 1 Processor -- start 2024-05-20T18:00:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.960+0000 7f4b37684640 1 -- start start 2024-05-20T18:00:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b37684640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b3006d6b0 0x7f4b301589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b37684640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 0x7f4b301f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b37684640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b300cf3d0 0x7f4b301f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b37684640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30163c80 con 0x7f4b300cf3d0 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b37684640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4b301639a0 con 0x7f4b3006d6b0 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b37684640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4b300d1030 con 0x7f4b300cd710 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35c21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b300cf3d0 0x7f4b301f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35c21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b300cf3d0 0x7f4b301f8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42630/0 (socket says 172.21.15.6:42630) 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35c21640 1 -- 172.21.15.6:0/3533216895 learned_addr learned my addr 172.21.15.6:0/3533216895 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b34c1f640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 0x7f4b301f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35420640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b3006d6b0 0x7f4b301589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35c21640 1 -- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 msgr2=0x7f4b301f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35c21640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 0x7f4b301f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35c21640 1 -- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b3006d6b0 msgr2=0x7f4b301589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35c21640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b3006d6b0 0x7f4b301589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.961+0000 7f4b35c21640 1 -- 172.21.15.6:0/3533216895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b300b8160 con 0x7f4b300cf3d0 2024-05-20T18:00:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.962+0000 7f4b35c21640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b300cf3d0 0x7f4b301f8f40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c440 tx=0x7f4b2800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.962+0000 7f4b25ffb640 1 -- 172.21.15.6:0/3533216895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b280074e0 con 0x7f4b300cf3d0 2024-05-20T18:00:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.962+0000 7f4b25ffb640 1 -- 172.21.15.6:0/3533216895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b280047e0 con 0x7f4b300cf3d0 2024-05-20T18:00:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.962+0000 7f4b25ffb640 1 -- 172.21.15.6:0/3533216895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b28004bd0 con 0x7f4b300cf3d0 2024-05-20T18:00:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.962+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3015ce20 con 0x7f4b300cf3d0 2024-05-20T18:00:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.962+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b300b8440 con 0x7f4b300cf3d0 2024-05-20T18:00:12.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.963+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b30075b00 con 0x7f4b300cf3d0 2024-05-20T18:00:12.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.964+0000 7f4b25ffb640 1 -- 172.21.15.6:0/3533216895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b28011070 con 0x7f4b300cf3d0 2024-05-20T18:00:12.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.964+0000 7f4b25ffb640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4b1406be30 0x7f4b1406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:12.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.964+0000 7f4b25ffb640 1 -- 172.21.15.6:0/3533216895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5249+0+0 (secure 0 0 0) 0x7f4b2808a940 con 0x7f4b300cf3d0 2024-05-20T18:00:12.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.965+0000 7f4b35420640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4b1406be30 0x7f4b1406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:12.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.965+0000 7f4b35420640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4b1406be30 0x7f4b1406e340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4b30162d60 tx=0x7f4b2c003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:12.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:12.969+0000 7f4b25ffb640 1 -- 172.21.15.6:0/3533216895 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4b2801a2b0 con 0x7f4b300cf3d0 2024-05-20T18:00:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.152+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4b300b5520 con 0x7f4b300cf3d0 2024-05-20T18:00:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.152+0000 7f4b25ffb640 1 -- 172.21.15.6:0/3533216895 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) ==== 93+0+10 (secure 0 0 0) 0x7f4b28059460 con 0x7f4b300cf3d0 2024-05-20T18:00:13.151 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:00:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4b1406be30 msgr2=0x7f4b1406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4b1406be30 0x7f4b1406e340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4b30162d60 tx=0x7f4b2c003990 comp rx=0 tx=0).stop 2024-05-20T18:00:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b300cf3d0 msgr2=0x7f4b301f8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b300cf3d0 0x7f4b301f8f40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800c440 tx=0x7f4b2800c900 comp rx=0 tx=0).stop 2024-05-20T18:00:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 shutdown_connections 2024-05-20T18:00:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4b1406be30 0x7f4b1406e340 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b300cf3d0 0x7f4b301f8f40 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4b300cd710 0x7f4b301f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.154+0000 7f4b37684640 1 --2- 172.21.15.6:0/3533216895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4b3006d6b0 0x7f4b301589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.155+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 >> 172.21.15.6:0/3533216895 conn(0x7f4b300b44d0 msgr2=0x7f4b300b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.155+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 shutdown_connections 2024-05-20T18:00:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.155+0000 7f4b37684640 1 -- 172.21.15.6:0/3533216895 wait complete. 2024-05-20T18:00:13.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T18:00:13.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.280+0000 7f4adf3ea640 1 Processor -- start 2024-05-20T18:00:13.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.281+0000 7f4adf3ea640 1 -- start start 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4adf3ea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ad815d460 0x7f4ad806b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4adf3ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ad80d1780 0x7f4ad80d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4adf3ea640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad815d870 con 0x7f4ad809a4f0 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4adf3ea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad80d20d0 con 0x7f4ad815d460 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4adf3ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad815dae0 con 0x7f4ad80d1780 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4add186640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ad815d460 0x7f4ad806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4add987640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4ad809a4f0 0x7f4ad809a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38004/0 (socket says 172.21.15.6:38004) 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4add987640 1 -- 172.21.15.6:0/2843544183 learned_addr learned my addr 172.21.15.6:0/2843544183 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4add186640 1 -- 172.21.15.6:0/2843544183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ad80d1780 msgr2=0x7f4ad80d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.282+0000 7f4add186640 1 --2- 172.21.15.6:0/2843544183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ad80d1780 0x7f4ad80d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.283+0000 7f4add186640 1 -- 172.21.15.6:0/2843544183 >> v1:172.21.15.6:6789/0 conn(0x7f4ad809a4f0 legacy=0x7f4ad809a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.283+0000 7f4acffff640 1 -- 172.21.15.6:0/2843544183 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801208058 0 0) 0x7f4ad815d870 con 0x7f4ad809a4f0 2024-05-20T18:00:13.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.283+0000 7f4add186640 1 -- 172.21.15.6:0/2843544183 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad815ddc0 con 0x7f4ad815d460 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.283+0000 7f4add186640 1 --2- 172.21.15.6:0/2843544183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad806b870 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40097a0 tx=0x7f4ad402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e85cbbbe9efd1f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.283+0000 7f4acffff640 1 -- 172.21.15.6:0/2843544183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4037070 con 0x7f4ad815d460 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.283+0000 7f4acffff640 1 -- 172.21.15.6:0/2843544183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad4032440 con 0x7f4ad815d460 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.283+0000 7f4acffff640 1 -- 172.21.15.6:0/2843544183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4032810 con 0x7f4ad815d460 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.284+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2843544183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 msgr2=0x7f4ad806b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.284+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2843544183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad806b870 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40097a0 tx=0x7f4ad402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.284+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2843544183 shutdown_connections 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.284+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2843544183 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ad80d1780 0x7f4ad80d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.284+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2843544183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad806b870 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.284+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2843544183 >> 172.21.15.6:0/2843544183 conn(0x7f4ad80b6620 msgr2=0x7f4ad80b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.284+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2843544183 shutdown_connections 2024-05-20T18:00:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.284+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2843544183 wait complete. 2024-05-20T18:00:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.286+0000 7f4adf3ea640 1 Processor -- start 2024-05-20T18:00:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.286+0000 7f4adf3ea640 1 -- start start 2024-05-20T18:00:13.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4adf3ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ad809a4f0 0x7f4ad809f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4adf3ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad80d1780 0x7f4ad8140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4adf3ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad815f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4adf3ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad806bdb0 con 0x7f4ad815d460 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4adf3ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad80b12d0 con 0x7f4ad80d1780 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4adf3ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad815e380 con 0x7f4ad809a4f0 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4add987640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4add987640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad815f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42660/0 (socket says 172.21.15.6:42660) 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.287+0000 7f4add987640 1 -- 172.21.15.6:0/2705548040 learned_addr learned my addr 172.21.15.6:0/2705548040 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4add987640 1 -- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ad809a4f0 msgr2=0x7f4ad809f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4add987640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ad809a4f0 0x7f4ad809f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4add987640 1 -- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad80d1780 msgr2=0x7f4ad8140000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4add987640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad80d1780 0x7f4ad8140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4add987640 1 -- 172.21.15.6:0/2705548040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad80ce350 con 0x7f4ad815d460 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4add987640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad815f660 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000cac0 tx=0x7f4ad000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4acdffb640 1 -- 172.21.15.6:0/2705548040 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000ab70 con 0x7f4ad815d460 2024-05-20T18:00:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4acdffb640 1 -- 172.21.15.6:0/2705548040 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad000ad10 con 0x7f4ad815d460 2024-05-20T18:00:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad80ce5f0 con 0x7f4ad815d460 2024-05-20T18:00:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4acdffb640 1 -- 172.21.15.6:0/2705548040 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0012640 con 0x7f4ad815d460 2024-05-20T18:00:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.288+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad80cebb0 con 0x7f4ad815d460 2024-05-20T18:00:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.289+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad8075b00 con 0x7f4ad815d460 2024-05-20T18:00:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.290+0000 7f4acdffb640 1 -- 172.21.15.6:0/2705548040 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ad00127e0 con 0x7f4ad815d460 2024-05-20T18:00:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.290+0000 7f4acdffb640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4abc06be60 0x7f4abc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.291+0000 7f4acdffb640 1 -- 172.21.15.6:0/2705548040 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5249+0+0 (secure 0 0 0) 0x7f4ad008b2d0 con 0x7f4ad815d460 2024-05-20T18:00:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.291+0000 7f4add186640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4abc06be60 0x7f4abc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.291+0000 7f4add186640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4abc06be60 0x7f4abc06e370 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4034000 tx=0x7f4ad402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:13.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.295+0000 7f4acdffb640 1 -- 172.21.15.6:0/2705548040 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4ad0059db0 con 0x7f4ad815d460 2024-05-20T18:00:13.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.482+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4ad80b4240 con 0x7f4ad815d460 2024-05-20T18:00:13.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.483+0000 7f4acdffb640 1 -- 172.21.15.6:0/2705548040 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) ==== 84+0+65 (secure 0 0 0) 0x7f4ad00596b0 con 0x7f4ad815d460 2024-05-20T18:00:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:13.481 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T18:00:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T18:00:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T18:00:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:13.482 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T18:00:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4abc06be60 msgr2=0x7f4abc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4abc06be60 0x7f4abc06e370 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4034000 tx=0x7f4ad402c000 comp rx=0 tx=0).stop 2024-05-20T18:00:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 msgr2=0x7f4ad815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad815f660 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000cac0 tx=0x7f4ad000cf80 comp rx=0 tx=0).stop 2024-05-20T18:00:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 shutdown_connections 2024-05-20T18:00:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4abc06be60 0x7f4abc06e370 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad815d460 0x7f4ad815f660 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad80d1780 0x7f4ad8140000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 --2- 172.21.15.6:0/2705548040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ad809a4f0 0x7f4ad809f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 >> 172.21.15.6:0/2705548040 conn(0x7f4ad80b6620 msgr2=0x7f4ad809a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 shutdown_connections 2024-05-20T18:00:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.485+0000 7f4adf3ea640 1 -- 172.21.15.6:0/2705548040 wait complete. 2024-05-20T18:00:13.494 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T18:00:13.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T18:00:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.614+0000 7fd79bd8b640 1 Processor -- start 2024-05-20T18:00:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.614+0000 7fd79bd8b640 1 -- start start 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79bd8b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd79406d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79bd8b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7940ce140 0x7fd7940d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79bd8b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7940d2740 con 0x7fd79406d660 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79bd8b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd79409c3b0 con 0x7fd7940ce140 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79bd8b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd79406dda0 con 0x7fd7940d2330 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd799326640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd79406d660 0x7fd7940cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38012/0 (socket says 172.21.15.6:38012) 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd799326640 1 -- 172.21.15.6:0/2798551977 learned_addr learned my addr 172.21.15.6:0/2798551977 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79a328640 1 --2- 172.21.15.6:0/2798551977 >> v2:172.21.15.6:3300/0 conn(0x7fd7940ce140 0x7fd7940d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd799b27640 1 --2- 172.21.15.6:0/2798551977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd79406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79a328640 1 -- 172.21.15.6:0/2798551977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 msgr2=0x7fd79406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79a328640 1 --2- 172.21.15.6:0/2798551977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd79406d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79a328640 1 -- 172.21.15.6:0/2798551977 >> v1:172.21.15.6:6789/0 conn(0x7fd79406d660 legacy=0x7fd7940cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79a328640 1 -- 172.21.15.6:0/2798551977 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7940b81a0 con 0x7fd7940ce140 2024-05-20T18:00:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd798b25640 1 -- 172.21.15.6:0/2798551977 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1908293718 0 0) 0x7fd7940d2740 con 0x7fd79406d660 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd79a328640 1 --2- 172.21.15.6:0/2798551977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7940ce140 0x7fd7940d0f40 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fd784009d90 tx=0x7fd78402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaab4bcedd8697f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd798b25640 1 -- 172.21.15.6:0/2798551977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784007740 con 0x7fd7940ce140 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd798b25640 1 -- 172.21.15.6:0/2798551977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7840078e0 con 0x7fd7940ce140 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.617+0000 7fd798b25640 1 -- 172.21.15.6:0/2798551977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784007cb0 con 0x7fd7940ce140 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.618+0000 7fd79bd8b640 1 -- 172.21.15.6:0/2798551977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7940ce140 msgr2=0x7fd7940d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.618+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/2798551977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7940ce140 0x7fd7940d0f40 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fd784009d90 tx=0x7fd78402a660 comp rx=0 tx=0).stop 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.618+0000 7fd79bd8b640 1 -- 172.21.15.6:0/2798551977 shutdown_connections 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.618+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/2798551977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7940ce140 0x7fd7940d0f40 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.618+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/2798551977 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd79406d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.618+0000 7fd79bd8b640 1 -- 172.21.15.6:0/2798551977 >> 172.21.15.6:0/2798551977 conn(0x7fd7940cf450 msgr2=0x7fd7940cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.618+0000 7fd79bd8b640 1 -- 172.21.15.6:0/2798551977 shutdown_connections 2024-05-20T18:00:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.618+0000 7fd79bd8b640 1 -- 172.21.15.6:0/2798551977 wait complete. 2024-05-20T18:00:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.620+0000 7fd79bd8b640 1 Processor -- start 2024-05-20T18:00:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.620+0000 7fd79bd8b640 1 -- start start 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79bd8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79406d660 0x7fd7941f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79bd8b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7940ce140 0x7fd7940c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79bd8b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd7941597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79bd8b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd7940d3800 con 0x7fd79406d660 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79bd8b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd79406da70 con 0x7fd7940ce140 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79bd8b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd7940d3980 con 0x7fd7940d2330 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79406d660 0x7fd7941f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79406d660 0x7fd7941f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42682/0 (socket says 172.21.15.6:42682) 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 -- 172.21.15.6:0/3660555525 learned_addr learned my addr 172.21.15.6:0/3660555525 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799326640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7940ce140 0x7fd7940c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79a328640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd7941597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 -- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 msgr2=0x7fd7941597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd7941597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 -- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7940ce140 msgr2=0x7fd7940c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7940ce140 0x7fd7940c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 -- 172.21.15.6:0/3660555525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7940c7160 con 0x7fd79406d660 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79a328640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd7941597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd799b27640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79406d660 0x7fd7941f8f50 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00d800 tx=0x7fd78c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd7927fc640 1 -- 172.21.15.6:0/3660555525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c005990 con 0x7fd79406d660 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd7927fc640 1 -- 172.21.15.6:0/3660555525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd78c005b30 con 0x7fd79406d660 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7941f8470 con 0x7fd79406d660 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd7927fc640 1 -- 172.21.15.6:0/3660555525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0096a0 con 0x7fd79406d660 2024-05-20T18:00:13.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.622+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7940c6c80 con 0x7fd79406d660 2024-05-20T18:00:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.623+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7940690b0 con 0x7fd79406d660 2024-05-20T18:00:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.624+0000 7fd7927fc640 1 -- 172.21.15.6:0/3660555525 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd78c009840 con 0x7fd79406d660 2024-05-20T18:00:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.625+0000 7fd7927fc640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.625+0000 7fd7927fc640 1 -- 172.21.15.6:0/3660555525 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5249+0+0 (secure 0 0 0) 0x7fd78c08af10 con 0x7fd79406d660 2024-05-20T18:00:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.625+0000 7fd799326640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:13.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.625+0000 7fd799326640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd7941e9110 tx=0x7fd788007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:13.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.630+0000 7fd7927fc640 1 -- 172.21.15.6:0/3660555525 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd78c0599f0 con 0x7fd79406d660 2024-05-20T18:00:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:13.811+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd7940d0220 con 0x7fd79406d660 2024-05-20T18:00:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.110+0000 7fd7927fc640 1 -- 172.21.15.6:0/3660555525 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) ==== 138+0+0 (secure 0 0 0) 0x7fd78c0592f0 con 0x7fd79406d660 2024-05-20T18:00:14.108 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T18:00:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 msgr2=0x7fd78006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd7941e9110 tx=0x7fd788007de0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79406d660 msgr2=0x7fd7941f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79406d660 0x7fd7941f8f50 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00d800 tx=0x7fd78c00dcc0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 shutdown_connections 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd78006be60 0x7fd78006e370 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7940d2330 0x7fd7941597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7940ce140 0x7fd7940c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 --2- 172.21.15.6:0/3660555525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd79406d660 0x7fd7941f8f50 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 >> 172.21.15.6:0/3660555525 conn(0x7fd7940cf450 msgr2=0x7fd7940b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 shutdown_connections 2024-05-20T18:00:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.112+0000 7fd79bd8b640 1 -- 172.21.15.6:0/3660555525 wait complete. 2024-05-20T18:00:14.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T18:00:14.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.250+0000 7efd0dc6c640 1 Processor -- start 2024-05-20T18:00:14.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.250+0000 7efd0dc6c640 1 -- start start 2024-05-20T18:00:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.251+0000 7efd0dc6c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efd0815cf30 0x7efd0806c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.251+0000 7efd0dc6c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806ca70 0x7efd08160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.251+0000 7efd0dc6c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd0806ce80 con 0x7efd0806fb10 2024-05-20T18:00:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.251+0000 7efd0dc6c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efd08160a20 con 0x7efd0815cf30 2024-05-20T18:00:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.251+0000 7efd0dc6c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd0806e780 con 0x7efd0806ca70 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd06ffd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efd0815cf30 0x7efd0806c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd07fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806ca70 0x7efd08160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd077fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7efd0806fb10 0x7efd080cd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:46940/0 (socket says 172.21.15.6:46940) 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd077fe640 1 -- 172.21.15.6:0/2263500237 learned_addr learned my addr 172.21.15.6:0/2263500237 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd06ffd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efd0815cf30 0x7efd0806c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:35638/0 (socket says 172.21.15.6:35638) 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd06ffd640 1 -- 172.21.15.6:0/2263500237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806ca70 msgr2=0x7efd08160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd06ffd640 1 --2- 172.21.15.6:0/2263500237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806ca70 0x7efd08160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd06ffd640 1 -- 172.21.15.6:0/2263500237 >> v1:172.21.15.171:6789/0 conn(0x7efd0806fb10 legacy=0x7efd080cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd067fc640 1 -- 172.21.15.6:0/2263500237 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970993145 0 0) 0x7efcf8001110 con 0x7efd0806fb10 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.252+0000 7efd06ffd640 1 -- 172.21.15.6:0/2263500237 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0806ea60 con 0x7efd0815cf30 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.253+0000 7efd06ffd640 1 --2- 172.21.15.6:0/2263500237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0815cf30 0x7efd0806c530 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0097a0 tx=0x7efcfc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39efa6366154efb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.253+0000 7efd067fc640 1 -- 172.21.15.6:0/2263500237 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc037070 con 0x7efd0815cf30 2024-05-20T18:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.253+0000 7efd067fc640 1 -- 172.21.15.6:0/2263500237 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcfc02ae50 con 0x7efd0815cf30 2024-05-20T18:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.253+0000 7efd067fc640 1 -- 172.21.15.6:0/2263500237 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc032660 con 0x7efd0815cf30 2024-05-20T18:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.254+0000 7efd0dc6c640 1 -- 172.21.15.6:0/2263500237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0815cf30 msgr2=0x7efd0806c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.254+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/2263500237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0815cf30 0x7efd0806c530 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0097a0 tx=0x7efcfc02a100 comp rx=0 tx=0).stop 2024-05-20T18:00:14.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.254+0000 7efd0dc6c640 1 -- 172.21.15.6:0/2263500237 shutdown_connections 2024-05-20T18:00:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.254+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/2263500237 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806ca70 0x7efd08160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.254+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/2263500237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0815cf30 0x7efd0806c530 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.254+0000 7efd0dc6c640 1 -- 172.21.15.6:0/2263500237 >> 172.21.15.6:0/2263500237 conn(0x7efd080723a0 msgr2=0x7efd080727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.254+0000 7efd0dc6c640 1 -- 172.21.15.6:0/2263500237 shutdown_connections 2024-05-20T18:00:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.254+0000 7efd0dc6c640 1 -- 172.21.15.6:0/2263500237 wait complete. 2024-05-20T18:00:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.256+0000 7efd0dc6c640 1 Processor -- start 2024-05-20T18:00:14.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.256+0000 7efd0dc6c640 1 -- start start 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd0dc6c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0806ca70 0x7efd081492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd0dc6c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806fb10 0x7efd0809d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd0dc6c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd0815cf30 0x7efd0809de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd0dc6c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efd080cde00 con 0x7efd0815cf30 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd0dc6c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efd0806f020 con 0x7efd0806ca70 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd0dc6c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efd0806e3e0 con 0x7efd0806fb10 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd0815cf30 0x7efd0809de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd0815cf30 0x7efd0809de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42692/0 (socket says 172.21.15.6:42692) 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 -- 172.21.15.6:0/619429987 learned_addr learned my addr 172.21.15.6:0/619429987 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd077fe640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0806ca70 0x7efd081492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd06ffd640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806fb10 0x7efd0809d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:14.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 -- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806fb10 msgr2=0x7efd0809d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806fb10 0x7efd0809d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 -- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0806ca70 msgr2=0x7efd081492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0806ca70 0x7efd081492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 -- 172.21.15.6:0/619429987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd081e5eb0 con 0x7efd0815cf30 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd07fff640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd0815cf30 0x7efd0809de40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7efd0000efc0 tx=0x7efd0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efceffff640 1 -- 172.21.15.6:0/619429987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00018020 con 0x7efd0815cf30 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efceffff640 1 -- 172.21.15.6:0/619429987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00014480 con 0x7efd0815cf30 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efceffff640 1 -- 172.21.15.6:0/619429987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00009e60 con 0x7efd0815cf30 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd08147170 con 0x7efd0815cf30 2024-05-20T18:00:14.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.258+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd08147730 con 0x7efd0815cf30 2024-05-20T18:00:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.259+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd08158b80 con 0x7efd0815cf30 2024-05-20T18:00:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.260+0000 7efceffff640 1 -- 172.21.15.6:0/619429987 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd00005d10 con 0x7efd0815cf30 2024-05-20T18:00:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.261+0000 7efceffff640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcf406be30 0x7efcf406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.261+0000 7efceffff640 1 -- 172.21.15.6:0/619429987 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5619+0+0 (secure 0 0 0) 0x7efd0008ba60 con 0x7efd0815cf30 2024-05-20T18:00:14.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.261+0000 7efd077fe640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcf406be30 0x7efcf406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:14.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.261+0000 7efd077fe640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcf406be30 0x7efcf406e340 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efcf8007fd0 tx=0x7efcf8007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:14.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.265+0000 7efceffff640 1 -- 172.21.15.6:0/619429987 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd00022030 con 0x7efd0815cf30 2024-05-20T18:00:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:14.452+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efd081e6080 con 0x7efd0815cf30 2024-05-20T18:00:15.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.117+0000 7efceffff640 1 -- 172.21.15.6:0/619429987 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) ==== 170+0+0 (secure 0 0 0) 0x7efd00010040 con 0x7efd0815cf30 2024-05-20T18:00:15.115 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T18:00:15.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcf406be30 msgr2=0x7efcf406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:15.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcf406be30 0x7efcf406e340 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efcf8007fd0 tx=0x7efcf8007de0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd0815cf30 msgr2=0x7efd0809de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd0815cf30 0x7efd0809de40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7efd0000efc0 tx=0x7efd0000c490 comp rx=0 tx=0).stop 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 shutdown_connections 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcf406be30 0x7efcf406e340 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd0815cf30 0x7efd0809de40 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd0806fb10 0x7efd0809d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 --2- 172.21.15.6:0/619429987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd0806ca70 0x7efd081492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 >> 172.21.15.6:0/619429987 conn(0x7efd080723a0 msgr2=0x7efd080b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 shutdown_connections 2024-05-20T18:00:15.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.121+0000 7efd0dc6c640 1 -- 172.21.15.6:0/619429987 wait complete. 2024-05-20T18:00:15.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T18:00:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.269+0000 7f554a523640 1 Processor -- start 2024-05-20T18:00:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.269+0000 7f554a523640 1 -- start start 2024-05-20T18:00:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f554a523640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f554406d3d0 0x7f554406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f554a523640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55440b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f554a523640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554406dd20 con 0x7f5544162820 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f554a523640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f55440d0630 con 0x7f554406d3d0 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f554a523640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f55440d39c0 con 0x7f55440b8190 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f55437fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f554406d3d0 0x7f554406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f5543fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5544162820 0x7f55440b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38018/0 (socket says 172.21.15.6:38018) 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f5543fff640 1 -- 172.21.15.6:0/2256230529 learned_addr learned my addr 172.21.15.6:0/2256230529 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f5548ac0640 1 --2- 172.21.15.6:0/2256230529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55440b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f55437fe640 1 -- 172.21.15.6:0/2256230529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 msgr2=0x7f55440b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f55437fe640 1 --2- 172.21.15.6:0/2256230529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55440b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f55437fe640 1 -- 172.21.15.6:0/2256230529 >> v1:172.21.15.6:6789/0 conn(0x7f5544162820 legacy=0x7f55440b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f5542ffd640 1 -- 172.21.15.6:0/2256230529 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352220696 0 0) 0x7f5534001110 con 0x7f5544162820 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f55437fe640 1 -- 172.21.15.6:0/2256230529 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55440d3ca0 con 0x7f554406d3d0 2024-05-20T18:00:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.271+0000 7f5548ac0640 1 --2- 172.21.15.6:0/2256230529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55440b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.272+0000 7f55437fe640 1 --2- 172.21.15.6:0/2256230529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554406d3d0 0x7f554406d7e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f55380097a0 tx=0x7f553802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d78aa6b4440b3d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.272+0000 7f5542ffd640 1 -- 172.21.15.6:0/2256230529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538037070 con 0x7f554406d3d0 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.272+0000 7f5542ffd640 1 -- 172.21.15.6:0/2256230529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5538032440 con 0x7f554406d3d0 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.272+0000 7f5542ffd640 1 -- 172.21.15.6:0/2256230529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538032810 con 0x7f554406d3d0 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.273+0000 7f554a523640 1 -- 172.21.15.6:0/2256230529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554406d3d0 msgr2=0x7f554406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.273+0000 7f554a523640 1 --2- 172.21.15.6:0/2256230529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554406d3d0 0x7f554406d7e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f55380097a0 tx=0x7f553802a180 comp rx=0 tx=0).stop 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.273+0000 7f554a523640 1 -- 172.21.15.6:0/2256230529 shutdown_connections 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.273+0000 7f554a523640 1 --2- 172.21.15.6:0/2256230529 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55440b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.273+0000 7f554a523640 1 --2- 172.21.15.6:0/2256230529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f554406d3d0 0x7f554406d7e0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.273+0000 7f554a523640 1 -- 172.21.15.6:0/2256230529 >> 172.21.15.6:0/2256230529 conn(0x7f55440d4bd0 msgr2=0x7f55440d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.273+0000 7f554a523640 1 -- 172.21.15.6:0/2256230529 shutdown_connections 2024-05-20T18:00:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.273+0000 7f554a523640 1 -- 172.21.15.6:0/2256230529 wait complete. 2024-05-20T18:00:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.275+0000 7f554a523640 1 Processor -- start 2024-05-20T18:00:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.275+0000 7f554a523640 1 -- start start 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.276+0000 7f554a523640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f554406d3d0 0x7f554414b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.276+0000 7f554a523640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55441f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.276+0000 7f554a523640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5544162820 0x7f55440c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.276+0000 7f554a523640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55440d0300 con 0x7f5544162820 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.276+0000 7f554a523640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f55440d4260 con 0x7f554406d3d0 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.276+0000 7f554a523640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f55440b4050 con 0x7f55440b8190 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5544162820 0x7f55440c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5544162820 0x7f55440c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42712/0 (socket says 172.21.15.6:42712) 2024-05-20T18:00:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 -- 172.21.15.6:0/2246148309 learned_addr learned my addr 172.21.15.6:0/2246148309 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f55437fe640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55441f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5543fff640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f554406d3d0 0x7f554414b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 -- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 msgr2=0x7f55441f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55441f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 -- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f554406d3d0 msgr2=0x7f554414b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f554406d3d0 0x7f554414b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 -- 172.21.15.6:0/2246148309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55440c9750 con 0x7f5544162820 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5548ac0640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5544162820 0x7f55440c9f10 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f553c00cd10 tx=0x7f553c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5540ff9640 1 -- 172.21.15.6:0/2246148309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c003b90 con 0x7f5544162820 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5540ff9640 1 -- 172.21.15.6:0/2246148309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c003d50 con 0x7f5544162820 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55441f5b30 con 0x7f5544162820 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f5540ff9640 1 -- 172.21.15.6:0/2246148309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c004260 con 0x7f5544162820 2024-05-20T18:00:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.277+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55441f60f0 con 0x7f5544162820 2024-05-20T18:00:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.278+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55441f58a0 con 0x7f5544162820 2024-05-20T18:00:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.279+0000 7f5540ff9640 1 -- 172.21.15.6:0/2246148309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f553c004400 con 0x7f5544162820 2024-05-20T18:00:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.280+0000 7f5540ff9640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f553006be60 0x7f553006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.280+0000 7f5540ff9640 1 -- 172.21.15.6:0/2246148309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6001+0+0 (secure 0 0 0) 0x7f553c08b9d0 con 0x7f5544162820 2024-05-20T18:00:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.280+0000 7f5543fff640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f553006be60 0x7f553006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.281+0000 7f5543fff640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f553006be60 0x7f553006e370 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5534007fd0 tx=0x7f5534007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:15.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.285+0000 7f5540ff9640 1 -- 172.21.15.6:0/2246148309 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f553c014030 con 0x7f5544162820 2024-05-20T18:00:15.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:15.506+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f55440cbf30 con 0x7f5544162820 2024-05-20T18:00:15.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-20T18:00:16.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.119+0000 7f5540ff9640 1 -- 172.21.15.6:0/2246148309 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v63) ==== 174+0+0 (secure 0 0 0) 0x7f553c059b70 con 0x7f5544162820 2024-05-20T18:00:16.116 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 15 and data pool 16 2024-05-20T18:00:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.123+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f553006be60 msgr2=0x7f553006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.123+0000 7f554a523640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f553006be60 0x7f553006e370 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5534007fd0 tx=0x7f5534007de0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.123+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5544162820 msgr2=0x7f55440c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.123+0000 7f554a523640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5544162820 0x7f55440c9f10 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f553c00cd10 tx=0x7f553c00a650 comp rx=0 tx=0).stop 2024-05-20T18:00:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.124+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 shutdown_connections 2024-05-20T18:00:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.124+0000 7f554a523640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f553006be60 0x7f553006e370 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.124+0000 7f554a523640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5544162820 0x7f55440c9f10 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.124+0000 7f554a523640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55440b8190 0x7f55441f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.124+0000 7f554a523640 1 --2- 172.21.15.6:0/2246148309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f554406d3d0 0x7f554414b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.124+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 >> 172.21.15.6:0/2246148309 conn(0x7f55440d4bd0 msgr2=0x7f554415e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:16.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.126+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 shutdown_connections 2024-05-20T18:00:16.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.126+0000 7f554a523640 1 -- 172.21.15.6:0/2246148309 wait complete. 2024-05-20T18:00:16.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:16.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.272+0000 7f66e09e3640 1 Processor -- start 2024-05-20T18:00:16.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.272+0000 7f66e09e3640 1 -- start start 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.273+0000 7f66e09e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66dc0b4010 0x7f66dc0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.273+0000 7f66e09e3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc0d0370 con 0x7f66dc163a10 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.273+0000 7f66e09e3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc0d0650 con 0x7f66dc0d14b0 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.273+0000 7f66e09e3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f66dc0d3ca0 con 0x7f66dc0b4010 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.273+0000 7f66d9d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66dc0b4010 0x7f66dc0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.273+0000 7f66da59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f66dc163a10 0x7f66dc0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38034/0 (socket says 172.21.15.6:38034) 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.273+0000 7f66da59c640 1 -- 172.21.15.6:0/3656913406 learned_addr learned my addr 172.21.15.6:0/3656913406 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.274+0000 7f66d9d9b640 1 -- 172.21.15.6:0/3656913406 >> v1:172.21.15.171:6789/0 conn(0x7f66dc0d14b0 legacy=0x7f66dc0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.274+0000 7f66d9d9b640 1 -- 172.21.15.6:0/3656913406 >> v1:172.21.15.6:6789/0 conn(0x7f66dc163a10 legacy=0x7f66dc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.274+0000 7f66d9d9b640 1 -- 172.21.15.6:0/3656913406 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc0d3650 con 0x7f66dc0b4010 2024-05-20T18:00:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.274+0000 7f66d959a640 1 -- 172.21.15.6:0/3656913406 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531959508 0 0) 0x7f66dc0d0370 con 0x7f66dc163a10 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.274+0000 7f66d9d9b640 1 --2- 172.21.15.6:0/3656913406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0b4010 0x7f66dc0d4130 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f66d00097a0 tx=0x7f66d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f688c6bb4155418 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66d959a640 1 -- 172.21.15.6:0/3656913406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0037070 con 0x7f66dc0b4010 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66d959a640 1 -- 172.21.15.6:0/3656913406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d0032440 con 0x7f66dc0b4010 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66d959a640 1 -- 172.21.15.6:0/3656913406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0032810 con 0x7f66dc0b4010 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66e09e3640 1 -- 172.21.15.6:0/3656913406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0b4010 msgr2=0x7f66dc0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66e09e3640 1 --2- 172.21.15.6:0/3656913406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0b4010 0x7f66dc0d4130 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f66d00097a0 tx=0x7f66d002a1e0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66e09e3640 1 -- 172.21.15.6:0/3656913406 shutdown_connections 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66e09e3640 1 --2- 172.21.15.6:0/3656913406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0b4010 0x7f66dc0d4130 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66e09e3640 1 -- 172.21.15.6:0/3656913406 >> 172.21.15.6:0/3656913406 conn(0x7f66dc06d240 msgr2=0x7f66dc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66e09e3640 1 -- 172.21.15.6:0/3656913406 shutdown_connections 2024-05-20T18:00:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.275+0000 7f66e09e3640 1 -- 172.21.15.6:0/3656913406 wait complete. 2024-05-20T18:00:16.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.277+0000 7f66e09e3640 1 Processor -- start 2024-05-20T18:00:16.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.277+0000 7f66e09e3640 1 -- start start 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66e09e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66dc0b4010 0x7f66dc0b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66e09e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0d14b0 0x7f66dc1eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66e09e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66dc163a10 0x7f66dc1eb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66e09e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0b8390 con 0x7f66dc0d14b0 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66e09e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0b8210 con 0x7f66dc163a10 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66e09e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc0b8510 con 0x7f66dc0b4010 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0d14b0 0x7f66dc1eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0d14b0 0x7f66dc1eaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42724/0 (socket says 172.21.15.6:42724) 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 -- 172.21.15.6:0/2956955119 learned_addr learned my addr 172.21.15.6:0/2956955119 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66da59c640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66dc0b4010 0x7f66dc0b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66dad9d640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66dc163a10 0x7f66dc1eb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 -- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66dc0b4010 msgr2=0x7f66dc0b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66dc0b4010 0x7f66dc0b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 -- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66dc163a10 msgr2=0x7f66dc1eb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66dc163a10 0x7f66dc1eb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 -- 172.21.15.6:0/2956955119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc157a50 con 0x7f66dc0d14b0 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.279+0000 7f66d9d9b640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0d14b0 0x7f66dc1eaeb0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f66d00097a0 tx=0x7f66d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.280+0000 7f66caffd640 1 -- 172.21.15.6:0/2956955119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0041070 con 0x7f66dc0d14b0 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.280+0000 7f66caffd640 1 -- 172.21.15.6:0/2956955119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d003c870 con 0x7f66dc0d14b0 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.280+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc156ed0 con 0x7f66dc0d14b0 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.280+0000 7f66caffd640 1 -- 172.21.15.6:0/2956955119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0037040 con 0x7f66dc0d14b0 2024-05-20T18:00:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.280+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc157490 con 0x7f66dc0d14b0 2024-05-20T18:00:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.281+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66dc075b00 con 0x7f66dc0d14b0 2024-05-20T18:00:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.281+0000 7f66caffd640 1 -- 172.21.15.6:0/2956955119 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66d0044070 con 0x7f66dc0d14b0 2024-05-20T18:00:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.282+0000 7f66caffd640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f66bc06be30 0x7f66bc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.282+0000 7f66caffd640 1 -- 172.21.15.6:0/2956955119 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f66d00ab850 con 0x7f66dc0d14b0 2024-05-20T18:00:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.282+0000 7f66da59c640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f66bc06be30 0x7f66bc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.283+0000 7f66da59c640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f66bc06be30 0x7f66bc06e340 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0012e0 tx=0x7f66cc001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.287+0000 7f66caffd640 1 -- 172.21.15.6:0/2956955119 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f66d0079a20 con 0x7f66dc0d14b0 2024-05-20T18:00:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.474+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66dc0d3050 con 0x7f66dc0d14b0 2024-05-20T18:00:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.475+0000 7f66caffd640 1 -- 172.21.15.6:0/2956955119 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16841 (secure 0 0 0) 0x7f66d007dd20 con 0x7f66dc0d14b0 2024-05-20T18:00:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:16.473 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":100,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:15.506828+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:13.843929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:14.484733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f66bc06be30 msgr2=0x7f66bc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f66bc06be30 0x7f66bc06e340 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0012e0 tx=0x7f66cc001630 comp rx=0 tx=0).stop 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0d14b0 msgr2=0x7f66dc1eaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0d14b0 0x7f66dc1eaeb0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f66d00097a0 tx=0x7f66d00046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 shutdown_connections 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f66bc06be30 0x7f66bc06e340 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66dc163a10 0x7f66dc1eb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66dc0d14b0 0x7f66dc1eaeb0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 --2- 172.21.15.6:0/2956955119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66dc0b4010 0x7f66dc0b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 >> 172.21.15.6:0/2956955119 conn(0x7f66dc06d240 msgr2=0x7f66dc0cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 shutdown_connections 2024-05-20T18:00:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.477+0000 7f66e09e3640 1 -- 172.21.15.6:0/2956955119 wait complete. 2024-05-20T18:00:16.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:16.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.603+0000 7fba72a51640 1 Processor -- start 2024-05-20T18:00:16.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.603+0000 7fba72a51640 1 -- start start 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.604+0000 7fba72a51640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c168050 0x7fba6c16a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.604+0000 7fba72a51640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6c0d0630 con 0x7fba6c162820 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.604+0000 7fba72a51640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6c0d39c0 con 0x7fba6c06d3d0 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.604+0000 7fba72a51640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c0d3ca0 con 0x7fba6c168050 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.604+0000 7fba6bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fba6c162820 0x7fba6c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38050/0 (socket says 172.21.15.6:38050) 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6bfff640 1 -- 172.21.15.6:0/3963808148 learned_addr learned my addr 172.21.15.6:0/3963808148 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba70fee640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c168050 0x7fba6c16a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3081656914 0 0) 0x7fba6c0d0630 con 0x7fba6c162820 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba54003520 con 0x7fba6c162820 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160541295 0 0) 0x7fba6c0d39c0 con 0x7fba6c06d3d0 2024-05-20T18:00:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba6c0d0630 con 0x7fba6c06d3d0 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4135644313 0 0) 0x7fba54003520 con 0x7fba6c162820 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c168050 msgr2=0x7fba6c16a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c168050 0x7fba6c16a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 >> v1:172.21.15.171:6789/0 conn(0x7fba6c06d3d0 legacy=0x7fba6c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c0d3f80 con 0x7fba6c162820 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fba5c0015f0 con 0x7fba6c162820 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 >> v1:172.21.15.6:6789/0 conn(0x7fba6c162820 legacy=0x7fba6c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba54003b70 0x7fba54003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba54004800 0x7fba54004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba540051a0 0x7fba5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0d3ca0 con 0x7fba540051a0 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fba5400c0f0 con 0x7fba54004800 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fba5400c2f0 con 0x7fba54003b70 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba70fee640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c168050 0x7fba6c16a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6bfff640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba54003b70 0x7fba54003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba6b7fe640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba54004800 0x7fba54004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.605+0000 7fba70fee640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba540051a0 0x7fba5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.606+0000 7fba70fee640 1 -- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba54003b70 msgr2=0x7fba54003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.606+0000 7fba70fee640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba54003b70 0x7fba54003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.606+0000 7fba70fee640 1 -- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba54004800 msgr2=0x7fba54004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.606+0000 7fba70fee640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba54004800 0x7fba54004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.606+0000 7fba70fee640 1 -- 172.21.15.6:0/3963808148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba54003520 con 0x7fba540051a0 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.606+0000 7fba70fee640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba540051a0 0x7fba5400b9c0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fba6c06ce40 tx=0x7fba54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1099e5000cab84ae server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64036070 con 0x7fba540051a0 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba64003b90 con 0x7fba540051a0 2024-05-20T18:00:16.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba6affd640 1 -- 172.21.15.6:0/3963808148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64009d60 con 0x7fba540051a0 2024-05-20T18:00:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba72a51640 1 -- 172.21.15.6:0/3963808148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba540051a0 msgr2=0x7fba5400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba72a51640 1 --2- 172.21.15.6:0/3963808148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba540051a0 0x7fba5400b9c0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fba6c06ce40 tx=0x7fba54005830 comp rx=0 tx=0).stop 2024-05-20T18:00:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba70fee640 1 -- 172.21.15.6:0/3963808148 reap_dead start 2024-05-20T18:00:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba72a51640 1 -- 172.21.15.6:0/3963808148 shutdown_connections 2024-05-20T18:00:16.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba72a51640 1 -- 172.21.15.6:0/3963808148 >> 172.21.15.6:0/3963808148 conn(0x7fba6c0d4bd0 msgr2=0x7fba6c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.607+0000 7fba72a51640 1 -- 172.21.15.6:0/3963808148 shutdown_connections 2024-05-20T18:00:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.608+0000 7fba72a51640 1 -- 172.21.15.6:0/3963808148 wait complete. 2024-05-20T18:00:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.609+0000 7fba72a51640 1 Processor -- start 2024-05-20T18:00:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.609+0000 7fba72a51640 1 -- start start 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba72a51640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c14fb40 0x7fba6c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba72a51640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba6c0c86d0 0x7fba6c0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba72a51640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c154bb0 0x7fba6c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba72a51640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0b91a0 con 0x7fba6c154bb0 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba72a51640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0d0300 con 0x7fba6c0c86d0 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba72a51640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c0b4050 con 0x7fba6c14fb40 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c154bb0 0x7fba6c154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c154bb0 0x7fba6c154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42750/0 (socket says 172.21.15.6:42750) 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 -- 172.21.15.6:0/1072884326 learned_addr learned my addr 172.21.15.6:0/1072884326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba6bfff640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c14fb40 0x7fba6c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba6b7fe640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba6c0c86d0 0x7fba6c0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 -- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c14fb40 msgr2=0x7fba6c0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c14fb40 0x7fba6c0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 -- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba6c0c86d0 msgr2=0x7fba6c0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba6c0c86d0 0x7fba6c0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 -- 172.21.15.6:0/1072884326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c0c9020 con 0x7fba6c154bb0 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.611+0000 7fba70fee640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c154bb0 0x7fba6c154fc0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0cbc50 tx=0x7fba64009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.612+0000 7fba68ff9640 1 -- 172.21.15.6:0/1072884326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64036070 con 0x7fba6c154bb0 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.612+0000 7fba68ff9640 1 -- 172.21.15.6:0/1072884326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba64041070 con 0x7fba6c154bb0 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.612+0000 7fba68ff9640 1 -- 172.21.15.6:0/1072884326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64009d60 con 0x7fba6c154bb0 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.612+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c155500 con 0x7fba6c154bb0 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.612+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c153df0 con 0x7fba6c154bb0 2024-05-20T18:00:16.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.613+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c075b00 con 0x7fba6c154bb0 2024-05-20T18:00:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.613+0000 7fba68ff9640 1 -- 172.21.15.6:0/1072884326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba64005d10 con 0x7fba6c154bb0 2024-05-20T18:00:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.614+0000 7fba68ff9640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba5806be30 0x7fba5806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.614+0000 7fba68ff9640 1 -- 172.21.15.6:0/1072884326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7fba640ab3a0 con 0x7fba6c154bb0 2024-05-20T18:00:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.614+0000 7fba6bfff640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba5806be30 0x7fba5806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.615+0000 7fba6bfff640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba5806be30 0x7fba5806e340 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fba6c167dc0 tx=0x7fba5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.618+0000 7fba68ff9640 1 -- 172.21.15.6:0/1072884326 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fba6c0c9020 con 0x7fba6c154bb0 2024-05-20T18:00:16.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.802+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba6c0b3620 con 0x7fba6c154bb0 2024-05-20T18:00:16.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.804+0000 7fba68ff9640 1 -- 172.21.15.6:0/1072884326 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16841 (secure 0 0 0) 0x7fba6402e050 con 0x7fba6c154bb0 2024-05-20T18:00:16.801 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:16.801 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":100,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:15.506828+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:13.843929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:14.484733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:16.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba5806be30 msgr2=0x7fba5806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba5806be30 0x7fba5806e340 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fba6c167dc0 tx=0x7fba5c009040 comp rx=0 tx=0).stop 2024-05-20T18:00:16.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c154bb0 msgr2=0x7fba6c154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c154bb0 0x7fba6c154fc0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0cbc50 tx=0x7fba64009750 comp rx=0 tx=0).stop 2024-05-20T18:00:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 shutdown_connections 2024-05-20T18:00:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fba5806be30 0x7fba5806e340 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba6c154bb0 0x7fba6c154fc0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba6c0c86d0 0x7fba6c0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 --2- 172.21.15.6:0/1072884326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba6c14fb40 0x7fba6c0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 >> 172.21.15.6:0/1072884326 conn(0x7fba6c0d4bd0 msgr2=0x7fba6c06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 shutdown_connections 2024-05-20T18:00:16.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.806+0000 7fba72a51640 1 -- 172.21.15.6:0/1072884326 wait complete. 2024-05-20T18:00:16.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T18:00:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.935+0000 7f6dc9a5a640 1 Processor -- start 2024-05-20T18:00:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.935+0000 7f6dc9a5a640 1 -- start start 2024-05-20T18:00:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc9a5a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6dc4162820 0x7f6dc40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc9a5a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6dc40b3e80 0x7f6dc406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc9a5a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc406dd20 con 0x7f6dc406d910 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc9a5a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc40d0630 con 0x7f6dc4162820 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc9a5a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc40d39c0 con 0x7f6dc40b3e80 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6dc4162820 0x7f6dc40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6dc4162820 0x7f6dc40b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42752/0 (socket says 172.21.15.6:42752) 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc2ffd640 1 -- 172.21.15.6:0/2411062997 learned_addr learned my addr 172.21.15.6:0/2411062997 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc27fc640 1 --2- 172.21.15.6:0/2411062997 >> v2:172.21.15.171:3300/0 conn(0x7f6dc40b3e80 0x7f6dc406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc2ffd640 1 -- 172.21.15.6:0/2411062997 >> v2:172.21.15.171:3300/0 conn(0x7f6dc40b3e80 msgr2=0x7f6dc406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc2ffd640 1 --2- 172.21.15.6:0/2411062997 >> v2:172.21.15.171:3300/0 conn(0x7f6dc40b3e80 0x7f6dc406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc2ffd640 1 -- 172.21.15.6:0/2411062997 >> v1:172.21.15.171:6789/0 conn(0x7f6dc406d910 legacy=0x7f6dc40d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.937+0000 7f6dc2ffd640 1 -- 172.21.15.6:0/2411062997 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc40d3ca0 con 0x7f6dc4162820 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.938+0000 7f6dc2ffd640 1 --2- 172.21.15.6:0/2411062997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc4162820 0x7f6dc40b3940 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40d1230 tx=0x7f6db402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4e951b5905835f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.938+0000 7f6dc1ffb640 1 -- 172.21.15.6:0/2411062997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4037070 con 0x7f6dc4162820 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.938+0000 7f6dc1ffb640 1 -- 172.21.15.6:0/2411062997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db4032440 con 0x7f6dc4162820 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.938+0000 7f6dc1ffb640 1 -- 172.21.15.6:0/2411062997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4032810 con 0x7f6dc4162820 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.939+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2411062997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc4162820 msgr2=0x7f6dc40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.939+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2411062997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc4162820 0x7f6dc40b3940 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40d1230 tx=0x7f6db402a270 comp rx=0 tx=0).stop 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.939+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2411062997 shutdown_connections 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.939+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2411062997 >> v2:172.21.15.171:3300/0 conn(0x7f6dc40b3e80 0x7f6dc406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.939+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2411062997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc4162820 0x7f6dc40b3940 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.939+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2411062997 >> 172.21.15.6:0/2411062997 conn(0x7f6dc40d4bd0 msgr2=0x7f6dc40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.939+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2411062997 shutdown_connections 2024-05-20T18:00:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.939+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2411062997 wait complete. 2024-05-20T18:00:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.941+0000 7f6dc9a5a640 1 Processor -- start 2024-05-20T18:00:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.941+0000 7f6dc9a5a640 1 -- start start 2024-05-20T18:00:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc9a5a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc406d910 0x7f6dc414aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc9a5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc40b3e80 0x7f6dc414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc9a5a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc4162820 0x7f6dc41f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc9a5a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc40d0300 con 0x7f6dc40b3e80 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc9a5a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc40d4260 con 0x7f6dc406d910 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc9a5a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc40b91a0 con 0x7f6dc4162820 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc40b3e80 0x7f6dc414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc40b3e80 0x7f6dc414b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42754/0 (socket says 172.21.15.6:42754) 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.942+0000 7f6dc27fc640 1 -- 172.21.15.6:0/2891860748 learned_addr learned my addr 172.21.15.6:0/2891860748 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc37fe640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc4162820 0x7f6dc41f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc2ffd640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc406d910 0x7f6dc414aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc27fc640 1 -- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc4162820 msgr2=0x7f6dc41f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc27fc640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc4162820 0x7f6dc41f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc27fc640 1 -- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc406d910 msgr2=0x7f6dc414aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc27fc640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc406d910 0x7f6dc414aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc27fc640 1 -- 172.21.15.6:0/2891860748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc40c99f0 con 0x7f6dc40b3e80 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc27fc640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc40b3e80 0x7f6dc414b0e0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d620 tx=0x7f6db800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dabfff640 1 -- 172.21.15.6:0/2891860748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db800b620 con 0x7f6dc40b3e80 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dabfff640 1 -- 172.21.15.6:0/2891860748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db8019070 con 0x7f6dc40b3e80 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dabfff640 1 -- 172.21.15.6:0/2891860748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db800ba00 con 0x7f6dc40b3e80 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc40c9cd0 con 0x7f6dc40b3e80 2024-05-20T18:00:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.943+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc40cbd20 con 0x7f6dc40b3e80 2024-05-20T18:00:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.944+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc4075b00 con 0x7f6dc40b3e80 2024-05-20T18:00:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.945+0000 7f6dabfff640 1 -- 172.21.15.6:0/2891860748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6db800bba0 con 0x7f6dc40b3e80 2024-05-20T18:00:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.945+0000 7f6dabfff640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6db006be30 0x7f6db006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.945+0000 7f6dabfff640 1 -- 172.21.15.6:0/2891860748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f6db808b480 con 0x7f6dc40b3e80 2024-05-20T18:00:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.945+0000 7f6dc2ffd640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6db006be30 0x7f6db006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.946+0000 7f6dc2ffd640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6db006be30 0x7f6db006e340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6db4034000 tx=0x7f6db402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:16.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:16.950+0000 7f6dabfff640 1 -- 172.21.15.6:0/2891860748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6db8059c20 con 0x7f6dc40b3e80 2024-05-20T18:00:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:17.182+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6dc4160a90 con 0x7f6dc40b3e80 2024-05-20T18:00:18.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.142+0000 7f6dabfff640 1 -- 172.21.15.6:0/2891860748 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) ==== 118+0+0 (secure 0 0 0) 0x7f6db8059520 con 0x7f6dc40b3e80 2024-05-20T18:00:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6db006be30 msgr2=0x7f6db006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6db006be30 0x7f6db006e340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6db4034000 tx=0x7f6db402e000 comp rx=0 tx=0).stop 2024-05-20T18:00:18.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc40b3e80 msgr2=0x7f6dc414b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc40b3e80 0x7f6dc414b0e0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d620 tx=0x7f6db800dae0 comp rx=0 tx=0).stop 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 shutdown_connections 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6db006be30 0x7f6db006e340 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dc4162820 0x7f6dc41f8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dc40b3e80 0x7f6dc414b0e0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 --2- 172.21.15.6:0/2891860748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dc406d910 0x7f6dc414aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 >> 172.21.15.6:0/2891860748 conn(0x7f6dc40d4bd0 msgr2=0x7f6dc40b9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 shutdown_connections 2024-05-20T18:00:18.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.145+0000 7f6dc9a5a640 1 -- 172.21.15.6:0/2891860748 wait complete. 2024-05-20T18:00:18.156 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T18:00:18.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T18:00:18.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.284+0000 7fb711e5a640 1 Processor -- start 2024-05-20T18:00:18.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.284+0000 7fb711e5a640 1 -- start start 2024-05-20T18:00:18.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.285+0000 7fb711e5a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb70c162820 0x7fb70c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:18.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.285+0000 7fb711e5a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb70c0d0630 con 0x7fb70c06dae0 2024-05-20T18:00:18.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.285+0000 7fb711e5a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb70c0d39c0 con 0x7fb70c0b3e80 2024-05-20T18:00:18.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.285+0000 7fb711e5a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb70c0d3ca0 con 0x7fb70c162820 2024-05-20T18:00:18.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.285+0000 7fb70b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb70c162820 0x7fb70c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:18.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.286+0000 7fb70bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb70c06dae0 0x7fb70c0b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54138/0 (socket says 172.21.15.6:54138) 2024-05-20T18:00:18.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.286+0000 7fb70bfff640 1 -- 172.21.15.6:0/2806376475 learned_addr learned my addr 172.21.15.6:0/2806376475 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:18.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.286+0000 7fb70b7fe640 1 -- 172.21.15.6:0/2806376475 >> v1:172.21.15.171:6789/0 conn(0x7fb70c0b3e80 legacy=0x7fb70c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:18.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.286+0000 7fb70b7fe640 1 -- 172.21.15.6:0/2806376475 >> v1:172.21.15.6:6789/0 conn(0x7fb70c06dae0 legacy=0x7fb70c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:18.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.286+0000 7fb70b7fe640 1 -- 172.21.15.6:0/2806376475 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c0d3f80 con 0x7fb70c162820 2024-05-20T18:00:18.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.286+0000 7fb70a7fc640 1 -- 172.21.15.6:0/2806376475 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077531558 0 0) 0x7fb70c0d0630 con 0x7fb70c06dae0 2024-05-20T18:00:18.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.287+0000 7fb70b7fe640 1 --2- 172.21.15.6:0/2806376475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0b3940 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097a0 tx=0x7fb6fc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fa3c9e1d5dca9f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:18.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.287+0000 7fb70a7fc640 1 -- 172.21.15.6:0/2806376475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc037070 con 0x7fb70c162820 2024-05-20T18:00:18.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.287+0000 7fb70a7fc640 1 -- 172.21.15.6:0/2806376475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6fc032440 con 0x7fb70c162820 2024-05-20T18:00:18.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.287+0000 7fb70a7fc640 1 -- 172.21.15.6:0/2806376475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc032810 con 0x7fb70c162820 2024-05-20T18:00:18.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.288+0000 7fb711e5a640 1 -- 172.21.15.6:0/2806376475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 msgr2=0x7fb70c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:18.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.288+0000 7fb711e5a640 1 --2- 172.21.15.6:0/2806376475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0b3940 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0097a0 tx=0x7fb6fc02a230 comp rx=0 tx=0).stop 2024-05-20T18:00:18.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.288+0000 7fb711e5a640 1 -- 172.21.15.6:0/2806376475 shutdown_connections 2024-05-20T18:00:18.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.288+0000 7fb711e5a640 1 --2- 172.21.15.6:0/2806376475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0b3940 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:18.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.288+0000 7fb711e5a640 1 -- 172.21.15.6:0/2806376475 >> 172.21.15.6:0/2806376475 conn(0x7fb70c0d4bd0 msgr2=0x7fb70c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:18.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.288+0000 7fb711e5a640 1 -- 172.21.15.6:0/2806376475 shutdown_connections 2024-05-20T18:00:18.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.288+0000 7fb711e5a640 1 -- 172.21.15.6:0/2806376475 wait complete. 2024-05-20T18:00:18.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.291+0000 7fb711e5a640 1 Processor -- start 2024-05-20T18:00:18.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.291+0000 7fb711e5a640 1 -- start start 2024-05-20T18:00:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb711e5a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb70c0b3e80 0x7fb70c150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb711e5a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb711e5a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb70c0cdbc0 0x7fb70c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb711e5a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c0d4780 con 0x7fb70c162820 2024-05-20T18:00:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb711e5a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c0d0300 con 0x7fb70c0b3e80 2024-05-20T18:00:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb711e5a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c0d4900 con 0x7fb70c0cdbc0 2024-05-20T18:00:18.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50038/0 (socket says 172.21.15.6:50038) 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 -- 172.21.15.6:0/1128873635 learned_addr learned my addr 172.21.15.6:0/1128873635 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70b7fe640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb70c0b3e80 0x7fb70c150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70bfff640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb70c0cdbc0 0x7fb70c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 -- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb70c0cdbc0 msgr2=0x7fb70c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb70c0cdbc0 0x7fb70c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 -- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb70c0b3e80 msgr2=0x7fb70c150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb70c0b3e80 0x7fb70c150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 -- 172.21.15.6:0/1128873635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c1f83a0 con 0x7fb70c162820 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.294+0000 7fb70affd640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0cd680 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fb70000c430 tx=0x7fb70000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:18.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.295+0000 7fb6f3fff640 1 -- 172.21.15.6:0/1128873635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700017070 con 0x7fb70c162820 2024-05-20T18:00:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.295+0000 7fb6f3fff640 1 -- 172.21.15.6:0/1128873635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7000052d0 con 0x7fb70c162820 2024-05-20T18:00:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.295+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c1f8680 con 0x7fb70c162820 2024-05-20T18:00:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.295+0000 7fb6f3fff640 1 -- 172.21.15.6:0/1128873635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700003830 con 0x7fb70c162820 2024-05-20T18:00:18.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.295+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c1f8c40 con 0x7fb70c162820 2024-05-20T18:00:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.296+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c0ce0b0 con 0x7fb70c162820 2024-05-20T18:00:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.296+0000 7fb6f3fff640 1 -- 172.21.15.6:0/1128873635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb70001a070 con 0x7fb70c162820 2024-05-20T18:00:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.297+0000 7fb6f3fff640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb6f806be30 0x7fb6f806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.297+0000 7fb6f3fff640 1 -- 172.21.15.6:0/1128873635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fb70008a350 con 0x7fb70c162820 2024-05-20T18:00:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.297+0000 7fb70b7fe640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb6f806be30 0x7fb6f806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.298+0000 7fb70b7fe640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb6f806be30 0x7fb6f806e340 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc034000 tx=0x7fb6fc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.302+0000 7fb6f3fff640 1 -- 172.21.15.6:0/1128873635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb700058b70 con 0x7fb70c162820 2024-05-20T18:00:18.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:18.525+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb70c075b00 con 0x7fb70c162820 2024-05-20T18:00:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.158+0000 7fb6f3fff640 1 -- 172.21.15.6:0/1128873635 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7fb700058470 con 0x7fb70c162820 2024-05-20T18:00:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb6f806be30 msgr2=0x7fb6f806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb6f806be30 0x7fb6f806e340 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc034000 tx=0x7fb6fc02e000 comp rx=0 tx=0).stop 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 msgr2=0x7fb70c0cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0cd680 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fb70000c430 tx=0x7fb70000c8f0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 shutdown_connections 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb6f806be30 0x7fb6f806e340 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb70c0cdbc0 0x7fb70c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb70c162820 0x7fb70c0cd680 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 --2- 172.21.15.6:0/1128873635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb70c0b3e80 0x7fb70c150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 >> 172.21.15.6:0/1128873635 conn(0x7fb70c0d4bd0 msgr2=0x7fb70c15e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 shutdown_connections 2024-05-20T18:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.161+0000 7fb711e5a640 1 -- 172.21.15.6:0/1128873635 wait complete. 2024-05-20T18:00:19.173 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T18:00:19.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:19.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.298+0000 7f5cdb81b640 1 Processor -- start 2024-05-20T18:00:19.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.298+0000 7f5cdb81b640 1 -- start start 2024-05-20T18:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.299+0000 7f5cdb81b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5cd4163a10 0x7f5cd40d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.299+0000 7f5cdb81b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cd40b4010 0x7f5cd40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.299+0000 7f5cdb81b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd40d0370 con 0x7f5cd40d14b0 2024-05-20T18:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.299+0000 7f5cdb81b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd40d3ca0 con 0x7f5cd40b4010 2024-05-20T18:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.299+0000 7f5cdb81b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd40d0650 con 0x7f5cd4163a10 2024-05-20T18:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5cd8db6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5cd40b4010 0x7f5cd40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5cd9db8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5cd40d14b0 0x7f5cd40d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54154/0 (socket says 172.21.15.6:54154) 2024-05-20T18:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5cd9db8640 1 -- 172.21.15.6:0/2499378702 learned_addr learned my addr 172.21.15.6:0/2499378702 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5cd95b7640 1 --2- 172.21.15.6:0/2499378702 >> v2:172.21.15.171:3300/0 conn(0x7f5cd4163a10 0x7f5cd40d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5cd8db6640 1 -- 172.21.15.6:0/2499378702 >> v2:172.21.15.171:3300/0 conn(0x7f5cd4163a10 msgr2=0x7f5cd40d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5cd8db6640 1 --2- 172.21.15.6:0/2499378702 >> v2:172.21.15.171:3300/0 conn(0x7f5cd4163a10 0x7f5cd40d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5cd8db6640 1 -- 172.21.15.6:0/2499378702 >> v1:172.21.15.6:6789/0 conn(0x7f5cd40d14b0 legacy=0x7f5cd40d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5ccbfff640 1 -- 172.21.15.6:0/2499378702 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255080936 0 0) 0x7f5cd40d0370 con 0x7f5cd40d14b0 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.300+0000 7f5cd8db6640 1 -- 172.21.15.6:0/2499378702 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd40d3650 con 0x7f5cd40b4010 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.301+0000 7f5cd8db6640 1 --2- 172.21.15.6:0/2499378702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40b4010 0x7f5cd40cfb00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40cf1c0 tx=0x7f5cc402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f995d7a9d2c5f37 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.301+0000 7f5ccbfff640 1 -- 172.21.15.6:0/2499378702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4037070 con 0x7f5cd40b4010 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.301+0000 7f5ccbfff640 1 -- 172.21.15.6:0/2499378702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc4032440 con 0x7f5cd40b4010 2024-05-20T18:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.301+0000 7f5ccbfff640 1 -- 172.21.15.6:0/2499378702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4032810 con 0x7f5cd40b4010 2024-05-20T18:00:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.302+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2499378702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40b4010 msgr2=0x7f5cd40cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.302+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2499378702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40b4010 0x7f5cd40cfb00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40cf1c0 tx=0x7f5cc402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.302+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2499378702 shutdown_connections 2024-05-20T18:00:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.302+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2499378702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40b4010 0x7f5cd40cfb00 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.302+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2499378702 >> v2:172.21.15.171:3300/0 conn(0x7f5cd4163a10 0x7f5cd40d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.302+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2499378702 >> 172.21.15.6:0/2499378702 conn(0x7f5cd406d240 msgr2=0x7f5cd406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.302+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2499378702 shutdown_connections 2024-05-20T18:00:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.302+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2499378702 wait complete. 2024-05-20T18:00:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.303+0000 7f5cdb81b640 1 Processor -- start 2024-05-20T18:00:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.304+0000 7f5cdb81b640 1 -- start start 2024-05-20T18:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cdb81b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd40b4010 0x7f5cd40b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cdb81b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40d14b0 0x7f5cd40ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cdb81b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cd4163a10 0x7f5cd41f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cdb81b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd40b8210 con 0x7f5cd40d14b0 2024-05-20T18:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cdb81b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd40d0040 con 0x7f5cd4163a10 2024-05-20T18:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cdb81b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd40b8390 con 0x7f5cd40b4010 2024-05-20T18:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd8db6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40d14b0 0x7f5cd40ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd8db6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40d14b0 0x7f5cd40ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50058/0 (socket says 172.21.15.6:50058) 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd8db6640 1 -- 172.21.15.6:0/2459508676 learned_addr learned my addr 172.21.15.6:0/2459508676 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd9db8640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cd4163a10 0x7f5cd41f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd95b7640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd40b4010 0x7f5cd40b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd8db6640 1 -- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd40b4010 msgr2=0x7f5cd40b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd8db6640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd40b4010 0x7f5cd40b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd8db6640 1 -- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cd4163a10 msgr2=0x7f5cd41f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd8db6640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cd4163a10 0x7f5cd41f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.305+0000 7f5cd8db6640 1 -- 172.21.15.6:0/2459508676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd414ab20 con 0x7f5cd40d14b0 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.306+0000 7f5cd8db6640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40d14b0 0x7f5cd40ce030 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4000c00 tx=0x7f5cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.306+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/2459508676 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4037040 con 0x7f5cd40d14b0 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.306+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/2459508676 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc4042070 con 0x7f5cd40d14b0 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.306+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd40b5930 con 0x7f5cd40d14b0 2024-05-20T18:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.306+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/2459508676 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4030bd0 con 0x7f5cd40d14b0 2024-05-20T18:00:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.306+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd40b5ef0 con 0x7f5cd40d14b0 2024-05-20T18:00:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.307+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd40b56a0 con 0x7f5cd40d14b0 2024-05-20T18:00:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.308+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/2459508676 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cc4047460 con 0x7f5cd40d14b0 2024-05-20T18:00:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.308+0000 7f5cc9ffb640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cb806be60 0x7f5cb806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.308+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/2459508676 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f5cc40ab900 con 0x7f5cd40d14b0 2024-05-20T18:00:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.308+0000 7f5cd95b7640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cb806be60 0x7f5cb806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.309+0000 7f5cd95b7640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cb806be60 0x7f5cb806e370 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40d3020 tx=0x7f5cd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.313+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/2459508676 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5cc404c020 con 0x7f5cd40d14b0 2024-05-20T18:00:19.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.533+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cd4075b00 con 0x7f5cd40d14b0 2024-05-20T18:00:19.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.534+0000 7f5cc9ffb640 1 -- 172.21.15.6:0/2459508676 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5180 (secure 0 0 0) 0x7f5cc4032e20 con 0x7f5cd40d14b0 2024-05-20T18:00:19.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:19.532 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6413,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2288332461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2288332461},{"type":"v1","addr":"172.21.15.171:6835","nonce":2288332461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/4138789955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4138789955},{"type":"v1","addr":"172.21.15.171:6837","nonce":4138789955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2834528553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2834528553},{"type":"v1","addr":"172.21.15.6:6835","nonce":2834528553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:15.507163+0000","modified":"2024-05-20T18:00:18.526380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7725":{"gid":7725,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6834/957433228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":957433228},{"type":"v1","addr":"172.21.15.6:6834","nonce":957433228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7725,"qdb_cluster":[7725]},"id":7}]} 2024-05-20T18:00:19.532 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cb806be60 msgr2=0x7f5cb806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cb806be60 0x7f5cb806e370 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40d3020 tx=0x7f5cd0008040 comp rx=0 tx=0).stop 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40d14b0 msgr2=0x7f5cd40ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40d14b0 0x7f5cd40ce030 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4000c00 tx=0x7f5cc40046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 shutdown_connections 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5cb806be60 0x7f5cb806e370 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cd4163a10 0x7f5cd41f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cd40d14b0 0x7f5cd40ce030 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 --2- 172.21.15.6:0/2459508676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5cd40b4010 0x7f5cd40b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 >> 172.21.15.6:0/2459508676 conn(0x7f5cd406d240 msgr2=0x7f5cd415d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 shutdown_connections 2024-05-20T18:00:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.536+0000 7f5cdb81b640 1 -- 172.21.15.6:0/2459508676 wait complete. 2024-05-20T18:00:19.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:19.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.662+0000 7f1f388fe640 1 Processor -- start 2024-05-20T18:00:19.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.662+0000 7f1f388fe640 1 -- start start 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f388fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f34168050 0x7f1f3416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f388fe640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f340d0630 con 0x7f1f3406d3d0 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f388fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f340d39c0 con 0x7f1f34162820 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f388fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340d3ca0 con 0x7f1f34168050 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f31d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1f3406d3d0 0x7f1f3406d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54156/0 (socket says 172.21.15.6:54156) 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f31d9b640 1 -- 172.21.15.6:0/1216510599 learned_addr learned my addr 172.21.15.6:0/1216510599 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f32d9d640 1 --2- 172.21.15.6:0/1216510599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f34168050 0x7f1f3416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f3159a640 1 -- 172.21.15.6:0/1216510599 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437915079 0 0) 0x7f1f340d0630 con 0x7f1f3406d3d0 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f3159a640 1 -- 172.21.15.6:0/1216510599 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c003520 con 0x7f1f3406d3d0 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f3159a640 1 -- 172.21.15.6:0/1216510599 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689860199 0 0) 0x7f1f340d39c0 con 0x7f1f34162820 2024-05-20T18:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f3159a640 1 -- 172.21.15.6:0/1216510599 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f340d0630 con 0x7f1f34162820 2024-05-20T18:00:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f32d9d640 1 -- 172.21.15.6:0/1216510599 >> v1:172.21.15.171:6789/0 conn(0x7f1f34162820 legacy=0x7f1f340b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f3159a640 1 -- 172.21.15.6:0/1216510599 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3707788552 0 0) 0x7f1f1c003520 con 0x7f1f3406d3d0 2024-05-20T18:00:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f32d9d640 1 -- 172.21.15.6:0/1216510599 >> v1:172.21.15.6:6789/0 conn(0x7f1f3406d3d0 legacy=0x7f1f3406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.664+0000 7f1f32d9d640 1 -- 172.21.15.6:0/1216510599 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f340d3f80 con 0x7f1f34168050 2024-05-20T18:00:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.665+0000 7f1f32d9d640 1 --2- 172.21.15.6:0/1216510599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f34168050 0x7f1f3416a470 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0097d0 tx=0x7f1f2c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9e6a4cd430397c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f3159a640 1 -- 172.21.15.6:0/1216510599 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c037070 con 0x7f1f34168050 2024-05-20T18:00:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f3159a640 1 -- 172.21.15.6:0/1216510599 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c02ac30 con 0x7f1f34168050 2024-05-20T18:00:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f3159a640 1 -- 172.21.15.6:0/1216510599 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28001670 con 0x7f1f34168050 2024-05-20T18:00:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f388fe640 1 -- 172.21.15.6:0/1216510599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f34168050 msgr2=0x7f1f3416a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f388fe640 1 --2- 172.21.15.6:0/1216510599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f34168050 0x7f1f3416a470 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0097d0 tx=0x7f1f2c02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f388fe640 1 -- 172.21.15.6:0/1216510599 shutdown_connections 2024-05-20T18:00:19.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f388fe640 1 --2- 172.21.15.6:0/1216510599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f34168050 0x7f1f3416a470 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f388fe640 1 -- 172.21.15.6:0/1216510599 >> 172.21.15.6:0/1216510599 conn(0x7f1f340d4bd0 msgr2=0x7f1f340d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:19.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f388fe640 1 -- 172.21.15.6:0/1216510599 shutdown_connections 2024-05-20T18:00:19.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.666+0000 7f1f388fe640 1 -- 172.21.15.6:0/1216510599 wait complete. 2024-05-20T18:00:19.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.668+0000 7f1f388fe640 1 Processor -- start 2024-05-20T18:00:19.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.668+0000 7f1f388fe640 1 -- start start 2024-05-20T18:00:19.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f388fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f3406d3d0 0x7f1f34158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f388fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f34162820 0x7f1f34156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f388fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f34168050 0x7f1f34159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f388fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1f340b91a0 con 0x7f1f34162820 2024-05-20T18:00:19.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f388fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1f340d0300 con 0x7f1f34168050 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f388fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340b4050 con 0x7f1f3406d3d0 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f34162820 0x7f1f34156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f34162820 0x7f1f34156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50062/0 (socket says 172.21.15.6:50062) 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 -- 172.21.15.6:0/3291219179 learned_addr learned my addr 172.21.15.6:0/3291219179 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f3259c640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f3406d3d0 0x7f1f34158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f32d9d640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f34168050 0x7f1f34159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 -- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f3406d3d0 msgr2=0x7f1f34158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f3406d3d0 0x7f1f34158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 -- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f34168050 msgr2=0x7f1f34159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f34168050 0x7f1f34159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 -- 172.21.15.6:0/3291219179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34158c60 con 0x7f1f34162820 2024-05-20T18:00:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f32d9d640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f34168050 0x7f1f34159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f31d9b640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f34162820 0x7f1f34156b00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c5d0 tx=0x7f1f2800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f22ffd640 1 -- 172.21.15.6:0/3291219179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28017070 con 0x7f1f34162820 2024-05-20T18:00:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f22ffd640 1 -- 172.21.15.6:0/3291219179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f28005d00 con 0x7f1f34162820 2024-05-20T18:00:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f22ffd640 1 -- 172.21.15.6:0/3291219179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f280072b0 con 0x7f1f34162820 2024-05-20T18:00:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.670+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f34158f40 con 0x7f1f34162820 2024-05-20T18:00:19.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.671+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f34159500 con 0x7f1f34162820 2024-05-20T18:00:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.672+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f34075b00 con 0x7f1f34162820 2024-05-20T18:00:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.672+0000 7f1f22ffd640 1 -- 172.21.15.6:0/3291219179 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f2801a070 con 0x7f1f34162820 2024-05-20T18:00:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.672+0000 7f1f22ffd640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1f1406be30 0x7f1f1406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.673+0000 7f1f22ffd640 1 -- 172.21.15.6:0/3291219179 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f1f2808a480 con 0x7f1f34162820 2024-05-20T18:00:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.673+0000 7f1f3259c640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1f1406be30 0x7f1f1406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.673+0000 7f1f3259c640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1f1406be30 0x7f1f1406e340 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1f24001460 tx=0x7f1f24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:19.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.677+0000 7f1f22ffd640 1 -- 172.21.15.6:0/3291219179 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1f28058ca0 con 0x7f1f34162820 2024-05-20T18:00:19.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.861+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f341589f0 con 0x7f1f34162820 2024-05-20T18:00:19.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.863+0000 7f1f22ffd640 1 -- 172.21.15.6:0/3291219179 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16828 (secure 0 0 0) 0x7f1f280585a0 con 0x7f1f34162820 2024-05-20T18:00:19.860 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:19.860 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":101,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:17.119205+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:13.843929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:14.484733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1f1406be30 msgr2=0x7f1f1406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1f1406be30 0x7f1f1406e340 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1f24001460 tx=0x7f1f24009040 comp rx=0 tx=0).stop 2024-05-20T18:00:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f34162820 msgr2=0x7f1f34156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f34162820 0x7f1f34156b00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c5d0 tx=0x7f1f2800ca90 comp rx=0 tx=0).stop 2024-05-20T18:00:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 shutdown_connections 2024-05-20T18:00:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1f1406be30 0x7f1f1406e340 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f34168050 0x7f1f34159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f34162820 0x7f1f34156b00 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 --2- 172.21.15.6:0/3291219179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1f3406d3d0 0x7f1f34158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 >> 172.21.15.6:0/3291219179 conn(0x7f1f340d4bd0 msgr2=0x7f1f341619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 shutdown_connections 2024-05-20T18:00:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.865+0000 7f1f388fe640 1 -- 172.21.15.6:0/3291219179 wait complete. 2024-05-20T18:00:19.874 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T18:00:19.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:00:19.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.991+0000 7fa917ca2640 1 Processor -- start 2024-05-20T18:00:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.991+0000 7fa917ca2640 1 -- start start 2024-05-20T18:00:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa917ca2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa91006d3d0 0x7fa91006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa917ca2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9100b8190 0x7fa9100b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa917ca2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa91006dd20 con 0x7fa910162820 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa917ca2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa9100d0630 con 0x7fa9100b8190 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa917ca2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9100d39c0 con 0x7fa91006d3d0 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa91623f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9100b8190 0x7fa9100b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa91623f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9100b8190 0x7fa9100b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50074/0 (socket says 172.21.15.6:50074) 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa91623f640 1 -- 172.21.15.6:0/1746560133 learned_addr learned my addr 172.21.15.6:0/1746560133 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa91523d640 1 --2- 172.21.15.6:0/1746560133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa91006d3d0 0x7fa91006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa91623f640 1 -- 172.21.15.6:0/1746560133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa91006d3d0 msgr2=0x7fa91006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa91623f640 1 --2- 172.21.15.6:0/1746560133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa91006d3d0 0x7fa91006d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa91623f640 1 -- 172.21.15.6:0/1746560133 >> v1:172.21.15.171:6789/0 conn(0x7fa910162820 legacy=0x7fa9100b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.993+0000 7fa91623f640 1 -- 172.21.15.6:0/1746560133 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9100d3ca0 con 0x7fa9100b8190 2024-05-20T18:00:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.994+0000 7fa91623f640 1 --2- 172.21.15.6:0/1746560133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9100b8190 0x7fa9100b85a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa908009e50 tx=0x7fa90802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b401cc40f41f071 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.994+0000 7fa914a3c640 1 -- 172.21.15.6:0/1746560133 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908036070 con 0x7fa9100b8190 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.994+0000 7fa914a3c640 1 -- 172.21.15.6:0/1746560133 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa908031600 con 0x7fa9100b8190 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.994+0000 7fa914a3c640 1 -- 172.21.15.6:0/1746560133 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080319d0 con 0x7fa9100b8190 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.995+0000 7fa917ca2640 1 -- 172.21.15.6:0/1746560133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9100b8190 msgr2=0x7fa9100b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.995+0000 7fa917ca2640 1 --2- 172.21.15.6:0/1746560133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9100b8190 0x7fa9100b85a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa908009e50 tx=0x7fa90802a6c0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.995+0000 7fa917ca2640 1 -- 172.21.15.6:0/1746560133 shutdown_connections 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.995+0000 7fa917ca2640 1 --2- 172.21.15.6:0/1746560133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9100b8190 0x7fa9100b85a0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.995+0000 7fa917ca2640 1 --2- 172.21.15.6:0/1746560133 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa91006d3d0 0x7fa91006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.995+0000 7fa917ca2640 1 -- 172.21.15.6:0/1746560133 >> 172.21.15.6:0/1746560133 conn(0x7fa9100d4bd0 msgr2=0x7fa9100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.995+0000 7fa917ca2640 1 -- 172.21.15.6:0/1746560133 shutdown_connections 2024-05-20T18:00:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.995+0000 7fa917ca2640 1 -- 172.21.15.6:0/1746560133 wait complete. 2024-05-20T18:00:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.997+0000 7fa917ca2640 1 Processor -- start 2024-05-20T18:00:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.997+0000 7fa917ca2640 1 -- start start 2024-05-20T18:00:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa917ca2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa91006d3d0 0x7fa91015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa917ca2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9100b8190 0x7fa9100b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa917ca2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa910162820 0x7fa9100caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa917ca2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100d0300 con 0x7fa91006d3d0 2024-05-20T18:00:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa917ca2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100d4260 con 0x7fa9100b8190 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa917ca2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9100b4050 con 0x7fa910162820 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa915a3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa91006d3d0 0x7fa91015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa915a3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa91006d3d0 0x7fa91015a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50078/0 (socket says 172.21.15.6:50078) 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa915a3e640 1 -- 172.21.15.6:0/441513827 learned_addr learned my addr 172.21.15.6:0/441513827 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa91523d640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9100b8190 0x7fa9100b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa91623f640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa910162820 0x7fa9100caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa915a3e640 1 -- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa910162820 msgr2=0x7fa9100caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa915a3e640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa910162820 0x7fa9100caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa915a3e640 1 -- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9100b8190 msgr2=0x7fa9100b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa915a3e640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9100b8190 0x7fa9100b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa915a3e640 1 -- 172.21.15.6:0/441513827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9101f57b0 con 0x7fa91006d3d0 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.998+0000 7fa91523d640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9100b8190 0x7fa9100b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:19.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.999+0000 7fa915a3e640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa91006d3d0 0x7fa91015a3e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00b3f0 tx=0x7fa90c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:19.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.999+0000 7fa9027fc640 1 -- 172.21.15.6:0/441513827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c015020 con 0x7fa91006d3d0 2024-05-20T18:00:19.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.999+0000 7fa9027fc640 1 -- 172.21.15.6:0/441513827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c011830 con 0x7fa91006d3d0 2024-05-20T18:00:19.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.999+0000 7fa9027fc640 1 -- 172.21.15.6:0/441513827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c011c20 con 0x7fa91006d3d0 2024-05-20T18:00:19.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.999+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9101f5a90 con 0x7fa91006d3d0 2024-05-20T18:00:19.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:19.999+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9101f6050 con 0x7fa91006d3d0 2024-05-20T18:00:19.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.000+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa910075b00 con 0x7fa91006d3d0 2024-05-20T18:00:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.000+0000 7fa9027fc640 1 -- 172.21.15.6:0/441513827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa90c018020 con 0x7fa91006d3d0 2024-05-20T18:00:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.001+0000 7fa9027fc640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8f406be30 0x7fa8f406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.001+0000 7fa9027fc640 1 -- 172.21.15.6:0/441513827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fa90c08ac20 con 0x7fa91006d3d0 2024-05-20T18:00:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.001+0000 7fa91523d640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8f406be30 0x7fa8f406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.002+0000 7fa91523d640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8f406be30 0x7fa8f406e340 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa904006fd0 tx=0x7fa904008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.005+0000 7fa9027fc640 1 -- 172.21.15.6:0/441513827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa90c01f030 con 0x7fa91006d3d0 2024-05-20T18:00:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.187+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa910154660 con 0x7fa8f406be30 2024-05-20T18:00:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.194+0000 7fa9027fc640 1 -- 172.21.15.6:0/441513827 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240160 (secure 0 0 0) 0x7fa910154660 con 0x7fa8f406be30 2024-05-20T18:00:20.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8f406be30 msgr2=0x7fa8f406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8f406be30 0x7fa8f406e340 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa904006fd0 tx=0x7fa904008040 comp rx=0 tx=0).stop 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa91006d3d0 msgr2=0x7fa91015a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa91006d3d0 0x7fa91015a3e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00b3f0 tx=0x7fa90c00b8b0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 shutdown_connections 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa8f406be30 0x7fa8f406e340 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa910162820 0x7fa9100caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9100b8190 0x7fa9100b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 --2- 172.21.15.6:0/441513827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa91006d3d0 0x7fa91015a3e0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 >> 172.21.15.6:0/441513827 conn(0x7fa9100d4bd0 msgr2=0x7fa9100ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 shutdown_connections 2024-05-20T18:00:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.197+0000 7fa917ca2640 1 -- 172.21.15.6:0/441513827 wait complete. 2024-05-20T18:00:20.206 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-05-20T18:00:18.345726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260056,"kb_used_data":10592,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714664,"statfs":{"total":773094113280,"available":772827815936,"internally_reserved":0,"allocated":10846208,"data_stored":5605850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.229948"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.114927+0000","last_change":"2024-05-20T18:00:14.114927+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.114927+0000","last_undegraded":"2024-05-20T18:00:14.114927+0000","last_fullsized":"2024-05-20T18:00:14.114927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.120585+0000","last_change":"2024-05-20T18:00:14.120585+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.120585+0000","last_undegraded":"2024-05-20T18:00:14.120585+0000","last_fullsized":"2024-05-20T18:00:14.120585+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.120174+0000","last_change":"2024-05-20T18:00:14.120174+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.120174+0000","last_undegraded":"2024-05-20T18:00:14.120174+0000","last_fullsized":"2024-05-20T18:00:14.120174+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.117058+0000","last_change":"2024-05-20T18:00:14.117058+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.117058+0000","last_undegraded":"2024-05-20T18:00:14.117058+0000","last_fullsized":"2024-05-20T18:00:14.117058+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.119255+0000","last_change":"2024-05-20T18:00:14.119255+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.119255+0000","last_undegraded":"2024-05-20T18:00:14.119255+0000","last_fullsized":"2024-05-20T18:00:14.119255+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.121777+0000","last_change":"2024-05-20T18:00:14.121777+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.121777+0000","last_undegraded":"2024-05-20T18:00:14.121777+0000","last_fullsized":"2024-05-20T18:00:14.121777+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.118761+0000","last_change":"2024-05-20T18:00:14.118761+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.118761+0000","last_undegraded":"2024-05-20T18:00:14.118761+0000","last_fullsized":"2024-05-20T18:00:14.118761+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.114908+0000","last_change":"2024-05-20T18:00:14.114908+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.114908+0000","last_undegraded":"2024-05-20T18:00:14.114908+0000","last_fullsized":"2024-05-20T18:00:14.114908+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.119089+0000","last_change":"2024-05-20T18:00:14.119089+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.119089+0000","last_undegraded":"2024-05-20T18:00:14.119089+0000","last_fullsized":"2024-05-20T18:00:14.119089+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.122186+0000","last_change":"2024-05-20T18:00:14.122186+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.122186+0000","last_undegraded":"2024-05-20T18:00:14.122186+0000","last_fullsized":"2024-05-20T18:00:14.122186+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.118398+0000","last_change":"2024-05-20T18:00:14.118398+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.118398+0000","last_undegraded":"2024-05-20T18:00:14.118398+0000","last_fullsized":"2024-05-20T18:00:14.118398+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.121034+0000","last_change":"2024-05-20T18:00:14.121034+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.121034+0000","last_undegraded":"2024-05-20T18:00:14.121034+0000","last_fullsized":"2024-05-20T18:00:14.121034+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.116900+0000","last_change":"2024-05-20T18:00:14.116900+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.116900+0000","last_undegraded":"2024-05-20T18:00:14.116900+0000","last_fullsized":"2024-05-20T18:00:14.116900+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.114908+0000","last_change":"2024-05-20T18:00:14.114908+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.114908+0000","last_undegraded":"2024-05-20T18:00:14.114908+0000","last_fullsized":"2024-05-20T18:00:14.114908+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.118838+0000","last_change":"2024-05-20T18:00:14.118838+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.118838+0000","last_undegraded":"2024-05-20T18:00:14.118838+0000","last_fullsized":"2024-05-20T18:00:14.118838+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.118694+0000","last_change":"2024-05-20T18:00:14.118694+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.118694+0000","last_undegraded":"2024-05-20T18:00:14.118694+0000","last_fullsized":"2024-05-20T18:00:14.118694+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.120926+0000","last_change":"2024-05-20T18:00:14.120926+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.120926+0000","last_undegraded":"2024-05-20T18:00:14.120926+0000","last_fullsized":"2024-05-20T18:00:14.120926+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.117833+0000","last_change":"2024-05-20T18:00:14.117833+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.117833+0000","last_undegraded":"2024-05-20T18:00:14.117833+0000","last_fullsized":"2024-05-20T18:00:14.117833+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.121843+0000","last_change":"2024-05-20T18:00:14.121843+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.121843+0000","last_undegraded":"2024-05-20T18:00:14.121843+0000","last_fullsized":"2024-05-20T18:00:14.121843+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.120516+0000","last_change":"2024-05-20T18:00:14.120516+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.120516+0000","last_undegraded":"2024-05-20T18:00:14.120516+0000","last_fullsized":"2024-05-20T18:00:14.120516+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.119571+0000","last_change":"2024-05-20T18:00:14.119571+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.119571+0000","last_undegraded":"2024-05-20T18:00:14.119571+0000","last_fullsized":"2024-05-20T18:00:14.119571+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.120832+0000","last_change":"2024-05-20T18:00:14.120832+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.120832+0000","last_undegraded":"2024-05-20T18:00:14.120832+0000","last_fullsized":"2024-05-20T18:00:14.120832+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.119383+0000","last_change":"2024-05-20T18:00:14.119383+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.119383+0000","last_undegraded":"2024-05-20T18:00:14.119383+0000","last_fullsized":"2024-05-20T18:00:14.119383+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.116935+0000","last_change":"2024-05-20T18:00:14.116935+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.116935+0000","last_undegraded":"2024-05-20T18:00:14.116935+0000","last_fullsized":"2024-05-20T18:00:14.116935+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.121624+0000","last_change":"2024-05-20T18:00:14.121624+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.121624+0000","last_undegraded":"2024-05-20T18:00:14.121624+0000","last_fullsized":"2024-05-20T18:00:14.121624+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.119846+0000","last_change":"2024-05-20T18:00:14.119846+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.119846+0000","last_undegraded":"2024-05-20T18:00:14.119846+0000","last_fullsized":"2024-05-20T18:00:14.119846+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.116632+0000","last_change":"2024-05-20T18:00:14.116632+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.116632+0000","last_undegraded":"2024-05-20T18:00:14.116632+0000","last_fullsized":"2024-05-20T18:00:14.116632+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.118737+0000","last_change":"2024-05-20T18:00:14.118737+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.118737+0000","last_undegraded":"2024-05-20T18:00:14.118737+0000","last_fullsized":"2024-05-20T18:00:14.118737+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.118831+0000","last_change":"2024-05-20T18:00:14.118831+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.118831+0000","last_undegraded":"2024-05-20T18:00:14.118831+0000","last_fullsized":"2024-05-20T18:00:14.118831+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.117806+0000","last_change":"2024-05-20T18:00:14.117806+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.117806+0000","last_undegraded":"2024-05-20T18:00:14.117806+0000","last_fullsized":"2024-05-20T18:00:14.117806+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.118815+0000","last_change":"2024-05-20T18:00:14.118815+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.118815+0000","last_undegraded":"2024-05-20T18:00:14.118815+0000","last_fullsized":"2024-05-20T18:00:14.118815+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-20T18:00:15.111812+0000","last_change":"2024-05-20T18:00:15.111812+0000","last_active":"2024-05-20T18:00:15.111812+0000","last_peered":"2024-05-20T18:00:15.111812+0000","last_clean":"2024-05-20T18:00:15.111812+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:15.111812+0000","last_undegraded":"2024-05-20T18:00:15.111812+0000","last_fullsized":"2024-05-20T18:00:15.111812+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2024-05-20T18:00:14.120025+0000","last_change":"2024-05-20T18:00:14.120025+0000","last_active":"2024-05-20T18:00:14.101924+0000","last_peered":"2024-05-20T18:00:14.101924+0000","last_clean":"2024-05-20T18:00:14.101924+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:14.120025+0000","last_undegraded":"2024-05-20T18:00:14.120025+0000","last_fullsized":"2024-05-20T18:00:14.120025+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":313,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-05-20T18:00:14.118700+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:00:14.118700+0000","last_peered":"2024-05-20T18:00:14.118700+0000","last_clean":"2024-05-20T18:00:14.118700+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:00:14.118700+0000","last_undegraded":"2024-05-20T18:00:14.118700+0000","last_fullsized":"2024-05-20T18:00:14.118700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574941,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1798144,"data_stored":1141955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":551587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":551587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":551587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":551587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":551587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1216512,"data_stored":557796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1810432,"data_stored":1148164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:00:20.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:00:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.364+0000 7f947f157640 1 Processor -- start 2024-05-20T18:00:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.364+0000 7f947f157640 1 -- start start 2024-05-20T18:00:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f947f157640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 0x7f947815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f947f157640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94780cd1b0 0x7f947806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f947f157640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9478070850 0x7f9478070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f947f157640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f947815f790 con 0x7f94780cd1b0 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f947f157640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f947806e590 con 0x7f9478070850 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f947f157640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f94780ce590 con 0x7f9478071630 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f946ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94780cd1b0 0x7f947806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f946ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94780cd1b0 0x7f947806d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50082/0 (socket says 172.21.15.6:50082) 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.365+0000 7f946ffff640 1 -- 172.21.15.6:0/3807762865 learned_addr learned my addr 172.21.15.6:0/3807762865 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.366+0000 7f947d6f4640 1 --2- 172.21.15.6:0/3807762865 >> v2:172.21.15.171:3300/0 conn(0x7f9478070850 0x7f9478070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.366+0000 7f947cef3640 1 --2- 172.21.15.6:0/3807762865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 0x7f947815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.366+0000 7f946ffff640 1 -- 172.21.15.6:0/3807762865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 msgr2=0x7f947815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.366+0000 7f946ffff640 1 --2- 172.21.15.6:0/3807762865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 0x7f947815f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.366+0000 7f946ffff640 1 -- 172.21.15.6:0/3807762865 >> v2:172.21.15.171:3300/0 conn(0x7f9478070850 msgr2=0x7f9478070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.366+0000 7f946ffff640 1 --2- 172.21.15.6:0/3807762865 >> v2:172.21.15.171:3300/0 conn(0x7f9478070850 0x7f9478070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.366+0000 7f946ffff640 1 -- 172.21.15.6:0/3807762865 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94780711a0 con 0x7f94780cd1b0 2024-05-20T18:00:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.366+0000 7f946ffff640 1 --2- 172.21.15.6:0/3807762865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f947806d7c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f94780cd140 tx=0x7f946802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee682a7637da6eca server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f946f7fe640 1 -- 172.21.15.6:0/3807762865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468037070 con 0x7f94780cd1b0 2024-05-20T18:00:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f946f7fe640 1 -- 172.21.15.6:0/3807762865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9468032440 con 0x7f94780cd1b0 2024-05-20T18:00:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f946f7fe640 1 -- 172.21.15.6:0/3807762865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9468032810 con 0x7f94780cd1b0 2024-05-20T18:00:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 -- 172.21.15.6:0/3807762865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 msgr2=0x7f947806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 --2- 172.21.15.6:0/3807762865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f947806d7c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f94780cd140 tx=0x7f946802a140 comp rx=0 tx=0).stop 2024-05-20T18:00:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 -- 172.21.15.6:0/3807762865 shutdown_connections 2024-05-20T18:00:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 --2- 172.21.15.6:0/3807762865 >> v2:172.21.15.171:3300/0 conn(0x7f9478070850 0x7f9478070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 --2- 172.21.15.6:0/3807762865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f947806d7c0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 --2- 172.21.15.6:0/3807762865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 0x7f947815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 -- 172.21.15.6:0/3807762865 >> 172.21.15.6:0/3807762865 conn(0x7f94780d29d0 msgr2=0x7f94780d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 -- 172.21.15.6:0/3807762865 shutdown_connections 2024-05-20T18:00:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.367+0000 7f947f157640 1 -- 172.21.15.6:0/3807762865 wait complete. 2024-05-20T18:00:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.369+0000 7f947f157640 1 Processor -- start 2024-05-20T18:00:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.369+0000 7f947f157640 1 -- start start 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947f157640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9478070850 0x7f94781f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947f157640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 0x7f9478159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947f157640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f94781eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947f157640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f947806cfc0 con 0x7f94780cd1b0 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947f157640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f947806cce0 con 0x7f9478070850 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947f157640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f947806d2a0 con 0x7f9478071630 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f94781eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f94781eaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50088/0 (socket says 172.21.15.6:50088) 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 -- 172.21.15.6:0/1027706860 learned_addr learned my addr 172.21.15.6:0/1027706860 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947cef3640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9478070850 0x7f94781f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f946ffff640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 0x7f9478159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 -- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 msgr2=0x7f9478159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 0x7f9478159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 -- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9478070850 msgr2=0x7f94781f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9478070850 0x7f94781f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 -- 172.21.15.6:0/1027706860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94781e4b90 con 0x7f94780cd1b0 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f947d6f4640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f94781eaab0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f947000cc00 tx=0x7f947000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.371+0000 7f946d7fa640 1 -- 172.21.15.6:0/1027706860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947000ce10 con 0x7f94780cd1b0 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.372+0000 7f946d7fa640 1 -- 172.21.15.6:0/1027706860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9470003990 con 0x7f94780cd1b0 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.372+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94781e4e70 con 0x7f94780cd1b0 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.372+0000 7f946d7fa640 1 -- 172.21.15.6:0/1027706860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470003d60 con 0x7f94780cd1b0 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.372+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94781e5430 con 0x7f94780cd1b0 2024-05-20T18:00:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.373+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94781e4900 con 0x7f94780cd1b0 2024-05-20T18:00:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.373+0000 7f946d7fa640 1 -- 172.21.15.6:0/1027706860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9470004000 con 0x7f94780cd1b0 2024-05-20T18:00:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.374+0000 7f946d7fa640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946406be60 0x7f946406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.374+0000 7f946d7fa640 1 -- 172.21.15.6:0/1027706860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f947008b330 con 0x7f94780cd1b0 2024-05-20T18:00:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.374+0000 7f947cef3640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946406be60 0x7f946406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.375+0000 7f947cef3640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946406be60 0x7f946406e370 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f947400a9a0 tx=0x7f9474008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.378+0000 7f946d7fa640 1 -- 172.21.15.6:0/1027706860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9470014030 con 0x7f94780cd1b0 2024-05-20T18:00:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.560+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9478075b00 con 0x7f946406be60 2024-05-20T18:00:20.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.567+0000 7f946d7fa640 1 -- 172.21.15.6:0/1027706860 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252262 (secure 0 0 0) 0x7f9478075b00 con 0x7f946406be60 2024-05-20T18:00:20.567 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:00:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946406be60 msgr2=0x7f946406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946406be60 0x7f946406e370 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f947400a9a0 tx=0x7f9474008040 comp rx=0 tx=0).stop 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 msgr2=0x7f94781eaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f94781eaab0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f947000cc00 tx=0x7f947000a5c0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 shutdown_connections 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946406be60 0x7f946406e370 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94780cd1b0 0x7f94781eaab0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9478071630 0x7f9478159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 --2- 172.21.15.6:0/1027706860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9478070850 0x7f94781f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 >> 172.21.15.6:0/1027706860 conn(0x7f94780d29d0 msgr2=0x7f947815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 shutdown_connections 2024-05-20T18:00:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.570+0000 7f947f157640 1 -- 172.21.15.6:0/1027706860 wait complete. 2024-05-20T18:00:20.578 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-05-20T18:00:20.346183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260480,"kb_used_data":11016,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714240,"statfs":{"total":773094113280,"available":772827381760,"internally_reserved":0,"allocated":11280384,"data_stored":5812132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001616"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.129942+0000","last_change":"2024-05-20T18:00:16.154789+0000","last_active":"2024-05-20T18:00:17.129942+0000","last_peered":"2024-05-20T18:00:17.129942+0000","last_clean":"2024-05-20T18:00:17.129942+0000","last_became_active":"2024-05-20T18:00:16.154461+0000","last_became_peered":"2024-05-20T18:00:16.154461+0000","last_unstale":"2024-05-20T18:00:17.129942+0000","last_undegraded":"2024-05-20T18:00:17.129942+0000","last_fullsized":"2024-05-20T18:00:17.129942+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:00:36.394852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151993+0000","last_change":"2024-05-20T18:00:16.141423+0000","last_active":"2024-05-20T18:00:17.151993+0000","last_peered":"2024-05-20T18:00:17.151993+0000","last_clean":"2024-05-20T18:00:17.151993+0000","last_became_active":"2024-05-20T18:00:16.141116+0000","last_became_peered":"2024-05-20T18:00:16.141116+0000","last_unstale":"2024-05-20T18:00:17.151993+0000","last_undegraded":"2024-05-20T18:00:17.151993+0000","last_fullsized":"2024-05-20T18:00:17.151993+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:53:06.266710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130007+0000","last_change":"2024-05-20T18:00:16.142476+0000","last_active":"2024-05-20T18:00:17.130007+0000","last_peered":"2024-05-20T18:00:17.130007+0000","last_clean":"2024-05-20T18:00:17.130007+0000","last_became_active":"2024-05-20T18:00:16.142155+0000","last_became_peered":"2024-05-20T18:00:16.142155+0000","last_unstale":"2024-05-20T18:00:17.130007+0000","last_undegraded":"2024-05-20T18:00:17.130007+0000","last_fullsized":"2024-05-20T18:00:17.130007+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:17.391325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122602+0000","last_change":"2024-05-20T18:00:16.127387+0000","last_active":"2024-05-20T18:00:17.122602+0000","last_peered":"2024-05-20T18:00:17.122602+0000","last_clean":"2024-05-20T18:00:17.122602+0000","last_became_active":"2024-05-20T18:00:16.126388+0000","last_became_peered":"2024-05-20T18:00:16.126388+0000","last_unstale":"2024-05-20T18:00:17.122602+0000","last_undegraded":"2024-05-20T18:00:17.122602+0000","last_fullsized":"2024-05-20T18:00:17.122602+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:52.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151120+0000","last_change":"2024-05-20T18:00:16.155271+0000","last_active":"2024-05-20T18:00:17.151120+0000","last_peered":"2024-05-20T18:00:17.151120+0000","last_clean":"2024-05-20T18:00:17.151120+0000","last_became_active":"2024-05-20T18:00:16.152355+0000","last_became_peered":"2024-05-20T18:00:16.152355+0000","last_unstale":"2024-05-20T18:00:17.151120+0000","last_undegraded":"2024-05-20T18:00:17.151120+0000","last_fullsized":"2024-05-20T18:00:17.151120+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:43:30.608608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151609+0000","last_change":"2024-05-20T18:00:16.156731+0000","last_active":"2024-05-20T18:00:17.151609+0000","last_peered":"2024-05-20T18:00:17.151609+0000","last_clean":"2024-05-20T18:00:17.151609+0000","last_became_active":"2024-05-20T18:00:16.156447+0000","last_became_peered":"2024-05-20T18:00:16.156447+0000","last_unstale":"2024-05-20T18:00:17.151609+0000","last_undegraded":"2024-05-20T18:00:17.151609+0000","last_fullsized":"2024-05-20T18:00:17.151609+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:55:34.036365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151533+0000","last_change":"2024-05-20T18:00:16.152951+0000","last_active":"2024-05-20T18:00:17.151533+0000","last_peered":"2024-05-20T18:00:17.151533+0000","last_clean":"2024-05-20T18:00:17.151533+0000","last_became_active":"2024-05-20T18:00:16.152614+0000","last_became_peered":"2024-05-20T18:00:16.152614+0000","last_unstale":"2024-05-20T18:00:17.151533+0000","last_undegraded":"2024-05-20T18:00:17.151533+0000","last_fullsized":"2024-05-20T18:00:17.151533+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:44:16.240868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152212+0000","last_change":"2024-05-20T18:00:16.153192+0000","last_active":"2024-05-20T18:00:17.152212+0000","last_peered":"2024-05-20T18:00:17.152212+0000","last_clean":"2024-05-20T18:00:17.152212+0000","last_became_active":"2024-05-20T18:00:16.152826+0000","last_became_peered":"2024-05-20T18:00:16.152826+0000","last_unstale":"2024-05-20T18:00:17.152212+0000","last_undegraded":"2024-05-20T18:00:17.152212+0000","last_fullsized":"2024-05-20T18:00:17.152212+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:37:55.511388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152066+0000","last_change":"2024-05-20T18:00:16.147395+0000","last_active":"2024-05-20T18:00:17.152066+0000","last_peered":"2024-05-20T18:00:17.152066+0000","last_clean":"2024-05-20T18:00:17.152066+0000","last_became_active":"2024-05-20T18:00:16.147058+0000","last_became_peered":"2024-05-20T18:00:16.147058+0000","last_unstale":"2024-05-20T18:00:17.152066+0000","last_undegraded":"2024-05-20T18:00:17.152066+0000","last_fullsized":"2024-05-20T18:00:17.152066+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:05:53.795074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151361+0000","last_change":"2024-05-20T18:00:16.148140+0000","last_active":"2024-05-20T18:00:17.151361+0000","last_peered":"2024-05-20T18:00:17.151361+0000","last_clean":"2024-05-20T18:00:17.151361+0000","last_became_active":"2024-05-20T18:00:16.147841+0000","last_became_peered":"2024-05-20T18:00:16.147841+0000","last_unstale":"2024-05-20T18:00:17.151361+0000","last_undegraded":"2024-05-20T18:00:17.151361+0000","last_fullsized":"2024-05-20T18:00:17.151361+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.708521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.135393+0000","last_change":"2024-05-20T18:00:16.148327+0000","last_active":"2024-05-20T18:00:17.135393+0000","last_peered":"2024-05-20T18:00:17.135393+0000","last_clean":"2024-05-20T18:00:17.135393+0000","last_became_active":"2024-05-20T18:00:16.148005+0000","last_became_peered":"2024-05-20T18:00:16.148005+0000","last_unstale":"2024-05-20T18:00:17.135393+0000","last_undegraded":"2024-05-20T18:00:17.135393+0000","last_fullsized":"2024-05-20T18:00:17.135393+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:14:58.645083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126644+0000","last_change":"2024-05-20T18:00:16.135421+0000","last_active":"2024-05-20T18:00:17.126644+0000","last_peered":"2024-05-20T18:00:17.126644+0000","last_clean":"2024-05-20T18:00:17.126644+0000","last_became_active":"2024-05-20T18:00:16.135094+0000","last_became_peered":"2024-05-20T18:00:16.135094+0000","last_unstale":"2024-05-20T18:00:17.126644+0000","last_undegraded":"2024-05-20T18:00:17.126644+0000","last_fullsized":"2024-05-20T18:00:17.126644+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:44:16.240868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122343+0000","last_change":"2024-05-20T18:00:16.130730+0000","last_active":"2024-05-20T18:00:17.122343+0000","last_peered":"2024-05-20T18:00:17.122343+0000","last_clean":"2024-05-20T18:00:17.122343+0000","last_became_active":"2024-05-20T18:00:16.130392+0000","last_became_peered":"2024-05-20T18:00:16.130392+0000","last_unstale":"2024-05-20T18:00:17.122343+0000","last_undegraded":"2024-05-20T18:00:17.122343+0000","last_fullsized":"2024-05-20T18:00:17.122343+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:15:25.163056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.125670+0000","last_change":"2024-05-20T18:00:16.148634+0000","last_active":"2024-05-20T18:00:17.125670+0000","last_peered":"2024-05-20T18:00:17.125670+0000","last_clean":"2024-05-20T18:00:17.125670+0000","last_became_active":"2024-05-20T18:00:16.148317+0000","last_became_peered":"2024-05-20T18:00:16.148317+0000","last_unstale":"2024-05-20T18:00:17.125670+0000","last_undegraded":"2024-05-20T18:00:17.125670+0000","last_fullsized":"2024-05-20T18:00:17.125670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:23.244436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.125737+0000","last_change":"2024-05-20T18:00:16.142478+0000","last_active":"2024-05-20T18:00:17.125737+0000","last_peered":"2024-05-20T18:00:17.125737+0000","last_clean":"2024-05-20T18:00:17.125737+0000","last_became_active":"2024-05-20T18:00:16.142012+0000","last_became_peered":"2024-05-20T18:00:16.142012+0000","last_unstale":"2024-05-20T18:00:17.125737+0000","last_undegraded":"2024-05-20T18:00:17.125737+0000","last_fullsized":"2024-05-20T18:00:17.125737+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:05:53.795074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.125670+0000","last_change":"2024-05-20T18:00:16.137714+0000","last_active":"2024-05-20T18:00:17.125670+0000","last_peered":"2024-05-20T18:00:17.125670+0000","last_clean":"2024-05-20T18:00:17.125670+0000","last_became_active":"2024-05-20T18:00:16.137272+0000","last_became_peered":"2024-05-20T18:00:16.137272+0000","last_unstale":"2024-05-20T18:00:17.125670+0000","last_undegraded":"2024-05-20T18:00:17.125670+0000","last_fullsized":"2024-05-20T18:00:17.125670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:53:06.266710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130131+0000","last_change":"2024-05-20T18:00:16.144339+0000","last_active":"2024-05-20T18:00:17.130131+0000","last_peered":"2024-05-20T18:00:17.130131+0000","last_clean":"2024-05-20T18:00:17.130131+0000","last_became_active":"2024-05-20T18:00:16.143967+0000","last_became_peered":"2024-05-20T18:00:16.143967+0000","last_unstale":"2024-05-20T18:00:17.130131+0000","last_undegraded":"2024-05-20T18:00:17.130131+0000","last_fullsized":"2024-05-20T18:00:17.130131+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:21.298306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152142+0000","last_change":"2024-05-20T18:00:16.149304+0000","last_active":"2024-05-20T18:00:17.152142+0000","last_peered":"2024-05-20T18:00:17.152142+0000","last_clean":"2024-05-20T18:00:17.152142+0000","last_became_active":"2024-05-20T18:00:16.148478+0000","last_became_peered":"2024-05-20T18:00:16.148478+0000","last_unstale":"2024-05-20T18:00:17.152142+0000","last_undegraded":"2024-05-20T18:00:17.152142+0000","last_fullsized":"2024-05-20T18:00:17.152142+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:20:33.413965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130237+0000","last_change":"2024-05-20T18:00:16.149264+0000","last_active":"2024-05-20T18:00:17.130237+0000","last_peered":"2024-05-20T18:00:17.130237+0000","last_clean":"2024-05-20T18:00:17.130237+0000","last_became_active":"2024-05-20T18:00:16.148930+0000","last_became_peered":"2024-05-20T18:00:16.148930+0000","last_unstale":"2024-05-20T18:00:17.130237+0000","last_undegraded":"2024-05-20T18:00:17.130237+0000","last_fullsized":"2024-05-20T18:00:17.130237+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:22.427381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126840+0000","last_change":"2024-05-20T18:00:16.137990+0000","last_active":"2024-05-20T18:00:17.126840+0000","last_peered":"2024-05-20T18:00:17.126840+0000","last_clean":"2024-05-20T18:00:17.126840+0000","last_became_active":"2024-05-20T18:00:16.137662+0000","last_became_peered":"2024-05-20T18:00:16.137662+0000","last_unstale":"2024-05-20T18:00:17.126840+0000","last_undegraded":"2024-05-20T18:00:17.126840+0000","last_fullsized":"2024-05-20T18:00:17.126840+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:35:34.414217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152671+0000","last_change":"2024-05-20T18:00:16.131970+0000","last_active":"2024-05-20T18:00:17.152671+0000","last_peered":"2024-05-20T18:00:17.152671+0000","last_clean":"2024-05-20T18:00:17.152671+0000","last_became_active":"2024-05-20T18:00:16.131624+0000","last_became_peered":"2024-05-20T18:00:16.131624+0000","last_unstale":"2024-05-20T18:00:17.152671+0000","last_undegraded":"2024-05-20T18:00:17.152671+0000","last_fullsized":"2024-05-20T18:00:17.152671+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:20:50.130526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151408+0000","last_change":"2024-05-20T18:00:16.144087+0000","last_active":"2024-05-20T18:00:17.151408+0000","last_peered":"2024-05-20T18:00:17.151408+0000","last_clean":"2024-05-20T18:00:17.151408+0000","last_became_active":"2024-05-20T18:00:16.143789+0000","last_became_peered":"2024-05-20T18:00:16.143789+0000","last_unstale":"2024-05-20T18:00:17.151408+0000","last_undegraded":"2024-05-20T18:00:17.151408+0000","last_fullsized":"2024-05-20T18:00:17.151408+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:44:16.240868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.129992+0000","last_change":"2024-05-20T18:00:16.143698+0000","last_active":"2024-05-20T18:00:17.129992+0000","last_peered":"2024-05-20T18:00:17.129992+0000","last_clean":"2024-05-20T18:00:17.129992+0000","last_became_active":"2024-05-20T18:00:16.143377+0000","last_became_peered":"2024-05-20T18:00:16.143377+0000","last_unstale":"2024-05-20T18:00:17.129992+0000","last_undegraded":"2024-05-20T18:00:17.129992+0000","last_fullsized":"2024-05-20T18:00:17.129992+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:18:37.765035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.150886+0000","last_change":"2024-05-20T18:00:16.144119+0000","last_active":"2024-05-20T18:00:17.150886+0000","last_peered":"2024-05-20T18:00:17.150886+0000","last_clean":"2024-05-20T18:00:17.150886+0000","last_became_active":"2024-05-20T18:00:16.143814+0000","last_became_peered":"2024-05-20T18:00:16.143814+0000","last_unstale":"2024-05-20T18:00:17.150886+0000","last_undegraded":"2024-05-20T18:00:17.150886+0000","last_fullsized":"2024-05-20T18:00:17.150886+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:23.626369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126749+0000","last_change":"2024-05-20T18:00:16.131319+0000","last_active":"2024-05-20T18:00:17.126749+0000","last_peered":"2024-05-20T18:00:17.126749+0000","last_clean":"2024-05-20T18:00:17.126749+0000","last_became_active":"2024-05-20T18:00:16.131025+0000","last_became_peered":"2024-05-20T18:00:16.131025+0000","last_unstale":"2024-05-20T18:00:17.126749+0000","last_undegraded":"2024-05-20T18:00:17.126749+0000","last_fullsized":"2024-05-20T18:00:17.126749+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:55:34.036365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126369+0000","last_change":"2024-05-20T18:00:16.145829+0000","last_active":"2024-05-20T18:00:17.126369+0000","last_peered":"2024-05-20T18:00:17.126369+0000","last_clean":"2024-05-20T18:00:17.126369+0000","last_became_active":"2024-05-20T18:00:16.145508+0000","last_became_peered":"2024-05-20T18:00:16.145508+0000","last_unstale":"2024-05-20T18:00:17.126369+0000","last_undegraded":"2024-05-20T18:00:17.126369+0000","last_fullsized":"2024-05-20T18:00:17.126369+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:14:58.645083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.135464+0000","last_change":"2024-05-20T18:00:16.139299+0000","last_active":"2024-05-20T18:00:17.135464+0000","last_peered":"2024-05-20T18:00:17.135464+0000","last_clean":"2024-05-20T18:00:17.135464+0000","last_became_active":"2024-05-20T18:00:16.138809+0000","last_became_peered":"2024-05-20T18:00:16.138809+0000","last_unstale":"2024-05-20T18:00:17.135464+0000","last_undegraded":"2024-05-20T18:00:17.135464+0000","last_fullsized":"2024-05-20T18:00:17.135464+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:54:17.530983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151704+0000","last_change":"2024-05-20T18:00:16.144298+0000","last_active":"2024-05-20T18:00:17.151704+0000","last_peered":"2024-05-20T18:00:17.151704+0000","last_clean":"2024-05-20T18:00:17.151704+0000","last_became_active":"2024-05-20T18:00:16.143883+0000","last_became_peered":"2024-05-20T18:00:16.143883+0000","last_unstale":"2024-05-20T18:00:17.151704+0000","last_undegraded":"2024-05-20T18:00:17.151704+0000","last_fullsized":"2024-05-20T18:00:17.151704+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:35:34.414217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152629+0000","last_change":"2024-05-20T18:00:16.140152+0000","last_active":"2024-05-20T18:00:17.152629+0000","last_peered":"2024-05-20T18:00:17.152629+0000","last_clean":"2024-05-20T18:00:17.152629+0000","last_became_active":"2024-05-20T18:00:16.139856+0000","last_became_peered":"2024-05-20T18:00:16.139856+0000","last_unstale":"2024-05-20T18:00:17.152629+0000","last_undegraded":"2024-05-20T18:00:17.152629+0000","last_fullsized":"2024-05-20T18:00:17.152629+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:37:09.519491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126509+0000","last_change":"2024-05-20T18:00:16.129878+0000","last_active":"2024-05-20T18:00:17.126509+0000","last_peered":"2024-05-20T18:00:17.126509+0000","last_clean":"2024-05-20T18:00:17.126509+0000","last_became_active":"2024-05-20T18:00:16.129480+0000","last_became_peered":"2024-05-20T18:00:16.129480+0000","last_unstale":"2024-05-20T18:00:17.126509+0000","last_undegraded":"2024-05-20T18:00:17.126509+0000","last_fullsized":"2024-05-20T18:00:17.126509+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:54:17.530983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151533+0000","last_change":"2024-05-20T18:00:16.147437+0000","last_active":"2024-05-20T18:00:17.151533+0000","last_peered":"2024-05-20T18:00:17.151533+0000","last_clean":"2024-05-20T18:00:17.151533+0000","last_became_active":"2024-05-20T18:00:16.146755+0000","last_became_peered":"2024-05-20T18:00:16.146755+0000","last_unstale":"2024-05-20T18:00:17.151533+0000","last_undegraded":"2024-05-20T18:00:17.151533+0000","last_fullsized":"2024-05-20T18:00:17.151533+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:15:25.163056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152698+0000","last_change":"2024-05-20T18:00:16.128424+0000","last_active":"2024-05-20T18:00:17.152698+0000","last_peered":"2024-05-20T18:00:17.152698+0000","last_clean":"2024-05-20T18:00:17.152698+0000","last_became_active":"2024-05-20T18:00:16.128086+0000","last_became_peered":"2024-05-20T18:00:16.128086+0000","last_unstale":"2024-05-20T18:00:17.152698+0000","last_undegraded":"2024-05-20T18:00:17.152698+0000","last_fullsized":"2024-05-20T18:00:17.152698+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:42.717927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130143+0000","last_change":"2024-05-20T18:00:16.147981+0000","last_active":"2024-05-20T18:00:17.130143+0000","last_peered":"2024-05-20T18:00:17.130143+0000","last_clean":"2024-05-20T18:00:17.130143+0000","last_became_active":"2024-05-20T18:00:16.147661+0000","last_became_peered":"2024-05-20T18:00:16.147661+0000","last_unstale":"2024-05-20T18:00:17.130143+0000","last_undegraded":"2024-05-20T18:00:17.130143+0000","last_fullsized":"2024-05-20T18:00:17.130143+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:19.810496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"100'4","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122648+0000","last_change":"2024-05-20T18:00:15.135667+0000","last_active":"2024-05-20T18:00:17.122648+0000","last_peered":"2024-05-20T18:00:17.122648+0000","last_clean":"2024-05-20T18:00:17.122648+0000","last_became_active":"2024-05-20T18:00:15.135344+0000","last_became_peered":"2024-05-20T18:00:15.135344+0000","last_unstale":"2024-05-20T18:00:17.122648+0000","last_undegraded":"2024-05-20T18:00:17.122648+0000","last_fullsized":"2024-05-20T18:00:17.122648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:40:44.056405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152335+0000","last_change":"2024-05-20T18:00:16.149729+0000","last_active":"2024-05-20T18:00:17.152335+0000","last_peered":"2024-05-20T18:00:17.152335+0000","last_clean":"2024-05-20T18:00:17.152335+0000","last_became_active":"2024-05-20T18:00:16.149268+0000","last_became_peered":"2024-05-20T18:00:16.149268+0000","last_unstale":"2024-05-20T18:00:17.152335+0000","last_undegraded":"2024-05-20T18:00:17.152335+0000","last_fullsized":"2024-05-20T18:00:17.152335+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:58:10.462109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152421+0000","last_change":"2024-05-20T18:00:15.143406+0000","last_active":"2024-05-20T18:00:17.152421+0000","last_peered":"2024-05-20T18:00:17.152421+0000","last_clean":"2024-05-20T18:00:17.152421+0000","last_became_active":"2024-05-20T18:00:15.143043+0000","last_became_peered":"2024-05-20T18:00:15.143043+0000","last_unstale":"2024-05-20T18:00:17.152421+0000","last_undegraded":"2024-05-20T18:00:17.152421+0000","last_fullsized":"2024-05-20T18:00:17.152421+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:36:54.127902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126739+0000","last_change":"2024-05-20T18:00:16.148637+0000","last_active":"2024-05-20T18:00:17.126739+0000","last_peered":"2024-05-20T18:00:17.126739+0000","last_clean":"2024-05-20T18:00:17.126739+0000","last_became_active":"2024-05-20T18:00:16.148325+0000","last_became_peered":"2024-05-20T18:00:16.148325+0000","last_unstale":"2024-05-20T18:00:17.126739+0000","last_undegraded":"2024-05-20T18:00:17.126739+0000","last_fullsized":"2024-05-20T18:00:17.126739+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:15:25.163056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126003+0000","last_change":"2024-05-20T18:00:15.133626+0000","last_active":"2024-05-20T18:00:17.126003+0000","last_peered":"2024-05-20T18:00:17.126003+0000","last_clean":"2024-05-20T18:00:17.126003+0000","last_became_active":"2024-05-20T18:00:15.133239+0000","last_became_peered":"2024-05-20T18:00:15.133239+0000","last_unstale":"2024-05-20T18:00:17.126003+0000","last_undegraded":"2024-05-20T18:00:17.126003+0000","last_fullsized":"2024-05-20T18:00:17.126003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:25:51.685534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.135132+0000","last_change":"2024-05-20T18:00:16.131019+0000","last_active":"2024-05-20T18:00:17.135132+0000","last_peered":"2024-05-20T18:00:17.135132+0000","last_clean":"2024-05-20T18:00:17.135132+0000","last_became_active":"2024-05-20T18:00:16.130697+0000","last_became_peered":"2024-05-20T18:00:16.130697+0000","last_unstale":"2024-05-20T18:00:17.135132+0000","last_undegraded":"2024-05-20T18:00:17.135132+0000","last_fullsized":"2024-05-20T18:00:17.135132+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:43:30.608608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151209+0000","last_change":"2024-05-20T18:00:15.132958+0000","last_active":"2024-05-20T18:00:17.151209+0000","last_peered":"2024-05-20T18:00:17.151209+0000","last_clean":"2024-05-20T18:00:17.151209+0000","last_became_active":"2024-05-20T18:00:15.132623+0000","last_became_peered":"2024-05-20T18:00:15.132623+0000","last_unstale":"2024-05-20T18:00:17.151209+0000","last_undegraded":"2024-05-20T18:00:17.151209+0000","last_fullsized":"2024-05-20T18:00:17.151209+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:14:20.140410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122559+0000","last_change":"2024-05-20T18:00:16.149166+0000","last_active":"2024-05-20T18:00:17.122559+0000","last_peered":"2024-05-20T18:00:17.122559+0000","last_clean":"2024-05-20T18:00:17.122559+0000","last_became_active":"2024-05-20T18:00:16.147535+0000","last_became_peered":"2024-05-20T18:00:16.147535+0000","last_unstale":"2024-05-20T18:00:17.122559+0000","last_undegraded":"2024-05-20T18:00:17.122559+0000","last_fullsized":"2024-05-20T18:00:17.122559+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:35:34.414217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126181+0000","last_change":"2024-05-20T18:00:15.139245+0000","last_active":"2024-05-20T18:00:17.126181+0000","last_peered":"2024-05-20T18:00:17.126181+0000","last_clean":"2024-05-20T18:00:17.126181+0000","last_became_active":"2024-05-20T18:00:15.138923+0000","last_became_peered":"2024-05-20T18:00:15.138923+0000","last_unstale":"2024-05-20T18:00:17.126181+0000","last_undegraded":"2024-05-20T18:00:17.126181+0000","last_fullsized":"2024-05-20T18:00:17.126181+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:57.698633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130466+0000","last_change":"2024-05-20T18:00:16.148940+0000","last_active":"2024-05-20T18:00:17.130466+0000","last_peered":"2024-05-20T18:00:17.130466+0000","last_clean":"2024-05-20T18:00:17.130466+0000","last_became_active":"2024-05-20T18:00:16.148476+0000","last_became_peered":"2024-05-20T18:00:16.148476+0000","last_unstale":"2024-05-20T18:00:17.130466+0000","last_undegraded":"2024-05-20T18:00:17.130466+0000","last_fullsized":"2024-05-20T18:00:17.130466+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:52:41.729766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.134732+0000","last_change":"2024-05-20T18:00:15.132161+0000","last_active":"2024-05-20T18:00:17.134732+0000","last_peered":"2024-05-20T18:00:17.134732+0000","last_clean":"2024-05-20T18:00:17.134732+0000","last_became_active":"2024-05-20T18:00:15.131825+0000","last_became_peered":"2024-05-20T18:00:15.131825+0000","last_unstale":"2024-05-20T18:00:17.134732+0000","last_undegraded":"2024-05-20T18:00:17.134732+0000","last_fullsized":"2024-05-20T18:00:17.134732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:14:20.140410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152143+0000","last_change":"2024-05-20T18:00:16.146236+0000","last_active":"2024-05-20T18:00:17.152143+0000","last_peered":"2024-05-20T18:00:17.152143+0000","last_clean":"2024-05-20T18:00:17.152143+0000","last_became_active":"2024-05-20T18:00:16.145929+0000","last_became_peered":"2024-05-20T18:00:16.145929+0000","last_unstale":"2024-05-20T18:00:17.152143+0000","last_undegraded":"2024-05-20T18:00:17.152143+0000","last_fullsized":"2024-05-20T18:00:17.152143+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:33:43.552423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126667+0000","last_change":"2024-05-20T18:00:15.134898+0000","last_active":"2024-05-20T18:00:17.126667+0000","last_peered":"2024-05-20T18:00:17.126667+0000","last_clean":"2024-05-20T18:00:17.126667+0000","last_became_active":"2024-05-20T18:00:15.134580+0000","last_became_peered":"2024-05-20T18:00:15.134580+0000","last_unstale":"2024-05-20T18:00:17.126667+0000","last_undegraded":"2024-05-20T18:00:17.126667+0000","last_fullsized":"2024-05-20T18:00:17.126667+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:37.088767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122695+0000","last_change":"2024-05-20T18:00:16.146614+0000","last_active":"2024-05-20T18:00:17.122695+0000","last_peered":"2024-05-20T18:00:17.122695+0000","last_clean":"2024-05-20T18:00:17.122695+0000","last_became_active":"2024-05-20T18:00:16.146307+0000","last_became_peered":"2024-05-20T18:00:16.146307+0000","last_unstale":"2024-05-20T18:00:17.122695+0000","last_undegraded":"2024-05-20T18:00:17.122695+0000","last_fullsized":"2024-05-20T18:00:17.122695+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:23.244436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122192+0000","last_change":"2024-05-20T18:00:15.133817+0000","last_active":"2024-05-20T18:00:17.122192+0000","last_peered":"2024-05-20T18:00:17.122192+0000","last_clean":"2024-05-20T18:00:17.122192+0000","last_became_active":"2024-05-20T18:00:15.133495+0000","last_became_peered":"2024-05-20T18:00:15.133495+0000","last_unstale":"2024-05-20T18:00:17.122192+0000","last_undegraded":"2024-05-20T18:00:17.122192+0000","last_fullsized":"2024-05-20T18:00:17.122192+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:48:59.485114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130206+0000","last_change":"2024-05-20T18:00:16.149953+0000","last_active":"2024-05-20T18:00:17.130206+0000","last_peered":"2024-05-20T18:00:17.130206+0000","last_clean":"2024-05-20T18:00:17.130206+0000","last_became_active":"2024-05-20T18:00:16.149587+0000","last_became_peered":"2024-05-20T18:00:16.149587+0000","last_unstale":"2024-05-20T18:00:17.130206+0000","last_undegraded":"2024-05-20T18:00:17.130206+0000","last_fullsized":"2024-05-20T18:00:17.130206+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:37:35.488357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126817+0000","last_change":"2024-05-20T18:00:15.133879+0000","last_active":"2024-05-20T18:00:17.126817+0000","last_peered":"2024-05-20T18:00:17.126817+0000","last_clean":"2024-05-20T18:00:17.126817+0000","last_became_active":"2024-05-20T18:00:15.133512+0000","last_became_peered":"2024-05-20T18:00:15.133512+0000","last_unstale":"2024-05-20T18:00:17.126817+0000","last_undegraded":"2024-05-20T18:00:17.126817+0000","last_fullsized":"2024-05-20T18:00:17.126817+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:06.789141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151039+0000","last_change":"2024-05-20T18:00:16.150050+0000","last_active":"2024-05-20T18:00:17.151039+0000","last_peered":"2024-05-20T18:00:17.151039+0000","last_clean":"2024-05-20T18:00:17.151039+0000","last_became_active":"2024-05-20T18:00:16.146745+0000","last_became_peered":"2024-05-20T18:00:16.146745+0000","last_unstale":"2024-05-20T18:00:17.151039+0000","last_undegraded":"2024-05-20T18:00:17.151039+0000","last_fullsized":"2024-05-20T18:00:17.151039+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:09:49.924868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.129814+0000","last_change":"2024-05-20T18:00:15.145004+0000","last_active":"2024-05-20T18:00:17.129814+0000","last_peered":"2024-05-20T18:00:17.129814+0000","last_clean":"2024-05-20T18:00:17.129814+0000","last_became_active":"2024-05-20T18:00:15.144669+0000","last_became_peered":"2024-05-20T18:00:15.144669+0000","last_unstale":"2024-05-20T18:00:17.129814+0000","last_undegraded":"2024-05-20T18:00:17.129814+0000","last_fullsized":"2024-05-20T18:00:17.129814+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:33:42.542534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152305+0000","last_change":"2024-05-20T18:00:16.148267+0000","last_active":"2024-05-20T18:00:17.152305+0000","last_peered":"2024-05-20T18:00:17.152305+0000","last_clean":"2024-05-20T18:00:17.152305+0000","last_became_active":"2024-05-20T18:00:16.147955+0000","last_became_peered":"2024-05-20T18:00:16.147955+0000","last_unstale":"2024-05-20T18:00:17.152305+0000","last_undegraded":"2024-05-20T18:00:17.152305+0000","last_fullsized":"2024-05-20T18:00:17.152305+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:27.952649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"100'3","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126457+0000","last_change":"2024-05-20T18:00:15.142383+0000","last_active":"2024-05-20T18:00:17.126457+0000","last_peered":"2024-05-20T18:00:17.126457+0000","last_clean":"2024-05-20T18:00:17.126457+0000","last_became_active":"2024-05-20T18:00:15.142090+0000","last_became_peered":"2024-05-20T18:00:15.142090+0000","last_unstale":"2024-05-20T18:00:17.126457+0000","last_undegraded":"2024-05-20T18:00:17.126457+0000","last_fullsized":"2024-05-20T18:00:17.126457+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:54:16.521095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151323+0000","last_change":"2024-05-20T18:00:16.152733+0000","last_active":"2024-05-20T18:00:17.151323+0000","last_peered":"2024-05-20T18:00:17.151323+0000","last_clean":"2024-05-20T18:00:17.151323+0000","last_became_active":"2024-05-20T18:00:16.151712+0000","last_became_peered":"2024-05-20T18:00:16.151712+0000","last_unstale":"2024-05-20T18:00:17.151323+0000","last_undegraded":"2024-05-20T18:00:17.151323+0000","last_fullsized":"2024-05-20T18:00:17.151323+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:54:17.530983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"100'6","reported_seq":20,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151738+0000","last_change":"2024-05-20T18:00:15.146633+0000","last_active":"2024-05-20T18:00:17.151738+0000","last_peered":"2024-05-20T18:00:17.151738+0000","last_clean":"2024-05-20T18:00:17.151738+0000","last_became_active":"2024-05-20T18:00:15.146399+0000","last_became_peered":"2024-05-20T18:00:15.146399+0000","last_unstale":"2024-05-20T18:00:17.151738+0000","last_undegraded":"2024-05-20T18:00:17.151738+0000","last_fullsized":"2024-05-20T18:00:17.151738+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:14:20.140410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.135034+0000","last_change":"2024-05-20T18:00:16.140386+0000","last_active":"2024-05-20T18:00:17.135034+0000","last_peered":"2024-05-20T18:00:17.135034+0000","last_clean":"2024-05-20T18:00:17.135034+0000","last_became_active":"2024-05-20T18:00:16.139517+0000","last_became_peered":"2024-05-20T18:00:16.139517+0000","last_unstale":"2024-05-20T18:00:17.135034+0000","last_undegraded":"2024-05-20T18:00:17.135034+0000","last_fullsized":"2024-05-20T18:00:17.135034+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:23.626369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151354+0000","last_change":"2024-05-20T18:00:15.142543+0000","last_active":"2024-05-20T18:00:17.151354+0000","last_peered":"2024-05-20T18:00:17.151354+0000","last_clean":"2024-05-20T18:00:17.151354+0000","last_became_active":"2024-05-20T18:00:15.142251+0000","last_became_peered":"2024-05-20T18:00:15.142251+0000","last_unstale":"2024-05-20T18:00:17.151354+0000","last_undegraded":"2024-05-20T18:00:17.151354+0000","last_fullsized":"2024-05-20T18:00:17.151354+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:45.871122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152009+0000","last_change":"2024-05-20T18:00:16.143331+0000","last_active":"2024-05-20T18:00:17.152009+0000","last_peered":"2024-05-20T18:00:17.152009+0000","last_clean":"2024-05-20T18:00:17.152009+0000","last_became_active":"2024-05-20T18:00:16.142785+0000","last_became_peered":"2024-05-20T18:00:16.142785+0000","last_unstale":"2024-05-20T18:00:17.152009+0000","last_undegraded":"2024-05-20T18:00:17.152009+0000","last_fullsized":"2024-05-20T18:00:17.152009+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:23.244436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122474+0000","last_change":"2024-05-20T18:00:15.131336+0000","last_active":"2024-05-20T18:00:17.122474+0000","last_peered":"2024-05-20T18:00:17.122474+0000","last_clean":"2024-05-20T18:00:17.122474+0000","last_became_active":"2024-05-20T18:00:15.130973+0000","last_became_peered":"2024-05-20T18:00:15.130973+0000","last_unstale":"2024-05-20T18:00:17.122474+0000","last_undegraded":"2024-05-20T18:00:17.122474+0000","last_fullsized":"2024-05-20T18:00:17.122474+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:54.507321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152524+0000","last_change":"2024-05-20T18:00:16.129225+0000","last_active":"2024-05-20T18:00:17.152524+0000","last_peered":"2024-05-20T18:00:17.152524+0000","last_clean":"2024-05-20T18:00:17.152524+0000","last_became_active":"2024-05-20T18:00:16.128923+0000","last_became_peered":"2024-05-20T18:00:16.128923+0000","last_unstale":"2024-05-20T18:00:17.152524+0000","last_undegraded":"2024-05-20T18:00:17.152524+0000","last_fullsized":"2024-05-20T18:00:17.152524+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:19:26.729173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152215+0000","last_change":"2024-05-20T18:00:15.139871+0000","last_active":"2024-05-20T18:00:17.152215+0000","last_peered":"2024-05-20T18:00:17.152215+0000","last_clean":"2024-05-20T18:00:17.152215+0000","last_became_active":"2024-05-20T18:00:15.139539+0000","last_became_peered":"2024-05-20T18:00:15.139539+0000","last_unstale":"2024-05-20T18:00:17.152215+0000","last_undegraded":"2024-05-20T18:00:17.152215+0000","last_fullsized":"2024-05-20T18:00:17.152215+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:08:56.679015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130318+0000","last_change":"2024-05-20T18:00:16.143639+0000","last_active":"2024-05-20T18:00:17.130318+0000","last_peered":"2024-05-20T18:00:17.130318+0000","last_clean":"2024-05-20T18:00:17.130318+0000","last_became_active":"2024-05-20T18:00:16.143008+0000","last_became_peered":"2024-05-20T18:00:16.143008+0000","last_unstale":"2024-05-20T18:00:17.130318+0000","last_undegraded":"2024-05-20T18:00:17.130318+0000","last_fullsized":"2024-05-20T18:00:17.130318+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:29.861739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"100'8","reported_seq":22,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.125643+0000","last_change":"2024-05-20T18:00:15.134166+0000","last_active":"2024-05-20T18:00:17.125643+0000","last_peered":"2024-05-20T18:00:17.125643+0000","last_clean":"2024-05-20T18:00:17.125643+0000","last_became_active":"2024-05-20T18:00:15.133858+0000","last_became_peered":"2024-05-20T18:00:15.133858+0000","last_unstale":"2024-05-20T18:00:17.125643+0000","last_undegraded":"2024-05-20T18:00:17.125643+0000","last_fullsized":"2024-05-20T18:00:17.125643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:38:38.844698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152412+0000","last_change":"2024-05-20T18:00:16.145615+0000","last_active":"2024-05-20T18:00:17.152412+0000","last_peered":"2024-05-20T18:00:17.152412+0000","last_clean":"2024-05-20T18:00:17.152412+0000","last_became_active":"2024-05-20T18:00:16.144426+0000","last_became_peered":"2024-05-20T18:00:16.144426+0000","last_unstale":"2024-05-20T18:00:17.152412+0000","last_undegraded":"2024-05-20T18:00:17.152412+0000","last_fullsized":"2024-05-20T18:00:17.152412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:07:17.933599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151993+0000","last_change":"2024-05-20T18:00:15.139746+0000","last_active":"2024-05-20T18:00:17.151993+0000","last_peered":"2024-05-20T18:00:17.151993+0000","last_clean":"2024-05-20T18:00:17.151993+0000","last_became_active":"2024-05-20T18:00:15.139417+0000","last_became_peered":"2024-05-20T18:00:15.139417+0000","last_unstale":"2024-05-20T18:00:17.151993+0000","last_undegraded":"2024-05-20T18:00:17.151993+0000","last_fullsized":"2024-05-20T18:00:17.151993+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:38:38.844698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151720+0000","last_change":"2024-05-20T18:00:16.148666+0000","last_active":"2024-05-20T18:00:17.151720+0000","last_peered":"2024-05-20T18:00:17.151720+0000","last_clean":"2024-05-20T18:00:17.151720+0000","last_became_active":"2024-05-20T18:00:16.147149+0000","last_became_peered":"2024-05-20T18:00:16.147149+0000","last_unstale":"2024-05-20T18:00:17.151720+0000","last_undegraded":"2024-05-20T18:00:17.151720+0000","last_fullsized":"2024-05-20T18:00:17.151720+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:52.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126590+0000","last_change":"2024-05-20T18:00:15.139997+0000","last_active":"2024-05-20T18:00:17.126590+0000","last_peered":"2024-05-20T18:00:17.126590+0000","last_clean":"2024-05-20T18:00:17.126590+0000","last_became_active":"2024-05-20T18:00:15.139520+0000","last_became_peered":"2024-05-20T18:00:15.139520+0000","last_unstale":"2024-05-20T18:00:17.126590+0000","last_undegraded":"2024-05-20T18:00:17.126590+0000","last_fullsized":"2024-05-20T18:00:17.126590+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:14:57.635194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151120+0000","last_change":"2024-05-20T18:00:16.152990+0000","last_active":"2024-05-20T18:00:17.151120+0000","last_peered":"2024-05-20T18:00:17.151120+0000","last_clean":"2024-05-20T18:00:17.151120+0000","last_became_active":"2024-05-20T18:00:16.152034+0000","last_became_peered":"2024-05-20T18:00:16.152034+0000","last_unstale":"2024-05-20T18:00:17.151120+0000","last_undegraded":"2024-05-20T18:00:17.151120+0000","last_fullsized":"2024-05-20T18:00:17.151120+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:14:58.645083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.134973+0000","last_change":"2024-05-20T18:00:15.136813+0000","last_active":"2024-05-20T18:00:17.134973+0000","last_peered":"2024-05-20T18:00:17.134973+0000","last_clean":"2024-05-20T18:00:17.134973+0000","last_became_active":"2024-05-20T18:00:15.136415+0000","last_became_peered":"2024-05-20T18:00:15.136415+0000","last_unstale":"2024-05-20T18:00:17.134973+0000","last_undegraded":"2024-05-20T18:00:17.134973+0000","last_fullsized":"2024-05-20T18:00:17.134973+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:26.389586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130104+0000","last_change":"2024-05-20T18:00:16.151798+0000","last_active":"2024-05-20T18:00:17.130104+0000","last_peered":"2024-05-20T18:00:17.130104+0000","last_clean":"2024-05-20T18:00:17.130104+0000","last_became_active":"2024-05-20T18:00:16.151260+0000","last_became_peered":"2024-05-20T18:00:16.151260+0000","last_unstale":"2024-05-20T18:00:17.130104+0000","last_undegraded":"2024-05-20T18:00:17.130104+0000","last_fullsized":"2024-05-20T18:00:17.130104+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:43:51.891669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152709+0000","last_change":"2024-05-20T18:00:15.144645+0000","last_active":"2024-05-20T18:00:17.152709+0000","last_peered":"2024-05-20T18:00:17.152709+0000","last_clean":"2024-05-20T18:00:17.152709+0000","last_became_active":"2024-05-20T18:00:15.144305+0000","last_became_peered":"2024-05-20T18:00:15.144305+0000","last_unstale":"2024-05-20T18:00:17.152709+0000","last_undegraded":"2024-05-20T18:00:17.152709+0000","last_fullsized":"2024-05-20T18:00:17.152709+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:07:47.497461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130413+0000","last_change":"2024-05-20T18:00:16.155938+0000","last_active":"2024-05-20T18:00:17.130413+0000","last_peered":"2024-05-20T18:00:17.130413+0000","last_clean":"2024-05-20T18:00:17.130413+0000","last_became_active":"2024-05-20T18:00:16.155178+0000","last_became_peered":"2024-05-20T18:00:16.155178+0000","last_unstale":"2024-05-20T18:00:17.130413+0000","last_undegraded":"2024-05-20T18:00:17.130413+0000","last_fullsized":"2024-05-20T18:00:17.130413+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:32:54.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152376+0000","last_change":"2024-05-20T18:00:15.139567+0000","last_active":"2024-05-20T18:00:17.152376+0000","last_peered":"2024-05-20T18:00:17.152376+0000","last_clean":"2024-05-20T18:00:17.152376+0000","last_became_active":"2024-05-20T18:00:15.139244+0000","last_became_peered":"2024-05-20T18:00:15.139244+0000","last_unstale":"2024-05-20T18:00:17.152376+0000","last_undegraded":"2024-05-20T18:00:17.152376+0000","last_fullsized":"2024-05-20T18:00:17.152376+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:30:34.088092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122626+0000","last_change":"2024-05-20T18:00:16.145169+0000","last_active":"2024-05-20T18:00:17.122626+0000","last_peered":"2024-05-20T18:00:17.122626+0000","last_clean":"2024-05-20T18:00:17.122626+0000","last_became_active":"2024-05-20T18:00:16.144854+0000","last_became_peered":"2024-05-20T18:00:16.144854+0000","last_unstale":"2024-05-20T18:00:17.122626+0000","last_undegraded":"2024-05-20T18:00:17.122626+0000","last_fullsized":"2024-05-20T18:00:17.122626+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:53:06.266710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151644+0000","last_change":"2024-05-20T18:00:15.137481+0000","last_active":"2024-05-20T18:00:17.151644+0000","last_peered":"2024-05-20T18:00:17.151644+0000","last_clean":"2024-05-20T18:00:17.151644+0000","last_became_active":"2024-05-20T18:00:15.137247+0000","last_became_peered":"2024-05-20T18:00:15.137247+0000","last_unstale":"2024-05-20T18:00:17.151644+0000","last_undegraded":"2024-05-20T18:00:17.151644+0000","last_fullsized":"2024-05-20T18:00:17.151644+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:06.789141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152560+0000","last_change":"2024-05-20T18:00:16.151648+0000","last_active":"2024-05-20T18:00:17.152560+0000","last_peered":"2024-05-20T18:00:17.152560+0000","last_clean":"2024-05-20T18:00:17.152560+0000","last_became_active":"2024-05-20T18:00:16.151306+0000","last_became_peered":"2024-05-20T18:00:16.151306+0000","last_unstale":"2024-05-20T18:00:17.152560+0000","last_undegraded":"2024-05-20T18:00:17.152560+0000","last_fullsized":"2024-05-20T18:00:17.152560+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:05:38.243199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152477+0000","last_change":"2024-05-20T18:00:15.141423+0000","last_active":"2024-05-20T18:00:17.152477+0000","last_peered":"2024-05-20T18:00:17.152477+0000","last_clean":"2024-05-20T18:00:17.152477+0000","last_became_active":"2024-05-20T18:00:15.141095+0000","last_became_peered":"2024-05-20T18:00:15.141095+0000","last_unstale":"2024-05-20T18:00:17.152477+0000","last_undegraded":"2024-05-20T18:00:17.152477+0000","last_fullsized":"2024-05-20T18:00:17.152477+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:51:21.329855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.129814+0000","last_change":"2024-05-20T18:00:16.154537+0000","last_active":"2024-05-20T18:00:17.129814+0000","last_peered":"2024-05-20T18:00:17.129814+0000","last_clean":"2024-05-20T18:00:17.129814+0000","last_became_active":"2024-05-20T18:00:16.154203+0000","last_became_peered":"2024-05-20T18:00:16.154203+0000","last_unstale":"2024-05-20T18:00:17.129814+0000","last_undegraded":"2024-05-20T18:00:17.129814+0000","last_fullsized":"2024-05-20T18:00:17.129814+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:56:42.578269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151374+0000","last_change":"2024-05-20T18:00:15.141751+0000","last_active":"2024-05-20T18:00:17.151374+0000","last_peered":"2024-05-20T18:00:17.151374+0000","last_clean":"2024-05-20T18:00:17.151374+0000","last_became_active":"2024-05-20T18:00:15.141459+0000","last_became_peered":"2024-05-20T18:00:15.141459+0000","last_unstale":"2024-05-20T18:00:17.151374+0000","last_undegraded":"2024-05-20T18:00:17.151374+0000","last_fullsized":"2024-05-20T18:00:17.151374+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:38:38.844698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126600+0000","last_change":"2024-05-20T18:00:16.129335+0000","last_active":"2024-05-20T18:00:17.126600+0000","last_peered":"2024-05-20T18:00:17.126600+0000","last_clean":"2024-05-20T18:00:17.126600+0000","last_became_active":"2024-05-20T18:00:16.128990+0000","last_became_peered":"2024-05-20T18:00:16.128990+0000","last_unstale":"2024-05-20T18:00:17.126600+0000","last_undegraded":"2024-05-20T18:00:17.126600+0000","last_fullsized":"2024-05-20T18:00:17.126600+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.708521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"101'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.130133+0000","last_change":"2024-05-20T18:00:15.137304+0000","last_active":"2024-05-20T18:00:17.130133+0000","last_peered":"2024-05-20T18:00:17.130133+0000","last_clean":"2024-05-20T18:00:17.130133+0000","last_became_active":"2024-05-20T18:00:15.136962+0000","last_became_peered":"2024-05-20T18:00:15.136962+0000","last_unstale":"2024-05-20T18:00:17.130133+0000","last_undegraded":"2024-05-20T18:00:17.130133+0000","last_fullsized":"2024-05-20T18:00:17.130133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:10.824719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.122465+0000","last_change":"2024-05-20T18:00:16.146873+0000","last_active":"2024-05-20T18:00:17.122465+0000","last_peered":"2024-05-20T18:00:17.122465+0000","last_clean":"2024-05-20T18:00:17.122465+0000","last_became_active":"2024-05-20T18:00:16.145662+0000","last_became_peered":"2024-05-20T18:00:16.145662+0000","last_unstale":"2024-05-20T18:00:17.122465+0000","last_undegraded":"2024-05-20T18:00:17.122465+0000","last_fullsized":"2024-05-20T18:00:17.122465+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:55:34.036365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151968+0000","last_change":"2024-05-20T18:00:15.140439+0000","last_active":"2024-05-20T18:00:17.151968+0000","last_peered":"2024-05-20T18:00:17.151968+0000","last_clean":"2024-05-20T18:00:17.151968+0000","last_became_active":"2024-05-20T18:00:15.140026+0000","last_became_peered":"2024-05-20T18:00:15.140026+0000","last_unstale":"2024-05-20T18:00:17.151968+0000","last_undegraded":"2024-05-20T18:00:17.151968+0000","last_fullsized":"2024-05-20T18:00:17.151968+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:26.389586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.135112+0000","last_change":"2024-05-20T18:00:16.158376+0000","last_active":"2024-05-20T18:00:17.135112+0000","last_peered":"2024-05-20T18:00:17.135112+0000","last_clean":"2024-05-20T18:00:17.135112+0000","last_became_active":"2024-05-20T18:00:16.158062+0000","last_became_peered":"2024-05-20T18:00:16.158062+0000","last_unstale":"2024-05-20T18:00:17.135112+0000","last_undegraded":"2024-05-20T18:00:17.135112+0000","last_fullsized":"2024-05-20T18:00:17.135112+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:09:49.924868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151269+0000","last_change":"2024-05-20T18:00:15.138096+0000","last_active":"2024-05-20T18:00:17.151269+0000","last_peered":"2024-05-20T18:00:17.151269+0000","last_clean":"2024-05-20T18:00:17.151269+0000","last_became_active":"2024-05-20T18:00:15.137739+0000","last_became_peered":"2024-05-20T18:00:15.137739+0000","last_unstale":"2024-05-20T18:00:17.151269+0000","last_undegraded":"2024-05-20T18:00:17.151269+0000","last_fullsized":"2024-05-20T18:00:17.151269+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:26.389586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152653+0000","last_change":"2024-05-20T18:00:16.152345+0000","last_active":"2024-05-20T18:00:17.152653+0000","last_peered":"2024-05-20T18:00:17.152653+0000","last_clean":"2024-05-20T18:00:17.152653+0000","last_became_active":"2024-05-20T18:00:16.151998+0000","last_became_peered":"2024-05-20T18:00:16.151998+0000","last_unstale":"2024-05-20T18:00:17.152653+0000","last_undegraded":"2024-05-20T18:00:17.152653+0000","last_fullsized":"2024-05-20T18:00:17.152653+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:03:00.654127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.125926+0000","last_change":"2024-05-20T18:00:15.134308+0000","last_active":"2024-05-20T18:00:17.125926+0000","last_peered":"2024-05-20T18:00:17.125926+0000","last_clean":"2024-05-20T18:00:17.125926+0000","last_became_active":"2024-05-20T18:00:15.133955+0000","last_became_peered":"2024-05-20T18:00:15.133955+0000","last_unstale":"2024-05-20T18:00:17.125926+0000","last_undegraded":"2024-05-20T18:00:17.125926+0000","last_fullsized":"2024-05-20T18:00:17.125926+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:26.389586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152570+0000","last_change":"2024-05-20T18:00:16.151509+0000","last_active":"2024-05-20T18:00:17.152570+0000","last_peered":"2024-05-20T18:00:17.152570+0000","last_clean":"2024-05-20T18:00:17.152570+0000","last_became_active":"2024-05-20T18:00:16.151196+0000","last_became_peered":"2024-05-20T18:00:16.151196+0000","last_unstale":"2024-05-20T18:00:17.152570+0000","last_undegraded":"2024-05-20T18:00:17.152570+0000","last_fullsized":"2024-05-20T18:00:17.152570+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:53:07.807785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152437+0000","last_change":"2024-05-20T18:00:15.142689+0000","last_active":"2024-05-20T18:00:17.152437+0000","last_peered":"2024-05-20T18:00:17.152437+0000","last_clean":"2024-05-20T18:00:17.152437+0000","last_became_active":"2024-05-20T18:00:15.142388+0000","last_became_peered":"2024-05-20T18:00:15.142388+0000","last_unstale":"2024-05-20T18:00:17.152437+0000","last_undegraded":"2024-05-20T18:00:17.152437+0000","last_fullsized":"2024-05-20T18:00:17.152437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:31:44.758794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.126255+0000","last_change":"2024-05-20T18:00:16.142458+0000","last_active":"2024-05-20T18:00:17.126255+0000","last_peered":"2024-05-20T18:00:17.126255+0000","last_clean":"2024-05-20T18:00:17.126255+0000","last_became_active":"2024-05-20T18:00:16.141931+0000","last_became_peered":"2024-05-20T18:00:16.141931+0000","last_unstale":"2024-05-20T18:00:17.126255+0000","last_undegraded":"2024-05-20T18:00:17.126255+0000","last_fullsized":"2024-05-20T18:00:17.126255+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:20:33.413965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.151690+0000","last_change":"2024-05-20T18:00:15.138924+0000","last_active":"2024-05-20T18:00:17.151690+0000","last_peered":"2024-05-20T18:00:17.151690+0000","last_clean":"2024-05-20T18:00:17.151690+0000","last_became_active":"2024-05-20T18:00:15.138617+0000","last_became_peered":"2024-05-20T18:00:15.138617+0000","last_unstale":"2024-05-20T18:00:17.151690+0000","last_undegraded":"2024-05-20T18:00:17.151690+0000","last_fullsized":"2024-05-20T18:00:17.151690+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:23:37.088767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.135659+0000","last_change":"2024-05-20T18:00:16.137534+0000","last_active":"2024-05-20T18:00:17.135659+0000","last_peered":"2024-05-20T18:00:17.135659+0000","last_clean":"2024-05-20T18:00:17.135659+0000","last_became_active":"2024-05-20T18:00:16.137189+0000","last_became_peered":"2024-05-20T18:00:16.137189+0000","last_unstale":"2024-05-20T18:00:17.135659+0000","last_undegraded":"2024-05-20T18:00:17.135659+0000","last_fullsized":"2024-05-20T18:00:17.135659+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:53:58.708521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152658+0000","last_change":"2024-05-20T18:00:15.140691+0000","last_active":"2024-05-20T18:00:17.152658+0000","last_peered":"2024-05-20T18:00:17.152658+0000","last_clean":"2024-05-20T18:00:17.152658+0000","last_became_active":"2024-05-20T18:00:15.140346+0000","last_became_peered":"2024-05-20T18:00:15.140346+0000","last_unstale":"2024-05-20T18:00:17.152658+0000","last_undegraded":"2024-05-20T18:00:17.152658+0000","last_fullsized":"2024-05-20T18:00:17.152658+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:56:11.004444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.134923+0000","last_change":"2024-05-20T18:00:16.141107+0000","last_active":"2024-05-20T18:00:17.134923+0000","last_peered":"2024-05-20T18:00:17.134923+0000","last_clean":"2024-05-20T18:00:17.134923+0000","last_became_active":"2024-05-20T18:00:16.139074+0000","last_became_peered":"2024-05-20T18:00:16.139074+0000","last_unstale":"2024-05-20T18:00:17.134923+0000","last_undegraded":"2024-05-20T18:00:17.134923+0000","last_fullsized":"2024-05-20T18:00:17.134923+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:15.111812+0000","last_clean_scrub_stamp":"2024-05-20T18:00:15.111812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:40:45.066294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.152549+0000","last_change":"2024-05-20T18:00:15.138727+0000","last_active":"2024-05-20T18:00:17.152549+0000","last_peered":"2024-05-20T18:00:17.152549+0000","last_clean":"2024-05-20T18:00:17.152549+0000","last_became_active":"2024-05-20T18:00:15.137883+0000","last_became_peered":"2024-05-20T18:00:15.137883+0000","last_unstale":"2024-05-20T18:00:17.152549+0000","last_undegraded":"2024-05-20T18:00:17.152549+0000","last_fullsized":"2024-05-20T18:00:17.152549+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:14.101924+0000","last_clean_scrub_stamp":"2024-05-20T18:00:14.101924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:22:14.679488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":319,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-05-20T18:00:17.125494+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:00:17.125494+0000","last_peered":"2024-05-20T18:00:17.125494+0000","last_clean":"2024-05-20T18:00:17.125494+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:00:17.125494+0000","last_undegraded":"2024-05-20T18:00:17.125494+0000","last_fullsized":"2024-05-20T18:00:17.125494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1855488,"data_stored":1168850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574941,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1273856,"data_stored":580538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":578322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1261568,"data_stored":578414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":578904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574941,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":578356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":578356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1863680,"data_stored":1170392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:00:20.582 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T18:00:20.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T18:00:20.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.743+0000 7f8c48bcc640 1 Processor -- start 2024-05-20T18:00:20.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.743+0000 7f8c48bcc640 1 -- start start 2024-05-20T18:00:20.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c48bcc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c44162820 0x7f8c440b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c48bcc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8c4406dae0 0x7f8c440b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c48bcc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c440d0630 con 0x7f8c440b3e80 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c48bcc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8c440d39c0 con 0x7f8c44162820 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c48bcc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8c440d3ca0 con 0x7f8c4406dae0 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c4259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c44162820 0x7f8c440b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c4259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c44162820 0x7f8c440b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50098/0 (socket says 172.21.15.6:50098) 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c4259c640 1 -- 172.21.15.6:0/4269236333 learned_addr learned my addr 172.21.15.6:0/4269236333 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c42d9d640 1 --2- 172.21.15.6:0/4269236333 >> v2:172.21.15.171:3300/0 conn(0x7f8c4406dae0 0x7f8c440b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c4259c640 1 -- 172.21.15.6:0/4269236333 >> v2:172.21.15.171:3300/0 conn(0x7f8c4406dae0 msgr2=0x7f8c440b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c4259c640 1 --2- 172.21.15.6:0/4269236333 >> v2:172.21.15.171:3300/0 conn(0x7f8c4406dae0 0x7f8c440b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c4259c640 1 -- 172.21.15.6:0/4269236333 >> v1:172.21.15.171:6789/0 conn(0x7f8c440b3e80 legacy=0x7f8c4406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.745+0000 7f8c4259c640 1 -- 172.21.15.6:0/4269236333 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c440d3f80 con 0x7f8c44162820 2024-05-20T18:00:20.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.746+0000 7f8c4259c640 1 --2- 172.21.15.6:0/4269236333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440b3940 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8c4408e070 tx=0x7f8c3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebf0419e2534e5d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:20.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.746+0000 7f8c4159a640 1 -- 172.21.15.6:0/4269236333 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c037070 con 0x7f8c44162820 2024-05-20T18:00:20.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.746+0000 7f8c4159a640 1 -- 172.21.15.6:0/4269236333 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c032440 con 0x7f8c44162820 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.746+0000 7f8c4159a640 1 -- 172.21.15.6:0/4269236333 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c032810 con 0x7f8c44162820 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.747+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4269236333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 msgr2=0x7f8c440b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.747+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4269236333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440b3940 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8c4408e070 tx=0x7f8c3c02a270 comp rx=0 tx=0).stop 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.747+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4269236333 shutdown_connections 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.747+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4269236333 >> v2:172.21.15.171:3300/0 conn(0x7f8c4406dae0 0x7f8c440b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.747+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4269236333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440b3940 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.747+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4269236333 >> 172.21.15.6:0/4269236333 conn(0x7f8c440d4bd0 msgr2=0x7f8c440d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.747+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4269236333 shutdown_connections 2024-05-20T18:00:20.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.747+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4269236333 wait complete. 2024-05-20T18:00:20.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.749+0000 7f8c48bcc640 1 Processor -- start 2024-05-20T18:00:20.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.749+0000 7f8c48bcc640 1 -- start start 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c48bcc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c440b3e80 0x7f8c4415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c48bcc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c48bcc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c440cde50 0x7f8c440ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c48bcc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c440d4780 con 0x7f8c44162820 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c48bcc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c440d0300 con 0x7f8c440b3e80 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c48bcc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c440d4900 con 0x7f8c440cde50 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c41d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c41d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50110/0 (socket says 172.21.15.6:50110) 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.750+0000 7f8c41d9b640 1 -- 172.21.15.6:0/4033757247 learned_addr learned my addr 172.21.15.6:0/4033757247 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c42d9d640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c440cde50 0x7f8c440ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c4259c640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c440b3e80 0x7f8c4415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c41d9b640 1 -- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c440cde50 msgr2=0x7f8c440ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c41d9b640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c440cde50 0x7f8c440ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c41d9b640 1 -- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c440b3e80 msgr2=0x7f8c4415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c41d9b640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c440b3e80 0x7f8c4415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c41d9b640 1 -- 172.21.15.6:0/4033757247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c440ac620 con 0x7f8c44162820 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c42d9d640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c440cde50 0x7f8c440ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c4259c640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c440b3e80 0x7f8c4415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c41d9b640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440ca130 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00c3f0 tx=0x7f8c2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c3affd640 1 -- 172.21.15.6:0/4033757247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0052d0 con 0x7f8c44162820 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c3affd640 1 -- 172.21.15.6:0/4033757247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2c005490 con 0x7f8c44162820 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c440ca930 con 0x7f8c44162820 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c3affd640 1 -- 172.21.15.6:0/4033757247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c007260 con 0x7f8c44162820 2024-05-20T18:00:20.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.751+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c440ca670 con 0x7f8c44162820 2024-05-20T18:00:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.752+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c440ce7a0 con 0x7f8c44162820 2024-05-20T18:00:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.753+0000 7f8c3affd640 1 -- 172.21.15.6:0/4033757247 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c2c007400 con 0x7f8c44162820 2024-05-20T18:00:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.753+0000 7f8c3affd640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2406be60 0x7f8c2406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.753+0000 7f8c3affd640 1 -- 172.21.15.6:0/4033757247 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f8c2c08a580 con 0x7f8c44162820 2024-05-20T18:00:20.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.754+0000 7f8c4259c640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2406be60 0x7f8c2406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:20.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.754+0000 7f8c4259c640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2406be60 0x7f8c2406e370 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c034000 tx=0x7f8c3c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:20.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:20.758+0000 7f8c3affd640 1 -- 172.21.15.6:0/4033757247 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8c440ce7a0 con 0x7f8c44162820 2024-05-20T18:00:21.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.017+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8c4415ed20 con 0x7f8c44162820 2024-05-20T18:00:21.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.019+0000 7f8c3affd640 1 -- 172.21.15.6:0/4033757247 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f8c4415ed20 con 0x7f8c44162820 2024-05-20T18:00:21.017 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T18:00:21.017 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T18:00:21.017 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T18:00:21.017 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T18:00:21.017 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T18:00:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T18:00:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2406be60 msgr2=0x7f8c2406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2406be60 0x7f8c2406e370 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c034000 tx=0x7f8c3c02e000 comp rx=0 tx=0).stop 2024-05-20T18:00:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 msgr2=0x7f8c440ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440ca130 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00c3f0 tx=0x7f8c2c00c8b0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 shutdown_connections 2024-05-20T18:00:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2406be60 0x7f8c2406e370 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c440cde50 0x7f8c440ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c44162820 0x7f8c440ca130 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 --2- 172.21.15.6:0/4033757247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c440b3e80 0x7f8c4415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 >> 172.21.15.6:0/4033757247 conn(0x7f8c440d4bd0 msgr2=0x7f8c4415fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 shutdown_connections 2024-05-20T18:00:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.023+0000 7f8c48bcc640 1 -- 172.21.15.6:0/4033757247 wait complete. 2024-05-20T18:00:21.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:21.069 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-20T18:00:21.072+0000 7f0ac58a4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T18:00:21.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.149+0000 7f5f48545640 1 Processor -- start 2024-05-20T18:00:21.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.149+0000 7f5f48545640 1 -- start start 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.150+0000 7f5f48545640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f400b6d90 0x7f5f4015f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.150+0000 7f5f48545640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f400d0550 con 0x7f5f400d3220 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.150+0000 7f5f48545640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f400d0830 con 0x7f5f400cf250 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.150+0000 7f5f48545640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5f4015f9a0 con 0x7f5f400b6d90 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.150+0000 7f5f45ae0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5f400b6d90 0x7f5f4015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.150+0000 7f5f46ae2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5f400d3220 0x7f5f400d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54170/0 (socket says 172.21.15.6:54170) 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.150+0000 7f5f46ae2640 1 -- 172.21.15.6:0/2775100068 learned_addr learned my addr 172.21.15.6:0/2775100068 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.151+0000 7f5f45ae0640 1 -- 172.21.15.6:0/2775100068 >> v1:172.21.15.171:6789/0 conn(0x7f5f400cf250 legacy=0x7f5f400b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.151+0000 7f5f45ae0640 1 -- 172.21.15.6:0/2775100068 >> v1:172.21.15.6:6789/0 conn(0x7f5f400d3220 legacy=0x7f5f400d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.151+0000 7f5f45ae0640 1 -- 172.21.15.6:0/2775100068 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f400d2a20 con 0x7f5f400b6d90 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.152+0000 7f5f45ae0640 1 --2- 172.21.15.6:0/2775100068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f400b6d90 0x7f5f4015f460 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097a0 tx=0x7f5f3002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc9090e87c0c07f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.152+0000 7f5f452df640 1 -- 172.21.15.6:0/2775100068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30037070 con 0x7f5f400b6d90 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.152+0000 7f5f452df640 1 -- 172.21.15.6:0/2775100068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f30032440 con 0x7f5f400b6d90 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.152+0000 7f5f452df640 1 -- 172.21.15.6:0/2775100068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30032810 con 0x7f5f400b6d90 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.152+0000 7f5f48545640 1 -- 172.21.15.6:0/2775100068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f400b6d90 msgr2=0x7f5f4015f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.152+0000 7f5f48545640 1 --2- 172.21.15.6:0/2775100068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f400b6d90 0x7f5f4015f460 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097a0 tx=0x7f5f3002a230 comp rx=0 tx=0).stop 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.153+0000 7f5f48545640 1 -- 172.21.15.6:0/2775100068 shutdown_connections 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.153+0000 7f5f48545640 1 --2- 172.21.15.6:0/2775100068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f400b6d90 0x7f5f4015f460 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.153+0000 7f5f48545640 1 -- 172.21.15.6:0/2775100068 >> 172.21.15.6:0/2775100068 conn(0x7f5f400d1860 msgr2=0x7f5f400d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.153+0000 7f5f48545640 1 -- 172.21.15.6:0/2775100068 shutdown_connections 2024-05-20T18:00:21.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.153+0000 7f5f48545640 1 -- 172.21.15.6:0/2775100068 wait complete. 2024-05-20T18:00:21.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.154+0000 7f5f48545640 1 Processor -- start 2024-05-20T18:00:21.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.154+0000 7f5f48545640 1 -- start start 2024-05-20T18:00:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f48545640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f400cf250 0x7f5f401f88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f48545640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f400d3220 0x7f5f401e9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f48545640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f4014bd00 0x7f5f4014c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f48545640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5f400d27d0 con 0x7f5f4014bd00 2024-05-20T18:00:21.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f48545640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f400d0140 con 0x7f5f400d3220 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f48545640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f400d02c0 con 0x7f5f400cf250 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f4014bd00 0x7f5f4014c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f4014bd00 0x7f5f4014c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50126/0 (socket says 172.21.15.6:50126) 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 -- 172.21.15.6:0/4256693411 learned_addr learned my addr 172.21.15.6:0/4256693411 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f462e1640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f400cf250 0x7f5f401f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f45ae0640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f400d3220 0x7f5f401e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 -- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f400cf250 msgr2=0x7f5f401f88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f400cf250 0x7f5f401f88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 -- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f400d3220 msgr2=0x7f5f401e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f400d3220 0x7f5f401e9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 -- 172.21.15.6:0/4256693411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f401639d0 con 0x7f5f4014bd00 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.156+0000 7f5f46ae2640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f4014bd00 0x7f5f4014c110 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c3a0 tx=0x7f5f3800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.157+0000 7f5f36ffd640 1 -- 172.21.15.6:0/4256693411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38017070 con 0x7f5f4014bd00 2024-05-20T18:00:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.157+0000 7f5f36ffd640 1 -- 172.21.15.6:0/4256693411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f38005ce0 con 0x7f5f4014bd00 2024-05-20T18:00:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.157+0000 7f5f36ffd640 1 -- 172.21.15.6:0/4256693411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f380072d0 con 0x7f5f4014bd00 2024-05-20T18:00:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.157+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f401ea3e0 con 0x7f5f4014bd00 2024-05-20T18:00:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.157+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f40149ea0 con 0x7f5f4014bd00 2024-05-20T18:00:21.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.158+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f401ea150 con 0x7f5f4014bd00 2024-05-20T18:00:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.158+0000 7f5f36ffd640 1 -- 172.21.15.6:0/4256693411 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f3801a070 con 0x7f5f4014bd00 2024-05-20T18:00:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.159+0000 7f5f36ffd640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5f2406be30 0x7f5f2406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.159+0000 7f5f36ffd640 1 -- 172.21.15.6:0/4256693411 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f5f3808a1c0 con 0x7f5f4014bd00 2024-05-20T18:00:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.160+0000 7f5f462e1640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5f2406be30 0x7f5f2406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.160+0000 7f5f462e1640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5f2406be30 0x7f5f2406e340 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c001e70 tx=0x7f5f3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.164+0000 7f5f36ffd640 1 -- 172.21.15.6:0/4256693411 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5f401639d0 con 0x7f5f4014bd00 2024-05-20T18:00:21.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.386+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f40075b00 con 0x7f5f4014bd00 2024-05-20T18:00:21.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.387+0000 7f5f36ffd640 1 -- 172.21.15.6:0/4256693411 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5180 (secure 0 0 0) 0x7f5f38058380 con 0x7f5f4014bd00 2024-05-20T18:00:21.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:21.384 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6413,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2288332461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2288332461},{"type":"v1","addr":"172.21.15.171:6835","nonce":2288332461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/4138789955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4138789955},{"type":"v1","addr":"172.21.15.171:6837","nonce":4138789955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2834528553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2834528553},{"type":"v1","addr":"172.21.15.6:6835","nonce":2834528553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:15.507163+0000","modified":"2024-05-20T18:00:18.526380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7725":{"gid":7725,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6834/957433228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":957433228},{"type":"v1","addr":"172.21.15.6:6834","nonce":957433228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7725,"qdb_cluster":[7725]},"id":7}]} 2024-05-20T18:00:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2024-05-20T18:00:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5f2406be30 msgr2=0x7f5f2406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5f2406be30 0x7f5f2406e340 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c001e70 tx=0x7f5f3c009040 comp rx=0 tx=0).stop 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f4014bd00 msgr2=0x7f5f4014c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f4014bd00 0x7f5f4014c110 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c3a0 tx=0x7f5f3800c860 comp rx=0 tx=0).stop 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 shutdown_connections 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5f2406be30 0x7f5f2406e340 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f4014bd00 0x7f5f4014c110 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f400d3220 0x7f5f401e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 --2- 172.21.15.6:0/4256693411 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f400cf250 0x7f5f401f88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 >> 172.21.15.6:0/4256693411 conn(0x7f5f400d1860 msgr2=0x7f5f400d3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 shutdown_connections 2024-05-20T18:00:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.389+0000 7f5f48545640 1 -- 172.21.15.6:0/4256693411 wait complete. 2024-05-20T18:00:21.800 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T18:00:15.507163+0000', 'modified': '2024-05-20T18:00:18.526380+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7725}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7725': {'gid': 7725, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.6:6834/957433228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 957433228}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 957433228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7725, 'qdb_cluster': [7725]} 2024-05-20T18:00:21.800 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T18:00:21.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-20T18:00:21.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.926+0000 7f0049b4c640 1 Processor -- start 2024-05-20T18:00:21.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.926+0000 7f0049b4c640 1 -- start start 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0049b4c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f004415f220 0x7f00440d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0049b4c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00440cfae0 0x7f00440ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0049b4c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00440cda20 con 0x7f00440d0e00 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0049b4c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f00440cdd00 con 0x7f00440cfae0 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0049b4c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f00440cdfe0 con 0x7f004415f220 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0043fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00440cfae0 0x7f00440ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0042ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f00440d0e00 0x7f00440cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54178/0 (socket says 172.21.15.6:54178) 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0042ffd640 1 -- 172.21.15.6:0/2157715885 learned_addr learned my addr 172.21.15.6:0/2157715885 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f00437fe640 1 --2- 172.21.15.6:0/2157715885 >> v2:172.21.15.171:3300/0 conn(0x7f004415f220 0x7f00440d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0043fff640 1 -- 172.21.15.6:0/2157715885 >> v2:172.21.15.171:3300/0 conn(0x7f004415f220 msgr2=0x7f00440d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0043fff640 1 --2- 172.21.15.6:0/2157715885 >> v2:172.21.15.171:3300/0 conn(0x7f004415f220 0x7f00440d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0043fff640 1 -- 172.21.15.6:0/2157715885 >> v1:172.21.15.6:6789/0 conn(0x7f00440d0e00 legacy=0x7f00440cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f0043fff640 1 -- 172.21.15.6:0/2157715885 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00440ce2c0 con 0x7f00440cfae0 2024-05-20T18:00:21.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.928+0000 7f00427fc640 1 -- 172.21.15.6:0/2157715885 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2222324558 0 0) 0x7f00440cda20 con 0x7f00440d0e00 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.929+0000 7f0043fff640 1 --2- 172.21.15.6:0/2157715885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440cfae0 0x7f00440ce7e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f004406e810 tx=0x7f003c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a2c668aa9969e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.929+0000 7f00427fc640 1 -- 172.21.15.6:0/2157715885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c007740 con 0x7f00440cfae0 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.929+0000 7f00427fc640 1 -- 172.21.15.6:0/2157715885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c0078e0 con 0x7f00440cfae0 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.929+0000 7f00427fc640 1 -- 172.21.15.6:0/2157715885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c007cb0 con 0x7f00440cfae0 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.930+0000 7f0049b4c640 1 -- 172.21.15.6:0/2157715885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440cfae0 msgr2=0x7f00440ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.930+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2157715885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440cfae0 0x7f00440ce7e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f004406e810 tx=0x7f003c02a5f0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.930+0000 7f0049b4c640 1 -- 172.21.15.6:0/2157715885 shutdown_connections 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.930+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2157715885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440cfae0 0x7f00440ce7e0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.930+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2157715885 >> v2:172.21.15.171:3300/0 conn(0x7f004415f220 0x7f00440d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.930+0000 7f0049b4c640 1 -- 172.21.15.6:0/2157715885 >> 172.21.15.6:0/2157715885 conn(0x7f00440b44d0 msgr2=0x7f00440b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.930+0000 7f0049b4c640 1 -- 172.21.15.6:0/2157715885 shutdown_connections 2024-05-20T18:00:21.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.930+0000 7f0049b4c640 1 -- 172.21.15.6:0/2157715885 wait complete. 2024-05-20T18:00:21.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.932+0000 7f0049b4c640 1 Processor -- start 2024-05-20T18:00:21.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.932+0000 7f0049b4c640 1 -- start start 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f0049b4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440d0e00 0x7f0044160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f0049b4c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f004415f220 0x7f00440b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f0049b4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0044160880 0x7f00440b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f0049b4c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f004415f7b0 con 0x7f00440d0e00 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f0049b4c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f004415f630 con 0x7f004415f220 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f0049b4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f00440ced20 con 0x7f0044160880 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f00437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440d0e00 0x7f0044160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f00437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440d0e00 0x7f0044160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50152/0 (socket says 172.21.15.6:50152) 2024-05-20T18:00:21.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.933+0000 7f00437fe640 1 -- 172.21.15.6:0/2103579673 learned_addr learned my addr 172.21.15.6:0/2103579673 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f004415f220 0x7f00440b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f0043fff640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0044160880 0x7f00440b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f00437fe640 1 -- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0044160880 msgr2=0x7f00440b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f00437fe640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0044160880 0x7f00440b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f00437fe640 1 -- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f004415f220 msgr2=0x7f00440b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f00437fe640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f004415f220 0x7f00440b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f00437fe640 1 -- 172.21.15.6:0/2103579673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0044161950 con 0x7f00440d0e00 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f0043fff640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0044160880 0x7f00440b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f00437fe640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440d0e00 0x7f0044160340 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f003400d5d0 tx=0x7f003400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f002bfff640 1 -- 172.21.15.6:0/2103579673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034004240 con 0x7f00440d0e00 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f002bfff640 1 -- 172.21.15.6:0/2103579673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00340043e0 con 0x7f00440d0e00 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f0049b4c640 1 -- 172.21.15.6:0/2103579673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00440b7000 con 0x7f00440d0e00 2024-05-20T18:00:21.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f002bfff640 1 -- 172.21.15.6:0/2103579673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034003830 con 0x7f00440d0e00 2024-05-20T18:00:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.934+0000 7f0049b4c640 1 -- 172.21.15.6:0/2103579673 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0044161670 con 0x7f00440d0e00 2024-05-20T18:00:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.937+0000 7f002bfff640 1 -- 172.21.15.6:0/2103579673 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00340039d0 con 0x7f00440d0e00 2024-05-20T18:00:21.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.937+0000 7f002bfff640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f003006be30 0x7f003006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.937+0000 7f002bfff640 1 -- 172.21.15.6:0/2103579673 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f003408b2b0 con 0x7f00440d0e00 2024-05-20T18:00:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.937+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f003006be30 0x7f003006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.938+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f003006be30 0x7f003006e340 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f00440b4f10 tx=0x7f0038007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.938+0000 7f00509fc740 1 Processor -- start 2024-05-20T18:00:21.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.938+0000 7f00509fc740 1 -- start start 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.939+0000 7f00509fc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a41a270 0x55fe3a7e5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.939+0000 7f00509fc740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 0x55fe3a7e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f00509fc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7bb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f00509fc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fe3a71e4d0 con 0x55fe3a3f9590 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f00509fc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fe3a6c63e0 con 0x55fe3a41a270 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f00509fc740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55fe3a71a490 con 0x55fe3a3f13b0 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7bb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50160/0 (socket says 172.21.15.6:50160) 2024-05-20T18:00:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 -- 172.21.15.6:0/396575189 learned_addr learned my addr 172.21.15.6:0/396575189 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f00437fe640 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a41a270 0x55fe3a7e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0042ffd640 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 0x55fe3a7e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 -- 172.21.15.6:0/396575189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 msgr2=0x55fe3a7e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 0x55fe3a7e20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 -- 172.21.15.6:0/396575189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a41a270 msgr2=0x55fe3a7e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a41a270 0x55fe3a7e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 -- 172.21.15.6:0/396575189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3a4322d0 con 0x55fe3a3f9590 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f0043fff640 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7bb360 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f003c02abe0 tx=0x7f003c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a0291a3357f044 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f00297fa640 1 -- 172.21.15.6:0/396575189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c0079f0 con 0x55fe3a3f9590 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f00297fa640 1 -- 172.21.15.6:0/396575189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c007b90 con 0x55fe3a3f9590 2024-05-20T18:00:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.940+0000 7f00297fa640 1 -- 172.21.15.6:0/396575189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c045430 con 0x55fe3a3f9590 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 -- 172.21.15.6:0/396575189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 msgr2=0x55fe3a7bb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7bb360 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f003c02abe0 tx=0x7f003c02f000 comp rx=0 tx=0).stop 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 -- 172.21.15.6:0/396575189 shutdown_connections 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7bb360 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 0x55fe3a7e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 --2- 172.21.15.6:0/396575189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a41a270 0x55fe3a7e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 -- 172.21.15.6:0/396575189 >> 172.21.15.6:0/396575189 conn(0x55fe3a40e3c0 msgr2=0x55fe3a7baaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 -- 172.21.15.6:0/396575189 shutdown_connections 2024-05-20T18:00:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.941+0000 7f00509fc740 1 -- 172.21.15.6:0/396575189 wait complete. 2024-05-20T18:00:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.942+0000 7f00509fc740 1 -- start start 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.942+0000 7f00509fc740 1 Processor -- start 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00509fc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7de180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00509fc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7ff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00509fc740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a41a270 0x55fe3a7ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00509fc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fe3a6d98e0 con 0x55fe3a3f9590 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00509fc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fe3a803c30 con 0x55fe3a3f13b0 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00509fc740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55fe3a7e6de0 con 0x55fe3a41a270 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00509fc740 10 client.0 _ll_register_callbacks cb 0x55fe3a6a69c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7ff610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50176/0 (socket says 172.21.15.6:50176) 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 -- 172.21.15.6:0/2035149967 learned_addr learned my addr 172.21.15.6:0/2035149967 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00437fe640 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7de180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0043fff640 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a41a270 0x55fe3a7ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 -- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a41a270 msgr2=0x55fe3a7ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a41a270 0x55fe3a7ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 -- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f13b0 msgr2=0x55fe3a7de180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7de180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 -- 172.21.15.6:0/2035149967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3a4fc6b0 con 0x55fe3a3f9590 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0043fff640 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a41a270 0x55fe3a7ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7ff610 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f00440b2410 tx=0x7f0038000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4352ca4dd3756e8e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00227fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.944+0000 7f00227fc640 1 -- 172.21.15.6:0/2035149967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038020580 con 0x55fe3a3f9590 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00227fc640 1 -- 172.21.15.6:0/2035149967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f0038020720 con 0x55fe3a3f9590 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 1 -- 172.21.15.6:0/2035149967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f003c007b90 con 0x55fe3a3f9590 2024-05-20T18:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00227fc640 1 -- 172.21.15.6:0/2035149967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f003802e050 con 0x55fe3a3f9590 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 10 client.7887 fetch_fsmap learned FSMap version 66 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 1 -- 172.21.15.6:0/2035149967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55fe3a7e5280 con 0x55fe3a3f9590 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00227fc640 1 -- 172.21.15.6:0/2035149967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003c007b90 con 0x55fe3a3f9590 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00227fc640 1 -- 172.21.15.6:0/2035149967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f0038031020 con 0x55fe3a3f9590 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 10 client.7887 fetch_fsmap finished waiting for FSMap version 66 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 10 client.7887 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 20 client.7887 populate_metadata read hostname 'smithi006' 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] conn(0x55fe3a3d8e40 0x55fe3a81d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 4 client.7887 mds_command: new command op to 7725 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00509fc740 1 -- 172.21.15.6:0/2035149967 --> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe3a72bc00 con 0x55fe3a3d8e40 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.945+0000 7f00437fe640 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] conn(0x55fe3a3d8e40 0x55fe3a81d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.946+0000 7f00227fc640 10 client.7887 ms_handle_connect on v2:172.21.15.6:6832/957433228 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.946+0000 7f00437fe640 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] conn(0x55fe3a3d8e40 0x55fe3a81d430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a28f34c74569ca75 server_cookie=155febd643694715 in_seq=0 out_seq=0 2024-05-20T18:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.946+0000 7f00227fc640 1 -- 172.21.15.6:0/2035149967 <== mds.0 v2:172.21.15.6:6832/957433228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fe3a72bc00 con 0x55fe3a3d8e40 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.946+0000 7f00227fc640 10 client.7887 handle_command_reply: tid=0 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.946+0000 7f00509fc740 1 client.7887 shutdown 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 -- 172.21.15.6:0/2035149967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 msgr2=0x55fe3a7ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7ff610 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f00440b2410 tx=0x7f0038000ed0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 -- 172.21.15.6:0/2035149967 shutdown_connections 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] conn(0x55fe3a3d8e40 0x55fe3a81d430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a41a270 0x55fe3a7ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f9590 0x55fe3a7ff610 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00227fc640 0 client.7887 ms_handle_reset on v2:172.21.15.6:6832/957433228 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 --2- 172.21.15.6:0/2035149967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7de180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 -- 172.21.15.6:0/2035149967 >> 172.21.15.6:0/2035149967 conn(0x55fe3a40e3c0 msgr2=0x55fe3a7b9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 -- 172.21.15.6:0/2035149967 shutdown_connections 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 1 -- 172.21.15.6:0/2035149967 wait complete. 2024-05-20T18:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.947+0000 7f00509fc740 20 client.7887 trim_cache size 0 max 16384 2024-05-20T18:00:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.966+0000 7f00509fc740 1 Processor -- start 2024-05-20T18:00:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.966+0000 7f00509fc740 1 -- start start 2024-05-20T18:00:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f00509fc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3d8e40 0x55fe3a7ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f00509fc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f00509fc740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f9590 0x55fe3a7e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f00509fc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f00442013b0 con 0x55fe3a3f13b0 2024-05-20T18:00:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f00509fc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0044200740 con 0x55fe3a3d8e40 2024-05-20T18:00:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f00509fc740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0044200d90 con 0x55fe3a3f9590 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f0042ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f0042ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50178/0 (socket says 172.21.15.6:50178) 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.967+0000 7f0042ffd640 1 -- 172.21.15.6:0/2713195865 learned_addr learned my addr 172.21.15.6:0/2713195865 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0042ffd640 1 -- 172.21.15.6:0/2713195865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f9590 msgr2=0x55fe3a7e84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2713195865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f9590 0x55fe3a7e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0042ffd640 1 -- 172.21.15.6:0/2713195865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3d8e40 msgr2=0x55fe3a7ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2713195865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3d8e40 0x55fe3a7ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0042ffd640 1 -- 172.21.15.6:0/2713195865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe3a800760 con 0x55fe3a3f13b0 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0042ffd640 1 --2- 172.21.15.6:0/2713195865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7ffb30 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0038000fe0 tx=0x7f0038021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9790784c3d5452a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0028ff9640 1 -- 172.21.15.6:0/2713195865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038020cf0 con 0x55fe3a3f13b0 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0028ff9640 1 -- 172.21.15.6:0/2713195865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0038026070 con 0x55fe3a3f13b0 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.968+0000 7f0028ff9640 1 -- 172.21.15.6:0/2713195865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038020780 con 0x55fe3a3f13b0 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 -- 172.21.15.6:0/2713195865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f13b0 msgr2=0x55fe3a7ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 --2- 172.21.15.6:0/2713195865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7ffb30 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0038000fe0 tx=0x7f0038021000 comp rx=0 tx=0).stop 2024-05-20T18:00:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 -- 172.21.15.6:0/2713195865 shutdown_connections 2024-05-20T18:00:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 --2- 172.21.15.6:0/2713195865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f9590 0x55fe3a7e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 --2- 172.21.15.6:0/2713195865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3f13b0 0x55fe3a7ffb30 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 --2- 172.21.15.6:0/2713195865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3d8e40 0x55fe3a7ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 -- 172.21.15.6:0/2713195865 >> 172.21.15.6:0/2713195865 conn(0x55fe3a40e3c0 msgr2=0x55fe3a7e31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 -- 172.21.15.6:0/2713195865 shutdown_connections 2024-05-20T18:00:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.969+0000 7f00509fc740 1 -- 172.21.15.6:0/2713195865 wait complete. 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.970+0000 7f00509fc740 1 -- start start 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.970+0000 7f00509fc740 1 Processor -- start 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00509fc740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3d8e40 0x55fe3a8194f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00509fc740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 0x55fe3a7e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00509fc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f9590 0x55fe3a7e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00509fc740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55fe3a8002c0 con 0x55fe3a3d8e40 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00509fc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fe3a803970 con 0x55fe3a3f9590 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00509fc740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55fe3a7e4940 con 0x55fe3a3f13b0 2024-05-20T18:00:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00509fc740 10 client.0 _ll_register_callbacks cb 0x7f0038004c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3d8e40 0x55fe3a8194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3d8e40 0x55fe3a8194f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50182/0 (socket says 172.21.15.6:50182) 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00437fe640 1 -- 172.21.15.6:0/371691557 learned_addr learned my addr 172.21.15.6:0/371691557 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f0043fff640 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f9590 0x55fe3a7e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f0042ffd640 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 0x55fe3a7e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00437fe640 1 -- 172.21.15.6:0/371691557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 msgr2=0x55fe3a7e89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.971+0000 7f00437fe640 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 0x55fe3a7e89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00437fe640 1 -- 172.21.15.6:0/371691557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f9590 msgr2=0x55fe3a7e8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00437fe640 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f9590 0x55fe3a7e8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00437fe640 1 -- 172.21.15.6:0/371691557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe3a802fd0 con 0x55fe3a3d8e40 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00437fe640 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3d8e40 0x55fe3a8194f0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f00340557a0 tx=0x7f003408b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73024b4b6b342b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00227fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:00:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00227fc640 1 -- 172.21.15.6:0/371691557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034076060 con 0x55fe3a3d8e40 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00227fc640 1 -- 172.21.15.6:0/371691557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f0034057640 con 0x55fe3a3d8e40 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 1 -- 172.21.15.6:0/371691557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0038026070 con 0x55fe3a3d8e40 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00227fc640 1 -- 172.21.15.6:0/371691557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f00340559b0 con 0x55fe3a3d8e40 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 10 client.7893 fetch_fsmap learned FSMap version 66 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 1 -- 172.21.15.6:0/371691557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55fe3a7de440 con 0x55fe3a3d8e40 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00227fc640 1 -- 172.21.15.6:0/371691557 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0038026070 con 0x55fe3a3d8e40 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00227fc640 1 -- 172.21.15.6:0/371691557 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f0034013070 con 0x55fe3a3d8e40 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 10 client.7893 fetch_fsmap finished waiting for FSMap version 66 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 10 client.7893 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 20 client.7893 populate_metadata read hostname 'smithi006' 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] conn(0x55fe3a3ae280 0x55fe3a7b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 4 client.7893 mds_command: new command op to 7725 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.972+0000 7f00509fc740 1 -- 172.21.15.6:0/371691557 --> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] -- command(tid 0: {"prefix": "status"}) -- 0x55fe3a725f50 con 0x55fe3a3ae280 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f0042ffd640 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] conn(0x55fe3a3ae280 0x55fe3a7b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00227fc640 10 client.7893 ms_handle_connect on v2:172.21.15.6:6832/957433228 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f0042ffd640 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] conn(0x55fe3a3ae280 0x55fe3a7b4420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0193403ad05ba4 server_cookie=e3f4ac0898c5cfeb in_seq=0 out_seq=0 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00227fc640 1 -- 172.21.15.6:0/371691557 <== mds.0 v2:172.21.15.6:6832/957433228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55fe3a725f50 con 0x55fe3a3ae280 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00227fc640 10 client.7893 handle_command_reply: tid=0 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 client.7893 shutdown 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 -- 172.21.15.6:0/371691557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3d8e40 msgr2=0x55fe3a8194f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3d8e40 0x55fe3a8194f0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f00340557a0 tx=0x7f003408b040 comp rx=0 tx=0).stop 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 -- 172.21.15.6:0/371691557 shutdown_connections 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.6:6832/957433228,v1:172.21.15.6:6834/957433228] conn(0x55fe3a3ae280 0x55fe3a7b4420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fe3a3f9590 0x55fe3a7e8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55fe3a3f13b0 0x55fe3a7e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00227fc640 0 client.7893 ms_handle_reset on v2:172.21.15.6:6832/957433228 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 --2- 172.21.15.6:0/371691557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fe3a3d8e40 0x55fe3a8194f0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 -- 172.21.15.6:0/371691557 >> 172.21.15.6:0/371691557 conn(0x55fe3a40e3c0 msgr2=0x55fe3a7e3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 -- 172.21.15.6:0/371691557 shutdown_connections 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.973+0000 7f00509fc740 1 -- 172.21.15.6:0/371691557 wait complete. 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f00509fc740 20 client.7893 trim_cache size 0 max 16384 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T18:00:21.976 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7725, 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.853795184, 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 66, 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 101, 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 101, 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 17.848999984999999 2024-05-20T18:00:21.977 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:00:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 -- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f003006be30 msgr2=0x7f003006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f003006be30 0x7f003006e340 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f00440b4f10 tx=0x7f0038007de0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 -- 172.21.15.6:0/2103579673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440d0e00 msgr2=0x7f0044160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440d0e00 0x7f0044160340 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f003400d5d0 tx=0x7f003400da90 comp rx=0 tx=0).stop 2024-05-20T18:00:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 -- 172.21.15.6:0/2103579673 shutdown_connections 2024-05-20T18:00:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f003006be30 0x7f003006e340 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0044160880 0x7f00440b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f004415f220 0x7f00440b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 --2- 172.21.15.6:0/2103579673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00440d0e00 0x7f0044160340 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 -- 172.21.15.6:0/2103579673 >> 172.21.15.6:0/2103579673 conn(0x7f00440b44d0 msgr2=0x7f00440b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 -- 172.21.15.6:0/2103579673 shutdown_connections 2024-05-20T18:00:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:21.974+0000 7f0049b4c640 1 -- 172.21.15.6:0/2103579673 wait complete. 2024-05-20T18:00:21.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:00:22.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.100+0000 7f5334545640 1 Processor -- start 2024-05-20T18:00:22.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.100+0000 7f5334545640 1 -- start start 2024-05-20T18:00:22.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.101+0000 7f5334545640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f532c0cf250 0x7f532c15f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:22.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.101+0000 7f5334545640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f532c0b6680 0x7f532c0b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:22.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.101+0000 7f5334545640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532c0b6fd0 con 0x7f532c163020 2024-05-20T18:00:22.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.101+0000 7f5334545640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f532c15f9a0 con 0x7f532c0b6680 2024-05-20T18:00:22.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.101+0000 7f5334545640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f532c0d0b10 con 0x7f532c0cf250 2024-05-20T18:00:22.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.101+0000 7f5331ae0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f532c0b6680 0x7f532c0b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.101+0000 7f5332ae2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f532c163020 0x7f532c163430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54194/0 (socket says 172.21.15.6:54194) 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.101+0000 7f5332ae2640 1 -- 172.21.15.6:0/3666902771 learned_addr learned my addr 172.21.15.6:0/3666902771 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.102+0000 7f53322e1640 1 --2- 172.21.15.6:0/3666902771 >> v2:172.21.15.171:3300/0 conn(0x7f532c0cf250 0x7f532c15f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.102+0000 7f5331ae0640 1 -- 172.21.15.6:0/3666902771 >> v2:172.21.15.171:3300/0 conn(0x7f532c0cf250 msgr2=0x7f532c15f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.102+0000 7f5331ae0640 1 --2- 172.21.15.6:0/3666902771 >> v2:172.21.15.171:3300/0 conn(0x7f532c0cf250 0x7f532c15f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.102+0000 7f5331ae0640 1 -- 172.21.15.6:0/3666902771 >> v1:172.21.15.6:6789/0 conn(0x7f532c163020 legacy=0x7f532c163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.102+0000 7f5331ae0640 1 -- 172.21.15.6:0/3666902771 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c0d0550 con 0x7f532c0b6680 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.102+0000 7f53312df640 1 -- 172.21.15.6:0/3666902771 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606375835 0 0) 0x7f5324001490 con 0x7f532c163020 2024-05-20T18:00:22.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.102+0000 7f53322e1640 1 --2- 172.21.15.6:0/3666902771 >> v2:172.21.15.171:3300/0 conn(0x7f532c0cf250 0x7f532c15f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:22.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.102+0000 7f5331ae0640 1 --2- 172.21.15.6:0/3666902771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0b6680 0x7f532c0b6a90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f532c08c360 tx=0x7f531c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e84610c4fef3d22 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f53312df640 1 -- 172.21.15.6:0/3666902771 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c037070 con 0x7f532c0b6680 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f53312df640 1 -- 172.21.15.6:0/3666902771 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c032440 con 0x7f532c0b6680 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f53312df640 1 -- 172.21.15.6:0/3666902771 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c032810 con 0x7f532c0b6680 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f5334545640 1 -- 172.21.15.6:0/3666902771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0b6680 msgr2=0x7f532c0b6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f5334545640 1 --2- 172.21.15.6:0/3666902771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0b6680 0x7f532c0b6a90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f532c08c360 tx=0x7f531c02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f5334545640 1 -- 172.21.15.6:0/3666902771 shutdown_connections 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f5334545640 1 --2- 172.21.15.6:0/3666902771 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0b6680 0x7f532c0b6a90 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f5334545640 1 --2- 172.21.15.6:0/3666902771 >> v2:172.21.15.171:3300/0 conn(0x7f532c0cf250 0x7f532c15f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f5334545640 1 -- 172.21.15.6:0/3666902771 >> 172.21.15.6:0/3666902771 conn(0x7f532c0d1860 msgr2=0x7f532c0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:22.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.103+0000 7f5334545640 1 -- 172.21.15.6:0/3666902771 shutdown_connections 2024-05-20T18:00:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.104+0000 7f5334545640 1 -- 172.21.15.6:0/3666902771 wait complete. 2024-05-20T18:00:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.105+0000 7f5334545640 1 Processor -- start 2024-05-20T18:00:22.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.105+0000 7f5334545640 1 -- start start 2024-05-20T18:00:22.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5334545640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f532c0b6680 0x7f532c1e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:22.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5334545640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0cf250 0x7f532c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:22.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5334545640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f532c163020 0x7f532c1495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5334545640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f532c0d2a20 con 0x7f532c0cf250 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5334545640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f532c0d27d0 con 0x7f532c163020 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5334545640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f532c0d2d00 con 0x7f532c0b6680 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0cf250 0x7f532c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0cf250 0x7f532c0c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50200/0 (socket says 172.21.15.6:50200) 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 -- 172.21.15.6:0/2541035629 learned_addr learned my addr 172.21.15.6:0/2541035629 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5332ae2640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f532c163020 0x7f532c1495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f53322e1640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f532c0b6680 0x7f532c1e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 -- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f532c0b6680 msgr2=0x7f532c1e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f532c0b6680 0x7f532c1e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 -- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f532c163020 msgr2=0x7f532c1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:22.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f532c163020 0x7f532c1495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 -- 172.21.15.6:0/2541035629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c15b390 con 0x7f532c0cf250 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5332ae2640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f532c163020 0x7f532c1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f53322e1640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f532c0b6680 0x7f532c1e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5331ae0640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0cf250 0x7f532c0c7c50 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f531c009890 tx=0x7f531c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5322ffd640 1 -- 172.21.15.6:0/2541035629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c037040 con 0x7f532c0cf250 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5322ffd640 1 -- 172.21.15.6:0/2541035629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c042070 con 0x7f532c0cf250 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.107+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532c148540 con 0x7f532c0cf250 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.108+0000 7f5322ffd640 1 -- 172.21.15.6:0/2541035629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c030bd0 con 0x7f532c0cf250 2024-05-20T18:00:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.108+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f532c148b00 con 0x7f532c0cf250 2024-05-20T18:00:22.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.108+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532c075b00 con 0x7f532c0cf250 2024-05-20T18:00:22.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.109+0000 7f5322ffd640 1 -- 172.21.15.6:0/2541035629 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f531c047460 con 0x7f532c0cf250 2024-05-20T18:00:22.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.109+0000 7f5322ffd640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f531006be30 0x7f531006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:22.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.110+0000 7f5322ffd640 1 -- 172.21.15.6:0/2541035629 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f531c0abcd0 con 0x7f532c0cf250 2024-05-20T18:00:22.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.110+0000 7f53322e1640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f531006be30 0x7f531006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:22.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.110+0000 7f53322e1640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f531006be30 0x7f531006e340 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5328006fd0 tx=0x7f5328008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:22.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.114+0000 7f5322ffd640 1 -- 172.21.15.6:0/2541035629 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f531c032e20 con 0x7f532c0cf250 2024-05-20T18:00:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.335+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f532c0b7440 con 0x7f532c0cf250 2024-05-20T18:00:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.335+0000 7f5322ffd640 1 -- 172.21.15.6:0/2541035629 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7f531c07a450 con 0x7f532c0cf250 2024-05-20T18:00:22.333 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:00:22.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f531006be30 msgr2=0x7f531006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:22.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f531006be30 0x7f531006e340 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5328006fd0 tx=0x7f5328008040 comp rx=0 tx=0).stop 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0cf250 msgr2=0x7f532c0c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0cf250 0x7f532c0c7c50 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f531c009890 tx=0x7f531c0046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 shutdown_connections 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f531006be30 0x7f531006e340 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f532c163020 0x7f532c1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f532c0cf250 0x7f532c0c7c50 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 --2- 172.21.15.6:0/2541035629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f532c0b6680 0x7f532c1e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 >> 172.21.15.6:0/2541035629 conn(0x7f532c0d1860 msgr2=0x7f532c0d3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 shutdown_connections 2024-05-20T18:00:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22.337+0000 7f5334545640 1 -- 172.21.15.6:0/2541035629 wait complete. 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:00:22.346 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:00:22.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:22.347 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T18:00:22.363 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:00:22.363 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:00:22.363 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:00:22.363 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:22.363 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T18:00:22.363 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:22.363 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42292sec preferred_lft 42292sec 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:22.364 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T18:00:22.365 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:22.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:22.366 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:00:22.427 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T18:00:22.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:22.429 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T18:00:22.486 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T18:00:22.486 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:00:22.486 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T18:00:22.486 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T18:00:22.486 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:00:22.487 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:00:22.487 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T18:00:22.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T18:00:22.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T18:00:22.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T18:00:22.487 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T18:00:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:00:22.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:22.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:22.615 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T18:00:22.631 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T18:00:22.631 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T18:00:22.631 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:00:22.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:22.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T18:00:22.696 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:00:22.696 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:22.752 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:00:22.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:00:22.753 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:22.807 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T18:00:22.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:22.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:22.904 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:22.904 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:00:22.913 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:22.913 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:00:22.914 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:00:22.914 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:00:22.914 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:00:22.914 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T18:00:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:00:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:00:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:00:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:00:22.916 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:00:22.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:22.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:22.943 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:00:23.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:00:23.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:23.045 INFO:teuthology.orchestra.run.smithi006.stdout:client6503 2024-05-20T18:00:23.046 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:23.046 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:23.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:00:23.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.221+0000 7ff518dc3640 1 Processor -- start 2024-05-20T18:00:23.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.221+0000 7ff518dc3640 1 -- start start 2024-05-20T18:00:23.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff518dc3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5140b0020 0x7ff51415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:23.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff518dc3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff51406c4c0 0x7ff5140b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:23.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff518dc3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5140b51c0 con 0x7ff51415ca00 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff518dc3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff51415bf20 con 0x7ff5140b0020 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff518dc3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff51415c200 con 0x7ff51406c4c0 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff51259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5140b0020 0x7ff51415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff511d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff51415ca00 0x7ff51406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54206/0 (socket says 172.21.15.6:54206) 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff511d9b640 1 -- 172.21.15.6:0/2238252473 learned_addr learned my addr 172.21.15.6:0/2238252473 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff512d9d640 1 --2- 172.21.15.6:0/2238252473 >> v2:172.21.15.171:3300/0 conn(0x7ff51406c4c0 0x7ff5140b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff51259c640 1 -- 172.21.15.6:0/2238252473 >> v2:172.21.15.171:3300/0 conn(0x7ff51406c4c0 msgr2=0x7ff5140b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff51259c640 1 --2- 172.21.15.6:0/2238252473 >> v2:172.21.15.171:3300/0 conn(0x7ff51406c4c0 0x7ff5140b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff51259c640 1 -- 172.21.15.6:0/2238252473 >> v1:172.21.15.6:6789/0 conn(0x7ff51415ca00 legacy=0x7ff51406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.223+0000 7ff51259c640 1 -- 172.21.15.6:0/2238252473 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51415c4e0 con 0x7ff5140b0020 2024-05-20T18:00:23.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.224+0000 7ff51259c640 1 --2- 172.21.15.6:0/2238252473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5140b0020 0x7ff51415fd80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff5140723a0 tx=0x7ff50402b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b901d22e691757e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:23.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.224+0000 7ff51159a640 1 -- 172.21.15.6:0/2238252473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50400b040 con 0x7ff5140b0020 2024-05-20T18:00:23.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.224+0000 7ff51159a640 1 -- 172.21.15.6:0/2238252473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff504030710 con 0x7ff5140b0020 2024-05-20T18:00:23.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.224+0000 7ff51159a640 1 -- 172.21.15.6:0/2238252473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504030ae0 con 0x7ff5140b0020 2024-05-20T18:00:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.225+0000 7ff518dc3640 1 -- 172.21.15.6:0/2238252473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5140b0020 msgr2=0x7ff51415fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.225+0000 7ff518dc3640 1 --2- 172.21.15.6:0/2238252473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5140b0020 0x7ff51415fd80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff5140723a0 tx=0x7ff50402b4d0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.225+0000 7ff518dc3640 1 -- 172.21.15.6:0/2238252473 shutdown_connections 2024-05-20T18:00:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.225+0000 7ff518dc3640 1 --2- 172.21.15.6:0/2238252473 >> v2:172.21.15.171:3300/0 conn(0x7ff51406c4c0 0x7ff5140b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.225+0000 7ff518dc3640 1 --2- 172.21.15.6:0/2238252473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5140b0020 0x7ff51415fd80 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.225+0000 7ff518dc3640 1 -- 172.21.15.6:0/2238252473 >> 172.21.15.6:0/2238252473 conn(0x7ff5140cd2a0 msgr2=0x7ff5140cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.225+0000 7ff518dc3640 1 -- 172.21.15.6:0/2238252473 shutdown_connections 2024-05-20T18:00:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.225+0000 7ff518dc3640 1 -- 172.21.15.6:0/2238252473 wait complete. 2024-05-20T18:00:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.227+0000 7ff518dc3640 1 Processor -- start 2024-05-20T18:00:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.227+0000 7ff518dc3640 1 -- start start 2024-05-20T18:00:23.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff518dc3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140b0020 0x7ff5140ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:23.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff518dc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415ca00 0x7ff51409d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff518dc3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51414ff20 0x7ff51409d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff518dc3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5140b4c00 con 0x7ff51415ca00 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff518dc3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5140b54a0 con 0x7ff51414ff20 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff518dc3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5140b4d80 con 0x7ff5140b0020 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff511d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415ca00 0x7ff51409d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff511d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415ca00 0x7ff51409d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50226/0 (socket says 172.21.15.6:50226) 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.228+0000 7ff511d9b640 1 -- 172.21.15.6:0/1081868475 learned_addr learned my addr 172.21.15.6:0/1081868475 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff51259c640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140b0020 0x7ff5140ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff512d9d640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51414ff20 0x7ff51409d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff511d9b640 1 -- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140b0020 msgr2=0x7ff5140ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff511d9b640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140b0020 0x7ff5140ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff511d9b640 1 -- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51414ff20 msgr2=0x7ff51409d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff511d9b640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51414ff20 0x7ff51409d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff511d9b640 1 -- 172.21.15.6:0/1081868475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51409c890 con 0x7ff51415ca00 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff51259c640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140b0020 0x7ff5140ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff511d9b640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415ca00 0x7ff51409d050 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff50800c3f0 tx=0x7ff50800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff502ffd640 1 -- 172.21.15.6:0/1081868475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508017070 con 0x7ff51415ca00 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff502ffd640 1 -- 172.21.15.6:0/1081868475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff508005ce0 con 0x7ff51415ca00 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51409b870 con 0x7ff51415ca00 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff502ffd640 1 -- 172.21.15.6:0/1081868475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5080072f0 con 0x7ff51415ca00 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.229+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51409be30 con 0x7ff51415ca00 2024-05-20T18:00:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.230+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff514075b00 con 0x7ff51415ca00 2024-05-20T18:00:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.231+0000 7ff502ffd640 1 -- 172.21.15.6:0/1081868475 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff50801a070 con 0x7ff51415ca00 2024-05-20T18:00:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.232+0000 7ff502ffd640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4f406be60 0x7ff4f406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.232+0000 7ff502ffd640 1 -- 172.21.15.6:0/1081868475 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7ff50808a330 con 0x7ff51415ca00 2024-05-20T18:00:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.232+0000 7ff51259c640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4f406be60 0x7ff4f406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.232+0000 7ff51259c640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4f406be60 0x7ff4f406e370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff504035000 tx=0x7ff504030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:23.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.236+0000 7ff502ffd640 1 -- 172.21.15.6:0/1081868475 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff508058b60 con 0x7ff51415ca00 2024-05-20T18:00:23.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.457+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff51409b600 con 0x7ff51415ca00 2024-05-20T18:00:23.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.458+0000 7ff502ffd640 1 -- 172.21.15.6:0/1081868475 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7ff508058460 con 0x7ff51415ca00 2024-05-20T18:00:23.455 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:00:23.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4f406be60 msgr2=0x7ff4f406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:23.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4f406be60 0x7ff4f406e370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff504035000 tx=0x7ff504030000 comp rx=0 tx=0).stop 2024-05-20T18:00:23.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415ca00 msgr2=0x7ff51409d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:23.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415ca00 0x7ff51409d050 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff50800c3f0 tx=0x7ff50800c8b0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 shutdown_connections 2024-05-20T18:00:23.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff4f406be60 0x7ff4f406e370 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff51414ff20 0x7ff51409d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff51415ca00 0x7ff51409d050 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 --2- 172.21.15.6:0/1081868475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5140b0020 0x7ff5140ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:23.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 >> 172.21.15.6:0/1081868475 conn(0x7ff5140cd2a0 msgr2=0x7ff51406f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:23.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 shutdown_connections 2024-05-20T18:00:23.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:23.460+0000 7ff518dc3640 1 -- 172.21.15.6:0/1081868475 wait complete. 2024-05-20T18:00:23.468 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:00:23.468 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:00:23.468 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T18:00:23.469 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T18:00:23.469 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:23.469 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:00:23.469 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:00:23.469 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:00:23.469 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:00:23.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:23.469 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T18:00:23.489 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:00:23.489 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:23.490 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42301sec preferred_lft 42301sec 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:23.491 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:23.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:23.492 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:00:23.558 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T18:00:23.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:23.560 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T18:00:23.619 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T18:00:23.619 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:00:23.619 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T18:00:23.619 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T18:00:23.619 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:00:23.619 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:00:23.619 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T18:00:23.619 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T18:00:23.620 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T18:00:23.620 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T18:00:23.620 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T18:00:23.712 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:00:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:00:23.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:00:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:23.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:23.753 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T18:00:23.768 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T18:00:23.769 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T18:00:23.769 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:00:23.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:23.769 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T18:00:23.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:00:23.835 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:23.891 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:00:23.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:00:23.891 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:23.946 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T18:00:23.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:23.946 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:24.040 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:24.041 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:00:24.050 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:00:24.051 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:00:24.052 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:00:24.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:24.053 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:24.077 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:00:24.167 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:00:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:00:24.169 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:00:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:24.175 INFO:teuthology.orchestra.run.smithi171.stdout:client7234 2024-05-20T18:00:24.175 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:24.175 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:24.191 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:00:24.191 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:00:24.234 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:00:24.275 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:00:24.275 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:00:24.275 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:24.275 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:24.293 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:24.293 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:24.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.515+0000 7fbfc8d8f640 1 Processor -- start 2024-05-20T18:00:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.515+0000 7fbfc8d8f640 1 -- start start 2024-05-20T18:00:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.516+0000 7fbfc8d8f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfc40cd680 0x7fbfc415f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc8d8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc406c6c0 0x7fbfc406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc8d8f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc406d0f0 con 0x7fbfc40cf3d0 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc8d8f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc40cda90 con 0x7fbfc40cd680 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc8d8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc415f760 con 0x7fbfc406c6c0 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbfc40cd680 0x7fbfc415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc2d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbfc40cf3d0 0x7fbfc40cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54214/0 (socket says 172.21.15.6:54214) 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc2d9d640 1 -- 172.21.15.6:0/3493788520 learned_addr learned my addr 172.21.15.6:0/3493788520 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc1d9b640 1 --2- 172.21.15.6:0/3493788520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc406c6c0 0x7fbfc406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc259c640 1 -- 172.21.15.6:0/3493788520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc406c6c0 msgr2=0x7fbfc406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc259c640 1 --2- 172.21.15.6:0/3493788520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc406c6c0 0x7fbfc406cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc259c640 1 -- 172.21.15.6:0/3493788520 >> v1:172.21.15.6:6789/0 conn(0x7fbfc40cf3d0 legacy=0x7fbfc40cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.517+0000 7fbfc259c640 1 -- 172.21.15.6:0/3493788520 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc406d3d0 con 0x7fbfc40cd680 2024-05-20T18:00:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.518+0000 7fbfc259c640 1 --2- 172.21.15.6:0/3493788520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc40cd680 0x7fbfc415f220 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40097a0 tx=0x7fbfb402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c203b7a47c0f9a8d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.518+0000 7fbfc159a640 1 -- 172.21.15.6:0/3493788520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4037070 con 0x7fbfc40cd680 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.518+0000 7fbfc159a640 1 -- 172.21.15.6:0/3493788520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb402ae50 con 0x7fbfc40cd680 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.518+0000 7fbfc159a640 1 -- 172.21.15.6:0/3493788520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4032660 con 0x7fbfc40cd680 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.519+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/3493788520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc40cd680 msgr2=0x7fbfc415f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.519+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/3493788520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc40cd680 0x7fbfc415f220 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40097a0 tx=0x7fbfb402a100 comp rx=0 tx=0).stop 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.519+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/3493788520 shutdown_connections 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.519+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/3493788520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc406c6c0 0x7fbfc406cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.519+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/3493788520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc40cd680 0x7fbfc415f220 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.519+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/3493788520 >> 172.21.15.6:0/3493788520 conn(0x7fbfc40b44d0 msgr2=0x7fbfc40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.519+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/3493788520 shutdown_connections 2024-05-20T18:00:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.519+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/3493788520 wait complete. 2024-05-20T18:00:24.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.521+0000 7fbfc8d8f640 1 Processor -- start 2024-05-20T18:00:24.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.521+0000 7fbfc8d8f640 1 -- start start 2024-05-20T18:00:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc8d8f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc406c6c0 0x7fbfc4151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc8d8f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc40cd680 0x7fbfc40b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc8d8f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfc40cf3d0 0x7fbfc40c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc8d8f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc406d990 con 0x7fbfc406c6c0 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc8d8f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc40d0b40 con 0x7fbfc40cf3d0 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc8d8f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc40d2460 con 0x7fbfc40cd680 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc406c6c0 0x7fbfc4151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc406c6c0 0x7fbfc4151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50246/0 (socket says 172.21.15.6:50246) 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc259c640 1 -- 172.21.15.6:0/2820691872 learned_addr learned my addr 172.21.15.6:0/2820691872 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc1d9b640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc40cd680 0x7fbfc40b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.522+0000 7fbfc2d9d640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfc40cf3d0 0x7fbfc40c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfc259c640 1 -- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc40cd680 msgr2=0x7fbfc40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfc259c640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc40cd680 0x7fbfc40b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfc259c640 1 -- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfc40cf3d0 msgr2=0x7fbfc40c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfc259c640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfc40cf3d0 0x7fbfc40c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfc259c640 1 -- 172.21.15.6:0/2820691872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc41521d0 con 0x7fbfc406c6c0 2024-05-20T18:00:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfc259c640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc406c6c0 0x7fbfc4151c90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4035040 tx=0x7fbfb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfb2ffd640 1 -- 172.21.15.6:0/2820691872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4041020 con 0x7fbfc406c6c0 2024-05-20T18:00:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfb2ffd640 1 -- 172.21.15.6:0/2820691872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb403c670 con 0x7fbfc406c6c0 2024-05-20T18:00:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc40b69a0 con 0x7fbfc406c6c0 2024-05-20T18:00:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfb2ffd640 1 -- 172.21.15.6:0/2820691872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4037040 con 0x7fbfc406c6c0 2024-05-20T18:00:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.523+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc40b6f60 con 0x7fbfc406c6c0 2024-05-20T18:00:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.524+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc4075b00 con 0x7fbfc406c6c0 2024-05-20T18:00:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.525+0000 7fbfb2ffd640 1 -- 172.21.15.6:0/2820691872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfb4044020 con 0x7fbfc406c6c0 2024-05-20T18:00:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.525+0000 7fbfb2ffd640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfa406be30 0x7fbfa406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.525+0000 7fbfb2ffd640 1 -- 172.21.15.6:0/2820691872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fbfb40ab660 con 0x7fbfc406c6c0 2024-05-20T18:00:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.526+0000 7fbfc1d9b640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfa406be30 0x7fbfa406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.526+0000 7fbfc1d9b640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfa406be30 0x7fbfa406e340 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbfc415bb50 tx=0x7fbfb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.530+0000 7fbfb2ffd640 1 -- 172.21.15.6:0/2820691872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbfb404b030 con 0x7fbfc406c6c0 2024-05-20T18:00:24.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.714+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfc40b8940 con 0x7fbfc406c6c0 2024-05-20T18:00:24.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.715+0000 7fbfb2ffd640 1 -- 172.21.15.6:0/2820691872 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16828 (secure 0 0 0) 0x7fbfb40a9e20 con 0x7fbfc406c6c0 2024-05-20T18:00:24.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:24.713 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":101,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:17.119205+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:13.843929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:14.484733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:24.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfa406be30 msgr2=0x7fbfa406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfa406be30 0x7fbfa406e340 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbfc415bb50 tx=0x7fbfb8008040 comp rx=0 tx=0).stop 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc406c6c0 msgr2=0x7fbfc4151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc406c6c0 0x7fbfc4151c90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4035040 tx=0x7fbfb40046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 shutdown_connections 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbfa406be30 0x7fbfa406e340 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfc40cf3d0 0x7fbfc40c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbfc40cd680 0x7fbfc40b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 --2- 172.21.15.6:0/2820691872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfc406c6c0 0x7fbfc4151c90 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 >> 172.21.15.6:0/2820691872 conn(0x7fbfc40b44d0 msgr2=0x7fbfc40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 shutdown_connections 2024-05-20T18:00:24.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.717+0000 7fbfc8d8f640 1 -- 172.21.15.6:0/2820691872 wait complete. 2024-05-20T18:00:24.726 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:00:13.843929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:00:14.484733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:00:24.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:00:24.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.846+0000 7f0b42b6b640 1 Processor -- start 2024-05-20T18:00:24.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.846+0000 7f0b42b6b640 1 -- start start 2024-05-20T18:00:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.847+0000 7f0b42b6b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b3c163a10 0x7f0b3c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.847+0000 7f0b42b6b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 0x7f0b3c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.847+0000 7f0b42b6b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b3c0d0370 con 0x7f0b3c0d14b0 2024-05-20T18:00:24.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.847+0000 7f0b42b6b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0b3c0d3ca0 con 0x7f0b3c163a10 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.847+0000 7f0b42b6b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3c0d0650 con 0x7f0b3c0b4010 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.848+0000 7f0b40907640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b3c163a10 0x7f0b3c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.848+0000 7f0b40907640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b3c163a10 0x7f0b3c0d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50258/0 (socket says 172.21.15.6:50258) 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.848+0000 7f0b40907640 1 -- 172.21.15.6:0/1063446569 learned_addr learned my addr 172.21.15.6:0/1063446569 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.848+0000 7f0b33fff640 1 --2- 172.21.15.6:0/1063446569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 0x7f0b3c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.848+0000 7f0b40907640 1 -- 172.21.15.6:0/1063446569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 msgr2=0x7f0b3c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.848+0000 7f0b40907640 1 --2- 172.21.15.6:0/1063446569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 0x7f0b3c0cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.848+0000 7f0b40907640 1 -- 172.21.15.6:0/1063446569 >> v1:172.21.15.171:6789/0 conn(0x7f0b3c0d14b0 legacy=0x7f0b3c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:24.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.848+0000 7f0b40907640 1 -- 172.21.15.6:0/1063446569 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c0d3650 con 0x7f0b3c163a10 2024-05-20T18:00:24.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.849+0000 7f0b40907640 1 --2- 172.21.15.6:0/1063446569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c0d4130 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009e50 tx=0x7f0b3802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2480f55c8b95fe server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:24.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.849+0000 7f0b337fe640 1 -- 172.21.15.6:0/1063446569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38036070 con 0x7f0b3c163a10 2024-05-20T18:00:24.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.849+0000 7f0b337fe640 1 -- 172.21.15.6:0/1063446569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b38031600 con 0x7f0b3c163a10 2024-05-20T18:00:24.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.849+0000 7f0b337fe640 1 -- 172.21.15.6:0/1063446569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b380319d0 con 0x7f0b3c163a10 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.849+0000 7f0b42b6b640 1 -- 172.21.15.6:0/1063446569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 msgr2=0x7f0b3c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.849+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/1063446569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c0d4130 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009e50 tx=0x7f0b3802a6c0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.850+0000 7f0b42b6b640 1 -- 172.21.15.6:0/1063446569 shutdown_connections 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.850+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/1063446569 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 0x7f0b3c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.850+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/1063446569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c0d4130 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.850+0000 7f0b42b6b640 1 -- 172.21.15.6:0/1063446569 >> 172.21.15.6:0/1063446569 conn(0x7f0b3c06d240 msgr2=0x7f0b3c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.850+0000 7f0b42b6b640 1 -- 172.21.15.6:0/1063446569 shutdown_connections 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.850+0000 7f0b42b6b640 1 -- 172.21.15.6:0/1063446569 wait complete. 2024-05-20T18:00:24.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.851+0000 7f0b42b6b640 1 Processor -- start 2024-05-20T18:00:24.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.851+0000 7f0b42b6b640 1 -- start start 2024-05-20T18:00:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b42b6b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 0x7f0b3c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b42b6b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b3c0d14b0 0x7f0b3c1f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b42b6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c1f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b42b6b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c0b8210 con 0x7f0b3c163a10 2024-05-20T18:00:24.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b42b6b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c0d0040 con 0x7f0b3c0d14b0 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b42b6b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3c0b8390 con 0x7f0b3c0b4010 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c1f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c1f9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50272/0 (socket says 172.21.15.6:50272) 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 -- 172.21.15.6:0/2647355308 learned_addr learned my addr 172.21.15.6:0/2647355308 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b40907640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 0x7f0b3c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b33fff640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b3c0d14b0 0x7f0b3c1f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 -- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 msgr2=0x7f0b3c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 0x7f0b3c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 -- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b3c0d14b0 msgr2=0x7f0b3c1f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b3c0d14b0 0x7f0b3c1f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 -- 172.21.15.6:0/2647355308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c1e9f50 con 0x7f0b3c163a10 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.853+0000 7f0b41108640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c1f9230 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400b390 tx=0x7f0b3400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.854+0000 7f0b317fa640 1 -- 172.21.15.6:0/2647355308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34015020 con 0x7f0b3c163a10 2024-05-20T18:00:24.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.854+0000 7f0b317fa640 1 -- 172.21.15.6:0/2647355308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b34011850 con 0x7f0b3c163a10 2024-05-20T18:00:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.854+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c1ea230 con 0x7f0b3c163a10 2024-05-20T18:00:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.854+0000 7f0b317fa640 1 -- 172.21.15.6:0/2647355308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34011c40 con 0x7f0b3c163a10 2024-05-20T18:00:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.854+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c161700 con 0x7f0b3c163a10 2024-05-20T18:00:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.855+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3c075b00 con 0x7f0b3c163a10 2024-05-20T18:00:24.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.855+0000 7f0b317fa640 1 -- 172.21.15.6:0/2647355308 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b34018020 con 0x7f0b3c163a10 2024-05-20T18:00:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.856+0000 7f0b317fa640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0b2806be30 0x7f0b2806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.856+0000 7f0b317fa640 1 -- 172.21.15.6:0/2647355308 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f0b3408ae70 con 0x7f0b3c163a10 2024-05-20T18:00:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.856+0000 7f0b40907640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0b2806be30 0x7f0b2806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:24.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.857+0000 7f0b40907640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0b2806be30 0x7f0b2806e340 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0b38033000 tx=0x7f0b38009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:24.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:24.861+0000 7f0b317fa640 1 -- 172.21.15.6:0/2647355308 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0b3401f020 con 0x7f0b3c163a10 2024-05-20T18:00:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.044+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0b3c0d3050 con 0x7f0b3c163a10 2024-05-20T18:00:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.044+0000 7f0b317fa640 1 -- 172.21.15.6:0/2647355308 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) ==== 93+0+10 (secure 0 0 0) 0x7f0b340172c0 con 0x7f0b3c163a10 2024-05-20T18:00:25.041 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:00:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0b2806be30 msgr2=0x7f0b2806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0b2806be30 0x7f0b2806e340 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0b38033000 tx=0x7f0b38009000 comp rx=0 tx=0).stop 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 msgr2=0x7f0b3c1f9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c1f9230 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400b390 tx=0x7f0b3400b850 comp rx=0 tx=0).stop 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 shutdown_connections 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0b2806be30 0x7f0b2806e340 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b3c163a10 0x7f0b3c1f9230 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b3c0d14b0 0x7f0b3c1f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 --2- 172.21.15.6:0/2647355308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b3c0b4010 0x7f0b3c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 >> 172.21.15.6:0/2647355308 conn(0x7f0b3c06d240 msgr2=0x7f0b3c0b6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 shutdown_connections 2024-05-20T18:00:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.046+0000 7f0b42b6b640 1 -- 172.21.15.6:0/2647355308 wait complete. 2024-05-20T18:00:25.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:00:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.175+0000 7fb38d821640 1 Processor -- start 2024-05-20T18:00:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.175+0000 7fb38d821640 1 -- start start 2024-05-20T18:00:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.176+0000 7fb38d821640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb388163a10 0x7fb3880d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.176+0000 7fb38d821640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb3880d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.176+0000 7fb38d821640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3880d0370 con 0x7fb3880b4010 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb38d821640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb3880d3ca0 con 0x7fb388163a10 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb38d821640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3880d0650 con 0x7fb3880d14b0 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb386ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb388163a10 0x7fb3880d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb386ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb388163a10 0x7fb3880d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50284/0 (socket says 172.21.15.6:50284) 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb386ffd640 1 -- 172.21.15.6:0/3466076610 learned_addr learned my addr 172.21.15.6:0/3466076610 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb3877fe640 1 --2- 172.21.15.6:0/3466076610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb3880d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb386ffd640 1 -- 172.21.15.6:0/3466076610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 msgr2=0x7fb3880d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb386ffd640 1 --2- 172.21.15.6:0/3466076610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb3880d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb386ffd640 1 -- 172.21.15.6:0/3466076610 >> v1:172.21.15.171:6789/0 conn(0x7fb3880b4010 legacy=0x7fb3880cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb386ffd640 1 -- 172.21.15.6:0/3466076610 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3880d3650 con 0x7fb388163a10 2024-05-20T18:00:25.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.177+0000 7fb3877fe640 1 --2- 172.21.15.6:0/3466076610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb3880d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.178+0000 7fb386ffd640 1 --2- 172.21.15.6:0/3466076610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3880d4130 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fb378009870 tx=0x7fb37802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c9fa4291741067 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.178+0000 7fb385ffb640 1 -- 172.21.15.6:0/3466076610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378037070 con 0x7fb388163a10 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.178+0000 7fb385ffb640 1 -- 172.21.15.6:0/3466076610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb378032440 con 0x7fb388163a10 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.178+0000 7fb385ffb640 1 -- 172.21.15.6:0/3466076610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378032810 con 0x7fb388163a10 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.179+0000 7fb38d821640 1 -- 172.21.15.6:0/3466076610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 msgr2=0x7fb3880d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.179+0000 7fb38d821640 1 --2- 172.21.15.6:0/3466076610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3880d4130 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fb378009870 tx=0x7fb37802a210 comp rx=0 tx=0).stop 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.179+0000 7fb38d821640 1 -- 172.21.15.6:0/3466076610 shutdown_connections 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.179+0000 7fb38d821640 1 --2- 172.21.15.6:0/3466076610 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb3880d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.179+0000 7fb38d821640 1 --2- 172.21.15.6:0/3466076610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3880d4130 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.179+0000 7fb38d821640 1 -- 172.21.15.6:0/3466076610 >> 172.21.15.6:0/3466076610 conn(0x7fb38806d240 msgr2=0x7fb38806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.179+0000 7fb38d821640 1 -- 172.21.15.6:0/3466076610 shutdown_connections 2024-05-20T18:00:25.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.179+0000 7fb38d821640 1 -- 172.21.15.6:0/3466076610 wait complete. 2024-05-20T18:00:25.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.181+0000 7fb38d821640 1 Processor -- start 2024-05-20T18:00:25.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.181+0000 7fb38d821640 1 -- start start 2024-05-20T18:00:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb38d821640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3880b4010 0x7fb388156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb38d821640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb388161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb38d821640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3881f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb38d821640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb3880b8210 con 0x7fb388163a10 2024-05-20T18:00:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb38d821640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb3880d1e00 con 0x7fb3880b4010 2024-05-20T18:00:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb38d821640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3880b8390 con 0x7fb3880d14b0 2024-05-20T18:00:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb3877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3881f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb3877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3881f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50294/0 (socket says 172.21.15.6:50294) 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb3877fe640 1 -- 172.21.15.6:0/2925906264 learned_addr learned my addr 172.21.15.6:0/2925906264 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb386ffd640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3880b4010 0x7fb388156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.182+0000 7fb3867fc640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb388161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.183+0000 7fb3877fe640 1 -- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 msgr2=0x7fb388161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.183+0000 7fb3877fe640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb388161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.183+0000 7fb3877fe640 1 -- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3880b4010 msgr2=0x7fb388156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.183+0000 7fb3877fe640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3880b4010 0x7fb388156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.183+0000 7fb3877fe640 1 -- 172.21.15.6:0/2925906264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3881f61d0 con 0x7fb388163a10 2024-05-20T18:00:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.183+0000 7fb3877fe640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3881f5450 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb38000cd80 tx=0x7fb38000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.185+0000 7fb36ffff640 1 -- 172.21.15.6:0/2925906264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38000f680 con 0x7fb388163a10 2024-05-20T18:00:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.185+0000 7fb36ffff640 1 -- 172.21.15.6:0/2925906264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb38000f840 con 0x7fb388163a10 2024-05-20T18:00:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.185+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb388155f40 con 0x7fb388163a10 2024-05-20T18:00:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.185+0000 7fb36ffff640 1 -- 172.21.15.6:0/2925906264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38000fc30 con 0x7fb388163a10 2024-05-20T18:00:25.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.185+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb388160420 con 0x7fb388163a10 2024-05-20T18:00:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.186+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb388160680 con 0x7fb388163a10 2024-05-20T18:00:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.187+0000 7fb36ffff640 1 -- 172.21.15.6:0/2925906264 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3800213f0 con 0x7fb388163a10 2024-05-20T18:00:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.187+0000 7fb36ffff640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb37406be30 0x7fb37406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.187+0000 7fb36ffff640 1 -- 172.21.15.6:0/2925906264 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fb38008bd70 con 0x7fb388163a10 2024-05-20T18:00:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.187+0000 7fb386ffd640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb37406be30 0x7fb37406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.188+0000 7fb386ffd640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb37406be30 0x7fb37406e340 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb378034000 tx=0x7fb37802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.192+0000 7fb36ffff640 1 -- 172.21.15.6:0/2925906264 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb380014030 con 0x7fb388163a10 2024-05-20T18:00:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.374+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb388075b00 con 0x7fb388163a10 2024-05-20T18:00:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.374+0000 7fb36ffff640 1 -- 172.21.15.6:0/2925906264 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) ==== 104+0+11 (secure 0 0 0) 0x7fb380059e10 con 0x7fb388163a10 2024-05-20T18:00:25.372 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb37406be30 msgr2=0x7fb37406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb37406be30 0x7fb37406e340 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb378034000 tx=0x7fb37802e000 comp rx=0 tx=0).stop 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 msgr2=0x7fb3881f5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3881f5450 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb38000cd80 tx=0x7fb38000a650 comp rx=0 tx=0).stop 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 shutdown_connections 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb37406be30 0x7fb37406e340 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb388163a10 0x7fb3881f5450 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3880d14b0 0x7fb388161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 --2- 172.21.15.6:0/2925906264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3880b4010 0x7fb388156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 >> 172.21.15.6:0/2925906264 conn(0x7fb38806d240 msgr2=0x7fb38815b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 shutdown_connections 2024-05-20T18:00:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.376+0000 7fb38d821640 1 -- 172.21.15.6:0/2925906264 wait complete. 2024-05-20T18:00:25.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:00:25.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.505+0000 7f32266ca640 1 Processor -- start 2024-05-20T18:00:25.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.505+0000 7f32266ca640 1 -- start start 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f32266ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f322015f220 0x7f32200d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f32266ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200cfae0 0x7f32200ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f32266ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32200cda20 con 0x7f32200d0e00 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f32266ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f32200cdd00 con 0x7f322015f220 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f32266ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32200cdfe0 con 0x7f32200cfae0 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f32200d0e00 0x7f32200cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54226/0 (socket says 172.21.15.6:54226) 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321f7fe640 1 -- 172.21.15.6:0/2378433505 learned_addr learned my addr 172.21.15.6:0/2378433505 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321ffff640 1 --2- 172.21.15.6:0/2378433505 >> v2:172.21.15.171:3300/0 conn(0x7f322015f220 0x7f32200d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f3224c67640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200cfae0 0x7f32200ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247847588 0 0) 0x7f32200cda20 con 0x7f32200d0e00 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3208003520 con 0x7f32200d0e00 2024-05-20T18:00:25.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 694576943 0 0) 0x7f3208003520 con 0x7f32200d0e00 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200cfae0 msgr2=0x7f32200ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200cfae0 0x7f32200ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 >> v2:172.21.15.171:3300/0 conn(0x7f322015f220 msgr2=0x7f32200d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 --2- 172.21.15.6:0/2378433505 >> v2:172.21.15.171:3300/0 conn(0x7f322015f220 0x7f32200d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32200ce2c0 con 0x7f32200d0e00 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f3214001670 con 0x7f32200d0e00 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321ffff640 1 --2- 172.21.15.6:0/2378433505 >> v2:172.21.15.171:3300/0 conn(0x7f322015f220 0x7f32200d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.507+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 >> v1:172.21.15.6:6789/0 conn(0x7f32200d0e00 legacy=0x7f32200cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f321effd640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32080039b0 0x7f3208003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f321effd640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3208004800 0x7f3208004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f321effd640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208005150 0x7f320800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f32200cdd00 con 0x7f3208005150 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32200cdfe0 con 0x7f32080039b0 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f320800bf00 con 0x7f3208004800 2024-05-20T18:00:25.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f3224c67640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208005150 0x7f320800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f321ffff640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32080039b0 0x7f3208003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f321f7fe640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3208004800 0x7f3208004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f3224c67640 1 -- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3208004800 msgr2=0x7f3208004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f3224c67640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3208004800 0x7f3208004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f3224c67640 1 -- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32080039b0 msgr2=0x7f3208003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f3224c67640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32080039b0 0x7f3208003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.508+0000 7f3224c67640 1 -- 172.21.15.6:0/2378433505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3208003520 con 0x7f3208005150 2024-05-20T18:00:25.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.509+0000 7f3224c67640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208005150 0x7f320800b9c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f3218009fc0 tx=0x7f3208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d8ade7c5a2645d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.509+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3218034020 con 0x7f3208005150 2024-05-20T18:00:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.509+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32180305f0 con 0x7f3208005150 2024-05-20T18:00:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.509+0000 7f321effd640 1 -- 172.21.15.6:0/2378433505 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3218009c10 con 0x7f3208005150 2024-05-20T18:00:25.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.510+0000 7f32266ca640 1 -- 172.21.15.6:0/2378433505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208005150 msgr2=0x7f320800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.510+0000 7f32266ca640 1 --2- 172.21.15.6:0/2378433505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208005150 0x7f320800b9c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f3218009fc0 tx=0x7f3208005830 comp rx=0 tx=0).stop 2024-05-20T18:00:25.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.510+0000 7f3224c67640 1 -- 172.21.15.6:0/2378433505 reap_dead start 2024-05-20T18:00:25.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.510+0000 7f32266ca640 1 -- 172.21.15.6:0/2378433505 shutdown_connections 2024-05-20T18:00:25.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.510+0000 7f32266ca640 1 -- 172.21.15.6:0/2378433505 >> 172.21.15.6:0/2378433505 conn(0x7f32200b44d0 msgr2=0x7f32200b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:25.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.510+0000 7f32266ca640 1 -- 172.21.15.6:0/2378433505 shutdown_connections 2024-05-20T18:00:25.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.510+0000 7f32266ca640 1 -- 172.21.15.6:0/2378433505 wait complete. 2024-05-20T18:00:25.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.511+0000 7f32266ca640 1 Processor -- start 2024-05-20T18:00:25.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.512+0000 7f32266ca640 1 -- start start 2024-05-20T18:00:25.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f32266ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3208005150 0x7f3220150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f32266ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32200b6e10 0x7f32200c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f32266ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200c6aa0 0x7f32200c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f32266ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f322015f7b0 con 0x7f32200b6e10 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f32266ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f322015f630 con 0x7f3208005150 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f32266ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32200cfae0 con 0x7f32200c6aa0 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f321f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32200b6e10 0x7f32200c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f321f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32200b6e10 0x7f32200c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50306/0 (socket says 172.21.15.6:50306) 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f321f7fe640 1 -- 172.21.15.6:0/3287598487 learned_addr learned my addr 172.21.15.6:0/3287598487 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f3224c67640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200c6aa0 0x7f32200c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f321ffff640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3208005150 0x7f3220150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f321f7fe640 1 -- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200c6aa0 msgr2=0x7f32200c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.513+0000 7f321f7fe640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200c6aa0 0x7f32200c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f321f7fe640 1 -- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3208005150 msgr2=0x7f3220150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f321f7fe640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3208005150 0x7f3220150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f321f7fe640 1 -- 172.21.15.6:0/3287598487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32200c73f0 con 0x7f32200b6e10 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f321f7fe640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32200b6e10 0x7f32200c6560 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3214007370 tx=0x7f3214007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f321cff9640 1 -- 172.21.15.6:0/3287598487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321400f960 con 0x7f32200b6e10 2024-05-20T18:00:25.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f321cff9640 1 -- 172.21.15.6:0/3287598487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3214018070 con 0x7f32200b6e10 2024-05-20T18:00:25.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32200b78d0 con 0x7f32200b6e10 2024-05-20T18:00:25.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f321cff9640 1 -- 172.21.15.6:0/3287598487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321400fd80 con 0x7f32200b6e10 2024-05-20T18:00:25.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.514+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32200b7e90 con 0x7f32200b6e10 2024-05-20T18:00:25.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.515+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3220075b00 con 0x7f32200b6e10 2024-05-20T18:00:25.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.516+0000 7f321cff9640 1 -- 172.21.15.6:0/3287598487 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f321401d460 con 0x7f32200b6e10 2024-05-20T18:00:25.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.516+0000 7f321cff9640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320c06be30 0x7f320c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.516+0000 7f321cff9640 1 -- 172.21.15.6:0/3287598487 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f321408afd0 con 0x7f32200b6e10 2024-05-20T18:00:25.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.516+0000 7f321ffff640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320c06be30 0x7f320c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.517+0000 7f321ffff640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320c06be30 0x7f320c06e340 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f32100093d0 tx=0x7f3210009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.521+0000 7f321cff9640 1 -- 172.21.15.6:0/3287598487 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f32140591a0 con 0x7f32200b6e10 2024-05-20T18:00:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.702+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3220162c60 con 0x7f32200b6e10 2024-05-20T18:00:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.703+0000 7f321cff9640 1 -- 172.21.15.6:0/3287598487 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) ==== 100+0+11 (secure 0 0 0) 0x7f321405d4a0 con 0x7f32200b6e10 2024-05-20T18:00:25.700 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:00:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320c06be30 msgr2=0x7f320c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320c06be30 0x7f320c06e340 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f32100093d0 tx=0x7f3210009190 comp rx=0 tx=0).stop 2024-05-20T18:00:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32200b6e10 msgr2=0x7f32200c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32200b6e10 0x7f32200c6560 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3214007370 tx=0x7f3214007830 comp rx=0 tx=0).stop 2024-05-20T18:00:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 shutdown_connections 2024-05-20T18:00:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320c06be30 0x7f320c06e340 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32200c6aa0 0x7f32200c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32200b6e10 0x7f32200c6560 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 --2- 172.21.15.6:0/3287598487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3208005150 0x7f3220150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 >> 172.21.15.6:0/3287598487 conn(0x7f32200b44d0 msgr2=0x7f32200b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 shutdown_connections 2024-05-20T18:00:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.705+0000 7f32266ca640 1 -- 172.21.15.6:0/3287598487 wait complete. 2024-05-20T18:00:25.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:00:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.832+0000 7fc167651640 1 Processor -- start 2024-05-20T18:00:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.832+0000 7fc167651640 1 -- start start 2024-05-20T18:00:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.833+0000 7fc167651640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc1600d4400 0x7fc16015f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.833+0000 7fc167651640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc16006cf00 0x7fc16006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.833+0000 7fc167651640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16008d2a0 con 0x7fc1600d2780 2024-05-20T18:00:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.833+0000 7fc167651640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc1600d3f70 con 0x7fc1600d4400 2024-05-20T18:00:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.833+0000 7fc167651640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc16006d850 con 0x7fc16006cf00 2024-05-20T18:00:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.833+0000 7fc165bee640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc1600d2780 0x7fc1600d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54228/0 (socket says 172.21.15.6:54228) 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.833+0000 7fc165bee640 1 -- 172.21.15.6:0/2377874884 learned_addr learned my addr 172.21.15.6:0/2377874884 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.834+0000 7fc164bec640 1 --2- 172.21.15.6:0/2377874884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc16006cf00 0x7fc16006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.834+0000 7fc1653ed640 1 --2- 172.21.15.6:0/2377874884 >> v2:172.21.15.171:3300/0 conn(0x7fc1600d4400 0x7fc16015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.834+0000 7fc15ffff640 1 -- 172.21.15.6:0/2377874884 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166384951 0 0) 0x7fc150001490 con 0x7fc1600d2780 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.834+0000 7fc15ffff640 1 -- 172.21.15.6:0/2377874884 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc148003520 con 0x7fc1600d2780 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.834+0000 7fc1653ed640 1 -- 172.21.15.6:0/2377874884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc16006cf00 msgr2=0x7fc16006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.834+0000 7fc1653ed640 1 --2- 172.21.15.6:0/2377874884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc16006cf00 0x7fc16006d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.834+0000 7fc1653ed640 1 -- 172.21.15.6:0/2377874884 >> v1:172.21.15.6:6789/0 conn(0x7fc1600d2780 legacy=0x7fc1600d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.834+0000 7fc1653ed640 1 -- 172.21.15.6:0/2377874884 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1600d4810 con 0x7fc1600d4400 2024-05-20T18:00:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.835+0000 7fc1653ed640 1 --2- 172.21.15.6:0/2377874884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1600d4400 0x7fc16015f440 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc1580097d0 tx=0x7fc15802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=267ff5449b7f9e17 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.835+0000 7fc15ffff640 1 -- 172.21.15.6:0/2377874884 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158037070 con 0x7fc1600d4400 2024-05-20T18:00:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.835+0000 7fc15ffff640 1 -- 172.21.15.6:0/2377874884 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc158032440 con 0x7fc1600d4400 2024-05-20T18:00:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.835+0000 7fc15ffff640 1 -- 172.21.15.6:0/2377874884 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158032810 con 0x7fc1600d4400 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.836+0000 7fc167651640 1 -- 172.21.15.6:0/2377874884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1600d4400 msgr2=0x7fc16015f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.836+0000 7fc167651640 1 --2- 172.21.15.6:0/2377874884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1600d4400 0x7fc16015f440 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc1580097d0 tx=0x7fc15802a250 comp rx=0 tx=0).stop 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.836+0000 7fc167651640 1 -- 172.21.15.6:0/2377874884 shutdown_connections 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.836+0000 7fc167651640 1 --2- 172.21.15.6:0/2377874884 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc16006cf00 0x7fc16006d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.836+0000 7fc167651640 1 --2- 172.21.15.6:0/2377874884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1600d4400 0x7fc16015f440 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.836+0000 7fc167651640 1 -- 172.21.15.6:0/2377874884 >> 172.21.15.6:0/2377874884 conn(0x7fc1600d4bb0 msgr2=0x7fc1600d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.836+0000 7fc167651640 1 -- 172.21.15.6:0/2377874884 shutdown_connections 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.836+0000 7fc167651640 1 -- 172.21.15.6:0/2377874884 wait complete. 2024-05-20T18:00:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.837+0000 7fc167651640 1 Processor -- start 2024-05-20T18:00:25.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.838+0000 7fc167651640 1 -- start start 2024-05-20T18:00:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc167651640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc16006cf00 0x7fc16015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc167651640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1600d2780 0x7fc1600cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc167651640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1600d4400 0x7fc1601f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc167651640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600d3920 con 0x7fc1600d4400 2024-05-20T18:00:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc167651640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600d3640 con 0x7fc16006cf00 2024-05-20T18:00:25.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc167651640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc1600d3c00 con 0x7fc1600d2780 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc165bee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1600d4400 0x7fc1601f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc165bee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1600d4400 0x7fc1601f5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50316/0 (socket says 172.21.15.6:50316) 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc165bee640 1 -- 172.21.15.6:0/3430564958 learned_addr learned my addr 172.21.15.6:0/3430564958 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc1653ed640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc16006cf00 0x7fc16015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc164bec640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1600d2780 0x7fc1600cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc165bee640 1 -- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1600d2780 msgr2=0x7fc1600cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc165bee640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1600d2780 0x7fc1600cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc165bee640 1 -- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc16006cf00 msgr2=0x7fc16015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc165bee640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc16006cf00 0x7fc16015de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.839+0000 7fc165bee640 1 -- 172.21.15.6:0/3430564958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1600ac560 con 0x7fc1600d4400 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.840+0000 7fc165bee640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1600d4400 0x7fc1601f5780 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fc15000caa0 tx=0x7fc15000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.840+0000 7fc15dffb640 1 -- 172.21.15.6:0/3430564958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150017070 con 0x7fc1600d4400 2024-05-20T18:00:25.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.840+0000 7fc15dffb640 1 -- 172.21.15.6:0/3430564958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15000ac00 con 0x7fc1600d4400 2024-05-20T18:00:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.840+0000 7fc15dffb640 1 -- 172.21.15.6:0/3430564958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150012400 con 0x7fc1600d4400 2024-05-20T18:00:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.840+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1600ac840 con 0x7fc1600d4400 2024-05-20T18:00:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.840+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1600ace00 con 0x7fc1600d4400 2024-05-20T18:00:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.841+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1600735a0 con 0x7fc1600d4400 2024-05-20T18:00:25.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.842+0000 7fc15dffb640 1 -- 172.21.15.6:0/3430564958 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc15001a070 con 0x7fc1600d4400 2024-05-20T18:00:25.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.842+0000 7fc15dffb640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc14c06be30 0x7fc14c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:25.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.842+0000 7fc15dffb640 1 -- 172.21.15.6:0/3430564958 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fc15008ac90 con 0x7fc1600d4400 2024-05-20T18:00:25.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.843+0000 7fc1653ed640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc14c06be30 0x7fc14c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:25.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.843+0000 7fc1653ed640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc14c06be30 0x7fc14c06e340 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc158034000 tx=0x7fc15802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:25.847+0000 7fc15dffb640 1 -- 172.21.15.6:0/3430564958 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc1600735a0 con 0x7fc1600d4400 2024-05-20T18:00:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.041+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc1600ac2f0 con 0x7fc1600d4400 2024-05-20T18:00:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.041+0000 7fc15dffb640 1 -- 172.21.15.6:0/3430564958 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) ==== 80+0+0 (secure 0 0 0) 0x7fc16008d2a0 con 0x7fc1600d4400 2024-05-20T18:00:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc14c06be30 msgr2=0x7fc14c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc14c06be30 0x7fc14c06e340 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc158034000 tx=0x7fc15802e000 comp rx=0 tx=0).stop 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1600d4400 msgr2=0x7fc1601f5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1600d4400 0x7fc1601f5780 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fc15000caa0 tx=0x7fc15000cf60 comp rx=0 tx=0).stop 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 shutdown_connections 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc14c06be30 0x7fc14c06e340 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1600d4400 0x7fc1601f5780 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1600d2780 0x7fc1600cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 --2- 172.21.15.6:0/3430564958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc16006cf00 0x7fc16015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 >> 172.21.15.6:0/3430564958 conn(0x7fc1600d4bb0 msgr2=0x7fc1600b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.043+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 shutdown_connections 2024-05-20T18:00:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.044+0000 7fc167651640 1 -- 172.21.15.6:0/3430564958 wait complete. 2024-05-20T18:00:26.052 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T18:00:26.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:26.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:26.081 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:00:26.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:26.082 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T18:00:26.138 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:00:26.138 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:26.138 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:26.158 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:26.158 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:26.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:26.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.335+0000 7ff2c4cc3640 1 Processor -- start 2024-05-20T18:00:26.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.335+0000 7ff2c4cc3640 1 -- start start 2024-05-20T18:00:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2c4cc3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c0162820 0x7ff2c00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2c4cc3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff2c00b3e80 0x7ff2c006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2c4cc3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c006dd20 con 0x7ff2c006d910 2024-05-20T18:00:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2c4cc3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c00d0630 con 0x7ff2c00b3e80 2024-05-20T18:00:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2c4cc3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c00d39c0 con 0x7ff2c0162820 2024-05-20T18:00:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2bdd9b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff2c00b3e80 0x7ff2c006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2be59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c0162820 0x7ff2c00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2bdd9b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff2c00b3e80 0x7ff2c006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:59710/0 (socket says 172.21.15.6:59710) 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2bdd9b640 1 -- 172.21.15.6:0/970629715 learned_addr learned my addr 172.21.15.6:0/970629715 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2bed9d640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff2c006d910 0x7ff2c00d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:51508/0 (socket says 172.21.15.6:51508) 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2be59c640 1 -- 172.21.15.6:0/970629715 >> v2:172.21.15.171:3300/0 conn(0x7ff2c00b3e80 msgr2=0x7ff2c006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2be59c640 1 --2- 172.21.15.6:0/970629715 >> v2:172.21.15.171:3300/0 conn(0x7ff2c00b3e80 0x7ff2c006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2be59c640 1 -- 172.21.15.6:0/970629715 >> v1:172.21.15.171:6789/0 conn(0x7ff2c006d910 legacy=0x7ff2c00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2bd59a640 1 -- 172.21.15.6:0/970629715 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933588015 0 0) 0x7ff2b8001110 con 0x7ff2c006d910 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.337+0000 7ff2be59c640 1 -- 172.21.15.6:0/970629715 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c00d3ca0 con 0x7ff2c0162820 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.338+0000 7ff2bdd9b640 1 --2- 172.21.15.6:0/970629715 >> v2:172.21.15.171:3300/0 conn(0x7ff2c00b3e80 0x7ff2c006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.338+0000 7ff2be59c640 1 --2- 172.21.15.6:0/970629715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c0162820 0x7ff2c00b3940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009d90 tx=0x7ff2b002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c27af635238ba24c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.338+0000 7ff2bd59a640 1 -- 172.21.15.6:0/970629715 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0007740 con 0x7ff2c0162820 2024-05-20T18:00:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2bd59a640 1 -- 172.21.15.6:0/970629715 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b00078e0 con 0x7ff2c0162820 2024-05-20T18:00:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2bd59a640 1 -- 172.21.15.6:0/970629715 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0007cb0 con 0x7ff2c0162820 2024-05-20T18:00:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/970629715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c0162820 msgr2=0x7ff2c00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/970629715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c0162820 0x7ff2c00b3940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009d90 tx=0x7ff2b002a660 comp rx=0 tx=0).stop 2024-05-20T18:00:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/970629715 shutdown_connections 2024-05-20T18:00:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/970629715 >> v2:172.21.15.171:3300/0 conn(0x7ff2c00b3e80 0x7ff2c006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/970629715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c0162820 0x7ff2c00b3940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/970629715 >> 172.21.15.6:0/970629715 conn(0x7ff2c00d4bd0 msgr2=0x7ff2c00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/970629715 shutdown_connections 2024-05-20T18:00:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.339+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/970629715 wait complete. 2024-05-20T18:00:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.341+0000 7ff2c4cc3640 1 Processor -- start 2024-05-20T18:00:26.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.341+0000 7ff2c4cc3640 1 -- start start 2024-05-20T18:00:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2c4cc3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c006d910 0x7ff2c00b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2c4cc3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00b3e80 0x7ff2c00b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2c4cc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c0162820 0x7ff2c014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2c4cc3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00d0300 con 0x7ff2c0162820 2024-05-20T18:00:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2c4cc3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c00d4260 con 0x7ff2c00b3e80 2024-05-20T18:00:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2c4cc3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c00b91a0 con 0x7ff2c006d910 2024-05-20T18:00:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2be59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c006d910 0x7ff2c00b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c0162820 0x7ff2c014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2bdd9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00b3e80 0x7ff2c00b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2be59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c006d910 0x7ff2c00b6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:44488/0 (socket says 172.21.15.6:44488) 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2be59c640 1 -- 172.21.15.6:0/4200851174 learned_addr learned my addr 172.21.15.6:0/4200851174 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2be59c640 1 -- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00b3e80 msgr2=0x7ff2c00b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2be59c640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00b3e80 0x7ff2c00b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2be59c640 1 -- 172.21.15.6:0/4200851174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c0162820 msgr2=0x7ff2c014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2be59c640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c0162820 0x7ff2c014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.343+0000 7ff2be59c640 1 -- 172.21.15.6:0/4200851174 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c00b5560 con 0x7ff2c006d910 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.344+0000 7ff2be59c640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c006d910 0x7ff2c00b6bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000f80 tx=0x7ff2b0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.344+0000 7ff2aeffd640 1 -- 172.21.15.6:0/4200851174 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b003f070 con 0x7ff2c006d910 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.344+0000 7ff2aeffd640 1 -- 172.21.15.6:0/4200851174 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b0031c40 con 0x7ff2c006d910 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.344+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c00b5840 con 0x7ff2c006d910 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.344+0000 7ff2aeffd640 1 -- 172.21.15.6:0/4200851174 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0009450 con 0x7ff2c006d910 2024-05-20T18:00:26.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.344+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c00b5e00 con 0x7ff2c006d910 2024-05-20T18:00:26.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.345+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c0075b00 con 0x7ff2c006d910 2024-05-20T18:00:26.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.346+0000 7ff2aeffd640 1 -- 172.21.15.6:0/4200851174 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2b0003990 con 0x7ff2c006d910 2024-05-20T18:00:26.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.346+0000 7ff2aeffd640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2a006be30 0x7ff2a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.346+0000 7ff2aeffd640 1 -- 172.21.15.6:0/4200851174 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7ff2b00ac2e0 con 0x7ff2c006d910 2024-05-20T18:00:26.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.346+0000 7ff2bdd9b640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2a006be30 0x7ff2a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.347+0000 7ff2bdd9b640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2a006be30 0x7ff2a006e340 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009630 tx=0x7ff2b4009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:26.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.351+0000 7ff2aeffd640 1 -- 172.21.15.6:0/4200851174 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff2b007a520 con 0x7ff2c006d910 2024-05-20T18:00:26.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.541+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2c015faf0 con 0x7ff2c006d910 2024-05-20T18:00:26.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.543+0000 7ff2aeffd640 1 -- 172.21.15.6:0/4200851174 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16828 (secure 0 0 0) 0x7ff2b007e820 con 0x7ff2c006d910 2024-05-20T18:00:26.541 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:26.541 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":101,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:17.119205+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:13.843929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:14.484733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:26.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2a006be30 msgr2=0x7ff2a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2a006be30 0x7ff2a006e340 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009630 tx=0x7ff2b4009240 comp rx=0 tx=0).stop 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c006d910 msgr2=0x7ff2c00b6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c006d910 0x7ff2c00b6bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000f80 tx=0x7ff2b0004a40 comp rx=0 tx=0).stop 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 shutdown_connections 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff2a006be30 0x7ff2a006e340 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2c0162820 0x7ff2c014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2c00b3e80 0x7ff2c00b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 --2- 172.21.15.6:0/4200851174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2c006d910 0x7ff2c00b6bb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 >> 172.21.15.6:0/4200851174 conn(0x7ff2c00d4bd0 msgr2=0x7ff2c00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 shutdown_connections 2024-05-20T18:00:26.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.545+0000 7ff2c4cc3640 1 -- 172.21.15.6:0/4200851174 wait complete. 2024-05-20T18:00:26.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:00:13.843929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:00:14.484733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:00:26.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:00:26.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.675+0000 7f499e6ca640 1 Processor -- start 2024-05-20T18:00:26.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.675+0000 7f499e6ca640 1 -- start start 2024-05-20T18:00:26.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f499e6ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f499806d3d0 0x7f499806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f499e6ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49980b8190 0x7f49980b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f499e6ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499806dd20 con 0x7f4998162820 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f499e6ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f49980d0630 con 0x7f499806d3d0 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f499e6ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f49980d39c0 con 0x7f49980b8190 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f4997fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4998162820 0x7f49980b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54232/0 (socket says 172.21.15.6:54232) 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f4997fff640 1 -- 172.21.15.6:0/2623778512 learned_addr learned my addr 172.21.15.6:0/2623778512 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f499cc67640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49980b8190 0x7f49980b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f498ffff640 1 --2- 172.21.15.6:0/2623778512 >> v2:172.21.15.171:3300/0 conn(0x7f499806d3d0 0x7f499806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798646568 0 0) 0x7f4988001110 con 0x7f4998162820 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4984003520 con 0x7f4998162820 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 652779092 0 0) 0x7f4984003520 con 0x7f4998162820 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49980b8190 msgr2=0x7f49980b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49980b8190 0x7f49980b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 >> v2:172.21.15.171:3300/0 conn(0x7f499806d3d0 msgr2=0x7f499806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 --2- 172.21.15.6:0/2623778512 >> v2:172.21.15.171:3300/0 conn(0x7f499806d3d0 0x7f499806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49980d3ca0 con 0x7f4998162820 2024-05-20T18:00:26.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f4988001840 con 0x7f4998162820 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 >> v1:172.21.15.6:6789/0 conn(0x7f4998162820 legacy=0x7f49980b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49840039b0 0x7f4984003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.677+0000 7f49977fe640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49980b8190 0x7f4984004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f49977fe640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4984004d40 0x7f4984005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f49980d0630 con 0x7f49840039b0 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49980d39c0 con 0x7f4984004d40 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f498400b9c0 con 0x7f49980b8190 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f4997fff640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49840039b0 0x7f4984003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f499cc67640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4984004d40 0x7f4984005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f498ffff640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49980b8190 0x7f4984004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f4997fff640 1 -- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49980b8190 msgr2=0x7f4984004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f4997fff640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49980b8190 0x7f4984004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f4997fff640 1 -- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4984004d40 msgr2=0x7f4984005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f4997fff640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4984004d40 0x7f4984005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.678+0000 7f4997fff640 1 -- 172.21.15.6:0/2623778512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4984003520 con 0x7f49840039b0 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.679+0000 7f4997fff640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49840039b0 0x7f4984003e20 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f498800c4c0 tx=0x7f4984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280bbc06149c181c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.679+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498800c0e0 con 0x7f49840039b0 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.679+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4988034070 con 0x7f49840039b0 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.679+0000 7f49977fe640 1 -- 172.21.15.6:0/2623778512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988005d30 con 0x7f49840039b0 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.680+0000 7f499e6ca640 1 -- 172.21.15.6:0/2623778512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49840039b0 msgr2=0x7f4984003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.680+0000 7f499e6ca640 1 --2- 172.21.15.6:0/2623778512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49840039b0 0x7f4984003e20 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f498800c4c0 tx=0x7f4984005830 comp rx=0 tx=0).stop 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.680+0000 7f499cc67640 1 -- 172.21.15.6:0/2623778512 reap_dead start 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.680+0000 7f499e6ca640 1 -- 172.21.15.6:0/2623778512 shutdown_connections 2024-05-20T18:00:26.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.680+0000 7f499e6ca640 1 -- 172.21.15.6:0/2623778512 >> 172.21.15.6:0/2623778512 conn(0x7f49980d4bd0 msgr2=0x7f49980d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:26.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.680+0000 7f499e6ca640 1 -- 172.21.15.6:0/2623778512 shutdown_connections 2024-05-20T18:00:26.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.680+0000 7f499e6ca640 1 -- 172.21.15.6:0/2623778512 wait complete. 2024-05-20T18:00:26.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.681+0000 7f499e6ca640 1 Processor -- start 2024-05-20T18:00:26.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.682+0000 7f499e6ca640 1 -- start start 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499e6ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49840039b0 0x7f499814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499e6ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49981f8810 0x7f49981f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499e6ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49980c9ac0 0x7f49980c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499e6ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f49980d0300 con 0x7f49980c9ac0 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499e6ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49980d4260 con 0x7f49981f8810 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499e6ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f49980b4050 con 0x7f49840039b0 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499cc67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49980c9ac0 0x7f49980c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499cc67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49980c9ac0 0x7f49980c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50340/0 (socket says 172.21.15.6:50340) 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499cc67640 1 -- 172.21.15.6:0/2898437944 learned_addr learned my addr 172.21.15.6:0/2898437944 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:26.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f4997fff640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49840039b0 0x7f499814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f498ffff640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49981f8810 0x7f49981f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499cc67640 1 -- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49840039b0 msgr2=0x7f499814c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499cc67640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49840039b0 0x7f499814c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499cc67640 1 -- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49981f8810 msgr2=0x7f49981f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499cc67640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49981f8810 0x7f49981f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f499cc67640 1 -- 172.21.15.6:0/2898437944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49981f50b0 con 0x7f49980c9ac0 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f4997fff640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49840039b0 0x7f499814c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.683+0000 7f498ffff640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49981f8810 0x7f49981f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.684+0000 7f499cc67640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49980c9ac0 0x7f49980c9ed0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f499808e090 tx=0x7f499000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.684+0000 7f49957fa640 1 -- 172.21.15.6:0/2898437944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990019070 con 0x7f49980c9ac0 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.684+0000 7f49957fa640 1 -- 172.21.15.6:0/2898437944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990011e90 con 0x7f49980c9ac0 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.684+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49980ca410 con 0x7f49980c9ac0 2024-05-20T18:00:26.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.684+0000 7f49957fa640 1 -- 172.21.15.6:0/2898437944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990003bd0 con 0x7f49980c9ac0 2024-05-20T18:00:26.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.684+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49981e7a70 con 0x7f49980c9ac0 2024-05-20T18:00:26.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.685+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49981f8c20 con 0x7f49980c9ac0 2024-05-20T18:00:26.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.686+0000 7f49957fa640 1 -- 172.21.15.6:0/2898437944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f499001c070 con 0x7f49980c9ac0 2024-05-20T18:00:26.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.686+0000 7f49957fa640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f497806be60 0x7f497806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:26.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.686+0000 7f49957fa640 1 -- 172.21.15.6:0/2898437944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f499008b880 con 0x7f49980c9ac0 2024-05-20T18:00:26.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.686+0000 7f4997fff640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f497806be60 0x7f497806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:26.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.687+0000 7f4997fff640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f497806be60 0x7f497806e370 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4988033000 tx=0x7f4988009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:26.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.690+0000 7f49957fa640 1 -- 172.21.15.6:0/2898437944 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f49980ca410 con 0x7f49980c9ac0 2024-05-20T18:00:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.874+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4998075b00 con 0x7f49980c9ac0 2024-05-20T18:00:26.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.874+0000 7f49957fa640 1 -- 172.21.15.6:0/2898437944 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) ==== 93+0+10 (secure 0 0 0) 0x7f49981f50b0 con 0x7f49980c9ac0 2024-05-20T18:00:26.872 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f497806be60 msgr2=0x7f497806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f497806be60 0x7f497806e370 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4988033000 tx=0x7f4988009030 comp rx=0 tx=0).stop 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49980c9ac0 msgr2=0x7f49980c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49980c9ac0 0x7f49980c9ed0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f499808e090 tx=0x7f499000f580 comp rx=0 tx=0).stop 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 shutdown_connections 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f497806be60 0x7f497806e370 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49980c9ac0 0x7f49980c9ed0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49981f8810 0x7f49981f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 --2- 172.21.15.6:0/2898437944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f49840039b0 0x7f499814c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 >> 172.21.15.6:0/2898437944 conn(0x7f49980d4bd0 msgr2=0x7f499815fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 shutdown_connections 2024-05-20T18:00:26.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:26.876+0000 7f499e6ca640 1 -- 172.21.15.6:0/2898437944 wait complete. 2024-05-20T18:00:26.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:00:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.005+0000 7fd4e5c37640 1 Processor -- start 2024-05-20T18:00:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.005+0000 7fd4e5c37640 1 -- start start 2024-05-20T18:00:27.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.006+0000 7fd4e5c37640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.006+0000 7fd4e5c37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e00cd580 con 0x7fd4e0070850 2024-05-20T18:00:27.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.006+0000 7fd4e5c37640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e00cd860 con 0x7fd4e00b1700 2024-05-20T18:00:27.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.006+0000 7fd4e5c37640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e00ce190 con 0x7fd4e015d530 2024-05-20T18:00:27.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.006+0000 7fd4dffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd4e0070850 0x7fd4e0070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54236/0 (socket says 172.21.15.6:54236) 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.006+0000 7fd4dffff640 1 -- 172.21.15.6:0/1133840321 learned_addr learned my addr 172.21.15.6:0/1133840321 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4df7fe640 1 --2- 172.21.15.6:0/1133840321 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4deffd640 1 -- 172.21.15.6:0/1133840321 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675151365 0 0) 0x7fd4e00cd580 con 0x7fd4e0070850 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4deffd640 1 -- 172.21.15.6:0/1133840321 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4cc003520 con 0x7fd4e0070850 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4deffd640 1 -- 172.21.15.6:0/1133840321 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976292431 0 0) 0x7fd4e00cd860 con 0x7fd4e00b1700 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4deffd640 1 -- 172.21.15.6:0/1133840321 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4e00cd580 con 0x7fd4e00b1700 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4deffd640 1 -- 172.21.15.6:0/1133840321 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3403595172 0 0) 0x7fd4cc003520 con 0x7fd4e0070850 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4df7fe640 1 -- 172.21.15.6:0/1133840321 >> v1:172.21.15.171:6789/0 conn(0x7fd4e00b1700 legacy=0x7fd4e00b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4df7fe640 1 -- 172.21.15.6:0/1133840321 >> v1:172.21.15.6:6789/0 conn(0x7fd4e0070850 legacy=0x7fd4e0070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.007+0000 7fd4df7fe640 1 -- 172.21.15.6:0/1133840321 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e00cdb40 con 0x7fd4e015d530 2024-05-20T18:00:27.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.008+0000 7fd4df7fe640 1 --2- 172.21.15.6:0/1133840321 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e015aaa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00097d0 tx=0x7fd4d002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917d91e9cff94c6c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.008+0000 7fd4deffd640 1 -- 172.21.15.6:0/1133840321 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0037070 con 0x7fd4e015d530 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.008+0000 7fd4deffd640 1 -- 172.21.15.6:0/1133840321 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d002ac30 con 0x7fd4e015d530 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.008+0000 7fd4deffd640 1 -- 172.21.15.6:0/1133840321 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80019f0 con 0x7fd4e015d530 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.009+0000 7fd4e5c37640 1 -- 172.21.15.6:0/1133840321 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 msgr2=0x7fd4e015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.009+0000 7fd4e5c37640 1 --2- 172.21.15.6:0/1133840321 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e015aaa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00097d0 tx=0x7fd4d002a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.009+0000 7fd4e5c37640 1 -- 172.21.15.6:0/1133840321 shutdown_connections 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.009+0000 7fd4e5c37640 1 --2- 172.21.15.6:0/1133840321 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e015aaa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.009+0000 7fd4e5c37640 1 -- 172.21.15.6:0/1133840321 >> 172.21.15.6:0/1133840321 conn(0x7fd4e00d29d0 msgr2=0x7fd4e00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.009+0000 7fd4e5c37640 1 -- 172.21.15.6:0/1133840321 shutdown_connections 2024-05-20T18:00:27.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.009+0000 7fd4e5c37640 1 -- 172.21.15.6:0/1133840321 wait complete. 2024-05-20T18:00:27.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.011+0000 7fd4e5c37640 1 Processor -- start 2024-05-20T18:00:27.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.011+0000 7fd4e5c37640 1 -- start start 2024-05-20T18:00:27.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4e5c37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4e0070850 0x7fd4e006d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4e5c37640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4e00b1700 0x7fd4e00cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4e5c37640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e01f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4e5c37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0071370 con 0x7fd4e0070850 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4e5c37640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e00cd230 con 0x7fd4e00b1700 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4e5c37640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e00714f0 con 0x7fd4e015d530 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4e0070850 0x7fd4e006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4e0070850 0x7fd4e006d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50350/0 (socket says 172.21.15.6:50350) 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4df7fe640 1 -- 172.21.15.6:0/2671589309 learned_addr learned my addr 172.21.15.6:0/2671589309 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4d7fff640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4e00b1700 0x7fd4e00cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4dffff640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e01f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4df7fe640 1 -- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 msgr2=0x7fd4e01f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4df7fe640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e01f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4df7fe640 1 -- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4e00b1700 msgr2=0x7fd4e00cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4df7fe640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4e00b1700 0x7fd4e00cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.012+0000 7fd4df7fe640 1 -- 172.21.15.6:0/2671589309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e015bb80 con 0x7fd4e0070850 2024-05-20T18:00:27.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.013+0000 7fd4df7fe640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4e0070850 0x7fd4e006d250 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0035040 tx=0x7fd4d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.013+0000 7fd4dcff9640 1 -- 172.21.15.6:0/2671589309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0042020 con 0x7fd4e0070850 2024-05-20T18:00:27.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.013+0000 7fd4dcff9640 1 -- 172.21.15.6:0/2671589309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d003d690 con 0x7fd4e0070850 2024-05-20T18:00:27.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.013+0000 7fd4dcff9640 1 -- 172.21.15.6:0/2671589309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0037040 con 0x7fd4e0070850 2024-05-20T18:00:27.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.013+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e015be20 con 0x7fd4e0070850 2024-05-20T18:00:27.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.013+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e015c3e0 con 0x7fd4e0070850 2024-05-20T18:00:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.014+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e00d3810 con 0x7fd4e0070850 2024-05-20T18:00:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.015+0000 7fd4dcff9640 1 -- 172.21.15.6:0/2671589309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4d0045020 con 0x7fd4e0070850 2024-05-20T18:00:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.015+0000 7fd4dcff9640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd4c006be30 0x7fd4c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.015+0000 7fd4dcff9640 1 -- 172.21.15.6:0/2671589309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fd4d00ab680 con 0x7fd4e0070850 2024-05-20T18:00:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.015+0000 7fd4d7fff640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd4c006be30 0x7fd4c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.016+0000 7fd4d7fff640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd4c006be30 0x7fd4c006e340 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80011e0 tx=0x7fd4c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.020+0000 7fd4dcff9640 1 -- 172.21.15.6:0/2671589309 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd4d004c030 con 0x7fd4e0070850 2024-05-20T18:00:27.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.205+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd4e0075b00 con 0x7fd4e0070850 2024-05-20T18:00:27.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.205+0000 7fd4dcff9640 1 -- 172.21.15.6:0/2671589309 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) ==== 104+0+11 (secure 0 0 0) 0x7fd4d0079ea0 con 0x7fd4e0070850 2024-05-20T18:00:27.202 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:00:27.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd4c006be30 msgr2=0x7fd4c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd4c006be30 0x7fd4c006e340 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80011e0 tx=0x7fd4c8009040 comp rx=0 tx=0).stop 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4e0070850 msgr2=0x7fd4e006d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4e0070850 0x7fd4e006d250 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0035040 tx=0x7fd4d00046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 shutdown_connections 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd4c006be30 0x7fd4c006e340 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4e015d530 0x7fd4e01f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4e00b1700 0x7fd4e00cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 --2- 172.21.15.6:0/2671589309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4e0070850 0x7fd4e006d250 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 >> 172.21.15.6:0/2671589309 conn(0x7fd4e00d29d0 msgr2=0x7fd4e015e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 shutdown_connections 2024-05-20T18:00:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.207+0000 7fd4e5c37640 1 -- 172.21.15.6:0/2671589309 wait complete. 2024-05-20T18:00:27.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:00:27.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.336+0000 7f8e3afcc640 1 Processor -- start 2024-05-20T18:00:27.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.337+0000 7f8e3afcc640 1 -- start start 2024-05-20T18:00:27.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e3afcc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8e340d10e0 0x7f8e340cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e3afcc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340d14f0 0x7f8e340cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e3afcc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e340d1ac0 con 0x7f8e340cd4d0 2024-05-20T18:00:27.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e3afcc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8e340d1da0 con 0x7f8e340d10e0 2024-05-20T18:00:27.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e3afcc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8e340d2080 con 0x7f8e340d14f0 2024-05-20T18:00:27.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e33fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340d14f0 0x7f8e340cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e38d68640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8e340d10e0 0x7f8e340cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e39569640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8e340cd4d0 0x7f8e340cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:51532/0 (socket says 172.21.15.6:51532) 2024-05-20T18:00:27.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.338+0000 7f8e39569640 1 -- 172.21.15.6:0/3709745170 learned_addr learned my addr 172.21.15.6:0/3709745170 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:27.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.339+0000 7f8e33fff640 1 -- 172.21.15.6:0/3709745170 >> v2:172.21.15.171:3300/0 conn(0x7f8e340d10e0 msgr2=0x7f8e340cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:27.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.339+0000 7f8e33fff640 1 --2- 172.21.15.6:0/3709745170 >> v2:172.21.15.171:3300/0 conn(0x7f8e340d10e0 0x7f8e340cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.339+0000 7f8e33fff640 1 -- 172.21.15.6:0/3709745170 >> v1:172.21.15.171:6789/0 conn(0x7f8e340cd4d0 legacy=0x7f8e340cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.339+0000 7f8e33fff640 1 -- 172.21.15.6:0/3709745170 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e340d2360 con 0x7f8e340d14f0 2024-05-20T18:00:27.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.339+0000 7f8e337fe640 1 -- 172.21.15.6:0/3709745170 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212650774 0 0) 0x7f8e340d1ac0 con 0x7f8e340cd4d0 2024-05-20T18:00:27.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e33fff640 1 --2- 172.21.15.6:0/3709745170 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340d14f0 0x7f8e340cf680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e280097a0 tx=0x7f8e2802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8df1f0aa56192dee server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e337fe640 1 -- 172.21.15.6:0/3709745170 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28037070 con 0x7f8e340d14f0 2024-05-20T18:00:27.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e337fe640 1 -- 172.21.15.6:0/3709745170 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e28032440 con 0x7f8e340d14f0 2024-05-20T18:00:27.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e337fe640 1 -- 172.21.15.6:0/3709745170 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28032810 con 0x7f8e340d14f0 2024-05-20T18:00:27.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e3afcc640 1 -- 172.21.15.6:0/3709745170 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340d14f0 msgr2=0x7f8e340cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/3709745170 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340d14f0 0x7f8e340cf680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e280097a0 tx=0x7f8e2802a180 comp rx=0 tx=0).stop 2024-05-20T18:00:27.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e3afcc640 1 -- 172.21.15.6:0/3709745170 shutdown_connections 2024-05-20T18:00:27.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/3709745170 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340d14f0 0x7f8e340cf680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/3709745170 >> v2:172.21.15.171:3300/0 conn(0x7f8e340d10e0 0x7f8e340cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.340+0000 7f8e3afcc640 1 -- 172.21.15.6:0/3709745170 >> 172.21.15.6:0/3709745170 conn(0x7f8e340b44d0 msgr2=0x7f8e340b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:27.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.341+0000 7f8e3afcc640 1 -- 172.21.15.6:0/3709745170 shutdown_connections 2024-05-20T18:00:27.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.341+0000 7f8e3afcc640 1 -- 172.21.15.6:0/3709745170 wait complete. 2024-05-20T18:00:27.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.342+0000 7f8e3afcc640 1 Processor -- start 2024-05-20T18:00:27.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.342+0000 7f8e3afcc640 1 -- start start 2024-05-20T18:00:27.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e3afcc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340cd4d0 0x7f8e340c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e3afcc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e340d10e0 0x7f8e34152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e3afcc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e340d14f0 0x7f8e341f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e3afcc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8e340b8440 con 0x7f8e340d14f0 2024-05-20T18:00:27.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e3afcc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8e340b82c0 con 0x7f8e340d10e0 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e3afcc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8e340709f0 con 0x7f8e340cd4d0 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e39569640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e340d14f0 0x7f8e341f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e38d68640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340cd4d0 0x7f8e340c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e38d68640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340cd4d0 0x7f8e340c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:44536/0 (socket says 172.21.15.6:44536) 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e39569640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e340d14f0 0x7f8e341f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50356/0 (socket says 172.21.15.6:50356) 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e38d68640 1 -- 172.21.15.6:0/2517929618 learned_addr learned my addr 172.21.15.6:0/2517929618 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e33fff640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e340d10e0 0x7f8e34152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e38d68640 1 -- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e340d10e0 msgr2=0x7f8e34152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e38d68640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e340d10e0 0x7f8e34152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e38d68640 1 -- 172.21.15.6:0/2517929618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e340d14f0 msgr2=0x7f8e341f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e38d68640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e340d14f0 0x7f8e341f3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e38d68640 1 -- 172.21.15.6:0/2517929618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e340c7b30 con 0x7f8e340cd4d0 2024-05-20T18:00:27.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.344+0000 7f8e39569640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e340d14f0 0x7f8e341f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:27.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.345+0000 7f8e38d68640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340cd4d0 0x7f8e340c8bd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400e8a0 tx=0x7f8e2400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.345+0000 7f8e317fa640 1 -- 172.21.15.6:0/2517929618 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24017070 con 0x7f8e340cd4d0 2024-05-20T18:00:27.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.345+0000 7f8e317fa640 1 -- 172.21.15.6:0/2517929618 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2400c940 con 0x7f8e340cd4d0 2024-05-20T18:00:27.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.345+0000 7f8e317fa640 1 -- 172.21.15.6:0/2517929618 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400cd30 con 0x7f8e340cd4d0 2024-05-20T18:00:27.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.345+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e340c7e10 con 0x7f8e340cd4d0 2024-05-20T18:00:27.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.345+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e340c83d0 con 0x7f8e340cd4d0 2024-05-20T18:00:27.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.346+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e34075b00 con 0x7f8e340cd4d0 2024-05-20T18:00:27.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.347+0000 7f8e317fa640 1 -- 172.21.15.6:0/2517929618 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e2401a070 con 0x7f8e340cd4d0 2024-05-20T18:00:27.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.347+0000 7f8e317fa640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e2006be30 0x7f8e2006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.347+0000 7f8e317fa640 1 -- 172.21.15.6:0/2517929618 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f8e2408b330 con 0x7f8e340cd4d0 2024-05-20T18:00:27.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.347+0000 7f8e33fff640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e2006be30 0x7f8e2006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.348+0000 7f8e33fff640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e2006be30 0x7f8e2006e340 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8e28034000 tx=0x7f8e2802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.352+0000 7f8e317fa640 1 -- 172.21.15.6:0/2517929618 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8e240593d0 con 0x7f8e340cd4d0 2024-05-20T18:00:27.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.533+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8e340b2990 con 0x7f8e340cd4d0 2024-05-20T18:00:27.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.534+0000 7f8e317fa640 1 -- 172.21.15.6:0/2517929618 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) ==== 100+0+11 (secure 0 0 0) 0x7f8e2405d6d0 con 0x7f8e340cd4d0 2024-05-20T18:00:27.531 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:00:27.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e2006be30 msgr2=0x7f8e2006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e2006be30 0x7f8e2006e340 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8e28034000 tx=0x7f8e2802e000 comp rx=0 tx=0).stop 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340cd4d0 msgr2=0x7f8e340c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340cd4d0 0x7f8e340c8bd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400e8a0 tx=0x7f8e2400ed60 comp rx=0 tx=0).stop 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 shutdown_connections 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e2006be30 0x7f8e2006e340 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e340d14f0 0x7f8e341f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e340d10e0 0x7f8e34152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 --2- 172.21.15.6:0/2517929618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e340cd4d0 0x7f8e340c8bd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 >> 172.21.15.6:0/2517929618 conn(0x7f8e340b44d0 msgr2=0x7f8e3415c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 shutdown_connections 2024-05-20T18:00:27.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.536+0000 7f8e3afcc640 1 -- 172.21.15.6:0/2517929618 wait complete. 2024-05-20T18:00:27.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:00:27.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.663+0000 7f81c345f640 1 Processor -- start 2024-05-20T18:00:27.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.663+0000 7f81c345f640 1 -- start start 2024-05-20T18:00:27.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c345f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81bc15d5f0 0x7f81bc1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c345f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c345f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81bc06b900 con 0x7f81bc0cec00 2024-05-20T18:00:27.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c345f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f81bc06bbe0 con 0x7f81bc15d5f0 2024-05-20T18:00:27.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c345f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc06bec0 con 0x7f81bc06c9a0 2024-05-20T18:00:27.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c11fb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81bc15d5f0 0x7f81bc1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c11fb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81bc15d5f0 0x7f81bc1576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50372/0 (socket says 172.21.15.6:50372) 2024-05-20T18:00:27.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c11fb640 1 -- 172.21.15.6:0/2140967022 learned_addr learned my addr 172.21.15.6:0/2140967022 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:27.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c09fa640 1 --2- 172.21.15.6:0/2140967022 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c11fb640 1 -- 172.21.15.6:0/2140967022 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 msgr2=0x7f81bc0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:27.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c11fb640 1 --2- 172.21.15.6:0/2140967022 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c11fb640 1 -- 172.21.15.6:0/2140967022 >> v1:172.21.15.171:6789/0 conn(0x7f81bc0cec00 legacy=0x7f81bc06e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.665+0000 7f81c11fb640 1 -- 172.21.15.6:0/2140967022 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc06c1a0 con 0x7f81bc15d5f0 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.666+0000 7f81c11fb640 1 --2- 172.21.15.6:0/2140967022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc1576d0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009870 tx=0x7f81b802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a69ce0e4728f07 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.666+0000 7f81b3fff640 1 -- 172.21.15.6:0/2140967022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8037070 con 0x7f81bc15d5f0 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.666+0000 7f81b3fff640 1 -- 172.21.15.6:0/2140967022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b8032440 con 0x7f81bc15d5f0 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.666+0000 7f81b3fff640 1 -- 172.21.15.6:0/2140967022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8032810 con 0x7f81bc15d5f0 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.667+0000 7f81c345f640 1 -- 172.21.15.6:0/2140967022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 msgr2=0x7f81bc1576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.667+0000 7f81c345f640 1 --2- 172.21.15.6:0/2140967022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc1576d0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009870 tx=0x7f81b802a1c0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.667+0000 7f81c345f640 1 -- 172.21.15.6:0/2140967022 shutdown_connections 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.667+0000 7f81c345f640 1 --2- 172.21.15.6:0/2140967022 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.667+0000 7f81c345f640 1 --2- 172.21.15.6:0/2140967022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc1576d0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.667+0000 7f81c345f640 1 -- 172.21.15.6:0/2140967022 >> 172.21.15.6:0/2140967022 conn(0x7f81bc0cd2a0 msgr2=0x7f81bc0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.667+0000 7f81c345f640 1 -- 172.21.15.6:0/2140967022 shutdown_connections 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.667+0000 7f81c345f640 1 -- 172.21.15.6:0/2140967022 wait complete. 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.669+0000 7f81c345f640 1 Processor -- start 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.669+0000 7f81c345f640 1 -- start start 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c345f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c345f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81bc0cec00 0x7f81bc142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c345f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c345f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc06b520 con 0x7f81bc15d5f0 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c345f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc06cdb0 con 0x7f81bc0cec00 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c345f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc06b6a0 con 0x7f81bc06c9a0 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c19fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c19fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50382/0 (socket says 172.21.15.6:50382) 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c19fc640 1 -- 172.21.15.6:0/334131813 learned_addr learned my addr 172.21.15.6:0/334131813 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c09fa640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81bc0cec00 0x7f81bc142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.670+0000 7f81c11fb640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c19fc640 1 -- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 msgr2=0x7f81bc0b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c19fc640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c19fc640 1 -- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81bc0cec00 msgr2=0x7f81bc142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c19fc640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81bc0cec00 0x7f81bc142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c19fc640 1 -- 172.21.15.6:0/334131813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc145740 con 0x7f81bc15d5f0 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c11fb640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c19fc640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc15c080 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f81b400c6b0 tx=0x7f81b400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81b1ffb640 1 -- 172.21.15.6:0/334131813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4003b70 con 0x7f81bc15d5f0 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81b1ffb640 1 -- 172.21.15.6:0/334131813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b4003d30 con 0x7f81bc15d5f0 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc145a20 con 0x7f81bc15d5f0 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81b1ffb640 1 -- 172.21.15.6:0/334131813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4005310 con 0x7f81bc15d5f0 2024-05-20T18:00:27.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.671+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc1443d0 con 0x7f81bc15d5f0 2024-05-20T18:00:27.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.672+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc0b06b0 con 0x7f81bc15d5f0 2024-05-20T18:00:27.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.673+0000 7f81b1ffb640 1 -- 172.21.15.6:0/334131813 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81b40054b0 con 0x7f81bc15d5f0 2024-05-20T18:00:27.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.673+0000 7f81b1ffb640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81a006be30 0x7f81a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:27.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.673+0000 7f81b1ffb640 1 -- 172.21.15.6:0/334131813 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f81b408aea0 con 0x7f81bc15d5f0 2024-05-20T18:00:27.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.674+0000 7f81c11fb640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81a006be30 0x7f81a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:27.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.674+0000 7f81c11fb640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81a006be30 0x7f81a006e340 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f81b8034000 tx=0x7f81b802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:27.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.678+0000 7f81b1ffb640 1 -- 172.21.15.6:0/334131813 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f81b40596c0 con 0x7f81bc15d5f0 2024-05-20T18:00:27.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.872+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f81bc075b00 con 0x7f81bc15d5f0 2024-05-20T18:00:27.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.873+0000 7f81b1ffb640 1 -- 172.21.15.6:0/334131813 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) ==== 80+0+0 (secure 0 0 0) 0x7f81b4058fc0 con 0x7f81bc15d5f0 2024-05-20T18:00:27.870 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:00:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81a006be30 msgr2=0x7f81a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81a006be30 0x7f81a006e340 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f81b8034000 tx=0x7f81b802e000 comp rx=0 tx=0).stop 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 msgr2=0x7f81bc15c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc15c080 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f81b400c6b0 tx=0x7f81b400cb70 comp rx=0 tx=0).stop 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 shutdown_connections 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81a006be30 0x7f81a006e340 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81bc15d5f0 0x7f81bc15c080 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81bc0cec00 0x7f81bc142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 --2- 172.21.15.6:0/334131813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81bc06c9a0 0x7f81bc0b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 >> 172.21.15.6:0/334131813 conn(0x7f81bc0cd2a0 msgr2=0x7f81bc0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 shutdown_connections 2024-05-20T18:00:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:27.875+0000 7f81c345f640 1 -- 172.21.15.6:0/334131813 wait complete. 2024-05-20T18:00:27.884 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T18:00:27.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:27.884 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:27.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:00:27.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:27.918 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T18:00:27.977 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:00:27.977 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:27.977 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:27.993 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:00:27.993 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:00:27.994 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:27.994 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:28.035 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:00:28.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.153+0000 7f7fe9273640 1 Processor -- start 2024-05-20T18:00:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.154+0000 7f7fe9273640 1 -- start start 2024-05-20T18:00:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe9273640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 0x7f7fe415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe9273640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7fe406cf00 0x7f7fe406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe9273640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe408d2a0 con 0x7f7fe40d2780 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe9273640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe40d3f70 con 0x7f7fe406cf00 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe9273640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe406d850 con 0x7f7fe40d4400 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe27fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7fe406cf00 0x7f7fe406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe27fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7fe406cf00 0x7f7fe406d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34364/0 (socket says 172.21.15.6:34364) 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe27fc640 1 -- 172.21.15.6:0/2986200489 learned_addr learned my addr 172.21.15.6:0/2986200489 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe2ffd640 1 --2- 172.21.15.6:0/2986200489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 0x7f7fe415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe27fc640 1 -- 172.21.15.6:0/2986200489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 msgr2=0x7f7fe415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe27fc640 1 --2- 172.21.15.6:0/2986200489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 0x7f7fe415f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe27fc640 1 -- 172.21.15.6:0/2986200489 >> v1:172.21.15.171:6789/0 conn(0x7f7fe40d2780 legacy=0x7f7fe40d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.155+0000 7f7fe27fc640 1 -- 172.21.15.6:0/2986200489 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe40d4810 con 0x7f7fe406cf00 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.156+0000 7f7fe27fc640 1 --2- 172.21.15.6:0/2986200489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe406cf00 0x7f7fe406d310 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009870 tx=0x7f7fcc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb863981e47a7ec server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.156+0000 7f7fe1ffb640 1 -- 172.21.15.6:0/2986200489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc037070 con 0x7f7fe406cf00 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.156+0000 7f7fe1ffb640 1 -- 172.21.15.6:0/2986200489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fcc02ae50 con 0x7f7fe406cf00 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.156+0000 7f7fe1ffb640 1 -- 172.21.15.6:0/2986200489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc032860 con 0x7f7fe406cf00 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.157+0000 7f7fe9273640 1 -- 172.21.15.6:0/2986200489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe406cf00 msgr2=0x7f7fe406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.157+0000 7f7fe9273640 1 --2- 172.21.15.6:0/2986200489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe406cf00 0x7f7fe406d310 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009870 tx=0x7f7fcc02a300 comp rx=0 tx=0).stop 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.157+0000 7f7fe9273640 1 -- 172.21.15.6:0/2986200489 shutdown_connections 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.157+0000 7f7fe9273640 1 --2- 172.21.15.6:0/2986200489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe406cf00 0x7f7fe406d310 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.157+0000 7f7fe9273640 1 --2- 172.21.15.6:0/2986200489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 0x7f7fe415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.157+0000 7f7fe9273640 1 -- 172.21.15.6:0/2986200489 >> 172.21.15.6:0/2986200489 conn(0x7f7fe40d4bb0 msgr2=0x7f7fe40d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.157+0000 7f7fe9273640 1 -- 172.21.15.6:0/2986200489 shutdown_connections 2024-05-20T18:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.157+0000 7f7fe9273640 1 -- 172.21.15.6:0/2986200489 wait complete. 2024-05-20T18:00:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.159+0000 7f7fe9273640 1 Processor -- start 2024-05-20T18:00:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.159+0000 7f7fe9273640 1 -- start start 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.160+0000 7f7fe9273640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7fe406cf00 0x7f7fe41f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.160+0000 7f7fe9273640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe40d2780 0x7f7fe41f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.160+0000 7f7fe9273640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 0x7f7fe4159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.160+0000 7f7fe9273640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe40d3920 con 0x7f7fe40d2780 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.160+0000 7f7fe9273640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe40d3640 con 0x7f7fe406cf00 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.160+0000 7f7fe9273640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe40d3c00 con 0x7f7fe40d4400 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe40d2780 0x7f7fe41f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe40d2780 0x7f7fe41f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34374/0 (socket says 172.21.15.6:34374) 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 -- 172.21.15.6:0/1208060291 learned_addr learned my addr 172.21.15.6:0/1208060291 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe2ffd640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7fe406cf00 0x7f7fe41f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe37fe640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 0x7f7fe4159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 -- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 msgr2=0x7f7fe4159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 0x7f7fe4159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 -- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7fe406cf00 msgr2=0x7f7fe41f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7fe406cf00 0x7f7fe41f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 -- 172.21.15.6:0/1208060291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe41f6830 con 0x7f7fe40d2780 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe27fc640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe40d2780 0x7f7fe41f5980 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc000c00 tx=0x7f7fcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/1208060291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc041020 con 0x7f7fe40d2780 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/1208060291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fcc03c870 con 0x7f7fe40d2780 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe415b470 con 0x7f7fe40d2780 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/1208060291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc037040 con 0x7f7fe40d2780 2024-05-20T18:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.161+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe415ba30 con 0x7f7fe40d2780 2024-05-20T18:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.162+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe40735a0 con 0x7f7fe40d2780 2024-05-20T18:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.163+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/1208060291 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fcc044020 con 0x7f7fe40d2780 2024-05-20T18:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.164+0000 7f7fdb7fe640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7fc406be30 0x7f7fc406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.164+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/1208060291 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f7fcc0ab870 con 0x7f7fe40d2780 2024-05-20T18:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.164+0000 7f7fe2ffd640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7fc406be30 0x7f7fc406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.164+0000 7f7fe2ffd640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7fc406be30 0x7f7fc406e340 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4011340 tx=0x7f7fd400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.168+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/1208060291 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7fe40735a0 con 0x7f7fe40d2780 2024-05-20T18:00:28.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.390+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fe4075b00 con 0x7f7fe40d2780 2024-05-20T18:00:28.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.390+0000 7f7fdb7fe640 1 -- 172.21.15.6:0/1208060291 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5180 (secure 0 0 0) 0x7f7fcc04b030 con 0x7f7fe40d2780 2024-05-20T18:00:28.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:28.388 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6413,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2288332461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2288332461},{"type":"v1","addr":"172.21.15.171:6835","nonce":2288332461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/4138789955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4138789955},{"type":"v1","addr":"172.21.15.171:6837","nonce":4138789955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2834528553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2834528553},{"type":"v1","addr":"172.21.15.6:6835","nonce":2834528553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:15.507163+0000","modified":"2024-05-20T18:00:18.526380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7725":{"gid":7725,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6834/957433228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":957433228},{"type":"v1","addr":"172.21.15.6:6834","nonce":957433228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7725,"qdb_cluster":[7725]},"id":7}]} 2024-05-20T18:00:28.388 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2024-05-20T18:00:28.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7fc406be30 msgr2=0x7f7fc406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7fc406be30 0x7f7fc406e340 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4011340 tx=0x7f7fd400b040 comp rx=0 tx=0).stop 2024-05-20T18:00:28.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe40d2780 msgr2=0x7f7fe41f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe40d2780 0x7f7fe41f5980 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc000c00 tx=0x7f7fcc0046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 shutdown_connections 2024-05-20T18:00:28.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7fc406be30 0x7f7fc406e340 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7fe40d4400 0x7f7fe4159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe40d2780 0x7f7fe41f5980 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 --2- 172.21.15.6:0/1208060291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7fe406cf00 0x7f7fe41f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 >> 172.21.15.6:0/1208060291 conn(0x7f7fe40d4bb0 msgr2=0x7f7fe4161ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:28.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 shutdown_connections 2024-05-20T18:00:28.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.392+0000 7f7fe9273640 1 -- 172.21.15.6:0/1208060291 wait complete. 2024-05-20T18:00:28.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:28.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.519+0000 7fbac4cf7640 1 Processor -- start 2024-05-20T18:00:28.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.520+0000 7fbac4cf7640 1 -- start start 2024-05-20T18:00:28.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbac4cf7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbac4cf7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbac006dae0 0x7fbac00b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbac4cf7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac00d0630 con 0x7fbac00b3e80 2024-05-20T18:00:28.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbac4cf7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbac00d39c0 con 0x7fbac006dae0 2024-05-20T18:00:28.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbac4cf7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbac00d3ca0 con 0x7fbac0162820 2024-05-20T18:00:28.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbabe59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbabed9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbac006dae0 0x7fbac00b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbabe59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:35296/0 (socket says 172.21.15.6:35296) 2024-05-20T18:00:28.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbabe59c640 1 -- 172.21.15.6:0/1191427555 learned_addr learned my addr 172.21.15.6:0/1191427555 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:28.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.521+0000 7fbabdd9b640 1 --1- 172.21.15.6:0/1191427555 >> v1:172.21.15.171:6789/0 conn(0x7fbac00b3e80 0x7fbac006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:58014/0 (socket says 172.21.15.6:58014) 2024-05-20T18:00:28.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.522+0000 7fbabe59c640 1 -- 172.21.15.6:0/1191427555 >> v2:172.21.15.171:3300/0 conn(0x7fbac006dae0 msgr2=0x7fbac00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:28.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.522+0000 7fbabe59c640 1 --2- 172.21.15.6:0/1191427555 >> v2:172.21.15.171:3300/0 conn(0x7fbac006dae0 0x7fbac00b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.522+0000 7fbabe59c640 1 -- 172.21.15.6:0/1191427555 >> v1:172.21.15.171:6789/0 conn(0x7fbac00b3e80 legacy=0x7fbac006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.522+0000 7fbabe59c640 1 -- 172.21.15.6:0/1191427555 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac00d3f80 con 0x7fbac0162820 2024-05-20T18:00:28.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.523+0000 7fbabe59c640 1 --2- 172.21.15.6:0/1191427555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac00b3940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009e50 tx=0x7fbab002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45180b4ac6bbb081 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.523+0000 7fbabd59a640 1 -- 172.21.15.6:0/1191427555 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0036070 con 0x7fbac0162820 2024-05-20T18:00:28.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.523+0000 7fbabd59a640 1 -- 172.21.15.6:0/1191427555 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab0031600 con 0x7fbac0162820 2024-05-20T18:00:28.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.523+0000 7fbabd59a640 1 -- 172.21.15.6:0/1191427555 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00319d0 con 0x7fbac0162820 2024-05-20T18:00:28.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.523+0000 7fbac4cf7640 1 -- 172.21.15.6:0/1191427555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 msgr2=0x7fbac00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.523+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/1191427555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac00b3940 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009e50 tx=0x7fbab002a710 comp rx=0 tx=0).stop 2024-05-20T18:00:28.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.524+0000 7fbac4cf7640 1 -- 172.21.15.6:0/1191427555 shutdown_connections 2024-05-20T18:00:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.524+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/1191427555 >> v2:172.21.15.171:3300/0 conn(0x7fbac006dae0 0x7fbac00b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.524+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/1191427555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac00b3940 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.524+0000 7fbac4cf7640 1 -- 172.21.15.6:0/1191427555 >> 172.21.15.6:0/1191427555 conn(0x7fbac00d4bd0 msgr2=0x7fbac00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.524+0000 7fbac4cf7640 1 -- 172.21.15.6:0/1191427555 shutdown_connections 2024-05-20T18:00:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.524+0000 7fbac4cf7640 1 -- 172.21.15.6:0/1191427555 wait complete. 2024-05-20T18:00:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.526+0000 7fbac4cf7640 1 Processor -- start 2024-05-20T18:00:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.526+0000 7fbac4cf7640 1 -- start start 2024-05-20T18:00:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbac4cf7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbac00b3e80 0x7fbac0158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbac4cf7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac01f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbac4cf7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbac01f23f0 0x7fbac01e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbac4cf7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbac00d4780 con 0x7fbac01f23f0 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbac4cf7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbac00d0300 con 0x7fbac00b3e80 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbac4cf7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbac00d4900 con 0x7fbac0162820 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbac01f23f0 0x7fbac01e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbac01f23f0 0x7fbac01e7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34382/0 (socket says 172.21.15.6:34382) 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabed9d640 1 -- 172.21.15.6:0/646391944 learned_addr learned my addr 172.21.15.6:0/646391944 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabdd9b640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac01f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabe59c640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbac00b3e80 0x7fbac0158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabed9d640 1 -- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 msgr2=0x7fbac01f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabed9d640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac01f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabed9d640 1 -- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbac00b3e80 msgr2=0x7fbac0158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabed9d640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbac00b3e80 0x7fbac0158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.527+0000 7fbabed9d640 1 -- 172.21.15.6:0/646391944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac01f2800 con 0x7fbac01f23f0 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.528+0000 7fbabed9d640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbac01f23f0 0x7fbac01e7be0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fbab800e7f0 tx=0x7fbab800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.528+0000 7fbab6ffd640 1 -- 172.21.15.6:0/646391944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8017070 con 0x7fbac01f23f0 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.528+0000 7fbab6ffd640 1 -- 172.21.15.6:0/646391944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab800ee40 con 0x7fbac01f23f0 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.528+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac0159570 con 0x7fbac01f23f0 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.528+0000 7fbab6ffd640 1 -- 172.21.15.6:0/646391944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab800cb80 con 0x7fbac01f23f0 2024-05-20T18:00:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.528+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac0159b30 con 0x7fbac01f23f0 2024-05-20T18:00:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.529+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac0075b00 con 0x7fbac01f23f0 2024-05-20T18:00:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.530+0000 7fbab6ffd640 1 -- 172.21.15.6:0/646391944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbab801a070 con 0x7fbac01f23f0 2024-05-20T18:00:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.530+0000 7fbab6ffd640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbaa006be30 0x7fbaa006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.530+0000 7fbab6ffd640 1 -- 172.21.15.6:0/646391944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fbab808aea0 con 0x7fbac01f23f0 2024-05-20T18:00:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.531+0000 7fbabe59c640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbaa006be30 0x7fbaa006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.531+0000 7fbabe59c640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbaa006be30 0x7fbaa006e340 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbab0033000 tx=0x7fbab0009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.535+0000 7fbab6ffd640 1 -- 172.21.15.6:0/646391944 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbac01f2800 con 0x7fbac01f23f0 2024-05-20T18:00:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.724+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbac00ba6e0 con 0x7fbac01f23f0 2024-05-20T18:00:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.725+0000 7fbab6ffd640 1 -- 172.21.15.6:0/646391944 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16828 (secure 0 0 0) 0x7fbab8058fe0 con 0x7fbac01f23f0 2024-05-20T18:00:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:28.723 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":101,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:17.119205+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:13.843929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:14.484733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbaa006be30 msgr2=0x7fbaa006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbaa006be30 0x7fbaa006e340 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbab0033000 tx=0x7fbab0009000 comp rx=0 tx=0).stop 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbac01f23f0 msgr2=0x7fbac01e7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbac01f23f0 0x7fbac01e7be0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fbab800e7f0 tx=0x7fbab800ebf0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 shutdown_connections 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbaa006be30 0x7fbaa006e340 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbac01f23f0 0x7fbac01e7be0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbac0162820 0x7fbac01f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 --2- 172.21.15.6:0/646391944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbac00b3e80 0x7fbac0158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 >> 172.21.15.6:0/646391944 conn(0x7fbac00d4bd0 msgr2=0x7fbac0160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 shutdown_connections 2024-05-20T18:00:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.727+0000 7fbac4cf7640 1 -- 172.21.15.6:0/646391944 wait complete. 2024-05-20T18:00:28.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:00:13.843929+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:00:14.484733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:00:28.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:00:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.857+0000 7f03e0738640 1 Processor -- start 2024-05-20T18:00:28.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.857+0000 7f03e0738640 1 -- start start 2024-05-20T18:00:28.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03e0738640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03d8162820 0x7f03d80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03e0738640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f03d806dae0 0x7f03d80b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03e0738640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d80d0630 con 0x7f03d80b3e80 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03e0738640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f03d80d39c0 con 0x7f03d8162820 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03e0738640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f03d80d3ca0 con 0x7f03d806dae0 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03de4d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03d8162820 0x7f03d80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03ddcd3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f03d80b3e80 0x7f03d806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50690/0 (socket says 172.21.15.6:50690) 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03de4d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03d8162820 0x7f03d80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34386/0 (socket says 172.21.15.6:34386) 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03ddcd3640 1 -- 172.21.15.6:0/2483989395 learned_addr learned my addr 172.21.15.6:0/2483989395 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03decd5640 1 --2- 172.21.15.6:0/2483989395 >> v2:172.21.15.171:3300/0 conn(0x7f03d806dae0 0x7f03d80b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03de4d4640 1 -- 172.21.15.6:0/2483989395 >> v2:172.21.15.171:3300/0 conn(0x7f03d806dae0 msgr2=0x7f03d80b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03de4d4640 1 --2- 172.21.15.6:0/2483989395 >> v2:172.21.15.171:3300/0 conn(0x7f03d806dae0 0x7f03d80b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03de4d4640 1 -- 172.21.15.6:0/2483989395 >> v1:172.21.15.6:6789/0 conn(0x7f03d80b3e80 legacy=0x7f03d806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03dd4d2640 1 -- 172.21.15.6:0/2483989395 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915395042 0 0) 0x7f03d80d0630 con 0x7f03d80b3e80 2024-05-20T18:00:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.859+0000 7f03de4d4640 1 -- 172.21.15.6:0/2483989395 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d80d3f80 con 0x7f03d8162820 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.860+0000 7f03de4d4640 1 --2- 172.21.15.6:0/2483989395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d80b3940 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f03d808e070 tx=0x7f03d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3db35ca29e7b6a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.860+0000 7f03dd4d2640 1 -- 172.21.15.6:0/2483989395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0037070 con 0x7f03d8162820 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.860+0000 7f03dd4d2640 1 -- 172.21.15.6:0/2483989395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d0032440 con 0x7f03d8162820 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.860+0000 7f03dd4d2640 1 -- 172.21.15.6:0/2483989395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0032810 con 0x7f03d8162820 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.861+0000 7f03e0738640 1 -- 172.21.15.6:0/2483989395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 msgr2=0x7f03d80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.861+0000 7f03e0738640 1 --2- 172.21.15.6:0/2483989395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d80b3940 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f03d808e070 tx=0x7f03d002a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.861+0000 7f03e0738640 1 -- 172.21.15.6:0/2483989395 shutdown_connections 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.861+0000 7f03e0738640 1 --2- 172.21.15.6:0/2483989395 >> v2:172.21.15.171:3300/0 conn(0x7f03d806dae0 0x7f03d80b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.861+0000 7f03e0738640 1 --2- 172.21.15.6:0/2483989395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d80b3940 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.861+0000 7f03e0738640 1 -- 172.21.15.6:0/2483989395 >> 172.21.15.6:0/2483989395 conn(0x7f03d80d4bd0 msgr2=0x7f03d80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.861+0000 7f03e0738640 1 -- 172.21.15.6:0/2483989395 shutdown_connections 2024-05-20T18:00:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.861+0000 7f03e0738640 1 -- 172.21.15.6:0/2483989395 wait complete. 2024-05-20T18:00:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.863+0000 7f03e0738640 1 Processor -- start 2024-05-20T18:00:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.863+0000 7f03e0738640 1 -- start start 2024-05-20T18:00:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03e0738640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03d80b3e80 0x7f03d80c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03e0738640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03e0738640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d80cbec0 0x7f03d80ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03e0738640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f03d80d4780 con 0x7f03d8162820 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03e0738640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f03d80d0300 con 0x7f03d80cbec0 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03e0738640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f03d80d4900 con 0x7f03d80b3e80 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03ddcd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03ddcd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d81560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34396/0 (socket says 172.21.15.6:34396) 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.864+0000 7f03ddcd3640 1 -- 172.21.15.6:0/3873933429 learned_addr learned my addr 172.21.15.6:0/3873933429 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03de4d4640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03d80b3e80 0x7f03d80c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03decd5640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d80cbec0 0x7f03d80ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03ddcd3640 1 -- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03d80b3e80 msgr2=0x7f03d80c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03ddcd3640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03d80b3e80 0x7f03d80c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03ddcd3640 1 -- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d80cbec0 msgr2=0x7f03d80ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03ddcd3640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d80cbec0 0x7f03d80ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03ddcd3640 1 -- 172.21.15.6:0/3873933429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d8156630 con 0x7f03d8162820 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03ddcd3640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d81560f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00c460 tx=0x7f03cc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03d6ffd640 1 -- 172.21.15.6:0/3873933429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc018070 con 0x7f03d8162820 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03d6ffd640 1 -- 172.21.15.6:0/3873933429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03cc007500 con 0x7f03d8162820 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d80b5c90 con 0x7f03d8162820 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03d6ffd640 1 -- 172.21.15.6:0/3873933429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc004a20 con 0x7f03d8162820 2024-05-20T18:00:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.865+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d80b6250 con 0x7f03d8162820 2024-05-20T18:00:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.866+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d8162430 con 0x7f03d8162820 2024-05-20T18:00:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.867+0000 7f03d6ffd640 1 -- 172.21.15.6:0/3873933429 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03cc01b070 con 0x7f03d8162820 2024-05-20T18:00:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.867+0000 7f03d6ffd640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03c406be30 0x7f03c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.867+0000 7f03d6ffd640 1 -- 172.21.15.6:0/3873933429 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f03cc08a330 con 0x7f03d8162820 2024-05-20T18:00:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.868+0000 7f03de4d4640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03c406be30 0x7f03c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.868+0000 7f03de4d4640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03c406be30 0x7f03c406e340 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f03d0034000 tx=0x7f03d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:28.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:28.872+0000 7f03d6ffd640 1 -- 172.21.15.6:0/3873933429 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f03d8162430 con 0x7f03d8162820 2024-05-20T18:00:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.056+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f03d80bab50 con 0x7f03d8162820 2024-05-20T18:00:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.057+0000 7f03d6ffd640 1 -- 172.21.15.6:0/3873933429 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) ==== 93+0+10 (secure 0 0 0) 0x7f03d8156630 con 0x7f03d8162820 2024-05-20T18:00:29.054 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03c406be30 msgr2=0x7f03c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03c406be30 0x7f03c406e340 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f03d0034000 tx=0x7f03d002e000 comp rx=0 tx=0).stop 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 msgr2=0x7f03d81560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d81560f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00c460 tx=0x7f03cc00c920 comp rx=0 tx=0).stop 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 shutdown_connections 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f03c406be30 0x7f03c406e340 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03d80cbec0 0x7f03d80ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03d8162820 0x7f03d81560f0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 --2- 172.21.15.6:0/3873933429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03d80b3e80 0x7f03d80c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 >> 172.21.15.6:0/3873933429 conn(0x7f03d80d4bd0 msgr2=0x7f03d80ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 shutdown_connections 2024-05-20T18:00:29.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.059+0000 7f03e0738640 1 -- 172.21.15.6:0/3873933429 wait complete. 2024-05-20T18:00:29.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:00:29.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.189+0000 7fbc4df23640 1 Processor -- start 2024-05-20T18:00:29.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.189+0000 7fbc4df23640 1 -- start start 2024-05-20T18:00:29.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.190+0000 7fbc4df23640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbc48162820 0x7fbc480b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.190+0000 7fbc4df23640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 0x7fbc4806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.190+0000 7fbc4df23640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4806dd20 con 0x7fbc4806d910 2024-05-20T18:00:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.190+0000 7fbc4df23640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbc480d0630 con 0x7fbc48162820 2024-05-20T18:00:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.190+0000 7fbc4df23640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbc480d39c0 con 0x7fbc480b3e80 2024-05-20T18:00:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.191+0000 7fbc477fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbc48162820 0x7fbc480b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.191+0000 7fbc47fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fbc4806d910 0x7fbc480d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:58028/0 (socket says 172.21.15.6:58028) 2024-05-20T18:00:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.191+0000 7fbc47fff640 1 -- 172.21.15.6:0/2550007004 learned_addr learned my addr 172.21.15.6:0/2550007004 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.191+0000 7fbc46ffd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 0x7fbc4806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.191+0000 7fbc477fe640 1 -- 172.21.15.6:0/2550007004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 msgr2=0x7fbc4806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.191+0000 7fbc477fe640 1 --2- 172.21.15.6:0/2550007004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 0x7fbc4806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.191+0000 7fbc477fe640 1 -- 172.21.15.6:0/2550007004 >> v1:172.21.15.171:6789/0 conn(0x7fbc4806d910 legacy=0x7fbc480d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.191+0000 7fbc477fe640 1 -- 172.21.15.6:0/2550007004 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc480d3ca0 con 0x7fbc48162820 2024-05-20T18:00:29.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.192+0000 7fbc477fe640 1 --2- 172.21.15.6:0/2550007004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc48162820 0x7fbc480b3940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc380097a0 tx=0x7fbc3802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dea6d69bbc255fc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.192+0000 7fbc467fc640 1 -- 172.21.15.6:0/2550007004 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38037070 con 0x7fbc48162820 2024-05-20T18:00:29.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.192+0000 7fbc467fc640 1 -- 172.21.15.6:0/2550007004 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc38032440 con 0x7fbc48162820 2024-05-20T18:00:29.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.192+0000 7fbc467fc640 1 -- 172.21.15.6:0/2550007004 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38032810 con 0x7fbc48162820 2024-05-20T18:00:29.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.193+0000 7fbc4df23640 1 -- 172.21.15.6:0/2550007004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc48162820 msgr2=0x7fbc480b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.193+0000 7fbc4df23640 1 --2- 172.21.15.6:0/2550007004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc48162820 0x7fbc480b3940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc380097a0 tx=0x7fbc3802a180 comp rx=0 tx=0).stop 2024-05-20T18:00:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.193+0000 7fbc4df23640 1 -- 172.21.15.6:0/2550007004 shutdown_connections 2024-05-20T18:00:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.193+0000 7fbc4df23640 1 --2- 172.21.15.6:0/2550007004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 0x7fbc4806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.193+0000 7fbc4df23640 1 --2- 172.21.15.6:0/2550007004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc48162820 0x7fbc480b3940 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.193+0000 7fbc4df23640 1 -- 172.21.15.6:0/2550007004 >> 172.21.15.6:0/2550007004 conn(0x7fbc480d4bd0 msgr2=0x7fbc480d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.193+0000 7fbc4df23640 1 -- 172.21.15.6:0/2550007004 shutdown_connections 2024-05-20T18:00:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.193+0000 7fbc4df23640 1 -- 172.21.15.6:0/2550007004 wait complete. 2024-05-20T18:00:29.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.195+0000 7fbc4df23640 1 Processor -- start 2024-05-20T18:00:29.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.195+0000 7fbc4df23640 1 -- start start 2024-05-20T18:00:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc4df23640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4806d910 0x7fbc48160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc4df23640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 0x7fbc48157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc4df23640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48162820 0x7fbc480b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc4df23640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc480d0300 con 0x7fbc48162820 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc4df23640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbc480d4260 con 0x7fbc4806d910 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc4df23640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbc480b91a0 con 0x7fbc480b3e80 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48162820 0x7fbc480b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48162820 0x7fbc480b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34412/0 (socket says 172.21.15.6:34412) 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc47fff640 1 -- 172.21.15.6:0/4104386253 learned_addr learned my addr 172.21.15.6:0/4104386253 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc477fe640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4806d910 0x7fbc48160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.196+0000 7fbc46ffd640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 0x7fbc48157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.197+0000 7fbc47fff640 1 -- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 msgr2=0x7fbc48157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.197+0000 7fbc47fff640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 0x7fbc48157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.197+0000 7fbc47fff640 1 -- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4806d910 msgr2=0x7fbc48160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.197+0000 7fbc47fff640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4806d910 0x7fbc48160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.197+0000 7fbc47fff640 1 -- 172.21.15.6:0/4104386253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc48160ba0 con 0x7fbc48162820 2024-05-20T18:00:29.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.197+0000 7fbc47fff640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48162820 0x7fbc480b4630 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000caa0 tx=0x7fbc4000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.199+0000 7fbc2ffff640 1 -- 172.21.15.6:0/4104386253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40017070 con 0x7fbc48162820 2024-05-20T18:00:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.199+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc481f56b0 con 0x7fbc48162820 2024-05-20T18:00:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.199+0000 7fbc2ffff640 1 -- 172.21.15.6:0/4104386253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4000ac00 con 0x7fbc48162820 2024-05-20T18:00:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.199+0000 7fbc2ffff640 1 -- 172.21.15.6:0/4104386253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40012400 con 0x7fbc48162820 2024-05-20T18:00:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.199+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc481f5950 con 0x7fbc48162820 2024-05-20T18:00:29.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.200+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc48160630 con 0x7fbc48162820 2024-05-20T18:00:29.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.201+0000 7fbc2ffff640 1 -- 172.21.15.6:0/4104386253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc4001a070 con 0x7fbc48162820 2024-05-20T18:00:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.202+0000 7fbc2ffff640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3406be30 0x7fbc3406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.202+0000 7fbc2ffff640 1 -- 172.21.15.6:0/4104386253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fbc4008ac70 con 0x7fbc48162820 2024-05-20T18:00:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.202+0000 7fbc477fe640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3406be30 0x7fbc3406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.202+0000 7fbc477fe640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3406be30 0x7fbc3406e340 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbc38034000 tx=0x7fbc3802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.206+0000 7fbc2ffff640 1 -- 172.21.15.6:0/4104386253 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc4806dd20 con 0x7fbc48162820 2024-05-20T18:00:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.390+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbc48075b00 con 0x7fbc48162820 2024-05-20T18:00:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.390+0000 7fbc2ffff640 1 -- 172.21.15.6:0/4104386253 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) ==== 104+0+11 (secure 0 0 0) 0x7fbc40058d30 con 0x7fbc48162820 2024-05-20T18:00:29.388 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:00:29.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3406be30 msgr2=0x7fbc3406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3406be30 0x7fbc3406e340 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbc38034000 tx=0x7fbc3802e000 comp rx=0 tx=0).stop 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48162820 msgr2=0x7fbc480b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48162820 0x7fbc480b4630 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000caa0 tx=0x7fbc4000cf60 comp rx=0 tx=0).stop 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 shutdown_connections 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3406be30 0x7fbc3406e340 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc48162820 0x7fbc480b4630 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc480b3e80 0x7fbc48157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 --2- 172.21.15.6:0/4104386253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4806d910 0x7fbc48160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 >> 172.21.15.6:0/4104386253 conn(0x7fbc480d4bd0 msgr2=0x7fbc480d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 shutdown_connections 2024-05-20T18:00:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.392+0000 7fbc4df23640 1 -- 172.21.15.6:0/4104386253 wait complete. 2024-05-20T18:00:29.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:00:29.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.521+0000 7f91457cc640 1 Processor -- start 2024-05-20T18:00:29.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.521+0000 7f91457cc640 1 -- start start 2024-05-20T18:00:29.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f91457cc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9140162820 0x7f91400b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f91457cc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91400d0630 con 0x7f914006dae0 2024-05-20T18:00:29.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f91457cc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91400d39c0 con 0x7f91400b3e80 2024-05-20T18:00:29.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f91457cc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f91400d3ca0 con 0x7f9140162820 2024-05-20T18:00:29.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f914006dae0 0x7f91400b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50698/0 (socket says 172.21.15.6:50698) 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913f7fe640 1 -- 172.21.15.6:0/4152417764 learned_addr learned my addr 172.21.15.6:0/4152417764 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913effd640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9140162820 0x7f91400b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742864845 0 0) 0x7f91400d0630 con 0x7f914006dae0 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9128003520 con 0x7f914006dae0 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922854130 0 0) 0x7f91400d39c0 con 0x7f91400b3e80 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91400d0630 con 0x7f91400b3e80 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2811811450 0 0) 0x7f9128003520 con 0x7f914006dae0 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9140162820 msgr2=0x7f91400b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9140162820 0x7f91400b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 >> v1:172.21.15.171:6789/0 conn(0x7f91400b3e80 legacy=0x7f914006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91400d3f80 con 0x7f914006dae0 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.523+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f9138001670 con 0x7f914006dae0 2024-05-20T18:00:29.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 >> v1:172.21.15.6:6789/0 conn(0x7f914006dae0 legacy=0x7f91400b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913dffb640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9140162820 0x7f9128003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913dffb640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9128004120 0x7f9128004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913dffb640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9128004d40 0x7f9128005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f91400d3ca0 con 0x7f9128004120 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f912800bb80 con 0x7f9128004d40 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f912800bd80 con 0x7f9140162820 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913e7fc640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9128004120 0x7f9128004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913effd640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9140162820 0x7f9128003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913f7fe640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9128004d40 0x7f9128005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913e7fc640 1 -- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9140162820 msgr2=0x7f9128003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913e7fc640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9140162820 0x7f9128003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913e7fc640 1 -- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9128004d40 msgr2=0x7f9128005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:29.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913e7fc640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9128004d40 0x7f9128005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.524+0000 7f913e7fc640 1 -- 172.21.15.6:0/4152417764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9128003520 con 0x7f9128004120 2024-05-20T18:00:29.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.525+0000 7f913e7fc640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9128004120 0x7f9128004800 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f91340018a0 tx=0x7f9128005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712f3d60e4121d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.525+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91340014f0 con 0x7f9128004120 2024-05-20T18:00:29.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.525+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91340052d0 con 0x7f9128004120 2024-05-20T18:00:29.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.525+0000 7f913dffb640 1 -- 172.21.15.6:0/4152417764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913402ac60 con 0x7f9128004120 2024-05-20T18:00:29.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.526+0000 7f91457cc640 1 -- 172.21.15.6:0/4152417764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9128004120 msgr2=0x7f9128004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.526+0000 7f91457cc640 1 --2- 172.21.15.6:0/4152417764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9128004120 0x7f9128004800 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f91340018a0 tx=0x7f9128005830 comp rx=0 tx=0).stop 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.526+0000 7f913f7fe640 1 -- 172.21.15.6:0/4152417764 reap_dead start 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.526+0000 7f91457cc640 1 -- 172.21.15.6:0/4152417764 shutdown_connections 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.526+0000 7f91457cc640 1 -- 172.21.15.6:0/4152417764 >> 172.21.15.6:0/4152417764 conn(0x7f91400d4bd0 msgr2=0x7f91400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.526+0000 7f91457cc640 1 -- 172.21.15.6:0/4152417764 shutdown_connections 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.526+0000 7f91457cc640 1 -- 172.21.15.6:0/4152417764 wait complete. 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.528+0000 7f91457cc640 1 Processor -- start 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.528+0000 7f91457cc640 1 -- start start 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f91457cc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9128004120 0x7f91400cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f91457cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91401f4630 0x7f91400b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f91457cc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91401612e0 0x7f91401616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f91457cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f91400d4780 con 0x7f91401f4630 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f91457cc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f91400d0300 con 0x7f91401612e0 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f91457cc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f91400d4900 con 0x7f9128004120 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f913e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91401f4630 0x7f91400b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f913e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91401f4630 0x7f91400b6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34428/0 (socket says 172.21.15.6:34428) 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f913e7fc640 1 -- 172.21.15.6:0/4079244458 learned_addr learned my addr 172.21.15.6:0/4079244458 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f913effd640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9128004120 0x7f91400cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.529+0000 7f913f7fe640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91401612e0 0x7f91401616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f913e7fc640 1 -- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9128004120 msgr2=0x7f91400cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f913e7fc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9128004120 0x7f91400cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f913e7fc640 1 -- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91401612e0 msgr2=0x7f91401616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f913e7fc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91401612e0 0x7f91401616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f913e7fc640 1 -- 172.21.15.6:0/4079244458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91400c87a0 con 0x7f91401f4630 2024-05-20T18:00:29.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f913e7fc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91401f4630 0x7f91400b6280 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f913402a6f0 tx=0x7f91340012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f91277fe640 1 -- 172.21.15.6:0/4079244458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913403f020 con 0x7f91401f4630 2024-05-20T18:00:29.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f91277fe640 1 -- 172.21.15.6:0/4079244458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9134006e50 con 0x7f91401f4630 2024-05-20T18:00:29.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9140161c30 con 0x7f91401f4630 2024-05-20T18:00:29.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f91277fe640 1 -- 172.21.15.6:0/4079244458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134037040 con 0x7f91401f4630 2024-05-20T18:00:29.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.530+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91401f8890 con 0x7f91401f4630 2024-05-20T18:00:29.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.531+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9140075b00 con 0x7f91401f4630 2024-05-20T18:00:29.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.532+0000 7f91277fe640 1 -- 172.21.15.6:0/4079244458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9134042020 con 0x7f91401f4630 2024-05-20T18:00:29.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.532+0000 7f91277fe640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f912c06be30 0x7f912c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.532+0000 7f91277fe640 1 -- 172.21.15.6:0/4079244458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f91340aac60 con 0x7f91401f4630 2024-05-20T18:00:29.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.533+0000 7f913effd640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f912c06be30 0x7f912c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.533+0000 7f913effd640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f912c06be30 0x7f912c06e340 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9130014430 tx=0x7f913000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.537+0000 7f91277fe640 1 -- 172.21.15.6:0/4079244458 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9134049030 con 0x7f91401f4630 2024-05-20T18:00:29.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.723+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91401f8340 con 0x7f91401f4630 2024-05-20T18:00:29.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.724+0000 7f91277fe640 1 -- 172.21.15.6:0/4079244458 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) ==== 100+0+11 (secure 0 0 0) 0x7f9140161c30 con 0x7f91401f4630 2024-05-20T18:00:29.721 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f912c06be30 msgr2=0x7f912c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f912c06be30 0x7f912c06e340 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9130014430 tx=0x7f913000b040 comp rx=0 tx=0).stop 2024-05-20T18:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91401f4630 msgr2=0x7f91400b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91401f4630 0x7f91400b6280 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f913402a6f0 tx=0x7f91340012d0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 shutdown_connections 2024-05-20T18:00:29.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f912c06be30 0x7f912c06e340 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91401612e0 0x7f91401616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91401f4630 0x7f91400b6280 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 --2- 172.21.15.6:0/4079244458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9128004120 0x7f91400cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 >> 172.21.15.6:0/4079244458 conn(0x7f91400d4bd0 msgr2=0x7f9140155250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 shutdown_connections 2024-05-20T18:00:29.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.726+0000 7f91457cc640 1 -- 172.21.15.6:0/4079244458 wait complete. 2024-05-20T18:00:29.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:29.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.852+0000 7f32ef856640 1 Processor -- start 2024-05-20T18:00:29.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.852+0000 7f32ef856640 1 -- start start 2024-05-20T18:00:29.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.853+0000 7f32ef856640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32e80cd680 0x7f32e815f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.853+0000 7f32ef856640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f32e806c6c0 0x7f32e806cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.853+0000 7f32ef856640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e806d0f0 con 0x7f32e80cf3d0 2024-05-20T18:00:29.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.853+0000 7f32ef856640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f32e80cda90 con 0x7f32e80cd680 2024-05-20T18:00:29.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.853+0000 7f32ef856640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f32e815f760 con 0x7f32e806c6c0 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32ed5f2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32e80cd680 0x7f32e815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32eddf3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f32e80cf3d0 0x7f32e80cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50700/0 (socket says 172.21.15.6:50700) 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32eddf3640 1 -- 172.21.15.6:0/3364239740 learned_addr learned my addr 172.21.15.6:0/3364239740 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32ecdf1640 1 --2- 172.21.15.6:0/3364239740 >> v2:172.21.15.171:3300/0 conn(0x7f32e806c6c0 0x7f32e806cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32ed5f2640 1 -- 172.21.15.6:0/3364239740 >> v2:172.21.15.171:3300/0 conn(0x7f32e806c6c0 msgr2=0x7f32e806cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32ed5f2640 1 --2- 172.21.15.6:0/3364239740 >> v2:172.21.15.171:3300/0 conn(0x7f32e806c6c0 0x7f32e806cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32ed5f2640 1 -- 172.21.15.6:0/3364239740 >> v1:172.21.15.6:6789/0 conn(0x7f32e80cf3d0 legacy=0x7f32e80cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32dffff640 1 -- 172.21.15.6:0/3364239740 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657632744 0 0) 0x7f32e806d0f0 con 0x7f32e80cf3d0 2024-05-20T18:00:29.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.854+0000 7f32ed5f2640 1 -- 172.21.15.6:0/3364239740 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e806d3d0 con 0x7f32e80cd680 2024-05-20T18:00:29.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.855+0000 7f32ed5f2640 1 --2- 172.21.15.6:0/3364239740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e80cd680 0x7f32e815f220 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f32e8070110 tx=0x7f32e402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36ed2d013ed2bf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.855+0000 7f32dffff640 1 -- 172.21.15.6:0/3364239740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4037070 con 0x7f32e80cd680 2024-05-20T18:00:29.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.855+0000 7f32dffff640 1 -- 172.21.15.6:0/3364239740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e402adc0 con 0x7f32e80cd680 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.855+0000 7f32dffff640 1 -- 172.21.15.6:0/3364239740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4032660 con 0x7f32e80cd680 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.856+0000 7f32ef856640 1 -- 172.21.15.6:0/3364239740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e80cd680 msgr2=0x7f32e815f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.856+0000 7f32ef856640 1 --2- 172.21.15.6:0/3364239740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e80cd680 0x7f32e815f220 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f32e8070110 tx=0x7f32e402a0b0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.856+0000 7f32ef856640 1 -- 172.21.15.6:0/3364239740 shutdown_connections 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.856+0000 7f32ef856640 1 --2- 172.21.15.6:0/3364239740 >> v2:172.21.15.171:3300/0 conn(0x7f32e806c6c0 0x7f32e806cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.856+0000 7f32ef856640 1 --2- 172.21.15.6:0/3364239740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e80cd680 0x7f32e815f220 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.856+0000 7f32ef856640 1 -- 172.21.15.6:0/3364239740 >> 172.21.15.6:0/3364239740 conn(0x7f32e80b44d0 msgr2=0x7f32e80b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.856+0000 7f32ef856640 1 -- 172.21.15.6:0/3364239740 shutdown_connections 2024-05-20T18:00:29.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.856+0000 7f32ef856640 1 -- 172.21.15.6:0/3364239740 wait complete. 2024-05-20T18:00:29.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.857+0000 7f32ef856640 1 Processor -- start 2024-05-20T18:00:29.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.858+0000 7f32ef856640 1 -- start start 2024-05-20T18:00:29.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ef856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e806c6c0 0x7f32e81595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ef856640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32e80cd680 0x7f32e815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ef856640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e80cf3d0 0x7f32e81f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ef856640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f32e806d990 con 0x7f32e806c6c0 2024-05-20T18:00:29.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ef856640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32e806d750 con 0x7f32e80cf3d0 2024-05-20T18:00:29.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ef856640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32e80d2460 con 0x7f32e80cd680 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ed5f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e806c6c0 0x7f32e81595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ed5f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e806c6c0 0x7f32e81595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34448/0 (socket says 172.21.15.6:34448) 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ed5f2640 1 -- 172.21.15.6:0/1324505525 learned_addr learned my addr 172.21.15.6:0/1324505525 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32eddf3640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e80cf3d0 0x7f32e81f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ecdf1640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32e80cd680 0x7f32e815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ed5f2640 1 -- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32e80cd680 msgr2=0x7f32e815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ed5f2640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32e80cd680 0x7f32e815b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ed5f2640 1 -- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e80cf3d0 msgr2=0x7f32e81f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ed5f2640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e80cf3d0 0x7f32e81f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.859+0000 7f32ed5f2640 1 -- 172.21.15.6:0/1324505525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e815c180 con 0x7f32e806c6c0 2024-05-20T18:00:29.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.860+0000 7f32ed5f2640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e806c6c0 0x7f32e81595c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f32e40098c0 tx=0x7f32e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.860+0000 7f32ddffb640 1 -- 172.21.15.6:0/1324505525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4037040 con 0x7f32e806c6c0 2024-05-20T18:00:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.860+0000 7f32ddffb640 1 -- 172.21.15.6:0/1324505525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e403b430 con 0x7f32e806c6c0 2024-05-20T18:00:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.860+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e815c460 con 0x7f32e806c6c0 2024-05-20T18:00:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.860+0000 7f32ddffb640 1 -- 172.21.15.6:0/1324505525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e403b800 con 0x7f32e806c6c0 2024-05-20T18:00:29.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.860+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e815bdb0 con 0x7f32e806c6c0 2024-05-20T18:00:29.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.861+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e8075b00 con 0x7f32e806c6c0 2024-05-20T18:00:29.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.862+0000 7f32ddffb640 1 -- 172.21.15.6:0/1324505525 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32e4044020 con 0x7f32e806c6c0 2024-05-20T18:00:29.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.862+0000 7f32ddffb640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32cc06be30 0x7f32cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:29.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.862+0000 7f32ddffb640 1 -- 172.21.15.6:0/1324505525 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f32e40aaeb0 con 0x7f32e806c6c0 2024-05-20T18:00:29.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.863+0000 7f32ecdf1640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32cc06be30 0x7f32cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:29.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.863+0000 7f32ecdf1640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32cc06be30 0x7f32cc06e340 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f32d8006fd0 tx=0x7f32d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:29.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:29.867+0000 7f32ddffb640 1 -- 172.21.15.6:0/1324505525 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f32e40796c0 con 0x7f32e806c6c0 2024-05-20T18:00:30.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.092+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32e80b8940 con 0x7f32e806c6c0 2024-05-20T18:00:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.093+0000 7f32ddffb640 1 -- 172.21.15.6:0/1324505525 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5180 (secure 0 0 0) 0x7f32e4078fc0 con 0x7f32e806c6c0 2024-05-20T18:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6413,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2288332461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2288332461},{"type":"v1","addr":"172.21.15.171:6835","nonce":2288332461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/4138789955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4138789955},{"type":"v1","addr":"172.21.15.171:6837","nonce":4138789955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2834528553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2834528553},{"type":"v1","addr":"172.21.15.6:6835","nonce":2834528553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:15.507163+0000","modified":"2024-05-20T18:00:18.526380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7725":{"gid":7725,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6834/957433228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":957433228},{"type":"v1","addr":"172.21.15.6:6834","nonce":957433228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7725,"qdb_cluster":[7725]},"id":7}]} 2024-05-20T18:00:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2024-05-20T18:00:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32cc06be30 msgr2=0x7f32cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32cc06be30 0x7f32cc06e340 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f32d8006fd0 tx=0x7f32d8008040 comp rx=0 tx=0).stop 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e806c6c0 msgr2=0x7f32e81595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e806c6c0 0x7f32e81595c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f32e40098c0 tx=0x7f32e40046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 shutdown_connections 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f32cc06be30 0x7f32cc06e340 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e80cf3d0 0x7f32e81f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32e80cd680 0x7f32e815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 --2- 172.21.15.6:0/1324505525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32e806c6c0 0x7f32e81595c0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 >> 172.21.15.6:0/1324505525 conn(0x7f32e80b44d0 msgr2=0x7f32e80d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 shutdown_connections 2024-05-20T18:00:30.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.095+0000 7f32ef856640 1 -- 172.21.15.6:0/1324505525 wait complete. 2024-05-20T18:00:30.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:30.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.222+0000 7f20978a8640 1 Processor -- start 2024-05-20T18:00:30.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.222+0000 7f20978a8640 1 -- start start 2024-05-20T18:00:30.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.223+0000 7f20978a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20900b2f10 0x7f20900d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.223+0000 7f20978a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 0x7f209015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.223+0000 7f20978a8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209015e6b0 con 0x7f209006d290 2024-05-20T18:00:30.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.223+0000 7f20978a8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f20900d2400 con 0x7f20900b2f10 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.223+0000 7f20978a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f20900d1a30 con 0x7f209015d940 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.224+0000 7f2095644640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20900b2f10 0x7f20900d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.224+0000 7f2095644640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20900b2f10 0x7f20900d1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34462/0 (socket says 172.21.15.6:34462) 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.224+0000 7f2095644640 1 -- 172.21.15.6:0/1248232656 learned_addr learned my addr 172.21.15.6:0/1248232656 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.224+0000 7f2095e45640 1 --2- 172.21.15.6:0/1248232656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 0x7f209015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.224+0000 7f2095644640 1 -- 172.21.15.6:0/1248232656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 msgr2=0x7f209015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.224+0000 7f2095644640 1 --2- 172.21.15.6:0/1248232656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 0x7f209015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.224+0000 7f2095644640 1 -- 172.21.15.6:0/1248232656 >> v1:172.21.15.171:6789/0 conn(0x7f209006d290 legacy=0x7f209006d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.224+0000 7f2095644640 1 -- 172.21.15.6:0/1248232656 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20900d1100 con 0x7f20900b2f10 2024-05-20T18:00:30.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.225+0000 7f2095644640 1 --2- 172.21.15.6:0/1248232656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f20900d1ec0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f208c009870 tx=0x7f208c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a3c5d8ed98aa6f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.225+0000 7f2087fff640 1 -- 172.21.15.6:0/1248232656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c037070 con 0x7f20900b2f10 2024-05-20T18:00:30.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.225+0000 7f2087fff640 1 -- 172.21.15.6:0/1248232656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c032440 con 0x7f20900b2f10 2024-05-20T18:00:30.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.225+0000 7f2087fff640 1 -- 172.21.15.6:0/1248232656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c032810 con 0x7f20900b2f10 2024-05-20T18:00:30.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.225+0000 7f20978a8640 1 -- 172.21.15.6:0/1248232656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 msgr2=0x7f20900d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.226+0000 7f20978a8640 1 --2- 172.21.15.6:0/1248232656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f20900d1ec0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f208c009870 tx=0x7f208c02a1c0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.226+0000 7f20978a8640 1 -- 172.21.15.6:0/1248232656 shutdown_connections 2024-05-20T18:00:30.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.226+0000 7f20978a8640 1 --2- 172.21.15.6:0/1248232656 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 0x7f209015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.226+0000 7f20978a8640 1 --2- 172.21.15.6:0/1248232656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f20900d1ec0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.226+0000 7f20978a8640 1 -- 172.21.15.6:0/1248232656 >> 172.21.15.6:0/1248232656 conn(0x7f20900b6670 msgr2=0x7f20900b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:30.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.226+0000 7f20978a8640 1 -- 172.21.15.6:0/1248232656 shutdown_connections 2024-05-20T18:00:30.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.226+0000 7f20978a8640 1 -- 172.21.15.6:0/1248232656 wait complete. 2024-05-20T18:00:30.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.227+0000 7f20978a8640 1 Processor -- start 2024-05-20T18:00:30.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.227+0000 7f20978a8640 1 -- start start 2024-05-20T18:00:30.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f20978a8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209006d290 0x7f20901563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f20978a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f209009f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f20978a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 0x7f209009ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f20978a8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f20900d16c0 con 0x7f20900b2f10 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f20978a8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f20900b3320 con 0x7f209006d290 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f20978a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f209015e290 con 0x7f209015d940 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f209009f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f209009f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34466/0 (socket says 172.21.15.6:34466) 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 -- 172.21.15.6:0/1358858008 learned_addr learned my addr 172.21.15.6:0/1358858008 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2095644640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209006d290 0x7f20901563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2095e45640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 0x7f209009ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 -- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 msgr2=0x7f209009ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 0x7f209009ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 -- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209006d290 msgr2=0x7f20901563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209006d290 0x7f20901563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 -- 172.21.15.6:0/1358858008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209009f5d0 con 0x7f20900b2f10 2024-05-20T18:00:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.229+0000 7f2094e43640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f209009f090 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f208000c3c0 tx=0x7f208000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.230+0000 7f2085ffb640 1 -- 172.21.15.6:0/1358858008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20800052d0 con 0x7f20900b2f10 2024-05-20T18:00:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.230+0000 7f2085ffb640 1 -- 172.21.15.6:0/1358858008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2080005490 con 0x7f20900b2f10 2024-05-20T18:00:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.230+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2090155630 con 0x7f20900b2f10 2024-05-20T18:00:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.230+0000 7f2085ffb640 1 -- 172.21.15.6:0/1358858008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080006a20 con 0x7f20900b2f10 2024-05-20T18:00:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.230+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2090155bf0 con 0x7f20900b2f10 2024-05-20T18:00:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.231+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2090075b00 con 0x7f20900b2f10 2024-05-20T18:00:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.231+0000 7f2085ffb640 1 -- 172.21.15.6:0/1358858008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2080003640 con 0x7f20900b2f10 2024-05-20T18:00:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.232+0000 7f2085ffb640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f207406be60 0x7f207406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.232+0000 7f2085ffb640 1 -- 172.21.15.6:0/1358858008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f208008a410 con 0x7f20900b2f10 2024-05-20T18:00:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.232+0000 7f2095644640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f207406be60 0x7f207406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.233+0000 7f2095644640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f207406be60 0x7f207406e370 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f208c034000 tx=0x7f208c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.236+0000 7f2085ffb640 1 -- 172.21.15.6:0/1358858008 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2080058550 con 0x7f20900b2f10 2024-05-20T18:00:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.421+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f209009f7a0 con 0x7f20900b2f10 2024-05-20T18:00:30.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.423+0000 7f2085ffb640 1 -- 172.21.15.6:0/1358858008 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16828 (secure 0 0 0) 0x7f208005c850 con 0x7f20900b2f10 2024-05-20T18:00:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:30.420 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":101,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:17.119205+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:13.843929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:14.484733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f207406be60 msgr2=0x7f207406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f207406be60 0x7f207406e370 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f208c034000 tx=0x7f208c02e000 comp rx=0 tx=0).stop 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 msgr2=0x7f209009f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f209009f090 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f208000c3c0 tx=0x7f208000c880 comp rx=0 tx=0).stop 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 shutdown_connections 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f207406be60 0x7f207406e370 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f209015d940 0x7f209009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20900b2f10 0x7f209009f090 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 --2- 172.21.15.6:0/1358858008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f209006d290 0x7f20901563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 >> 172.21.15.6:0/1358858008 conn(0x7f20900b6670 msgr2=0x7f20900d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 shutdown_connections 2024-05-20T18:00:30.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.425+0000 7f20978a8640 1 -- 172.21.15.6:0/1358858008 wait complete. 2024-05-20T18:00:30.434 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T18:00:30.434 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.552+0000 7f9f57ee9640 1 Processor -- start 2024-05-20T18:00:30.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.552+0000 7f9f57ee9640 1 -- start start 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f57ee9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 0x7f9f500b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f57ee9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f5006dae0 0x7f9f500b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f57ee9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f500d0630 con 0x7f9f500b3e80 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f57ee9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9f500d39c0 con 0x7f9f5006dae0 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f57ee9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f500d3ca0 con 0x7f9f50162820 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f56486640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f5006dae0 0x7f9f500b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f55484640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9f500b3e80 0x7f9f5006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50708/0 (socket says 172.21.15.6:50708) 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f55484640 1 -- 172.21.15.6:0/457570241 learned_addr learned my addr 172.21.15.6:0/457570241 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f56486640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f5006dae0 0x7f9f500b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34468/0 (socket says 172.21.15.6:34468) 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f55c85640 1 --2- 172.21.15.6:0/457570241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 0x7f9f500b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f56486640 1 -- 172.21.15.6:0/457570241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 msgr2=0x7f9f500b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:30.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f56486640 1 --2- 172.21.15.6:0/457570241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 0x7f9f500b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f56486640 1 -- 172.21.15.6:0/457570241 >> v1:172.21.15.6:6789/0 conn(0x7f9f500b3e80 legacy=0x7f9f5006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f54c83640 1 -- 172.21.15.6:0/457570241 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18365369 0 0) 0x7f9f500d0630 con 0x7f9f500b3e80 2024-05-20T18:00:30.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.554+0000 7f9f56486640 1 -- 172.21.15.6:0/457570241 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f500d3f80 con 0x7f9f5006dae0 2024-05-20T18:00:30.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.555+0000 7f9f56486640 1 --2- 172.21.15.6:0/457570241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5006dae0 0x7f9f500b8190 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009d90 tx=0x7f9f4802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2135c5e41e08734 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.555+0000 7f9f54c83640 1 -- 172.21.15.6:0/457570241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48007740 con 0x7f9f5006dae0 2024-05-20T18:00:30.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.555+0000 7f9f54c83640 1 -- 172.21.15.6:0/457570241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f480078e0 con 0x7f9f5006dae0 2024-05-20T18:00:30.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.555+0000 7f9f54c83640 1 -- 172.21.15.6:0/457570241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48007cb0 con 0x7f9f5006dae0 2024-05-20T18:00:30.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.556+0000 7f9f57ee9640 1 -- 172.21.15.6:0/457570241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5006dae0 msgr2=0x7f9f500b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.556+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/457570241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5006dae0 0x7f9f500b8190 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009d90 tx=0x7f9f4802a660 comp rx=0 tx=0).stop 2024-05-20T18:00:30.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.556+0000 7f9f57ee9640 1 -- 172.21.15.6:0/457570241 shutdown_connections 2024-05-20T18:00:30.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.556+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/457570241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5006dae0 0x7f9f500b8190 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.556+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/457570241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 0x7f9f500b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.556+0000 7f9f57ee9640 1 -- 172.21.15.6:0/457570241 >> 172.21.15.6:0/457570241 conn(0x7f9f500d4bd0 msgr2=0x7f9f500d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:30.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.556+0000 7f9f57ee9640 1 -- 172.21.15.6:0/457570241 shutdown_connections 2024-05-20T18:00:30.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.556+0000 7f9f57ee9640 1 -- 172.21.15.6:0/457570241 wait complete. 2024-05-20T18:00:30.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.558+0000 7f9f57ee9640 1 Processor -- start 2024-05-20T18:00:30.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.558+0000 7f9f57ee9640 1 -- start start 2024-05-20T18:00:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f57ee9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f500b3e80 0x7f9f500b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f57ee9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 0x7f9f5015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f57ee9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f500b5040 0x7f9f5015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f57ee9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f500d4780 con 0x7f9f500b3e80 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f57ee9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f500d0300 con 0x7f9f500b5040 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f57ee9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f500d4900 con 0x7f9f50162820 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f55c85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f500b3e80 0x7f9f500b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f55c85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f500b3e80 0x7f9f500b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34478/0 (socket says 172.21.15.6:34478) 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f55c85640 1 -- 172.21.15.6:0/3059488501 learned_addr learned my addr 172.21.15.6:0/3059488501 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f55484640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 0x7f9f5015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f55c85640 1 -- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 msgr2=0x7f9f5015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f56486640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f500b5040 0x7f9f5015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f55c85640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 0x7f9f5015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.559+0000 7f9f55c85640 1 -- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f500b5040 msgr2=0x7f9f5015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.560+0000 7f9f55c85640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f500b5040 0x7f9f5015aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.560+0000 7f9f55c85640 1 -- 172.21.15.6:0/3059488501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f500ceae0 con 0x7f9f500b3e80 2024-05-20T18:00:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.560+0000 7f9f55c85640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f500b3e80 0x7f9f500b6cf0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00e8a0 tx=0x7f9f4c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.560+0000 7f9f467fc640 1 -- 172.21.15.6:0/3059488501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c017070 con 0x7f9f500b3e80 2024-05-20T18:00:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.560+0000 7f9f467fc640 1 -- 172.21.15.6:0/3059488501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00c940 con 0x7f9f500b3e80 2024-05-20T18:00:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.560+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f500ccca0 con 0x7f9f500b3e80 2024-05-20T18:00:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.560+0000 7f9f467fc640 1 -- 172.21.15.6:0/3059488501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00cd30 con 0x7f9f500b3e80 2024-05-20T18:00:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.560+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f500cd260 con 0x7f9f500b3e80 2024-05-20T18:00:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.561+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f50075b00 con 0x7f9f500b3e80 2024-05-20T18:00:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.561+0000 7f9f467fc640 1 -- 172.21.15.6:0/3059488501 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f4c01a070 con 0x7f9f500b3e80 2024-05-20T18:00:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.562+0000 7f9f467fc640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f3406be60 0x7f9f3406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.562+0000 7f9f467fc640 1 -- 172.21.15.6:0/3059488501 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f9f4c08b250 con 0x7f9f500b3e80 2024-05-20T18:00:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.562+0000 7f9f55484640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f3406be60 0x7f9f3406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.563+0000 7f9f55484640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f3406be60 0x7f9f3406e370 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f500b3980 tx=0x7f9f40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.566+0000 7f9f467fc640 1 -- 172.21.15.6:0/3059488501 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f4c0599e0 con 0x7f9f500b3e80 2024-05-20T18:00:30.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.788+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f501e8d50 con 0x7f9f500b3e80 2024-05-20T18:00:30.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.788+0000 7f9f467fc640 1 -- 172.21.15.6:0/3059488501 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5180 (secure 0 0 0) 0x7f9f4c0592e0 con 0x7f9f500b3e80 2024-05-20T18:00:30.786 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:30.786 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6413,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2288332461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2288332461},{"type":"v1","addr":"172.21.15.171:6835","nonce":2288332461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/4138789955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4138789955},{"type":"v1","addr":"172.21.15.171:6837","nonce":4138789955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2834528553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2834528553},{"type":"v1","addr":"172.21.15.6:6835","nonce":2834528553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:15.507163+0000","modified":"2024-05-20T18:00:18.526380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7725":{"gid":7725,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6834/957433228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":957433228},{"type":"v1","addr":"172.21.15.6:6834","nonce":957433228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7725,"qdb_cluster":[7725]},"id":7}]} 2024-05-20T18:00:30.786 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2024-05-20T18:00:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.790+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f3406be60 msgr2=0x7f9f3406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.790+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f3406be60 0x7f9f3406e370 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f500b3980 tx=0x7f9f40009040 comp rx=0 tx=0).stop 2024-05-20T18:00:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f500b3e80 msgr2=0x7f9f500b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f500b3e80 0x7f9f500b6cf0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00e8a0 tx=0x7f9f4c00ed60 comp rx=0 tx=0).stop 2024-05-20T18:00:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 shutdown_connections 2024-05-20T18:00:30.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f3406be60 0x7f9f3406e370 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f500b5040 0x7f9f5015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f50162820 0x7f9f5015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 --2- 172.21.15.6:0/3059488501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f500b3e80 0x7f9f500b6cf0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 >> 172.21.15.6:0/3059488501 conn(0x7f9f500d4bd0 msgr2=0x7f9f50161bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 shutdown_connections 2024-05-20T18:00:30.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.791+0000 7f9f57ee9640 1 -- 172.21.15.6:0/3059488501 wait complete. 2024-05-20T18:00:30.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:30.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.917+0000 7f51e01c7640 1 Processor -- start 2024-05-20T18:00:30.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.917+0000 7f51e01c7640 1 -- start start 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51e01c7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51d8162820 0x7f51d80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51e01c7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 0x7f51d806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51e01c7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51d806dd20 con 0x7f51d806d910 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51e01c7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f51d80d0630 con 0x7f51d8162820 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51e01c7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51d80d39c0 con 0x7f51d80b3e80 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51ddf63640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51d8162820 0x7f51d80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51ddf63640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51d8162820 0x7f51d80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34494/0 (socket says 172.21.15.6:34494) 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51ddf63640 1 -- 172.21.15.6:0/2868989227 learned_addr learned my addr 172.21.15.6:0/2868989227 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51dd762640 1 --2- 172.21.15.6:0/2868989227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 0x7f51d806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51ddf63640 1 -- 172.21.15.6:0/2868989227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 msgr2=0x7f51d806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51ddf63640 1 --2- 172.21.15.6:0/2868989227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 0x7f51d806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51ddf63640 1 -- 172.21.15.6:0/2868989227 >> v1:172.21.15.171:6789/0 conn(0x7f51d806d910 legacy=0x7f51d80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.919+0000 7f51ddf63640 1 -- 172.21.15.6:0/2868989227 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d80d3ca0 con 0x7f51d8162820 2024-05-20T18:00:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.920+0000 7f51ddf63640 1 --2- 172.21.15.6:0/2868989227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d80b3940 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009870 tx=0x7f51d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e82928702bac727 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.920+0000 7f51dcf61640 1 -- 172.21.15.6:0/2868989227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4037070 con 0x7f51d8162820 2024-05-20T18:00:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.920+0000 7f51dcf61640 1 -- 172.21.15.6:0/2868989227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d4032440 con 0x7f51d8162820 2024-05-20T18:00:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.920+0000 7f51dcf61640 1 -- 172.21.15.6:0/2868989227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4032810 con 0x7f51d8162820 2024-05-20T18:00:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.921+0000 7f51e01c7640 1 -- 172.21.15.6:0/2868989227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 msgr2=0x7f51d80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.921+0000 7f51e01c7640 1 --2- 172.21.15.6:0/2868989227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d80b3940 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009870 tx=0x7f51d402a270 comp rx=0 tx=0).stop 2024-05-20T18:00:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.921+0000 7f51e01c7640 1 -- 172.21.15.6:0/2868989227 shutdown_connections 2024-05-20T18:00:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.921+0000 7f51e01c7640 1 --2- 172.21.15.6:0/2868989227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 0x7f51d806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.921+0000 7f51e01c7640 1 --2- 172.21.15.6:0/2868989227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d80b3940 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.921+0000 7f51e01c7640 1 -- 172.21.15.6:0/2868989227 >> 172.21.15.6:0/2868989227 conn(0x7f51d80d4bd0 msgr2=0x7f51d80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.921+0000 7f51e01c7640 1 -- 172.21.15.6:0/2868989227 shutdown_connections 2024-05-20T18:00:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.921+0000 7f51e01c7640 1 -- 172.21.15.6:0/2868989227 wait complete. 2024-05-20T18:00:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.923+0000 7f51e01c7640 1 Processor -- start 2024-05-20T18:00:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.923+0000 7f51e01c7640 1 -- start start 2024-05-20T18:00:30.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51e01c7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51d806d910 0x7f51d814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51e01c7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 0x7f51d815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51e01c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51e01c7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51d80d0300 con 0x7f51d8162820 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51e01c7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51d80d4260 con 0x7f51d806d910 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51e01c7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51d80b91a0 con 0x7f51d80b3e80 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51de764640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51de764640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d815ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34510/0 (socket says 172.21.15.6:34510) 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51de764640 1 -- 172.21.15.6:0/76800769 learned_addr learned my addr 172.21.15.6:0/76800769 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51dd762640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 0x7f51d815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.924+0000 7f51ddf63640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51d806d910 0x7f51d814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51de764640 1 -- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 msgr2=0x7f51d815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51de764640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 0x7f51d815e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51de764640 1 -- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51d806d910 msgr2=0x7f51d814e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51de764640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51d806d910 0x7f51d814e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51de764640 1 -- 172.21.15.6:0/76800769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d815f2e0 con 0x7f51d8162820 2024-05-20T18:00:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51de764640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d815ea80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f51d000c6b0 tx=0x7f51d000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51ce7fc640 1 -- 172.21.15.6:0/76800769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0003b70 con 0x7f51d8162820 2024-05-20T18:00:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51ce7fc640 1 -- 172.21.15.6:0/76800769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d0003d10 con 0x7f51d8162820 2024-05-20T18:00:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d80c8700 con 0x7f51d8162820 2024-05-20T18:00:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51ce7fc640 1 -- 172.21.15.6:0/76800769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0005310 con 0x7f51d8162820 2024-05-20T18:00:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.925+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d80c8cc0 con 0x7f51d8162820 2024-05-20T18:00:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.926+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d815f050 con 0x7f51d8162820 2024-05-20T18:00:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.927+0000 7f51ce7fc640 1 -- 172.21.15.6:0/76800769 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f51d00054b0 con 0x7f51d8162820 2024-05-20T18:00:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.927+0000 7f51ce7fc640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51bc06be60 0x7f51bc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.927+0000 7f51ce7fc640 1 -- 172.21.15.6:0/76800769 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f51d008add0 con 0x7f51d8162820 2024-05-20T18:00:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.928+0000 7f51ddf63640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51bc06be60 0x7f51bc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.928+0000 7f51ddf63640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51bc06be60 0x7f51bc06e370 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f51d4034000 tx=0x7f51d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:30.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:30.932+0000 7f51ce7fc640 1 -- 172.21.15.6:0/76800769 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f51d806dd20 con 0x7f51d8162820 2024-05-20T18:00:31.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.155+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51d806e110 con 0x7f51d8162820 2024-05-20T18:00:31.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.156+0000 7f51ce7fc640 1 -- 172.21.15.6:0/76800769 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5180 (secure 0 0 0) 0x7f51d0058e70 con 0x7f51d8162820 2024-05-20T18:00:31.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:31.154 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6413,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2288332461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2288332461},{"type":"v1","addr":"172.21.15.171:6835","nonce":2288332461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/4138789955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4138789955},{"type":"v1","addr":"172.21.15.171:6837","nonce":4138789955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2834528553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2834528553},{"type":"v1","addr":"172.21.15.6:6835","nonce":2834528553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:15.507163+0000","modified":"2024-05-20T18:00:18.526380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7725},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7725":{"gid":7725,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.6:6834/957433228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":957433228},{"type":"v1","addr":"172.21.15.6:6834","nonce":957433228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7725,"qdb_cluster":[7725]},"id":7}]} 2024-05-20T18:00:31.154 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51bc06be60 msgr2=0x7f51bc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51bc06be60 0x7f51bc06e370 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f51d4034000 tx=0x7f51d402e000 comp rx=0 tx=0).stop 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 msgr2=0x7f51d815ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d815ea80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f51d000c6b0 tx=0x7f51d000cb70 comp rx=0 tx=0).stop 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 shutdown_connections 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f51bc06be60 0x7f51bc06e370 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8162820 0x7f51d815ea80 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f51d80b3e80 0x7f51d815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 --2- 172.21.15.6:0/76800769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51d806d910 0x7f51d814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 >> 172.21.15.6:0/76800769 conn(0x7f51d80d4bd0 msgr2=0x7f51d80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 shutdown_connections 2024-05-20T18:00:31.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.158+0000 7f51e01c7640 1 -- 172.21.15.6:0/76800769 wait complete. 2024-05-20T18:00:31.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.285+0000 7efed70a6640 1 Processor -- start 2024-05-20T18:00:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.285+0000 7efed70a6640 1 -- start start 2024-05-20T18:00:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efed70a6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 0x7efed00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efed70a6640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efed00b3e80 0x7efed006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efed70a6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed006dd20 con 0x7efed006d910 2024-05-20T18:00:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efed70a6640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efed00d0630 con 0x7efed00b3e80 2024-05-20T18:00:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efed70a6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efed00d39c0 con 0x7efed0162820 2024-05-20T18:00:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efed5643640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efed006d910 0x7efed00d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50720/0 (socket says 172.21.15.6:50720) 2024-05-20T18:00:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efed5643640 1 -- 172.21.15.6:0/2302499934 learned_addr learned my addr 172.21.15.6:0/2302499934 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efed4e42640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 0x7efed00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444849563 0 0) 0x7efec8001490 con 0x7efed006d910 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecffff640 1 --2- 172.21.15.6:0/2302499934 >> v2:172.21.15.171:3300/0 conn(0x7efed00b3e80 0x7efed006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeb8003520 con 0x7efed006d910 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 749723739 0 0) 0x7efeb8003520 con 0x7efed006d910 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 msgr2=0x7efed00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 0x7efed00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 >> v2:172.21.15.171:3300/0 conn(0x7efed00b3e80 msgr2=0x7efed006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 --2- 172.21.15.6:0/2302499934 >> v2:172.21.15.171:3300/0 conn(0x7efed00b3e80 0x7efed006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed00d3ca0 con 0x7efed006d910 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7efec8001bc0 con 0x7efed006d910 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 >> v1:172.21.15.6:6789/0 conn(0x7efed006d910 legacy=0x7efed00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb80039b0 0x7efeb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8004800 0x7efeb8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 0x7efeb8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efed00d0630 con 0x7efeb80039b0 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efed00d39c0 con 0x7efeb8004800 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.287+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efeb800b9c0 con 0x7efed0162820 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efed4e42640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb80039b0 0x7efeb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efecffff640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8004800 0x7efeb8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efed5643640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 0x7efeb8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efed4e42640 1 -- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 msgr2=0x7efeb8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efed4e42640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 0x7efeb8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efed4e42640 1 -- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8004800 msgr2=0x7efeb8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efed4e42640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8004800 0x7efeb8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efed4e42640 1 -- 172.21.15.6:0/2302499934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb8003520 con 0x7efeb80039b0 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efecffff640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8004800 0x7efeb8004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.288+0000 7efed5643640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed0162820 0x7efeb8005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efed4e42640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb80039b0 0x7efeb8003e20 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7efec0009ac0 tx=0x7efeb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc653c1883075b24 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec0036070 con 0x7efeb80039b0 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec0031400 con 0x7efeb80039b0 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efecf7fe640 1 -- 172.21.15.6:0/2302499934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec0009690 con 0x7efeb80039b0 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efed70a6640 1 -- 172.21.15.6:0/2302499934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb80039b0 msgr2=0x7efeb8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efed70a6640 1 --2- 172.21.15.6:0/2302499934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb80039b0 0x7efeb8003e20 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7efec0009ac0 tx=0x7efeb8005830 comp rx=0 tx=0).stop 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efed5643640 1 -- 172.21.15.6:0/2302499934 reap_dead start 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efed70a6640 1 -- 172.21.15.6:0/2302499934 shutdown_connections 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efed70a6640 1 -- 172.21.15.6:0/2302499934 >> 172.21.15.6:0/2302499934 conn(0x7efed00d4bd0 msgr2=0x7efed00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.289+0000 7efed70a6640 1 -- 172.21.15.6:0/2302499934 shutdown_connections 2024-05-20T18:00:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.290+0000 7efed70a6640 1 -- 172.21.15.6:0/2302499934 wait complete. 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.291+0000 7efed70a6640 1 Processor -- start 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.291+0000 7efed70a6640 1 -- start start 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efed70a6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb80039b0 0x7efed01f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efed70a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed00ca540 0x7efed01f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efed70a6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed00cde20 0x7efed00ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efed70a6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efed00d0300 con 0x7efed00ca540 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efed70a6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efed00d4260 con 0x7efeb80039b0 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efed70a6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efed00b91a0 con 0x7efed00cde20 2024-05-20T18:00:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed00ca540 0x7efed01f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed00ca540 0x7efed01f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34540/0 (socket says 172.21.15.6:34540) 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 -- 172.21.15.6:0/2351681582 learned_addr learned my addr 172.21.15.6:0/2351681582 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efed4e42640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb80039b0 0x7efed01f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efed5643640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed00cde20 0x7efed00ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 -- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed00cde20 msgr2=0x7efed00ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed00cde20 0x7efed00ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 -- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb80039b0 msgr2=0x7efed01f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb80039b0 0x7efed01f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 -- 172.21.15.6:0/2351681582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed00ce770 con 0x7efed00ca540 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.293+0000 7efecffff640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed00ca540 0x7efed01f4890 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7efec4011690 tx=0x7efec4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.294+0000 7efecd7fa640 1 -- 172.21.15.6:0/2351681582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec400f8f0 con 0x7efed00ca540 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.294+0000 7efecd7fa640 1 -- 172.21.15.6:0/2351681582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec400fa90 con 0x7efed00ca540 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.294+0000 7efecd7fa640 1 -- 172.21.15.6:0/2351681582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec400fe80 con 0x7efed00ca540 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.294+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed01f4dd0 con 0x7efed00ca540 2024-05-20T18:00:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.294+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed00cb000 con 0x7efed00ca540 2024-05-20T18:00:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.295+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed0075b00 con 0x7efed00ca540 2024-05-20T18:00:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.295+0000 7efecd7fa640 1 -- 172.21.15.6:0/2351681582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efec4015460 con 0x7efed00ca540 2024-05-20T18:00:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.296+0000 7efecd7fa640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efebc06be30 0x7efebc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.296+0000 7efecd7fa640 1 -- 172.21.15.6:0/2351681582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7efec408b820 con 0x7efed00ca540 2024-05-20T18:00:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.296+0000 7efed4e42640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efebc06be30 0x7efebc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.297+0000 7efed4e42640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efebc06be30 0x7efebc06e340 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efec0033000 tx=0x7efec0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.301+0000 7efecd7fa640 1 -- 172.21.15.6:0/2351681582 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efed00ce770 con 0x7efed00ca540 2024-05-20T18:00:31.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.484+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efed00b4320 con 0x7efed00ca540 2024-05-20T18:00:31.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.485+0000 7efecd7fa640 1 -- 172.21.15.6:0/2351681582 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16828 (secure 0 0 0) 0x7efec4019030 con 0x7efed00ca540 2024-05-20T18:00:31.483 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:31.483 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":101,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:17.119205+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:13.843929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:14.484733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efebc06be30 msgr2=0x7efebc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efebc06be30 0x7efebc06e340 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efec0033000 tx=0x7efec0008030 comp rx=0 tx=0).stop 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed00ca540 msgr2=0x7efed01f4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed00ca540 0x7efed01f4890 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7efec4011690 tx=0x7efec4011a90 comp rx=0 tx=0).stop 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 shutdown_connections 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efebc06be30 0x7efebc06e340 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efed00cde20 0x7efed00ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efed00ca540 0x7efed01f4890 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 --2- 172.21.15.6:0/2351681582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb80039b0 0x7efed01f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 >> 172.21.15.6:0/2351681582 conn(0x7efed00d4bd0 msgr2=0x7efed0161c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:31.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 shutdown_connections 2024-05-20T18:00:31.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.487+0000 7efed70a6640 1 -- 172.21.15.6:0/2351681582 wait complete. 2024-05-20T18:00:31.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T18:00:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.615+0000 7fbb6f4ca640 1 Processor -- start 2024-05-20T18:00:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.615+0000 7fbb6f4ca640 1 -- start start 2024-05-20T18:00:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb6f4ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 0x7fbb6815f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb6f4ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6806d0f0 con 0x7fbb6806c6c0 2024-05-20T18:00:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb6f4ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6806d3d0 con 0x7fbb680cfae0 2024-05-20T18:00:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb6f4ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbb680cda90 con 0x7fbb680cd680 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb6ca65640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb6806c6c0 0x7fbb680cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50724/0 (socket says 172.21.15.6:50724) 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb6ca65640 1 -- 172.21.15.6:0/595197069 learned_addr learned my addr 172.21.15.6:0/595197069 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb6d266640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 0x7fbb6815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082683598 0 0) 0x7fbb6806d0f0 con 0x7fbb6806c6c0 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb50003520 con 0x7fbb6806c6c0 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499631280 0 0) 0x7fbb6806d3d0 con 0x7fbb680cfae0 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb6806d0f0 con 0x7fbb680cfae0 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016261815 0 0) 0x7fbb50003520 con 0x7fbb6806c6c0 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 msgr2=0x7fbb6815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 0x7fbb6815f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 >> v1:172.21.15.171:6789/0 conn(0x7fbb680cfae0 legacy=0x7fbb680d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6806d6b0 con 0x7fbb6806c6c0 2024-05-20T18:00:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fbb5c001670 con 0x7fbb6806c6c0 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb6d266640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 0x7fbb6815f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.617+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 >> v1:172.21.15.6:6789/0 conn(0x7fbb6806c6c0 legacy=0x7fbb680cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb67fff640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb50003b70 0x7fbb50003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb67fff640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb50004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb67fff640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 0x7fbb50005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5000bb50 con 0x7fbb50004800 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5000bd00 con 0x7fbb50003b70 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5000bf00 con 0x7fbb680cd680 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb6ca65640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb50004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb6d266640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb50003b70 0x7fbb50003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb6da67640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 0x7fbb50005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb6ca65640 1 -- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 msgr2=0x7fbb50005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb6ca65640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb680cd680 0x7fbb50005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb6ca65640 1 -- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb50003b70 msgr2=0x7fbb50003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb6ca65640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb50003b70 0x7fbb50003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.618+0000 7fbb6ca65640 1 -- 172.21.15.6:0/595197069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb50003520 con 0x7fbb50004800 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.619+0000 7fbb6ca65640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb50004c10 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c007f90 tx=0x7fbb50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c29fea561a5508 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.619+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c007be0 con 0x7fbb50004800 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.619+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb5c005af0 con 0x7fbb50004800 2024-05-20T18:00:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.619+0000 7fbb67fff640 1 -- 172.21.15.6:0/595197069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c007070 con 0x7fbb50004800 2024-05-20T18:00:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.620+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/595197069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 msgr2=0x7fbb50004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.620+0000 7fbb6f4ca640 1 --2- 172.21.15.6:0/595197069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb50004c10 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c007f90 tx=0x7fbb50005830 comp rx=0 tx=0).stop 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.620+0000 7fbb6da67640 1 -- 172.21.15.6:0/595197069 reap_dead start 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.620+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/595197069 shutdown_connections 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.620+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/595197069 >> 172.21.15.6:0/595197069 conn(0x7fbb680b44d0 msgr2=0x7fbb680b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.620+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/595197069 shutdown_connections 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.620+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/595197069 wait complete. 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.621+0000 7fbb6f4ca640 1 Processor -- start 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.622+0000 7fbb6f4ca640 1 -- start start 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6f4ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb6815fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6f4ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb68154d80 0x7fbb6815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6f4ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb68155190 0x7fbb6815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6f4ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680d2460 con 0x7fbb50004800 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6f4ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6806da10 con 0x7fbb68154d80 2024-05-20T18:00:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6f4ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbb680d25e0 con 0x7fbb68155190 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb6815fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb6815fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34548/0 (socket says 172.21.15.6:34548) 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 -- 172.21.15.6:0/217788765 learned_addr learned my addr 172.21.15.6:0/217788765 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6ca65640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb68154d80 0x7fbb6815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6da67640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb68155190 0x7fbb6815de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 -- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb68155190 msgr2=0x7fbb6815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb68155190 0x7fbb6815de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 -- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb68154d80 msgr2=0x7fbb6815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb68154d80 0x7fbb6815d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 -- 172.21.15.6:0/217788765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb680b57c0 con 0x7fbb50004800 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.623+0000 7fbb6d266640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb6815fc00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009f50 tx=0x7fbb5800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.624+0000 7fbb65ffb640 1 -- 172.21.15.6:0/217788765 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58015430 con 0x7fbb50004800 2024-05-20T18:00:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.624+0000 7fbb65ffb640 1 -- 172.21.15.6:0/217788765 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb580155d0 con 0x7fbb50004800 2024-05-20T18:00:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.624+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb680b5cf0 con 0x7fbb50004800 2024-05-20T18:00:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.624+0000 7fbb65ffb640 1 -- 172.21.15.6:0/217788765 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58015980 con 0x7fbb50004800 2024-05-20T18:00:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.624+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb680b62b0 con 0x7fbb50004800 2024-05-20T18:00:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.625+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb680b69d0 con 0x7fbb50004800 2024-05-20T18:00:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.625+0000 7fbb65ffb640 1 -- 172.21.15.6:0/217788765 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb58015b20 con 0x7fbb50004800 2024-05-20T18:00:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.626+0000 7fbb65ffb640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb5406be30 0x7fbb5406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.626+0000 7fbb65ffb640 1 -- 172.21.15.6:0/217788765 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fbb5808c230 con 0x7fbb50004800 2024-05-20T18:00:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.626+0000 7fbb6ca65640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb5406be30 0x7fbb5406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.627+0000 7fbb6ca65640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb5406be30 0x7fbb5406e340 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c032000 tx=0x7fbb5c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:31.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.631+0000 7fbb65ffb640 1 -- 172.21.15.6:0/217788765 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbb58019030 con 0x7fbb50004800 2024-05-20T18:00:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.856+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbb68075b00 con 0x7fbb50004800 2024-05-20T18:00:31.854 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T18:00:31.857+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T18:00:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.858+0000 7fbb65ffb640 1 -- 172.21.15.6:0/217788765 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) ==== 161+0+0 (secure 0 0 0) 0x7fbb58010040 con 0x7fbb50004800 2024-05-20T18:00:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T18:00:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb5406be30 msgr2=0x7fbb5406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb5406be30 0x7fbb5406e340 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c032000 tx=0x7fbb5c009030 comp rx=0 tx=0).stop 2024-05-20T18:00:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 msgr2=0x7fbb6815fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb6815fc00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009f50 tx=0x7fbb5800f580 comp rx=0 tx=0).stop 2024-05-20T18:00:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 shutdown_connections 2024-05-20T18:00:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbb5406be30 0x7fbb5406e340 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbb68155190 0x7fbb6815de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb68154d80 0x7fbb6815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 --2- 172.21.15.6:0/217788765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb50004800 0x7fbb6815fc00 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 >> 172.21.15.6:0/217788765 conn(0x7fbb680b44d0 msgr2=0x7fbb680cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 shutdown_connections 2024-05-20T18:00:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.861+0000 7fbb6f4ca640 1 -- 172.21.15.6:0/217788765 wait complete. 2024-05-20T18:00:31.860 INFO:tasks.ceph.mds.a.smithi006.stderr: -2115> 2024-05-20T18:00:21.072+0000 7f0ac58a4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T18:00:31.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T18:00:31.917 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T18:00:31.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.994+0000 7f4f6a606640 1 Processor -- start 2024-05-20T18:00:31.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.994+0000 7f4f6a606640 1 -- start start 2024-05-20T18:00:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.995+0000 7f4f6a606640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f640b47b0 0x7f4f640afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.995+0000 7f4f6a606640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f640b39f0 con 0x7f4f6415d060 2024-05-20T18:00:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.995+0000 7f4f6a606640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f640b3cd0 con 0x7f4f640b58f0 2024-05-20T18:00:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.995+0000 7f4f6a606640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f4f640b3fb0 con 0x7f4f640b47b0 2024-05-20T18:00:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.995+0000 7f4f63fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f640b47b0 0x7f4f640afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.995+0000 7f4f5bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f6415d060 0x7f4f640b51e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50738/0 (socket says 172.21.15.6:50738) 2024-05-20T18:00:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.995+0000 7f4f5bfff640 1 -- 172.21.15.6:0/690373662 learned_addr learned my addr 172.21.15.6:0/690373662 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.996+0000 7f4f63fff640 1 -- 172.21.15.6:0/690373662 >> v1:172.21.15.171:6789/0 conn(0x7f4f640b58f0 legacy=0x7f4f6406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.996+0000 7f4f63fff640 1 -- 172.21.15.6:0/690373662 >> v1:172.21.15.6:6789/0 conn(0x7f4f6415d060 legacy=0x7f4f640b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.996+0000 7f4f63fff640 1 -- 172.21.15.6:0/690373662 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f640b4290 con 0x7f4f640b47b0 2024-05-20T18:00:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.996+0000 7f4f637fe640 1 -- 172.21.15.6:0/690373662 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507590112 0 0) 0x7f4f640b39f0 con 0x7f4f6415d060 2024-05-20T18:00:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.996+0000 7f4f63fff640 1 --2- 172.21.15.6:0/690373662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b47b0 0x7f4f640afad0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097d0 tx=0x7f4f5402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffab3c6e8792bc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f637fe640 1 -- 172.21.15.6:0/690373662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54037070 con 0x7f4f640b47b0 2024-05-20T18:00:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f637fe640 1 -- 172.21.15.6:0/690373662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54032440 con 0x7f4f640b47b0 2024-05-20T18:00:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f637fe640 1 -- 172.21.15.6:0/690373662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54032810 con 0x7f4f640b47b0 2024-05-20T18:00:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f6a606640 1 -- 172.21.15.6:0/690373662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b47b0 msgr2=0x7f4f640afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f6a606640 1 --2- 172.21.15.6:0/690373662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b47b0 0x7f4f640afad0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f4f540097d0 tx=0x7f4f5402a180 comp rx=0 tx=0).stop 2024-05-20T18:00:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f6a606640 1 -- 172.21.15.6:0/690373662 shutdown_connections 2024-05-20T18:00:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f6a606640 1 --2- 172.21.15.6:0/690373662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b47b0 0x7f4f640afad0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f6a606640 1 -- 172.21.15.6:0/690373662 >> 172.21.15.6:0/690373662 conn(0x7f4f640cd2a0 msgr2=0x7f4f640cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f6a606640 1 -- 172.21.15.6:0/690373662 shutdown_connections 2024-05-20T18:00:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.997+0000 7f4f6a606640 1 -- 172.21.15.6:0/690373662 wait complete. 2024-05-20T18:00:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.999+0000 7f4f6a606640 1 Processor -- start 2024-05-20T18:00:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:31.999+0000 7f4f6a606640 1 -- start start 2024-05-20T18:00:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f6a606640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6415d060 0x7f4f64150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f6a606640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f640b1d10 0x7f4f641f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f6a606640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b2120 0x7f4f640ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f6a606640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64159de0 con 0x7f4f640b2120 2024-05-20T18:00:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f6a606640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64159c60 con 0x7f4f640b1d10 2024-05-20T18:00:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f6a606640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6406fae0 con 0x7f4f6415d060 2024-05-20T18:00:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b2120 0x7f4f640ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b2120 0x7f4f640ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34582/0 (socket says 172.21.15.6:34582) 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 -- 172.21.15.6:0/1095274789 learned_addr learned my addr 172.21.15.6:0/1095274789 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f5bfff640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f640b1d10 0x7f4f641f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f63fff640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6415d060 0x7f4f64150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 -- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6415d060 msgr2=0x7f4f64150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6415d060 0x7f4f64150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 -- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f640b1d10 msgr2=0x7f4f641f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f640b1d10 0x7f4f641f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 -- 172.21.15.6:0/1095274789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f640b0c70 con 0x7f4f640b2120 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f68ba3640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b2120 0x7f4f640ca9a0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00b970 tx=0x7f4f5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f617fa640 1 -- 172.21.15.6:0/1095274789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c019070 con 0x7f4f640b2120 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f617fa640 1 -- 172.21.15.6:0/1095274789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00cb40 con 0x7f4f640b2120 2024-05-20T18:00:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f640b0f50 con 0x7f4f640b2120 2024-05-20T18:00:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.001+0000 7f4f617fa640 1 -- 172.21.15.6:0/1095274789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c014440 con 0x7f4f640b2120 2024-05-20T18:00:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.002+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f640b1510 con 0x7f4f640b2120 2024-05-20T18:00:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.003+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f64075b00 con 0x7f4f640b2120 2024-05-20T18:00:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.003+0000 7f4f617fa640 1 -- 172.21.15.6:0/1095274789 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f5c01c070 con 0x7f4f640b2120 2024-05-20T18:00:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.004+0000 7f4f617fa640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f4406be30 0x7f4f4406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.004+0000 7f4f617fa640 1 -- 172.21.15.6:0/1095274789 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7f4f5c08ad40 con 0x7f4f640b2120 2024-05-20T18:00:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.004+0000 7f4f63fff640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f4406be30 0x7f4f4406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:32.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.004+0000 7f4f63fff640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f4406be30 0x7f4f4406e340 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4f54034000 tx=0x7f4f5402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:32.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.008+0000 7f4f617fa640 1 -- 172.21.15.6:0/1095274789 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4f5c059510 con 0x7f4f640b2120 2024-05-20T18:00:32.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.236+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4f640ce1f0 con 0x7f4f640b2120 2024-05-20T18:00:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.860+0000 7f4f617fa640 1 -- 172.21.15.6:0/1095274789 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) ==== 104+0+0 (secure 0 0 0) 0x7f4f5c058e10 con 0x7f4f640b2120 2024-05-20T18:00:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.862+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f4406be30 msgr2=0x7f4f4406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.862+0000 7f4f6a606640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f4406be30 0x7f4f4406e340 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4f54034000 tx=0x7f4f5402e000 comp rx=0 tx=0).stop 2024-05-20T18:00:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b2120 msgr2=0x7f4f640ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b2120 0x7f4f640ca9a0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00b970 tx=0x7f4f5c00be30 comp rx=0 tx=0).stop 2024-05-20T18:00:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 shutdown_connections 2024-05-20T18:00:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4f4406be30 0x7f4f4406e340 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f640b2120 0x7f4f640ca9a0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f640b1d10 0x7f4f641f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 --2- 172.21.15.6:0/1095274789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4f6415d060 0x7f4f64150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 >> 172.21.15.6:0/1095274789 conn(0x7f4f640cd2a0 msgr2=0x7f4f64159250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 shutdown_connections 2024-05-20T18:00:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:32.863+0000 7f4f6a606640 1 -- 172.21.15.6:0/1095274789 wait complete. 2024-05-20T18:00:32.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T18:00:32.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.002+0000 7ff286ea8640 1 Processor -- start 2024-05-20T18:00:32.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.002+0000 7ff286ea8640 1 -- start start 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.003+0000 7ff286ea8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff28015f2e0 0x7ff2800cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.003+0000 7ff286ea8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800d0220 0x7ff2800b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.003+0000 7ff286ea8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2800d0630 con 0x7ff2800d28e0 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.003+0000 7ff286ea8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff2800d3e70 con 0x7ff28015f2e0 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.003+0000 7ff286ea8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2800b8860 con 0x7ff2800d0220 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.003+0000 7ff284c44640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff2800d28e0 0x7ff2800d3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50746/0 (socket says 172.21.15.6:50746) 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.003+0000 7ff284c44640 1 -- 172.21.15.6:0/3575636129 learned_addr learned my addr 172.21.15.6:0/3575636129 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991889198 0 0) 0x7ff278001110 con 0x7ff2800d28e0 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff26c003520 con 0x7ff2800d28e0 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27ffff640 1 --2- 172.21.15.6:0/3575636129 >> v2:172.21.15.171:3300/0 conn(0x7ff28015f2e0 0x7ff2800cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff285445640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800d0220 0x7ff2800b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1153374403 0 0) 0x7ff26c003520 con 0x7ff2800d28e0 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800d0220 msgr2=0x7ff2800b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800d0220 0x7ff2800b8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 >> v2:172.21.15.171:3300/0 conn(0x7ff28015f2e0 msgr2=0x7ff2800cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 --2- 172.21.15.6:0/3575636129 >> v2:172.21.15.171:3300/0 conn(0x7ff28015f2e0 0x7ff2800cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2800d4090 con 0x7ff2800d28e0 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ff278001840 con 0x7ff2800d28e0 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 >> v1:172.21.15.6:6789/0 conn(0x7ff2800d28e0 legacy=0x7ff2800d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0039b0 0x7ff26c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800d0220 0x7ff26c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c004d40 0x7ff26c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2800d3e70 con 0x7ff26c0039b0 2024-05-20T18:00:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2800b8860 con 0x7ff26c004d40 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff26c00b9c0 con 0x7ff2800d0220 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff284c44640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0039b0 0x7ff26c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff27ffff640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800d0220 0x7ff26c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.004+0000 7ff285445640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c004d40 0x7ff26c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.005+0000 7ff284c44640 1 -- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800d0220 msgr2=0x7ff26c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.005+0000 7ff284c44640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800d0220 0x7ff26c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.005+0000 7ff284c44640 1 -- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c004d40 msgr2=0x7ff26c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.005+0000 7ff284c44640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c004d40 0x7ff26c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.005+0000 7ff284c44640 1 -- 172.21.15.6:0/3575636129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26c003520 con 0x7ff26c0039b0 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.005+0000 7ff285445640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c004d40 0x7ff26c005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.005+0000 7ff284c44640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0039b0 0x7ff26c003e20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c490 tx=0x7ff26c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9858e3458896cb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.005+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27800c0e0 con 0x7ff26c0039b0 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff278034070 con 0x7ff26c0039b0 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff27f7fe640 1 -- 172.21.15.6:0/3575636129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278005af0 con 0x7ff26c0039b0 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff286ea8640 1 -- 172.21.15.6:0/3575636129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0039b0 msgr2=0x7ff26c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff286ea8640 1 --2- 172.21.15.6:0/3575636129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0039b0 0x7ff26c003e20 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c490 tx=0x7ff26c005830 comp rx=0 tx=0).stop 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff285445640 1 -- 172.21.15.6:0/3575636129 reap_dead start 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff286ea8640 1 -- 172.21.15.6:0/3575636129 shutdown_connections 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff286ea8640 1 -- 172.21.15.6:0/3575636129 >> 172.21.15.6:0/3575636129 conn(0x7ff2800b67b0 msgr2=0x7ff2800b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff286ea8640 1 -- 172.21.15.6:0/3575636129 shutdown_connections 2024-05-20T18:00:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.006+0000 7ff286ea8640 1 -- 172.21.15.6:0/3575636129 wait complete. 2024-05-20T18:00:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.008+0000 7ff286ea8640 1 Processor -- start 2024-05-20T18:00:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.008+0000 7ff286ea8640 1 -- start start 2024-05-20T18:00:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.009+0000 7ff286ea8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c0039b0 0x7ff280159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.009+0000 7ff286ea8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280152c40 0x7ff2800ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff286ea8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800ca5a0 0x7ff2800ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff286ea8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2800b84f0 con 0x7ff280152c40 2024-05-20T18:00:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff286ea8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2800d4650 con 0x7ff26c0039b0 2024-05-20T18:00:33.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff286ea8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff28015f6f0 con 0x7ff2800ca5a0 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280152c40 0x7ff2800ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280152c40 0x7ff2800ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34604/0 (socket says 172.21.15.6:34604) 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 -- 172.21.15.6:0/2181863019 learned_addr learned my addr 172.21.15.6:0/2181863019 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff284c44640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c0039b0 0x7ff280159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff285445640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800ca5a0 0x7ff2800ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 -- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800ca5a0 msgr2=0x7ff2800ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800ca5a0 0x7ff2800ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 -- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c0039b0 msgr2=0x7ff280159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c0039b0 0x7ff280159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 -- 172.21.15.6:0/2181863019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2800caef0 con 0x7ff280152c40 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27ffff640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280152c40 0x7ff2800ca060 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff268009f90 tx=0x7ff26800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27d7fa640 1 -- 172.21.15.6:0/2181863019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268019070 con 0x7ff280152c40 2024-05-20T18:00:33.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27d7fa640 1 -- 172.21.15.6:0/2181863019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff268003990 con 0x7ff280152c40 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2800cc8b0 con 0x7ff280152c40 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff27d7fa640 1 -- 172.21.15.6:0/2181863019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268003d40 con 0x7ff280152c40 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.010+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2800c9860 con 0x7ff280152c40 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.012+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2800ccdd0 con 0x7ff280152c40 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.012+0000 7ff27d7fa640 1 -- 172.21.15.6:0/2181863019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff26801c070 con 0x7ff280152c40 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.012+0000 7ff27d7fa640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff26006be30 0x7ff26006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.013+0000 7ff27d7fa640 1 -- 172.21.15.6:0/2181863019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7ff26808bdb0 con 0x7ff280152c40 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.013+0000 7ff284c44640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff26006be30 0x7ff26006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:33.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.013+0000 7ff284c44640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff26006be30 0x7ff26006e340 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff278033000 tx=0x7ff278009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:33.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.017+0000 7ff27d7fa640 1 -- 172.21.15.6:0/2181863019 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff268010040 con 0x7ff280152c40 2024-05-20T18:00:33.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.200+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff2800c9650 con 0x7ff280152c40 2024-05-20T18:00:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.862+0000 7ff27d7fa640 1 -- 172.21.15.6:0/2181863019 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) ==== 181+0+0 (secure 0 0 0) 0x7ff26805a4f0 con 0x7ff280152c40 2024-05-20T18:00:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T18:00:33.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.864+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff26006be30 msgr2=0x7ff26006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:33.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.864+0000 7ff286ea8640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff26006be30 0x7ff26006e340 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff278033000 tx=0x7ff278009030 comp rx=0 tx=0).stop 2024-05-20T18:00:33.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280152c40 msgr2=0x7ff2800ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:33.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280152c40 0x7ff2800ca060 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff268009f90 tx=0x7ff26800f580 comp rx=0 tx=0).stop 2024-05-20T18:00:33.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 shutdown_connections 2024-05-20T18:00:33.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff26006be30 0x7ff26006e340 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff2800ca5a0 0x7ff2800ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280152c40 0x7ff2800ca060 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 --2- 172.21.15.6:0/2181863019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26c0039b0 0x7ff280159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 >> 172.21.15.6:0/2181863019 conn(0x7ff2800b67b0 msgr2=0x7ff2800b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 shutdown_connections 2024-05-20T18:00:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:33.865+0000 7ff286ea8640 1 -- 172.21.15.6:0/2181863019 wait complete. 2024-05-20T18:00:33.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T18:00:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.009+0000 7f6a6d585640 1 Processor -- start 2024-05-20T18:00:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.009+0000 7f6a6d585640 1 -- start start 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a6d585640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a680b3a30 0x7f6a6806b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a6d585640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6a6806ba60 0x7f6a680afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a6d585640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a68162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a6d585640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6815f920 con 0x7f6a680b3a30 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a6d585640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6a680b3e40 con 0x7f6a6806ba60 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a6d585640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6a680b0540 con 0x7f6a680b0130 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a66ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a680b3a30 0x7f6a6806b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a66ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a680b3a30 0x7f6a6806b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34614/0 (socket says 172.21.15.6:34614) 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.010+0000 7f6a66ffd640 1 -- 172.21.15.6:0/2822578631 learned_addr learned my addr 172.21.15.6:0/2822578631 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.011+0000 7f6a66ffd640 1 -- 172.21.15.6:0/2822578631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 msgr2=0x7f6a68162fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.011+0000 7f6a677fe640 1 --2- 172.21.15.6:0/2822578631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a68162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.011+0000 7f6a66ffd640 1 --2- 172.21.15.6:0/2822578631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a68162fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.011+0000 7f6a66ffd640 1 -- 172.21.15.6:0/2822578631 >> v2:172.21.15.171:3300/0 conn(0x7f6a6806ba60 msgr2=0x7f6a680afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.011+0000 7f6a667fc640 1 --2- 172.21.15.6:0/2822578631 >> v2:172.21.15.171:3300/0 conn(0x7f6a6806ba60 0x7f6a680afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.011+0000 7f6a66ffd640 1 --2- 172.21.15.6:0/2822578631 >> v2:172.21.15.171:3300/0 conn(0x7f6a6806ba60 0x7f6a680afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.011+0000 7f6a66ffd640 1 -- 172.21.15.6:0/2822578631 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a680aeb50 con 0x7f6a680b3a30 2024-05-20T18:00:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.011+0000 7f6a66ffd640 1 --2- 172.21.15.6:0/2822578631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6806b520 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f6a68071da0 tx=0x7f6a5802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1bb484b764ba8e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a65ffb640 1 -- 172.21.15.6:0/2822578631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58037070 con 0x7f6a680b3a30 2024-05-20T18:00:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a65ffb640 1 -- 172.21.15.6:0/2822578631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a58032440 con 0x7f6a680b3a30 2024-05-20T18:00:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a65ffb640 1 -- 172.21.15.6:0/2822578631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58032810 con 0x7f6a680b3a30 2024-05-20T18:00:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 -- 172.21.15.6:0/2822578631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 msgr2=0x7f6a6806b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2822578631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6806b520 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f6a68071da0 tx=0x7f6a5802a140 comp rx=0 tx=0).stop 2024-05-20T18:00:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 -- 172.21.15.6:0/2822578631 shutdown_connections 2024-05-20T18:00:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2822578631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a68162fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2822578631 >> v2:172.21.15.171:3300/0 conn(0x7f6a6806ba60 0x7f6a680afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2822578631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6806b520 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 -- 172.21.15.6:0/2822578631 >> 172.21.15.6:0/2822578631 conn(0x7f6a680b6630 msgr2=0x7f6a680b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 -- 172.21.15.6:0/2822578631 shutdown_connections 2024-05-20T18:00:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.012+0000 7f6a6d585640 1 -- 172.21.15.6:0/2822578631 wait complete. 2024-05-20T18:00:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.014+0000 7f6a6d585640 1 Processor -- start 2024-05-20T18:00:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.014+0000 7f6a6d585640 1 -- start start 2024-05-20T18:00:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a6d585640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a6806ba60 0x7f6a68152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a6d585640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a6809d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a6d585640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6809b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a6d585640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6a680af3f0 con 0x7f6a680b3a30 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a6d585640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6a680af110 con 0x7f6a6806ba60 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a6d585640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6a680af6d0 con 0x7f6a680b0130 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6809b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6809b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34624/0 (socket says 172.21.15.6:34624) 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 -- 172.21.15.6:0/2767720330 learned_addr learned my addr 172.21.15.6:0/2767720330 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a66ffd640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a6806ba60 0x7f6a68152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a667fc640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a6809d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 -- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 msgr2=0x7f6a6809d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a6809d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 -- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a6806ba60 msgr2=0x7f6a68152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a6806ba60 0x7f6a68152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 -- 172.21.15.6:0/2767720330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6809c270 con 0x7f6a680b3a30 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a66ffd640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a6806ba60 0x7f6a68152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a667fc640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a6809d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a677fe640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6809b840 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000cc30 tx=0x7f6a6000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a5f7fe640 1 -- 172.21.15.6:0/2767720330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000ce40 con 0x7f6a680b3a30 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a5f7fe640 1 -- 172.21.15.6:0/2767720330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a60003990 con 0x7f6a680b3a30 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.016+0000 7f6a5f7fe640 1 -- 172.21.15.6:0/2767720330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60003d40 con 0x7f6a680b3a30 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.017+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6809c550 con 0x7f6a680b3a30 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.017+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6809cb10 con 0x7f6a680b3a30 2024-05-20T18:00:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.017+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a680690b0 con 0x7f6a680b3a30 2024-05-20T18:00:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.018+0000 7f6a5f7fe640 1 -- 172.21.15.6:0/2767720330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a60003ee0 con 0x7f6a680b3a30 2024-05-20T18:00:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.019+0000 7f6a5f7fe640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6a4806be30 0x7f6a4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.019+0000 7f6a5f7fe640 1 -- 172.21.15.6:0/2767720330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5749+0+0 (secure 0 0 0) 0x7f6a6008b330 con 0x7f6a680b3a30 2024-05-20T18:00:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.019+0000 7f6a66ffd640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6a4806be30 0x7f6a4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.019+0000 7f6a66ffd640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6a4806be30 0x7f6a4806e340 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6a58034000 tx=0x7f6a5802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:34.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.023+0000 7f6a5f7fe640 1 -- 172.21.15.6:0/2767720330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6a60014030 con 0x7f6a680b3a30 2024-05-20T18:00:34.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.206+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a68161ed0 con 0x7f6a680b3a30 2024-05-20T18:00:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.869+0000 7f6a5f7fe640 1 -- 172.21.15.6:0/2767720330 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) ==== 169+0+0 (secure 0 0 0) 0x7f6a60059cb0 con 0x7f6a680b3a30 2024-05-20T18:00:34.867 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T18:00:34.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.873+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6a4806be30 msgr2=0x7f6a4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:34.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.873+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6a4806be30 0x7f6a4806e340 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6a58034000 tx=0x7f6a5802e000 comp rx=0 tx=0).stop 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 msgr2=0x7f6a6809b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6809b840 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000cc30 tx=0x7f6a6000a5c0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 shutdown_connections 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6a4806be30 0x7f6a4806e340 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a680b3a30 0x7f6a6809b840 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a680b0130 0x7f6a6809d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 --2- 172.21.15.6:0/2767720330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a6806ba60 0x7f6a68152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 >> 172.21.15.6:0/2767720330 conn(0x7f6a680b6630 msgr2=0x7f6a68070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 shutdown_connections 2024-05-20T18:00:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:34.874+0000 7f6a6d585640 1 -- 172.21.15.6:0/2767720330 wait complete. 2024-05-20T18:00:34.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T18:00:35.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.014+0000 7f8366f4c640 1 Processor -- start 2024-05-20T18:00:35.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.014+0000 7f8366f4c640 1 -- start start 2024-05-20T18:00:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f8366f4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8360163a10 0x7f83600d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f8366f4c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83600d14b0 0x7f83600d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f8366f4c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83600d0370 con 0x7f83600b4010 2024-05-20T18:00:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f8366f4c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f83600d3ca0 con 0x7f83600d14b0 2024-05-20T18:00:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f8366f4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f83600d0650 con 0x7f8360163a10 2024-05-20T18:00:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f83654e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83600d14b0 0x7f83600d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f83654e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83600d14b0 0x7f83600d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34632/0 (socket says 172.21.15.6:34632) 2024-05-20T18:00:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f83654e9640 1 -- 172.21.15.6:0/1778426725 learned_addr learned my addr 172.21.15.6:0/1778426725 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.015+0000 7f8364ce8640 1 --2- 172.21.15.6:0/1778426725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8360163a10 0x7f83600d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.016+0000 7f83654e9640 1 -- 172.21.15.6:0/1778426725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8360163a10 msgr2=0x7f83600d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.016+0000 7f83654e9640 1 --2- 172.21.15.6:0/1778426725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8360163a10 0x7f83600d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.016+0000 7f83654e9640 1 -- 172.21.15.6:0/1778426725 >> v1:172.21.15.171:6789/0 conn(0x7f83600b4010 legacy=0x7f83600cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.016+0000 7f83654e9640 1 -- 172.21.15.6:0/1778426725 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83600d3650 con 0x7f83600d14b0 2024-05-20T18:00:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.016+0000 7f83654e9640 1 --2- 172.21.15.6:0/1778426725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600d18c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f8358009e50 tx=0x7f835802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a786b4465b3be2a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.016+0000 7f835f7fe640 1 -- 172.21.15.6:0/1778426725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358036070 con 0x7f83600d14b0 2024-05-20T18:00:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f835f7fe640 1 -- 172.21.15.6:0/1778426725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8358031600 con 0x7f83600d14b0 2024-05-20T18:00:35.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f835f7fe640 1 -- 172.21.15.6:0/1778426725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580319d0 con 0x7f83600d14b0 2024-05-20T18:00:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f8366f4c640 1 -- 172.21.15.6:0/1778426725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 msgr2=0x7f83600d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f8366f4c640 1 --2- 172.21.15.6:0/1778426725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600d18c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f8358009e50 tx=0x7f835802a710 comp rx=0 tx=0).stop 2024-05-20T18:00:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f8366f4c640 1 -- 172.21.15.6:0/1778426725 shutdown_connections 2024-05-20T18:00:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f8366f4c640 1 --2- 172.21.15.6:0/1778426725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600d18c0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f8366f4c640 1 --2- 172.21.15.6:0/1778426725 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8360163a10 0x7f83600d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f8366f4c640 1 -- 172.21.15.6:0/1778426725 >> 172.21.15.6:0/1778426725 conn(0x7f836006d240 msgr2=0x7f836006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f8366f4c640 1 -- 172.21.15.6:0/1778426725 shutdown_connections 2024-05-20T18:00:35.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.017+0000 7f8366f4c640 1 -- 172.21.15.6:0/1778426725 wait complete. 2024-05-20T18:00:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.019+0000 7f8366f4c640 1 Processor -- start 2024-05-20T18:00:35.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.019+0000 7f8366f4c640 1 -- start start 2024-05-20T18:00:35.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f8366f4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83600b4010 0x7f83600ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f8366f4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f8366f4c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8360163a10 0x7f83600ad140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f8366f4c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83600b8210 con 0x7f83600d14b0 2024-05-20T18:00:35.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f8366f4c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f83600d1e00 con 0x7f8360163a10 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f8366f4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f83600b8390 con 0x7f83600b4010 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600ab580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34648/0 (socket says 172.21.15.6:34648) 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 -- 172.21.15.6:0/2217646481 learned_addr learned my addr 172.21.15.6:0/2217646481 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f8364ce8640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83600b4010 0x7f83600ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f83654e9640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8360163a10 0x7f83600ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 -- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83600b4010 msgr2=0x7f83600ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83600b4010 0x7f83600ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 -- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8360163a10 msgr2=0x7f83600ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8360163a10 0x7f83600ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 -- 172.21.15.6:0/2217646481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83600ac200 con 0x7f83600d14b0 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835ffff640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600ab580 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c3f0 tx=0x7f834c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835d7fa640 1 -- 172.21.15.6:0/2217646481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0052d0 con 0x7f83600d14b0 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.021+0000 7f835d7fa640 1 -- 172.21.15.6:0/2217646481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c005490 con 0x7f83600d14b0 2024-05-20T18:00:35.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.022+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83600ac4e0 con 0x7f83600d14b0 2024-05-20T18:00:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.022+0000 7f835d7fa640 1 -- 172.21.15.6:0/2217646481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c007260 con 0x7f83600d14b0 2024-05-20T18:00:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.022+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8360159100 con 0x7f83600d14b0 2024-05-20T18:00:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.023+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8360075b00 con 0x7f83600d14b0 2024-05-20T18:00:35.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.023+0000 7f835d7fa640 1 -- 172.21.15.6:0/2217646481 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f834c007400 con 0x7f83600d14b0 2024-05-20T18:00:35.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.024+0000 7f835d7fa640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834406be60 0x7f834406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.024+0000 7f835d7fa640 1 -- 172.21.15.6:0/2217646481 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7f834c08a0e0 con 0x7f83600d14b0 2024-05-20T18:00:35.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.024+0000 7f8364ce8640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834406be60 0x7f834406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.024+0000 7f8364ce8640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834406be60 0x7f834406e370 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f83600d3020 tx=0x7f8354008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:35.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.028+0000 7f835d7fa640 1 -- 172.21.15.6:0/2217646481 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f834c058510 con 0x7f83600d14b0 2024-05-20T18:00:35.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.214+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f83600abf90 con 0x7f83600d14b0 2024-05-20T18:00:35.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.217+0000 7f835d7fa640 1 -- 172.21.15.6:0/2217646481 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f834c05c810 con 0x7f83600d14b0 2024-05-20T18:00:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834406be60 msgr2=0x7f834406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834406be60 0x7f834406e370 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f83600d3020 tx=0x7f8354008040 comp rx=0 tx=0).stop 2024-05-20T18:00:35.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 msgr2=0x7f83600ab580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600ab580 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c3f0 tx=0x7f834c00c8b0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 shutdown_connections 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834406be60 0x7f834406e370 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8360163a10 0x7f83600ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83600d14b0 0x7f83600ab580 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 --2- 172.21.15.6:0/2217646481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83600b4010 0x7f83600ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 >> 172.21.15.6:0/2217646481 conn(0x7f836006d240 msgr2=0x7f83600d4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 shutdown_connections 2024-05-20T18:00:35.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.220+0000 7f8366f4c640 1 -- 172.21.15.6:0/2217646481 wait complete. 2024-05-20T18:00:35.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid' 2024-05-20T18:00:35.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.347+0000 7f547407a640 1 Processor -- start 2024-05-20T18:00:35.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.347+0000 7f547407a640 1 -- start start 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.348+0000 7f547407a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c15d530 0x7f546c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.348+0000 7f547407a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546c0cd580 con 0x7f546c070850 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.348+0000 7f547407a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546c0cd860 con 0x7f546c0b1700 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.348+0000 7f547407a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f546c0ce190 con 0x7f546c15d530 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.348+0000 7f5472617640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f546c070850 0x7f546c070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50748/0 (socket says 172.21.15.6:50748) 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.348+0000 7f5472617640 1 -- 172.21.15.6:0/1011879203 learned_addr learned my addr 172.21.15.6:0/1011879203 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5471e16640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c15d530 0x7f546c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013285602 0 0) 0x7f546c0cd580 con 0x7f546c070850 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5458003520 con 0x7f546c070850 2024-05-20T18:00:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539644254 0 0) 0x7f546c0cd860 con 0x7f546c0b1700 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f546c0cd580 con 0x7f546c0b1700 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 428926115 0 0) 0x7f5458003520 con 0x7f546c070850 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c15d530 msgr2=0x7f546c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c15d530 0x7f546c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 >> v1:172.21.15.171:6789/0 conn(0x7f546c0b1700 legacy=0x7f546c0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c0cdb40 con 0x7f546c070850 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f54640019f0 con 0x7f546c070850 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 >> v1:172.21.15.6:6789/0 conn(0x7f546c070850 legacy=0x7f546c070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c15d530 0x7f5458003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54580040d0 0x7f5458004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5458004d40 0x7f5458005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f546c0ce190 con 0x7f5458004d40 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f545800bb20 con 0x7f54580040d0 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f545800bd20 con 0x7f546c15d530 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5472617640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5458004d40 0x7f5458005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5471e16640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c15d530 0x7f5458003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.349+0000 7f5471615640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54580040d0 0x7f5458004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.350+0000 7f5472617640 1 -- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c15d530 msgr2=0x7f5458003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.350+0000 7f5472617640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c15d530 0x7f5458003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.350+0000 7f5472617640 1 -- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54580040d0 msgr2=0x7f5458004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:35.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.350+0000 7f5472617640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54580040d0 0x7f5458004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.350+0000 7f5472617640 1 -- 172.21.15.6:0/1011879203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5458003520 con 0x7f5458004d40 2024-05-20T18:00:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.350+0000 7f5472617640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5458004d40 0x7f5458005150 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f546c0b8420 tx=0x7f5458005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d1dd1c6ad29564 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.350+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546400a430 con 0x7f5458004d40 2024-05-20T18:00:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546402f070 con 0x7f5458004d40 2024-05-20T18:00:35.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f5470e14640 1 -- 172.21.15.6:0/1011879203 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546402bc40 con 0x7f5458004d40 2024-05-20T18:00:35.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f547407a640 1 -- 172.21.15.6:0/1011879203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5458004d40 msgr2=0x7f5458005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f547407a640 1 --2- 172.21.15.6:0/1011879203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5458004d40 0x7f5458005150 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f546c0b8420 tx=0x7f5458005830 comp rx=0 tx=0).stop 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f5472617640 1 -- 172.21.15.6:0/1011879203 reap_dead start 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f547407a640 1 -- 172.21.15.6:0/1011879203 shutdown_connections 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f547407a640 1 -- 172.21.15.6:0/1011879203 >> 172.21.15.6:0/1011879203 conn(0x7f546c0d29d0 msgr2=0x7f546c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f547407a640 1 -- 172.21.15.6:0/1011879203 shutdown_connections 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.351+0000 7f547407a640 1 -- 172.21.15.6:0/1011879203 wait complete. 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.353+0000 7f547407a640 1 Processor -- start 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.353+0000 7f547407a640 1 -- start start 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.354+0000 7f547407a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458004d40 0x7f546c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.354+0000 7f547407a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c0c9d80 0x7f546c0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.354+0000 7f547407a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0c6b50 0x7f546c0c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.354+0000 7f547407a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f546c071370 con 0x7f546c0c9d80 2024-05-20T18:00:35.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.354+0000 7f547407a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f546c0cd230 con 0x7f5458004d40 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.354+0000 7f547407a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f546c0714f0 con 0x7f546c0c6b50 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c0c9d80 0x7f546c0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c0c9d80 0x7f546c0c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34662/0 (socket says 172.21.15.6:34662) 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 -- 172.21.15.6:0/2964674516 learned_addr learned my addr 172.21.15.6:0/2964674516 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5472617640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0c6b50 0x7f546c0c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471e16640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458004d40 0x7f546c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 -- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0c6b50 msgr2=0x7f546c0c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0c6b50 0x7f546c0c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 -- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458004d40 msgr2=0x7f546c0c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458004d40 0x7f546c0c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 -- 172.21.15.6:0/2964674516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c149bf0 con 0x7f546c0c9d80 2024-05-20T18:00:35.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f5471615640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c0c9d80 0x7f546c0c5530 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f545c00f720 tx=0x7f545c00fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:35.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f54627fc640 1 -- 172.21.15.6:0/2964674516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c0050d0 con 0x7f546c0c9d80 2024-05-20T18:00:35.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f54627fc640 1 -- 172.21.15.6:0/2964674516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c018070 con 0x7f546c0c9d80 2024-05-20T18:00:35.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f54627fc640 1 -- 172.21.15.6:0/2964674516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c00d730 con 0x7f546c0c9d80 2024-05-20T18:00:35.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546c149ed0 con 0x7f546c0c9d80 2024-05-20T18:00:35.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.355+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546c0c6630 con 0x7f546c0c9d80 2024-05-20T18:00:35.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.356+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546c149960 con 0x7f546c0c9d80 2024-05-20T18:00:35.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.357+0000 7f54627fc640 1 -- 172.21.15.6:0/2964674516 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f545c00d8d0 con 0x7f546c0c9d80 2024-05-20T18:00:35.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.357+0000 7f54627fc640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545006be30 0x7f545006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:35.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.358+0000 7f54627fc640 1 -- 172.21.15.6:0/2964674516 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7f545c08ac80 con 0x7f546c0c9d80 2024-05-20T18:00:35.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.358+0000 7f5471e16640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545006be30 0x7f545006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:35.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.358+0000 7f5471e16640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545006be30 0x7f545006e340 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f546c0d29a0 tx=0x7f5468008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:35.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.362+0000 7f54627fc640 1 -- 172.21.15.6:0/2964674516 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f545c0597a0 con 0x7f546c0c9d80 2024-05-20T18:00:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.617+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]} v 0) -- 0x7f546c075b00 con 0x7f546c0c9d80 2024-05-20T18:00:35.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.871+0000 7f54627fc640 1 -- 172.21.15.6:0/2964674516 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]}]=0 v387) ==== 150+0+0 (secure 0 0 0) 0x7f545c0590a0 con 0x7f546c0c9d80 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545006be30 msgr2=0x7f545006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545006be30 0x7f545006e340 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f546c0d29a0 tx=0x7f5468008040 comp rx=0 tx=0).stop 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c0c9d80 msgr2=0x7f546c0c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c0c9d80 0x7f546c0c5530 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f545c00f720 tx=0x7f545c00fbe0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 shutdown_connections 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f545006be30 0x7f545006e340 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f546c0c6b50 0x7f546c0c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f546c0c9d80 0x7f546c0c5530 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 --2- 172.21.15.6:0/2964674516 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458004d40 0x7f546c0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 >> 172.21.15.6:0/2964674516 conn(0x7f546c0d29d0 msgr2=0x7f546c15e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 shutdown_connections 2024-05-20T18:00:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:35.873+0000 7f547407a640 1 -- 172.21.15.6:0/2964674516 wait complete. 2024-05-20T18:00:35.883 INFO:tasks.cephfs_test_runner:When a client does not advance its oldest tid, the MDS should notice that ... skipped 'Require FUSE client to inject client release failure' 2024-05-20T18:00:35.883 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T18:00:35.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:35.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.001+0000 7fa58fabc640 1 Processor -- start 2024-05-20T18:00:35.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.002+0000 7fa58fabc640 1 -- start start 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58fabc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa58815d530 0x7fa58815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58fabc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5880b1700 0x7fa5880b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58fabc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5880cd580 con 0x7fa588070850 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58fabc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa5880ce190 con 0x7fa5880b1700 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58fabc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa5880cd860 con 0x7fa58815d530 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58d057640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5880b1700 0x7fa5880b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58d057640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5880b1700 0x7fa5880b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34678/0 (socket says 172.21.15.6:34678) 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58d057640 1 -- 172.21.15.6:0/2261300287 learned_addr learned my addr 172.21.15.6:0/2261300287 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58d858640 1 --2- 172.21.15.6:0/2261300287 >> v2:172.21.15.171:3300/0 conn(0x7fa58815d530 0x7fa58815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58d057640 1 -- 172.21.15.6:0/2261300287 >> v2:172.21.15.171:3300/0 conn(0x7fa58815d530 msgr2=0x7fa58815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:36.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58d057640 1 --2- 172.21.15.6:0/2261300287 >> v2:172.21.15.171:3300/0 conn(0x7fa58815d530 0x7fa58815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.003+0000 7fa58d057640 1 -- 172.21.15.6:0/2261300287 >> v1:172.21.15.171:6789/0 conn(0x7fa588070850 legacy=0x7fa588070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.004+0000 7fa58d057640 1 -- 172.21.15.6:0/2261300287 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5880cdb40 con 0x7fa5880b1700 2024-05-20T18:00:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.004+0000 7fa58d057640 1 --2- 172.21.15.6:0/2261300287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5880b1700 0x7fa5880b1b10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa58804f790 tx=0x7fa57802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c0147c720409b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.004+0000 7fa58c856640 1 -- 172.21.15.6:0/2261300287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578037070 con 0x7fa5880b1700 2024-05-20T18:00:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58c856640 1 -- 172.21.15.6:0/2261300287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa578032440 con 0x7fa5880b1700 2024-05-20T18:00:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58c856640 1 -- 172.21.15.6:0/2261300287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578032810 con 0x7fa5880b1700 2024-05-20T18:00:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58fabc640 1 -- 172.21.15.6:0/2261300287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5880b1700 msgr2=0x7fa5880b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58fabc640 1 --2- 172.21.15.6:0/2261300287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5880b1700 0x7fa5880b1b10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa58804f790 tx=0x7fa57802a270 comp rx=0 tx=0).stop 2024-05-20T18:00:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58fabc640 1 -- 172.21.15.6:0/2261300287 shutdown_connections 2024-05-20T18:00:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58fabc640 1 --2- 172.21.15.6:0/2261300287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5880b1700 0x7fa5880b1b10 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58fabc640 1 --2- 172.21.15.6:0/2261300287 >> v2:172.21.15.171:3300/0 conn(0x7fa58815d530 0x7fa58815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58fabc640 1 -- 172.21.15.6:0/2261300287 >> 172.21.15.6:0/2261300287 conn(0x7fa5880d29d0 msgr2=0x7fa5880d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58fabc640 1 -- 172.21.15.6:0/2261300287 shutdown_connections 2024-05-20T18:00:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.005+0000 7fa58fabc640 1 -- 172.21.15.6:0/2261300287 wait complete. 2024-05-20T18:00:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.007+0000 7fa58fabc640 1 Processor -- start 2024-05-20T18:00:36.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.007+0000 7fa58fabc640 1 -- start start 2024-05-20T18:00:36.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58fabc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa588070850 0x7fa5881f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58fabc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5880b1700 0x7fa5880c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58fabc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58815d530 0x7fa5880c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58fabc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5880b2050 con 0x7fa588070850 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58fabc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5880cd230 con 0x7fa58815d530 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58fabc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa588071370 con 0x7fa5880b1700 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa588070850 0x7fa5881f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa588070850 0x7fa5881f3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34682/0 (socket says 172.21.15.6:34682) 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 -- 172.21.15.6:0/3064771553 learned_addr learned my addr 172.21.15.6:0/3064771553 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d057640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5880b1700 0x7fa5880c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58e059640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58815d530 0x7fa5880c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 -- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5880b1700 msgr2=0x7fa5880c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5880b1700 0x7fa5880c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 -- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58815d530 msgr2=0x7fa5880c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58815d530 0x7fa5880c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 -- 172.21.15.6:0/3064771553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5880c8a70 con 0x7fa588070850 2024-05-20T18:00:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58e059640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58815d530 0x7fa5880c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:36.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d057640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5880b1700 0x7fa5880c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:36.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa58d858640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa588070850 0x7fa5881f3c10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fa584007e30 tx=0x7fa58400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa57e7fc640 1 -- 172.21.15.6:0/3064771553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584014620 con 0x7fa588070850 2024-05-20T18:00:36.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.009+0000 7fa57e7fc640 1 -- 172.21.15.6:0/3064771553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584019070 con 0x7fa588070850 2024-05-20T18:00:36.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.010+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5880c8f80 con 0x7fa588070850 2024-05-20T18:00:36.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.010+0000 7fa57e7fc640 1 -- 172.21.15.6:0/3064771553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584014a00 con 0x7fa588070850 2024-05-20T18:00:36.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.010+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5881f3410 con 0x7fa588070850 2024-05-20T18:00:36.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.011+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa588075b00 con 0x7fa588070850 2024-05-20T18:00:36.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.011+0000 7fa57e7fc640 1 -- 172.21.15.6:0/3064771553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa584014ba0 con 0x7fa588070850 2024-05-20T18:00:36.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.012+0000 7fa57e7fc640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa56c06be60 0x7fa56c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.012+0000 7fa57e7fc640 1 -- 172.21.15.6:0/3064771553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7fa58408b270 con 0x7fa588070850 2024-05-20T18:00:36.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.012+0000 7fa58d057640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa56c06be60 0x7fa56c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.013+0000 7fa58d057640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa56c06be60 0x7fa56c06e370 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa578034000 tx=0x7fa57802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.017+0000 7fa57e7fc640 1 -- 172.21.15.6:0/3064771553 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa584023020 con 0x7fa588070850 2024-05-20T18:00:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.207+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa588070e00 con 0x7fa588070850 2024-05-20T18:00:36.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.208+0000 7fa57e7fc640 1 -- 172.21.15.6:0/3064771553 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+13243 (secure 0 0 0) 0x7fa584059e20 con 0x7fa588070850 2024-05-20T18:00:36.206 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:36.206 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":104,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:34.862709+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/957433228":"2024-05-21T18:00:31.857363+0000","172.21.15.6:6832/957433228":"2024-05-21T18:00:31.857363+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa56c06be60 msgr2=0x7fa56c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa56c06be60 0x7fa56c06e370 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa578034000 tx=0x7fa57802e000 comp rx=0 tx=0).stop 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa588070850 msgr2=0x7fa5881f3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa588070850 0x7fa5881f3c10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fa584007e30 tx=0x7fa58400e4b0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 shutdown_connections 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa56c06be60 0x7fa56c06e370 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58815d530 0x7fa5880c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5880b1700 0x7fa5880c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 --2- 172.21.15.6:0/3064771553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa588070850 0x7fa5881f3c10 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 >> 172.21.15.6:0/3064771553 conn(0x7fa5880d29d0 msgr2=0x7fa58815db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 shutdown_connections 2024-05-20T18:00:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.210+0000 7fa58fabc640 1 -- 172.21.15.6:0/3064771553 wait complete. 2024-05-20T18:00:36.219 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:00:36.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:00:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.340+0000 7f2f72979640 1 Processor -- start 2024-05-20T18:00:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.340+0000 7f2f72979640 1 -- start start 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.341+0000 7f2f72979640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15d530 0x7f2f6c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.341+0000 7f2f72979640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6c0cd580 con 0x7f2f6c0b1700 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.341+0000 7f2f72979640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6c0cd860 con 0x7f2f6c070850 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.341+0000 7f2f72979640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6c0ce190 con 0x7f2f6c15d530 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f63fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f6c0b1700 0x7f2f6c0b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:50754/0 (socket says 172.21.15.6:50754) 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f63fff640 1 -- 172.21.15.6:0/1343897657 learned_addr learned my addr 172.21.15.6:0/1343897657 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 981878258 0 0) 0x7f2f6c0cd580 con 0x7f2f6c0b1700 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f58003520 con 0x7f2f6c0b1700 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6bfff640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15d530 0x7f2f6c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1552322507 0 0) 0x7f2f58003520 con 0x7f2f6c0b1700 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15d530 msgr2=0x7f2f6c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:36.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15d530 0x7f2f6c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 >> v1:172.21.15.171:6789/0 conn(0x7f2f6c070850 legacy=0x7f2f6c070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6c0cdb40 con 0x7f2f6c0b1700 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f2f54001670 con 0x7f2f6c0b1700 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 >> v1:172.21.15.6:6789/0 conn(0x7f2f6c0b1700 legacy=0x7f2f6c0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15d530 0x7f2f580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f58004d40 0x7f2f58005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c0ce190 con 0x7f2f58003f60 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5800bb50 con 0x7f2f58004d40 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5800bd50 con 0x7f2f6c15d530 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.342+0000 7f2f63fff640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f6bfff640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15d530 0x7f2f580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f70f16640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f58004d40 0x7f2f58005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f63fff640 1 -- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15d530 msgr2=0x7f2f580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f63fff640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15d530 0x7f2f580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f63fff640 1 -- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f58004d40 msgr2=0x7f2f58005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f63fff640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f58004d40 0x7f2f58005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f63fff640 1 -- 172.21.15.6:0/1343897657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f58003520 con 0x7f2f58003f60 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f70f16640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f58004d40 0x7f2f58005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.343+0000 7f2f63fff640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f58004800 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0d3ad0 tx=0x7f2f58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3ea8763055299b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54007d10 con 0x7f2f58003f60 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f54005ad0 con 0x7f2f58003f60 2024-05-20T18:00:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f6b7fe640 1 -- 172.21.15.6:0/1343897657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54007070 con 0x7f2f58003f60 2024-05-20T18:00:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f72979640 1 -- 172.21.15.6:0/1343897657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 msgr2=0x7f2f58004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f72979640 1 --2- 172.21.15.6:0/1343897657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f58004800 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0d3ad0 tx=0x7f2f58005830 comp rx=0 tx=0).stop 2024-05-20T18:00:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f70f16640 1 -- 172.21.15.6:0/1343897657 reap_dead start 2024-05-20T18:00:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f72979640 1 -- 172.21.15.6:0/1343897657 shutdown_connections 2024-05-20T18:00:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f72979640 1 -- 172.21.15.6:0/1343897657 >> 172.21.15.6:0/1343897657 conn(0x7f2f6c0d29d0 msgr2=0x7f2f6c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.344+0000 7f2f72979640 1 -- 172.21.15.6:0/1343897657 shutdown_connections 2024-05-20T18:00:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.345+0000 7f2f72979640 1 -- 172.21.15.6:0/1343897657 wait complete. 2024-05-20T18:00:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.346+0000 7f2f72979640 1 Processor -- start 2024-05-20T18:00:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.346+0000 7f2f72979640 1 -- start start 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f72979640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f6c1f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f72979640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f6c0c5750 0x7f2f6c0c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f72979640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15ef40 0x7f2f6c15f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f72979640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c071370 con 0x7f2f58003f60 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f72979640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6c0cd230 con 0x7f2f6c0c5750 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f72979640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6c0714f0 con 0x7f2f6c15ef40 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f6c1f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f6c1f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34714/0 (socket says 172.21.15.6:34714) 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 -- 172.21.15.6:0/3968161700 learned_addr learned my addr 172.21.15.6:0/3968161700 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f70f16640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15ef40 0x7f2f6c15f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f63fff640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f6c0c5750 0x7f2f6c0c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 -- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15ef40 msgr2=0x7f2f6c15f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15ef40 0x7f2f6c15f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 -- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f6c0c5750 msgr2=0x7f2f6c0c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f6c0c5750 0x7f2f6c0c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 -- 172.21.15.6:0/3968161700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6c15f890 con 0x7f2f58003f60 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f6bfff640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f6c1f5d60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c011970 tx=0x7f2f5c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f697fa640 1 -- 172.21.15.6:0/3968161700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00faf0 con 0x7f2f58003f60 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f697fa640 1 -- 172.21.15.6:0/3968161700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c00fc90 con 0x7f2f58003f60 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6c1f6460 con 0x7f2f58003f60 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.348+0000 7f2f697fa640 1 -- 172.21.15.6:0/3968161700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c014440 con 0x7f2f58003f60 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.349+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f6c1f8ee0 con 0x7f2f58003f60 2024-05-20T18:00:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.349+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6c075b00 con 0x7f2f58003f60 2024-05-20T18:00:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.350+0000 7f2f697fa640 1 -- 172.21.15.6:0/3968161700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f5c012040 con 0x7f2f58003f60 2024-05-20T18:00:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.351+0000 7f2f697fa640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f4c06be60 0x7f2f4c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.351+0000 7f2f697fa640 1 -- 172.21.15.6:0/3968161700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7f2f5c08b490 con 0x7f2f58003f60 2024-05-20T18:00:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.351+0000 7f2f63fff640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f4c06be60 0x7f2f4c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.352+0000 7f2f63fff640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f4c06be60 0x7f2f4c06e370 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0d3ad0 tx=0x7f2f5402d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.356+0000 7f2f697fa640 1 -- 172.21.15.6:0/3968161700 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2f6c15f890 con 0x7f2f58003f60 2024-05-20T18:00:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.539+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f6c0af7c0 con 0x7f2f58003f60 2024-05-20T18:00:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.540+0000 7f2f697fa640 1 -- 172.21.15.6:0/3968161700 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) ==== 93+0+10 (secure 0 0 0) 0x7f2f5c019030 con 0x7f2f58003f60 2024-05-20T18:00:36.537 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:00:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.541+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f4c06be60 msgr2=0x7f2f4c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.541+0000 7f2f72979640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f4c06be60 0x7f2f4c06e370 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0d3ad0 tx=0x7f2f5402d000 comp rx=0 tx=0).stop 2024-05-20T18:00:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 msgr2=0x7f2f6c1f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f6c1f5d60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c011970 tx=0x7f2f5c011e30 comp rx=0 tx=0).stop 2024-05-20T18:00:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 shutdown_connections 2024-05-20T18:00:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2f4c06be60 0x7f2f4c06e370 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2f6c15ef40 0x7f2f6c15f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f6c0c5750 0x7f2f6c0c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 --2- 172.21.15.6:0/3968161700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f58003f60 0x7f2f6c1f5d60 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 >> 172.21.15.6:0/3968161700 conn(0x7f2f6c0d29d0 msgr2=0x7f2f6c0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 shutdown_connections 2024-05-20T18:00:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.542+0000 7f2f72979640 1 -- 172.21.15.6:0/3968161700 wait complete. 2024-05-20T18:00:36.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin' 2024-05-20T18:00:36.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.668+0000 7fe388051640 1 Processor -- start 2024-05-20T18:00:36.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.668+0000 7fe388051640 1 -- start start 2024-05-20T18:00:36.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.669+0000 7fe388051640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe3800b4010 0x7fe3800d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.669+0000 7fe388051640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3800d14b0 0x7fe3800d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.669+0000 7fe388051640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3800d0370 con 0x7fe380163a10 2024-05-20T18:00:36.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.669+0000 7fe388051640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe3800d3ca0 con 0x7fe3800d14b0 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.669+0000 7fe388051640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe3800d0650 con 0x7fe3800b4010 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.670+0000 7fe3865ee640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3800d14b0 0x7fe3800d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.670+0000 7fe3865ee640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3800d14b0 0x7fe3800d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34724/0 (socket says 172.21.15.6:34724) 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.670+0000 7fe3865ee640 1 -- 172.21.15.6:0/931738102 learned_addr learned my addr 172.21.15.6:0/931738102 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.670+0000 7fe3855ec640 1 --2- 172.21.15.6:0/931738102 >> v2:172.21.15.171:3300/0 conn(0x7fe3800b4010 0x7fe3800d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.670+0000 7fe3865ee640 1 -- 172.21.15.6:0/931738102 >> v2:172.21.15.171:3300/0 conn(0x7fe3800b4010 msgr2=0x7fe3800d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.670+0000 7fe3865ee640 1 --2- 172.21.15.6:0/931738102 >> v2:172.21.15.171:3300/0 conn(0x7fe3800b4010 0x7fe3800d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.670+0000 7fe3865ee640 1 -- 172.21.15.6:0/931738102 >> v1:172.21.15.171:6789/0 conn(0x7fe380163a10 legacy=0x7fe3800cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:36.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.670+0000 7fe3865ee640 1 -- 172.21.15.6:0/931738102 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3800d3650 con 0x7fe3800d14b0 2024-05-20T18:00:36.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.671+0000 7fe3865ee640 1 --2- 172.21.15.6:0/931738102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3800d14b0 0x7fe3800d18c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe3800b7f80 tx=0x7fe37802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1222d98b138fa77 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.671+0000 7fe384deb640 1 -- 172.21.15.6:0/931738102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378036070 con 0x7fe3800d14b0 2024-05-20T18:00:36.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.671+0000 7fe384deb640 1 -- 172.21.15.6:0/931738102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe378031600 con 0x7fe3800d14b0 2024-05-20T18:00:36.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.671+0000 7fe384deb640 1 -- 172.21.15.6:0/931738102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3780319d0 con 0x7fe3800d14b0 2024-05-20T18:00:36.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.672+0000 7fe388051640 1 -- 172.21.15.6:0/931738102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3800d14b0 msgr2=0x7fe3800d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.672+0000 7fe388051640 1 --2- 172.21.15.6:0/931738102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3800d14b0 0x7fe3800d18c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe3800b7f80 tx=0x7fe37802a730 comp rx=0 tx=0).stop 2024-05-20T18:00:36.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.672+0000 7fe388051640 1 -- 172.21.15.6:0/931738102 shutdown_connections 2024-05-20T18:00:36.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.672+0000 7fe388051640 1 --2- 172.21.15.6:0/931738102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3800d14b0 0x7fe3800d18c0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.672+0000 7fe388051640 1 --2- 172.21.15.6:0/931738102 >> v2:172.21.15.171:3300/0 conn(0x7fe3800b4010 0x7fe3800d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.672+0000 7fe388051640 1 -- 172.21.15.6:0/931738102 >> 172.21.15.6:0/931738102 conn(0x7fe38006d240 msgr2=0x7fe38006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:36.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.672+0000 7fe388051640 1 -- 172.21.15.6:0/931738102 shutdown_connections 2024-05-20T18:00:36.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.672+0000 7fe388051640 1 -- 172.21.15.6:0/931738102 wait complete. 2024-05-20T18:00:36.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.674+0000 7fe388051640 1 Processor -- start 2024-05-20T18:00:36.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.674+0000 7fe388051640 1 -- start start 2024-05-20T18:00:36.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe388051640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3800b4010 0x7fe380159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe388051640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3800d14b0 0x7fe380148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe388051640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe380163a10 0x7fe3801491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe388051640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe3800b8210 con 0x7fe380163a10 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe388051640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe3800d1e00 con 0x7fe3800b4010 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe388051640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe3800b8390 con 0x7fe3800d14b0 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3865ee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe380163a10 0x7fe3801491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3865ee640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe380163a10 0x7fe3801491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34726/0 (socket says 172.21.15.6:34726) 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3865ee640 1 -- 172.21.15.6:0/2688409212 learned_addr learned my addr 172.21.15.6:0/2688409212 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe385ded640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3800b4010 0x7fe380159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3855ec640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3800d14b0 0x7fe380148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3865ee640 1 -- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3800d14b0 msgr2=0x7fe380148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3865ee640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3800d14b0 0x7fe380148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3865ee640 1 -- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3800b4010 msgr2=0x7fe380159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3865ee640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3800b4010 0x7fe380159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.675+0000 7fe3865ee640 1 -- 172.21.15.6:0/2688409212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3800b6fe0 con 0x7fe380163a10 2024-05-20T18:00:36.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.676+0000 7fe3865ee640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe380163a10 0x7fe3801491d0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fe378009f40 tx=0x7fe378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.676+0000 7fe3767fc640 1 -- 172.21.15.6:0/2688409212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37803f020 con 0x7fe380163a10 2024-05-20T18:00:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.676+0000 7fe3767fc640 1 -- 172.21.15.6:0/2688409212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe378037040 con 0x7fe380163a10 2024-05-20T18:00:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.676+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38015b010 con 0x7fe380163a10 2024-05-20T18:00:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.676+0000 7fe3767fc640 1 -- 172.21.15.6:0/2688409212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378036070 con 0x7fe380163a10 2024-05-20T18:00:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.676+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38015aa50 con 0x7fe380163a10 2024-05-20T18:00:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.677+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe380075b00 con 0x7fe380163a10 2024-05-20T18:00:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.677+0000 7fe3767fc640 1 -- 172.21.15.6:0/2688409212 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe378042020 con 0x7fe380163a10 2024-05-20T18:00:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.678+0000 7fe3767fc640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36406be60 0x7fe36406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.678+0000 7fe3767fc640 1 -- 172.21.15.6:0/2688409212 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7fe3780ab020 con 0x7fe380163a10 2024-05-20T18:00:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.678+0000 7fe385ded640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36406be60 0x7fe36406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:36.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.679+0000 7fe385ded640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36406be60 0x7fe36406e370 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe3800d3020 tx=0x7fe37c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:36.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.683+0000 7fe3767fc640 1 -- 172.21.15.6:0/2688409212 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe378049030 con 0x7fe380163a10 2024-05-20T18:00:36.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:36.943+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]} v 0) -- 0x7fe38015d770 con 0x7fe380163a10 2024-05-20T18:00:36.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:00:36.983 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:00:37.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.880+0000 7fe3767fc640 1 -- 172.21.15.6:0/2688409212 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]}]=0 v389) ==== 146+0+0 (secure 0 0 0) 0x7fe378079460 con 0x7fe380163a10 2024-05-20T18:00:37.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36406be60 msgr2=0x7fe36406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:37.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36406be60 0x7fe36406e370 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe3800d3020 tx=0x7fe37c009040 comp rx=0 tx=0).stop 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe380163a10 msgr2=0x7fe3801491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe380163a10 0x7fe3801491d0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fe378009f40 tx=0x7fe378004a40 comp rx=0 tx=0).stop 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 shutdown_connections 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36406be60 0x7fe36406e370 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe380163a10 0x7fe3801491d0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3800d14b0 0x7fe380148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 --2- 172.21.15.6:0/2688409212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3800b4010 0x7fe380159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 >> 172.21.15.6:0/2688409212 conn(0x7fe38006d240 msgr2=0x7fe38015e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 shutdown_connections 2024-05-20T18:00:37.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:37.883+0000 7fe388051640 1 -- 172.21.15.6:0/2688409212 wait complete. 2024-05-20T18:00:37.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T18:00:38.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.022+0000 7f35e9499640 1 Processor -- start 2024-05-20T18:00:38.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.022+0000 7f35e9499640 1 -- start start 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.023+0000 7f35e9499640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f35e406eab0 0x7f35e406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.023+0000 7f35e9499640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e406ba20 con 0x7f35e406b520 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.023+0000 7f35e9499640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e406bd00 con 0x7f35e4157770 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.023+0000 7f35e9499640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f35e406c630 con 0x7f35e406eab0 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f35e406b520 0x7f35e406e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34410/0 (socket says 172.21.15.6:34410) 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e2ffd640 1 -- 172.21.15.6:0/3917948618 learned_addr learned my addr 172.21.15.6:0/3917948618 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35da7fc640 1 --2- 172.21.15.6:0/3917948618 >> v2:172.21.15.171:3300/0 conn(0x7f35e406eab0 0x7f35e406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764763860 0 0) 0x7f35e406ba20 con 0x7f35e406b520 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35d0003520 con 0x7f35e406b520 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2526195454 0 0) 0x7f35d0003520 con 0x7f35e406b520 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 >> v2:172.21.15.171:3300/0 conn(0x7f35e406eab0 msgr2=0x7f35e406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 --2- 172.21.15.6:0/3917948618 >> v2:172.21.15.171:3300/0 conn(0x7f35e406eab0 0x7f35e406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 >> v1:172.21.15.171:6789/0 conn(0x7f35e4157770 legacy=0x7f35e40ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e406bfe0 con 0x7f35e406b520 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f35d4001670 con 0x7f35e406b520 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 >> v1:172.21.15.6:6789/0 conn(0x7f35e406b520 legacy=0x7f35e406e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35d00039b0 0x7f35d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0004800 0x7f35d0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d0005250 0x7f35d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35e406c630 con 0x7f35d0005250 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35d000c1e0 con 0x7f35d0004800 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f35d000c3e0 con 0x7f35d00039b0 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e37fe640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d0005250 0x7f35d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35e2ffd640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35d00039b0 0x7f35d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.024+0000 7f35da7fc640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0004800 0x7f35d0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.025+0000 7f35e37fe640 1 -- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35d00039b0 msgr2=0x7f35d0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.025+0000 7f35e37fe640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35d00039b0 0x7f35d0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.025+0000 7f35e37fe640 1 -- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0004800 msgr2=0x7f35d0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.025+0000 7f35e37fe640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0004800 0x7f35d0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.025+0000 7f35e37fe640 1 -- 172.21.15.6:0/3917948618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d0003520 con 0x7f35d0005250 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.025+0000 7f35da7fc640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0004800 0x7f35d0004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.025+0000 7f35e37fe640 1 -- 172.21.15.6:0/3917948618 reap_dead start 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.025+0000 7f35e37fe640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d0005250 0x7f35d000b9c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f35dc001e50 tx=0x7f35d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7a587cf6a8493e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc001a70 con 0x7f35d0005250 2024-05-20T18:00:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35dc003970 con 0x7f35d0005250 2024-05-20T18:00:38.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e27fc640 1 -- 172.21.15.6:0/3917948618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc003d60 con 0x7f35d0005250 2024-05-20T18:00:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e9499640 1 -- 172.21.15.6:0/3917948618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d0005250 msgr2=0x7f35d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e9499640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d0005250 0x7f35d000b9c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f35dc001e50 tx=0x7f35d0005830 comp rx=0 tx=0).stop 2024-05-20T18:00:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e9499640 1 -- 172.21.15.6:0/3917948618 shutdown_connections 2024-05-20T18:00:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e9499640 1 --2- 172.21.15.6:0/3917948618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35d0005250 0x7f35d000b9c0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e9499640 1 -- 172.21.15.6:0/3917948618 >> 172.21.15.6:0/3917948618 conn(0x7f35e40cd2a0 msgr2=0x7f35e40cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e9499640 1 -- 172.21.15.6:0/3917948618 shutdown_connections 2024-05-20T18:00:38.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.026+0000 7f35e9499640 1 -- 172.21.15.6:0/3917948618 wait complete. 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.028+0000 7f35e9499640 1 Processor -- start 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.028+0000 7f35e9499640 1 -- start start 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e9499640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0005250 0x7f35e4148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e9499640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e415a260 0x7f35e40ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e9499640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35e4149310 0x7f35e40cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e9499640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35e406f0c0 con 0x7f35e415a260 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e9499640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35e406ef40 con 0x7f35d0005250 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e9499640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f35e406cac0 con 0x7f35e4149310 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e415a260 0x7f35e40ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e415a260 0x7f35e40ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35056/0 (socket says 172.21.15.6:35056) 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 -- 172.21.15.6:0/2725158143 learned_addr learned my addr 172.21.15.6:0/2725158143 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e37fe640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35e4149310 0x7f35e40cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e2ffd640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0005250 0x7f35e4148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 -- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35e4149310 msgr2=0x7f35e40cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35e4149310 0x7f35e40cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 -- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0005250 msgr2=0x7f35e4148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0005250 0x7f35e4148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 -- 172.21.15.6:0/2725158143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e41591c0 con 0x7f35e415a260 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35da7fc640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e415a260 0x7f35e40ceb40 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006c00 tx=0x7f35cc011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35dbfff640 1 -- 172.21.15.6:0/2725158143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc015870 con 0x7f35e415a260 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35dbfff640 1 -- 172.21.15.6:0/2725158143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc015a10 con 0x7f35e415a260 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.030+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e41594a0 con 0x7f35e415a260 2024-05-20T18:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.031+0000 7f35dbfff640 1 -- 172.21.15.6:0/2725158143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc015e00 con 0x7f35e415a260 2024-05-20T18:00:38.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.031+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e4159a60 con 0x7f35e415a260 2024-05-20T18:00:38.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.031+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e40af890 con 0x7f35e415a260 2024-05-20T18:00:38.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.032+0000 7f35dbfff640 1 -- 172.21.15.6:0/2725158143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35cc01d400 con 0x7f35e415a260 2024-05-20T18:00:38.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.033+0000 7f35dbfff640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35c406be60 0x7f35c406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.033+0000 7f35dbfff640 1 -- 172.21.15.6:0/2725158143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7f35cc08b6e0 con 0x7f35e415a260 2024-05-20T18:00:38.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.033+0000 7f35e2ffd640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35c406be60 0x7f35c406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.033+0000 7f35e2ffd640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35c406be60 0x7f35c406e370 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f35e4073ad0 tx=0x7f35d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.038+0000 7f35dbfff640 1 -- 172.21.15.6:0/2725158143 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f35e40af890 con 0x7f35e415a260 2024-05-20T18:00:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.220+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f35e4075b00 con 0x7f35e415a260 2024-05-20T18:00:38.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.223+0000 7f35dbfff640 1 -- 172.21.15.6:0/2725158143 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f35cc019030 con 0x7f35e415a260 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35c406be60 msgr2=0x7f35c406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35c406be60 0x7f35c406e370 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f35e4073ad0 tx=0x7f35d4009040 comp rx=0 tx=0).stop 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e415a260 msgr2=0x7f35e40ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e415a260 0x7f35e40ceb40 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f35cc006c00 tx=0x7f35cc011970 comp rx=0 tx=0).stop 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 shutdown_connections 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f35c406be60 0x7f35c406e370 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35e4149310 0x7f35e40cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e415a260 0x7f35e40ceb40 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.225+0000 7f35e9499640 1 --2- 172.21.15.6:0/2725158143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35d0005250 0x7f35e4148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.226+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 >> 172.21.15.6:0/2725158143 conn(0x7f35e40cd2a0 msgr2=0x7f35e40af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.226+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 shutdown_connections 2024-05-20T18:00:38.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.226+0000 7f35e9499640 1 -- 172.21.15.6:0/2725158143 wait complete. 2024-05-20T18:00:38.234 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:00:38.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:00:38.270 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:00:38.314 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:00:38.314 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:38.314 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:38.333 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:00:38.334 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:38.334 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:38.372 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:00:38.372 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:38.372 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:38.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:00:38.390 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:38.390 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:38.430 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:00:38.430 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T18:00:38.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.549+0000 7f2a22785640 1 Processor -- start 2024-05-20T18:00:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.549+0000 7f2a22785640 1 -- start start 2024-05-20T18:00:38.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.550+0000 7f2a22785640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2a1c162820 0x7f2a1c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.550+0000 7f2a22785640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c06dae0 0x7f2a1c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.550+0000 7f2a22785640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1c0d0630 con 0x7f2a1c0b3e80 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.550+0000 7f2a22785640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1c0d39c0 con 0x7f2a1c162820 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.550+0000 7f2a22785640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1c0d3ca0 con 0x7f2a1c06dae0 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.550+0000 7f2a13fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2a1c0b3e80 0x7f2a1c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34422/0 (socket says 172.21.15.6:34422) 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.550+0000 7f2a13fff640 1 -- 172.21.15.6:0/602631007 learned_addr learned my addr 172.21.15.6:0/602631007 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a20d22640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c06dae0 0x7f2a1c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1bfff640 1 --2- 172.21.15.6:0/602631007 >> v2:172.21.15.171:3300/0 conn(0x7f2a1c162820 0x7f2a1c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606913151 0 0) 0x7f2a1c0d0630 con 0x7f2a1c0b3e80 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a08003520 con 0x7f2a1c0b3e80 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4100964766 0 0) 0x7f2a08003520 con 0x7f2a1c0b3e80 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c06dae0 msgr2=0x7f2a1c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c06dae0 0x7f2a1c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 >> v2:172.21.15.171:3300/0 conn(0x7f2a1c162820 msgr2=0x7f2a1c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 --2- 172.21.15.6:0/602631007 >> v2:172.21.15.171:3300/0 conn(0x7f2a1c162820 0x7f2a1c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c0d3f80 con 0x7f2a1c0b3e80 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f2a04001670 con 0x7f2a1c0b3e80 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 >> v1:172.21.15.6:6789/0 conn(0x7f2a1c0b3e80 legacy=0x7f2a1c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a080039b0 0x7f2a08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a08004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a08005150 0x7f2a0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c0d39c0 con 0x7f2a08004800 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c0d3ca0 con 0x7f2a080039b0 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0800bf00 con 0x7f2a08005150 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a13fff640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a08004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a1bfff640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a080039b0 0x7f2a08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.551+0000 7f2a20d22640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a08005150 0x7f2a0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.552+0000 7f2a13fff640 1 -- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a08005150 msgr2=0x7f2a0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.552+0000 7f2a13fff640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a08005150 0x7f2a0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.552+0000 7f2a13fff640 1 -- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a080039b0 msgr2=0x7f2a08003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.552+0000 7f2a13fff640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a080039b0 0x7f2a08003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.552+0000 7f2a13fff640 1 -- 172.21.15.6:0/602631007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a08003520 con 0x7f2a08004800 2024-05-20T18:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.552+0000 7f2a13fff640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a08004c10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400c240 tx=0x7f2a08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1274c98f1b4a61 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0402e070 con 0x7f2a08004800 2024-05-20T18:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a04005af0 con 0x7f2a08004800 2024-05-20T18:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a1b7fe640 1 -- 172.21.15.6:0/602631007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04007d30 con 0x7f2a08004800 2024-05-20T18:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a22785640 1 -- 172.21.15.6:0/602631007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 msgr2=0x7f2a08004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a22785640 1 --2- 172.21.15.6:0/602631007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a08004c10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400c240 tx=0x7f2a08005830 comp rx=0 tx=0).stop 2024-05-20T18:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a20d22640 1 -- 172.21.15.6:0/602631007 reap_dead start 2024-05-20T18:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a22785640 1 -- 172.21.15.6:0/602631007 shutdown_connections 2024-05-20T18:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a22785640 1 -- 172.21.15.6:0/602631007 >> 172.21.15.6:0/602631007 conn(0x7f2a1c0d4bd0 msgr2=0x7f2a1c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a22785640 1 -- 172.21.15.6:0/602631007 shutdown_connections 2024-05-20T18:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.553+0000 7f2a22785640 1 -- 172.21.15.6:0/602631007 wait complete. 2024-05-20T18:00:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.555+0000 7f2a22785640 1 Processor -- start 2024-05-20T18:00:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.555+0000 7f2a22785640 1 -- start start 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a22785640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a1c15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a22785640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c154d20 0x7f2a1c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a22785640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a1c160a10 0x7f2a1c160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a22785640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c0d4780 con 0x7f2a08004800 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a22785640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c0d0300 con 0x7f2a1c160a10 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a22785640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1c0d4900 con 0x7f2a1c154d20 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a1c15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a1c15a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35072/0 (socket says 172.21.15.6:35072) 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 -- 172.21.15.6:0/3645872505 learned_addr learned my addr 172.21.15.6:0/3645872505 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a20d22640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a1c160a10 0x7f2a1c160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a13fff640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c154d20 0x7f2a1c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 -- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c154d20 msgr2=0x7f2a1c154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c154d20 0x7f2a1c154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 -- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a1c160a10 msgr2=0x7f2a1c160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a1c160a10 0x7f2a1c160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 -- 172.21.15.6:0/3645872505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c161360 con 0x7f2a08004800 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a20d22640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a1c160a10 0x7f2a1c160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a1bfff640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a1c15a5f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c011960 tx=0x7f2a0c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a197fa640 1 -- 172.21.15.6:0/3645872505 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00faf0 con 0x7f2a08004800 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1c154ad0 con 0x7f2a08004800 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a197fa640 1 -- 172.21.15.6:0/3645872505 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c00fc90 con 0x7f2a08004800 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a197fa640 1 -- 172.21.15.6:0/3645872505 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c014440 con 0x7f2a08004800 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.557+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1c159830 con 0x7f2a08004800 2024-05-20T18:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.558+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a1c075b00 con 0x7f2a08004800 2024-05-20T18:00:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.559+0000 7f2a197fa640 1 -- 172.21.15.6:0/3645872505 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a0c012040 con 0x7f2a08004800 2024-05-20T18:00:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.560+0000 7f2a197fa640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29fc06be30 0x7f29fc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.560+0000 7f2a197fa640 1 -- 172.21.15.6:0/3645872505 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7f2a0c08b4c0 con 0x7f2a08004800 2024-05-20T18:00:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.560+0000 7f2a13fff640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29fc06be30 0x7f29fc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.561+0000 7f2a13fff640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29fc06be30 0x7f29fc06e340 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2a04033000 tx=0x7f2a04009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.565+0000 7f2a197fa640 1 -- 172.21.15.6:0/3645872505 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2a1c161360 con 0x7f2a08004800 2024-05-20T18:00:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.789+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a1c1e8080 con 0x7f2a08004800 2024-05-20T18:00:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.790+0000 7f2a197fa640 1 -- 172.21.15.6:0/3645872505 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+3869 (secure 0 0 0) 0x7f2a0c019030 con 0x7f2a08004800 2024-05-20T18:00:38.787 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:38.787 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6413,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2288332461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2288332461},{"type":"v1","addr":"172.21.15.171:6835","nonce":2288332461}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7123,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/4138789955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":4138789955},{"type":"v1","addr":"172.21.15.171:6837","nonce":4138789955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2834528553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2834528553},{"type":"v1","addr":"172.21.15.6:6835","nonce":2834528553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2344770254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2344770254},{"type":"v1","addr":"172.21.15.6:6834","nonce":2344770254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[]} 2024-05-20T18:00:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2024-05-20T18:00:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29fc06be30 msgr2=0x7f29fc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29fc06be30 0x7f29fc06e340 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2a04033000 tx=0x7f2a04009030 comp rx=0 tx=0).stop 2024-05-20T18:00:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 msgr2=0x7f2a1c15a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a1c15a5f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c011960 tx=0x7f2a0c011e20 comp rx=0 tx=0).stop 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 shutdown_connections 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29fc06be30 0x7f29fc06e340 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a1c160a10 0x7f2a1c160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a1c154d20 0x7f2a1c154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 --2- 172.21.15.6:0/3645872505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a08004800 0x7f2a1c15a5f0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 >> 172.21.15.6:0/3645872505 conn(0x7f2a1c0d4bd0 msgr2=0x7f2a1c15e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 shutdown_connections 2024-05-20T18:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.792+0000 7f2a22785640 1 -- 172.21.15.6:0/3645872505 wait complete. 2024-05-20T18:00:38.801 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T18:00:38.801 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T18:00:38.801 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T18:00:38.801 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:00:38.801 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T18:00:38.802 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T18:00:38.802 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T18:00:38.802 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:00:38.802 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T18:00:38.802 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T18:00:38.802 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T18:00:38.802 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:00:38.803 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T18:00:38.803 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T18:00:38.803 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T18:00:38.803 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:00:38.811 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T18:00:38.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T18:00:38.813 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T18:00:38.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T18:00:38.814 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T18:00:38.815 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T18:00:38.815 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T18:00:38.815 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T18:00:38.856 INFO:tasks.ceph.mds.c:Started 2024-05-20T18:00:38.856 DEBUG:teuthology.parallel:result is None 2024-05-20T18:00:38.857 INFO:tasks.ceph.mds.a:Started 2024-05-20T18:00:38.857 DEBUG:teuthology.parallel:result is None 2024-05-20T18:00:38.858 INFO:tasks.ceph.mds.d:Started 2024-05-20T18:00:38.858 DEBUG:teuthology.parallel:result is None 2024-05-20T18:00:38.859 INFO:tasks.ceph.mds.b:Started 2024-05-20T18:00:38.859 DEBUG:teuthology.parallel:result is None 2024-05-20T18:00:38.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T18:00:38.947 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T18:00:38.947 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T18:00:38.947 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-20T18:00:38.949+0000 7f586564f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-20T18:00:38.954 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T18:00:38.954 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T18:00:38.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.983+0000 7fa500fea640 1 Processor -- start 2024-05-20T18:00:38.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.983+0000 7fa500fea640 1 -- start start 2024-05-20T18:00:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa500fea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc0cd1b0 0x7fa4fc15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa500fea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4fc070850 0x7fa4fc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa500fea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4fc0711a0 con 0x7fa4fc071630 2024-05-20T18:00:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa500fea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa4fc15f790 con 0x7fa4fc070850 2024-05-20T18:00:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa500fea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc06e590 con 0x7fa4fc0cd1b0 2024-05-20T18:00:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa4fad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4fc070850 0x7fa4fc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa4fad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4fc070850 0x7fa4fc070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35094/0 (socket says 172.21.15.6:35094) 2024-05-20T18:00:38.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa4fa59c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa4fc071630 0x7fa4fc06d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:49080/0 (socket says 172.21.15.6:49080) 2024-05-20T18:00:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa4fad9d640 1 -- 172.21.15.6:0/2968045631 learned_addr learned my addr 172.21.15.6:0/2968045631 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.984+0000 7fa4f1d9b640 1 --2- 172.21.15.6:0/2968045631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc0cd1b0 0x7fa4fc15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.985+0000 7fa4fad9d640 1 -- 172.21.15.6:0/2968045631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc0cd1b0 msgr2=0x7fa4fc15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.985+0000 7fa4fad9d640 1 --2- 172.21.15.6:0/2968045631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc0cd1b0 0x7fa4fc15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.985+0000 7fa4fad9d640 1 -- 172.21.15.6:0/2968045631 >> v1:172.21.15.171:6789/0 conn(0x7fa4fc071630 legacy=0x7fa4fc06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.985+0000 7fa4fad9d640 1 -- 172.21.15.6:0/2968045631 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc0ce2b0 con 0x7fa4fc070850 2024-05-20T18:00:38.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.985+0000 7fa4f9d9b640 1 -- 172.21.15.6:0/2968045631 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991649604 0 0) 0x7fa4ec001110 con 0x7fa4fc071630 2024-05-20T18:00:38.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.985+0000 7fa4fad9d640 1 --2- 172.21.15.6:0/2968045631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc070850 0x7fa4fc070c60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009e50 tx=0x7fa4f402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2617a98f1e9bdab5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa4f9d9b640 1 -- 172.21.15.6:0/2968045631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4036070 con 0x7fa4fc070850 2024-05-20T18:00:38.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa4f9d9b640 1 -- 172.21.15.6:0/2968045631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f4031600 con 0x7fa4fc070850 2024-05-20T18:00:38.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa4f9d9b640 1 -- 172.21.15.6:0/2968045631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40319d0 con 0x7fa4fc070850 2024-05-20T18:00:38.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa500fea640 1 -- 172.21.15.6:0/2968045631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc070850 msgr2=0x7fa4fc070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa500fea640 1 --2- 172.21.15.6:0/2968045631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc070850 0x7fa4fc070c60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009e50 tx=0x7fa4f402a680 comp rx=0 tx=0).stop 2024-05-20T18:00:38.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa500fea640 1 -- 172.21.15.6:0/2968045631 shutdown_connections 2024-05-20T18:00:38.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa500fea640 1 --2- 172.21.15.6:0/2968045631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc070850 0x7fa4fc070c60 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa500fea640 1 --2- 172.21.15.6:0/2968045631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc0cd1b0 0x7fa4fc15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa500fea640 1 -- 172.21.15.6:0/2968045631 >> 172.21.15.6:0/2968045631 conn(0x7fa4fc0d29d0 msgr2=0x7fa4fc0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:38.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa500fea640 1 -- 172.21.15.6:0/2968045631 shutdown_connections 2024-05-20T18:00:38.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.986+0000 7fa500fea640 1 -- 172.21.15.6:0/2968045631 wait complete. 2024-05-20T18:00:38.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.989+0000 7fa500fea640 1 Processor -- start 2024-05-20T18:00:38.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.989+0000 7fa500fea640 1 -- start start 2024-05-20T18:00:38.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.990+0000 7fa500fea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc070850 0x7fa4fc160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.990+0000 7fa500fea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc071630 0x7fa4fc0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.990+0000 7fa500fea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0cd1b0 0x7fa4fc14e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.990+0000 7fa500fea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc06ded0 con 0x7fa4fc071630 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.990+0000 7fa500fea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc06cfc0 con 0x7fa4fc0cd1b0 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.990+0000 7fa4f1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc071630 0x7fa4fc0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.990+0000 7fa500fea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc06d2a0 con 0x7fa4fc070850 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc071630 0x7fa4fc0cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35100/0 (socket says 172.21.15.6:35100) 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f1d9b640 1 -- 172.21.15.6:0/454473136 learned_addr learned my addr 172.21.15.6:0/454473136 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4fa59c640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc070850 0x7fa4fc160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4fad9d640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0cd1b0 0x7fa4fc14e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f1d9b640 1 -- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc070850 msgr2=0x7fa4fc160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f1d9b640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc070850 0x7fa4fc160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f1d9b640 1 -- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0cd1b0 msgr2=0x7fa4fc14e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:38.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f1d9b640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0cd1b0 0x7fa4fc14e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f1d9b640 1 -- 172.21.15.6:0/454473136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc161570 con 0x7fa4fc071630 2024-05-20T18:00:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f1d9b640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc071630 0x7fa4fc0cf3e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400e8a0 tx=0x7fa4e400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f37fe640 1 -- 172.21.15.6:0/454473136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4017070 con 0x7fa4fc071630 2024-05-20T18:00:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f37fe640 1 -- 172.21.15.6:0/454473136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e400c940 con 0x7fa4fc071630 2024-05-20T18:00:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa4f37fe640 1 -- 172.21.15.6:0/454473136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e400cd30 con 0x7fa4fc071630 2024-05-20T18:00:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.991+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc161850 con 0x7fa4fc071630 2024-05-20T18:00:38.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.992+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc161e10 con 0x7fa4fc071630 2024-05-20T18:00:38.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.993+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc075b00 con 0x7fa4fc071630 2024-05-20T18:00:38.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.993+0000 7fa4f37fe640 1 -- 172.21.15.6:0/454473136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4e401a070 con 0x7fa4fc071630 2024-05-20T18:00:38.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.994+0000 7fa4f37fe640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4dc06be60 0x7fa4dc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:38.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.994+0000 7fa4f37fe640 1 -- 172.21.15.6:0/454473136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7fa4e408af40 con 0x7fa4fc071630 2024-05-20T18:00:38.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.994+0000 7fa4fa59c640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4dc06be60 0x7fa4dc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:38.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.994+0000 7fa4fa59c640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4dc06be60 0x7fa4dc06e370 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec007fd0 tx=0x7fa4ec007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:38.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:38.998+0000 7fa4f37fe640 1 -- 172.21.15.6:0/454473136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa4e40592e0 con 0x7fa4fc071630 2024-05-20T18:00:39.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:39.194+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa4fc1612c0 con 0x7fa4fc071630 2024-05-20T18:00:40.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.238+0000 7fa4f37fe640 1 -- 172.21.15.6:0/454473136 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) ==== 97+0+0 (secure 0 0 0) 0x7fa4e405d5e0 con 0x7fa4fc071630 2024-05-20T18:00:40.236 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T18:00:40.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4dc06be60 msgr2=0x7fa4dc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4dc06be60 0x7fa4dc06e370 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec007fd0 tx=0x7fa4ec007de0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc071630 msgr2=0x7fa4fc0cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc071630 0x7fa4fc0cf3e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fa4e400e8a0 tx=0x7fa4e400ed60 comp rx=0 tx=0).stop 2024-05-20T18:00:40.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 shutdown_connections 2024-05-20T18:00:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4dc06be60 0x7fa4dc06e370 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0cd1b0 0x7fa4fc14e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc071630 0x7fa4fc0cf3e0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 --2- 172.21.15.6:0/454473136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc070850 0x7fa4fc160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 >> 172.21.15.6:0/454473136 conn(0x7fa4fc0d29d0 msgr2=0x7fa4fc15e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 shutdown_connections 2024-05-20T18:00:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.241+0000 7fa500fea640 1 -- 172.21.15.6:0/454473136 wait complete. 2024-05-20T18:00:40.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T18:00:40.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.379+0000 7f1bdfccc640 1 Processor -- start 2024-05-20T18:00:40.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.379+0000 7f1bdfccc640 1 -- start start 2024-05-20T18:00:40.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdfccc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 0x7f1bd80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdfccc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1bd806dae0 0x7f1bd80b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdfccc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd80d0630 con 0x7f1bd80b3e80 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdfccc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd80d39c0 con 0x7f1bd806dae0 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdfccc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd80d3ca0 con 0x7f1bd8162820 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdd267640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1bd80b3e80 0x7f1bd806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34458/0 (socket says 172.21.15.6:34458) 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdd267640 1 -- 172.21.15.6:0/3791511099 learned_addr learned my addr 172.21.15.6:0/3791511099 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409338918 0 0) 0x7f1bd80d0630 con 0x7f1bd80b3e80 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bc4003520 con 0x7f1bd80b3e80 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bde269640 1 --2- 172.21.15.6:0/3791511099 >> v2:172.21.15.171:3300/0 conn(0x7f1bd806dae0 0x7f1bd80b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdda68640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 0x7f1bd80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 653765652 0 0) 0x7f1bc4003520 con 0x7f1bd80b3e80 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 msgr2=0x7f1bd80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 0x7f1bd80b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 >> v2:172.21.15.171:3300/0 conn(0x7f1bd806dae0 msgr2=0x7f1bd80b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 --2- 172.21.15.6:0/3791511099 >> v2:172.21.15.171:3300/0 conn(0x7f1bd806dae0 0x7f1bd80b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd80d3f80 con 0x7f1bd80b3e80 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f1bc8001670 con 0x7f1bd80b3e80 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdda68640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 0x7f1bd80b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 >> v1:172.21.15.6:6789/0 conn(0x7f1bd80b3e80 legacy=0x7f1bd806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bc4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.381+0000 7f1bdca66640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bc4004800 0x7f1bc4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdca66640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 0x7f1bc4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80d39c0 con 0x7f1bc40039b0 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80d3ca0 con 0x7f1bc4004800 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc400ba70 con 0x7f1bd8162820 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdda68640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bc4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdd267640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bc4004800 0x7f1bc4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bde269640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 0x7f1bc4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdda68640 1 -- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 msgr2=0x7f1bc4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdda68640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8162820 0x7f1bc4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdda68640 1 -- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bc4004800 msgr2=0x7f1bc4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdda68640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bc4004800 0x7f1bc4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.382+0000 7f1bdda68640 1 -- 172.21.15.6:0/3791511099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc4003520 con 0x7f1bc40039b0 2024-05-20T18:00:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.383+0000 7f1bdda68640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bc4003e20 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4007410 tx=0x7f1bc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27599b2bba4ec8bc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:40.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.383+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4009c80 con 0x7f1bc40039b0 2024-05-20T18:00:40.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.383+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd402c650 con 0x7f1bc40039b0 2024-05-20T18:00:40.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.383+0000 7f1bdca66640 1 -- 172.21.15.6:0/3791511099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd402ca00 con 0x7f1bc40039b0 2024-05-20T18:00:40.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.383+0000 7f1bdfccc640 1 -- 172.21.15.6:0/3791511099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 msgr2=0x7f1bc4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.383+0000 7f1bdfccc640 1 --2- 172.21.15.6:0/3791511099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bc4003e20 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4007410 tx=0x7f1bc4005830 comp rx=0 tx=0).stop 2024-05-20T18:00:40.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.384+0000 7f1bde269640 1 -- 172.21.15.6:0/3791511099 reap_dead start 2024-05-20T18:00:40.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.384+0000 7f1bdfccc640 1 -- 172.21.15.6:0/3791511099 shutdown_connections 2024-05-20T18:00:40.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.384+0000 7f1bdfccc640 1 -- 172.21.15.6:0/3791511099 >> 172.21.15.6:0/3791511099 conn(0x7f1bd80d4bd0 msgr2=0x7f1bd80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:40.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.384+0000 7f1bdfccc640 1 -- 172.21.15.6:0/3791511099 shutdown_connections 2024-05-20T18:00:40.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.384+0000 7f1bdfccc640 1 -- 172.21.15.6:0/3791511099 wait complete. 2024-05-20T18:00:40.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.385+0000 7f1bdfccc640 1 Processor -- start 2024-05-20T18:00:40.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.386+0000 7f1bdfccc640 1 -- start start 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdfccc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bd8154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdfccc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8155090 0x7f1bd81f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdfccc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bd81f8830 0x7f1bd81f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdfccc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80d4780 con 0x7f1bc40039b0 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdfccc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80d0300 con 0x7f1bd81f8830 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdfccc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd80d4900 con 0x7f1bd8155090 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bd8154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bd8154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35114/0 (socket says 172.21.15.6:35114) 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 -- 172.21.15.6:0/2168714324 learned_addr learned my addr 172.21.15.6:0/2168714324 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bde269640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bd81f8830 0x7f1bd81f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdd267640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8155090 0x7f1bd81f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 -- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8155090 msgr2=0x7f1bd81f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8155090 0x7f1bd81f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 -- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bd81f8830 msgr2=0x7f1bd81f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bd81f8830 0x7f1bd81f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 -- 172.21.15.6:0/2168714324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd8154ea0 con 0x7f1bc40039b0 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bde269640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bd81f8830 0x7f1bd81f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.387+0000 7f1bdda68640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bd8154960 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40073b0 tx=0x7f1bd4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.388+0000 7f1bce7fc640 1 -- 172.21.15.6:0/2168714324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4009c80 con 0x7f1bc40039b0 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.388+0000 7f1bce7fc640 1 -- 172.21.15.6:0/2168714324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd402c450 con 0x7f1bc40039b0 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.388+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd80ceaf0 con 0x7f1bc40039b0 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.388+0000 7f1bce7fc640 1 -- 172.21.15.6:0/2168714324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4003bb0 con 0x7f1bc40039b0 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.388+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd80b6ac0 con 0x7f1bc40039b0 2024-05-20T18:00:40.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.389+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd8075b00 con 0x7f1bc40039b0 2024-05-20T18:00:40.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.389+0000 7f1bce7fc640 1 -- 172.21.15.6:0/2168714324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bd4047030 con 0x7f1bc40039b0 2024-05-20T18:00:40.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.390+0000 7f1bce7fc640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bbc06be60 0x7f1bbc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.390+0000 7f1bce7fc640 1 -- 172.21.15.6:0/2168714324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5249+0+0 (secure 0 0 0) 0x7f1bd40ab400 con 0x7f1bc40039b0 2024-05-20T18:00:40.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.390+0000 7f1bdd267640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bbc06be60 0x7f1bbc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.391+0000 7f1bdd267640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bbc06be60 0x7f1bbc06e370 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80b38b0 tx=0x7f1bc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:40.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.394+0000 7f1bce7fc640 1 -- 172.21.15.6:0/2168714324 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1bd404e060 con 0x7f1bc40039b0 2024-05-20T18:00:40.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.647+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f1bd80d5180 con 0x7f1bc40039b0 2024-05-20T18:00:40.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.648+0000 7f1bce7fc640 1 -- 172.21.15.6:0/2168714324 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f1bd403d070 con 0x7f1bc40039b0 2024-05-20T18:00:40.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:40.646 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:00:40.646 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T18:00:40.647 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T18:00:40.648 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:40.649 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.650 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:40.652 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T18:00:40.653 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T18:00:40.655 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:00:40.657 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T18:00:40.659 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:00:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bbc06be60 msgr2=0x7f1bbc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bbc06be60 0x7f1bbc06e370 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80b38b0 tx=0x7f1bc8009040 comp rx=0 tx=0).stop 2024-05-20T18:00:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 msgr2=0x7f1bd8154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bd8154960 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40073b0 tx=0x7f1bd4004ab0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 shutdown_connections 2024-05-20T18:00:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bbc06be60 0x7f1bbc06e370 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1bd81f8830 0x7f1bd81f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1bd8155090 0x7f1bd81f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 --2- 172.21.15.6:0/2168714324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bc40039b0 0x7f1bd8154960 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 >> 172.21.15.6:0/2168714324 conn(0x7f1bd80d4bd0 msgr2=0x7f1bd80b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:40.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 shutdown_connections 2024-05-20T18:00:40.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.650+0000 7f1bdfccc640 1 -- 172.21.15.6:0/2168714324 wait complete. 2024-05-20T18:00:40.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.779+0000 7fa2ee084640 1 Processor -- start 2024-05-20T18:00:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.779+0000 7fa2ee084640 1 -- start start 2024-05-20T18:00:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.780+0000 7fa2ee084640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa2e8162820 0x7fa2e80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.780+0000 7fa2ee084640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2e806dae0 0x7fa2e80b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.780+0000 7fa2ee084640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2e80d0630 con 0x7fa2e80b3e80 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.780+0000 7fa2ee084640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e80d39c0 con 0x7fa2e806dae0 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.780+0000 7fa2ee084640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e80d3ca0 con 0x7fa2e8162820 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2e806dae0 0x7fa2e80b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2e806dae0 0x7fa2e80b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35130/0 (socket says 172.21.15.6:35130) 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e7fff640 1 -- 172.21.15.6:0/3886093258 learned_addr learned my addr 172.21.15.6:0/3886093258 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e77fe640 1 --2- 172.21.15.6:0/3886093258 >> v2:172.21.15.171:3300/0 conn(0x7fa2e8162820 0x7fa2e80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e7fff640 1 -- 172.21.15.6:0/3886093258 >> v2:172.21.15.171:3300/0 conn(0x7fa2e8162820 msgr2=0x7fa2e80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e7fff640 1 --2- 172.21.15.6:0/3886093258 >> v2:172.21.15.171:3300/0 conn(0x7fa2e8162820 0x7fa2e80b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e7fff640 1 -- 172.21.15.6:0/3886093258 >> v1:172.21.15.171:6789/0 conn(0x7fa2e80b3e80 legacy=0x7fa2e806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e7fff640 1 -- 172.21.15.6:0/3886093258 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e80d3f80 con 0x7fa2e806dae0 2024-05-20T18:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.781+0000 7fa2e77fe640 1 --2- 172.21.15.6:0/3886093258 >> v2:172.21.15.171:3300/0 conn(0x7fa2e8162820 0x7fa2e80b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.782+0000 7fa2e7fff640 1 --2- 172.21.15.6:0/3886093258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e806dae0 0x7fa2e80b8190 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80b7740 tx=0x7fa2e002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7763d59eafb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.782+0000 7fa2e67fc640 1 -- 172.21.15.6:0/3886093258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0036070 con 0x7fa2e806dae0 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.782+0000 7fa2e67fc640 1 -- 172.21.15.6:0/3886093258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e0031600 con 0x7fa2e806dae0 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.782+0000 7fa2e67fc640 1 -- 172.21.15.6:0/3886093258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00319d0 con 0x7fa2e806dae0 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.783+0000 7fa2ee084640 1 -- 172.21.15.6:0/3886093258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e806dae0 msgr2=0x7fa2e80b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.783+0000 7fa2ee084640 1 --2- 172.21.15.6:0/3886093258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e806dae0 0x7fa2e80b8190 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80b7740 tx=0x7fa2e002a730 comp rx=0 tx=0).stop 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.783+0000 7fa2ee084640 1 -- 172.21.15.6:0/3886093258 shutdown_connections 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.783+0000 7fa2ee084640 1 --2- 172.21.15.6:0/3886093258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e806dae0 0x7fa2e80b8190 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.783+0000 7fa2ee084640 1 --2- 172.21.15.6:0/3886093258 >> v2:172.21.15.171:3300/0 conn(0x7fa2e8162820 0x7fa2e80b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.783+0000 7fa2ee084640 1 -- 172.21.15.6:0/3886093258 >> 172.21.15.6:0/3886093258 conn(0x7fa2e80d4bd0 msgr2=0x7fa2e80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.783+0000 7fa2ee084640 1 -- 172.21.15.6:0/3886093258 shutdown_connections 2024-05-20T18:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.783+0000 7fa2ee084640 1 -- 172.21.15.6:0/3886093258 wait complete. 2024-05-20T18:00:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.784+0000 7fa2ee084640 1 Processor -- start 2024-05-20T18:00:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.785+0000 7fa2ee084640 1 -- start start 2024-05-20T18:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2ee084640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e80b3e80 0x7fa2e8148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2ee084640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e8162820 0x7fa2e8145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2ee084640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e8145940 0x7fa2e8158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2ee084640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e80d4780 con 0x7fa2e80b3e80 2024-05-20T18:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2ee084640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e80d0300 con 0x7fa2e8162820 2024-05-20T18:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2ee084640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e80d4900 con 0x7fa2e8145940 2024-05-20T18:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e80b3e80 0x7fa2e8148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e80b3e80 0x7fa2e8148ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35144/0 (socket says 172.21.15.6:35144) 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e77fe640 1 -- 172.21.15.6:0/857291828 learned_addr learned my addr 172.21.15.6:0/857291828 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e6ffd640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e8162820 0x7fa2e8145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e7fff640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e8145940 0x7fa2e8158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e77fe640 1 -- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e8145940 msgr2=0x7fa2e8158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e77fe640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e8145940 0x7fa2e8158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e77fe640 1 -- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e8162820 msgr2=0x7fa2e8145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e77fe640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e8162820 0x7fa2e8145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.786+0000 7fa2e77fe640 1 -- 172.21.15.6:0/857291828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e8155650 con 0x7fa2e80b3e80 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.787+0000 7fa2e77fe640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e80b3e80 0x7fa2e8148ce0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800d7d0 tx=0x7fa2d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.787+0000 7fa2cffff640 1 -- 172.21.15.6:0/857291828 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8004030 con 0x7fa2e80b3e80 2024-05-20T18:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.787+0000 7fa2cffff640 1 -- 172.21.15.6:0/857291828 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d80041d0 con 0x7fa2e80b3e80 2024-05-20T18:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.787+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e8155930 con 0x7fa2e80b3e80 2024-05-20T18:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.787+0000 7fa2cffff640 1 -- 172.21.15.6:0/857291828 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80096a0 con 0x7fa2e80b3e80 2024-05-20T18:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.787+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e80b64e0 con 0x7fa2e80b3e80 2024-05-20T18:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.788+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e80b6740 con 0x7fa2e80b3e80 2024-05-20T18:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.788+0000 7fa2cffff640 1 -- 172.21.15.6:0/857291828 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2d8009840 con 0x7fa2e80b3e80 2024-05-20T18:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.789+0000 7fa2cffff640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2d406be30 0x7fa2d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.789+0000 7fa2cffff640 1 -- 172.21.15.6:0/857291828 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5249+0+0 (secure 0 0 0) 0x7fa2d808b030 con 0x7fa2e80b3e80 2024-05-20T18:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.789+0000 7fa2e6ffd640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2d406be30 0x7fa2d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.790+0000 7fa2e6ffd640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2d406be30 0x7fa2d406e340 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc007fd0 tx=0x7fa2dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.794+0000 7fa2cffff640 1 -- 172.21.15.6:0/857291828 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa2d8059b10 con 0x7fa2e80b3e80 2024-05-20T18:00:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.978+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2e8075b00 con 0x7fa2e80b3e80 2024-05-20T18:00:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.978+0000 7fa2cffff640 1 -- 172.21.15.6:0/857291828 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+13118 (secure 0 0 0) 0x7fa2d8059410 con 0x7fa2e80b3e80 2024-05-20T18:00:40.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:40.977 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":109,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:40.237532+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2d406be30 msgr2=0x7fa2d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2d406be30 0x7fa2d406e340 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc007fd0 tx=0x7fa2dc009040 comp rx=0 tx=0).stop 2024-05-20T18:00:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e80b3e80 msgr2=0x7fa2e8148ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e80b3e80 0x7fa2e8148ce0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800d7d0 tx=0x7fa2d800dc90 comp rx=0 tx=0).stop 2024-05-20T18:00:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 shutdown_connections 2024-05-20T18:00:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2d406be30 0x7fa2d406e340 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e8145940 0x7fa2e8158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e8162820 0x7fa2e8145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 --2- 172.21.15.6:0/857291828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e80b3e80 0x7fa2e8148ce0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 >> 172.21.15.6:0/857291828 conn(0x7fa2e80d4bd0 msgr2=0x7fa2e80c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 shutdown_connections 2024-05-20T18:00:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:40.981+0000 7fa2ee084640 1 -- 172.21.15.6:0/857291828 wait complete. 2024-05-20T18:00:40.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:00:40.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:00:41.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.111+0000 7fbf1358f640 1 Processor -- start 2024-05-20T18:00:41.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.111+0000 7fbf1358f640 1 -- start start 2024-05-20T18:00:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.112+0000 7fbf1358f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbf0c161350 0x7fbf0c161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.112+0000 7fbf1358f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf0c0d1830 0x7fbf0c0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.112+0000 7fbf1358f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0c160b90 con 0x7fbf0c06b520 2024-05-20T18:00:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.112+0000 7fbf1358f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbf0c0d2180 con 0x7fbf0c0d1830 2024-05-20T18:00:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.112+0000 7fbf1358f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbf0c15de60 con 0x7fbf0c161350 2024-05-20T18:00:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.112+0000 7fbf11b2c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf0c0d1830 0x7fbf0c0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.112+0000 7fbf1132b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf0c06b520 0x7fbf0c15d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34466/0 (socket says 172.21.15.6:34466) 2024-05-20T18:00:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.112+0000 7fbf1132b640 1 -- 172.21.15.6:0/2302901894 learned_addr learned my addr 172.21.15.6:0/2302901894 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.113+0000 7fbf10b2a640 1 --2- 172.21.15.6:0/2302901894 >> v2:172.21.15.171:3300/0 conn(0x7fbf0c161350 0x7fbf0c161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.113+0000 7fbf11b2c640 1 -- 172.21.15.6:0/2302901894 >> v2:172.21.15.171:3300/0 conn(0x7fbf0c161350 msgr2=0x7fbf0c161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.113+0000 7fbf11b2c640 1 --2- 172.21.15.6:0/2302901894 >> v2:172.21.15.171:3300/0 conn(0x7fbf0c161350 0x7fbf0c161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.113+0000 7fbf11b2c640 1 -- 172.21.15.6:0/2302901894 >> v1:172.21.15.6:6789/0 conn(0x7fbf0c06b520 legacy=0x7fbf0c15d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.113+0000 7fbf0bfff640 1 -- 172.21.15.6:0/2302901894 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 465408192 0 0) 0x7fbf0c160b90 con 0x7fbf0c06b520 2024-05-20T18:00:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.113+0000 7fbf11b2c640 1 -- 172.21.15.6:0/2302901894 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c15e140 con 0x7fbf0c0d1830 2024-05-20T18:00:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf11b2c640 1 --2- 172.21.15.6:0/2302901894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c0d1830 0x7fbf0c0d1c40 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0b7510 tx=0x7fbefc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbaccab44bd0653 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf0bfff640 1 -- 172.21.15.6:0/2302901894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc037070 con 0x7fbf0c0d1830 2024-05-20T18:00:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf0bfff640 1 -- 172.21.15.6:0/2302901894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc032440 con 0x7fbf0c0d1830 2024-05-20T18:00:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf0bfff640 1 -- 172.21.15.6:0/2302901894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc032810 con 0x7fbf0c0d1830 2024-05-20T18:00:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf1358f640 1 -- 172.21.15.6:0/2302901894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c0d1830 msgr2=0x7fbf0c0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2302901894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c0d1830 0x7fbf0c0d1c40 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0b7510 tx=0x7fbefc02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf1358f640 1 -- 172.21.15.6:0/2302901894 shutdown_connections 2024-05-20T18:00:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2302901894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c0d1830 0x7fbf0c0d1c40 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2302901894 >> v2:172.21.15.171:3300/0 conn(0x7fbf0c161350 0x7fbf0c161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.114+0000 7fbf1358f640 1 -- 172.21.15.6:0/2302901894 >> 172.21.15.6:0/2302901894 conn(0x7fbf0c0b6670 msgr2=0x7fbf0c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.115+0000 7fbf1358f640 1 -- 172.21.15.6:0/2302901894 shutdown_connections 2024-05-20T18:00:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.115+0000 7fbf1358f640 1 -- 172.21.15.6:0/2302901894 wait complete. 2024-05-20T18:00:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.116+0000 7fbf1358f640 1 Processor -- start 2024-05-20T18:00:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.116+0000 7fbf1358f640 1 -- start start 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1358f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf0c06b520 0x7fbf0c13f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1358f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c1e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1358f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c161350 0x7fbf0c1e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1358f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c143740 con 0x7fbf0c161350 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1358f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c160e30 con 0x7fbf0c06b520 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1358f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0c15e970 con 0x7fbf0c0d1830 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c161350 0x7fbf0c1e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c161350 0x7fbf0c1e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35154/0 (socket says 172.21.15.6:35154) 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 -- 172.21.15.6:0/2861750217 learned_addr learned my addr 172.21.15.6:0/2861750217 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1132b640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf0c06b520 0x7fbf0c13f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf10b2a640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c1e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 -- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf0c0d1830 msgr2=0x7fbf0c1e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c1e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 -- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf0c06b520 msgr2=0x7fbf0c13f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf0c06b520 0x7fbf0c13f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 -- 172.21.15.6:0/2861750217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c0b2880 con 0x7fbf0c161350 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1132b640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf0c06b520 0x7fbf0c13f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf11b2c640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c161350 0x7fbf0c1e69b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fbefc02a1e0 tx=0x7fbefc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf09ffb640 1 -- 172.21.15.6:0/2861750217 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc037040 con 0x7fbf0c161350 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf09ffb640 1 -- 172.21.15.6:0/2861750217 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc042070 con 0x7fbf0c161350 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.118+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0c149e30 con 0x7fbf0c161350 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.119+0000 7fbf09ffb640 1 -- 172.21.15.6:0/2861750217 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc030b50 con 0x7fbf0c161350 2024-05-20T18:00:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.119+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0c14b990 con 0x7fbf0c161350 2024-05-20T18:00:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.120+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0c149c50 con 0x7fbf0c161350 2024-05-20T18:00:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.120+0000 7fbf09ffb640 1 -- 172.21.15.6:0/2861750217 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbefc030cf0 con 0x7fbf0c161350 2024-05-20T18:00:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.121+0000 7fbf09ffb640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbef806be60 0x7fbef806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.121+0000 7fbf09ffb640 1 -- 172.21.15.6:0/2861750217 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5249+0+0 (secure 0 0 0) 0x7fbefc0ab7b0 con 0x7fbf0c161350 2024-05-20T18:00:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.121+0000 7fbf1132b640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbef806be60 0x7fbef806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.122+0000 7fbf1132b640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbef806be60 0x7fbef806e370 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000f60 tx=0x7fbf04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.125+0000 7fbf09ffb640 1 -- 172.21.15.6:0/2861750217 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbf0c149c50 con 0x7fbf0c161350 2024-05-20T18:00:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.309+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf0c075b00 con 0x7fbf0c161350 2024-05-20T18:00:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.310+0000 7fbf09ffb640 1 -- 172.21.15.6:0/2861750217 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) ==== 93+0+10 (secure 0 0 0) 0x7fbefc04c020 con 0x7fbf0c161350 2024-05-20T18:00:41.308 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:00:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbef806be60 msgr2=0x7fbef806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbef806be60 0x7fbef806e370 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000f60 tx=0x7fbf04009040 comp rx=0 tx=0).stop 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c161350 msgr2=0x7fbf0c1e69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c161350 0x7fbf0c1e69b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fbefc02a1e0 tx=0x7fbefc0046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 shutdown_connections 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbef806be60 0x7fbef806e370 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf0c161350 0x7fbf0c1e69b0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbf0c0d1830 0x7fbf0c1e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 --2- 172.21.15.6:0/2861750217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf0c06b520 0x7fbf0c13f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 >> 172.21.15.6:0/2861750217 conn(0x7fbf0c0b6670 msgr2=0x7fbf0c09a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 shutdown_connections 2024-05-20T18:00:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.312+0000 7fbf1358f640 1 -- 172.21.15.6:0/2861750217 wait complete. 2024-05-20T18:00:41.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T18:00:41.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.438+0000 7f223a21b640 1 Processor -- start 2024-05-20T18:00:41.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.438+0000 7f223a21b640 1 -- start start 2024-05-20T18:00:41.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.439+0000 7f223a21b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2234163a10 0x7f22340d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.439+0000 7f223a21b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340d14b0 0x7f22340d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.439+0000 7f223a21b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22340d0370 con 0x7f22340b4010 2024-05-20T18:00:41.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.439+0000 7f223a21b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f22340d3ca0 con 0x7f2234163a10 2024-05-20T18:00:41.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.439+0000 7f223a21b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22340d0650 con 0x7f22340d14b0 2024-05-20T18:00:41.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f2233fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340d14b0 0x7f22340d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f2233fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340d14b0 0x7f22340d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:34310/0 (socket says 172.21.15.6:34310) 2024-05-20T18:00:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f2233fff640 1 -- 172.21.15.6:0/140509031 learned_addr learned my addr 172.21.15.6:0/140509031 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f22337fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2234163a10 0x7f22340d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f2233fff640 1 -- 172.21.15.6:0/140509031 >> v2:172.21.15.171:3300/0 conn(0x7f2234163a10 msgr2=0x7f22340d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f2233fff640 1 --2- 172.21.15.6:0/140509031 >> v2:172.21.15.171:3300/0 conn(0x7f2234163a10 0x7f22340d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f2233fff640 1 -- 172.21.15.6:0/140509031 >> v1:172.21.15.171:6789/0 conn(0x7f22340b4010 legacy=0x7f22340cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f2233fff640 1 -- 172.21.15.6:0/140509031 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22340d3650 con 0x7f22340d14b0 2024-05-20T18:00:41.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.440+0000 7f22337fe640 1 --2- 172.21.15.6:0/140509031 >> v2:172.21.15.171:3300/0 conn(0x7f2234163a10 0x7f22340d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:41.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.441+0000 7f2233fff640 1 --2- 172.21.15.6:0/140509031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340d14b0 0x7f22340d18c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f222c009e50 tx=0x7f222c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a8ceb1c090d100b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.441+0000 7f22327fc640 1 -- 172.21.15.6:0/140509031 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c036070 con 0x7f22340d14b0 2024-05-20T18:00:41.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.441+0000 7f22327fc640 1 -- 172.21.15.6:0/140509031 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c031600 con 0x7f22340d14b0 2024-05-20T18:00:41.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.441+0000 7f22327fc640 1 -- 172.21.15.6:0/140509031 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c0319d0 con 0x7f22340d14b0 2024-05-20T18:00:41.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.442+0000 7f223a21b640 1 -- 172.21.15.6:0/140509031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340d14b0 msgr2=0x7f22340d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.442+0000 7f223a21b640 1 --2- 172.21.15.6:0/140509031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340d14b0 0x7f22340d18c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f222c009e50 tx=0x7f222c02a710 comp rx=0 tx=0).stop 2024-05-20T18:00:41.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.442+0000 7f223a21b640 1 -- 172.21.15.6:0/140509031 shutdown_connections 2024-05-20T18:00:41.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.442+0000 7f223a21b640 1 --2- 172.21.15.6:0/140509031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340d14b0 0x7f22340d18c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.442+0000 7f223a21b640 1 --2- 172.21.15.6:0/140509031 >> v2:172.21.15.171:3300/0 conn(0x7f2234163a10 0x7f22340d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.442+0000 7f223a21b640 1 -- 172.21.15.6:0/140509031 >> 172.21.15.6:0/140509031 conn(0x7f223406d240 msgr2=0x7f223406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.442+0000 7f223a21b640 1 -- 172.21.15.6:0/140509031 shutdown_connections 2024-05-20T18:00:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.442+0000 7f223a21b640 1 -- 172.21.15.6:0/140509031 wait complete. 2024-05-20T18:00:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.444+0000 7f223a21b640 1 Processor -- start 2024-05-20T18:00:41.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.444+0000 7f223a21b640 1 -- start start 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f223a21b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340b4010 0x7f2234160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f223a21b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22340d14b0 0x7f2234153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f223a21b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2234163a10 0x7f2234161d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f223a21b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22340b8210 con 0x7f2234163a10 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f223a21b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22340d1e00 con 0x7f22340d14b0 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f223a21b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22340b8390 con 0x7f22340b4010 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f2233fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2234163a10 0x7f2234161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f2233fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2234163a10 0x7f2234161d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35160/0 (socket says 172.21.15.6:35160) 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.445+0000 7f2233fff640 1 -- 172.21.15.6:0/3998701100 learned_addr learned my addr 172.21.15.6:0/3998701100 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f2232ffd640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22340d14b0 0x7f2234153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f22337fe640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340b4010 0x7f2234160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f2233fff640 1 -- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340b4010 msgr2=0x7f2234160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f2233fff640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340b4010 0x7f2234160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f2233fff640 1 -- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22340d14b0 msgr2=0x7f2234153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f2233fff640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22340d14b0 0x7f2234153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f2233fff640 1 -- 172.21.15.6:0/3998701100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2234161360 con 0x7f2234163a10 2024-05-20T18:00:41.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f2233fff640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2234163a10 0x7f2234161d30 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f222c009f70 tx=0x7f222c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f221bfff640 1 -- 172.21.15.6:0/3998701100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c03f020 con 0x7f2234163a10 2024-05-20T18:00:41.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f221bfff640 1 -- 172.21.15.6:0/3998701100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222c037040 con 0x7f2234163a10 2024-05-20T18:00:41.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2234159640 con 0x7f2234163a10 2024-05-20T18:00:41.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f221bfff640 1 -- 172.21.15.6:0/3998701100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222c036070 con 0x7f2234163a10 2024-05-20T18:00:41.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.446+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2234159c00 con 0x7f2234163a10 2024-05-20T18:00:41.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.447+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22341610d0 con 0x7f2234163a10 2024-05-20T18:00:41.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.448+0000 7f221bfff640 1 -- 172.21.15.6:0/3998701100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f222c042020 con 0x7f2234163a10 2024-05-20T18:00:41.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.448+0000 7f221bfff640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f222006be30 0x7f222006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.449+0000 7f221bfff640 1 -- 172.21.15.6:0/3998701100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5249+0+0 (secure 0 0 0) 0x7f222c0ab1d0 con 0x7f2234163a10 2024-05-20T18:00:41.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.449+0000 7f22337fe640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f222006be30 0x7f222006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.449+0000 7f22337fe640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f222006be30 0x7f222006e340 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f22340d3020 tx=0x7f2224008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.453+0000 7f221bfff640 1 -- 172.21.15.6:0/3998701100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f222c049030 con 0x7f2234163a10 2024-05-20T18:00:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.638+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2234075b00 con 0x7f2234163a10 2024-05-20T18:00:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.638+0000 7f221bfff640 1 -- 172.21.15.6:0/3998701100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) ==== 84+0+65 (secure 0 0 0) 0x7f222c079cb0 con 0x7f2234163a10 2024-05-20T18:00:41.637 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:41.637 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T18:00:41.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:00:41.637 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T18:00:41.637 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T18:00:41.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:00:41.637 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f222006be30 msgr2=0x7f222006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f222006be30 0x7f222006e340 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f22340d3020 tx=0x7f2224008040 comp rx=0 tx=0).stop 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2234163a10 msgr2=0x7f2234161d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2234163a10 0x7f2234161d30 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f222c009f70 tx=0x7f222c004a40 comp rx=0 tx=0).stop 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 shutdown_connections 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f222006be30 0x7f222006e340 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2234163a10 0x7f2234161d30 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22340d14b0 0x7f2234153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 --2- 172.21.15.6:0/3998701100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22340b4010 0x7f2234160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 >> 172.21.15.6:0/3998701100 conn(0x7f223406d240 msgr2=0x7f22340b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 shutdown_connections 2024-05-20T18:00:41.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.640+0000 7f223a21b640 1 -- 172.21.15.6:0/3998701100 wait complete. 2024-05-20T18:00:41.650 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T18:00:41.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T18:00:41.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.771+0000 7ff98b8d8640 1 Processor -- start 2024-05-20T18:00:41.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.771+0000 7ff98b8d8640 1 -- start start 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff98b8d8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff98406d830 0x7ff9840cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff98b8d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9840d2740 con 0x7ff9840cdf70 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff98b8d8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9840b81a0 con 0x7ff9840d2330 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff98b8d8640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff98409c3b0 con 0x7ff98406d830 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff989e75640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff9840cdf70 0x7ff9840d0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34468/0 (socket says 172.21.15.6:34468) 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff989e75640 1 -- 172.21.15.6:0/1935443761 learned_addr learned my addr 172.21.15.6:0/1935443761 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff988e73640 1 --2- 172.21.15.6:0/1935443761 >> v2:172.21.15.171:3300/0 conn(0x7ff98406d830 0x7ff9840cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff97bfff640 1 -- 172.21.15.6:0/1935443761 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2349311678 0 0) 0x7ff9840d2740 con 0x7ff9840cdf70 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff97bfff640 1 -- 172.21.15.6:0/1935443761 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff970003520 con 0x7ff9840cdf70 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff97bfff640 1 -- 172.21.15.6:0/1935443761 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975662650 0 0) 0x7ff9840b81a0 con 0x7ff9840d2330 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff97bfff640 1 -- 172.21.15.6:0/1935443761 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9840d2740 con 0x7ff9840d2330 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff988e73640 1 -- 172.21.15.6:0/1935443761 >> v1:172.21.15.171:6789/0 conn(0x7ff9840d2330 legacy=0x7ff98406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff988e73640 1 -- 172.21.15.6:0/1935443761 >> v1:172.21.15.6:6789/0 conn(0x7ff9840cdf70 legacy=0x7ff9840d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.773+0000 7ff97bfff640 1 -- 172.21.15.6:0/1935443761 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2657154031 0 0) 0x7ff970003520 con 0x7ff9840cdf70 2024-05-20T18:00:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.774+0000 7ff988e73640 1 -- 172.21.15.6:0/1935443761 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98409c040 con 0x7ff98406d830 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.774+0000 7ff988e73640 1 --2- 172.21.15.6:0/1935443761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff98406d830 0x7ff9840cda30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff97402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4aab7c8158124d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff97bfff640 1 -- 172.21.15.6:0/1935443761 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974037070 con 0x7ff98406d830 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff97bfff640 1 -- 172.21.15.6:0/1935443761 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97402ac50 con 0x7ff98406d830 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff97bfff640 1 -- 172.21.15.6:0/1935443761 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c001670 con 0x7ff98406d830 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff98b8d8640 1 -- 172.21.15.6:0/1935443761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff98406d830 msgr2=0x7ff9840cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff98b8d8640 1 --2- 172.21.15.6:0/1935443761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff98406d830 0x7ff9840cda30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff97402a1c0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff98b8d8640 1 -- 172.21.15.6:0/1935443761 shutdown_connections 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff98b8d8640 1 --2- 172.21.15.6:0/1935443761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff98406d830 0x7ff9840cda30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff98b8d8640 1 -- 172.21.15.6:0/1935443761 >> 172.21.15.6:0/1935443761 conn(0x7ff9840cf450 msgr2=0x7ff9840cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff98b8d8640 1 -- 172.21.15.6:0/1935443761 shutdown_connections 2024-05-20T18:00:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.775+0000 7ff98b8d8640 1 -- 172.21.15.6:0/1935443761 wait complete. 2024-05-20T18:00:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.777+0000 7ff98b8d8640 1 Processor -- start 2024-05-20T18:00:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.777+0000 7ff98b8d8640 1 -- start start 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.778+0000 7ff98b8d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff98406d830 0x7ff98415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.778+0000 7ff98b8d8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9840cdf70 0x7ff98415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.778+0000 7ff98b8d8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9840d2330 0x7ff98415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.778+0000 7ff98b8d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff9840b4180 con 0x7ff98406d830 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.778+0000 7ff98b8d8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff98406dda0 con 0x7ff9840cdf70 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.778+0000 7ff98b8d8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff9840b4300 con 0x7ff9840d2330 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff98406d830 0x7ff98415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff98406d830 0x7ff98415dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35166/0 (socket says 172.21.15.6:35166) 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 -- 172.21.15.6:0/760114547 learned_addr learned my addr 172.21.15.6:0/760114547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:41.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff988e73640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9840cdf70 0x7ff98415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989e75640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9840d2330 0x7ff98415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 -- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9840d2330 msgr2=0x7ff98415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9840d2330 0x7ff98415b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 -- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9840cdf70 msgr2=0x7ff98415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9840cdf70 0x7ff98415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 -- 172.21.15.6:0/760114547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98415cf50 con 0x7ff98406d830 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff988e73640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9840cdf70 0x7ff98415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff989674640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff98406d830 0x7ff98415dff0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c7c0 tx=0x7ff98000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff979ffb640 1 -- 172.21.15.6:0/760114547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980003bc0 con 0x7ff98406d830 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff979ffb640 1 -- 172.21.15.6:0/760114547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff980003d60 con 0x7ff98406d830 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98415d230 con 0x7ff98406d830 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.779+0000 7ff979ffb640 1 -- 172.21.15.6:0/760114547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98000aa50 con 0x7ff98406d830 2024-05-20T18:00:41.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.780+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98415d7f0 con 0x7ff98406d830 2024-05-20T18:00:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.781+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9840b8b70 con 0x7ff98406d830 2024-05-20T18:00:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.781+0000 7ff979ffb640 1 -- 172.21.15.6:0/760114547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff98000abf0 con 0x7ff98406d830 2024-05-20T18:00:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.782+0000 7ff979ffb640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff96806be60 0x7ff96806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.782+0000 7ff979ffb640 1 -- 172.21.15.6:0/760114547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5249+0+0 (secure 0 0 0) 0x7ff98008acc0 con 0x7ff98406d830 2024-05-20T18:00:41.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.782+0000 7ff988e73640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff96806be60 0x7ff96806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:41.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.783+0000 7ff988e73640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff96806be60 0x7ff96806e370 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff974034000 tx=0x7ff97402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.786+0000 7ff979ffb640 1 -- 172.21.15.6:0/760114547 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff9840b8b70 con 0x7ff98406d830 2024-05-20T18:00:41.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:41.973+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff9840690b0 con 0x7ff98406d830 2024-05-20T18:00:42.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.895+0000 7ff979ffb640 1 -- 172.21.15.6:0/760114547 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) ==== 138+0+0 (secure 0 0 0) 0x7ff9800597a0 con 0x7ff98406d830 2024-05-20T18:00:42.894 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff96806be60 msgr2=0x7ff96806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff96806be60 0x7ff96806e370 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff974034000 tx=0x7ff97402e000 comp rx=0 tx=0).stop 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff98406d830 msgr2=0x7ff98415dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff98406d830 0x7ff98415dff0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c7c0 tx=0x7ff98000cc80 comp rx=0 tx=0).stop 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 shutdown_connections 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff96806be60 0x7ff96806e370 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9840d2330 0x7ff98415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff9840cdf70 0x7ff98415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.898+0000 7ff98b8d8640 1 --2- 172.21.15.6:0/760114547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff98406d830 0x7ff98415dff0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:42.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.899+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 >> 172.21.15.6:0/760114547 conn(0x7ff9840cf450 msgr2=0x7ff9840714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.899+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 shutdown_connections 2024-05-20T18:00:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:42.899+0000 7ff98b8d8640 1 -- 172.21.15.6:0/760114547 wait complete. 2024-05-20T18:00:42.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T18:00:43.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.046+0000 7f3b1a965640 1 Processor -- start 2024-05-20T18:00:43.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.046+0000 7f3b1a965640 1 -- start start 2024-05-20T18:00:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.047+0000 7f3b1a965640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3b140cfcc0 0x7f3b140d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b1a965640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b140d0a50 con 0x7f3b140b6670 2024-05-20T18:00:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b1a965640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b1415fc40 con 0x7f3b1406d0f0 2024-05-20T18:00:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b1a965640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1415f9e0 con 0x7f3b140cfcc0 2024-05-20T18:00:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b0bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3b140b6670 0x7f3b140b6a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34484/0 (socket says 172.21.15.6:34484) 2024-05-20T18:00:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b0bfff640 1 -- 172.21.15.6:0/1679833426 learned_addr learned my addr 172.21.15.6:0/1679833426 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:43.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225709069 0 0) 0x7f3b140d0a50 con 0x7f3b140b6670 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b13fff640 1 --2- 172.21.15.6:0/1679833426 >> v2:172.21.15.171:3300/0 conn(0x7f3b140cfcc0 0x7f3b140d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b00003520 con 0x7f3b140b6670 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2889640451 0 0) 0x7f3b00003520 con 0x7f3b140b6670 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 >> v2:172.21.15.171:3300/0 conn(0x7f3b140cfcc0 msgr2=0x7f3b140d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 --2- 172.21.15.6:0/1679833426 >> v2:172.21.15.171:3300/0 conn(0x7f3b140cfcc0 0x7f3b140d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 >> v1:172.21.15.171:6789/0 conn(0x7f3b1406d0f0 legacy=0x7f3b1406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1415ff20 con 0x7f3b140b6670 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f3afc001690 con 0x7f3b140b6670 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 >> v1:172.21.15.6:6789/0 conn(0x7f3b140b6670 legacy=0x7f3b140b6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b00003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b00004800 0x7f3b00004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00005250 0x7f3b0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1415f9e0 con 0x7f3b000039b0 2024-05-20T18:00:43.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0000c1e0 con 0x7f3b00005250 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.048+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0000c3e0 con 0x7f3b00004800 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b13fff640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b00003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b0bfff640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b00004800 0x7f3b00004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b18f02640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00005250 0x7f3b0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b13fff640 1 -- 172.21.15.6:0/1679833426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b00004800 msgr2=0x7f3b00004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b13fff640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b00004800 0x7f3b00004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b13fff640 1 -- 172.21.15.6:0/1679833426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00005250 msgr2=0x7f3b0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b13fff640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b00005250 0x7f3b0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b18f02640 1 -- 172.21.15.6:0/1679833426 reap_dead start 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.049+0000 7f3b13fff640 1 -- 172.21.15.6:0/1679833426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b00003520 con 0x7f3b000039b0 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.050+0000 7f3b13fff640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b00003e20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009ac0 tx=0x7f3b00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad90e1a94f7ab10 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.050+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04036070 con 0x7f3b000039b0 2024-05-20T18:00:43.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.050+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b04031400 con 0x7f3b000039b0 2024-05-20T18:00:43.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.050+0000 7f3b137fe640 1 -- 172.21.15.6:0/1679833426 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04009690 con 0x7f3b000039b0 2024-05-20T18:00:43.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.051+0000 7f3b1a965640 1 -- 172.21.15.6:0/1679833426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 msgr2=0x7f3b00003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:43.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.051+0000 7f3b1a965640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b00003e20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009ac0 tx=0x7f3b00005830 comp rx=0 tx=0).stop 2024-05-20T18:00:43.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.051+0000 7f3b1a965640 1 -- 172.21.15.6:0/1679833426 shutdown_connections 2024-05-20T18:00:43.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.051+0000 7f3b1a965640 1 --2- 172.21.15.6:0/1679833426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b00003e20 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.051+0000 7f3b1a965640 1 -- 172.21.15.6:0/1679833426 >> 172.21.15.6:0/1679833426 conn(0x7f3b140d1670 msgr2=0x7f3b140d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:43.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.051+0000 7f3b1a965640 1 -- 172.21.15.6:0/1679833426 shutdown_connections 2024-05-20T18:00:43.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.051+0000 7f3b1a965640 1 -- 172.21.15.6:0/1679833426 wait complete. 2024-05-20T18:00:43.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.053+0000 7f3b1a965640 1 Processor -- start 2024-05-20T18:00:43.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.053+0000 7f3b1a965640 1 -- start start 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b1a965640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b1415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b1a965640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b140c8720 0x7f3b140ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b1a965640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b14151950 0x7f3b141eb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b1a965640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3b140d39b0 con 0x7f3b000039b0 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b1a965640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3b141604e0 con 0x7f3b140c8720 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b1a965640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3b140d3b30 con 0x7f3b14151950 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b1415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b1415eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35186/0 (socket says 172.21.15.6:35186) 2024-05-20T18:00:43.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b13fff640 1 -- 172.21.15.6:0/3913144684 learned_addr learned my addr 172.21.15.6:0/3913144684 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b0bfff640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b140c8720 0x7f3b140ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b18f02640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b14151950 0x7f3b141eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b13fff640 1 -- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b14151950 msgr2=0x7f3b141eb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b13fff640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b14151950 0x7f3b141eb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b13fff640 1 -- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b140c8720 msgr2=0x7f3b140ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b13fff640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b140c8720 0x7f3b140ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.054+0000 7f3b13fff640 1 -- 172.21.15.6:0/3913144684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b140c92c0 con 0x7f3b000039b0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.055+0000 7f3b13fff640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b1415eea0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009be0 tx=0x7f3b04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.055+0000 7f3b117fa640 1 -- 172.21.15.6:0/3913144684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0403f020 con 0x7f3b000039b0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.055+0000 7f3b117fa640 1 -- 172.21.15.6:0/3913144684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b04037040 con 0x7f3b000039b0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.055+0000 7f3b117fa640 1 -- 172.21.15.6:0/3913144684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04036070 con 0x7f3b000039b0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.055+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b140c95a0 con 0x7f3b000039b0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.055+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b141eaab0 con 0x7f3b000039b0 2024-05-20T18:00:43.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.056+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b140690b0 con 0x7f3b000039b0 2024-05-20T18:00:43.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.057+0000 7f3b117fa640 1 -- 172.21.15.6:0/3913144684 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b04042020 con 0x7f3b000039b0 2024-05-20T18:00:43.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.057+0000 7f3b117fa640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3af406be30 0x7f3af406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:43.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.058+0000 7f3b117fa640 1 -- 172.21.15.6:0/3913144684 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5619+0+0 (secure 0 0 0) 0x7f3b040ab6d0 con 0x7f3b000039b0 2024-05-20T18:00:43.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.058+0000 7f3b0bfff640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3af406be30 0x7f3af406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:43.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.058+0000 7f3b0bfff640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3af406be30 0x7f3af406e340 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3afc001800 tx=0x7f3afc001490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:43.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.062+0000 7f3b117fa640 1 -- 172.21.15.6:0/3913144684 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3b04049030 con 0x7f3b000039b0 2024-05-20T18:00:43.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.251+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3b140cd4b0 con 0x7f3b000039b0 2024-05-20T18:00:43.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.902+0000 7f3b117fa640 1 -- 172.21.15.6:0/3913144684 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) ==== 170+0+0 (secure 0 0 0) 0x7f3b04079ad0 con 0x7f3b000039b0 2024-05-20T18:00:43.901 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T18:00:43.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3af406be30 msgr2=0x7f3af406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3af406be30 0x7f3af406e340 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3afc001800 tx=0x7f3afc001490 comp rx=0 tx=0).stop 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 msgr2=0x7f3b1415eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b1415eea0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009be0 tx=0x7f3b04004730 comp rx=0 tx=0).stop 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 shutdown_connections 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3af406be30 0x7f3af406e340 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3b14151950 0x7f3b141eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3b140c8720 0x7f3b140ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 --2- 172.21.15.6:0/3913144684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b000039b0 0x7f3b1415eea0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.906+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 >> 172.21.15.6:0/3913144684 conn(0x7f3b140d1670 msgr2=0x7f3b140b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.907+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 shutdown_connections 2024-05-20T18:00:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:43.907+0000 7f3b1a965640 1 -- 172.21.15.6:0/3913144684 wait complete. 2024-05-20T18:00:43.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T18:00:44.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.061+0000 7fe55a0c3640 1 Processor -- start 2024-05-20T18:00:44.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.061+0000 7fe55a0c3640 1 -- start start 2024-05-20T18:00:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe55a0c3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe554162820 0x7fe5540b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe55a0c3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5540d0630 con 0x7fe5540b3e80 2024-05-20T18:00:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe55a0c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5540d39c0 con 0x7fe55406dae0 2024-05-20T18:00:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe55a0c3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe5540d3ca0 con 0x7fe554162820 2024-05-20T18:00:44.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe552ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe5540b3e80 0x7fe55406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34500/0 (socket says 172.21.15.6:34500) 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe552ffd640 1 -- 172.21.15.6:0/879655759 learned_addr learned my addr 172.21.15.6:0/879655759 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5537fe640 1 --2- 172.21.15.6:0/879655759 >> v2:172.21.15.171:3300/0 conn(0x7fe554162820 0x7fe5540b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772937908 0 0) 0x7fe5540d0630 con 0x7fe5540b3e80 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe53c003520 con 0x7fe5540b3e80 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1637214735 0 0) 0x7fe53c003520 con 0x7fe5540b3e80 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 >> v2:172.21.15.171:3300/0 conn(0x7fe554162820 msgr2=0x7fe5540b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5527fc640 1 --2- 172.21.15.6:0/879655759 >> v2:172.21.15.171:3300/0 conn(0x7fe554162820 0x7fe5540b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 >> v1:172.21.15.171:6789/0 conn(0x7fe55406dae0 legacy=0x7fe5540b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5540d3f80 con 0x7fe5540b3e80 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.063+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fe548001670 con 0x7fe5540b3e80 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 >> v1:172.21.15.6:6789/0 conn(0x7fe5540b3e80 legacy=0x7fe55406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:44.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5527fc640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53c0039b0 0x7fe53c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5527fc640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe53c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5527fc640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe53c005150 0x7fe53c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe5540d3ca0 con 0x7fe53c004800 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c00c0c0 con 0x7fe53c005150 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe53c00c2c0 con 0x7fe53c0039b0 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5537fe640 1 --2- 172.21.15.6:0/879655759 >> v2:172.21.15.171:3300/0 conn(0x7fe554162820 0x7fe5540b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe552ffd640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe53c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe553fff640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe53c005150 0x7fe53c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5537fe640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53c0039b0 0x7fe53c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe552ffd640 1 -- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53c0039b0 msgr2=0x7fe53c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe552ffd640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53c0039b0 0x7fe53c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe552ffd640 1 -- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe53c005150 msgr2=0x7fe53c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe552ffd640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe53c005150 0x7fe53c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe552ffd640 1 -- 172.21.15.6:0/879655759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53c003520 con 0x7fe53c004800 2024-05-20T18:00:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe553fff640 1 -- 172.21.15.6:0/879655759 reap_dead start 2024-05-20T18:00:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.064+0000 7fe5537fe640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe53c0039b0 0x7fe53c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.065+0000 7fe552ffd640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe53c004c10 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c240 tx=0x7fe53c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c133a98348bba81 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.065+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548007d10 con 0x7fe53c004800 2024-05-20T18:00:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.065+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5480058d0 con 0x7fe53c004800 2024-05-20T18:00:44.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.065+0000 7fe5527fc640 1 -- 172.21.15.6:0/879655759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548005d20 con 0x7fe53c004800 2024-05-20T18:00:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.066+0000 7fe55a0c3640 1 -- 172.21.15.6:0/879655759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 msgr2=0x7fe53c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:44.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.066+0000 7fe55a0c3640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe53c004c10 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c240 tx=0x7fe53c005830 comp rx=0 tx=0).stop 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.066+0000 7fe55a0c3640 1 -- 172.21.15.6:0/879655759 shutdown_connections 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.066+0000 7fe55a0c3640 1 --2- 172.21.15.6:0/879655759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe53c004c10 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.066+0000 7fe55a0c3640 1 -- 172.21.15.6:0/879655759 >> 172.21.15.6:0/879655759 conn(0x7fe5540d4bd0 msgr2=0x7fe5540d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.066+0000 7fe55a0c3640 1 -- 172.21.15.6:0/879655759 shutdown_connections 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.066+0000 7fe55a0c3640 1 -- 172.21.15.6:0/879655759 wait complete. 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.067+0000 7fe55a0c3640 1 Processor -- start 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.068+0000 7fe55a0c3640 1 -- start start 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe55a0c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe554159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe55a0c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5540cd0f0 0x7fe5540cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe55a0c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe55415b6d0 0x7fe55415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe55a0c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe5540d4780 con 0x7fe53c004800 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe55a0c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe5540d0300 con 0x7fe5540cd0f0 2024-05-20T18:00:44.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe55a0c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe5540d4900 con 0x7fe55415b6d0 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe5537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe554159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe5537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe554159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35204/0 (socket says 172.21.15.6:35204) 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe5537fe640 1 -- 172.21.15.6:0/3530158780 learned_addr learned my addr 172.21.15.6:0/3530158780 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe552ffd640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5540cd0f0 0x7fe5540cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe553fff640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe55415b6d0 0x7fe55415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe5537fe640 1 -- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe55415b6d0 msgr2=0x7fe55415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe5537fe640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe55415b6d0 0x7fe55415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe5537fe640 1 -- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5540cd0f0 msgr2=0x7fe5540cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe5537fe640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5540cd0f0 0x7fe5540cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.069+0000 7fe5537fe640 1 -- 172.21.15.6:0/3530158780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55415c020 con 0x7fe53c004800 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.070+0000 7fe5537fe640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe554159b40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe544011860 tx=0x7fe544011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.070+0000 7fe53bfff640 1 -- 172.21.15.6:0/3530158780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54400fbd0 con 0x7fe53c004800 2024-05-20T18:00:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.070+0000 7fe53bfff640 1 -- 172.21.15.6:0/3530158780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54400fd70 con 0x7fe53c004800 2024-05-20T18:00:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.070+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5541f86a0 con 0x7fe53c004800 2024-05-20T18:00:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.070+0000 7fe53bfff640 1 -- 172.21.15.6:0/3530158780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544015660 con 0x7fe53c004800 2024-05-20T18:00:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.070+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5541f8c60 con 0x7fe53c004800 2024-05-20T18:00:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.071+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe554075b00 con 0x7fe53c004800 2024-05-20T18:00:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.072+0000 7fe53bfff640 1 -- 172.21.15.6:0/3530158780 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe544015800 con 0x7fe53c004800 2024-05-20T18:00:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.072+0000 7fe53bfff640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe54006be30 0x7fe54006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.072+0000 7fe53bfff640 1 -- 172.21.15.6:0/3530158780 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 6001+0+0 (secure 0 0 0) 0x7fe54408b9a0 con 0x7fe53c004800 2024-05-20T18:00:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.073+0000 7fe552ffd640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe54006be30 0x7fe54006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:44.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.073+0000 7fe552ffd640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe54006be30 0x7fe54006e340 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe548033000 tx=0x7fe548009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.077+0000 7fe53bfff640 1 -- 172.21.15.6:0/3530158780 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe55415c020 con 0x7fe53c004800 2024-05-20T18:00:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.302+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe55415cf80 con 0x7fe53c004800 2024-05-20T18:00:44.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.918+0000 7fe53bfff640 1 -- 172.21.15.6:0/3530158780 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v70) ==== 174+0+0 (secure 0 0 0) 0x7fe544019030 con 0x7fe53c004800 2024-05-20T18:00:44.917 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 17 and data pool 18 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.936+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe54006be30 msgr2=0x7fe54006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.936+0000 7fe55a0c3640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe54006be30 0x7fe54006e340 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe548033000 tx=0x7fe548009030 comp rx=0 tx=0).stop 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.936+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 msgr2=0x7fe554159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.936+0000 7fe55a0c3640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe554159b40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe544011860 tx=0x7fe544011d20 comp rx=0 tx=0).stop 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.937+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 shutdown_connections 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.937+0000 7fe55a0c3640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe54006be30 0x7fe54006e340 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.937+0000 7fe55a0c3640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe55415b6d0 0x7fe55415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.937+0000 7fe55a0c3640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5540cd0f0 0x7fe5540cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.938+0000 7fe55a0c3640 1 --2- 172.21.15.6:0/3530158780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c004800 0x7fe554159b40 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.938+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 >> 172.21.15.6:0/3530158780 conn(0x7fe5540d4bd0 msgr2=0x7fe55406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:44.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.939+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 shutdown_connections 2024-05-20T18:00:44.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:44.939+0000 7fe55a0c3640 1 -- 172.21.15.6:0/3530158780 wait complete. 2024-05-20T18:00:44.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.075+0000 7faf9ffb1640 1 Processor -- start 2024-05-20T18:00:45.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.075+0000 7faf9ffb1640 1 -- start start 2024-05-20T18:00:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.076+0000 7faf9ffb1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 0x7faf9815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.076+0000 7faf9ffb1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf98070850 0x7faf98070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.076+0000 7faf9ffb1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf980711a0 con 0x7faf980cd1b0 2024-05-20T18:00:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.076+0000 7faf9ffb1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7faf9815f790 con 0x7faf98070850 2024-05-20T18:00:45.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.076+0000 7faf9ffb1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf9806e590 con 0x7faf98071630 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9e54e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf98070850 0x7faf98070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9d54c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faf980cd1b0 0x7faf9806d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34506/0 (socket says 172.21.15.6:34506) 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9d54c640 1 -- 172.21.15.6:0/1270695216 learned_addr learned my addr 172.21.15.6:0/1270695216 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9dd4d640 1 --2- 172.21.15.6:0/1270695216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 0x7faf9815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9e54e640 1 -- 172.21.15.6:0/1270695216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 msgr2=0x7faf9815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9e54e640 1 --2- 172.21.15.6:0/1270695216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 0x7faf9815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9e54e640 1 -- 172.21.15.6:0/1270695216 >> v1:172.21.15.6:6789/0 conn(0x7faf980cd1b0 legacy=0x7faf9806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9cd4b640 1 -- 172.21.15.6:0/1270695216 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3628763531 0 0) 0x7faf88001110 con 0x7faf980cd1b0 2024-05-20T18:00:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.077+0000 7faf9e54e640 1 -- 172.21.15.6:0/1270695216 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf980ce2b0 con 0x7faf98070850 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.078+0000 7faf9e54e640 1 --2- 172.21.15.6:0/1270695216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf98070850 0x7faf98070c60 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7faf90009d90 tx=0x7faf9002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62286b650ea56720 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.078+0000 7faf9cd4b640 1 -- 172.21.15.6:0/1270695216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90031600 con 0x7faf98070850 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.078+0000 7faf9cd4b640 1 -- 172.21.15.6:0/1270695216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf900317a0 con 0x7faf98070850 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.078+0000 7faf9cd4b640 1 -- 172.21.15.6:0/1270695216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90031b70 con 0x7faf98070850 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.079+0000 7faf9ffb1640 1 -- 172.21.15.6:0/1270695216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf98070850 msgr2=0x7faf98070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.079+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/1270695216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf98070850 0x7faf98070c60 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7faf90009d90 tx=0x7faf9002a5d0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.079+0000 7faf9ffb1640 1 -- 172.21.15.6:0/1270695216 shutdown_connections 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.079+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/1270695216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf98070850 0x7faf98070c60 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.079+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/1270695216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 0x7faf9815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.079+0000 7faf9ffb1640 1 -- 172.21.15.6:0/1270695216 >> 172.21.15.6:0/1270695216 conn(0x7faf980d29d0 msgr2=0x7faf980d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.079+0000 7faf9ffb1640 1 -- 172.21.15.6:0/1270695216 shutdown_connections 2024-05-20T18:00:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.079+0000 7faf9ffb1640 1 -- 172.21.15.6:0/1270695216 wait complete. 2024-05-20T18:00:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.081+0000 7faf9ffb1640 1 Processor -- start 2024-05-20T18:00:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.081+0000 7faf9ffb1640 1 -- start start 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9ffb1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf98070850 0x7faf980b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9ffb1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 0x7faf9814feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9ffb1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf980cd1b0 0x7faf980ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9ffb1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faf9806ded0 con 0x7faf980cd1b0 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9ffb1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faf9806cfc0 con 0x7faf98070850 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9ffb1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf9806d2a0 con 0x7faf98071630 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9e54e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf980cd1b0 0x7faf980ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9e54e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf980cd1b0 0x7faf980ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35226/0 (socket says 172.21.15.6:35226) 2024-05-20T18:00:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9e54e640 1 -- 172.21.15.6:0/2881412004 learned_addr learned my addr 172.21.15.6:0/2881412004 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9d54c640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 0x7faf9814feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9dd4d640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf98070850 0x7faf980b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9e54e640 1 -- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 msgr2=0x7faf9814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9e54e640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 0x7faf9814feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9e54e640 1 -- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf98070850 msgr2=0x7faf980b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9e54e640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf98070850 0x7faf980b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.082+0000 7faf9e54e640 1 -- 172.21.15.6:0/2881412004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf980c97a0 con 0x7faf980cd1b0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.083+0000 7faf9e54e640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf980cd1b0 0x7faf980ca840 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7faf90009eb0 tx=0x7faf90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.083+0000 7faf8e7fc640 1 -- 172.21.15.6:0/2881412004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9003f070 con 0x7faf980cd1b0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.083+0000 7faf8e7fc640 1 -- 172.21.15.6:0/2881412004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf90030be0 con 0x7faf980cd1b0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.083+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf980c9a80 con 0x7faf980cd1b0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.083+0000 7faf8e7fc640 1 -- 172.21.15.6:0/2881412004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90009450 con 0x7faf980cd1b0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.083+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf980ca040 con 0x7faf980cd1b0 2024-05-20T18:00:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.084+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf98075b00 con 0x7faf980cd1b0 2024-05-20T18:00:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.084+0000 7faf8e7fc640 1 -- 172.21.15.6:0/2881412004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf90003990 con 0x7faf980cd1b0 2024-05-20T18:00:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.085+0000 7faf8e7fc640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7c06be60 0x7faf7c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.085+0000 7faf8e7fc640 1 -- 172.21.15.6:0/2881412004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 6101+0+0 (secure 0 0 0) 0x7faf900abb40 con 0x7faf980cd1b0 2024-05-20T18:00:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.085+0000 7faf9dd4d640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7c06be60 0x7faf7c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.086+0000 7faf9dd4d640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7c06be60 0x7faf7c06e370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7faf940079a0 tx=0x7faf94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.089+0000 7faf8e7fc640 1 -- 172.21.15.6:0/2881412004 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faf90079d10 con 0x7faf980cd1b0 2024-05-20T18:00:45.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.274+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf98071410 con 0x7faf980cd1b0 2024-05-20T18:00:45.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.275+0000 7faf8e7fc640 1 -- 172.21.15.6:0/2881412004 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+16917 (secure 0 0 0) 0x7faf9007e010 con 0x7faf980cd1b0 2024-05-20T18:00:45.273 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:45.273 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":112,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:44.303761+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:42.005763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:43.283834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7c06be60 msgr2=0x7faf7c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7c06be60 0x7faf7c06e370 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7faf940079a0 tx=0x7faf94008040 comp rx=0 tx=0).stop 2024-05-20T18:00:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf980cd1b0 msgr2=0x7faf980ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf980cd1b0 0x7faf980ca840 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7faf90009eb0 tx=0x7faf90004a40 comp rx=0 tx=0).stop 2024-05-20T18:00:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 shutdown_connections 2024-05-20T18:00:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf7c06be60 0x7faf7c06e370 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf980cd1b0 0x7faf980ca840 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf98071630 0x7faf9814feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 --2- 172.21.15.6:0/2881412004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf98070850 0x7faf980b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 >> 172.21.15.6:0/2881412004 conn(0x7faf980d29d0 msgr2=0x7faf9815dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 shutdown_connections 2024-05-20T18:00:45.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.277+0000 7faf9ffb1640 1 -- 172.21.15.6:0/2881412004 wait complete. 2024-05-20T18:00:45.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:45.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.403+0000 7fab96813640 1 Processor -- start 2024-05-20T18:00:45.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.403+0000 7fab96813640 1 -- start start 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab96813640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fab90162820 0x7fab900b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab96813640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab900d0630 con 0x7fab900b3e80 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab96813640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab900d39c0 con 0x7fab9006dae0 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab96813640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fab900d3ca0 con 0x7fab90162820 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab8f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fab900b3e80 0x7fab9006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34512/0 (socket says 172.21.15.6:34512) 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab8f7fe640 1 -- 172.21.15.6:0/3784819115 learned_addr learned my addr 172.21.15.6:0/3784819115 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab8ffff640 1 --2- 172.21.15.6:0/3784819115 >> v2:172.21.15.171:3300/0 conn(0x7fab90162820 0x7fab900b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab8effd640 1 -- 172.21.15.6:0/3784819115 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726331700 0 0) 0x7fab900d0630 con 0x7fab900b3e80 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab8effd640 1 -- 172.21.15.6:0/3784819115 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab78003520 con 0x7fab900b3e80 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.405+0000 7fab8ffff640 1 -- 172.21.15.6:0/3784819115 >> v1:172.21.15.171:6789/0 conn(0x7fab9006dae0 legacy=0x7fab900b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.406+0000 7fab8effd640 1 -- 172.21.15.6:0/3784819115 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2138078826 0 0) 0x7fab900d39c0 con 0x7fab9006dae0 2024-05-20T18:00:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.406+0000 7fab8ffff640 1 -- 172.21.15.6:0/3784819115 >> v1:172.21.15.6:6789/0 conn(0x7fab900b3e80 legacy=0x7fab9006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.406+0000 7fab8ffff640 1 -- 172.21.15.6:0/3784819115 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab900d3f80 con 0x7fab90162820 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.406+0000 7fab8ffff640 1 --2- 172.21.15.6:0/3784819115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab90162820 0x7fab900b3940 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fab800097a0 tx=0x7fab8002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a376fa9522a0dfb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab8effd640 1 -- 172.21.15.6:0/3784819115 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80037070 con 0x7fab90162820 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab8effd640 1 -- 172.21.15.6:0/3784819115 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8002ac30 con 0x7fab90162820 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab8effd640 1 -- 172.21.15.6:0/3784819115 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84001670 con 0x7fab90162820 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab96813640 1 -- 172.21.15.6:0/3784819115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab90162820 msgr2=0x7fab900b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab96813640 1 --2- 172.21.15.6:0/3784819115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab90162820 0x7fab900b3940 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fab800097a0 tx=0x7fab8002a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab96813640 1 -- 172.21.15.6:0/3784819115 shutdown_connections 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab96813640 1 --2- 172.21.15.6:0/3784819115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab90162820 0x7fab900b3940 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab96813640 1 -- 172.21.15.6:0/3784819115 >> 172.21.15.6:0/3784819115 conn(0x7fab900d4bd0 msgr2=0x7fab900d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab96813640 1 -- 172.21.15.6:0/3784819115 shutdown_connections 2024-05-20T18:00:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.407+0000 7fab96813640 1 -- 172.21.15.6:0/3784819115 wait complete. 2024-05-20T18:00:45.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.409+0000 7fab96813640 1 Processor -- start 2024-05-20T18:00:45.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.409+0000 7fab96813640 1 -- start start 2024-05-20T18:00:45.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.410+0000 7fab96813640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab900b3e80 0x7fab90151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.410+0000 7fab96813640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab90162820 0x7fab90159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.410+0000 7fab96813640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9015a510 0x7fab900b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.410+0000 7fab96813640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fab900d4780 con 0x7fab9015a510 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.410+0000 7fab96813640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab900d0300 con 0x7fab900b3e80 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.410+0000 7fab96813640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fab900d4900 con 0x7fab90162820 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9015a510 0x7fab900b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9015a510 0x7fab900b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35232/0 (socket says 172.21.15.6:35232) 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 -- 172.21.15.6:0/3281004919 learned_addr learned my addr 172.21.15.6:0/3281004919 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab8f7fe640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab90162820 0x7fab90159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab8ffff640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab900b3e80 0x7fab90151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 -- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab90162820 msgr2=0x7fab90159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab90162820 0x7fab90159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 -- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab900b3e80 msgr2=0x7fab90151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab900b3e80 0x7fab90151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 -- 172.21.15.6:0/3281004919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9015ab00 con 0x7fab9015a510 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab8ffff640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab900b3e80 0x7fab90151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab94db0640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9015a510 0x7fab900b4dd0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c7b0 tx=0x7fab8800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab8cff9640 1 -- 172.21.15.6:0/3281004919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88003ba0 con 0x7fab9015a510 2024-05-20T18:00:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab8cff9640 1 -- 172.21.15.6:0/3281004919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab88003d40 con 0x7fab9015a510 2024-05-20T18:00:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9015ade0 con 0x7fab9015a510 2024-05-20T18:00:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab8cff9640 1 -- 172.21.15.6:0/3281004919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88005270 con 0x7fab9015a510 2024-05-20T18:00:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.411+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9015b3a0 con 0x7fab9015a510 2024-05-20T18:00:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.412+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab90075b00 con 0x7fab9015a510 2024-05-20T18:00:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.413+0000 7fab8cff9640 1 -- 172.21.15.6:0/3281004919 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab88005410 con 0x7fab9015a510 2024-05-20T18:00:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.414+0000 7fab8cff9640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fab7c06be30 0x7fab7c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.414+0000 7fab8cff9640 1 -- 172.21.15.6:0/3281004919 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 6101+0+0 (secure 0 0 0) 0x7fab8808ae80 con 0x7fab9015a510 2024-05-20T18:00:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.414+0000 7fab8ffff640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fab7c06be30 0x7fab7c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.414+0000 7fab8ffff640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fab7c06be30 0x7fab7c06e340 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fab80034000 tx=0x7fab8002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.418+0000 7fab8cff9640 1 -- 172.21.15.6:0/3281004919 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fab88059610 con 0x7fab9015a510 2024-05-20T18:00:45.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.603+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab900cee60 con 0x7fab9015a510 2024-05-20T18:00:45.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.604+0000 7fab8cff9640 1 -- 172.21.15.6:0/3281004919 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+16917 (secure 0 0 0) 0x7fab88058f10 con 0x7fab9015a510 2024-05-20T18:00:45.602 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:45.603 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":112,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:44.303761+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:42.005763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:43.283834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:45.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fab7c06be30 msgr2=0x7fab7c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fab7c06be30 0x7fab7c06e340 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fab80034000 tx=0x7fab8002e000 comp rx=0 tx=0).stop 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9015a510 msgr2=0x7fab900b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9015a510 0x7fab900b4dd0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c7b0 tx=0x7fab8800cbb0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 shutdown_connections 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fab7c06be30 0x7fab7c06e340 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab9015a510 0x7fab900b4dd0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab90162820 0x7fab90159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 --2- 172.21.15.6:0/3281004919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab900b3e80 0x7fab90151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 >> 172.21.15.6:0/3281004919 conn(0x7fab900d4bd0 msgr2=0x7fab901562c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 shutdown_connections 2024-05-20T18:00:45.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.606+0000 7fab96813640 1 -- 172.21.15.6:0/3281004919 wait complete. 2024-05-20T18:00:45.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T18:00:45.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.735+0000 7fbc6971a640 1 Processor -- start 2024-05-20T18:00:45.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.735+0000 7fbc6971a640 1 -- start start 2024-05-20T18:00:45.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc6971a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbc64162820 0x7fbc640b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc6971a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc640d0630 con 0x7fbc6406dae0 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc6971a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc640d39c0 con 0x7fbc640b3e80 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc6971a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbc640d3ca0 con 0x7fbc64162820 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc637fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbc6406dae0 0x7fbc640b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34520/0 (socket says 172.21.15.6:34520) 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc637fe640 1 -- 172.21.15.6:0/868297800 learned_addr learned my addr 172.21.15.6:0/868297800 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc62ffd640 1 --2- 172.21.15.6:0/868297800 >> v2:172.21.15.171:3300/0 conn(0x7fbc64162820 0x7fbc640b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc61ffb640 1 -- 172.21.15.6:0/868297800 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832774243 0 0) 0x7fbc640d0630 con 0x7fbc6406dae0 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc61ffb640 1 -- 172.21.15.6:0/868297800 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc50003520 con 0x7fbc6406dae0 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc62ffd640 1 -- 172.21.15.6:0/868297800 >> v1:172.21.15.171:6789/0 conn(0x7fbc640b3e80 legacy=0x7fbc6406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc62ffd640 1 -- 172.21.15.6:0/868297800 >> v1:172.21.15.6:6789/0 conn(0x7fbc6406dae0 legacy=0x7fbc640b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.737+0000 7fbc62ffd640 1 -- 172.21.15.6:0/868297800 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc640d3f80 con 0x7fbc64162820 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.738+0000 7fbc62ffd640 1 --2- 172.21.15.6:0/868297800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc64162820 0x7fbc640b3940 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0097a0 tx=0x7fbc5c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9652d995d97863b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc61ffb640 1 -- 172.21.15.6:0/868297800 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c037070 con 0x7fbc64162820 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc61ffb640 1 -- 172.21.15.6:0/868297800 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c032440 con 0x7fbc64162820 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc61ffb640 1 -- 172.21.15.6:0/868297800 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c032810 con 0x7fbc64162820 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc6971a640 1 -- 172.21.15.6:0/868297800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc64162820 msgr2=0x7fbc640b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc6971a640 1 --2- 172.21.15.6:0/868297800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc64162820 0x7fbc640b3940 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0097a0 tx=0x7fbc5c02a230 comp rx=0 tx=0).stop 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc6971a640 1 -- 172.21.15.6:0/868297800 shutdown_connections 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc6971a640 1 --2- 172.21.15.6:0/868297800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc64162820 0x7fbc640b3940 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc6971a640 1 -- 172.21.15.6:0/868297800 >> 172.21.15.6:0/868297800 conn(0x7fbc640d4bd0 msgr2=0x7fbc640d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc6971a640 1 -- 172.21.15.6:0/868297800 shutdown_connections 2024-05-20T18:00:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.739+0000 7fbc6971a640 1 -- 172.21.15.6:0/868297800 wait complete. 2024-05-20T18:00:45.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.741+0000 7fbc6971a640 1 Processor -- start 2024-05-20T18:00:45.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.741+0000 7fbc6971a640 1 -- start start 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.742+0000 7fbc6971a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc640b3e80 0x7fbc640cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.742+0000 7fbc6971a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc64162820 0x7fbc64159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.742+0000 7fbc6971a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc6415af50 0x7fbc6415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.742+0000 7fbc6971a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc640d4780 con 0x7fbc64162820 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.742+0000 7fbc6971a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbc640d0300 con 0x7fbc640b3e80 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.742+0000 7fbc6971a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbc640d4900 con 0x7fbc6415af50 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc64162820 0x7fbc64159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc64162820 0x7fbc64159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35236/0 (socket says 172.21.15.6:35236) 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 -- 172.21.15.6:0/636996522 learned_addr learned my addr 172.21.15.6:0/636996522 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc62ffd640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc640b3e80 0x7fbc640cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc637fe640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc6415af50 0x7fbc6415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 -- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc6415af50 msgr2=0x7fbc6415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc6415af50 0x7fbc6415b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 -- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc640b3e80 msgr2=0x7fbc640cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc640b3e80 0x7fbc640cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 -- 172.21.15.6:0/636996522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6415b8a0 con 0x7fbc64162820 2024-05-20T18:00:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc627fc640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc64162820 0x7fbc64159190 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c3f0 tx=0x7fbc4c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/636996522 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0052d0 con 0x7fbc64162820 2024-05-20T18:00:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/636996522 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c005490 con 0x7fbc64162820 2024-05-20T18:00:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc640b5310 con 0x7fbc64162820 2024-05-20T18:00:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.743+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/636996522 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c007260 con 0x7fbc64162820 2024-05-20T18:00:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.744+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc640b58d0 con 0x7fbc64162820 2024-05-20T18:00:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.745+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc64075b00 con 0x7fbc64162820 2024-05-20T18:00:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.745+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/636996522 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc4c007400 con 0x7fbc64162820 2024-05-20T18:00:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.746+0000 7fbc5b7fe640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc4406be30 0x7fbc4406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.746+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/636996522 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 6101+0+0 (secure 0 0 0) 0x7fbc4c08a410 con 0x7fbc64162820 2024-05-20T18:00:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.746+0000 7fbc62ffd640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc4406be30 0x7fbc4406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.747+0000 7fbc62ffd640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc4406be30 0x7fbc4406e340 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c034000 tx=0x7fbc5c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.751+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/636996522 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc6415b8a0 con 0x7fbc64162820 2024-05-20T18:00:45.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:45.974+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbc641e7d10 con 0x7fbc64162820 2024-05-20T18:00:46.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.924+0000 7fbc5b7fe640 1 -- 172.21.15.6:0/636996522 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) ==== 118+0+0 (secure 0 0 0) 0x7fbc4c0585e0 con 0x7fbc64162820 2024-05-20T18:00:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc4406be30 msgr2=0x7fbc4406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc4406be30 0x7fbc4406e340 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c034000 tx=0x7fbc5c02e000 comp rx=0 tx=0).stop 2024-05-20T18:00:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc64162820 msgr2=0x7fbc64159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:46.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc64162820 0x7fbc64159190 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00c3f0 tx=0x7fbc4c00c8b0 comp rx=0 tx=0).stop 2024-05-20T18:00:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 shutdown_connections 2024-05-20T18:00:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc4406be30 0x7fbc4406e340 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc6415af50 0x7fbc6415b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc64162820 0x7fbc64159190 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 --2- 172.21.15.6:0/636996522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc640b3e80 0x7fbc640cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 >> 172.21.15.6:0/636996522 conn(0x7fbc640d4bd0 msgr2=0x7fbc6406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 shutdown_connections 2024-05-20T18:00:46.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:46.927+0000 7fbc6971a640 1 -- 172.21.15.6:0/636996522 wait complete. 2024-05-20T18:00:46.939 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T18:00:46.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T18:00:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.066+0000 7f78e1e7a640 1 Processor -- start 2024-05-20T18:00:47.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.066+0000 7f78e1e7a640 1 -- start start 2024-05-20T18:00:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.067+0000 7f78e1e7a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f78dc0af740 0x7f78dc0b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.067+0000 7f78e1e7a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78dc06c840 con 0x7f78dc0b2390 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.067+0000 7f78e1e7a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78dc0d20d0 con 0x7f78dc0af330 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.067+0000 7f78e1e7a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f78dc0afb50 con 0x7f78dc0af740 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78dbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78dc0b2390 0x7f78dc06d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34532/0 (socket says 172.21.15.6:34532) 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78dbfff640 1 -- 172.21.15.6:0/1797190554 learned_addr learned my addr 172.21.15.6:0/1797190554 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78daffd640 1 --2- 172.21.15.6:0/1797190554 >> v2:172.21.15.171:3300/0 conn(0x7f78dc0af740 0x7f78dc0b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78da7fc640 1 -- 172.21.15.6:0/1797190554 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786566105 0 0) 0x7f78dc06c840 con 0x7f78dc0b2390 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78da7fc640 1 -- 172.21.15.6:0/1797190554 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78c4003520 con 0x7f78dc0b2390 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78da7fc640 1 -- 172.21.15.6:0/1797190554 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196480459 0 0) 0x7f78dc0d20d0 con 0x7f78dc0af330 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78da7fc640 1 -- 172.21.15.6:0/1797190554 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78dc06c840 con 0x7f78dc0af330 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78daffd640 1 -- 172.21.15.6:0/1797190554 >> v1:172.21.15.171:6789/0 conn(0x7f78dc0af330 legacy=0x7f78dc0d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78daffd640 1 -- 172.21.15.6:0/1797190554 >> v1:172.21.15.6:6789/0 conn(0x7f78dc0b2390 legacy=0x7f78dc06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.068+0000 7f78daffd640 1 -- 172.21.15.6:0/1797190554 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc06cae0 con 0x7f78dc0af740 2024-05-20T18:00:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.069+0000 7f78daffd640 1 --2- 172.21.15.6:0/1797190554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 0x7f78dc0b1e50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78d00097a0 tx=0x7f78d002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fd80a10419bc9c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.069+0000 7f78da7fc640 1 -- 172.21.15.6:0/1797190554 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0037070 con 0x7f78dc0af740 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.069+0000 7f78da7fc640 1 -- 172.21.15.6:0/1797190554 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d0032440 con 0x7f78dc0af740 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.069+0000 7f78da7fc640 1 -- 172.21.15.6:0/1797190554 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0032810 con 0x7f78dc0af740 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.070+0000 7f78e1e7a640 1 -- 172.21.15.6:0/1797190554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 msgr2=0x7f78dc0b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.070+0000 7f78e1e7a640 1 --2- 172.21.15.6:0/1797190554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 0x7f78dc0b1e50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f78d00097a0 tx=0x7f78d002a1a0 comp rx=0 tx=0).stop 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.070+0000 7f78e1e7a640 1 -- 172.21.15.6:0/1797190554 shutdown_connections 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.070+0000 7f78e1e7a640 1 --2- 172.21.15.6:0/1797190554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 0x7f78dc0b1e50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.070+0000 7f78e1e7a640 1 -- 172.21.15.6:0/1797190554 >> 172.21.15.6:0/1797190554 conn(0x7f78dc0b6670 msgr2=0x7f78dc0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.070+0000 7f78e1e7a640 1 -- 172.21.15.6:0/1797190554 shutdown_connections 2024-05-20T18:00:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.070+0000 7f78e1e7a640 1 -- 172.21.15.6:0/1797190554 wait complete. 2024-05-20T18:00:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.072+0000 7f78e1e7a640 1 Processor -- start 2024-05-20T18:00:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.072+0000 7f78e1e7a640 1 -- start start 2024-05-20T18:00:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78e1e7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78dc0af330 0x7f78dc0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78e1e7a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 0x7f78dc155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78e1e7a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78dc0b2390 0x7f78dc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78e1e7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc0b27a0 con 0x7f78dc0af330 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78e1e7a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc06d0a0 con 0x7f78dc0af740 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78e1e7a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f78dc15d350 con 0x7f78dc0b2390 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78db7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78dc0af330 0x7f78dc0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78db7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78dc0af330 0x7f78dc0cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35244/0 (socket says 172.21.15.6:35244) 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.073+0000 7f78db7fe640 1 -- 172.21.15.6:0/2817075519 learned_addr learned my addr 172.21.15.6:0/2817075519 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78dbfff640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78dc0b2390 0x7f78dc156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78daffd640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 0x7f78dc155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78db7fe640 1 -- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78dc0b2390 msgr2=0x7f78dc156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78db7fe640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78dc0b2390 0x7f78dc156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78db7fe640 1 -- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 msgr2=0x7f78dc155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78db7fe640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 0x7f78dc155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78db7fe640 1 -- 172.21.15.6:0/2817075519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc155790 con 0x7f78dc0af330 2024-05-20T18:00:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78db7fe640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78dc0af330 0x7f78dc0cce10 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c760 tx=0x7f78cc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78c3fff640 1 -- 172.21.15.6:0/2817075519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc003b70 con 0x7f78dc0af330 2024-05-20T18:00:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78c3fff640 1 -- 172.21.15.6:0/2817075519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc003d10 con 0x7f78dc0af330 2024-05-20T18:00:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc1508c0 con 0x7f78dc0af330 2024-05-20T18:00:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78c3fff640 1 -- 172.21.15.6:0/2817075519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00a9f0 con 0x7f78dc0af330 2024-05-20T18:00:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.074+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc15b7b0 con 0x7f78dc0af330 2024-05-20T18:00:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.075+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc075b00 con 0x7f78dc0af330 2024-05-20T18:00:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.076+0000 7f78c3fff640 1 -- 172.21.15.6:0/2817075519 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78cc00ab90 con 0x7f78dc0af330 2024-05-20T18:00:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.076+0000 7f78c3fff640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f78c806be60 0x7f78c806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.076+0000 7f78c3fff640 1 -- 172.21.15.6:0/2817075519 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f78cc08aec0 con 0x7f78dc0af330 2024-05-20T18:00:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.077+0000 7f78daffd640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f78c806be60 0x7f78c806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.077+0000 7f78daffd640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f78c806be60 0x7f78c806e370 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f78d0034000 tx=0x7f78d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:47.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.081+0000 7f78c3fff640 1 -- 172.21.15.6:0/2817075519 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f78dc155790 con 0x7f78dc0af330 2024-05-20T18:00:47.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.308+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f78dc0affb0 con 0x7f78dc0af330 2024-05-20T18:00:47.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.930+0000 7f78c3fff640 1 -- 172.21.15.6:0/2817075519 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) ==== 122+0+0 (secure 0 0 0) 0x7f78cc0596e0 con 0x7f78dc0af330 2024-05-20T18:00:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f78c806be60 msgr2=0x7f78c806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f78c806be60 0x7f78c806e370 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f78d0034000 tx=0x7f78d002e000 comp rx=0 tx=0).stop 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78dc0af330 msgr2=0x7f78dc0cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78dc0af330 0x7f78dc0cce10 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c760 tx=0x7f78cc00cc20 comp rx=0 tx=0).stop 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 shutdown_connections 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f78c806be60 0x7f78c806e370 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78dc0b2390 0x7f78dc156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78dc0af740 0x7f78dc155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 --2- 172.21.15.6:0/2817075519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78dc0af330 0x7f78dc0cce10 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 >> 172.21.15.6:0/2817075519 conn(0x7f78dc0b6670 msgr2=0x7f78dc06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 shutdown_connections 2024-05-20T18:00:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:47.933+0000 7f78e1e7a640 1 -- 172.21.15.6:0/2817075519 wait complete. 2024-05-20T18:00:47.945 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T18:00:47.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:48.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.069+0000 7f7ddb8de640 1 Processor -- start 2024-05-20T18:00:48.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.070+0000 7f7ddb8de640 1 -- start start 2024-05-20T18:00:48.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7ddb8de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4162820 0x7f7dd40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7ddb8de640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7dd406dae0 0x7f7dd40b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7ddb8de640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd40d0630 con 0x7f7dd40b3e80 2024-05-20T18:00:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7ddb8de640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd40d39c0 con 0x7f7dd406dae0 2024-05-20T18:00:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7ddb8de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd40d3ca0 con 0x7f7dd4162820 2024-05-20T18:00:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7dd967a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4162820 0x7f7dd40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7dd967a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4162820 0x7f7dd40b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:54914/0 (socket says 172.21.15.6:54914) 2024-05-20T18:00:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7dd967a640 1 -- 172.21.15.6:0/1741121334 learned_addr learned my addr 172.21.15.6:0/1741121334 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:48.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.071+0000 7f7dd9e7b640 1 --2- 172.21.15.6:0/1741121334 >> v2:172.21.15.171:3300/0 conn(0x7f7dd406dae0 0x7f7dd40b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.072+0000 7f7dd9e7b640 1 -- 172.21.15.6:0/1741121334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4162820 msgr2=0x7f7dd40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.072+0000 7f7dd9e7b640 1 --2- 172.21.15.6:0/1741121334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4162820 0x7f7dd40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.072+0000 7f7dd9e7b640 1 -- 172.21.15.6:0/1741121334 >> v1:172.21.15.171:6789/0 conn(0x7f7dd40b3e80 legacy=0x7f7dd406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.072+0000 7f7dd9e7b640 1 -- 172.21.15.6:0/1741121334 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd40d3f80 con 0x7f7dd406dae0 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.072+0000 7f7dd967a640 1 --2- 172.21.15.6:0/1741121334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4162820 0x7f7dd40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.072+0000 7f7dd9e7b640 1 --2- 172.21.15.6:0/1741121334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd406dae0 0x7f7dd40b8190 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0097a0 tx=0x7f7dcc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc71846e8f9f96 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7dcbfff640 1 -- 172.21.15.6:0/1741121334 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc037070 con 0x7f7dd406dae0 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7dcbfff640 1 -- 172.21.15.6:0/1741121334 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc032440 con 0x7f7dd406dae0 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7dcbfff640 1 -- 172.21.15.6:0/1741121334 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc032810 con 0x7f7dd406dae0 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7ddb8de640 1 -- 172.21.15.6:0/1741121334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd406dae0 msgr2=0x7f7dd40b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/1741121334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd406dae0 0x7f7dd40b8190 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0097a0 tx=0x7f7dcc02a180 comp rx=0 tx=0).stop 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7ddb8de640 1 -- 172.21.15.6:0/1741121334 shutdown_connections 2024-05-20T18:00:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/1741121334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd406dae0 0x7f7dd40b8190 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/1741121334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4162820 0x7f7dd40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.073+0000 7f7ddb8de640 1 -- 172.21.15.6:0/1741121334 >> 172.21.15.6:0/1741121334 conn(0x7f7dd40d4bd0 msgr2=0x7f7dd40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.074+0000 7f7ddb8de640 1 -- 172.21.15.6:0/1741121334 shutdown_connections 2024-05-20T18:00:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.074+0000 7f7ddb8de640 1 -- 172.21.15.6:0/1741121334 wait complete. 2024-05-20T18:00:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.075+0000 7f7ddb8de640 1 Processor -- start 2024-05-20T18:00:48.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.075+0000 7f7ddb8de640 1 -- start start 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7ddb8de640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd40b3e80 0x7f7dd41f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7ddb8de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dd4162820 0x7f7dd41f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7ddb8de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4158940 0x7f7dd41f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7ddb8de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd40d4780 con 0x7f7dd4162820 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7ddb8de640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd40d0300 con 0x7f7dd40b3e80 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7ddb8de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd40d4900 con 0x7f7dd4158940 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dd4162820 0x7f7dd41f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dd4162820 0x7f7dd41f6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49440/0 (socket says 172.21.15.6:49440) 2024-05-20T18:00:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 -- 172.21.15.6:0/2675888147 learned_addr learned my addr 172.21.15.6:0/2675888147 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd967a640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd40b3e80 0x7f7dd41f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd9e7b640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4158940 0x7f7dd41f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 -- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4158940 msgr2=0x7f7dd41f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4158940 0x7f7dd41f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 -- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd40b3e80 msgr2=0x7f7dd41f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd40b3e80 0x7f7dd41f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 -- 172.21.15.6:0/2675888147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd4159050 con 0x7f7dd4162820 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.077+0000 7f7dd8e79640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dd4162820 0x7f7dd41f6790 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c440 tx=0x7f7dc400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.078+0000 7f7dc9ffb640 1 -- 172.21.15.6:0/2675888147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40052d0 con 0x7f7dd4162820 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.078+0000 7f7dc9ffb640 1 -- 172.21.15.6:0/2675888147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4005470 con 0x7f7dd4162820 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.078+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd4159330 con 0x7f7dd4162820 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.078+0000 7f7dc9ffb640 1 -- 172.21.15.6:0/2675888147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4007260 con 0x7f7dd4162820 2024-05-20T18:00:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.078+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd41598f0 con 0x7f7dd4162820 2024-05-20T18:00:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.079+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd4075b00 con 0x7f7dd4162820 2024-05-20T18:00:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.079+0000 7f7dc9ffb640 1 -- 172.21.15.6:0/2675888147 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7dc40074c0 con 0x7f7dd4162820 2024-05-20T18:00:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.080+0000 7f7dc9ffb640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7db806be30 0x7f7db806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.080+0000 7f7dc9ffb640 1 -- 172.21.15.6:0/2675888147 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f7dc408a470 con 0x7f7dd4162820 2024-05-20T18:00:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.080+0000 7f7dd967a640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7db806be30 0x7f7db806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.081+0000 7f7dd967a640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7db806be30 0x7f7db806e340 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00072c0 tx=0x7f7dd000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.084+0000 7f7dc9ffb640 1 -- 172.21.15.6:0/2675888147 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7dc40585a0 con 0x7f7dd4162820 2024-05-20T18:00:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.306+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dd4158de0 con 0x7f7dd4162820 2024-05-20T18:00:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.306+0000 7f7dc9ffb640 1 -- 172.21.15.6:0/2675888147 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5177 (secure 0 0 0) 0x7f7dc405c8a0 con 0x7f7dd4162820 2024-05-20T18:00:48.305 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:48.305 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:00:47.310018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:00:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 74 2024-05-20T18:00:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7db806be30 msgr2=0x7f7db806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7db806be30 0x7f7db806e340 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00072c0 tx=0x7f7dd000b040 comp rx=0 tx=0).stop 2024-05-20T18:00:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dd4162820 msgr2=0x7f7dd41f6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dd4162820 0x7f7dd41f6790 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400c440 tx=0x7f7dc400c900 comp rx=0 tx=0).stop 2024-05-20T18:00:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 shutdown_connections 2024-05-20T18:00:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7db806be30 0x7f7db806e340 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7dd4158940 0x7f7dd41f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dd4162820 0x7f7dd41f6790 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 --2- 172.21.15.6:0/2675888147 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd40b3e80 0x7f7dd41f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 >> 172.21.15.6:0/2675888147 conn(0x7f7dd40d4bd0 msgr2=0x7f7dd415e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 shutdown_connections 2024-05-20T18:00:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.309+0000 7f7ddb8de640 1 -- 172.21.15.6:0/2675888147 wait complete. 2024-05-20T18:00:48.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:00:48.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.435+0000 7fbc532e2640 1 Processor -- start 2024-05-20T18:00:48.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.435+0000 7fbc532e2640 1 -- start start 2024-05-20T18:00:48.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc532e2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc4c162820 0x7fbc4c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc532e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc532e2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4c06dd20 con 0x7fbc4c06d910 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc532e2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbc4c0d0630 con 0x7fbc4c162820 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc532e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c0d39c0 con 0x7fbc4c0b3e80 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5107e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc4c162820 0x7fbc4c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5187f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbc4c06d910 0x7fbc4c0d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54254/0 (socket says 172.21.15.6:54254) 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5187f640 1 -- 172.21.15.6:0/4233958283 learned_addr learned my addr 172.21.15.6:0/4233958283 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5087d640 1 --2- 172.21.15.6:0/4233958283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5107e640 1 -- 172.21.15.6:0/4233958283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 msgr2=0x7fbc4c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5107e640 1 --2- 172.21.15.6:0/4233958283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5107e640 1 -- 172.21.15.6:0/4233958283 >> v1:172.21.15.6:6789/0 conn(0x7fbc4c06d910 legacy=0x7fbc4c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5107e640 1 -- 172.21.15.6:0/4233958283 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c0d3ca0 con 0x7fbc4c162820 2024-05-20T18:00:48.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.437+0000 7fbc5087d640 1 --2- 172.21.15.6:0/4233958283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.438+0000 7fbc5107e640 1 --2- 172.21.15.6:0/4233958283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c162820 0x7fbc4c0b3940 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fbc480097a0 tx=0x7fbc4802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f688b39f377259a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.438+0000 7fbc43fff640 1 -- 172.21.15.6:0/4233958283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48037070 con 0x7fbc4c162820 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.438+0000 7fbc43fff640 1 -- 172.21.15.6:0/4233958283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc48032440 con 0x7fbc4c162820 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.438+0000 7fbc43fff640 1 -- 172.21.15.6:0/4233958283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48032810 con 0x7fbc4c162820 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.439+0000 7fbc532e2640 1 -- 172.21.15.6:0/4233958283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c162820 msgr2=0x7fbc4c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.439+0000 7fbc532e2640 1 --2- 172.21.15.6:0/4233958283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c162820 0x7fbc4c0b3940 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fbc480097a0 tx=0x7fbc4802a180 comp rx=0 tx=0).stop 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.439+0000 7fbc532e2640 1 -- 172.21.15.6:0/4233958283 shutdown_connections 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.439+0000 7fbc532e2640 1 --2- 172.21.15.6:0/4233958283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.439+0000 7fbc532e2640 1 --2- 172.21.15.6:0/4233958283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c162820 0x7fbc4c0b3940 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.439+0000 7fbc532e2640 1 -- 172.21.15.6:0/4233958283 >> 172.21.15.6:0/4233958283 conn(0x7fbc4c0d4bd0 msgr2=0x7fbc4c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.439+0000 7fbc532e2640 1 -- 172.21.15.6:0/4233958283 shutdown_connections 2024-05-20T18:00:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.439+0000 7fbc532e2640 1 -- 172.21.15.6:0/4233958283 wait complete. 2024-05-20T18:00:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.441+0000 7fbc532e2640 1 Processor -- start 2024-05-20T18:00:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.441+0000 7fbc532e2640 1 -- start start 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc532e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c06d910 0x7fbc4c1f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc532e2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c1f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc532e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4c162820 0x7fbc4c0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc532e2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c0d0300 con 0x7fbc4c06d910 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc532e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4c0d4260 con 0x7fbc4c162820 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc532e2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c0b91a0 con 0x7fbc4c0b3e80 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc5107e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c06d910 0x7fbc4c1f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc5107e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c06d910 0x7fbc4c1f29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49468/0 (socket says 172.21.15.6:49468) 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.442+0000 7fbc5107e640 1 -- 172.21.15.6:0/1163296403 learned_addr learned my addr 172.21.15.6:0/1163296403 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5107e640 1 -- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 msgr2=0x7fbc4c1f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5087d640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c1f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5187f640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4c162820 0x7fbc4c0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5107e640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c1f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5107e640 1 -- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4c162820 msgr2=0x7fbc4c0cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5107e640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4c162820 0x7fbc4c0cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5107e640 1 -- 172.21.15.6:0/1163296403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c1f64c0 con 0x7fbc4c06d910 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5187f640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4c162820 0x7fbc4c0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5087d640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c1f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc5107e640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c06d910 0x7fbc4c1f29e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fbc480098c0 tx=0x7fbc480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc41ffb640 1 -- 172.21.15.6:0/1163296403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48037040 con 0x7fbc4c06d910 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc41ffb640 1 -- 172.21.15.6:0/1163296403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc48030770 con 0x7fbc4c06d910 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4c1f6280 con 0x7fbc4c06d910 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc41ffb640 1 -- 172.21.15.6:0/1163296403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48030b40 con 0x7fbc4c06d910 2024-05-20T18:00:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.443+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc4c0b4c40 con 0x7fbc4c06d910 2024-05-20T18:00:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.444+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4c075b00 con 0x7fbc4c06d910 2024-05-20T18:00:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.445+0000 7fbc41ffb640 1 -- 172.21.15.6:0/1163296403 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc48044020 con 0x7fbc4c06d910 2024-05-20T18:00:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.446+0000 7fbc41ffb640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3006be60 0x7fbc3006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.446+0000 7fbc41ffb640 1 -- 172.21.15.6:0/1163296403 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fbc480ab540 con 0x7fbc4c06d910 2024-05-20T18:00:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.446+0000 7fbc5087d640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3006be60 0x7fbc3006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.446+0000 7fbc5087d640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3006be60 0x7fbc3006e370 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c006fd0 tx=0x7fbc3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.450+0000 7fbc41ffb640 1 -- 172.21.15.6:0/1163296403 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc48032e20 con 0x7fbc4c06d910 2024-05-20T18:00:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.638+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc4c0b3620 con 0x7fbc4c06d910 2024-05-20T18:00:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.639+0000 7fbc41ffb640 1 -- 172.21.15.6:0/1163296403 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16904 (secure 0 0 0) 0x7fbc48079d60 con 0x7fbc4c06d910 2024-05-20T18:00:48.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:48.638 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":113,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:45.915316+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:42.005763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:43.283834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:00:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3006be60 msgr2=0x7fbc3006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3006be60 0x7fbc3006e370 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c006fd0 tx=0x7fbc3c008040 comp rx=0 tx=0).stop 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c06d910 msgr2=0x7fbc4c1f29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c06d910 0x7fbc4c1f29e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fbc480098c0 tx=0x7fbc480046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 shutdown_connections 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc3006be60 0x7fbc3006e370 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbc4c162820 0x7fbc4c0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbc4c0b3e80 0x7fbc4c1f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 --2- 172.21.15.6:0/1163296403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc4c06d910 0x7fbc4c1f29e0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 >> 172.21.15.6:0/1163296403 conn(0x7fbc4c0d4bd0 msgr2=0x7fbc4c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 shutdown_connections 2024-05-20T18:00:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.642+0000 7fbc532e2640 1 -- 172.21.15.6:0/1163296403 wait complete. 2024-05-20T18:00:48.652 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T18:00:48.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:00:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.769+0000 7f23efd79640 1 Processor -- start 2024-05-20T18:00:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.769+0000 7f23efd79640 1 -- start start 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.770+0000 7f23efd79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e815d530 0x7f23e815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.770+0000 7f23efd79640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f23e8070850 0x7f23e8070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.770+0000 7f23efd79640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e80cd580 con 0x7f23e80b1700 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.770+0000 7f23efd79640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f23e80ce190 con 0x7f23e8070850 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.770+0000 7f23efd79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f23e80cd860 con 0x7f23e815d530 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23ee316640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f23e8070850 0x7f23e8070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23edb15640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e815d530 0x7f23e815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23ed314640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f23e80b1700 0x7f23e80b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:33948/0 (socket says 172.21.15.6:33948) 2024-05-20T18:00:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23ed314640 1 -- 172.21.15.6:0/1048647894 learned_addr learned my addr 172.21.15.6:0/1048647894 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23ee316640 1 -- 172.21.15.6:0/1048647894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e815d530 msgr2=0x7f23e815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23ee316640 1 --2- 172.21.15.6:0/1048647894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e815d530 0x7f23e815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23ee316640 1 -- 172.21.15.6:0/1048647894 >> v1:172.21.15.171:6789/0 conn(0x7f23e80b1700 legacy=0x7f23e80b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23ee316640 1 -- 172.21.15.6:0/1048647894 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e80cdb40 con 0x7f23e8070850 2024-05-20T18:00:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.771+0000 7f23edb15640 1 --2- 172.21.15.6:0/1048647894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e815d530 0x7f23e815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.772+0000 7f23ee316640 1 --2- 172.21.15.6:0/1048647894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e8070850 0x7f23e8070c60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009d90 tx=0x7f23e002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6a377c3d18c6121 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.772+0000 7f23ecb13640 1 -- 172.21.15.6:0/1048647894 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0007740 con 0x7f23e8070850 2024-05-20T18:00:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.772+0000 7f23ecb13640 1 -- 172.21.15.6:0/1048647894 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e00078e0 con 0x7f23e8070850 2024-05-20T18:00:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.772+0000 7f23ecb13640 1 -- 172.21.15.6:0/1048647894 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0007cb0 con 0x7f23e8070850 2024-05-20T18:00:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.773+0000 7f23efd79640 1 -- 172.21.15.6:0/1048647894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e8070850 msgr2=0x7f23e8070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.773+0000 7f23efd79640 1 --2- 172.21.15.6:0/1048647894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e8070850 0x7f23e8070c60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009d90 tx=0x7f23e002a660 comp rx=0 tx=0).stop 2024-05-20T18:00:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.773+0000 7f23efd79640 1 -- 172.21.15.6:0/1048647894 shutdown_connections 2024-05-20T18:00:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.773+0000 7f23efd79640 1 --2- 172.21.15.6:0/1048647894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e8070850 0x7f23e8070c60 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.773+0000 7f23efd79640 1 --2- 172.21.15.6:0/1048647894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e815d530 0x7f23e815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.773+0000 7f23efd79640 1 -- 172.21.15.6:0/1048647894 >> 172.21.15.6:0/1048647894 conn(0x7f23e80d29d0 msgr2=0x7f23e80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.773+0000 7f23efd79640 1 -- 172.21.15.6:0/1048647894 shutdown_connections 2024-05-20T18:00:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.773+0000 7f23efd79640 1 -- 172.21.15.6:0/1048647894 wait complete. 2024-05-20T18:00:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.775+0000 7f23efd79640 1 Processor -- start 2024-05-20T18:00:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.775+0000 7f23efd79640 1 -- start start 2024-05-20T18:00:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23efd79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23e8070850 0x7f23e80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23efd79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e80b1700 0x7f23e80c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23efd79640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e815d530 0x7f23e80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23efd79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f23e80711a0 con 0x7f23e8070850 2024-05-20T18:00:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23efd79640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23e80cd230 con 0x7f23e815d530 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23efd79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f23e8071320 con 0x7f23e80b1700 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23edb15640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23e8070850 0x7f23e80c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23edb15640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23e8070850 0x7f23e80c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49482/0 (socket says 172.21.15.6:49482) 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23edb15640 1 -- 172.21.15.6:0/1080945578 learned_addr learned my addr 172.21.15.6:0/1080945578 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23ee316640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e815d530 0x7f23e80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23ed314640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e80b1700 0x7f23e80c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23edb15640 1 -- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e80b1700 msgr2=0x7f23e80c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23edb15640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e80b1700 0x7f23e80c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23edb15640 1 -- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e815d530 msgr2=0x7f23e80cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.776+0000 7f23edb15640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e815d530 0x7f23e80cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.777+0000 7f23edb15640 1 -- 172.21.15.6:0/1080945578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e80c76d0 con 0x7f23e8070850 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.777+0000 7f23edb15640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23e8070850 0x7f23e80c6f10 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f23e400e940 tx=0x7f23e400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.777+0000 7f23de7fc640 1 -- 172.21.15.6:0/1080945578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4017070 con 0x7f23e8070850 2024-05-20T18:00:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.777+0000 7f23de7fc640 1 -- 172.21.15.6:0/1080945578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e400ca00 con 0x7f23e8070850 2024-05-20T18:00:48.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.777+0000 7f23de7fc640 1 -- 172.21.15.6:0/1080945578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e400cdd0 con 0x7f23e8070850 2024-05-20T18:00:48.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.777+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e80c79b0 con 0x7f23e8070850 2024-05-20T18:00:48.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.777+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e80c9b20 con 0x7f23e8070850 2024-05-20T18:00:48.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.778+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e8075b00 con 0x7f23e8070850 2024-05-20T18:00:48.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.779+0000 7f23de7fc640 1 -- 172.21.15.6:0/1080945578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23e401a070 con 0x7f23e8070850 2024-05-20T18:00:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.779+0000 7f23de7fc640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23cc06be60 0x7f23cc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.779+0000 7f23de7fc640 1 -- 172.21.15.6:0/1080945578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f23e408aef0 con 0x7f23e8070850 2024-05-20T18:00:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.780+0000 7f23ed314640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23cc06be60 0x7f23cc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.780+0000 7f23ed314640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23cc06be60 0x7f23cc06e370 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f23d8005880 tx=0x7f23d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:48.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.784+0000 7f23de7fc640 1 -- 172.21.15.6:0/1080945578 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f23e4059680 con 0x7f23e8070850 2024-05-20T18:00:48.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.965+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23e80c7480 con 0x7f23cc06be60 2024-05-20T18:00:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.972+0000 7f23de7fc640 1 -- 172.21.15.6:0/1080945578 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247088 (secure 0 0 0) 0x7f23e80c7480 con 0x7f23cc06be60 2024-05-20T18:00:48.973 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:00:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23cc06be60 msgr2=0x7f23cc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23cc06be60 0x7f23cc06e370 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f23d8005880 tx=0x7f23d8009040 comp rx=0 tx=0).stop 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23e8070850 msgr2=0x7f23e80c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23e8070850 0x7f23e80c6f10 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f23e400e940 tx=0x7f23e400ee00 comp rx=0 tx=0).stop 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 shutdown_connections 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23cc06be60 0x7f23cc06e370 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23e815d530 0x7f23e80cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23e80b1700 0x7f23e80c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 --2- 172.21.15.6:0/1080945578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23e8070850 0x7f23e80c6f10 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 >> 172.21.15.6:0/1080945578 conn(0x7f23e80d29d0 msgr2=0x7f23e815fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.974+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 shutdown_connections 2024-05-20T18:00:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:48.975+0000 7f23efd79640 1 -- 172.21.15.6:0/1080945578 wait complete. 2024-05-20T18:00:48.984 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-05-20T18:00:48.353099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261352,"kb_used_data":11904,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713368,"statfs":{"total":773094113280,"available":772826488832,"internally_reserved":0,"allocated":12189696,"data_stored":6242190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454449"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907683+0000","last_change":"2024-05-20T18:00:43.907683+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907683+0000","last_undegraded":"2024-05-20T18:00:43.907683+0000","last_fullsized":"2024-05-20T18:00:43.907683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915613+0000","last_change":"2024-05-20T18:00:43.915613+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915613+0000","last_undegraded":"2024-05-20T18:00:43.915613+0000","last_fullsized":"2024-05-20T18:00:43.915613+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915175+0000","last_change":"2024-05-20T18:00:43.915175+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915175+0000","last_undegraded":"2024-05-20T18:00:43.915175+0000","last_fullsized":"2024-05-20T18:00:43.915175+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913975+0000","last_change":"2024-05-20T18:00:43.913975+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913975+0000","last_undegraded":"2024-05-20T18:00:43.913975+0000","last_fullsized":"2024-05-20T18:00:43.913975+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907744+0000","last_change":"2024-05-20T18:00:43.907744+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907744+0000","last_undegraded":"2024-05-20T18:00:43.907744+0000","last_fullsized":"2024-05-20T18:00:43.907744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911078+0000","last_change":"2024-05-20T18:00:43.911078+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911078+0000","last_undegraded":"2024-05-20T18:00:43.911078+0000","last_fullsized":"2024-05-20T18:00:43.911078+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911041+0000","last_change":"2024-05-20T18:00:43.911041+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911041+0000","last_undegraded":"2024-05-20T18:00:43.911041+0000","last_fullsized":"2024-05-20T18:00:43.911041+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914940+0000","last_change":"2024-05-20T18:00:43.914940+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914940+0000","last_undegraded":"2024-05-20T18:00:43.914940+0000","last_fullsized":"2024-05-20T18:00:43.914940+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913935+0000","last_change":"2024-05-20T18:00:43.913935+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913935+0000","last_undegraded":"2024-05-20T18:00:43.913935+0000","last_fullsized":"2024-05-20T18:00:43.913935+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911718+0000","last_change":"2024-05-20T18:00:43.911718+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911718+0000","last_undegraded":"2024-05-20T18:00:43.911718+0000","last_fullsized":"2024-05-20T18:00:43.911718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.908128+0000","last_change":"2024-05-20T18:00:43.908128+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.908128+0000","last_undegraded":"2024-05-20T18:00:43.908128+0000","last_fullsized":"2024-05-20T18:00:43.908128+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913216+0000","last_change":"2024-05-20T18:00:43.913216+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913216+0000","last_undegraded":"2024-05-20T18:00:43.913216+0000","last_fullsized":"2024-05-20T18:00:43.913216+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915726+0000","last_change":"2024-05-20T18:00:43.915726+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915726+0000","last_undegraded":"2024-05-20T18:00:43.915726+0000","last_fullsized":"2024-05-20T18:00:43.915726+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914357+0000","last_change":"2024-05-20T18:00:43.914357+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914357+0000","last_undegraded":"2024-05-20T18:00:43.914357+0000","last_fullsized":"2024-05-20T18:00:43.914357+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.908463+0000","last_change":"2024-05-20T18:00:43.908463+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.908463+0000","last_undegraded":"2024-05-20T18:00:43.908463+0000","last_fullsized":"2024-05-20T18:00:43.908463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911686+0000","last_change":"2024-05-20T18:00:43.911686+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911686+0000","last_undegraded":"2024-05-20T18:00:43.911686+0000","last_fullsized":"2024-05-20T18:00:43.911686+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910769+0000","last_change":"2024-05-20T18:00:43.910769+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910769+0000","last_undegraded":"2024-05-20T18:00:43.910769+0000","last_fullsized":"2024-05-20T18:00:43.910769+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913105+0000","last_change":"2024-05-20T18:00:43.913105+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913105+0000","last_undegraded":"2024-05-20T18:00:43.913105+0000","last_fullsized":"2024-05-20T18:00:43.913105+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914296+0000","last_change":"2024-05-20T18:00:43.914296+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914296+0000","last_undegraded":"2024-05-20T18:00:43.914296+0000","last_fullsized":"2024-05-20T18:00:43.914296+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910275+0000","last_change":"2024-05-20T18:00:43.910275+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910275+0000","last_undegraded":"2024-05-20T18:00:43.910275+0000","last_fullsized":"2024-05-20T18:00:43.910275+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913262+0000","last_change":"2024-05-20T18:00:43.913262+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913262+0000","last_undegraded":"2024-05-20T18:00:43.913262+0000","last_fullsized":"2024-05-20T18:00:43.913262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907339+0000","last_change":"2024-05-20T18:00:43.907339+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907339+0000","last_undegraded":"2024-05-20T18:00:43.907339+0000","last_fullsized":"2024-05-20T18:00:43.907339+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912915+0000","last_change":"2024-05-20T18:00:43.912915+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912915+0000","last_undegraded":"2024-05-20T18:00:43.912915+0000","last_fullsized":"2024-05-20T18:00:43.912915+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910943+0000","last_change":"2024-05-20T18:00:43.910943+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910943+0000","last_undegraded":"2024-05-20T18:00:43.910943+0000","last_fullsized":"2024-05-20T18:00:43.910943+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911607+0000","last_change":"2024-05-20T18:00:43.911607+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911607+0000","last_undegraded":"2024-05-20T18:00:43.911607+0000","last_fullsized":"2024-05-20T18:00:43.911607+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911968+0000","last_change":"2024-05-20T18:00:43.911968+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911968+0000","last_undegraded":"2024-05-20T18:00:43.911968+0000","last_fullsized":"2024-05-20T18:00:43.911968+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913828+0000","last_change":"2024-05-20T18:00:43.913828+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913828+0000","last_undegraded":"2024-05-20T18:00:43.913828+0000","last_fullsized":"2024-05-20T18:00:43.913828+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912766+0000","last_change":"2024-05-20T18:00:43.912766+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912766+0000","last_undegraded":"2024-05-20T18:00:43.912766+0000","last_fullsized":"2024-05-20T18:00:43.912766+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910958+0000","last_change":"2024-05-20T18:00:43.910958+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910958+0000","last_undegraded":"2024-05-20T18:00:43.910958+0000","last_fullsized":"2024-05-20T18:00:43.910958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912505+0000","last_change":"2024-05-20T18:00:43.912505+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912505+0000","last_undegraded":"2024-05-20T18:00:43.912505+0000","last_fullsized":"2024-05-20T18:00:43.912505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.909807+0000","last_change":"2024-05-20T18:00:43.909807+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.909807+0000","last_undegraded":"2024-05-20T18:00:43.909807+0000","last_fullsized":"2024-05-20T18:00:43.909807+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910202+0000","last_change":"2024-05-20T18:00:43.910202+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910202+0000","last_undegraded":"2024-05-20T18:00:43.910202+0000","last_fullsized":"2024-05-20T18:00:43.910202+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913309+0000","last_change":"2024-05-20T18:00:43.913309+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913309+0000","last_undegraded":"2024-05-20T18:00:43.913309+0000","last_fullsized":"2024-05-20T18:00:43.913309+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928645+0000","last_change":"2024-05-20T18:00:43.925402+0000","last_active":"2024-05-20T18:00:43.928645+0000","last_peered":"2024-05-20T18:00:43.928645+0000","last_clean":"2024-05-20T18:00:43.928645+0000","last_became_active":"2024-05-20T18:00:43.925134+0000","last_became_peered":"2024-05-20T18:00:43.925134+0000","last_unstale":"2024-05-20T18:00:43.928645+0000","last_undegraded":"2024-05-20T18:00:43.928645+0000","last_fullsized":"2024-05-20T18:00:43.928645+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:24:29.952702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911824+0000","last_change":"2024-05-20T18:00:43.911824+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911824+0000","last_undegraded":"2024-05-20T18:00:43.911824+0000","last_fullsized":"2024-05-20T18:00:43.911824+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930124+0000","last_change":"2024-05-20T18:00:43.925970+0000","last_active":"2024-05-20T18:00:43.930124+0000","last_peered":"2024-05-20T18:00:43.930124+0000","last_clean":"2024-05-20T18:00:43.930124+0000","last_became_active":"2024-05-20T18:00:43.925355+0000","last_became_peered":"2024-05-20T18:00:43.925355+0000","last_unstale":"2024-05-20T18:00:43.930124+0000","last_undegraded":"2024-05-20T18:00:43.930124+0000","last_fullsized":"2024-05-20T18:00:43.930124+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:21.574924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910262+0000","last_change":"2024-05-20T18:00:43.910262+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910262+0000","last_undegraded":"2024-05-20T18:00:43.910262+0000","last_fullsized":"2024-05-20T18:00:43.910262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928667+0000","last_change":"2024-05-20T18:00:43.925185+0000","last_active":"2024-05-20T18:00:43.928667+0000","last_peered":"2024-05-20T18:00:43.928667+0000","last_clean":"2024-05-20T18:00:43.928667+0000","last_became_active":"2024-05-20T18:00:43.924852+0000","last_became_peered":"2024-05-20T18:00:43.924852+0000","last_unstale":"2024-05-20T18:00:43.928667+0000","last_undegraded":"2024-05-20T18:00:43.928667+0000","last_fullsized":"2024-05-20T18:00:43.928667+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:34.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913457+0000","last_change":"2024-05-20T18:00:43.913457+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913457+0000","last_undegraded":"2024-05-20T18:00:43.913457+0000","last_fullsized":"2024-05-20T18:00:43.913457+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928256+0000","last_change":"2024-05-20T18:00:43.921623+0000","last_active":"2024-05-20T18:00:43.928256+0000","last_peered":"2024-05-20T18:00:43.928256+0000","last_clean":"2024-05-20T18:00:43.928256+0000","last_became_active":"2024-05-20T18:00:43.921301+0000","last_became_peered":"2024-05-20T18:00:43.921301+0000","last_unstale":"2024-05-20T18:00:43.928256+0000","last_undegraded":"2024-05-20T18:00:43.928256+0000","last_fullsized":"2024-05-20T18:00:43.928256+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:51.024287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914889+0000","last_change":"2024-05-20T18:00:43.914889+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914889+0000","last_undegraded":"2024-05-20T18:00:43.914889+0000","last_fullsized":"2024-05-20T18:00:43.914889+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927413+0000","last_change":"2024-05-20T18:00:43.924910+0000","last_active":"2024-05-20T18:00:43.927413+0000","last_peered":"2024-05-20T18:00:43.927413+0000","last_clean":"2024-05-20T18:00:43.927413+0000","last_became_active":"2024-05-20T18:00:43.924572+0000","last_became_peered":"2024-05-20T18:00:43.924572+0000","last_unstale":"2024-05-20T18:00:43.927413+0000","last_undegraded":"2024-05-20T18:00:43.927413+0000","last_fullsized":"2024-05-20T18:00:43.927413+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:21:46.857750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907905+0000","last_change":"2024-05-20T18:00:43.907905+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907905+0000","last_undegraded":"2024-05-20T18:00:43.907905+0000","last_fullsized":"2024-05-20T18:00:43.907905+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.935141+0000","last_change":"2024-05-20T18:00:43.930892+0000","last_active":"2024-05-20T18:00:43.935141+0000","last_peered":"2024-05-20T18:00:43.935141+0000","last_clean":"2024-05-20T18:00:43.935141+0000","last_became_active":"2024-05-20T18:00:43.930513+0000","last_became_peered":"2024-05-20T18:00:43.930513+0000","last_unstale":"2024-05-20T18:00:43.935141+0000","last_undegraded":"2024-05-20T18:00:43.935141+0000","last_fullsized":"2024-05-20T18:00:43.935141+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:00.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911924+0000","last_change":"2024-05-20T18:00:43.911924+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911924+0000","last_undegraded":"2024-05-20T18:00:43.911924+0000","last_fullsized":"2024-05-20T18:00:43.911924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.921621+0000","last_change":"2024-05-20T18:00:43.918574+0000","last_active":"2024-05-20T18:00:43.921621+0000","last_peered":"2024-05-20T18:00:43.921621+0000","last_clean":"2024-05-20T18:00:43.921621+0000","last_became_active":"2024-05-20T18:00:43.918240+0000","last_became_peered":"2024-05-20T18:00:43.918240+0000","last_unstale":"2024-05-20T18:00:43.921621+0000","last_undegraded":"2024-05-20T18:00:43.921621+0000","last_fullsized":"2024-05-20T18:00:43.921621+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:51.024287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915220+0000","last_change":"2024-05-20T18:00:43.915220+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915220+0000","last_undegraded":"2024-05-20T18:00:43.915220+0000","last_fullsized":"2024-05-20T18:00:43.915220+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930175+0000","last_change":"2024-05-20T18:00:43.926835+0000","last_active":"2024-05-20T18:00:43.930175+0000","last_peered":"2024-05-20T18:00:43.930175+0000","last_clean":"2024-05-20T18:00:43.930175+0000","last_became_active":"2024-05-20T18:00:43.926506+0000","last_became_peered":"2024-05-20T18:00:43.926506+0000","last_unstale":"2024-05-20T18:00:43.930175+0000","last_undegraded":"2024-05-20T18:00:43.930175+0000","last_fullsized":"2024-05-20T18:00:43.930175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:50.048939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913377+0000","last_change":"2024-05-20T18:00:43.913377+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913377+0000","last_undegraded":"2024-05-20T18:00:43.913377+0000","last_fullsized":"2024-05-20T18:00:43.913377+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.931603+0000","last_change":"2024-05-20T18:00:43.930629+0000","last_active":"2024-05-20T18:00:43.931603+0000","last_peered":"2024-05-20T18:00:43.931603+0000","last_clean":"2024-05-20T18:00:43.931603+0000","last_became_active":"2024-05-20T18:00:43.930367+0000","last_became_peered":"2024-05-20T18:00:43.930367+0000","last_unstale":"2024-05-20T18:00:43.931603+0000","last_undegraded":"2024-05-20T18:00:43.931603+0000","last_fullsized":"2024-05-20T18:00:43.931603+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:57.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911312+0000","last_change":"2024-05-20T18:00:43.911312+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911312+0000","last_undegraded":"2024-05-20T18:00:43.911312+0000","last_fullsized":"2024-05-20T18:00:43.911312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927582+0000","last_change":"2024-05-20T18:00:43.922933+0000","last_active":"2024-05-20T18:00:43.927582+0000","last_peered":"2024-05-20T18:00:43.927582+0000","last_clean":"2024-05-20T18:00:43.927582+0000","last_became_active":"2024-05-20T18:00:43.922605+0000","last_became_peered":"2024-05-20T18:00:43.922605+0000","last_unstale":"2024-05-20T18:00:43.927582+0000","last_undegraded":"2024-05-20T18:00:43.927582+0000","last_fullsized":"2024-05-20T18:00:43.927582+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:01.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911380+0000","last_change":"2024-05-20T18:00:43.911380+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911380+0000","last_undegraded":"2024-05-20T18:00:43.911380+0000","last_fullsized":"2024-05-20T18:00:43.911380+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924569+0000","last_change":"2024-05-20T18:00:43.920113+0000","last_active":"2024-05-20T18:00:43.924569+0000","last_peered":"2024-05-20T18:00:43.924569+0000","last_clean":"2024-05-20T18:00:43.924569+0000","last_became_active":"2024-05-20T18:00:43.919814+0000","last_became_peered":"2024-05-20T18:00:43.919814+0000","last_unstale":"2024-05-20T18:00:43.924569+0000","last_undegraded":"2024-05-20T18:00:43.924569+0000","last_fullsized":"2024-05-20T18:00:43.924569+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:21.574924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910725+0000","last_change":"2024-05-20T18:00:43.910725+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910725+0000","last_undegraded":"2024-05-20T18:00:43.910725+0000","last_fullsized":"2024-05-20T18:00:43.910725+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.922982+0000","last_change":"2024-05-20T18:00:43.918943+0000","last_active":"2024-05-20T18:00:43.922982+0000","last_peered":"2024-05-20T18:00:43.922982+0000","last_clean":"2024-05-20T18:00:43.922982+0000","last_became_active":"2024-05-20T18:00:43.918615+0000","last_became_peered":"2024-05-20T18:00:43.918615+0000","last_unstale":"2024-05-20T18:00:43.922982+0000","last_undegraded":"2024-05-20T18:00:43.922982+0000","last_fullsized":"2024-05-20T18:00:43.922982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:52.896237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912812+0000","last_change":"2024-05-20T18:00:43.912812+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912812+0000","last_undegraded":"2024-05-20T18:00:43.912812+0000","last_fullsized":"2024-05-20T18:00:43.912812+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.922384+0000","last_change":"2024-05-20T18:00:43.916663+0000","last_active":"2024-05-20T18:00:43.922384+0000","last_peered":"2024-05-20T18:00:43.922384+0000","last_clean":"2024-05-20T18:00:43.922384+0000","last_became_active":"2024-05-20T18:00:43.916319+0000","last_became_peered":"2024-05-20T18:00:43.916319+0000","last_unstale":"2024-05-20T18:00:43.922384+0000","last_undegraded":"2024-05-20T18:00:43.922384+0000","last_fullsized":"2024-05-20T18:00:43.922384+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:27.626337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913322+0000","last_change":"2024-05-20T18:00:43.913322+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913322+0000","last_undegraded":"2024-05-20T18:00:43.913322+0000","last_fullsized":"2024-05-20T18:00:43.913322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928177+0000","last_change":"2024-05-20T18:00:43.919829+0000","last_active":"2024-05-20T18:00:43.928177+0000","last_peered":"2024-05-20T18:00:43.928177+0000","last_clean":"2024-05-20T18:00:43.928177+0000","last_became_active":"2024-05-20T18:00:43.919475+0000","last_became_peered":"2024-05-20T18:00:43.919475+0000","last_unstale":"2024-05-20T18:00:43.928177+0000","last_undegraded":"2024-05-20T18:00:43.928177+0000","last_fullsized":"2024-05-20T18:00:43.928177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:40:18.959941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911319+0000","last_change":"2024-05-20T18:00:43.911319+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911319+0000","last_undegraded":"2024-05-20T18:00:43.911319+0000","last_fullsized":"2024-05-20T18:00:43.911319+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928189+0000","last_change":"2024-05-20T18:00:43.920720+0000","last_active":"2024-05-20T18:00:43.928189+0000","last_peered":"2024-05-20T18:00:43.928189+0000","last_clean":"2024-05-20T18:00:43.928189+0000","last_became_active":"2024-05-20T18:00:43.918373+0000","last_became_peered":"2024-05-20T18:00:43.918373+0000","last_unstale":"2024-05-20T18:00:43.928189+0000","last_undegraded":"2024-05-20T18:00:43.928189+0000","last_fullsized":"2024-05-20T18:00:43.928189+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:58:52.369111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910218+0000","last_change":"2024-05-20T18:00:43.910218+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910218+0000","last_undegraded":"2024-05-20T18:00:43.910218+0000","last_fullsized":"2024-05-20T18:00:43.910218+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930018+0000","last_change":"2024-05-20T18:00:43.926382+0000","last_active":"2024-05-20T18:00:43.930018+0000","last_peered":"2024-05-20T18:00:43.930018+0000","last_clean":"2024-05-20T18:00:43.930018+0000","last_became_active":"2024-05-20T18:00:43.926047+0000","last_became_peered":"2024-05-20T18:00:43.926047+0000","last_unstale":"2024-05-20T18:00:43.930018+0000","last_undegraded":"2024-05-20T18:00:43.930018+0000","last_fullsized":"2024-05-20T18:00:43.930018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:01.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907103+0000","last_change":"2024-05-20T18:00:43.907103+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907103+0000","last_undegraded":"2024-05-20T18:00:43.907103+0000","last_fullsized":"2024-05-20T18:00:43.907103+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927643+0000","last_change":"2024-05-20T18:00:43.923411+0000","last_active":"2024-05-20T18:00:43.927643+0000","last_peered":"2024-05-20T18:00:43.927643+0000","last_clean":"2024-05-20T18:00:43.927643+0000","last_became_active":"2024-05-20T18:00:43.922877+0000","last_became_peered":"2024-05-20T18:00:43.922877+0000","last_unstale":"2024-05-20T18:00:43.927643+0000","last_undegraded":"2024-05-20T18:00:43.927643+0000","last_fullsized":"2024-05-20T18:00:43.927643+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:28:10.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913729+0000","last_change":"2024-05-20T18:00:43.913729+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913729+0000","last_undegraded":"2024-05-20T18:00:43.913729+0000","last_fullsized":"2024-05-20T18:00:43.913729+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927290+0000","last_change":"2024-05-20T18:00:43.922858+0000","last_active":"2024-05-20T18:00:43.927290+0000","last_peered":"2024-05-20T18:00:43.927290+0000","last_clean":"2024-05-20T18:00:43.927290+0000","last_became_active":"2024-05-20T18:00:43.922518+0000","last_became_peered":"2024-05-20T18:00:43.922518+0000","last_unstale":"2024-05-20T18:00:43.927290+0000","last_undegraded":"2024-05-20T18:00:43.927290+0000","last_fullsized":"2024-05-20T18:00:43.927290+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:15.883080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910185+0000","last_change":"2024-05-20T18:00:43.910185+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910185+0000","last_undegraded":"2024-05-20T18:00:43.910185+0000","last_fullsized":"2024-05-20T18:00:43.910185+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927327+0000","last_change":"2024-05-20T18:00:43.923354+0000","last_active":"2024-05-20T18:00:43.927327+0000","last_peered":"2024-05-20T18:00:43.927327+0000","last_clean":"2024-05-20T18:00:43.927327+0000","last_became_active":"2024-05-20T18:00:43.922991+0000","last_became_peered":"2024-05-20T18:00:43.922991+0000","last_unstale":"2024-05-20T18:00:43.927327+0000","last_undegraded":"2024-05-20T18:00:43.927327+0000","last_fullsized":"2024-05-20T18:00:43.927327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911141+0000","last_change":"2024-05-20T18:00:43.911141+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911141+0000","last_undegraded":"2024-05-20T18:00:43.911141+0000","last_fullsized":"2024-05-20T18:00:43.911141+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930133+0000","last_change":"2024-05-20T18:00:43.925470+0000","last_active":"2024-05-20T18:00:43.930133+0000","last_peered":"2024-05-20T18:00:43.930133+0000","last_clean":"2024-05-20T18:00:43.930133+0000","last_became_active":"2024-05-20T18:00:43.925053+0000","last_became_peered":"2024-05-20T18:00:43.925053+0000","last_unstale":"2024-05-20T18:00:43.930133+0000","last_undegraded":"2024-05-20T18:00:43.930133+0000","last_fullsized":"2024-05-20T18:00:43.930133+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:44.615268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910272+0000","last_change":"2024-05-20T18:00:43.910272+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910272+0000","last_undegraded":"2024-05-20T18:00:43.910272+0000","last_fullsized":"2024-05-20T18:00:43.910272+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924472+0000","last_change":"2024-05-20T18:00:43.920382+0000","last_active":"2024-05-20T18:00:43.924472+0000","last_peered":"2024-05-20T18:00:43.924472+0000","last_clean":"2024-05-20T18:00:43.924472+0000","last_became_active":"2024-05-20T18:00:43.919923+0000","last_became_peered":"2024-05-20T18:00:43.919923+0000","last_unstale":"2024-05-20T18:00:43.924472+0000","last_undegraded":"2024-05-20T18:00:43.924472+0000","last_fullsized":"2024-05-20T18:00:43.924472+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:40:18.959941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910857+0000","last_change":"2024-05-20T18:00:43.910857+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910857+0000","last_undegraded":"2024-05-20T18:00:43.910857+0000","last_fullsized":"2024-05-20T18:00:43.910857+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930063+0000","last_change":"2024-05-20T18:00:43.927113+0000","last_active":"2024-05-20T18:00:43.930063+0000","last_peered":"2024-05-20T18:00:43.930063+0000","last_clean":"2024-05-20T18:00:43.930063+0000","last_became_active":"2024-05-20T18:00:43.926779+0000","last_became_peered":"2024-05-20T18:00:43.926779+0000","last_unstale":"2024-05-20T18:00:43.930063+0000","last_undegraded":"2024-05-20T18:00:43.930063+0000","last_fullsized":"2024-05-20T18:00:43.930063+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910566+0000","last_change":"2024-05-20T18:00:43.910566+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910566+0000","last_undegraded":"2024-05-20T18:00:43.910566+0000","last_fullsized":"2024-05-20T18:00:43.910566+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927434+0000","last_change":"2024-05-20T18:00:43.923782+0000","last_active":"2024-05-20T18:00:43.927434+0000","last_peered":"2024-05-20T18:00:43.927434+0000","last_clean":"2024-05-20T18:00:43.927434+0000","last_became_active":"2024-05-20T18:00:43.923498+0000","last_became_peered":"2024-05-20T18:00:43.923498+0000","last_unstale":"2024-05-20T18:00:43.927434+0000","last_undegraded":"2024-05-20T18:00:43.927434+0000","last_fullsized":"2024-05-20T18:00:43.927434+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:24:29.952702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912308+0000","last_change":"2024-05-20T18:00:43.912308+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912308+0000","last_undegraded":"2024-05-20T18:00:43.912308+0000","last_fullsized":"2024-05-20T18:00:43.912308+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924714+0000","last_change":"2024-05-20T18:00:43.921058+0000","last_active":"2024-05-20T18:00:43.924714+0000","last_peered":"2024-05-20T18:00:43.924714+0000","last_clean":"2024-05-20T18:00:43.924714+0000","last_became_active":"2024-05-20T18:00:43.920773+0000","last_became_peered":"2024-05-20T18:00:43.920773+0000","last_unstale":"2024-05-20T18:00:43.924714+0000","last_undegraded":"2024-05-20T18:00:43.924714+0000","last_fullsized":"2024-05-20T18:00:43.924714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:10.717111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912240+0000","last_change":"2024-05-20T18:00:43.912240+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912240+0000","last_undegraded":"2024-05-20T18:00:43.912240+0000","last_fullsized":"2024-05-20T18:00:43.912240+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928627+0000","last_change":"2024-05-20T18:00:43.925337+0000","last_active":"2024-05-20T18:00:43.928627+0000","last_peered":"2024-05-20T18:00:43.928627+0000","last_clean":"2024-05-20T18:00:43.928627+0000","last_became_active":"2024-05-20T18:00:43.925036+0000","last_became_peered":"2024-05-20T18:00:43.925036+0000","last_unstale":"2024-05-20T18:00:43.928627+0000","last_undegraded":"2024-05-20T18:00:43.928627+0000","last_fullsized":"2024-05-20T18:00:43.928627+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912612+0000","last_change":"2024-05-20T18:00:43.912612+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912612+0000","last_undegraded":"2024-05-20T18:00:43.912612+0000","last_fullsized":"2024-05-20T18:00:43.912612+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.931349+0000","last_change":"2024-05-20T18:00:43.927476+0000","last_active":"2024-05-20T18:00:43.931349+0000","last_peered":"2024-05-20T18:00:43.931349+0000","last_clean":"2024-05-20T18:00:43.931349+0000","last_became_active":"2024-05-20T18:00:43.927118+0000","last_became_peered":"2024-05-20T18:00:43.927118+0000","last_unstale":"2024-05-20T18:00:43.931349+0000","last_undegraded":"2024-05-20T18:00:43.931349+0000","last_fullsized":"2024-05-20T18:00:43.931349+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:34.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910854+0000","last_change":"2024-05-20T18:00:43.910854+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910854+0000","last_undegraded":"2024-05-20T18:00:43.910854+0000","last_fullsized":"2024-05-20T18:00:43.910854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930935+0000","last_change":"2024-05-20T18:00:43.928985+0000","last_active":"2024-05-20T18:00:43.930935+0000","last_peered":"2024-05-20T18:00:43.930935+0000","last_clean":"2024-05-20T18:00:43.930935+0000","last_became_active":"2024-05-20T18:00:43.928674+0000","last_became_peered":"2024-05-20T18:00:43.928674+0000","last_unstale":"2024-05-20T18:00:43.930935+0000","last_undegraded":"2024-05-20T18:00:43.930935+0000","last_fullsized":"2024-05-20T18:00:43.930935+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:07:29.349922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910549+0000","last_change":"2024-05-20T18:00:43.910549+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910549+0000","last_undegraded":"2024-05-20T18:00:43.910549+0000","last_fullsized":"2024-05-20T18:00:43.910549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.918903+0000","last_change":"2024-05-20T18:00:43.917381+0000","last_active":"2024-05-20T18:00:43.918903+0000","last_peered":"2024-05-20T18:00:43.918903+0000","last_clean":"2024-05-20T18:00:43.918903+0000","last_became_active":"2024-05-20T18:00:43.917027+0000","last_became_peered":"2024-05-20T18:00:43.917027+0000","last_unstale":"2024-05-20T18:00:43.918903+0000","last_undegraded":"2024-05-20T18:00:43.918903+0000","last_fullsized":"2024-05-20T18:00:43.918903+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:55.857139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.909530+0000","last_change":"2024-05-20T18:00:43.909530+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.909530+0000","last_undegraded":"2024-05-20T18:00:43.909530+0000","last_fullsized":"2024-05-20T18:00:43.909530+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.917856+0000","last_change":"2024-05-20T18:00:43.912650+0000","last_active":"2024-05-20T18:00:43.917856+0000","last_peered":"2024-05-20T18:00:43.917856+0000","last_clean":"2024-05-20T18:00:43.917856+0000","last_became_active":"2024-05-20T18:00:43.912307+0000","last_became_peered":"2024-05-20T18:00:43.912307+0000","last_unstale":"2024-05-20T18:00:43.917856+0000","last_undegraded":"2024-05-20T18:00:43.917856+0000","last_fullsized":"2024-05-20T18:00:43.917856+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:39.614458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912136+0000","last_change":"2024-05-20T18:00:43.912136+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912136+0000","last_undegraded":"2024-05-20T18:00:43.912136+0000","last_fullsized":"2024-05-20T18:00:43.912136+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930981+0000","last_change":"2024-05-20T18:00:43.927440+0000","last_active":"2024-05-20T18:00:43.930981+0000","last_peered":"2024-05-20T18:00:43.930981+0000","last_clean":"2024-05-20T18:00:43.930981+0000","last_became_active":"2024-05-20T18:00:43.926940+0000","last_became_peered":"2024-05-20T18:00:43.926940+0000","last_unstale":"2024-05-20T18:00:43.930981+0000","last_undegraded":"2024-05-20T18:00:43.930981+0000","last_fullsized":"2024-05-20T18:00:43.930981+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:34.497727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914702+0000","last_change":"2024-05-20T18:00:43.914702+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914702+0000","last_undegraded":"2024-05-20T18:00:43.914702+0000","last_fullsized":"2024-05-20T18:00:43.914702+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927230+0000","last_change":"2024-05-20T18:00:43.922311+0000","last_active":"2024-05-20T18:00:43.927230+0000","last_peered":"2024-05-20T18:00:43.927230+0000","last_clean":"2024-05-20T18:00:43.927230+0000","last_became_active":"2024-05-20T18:00:43.921955+0000","last_became_peered":"2024-05-20T18:00:43.921955+0000","last_unstale":"2024-05-20T18:00:43.927230+0000","last_undegraded":"2024-05-20T18:00:43.927230+0000","last_fullsized":"2024-05-20T18:00:43.927230+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:58:52.369111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912812+0000","last_change":"2024-05-20T18:00:43.912812+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912812+0000","last_undegraded":"2024-05-20T18:00:43.912812+0000","last_fullsized":"2024-05-20T18:00:43.912812+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928161+0000","last_change":"2024-05-20T18:00:43.922085+0000","last_active":"2024-05-20T18:00:43.928161+0000","last_peered":"2024-05-20T18:00:43.928161+0000","last_clean":"2024-05-20T18:00:43.928161+0000","last_became_active":"2024-05-20T18:00:43.917629+0000","last_became_peered":"2024-05-20T18:00:43.917629+0000","last_unstale":"2024-05-20T18:00:43.928161+0000","last_undegraded":"2024-05-20T18:00:43.928161+0000","last_fullsized":"2024-05-20T18:00:43.928161+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:15.883080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":336,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.915122+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:00:43.915122+0000","last_peered":"2024-05-20T18:00:43.915122+0000","last_clean":"2024-05-20T18:00:43.915122+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:00:43.915122+0000","last_undegraded":"2024-05-20T18:00:43.915122+0000","last_fullsized":"2024-05-20T18:00:43.915122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":1978368,"data_stored":1228050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1384448,"data_stored":637682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1966080,"data_stored":1221383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:00:48.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:00:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.140+0000 7f47ec377640 1 Processor -- start 2024-05-20T18:00:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.140+0000 7f47ec377640 1 -- start start 2024-05-20T18:00:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47ec377640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e4162820 0x7f47e40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47ec377640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47e406dae0 0x7f47e40b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47ec377640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e40d0630 con 0x7f47e40b3e80 2024-05-20T18:00:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47ec377640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f47e40d39c0 con 0x7f47e406dae0 2024-05-20T18:00:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47ec377640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f47e40d3ca0 con 0x7f47e4162820 2024-05-20T18:00:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47ea914640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47e406dae0 0x7f47e40b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47e9912640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f47e40b3e80 0x7f47e406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:33960/0 (socket says 172.21.15.6:33960) 2024-05-20T18:00:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47e9912640 1 -- 172.21.15.6:0/3642711996 learned_addr learned my addr 172.21.15.6:0/3642711996 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.142+0000 7f47ea113640 1 --2- 172.21.15.6:0/3642711996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e4162820 0x7f47e40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.143+0000 7f47ea914640 1 -- 172.21.15.6:0/3642711996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e4162820 msgr2=0x7f47e40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.143+0000 7f47ea914640 1 --2- 172.21.15.6:0/3642711996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e4162820 0x7f47e40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.143+0000 7f47ea914640 1 -- 172.21.15.6:0/3642711996 >> v1:172.21.15.171:6789/0 conn(0x7f47e40b3e80 legacy=0x7f47e406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.143+0000 7f47ea914640 1 -- 172.21.15.6:0/3642711996 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e40d3f80 con 0x7f47e406dae0 2024-05-20T18:00:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.143+0000 7f47e9111640 1 -- 172.21.15.6:0/3642711996 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835640715 0 0) 0x7f47e40d0630 con 0x7f47e40b3e80 2024-05-20T18:00:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.143+0000 7f47ea914640 1 --2- 172.21.15.6:0/3642711996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e406dae0 0x7f47e40b8190 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009d90 tx=0x7f47dc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=577b851c7ed37012 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.144+0000 7f47e9111640 1 -- 172.21.15.6:0/3642711996 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc007740 con 0x7f47e406dae0 2024-05-20T18:00:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.144+0000 7f47e9111640 1 -- 172.21.15.6:0/3642711996 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc0078e0 con 0x7f47e406dae0 2024-05-20T18:00:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.144+0000 7f47e9111640 1 -- 172.21.15.6:0/3642711996 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc007cb0 con 0x7f47e406dae0 2024-05-20T18:00:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.144+0000 7f47ec377640 1 -- 172.21.15.6:0/3642711996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e406dae0 msgr2=0x7f47e40b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.144+0000 7f47ec377640 1 --2- 172.21.15.6:0/3642711996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e406dae0 0x7f47e40b8190 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009d90 tx=0x7f47dc02a660 comp rx=0 tx=0).stop 2024-05-20T18:00:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.145+0000 7f47ec377640 1 -- 172.21.15.6:0/3642711996 shutdown_connections 2024-05-20T18:00:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.145+0000 7f47ec377640 1 --2- 172.21.15.6:0/3642711996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e406dae0 0x7f47e40b8190 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.145+0000 7f47ec377640 1 --2- 172.21.15.6:0/3642711996 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e4162820 0x7f47e40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.145+0000 7f47ec377640 1 -- 172.21.15.6:0/3642711996 >> 172.21.15.6:0/3642711996 conn(0x7f47e40d4bd0 msgr2=0x7f47e40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.145+0000 7f47ec377640 1 -- 172.21.15.6:0/3642711996 shutdown_connections 2024-05-20T18:00:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.145+0000 7f47ec377640 1 -- 172.21.15.6:0/3642711996 wait complete. 2024-05-20T18:00:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.146+0000 7f47ec377640 1 Processor -- start 2024-05-20T18:00:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.146+0000 7f47ec377640 1 -- start start 2024-05-20T18:00:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ec377640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e40b3e80 0x7f47e414cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ec377640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e4162820 0x7f47e40cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ec377640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e41f82f0 0x7f47e41f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ec377640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f47e40d4780 con 0x7f47e40b3e80 2024-05-20T18:00:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ec377640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47e40d0300 con 0x7f47e4162820 2024-05-20T18:00:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ec377640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f47e40d4900 con 0x7f47e41f82f0 2024-05-20T18:00:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e40b3e80 0x7f47e414cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e40b3e80 0x7f47e414cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49484/0 (socket says 172.21.15.6:49484) 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 -- 172.21.15.6:0/585861496 learned_addr learned my addr 172.21.15.6:0/585861496 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea914640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e41f82f0 0x7f47e41f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47e9912640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e4162820 0x7f47e40cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 -- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e41f82f0 msgr2=0x7f47e41f8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e41f82f0 0x7f47e41f8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 -- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e4162820 msgr2=0x7f47e40cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e4162820 0x7f47e40cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 -- 172.21.15.6:0/585861496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e414d530 con 0x7f47e40b3e80 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47e9912640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e4162820 0x7f47e40cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47ea113640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e40b3e80 0x7f47e414cff0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f47e000e870 tx=0x7f47e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47daffd640 1 -- 172.21.15.6:0/585861496 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0017070 con 0x7f47e40b3e80 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.148+0000 7f47daffd640 1 -- 172.21.15.6:0/585861496 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e000c940 con 0x7f47e40b3e80 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.149+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e41f8c40 con 0x7f47e40b3e80 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.149+0000 7f47daffd640 1 -- 172.21.15.6:0/585861496 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e000cd30 con 0x7f47e40b3e80 2024-05-20T18:00:49.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.149+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e415dc80 con 0x7f47e40b3e80 2024-05-20T18:00:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.149+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e4075b00 con 0x7f47e40b3e80 2024-05-20T18:00:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.150+0000 7f47daffd640 1 -- 172.21.15.6:0/585861496 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47e001a070 con 0x7f47e40b3e80 2024-05-20T18:00:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.151+0000 7f47daffd640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c806be30 0x7f47c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.151+0000 7f47daffd640 1 -- 172.21.15.6:0/585861496 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f47e008ae80 con 0x7f47e40b3e80 2024-05-20T18:00:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.151+0000 7f47e9912640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c806be30 0x7f47c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.152+0000 7f47e9912640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c806be30 0x7f47c806e340 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f47e40b76a0 tx=0x7f47d4007cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.155+0000 7f47daffd640 1 -- 172.21.15.6:0/585861496 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f47e41f8c40 con 0x7f47e40b3e80 2024-05-20T18:00:49.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.336+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47e4161de0 con 0x7f47c806be30 2024-05-20T18:00:49.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.343+0000 7f47daffd640 1 -- 172.21.15.6:0/585861496 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247088 (secure 0 0 0) 0x7f47e4161de0 con 0x7f47c806be30 2024-05-20T18:00:49.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:49.345 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c806be30 msgr2=0x7f47c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c806be30 0x7f47c806e340 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f47e40b76a0 tx=0x7f47d4007cc0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e40b3e80 msgr2=0x7f47e414cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e40b3e80 0x7f47e414cff0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f47e000e870 tx=0x7f47e000ed30 comp rx=0 tx=0).stop 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 shutdown_connections 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f47c806be30 0x7f47c806e340 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47e41f82f0 0x7f47e41f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47e4162820 0x7f47e40cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 --2- 172.21.15.6:0/585861496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47e40b3e80 0x7f47e414cff0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.345+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 >> 172.21.15.6:0/585861496 conn(0x7f47e40d4bd0 msgr2=0x7f47e40ba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.346+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 shutdown_connections 2024-05-20T18:00:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.346+0000 7f47ec377640 1 -- 172.21.15.6:0/585861496 wait complete. 2024-05-20T18:00:49.355 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-05-20T18:00:48.353099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261352,"kb_used_data":11904,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713368,"statfs":{"total":773094113280,"available":772826488832,"internally_reserved":0,"allocated":12189696,"data_stored":6242190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454449"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907683+0000","last_change":"2024-05-20T18:00:43.907683+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907683+0000","last_undegraded":"2024-05-20T18:00:43.907683+0000","last_fullsized":"2024-05-20T18:00:43.907683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915613+0000","last_change":"2024-05-20T18:00:43.915613+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915613+0000","last_undegraded":"2024-05-20T18:00:43.915613+0000","last_fullsized":"2024-05-20T18:00:43.915613+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915175+0000","last_change":"2024-05-20T18:00:43.915175+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915175+0000","last_undegraded":"2024-05-20T18:00:43.915175+0000","last_fullsized":"2024-05-20T18:00:43.915175+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913975+0000","last_change":"2024-05-20T18:00:43.913975+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913975+0000","last_undegraded":"2024-05-20T18:00:43.913975+0000","last_fullsized":"2024-05-20T18:00:43.913975+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907744+0000","last_change":"2024-05-20T18:00:43.907744+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907744+0000","last_undegraded":"2024-05-20T18:00:43.907744+0000","last_fullsized":"2024-05-20T18:00:43.907744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911078+0000","last_change":"2024-05-20T18:00:43.911078+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911078+0000","last_undegraded":"2024-05-20T18:00:43.911078+0000","last_fullsized":"2024-05-20T18:00:43.911078+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911041+0000","last_change":"2024-05-20T18:00:43.911041+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911041+0000","last_undegraded":"2024-05-20T18:00:43.911041+0000","last_fullsized":"2024-05-20T18:00:43.911041+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914940+0000","last_change":"2024-05-20T18:00:43.914940+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914940+0000","last_undegraded":"2024-05-20T18:00:43.914940+0000","last_fullsized":"2024-05-20T18:00:43.914940+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913935+0000","last_change":"2024-05-20T18:00:43.913935+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913935+0000","last_undegraded":"2024-05-20T18:00:43.913935+0000","last_fullsized":"2024-05-20T18:00:43.913935+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911718+0000","last_change":"2024-05-20T18:00:43.911718+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911718+0000","last_undegraded":"2024-05-20T18:00:43.911718+0000","last_fullsized":"2024-05-20T18:00:43.911718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.908128+0000","last_change":"2024-05-20T18:00:43.908128+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.908128+0000","last_undegraded":"2024-05-20T18:00:43.908128+0000","last_fullsized":"2024-05-20T18:00:43.908128+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913216+0000","last_change":"2024-05-20T18:00:43.913216+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913216+0000","last_undegraded":"2024-05-20T18:00:43.913216+0000","last_fullsized":"2024-05-20T18:00:43.913216+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915726+0000","last_change":"2024-05-20T18:00:43.915726+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915726+0000","last_undegraded":"2024-05-20T18:00:43.915726+0000","last_fullsized":"2024-05-20T18:00:43.915726+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914357+0000","last_change":"2024-05-20T18:00:43.914357+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914357+0000","last_undegraded":"2024-05-20T18:00:43.914357+0000","last_fullsized":"2024-05-20T18:00:43.914357+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.908463+0000","last_change":"2024-05-20T18:00:43.908463+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.908463+0000","last_undegraded":"2024-05-20T18:00:43.908463+0000","last_fullsized":"2024-05-20T18:00:43.908463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911686+0000","last_change":"2024-05-20T18:00:43.911686+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911686+0000","last_undegraded":"2024-05-20T18:00:43.911686+0000","last_fullsized":"2024-05-20T18:00:43.911686+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910769+0000","last_change":"2024-05-20T18:00:43.910769+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910769+0000","last_undegraded":"2024-05-20T18:00:43.910769+0000","last_fullsized":"2024-05-20T18:00:43.910769+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913105+0000","last_change":"2024-05-20T18:00:43.913105+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913105+0000","last_undegraded":"2024-05-20T18:00:43.913105+0000","last_fullsized":"2024-05-20T18:00:43.913105+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914296+0000","last_change":"2024-05-20T18:00:43.914296+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914296+0000","last_undegraded":"2024-05-20T18:00:43.914296+0000","last_fullsized":"2024-05-20T18:00:43.914296+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910275+0000","last_change":"2024-05-20T18:00:43.910275+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910275+0000","last_undegraded":"2024-05-20T18:00:43.910275+0000","last_fullsized":"2024-05-20T18:00:43.910275+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913262+0000","last_change":"2024-05-20T18:00:43.913262+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913262+0000","last_undegraded":"2024-05-20T18:00:43.913262+0000","last_fullsized":"2024-05-20T18:00:43.913262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907339+0000","last_change":"2024-05-20T18:00:43.907339+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907339+0000","last_undegraded":"2024-05-20T18:00:43.907339+0000","last_fullsized":"2024-05-20T18:00:43.907339+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912915+0000","last_change":"2024-05-20T18:00:43.912915+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912915+0000","last_undegraded":"2024-05-20T18:00:43.912915+0000","last_fullsized":"2024-05-20T18:00:43.912915+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910943+0000","last_change":"2024-05-20T18:00:43.910943+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910943+0000","last_undegraded":"2024-05-20T18:00:43.910943+0000","last_fullsized":"2024-05-20T18:00:43.910943+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911607+0000","last_change":"2024-05-20T18:00:43.911607+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911607+0000","last_undegraded":"2024-05-20T18:00:43.911607+0000","last_fullsized":"2024-05-20T18:00:43.911607+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911968+0000","last_change":"2024-05-20T18:00:43.911968+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911968+0000","last_undegraded":"2024-05-20T18:00:43.911968+0000","last_fullsized":"2024-05-20T18:00:43.911968+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913828+0000","last_change":"2024-05-20T18:00:43.913828+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913828+0000","last_undegraded":"2024-05-20T18:00:43.913828+0000","last_fullsized":"2024-05-20T18:00:43.913828+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912766+0000","last_change":"2024-05-20T18:00:43.912766+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912766+0000","last_undegraded":"2024-05-20T18:00:43.912766+0000","last_fullsized":"2024-05-20T18:00:43.912766+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910958+0000","last_change":"2024-05-20T18:00:43.910958+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910958+0000","last_undegraded":"2024-05-20T18:00:43.910958+0000","last_fullsized":"2024-05-20T18:00:43.910958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912505+0000","last_change":"2024-05-20T18:00:43.912505+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912505+0000","last_undegraded":"2024-05-20T18:00:43.912505+0000","last_fullsized":"2024-05-20T18:00:43.912505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.909807+0000","last_change":"2024-05-20T18:00:43.909807+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.909807+0000","last_undegraded":"2024-05-20T18:00:43.909807+0000","last_fullsized":"2024-05-20T18:00:43.909807+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910202+0000","last_change":"2024-05-20T18:00:43.910202+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910202+0000","last_undegraded":"2024-05-20T18:00:43.910202+0000","last_fullsized":"2024-05-20T18:00:43.910202+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913309+0000","last_change":"2024-05-20T18:00:43.913309+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913309+0000","last_undegraded":"2024-05-20T18:00:43.913309+0000","last_fullsized":"2024-05-20T18:00:43.913309+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928645+0000","last_change":"2024-05-20T18:00:43.925402+0000","last_active":"2024-05-20T18:00:43.928645+0000","last_peered":"2024-05-20T18:00:43.928645+0000","last_clean":"2024-05-20T18:00:43.928645+0000","last_became_active":"2024-05-20T18:00:43.925134+0000","last_became_peered":"2024-05-20T18:00:43.925134+0000","last_unstale":"2024-05-20T18:00:43.928645+0000","last_undegraded":"2024-05-20T18:00:43.928645+0000","last_fullsized":"2024-05-20T18:00:43.928645+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:24:29.952702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911824+0000","last_change":"2024-05-20T18:00:43.911824+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911824+0000","last_undegraded":"2024-05-20T18:00:43.911824+0000","last_fullsized":"2024-05-20T18:00:43.911824+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930124+0000","last_change":"2024-05-20T18:00:43.925970+0000","last_active":"2024-05-20T18:00:43.930124+0000","last_peered":"2024-05-20T18:00:43.930124+0000","last_clean":"2024-05-20T18:00:43.930124+0000","last_became_active":"2024-05-20T18:00:43.925355+0000","last_became_peered":"2024-05-20T18:00:43.925355+0000","last_unstale":"2024-05-20T18:00:43.930124+0000","last_undegraded":"2024-05-20T18:00:43.930124+0000","last_fullsized":"2024-05-20T18:00:43.930124+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:21.574924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910262+0000","last_change":"2024-05-20T18:00:43.910262+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910262+0000","last_undegraded":"2024-05-20T18:00:43.910262+0000","last_fullsized":"2024-05-20T18:00:43.910262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928667+0000","last_change":"2024-05-20T18:00:43.925185+0000","last_active":"2024-05-20T18:00:43.928667+0000","last_peered":"2024-05-20T18:00:43.928667+0000","last_clean":"2024-05-20T18:00:43.928667+0000","last_became_active":"2024-05-20T18:00:43.924852+0000","last_became_peered":"2024-05-20T18:00:43.924852+0000","last_unstale":"2024-05-20T18:00:43.928667+0000","last_undegraded":"2024-05-20T18:00:43.928667+0000","last_fullsized":"2024-05-20T18:00:43.928667+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:34.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913457+0000","last_change":"2024-05-20T18:00:43.913457+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913457+0000","last_undegraded":"2024-05-20T18:00:43.913457+0000","last_fullsized":"2024-05-20T18:00:43.913457+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928256+0000","last_change":"2024-05-20T18:00:43.921623+0000","last_active":"2024-05-20T18:00:43.928256+0000","last_peered":"2024-05-20T18:00:43.928256+0000","last_clean":"2024-05-20T18:00:43.928256+0000","last_became_active":"2024-05-20T18:00:43.921301+0000","last_became_peered":"2024-05-20T18:00:43.921301+0000","last_unstale":"2024-05-20T18:00:43.928256+0000","last_undegraded":"2024-05-20T18:00:43.928256+0000","last_fullsized":"2024-05-20T18:00:43.928256+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:51.024287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914889+0000","last_change":"2024-05-20T18:00:43.914889+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914889+0000","last_undegraded":"2024-05-20T18:00:43.914889+0000","last_fullsized":"2024-05-20T18:00:43.914889+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927413+0000","last_change":"2024-05-20T18:00:43.924910+0000","last_active":"2024-05-20T18:00:43.927413+0000","last_peered":"2024-05-20T18:00:43.927413+0000","last_clean":"2024-05-20T18:00:43.927413+0000","last_became_active":"2024-05-20T18:00:43.924572+0000","last_became_peered":"2024-05-20T18:00:43.924572+0000","last_unstale":"2024-05-20T18:00:43.927413+0000","last_undegraded":"2024-05-20T18:00:43.927413+0000","last_fullsized":"2024-05-20T18:00:43.927413+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:21:46.857750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907905+0000","last_change":"2024-05-20T18:00:43.907905+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907905+0000","last_undegraded":"2024-05-20T18:00:43.907905+0000","last_fullsized":"2024-05-20T18:00:43.907905+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.935141+0000","last_change":"2024-05-20T18:00:43.930892+0000","last_active":"2024-05-20T18:00:43.935141+0000","last_peered":"2024-05-20T18:00:43.935141+0000","last_clean":"2024-05-20T18:00:43.935141+0000","last_became_active":"2024-05-20T18:00:43.930513+0000","last_became_peered":"2024-05-20T18:00:43.930513+0000","last_unstale":"2024-05-20T18:00:43.935141+0000","last_undegraded":"2024-05-20T18:00:43.935141+0000","last_fullsized":"2024-05-20T18:00:43.935141+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:00.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911924+0000","last_change":"2024-05-20T18:00:43.911924+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911924+0000","last_undegraded":"2024-05-20T18:00:43.911924+0000","last_fullsized":"2024-05-20T18:00:43.911924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.921621+0000","last_change":"2024-05-20T18:00:43.918574+0000","last_active":"2024-05-20T18:00:43.921621+0000","last_peered":"2024-05-20T18:00:43.921621+0000","last_clean":"2024-05-20T18:00:43.921621+0000","last_became_active":"2024-05-20T18:00:43.918240+0000","last_became_peered":"2024-05-20T18:00:43.918240+0000","last_unstale":"2024-05-20T18:00:43.921621+0000","last_undegraded":"2024-05-20T18:00:43.921621+0000","last_fullsized":"2024-05-20T18:00:43.921621+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:51.024287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915220+0000","last_change":"2024-05-20T18:00:43.915220+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915220+0000","last_undegraded":"2024-05-20T18:00:43.915220+0000","last_fullsized":"2024-05-20T18:00:43.915220+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930175+0000","last_change":"2024-05-20T18:00:43.926835+0000","last_active":"2024-05-20T18:00:43.930175+0000","last_peered":"2024-05-20T18:00:43.930175+0000","last_clean":"2024-05-20T18:00:43.930175+0000","last_became_active":"2024-05-20T18:00:43.926506+0000","last_became_peered":"2024-05-20T18:00:43.926506+0000","last_unstale":"2024-05-20T18:00:43.930175+0000","last_undegraded":"2024-05-20T18:00:43.930175+0000","last_fullsized":"2024-05-20T18:00:43.930175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:50.048939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913377+0000","last_change":"2024-05-20T18:00:43.913377+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913377+0000","last_undegraded":"2024-05-20T18:00:43.913377+0000","last_fullsized":"2024-05-20T18:00:43.913377+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.931603+0000","last_change":"2024-05-20T18:00:43.930629+0000","last_active":"2024-05-20T18:00:43.931603+0000","last_peered":"2024-05-20T18:00:43.931603+0000","last_clean":"2024-05-20T18:00:43.931603+0000","last_became_active":"2024-05-20T18:00:43.930367+0000","last_became_peered":"2024-05-20T18:00:43.930367+0000","last_unstale":"2024-05-20T18:00:43.931603+0000","last_undegraded":"2024-05-20T18:00:43.931603+0000","last_fullsized":"2024-05-20T18:00:43.931603+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:57.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911312+0000","last_change":"2024-05-20T18:00:43.911312+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911312+0000","last_undegraded":"2024-05-20T18:00:43.911312+0000","last_fullsized":"2024-05-20T18:00:43.911312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927582+0000","last_change":"2024-05-20T18:00:43.922933+0000","last_active":"2024-05-20T18:00:43.927582+0000","last_peered":"2024-05-20T18:00:43.927582+0000","last_clean":"2024-05-20T18:00:43.927582+0000","last_became_active":"2024-05-20T18:00:43.922605+0000","last_became_peered":"2024-05-20T18:00:43.922605+0000","last_unstale":"2024-05-20T18:00:43.927582+0000","last_undegraded":"2024-05-20T18:00:43.927582+0000","last_fullsized":"2024-05-20T18:00:43.927582+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:01.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911380+0000","last_change":"2024-05-20T18:00:43.911380+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911380+0000","last_undegraded":"2024-05-20T18:00:43.911380+0000","last_fullsized":"2024-05-20T18:00:43.911380+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924569+0000","last_change":"2024-05-20T18:00:43.920113+0000","last_active":"2024-05-20T18:00:43.924569+0000","last_peered":"2024-05-20T18:00:43.924569+0000","last_clean":"2024-05-20T18:00:43.924569+0000","last_became_active":"2024-05-20T18:00:43.919814+0000","last_became_peered":"2024-05-20T18:00:43.919814+0000","last_unstale":"2024-05-20T18:00:43.924569+0000","last_undegraded":"2024-05-20T18:00:43.924569+0000","last_fullsized":"2024-05-20T18:00:43.924569+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:21.574924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910725+0000","last_change":"2024-05-20T18:00:43.910725+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910725+0000","last_undegraded":"2024-05-20T18:00:43.910725+0000","last_fullsized":"2024-05-20T18:00:43.910725+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.922982+0000","last_change":"2024-05-20T18:00:43.918943+0000","last_active":"2024-05-20T18:00:43.922982+0000","last_peered":"2024-05-20T18:00:43.922982+0000","last_clean":"2024-05-20T18:00:43.922982+0000","last_became_active":"2024-05-20T18:00:43.918615+0000","last_became_peered":"2024-05-20T18:00:43.918615+0000","last_unstale":"2024-05-20T18:00:43.922982+0000","last_undegraded":"2024-05-20T18:00:43.922982+0000","last_fullsized":"2024-05-20T18:00:43.922982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:52.896237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912812+0000","last_change":"2024-05-20T18:00:43.912812+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912812+0000","last_undegraded":"2024-05-20T18:00:43.912812+0000","last_fullsized":"2024-05-20T18:00:43.912812+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.922384+0000","last_change":"2024-05-20T18:00:43.916663+0000","last_active":"2024-05-20T18:00:43.922384+0000","last_peered":"2024-05-20T18:00:43.922384+0000","last_clean":"2024-05-20T18:00:43.922384+0000","last_became_active":"2024-05-20T18:00:43.916319+0000","last_became_peered":"2024-05-20T18:00:43.916319+0000","last_unstale":"2024-05-20T18:00:43.922384+0000","last_undegraded":"2024-05-20T18:00:43.922384+0000","last_fullsized":"2024-05-20T18:00:43.922384+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:27.626337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913322+0000","last_change":"2024-05-20T18:00:43.913322+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913322+0000","last_undegraded":"2024-05-20T18:00:43.913322+0000","last_fullsized":"2024-05-20T18:00:43.913322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928177+0000","last_change":"2024-05-20T18:00:43.919829+0000","last_active":"2024-05-20T18:00:43.928177+0000","last_peered":"2024-05-20T18:00:43.928177+0000","last_clean":"2024-05-20T18:00:43.928177+0000","last_became_active":"2024-05-20T18:00:43.919475+0000","last_became_peered":"2024-05-20T18:00:43.919475+0000","last_unstale":"2024-05-20T18:00:43.928177+0000","last_undegraded":"2024-05-20T18:00:43.928177+0000","last_fullsized":"2024-05-20T18:00:43.928177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:40:18.959941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911319+0000","last_change":"2024-05-20T18:00:43.911319+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911319+0000","last_undegraded":"2024-05-20T18:00:43.911319+0000","last_fullsized":"2024-05-20T18:00:43.911319+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928189+0000","last_change":"2024-05-20T18:00:43.920720+0000","last_active":"2024-05-20T18:00:43.928189+0000","last_peered":"2024-05-20T18:00:43.928189+0000","last_clean":"2024-05-20T18:00:43.928189+0000","last_became_active":"2024-05-20T18:00:43.918373+0000","last_became_peered":"2024-05-20T18:00:43.918373+0000","last_unstale":"2024-05-20T18:00:43.928189+0000","last_undegraded":"2024-05-20T18:00:43.928189+0000","last_fullsized":"2024-05-20T18:00:43.928189+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:58:52.369111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910218+0000","last_change":"2024-05-20T18:00:43.910218+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910218+0000","last_undegraded":"2024-05-20T18:00:43.910218+0000","last_fullsized":"2024-05-20T18:00:43.910218+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930018+0000","last_change":"2024-05-20T18:00:43.926382+0000","last_active":"2024-05-20T18:00:43.930018+0000","last_peered":"2024-05-20T18:00:43.930018+0000","last_clean":"2024-05-20T18:00:43.930018+0000","last_became_active":"2024-05-20T18:00:43.926047+0000","last_became_peered":"2024-05-20T18:00:43.926047+0000","last_unstale":"2024-05-20T18:00:43.930018+0000","last_undegraded":"2024-05-20T18:00:43.930018+0000","last_fullsized":"2024-05-20T18:00:43.930018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:01.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907103+0000","last_change":"2024-05-20T18:00:43.907103+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907103+0000","last_undegraded":"2024-05-20T18:00:43.907103+0000","last_fullsized":"2024-05-20T18:00:43.907103+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927643+0000","last_change":"2024-05-20T18:00:43.923411+0000","last_active":"2024-05-20T18:00:43.927643+0000","last_peered":"2024-05-20T18:00:43.927643+0000","last_clean":"2024-05-20T18:00:43.927643+0000","last_became_active":"2024-05-20T18:00:43.922877+0000","last_became_peered":"2024-05-20T18:00:43.922877+0000","last_unstale":"2024-05-20T18:00:43.927643+0000","last_undegraded":"2024-05-20T18:00:43.927643+0000","last_fullsized":"2024-05-20T18:00:43.927643+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:28:10.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913729+0000","last_change":"2024-05-20T18:00:43.913729+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913729+0000","last_undegraded":"2024-05-20T18:00:43.913729+0000","last_fullsized":"2024-05-20T18:00:43.913729+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927290+0000","last_change":"2024-05-20T18:00:43.922858+0000","last_active":"2024-05-20T18:00:43.927290+0000","last_peered":"2024-05-20T18:00:43.927290+0000","last_clean":"2024-05-20T18:00:43.927290+0000","last_became_active":"2024-05-20T18:00:43.922518+0000","last_became_peered":"2024-05-20T18:00:43.922518+0000","last_unstale":"2024-05-20T18:00:43.927290+0000","last_undegraded":"2024-05-20T18:00:43.927290+0000","last_fullsized":"2024-05-20T18:00:43.927290+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:15.883080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910185+0000","last_change":"2024-05-20T18:00:43.910185+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910185+0000","last_undegraded":"2024-05-20T18:00:43.910185+0000","last_fullsized":"2024-05-20T18:00:43.910185+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927327+0000","last_change":"2024-05-20T18:00:43.923354+0000","last_active":"2024-05-20T18:00:43.927327+0000","last_peered":"2024-05-20T18:00:43.927327+0000","last_clean":"2024-05-20T18:00:43.927327+0000","last_became_active":"2024-05-20T18:00:43.922991+0000","last_became_peered":"2024-05-20T18:00:43.922991+0000","last_unstale":"2024-05-20T18:00:43.927327+0000","last_undegraded":"2024-05-20T18:00:43.927327+0000","last_fullsized":"2024-05-20T18:00:43.927327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911141+0000","last_change":"2024-05-20T18:00:43.911141+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911141+0000","last_undegraded":"2024-05-20T18:00:43.911141+0000","last_fullsized":"2024-05-20T18:00:43.911141+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930133+0000","last_change":"2024-05-20T18:00:43.925470+0000","last_active":"2024-05-20T18:00:43.930133+0000","last_peered":"2024-05-20T18:00:43.930133+0000","last_clean":"2024-05-20T18:00:43.930133+0000","last_became_active":"2024-05-20T18:00:43.925053+0000","last_became_peered":"2024-05-20T18:00:43.925053+0000","last_unstale":"2024-05-20T18:00:43.930133+0000","last_undegraded":"2024-05-20T18:00:43.930133+0000","last_fullsized":"2024-05-20T18:00:43.930133+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:44.615268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910272+0000","last_change":"2024-05-20T18:00:43.910272+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910272+0000","last_undegraded":"2024-05-20T18:00:43.910272+0000","last_fullsized":"2024-05-20T18:00:43.910272+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924472+0000","last_change":"2024-05-20T18:00:43.920382+0000","last_active":"2024-05-20T18:00:43.924472+0000","last_peered":"2024-05-20T18:00:43.924472+0000","last_clean":"2024-05-20T18:00:43.924472+0000","last_became_active":"2024-05-20T18:00:43.919923+0000","last_became_peered":"2024-05-20T18:00:43.919923+0000","last_unstale":"2024-05-20T18:00:43.924472+0000","last_undegraded":"2024-05-20T18:00:43.924472+0000","last_fullsized":"2024-05-20T18:00:43.924472+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:40:18.959941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910857+0000","last_change":"2024-05-20T18:00:43.910857+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910857+0000","last_undegraded":"2024-05-20T18:00:43.910857+0000","last_fullsized":"2024-05-20T18:00:43.910857+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930063+0000","last_change":"2024-05-20T18:00:43.927113+0000","last_active":"2024-05-20T18:00:43.930063+0000","last_peered":"2024-05-20T18:00:43.930063+0000","last_clean":"2024-05-20T18:00:43.930063+0000","last_became_active":"2024-05-20T18:00:43.926779+0000","last_became_peered":"2024-05-20T18:00:43.926779+0000","last_unstale":"2024-05-20T18:00:43.930063+0000","last_undegraded":"2024-05-20T18:00:43.930063+0000","last_fullsized":"2024-05-20T18:00:43.930063+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910566+0000","last_change":"2024-05-20T18:00:43.910566+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910566+0000","last_undegraded":"2024-05-20T18:00:43.910566+0000","last_fullsized":"2024-05-20T18:00:43.910566+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927434+0000","last_change":"2024-05-20T18:00:43.923782+0000","last_active":"2024-05-20T18:00:43.927434+0000","last_peered":"2024-05-20T18:00:43.927434+0000","last_clean":"2024-05-20T18:00:43.927434+0000","last_became_active":"2024-05-20T18:00:43.923498+0000","last_became_peered":"2024-05-20T18:00:43.923498+0000","last_unstale":"2024-05-20T18:00:43.927434+0000","last_undegraded":"2024-05-20T18:00:43.927434+0000","last_fullsized":"2024-05-20T18:00:43.927434+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:24:29.952702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912308+0000","last_change":"2024-05-20T18:00:43.912308+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912308+0000","last_undegraded":"2024-05-20T18:00:43.912308+0000","last_fullsized":"2024-05-20T18:00:43.912308+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924714+0000","last_change":"2024-05-20T18:00:43.921058+0000","last_active":"2024-05-20T18:00:43.924714+0000","last_peered":"2024-05-20T18:00:43.924714+0000","last_clean":"2024-05-20T18:00:43.924714+0000","last_became_active":"2024-05-20T18:00:43.920773+0000","last_became_peered":"2024-05-20T18:00:43.920773+0000","last_unstale":"2024-05-20T18:00:43.924714+0000","last_undegraded":"2024-05-20T18:00:43.924714+0000","last_fullsized":"2024-05-20T18:00:43.924714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:10.717111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912240+0000","last_change":"2024-05-20T18:00:43.912240+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912240+0000","last_undegraded":"2024-05-20T18:00:43.912240+0000","last_fullsized":"2024-05-20T18:00:43.912240+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928627+0000","last_change":"2024-05-20T18:00:43.925337+0000","last_active":"2024-05-20T18:00:43.928627+0000","last_peered":"2024-05-20T18:00:43.928627+0000","last_clean":"2024-05-20T18:00:43.928627+0000","last_became_active":"2024-05-20T18:00:43.925036+0000","last_became_peered":"2024-05-20T18:00:43.925036+0000","last_unstale":"2024-05-20T18:00:43.928627+0000","last_undegraded":"2024-05-20T18:00:43.928627+0000","last_fullsized":"2024-05-20T18:00:43.928627+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912612+0000","last_change":"2024-05-20T18:00:43.912612+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912612+0000","last_undegraded":"2024-05-20T18:00:43.912612+0000","last_fullsized":"2024-05-20T18:00:43.912612+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.931349+0000","last_change":"2024-05-20T18:00:43.927476+0000","last_active":"2024-05-20T18:00:43.931349+0000","last_peered":"2024-05-20T18:00:43.931349+0000","last_clean":"2024-05-20T18:00:43.931349+0000","last_became_active":"2024-05-20T18:00:43.927118+0000","last_became_peered":"2024-05-20T18:00:43.927118+0000","last_unstale":"2024-05-20T18:00:43.931349+0000","last_undegraded":"2024-05-20T18:00:43.931349+0000","last_fullsized":"2024-05-20T18:00:43.931349+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:34.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910854+0000","last_change":"2024-05-20T18:00:43.910854+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910854+0000","last_undegraded":"2024-05-20T18:00:43.910854+0000","last_fullsized":"2024-05-20T18:00:43.910854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930935+0000","last_change":"2024-05-20T18:00:43.928985+0000","last_active":"2024-05-20T18:00:43.930935+0000","last_peered":"2024-05-20T18:00:43.930935+0000","last_clean":"2024-05-20T18:00:43.930935+0000","last_became_active":"2024-05-20T18:00:43.928674+0000","last_became_peered":"2024-05-20T18:00:43.928674+0000","last_unstale":"2024-05-20T18:00:43.930935+0000","last_undegraded":"2024-05-20T18:00:43.930935+0000","last_fullsized":"2024-05-20T18:00:43.930935+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:07:29.349922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910549+0000","last_change":"2024-05-20T18:00:43.910549+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910549+0000","last_undegraded":"2024-05-20T18:00:43.910549+0000","last_fullsized":"2024-05-20T18:00:43.910549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.918903+0000","last_change":"2024-05-20T18:00:43.917381+0000","last_active":"2024-05-20T18:00:43.918903+0000","last_peered":"2024-05-20T18:00:43.918903+0000","last_clean":"2024-05-20T18:00:43.918903+0000","last_became_active":"2024-05-20T18:00:43.917027+0000","last_became_peered":"2024-05-20T18:00:43.917027+0000","last_unstale":"2024-05-20T18:00:43.918903+0000","last_undegraded":"2024-05-20T18:00:43.918903+0000","last_fullsized":"2024-05-20T18:00:43.918903+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:55.857139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.909530+0000","last_change":"2024-05-20T18:00:43.909530+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.909530+0000","last_undegraded":"2024-05-20T18:00:43.909530+0000","last_fullsized":"2024-05-20T18:00:43.909530+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.917856+0000","last_change":"2024-05-20T18:00:43.912650+0000","last_active":"2024-05-20T18:00:43.917856+0000","last_peered":"2024-05-20T18:00:43.917856+0000","last_clean":"2024-05-20T18:00:43.917856+0000","last_became_active":"2024-05-20T18:00:43.912307+0000","last_became_peered":"2024-05-20T18:00:43.912307+0000","last_unstale":"2024-05-20T18:00:43.917856+0000","last_undegraded":"2024-05-20T18:00:43.917856+0000","last_fullsized":"2024-05-20T18:00:43.917856+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:39.614458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912136+0000","last_change":"2024-05-20T18:00:43.912136+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912136+0000","last_undegraded":"2024-05-20T18:00:43.912136+0000","last_fullsized":"2024-05-20T18:00:43.912136+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930981+0000","last_change":"2024-05-20T18:00:43.927440+0000","last_active":"2024-05-20T18:00:43.930981+0000","last_peered":"2024-05-20T18:00:43.930981+0000","last_clean":"2024-05-20T18:00:43.930981+0000","last_became_active":"2024-05-20T18:00:43.926940+0000","last_became_peered":"2024-05-20T18:00:43.926940+0000","last_unstale":"2024-05-20T18:00:43.930981+0000","last_undegraded":"2024-05-20T18:00:43.930981+0000","last_fullsized":"2024-05-20T18:00:43.930981+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:34.497727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914702+0000","last_change":"2024-05-20T18:00:43.914702+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914702+0000","last_undegraded":"2024-05-20T18:00:43.914702+0000","last_fullsized":"2024-05-20T18:00:43.914702+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927230+0000","last_change":"2024-05-20T18:00:43.922311+0000","last_active":"2024-05-20T18:00:43.927230+0000","last_peered":"2024-05-20T18:00:43.927230+0000","last_clean":"2024-05-20T18:00:43.927230+0000","last_became_active":"2024-05-20T18:00:43.921955+0000","last_became_peered":"2024-05-20T18:00:43.921955+0000","last_unstale":"2024-05-20T18:00:43.927230+0000","last_undegraded":"2024-05-20T18:00:43.927230+0000","last_fullsized":"2024-05-20T18:00:43.927230+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:58:52.369111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912812+0000","last_change":"2024-05-20T18:00:43.912812+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912812+0000","last_undegraded":"2024-05-20T18:00:43.912812+0000","last_fullsized":"2024-05-20T18:00:43.912812+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928161+0000","last_change":"2024-05-20T18:00:43.922085+0000","last_active":"2024-05-20T18:00:43.928161+0000","last_peered":"2024-05-20T18:00:43.928161+0000","last_clean":"2024-05-20T18:00:43.928161+0000","last_became_active":"2024-05-20T18:00:43.917629+0000","last_became_peered":"2024-05-20T18:00:43.917629+0000","last_unstale":"2024-05-20T18:00:43.928161+0000","last_undegraded":"2024-05-20T18:00:43.928161+0000","last_fullsized":"2024-05-20T18:00:43.928161+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:15.883080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":336,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.915122+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:00:43.915122+0000","last_peered":"2024-05-20T18:00:43.915122+0000","last_clean":"2024-05-20T18:00:43.915122+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:00:43.915122+0000","last_undegraded":"2024-05-20T18:00:43.915122+0000","last_fullsized":"2024-05-20T18:00:43.915122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":1978368,"data_stored":1228050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1384448,"data_stored":637682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1966080,"data_stored":1221383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:00:49.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:00:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.513+0000 7f695f261640 1 Processor -- start 2024-05-20T18:00:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.513+0000 7f695f261640 1 -- start start 2024-05-20T18:00:49.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.514+0000 7f695f261640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6958159ca0 0x7f69580af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.514+0000 7f695f261640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 0x7f69580b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.514+0000 7f695f261640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f695809a740 con 0x7f695806c630 2024-05-20T18:00:49.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.514+0000 7f695f261640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f695809a4f0 con 0x7f6958159ca0 2024-05-20T18:00:49.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.514+0000 7f695f261640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f695809b350 con 0x7f69580b1650 2024-05-20T18:00:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.515+0000 7f695cffd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6958159ca0 0x7f69580af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.515+0000 7f694ffff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 0x7f69580b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.515+0000 7f695d7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f695806c630 0x7f695815c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:33976/0 (socket says 172.21.15.6:33976) 2024-05-20T18:00:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.515+0000 7f695d7fe640 1 -- 172.21.15.6:0/313582455 learned_addr learned my addr 172.21.15.6:0/313582455 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.515+0000 7f695cffd640 1 -- 172.21.15.6:0/313582455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 msgr2=0x7f69580b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.515+0000 7f695cffd640 1 --2- 172.21.15.6:0/313582455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 0x7f69580b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.515+0000 7f695cffd640 1 -- 172.21.15.6:0/313582455 >> v1:172.21.15.171:6789/0 conn(0x7f695806c630 legacy=0x7f695815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.515+0000 7f695cffd640 1 -- 172.21.15.6:0/313582455 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695809aa20 con 0x7f6958159ca0 2024-05-20T18:00:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.516+0000 7f695cffd640 1 --2- 172.21.15.6:0/313582455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 0x7f69580af230 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f69540097a0 tx=0x7f695402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a4bfba1fbbd0ca4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f694f7fe640 1 -- 172.21.15.6:0/313582455 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954037070 con 0x7f6958159ca0 2024-05-20T18:00:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f694f7fe640 1 -- 172.21.15.6:0/313582455 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695402ae50 con 0x7f6958159ca0 2024-05-20T18:00:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f694f7fe640 1 -- 172.21.15.6:0/313582455 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954032660 con 0x7f6958159ca0 2024-05-20T18:00:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f695f261640 1 -- 172.21.15.6:0/313582455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 msgr2=0x7f69580af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f695f261640 1 --2- 172.21.15.6:0/313582455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 0x7f69580af230 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f69540097a0 tx=0x7f695402a100 comp rx=0 tx=0).stop 2024-05-20T18:00:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f695f261640 1 -- 172.21.15.6:0/313582455 shutdown_connections 2024-05-20T18:00:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f695f261640 1 --2- 172.21.15.6:0/313582455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 0x7f69580b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f695f261640 1 --2- 172.21.15.6:0/313582455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 0x7f69580af230 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f695f261640 1 -- 172.21.15.6:0/313582455 >> 172.21.15.6:0/313582455 conn(0x7f69580b6620 msgr2=0x7f69580b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f695f261640 1 -- 172.21.15.6:0/313582455 shutdown_connections 2024-05-20T18:00:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.517+0000 7f695f261640 1 -- 172.21.15.6:0/313582455 wait complete. 2024-05-20T18:00:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.519+0000 7f695f261640 1 Processor -- start 2024-05-20T18:00:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.519+0000 7f695f261640 1 -- start start 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695f261640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695806c630 0x7f69581542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695f261640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 0x7f695809c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695f261640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 0x7f6958070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695f261640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f695809afe0 con 0x7f695806c630 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695f261640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f69580af770 con 0x7f6958159ca0 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695f261640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f69580b2220 con 0x7f69580b1650 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695806c630 0x7f69581542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695806c630 0x7f69581542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49486/0 (socket says 172.21.15.6:49486) 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 -- 172.21.15.6:0/3030856589 learned_addr learned my addr 172.21.15.6:0/3030856589 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f694ffff640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 0x7f695809c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695d7fe640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 0x7f6958070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 -- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 msgr2=0x7f695809c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 0x7f695809c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 -- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 msgr2=0x7f6958070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 0x7f6958070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 -- 172.21.15.6:0/3030856589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695815d7c0 con 0x7f695806c630 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.521+0000 7f695cffd640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695806c630 0x7f69581542e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f6954035040 tx=0x7f69540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.522+0000 7f694d7fa640 1 -- 172.21.15.6:0/3030856589 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954041070 con 0x7f695806c630 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.522+0000 7f694d7fa640 1 -- 172.21.15.6:0/3030856589 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695403c460 con 0x7f695806c630 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.522+0000 7f694d7fa640 1 -- 172.21.15.6:0/3030856589 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954037040 con 0x7f695806c630 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.522+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69581f5850 con 0x7f695806c630 2024-05-20T18:00:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.522+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69581f5e10 con 0x7f695806c630 2024-05-20T18:00:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.523+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6958075b00 con 0x7f695806c630 2024-05-20T18:00:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.523+0000 7f694d7fa640 1 -- 172.21.15.6:0/3030856589 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f695403a070 con 0x7f695806c630 2024-05-20T18:00:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.524+0000 7f694d7fa640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694406be60 0x7f694406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.524+0000 7f694d7fa640 1 -- 172.21.15.6:0/3030856589 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f69540ab2a0 con 0x7f695806c630 2024-05-20T18:00:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.524+0000 7f694ffff640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694406be60 0x7f694406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.525+0000 7f694ffff640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694406be60 0x7f694406e370 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f695815a4e0 tx=0x7f6948009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.528+0000 7f694d7fa640 1 -- 172.21.15.6:0/3030856589 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f69540793e0 con 0x7f695806c630 2024-05-20T18:00:49.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.707+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69581556d0 con 0x7f694406be60 2024-05-20T18:00:49.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.714+0000 7f694d7fa640 1 -- 172.21.15.6:0/3030856589 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247088 (secure 0 0 0) 0x7f69581556d0 con 0x7f694406be60 2024-05-20T18:00:49.715 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:49.716 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:00:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694406be60 msgr2=0x7f694406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694406be60 0x7f694406e370 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f695815a4e0 tx=0x7f6948009190 comp rx=0 tx=0).stop 2024-05-20T18:00:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695806c630 msgr2=0x7f69581542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695806c630 0x7f69581542e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f6954035040 tx=0x7f69540046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 shutdown_connections 2024-05-20T18:00:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f694406be60 0x7f694406e370 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6958159ca0 0x7f6958070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69580b1650 0x7f695809c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 --2- 172.21.15.6:0/3030856589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f695806c630 0x7f69581542e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 >> 172.21.15.6:0/3030856589 conn(0x7f69580b6620 msgr2=0x7f6958155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 shutdown_connections 2024-05-20T18:00:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.717+0000 7f695f261640 1 -- 172.21.15.6:0/3030856589 wait complete. 2024-05-20T18:00:49.727 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-05-20T18:00:48.353099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261352,"kb_used_data":11904,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713368,"statfs":{"total":773094113280,"available":772826488832,"internally_reserved":0,"allocated":12189696,"data_stored":6242190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454449"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907683+0000","last_change":"2024-05-20T18:00:43.907683+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907683+0000","last_undegraded":"2024-05-20T18:00:43.907683+0000","last_fullsized":"2024-05-20T18:00:43.907683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915613+0000","last_change":"2024-05-20T18:00:43.915613+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915613+0000","last_undegraded":"2024-05-20T18:00:43.915613+0000","last_fullsized":"2024-05-20T18:00:43.915613+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915175+0000","last_change":"2024-05-20T18:00:43.915175+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915175+0000","last_undegraded":"2024-05-20T18:00:43.915175+0000","last_fullsized":"2024-05-20T18:00:43.915175+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913975+0000","last_change":"2024-05-20T18:00:43.913975+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913975+0000","last_undegraded":"2024-05-20T18:00:43.913975+0000","last_fullsized":"2024-05-20T18:00:43.913975+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907744+0000","last_change":"2024-05-20T18:00:43.907744+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907744+0000","last_undegraded":"2024-05-20T18:00:43.907744+0000","last_fullsized":"2024-05-20T18:00:43.907744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911078+0000","last_change":"2024-05-20T18:00:43.911078+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911078+0000","last_undegraded":"2024-05-20T18:00:43.911078+0000","last_fullsized":"2024-05-20T18:00:43.911078+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911041+0000","last_change":"2024-05-20T18:00:43.911041+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911041+0000","last_undegraded":"2024-05-20T18:00:43.911041+0000","last_fullsized":"2024-05-20T18:00:43.911041+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914940+0000","last_change":"2024-05-20T18:00:43.914940+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914940+0000","last_undegraded":"2024-05-20T18:00:43.914940+0000","last_fullsized":"2024-05-20T18:00:43.914940+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913935+0000","last_change":"2024-05-20T18:00:43.913935+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913935+0000","last_undegraded":"2024-05-20T18:00:43.913935+0000","last_fullsized":"2024-05-20T18:00:43.913935+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911718+0000","last_change":"2024-05-20T18:00:43.911718+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911718+0000","last_undegraded":"2024-05-20T18:00:43.911718+0000","last_fullsized":"2024-05-20T18:00:43.911718+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.908128+0000","last_change":"2024-05-20T18:00:43.908128+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.908128+0000","last_undegraded":"2024-05-20T18:00:43.908128+0000","last_fullsized":"2024-05-20T18:00:43.908128+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913216+0000","last_change":"2024-05-20T18:00:43.913216+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913216+0000","last_undegraded":"2024-05-20T18:00:43.913216+0000","last_fullsized":"2024-05-20T18:00:43.913216+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915726+0000","last_change":"2024-05-20T18:00:43.915726+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915726+0000","last_undegraded":"2024-05-20T18:00:43.915726+0000","last_fullsized":"2024-05-20T18:00:43.915726+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914357+0000","last_change":"2024-05-20T18:00:43.914357+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914357+0000","last_undegraded":"2024-05-20T18:00:43.914357+0000","last_fullsized":"2024-05-20T18:00:43.914357+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.908463+0000","last_change":"2024-05-20T18:00:43.908463+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.908463+0000","last_undegraded":"2024-05-20T18:00:43.908463+0000","last_fullsized":"2024-05-20T18:00:43.908463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911686+0000","last_change":"2024-05-20T18:00:43.911686+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911686+0000","last_undegraded":"2024-05-20T18:00:43.911686+0000","last_fullsized":"2024-05-20T18:00:43.911686+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910769+0000","last_change":"2024-05-20T18:00:43.910769+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910769+0000","last_undegraded":"2024-05-20T18:00:43.910769+0000","last_fullsized":"2024-05-20T18:00:43.910769+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913105+0000","last_change":"2024-05-20T18:00:43.913105+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913105+0000","last_undegraded":"2024-05-20T18:00:43.913105+0000","last_fullsized":"2024-05-20T18:00:43.913105+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914296+0000","last_change":"2024-05-20T18:00:43.914296+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914296+0000","last_undegraded":"2024-05-20T18:00:43.914296+0000","last_fullsized":"2024-05-20T18:00:43.914296+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910275+0000","last_change":"2024-05-20T18:00:43.910275+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910275+0000","last_undegraded":"2024-05-20T18:00:43.910275+0000","last_fullsized":"2024-05-20T18:00:43.910275+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913262+0000","last_change":"2024-05-20T18:00:43.913262+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913262+0000","last_undegraded":"2024-05-20T18:00:43.913262+0000","last_fullsized":"2024-05-20T18:00:43.913262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907339+0000","last_change":"2024-05-20T18:00:43.907339+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907339+0000","last_undegraded":"2024-05-20T18:00:43.907339+0000","last_fullsized":"2024-05-20T18:00:43.907339+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912915+0000","last_change":"2024-05-20T18:00:43.912915+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912915+0000","last_undegraded":"2024-05-20T18:00:43.912915+0000","last_fullsized":"2024-05-20T18:00:43.912915+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910943+0000","last_change":"2024-05-20T18:00:43.910943+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910943+0000","last_undegraded":"2024-05-20T18:00:43.910943+0000","last_fullsized":"2024-05-20T18:00:43.910943+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911607+0000","last_change":"2024-05-20T18:00:43.911607+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911607+0000","last_undegraded":"2024-05-20T18:00:43.911607+0000","last_fullsized":"2024-05-20T18:00:43.911607+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911968+0000","last_change":"2024-05-20T18:00:43.911968+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911968+0000","last_undegraded":"2024-05-20T18:00:43.911968+0000","last_fullsized":"2024-05-20T18:00:43.911968+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913828+0000","last_change":"2024-05-20T18:00:43.913828+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913828+0000","last_undegraded":"2024-05-20T18:00:43.913828+0000","last_fullsized":"2024-05-20T18:00:43.913828+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912766+0000","last_change":"2024-05-20T18:00:43.912766+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912766+0000","last_undegraded":"2024-05-20T18:00:43.912766+0000","last_fullsized":"2024-05-20T18:00:43.912766+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910958+0000","last_change":"2024-05-20T18:00:43.910958+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910958+0000","last_undegraded":"2024-05-20T18:00:43.910958+0000","last_fullsized":"2024-05-20T18:00:43.910958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912505+0000","last_change":"2024-05-20T18:00:43.912505+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912505+0000","last_undegraded":"2024-05-20T18:00:43.912505+0000","last_fullsized":"2024-05-20T18:00:43.912505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.909807+0000","last_change":"2024-05-20T18:00:43.909807+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.909807+0000","last_undegraded":"2024-05-20T18:00:43.909807+0000","last_fullsized":"2024-05-20T18:00:43.909807+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910202+0000","last_change":"2024-05-20T18:00:43.910202+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910202+0000","last_undegraded":"2024-05-20T18:00:43.910202+0000","last_fullsized":"2024-05-20T18:00:43.910202+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913309+0000","last_change":"2024-05-20T18:00:43.913309+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913309+0000","last_undegraded":"2024-05-20T18:00:43.913309+0000","last_fullsized":"2024-05-20T18:00:43.913309+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928645+0000","last_change":"2024-05-20T18:00:43.925402+0000","last_active":"2024-05-20T18:00:43.928645+0000","last_peered":"2024-05-20T18:00:43.928645+0000","last_clean":"2024-05-20T18:00:43.928645+0000","last_became_active":"2024-05-20T18:00:43.925134+0000","last_became_peered":"2024-05-20T18:00:43.925134+0000","last_unstale":"2024-05-20T18:00:43.928645+0000","last_undegraded":"2024-05-20T18:00:43.928645+0000","last_fullsized":"2024-05-20T18:00:43.928645+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:24:29.952702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911824+0000","last_change":"2024-05-20T18:00:43.911824+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911824+0000","last_undegraded":"2024-05-20T18:00:43.911824+0000","last_fullsized":"2024-05-20T18:00:43.911824+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930124+0000","last_change":"2024-05-20T18:00:43.925970+0000","last_active":"2024-05-20T18:00:43.930124+0000","last_peered":"2024-05-20T18:00:43.930124+0000","last_clean":"2024-05-20T18:00:43.930124+0000","last_became_active":"2024-05-20T18:00:43.925355+0000","last_became_peered":"2024-05-20T18:00:43.925355+0000","last_unstale":"2024-05-20T18:00:43.930124+0000","last_undegraded":"2024-05-20T18:00:43.930124+0000","last_fullsized":"2024-05-20T18:00:43.930124+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:21.574924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910262+0000","last_change":"2024-05-20T18:00:43.910262+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910262+0000","last_undegraded":"2024-05-20T18:00:43.910262+0000","last_fullsized":"2024-05-20T18:00:43.910262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928667+0000","last_change":"2024-05-20T18:00:43.925185+0000","last_active":"2024-05-20T18:00:43.928667+0000","last_peered":"2024-05-20T18:00:43.928667+0000","last_clean":"2024-05-20T18:00:43.928667+0000","last_became_active":"2024-05-20T18:00:43.924852+0000","last_became_peered":"2024-05-20T18:00:43.924852+0000","last_unstale":"2024-05-20T18:00:43.928667+0000","last_undegraded":"2024-05-20T18:00:43.928667+0000","last_fullsized":"2024-05-20T18:00:43.928667+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:34.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913457+0000","last_change":"2024-05-20T18:00:43.913457+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913457+0000","last_undegraded":"2024-05-20T18:00:43.913457+0000","last_fullsized":"2024-05-20T18:00:43.913457+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928256+0000","last_change":"2024-05-20T18:00:43.921623+0000","last_active":"2024-05-20T18:00:43.928256+0000","last_peered":"2024-05-20T18:00:43.928256+0000","last_clean":"2024-05-20T18:00:43.928256+0000","last_became_active":"2024-05-20T18:00:43.921301+0000","last_became_peered":"2024-05-20T18:00:43.921301+0000","last_unstale":"2024-05-20T18:00:43.928256+0000","last_undegraded":"2024-05-20T18:00:43.928256+0000","last_fullsized":"2024-05-20T18:00:43.928256+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:51.024287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914889+0000","last_change":"2024-05-20T18:00:43.914889+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914889+0000","last_undegraded":"2024-05-20T18:00:43.914889+0000","last_fullsized":"2024-05-20T18:00:43.914889+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927413+0000","last_change":"2024-05-20T18:00:43.924910+0000","last_active":"2024-05-20T18:00:43.927413+0000","last_peered":"2024-05-20T18:00:43.927413+0000","last_clean":"2024-05-20T18:00:43.927413+0000","last_became_active":"2024-05-20T18:00:43.924572+0000","last_became_peered":"2024-05-20T18:00:43.924572+0000","last_unstale":"2024-05-20T18:00:43.927413+0000","last_undegraded":"2024-05-20T18:00:43.927413+0000","last_fullsized":"2024-05-20T18:00:43.927413+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:21:46.857750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907905+0000","last_change":"2024-05-20T18:00:43.907905+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907905+0000","last_undegraded":"2024-05-20T18:00:43.907905+0000","last_fullsized":"2024-05-20T18:00:43.907905+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.935141+0000","last_change":"2024-05-20T18:00:43.930892+0000","last_active":"2024-05-20T18:00:43.935141+0000","last_peered":"2024-05-20T18:00:43.935141+0000","last_clean":"2024-05-20T18:00:43.935141+0000","last_became_active":"2024-05-20T18:00:43.930513+0000","last_became_peered":"2024-05-20T18:00:43.930513+0000","last_unstale":"2024-05-20T18:00:43.935141+0000","last_undegraded":"2024-05-20T18:00:43.935141+0000","last_fullsized":"2024-05-20T18:00:43.935141+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:00.053513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911924+0000","last_change":"2024-05-20T18:00:43.911924+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911924+0000","last_undegraded":"2024-05-20T18:00:43.911924+0000","last_fullsized":"2024-05-20T18:00:43.911924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.921621+0000","last_change":"2024-05-20T18:00:43.918574+0000","last_active":"2024-05-20T18:00:43.921621+0000","last_peered":"2024-05-20T18:00:43.921621+0000","last_clean":"2024-05-20T18:00:43.921621+0000","last_became_active":"2024-05-20T18:00:43.918240+0000","last_became_peered":"2024-05-20T18:00:43.918240+0000","last_unstale":"2024-05-20T18:00:43.921621+0000","last_undegraded":"2024-05-20T18:00:43.921621+0000","last_fullsized":"2024-05-20T18:00:43.921621+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:58:51.024287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.915220+0000","last_change":"2024-05-20T18:00:43.915220+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.915220+0000","last_undegraded":"2024-05-20T18:00:43.915220+0000","last_fullsized":"2024-05-20T18:00:43.915220+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930175+0000","last_change":"2024-05-20T18:00:43.926835+0000","last_active":"2024-05-20T18:00:43.930175+0000","last_peered":"2024-05-20T18:00:43.930175+0000","last_clean":"2024-05-20T18:00:43.930175+0000","last_became_active":"2024-05-20T18:00:43.926506+0000","last_became_peered":"2024-05-20T18:00:43.926506+0000","last_unstale":"2024-05-20T18:00:43.930175+0000","last_undegraded":"2024-05-20T18:00:43.930175+0000","last_fullsized":"2024-05-20T18:00:43.930175+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:50.048939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913377+0000","last_change":"2024-05-20T18:00:43.913377+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913377+0000","last_undegraded":"2024-05-20T18:00:43.913377+0000","last_fullsized":"2024-05-20T18:00:43.913377+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.931603+0000","last_change":"2024-05-20T18:00:43.930629+0000","last_active":"2024-05-20T18:00:43.931603+0000","last_peered":"2024-05-20T18:00:43.931603+0000","last_clean":"2024-05-20T18:00:43.931603+0000","last_became_active":"2024-05-20T18:00:43.930367+0000","last_became_peered":"2024-05-20T18:00:43.930367+0000","last_unstale":"2024-05-20T18:00:43.931603+0000","last_undegraded":"2024-05-20T18:00:43.931603+0000","last_fullsized":"2024-05-20T18:00:43.931603+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:57.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911312+0000","last_change":"2024-05-20T18:00:43.911312+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911312+0000","last_undegraded":"2024-05-20T18:00:43.911312+0000","last_fullsized":"2024-05-20T18:00:43.911312+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927582+0000","last_change":"2024-05-20T18:00:43.922933+0000","last_active":"2024-05-20T18:00:43.927582+0000","last_peered":"2024-05-20T18:00:43.927582+0000","last_clean":"2024-05-20T18:00:43.927582+0000","last_became_active":"2024-05-20T18:00:43.922605+0000","last_became_peered":"2024-05-20T18:00:43.922605+0000","last_unstale":"2024-05-20T18:00:43.927582+0000","last_undegraded":"2024-05-20T18:00:43.927582+0000","last_fullsized":"2024-05-20T18:00:43.927582+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:01.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911380+0000","last_change":"2024-05-20T18:00:43.911380+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911380+0000","last_undegraded":"2024-05-20T18:00:43.911380+0000","last_fullsized":"2024-05-20T18:00:43.911380+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924569+0000","last_change":"2024-05-20T18:00:43.920113+0000","last_active":"2024-05-20T18:00:43.924569+0000","last_peered":"2024-05-20T18:00:43.924569+0000","last_clean":"2024-05-20T18:00:43.924569+0000","last_became_active":"2024-05-20T18:00:43.919814+0000","last_became_peered":"2024-05-20T18:00:43.919814+0000","last_unstale":"2024-05-20T18:00:43.924569+0000","last_undegraded":"2024-05-20T18:00:43.924569+0000","last_fullsized":"2024-05-20T18:00:43.924569+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:21.574924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910725+0000","last_change":"2024-05-20T18:00:43.910725+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910725+0000","last_undegraded":"2024-05-20T18:00:43.910725+0000","last_fullsized":"2024-05-20T18:00:43.910725+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.922982+0000","last_change":"2024-05-20T18:00:43.918943+0000","last_active":"2024-05-20T18:00:43.922982+0000","last_peered":"2024-05-20T18:00:43.922982+0000","last_clean":"2024-05-20T18:00:43.922982+0000","last_became_active":"2024-05-20T18:00:43.918615+0000","last_became_peered":"2024-05-20T18:00:43.918615+0000","last_unstale":"2024-05-20T18:00:43.922982+0000","last_undegraded":"2024-05-20T18:00:43.922982+0000","last_fullsized":"2024-05-20T18:00:43.922982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:52.896237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912812+0000","last_change":"2024-05-20T18:00:43.912812+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912812+0000","last_undegraded":"2024-05-20T18:00:43.912812+0000","last_fullsized":"2024-05-20T18:00:43.912812+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.922384+0000","last_change":"2024-05-20T18:00:43.916663+0000","last_active":"2024-05-20T18:00:43.922384+0000","last_peered":"2024-05-20T18:00:43.922384+0000","last_clean":"2024-05-20T18:00:43.922384+0000","last_became_active":"2024-05-20T18:00:43.916319+0000","last_became_peered":"2024-05-20T18:00:43.916319+0000","last_unstale":"2024-05-20T18:00:43.922384+0000","last_undegraded":"2024-05-20T18:00:43.922384+0000","last_fullsized":"2024-05-20T18:00:43.922384+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:27.626337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913322+0000","last_change":"2024-05-20T18:00:43.913322+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913322+0000","last_undegraded":"2024-05-20T18:00:43.913322+0000","last_fullsized":"2024-05-20T18:00:43.913322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928177+0000","last_change":"2024-05-20T18:00:43.919829+0000","last_active":"2024-05-20T18:00:43.928177+0000","last_peered":"2024-05-20T18:00:43.928177+0000","last_clean":"2024-05-20T18:00:43.928177+0000","last_became_active":"2024-05-20T18:00:43.919475+0000","last_became_peered":"2024-05-20T18:00:43.919475+0000","last_unstale":"2024-05-20T18:00:43.928177+0000","last_undegraded":"2024-05-20T18:00:43.928177+0000","last_fullsized":"2024-05-20T18:00:43.928177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:40:18.959941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911319+0000","last_change":"2024-05-20T18:00:43.911319+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911319+0000","last_undegraded":"2024-05-20T18:00:43.911319+0000","last_fullsized":"2024-05-20T18:00:43.911319+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928189+0000","last_change":"2024-05-20T18:00:43.920720+0000","last_active":"2024-05-20T18:00:43.928189+0000","last_peered":"2024-05-20T18:00:43.928189+0000","last_clean":"2024-05-20T18:00:43.928189+0000","last_became_active":"2024-05-20T18:00:43.918373+0000","last_became_peered":"2024-05-20T18:00:43.918373+0000","last_unstale":"2024-05-20T18:00:43.928189+0000","last_undegraded":"2024-05-20T18:00:43.928189+0000","last_fullsized":"2024-05-20T18:00:43.928189+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:58:52.369111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910218+0000","last_change":"2024-05-20T18:00:43.910218+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910218+0000","last_undegraded":"2024-05-20T18:00:43.910218+0000","last_fullsized":"2024-05-20T18:00:43.910218+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930018+0000","last_change":"2024-05-20T18:00:43.926382+0000","last_active":"2024-05-20T18:00:43.930018+0000","last_peered":"2024-05-20T18:00:43.930018+0000","last_clean":"2024-05-20T18:00:43.930018+0000","last_became_active":"2024-05-20T18:00:43.926047+0000","last_became_peered":"2024-05-20T18:00:43.926047+0000","last_unstale":"2024-05-20T18:00:43.930018+0000","last_undegraded":"2024-05-20T18:00:43.930018+0000","last_fullsized":"2024-05-20T18:00:43.930018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:01.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.907103+0000","last_change":"2024-05-20T18:00:43.907103+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.907103+0000","last_undegraded":"2024-05-20T18:00:43.907103+0000","last_fullsized":"2024-05-20T18:00:43.907103+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927643+0000","last_change":"2024-05-20T18:00:43.923411+0000","last_active":"2024-05-20T18:00:43.927643+0000","last_peered":"2024-05-20T18:00:43.927643+0000","last_clean":"2024-05-20T18:00:43.927643+0000","last_became_active":"2024-05-20T18:00:43.922877+0000","last_became_peered":"2024-05-20T18:00:43.922877+0000","last_unstale":"2024-05-20T18:00:43.927643+0000","last_undegraded":"2024-05-20T18:00:43.927643+0000","last_fullsized":"2024-05-20T18:00:43.927643+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:28:10.038918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.913729+0000","last_change":"2024-05-20T18:00:43.913729+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.913729+0000","last_undegraded":"2024-05-20T18:00:43.913729+0000","last_fullsized":"2024-05-20T18:00:43.913729+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927290+0000","last_change":"2024-05-20T18:00:43.922858+0000","last_active":"2024-05-20T18:00:43.927290+0000","last_peered":"2024-05-20T18:00:43.927290+0000","last_clean":"2024-05-20T18:00:43.927290+0000","last_became_active":"2024-05-20T18:00:43.922518+0000","last_became_peered":"2024-05-20T18:00:43.922518+0000","last_unstale":"2024-05-20T18:00:43.927290+0000","last_undegraded":"2024-05-20T18:00:43.927290+0000","last_fullsized":"2024-05-20T18:00:43.927290+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:15.883080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910185+0000","last_change":"2024-05-20T18:00:43.910185+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910185+0000","last_undegraded":"2024-05-20T18:00:43.910185+0000","last_fullsized":"2024-05-20T18:00:43.910185+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927327+0000","last_change":"2024-05-20T18:00:43.923354+0000","last_active":"2024-05-20T18:00:43.927327+0000","last_peered":"2024-05-20T18:00:43.927327+0000","last_clean":"2024-05-20T18:00:43.927327+0000","last_became_active":"2024-05-20T18:00:43.922991+0000","last_became_peered":"2024-05-20T18:00:43.922991+0000","last_unstale":"2024-05-20T18:00:43.927327+0000","last_undegraded":"2024-05-20T18:00:43.927327+0000","last_fullsized":"2024-05-20T18:00:43.927327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.911141+0000","last_change":"2024-05-20T18:00:43.911141+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.911141+0000","last_undegraded":"2024-05-20T18:00:43.911141+0000","last_fullsized":"2024-05-20T18:00:43.911141+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930133+0000","last_change":"2024-05-20T18:00:43.925470+0000","last_active":"2024-05-20T18:00:43.930133+0000","last_peered":"2024-05-20T18:00:43.930133+0000","last_clean":"2024-05-20T18:00:43.930133+0000","last_became_active":"2024-05-20T18:00:43.925053+0000","last_became_peered":"2024-05-20T18:00:43.925053+0000","last_unstale":"2024-05-20T18:00:43.930133+0000","last_undegraded":"2024-05-20T18:00:43.930133+0000","last_fullsized":"2024-05-20T18:00:43.930133+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:44.615268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910272+0000","last_change":"2024-05-20T18:00:43.910272+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910272+0000","last_undegraded":"2024-05-20T18:00:43.910272+0000","last_fullsized":"2024-05-20T18:00:43.910272+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924472+0000","last_change":"2024-05-20T18:00:43.920382+0000","last_active":"2024-05-20T18:00:43.924472+0000","last_peered":"2024-05-20T18:00:43.924472+0000","last_clean":"2024-05-20T18:00:43.924472+0000","last_became_active":"2024-05-20T18:00:43.919923+0000","last_became_peered":"2024-05-20T18:00:43.919923+0000","last_unstale":"2024-05-20T18:00:43.924472+0000","last_undegraded":"2024-05-20T18:00:43.924472+0000","last_fullsized":"2024-05-20T18:00:43.924472+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:40:18.959941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910857+0000","last_change":"2024-05-20T18:00:43.910857+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910857+0000","last_undegraded":"2024-05-20T18:00:43.910857+0000","last_fullsized":"2024-05-20T18:00:43.910857+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930063+0000","last_change":"2024-05-20T18:00:43.927113+0000","last_active":"2024-05-20T18:00:43.930063+0000","last_peered":"2024-05-20T18:00:43.930063+0000","last_clean":"2024-05-20T18:00:43.930063+0000","last_became_active":"2024-05-20T18:00:43.926779+0000","last_became_peered":"2024-05-20T18:00:43.926779+0000","last_unstale":"2024-05-20T18:00:43.930063+0000","last_undegraded":"2024-05-20T18:00:43.930063+0000","last_fullsized":"2024-05-20T18:00:43.930063+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910566+0000","last_change":"2024-05-20T18:00:43.910566+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910566+0000","last_undegraded":"2024-05-20T18:00:43.910566+0000","last_fullsized":"2024-05-20T18:00:43.910566+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927434+0000","last_change":"2024-05-20T18:00:43.923782+0000","last_active":"2024-05-20T18:00:43.927434+0000","last_peered":"2024-05-20T18:00:43.927434+0000","last_clean":"2024-05-20T18:00:43.927434+0000","last_became_active":"2024-05-20T18:00:43.923498+0000","last_became_peered":"2024-05-20T18:00:43.923498+0000","last_unstale":"2024-05-20T18:00:43.927434+0000","last_undegraded":"2024-05-20T18:00:43.927434+0000","last_fullsized":"2024-05-20T18:00:43.927434+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:24:29.952702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912308+0000","last_change":"2024-05-20T18:00:43.912308+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912308+0000","last_undegraded":"2024-05-20T18:00:43.912308+0000","last_fullsized":"2024-05-20T18:00:43.912308+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.924714+0000","last_change":"2024-05-20T18:00:43.921058+0000","last_active":"2024-05-20T18:00:43.924714+0000","last_peered":"2024-05-20T18:00:43.924714+0000","last_clean":"2024-05-20T18:00:43.924714+0000","last_became_active":"2024-05-20T18:00:43.920773+0000","last_became_peered":"2024-05-20T18:00:43.920773+0000","last_unstale":"2024-05-20T18:00:43.924714+0000","last_undegraded":"2024-05-20T18:00:43.924714+0000","last_fullsized":"2024-05-20T18:00:43.924714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:10.717111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912240+0000","last_change":"2024-05-20T18:00:43.912240+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912240+0000","last_undegraded":"2024-05-20T18:00:43.912240+0000","last_fullsized":"2024-05-20T18:00:43.912240+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928627+0000","last_change":"2024-05-20T18:00:43.925337+0000","last_active":"2024-05-20T18:00:43.928627+0000","last_peered":"2024-05-20T18:00:43.928627+0000","last_clean":"2024-05-20T18:00:43.928627+0000","last_became_active":"2024-05-20T18:00:43.925036+0000","last_became_peered":"2024-05-20T18:00:43.925036+0000","last_unstale":"2024-05-20T18:00:43.928627+0000","last_undegraded":"2024-05-20T18:00:43.928627+0000","last_fullsized":"2024-05-20T18:00:43.928627+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:11.647139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912612+0000","last_change":"2024-05-20T18:00:43.912612+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912612+0000","last_undegraded":"2024-05-20T18:00:43.912612+0000","last_fullsized":"2024-05-20T18:00:43.912612+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.931349+0000","last_change":"2024-05-20T18:00:43.927476+0000","last_active":"2024-05-20T18:00:43.931349+0000","last_peered":"2024-05-20T18:00:43.931349+0000","last_clean":"2024-05-20T18:00:43.931349+0000","last_became_active":"2024-05-20T18:00:43.927118+0000","last_became_peered":"2024-05-20T18:00:43.927118+0000","last_unstale":"2024-05-20T18:00:43.931349+0000","last_undegraded":"2024-05-20T18:00:43.931349+0000","last_fullsized":"2024-05-20T18:00:43.931349+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:34.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910854+0000","last_change":"2024-05-20T18:00:43.910854+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910854+0000","last_undegraded":"2024-05-20T18:00:43.910854+0000","last_fullsized":"2024-05-20T18:00:43.910854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930935+0000","last_change":"2024-05-20T18:00:43.928985+0000","last_active":"2024-05-20T18:00:43.930935+0000","last_peered":"2024-05-20T18:00:43.930935+0000","last_clean":"2024-05-20T18:00:43.930935+0000","last_became_active":"2024-05-20T18:00:43.928674+0000","last_became_peered":"2024-05-20T18:00:43.928674+0000","last_unstale":"2024-05-20T18:00:43.930935+0000","last_undegraded":"2024-05-20T18:00:43.930935+0000","last_fullsized":"2024-05-20T18:00:43.930935+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:07:29.349922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.910549+0000","last_change":"2024-05-20T18:00:43.910549+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.910549+0000","last_undegraded":"2024-05-20T18:00:43.910549+0000","last_fullsized":"2024-05-20T18:00:43.910549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.918903+0000","last_change":"2024-05-20T18:00:43.917381+0000","last_active":"2024-05-20T18:00:43.918903+0000","last_peered":"2024-05-20T18:00:43.918903+0000","last_clean":"2024-05-20T18:00:43.918903+0000","last_became_active":"2024-05-20T18:00:43.917027+0000","last_became_peered":"2024-05-20T18:00:43.917027+0000","last_unstale":"2024-05-20T18:00:43.918903+0000","last_undegraded":"2024-05-20T18:00:43.918903+0000","last_fullsized":"2024-05-20T18:00:43.918903+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:55.857139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.909530+0000","last_change":"2024-05-20T18:00:43.909530+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.909530+0000","last_undegraded":"2024-05-20T18:00:43.909530+0000","last_fullsized":"2024-05-20T18:00:43.909530+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.917856+0000","last_change":"2024-05-20T18:00:43.912650+0000","last_active":"2024-05-20T18:00:43.917856+0000","last_peered":"2024-05-20T18:00:43.917856+0000","last_clean":"2024-05-20T18:00:43.917856+0000","last_became_active":"2024-05-20T18:00:43.912307+0000","last_became_peered":"2024-05-20T18:00:43.912307+0000","last_unstale":"2024-05-20T18:00:43.917856+0000","last_undegraded":"2024-05-20T18:00:43.917856+0000","last_fullsized":"2024-05-20T18:00:43.917856+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:39.614458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912136+0000","last_change":"2024-05-20T18:00:43.912136+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912136+0000","last_undegraded":"2024-05-20T18:00:43.912136+0000","last_fullsized":"2024-05-20T18:00:43.912136+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.930981+0000","last_change":"2024-05-20T18:00:43.927440+0000","last_active":"2024-05-20T18:00:43.930981+0000","last_peered":"2024-05-20T18:00:43.930981+0000","last_clean":"2024-05-20T18:00:43.930981+0000","last_became_active":"2024-05-20T18:00:43.926940+0000","last_became_peered":"2024-05-20T18:00:43.926940+0000","last_unstale":"2024-05-20T18:00:43.930981+0000","last_undegraded":"2024-05-20T18:00:43.930981+0000","last_fullsized":"2024-05-20T18:00:43.930981+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:34.497727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.914702+0000","last_change":"2024-05-20T18:00:43.914702+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.914702+0000","last_undegraded":"2024-05-20T18:00:43.914702+0000","last_fullsized":"2024-05-20T18:00:43.914702+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.927230+0000","last_change":"2024-05-20T18:00:43.922311+0000","last_active":"2024-05-20T18:00:43.927230+0000","last_peered":"2024-05-20T18:00:43.927230+0000","last_clean":"2024-05-20T18:00:43.927230+0000","last_became_active":"2024-05-20T18:00:43.921955+0000","last_became_peered":"2024-05-20T18:00:43.921955+0000","last_unstale":"2024-05-20T18:00:43.927230+0000","last_undegraded":"2024-05-20T18:00:43.927230+0000","last_fullsized":"2024-05-20T18:00:43.927230+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:58:52.369111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-05-20T18:00:43.912812+0000","last_change":"2024-05-20T18:00:43.912812+0000","last_active":"2024-05-20T18:00:43.897434+0000","last_peered":"2024-05-20T18:00:43.897434+0000","last_clean":"2024-05-20T18:00:43.897434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-20T18:00:43.912812+0000","last_undegraded":"2024-05-20T18:00:43.912812+0000","last_fullsized":"2024-05-20T18:00:43.912812+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.928161+0000","last_change":"2024-05-20T18:00:43.922085+0000","last_active":"2024-05-20T18:00:43.928161+0000","last_peered":"2024-05-20T18:00:43.928161+0000","last_clean":"2024-05-20T18:00:43.928161+0000","last_became_active":"2024-05-20T18:00:43.917629+0000","last_became_peered":"2024-05-20T18:00:43.917629+0000","last_unstale":"2024-05-20T18:00:43.928161+0000","last_undegraded":"2024-05-20T18:00:43.928161+0000","last_fullsized":"2024-05-20T18:00:43.928161+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:59:15.883080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":336,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-05-20T18:00:43.915122+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:00:43.915122+0000","last_peered":"2024-05-20T18:00:43.915122+0000","last_clean":"2024-05-20T18:00:43.915122+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:00:43.915122+0000","last_undegraded":"2024-05-20T18:00:43.915122+0000","last_fullsized":"2024-05-20T18:00:43.915122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":1978368,"data_stored":1228050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1384448,"data_stored":637682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":631015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33100,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338740,"statfs":{"total":96636764160,"available":96602869760,"internally_reserved":0,"allocated":1966080,"data_stored":1221383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:00:49.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3f is not active+clean 2024-05-20T18:00:49.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.907683+0000', 'last_change': '2024-05-20T18:00:43.907683+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.907683+0000', 'last_undegraded': '2024-05-20T18:00:43.907683+0000', 'last_fullsized': '2024-05-20T18:00:43.907683+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T18:00:49.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2024-05-20T18:00:49.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.915613+0000', 'last_change': '2024-05-20T18:00:43.915613+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.915613+0000', 'last_undegraded': '2024-05-20T18:00:43.915613+0000', 'last_fullsized': '2024-05-20T18:00:43.915613+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.915175+0000', 'last_change': '2024-05-20T18:00:43.915175+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.915175+0000', 'last_undegraded': '2024-05-20T18:00:43.915175+0000', 'last_fullsized': '2024-05-20T18:00:43.915175+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913975+0000', 'last_change': '2024-05-20T18:00:43.913975+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913975+0000', 'last_undegraded': '2024-05-20T18:00:43.913975+0000', 'last_fullsized': '2024-05-20T18:00:43.913975+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3b is not active+clean 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.907744+0000', 'last_change': '2024-05-20T18:00:43.907744+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.907744+0000', 'last_undegraded': '2024-05-20T18:00:43.907744+0000', 'last_fullsized': '2024-05-20T18:00:43.907744+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911078+0000', 'last_change': '2024-05-20T18:00:43.911078+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911078+0000', 'last_undegraded': '2024-05-20T18:00:43.911078+0000', 'last_fullsized': '2024-05-20T18:00:43.911078+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911041+0000', 'last_change': '2024-05-20T18:00:43.911041+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911041+0000', 'last_undegraded': '2024-05-20T18:00:43.911041+0000', 'last_fullsized': '2024-05-20T18:00:43.911041+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2024-05-20T18:00:49.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.914940+0000', 'last_change': '2024-05-20T18:00:43.914940+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.914940+0000', 'last_undegraded': '2024-05-20T18:00:43.914940+0000', 'last_fullsized': '2024-05-20T18:00:43.914940+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913935+0000', 'last_change': '2024-05-20T18:00:43.913935+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913935+0000', 'last_undegraded': '2024-05-20T18:00:43.913935+0000', 'last_fullsized': '2024-05-20T18:00:43.913935+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911718+0000', 'last_change': '2024-05-20T18:00:43.911718+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911718+0000', 'last_undegraded': '2024-05-20T18:00:43.911718+0000', 'last_fullsized': '2024-05-20T18:00:43.911718+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.35 is not active+clean 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.908128+0000', 'last_change': '2024-05-20T18:00:43.908128+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.908128+0000', 'last_undegraded': '2024-05-20T18:00:43.908128+0000', 'last_fullsized': '2024-05-20T18:00:43.908128+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913216+0000', 'last_change': '2024-05-20T18:00:43.913216+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913216+0000', 'last_undegraded': '2024-05-20T18:00:43.913216+0000', 'last_fullsized': '2024-05-20T18:00:43.913216+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.915726+0000', 'last_change': '2024-05-20T18:00:43.915726+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.915726+0000', 'last_undegraded': '2024-05-20T18:00:43.915726+0000', 'last_fullsized': '2024-05-20T18:00:43.915726+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2024-05-20T18:00:49.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.914357+0000', 'last_change': '2024-05-20T18:00:43.914357+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.914357+0000', 'last_undegraded': '2024-05-20T18:00:43.914357+0000', 'last_fullsized': '2024-05-20T18:00:43.914357+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.31 is not active+clean 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.908463+0000', 'last_change': '2024-05-20T18:00:43.908463+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.908463+0000', 'last_undegraded': '2024-05-20T18:00:43.908463+0000', 'last_fullsized': '2024-05-20T18:00:43.908463+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911686+0000', 'last_change': '2024-05-20T18:00:43.911686+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911686+0000', 'last_undegraded': '2024-05-20T18:00:43.911686+0000', 'last_fullsized': '2024-05-20T18:00:43.911686+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910769+0000', 'last_change': '2024-05-20T18:00:43.910769+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910769+0000', 'last_undegraded': '2024-05-20T18:00:43.910769+0000', 'last_fullsized': '2024-05-20T18:00:43.910769+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913105+0000', 'last_change': '2024-05-20T18:00:43.913105+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913105+0000', 'last_undegraded': '2024-05-20T18:00:43.913105+0000', 'last_fullsized': '2024-05-20T18:00:43.913105+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.914296+0000', 'last_change': '2024-05-20T18:00:43.914296+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.914296+0000', 'last_undegraded': '2024-05-20T18:00:43.914296+0000', 'last_fullsized': '2024-05-20T18:00:43.914296+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2024-05-20T18:00:49.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910275+0000', 'last_change': '2024-05-20T18:00:43.910275+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910275+0000', 'last_undegraded': '2024-05-20T18:00:43.910275+0000', 'last_fullsized': '2024-05-20T18:00:43.910275+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913262+0000', 'last_change': '2024-05-20T18:00:43.913262+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913262+0000', 'last_undegraded': '2024-05-20T18:00:43.913262+0000', 'last_fullsized': '2024-05-20T18:00:43.913262+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2a is not active+clean 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.907339+0000', 'last_change': '2024-05-20T18:00:43.907339+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.907339+0000', 'last_undegraded': '2024-05-20T18:00:43.907339+0000', 'last_fullsized': '2024-05-20T18:00:43.907339+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912915+0000', 'last_change': '2024-05-20T18:00:43.912915+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912915+0000', 'last_undegraded': '2024-05-20T18:00:43.912915+0000', 'last_fullsized': '2024-05-20T18:00:43.912915+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.28 is not active+clean 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910943+0000', 'last_change': '2024-05-20T18:00:43.910943+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910943+0000', 'last_undegraded': '2024-05-20T18:00:43.910943+0000', 'last_fullsized': '2024-05-20T18:00:43.910943+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.27 is not active+clean 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911607+0000', 'last_change': '2024-05-20T18:00:43.911607+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911607+0000', 'last_undegraded': '2024-05-20T18:00:43.911607+0000', 'last_fullsized': '2024-05-20T18:00:43.911607+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2024-05-20T18:00:49.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911968+0000', 'last_change': '2024-05-20T18:00:43.911968+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911968+0000', 'last_undegraded': '2024-05-20T18:00:43.911968+0000', 'last_fullsized': '2024-05-20T18:00:43.911968+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913828+0000', 'last_change': '2024-05-20T18:00:43.913828+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913828+0000', 'last_undegraded': '2024-05-20T18:00:43.913828+0000', 'last_fullsized': '2024-05-20T18:00:43.913828+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912766+0000', 'last_change': '2024-05-20T18:00:43.912766+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912766+0000', 'last_undegraded': '2024-05-20T18:00:43.912766+0000', 'last_fullsized': '2024-05-20T18:00:43.912766+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910958+0000', 'last_change': '2024-05-20T18:00:43.910958+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910958+0000', 'last_undegraded': '2024-05-20T18:00:43.910958+0000', 'last_fullsized': '2024-05-20T18:00:43.910958+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912505+0000', 'last_change': '2024-05-20T18:00:43.912505+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912505+0000', 'last_undegraded': '2024-05-20T18:00:43.912505+0000', 'last_fullsized': '2024-05-20T18:00:43.912505+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.21 is not active+clean 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.909807+0000', 'last_change': '2024-05-20T18:00:43.909807+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.909807+0000', 'last_undegraded': '2024-05-20T18:00:43.909807+0000', 'last_fullsized': '2024-05-20T18:00:43.909807+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.20 is not active+clean 2024-05-20T18:00:49.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910202+0000', 'last_change': '2024-05-20T18:00:43.910202+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910202+0000', 'last_undegraded': '2024-05-20T18:00:43.910202+0000', 'last_fullsized': '2024-05-20T18:00:43.910202+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913309+0000', 'last_change': '2024-05-20T18:00:43.913309+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913309+0000', 'last_undegraded': '2024-05-20T18:00:43.913309+0000', 'last_fullsized': '2024-05-20T18:00:43.913309+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911824+0000', 'last_change': '2024-05-20T18:00:43.911824+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911824+0000', 'last_undegraded': '2024-05-20T18:00:43.911824+0000', 'last_fullsized': '2024-05-20T18:00:43.911824+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910262+0000', 'last_change': '2024-05-20T18:00:43.910262+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910262+0000', 'last_undegraded': '2024-05-20T18:00:43.910262+0000', 'last_fullsized': '2024-05-20T18:00:43.910262+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913457+0000', 'last_change': '2024-05-20T18:00:43.913457+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913457+0000', 'last_undegraded': '2024-05-20T18:00:43.913457+0000', 'last_fullsized': '2024-05-20T18:00:43.913457+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.914889+0000', 'last_change': '2024-05-20T18:00:43.914889+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.914889+0000', 'last_undegraded': '2024-05-20T18:00:43.914889+0000', 'last_fullsized': '2024-05-20T18:00:43.914889+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2024-05-20T18:00:49.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.907905+0000', 'last_change': '2024-05-20T18:00:43.907905+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.907905+0000', 'last_undegraded': '2024-05-20T18:00:43.907905+0000', 'last_fullsized': '2024-05-20T18:00:43.907905+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911924+0000', 'last_change': '2024-05-20T18:00:43.911924+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911924+0000', 'last_undegraded': '2024-05-20T18:00:43.911924+0000', 'last_fullsized': '2024-05-20T18:00:43.911924+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.915220+0000', 'last_change': '2024-05-20T18:00:43.915220+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.915220+0000', 'last_undegraded': '2024-05-20T18:00:43.915220+0000', 'last_fullsized': '2024-05-20T18:00:43.915220+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913377+0000', 'last_change': '2024-05-20T18:00:43.913377+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913377+0000', 'last_undegraded': '2024-05-20T18:00:43.913377+0000', 'last_fullsized': '2024-05-20T18:00:43.913377+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911312+0000', 'last_change': '2024-05-20T18:00:43.911312+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911312+0000', 'last_undegraded': '2024-05-20T18:00:43.911312+0000', 'last_fullsized': '2024-05-20T18:00:43.911312+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2024-05-20T18:00:49.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911380+0000', 'last_change': '2024-05-20T18:00:43.911380+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911380+0000', 'last_undegraded': '2024-05-20T18:00:43.911380+0000', 'last_fullsized': '2024-05-20T18:00:43.911380+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910725+0000', 'last_change': '2024-05-20T18:00:43.910725+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910725+0000', 'last_undegraded': '2024-05-20T18:00:43.910725+0000', 'last_fullsized': '2024-05-20T18:00:43.910725+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912812+0000', 'last_change': '2024-05-20T18:00:43.912812+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912812+0000', 'last_undegraded': '2024-05-20T18:00:43.912812+0000', 'last_fullsized': '2024-05-20T18:00:43.912812+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913322+0000', 'last_change': '2024-05-20T18:00:43.913322+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913322+0000', 'last_undegraded': '2024-05-20T18:00:43.913322+0000', 'last_fullsized': '2024-05-20T18:00:43.913322+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911319+0000', 'last_change': '2024-05-20T18:00:43.911319+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911319+0000', 'last_undegraded': '2024-05-20T18:00:43.911319+0000', 'last_fullsized': '2024-05-20T18:00:43.911319+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910218+0000', 'last_change': '2024-05-20T18:00:43.910218+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910218+0000', 'last_undegraded': '2024-05-20T18:00:43.910218+0000', 'last_fullsized': '2024-05-20T18:00:43.910218+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.907103+0000', 'last_change': '2024-05-20T18:00:43.907103+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.907103+0000', 'last_undegraded': '2024-05-20T18:00:43.907103+0000', 'last_fullsized': '2024-05-20T18:00:43.907103+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.913729+0000', 'last_change': '2024-05-20T18:00:43.913729+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.913729+0000', 'last_undegraded': '2024-05-20T18:00:43.913729+0000', 'last_fullsized': '2024-05-20T18:00:43.913729+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910185+0000', 'last_change': '2024-05-20T18:00:43.910185+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910185+0000', 'last_undegraded': '2024-05-20T18:00:43.910185+0000', 'last_fullsized': '2024-05-20T18:00:43.910185+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.911141+0000', 'last_change': '2024-05-20T18:00:43.911141+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.911141+0000', 'last_undegraded': '2024-05-20T18:00:43.911141+0000', 'last_fullsized': '2024-05-20T18:00:43.911141+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910272+0000', 'last_change': '2024-05-20T18:00:43.910272+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910272+0000', 'last_undegraded': '2024-05-20T18:00:43.910272+0000', 'last_fullsized': '2024-05-20T18:00:43.910272+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910857+0000', 'last_change': '2024-05-20T18:00:43.910857+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910857+0000', 'last_undegraded': '2024-05-20T18:00:43.910857+0000', 'last_fullsized': '2024-05-20T18:00:43.910857+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910566+0000', 'last_change': '2024-05-20T18:00:43.910566+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910566+0000', 'last_undegraded': '2024-05-20T18:00:43.910566+0000', 'last_fullsized': '2024-05-20T18:00:43.910566+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912308+0000', 'last_change': '2024-05-20T18:00:43.912308+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912308+0000', 'last_undegraded': '2024-05-20T18:00:43.912308+0000', 'last_fullsized': '2024-05-20T18:00:43.912308+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912240+0000', 'last_change': '2024-05-20T18:00:43.912240+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912240+0000', 'last_undegraded': '2024-05-20T18:00:43.912240+0000', 'last_fullsized': '2024-05-20T18:00:43.912240+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912612+0000', 'last_change': '2024-05-20T18:00:43.912612+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912612+0000', 'last_undegraded': '2024-05-20T18:00:43.912612+0000', 'last_fullsized': '2024-05-20T18:00:43.912612+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910854+0000', 'last_change': '2024-05-20T18:00:43.910854+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910854+0000', 'last_undegraded': '2024-05-20T18:00:43.910854+0000', 'last_fullsized': '2024-05-20T18:00:43.910854+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.910549+0000', 'last_change': '2024-05-20T18:00:43.910549+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.910549+0000', 'last_undegraded': '2024-05-20T18:00:43.910549+0000', 'last_fullsized': '2024-05-20T18:00:43.910549+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-20T18:00:49.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2024-05-20T18:00:49.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.909530+0000', 'last_change': '2024-05-20T18:00:43.909530+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.909530+0000', 'last_undegraded': '2024-05-20T18:00:43.909530+0000', 'last_fullsized': '2024-05-20T18:00:43.909530+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-20T18:00:49.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2024-05-20T18:00:49.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912136+0000', 'last_change': '2024-05-20T18:00:43.912136+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912136+0000', 'last_undegraded': '2024-05-20T18:00:43.912136+0000', 'last_fullsized': '2024-05-20T18:00:43.912136+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T18:00:49.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2024-05-20T18:00:49.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.914702+0000', 'last_change': '2024-05-20T18:00:43.914702+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.914702+0000', 'last_undegraded': '2024-05-20T18:00:43.914702+0000', 'last_fullsized': '2024-05-20T18:00:43.914702+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-20T18:00:49.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2024-05-20T18:00:49.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2024-05-20T18:00:43.912812+0000', 'last_change': '2024-05-20T18:00:43.912812+0000', 'last_active': '2024-05-20T18:00:43.897434+0000', 'last_peered': '2024-05-20T18:00:43.897434+0000', 'last_clean': '2024-05-20T18:00:43.897434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-20T18:00:43.912812+0000', 'last_undegraded': '2024-05-20T18:00:43.912812+0000', 'last_fullsized': '2024-05-20T18:00:43.912812+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'last_clean_scrub_stamp': '2024-05-20T18:00:43.897434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-20T18:00:49.742 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-20T18:00:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.883+0000 7ff588e26640 1 Processor -- start 2024-05-20T18:00:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.883+0000 7ff588e26640 1 -- start start 2024-05-20T18:00:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff588e26640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff5840b4070 0x7ff5840ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff588e26640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5840d0560 0x7ff58406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff588e26640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff58406dd20 con 0x7ff58406d910 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff588e26640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff5840b8490 con 0x7ff5840d0560 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff588e26640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff58415fa90 con 0x7ff5840b4070 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff581d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5840d0560 0x7ff58406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff582d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff58406d910 0x7ff5840d27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54268/0 (socket says 172.21.15.6:54268) 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff581d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5840d0560 0x7ff58406d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49496/0 (socket says 172.21.15.6:49496) 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff582d9d640 1 -- 172.21.15.6:0/2876127197 learned_addr learned my addr 172.21.15.6:0/2876127197 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff58259c640 1 --2- 172.21.15.6:0/2876127197 >> v2:172.21.15.171:3300/0 conn(0x7ff5840b4070 0x7ff5840ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff581d9b640 1 -- 172.21.15.6:0/2876127197 >> v2:172.21.15.171:3300/0 conn(0x7ff5840b4070 msgr2=0x7ff5840ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff581d9b640 1 --2- 172.21.15.6:0/2876127197 >> v2:172.21.15.171:3300/0 conn(0x7ff5840b4070 0x7ff5840ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff581d9b640 1 -- 172.21.15.6:0/2876127197 >> v1:172.21.15.6:6789/0 conn(0x7ff58406d910 legacy=0x7ff5840d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff581d9b640 1 -- 172.21.15.6:0/2876127197 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5840d3f00 con 0x7ff5840d0560 2024-05-20T18:00:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.885+0000 7ff58159a640 1 -- 172.21.15.6:0/2876127197 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152604793 0 0) 0x7ff57c001490 con 0x7ff58406d910 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.886+0000 7ff581d9b640 1 --2- 172.21.15.6:0/2876127197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840d0560 0x7ff58406d3d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ff58408d250 tx=0x7ff57802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2936fefd8e621b5a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.886+0000 7ff58159a640 1 -- 172.21.15.6:0/2876127197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578037070 con 0x7ff5840d0560 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.886+0000 7ff58159a640 1 -- 172.21.15.6:0/2876127197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff578032440 con 0x7ff5840d0560 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.886+0000 7ff58159a640 1 -- 172.21.15.6:0/2876127197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57802ae60 con 0x7ff5840d0560 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.887+0000 7ff588e26640 1 -- 172.21.15.6:0/2876127197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840d0560 msgr2=0x7ff58406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.887+0000 7ff588e26640 1 --2- 172.21.15.6:0/2876127197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840d0560 0x7ff58406d3d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ff58408d250 tx=0x7ff57802a110 comp rx=0 tx=0).stop 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.887+0000 7ff588e26640 1 -- 172.21.15.6:0/2876127197 shutdown_connections 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.887+0000 7ff588e26640 1 --2- 172.21.15.6:0/2876127197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840d0560 0x7ff58406d3d0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.887+0000 7ff588e26640 1 --2- 172.21.15.6:0/2876127197 >> v2:172.21.15.171:3300/0 conn(0x7ff5840b4070 0x7ff5840ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.887+0000 7ff588e26640 1 -- 172.21.15.6:0/2876127197 >> 172.21.15.6:0/2876127197 conn(0x7ff5840d4c10 msgr2=0x7ff5840d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.887+0000 7ff588e26640 1 -- 172.21.15.6:0/2876127197 shutdown_connections 2024-05-20T18:00:49.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.887+0000 7ff588e26640 1 -- 172.21.15.6:0/2876127197 wait complete. 2024-05-20T18:00:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.889+0000 7ff588e26640 1 Processor -- start 2024-05-20T18:00:49.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.889+0000 7ff588e26640 1 -- start start 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.890+0000 7ff588e26640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff58406d910 0x7ff5840c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.890+0000 7ff588e26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840b4070 0x7ff5840ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff588e26640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5840d0560 0x7ff58415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff588e26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5840d47a0 con 0x7ff5840b4070 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff588e26640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5840d44c0 con 0x7ff58406d910 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff588e26640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5840bab00 con 0x7ff5840d0560 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840b4070 0x7ff5840ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840b4070 0x7ff5840ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49500/0 (socket says 172.21.15.6:49500) 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 -- 172.21.15.6:0/4284428253 learned_addr learned my addr 172.21.15.6:0/4284428253 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff58259c640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff58406d910 0x7ff5840c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 -- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5840d0560 msgr2=0x7ff58415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff582d9d640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5840d0560 0x7ff58415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5840d0560 0x7ff58415eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 -- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff58406d910 msgr2=0x7ff5840c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff58406d910 0x7ff5840c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 -- 172.21.15.6:0/4284428253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5840c9260 con 0x7ff5840b4070 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff581d9b640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840b4070 0x7ff5840ab810 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7ff578000c00 tx=0x7ff5780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff572ffd640 1 -- 172.21.15.6:0/4284428253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578037040 con 0x7ff5840b4070 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff572ffd640 1 -- 172.21.15.6:0/4284428253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff578042070 con 0x7ff5840b4070 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5840abd50 con 0x7ff5840b4070 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.891+0000 7ff572ffd640 1 -- 172.21.15.6:0/4284428253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578030bd0 con 0x7ff5840b4070 2024-05-20T18:00:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.892+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58414ea20 con 0x7ff5840b4070 2024-05-20T18:00:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.893+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5840690b0 con 0x7ff5840b4070 2024-05-20T18:00:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.893+0000 7ff572ffd640 1 -- 172.21.15.6:0/4284428253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff578047460 con 0x7ff5840b4070 2024-05-20T18:00:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.893+0000 7ff572ffd640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff56406be30 0x7ff56406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.894+0000 7ff572ffd640 1 -- 172.21.15.6:0/4284428253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7ff5780abb00 con 0x7ff5840b4070 2024-05-20T18:00:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.894+0000 7ff58259c640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff56406be30 0x7ff56406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:49.893 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-05-20T18:00:49.894+0000 7fc2db404640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T18:00:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.894+0000 7ff58259c640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff56406be30 0x7ff56406e340 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff574006fd0 tx=0x7ff574008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:49.898+0000 7ff572ffd640 1 -- 172.21.15.6:0/4284428253 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff578032e20 con 0x7ff5840b4070 2024-05-20T18:00:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.152+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff5840b6680 con 0x7ff5840b4070 2024-05-20T18:00:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.153+0000 7ff572ffd640 1 -- 172.21.15.6:0/4284428253 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1455 (secure 0 0 0) 0x7ff57807a320 con 0x7ff5840b4070 2024-05-20T18:00:50.151 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:50.151 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":488,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1716227573,"num_in_osds":8,"osd_in_since":1716227564,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":267624448,"bytes_avail":772826488832,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":74,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8118}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-05-20T18:00:32.349438+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-20T18:00:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff56406be30 msgr2=0x7ff56406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff56406be30 0x7ff56406e340 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff574006fd0 tx=0x7ff574008040 comp rx=0 tx=0).stop 2024-05-20T18:00:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840b4070 msgr2=0x7ff5840ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840b4070 0x7ff5840ab810 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7ff578000c00 tx=0x7ff5780046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 shutdown_connections 2024-05-20T18:00:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff56406be30 0x7ff56406e340 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5840d0560 0x7ff58415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5840b4070 0x7ff5840ab810 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 --2- 172.21.15.6:0/4284428253 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff58406d910 0x7ff5840c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 >> 172.21.15.6:0/4284428253 conn(0x7ff5840d4c10 msgr2=0x7ff5840b6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 shutdown_connections 2024-05-20T18:00:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.155+0000 7ff588e26640 1 -- 172.21.15.6:0/4284428253 wait complete. 2024-05-20T18:00:50.164 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-20T18:00:50.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:00:50.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.281+0000 7feda272f640 1 Processor -- start 2024-05-20T18:00:50.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.281+0000 7feda272f640 1 -- start start 2024-05-20T18:00:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.282+0000 7feda272f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed9c15f460 0x7fed9c0d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.282+0000 7feda272f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed9c0d0550 con 0x7fed9c0b6d90 2024-05-20T18:00:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.282+0000 7feda272f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed9c0d0830 con 0x7fed9c0cf250 2024-05-20T18:00:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.282+0000 7feda272f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fed9c0d0b10 con 0x7fed9c15f460 2024-05-20T18:00:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.282+0000 7feda0ccc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed9c15f460 0x7fed9c0d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.283+0000 7fed93fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed9c0b6d90 0x7fed9c0d3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54274/0 (socket says 172.21.15.6:54274) 2024-05-20T18:00:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.283+0000 7fed93fff640 1 -- 172.21.15.6:0/3994030069 learned_addr learned my addr 172.21.15.6:0/3994030069 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:50.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.283+0000 7feda0ccc640 1 -- 172.21.15.6:0/3994030069 >> v1:172.21.15.171:6789/0 conn(0x7fed9c0cf250 legacy=0x7fed9c0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.283+0000 7feda0ccc640 1 -- 172.21.15.6:0/3994030069 >> v1:172.21.15.6:6789/0 conn(0x7fed9c0b6d90 legacy=0x7fed9c0d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.283+0000 7feda0ccc640 1 -- 172.21.15.6:0/3994030069 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c0d2a20 con 0x7fed9c15f460 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.284+0000 7feda0ccc640 1 --2- 172.21.15.6:0/3994030069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c0d3930 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fed94009d90 tx=0x7fed9402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bd74d2138d9bbd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.284+0000 7fed9b7fe640 1 -- 172.21.15.6:0/3994030069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94007740 con 0x7fed9c15f460 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.284+0000 7fed9b7fe640 1 -- 172.21.15.6:0/3994030069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed940078e0 con 0x7fed9c15f460 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.284+0000 7fed9b7fe640 1 -- 172.21.15.6:0/3994030069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94007cb0 con 0x7fed9c15f460 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.284+0000 7feda272f640 1 -- 172.21.15.6:0/3994030069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 msgr2=0x7fed9c0d3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.284+0000 7feda272f640 1 --2- 172.21.15.6:0/3994030069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c0d3930 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fed94009d90 tx=0x7fed9402a6f0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.285+0000 7feda272f640 1 -- 172.21.15.6:0/3994030069 shutdown_connections 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.285+0000 7feda272f640 1 --2- 172.21.15.6:0/3994030069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c0d3930 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.285+0000 7feda272f640 1 -- 172.21.15.6:0/3994030069 >> 172.21.15.6:0/3994030069 conn(0x7fed9c0d1860 msgr2=0x7fed9c0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.285+0000 7feda272f640 1 -- 172.21.15.6:0/3994030069 shutdown_connections 2024-05-20T18:00:50.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.285+0000 7feda272f640 1 -- 172.21.15.6:0/3994030069 wait complete. 2024-05-20T18:00:50.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.286+0000 7feda272f640 1 Processor -- start 2024-05-20T18:00:50.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.286+0000 7feda272f640 1 -- start start 2024-05-20T18:00:50.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7feda272f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed9c0cf250 0x7fed9c149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:50.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7feda272f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:50.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7feda272f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed9c1f5750 0x7fed9c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:50.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7feda272f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c15f870 con 0x7fed9c15f460 2024-05-20T18:00:50.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7feda272f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fed9c0d27d0 con 0x7fed9c1f5750 2024-05-20T18:00:50.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7feda272f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fed9c0d0140 con 0x7fed9c0cf250 2024-05-20T18:00:50.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:50.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49516/0 (socket says 172.21.15.6:49516) 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 -- 172.21.15.6:0/4029924494 learned_addr learned my addr 172.21.15.6:0/4029924494 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed9bfff640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed9c0cf250 0x7fed9c149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7feda0ccc640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed9c1f5750 0x7fed9c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 -- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed9c0cf250 msgr2=0x7fed9c149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed9c0cf250 0x7fed9c149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 -- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed9c1f5750 msgr2=0x7fed9c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed9c1f5750 0x7fed9c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 -- 172.21.15.6:0/4029924494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9c154f80 con 0x7fed9c15f460 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed93fff640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c154a40 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fed8400c480 tx=0x7fed8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.288+0000 7fed997fa640 1 -- 172.21.15.6:0/4029924494 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84017070 con 0x7fed9c15f460 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.289+0000 7fed997fa640 1 -- 172.21.15.6:0/4029924494 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed84005ce0 con 0x7fed9c15f460 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.289+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9c1573a0 con 0x7fed9c15f460 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.289+0000 7fed997fa640 1 -- 172.21.15.6:0/4029924494 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840072f0 con 0x7fed9c15f460 2024-05-20T18:00:50.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.289+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9c157960 con 0x7fed9c15f460 2024-05-20T18:00:50.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.290+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9c073080 con 0x7fed9c15f460 2024-05-20T18:00:50.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.290+0000 7fed997fa640 1 -- 172.21.15.6:0/4029924494 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed8401a070 con 0x7fed9c15f460 2024-05-20T18:00:50.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.291+0000 7fed997fa640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed7c06be30 0x7fed7c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:50.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.291+0000 7fed997fa640 1 -- 172.21.15.6:0/4029924494 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fed8408a220 con 0x7fed9c15f460 2024-05-20T18:00:50.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.291+0000 7fed9bfff640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed7c06be30 0x7fed7c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:50.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.292+0000 7fed9bfff640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed7c06be30 0x7fed7c06e340 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fed8c000f60 tx=0x7fed8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:50.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.296+0000 7fed997fa640 1 -- 172.21.15.6:0/4029924494 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fed9c073080 con 0x7fed9c15f460 2024-05-20T18:00:50.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.478+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed9c075b00 con 0x7fed7c06be30 2024-05-20T18:00:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.485+0000 7fed997fa640 1 -- 172.21.15.6:0/4029924494 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252488 (secure 0 0 0) 0x7fed9c075b00 con 0x7fed7c06be30 2024-05-20T18:00:50.485 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:50.486 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed7c06be30 msgr2=0x7fed7c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed7c06be30 0x7fed7c06e340 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fed8c000f60 tx=0x7fed8c009040 comp rx=0 tx=0).stop 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 msgr2=0x7fed9c154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c154a40 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fed8400c480 tx=0x7fed8400c940 comp rx=0 tx=0).stop 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 shutdown_connections 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed7c06be30 0x7fed7c06e340 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed9c1f5750 0x7fed9c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed9c15f460 0x7fed9c154a40 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 --2- 172.21.15.6:0/4029924494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed9c0cf250 0x7fed9c149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 >> 172.21.15.6:0/4029924494 conn(0x7fed9c0d1860 msgr2=0x7fed9c067490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 shutdown_connections 2024-05-20T18:00:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:50.488+0000 7feda272f640 1 -- 172.21.15.6:0/4029924494 wait complete. 2024-05-20T18:00:50.497 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-05-20T18:00:50.353539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261716,"kb_used_data":12232,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713004,"statfs":{"total":773094113280,"available":772826116096,"internally_reserved":0,"allocated":12525568,"data_stored":6397884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.448689"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924159+0000","last_change":"2024-05-20T18:00:44.920242+0000","last_active":"2024-05-20T18:00:45.924159+0000","last_peered":"2024-05-20T18:00:45.924159+0000","last_clean":"2024-05-20T18:00:45.924159+0000","last_became_active":"2024-05-20T18:00:44.919765+0000","last_became_peered":"2024-05-20T18:00:44.919765+0000","last_unstale":"2024-05-20T18:00:45.924159+0000","last_undegraded":"2024-05-20T18:00:45.924159+0000","last_fullsized":"2024-05-20T18:00:45.924159+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:48.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923473+0000","last_change":"2024-05-20T18:00:44.937796+0000","last_active":"2024-05-20T18:00:45.923473+0000","last_peered":"2024-05-20T18:00:45.923473+0000","last_clean":"2024-05-20T18:00:45.923473+0000","last_became_active":"2024-05-20T18:00:44.933194+0000","last_became_peered":"2024-05-20T18:00:44.933194+0000","last_unstale":"2024-05-20T18:00:45.923473+0000","last_undegraded":"2024-05-20T18:00:45.923473+0000","last_fullsized":"2024-05-20T18:00:45.923473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:51.054710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923580+0000","last_change":"2024-05-20T18:00:44.929695+0000","last_active":"2024-05-20T18:00:45.923580+0000","last_peered":"2024-05-20T18:00:45.923580+0000","last_clean":"2024-05-20T18:00:45.923580+0000","last_became_active":"2024-05-20T18:00:44.929329+0000","last_became_peered":"2024-05-20T18:00:44.929329+0000","last_unstale":"2024-05-20T18:00:45.923580+0000","last_undegraded":"2024-05-20T18:00:45.923580+0000","last_fullsized":"2024-05-20T18:00:45.923580+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:35.503499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830670+0000","last_change":"2024-05-20T18:00:44.934983+0000","last_active":"2024-05-20T18:00:46.830670+0000","last_peered":"2024-05-20T18:00:46.830670+0000","last_clean":"2024-05-20T18:00:46.830670+0000","last_became_active":"2024-05-20T18:00:44.933725+0000","last_became_peered":"2024-05-20T18:00:44.933725+0000","last_unstale":"2024-05-20T18:00:46.830670+0000","last_undegraded":"2024-05-20T18:00:46.830670+0000","last_fullsized":"2024-05-20T18:00:46.830670+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:26:14.353409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923841+0000","last_change":"2024-05-20T18:00:44.923676+0000","last_active":"2024-05-20T18:00:45.923841+0000","last_peered":"2024-05-20T18:00:45.923841+0000","last_clean":"2024-05-20T18:00:45.923841+0000","last_became_active":"2024-05-20T18:00:44.923350+0000","last_became_peered":"2024-05-20T18:00:44.923350+0000","last_unstale":"2024-05-20T18:00:45.923841+0000","last_undegraded":"2024-05-20T18:00:45.923841+0000","last_fullsized":"2024-05-20T18:00:45.923841+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:46.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930950+0000","last_change":"2024-05-20T18:00:44.935789+0000","last_active":"2024-05-20T18:00:45.930950+0000","last_peered":"2024-05-20T18:00:45.930950+0000","last_clean":"2024-05-20T18:00:45.930950+0000","last_became_active":"2024-05-20T18:00:44.935456+0000","last_became_peered":"2024-05-20T18:00:44.935456+0000","last_unstale":"2024-05-20T18:00:45.930950+0000","last_undegraded":"2024-05-20T18:00:45.930950+0000","last_fullsized":"2024-05-20T18:00:45.930950+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:08.508132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930798+0000","last_change":"2024-05-20T18:00:44.935560+0000","last_active":"2024-05-20T18:00:45.930798+0000","last_peered":"2024-05-20T18:00:45.930798+0000","last_clean":"2024-05-20T18:00:45.930798+0000","last_became_active":"2024-05-20T18:00:44.935192+0000","last_became_peered":"2024-05-20T18:00:44.935192+0000","last_unstale":"2024-05-20T18:00:45.930798+0000","last_undegraded":"2024-05-20T18:00:45.930798+0000","last_fullsized":"2024-05-20T18:00:45.930798+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:47:16.088741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.922790+0000","last_change":"2024-05-20T18:00:44.927415+0000","last_active":"2024-05-20T18:00:45.922790+0000","last_peered":"2024-05-20T18:00:45.922790+0000","last_clean":"2024-05-20T18:00:45.922790+0000","last_became_active":"2024-05-20T18:00:44.927080+0000","last_became_peered":"2024-05-20T18:00:44.927080+0000","last_unstale":"2024-05-20T18:00:45.922790+0000","last_undegraded":"2024-05-20T18:00:45.922790+0000","last_fullsized":"2024-05-20T18:00:45.922790+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:51:18.647992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831201+0000","last_change":"2024-05-20T18:00:44.942769+0000","last_active":"2024-05-20T18:00:46.831201+0000","last_peered":"2024-05-20T18:00:46.831201+0000","last_clean":"2024-05-20T18:00:46.831201+0000","last_became_active":"2024-05-20T18:00:44.942450+0000","last_became_peered":"2024-05-20T18:00:44.942450+0000","last_unstale":"2024-05-20T18:00:46.831201+0000","last_undegraded":"2024-05-20T18:00:46.831201+0000","last_fullsized":"2024-05-20T18:00:46.831201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:11.722882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211473+0000","last_change":"2024-05-20T18:00:44.923652+0000","last_active":"2024-05-20T18:00:46.211473+0000","last_peered":"2024-05-20T18:00:46.211473+0000","last_clean":"2024-05-20T18:00:46.211473+0000","last_became_active":"2024-05-20T18:00:44.923299+0000","last_became_peered":"2024-05-20T18:00:44.923299+0000","last_unstale":"2024-05-20T18:00:46.211473+0000","last_undegraded":"2024-05-20T18:00:46.211473+0000","last_fullsized":"2024-05-20T18:00:46.211473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:46.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923886+0000","last_change":"2024-05-20T18:00:44.923183+0000","last_active":"2024-05-20T18:00:45.923886+0000","last_peered":"2024-05-20T18:00:45.923886+0000","last_clean":"2024-05-20T18:00:45.923886+0000","last_became_active":"2024-05-20T18:00:44.917663+0000","last_became_peered":"2024-05-20T18:00:44.917663+0000","last_unstale":"2024-05-20T18:00:45.923886+0000","last_undegraded":"2024-05-20T18:00:45.923886+0000","last_fullsized":"2024-05-20T18:00:45.923886+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:20.677290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931303+0000","last_change":"2024-05-20T18:00:44.928582+0000","last_active":"2024-05-20T18:00:45.931303+0000","last_peered":"2024-05-20T18:00:45.931303+0000","last_clean":"2024-05-20T18:00:45.931303+0000","last_became_active":"2024-05-20T18:00:44.928258+0000","last_became_peered":"2024-05-20T18:00:44.928258+0000","last_unstale":"2024-05-20T18:00:45.931303+0000","last_undegraded":"2024-05-20T18:00:45.931303+0000","last_fullsized":"2024-05-20T18:00:45.931303+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:36:39.610784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211369+0000","last_change":"2024-05-20T18:00:44.920074+0000","last_active":"2024-05-20T18:00:46.211369+0000","last_peered":"2024-05-20T18:00:46.211369+0000","last_clean":"2024-05-20T18:00:46.211369+0000","last_became_active":"2024-05-20T18:00:44.919736+0000","last_became_peered":"2024-05-20T18:00:44.919736+0000","last_unstale":"2024-05-20T18:00:46.211369+0000","last_undegraded":"2024-05-20T18:00:46.211369+0000","last_fullsized":"2024-05-20T18:00:46.211369+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:58.036101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923175+0000","last_change":"2024-05-20T18:00:44.924576+0000","last_active":"2024-05-20T18:00:45.923175+0000","last_peered":"2024-05-20T18:00:45.923175+0000","last_clean":"2024-05-20T18:00:45.923175+0000","last_became_active":"2024-05-20T18:00:44.923970+0000","last_became_peered":"2024-05-20T18:00:44.923970+0000","last_unstale":"2024-05-20T18:00:45.923175+0000","last_undegraded":"2024-05-20T18:00:45.923175+0000","last_fullsized":"2024-05-20T18:00:45.923175+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:47.088602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923577+0000","last_change":"2024-05-20T18:00:44.917217+0000","last_active":"2024-05-20T18:00:45.923577+0000","last_peered":"2024-05-20T18:00:45.923577+0000","last_clean":"2024-05-20T18:00:45.923577+0000","last_became_active":"2024-05-20T18:00:44.916821+0000","last_became_peered":"2024-05-20T18:00:44.916821+0000","last_unstale":"2024-05-20T18:00:45.923577+0000","last_undegraded":"2024-05-20T18:00:45.923577+0000","last_fullsized":"2024-05-20T18:00:45.923577+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:11.363890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930787+0000","last_change":"2024-05-20T18:00:44.926664+0000","last_active":"2024-05-20T18:00:45.930787+0000","last_peered":"2024-05-20T18:00:45.930787+0000","last_clean":"2024-05-20T18:00:45.930787+0000","last_became_active":"2024-05-20T18:00:44.926280+0000","last_became_peered":"2024-05-20T18:00:44.926280+0000","last_unstale":"2024-05-20T18:00:45.930787+0000","last_undegraded":"2024-05-20T18:00:45.930787+0000","last_fullsized":"2024-05-20T18:00:45.930787+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:25:57.239121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211691+0000","last_change":"2024-05-20T18:00:44.917312+0000","last_active":"2024-05-20T18:00:46.211691+0000","last_peered":"2024-05-20T18:00:46.211691+0000","last_clean":"2024-05-20T18:00:46.211691+0000","last_became_active":"2024-05-20T18:00:44.916815+0000","last_became_peered":"2024-05-20T18:00:44.916815+0000","last_unstale":"2024-05-20T18:00:46.211691+0000","last_undegraded":"2024-05-20T18:00:46.211691+0000","last_fullsized":"2024-05-20T18:00:46.211691+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:38:04.273979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923429+0000","last_change":"2024-05-20T18:00:44.937792+0000","last_active":"2024-05-20T18:00:45.923429+0000","last_peered":"2024-05-20T18:00:45.923429+0000","last_clean":"2024-05-20T18:00:45.923429+0000","last_became_active":"2024-05-20T18:00:44.933713+0000","last_became_peered":"2024-05-20T18:00:44.933713+0000","last_unstale":"2024-05-20T18:00:45.923429+0000","last_undegraded":"2024-05-20T18:00:45.923429+0000","last_fullsized":"2024-05-20T18:00:45.923429+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:45.621039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929107+0000","last_change":"2024-05-20T18:00:44.932131+0000","last_active":"2024-05-20T18:00:45.929107+0000","last_peered":"2024-05-20T18:00:45.929107+0000","last_clean":"2024-05-20T18:00:45.929107+0000","last_became_active":"2024-05-20T18:00:44.931804+0000","last_became_peered":"2024-05-20T18:00:44.931804+0000","last_unstale":"2024-05-20T18:00:45.929107+0000","last_undegraded":"2024-05-20T18:00:45.929107+0000","last_fullsized":"2024-05-20T18:00:45.929107+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:53:10.515388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924072+0000","last_change":"2024-05-20T18:00:44.936644+0000","last_active":"2024-05-20T18:00:45.924072+0000","last_peered":"2024-05-20T18:00:45.924072+0000","last_clean":"2024-05-20T18:00:45.924072+0000","last_became_active":"2024-05-20T18:00:44.936256+0000","last_became_peered":"2024-05-20T18:00:44.936256+0000","last_unstale":"2024-05-20T18:00:45.924072+0000","last_undegraded":"2024-05-20T18:00:45.924072+0000","last_fullsized":"2024-05-20T18:00:45.924072+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:39:08.640208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830793+0000","last_change":"2024-05-20T18:00:44.939447+0000","last_active":"2024-05-20T18:00:46.830793+0000","last_peered":"2024-05-20T18:00:46.830793+0000","last_clean":"2024-05-20T18:00:46.830793+0000","last_became_active":"2024-05-20T18:00:44.938961+0000","last_became_peered":"2024-05-20T18:00:44.938961+0000","last_unstale":"2024-05-20T18:00:46.830793+0000","last_undegraded":"2024-05-20T18:00:46.830793+0000","last_fullsized":"2024-05-20T18:00:46.830793+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:28:15.000086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923762+0000","last_change":"2024-05-20T18:00:44.934618+0000","last_active":"2024-05-20T18:00:45.923762+0000","last_peered":"2024-05-20T18:00:45.923762+0000","last_clean":"2024-05-20T18:00:45.923762+0000","last_became_active":"2024-05-20T18:00:44.934295+0000","last_became_peered":"2024-05-20T18:00:44.934295+0000","last_unstale":"2024-05-20T18:00:45.923762+0000","last_undegraded":"2024-05-20T18:00:45.923762+0000","last_fullsized":"2024-05-20T18:00:45.923762+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:06.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831199+0000","last_change":"2024-05-20T18:00:44.943024+0000","last_active":"2024-05-20T18:00:46.831199+0000","last_peered":"2024-05-20T18:00:46.831199+0000","last_clean":"2024-05-20T18:00:46.831199+0000","last_became_active":"2024-05-20T18:00:44.942696+0000","last_became_peered":"2024-05-20T18:00:44.942696+0000","last_unstale":"2024-05-20T18:00:46.831199+0000","last_undegraded":"2024-05-20T18:00:46.831199+0000","last_fullsized":"2024-05-20T18:00:46.831199+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:45.621039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830055+0000","last_change":"2024-05-20T18:00:44.923692+0000","last_active":"2024-05-20T18:00:46.830055+0000","last_peered":"2024-05-20T18:00:46.830055+0000","last_clean":"2024-05-20T18:00:46.830055+0000","last_became_active":"2024-05-20T18:00:44.923242+0000","last_became_peered":"2024-05-20T18:00:44.923242+0000","last_unstale":"2024-05-20T18:00:46.830055+0000","last_undegraded":"2024-05-20T18:00:46.830055+0000","last_fullsized":"2024-05-20T18:00:46.830055+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:58.036101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830870+0000","last_change":"2024-05-20T18:00:44.916983+0000","last_active":"2024-05-20T18:00:46.830870+0000","last_peered":"2024-05-20T18:00:46.830870+0000","last_clean":"2024-05-20T18:00:46.830870+0000","last_became_active":"2024-05-20T18:00:44.916680+0000","last_became_peered":"2024-05-20T18:00:44.916680+0000","last_unstale":"2024-05-20T18:00:46.830870+0000","last_undegraded":"2024-05-20T18:00:46.830870+0000","last_fullsized":"2024-05-20T18:00:46.830870+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:48.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924388+0000","last_change":"2024-05-20T18:00:44.930494+0000","last_active":"2024-05-20T18:00:45.924388+0000","last_peered":"2024-05-20T18:00:45.924388+0000","last_clean":"2024-05-20T18:00:45.924388+0000","last_became_active":"2024-05-20T18:00:44.930158+0000","last_became_peered":"2024-05-20T18:00:44.930158+0000","last_unstale":"2024-05-20T18:00:45.924388+0000","last_undegraded":"2024-05-20T18:00:45.924388+0000","last_fullsized":"2024-05-20T18:00:45.924388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:36.584652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929094+0000","last_change":"2024-05-20T18:00:44.930217+0000","last_active":"2024-05-20T18:00:45.929094+0000","last_peered":"2024-05-20T18:00:45.929094+0000","last_clean":"2024-05-20T18:00:45.929094+0000","last_became_active":"2024-05-20T18:00:44.929878+0000","last_became_peered":"2024-05-20T18:00:44.929878+0000","last_unstale":"2024-05-20T18:00:45.929094+0000","last_undegraded":"2024-05-20T18:00:45.929094+0000","last_fullsized":"2024-05-20T18:00:45.929094+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:33:23.198512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931355+0000","last_change":"2024-05-20T18:00:44.927007+0000","last_active":"2024-05-20T18:00:45.931355+0000","last_peered":"2024-05-20T18:00:45.931355+0000","last_clean":"2024-05-20T18:00:45.931355+0000","last_became_active":"2024-05-20T18:00:44.926024+0000","last_became_peered":"2024-05-20T18:00:44.926024+0000","last_unstale":"2024-05-20T18:00:45.931355+0000","last_undegraded":"2024-05-20T18:00:45.931355+0000","last_fullsized":"2024-05-20T18:00:45.931355+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:44:42.333825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923832+0000","last_change":"2024-05-20T18:00:44.936477+0000","last_active":"2024-05-20T18:00:45.923832+0000","last_peered":"2024-05-20T18:00:45.923832+0000","last_clean":"2024-05-20T18:00:45.923832+0000","last_became_active":"2024-05-20T18:00:44.936132+0000","last_became_peered":"2024-05-20T18:00:44.936132+0000","last_unstale":"2024-05-20T18:00:45.923832+0000","last_undegraded":"2024-05-20T18:00:45.923832+0000","last_fullsized":"2024-05-20T18:00:45.923832+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:14:49.935920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923365+0000","last_change":"2024-05-20T18:00:44.918124+0000","last_active":"2024-05-20T18:00:45.923365+0000","last_peered":"2024-05-20T18:00:45.923365+0000","last_clean":"2024-05-20T18:00:45.923365+0000","last_became_active":"2024-05-20T18:00:44.917788+0000","last_became_peered":"2024-05-20T18:00:44.917788+0000","last_unstale":"2024-05-20T18:00:45.923365+0000","last_undegraded":"2024-05-20T18:00:45.923365+0000","last_fullsized":"2024-05-20T18:00:45.923365+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:11.722882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830202+0000","last_change":"2024-05-20T18:00:44.925489+0000","last_active":"2024-05-20T18:00:46.830202+0000","last_peered":"2024-05-20T18:00:46.830202+0000","last_clean":"2024-05-20T18:00:46.830202+0000","last_became_active":"2024-05-20T18:00:44.925168+0000","last_became_peered":"2024-05-20T18:00:44.925168+0000","last_unstale":"2024-05-20T18:00:46.830202+0000","last_undegraded":"2024-05-20T18:00:46.830202+0000","last_fullsized":"2024-05-20T18:00:46.830202+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:46.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830072+0000","last_change":"2024-05-20T18:00:44.924291+0000","last_active":"2024-05-20T18:00:46.830072+0000","last_peered":"2024-05-20T18:00:46.830072+0000","last_clean":"2024-05-20T18:00:46.830072+0000","last_became_active":"2024-05-20T18:00:44.923959+0000","last_became_peered":"2024-05-20T18:00:44.923959+0000","last_unstale":"2024-05-20T18:00:46.830072+0000","last_undegraded":"2024-05-20T18:00:46.830072+0000","last_fullsized":"2024-05-20T18:00:46.830072+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:11.363890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211491+0000","last_change":"2024-05-20T18:00:44.930891+0000","last_active":"2024-05-20T18:00:46.211491+0000","last_peered":"2024-05-20T18:00:46.211491+0000","last_clean":"2024-05-20T18:00:46.211491+0000","last_became_active":"2024-05-20T18:00:44.930532+0000","last_became_peered":"2024-05-20T18:00:44.930532+0000","last_unstale":"2024-05-20T18:00:46.211491+0000","last_undegraded":"2024-05-20T18:00:46.211491+0000","last_fullsized":"2024-05-20T18:00:46.211491+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:20.677290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"112'4","reported_seq":18,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929029+0000","last_change":"2024-05-20T18:00:43.925402+0000","last_active":"2024-05-20T18:00:45.929029+0000","last_peered":"2024-05-20T18:00:45.929029+0000","last_clean":"2024-05-20T18:00:45.929029+0000","last_became_active":"2024-05-20T18:00:43.925134+0000","last_became_peered":"2024-05-20T18:00:43.925134+0000","last_unstale":"2024-05-20T18:00:45.929029+0000","last_undegraded":"2024-05-20T18:00:45.929029+0000","last_fullsized":"2024-05-20T18:00:45.929029+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:10.358119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931151+0000","last_change":"2024-05-20T18:00:44.934967+0000","last_active":"2024-05-20T18:00:45.931151+0000","last_peered":"2024-05-20T18:00:45.931151+0000","last_clean":"2024-05-20T18:00:45.931151+0000","last_became_active":"2024-05-20T18:00:44.934607+0000","last_became_peered":"2024-05-20T18:00:44.934607+0000","last_unstale":"2024-05-20T18:00:45.931151+0000","last_undegraded":"2024-05-20T18:00:45.931151+0000","last_fullsized":"2024-05-20T18:00:45.931151+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:16:31.989678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211423+0000","last_change":"2024-05-20T18:00:43.925970+0000","last_active":"2024-05-20T18:00:46.211423+0000","last_peered":"2024-05-20T18:00:46.211423+0000","last_clean":"2024-05-20T18:00:46.211423+0000","last_became_active":"2024-05-20T18:00:43.925355+0000","last_became_peered":"2024-05-20T18:00:43.925355+0000","last_unstale":"2024-05-20T18:00:46.211423+0000","last_undegraded":"2024-05-20T18:00:46.211423+0000","last_fullsized":"2024-05-20T18:00:46.211423+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:39.614458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830501+0000","last_change":"2024-05-20T18:00:44.916205+0000","last_active":"2024-05-20T18:00:46.830501+0000","last_peered":"2024-05-20T18:00:46.830501+0000","last_clean":"2024-05-20T18:00:46.830501+0000","last_became_active":"2024-05-20T18:00:44.915602+0000","last_became_peered":"2024-05-20T18:00:44.915602+0000","last_unstale":"2024-05-20T18:00:46.830501+0000","last_undegraded":"2024-05-20T18:00:46.830501+0000","last_fullsized":"2024-05-20T18:00:46.830501+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:20.677290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831373+0000","last_change":"2024-05-20T18:00:43.925185+0000","last_active":"2024-05-20T18:00:46.831373+0000","last_peered":"2024-05-20T18:00:46.831373+0000","last_clean":"2024-05-20T18:00:46.831373+0000","last_became_active":"2024-05-20T18:00:43.924852+0000","last_became_peered":"2024-05-20T18:00:43.924852+0000","last_unstale":"2024-05-20T18:00:46.831373+0000","last_undegraded":"2024-05-20T18:00:46.831373+0000","last_fullsized":"2024-05-20T18:00:46.831373+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:45.171175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831258+0000","last_change":"2024-05-20T18:00:44.939458+0000","last_active":"2024-05-20T18:00:46.831258+0000","last_peered":"2024-05-20T18:00:46.831258+0000","last_clean":"2024-05-20T18:00:46.831258+0000","last_became_active":"2024-05-20T18:00:44.938949+0000","last_became_peered":"2024-05-20T18:00:44.938949+0000","last_unstale":"2024-05-20T18:00:46.831258+0000","last_undegraded":"2024-05-20T18:00:46.831258+0000","last_fullsized":"2024-05-20T18:00:46.831258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:51.054710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211593+0000","last_change":"2024-05-20T18:00:43.921623+0000","last_active":"2024-05-20T18:00:46.211593+0000","last_peered":"2024-05-20T18:00:46.211593+0000","last_clean":"2024-05-20T18:00:46.211593+0000","last_became_active":"2024-05-20T18:00:43.921301+0000","last_became_peered":"2024-05-20T18:00:43.921301+0000","last_unstale":"2024-05-20T18:00:46.211593+0000","last_undegraded":"2024-05-20T18:00:46.211593+0000","last_fullsized":"2024-05-20T18:00:46.211593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:11.332273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211395+0000","last_change":"2024-05-20T18:00:44.929528+0000","last_active":"2024-05-20T18:00:46.211395+0000","last_peered":"2024-05-20T18:00:46.211395+0000","last_clean":"2024-05-20T18:00:46.211395+0000","last_became_active":"2024-05-20T18:00:44.929128+0000","last_became_peered":"2024-05-20T18:00:44.929128+0000","last_unstale":"2024-05-20T18:00:46.211395+0000","last_undegraded":"2024-05-20T18:00:46.211395+0000","last_fullsized":"2024-05-20T18:00:46.211395+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:11.363890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923778+0000","last_change":"2024-05-20T18:00:43.924910+0000","last_active":"2024-05-20T18:00:45.923778+0000","last_peered":"2024-05-20T18:00:45.923778+0000","last_clean":"2024-05-20T18:00:45.923778+0000","last_became_active":"2024-05-20T18:00:43.924572+0000","last_became_peered":"2024-05-20T18:00:43.924572+0000","last_unstale":"2024-05-20T18:00:45.923778+0000","last_undegraded":"2024-05-20T18:00:45.923778+0000","last_fullsized":"2024-05-20T18:00:45.923778+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:27.626337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923591+0000","last_change":"2024-05-20T18:00:44.926900+0000","last_active":"2024-05-20T18:00:45.923591+0000","last_peered":"2024-05-20T18:00:45.923591+0000","last_clean":"2024-05-20T18:00:45.923591+0000","last_became_active":"2024-05-20T18:00:44.926595+0000","last_became_peered":"2024-05-20T18:00:44.926595+0000","last_unstale":"2024-05-20T18:00:45.923591+0000","last_undegraded":"2024-05-20T18:00:45.923591+0000","last_fullsized":"2024-05-20T18:00:45.923591+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:05.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930927+0000","last_change":"2024-05-20T18:00:43.930892+0000","last_active":"2024-05-20T18:00:45.930927+0000","last_peered":"2024-05-20T18:00:45.930927+0000","last_clean":"2024-05-20T18:00:45.930927+0000","last_became_active":"2024-05-20T18:00:43.930513+0000","last_became_peered":"2024-05-20T18:00:43.930513+0000","last_unstale":"2024-05-20T18:00:45.930927+0000","last_undegraded":"2024-05-20T18:00:45.930927+0000","last_fullsized":"2024-05-20T18:00:45.930927+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:25:10.565986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923699+0000","last_change":"2024-05-20T18:00:44.916559+0000","last_active":"2024-05-20T18:00:45.923699+0000","last_peered":"2024-05-20T18:00:45.923699+0000","last_clean":"2024-05-20T18:00:45.923699+0000","last_became_active":"2024-05-20T18:00:44.916048+0000","last_became_peered":"2024-05-20T18:00:44.916048+0000","last_unstale":"2024-05-20T18:00:45.923699+0000","last_undegraded":"2024-05-20T18:00:45.923699+0000","last_fullsized":"2024-05-20T18:00:45.923699+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:01.059285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830223+0000","last_change":"2024-05-20T18:00:43.918574+0000","last_active":"2024-05-20T18:00:46.830223+0000","last_peered":"2024-05-20T18:00:46.830223+0000","last_clean":"2024-05-20T18:00:46.830223+0000","last_became_active":"2024-05-20T18:00:43.918240+0000","last_became_peered":"2024-05-20T18:00:43.918240+0000","last_unstale":"2024-05-20T18:00:46.830223+0000","last_undegraded":"2024-05-20T18:00:46.830223+0000","last_fullsized":"2024-05-20T18:00:46.830223+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:55.857139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211584+0000","last_change":"2024-05-20T18:00:44.920994+0000","last_active":"2024-05-20T18:00:46.211584+0000","last_peered":"2024-05-20T18:00:46.211584+0000","last_clean":"2024-05-20T18:00:46.211584+0000","last_became_active":"2024-05-20T18:00:44.920680+0000","last_became_peered":"2024-05-20T18:00:44.920680+0000","last_unstale":"2024-05-20T18:00:46.211584+0000","last_undegraded":"2024-05-20T18:00:46.211584+0000","last_fullsized":"2024-05-20T18:00:46.211584+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:48.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931017+0000","last_change":"2024-05-20T18:00:43.926835+0000","last_active":"2024-05-20T18:00:45.931017+0000","last_peered":"2024-05-20T18:00:45.931017+0000","last_clean":"2024-05-20T18:00:45.931017+0000","last_became_active":"2024-05-20T18:00:43.926506+0000","last_became_peered":"2024-05-20T18:00:43.926506+0000","last_unstale":"2024-05-20T18:00:45.931017+0000","last_undegraded":"2024-05-20T18:00:45.931017+0000","last_fullsized":"2024-05-20T18:00:45.931017+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:05:38.827350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.928902+0000","last_change":"2024-05-20T18:00:44.932589+0000","last_active":"2024-05-20T18:00:45.928902+0000","last_peered":"2024-05-20T18:00:45.928902+0000","last_clean":"2024-05-20T18:00:45.928902+0000","last_became_active":"2024-05-20T18:00:44.931832+0000","last_became_peered":"2024-05-20T18:00:44.931832+0000","last_unstale":"2024-05-20T18:00:45.928902+0000","last_undegraded":"2024-05-20T18:00:45.928902+0000","last_fullsized":"2024-05-20T18:00:45.928902+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:58.647361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929078+0000","last_change":"2024-05-20T18:00:43.930629+0000","last_active":"2024-05-20T18:00:45.929078+0000","last_peered":"2024-05-20T18:00:45.929078+0000","last_clean":"2024-05-20T18:00:45.929078+0000","last_became_active":"2024-05-20T18:00:43.930367+0000","last_became_peered":"2024-05-20T18:00:43.930367+0000","last_unstale":"2024-05-20T18:00:45.929078+0000","last_undegraded":"2024-05-20T18:00:45.929078+0000","last_fullsized":"2024-05-20T18:00:45.929078+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:05.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830464+0000","last_change":"2024-05-20T18:00:44.918619+0000","last_active":"2024-05-20T18:00:46.830464+0000","last_peered":"2024-05-20T18:00:46.830464+0000","last_clean":"2024-05-20T18:00:46.830464+0000","last_became_active":"2024-05-20T18:00:44.918215+0000","last_became_peered":"2024-05-20T18:00:44.918215+0000","last_unstale":"2024-05-20T18:00:46.830464+0000","last_undegraded":"2024-05-20T18:00:46.830464+0000","last_fullsized":"2024-05-20T18:00:46.830464+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:06.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830396+0000","last_change":"2024-05-20T18:00:43.922933+0000","last_active":"2024-05-20T18:00:46.830396+0000","last_peered":"2024-05-20T18:00:46.830396+0000","last_clean":"2024-05-20T18:00:46.830396+0000","last_became_active":"2024-05-20T18:00:43.922605+0000","last_became_peered":"2024-05-20T18:00:43.922605+0000","last_unstale":"2024-05-20T18:00:46.830396+0000","last_undegraded":"2024-05-20T18:00:46.830396+0000","last_fullsized":"2024-05-20T18:00:46.830396+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:11.332273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923594+0000","last_change":"2024-05-20T18:00:44.923952+0000","last_active":"2024-05-20T18:00:45.923594+0000","last_peered":"2024-05-20T18:00:45.923594+0000","last_clean":"2024-05-20T18:00:45.923594+0000","last_became_active":"2024-05-20T18:00:44.923583+0000","last_became_peered":"2024-05-20T18:00:44.923583+0000","last_unstale":"2024-05-20T18:00:45.923594+0000","last_undegraded":"2024-05-20T18:00:45.923594+0000","last_fullsized":"2024-05-20T18:00:45.923594+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:07:30.355693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"112'3","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830467+0000","last_change":"2024-05-20T18:00:43.920113+0000","last_active":"2024-05-20T18:00:46.830467+0000","last_peered":"2024-05-20T18:00:46.830467+0000","last_clean":"2024-05-20T18:00:46.830467+0000","last_became_active":"2024-05-20T18:00:43.919814+0000","last_became_peered":"2024-05-20T18:00:43.919814+0000","last_unstale":"2024-05-20T18:00:46.830467+0000","last_undegraded":"2024-05-20T18:00:46.830467+0000","last_fullsized":"2024-05-20T18:00:46.830467+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:39.614458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831148+0000","last_change":"2024-05-20T18:00:44.927489+0000","last_active":"2024-05-20T18:00:46.831148+0000","last_peered":"2024-05-20T18:00:46.831148+0000","last_clean":"2024-05-20T18:00:46.831148+0000","last_became_active":"2024-05-20T18:00:44.926695+0000","last_became_peered":"2024-05-20T18:00:44.926695+0000","last_unstale":"2024-05-20T18:00:46.831148+0000","last_undegraded":"2024-05-20T18:00:46.831148+0000","last_fullsized":"2024-05-20T18:00:46.831148+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:51.213003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"112'6","reported_seq":20,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923356+0000","last_change":"2024-05-20T18:00:43.918943+0000","last_active":"2024-05-20T18:00:45.923356+0000","last_peered":"2024-05-20T18:00:45.923356+0000","last_clean":"2024-05-20T18:00:45.923356+0000","last_became_active":"2024-05-20T18:00:43.918615+0000","last_became_peered":"2024-05-20T18:00:43.918615+0000","last_unstale":"2024-05-20T18:00:45.923356+0000","last_undegraded":"2024-05-20T18:00:45.923356+0000","last_fullsized":"2024-05-20T18:00:45.923356+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:34.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929136+0000","last_change":"2024-05-20T18:00:44.939810+0000","last_active":"2024-05-20T18:00:45.929136+0000","last_peered":"2024-05-20T18:00:45.929136+0000","last_clean":"2024-05-20T18:00:45.929136+0000","last_became_active":"2024-05-20T18:00:44.939483+0000","last_became_peered":"2024-05-20T18:00:44.939483+0000","last_unstale":"2024-05-20T18:00:45.929136+0000","last_undegraded":"2024-05-20T18:00:45.929136+0000","last_fullsized":"2024-05-20T18:00:45.929136+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:22:36.316845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923131+0000","last_change":"2024-05-20T18:00:43.916663+0000","last_active":"2024-05-20T18:00:45.923131+0000","last_peered":"2024-05-20T18:00:45.923131+0000","last_clean":"2024-05-20T18:00:45.923131+0000","last_became_active":"2024-05-20T18:00:43.916319+0000","last_became_peered":"2024-05-20T18:00:43.916319+0000","last_unstale":"2024-05-20T18:00:45.923131+0000","last_undegraded":"2024-05-20T18:00:45.923131+0000","last_fullsized":"2024-05-20T18:00:45.923131+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:57.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211440+0000","last_change":"2024-05-20T18:00:44.930600+0000","last_active":"2024-05-20T18:00:46.211440+0000","last_peered":"2024-05-20T18:00:46.211440+0000","last_clean":"2024-05-20T18:00:46.211440+0000","last_became_active":"2024-05-20T18:00:44.930139+0000","last_became_peered":"2024-05-20T18:00:44.930139+0000","last_unstale":"2024-05-20T18:00:46.211440+0000","last_undegraded":"2024-05-20T18:00:46.211440+0000","last_fullsized":"2024-05-20T18:00:46.211440+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:06.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923955+0000","last_change":"2024-05-20T18:00:43.919829+0000","last_active":"2024-05-20T18:00:45.923955+0000","last_peered":"2024-05-20T18:00:45.923955+0000","last_clean":"2024-05-20T18:00:45.923955+0000","last_became_active":"2024-05-20T18:00:43.919475+0000","last_became_peered":"2024-05-20T18:00:43.919475+0000","last_unstale":"2024-05-20T18:00:45.923955+0000","last_undegraded":"2024-05-20T18:00:45.923955+0000","last_fullsized":"2024-05-20T18:00:45.923955+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:05.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923901+0000","last_change":"2024-05-20T18:00:44.928456+0000","last_active":"2024-05-20T18:00:45.923901+0000","last_peered":"2024-05-20T18:00:45.923901+0000","last_clean":"2024-05-20T18:00:45.923901+0000","last_became_active":"2024-05-20T18:00:44.928118+0000","last_became_peered":"2024-05-20T18:00:44.928118+0000","last_unstale":"2024-05-20T18:00:45.923901+0000","last_undegraded":"2024-05-20T18:00:45.923901+0000","last_fullsized":"2024-05-20T18:00:45.923901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:56.185096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923154+0000","last_change":"2024-05-20T18:00:43.920720+0000","last_active":"2024-05-20T18:00:45.923154+0000","last_peered":"2024-05-20T18:00:45.923154+0000","last_clean":"2024-05-20T18:00:45.923154+0000","last_became_active":"2024-05-20T18:00:43.918373+0000","last_became_peered":"2024-05-20T18:00:43.918373+0000","last_unstale":"2024-05-20T18:00:45.923154+0000","last_undegraded":"2024-05-20T18:00:45.923154+0000","last_fullsized":"2024-05-20T18:00:45.923154+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:10.358119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830663+0000","last_change":"2024-05-20T18:00:44.928299+0000","last_active":"2024-05-20T18:00:46.830663+0000","last_peered":"2024-05-20T18:00:46.830663+0000","last_clean":"2024-05-20T18:00:46.830663+0000","last_became_active":"2024-05-20T18:00:44.928017+0000","last_became_peered":"2024-05-20T18:00:44.928017+0000","last_unstale":"2024-05-20T18:00:46.830663+0000","last_undegraded":"2024-05-20T18:00:46.830663+0000","last_fullsized":"2024-05-20T18:00:46.830663+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:50.083927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211681+0000","last_change":"2024-05-20T18:00:43.926382+0000","last_active":"2024-05-20T18:00:46.211681+0000","last_peered":"2024-05-20T18:00:46.211681+0000","last_clean":"2024-05-20T18:00:46.211681+0000","last_became_active":"2024-05-20T18:00:43.926047+0000","last_became_peered":"2024-05-20T18:00:43.926047+0000","last_unstale":"2024-05-20T18:00:46.211681+0000","last_undegraded":"2024-05-20T18:00:46.211681+0000","last_fullsized":"2024-05-20T18:00:46.211681+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:55.857139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923948+0000","last_change":"2024-05-20T18:00:44.933817+0000","last_active":"2024-05-20T18:00:45.923948+0000","last_peered":"2024-05-20T18:00:45.923948+0000","last_clean":"2024-05-20T18:00:45.923948+0000","last_became_active":"2024-05-20T18:00:44.933486+0000","last_became_peered":"2024-05-20T18:00:44.933486+0000","last_unstale":"2024-05-20T18:00:45.923948+0000","last_undegraded":"2024-05-20T18:00:45.923948+0000","last_fullsized":"2024-05-20T18:00:45.923948+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:50.083927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924346+0000","last_change":"2024-05-20T18:00:43.923411+0000","last_active":"2024-05-20T18:00:45.924346+0000","last_peered":"2024-05-20T18:00:45.924346+0000","last_clean":"2024-05-20T18:00:45.924346+0000","last_became_active":"2024-05-20T18:00:43.922877+0000","last_became_peered":"2024-05-20T18:00:43.922877+0000","last_unstale":"2024-05-20T18:00:45.924346+0000","last_undegraded":"2024-05-20T18:00:45.924346+0000","last_fullsized":"2024-05-20T18:00:45.924346+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:03.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931539+0000","last_change":"2024-05-20T18:00:44.928515+0000","last_active":"2024-05-20T18:00:45.931539+0000","last_peered":"2024-05-20T18:00:45.931539+0000","last_clean":"2024-05-20T18:00:45.931539+0000","last_became_active":"2024-05-20T18:00:44.928193+0000","last_became_peered":"2024-05-20T18:00:44.928193+0000","last_unstale":"2024-05-20T18:00:45.931539+0000","last_undegraded":"2024-05-20T18:00:45.931539+0000","last_fullsized":"2024-05-20T18:00:45.931539+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:07.436232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831378+0000","last_change":"2024-05-20T18:00:43.922858+0000","last_active":"2024-05-20T18:00:46.831378+0000","last_peered":"2024-05-20T18:00:46.831378+0000","last_clean":"2024-05-20T18:00:46.831378+0000","last_became_active":"2024-05-20T18:00:43.922518+0000","last_became_peered":"2024-05-20T18:00:43.922518+0000","last_unstale":"2024-05-20T18:00:46.831378+0000","last_undegraded":"2024-05-20T18:00:46.831378+0000","last_fullsized":"2024-05-20T18:00:46.831378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:19.671519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831057+0000","last_change":"2024-05-20T18:00:44.928137+0000","last_active":"2024-05-20T18:00:46.831057+0000","last_peered":"2024-05-20T18:00:46.831057+0000","last_clean":"2024-05-20T18:00:46.831057+0000","last_became_active":"2024-05-20T18:00:44.927850+0000","last_became_peered":"2024-05-20T18:00:44.927850+0000","last_unstale":"2024-05-20T18:00:46.831057+0000","last_undegraded":"2024-05-20T18:00:46.831057+0000","last_fullsized":"2024-05-20T18:00:46.831057+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:38:04.273979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830804+0000","last_change":"2024-05-20T18:00:43.923354+0000","last_active":"2024-05-20T18:00:46.830804+0000","last_peered":"2024-05-20T18:00:46.830804+0000","last_clean":"2024-05-20T18:00:46.830804+0000","last_became_active":"2024-05-20T18:00:43.922991+0000","last_became_peered":"2024-05-20T18:00:43.922991+0000","last_unstale":"2024-05-20T18:00:46.830804+0000","last_undegraded":"2024-05-20T18:00:46.830804+0000","last_fullsized":"2024-05-20T18:00:46.830804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:04.174703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930790+0000","last_change":"2024-05-20T18:00:44.934121+0000","last_active":"2024-05-20T18:00:45.930790+0000","last_peered":"2024-05-20T18:00:45.930790+0000","last_clean":"2024-05-20T18:00:45.930790+0000","last_became_active":"2024-05-20T18:00:44.933806+0000","last_became_peered":"2024-05-20T18:00:44.933806+0000","last_unstale":"2024-05-20T18:00:45.930790+0000","last_undegraded":"2024-05-20T18:00:45.930790+0000","last_fullsized":"2024-05-20T18:00:45.930790+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:23.119741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931019+0000","last_change":"2024-05-20T18:00:43.925470+0000","last_active":"2024-05-20T18:00:45.931019+0000","last_peered":"2024-05-20T18:00:45.931019+0000","last_clean":"2024-05-20T18:00:45.931019+0000","last_became_active":"2024-05-20T18:00:43.925053+0000","last_became_peered":"2024-05-20T18:00:43.925053+0000","last_unstale":"2024-05-20T18:00:45.931019+0000","last_undegraded":"2024-05-20T18:00:45.931019+0000","last_fullsized":"2024-05-20T18:00:45.931019+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:33.044931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.922892+0000","last_change":"2024-05-20T18:00:44.916668+0000","last_active":"2024-05-20T18:00:45.922892+0000","last_peered":"2024-05-20T18:00:45.922892+0000","last_clean":"2024-05-20T18:00:45.922892+0000","last_became_active":"2024-05-20T18:00:44.916308+0000","last_became_peered":"2024-05-20T18:00:44.916308+0000","last_unstale":"2024-05-20T18:00:45.922892+0000","last_undegraded":"2024-05-20T18:00:45.922892+0000","last_fullsized":"2024-05-20T18:00:45.922892+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:28:15.000086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830632+0000","last_change":"2024-05-20T18:00:43.920382+0000","last_active":"2024-05-20T18:00:46.830632+0000","last_peered":"2024-05-20T18:00:46.830632+0000","last_clean":"2024-05-20T18:00:46.830632+0000","last_became_active":"2024-05-20T18:00:43.919923+0000","last_became_peered":"2024-05-20T18:00:43.919923+0000","last_unstale":"2024-05-20T18:00:46.830632+0000","last_undegraded":"2024-05-20T18:00:46.830632+0000","last_fullsized":"2024-05-20T18:00:46.830632+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:05.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923854+0000","last_change":"2024-05-20T18:00:44.924300+0000","last_active":"2024-05-20T18:00:45.923854+0000","last_peered":"2024-05-20T18:00:45.923854+0000","last_clean":"2024-05-20T18:00:45.923854+0000","last_became_active":"2024-05-20T18:00:44.923547+0000","last_became_peered":"2024-05-20T18:00:44.923547+0000","last_unstale":"2024-05-20T18:00:45.923854+0000","last_undegraded":"2024-05-20T18:00:45.923854+0000","last_fullsized":"2024-05-20T18:00:45.923854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:25:11.571758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923255+0000","last_change":"2024-05-20T18:00:43.927113+0000","last_active":"2024-05-20T18:00:45.923255+0000","last_peered":"2024-05-20T18:00:45.923255+0000","last_clean":"2024-05-20T18:00:45.923255+0000","last_became_active":"2024-05-20T18:00:43.926779+0000","last_became_peered":"2024-05-20T18:00:43.926779+0000","last_unstale":"2024-05-20T18:00:45.923255+0000","last_undegraded":"2024-05-20T18:00:45.923255+0000","last_fullsized":"2024-05-20T18:00:45.923255+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:04.174703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830378+0000","last_change":"2024-05-20T18:00:44.926301+0000","last_active":"2024-05-20T18:00:46.830378+0000","last_peered":"2024-05-20T18:00:46.830378+0000","last_clean":"2024-05-20T18:00:46.830378+0000","last_became_active":"2024-05-20T18:00:44.925991+0000","last_became_peered":"2024-05-20T18:00:44.925991+0000","last_unstale":"2024-05-20T18:00:46.830378+0000","last_undegraded":"2024-05-20T18:00:46.830378+0000","last_fullsized":"2024-05-20T18:00:46.830378+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:05.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.829973+0000","last_change":"2024-05-20T18:00:43.923782+0000","last_active":"2024-05-20T18:00:46.829973+0000","last_peered":"2024-05-20T18:00:46.829973+0000","last_clean":"2024-05-20T18:00:46.829973+0000","last_became_active":"2024-05-20T18:00:43.923498+0000","last_became_peered":"2024-05-20T18:00:43.923498+0000","last_unstale":"2024-05-20T18:00:46.829973+0000","last_undegraded":"2024-05-20T18:00:46.829973+0000","last_fullsized":"2024-05-20T18:00:46.829973+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:57.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931488+0000","last_change":"2024-05-20T18:00:44.927742+0000","last_active":"2024-05-20T18:00:45.931488+0000","last_peered":"2024-05-20T18:00:45.931488+0000","last_clean":"2024-05-20T18:00:45.931488+0000","last_became_active":"2024-05-20T18:00:44.925867+0000","last_became_peered":"2024-05-20T18:00:44.925867+0000","last_unstale":"2024-05-20T18:00:45.931488+0000","last_undegraded":"2024-05-20T18:00:45.931488+0000","last_fullsized":"2024-05-20T18:00:45.931488+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:35.180867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931391+0000","last_change":"2024-05-20T18:00:43.921058+0000","last_active":"2024-05-20T18:00:45.931391+0000","last_peered":"2024-05-20T18:00:45.931391+0000","last_clean":"2024-05-20T18:00:45.931391+0000","last_became_active":"2024-05-20T18:00:43.920773+0000","last_became_peered":"2024-05-20T18:00:43.920773+0000","last_unstale":"2024-05-20T18:00:45.931391+0000","last_undegraded":"2024-05-20T18:00:45.931391+0000","last_fullsized":"2024-05-20T18:00:45.931391+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:00:39.321443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211421+0000","last_change":"2024-05-20T18:00:44.927555+0000","last_active":"2024-05-20T18:00:46.211421+0000","last_peered":"2024-05-20T18:00:46.211421+0000","last_clean":"2024-05-20T18:00:46.211421+0000","last_became_active":"2024-05-20T18:00:44.927217+0000","last_became_peered":"2024-05-20T18:00:44.927217+0000","last_unstale":"2024-05-20T18:00:46.211421+0000","last_undegraded":"2024-05-20T18:00:46.211421+0000","last_fullsized":"2024-05-20T18:00:46.211421+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:05.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"113'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929190+0000","last_change":"2024-05-20T18:00:43.925337+0000","last_active":"2024-05-20T18:00:45.929190+0000","last_peered":"2024-05-20T18:00:45.929190+0000","last_clean":"2024-05-20T18:00:45.929190+0000","last_became_active":"2024-05-20T18:00:43.925036+0000","last_became_peered":"2024-05-20T18:00:43.925036+0000","last_unstale":"2024-05-20T18:00:45.929190+0000","last_undegraded":"2024-05-20T18:00:45.929190+0000","last_fullsized":"2024-05-20T18:00:45.929190+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:04.174703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831039+0000","last_change":"2024-05-20T18:00:44.933673+0000","last_active":"2024-05-20T18:00:46.831039+0000","last_peered":"2024-05-20T18:00:46.831039+0000","last_clean":"2024-05-20T18:00:46.831039+0000","last_became_active":"2024-05-20T18:00:44.933319+0000","last_became_peered":"2024-05-20T18:00:44.933319+0000","last_unstale":"2024-05-20T18:00:46.831039+0000","last_undegraded":"2024-05-20T18:00:46.831039+0000","last_fullsized":"2024-05-20T18:00:46.831039+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:47.088602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929170+0000","last_change":"2024-05-20T18:00:43.927476+0000","last_active":"2024-05-20T18:00:45.929170+0000","last_peered":"2024-05-20T18:00:45.929170+0000","last_clean":"2024-05-20T18:00:45.929170+0000","last_became_active":"2024-05-20T18:00:43.927118+0000","last_became_peered":"2024-05-20T18:00:43.927118+0000","last_unstale":"2024-05-20T18:00:45.929170+0000","last_undegraded":"2024-05-20T18:00:45.929170+0000","last_fullsized":"2024-05-20T18:00:45.929170+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:45.171175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924259+0000","last_change":"2024-05-20T18:00:44.927847+0000","last_active":"2024-05-20T18:00:45.924259+0000","last_peered":"2024-05-20T18:00:45.924259+0000","last_clean":"2024-05-20T18:00:45.924259+0000","last_became_active":"2024-05-20T18:00:44.927462+0000","last_became_peered":"2024-05-20T18:00:44.927462+0000","last_unstale":"2024-05-20T18:00:45.924259+0000","last_undegraded":"2024-05-20T18:00:45.924259+0000","last_fullsized":"2024-05-20T18:00:45.924259+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:24:06.884277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931464+0000","last_change":"2024-05-20T18:00:43.928985+0000","last_active":"2024-05-20T18:00:45.931464+0000","last_peered":"2024-05-20T18:00:45.931464+0000","last_clean":"2024-05-20T18:00:45.931464+0000","last_became_active":"2024-05-20T18:00:43.928674+0000","last_became_peered":"2024-05-20T18:00:43.928674+0000","last_unstale":"2024-05-20T18:00:45.931464+0000","last_undegraded":"2024-05-20T18:00:45.931464+0000","last_fullsized":"2024-05-20T18:00:45.931464+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:39:24.373489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930988+0000","last_change":"2024-05-20T18:00:44.926005+0000","last_active":"2024-05-20T18:00:45.930988+0000","last_peered":"2024-05-20T18:00:45.930988+0000","last_clean":"2024-05-20T18:00:45.930988+0000","last_became_active":"2024-05-20T18:00:44.925474+0000","last_became_peered":"2024-05-20T18:00:44.925474+0000","last_unstale":"2024-05-20T18:00:45.930988+0000","last_undegraded":"2024-05-20T18:00:45.930988+0000","last_fullsized":"2024-05-20T18:00:45.930988+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:58:53.575716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923951+0000","last_change":"2024-05-20T18:00:43.917381+0000","last_active":"2024-05-20T18:00:45.923951+0000","last_peered":"2024-05-20T18:00:45.923951+0000","last_clean":"2024-05-20T18:00:45.923951+0000","last_became_active":"2024-05-20T18:00:43.917027+0000","last_became_peered":"2024-05-20T18:00:43.917027+0000","last_unstale":"2024-05-20T18:00:45.923951+0000","last_undegraded":"2024-05-20T18:00:45.923951+0000","last_fullsized":"2024-05-20T18:00:45.923951+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:52.896237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923059+0000","last_change":"2024-05-20T18:00:44.928643+0000","last_active":"2024-05-20T18:00:45.923059+0000","last_peered":"2024-05-20T18:00:45.923059+0000","last_clean":"2024-05-20T18:00:45.923059+0000","last_became_active":"2024-05-20T18:00:44.928231+0000","last_became_peered":"2024-05-20T18:00:44.928231+0000","last_unstale":"2024-05-20T18:00:45.923059+0000","last_undegraded":"2024-05-20T18:00:45.923059+0000","last_fullsized":"2024-05-20T18:00:45.923059+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:46:32.655543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923758+0000","last_change":"2024-05-20T18:00:43.912650+0000","last_active":"2024-05-20T18:00:45.923758+0000","last_peered":"2024-05-20T18:00:45.923758+0000","last_clean":"2024-05-20T18:00:45.923758+0000","last_became_active":"2024-05-20T18:00:43.912307+0000","last_became_peered":"2024-05-20T18:00:43.912307+0000","last_unstale":"2024-05-20T18:00:45.923758+0000","last_undegraded":"2024-05-20T18:00:45.923758+0000","last_fullsized":"2024-05-20T18:00:45.923758+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:06.672279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830732+0000","last_change":"2024-05-20T18:00:44.940635+0000","last_active":"2024-05-20T18:00:46.830732+0000","last_peered":"2024-05-20T18:00:46.830732+0000","last_clean":"2024-05-20T18:00:46.830732+0000","last_became_active":"2024-05-20T18:00:44.940287+0000","last_became_peered":"2024-05-20T18:00:44.940287+0000","last_unstale":"2024-05-20T18:00:46.830732+0000","last_undegraded":"2024-05-20T18:00:46.830732+0000","last_fullsized":"2024-05-20T18:00:46.830732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:51:18.647992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930871+0000","last_change":"2024-05-20T18:00:43.927440+0000","last_active":"2024-05-20T18:00:45.930871+0000","last_peered":"2024-05-20T18:00:45.930871+0000","last_clean":"2024-05-20T18:00:45.930871+0000","last_became_active":"2024-05-20T18:00:43.926940+0000","last_became_peered":"2024-05-20T18:00:43.926940+0000","last_unstale":"2024-05-20T18:00:45.930871+0000","last_undegraded":"2024-05-20T18:00:45.930871+0000","last_fullsized":"2024-05-20T18:00:45.930871+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:29:25.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211570+0000","last_change":"2024-05-20T18:00:44.929534+0000","last_active":"2024-05-20T18:00:46.211570+0000","last_peered":"2024-05-20T18:00:46.211570+0000","last_clean":"2024-05-20T18:00:46.211570+0000","last_became_active":"2024-05-20T18:00:44.929165+0000","last_became_peered":"2024-05-20T18:00:44.929165+0000","last_unstale":"2024-05-20T18:00:46.211570+0000","last_undegraded":"2024-05-20T18:00:46.211570+0000","last_fullsized":"2024-05-20T18:00:46.211570+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:50.083927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830129+0000","last_change":"2024-05-20T18:00:43.922311+0000","last_active":"2024-05-20T18:00:46.830129+0000","last_peered":"2024-05-20T18:00:46.830129+0000","last_clean":"2024-05-20T18:00:46.830129+0000","last_became_active":"2024-05-20T18:00:43.921955+0000","last_became_peered":"2024-05-20T18:00:43.921955+0000","last_unstale":"2024-05-20T18:00:46.830129+0000","last_undegraded":"2024-05-20T18:00:46.830129+0000","last_fullsized":"2024-05-20T18:00:46.830129+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:10.358119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831019+0000","last_change":"2024-05-20T18:00:44.939642+0000","last_active":"2024-05-20T18:00:46.831019+0000","last_peered":"2024-05-20T18:00:46.831019+0000","last_clean":"2024-05-20T18:00:46.831019+0000","last_became_active":"2024-05-20T18:00:44.939350+0000","last_became_peered":"2024-05-20T18:00:44.939350+0000","last_unstale":"2024-05-20T18:00:46.831019+0000","last_undegraded":"2024-05-20T18:00:46.831019+0000","last_fullsized":"2024-05-20T18:00:46.831019+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:46:32.655543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"112'8","reported_seq":22,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.922808+0000","last_change":"2024-05-20T18:00:43.922085+0000","last_active":"2024-05-20T18:00:45.922808+0000","last_peered":"2024-05-20T18:00:45.922808+0000","last_clean":"2024-05-20T18:00:45.922808+0000","last_became_active":"2024-05-20T18:00:43.917629+0000","last_became_peered":"2024-05-20T18:00:43.917629+0000","last_unstale":"2024-05-20T18:00:45.922808+0000","last_undegraded":"2024-05-20T18:00:45.922808+0000","last_fullsized":"2024-05-20T18:00:45.922808+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:24:29.952702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":340,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830345+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:00:46.830345+0000","last_peered":"2024-05-20T18:00:46.830345+0000","last_clean":"2024-05-20T18:00:46.830345+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:00:46.830345+0000","last_undegraded":"2024-05-20T18:00:46.830345+0000","last_fullsized":"2024-05-20T18:00:46.830345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1242685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1413120,"data_stored":652123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1417216,"data_stored":651701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":653153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1425408,"data_stored":653187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1409024,"data_stored":651541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":651563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2007040,"data_stored":1241931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:00:53.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:00:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.633+0000 7f064fbea640 1 Processor -- start 2024-05-20T18:00:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.634+0000 7f064fbea640 1 -- start start 2024-05-20T18:00:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064fbea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f064806d3d0 0x7f064806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064fbea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06480b8190 0x7f06480b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064fbea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064806dd20 con 0x7f0648162820 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064fbea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f06480d0630 con 0x7f064806d3d0 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064fbea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f06480d39c0 con 0x7f06480b8190 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064e187640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06480b8190 0x7f06480b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064d185640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f064806d3d0 0x7f064806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064d185640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f064806d3d0 0x7f064806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:44912/0 (socket says 172.21.15.6:44912) 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064e187640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06480b8190 0x7f06480b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:55018/0 (socket says 172.21.15.6:55018) 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064d185640 1 -- 172.21.15.6:0/384460441 learned_addr learned my addr 172.21.15.6:0/384460441 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.635+0000 7f064d986640 1 --1- 172.21.15.6:0/384460441 >> v1:172.21.15.171:6789/0 conn(0x7f0648162820 0x7f06480b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:33994/0 (socket says 172.21.15.6:33994) 2024-05-20T18:00:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.636+0000 7f064d185640 1 -- 172.21.15.6:0/384460441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06480b8190 msgr2=0x7f06480b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.636+0000 7f064d185640 1 --2- 172.21.15.6:0/384460441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06480b8190 0x7f06480b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.636+0000 7f064d185640 1 -- 172.21.15.6:0/384460441 >> v1:172.21.15.171:6789/0 conn(0x7f0648162820 legacy=0x7f06480b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.636+0000 7f064d185640 1 -- 172.21.15.6:0/384460441 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06480d3ca0 con 0x7f064806d3d0 2024-05-20T18:00:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.636+0000 7f064e187640 1 --2- 172.21.15.6:0/384460441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06480b8190 0x7f06480b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.637+0000 7f064d185640 1 --2- 172.21.15.6:0/384460441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 0x7f064806d7e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0638009870 tx=0x7f063802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b227be84d5fde561 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.637+0000 7f064c984640 1 -- 172.21.15.6:0/384460441 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638037070 con 0x7f064806d3d0 2024-05-20T18:00:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.637+0000 7f064c984640 1 -- 172.21.15.6:0/384460441 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0638032440 con 0x7f064806d3d0 2024-05-20T18:00:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.637+0000 7f064c984640 1 -- 172.21.15.6:0/384460441 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638032810 con 0x7f064806d3d0 2024-05-20T18:00:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.638+0000 7f064fbea640 1 -- 172.21.15.6:0/384460441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 msgr2=0x7f064806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.638+0000 7f064fbea640 1 --2- 172.21.15.6:0/384460441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 0x7f064806d7e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0638009870 tx=0x7f063802a270 comp rx=0 tx=0).stop 2024-05-20T18:00:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.638+0000 7f064fbea640 1 -- 172.21.15.6:0/384460441 shutdown_connections 2024-05-20T18:00:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.638+0000 7f064fbea640 1 --2- 172.21.15.6:0/384460441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06480b8190 0x7f06480b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.638+0000 7f064fbea640 1 --2- 172.21.15.6:0/384460441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 0x7f064806d7e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.638+0000 7f064fbea640 1 -- 172.21.15.6:0/384460441 >> 172.21.15.6:0/384460441 conn(0x7f06480d4bd0 msgr2=0x7f06480d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.638+0000 7f064fbea640 1 -- 172.21.15.6:0/384460441 shutdown_connections 2024-05-20T18:00:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.638+0000 7f064fbea640 1 -- 172.21.15.6:0/384460441 wait complete. 2024-05-20T18:00:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.640+0000 7f064fbea640 1 Processor -- start 2024-05-20T18:00:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.640+0000 7f064fbea640 1 -- start start 2024-05-20T18:00:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064fbea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 0x7f06480cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064fbea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06480b8190 0x7f064814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064fbea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0648162820 0x7f06480b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064fbea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06480d0300 con 0x7f06480b8190 2024-05-20T18:00:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064fbea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06480d4260 con 0x7f064806d3d0 2024-05-20T18:00:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064fbea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f06480b4050 con 0x7f0648162820 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064d185640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06480b8190 0x7f064814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064d185640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06480b8190 0x7f064814ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49520/0 (socket says 172.21.15.6:49520) 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064d185640 1 -- 172.21.15.6:0/1272602391 learned_addr learned my addr 172.21.15.6:0/1272602391 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064d986640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 0x7f06480cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.641+0000 7f064e187640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0648162820 0x7f06480b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f064d185640 1 -- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0648162820 msgr2=0x7f06480b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f064d185640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0648162820 0x7f06480b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f064d185640 1 -- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 msgr2=0x7f06480cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f064d185640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 0x7f06480cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f064d185640 1 -- 172.21.15.6:0/1272602391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06480cc1c0 con 0x7f06480b8190 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f064d185640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06480b8190 0x7f064814ff90 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f063802a2b0 tx=0x7f06380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f063e7fc640 1 -- 172.21.15.6:0/1272602391 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638037040 con 0x7f06480b8190 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f063e7fc640 1 -- 172.21.15.6:0/1272602391 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0638042070 con 0x7f06480b8190 2024-05-20T18:00:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06480cec80 con 0x7f06480b8190 2024-05-20T18:00:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f063e7fc640 1 -- 172.21.15.6:0/1272602391 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638030880 con 0x7f06480b8190 2024-05-20T18:00:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.642+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06480cf240 con 0x7f06480b8190 2024-05-20T18:00:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.643+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0648075b00 con 0x7f06480b8190 2024-05-20T18:00:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.644+0000 7f063e7fc640 1 -- 172.21.15.6:0/1272602391 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0638030a20 con 0x7f06480b8190 2024-05-20T18:00:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.644+0000 7f063e7fc640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f062c06be60 0x7f062c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.644+0000 7f063e7fc640 1 -- 172.21.15.6:0/1272602391 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f06380ab7c0 con 0x7f06480b8190 2024-05-20T18:00:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.645+0000 7f064d986640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f062c06be60 0x7f062c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.645+0000 7f064d986640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f062c06be60 0x7f062c06e370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0644007fd0 tx=0x7f0644007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:53.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.649+0000 7f063e7fc640 1 -- 172.21.15.6:0/1272602391 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0638079880 con 0x7f06480b8190 2024-05-20T18:00:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.829+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0648161c30 con 0x7f062c06be60 2024-05-20T18:00:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.836+0000 7f063e7fc640 1 -- 172.21.15.6:0/1272602391 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252488 (secure 0 0 0) 0x7f0648161c30 con 0x7f062c06be60 2024-05-20T18:00:53.837 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f062c06be60 msgr2=0x7f062c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f062c06be60 0x7f062c06e370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0644007fd0 tx=0x7f0644007e80 comp rx=0 tx=0).stop 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06480b8190 msgr2=0x7f064814ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06480b8190 0x7f064814ff90 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f063802a2b0 tx=0x7f06380046c0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 shutdown_connections 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f062c06be60 0x7f062c06e370 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0648162820 0x7f06480b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06480b8190 0x7f064814ff90 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 --2- 172.21.15.6:0/1272602391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f064806d3d0 0x7f06480cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.839+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 >> 172.21.15.6:0/1272602391 conn(0x7f06480d4bd0 msgr2=0x7f06480ba020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.840+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 shutdown_connections 2024-05-20T18:00:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:53.840+0000 7f064fbea640 1 -- 172.21.15.6:0/1272602391 wait complete. 2024-05-20T18:00:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-05-20T18:00:52.354358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261716,"kb_used_data":12232,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713004,"statfs":{"total":773094113280,"available":772826116096,"internally_reserved":0,"allocated":12525568,"data_stored":6397884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002277"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924159+0000","last_change":"2024-05-20T18:00:44.920242+0000","last_active":"2024-05-20T18:00:45.924159+0000","last_peered":"2024-05-20T18:00:45.924159+0000","last_clean":"2024-05-20T18:00:45.924159+0000","last_became_active":"2024-05-20T18:00:44.919765+0000","last_became_peered":"2024-05-20T18:00:44.919765+0000","last_unstale":"2024-05-20T18:00:45.924159+0000","last_undegraded":"2024-05-20T18:00:45.924159+0000","last_fullsized":"2024-05-20T18:00:45.924159+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:48.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923473+0000","last_change":"2024-05-20T18:00:44.937796+0000","last_active":"2024-05-20T18:00:45.923473+0000","last_peered":"2024-05-20T18:00:45.923473+0000","last_clean":"2024-05-20T18:00:45.923473+0000","last_became_active":"2024-05-20T18:00:44.933194+0000","last_became_peered":"2024-05-20T18:00:44.933194+0000","last_unstale":"2024-05-20T18:00:45.923473+0000","last_undegraded":"2024-05-20T18:00:45.923473+0000","last_fullsized":"2024-05-20T18:00:45.923473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:51.054710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923580+0000","last_change":"2024-05-20T18:00:44.929695+0000","last_active":"2024-05-20T18:00:45.923580+0000","last_peered":"2024-05-20T18:00:45.923580+0000","last_clean":"2024-05-20T18:00:45.923580+0000","last_became_active":"2024-05-20T18:00:44.929329+0000","last_became_peered":"2024-05-20T18:00:44.929329+0000","last_unstale":"2024-05-20T18:00:45.923580+0000","last_undegraded":"2024-05-20T18:00:45.923580+0000","last_fullsized":"2024-05-20T18:00:45.923580+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:35.503499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830670+0000","last_change":"2024-05-20T18:00:44.934983+0000","last_active":"2024-05-20T18:00:46.830670+0000","last_peered":"2024-05-20T18:00:46.830670+0000","last_clean":"2024-05-20T18:00:46.830670+0000","last_became_active":"2024-05-20T18:00:44.933725+0000","last_became_peered":"2024-05-20T18:00:44.933725+0000","last_unstale":"2024-05-20T18:00:46.830670+0000","last_undegraded":"2024-05-20T18:00:46.830670+0000","last_fullsized":"2024-05-20T18:00:46.830670+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:26:14.353409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923841+0000","last_change":"2024-05-20T18:00:44.923676+0000","last_active":"2024-05-20T18:00:45.923841+0000","last_peered":"2024-05-20T18:00:45.923841+0000","last_clean":"2024-05-20T18:00:45.923841+0000","last_became_active":"2024-05-20T18:00:44.923350+0000","last_became_peered":"2024-05-20T18:00:44.923350+0000","last_unstale":"2024-05-20T18:00:45.923841+0000","last_undegraded":"2024-05-20T18:00:45.923841+0000","last_fullsized":"2024-05-20T18:00:45.923841+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:46.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930950+0000","last_change":"2024-05-20T18:00:44.935789+0000","last_active":"2024-05-20T18:00:45.930950+0000","last_peered":"2024-05-20T18:00:45.930950+0000","last_clean":"2024-05-20T18:00:45.930950+0000","last_became_active":"2024-05-20T18:00:44.935456+0000","last_became_peered":"2024-05-20T18:00:44.935456+0000","last_unstale":"2024-05-20T18:00:45.930950+0000","last_undegraded":"2024-05-20T18:00:45.930950+0000","last_fullsized":"2024-05-20T18:00:45.930950+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:08.508132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930798+0000","last_change":"2024-05-20T18:00:44.935560+0000","last_active":"2024-05-20T18:00:45.930798+0000","last_peered":"2024-05-20T18:00:45.930798+0000","last_clean":"2024-05-20T18:00:45.930798+0000","last_became_active":"2024-05-20T18:00:44.935192+0000","last_became_peered":"2024-05-20T18:00:44.935192+0000","last_unstale":"2024-05-20T18:00:45.930798+0000","last_undegraded":"2024-05-20T18:00:45.930798+0000","last_fullsized":"2024-05-20T18:00:45.930798+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:47:16.088741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.922790+0000","last_change":"2024-05-20T18:00:44.927415+0000","last_active":"2024-05-20T18:00:45.922790+0000","last_peered":"2024-05-20T18:00:45.922790+0000","last_clean":"2024-05-20T18:00:45.922790+0000","last_became_active":"2024-05-20T18:00:44.927080+0000","last_became_peered":"2024-05-20T18:00:44.927080+0000","last_unstale":"2024-05-20T18:00:45.922790+0000","last_undegraded":"2024-05-20T18:00:45.922790+0000","last_fullsized":"2024-05-20T18:00:45.922790+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:51:18.647992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831201+0000","last_change":"2024-05-20T18:00:44.942769+0000","last_active":"2024-05-20T18:00:46.831201+0000","last_peered":"2024-05-20T18:00:46.831201+0000","last_clean":"2024-05-20T18:00:46.831201+0000","last_became_active":"2024-05-20T18:00:44.942450+0000","last_became_peered":"2024-05-20T18:00:44.942450+0000","last_unstale":"2024-05-20T18:00:46.831201+0000","last_undegraded":"2024-05-20T18:00:46.831201+0000","last_fullsized":"2024-05-20T18:00:46.831201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:11.722882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211473+0000","last_change":"2024-05-20T18:00:44.923652+0000","last_active":"2024-05-20T18:00:46.211473+0000","last_peered":"2024-05-20T18:00:46.211473+0000","last_clean":"2024-05-20T18:00:46.211473+0000","last_became_active":"2024-05-20T18:00:44.923299+0000","last_became_peered":"2024-05-20T18:00:44.923299+0000","last_unstale":"2024-05-20T18:00:46.211473+0000","last_undegraded":"2024-05-20T18:00:46.211473+0000","last_fullsized":"2024-05-20T18:00:46.211473+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:46.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923886+0000","last_change":"2024-05-20T18:00:44.923183+0000","last_active":"2024-05-20T18:00:45.923886+0000","last_peered":"2024-05-20T18:00:45.923886+0000","last_clean":"2024-05-20T18:00:45.923886+0000","last_became_active":"2024-05-20T18:00:44.917663+0000","last_became_peered":"2024-05-20T18:00:44.917663+0000","last_unstale":"2024-05-20T18:00:45.923886+0000","last_undegraded":"2024-05-20T18:00:45.923886+0000","last_fullsized":"2024-05-20T18:00:45.923886+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:20.677290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931303+0000","last_change":"2024-05-20T18:00:44.928582+0000","last_active":"2024-05-20T18:00:45.931303+0000","last_peered":"2024-05-20T18:00:45.931303+0000","last_clean":"2024-05-20T18:00:45.931303+0000","last_became_active":"2024-05-20T18:00:44.928258+0000","last_became_peered":"2024-05-20T18:00:44.928258+0000","last_unstale":"2024-05-20T18:00:45.931303+0000","last_undegraded":"2024-05-20T18:00:45.931303+0000","last_fullsized":"2024-05-20T18:00:45.931303+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:36:39.610784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211369+0000","last_change":"2024-05-20T18:00:44.920074+0000","last_active":"2024-05-20T18:00:46.211369+0000","last_peered":"2024-05-20T18:00:46.211369+0000","last_clean":"2024-05-20T18:00:46.211369+0000","last_became_active":"2024-05-20T18:00:44.919736+0000","last_became_peered":"2024-05-20T18:00:44.919736+0000","last_unstale":"2024-05-20T18:00:46.211369+0000","last_undegraded":"2024-05-20T18:00:46.211369+0000","last_fullsized":"2024-05-20T18:00:46.211369+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:58.036101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923175+0000","last_change":"2024-05-20T18:00:44.924576+0000","last_active":"2024-05-20T18:00:45.923175+0000","last_peered":"2024-05-20T18:00:45.923175+0000","last_clean":"2024-05-20T18:00:45.923175+0000","last_became_active":"2024-05-20T18:00:44.923970+0000","last_became_peered":"2024-05-20T18:00:44.923970+0000","last_unstale":"2024-05-20T18:00:45.923175+0000","last_undegraded":"2024-05-20T18:00:45.923175+0000","last_fullsized":"2024-05-20T18:00:45.923175+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:47.088602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923577+0000","last_change":"2024-05-20T18:00:44.917217+0000","last_active":"2024-05-20T18:00:45.923577+0000","last_peered":"2024-05-20T18:00:45.923577+0000","last_clean":"2024-05-20T18:00:45.923577+0000","last_became_active":"2024-05-20T18:00:44.916821+0000","last_became_peered":"2024-05-20T18:00:44.916821+0000","last_unstale":"2024-05-20T18:00:45.923577+0000","last_undegraded":"2024-05-20T18:00:45.923577+0000","last_fullsized":"2024-05-20T18:00:45.923577+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:11.363890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930787+0000","last_change":"2024-05-20T18:00:44.926664+0000","last_active":"2024-05-20T18:00:45.930787+0000","last_peered":"2024-05-20T18:00:45.930787+0000","last_clean":"2024-05-20T18:00:45.930787+0000","last_became_active":"2024-05-20T18:00:44.926280+0000","last_became_peered":"2024-05-20T18:00:44.926280+0000","last_unstale":"2024-05-20T18:00:45.930787+0000","last_undegraded":"2024-05-20T18:00:45.930787+0000","last_fullsized":"2024-05-20T18:00:45.930787+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:25:57.239121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211691+0000","last_change":"2024-05-20T18:00:44.917312+0000","last_active":"2024-05-20T18:00:46.211691+0000","last_peered":"2024-05-20T18:00:46.211691+0000","last_clean":"2024-05-20T18:00:46.211691+0000","last_became_active":"2024-05-20T18:00:44.916815+0000","last_became_peered":"2024-05-20T18:00:44.916815+0000","last_unstale":"2024-05-20T18:00:46.211691+0000","last_undegraded":"2024-05-20T18:00:46.211691+0000","last_fullsized":"2024-05-20T18:00:46.211691+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:38:04.273979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923429+0000","last_change":"2024-05-20T18:00:44.937792+0000","last_active":"2024-05-20T18:00:45.923429+0000","last_peered":"2024-05-20T18:00:45.923429+0000","last_clean":"2024-05-20T18:00:45.923429+0000","last_became_active":"2024-05-20T18:00:44.933713+0000","last_became_peered":"2024-05-20T18:00:44.933713+0000","last_unstale":"2024-05-20T18:00:45.923429+0000","last_undegraded":"2024-05-20T18:00:45.923429+0000","last_fullsized":"2024-05-20T18:00:45.923429+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:45.621039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929107+0000","last_change":"2024-05-20T18:00:44.932131+0000","last_active":"2024-05-20T18:00:45.929107+0000","last_peered":"2024-05-20T18:00:45.929107+0000","last_clean":"2024-05-20T18:00:45.929107+0000","last_became_active":"2024-05-20T18:00:44.931804+0000","last_became_peered":"2024-05-20T18:00:44.931804+0000","last_unstale":"2024-05-20T18:00:45.929107+0000","last_undegraded":"2024-05-20T18:00:45.929107+0000","last_fullsized":"2024-05-20T18:00:45.929107+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:53:10.515388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924072+0000","last_change":"2024-05-20T18:00:44.936644+0000","last_active":"2024-05-20T18:00:45.924072+0000","last_peered":"2024-05-20T18:00:45.924072+0000","last_clean":"2024-05-20T18:00:45.924072+0000","last_became_active":"2024-05-20T18:00:44.936256+0000","last_became_peered":"2024-05-20T18:00:44.936256+0000","last_unstale":"2024-05-20T18:00:45.924072+0000","last_undegraded":"2024-05-20T18:00:45.924072+0000","last_fullsized":"2024-05-20T18:00:45.924072+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:39:08.640208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830793+0000","last_change":"2024-05-20T18:00:44.939447+0000","last_active":"2024-05-20T18:00:46.830793+0000","last_peered":"2024-05-20T18:00:46.830793+0000","last_clean":"2024-05-20T18:00:46.830793+0000","last_became_active":"2024-05-20T18:00:44.938961+0000","last_became_peered":"2024-05-20T18:00:44.938961+0000","last_unstale":"2024-05-20T18:00:46.830793+0000","last_undegraded":"2024-05-20T18:00:46.830793+0000","last_fullsized":"2024-05-20T18:00:46.830793+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:28:15.000086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923762+0000","last_change":"2024-05-20T18:00:44.934618+0000","last_active":"2024-05-20T18:00:45.923762+0000","last_peered":"2024-05-20T18:00:45.923762+0000","last_clean":"2024-05-20T18:00:45.923762+0000","last_became_active":"2024-05-20T18:00:44.934295+0000","last_became_peered":"2024-05-20T18:00:44.934295+0000","last_unstale":"2024-05-20T18:00:45.923762+0000","last_undegraded":"2024-05-20T18:00:45.923762+0000","last_fullsized":"2024-05-20T18:00:45.923762+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:06.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831199+0000","last_change":"2024-05-20T18:00:44.943024+0000","last_active":"2024-05-20T18:00:46.831199+0000","last_peered":"2024-05-20T18:00:46.831199+0000","last_clean":"2024-05-20T18:00:46.831199+0000","last_became_active":"2024-05-20T18:00:44.942696+0000","last_became_peered":"2024-05-20T18:00:44.942696+0000","last_unstale":"2024-05-20T18:00:46.831199+0000","last_undegraded":"2024-05-20T18:00:46.831199+0000","last_fullsized":"2024-05-20T18:00:46.831199+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:45.621039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830055+0000","last_change":"2024-05-20T18:00:44.923692+0000","last_active":"2024-05-20T18:00:46.830055+0000","last_peered":"2024-05-20T18:00:46.830055+0000","last_clean":"2024-05-20T18:00:46.830055+0000","last_became_active":"2024-05-20T18:00:44.923242+0000","last_became_peered":"2024-05-20T18:00:44.923242+0000","last_unstale":"2024-05-20T18:00:46.830055+0000","last_undegraded":"2024-05-20T18:00:46.830055+0000","last_fullsized":"2024-05-20T18:00:46.830055+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:58.036101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830870+0000","last_change":"2024-05-20T18:00:44.916983+0000","last_active":"2024-05-20T18:00:46.830870+0000","last_peered":"2024-05-20T18:00:46.830870+0000","last_clean":"2024-05-20T18:00:46.830870+0000","last_became_active":"2024-05-20T18:00:44.916680+0000","last_became_peered":"2024-05-20T18:00:44.916680+0000","last_unstale":"2024-05-20T18:00:46.830870+0000","last_undegraded":"2024-05-20T18:00:46.830870+0000","last_fullsized":"2024-05-20T18:00:46.830870+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:48.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924388+0000","last_change":"2024-05-20T18:00:44.930494+0000","last_active":"2024-05-20T18:00:45.924388+0000","last_peered":"2024-05-20T18:00:45.924388+0000","last_clean":"2024-05-20T18:00:45.924388+0000","last_became_active":"2024-05-20T18:00:44.930158+0000","last_became_peered":"2024-05-20T18:00:44.930158+0000","last_unstale":"2024-05-20T18:00:45.924388+0000","last_undegraded":"2024-05-20T18:00:45.924388+0000","last_fullsized":"2024-05-20T18:00:45.924388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:56:36.584652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929094+0000","last_change":"2024-05-20T18:00:44.930217+0000","last_active":"2024-05-20T18:00:45.929094+0000","last_peered":"2024-05-20T18:00:45.929094+0000","last_clean":"2024-05-20T18:00:45.929094+0000","last_became_active":"2024-05-20T18:00:44.929878+0000","last_became_peered":"2024-05-20T18:00:44.929878+0000","last_unstale":"2024-05-20T18:00:45.929094+0000","last_undegraded":"2024-05-20T18:00:45.929094+0000","last_fullsized":"2024-05-20T18:00:45.929094+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:33:23.198512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931355+0000","last_change":"2024-05-20T18:00:44.927007+0000","last_active":"2024-05-20T18:00:45.931355+0000","last_peered":"2024-05-20T18:00:45.931355+0000","last_clean":"2024-05-20T18:00:45.931355+0000","last_became_active":"2024-05-20T18:00:44.926024+0000","last_became_peered":"2024-05-20T18:00:44.926024+0000","last_unstale":"2024-05-20T18:00:45.931355+0000","last_undegraded":"2024-05-20T18:00:45.931355+0000","last_fullsized":"2024-05-20T18:00:45.931355+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:44:42.333825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923832+0000","last_change":"2024-05-20T18:00:44.936477+0000","last_active":"2024-05-20T18:00:45.923832+0000","last_peered":"2024-05-20T18:00:45.923832+0000","last_clean":"2024-05-20T18:00:45.923832+0000","last_became_active":"2024-05-20T18:00:44.936132+0000","last_became_peered":"2024-05-20T18:00:44.936132+0000","last_unstale":"2024-05-20T18:00:45.923832+0000","last_undegraded":"2024-05-20T18:00:45.923832+0000","last_fullsized":"2024-05-20T18:00:45.923832+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:14:49.935920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923365+0000","last_change":"2024-05-20T18:00:44.918124+0000","last_active":"2024-05-20T18:00:45.923365+0000","last_peered":"2024-05-20T18:00:45.923365+0000","last_clean":"2024-05-20T18:00:45.923365+0000","last_became_active":"2024-05-20T18:00:44.917788+0000","last_became_peered":"2024-05-20T18:00:44.917788+0000","last_unstale":"2024-05-20T18:00:45.923365+0000","last_undegraded":"2024-05-20T18:00:45.923365+0000","last_fullsized":"2024-05-20T18:00:45.923365+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:11.722882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830202+0000","last_change":"2024-05-20T18:00:44.925489+0000","last_active":"2024-05-20T18:00:46.830202+0000","last_peered":"2024-05-20T18:00:46.830202+0000","last_clean":"2024-05-20T18:00:46.830202+0000","last_became_active":"2024-05-20T18:00:44.925168+0000","last_became_peered":"2024-05-20T18:00:44.925168+0000","last_unstale":"2024-05-20T18:00:46.830202+0000","last_undegraded":"2024-05-20T18:00:46.830202+0000","last_fullsized":"2024-05-20T18:00:46.830202+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:46.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830072+0000","last_change":"2024-05-20T18:00:44.924291+0000","last_active":"2024-05-20T18:00:46.830072+0000","last_peered":"2024-05-20T18:00:46.830072+0000","last_clean":"2024-05-20T18:00:46.830072+0000","last_became_active":"2024-05-20T18:00:44.923959+0000","last_became_peered":"2024-05-20T18:00:44.923959+0000","last_unstale":"2024-05-20T18:00:46.830072+0000","last_undegraded":"2024-05-20T18:00:46.830072+0000","last_fullsized":"2024-05-20T18:00:46.830072+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:11.363890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211491+0000","last_change":"2024-05-20T18:00:44.930891+0000","last_active":"2024-05-20T18:00:46.211491+0000","last_peered":"2024-05-20T18:00:46.211491+0000","last_clean":"2024-05-20T18:00:46.211491+0000","last_became_active":"2024-05-20T18:00:44.930532+0000","last_became_peered":"2024-05-20T18:00:44.930532+0000","last_unstale":"2024-05-20T18:00:46.211491+0000","last_undegraded":"2024-05-20T18:00:46.211491+0000","last_fullsized":"2024-05-20T18:00:46.211491+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:20.677290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"112'4","reported_seq":18,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929029+0000","last_change":"2024-05-20T18:00:43.925402+0000","last_active":"2024-05-20T18:00:45.929029+0000","last_peered":"2024-05-20T18:00:45.929029+0000","last_clean":"2024-05-20T18:00:45.929029+0000","last_became_active":"2024-05-20T18:00:43.925134+0000","last_became_peered":"2024-05-20T18:00:43.925134+0000","last_unstale":"2024-05-20T18:00:45.929029+0000","last_undegraded":"2024-05-20T18:00:45.929029+0000","last_fullsized":"2024-05-20T18:00:45.929029+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:10.358119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931151+0000","last_change":"2024-05-20T18:00:44.934967+0000","last_active":"2024-05-20T18:00:45.931151+0000","last_peered":"2024-05-20T18:00:45.931151+0000","last_clean":"2024-05-20T18:00:45.931151+0000","last_became_active":"2024-05-20T18:00:44.934607+0000","last_became_peered":"2024-05-20T18:00:44.934607+0000","last_unstale":"2024-05-20T18:00:45.931151+0000","last_undegraded":"2024-05-20T18:00:45.931151+0000","last_fullsized":"2024-05-20T18:00:45.931151+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:16:31.989678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211423+0000","last_change":"2024-05-20T18:00:43.925970+0000","last_active":"2024-05-20T18:00:46.211423+0000","last_peered":"2024-05-20T18:00:46.211423+0000","last_clean":"2024-05-20T18:00:46.211423+0000","last_became_active":"2024-05-20T18:00:43.925355+0000","last_became_peered":"2024-05-20T18:00:43.925355+0000","last_unstale":"2024-05-20T18:00:46.211423+0000","last_undegraded":"2024-05-20T18:00:46.211423+0000","last_fullsized":"2024-05-20T18:00:46.211423+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:39.614458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830501+0000","last_change":"2024-05-20T18:00:44.916205+0000","last_active":"2024-05-20T18:00:46.830501+0000","last_peered":"2024-05-20T18:00:46.830501+0000","last_clean":"2024-05-20T18:00:46.830501+0000","last_became_active":"2024-05-20T18:00:44.915602+0000","last_became_peered":"2024-05-20T18:00:44.915602+0000","last_unstale":"2024-05-20T18:00:46.830501+0000","last_undegraded":"2024-05-20T18:00:46.830501+0000","last_fullsized":"2024-05-20T18:00:46.830501+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:20.677290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831373+0000","last_change":"2024-05-20T18:00:43.925185+0000","last_active":"2024-05-20T18:00:46.831373+0000","last_peered":"2024-05-20T18:00:46.831373+0000","last_clean":"2024-05-20T18:00:46.831373+0000","last_became_active":"2024-05-20T18:00:43.924852+0000","last_became_peered":"2024-05-20T18:00:43.924852+0000","last_unstale":"2024-05-20T18:00:46.831373+0000","last_undegraded":"2024-05-20T18:00:46.831373+0000","last_fullsized":"2024-05-20T18:00:46.831373+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:45.171175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831258+0000","last_change":"2024-05-20T18:00:44.939458+0000","last_active":"2024-05-20T18:00:46.831258+0000","last_peered":"2024-05-20T18:00:46.831258+0000","last_clean":"2024-05-20T18:00:46.831258+0000","last_became_active":"2024-05-20T18:00:44.938949+0000","last_became_peered":"2024-05-20T18:00:44.938949+0000","last_unstale":"2024-05-20T18:00:46.831258+0000","last_undegraded":"2024-05-20T18:00:46.831258+0000","last_fullsized":"2024-05-20T18:00:46.831258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:45:51.054710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211593+0000","last_change":"2024-05-20T18:00:43.921623+0000","last_active":"2024-05-20T18:00:46.211593+0000","last_peered":"2024-05-20T18:00:46.211593+0000","last_clean":"2024-05-20T18:00:46.211593+0000","last_became_active":"2024-05-20T18:00:43.921301+0000","last_became_peered":"2024-05-20T18:00:43.921301+0000","last_unstale":"2024-05-20T18:00:46.211593+0000","last_undegraded":"2024-05-20T18:00:46.211593+0000","last_fullsized":"2024-05-20T18:00:46.211593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:11.332273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211395+0000","last_change":"2024-05-20T18:00:44.929528+0000","last_active":"2024-05-20T18:00:46.211395+0000","last_peered":"2024-05-20T18:00:46.211395+0000","last_clean":"2024-05-20T18:00:46.211395+0000","last_became_active":"2024-05-20T18:00:44.929128+0000","last_became_peered":"2024-05-20T18:00:44.929128+0000","last_unstale":"2024-05-20T18:00:46.211395+0000","last_undegraded":"2024-05-20T18:00:46.211395+0000","last_fullsized":"2024-05-20T18:00:46.211395+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:11.363890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923778+0000","last_change":"2024-05-20T18:00:43.924910+0000","last_active":"2024-05-20T18:00:45.923778+0000","last_peered":"2024-05-20T18:00:45.923778+0000","last_clean":"2024-05-20T18:00:45.923778+0000","last_became_active":"2024-05-20T18:00:43.924572+0000","last_became_peered":"2024-05-20T18:00:43.924572+0000","last_unstale":"2024-05-20T18:00:45.923778+0000","last_undegraded":"2024-05-20T18:00:45.923778+0000","last_fullsized":"2024-05-20T18:00:45.923778+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:20:27.626337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923591+0000","last_change":"2024-05-20T18:00:44.926900+0000","last_active":"2024-05-20T18:00:45.923591+0000","last_peered":"2024-05-20T18:00:45.923591+0000","last_clean":"2024-05-20T18:00:45.923591+0000","last_became_active":"2024-05-20T18:00:44.926595+0000","last_became_peered":"2024-05-20T18:00:44.926595+0000","last_unstale":"2024-05-20T18:00:45.923591+0000","last_undegraded":"2024-05-20T18:00:45.923591+0000","last_fullsized":"2024-05-20T18:00:45.923591+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:05.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930927+0000","last_change":"2024-05-20T18:00:43.930892+0000","last_active":"2024-05-20T18:00:45.930927+0000","last_peered":"2024-05-20T18:00:45.930927+0000","last_clean":"2024-05-20T18:00:45.930927+0000","last_became_active":"2024-05-20T18:00:43.930513+0000","last_became_peered":"2024-05-20T18:00:43.930513+0000","last_unstale":"2024-05-20T18:00:45.930927+0000","last_undegraded":"2024-05-20T18:00:45.930927+0000","last_fullsized":"2024-05-20T18:00:45.930927+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:25:10.565986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923699+0000","last_change":"2024-05-20T18:00:44.916559+0000","last_active":"2024-05-20T18:00:45.923699+0000","last_peered":"2024-05-20T18:00:45.923699+0000","last_clean":"2024-05-20T18:00:45.923699+0000","last_became_active":"2024-05-20T18:00:44.916048+0000","last_became_peered":"2024-05-20T18:00:44.916048+0000","last_unstale":"2024-05-20T18:00:45.923699+0000","last_undegraded":"2024-05-20T18:00:45.923699+0000","last_fullsized":"2024-05-20T18:00:45.923699+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:01.059285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830223+0000","last_change":"2024-05-20T18:00:43.918574+0000","last_active":"2024-05-20T18:00:46.830223+0000","last_peered":"2024-05-20T18:00:46.830223+0000","last_clean":"2024-05-20T18:00:46.830223+0000","last_became_active":"2024-05-20T18:00:43.918240+0000","last_became_peered":"2024-05-20T18:00:43.918240+0000","last_unstale":"2024-05-20T18:00:46.830223+0000","last_undegraded":"2024-05-20T18:00:46.830223+0000","last_fullsized":"2024-05-20T18:00:46.830223+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:55.857139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211584+0000","last_change":"2024-05-20T18:00:44.920994+0000","last_active":"2024-05-20T18:00:46.211584+0000","last_peered":"2024-05-20T18:00:46.211584+0000","last_clean":"2024-05-20T18:00:46.211584+0000","last_became_active":"2024-05-20T18:00:44.920680+0000","last_became_peered":"2024-05-20T18:00:44.920680+0000","last_unstale":"2024-05-20T18:00:46.211584+0000","last_undegraded":"2024-05-20T18:00:46.211584+0000","last_fullsized":"2024-05-20T18:00:46.211584+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:48.596118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931017+0000","last_change":"2024-05-20T18:00:43.926835+0000","last_active":"2024-05-20T18:00:45.931017+0000","last_peered":"2024-05-20T18:00:45.931017+0000","last_clean":"2024-05-20T18:00:45.931017+0000","last_became_active":"2024-05-20T18:00:43.926506+0000","last_became_peered":"2024-05-20T18:00:43.926506+0000","last_unstale":"2024-05-20T18:00:45.931017+0000","last_undegraded":"2024-05-20T18:00:45.931017+0000","last_fullsized":"2024-05-20T18:00:45.931017+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:05:38.827350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.928902+0000","last_change":"2024-05-20T18:00:44.932589+0000","last_active":"2024-05-20T18:00:45.928902+0000","last_peered":"2024-05-20T18:00:45.928902+0000","last_clean":"2024-05-20T18:00:45.928902+0000","last_became_active":"2024-05-20T18:00:44.931832+0000","last_became_peered":"2024-05-20T18:00:44.931832+0000","last_unstale":"2024-05-20T18:00:45.928902+0000","last_undegraded":"2024-05-20T18:00:45.928902+0000","last_fullsized":"2024-05-20T18:00:45.928902+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:15:58.647361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929078+0000","last_change":"2024-05-20T18:00:43.930629+0000","last_active":"2024-05-20T18:00:45.929078+0000","last_peered":"2024-05-20T18:00:45.929078+0000","last_clean":"2024-05-20T18:00:45.929078+0000","last_became_active":"2024-05-20T18:00:43.930367+0000","last_became_peered":"2024-05-20T18:00:43.930367+0000","last_unstale":"2024-05-20T18:00:45.929078+0000","last_undegraded":"2024-05-20T18:00:45.929078+0000","last_fullsized":"2024-05-20T18:00:45.929078+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:05.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830464+0000","last_change":"2024-05-20T18:00:44.918619+0000","last_active":"2024-05-20T18:00:46.830464+0000","last_peered":"2024-05-20T18:00:46.830464+0000","last_clean":"2024-05-20T18:00:46.830464+0000","last_became_active":"2024-05-20T18:00:44.918215+0000","last_became_peered":"2024-05-20T18:00:44.918215+0000","last_unstale":"2024-05-20T18:00:46.830464+0000","last_undegraded":"2024-05-20T18:00:46.830464+0000","last_fullsized":"2024-05-20T18:00:46.830464+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:06.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830396+0000","last_change":"2024-05-20T18:00:43.922933+0000","last_active":"2024-05-20T18:00:46.830396+0000","last_peered":"2024-05-20T18:00:46.830396+0000","last_clean":"2024-05-20T18:00:46.830396+0000","last_became_active":"2024-05-20T18:00:43.922605+0000","last_became_peered":"2024-05-20T18:00:43.922605+0000","last_unstale":"2024-05-20T18:00:46.830396+0000","last_undegraded":"2024-05-20T18:00:46.830396+0000","last_fullsized":"2024-05-20T18:00:46.830396+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:11.332273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923594+0000","last_change":"2024-05-20T18:00:44.923952+0000","last_active":"2024-05-20T18:00:45.923594+0000","last_peered":"2024-05-20T18:00:45.923594+0000","last_clean":"2024-05-20T18:00:45.923594+0000","last_became_active":"2024-05-20T18:00:44.923583+0000","last_became_peered":"2024-05-20T18:00:44.923583+0000","last_unstale":"2024-05-20T18:00:45.923594+0000","last_undegraded":"2024-05-20T18:00:45.923594+0000","last_fullsized":"2024-05-20T18:00:45.923594+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:07:30.355693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"112'3","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830467+0000","last_change":"2024-05-20T18:00:43.920113+0000","last_active":"2024-05-20T18:00:46.830467+0000","last_peered":"2024-05-20T18:00:46.830467+0000","last_clean":"2024-05-20T18:00:46.830467+0000","last_became_active":"2024-05-20T18:00:43.919814+0000","last_became_peered":"2024-05-20T18:00:43.919814+0000","last_unstale":"2024-05-20T18:00:46.830467+0000","last_undegraded":"2024-05-20T18:00:46.830467+0000","last_fullsized":"2024-05-20T18:00:46.830467+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:56:39.614458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831148+0000","last_change":"2024-05-20T18:00:44.927489+0000","last_active":"2024-05-20T18:00:46.831148+0000","last_peered":"2024-05-20T18:00:46.831148+0000","last_clean":"2024-05-20T18:00:46.831148+0000","last_became_active":"2024-05-20T18:00:44.926695+0000","last_became_peered":"2024-05-20T18:00:44.926695+0000","last_unstale":"2024-05-20T18:00:46.831148+0000","last_undegraded":"2024-05-20T18:00:46.831148+0000","last_fullsized":"2024-05-20T18:00:46.831148+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:17:51.213003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"112'6","reported_seq":20,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923356+0000","last_change":"2024-05-20T18:00:43.918943+0000","last_active":"2024-05-20T18:00:45.923356+0000","last_peered":"2024-05-20T18:00:45.923356+0000","last_clean":"2024-05-20T18:00:45.923356+0000","last_became_active":"2024-05-20T18:00:43.918615+0000","last_became_peered":"2024-05-20T18:00:43.918615+0000","last_unstale":"2024-05-20T18:00:45.923356+0000","last_undegraded":"2024-05-20T18:00:45.923356+0000","last_fullsized":"2024-05-20T18:00:45.923356+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:20:34.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929136+0000","last_change":"2024-05-20T18:00:44.939810+0000","last_active":"2024-05-20T18:00:45.929136+0000","last_peered":"2024-05-20T18:00:45.929136+0000","last_clean":"2024-05-20T18:00:45.929136+0000","last_became_active":"2024-05-20T18:00:44.939483+0000","last_became_peered":"2024-05-20T18:00:44.939483+0000","last_unstale":"2024-05-20T18:00:45.929136+0000","last_undegraded":"2024-05-20T18:00:45.929136+0000","last_fullsized":"2024-05-20T18:00:45.929136+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:22:36.316845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923131+0000","last_change":"2024-05-20T18:00:43.916663+0000","last_active":"2024-05-20T18:00:45.923131+0000","last_peered":"2024-05-20T18:00:45.923131+0000","last_clean":"2024-05-20T18:00:45.923131+0000","last_became_active":"2024-05-20T18:00:43.916319+0000","last_became_peered":"2024-05-20T18:00:43.916319+0000","last_unstale":"2024-05-20T18:00:45.923131+0000","last_undegraded":"2024-05-20T18:00:45.923131+0000","last_fullsized":"2024-05-20T18:00:45.923131+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:57.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211440+0000","last_change":"2024-05-20T18:00:44.930600+0000","last_active":"2024-05-20T18:00:46.211440+0000","last_peered":"2024-05-20T18:00:46.211440+0000","last_clean":"2024-05-20T18:00:46.211440+0000","last_became_active":"2024-05-20T18:00:44.930139+0000","last_became_peered":"2024-05-20T18:00:44.930139+0000","last_unstale":"2024-05-20T18:00:46.211440+0000","last_undegraded":"2024-05-20T18:00:46.211440+0000","last_fullsized":"2024-05-20T18:00:46.211440+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:06.550657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923955+0000","last_change":"2024-05-20T18:00:43.919829+0000","last_active":"2024-05-20T18:00:45.923955+0000","last_peered":"2024-05-20T18:00:45.923955+0000","last_clean":"2024-05-20T18:00:45.923955+0000","last_became_active":"2024-05-20T18:00:43.919475+0000","last_became_peered":"2024-05-20T18:00:43.919475+0000","last_unstale":"2024-05-20T18:00:45.923955+0000","last_undegraded":"2024-05-20T18:00:45.923955+0000","last_fullsized":"2024-05-20T18:00:45.923955+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:05.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923901+0000","last_change":"2024-05-20T18:00:44.928456+0000","last_active":"2024-05-20T18:00:45.923901+0000","last_peered":"2024-05-20T18:00:45.923901+0000","last_clean":"2024-05-20T18:00:45.923901+0000","last_became_active":"2024-05-20T18:00:44.928118+0000","last_became_peered":"2024-05-20T18:00:44.928118+0000","last_unstale":"2024-05-20T18:00:45.923901+0000","last_undegraded":"2024-05-20T18:00:45.923901+0000","last_fullsized":"2024-05-20T18:00:45.923901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:56.185096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923154+0000","last_change":"2024-05-20T18:00:43.920720+0000","last_active":"2024-05-20T18:00:45.923154+0000","last_peered":"2024-05-20T18:00:45.923154+0000","last_clean":"2024-05-20T18:00:45.923154+0000","last_became_active":"2024-05-20T18:00:43.918373+0000","last_became_peered":"2024-05-20T18:00:43.918373+0000","last_unstale":"2024-05-20T18:00:45.923154+0000","last_undegraded":"2024-05-20T18:00:45.923154+0000","last_fullsized":"2024-05-20T18:00:45.923154+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:10.358119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830663+0000","last_change":"2024-05-20T18:00:44.928299+0000","last_active":"2024-05-20T18:00:46.830663+0000","last_peered":"2024-05-20T18:00:46.830663+0000","last_clean":"2024-05-20T18:00:46.830663+0000","last_became_active":"2024-05-20T18:00:44.928017+0000","last_became_peered":"2024-05-20T18:00:44.928017+0000","last_unstale":"2024-05-20T18:00:46.830663+0000","last_undegraded":"2024-05-20T18:00:46.830663+0000","last_fullsized":"2024-05-20T18:00:46.830663+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:50.083927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211681+0000","last_change":"2024-05-20T18:00:43.926382+0000","last_active":"2024-05-20T18:00:46.211681+0000","last_peered":"2024-05-20T18:00:46.211681+0000","last_clean":"2024-05-20T18:00:46.211681+0000","last_became_active":"2024-05-20T18:00:43.926047+0000","last_became_peered":"2024-05-20T18:00:43.926047+0000","last_unstale":"2024-05-20T18:00:46.211681+0000","last_undegraded":"2024-05-20T18:00:46.211681+0000","last_fullsized":"2024-05-20T18:00:46.211681+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:55.857139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923948+0000","last_change":"2024-05-20T18:00:44.933817+0000","last_active":"2024-05-20T18:00:45.923948+0000","last_peered":"2024-05-20T18:00:45.923948+0000","last_clean":"2024-05-20T18:00:45.923948+0000","last_became_active":"2024-05-20T18:00:44.933486+0000","last_became_peered":"2024-05-20T18:00:44.933486+0000","last_unstale":"2024-05-20T18:00:45.923948+0000","last_undegraded":"2024-05-20T18:00:45.923948+0000","last_fullsized":"2024-05-20T18:00:45.923948+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:50.083927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924346+0000","last_change":"2024-05-20T18:00:43.923411+0000","last_active":"2024-05-20T18:00:45.924346+0000","last_peered":"2024-05-20T18:00:45.924346+0000","last_clean":"2024-05-20T18:00:45.924346+0000","last_became_active":"2024-05-20T18:00:43.922877+0000","last_became_peered":"2024-05-20T18:00:43.922877+0000","last_unstale":"2024-05-20T18:00:45.924346+0000","last_undegraded":"2024-05-20T18:00:45.924346+0000","last_fullsized":"2024-05-20T18:00:45.924346+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:36:03.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931539+0000","last_change":"2024-05-20T18:00:44.928515+0000","last_active":"2024-05-20T18:00:45.931539+0000","last_peered":"2024-05-20T18:00:45.931539+0000","last_clean":"2024-05-20T18:00:45.931539+0000","last_became_active":"2024-05-20T18:00:44.928193+0000","last_became_peered":"2024-05-20T18:00:44.928193+0000","last_unstale":"2024-05-20T18:00:45.931539+0000","last_undegraded":"2024-05-20T18:00:45.931539+0000","last_fullsized":"2024-05-20T18:00:45.931539+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:07.436232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831378+0000","last_change":"2024-05-20T18:00:43.922858+0000","last_active":"2024-05-20T18:00:46.831378+0000","last_peered":"2024-05-20T18:00:46.831378+0000","last_clean":"2024-05-20T18:00:46.831378+0000","last_became_active":"2024-05-20T18:00:43.922518+0000","last_became_peered":"2024-05-20T18:00:43.922518+0000","last_unstale":"2024-05-20T18:00:46.831378+0000","last_undegraded":"2024-05-20T18:00:46.831378+0000","last_fullsized":"2024-05-20T18:00:46.831378+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:44:19.671519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831057+0000","last_change":"2024-05-20T18:00:44.928137+0000","last_active":"2024-05-20T18:00:46.831057+0000","last_peered":"2024-05-20T18:00:46.831057+0000","last_clean":"2024-05-20T18:00:46.831057+0000","last_became_active":"2024-05-20T18:00:44.927850+0000","last_became_peered":"2024-05-20T18:00:44.927850+0000","last_unstale":"2024-05-20T18:00:46.831057+0000","last_undegraded":"2024-05-20T18:00:46.831057+0000","last_fullsized":"2024-05-20T18:00:46.831057+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:38:04.273979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830804+0000","last_change":"2024-05-20T18:00:43.923354+0000","last_active":"2024-05-20T18:00:46.830804+0000","last_peered":"2024-05-20T18:00:46.830804+0000","last_clean":"2024-05-20T18:00:46.830804+0000","last_became_active":"2024-05-20T18:00:43.922991+0000","last_became_peered":"2024-05-20T18:00:43.922991+0000","last_unstale":"2024-05-20T18:00:46.830804+0000","last_undegraded":"2024-05-20T18:00:46.830804+0000","last_fullsized":"2024-05-20T18:00:46.830804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:04.174703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930790+0000","last_change":"2024-05-20T18:00:44.934121+0000","last_active":"2024-05-20T18:00:45.930790+0000","last_peered":"2024-05-20T18:00:45.930790+0000","last_clean":"2024-05-20T18:00:45.930790+0000","last_became_active":"2024-05-20T18:00:44.933806+0000","last_became_peered":"2024-05-20T18:00:44.933806+0000","last_unstale":"2024-05-20T18:00:45.930790+0000","last_undegraded":"2024-05-20T18:00:45.930790+0000","last_fullsized":"2024-05-20T18:00:45.930790+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:23.119741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931019+0000","last_change":"2024-05-20T18:00:43.925470+0000","last_active":"2024-05-20T18:00:45.931019+0000","last_peered":"2024-05-20T18:00:45.931019+0000","last_clean":"2024-05-20T18:00:45.931019+0000","last_became_active":"2024-05-20T18:00:43.925053+0000","last_became_peered":"2024-05-20T18:00:43.925053+0000","last_unstale":"2024-05-20T18:00:45.931019+0000","last_undegraded":"2024-05-20T18:00:45.931019+0000","last_fullsized":"2024-05-20T18:00:45.931019+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:19:33.044931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.922892+0000","last_change":"2024-05-20T18:00:44.916668+0000","last_active":"2024-05-20T18:00:45.922892+0000","last_peered":"2024-05-20T18:00:45.922892+0000","last_clean":"2024-05-20T18:00:45.922892+0000","last_became_active":"2024-05-20T18:00:44.916308+0000","last_became_peered":"2024-05-20T18:00:44.916308+0000","last_unstale":"2024-05-20T18:00:45.922892+0000","last_undegraded":"2024-05-20T18:00:45.922892+0000","last_fullsized":"2024-05-20T18:00:45.922892+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:28:15.000086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830632+0000","last_change":"2024-05-20T18:00:43.920382+0000","last_active":"2024-05-20T18:00:46.830632+0000","last_peered":"2024-05-20T18:00:46.830632+0000","last_clean":"2024-05-20T18:00:46.830632+0000","last_became_active":"2024-05-20T18:00:43.919923+0000","last_became_peered":"2024-05-20T18:00:43.919923+0000","last_unstale":"2024-05-20T18:00:46.830632+0000","last_undegraded":"2024-05-20T18:00:46.830632+0000","last_fullsized":"2024-05-20T18:00:46.830632+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:05.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923854+0000","last_change":"2024-05-20T18:00:44.924300+0000","last_active":"2024-05-20T18:00:45.923854+0000","last_peered":"2024-05-20T18:00:45.923854+0000","last_clean":"2024-05-20T18:00:45.923854+0000","last_became_active":"2024-05-20T18:00:44.923547+0000","last_became_peered":"2024-05-20T18:00:44.923547+0000","last_unstale":"2024-05-20T18:00:45.923854+0000","last_undegraded":"2024-05-20T18:00:45.923854+0000","last_fullsized":"2024-05-20T18:00:45.923854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:25:11.571758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923255+0000","last_change":"2024-05-20T18:00:43.927113+0000","last_active":"2024-05-20T18:00:45.923255+0000","last_peered":"2024-05-20T18:00:45.923255+0000","last_clean":"2024-05-20T18:00:45.923255+0000","last_became_active":"2024-05-20T18:00:43.926779+0000","last_became_peered":"2024-05-20T18:00:43.926779+0000","last_unstale":"2024-05-20T18:00:45.923255+0000","last_undegraded":"2024-05-20T18:00:45.923255+0000","last_fullsized":"2024-05-20T18:00:45.923255+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:04.174703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830378+0000","last_change":"2024-05-20T18:00:44.926301+0000","last_active":"2024-05-20T18:00:46.830378+0000","last_peered":"2024-05-20T18:00:46.830378+0000","last_clean":"2024-05-20T18:00:46.830378+0000","last_became_active":"2024-05-20T18:00:44.925991+0000","last_became_peered":"2024-05-20T18:00:44.925991+0000","last_unstale":"2024-05-20T18:00:46.830378+0000","last_undegraded":"2024-05-20T18:00:46.830378+0000","last_fullsized":"2024-05-20T18:00:46.830378+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:05.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.829973+0000","last_change":"2024-05-20T18:00:43.923782+0000","last_active":"2024-05-20T18:00:46.829973+0000","last_peered":"2024-05-20T18:00:46.829973+0000","last_clean":"2024-05-20T18:00:46.829973+0000","last_became_active":"2024-05-20T18:00:43.923498+0000","last_became_peered":"2024-05-20T18:00:43.923498+0000","last_unstale":"2024-05-20T18:00:46.829973+0000","last_undegraded":"2024-05-20T18:00:46.829973+0000","last_fullsized":"2024-05-20T18:00:46.829973+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:24:57.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931488+0000","last_change":"2024-05-20T18:00:44.927742+0000","last_active":"2024-05-20T18:00:45.931488+0000","last_peered":"2024-05-20T18:00:45.931488+0000","last_clean":"2024-05-20T18:00:45.931488+0000","last_became_active":"2024-05-20T18:00:44.925867+0000","last_became_peered":"2024-05-20T18:00:44.925867+0000","last_unstale":"2024-05-20T18:00:45.931488+0000","last_undegraded":"2024-05-20T18:00:45.931488+0000","last_fullsized":"2024-05-20T18:00:45.931488+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:35.180867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931391+0000","last_change":"2024-05-20T18:00:43.921058+0000","last_active":"2024-05-20T18:00:45.931391+0000","last_peered":"2024-05-20T18:00:45.931391+0000","last_clean":"2024-05-20T18:00:45.931391+0000","last_became_active":"2024-05-20T18:00:43.920773+0000","last_became_peered":"2024-05-20T18:00:43.920773+0000","last_unstale":"2024-05-20T18:00:45.931391+0000","last_undegraded":"2024-05-20T18:00:45.931391+0000","last_fullsized":"2024-05-20T18:00:45.931391+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:00:39.321443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211421+0000","last_change":"2024-05-20T18:00:44.927555+0000","last_active":"2024-05-20T18:00:46.211421+0000","last_peered":"2024-05-20T18:00:46.211421+0000","last_clean":"2024-05-20T18:00:46.211421+0000","last_became_active":"2024-05-20T18:00:44.927217+0000","last_became_peered":"2024-05-20T18:00:44.927217+0000","last_unstale":"2024-05-20T18:00:46.211421+0000","last_undegraded":"2024-05-20T18:00:46.211421+0000","last_fullsized":"2024-05-20T18:00:46.211421+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:05.180474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"113'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929190+0000","last_change":"2024-05-20T18:00:43.925337+0000","last_active":"2024-05-20T18:00:45.929190+0000","last_peered":"2024-05-20T18:00:45.929190+0000","last_clean":"2024-05-20T18:00:45.929190+0000","last_became_active":"2024-05-20T18:00:43.925036+0000","last_became_peered":"2024-05-20T18:00:43.925036+0000","last_unstale":"2024-05-20T18:00:45.929190+0000","last_undegraded":"2024-05-20T18:00:45.929190+0000","last_fullsized":"2024-05-20T18:00:45.929190+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:04.174703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831039+0000","last_change":"2024-05-20T18:00:44.933673+0000","last_active":"2024-05-20T18:00:46.831039+0000","last_peered":"2024-05-20T18:00:46.831039+0000","last_clean":"2024-05-20T18:00:46.831039+0000","last_became_active":"2024-05-20T18:00:44.933319+0000","last_became_peered":"2024-05-20T18:00:44.933319+0000","last_unstale":"2024-05-20T18:00:46.831039+0000","last_undegraded":"2024-05-20T18:00:46.831039+0000","last_fullsized":"2024-05-20T18:00:46.831039+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:24:47.088602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.929170+0000","last_change":"2024-05-20T18:00:43.927476+0000","last_active":"2024-05-20T18:00:45.929170+0000","last_peered":"2024-05-20T18:00:45.929170+0000","last_clean":"2024-05-20T18:00:45.929170+0000","last_became_active":"2024-05-20T18:00:43.927118+0000","last_became_peered":"2024-05-20T18:00:43.927118+0000","last_unstale":"2024-05-20T18:00:45.929170+0000","last_undegraded":"2024-05-20T18:00:45.929170+0000","last_fullsized":"2024-05-20T18:00:45.929170+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:45.171175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.924259+0000","last_change":"2024-05-20T18:00:44.927847+0000","last_active":"2024-05-20T18:00:45.924259+0000","last_peered":"2024-05-20T18:00:45.924259+0000","last_clean":"2024-05-20T18:00:45.924259+0000","last_became_active":"2024-05-20T18:00:44.927462+0000","last_became_peered":"2024-05-20T18:00:44.927462+0000","last_unstale":"2024-05-20T18:00:45.924259+0000","last_undegraded":"2024-05-20T18:00:45.924259+0000","last_fullsized":"2024-05-20T18:00:45.924259+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:24:06.884277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.931464+0000","last_change":"2024-05-20T18:00:43.928985+0000","last_active":"2024-05-20T18:00:45.931464+0000","last_peered":"2024-05-20T18:00:45.931464+0000","last_clean":"2024-05-20T18:00:45.931464+0000","last_became_active":"2024-05-20T18:00:43.928674+0000","last_became_peered":"2024-05-20T18:00:43.928674+0000","last_unstale":"2024-05-20T18:00:45.931464+0000","last_undegraded":"2024-05-20T18:00:45.931464+0000","last_fullsized":"2024-05-20T18:00:45.931464+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:39:24.373489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930988+0000","last_change":"2024-05-20T18:00:44.926005+0000","last_active":"2024-05-20T18:00:45.930988+0000","last_peered":"2024-05-20T18:00:45.930988+0000","last_clean":"2024-05-20T18:00:45.930988+0000","last_became_active":"2024-05-20T18:00:44.925474+0000","last_became_peered":"2024-05-20T18:00:44.925474+0000","last_unstale":"2024-05-20T18:00:45.930988+0000","last_undegraded":"2024-05-20T18:00:45.930988+0000","last_fullsized":"2024-05-20T18:00:45.930988+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:58:53.575716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923951+0000","last_change":"2024-05-20T18:00:43.917381+0000","last_active":"2024-05-20T18:00:45.923951+0000","last_peered":"2024-05-20T18:00:45.923951+0000","last_clean":"2024-05-20T18:00:45.923951+0000","last_became_active":"2024-05-20T18:00:43.917027+0000","last_became_peered":"2024-05-20T18:00:43.917027+0000","last_unstale":"2024-05-20T18:00:45.923951+0000","last_undegraded":"2024-05-20T18:00:45.923951+0000","last_fullsized":"2024-05-20T18:00:45.923951+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:35:52.896237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923059+0000","last_change":"2024-05-20T18:00:44.928643+0000","last_active":"2024-05-20T18:00:45.923059+0000","last_peered":"2024-05-20T18:00:45.923059+0000","last_clean":"2024-05-20T18:00:45.923059+0000","last_became_active":"2024-05-20T18:00:44.928231+0000","last_became_peered":"2024-05-20T18:00:44.928231+0000","last_unstale":"2024-05-20T18:00:45.923059+0000","last_undegraded":"2024-05-20T18:00:45.923059+0000","last_fullsized":"2024-05-20T18:00:45.923059+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:46:32.655543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.923758+0000","last_change":"2024-05-20T18:00:43.912650+0000","last_active":"2024-05-20T18:00:45.923758+0000","last_peered":"2024-05-20T18:00:45.923758+0000","last_clean":"2024-05-20T18:00:45.923758+0000","last_became_active":"2024-05-20T18:00:43.912307+0000","last_became_peered":"2024-05-20T18:00:43.912307+0000","last_unstale":"2024-05-20T18:00:45.923758+0000","last_undegraded":"2024-05-20T18:00:45.923758+0000","last_fullsized":"2024-05-20T18:00:45.923758+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:22:06.672279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830732+0000","last_change":"2024-05-20T18:00:44.940635+0000","last_active":"2024-05-20T18:00:46.830732+0000","last_peered":"2024-05-20T18:00:46.830732+0000","last_clean":"2024-05-20T18:00:46.830732+0000","last_became_active":"2024-05-20T18:00:44.940287+0000","last_became_peered":"2024-05-20T18:00:44.940287+0000","last_unstale":"2024-05-20T18:00:46.830732+0000","last_undegraded":"2024-05-20T18:00:46.830732+0000","last_fullsized":"2024-05-20T18:00:46.830732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:51:18.647992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.930871+0000","last_change":"2024-05-20T18:00:43.927440+0000","last_active":"2024-05-20T18:00:45.930871+0000","last_peered":"2024-05-20T18:00:45.930871+0000","last_clean":"2024-05-20T18:00:45.930871+0000","last_became_active":"2024-05-20T18:00:43.926940+0000","last_became_peered":"2024-05-20T18:00:43.926940+0000","last_unstale":"2024-05-20T18:00:45.930871+0000","last_undegraded":"2024-05-20T18:00:45.930871+0000","last_fullsized":"2024-05-20T18:00:45.930871+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:29:25.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.211570+0000","last_change":"2024-05-20T18:00:44.929534+0000","last_active":"2024-05-20T18:00:46.211570+0000","last_peered":"2024-05-20T18:00:46.211570+0000","last_clean":"2024-05-20T18:00:46.211570+0000","last_became_active":"2024-05-20T18:00:44.929165+0000","last_became_peered":"2024-05-20T18:00:44.929165+0000","last_unstale":"2024-05-20T18:00:46.211570+0000","last_undegraded":"2024-05-20T18:00:46.211570+0000","last_fullsized":"2024-05-20T18:00:46.211570+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:33:50.083927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830129+0000","last_change":"2024-05-20T18:00:43.922311+0000","last_active":"2024-05-20T18:00:46.830129+0000","last_peered":"2024-05-20T18:00:46.830129+0000","last_clean":"2024-05-20T18:00:46.830129+0000","last_became_active":"2024-05-20T18:00:43.921955+0000","last_became_peered":"2024-05-20T18:00:43.921955+0000","last_unstale":"2024-05-20T18:00:46.830129+0000","last_undegraded":"2024-05-20T18:00:46.830129+0000","last_fullsized":"2024-05-20T18:00:46.830129+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:10.358119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.831019+0000","last_change":"2024-05-20T18:00:44.939642+0000","last_active":"2024-05-20T18:00:46.831019+0000","last_peered":"2024-05-20T18:00:46.831019+0000","last_clean":"2024-05-20T18:00:46.831019+0000","last_became_active":"2024-05-20T18:00:44.939350+0000","last_became_peered":"2024-05-20T18:00:44.939350+0000","last_unstale":"2024-05-20T18:00:46.831019+0000","last_undegraded":"2024-05-20T18:00:46.831019+0000","last_fullsized":"2024-05-20T18:00:46.831019+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:43.897434+0000","last_clean_scrub_stamp":"2024-05-20T18:00:43.897434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:46:32.655543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"112'8","reported_seq":22,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:45.922808+0000","last_change":"2024-05-20T18:00:43.922085+0000","last_active":"2024-05-20T18:00:45.922808+0000","last_peered":"2024-05-20T18:00:45.922808+0000","last_clean":"2024-05-20T18:00:45.922808+0000","last_became_active":"2024-05-20T18:00:43.917629+0000","last_became_peered":"2024-05-20T18:00:43.917629+0000","last_unstale":"2024-05-20T18:00:45.922808+0000","last_undegraded":"2024-05-20T18:00:45.922808+0000","last_fullsized":"2024-05-20T18:00:45.922808+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:00:42.891662+0000","last_clean_scrub_stamp":"2024-05-20T18:00:42.891662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:24:29.952702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":340,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-05-20T18:00:46.830345+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:00:46.830345+0000","last_peered":"2024-05-20T18:00:46.830345+0000","last_clean":"2024-05-20T18:00:46.830345+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:00:46.830345+0000","last_undegraded":"2024-05-20T18:00:46.830345+0000","last_fullsized":"2024-05-20T18:00:46.830345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2019328,"data_stored":1242685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1413120,"data_stored":652123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1417216,"data_stored":651701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1421312,"data_stored":653153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1425408,"data_stored":653187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1409024,"data_stored":651541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":651563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":2007040,"data_stored":1241931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:00:53.896 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T18:00:53.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T18:00:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.021+0000 7fdf9405f640 1 Processor -- start 2024-05-20T18:00:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.021+0000 7fdf9405f640 1 -- start start 2024-05-20T18:00:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf9405f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf8c06d3d0 0x7fdf8c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf9405f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8c06dd20 con 0x7fdf8c0b8190 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf9405f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8c0d0630 con 0x7fdf8c162820 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf9405f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdf8c0d39c0 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf915fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf8c06d3d0 0x7fdf8c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf925fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdf8c0b8190 0x7fdf8c0b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54276/0 (socket says 172.21.15.6:54276) 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf925fc640 1 -- 172.21.15.6:0/266205736 learned_addr learned my addr 172.21.15.6:0/266205736 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf915fa640 1 -- 172.21.15.6:0/266205736 >> v1:172.21.15.171:6789/0 conn(0x7fdf8c162820 legacy=0x7fdf8c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf915fa640 1 -- 172.21.15.6:0/266205736 >> v1:172.21.15.6:6789/0 conn(0x7fdf8c0b8190 legacy=0x7fdf8c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf90df9640 1 -- 172.21.15.6:0/266205736 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009863816 0 0) 0x7fdf84001490 con 0x7fdf8c0b8190 2024-05-20T18:00:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.023+0000 7fdf915fa640 1 -- 172.21.15.6:0/266205736 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c0d3ca0 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.024+0000 7fdf915fa640 1 --2- 172.21.15.6:0/266205736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c06d7e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0097a0 tx=0x7fdf7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97dd06310011447b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.024+0000 7fdf90df9640 1 -- 172.21.15.6:0/266205736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c037070 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.024+0000 7fdf90df9640 1 -- 172.21.15.6:0/266205736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c032440 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.024+0000 7fdf90df9640 1 -- 172.21.15.6:0/266205736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c032810 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.025+0000 7fdf9405f640 1 -- 172.21.15.6:0/266205736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 msgr2=0x7fdf8c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.025+0000 7fdf9405f640 1 --2- 172.21.15.6:0/266205736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c06d7e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0097a0 tx=0x7fdf7c02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.025+0000 7fdf9405f640 1 -- 172.21.15.6:0/266205736 shutdown_connections 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.025+0000 7fdf9405f640 1 --2- 172.21.15.6:0/266205736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c06d7e0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.025+0000 7fdf9405f640 1 -- 172.21.15.6:0/266205736 >> 172.21.15.6:0/266205736 conn(0x7fdf8c0d4bd0 msgr2=0x7fdf8c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.025+0000 7fdf9405f640 1 -- 172.21.15.6:0/266205736 shutdown_connections 2024-05-20T18:00:54.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.025+0000 7fdf9405f640 1 -- 172.21.15.6:0/266205736 wait complete. 2024-05-20T18:00:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.027+0000 7fdf9405f640 1 Processor -- start 2024-05-20T18:00:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.027+0000 7fdf9405f640 1 -- start start 2024-05-20T18:00:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf9405f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf9405f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf8c0b8190 0x7fdf8c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf9405f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf8c162820 0x7fdf8c0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf9405f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c0d0300 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf9405f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c0d42e0 con 0x7fdf8c162820 2024-05-20T18:00:54.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf9405f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8c0b4050 con 0x7fdf8c0b8190 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf91dfb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf91dfb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49544/0 (socket says 172.21.15.6:49544) 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.028+0000 7fdf91dfb640 1 -- 172.21.15.6:0/2606548336 learned_addr learned my addr 172.21.15.6:0/2606548336 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf925fc640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf8c162820 0x7fdf8c0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf915fa640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf8c0b8190 0x7fdf8c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf91dfb640 1 -- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf8c0b8190 msgr2=0x7fdf8c0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf91dfb640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf8c0b8190 0x7fdf8c0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf91dfb640 1 -- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf8c162820 msgr2=0x7fdf8c0ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf91dfb640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf8c162820 0x7fdf8c0ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf91dfb640 1 -- 172.21.15.6:0/2606548336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8c0b5040 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf925fc640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf8c162820 0x7fdf8c0ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf915fa640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf8c0b8190 0x7fdf8c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf91dfb640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c153f40 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800b420 tx=0x7fdf8800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf827fc640 1 -- 172.21.15.6:0/2606548336 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88011830 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf827fc640 1 -- 172.21.15.6:0/2606548336 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf88016070 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf8c0b5320 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf827fc640 1 -- 172.21.15.6:0/2606548336 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88011c10 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.029+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf8c1583a0 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.030+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf8c075b00 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.031+0000 7fdf827fc640 1 -- 172.21.15.6:0/2606548336 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf8801b460 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.032+0000 7fdf827fc640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf7006be30 0x7fdf7006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.032+0000 7fdf827fc640 1 -- 172.21.15.6:0/2606548336 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fdf8808ae00 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.032+0000 7fdf915fa640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf7006be30 0x7fdf7006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.033+0000 7fdf915fa640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf7006be30 0x7fdf7006e340 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c034000 tx=0x7fdf7c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.036+0000 7fdf827fc640 1 -- 172.21.15.6:0/2606548336 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdf88059510 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.294+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdf8c0d5330 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.298+0000 7fdf827fc640 1 -- 172.21.15.6:0/2606548336 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fdf88058e10 con 0x7fdf8c06d3d0 2024-05-20T18:00:54.297 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T18:00:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T18:00:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T18:00:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T18:00:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T18:00:54.298 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T18:00:54.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.301+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf7006be30 msgr2=0x7fdf7006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.301+0000 7fdf9405f640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf7006be30 0x7fdf7006e340 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c034000 tx=0x7fdf7c02e000 comp rx=0 tx=0).stop 2024-05-20T18:00:54.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.301+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 msgr2=0x7fdf8c153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.301+0000 7fdf9405f640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c153f40 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800b420 tx=0x7fdf8800b8e0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.302+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 shutdown_connections 2024-05-20T18:00:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.302+0000 7fdf9405f640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdf7006be30 0x7fdf7006e340 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.302+0000 7fdf9405f640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf8c162820 0x7fdf8c0ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.302+0000 7fdf9405f640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdf8c0b8190 0x7fdf8c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.302+0000 7fdf9405f640 1 --2- 172.21.15.6:0/2606548336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf8c06d3d0 0x7fdf8c153f40 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.302+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 >> 172.21.15.6:0/2606548336 conn(0x7fdf8c0d4bd0 msgr2=0x7fdf8c15fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.302+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 shutdown_connections 2024-05-20T18:00:54.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.302+0000 7fdf9405f640 1 -- 172.21.15.6:0/2606548336 wait complete. 2024-05-20T18:00:54.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:00:54.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.429+0000 7f8c4f2e9640 1 Processor -- start 2024-05-20T18:00:54.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.429+0000 7f8c4f2e9640 1 -- start start 2024-05-20T18:00:54.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.430+0000 7f8c4f2e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 0x7f8c480cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.430+0000 7f8c4f2e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c480cf910 0x7f8c480d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.430+0000 7f8c4f2e9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c480cfd20 con 0x7f8c480cd680 2024-05-20T18:00:54.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.430+0000 7f8c4f2e9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8c480cda90 con 0x7f8c480cf910 2024-05-20T18:00:54.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.430+0000 7f8c4f2e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4806d0f0 con 0x7f8c4815f220 2024-05-20T18:00:54.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.430+0000 7f8c4d886640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c480cf910 0x7f8c480d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.430+0000 7f8c4d886640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c480cf910 0x7f8c480d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49558/0 (socket says 172.21.15.6:49558) 2024-05-20T18:00:54.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.430+0000 7f8c4d886640 1 -- 172.21.15.6:0/3648000866 learned_addr learned my addr 172.21.15.6:0/3648000866 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:54.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.431+0000 7f8c4c884640 1 --2- 172.21.15.6:0/3648000866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 0x7f8c480cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.431+0000 7f8c4d886640 1 -- 172.21.15.6:0/3648000866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 msgr2=0x7f8c480cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:54.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.431+0000 7f8c4d886640 1 --2- 172.21.15.6:0/3648000866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 0x7f8c480cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.431+0000 7f8c4d886640 1 -- 172.21.15.6:0/3648000866 >> v1:172.21.15.171:6789/0 conn(0x7f8c480cd680 legacy=0x7f8c4806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.431+0000 7f8c4d886640 1 -- 172.21.15.6:0/3648000866 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4806d3d0 con 0x7f8c480cf910 2024-05-20T18:00:54.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c4d886640 1 --2- 172.21.15.6:0/3648000866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cf910 0x7f8c480d1060 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009e50 tx=0x7f8c4002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e16a330280f192a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:54.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c3bfff640 1 -- 172.21.15.6:0/3648000866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40036070 con 0x7f8c480cf910 2024-05-20T18:00:54.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c3bfff640 1 -- 172.21.15.6:0/3648000866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c40031600 con 0x7f8c480cf910 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c3bfff640 1 -- 172.21.15.6:0/3648000866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c400319d0 con 0x7f8c480cf910 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/3648000866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cf910 msgr2=0x7f8c480d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/3648000866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cf910 0x7f8c480d1060 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009e50 tx=0x7f8c4002a680 comp rx=0 tx=0).stop 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/3648000866 shutdown_connections 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/3648000866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cf910 0x7f8c480d1060 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/3648000866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 0x7f8c480cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.432+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/3648000866 >> 172.21.15.6:0/3648000866 conn(0x7f8c480b44d0 msgr2=0x7f8c480b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.433+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/3648000866 shutdown_connections 2024-05-20T18:00:54.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.433+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/3648000866 wait complete. 2024-05-20T18:00:54.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.434+0000 7f8c4f2e9640 1 Processor -- start 2024-05-20T18:00:54.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.434+0000 7f8c4f2e9640 1 -- start start 2024-05-20T18:00:54.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4f2e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cd680 0x7f8c480b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4f2e9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c480cf910 0x7f8c48157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4f2e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 0x7f8c480b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4f2e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4806d990 con 0x7f8c480cd680 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4f2e9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480d0b40 con 0x7f8c480cf910 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4f2e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4806cdd0 con 0x7f8c4815f220 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cd680 0x7f8c480b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cd680 0x7f8c480b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49566/0 (socket says 172.21.15.6:49566) 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 -- 172.21.15.6:0/416360608 learned_addr learned my addr 172.21.15.6:0/416360608 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4c884640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c480cf910 0x7f8c48157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d886640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 0x7f8c480b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 -- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 msgr2=0x7f8c480b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 0x7f8c480b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 -- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c480cf910 msgr2=0x7f8c48157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c480cf910 0x7f8c48157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 -- 172.21.15.6:0/416360608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c480b7bc0 con 0x7f8c480cd680 2024-05-20T18:00:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.436+0000 7f8c4d085640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cd680 0x7f8c480b7680 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c440 tx=0x7f8c4400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.437+0000 7f8c39ffb640 1 -- 172.21.15.6:0/416360608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c440052d0 con 0x7f8c480cd680 2024-05-20T18:00:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.437+0000 7f8c39ffb640 1 -- 172.21.15.6:0/416360608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c44005470 con 0x7f8c480cd680 2024-05-20T18:00:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.437+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c480b80d0 con 0x7f8c480cd680 2024-05-20T18:00:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.437+0000 7f8c39ffb640 1 -- 172.21.15.6:0/416360608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44007260 con 0x7f8c480cd680 2024-05-20T18:00:54.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.437+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c481f8fd0 con 0x7f8c480cd680 2024-05-20T18:00:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.438+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c48075b00 con 0x7f8c480cd680 2024-05-20T18:00:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.438+0000 7f8c39ffb640 1 -- 172.21.15.6:0/416360608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c440074c0 con 0x7f8c480cd680 2024-05-20T18:00:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.439+0000 7f8c39ffb640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2c06be30 0x7f8c2c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.439+0000 7f8c39ffb640 1 -- 172.21.15.6:0/416360608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f8c4408a400 con 0x7f8c480cd680 2024-05-20T18:00:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.440+0000 7f8c4c884640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2c06be30 0x7f8c2c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.440+0000 7f8c4c884640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2c06be30 0x7f8c2c06e340 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8c481f8e90 tx=0x7f8c3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:54.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.444+0000 7f8c39ffb640 1 -- 172.21.15.6:0/416360608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8c480cfd20 con 0x7f8c480cd680 2024-05-20T18:00:54.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.664+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c480ccfc0 con 0x7f8c480cd680 2024-05-20T18:00:54.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.665+0000 7f8c39ffb640 1 -- 172.21.15.6:0/416360608 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5177 (secure 0 0 0) 0x7f8c44058540 con 0x7f8c480cd680 2024-05-20T18:00:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:00:54.663 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:00:47.310018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:00:54.663 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 74 2024-05-20T18:00:54.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2c06be30 msgr2=0x7f8c2c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2c06be30 0x7f8c2c06e340 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8c481f8e90 tx=0x7f8c3c008040 comp rx=0 tx=0).stop 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cd680 msgr2=0x7f8c480b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cd680 0x7f8c480b7680 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c440 tx=0x7f8c4400c900 comp rx=0 tx=0).stop 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 shutdown_connections 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c2c06be30 0x7f8c2c06e340 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c4815f220 0x7f8c480b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c480cf910 0x7f8c48157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 --2- 172.21.15.6:0/416360608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c480cd680 0x7f8c480b7680 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 >> 172.21.15.6:0/416360608 conn(0x7f8c480b44d0 msgr2=0x7f8c480d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 shutdown_connections 2024-05-20T18:00:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:54.667+0000 7f8c4f2e9640 1 -- 172.21.15.6:0/416360608 wait complete. 2024-05-20T18:00:55.080 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T18:00:44.304102+0000', 'modified': '2024-05-20T18:00:47.310018+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8118}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8118': {'gid': 8118, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6834/3266600943', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 3266600943}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 3266600943}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8118, 'qdb_cluster': [8118]} 2024-05-20T18:00:55.080 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T18:00:55.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-20T18:00:55.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.202+0000 7fc57e5ce640 1 Processor -- start 2024-05-20T18:00:55.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.203+0000 7fc57e5ce640 1 -- start start 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc57e5ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc578162820 0x7fc5780b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc57e5ce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5780b3e80 0x7fc57806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc57e5ce640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc57806dd20 con 0x7fc57806d910 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc57e5ce640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc5780d0630 con 0x7fc5780b3e80 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc57e5ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5780d39c0 con 0x7fc578162820 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc56ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5780b3e80 0x7fc57806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc56ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5780b3e80 0x7fc57806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49576/0 (socket says 172.21.15.6:49576) 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc57cb6b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc57806d910 0x7fc5780d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54282/0 (socket says 172.21.15.6:54282) 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc56ffff640 1 -- 172.21.15.6:0/3044081594 learned_addr learned my addr 172.21.15.6:0/3044081594 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:55.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc577fff640 1 --2- 172.21.15.6:0/3044081594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc578162820 0x7fc5780b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc56ffff640 1 -- 172.21.15.6:0/3044081594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc578162820 msgr2=0x7fc5780b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc56ffff640 1 --2- 172.21.15.6:0/3044081594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc578162820 0x7fc5780b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.204+0000 7fc56ffff640 1 -- 172.21.15.6:0/3044081594 >> v1:172.21.15.6:6789/0 conn(0x7fc57806d910 legacy=0x7fc5780d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.205+0000 7fc5777fe640 1 -- 172.21.15.6:0/3044081594 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286519315 0 0) 0x7fc570001490 con 0x7fc57806d910 2024-05-20T18:00:55.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.205+0000 7fc56ffff640 1 -- 172.21.15.6:0/3044081594 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5780d3ca0 con 0x7fc5780b3e80 2024-05-20T18:00:55.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.205+0000 7fc577fff640 1 --2- 172.21.15.6:0/3044081594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc578162820 0x7fc5780b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:55.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.205+0000 7fc56ffff640 1 --2- 172.21.15.6:0/3044081594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5780b3e80 0x7fc57806d3d0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fc560009870 tx=0x7fc56002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ec61e80e70b95f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.205+0000 7fc5777fe640 1 -- 172.21.15.6:0/3044081594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560037070 con 0x7fc5780b3e80 2024-05-20T18:00:55.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.205+0000 7fc5777fe640 1 -- 172.21.15.6:0/3044081594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560032440 con 0x7fc5780b3e80 2024-05-20T18:00:55.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc5777fe640 1 -- 172.21.15.6:0/3044081594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560032810 con 0x7fc5780b3e80 2024-05-20T18:00:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3044081594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5780b3e80 msgr2=0x7fc57806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3044081594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5780b3e80 0x7fc57806d3d0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fc560009870 tx=0x7fc56002a270 comp rx=0 tx=0).stop 2024-05-20T18:00:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3044081594 shutdown_connections 2024-05-20T18:00:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3044081594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5780b3e80 0x7fc57806d3d0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3044081594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc578162820 0x7fc5780b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3044081594 >> 172.21.15.6:0/3044081594 conn(0x7fc5780d4bd0 msgr2=0x7fc5780d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3044081594 shutdown_connections 2024-05-20T18:00:55.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.206+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3044081594 wait complete. 2024-05-20T18:00:55.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.208+0000 7fc57e5ce640 1 Processor -- start 2024-05-20T18:00:55.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.208+0000 7fc57e5ce640 1 -- start start 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.209+0000 7fc57e5ce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57806d910 0x7fc57814af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.209+0000 7fc57e5ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5780b3e80 0x7fc5780ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.209+0000 7fc57e5ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc578162820 0x7fc57814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.209+0000 7fc57e5ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5780d0300 con 0x7fc578162820 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57e5ce640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5780d4260 con 0x7fc57806d910 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57e5ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5780b91a0 con 0x7fc5780b3e80 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc578162820 0x7fc57814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc578162820 0x7fc57814d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49588/0 (socket says 172.21.15.6:49588) 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 -- 172.21.15.6:0/3860789900 learned_addr learned my addr 172.21.15.6:0/3860789900 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc56ffff640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5780b3e80 0x7fc5780ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc577fff640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57806d910 0x7fc57814af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 -- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5780b3e80 msgr2=0x7fc5780ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5780b3e80 0x7fc5780ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 -- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57806d910 msgr2=0x7fc57814af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57806d910 0x7fc57814af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 -- 172.21.15.6:0/3860789900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57814b480 con 0x7fc578162820 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc578162820 0x7fc57814d7f0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c730 tx=0x7fc57000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc5757fa640 1 -- 172.21.15.6:0/3860789900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570018070 con 0x7fc578162820 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc5757fa640 1 -- 172.21.15.6:0/3860789900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57000ce40 con 0x7fc578162820 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3860789900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57814bb40 con 0x7fc578162820 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc5757fa640 1 -- 172.21.15.6:0/3860789900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57000a860 con 0x7fc578162820 2024-05-20T18:00:55.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.210+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3860789900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57814c100 con 0x7fc578162820 2024-05-20T18:00:55.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.212+0000 7fc5757fa640 1 -- 172.21.15.6:0/3860789900 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc57001b070 con 0x7fc578162820 2024-05-20T18:00:55.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.213+0000 7fc5757fa640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc55806be30 0x7fc55806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.213+0000 7fc5757fa640 1 -- 172.21.15.6:0/3860789900 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fc57008a580 con 0x7fc578162820 2024-05-20T18:00:55.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.213+0000 7fc577fff640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc55806be30 0x7fc55806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.214+0000 7fc577fff640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc55806be30 0x7fc55806e340 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc568006fd0 tx=0x7fc568008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.214+0000 7fc585476740 1 Processor -- start 2024-05-20T18:00:55.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.214+0000 7fc585476740 1 -- start start 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc585476740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d77270 0x560895142700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc585476740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 0x56089513f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc585476740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x560895118360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc585476740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x56089507b4d0 con 0x560894d56590 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc585476740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5608950233e0 con 0x560894d77270 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc585476740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x560895077490 con 0x560894d4e3b0 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc57cb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x560895118360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc57cb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x560895118360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49604/0 (socket says 172.21.15.6:49604) 2024-05-20T18:00:55.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc57cb6b640 1 -- 172.21.15.6:0/2720042713 learned_addr learned my addr 172.21.15.6:0/2720042713 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc56ffff640 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 0x56089513f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc577fff640 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d77270 0x560895142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc57cb6b640 1 -- 172.21.15.6:0/2720042713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 msgr2=0x56089513f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 0x56089513f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc57cb6b640 1 -- 172.21.15.6:0/2720042713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d77270 msgr2=0x560895142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d77270 0x560895142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.215+0000 7fc57cb6b640 1 -- 172.21.15.6:0/2720042713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560894d8f2d0 con 0x560894d56590 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.216+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x560895118360 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc5700888b0 tx=0x7fc570058300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96a23b3a8f6dd89 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.216+0000 7fc56dffb640 1 -- 172.21.15.6:0/2720042713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570056990 con 0x560894d56590 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.216+0000 7fc56dffb640 1 -- 172.21.15.6:0/2720042713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570054d00 con 0x560894d56590 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.216+0000 7fc56dffb640 1 -- 172.21.15.6:0/2720042713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57005ddf0 con 0x560894d56590 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 -- 172.21.15.6:0/2720042713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 msgr2=0x560895118360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x560895118360 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc5700888b0 tx=0x7fc570058300 comp rx=0 tx=0).stop 2024-05-20T18:00:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 -- 172.21.15.6:0/2720042713 shutdown_connections 2024-05-20T18:00:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x560895118360 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 0x56089513f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 --2- 172.21.15.6:0/2720042713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d77270 0x560895142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 -- 172.21.15.6:0/2720042713 >> 172.21.15.6:0/2720042713 conn(0x560894d6b3c0 msgr2=0x560895117af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 -- 172.21.15.6:0/2720042713 shutdown_connections 2024-05-20T18:00:55.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 -- 172.21.15.6:0/2720042713 wait complete. 2024-05-20T18:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.217+0000 7fc585476740 1 -- start start 2024-05-20T18:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.218+0000 7fc585476740 1 Processor -- start 2024-05-20T18:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc585476740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 0x560895141f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc585476740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d56590 0x5608951451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc585476740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951456f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc585476740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x5608950368e0 con 0x560894d77270 2024-05-20T18:00:55.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc585476740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560895140770 con 0x560894d4e3b0 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc585476740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x5608951444a0 con 0x560894d56590 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc585476740 10 client.0 _ll_register_callbacks cb 0x5608950039c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc57cb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc57cb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49618/0 (socket says 172.21.15.6:49618) 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc57cb6b640 1 -- 172.21.15.6:0/3260301106 learned_addr learned my addr 172.21.15.6:0/3260301106 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc577fff640 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 0x560895141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.219+0000 7fc56ffff640 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d56590 0x5608951451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc57cb6b640 1 -- 172.21.15.6:0/3260301106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d56590 msgr2=0x5608951451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d56590 0x5608951451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc57cb6b640 1 -- 172.21.15.6:0/3260301106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 msgr2=0x560895141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 0x560895141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc57cb6b640 1 -- 172.21.15.6:0/3260301106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560894e596b0 con 0x560894d77270 2024-05-20T18:00:55.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951456f0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc57000a430 tx=0x7fc57005b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a64b6708aa32c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc556ffd640 1 -- 172.21.15.6:0/3260301106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57008a2c0 con 0x560894d77270 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc556ffd640 1 -- 172.21.15.6:0/3260301106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fc570057ae0 con 0x560894d77270 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc585476740 1 -- 172.21.15.6:0/3260301106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc570054d00 con 0x560894d77270 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc556ffd640 1 -- 172.21.15.6:0/3260301106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fc570057ce0 con 0x560894d77270 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc585476740 10 client.8283 fetch_fsmap learned FSMap version 74 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc585476740 1 -- 172.21.15.6:0/3260301106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x5608951404b0 con 0x560894d77270 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc556ffd640 1 -- 172.21.15.6:0/3260301106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc570054d00 con 0x560894d77270 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc556ffd640 1 -- 172.21.15.6:0/3260301106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fc570088ce0 con 0x560894d77270 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc585476740 10 client.8283 fetch_fsmap finished waiting for FSMap version 74 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc585476740 10 client.8283 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc585476740 20 client.8283 populate_metadata read hostname 'smithi006' 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.220+0000 7fc585476740 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] conn(0x560894d35e40 0x56089516fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.221+0000 7fc585476740 4 client.8283 mds_command: new command op to 8118 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.221+0000 7fc585476740 1 -- 172.21.15.6:0/3260301106 --> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560895088c00 con 0x560894d35e40 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.221+0000 7fc577fff640 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] conn(0x560894d35e40 0x56089516fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.221+0000 7fc556ffd640 10 client.8283 ms_handle_connect on v2:172.21.15.6:6832/3266600943 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.221+0000 7fc577fff640 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] conn(0x560894d35e40 0x56089516fb10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a24bcae9b2ddd1f server_cookie=151fbc10d869673c in_seq=0 out_seq=0 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc556ffd640 1 -- 172.21.15.6:0/3260301106 <== mds.0 v2:172.21.15.6:6832/3266600943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560895088c00 con 0x560894d35e40 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc556ffd640 10 client.8283 handle_command_reply: tid=0 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 client.8283 shutdown 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 -- 172.21.15.6:0/3260301106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 msgr2=0x5608951456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951456f0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc57000a430 tx=0x7fc57005b040 comp rx=0 tx=0).stop 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 -- 172.21.15.6:0/3260301106 shutdown_connections 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] conn(0x560894d35e40 0x56089516fb10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951456f0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d56590 0x5608951451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 --2- 172.21.15.6:0/3260301106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 0x560895141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc556ffd640 0 client.8283 ms_handle_reset on v2:172.21.15.6:6832/3266600943 2024-05-20T18:00:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 -- 172.21.15.6:0/3260301106 >> 172.21.15.6:0/3260301106 conn(0x560894d6b3c0 msgr2=0x560895117af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 -- 172.21.15.6:0/3260301106 shutdown_connections 2024-05-20T18:00:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 1 -- 172.21.15.6:0/3260301106 wait complete. 2024-05-20T18:00:55.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.222+0000 7fc585476740 20 client.8283 trim_cache size 0 max 16384 2024-05-20T18:00:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.241+0000 7fc585476740 1 Processor -- start 2024-05-20T18:00:55.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.242+0000 7fc585476740 1 -- start start 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc585476740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 0x5608951190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc585476740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d56590 0x560895143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc585476740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc585476740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc578201490 con 0x560894d77270 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc585476740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5780ca510 con 0x560894d56590 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc585476740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc57814d3c0 con 0x560894d4e3b0 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49626/0 (socket says 172.21.15.6:49626) 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 -- 172.21.15.6:0/730777175 learned_addr learned my addr 172.21.15.6:0/730777175 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc56ffff640 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d56590 0x560895143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc577fff640 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 0x5608951190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 -- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 msgr2=0x5608951190f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 0x5608951190f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 -- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d56590 msgr2=0x560895143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d56590 0x560895143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 -- 172.21.15.6:0/730777175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560895116a00 con 0x560894d77270 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc56ffff640 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d56590 0x560895143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951436b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c700 tx=0x7fc570006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136bc7e3447187d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.243+0000 7fc56d7fa640 1 -- 172.21.15.6:0/730777175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570054d00 con 0x560894d77270 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc56d7fa640 1 -- 172.21.15.6:0/730777175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57008a0c0 con 0x560894d77270 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc56d7fa640 1 -- 172.21.15.6:0/730777175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57006ce00 con 0x560894d77270 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 -- 172.21.15.6:0/730777175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 msgr2=0x5608951436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951436b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c700 tx=0x7fc570006040 comp rx=0 tx=0).stop 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 -- 172.21.15.6:0/730777175 shutdown_connections 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d77270 0x5608951436b0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d56590 0x560895143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 --2- 172.21.15.6:0/730777175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d4e3b0 0x5608951190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 -- 172.21.15.6:0/730777175 >> 172.21.15.6:0/730777175 conn(0x560894d6b3c0 msgr2=0x560895141d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:55.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 -- 172.21.15.6:0/730777175 shutdown_connections 2024-05-20T18:00:55.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.244+0000 7fc585476740 1 -- 172.21.15.6:0/730777175 wait complete. 2024-05-20T18:00:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.245+0000 7fc585476740 1 -- start start 2024-05-20T18:00:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.245+0000 7fc585476740 1 Processor -- start 2024-05-20T18:00:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc585476740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 0x56089513d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc585476740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x56089513d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc585476740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d77270 0x5608951dc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc585476740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x560895143fa0 con 0x560894d56590 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc585476740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560895140070 con 0x560894d4e3b0 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc585476740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x56089515bcd0 con 0x560894d77270 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc585476740 10 client.0 _ll_register_callbacks cb 0x7fc56800b600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x56089513d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x56089513d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49642/0 (socket says 172.21.15.6:49642) 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 -- 172.21.15.6:0/2031051365 learned_addr learned my addr 172.21.15.6:0/2031051365 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc577fff640 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 0x56089513d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc57cb6b640 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d77270 0x5608951dc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 -- 172.21.15.6:0/2031051365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d77270 msgr2=0x5608951dc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d77270 0x5608951dc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 -- 172.21.15.6:0/2031051365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 msgr2=0x56089513d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 0x56089513d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 -- 172.21.15.6:0/2031051365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560895111220 con 0x560894d56590 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc56ffff640 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x56089513d930 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fc560009870 tx=0x7fc560004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2080dd035717db server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.247+0000 7fc556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc556ffd640 1 -- 172.21.15.6:0/2031051365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56004d060 con 0x560894d56590 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 1 -- 172.21.15.6:0/2031051365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc57008a0c0 con 0x560894d56590 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc556ffd640 1 -- 172.21.15.6:0/2031051365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fc560003820 con 0x560894d56590 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc556ffd640 1 -- 172.21.15.6:0/2031051365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fc560053050 con 0x560894d56590 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 10 client.8289 fetch_fsmap learned FSMap version 74 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 1 -- 172.21.15.6:0/2031051365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x56089516f310 con 0x560894d56590 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc556ffd640 1 -- 172.21.15.6:0/2031051365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc57008a0c0 con 0x560894d56590 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc556ffd640 1 -- 172.21.15.6:0/2031051365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fc560056020 con 0x560894d56590 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 10 client.8289 fetch_fsmap finished waiting for FSMap version 74 2024-05-20T18:00:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 10 client.8289 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 20 client.8289 populate_metadata read hostname 'smithi006' 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] conn(0x5608951dd3a0 0x560895117ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 4 client.8289 mds_command: new command op to 8118 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc585476740 1 -- 172.21.15.6:0/2031051365 --> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] -- command(tid 0: {"prefix": "status"}) -- 0x560895082f50 con 0x5608951dd3a0 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.248+0000 7fc577fff640 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] conn(0x5608951dd3a0 0x560895117ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc556ffd640 10 client.8289 ms_handle_connect on v2:172.21.15.6:6832/3266600943 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc577fff640 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] conn(0x5608951dd3a0 0x560895117ad0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79c833a3a64d9e92 server_cookie=8abac9c3af3fb6db in_seq=0 out_seq=0 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc556ffd640 1 -- 172.21.15.6:0/2031051365 <== mds.0 v2:172.21.15.6:6832/3266600943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x560895082f50 con 0x5608951dd3a0 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc556ffd640 10 client.8289 handle_command_reply: tid=0 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 client.8289 shutdown 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 -- 172.21.15.6:0/2031051365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 msgr2=0x56089513d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x56089513d930 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fc560009870 tx=0x7fc560004730 comp rx=0 tx=0).stop 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 -- 172.21.15.6:0/2031051365 shutdown_connections 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.6:6832/3266600943,v1:172.21.15.6:6834/3266600943] conn(0x5608951dd3a0 0x560895117ad0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x560894d77270 0x5608951dc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560894d56590 0x56089513d930 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 --2- 172.21.15.6:0/2031051365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560894d4e3b0 0x56089513d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc556ffd640 0 client.8289 ms_handle_reset on v2:172.21.15.6:6832/3266600943 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 -- 172.21.15.6:0/2031051365 >> 172.21.15.6:0/2031051365 conn(0x560894d6b3c0 msgr2=0x560895180070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 -- 172.21.15.6:0/2031051365 shutdown_connections 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 1 -- 172.21.15.6:0/2031051365 wait complete. 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.249+0000 7fc585476740 20 client.8289 trim_cache size 0 max 16384 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T18:00:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8118, 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.334240787000001, 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 74, 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 113, 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 113, 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.298224360999999 2024-05-20T18:00:55.254 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:00:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc55806be30 msgr2=0x7fc55806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc55806be30 0x7fc55806e340 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc568006fd0 tx=0x7fc568008040 comp rx=0 tx=0).stop 2024-05-20T18:00:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3860789900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc578162820 msgr2=0x7fc57814d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc578162820 0x7fc57814d7f0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c730 tx=0x7fc57000cbf0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3860789900 shutdown_connections 2024-05-20T18:00:55.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc55806be30 0x7fc55806e340 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc578162820 0x7fc57814d7f0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5780b3e80 0x7fc5780ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 --2- 172.21.15.6:0/3860789900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc57806d910 0x7fc57814af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3860789900 >> 172.21.15.6:0/3860789900 conn(0x7fc5780d4bd0 msgr2=0x7fc5780b8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3860789900 shutdown_connections 2024-05-20T18:00:55.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.250+0000 7fc57e5ce640 1 -- 172.21.15.6:0/3860789900 wait complete. 2024-05-20T18:00:55.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:00:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.377+0000 7fc9d88d7640 1 Processor -- start 2024-05-20T18:00:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.377+0000 7fc9d88d7640 1 -- start start 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d88d7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d88d7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9d40b8190 0x7fc9d40b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d88d7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9d406dd20 con 0x7fc9d4162820 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d88d7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc9d40d0630 con 0x7fc9d40b8190 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d88d7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d40d39c0 con 0x7fc9d406d3d0 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d1d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d2d9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9d40b8190 0x7fc9d40b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d259c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc9d4162820 0x7fc9d40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:34022/0 (socket says 172.21.15.6:34022) 2024-05-20T18:00:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d259c640 1 -- 172.21.15.6:0/321812531 learned_addr learned my addr 172.21.15.6:0/321812531 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d159a640 1 -- 172.21.15.6:0/321812531 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881421929 0 0) 0x7fc9c4001110 con 0x7fc9d4162820 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d159a640 1 -- 172.21.15.6:0/321812531 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9bc003520 con 0x7fc9d4162820 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d1d9b640 1 -- 172.21.15.6:0/321812531 >> v2:172.21.15.171:3300/0 conn(0x7fc9d40b8190 msgr2=0x7fc9d40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d1d9b640 1 --2- 172.21.15.6:0/321812531 >> v2:172.21.15.171:3300/0 conn(0x7fc9d40b8190 0x7fc9d40b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d1d9b640 1 -- 172.21.15.6:0/321812531 >> v1:172.21.15.171:6789/0 conn(0x7fc9d4162820 legacy=0x7fc9d40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d1d9b640 1 -- 172.21.15.6:0/321812531 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d40d3ca0 con 0x7fc9d406d3d0 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.379+0000 7fc9d2d9d640 1 --2- 172.21.15.6:0/321812531 >> v2:172.21.15.171:3300/0 conn(0x7fc9d40b8190 0x7fc9d40b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.380+0000 7fc9d1d9b640 1 --2- 172.21.15.6:0/321812531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d406d7e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80097a0 tx=0x7fc9c802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37143558432470e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.380+0000 7fc9d159a640 1 -- 172.21.15.6:0/321812531 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8037070 con 0x7fc9d406d3d0 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.380+0000 7fc9d159a640 1 -- 172.21.15.6:0/321812531 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c8032440 con 0x7fc9d406d3d0 2024-05-20T18:00:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.380+0000 7fc9d159a640 1 -- 172.21.15.6:0/321812531 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8032810 con 0x7fc9d406d3d0 2024-05-20T18:00:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.381+0000 7fc9d88d7640 1 -- 172.21.15.6:0/321812531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 msgr2=0x7fc9d406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.381+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/321812531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d406d7e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80097a0 tx=0x7fc9c802a180 comp rx=0 tx=0).stop 2024-05-20T18:00:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.381+0000 7fc9d88d7640 1 -- 172.21.15.6:0/321812531 shutdown_connections 2024-05-20T18:00:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.381+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/321812531 >> v2:172.21.15.171:3300/0 conn(0x7fc9d40b8190 0x7fc9d40b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.381+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/321812531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d406d7e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.381+0000 7fc9d88d7640 1 -- 172.21.15.6:0/321812531 >> 172.21.15.6:0/321812531 conn(0x7fc9d40d4bd0 msgr2=0x7fc9d40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.381+0000 7fc9d88d7640 1 -- 172.21.15.6:0/321812531 shutdown_connections 2024-05-20T18:00:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.381+0000 7fc9d88d7640 1 -- 172.21.15.6:0/321812531 wait complete. 2024-05-20T18:00:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.383+0000 7fc9d88d7640 1 Processor -- start 2024-05-20T18:00:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.383+0000 7fc9d88d7640 1 -- start start 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.384+0000 7fc9d88d7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d41e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.384+0000 7fc9d88d7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d40b8190 0x7fc9d414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.384+0000 7fc9d88d7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9d4162820 0x7fc9d414bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d88d7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d40d0300 con 0x7fc9d4162820 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d88d7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d40d4260 con 0x7fc9d40b8190 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d88d7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d40b4050 con 0x7fc9d406d3d0 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9d4162820 0x7fc9d414bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9d4162820 0x7fc9d414bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49648/0 (socket says 172.21.15.6:49648) 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 -- 172.21.15.6:0/1372289704 learned_addr learned my addr 172.21.15.6:0/1372289704 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d1d9b640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d40b8190 0x7fc9d414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d259c640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d41e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 -- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 msgr2=0x7fc9d41e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d41e8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 -- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d40b8190 msgr2=0x7fc9d414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d40b8190 0x7fc9d414f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 -- 172.21.15.6:0/1372289704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d414f600 con 0x7fc9d4162820 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9d2d9d640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9d4162820 0x7fc9d414bd20 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00ef90 tx=0x7fc9cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.385+0000 7fc9c2ffd640 1 -- 172.21.15.6:0/1372289704 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc018020 con 0x7fc9d4162820 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.386+0000 7fc9c2ffd640 1 -- 172.21.15.6:0/1372289704 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9cc014480 con 0x7fc9d4162820 2024-05-20T18:00:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.386+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d414cbe0 con 0x7fc9d4162820 2024-05-20T18:00:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.386+0000 7fc9c2ffd640 1 -- 172.21.15.6:0/1372289704 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc014850 con 0x7fc9d4162820 2024-05-20T18:00:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.386+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d414d1a0 con 0x7fc9d4162820 2024-05-20T18:00:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.386+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d414c950 con 0x7fc9d4162820 2024-05-20T18:00:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.387+0000 7fc9c2ffd640 1 -- 172.21.15.6:0/1372289704 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9cc005d10 con 0x7fc9d4162820 2024-05-20T18:00:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.388+0000 7fc9c2ffd640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9b406be30 0x7fc9b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.388+0000 7fc9c2ffd640 1 -- 172.21.15.6:0/1372289704 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fc9cc08bbd0 con 0x7fc9d4162820 2024-05-20T18:00:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.388+0000 7fc9d259c640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9b406be30 0x7fc9b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.389+0000 7fc9d259c640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9b406be30 0x7fc9b406e340 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005880 tx=0x7fc9c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.392+0000 7fc9c2ffd640 1 -- 172.21.15.6:0/1372289704 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc9cc022030 con 0x7fc9d4162820 2024-05-20T18:00:55.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.616+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc9d4075b00 con 0x7fc9d4162820 2024-05-20T18:00:55.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.616+0000 7fc9c2ffd640 1 -- 172.21.15.6:0/1372289704 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) ==== 53+0+73 (secure 0 0 0) 0x7fc9cc010040 con 0x7fc9d4162820 2024-05-20T18:00:55.615 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9b406be30 msgr2=0x7fc9b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9b406be30 0x7fc9b406e340 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4005880 tx=0x7fc9c4009040 comp rx=0 tx=0).stop 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9d4162820 msgr2=0x7fc9d414bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9d4162820 0x7fc9d414bd20 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc00ef90 tx=0x7fc9cc00c490 comp rx=0 tx=0).stop 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 shutdown_connections 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc9b406be30 0x7fc9b406e340 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9d4162820 0x7fc9d414bd20 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9d40b8190 0x7fc9d414f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 --2- 172.21.15.6:0/1372289704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9d406d3d0 0x7fc9d41e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 >> 172.21.15.6:0/1372289704 conn(0x7fc9d40d4bd0 msgr2=0x7fc9d40b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 shutdown_connections 2024-05-20T18:00:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55.618+0000 7fc9d88d7640 1 -- 172.21.15.6:0/1372289704 wait complete. 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:00:55.628 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:00:55.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:55.629 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T18:00:55.645 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:00:55.645 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:00:55.645 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T18:00:55.646 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42258sec preferred_lft 42258sec 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T18:00:55.647 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T18:00:55.648 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:55.648 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:00:55.648 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T18:00:55.648 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T18:00:55.648 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:55.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:55.648 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:00:55.710 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T18:00:55.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:55.712 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T18:00:55.769 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T18:00:55.769 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:00:55.769 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T18:00:55.769 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T18:00:55.769 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:00:55.769 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:00:55.770 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T18:00:55.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T18:00:55.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T18:00:55.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T18:00:55.770 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T18:00:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:00:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:55.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:55.900 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T18:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T18:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T18:00:55.916 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:00:55.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:55.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T18:00:55.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:00:55.982 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:56.038 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:00:56.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:00:56.038 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:56.093 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T18:00:56.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:56.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:56.190 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:56.190 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:00:56.212 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:56.212 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:00:56.212 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:00:56.212 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:00:56.212 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:00:56.212 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T18:00:56.213 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:00:56.213 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:00:56.213 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:00:56.213 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:00:56.214 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:00:56.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:56.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:00:56.240 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:00:56.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:00:56.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:56.344 INFO:teuthology.orchestra.run.smithi006.stdout:client7612 2024-05-20T18:00:56.344 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:56.344 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:56.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:00:56.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.517+0000 7fddc1dce640 1 Processor -- start 2024-05-20T18:00:56.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.517+0000 7fddc1dce640 1 -- start start 2024-05-20T18:00:56.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddc1dce640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fddbc0b4010 0x7fddbc0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:56.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddc1dce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fddbc0d14b0 0x7fddbc0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:56.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddc1dce640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddbc0d0370 con 0x7fddbc163a10 2024-05-20T18:00:56.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddc1dce640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fddbc0d3ca0 con 0x7fddbc0d14b0 2024-05-20T18:00:56.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddc1dce640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fddbc0d0650 con 0x7fddbc0b4010 2024-05-20T18:00:56.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fddbc0d14b0 0x7fddbc0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:56.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fddbc0d14b0 0x7fddbc0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49664/0 (socket says 172.21.15.6:49664) 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbbfff640 1 -- 172.21.15.6:0/1733898443 learned_addr learned my addr 172.21.15.6:0/1733898443 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbaffd640 1 --2- 172.21.15.6:0/1733898443 >> v2:172.21.15.171:3300/0 conn(0x7fddbc0b4010 0x7fddbc0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbbfff640 1 -- 172.21.15.6:0/1733898443 >> v2:172.21.15.171:3300/0 conn(0x7fddbc0b4010 msgr2=0x7fddbc0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbbfff640 1 --2- 172.21.15.6:0/1733898443 >> v2:172.21.15.171:3300/0 conn(0x7fddbc0b4010 0x7fddbc0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbbfff640 1 -- 172.21.15.6:0/1733898443 >> v1:172.21.15.171:6789/0 conn(0x7fddbc163a10 legacy=0x7fddbc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbbfff640 1 -- 172.21.15.6:0/1733898443 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc0d3650 con 0x7fddbc0d14b0 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.519+0000 7fddbaffd640 1 --2- 172.21.15.6:0/1733898443 >> v2:172.21.15.171:3300/0 conn(0x7fddbc0b4010 0x7fddbc0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.520+0000 7fddbbfff640 1 --2- 172.21.15.6:0/1733898443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0d14b0 0x7fddbc0d18c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0b7f80 tx=0x7fddb402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7f429cbbe2b8fd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.520+0000 7fddba7fc640 1 -- 172.21.15.6:0/1733898443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4036070 con 0x7fddbc0d14b0 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.520+0000 7fddba7fc640 1 -- 172.21.15.6:0/1733898443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb4031600 con 0x7fddbc0d14b0 2024-05-20T18:00:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.520+0000 7fddba7fc640 1 -- 172.21.15.6:0/1733898443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb40319d0 con 0x7fddbc0d14b0 2024-05-20T18:00:56.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.521+0000 7fddc1dce640 1 -- 172.21.15.6:0/1733898443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0d14b0 msgr2=0x7fddbc0d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:56.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.521+0000 7fddc1dce640 1 --2- 172.21.15.6:0/1733898443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0d14b0 0x7fddbc0d18c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0b7f80 tx=0x7fddb402a6f0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.521+0000 7fddc1dce640 1 -- 172.21.15.6:0/1733898443 shutdown_connections 2024-05-20T18:00:56.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.521+0000 7fddc1dce640 1 --2- 172.21.15.6:0/1733898443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0d14b0 0x7fddbc0d18c0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.521+0000 7fddc1dce640 1 --2- 172.21.15.6:0/1733898443 >> v2:172.21.15.171:3300/0 conn(0x7fddbc0b4010 0x7fddbc0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.521+0000 7fddc1dce640 1 -- 172.21.15.6:0/1733898443 >> 172.21.15.6:0/1733898443 conn(0x7fddbc06d240 msgr2=0x7fddbc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:56.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.521+0000 7fddc1dce640 1 -- 172.21.15.6:0/1733898443 shutdown_connections 2024-05-20T18:00:56.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.521+0000 7fddc1dce640 1 -- 172.21.15.6:0/1733898443 wait complete. 2024-05-20T18:00:56.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.523+0000 7fddc1dce640 1 Processor -- start 2024-05-20T18:00:56.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.523+0000 7fddc1dce640 1 -- start start 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddc1dce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0b4010 0x7fddbc149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddc1dce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddbc0d14b0 0x7fddbc148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddc1dce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddbc163a10 0x7fddbc147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddc1dce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc0b8210 con 0x7fddbc0b4010 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddc1dce640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc0d1e00 con 0x7fddbc163a10 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddc1dce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fddbc0b8390 con 0x7fddbc0d14b0 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddbb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0b4010 0x7fddbc149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddbb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0b4010 0x7fddbc149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49672/0 (socket says 172.21.15.6:49672) 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddbb7fe640 1 -- 172.21.15.6:0/4028751385 learned_addr learned my addr 172.21.15.6:0/4028751385 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddbbfff640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddbc163a10 0x7fddbc147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.524+0000 7fddbaffd640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddbc0d14b0 0x7fddbc148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddbb7fe640 1 -- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddbc0d14b0 msgr2=0x7fddbc148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddbb7fe640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddbc0d14b0 0x7fddbc148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddbb7fe640 1 -- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddbc163a10 msgr2=0x7fddbc147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddbb7fe640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddbc163a10 0x7fddbc147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddbb7fe640 1 -- 172.21.15.6:0/4028751385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc148cd0 con 0x7fddbc0b4010 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddbbfff640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddbc163a10 0x7fddbc147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddbb7fe640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0b4010 0x7fddbc149d70 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fddac00b3f0 tx=0x7fddac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fdda3fff640 1 -- 172.21.15.6:0/4028751385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac015020 con 0x7fddbc0b4010 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fdda3fff640 1 -- 172.21.15.6:0/4028751385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddac011830 con 0x7fddbc0b4010 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc148fb0 con 0x7fddbc0b4010 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fdda3fff640 1 -- 172.21.15.6:0/4028751385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac011c00 con 0x7fddbc0b4010 2024-05-20T18:00:56.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.525+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc149570 con 0x7fddbc0b4010 2024-05-20T18:00:56.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.526+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc075b00 con 0x7fddbc0b4010 2024-05-20T18:00:56.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.527+0000 7fdda3fff640 1 -- 172.21.15.6:0/4028751385 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddac018020 con 0x7fddbc0b4010 2024-05-20T18:00:56.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.527+0000 7fdda3fff640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdda806be60 0x7fdda806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:56.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.527+0000 7fdda3fff640 1 -- 172.21.15.6:0/4028751385 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fddac08a9e0 con 0x7fddbc0b4010 2024-05-20T18:00:56.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.528+0000 7fddbaffd640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdda806be60 0x7fdda806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:56.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.528+0000 7fddbaffd640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdda806be60 0x7fdda806e370 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fddbc1e8cb0 tx=0x7fddb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:56.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.532+0000 7fdda3fff640 1 -- 172.21.15.6:0/4028751385 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fddac01f070 con 0x7fddbc0b4010 2024-05-20T18:00:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.755+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fddbc0d3050 con 0x7fddbc0b4010 2024-05-20T18:00:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.755+0000 7fdda3fff640 1 -- 172.21.15.6:0/4028751385 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) ==== 53+0+73 (secure 0 0 0) 0x7fddac059200 con 0x7fddbc0b4010 2024-05-20T18:00:56.754 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdda806be60 msgr2=0x7fdda806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdda806be60 0x7fdda806e370 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fddbc1e8cb0 tx=0x7fddb0008040 comp rx=0 tx=0).stop 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0b4010 msgr2=0x7fddbc149d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0b4010 0x7fddbc149d70 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fddac00b3f0 tx=0x7fddac00b8b0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 shutdown_connections 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdda806be60 0x7fdda806e370 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddbc163a10 0x7fddbc147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddbc0d14b0 0x7fddbc148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 --2- 172.21.15.6:0/4028751385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddbc0b4010 0x7fddbc149d70 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 >> 172.21.15.6:0/4028751385 conn(0x7fddbc06d240 msgr2=0x7fddbc0b92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 shutdown_connections 2024-05-20T18:00:56.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:56.757+0000 7fddc1dce640 1 -- 172.21.15.6:0/4028751385 wait complete. 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:00:56.767 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:00:56.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:56.768 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T18:00:56.788 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42268sec preferred_lft 42268sec 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:00:56.789 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T18:00:56.790 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:00:56.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:56.791 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:00:56.855 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T18:00:56.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:56.857 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T18:00:56.915 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T18:00:56.915 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:00:56.915 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T18:00:56.915 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T18:00:56.915 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:00:56.915 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:00:56.915 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T18:00:56.915 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T18:00:56.916 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T18:00:56.916 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T18:00:56.916 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T18:00:57.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:00:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:00:57.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:00:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:57.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:57.048 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T18:00:57.063 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T18:00:57.063 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T18:00:57.063 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:00:57.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:57.064 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T18:00:57.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:00:57.128 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:57.183 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:00:57.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:00:57.184 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:57.239 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T18:00:57.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:57.239 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:57.333 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:57.333 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:00:57.346 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:00:57.346 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:00:57.346 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:00:57.346 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:00:57.346 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:00:57.347 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T18:00:57.347 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:00:57.347 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:00:57.347 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:00:57.347 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:00:57.349 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:00:57.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:00:57.349 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:00:57.373 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:00:57.462 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:00:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:00:57.464 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:00:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:57.469 INFO:teuthology.orchestra.run.smithi171.stdout:client7618 2024-05-20T18:00:57.470 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:00:57.470 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:57.485 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-05-20T18:00:57.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.620+0000 7f01a7656640 1 Processor -- start 2024-05-20T18:00:57.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.620+0000 7f01a7656640 1 -- start start 2024-05-20T18:00:57.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.621+0000 7f01a7656640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f01a00cf250 0x7f01a015f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.621+0000 7f01a7656640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a00d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.621+0000 7f01a7656640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a00d0550 con 0x7f01a00b6680 2024-05-20T18:00:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.621+0000 7f01a7656640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f01a015f9a0 con 0x7f01a00cf250 2024-05-20T18:00:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.621+0000 7f01a7656640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f01a00d0b10 con 0x7f01a00d3220 2024-05-20T18:00:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a53f2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f01a00cf250 0x7f01a015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a5bf3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a00d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a4bf1640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f01a00b6680 0x7f01a00b6a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:34038/0 (socket says 172.21.15.6:34038) 2024-05-20T18:00:57.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a4bf1640 1 -- 172.21.15.6:0/2305888226 learned_addr learned my addr 172.21.15.6:0/2305888226 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a53f2640 1 -- 172.21.15.6:0/2305888226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 msgr2=0x7f01a00d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a53f2640 1 --2- 172.21.15.6:0/2305888226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a00d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a53f2640 1 -- 172.21.15.6:0/2305888226 >> v1:172.21.15.171:6789/0 conn(0x7f01a00b6680 legacy=0x7f01a00b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a53f2640 1 -- 172.21.15.6:0/2305888226 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a00d0830 con 0x7f01a00cf250 2024-05-20T18:00:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f019ffff640 1 -- 172.21.15.6:0/2305888226 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083095226 0 0) 0x7f01a00d0550 con 0x7f01a00b6680 2024-05-20T18:00:57.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.622+0000 7f01a5bf3640 1 --2- 172.21.15.6:0/2305888226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a00d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:57.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.623+0000 7f01a53f2640 1 --2- 172.21.15.6:0/2305888226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00cf250 0x7f01a015f460 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f01980097a0 tx=0x7f019802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d05c2649623e13f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:57.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.623+0000 7f019ffff640 1 -- 172.21.15.6:0/2305888226 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198037070 con 0x7f01a00cf250 2024-05-20T18:00:57.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.623+0000 7f019ffff640 1 -- 172.21.15.6:0/2305888226 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0198032440 con 0x7f01a00cf250 2024-05-20T18:00:57.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.623+0000 7f019ffff640 1 -- 172.21.15.6:0/2305888226 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198032810 con 0x7f01a00cf250 2024-05-20T18:00:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.624+0000 7f01a7656640 1 -- 172.21.15.6:0/2305888226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00cf250 msgr2=0x7f01a015f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.624+0000 7f01a7656640 1 --2- 172.21.15.6:0/2305888226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00cf250 0x7f01a015f460 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f01980097a0 tx=0x7f019802a180 comp rx=0 tx=0).stop 2024-05-20T18:00:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.624+0000 7f01a7656640 1 -- 172.21.15.6:0/2305888226 shutdown_connections 2024-05-20T18:00:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.624+0000 7f01a7656640 1 --2- 172.21.15.6:0/2305888226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a00d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.624+0000 7f01a7656640 1 --2- 172.21.15.6:0/2305888226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00cf250 0x7f01a015f460 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.624+0000 7f01a7656640 1 -- 172.21.15.6:0/2305888226 >> 172.21.15.6:0/2305888226 conn(0x7f01a00d1860 msgr2=0x7f01a00d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.624+0000 7f01a7656640 1 -- 172.21.15.6:0/2305888226 shutdown_connections 2024-05-20T18:00:57.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.624+0000 7f01a7656640 1 -- 172.21.15.6:0/2305888226 wait complete. 2024-05-20T18:00:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.626+0000 7f01a7656640 1 Processor -- start 2024-05-20T18:00:57.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.626+0000 7f01a7656640 1 -- start start 2024-05-20T18:00:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a7656640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00b6680 0x7f01a00ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a7656640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00cf250 0x7f01a0161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a7656640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a7656640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f01a00d2d00 con 0x7f01a00cf250 2024-05-20T18:00:57.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a7656640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f01a00d27d0 con 0x7f01a00b6680 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a7656640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f01a00d0140 con 0x7f01a00d3220 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a4bf1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00cf250 0x7f01a0161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a4bf1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00cf250 0x7f01a0161a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49682/0 (socket says 172.21.15.6:49682) 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a4bf1640 1 -- 172.21.15.6:0/803135455 learned_addr learned my addr 172.21.15.6:0/803135455 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a5bf3640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.627+0000 7f01a53f2640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00b6680 0x7f01a00ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f01a4bf1640 1 -- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 msgr2=0x7f01a015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f01a4bf1640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a015dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f01a4bf1640 1 -- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00b6680 msgr2=0x7f01a00ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f01a4bf1640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00b6680 0x7f01a00ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f01a4bf1640 1 -- 172.21.15.6:0/803135455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a01625b0 con 0x7f01a00cf250 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f01a4bf1640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00cf250 0x7f01a0161a40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f019400c7c0 tx=0x7f019400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:57.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f019dffb640 1 -- 172.21.15.6:0/803135455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194018070 con 0x7f01a00cf250 2024-05-20T18:00:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f019dffb640 1 -- 172.21.15.6:0/803135455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019400a5e0 con 0x7f01a00cf250 2024-05-20T18:00:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a0162890 con 0x7f01a00cf250 2024-05-20T18:00:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f019dffb640 1 -- 172.21.15.6:0/803135455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019400a9d0 con 0x7f01a00cf250 2024-05-20T18:00:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.628+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a0151630 con 0x7f01a00cf250 2024-05-20T18:00:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.629+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a0075b00 con 0x7f01a00cf250 2024-05-20T18:00:57.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.630+0000 7f019dffb640 1 -- 172.21.15.6:0/803135455 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f019401b070 con 0x7f01a00cf250 2024-05-20T18:00:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.630+0000 7f019dffb640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f018c06be60 0x7f018c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.630+0000 7f019dffb640 1 -- 172.21.15.6:0/803135455 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f019408a560 con 0x7f01a00cf250 2024-05-20T18:00:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.631+0000 7f01a53f2640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f018c06be60 0x7f018c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.631+0000 7f01a53f2640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f018c06be60 0x7f018c06e370 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0198034000 tx=0x7f019802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:57.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.635+0000 7f019dffb640 1 -- 172.21.15.6:0/803135455 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0194058e10 con 0x7f01a00cf250 2024-05-20T18:00:57.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.818+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f01a00b7440 con 0x7f01a00cf250 2024-05-20T18:00:57.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.822+0000 7f019dffb640 1 -- 172.21.15.6:0/803135455 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v37)=0 v37) ==== 121+0+0 (secure 0 0 0) 0x7f0194058710 con 0x7f01a00cf250 2024-05-20T18:00:57.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f018c06be60 msgr2=0x7f018c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f018c06be60 0x7f018c06e370 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0198034000 tx=0x7f019802e000 comp rx=0 tx=0).stop 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00cf250 msgr2=0x7f01a0161a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00cf250 0x7f01a0161a40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f019400c7c0 tx=0x7f019400cc80 comp rx=0 tx=0).stop 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 shutdown_connections 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f018c06be60 0x7f018c06e370 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01a00d3220 0x7f01a015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00cf250 0x7f01a0161a40 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 --2- 172.21.15.6:0/803135455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01a00b6680 0x7f01a00ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 >> 172.21.15.6:0/803135455 conn(0x7f01a00d1860 msgr2=0x7f01a00d3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 shutdown_connections 2024-05-20T18:00:57.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.824+0000 7f01a7656640 1 -- 172.21.15.6:0/803135455 wait complete. 2024-05-20T18:00:57.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 400 2024-05-20T18:00:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.953+0000 7f717146c640 1 Processor -- start 2024-05-20T18:00:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.953+0000 7f717146c640 1 -- start start 2024-05-20T18:00:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.954+0000 7f717146c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.954+0000 7f717146c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f716c06dd20 con 0x7f716c0b8190 2024-05-20T18:00:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.954+0000 7f717146c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f716c0d0630 con 0x7f716c162820 2024-05-20T18:00:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.954+0000 7f717146c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f716c0d39c0 con 0x7f716c06d3d0 2024-05-20T18:00:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f716b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f716c0b8190 0x7f716c0b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43454/0 (socket says 172.21.15.6:43454) 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f716b7fe640 1 -- 172.21.15.6:0/3436318615 learned_addr learned my addr 172.21.15.6:0/3436318615 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f716a7fc640 1 --2- 172.21.15.6:0/3436318615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f7169ffb640 1 -- 172.21.15.6:0/3436318615 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787027894 0 0) 0x7f7164001110 con 0x7f716c0b8190 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f7169ffb640 1 -- 172.21.15.6:0/3436318615 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7154003520 con 0x7f716c0b8190 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f7169ffb640 1 -- 172.21.15.6:0/3436318615 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680586448 0 0) 0x7f716c0d0630 con 0x7f716c162820 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f7169ffb640 1 -- 172.21.15.6:0/3436318615 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7164001110 con 0x7f716c162820 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f716a7fc640 1 -- 172.21.15.6:0/3436318615 >> v1:172.21.15.171:6789/0 conn(0x7f716c162820 legacy=0x7f716c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f716a7fc640 1 -- 172.21.15.6:0/3436318615 >> v1:172.21.15.6:6789/0 conn(0x7f716c0b8190 legacy=0x7f716c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.955+0000 7f716a7fc640 1 -- 172.21.15.6:0/3436318615 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c0d3ca0 con 0x7f716c06d3d0 2024-05-20T18:00:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.956+0000 7f716a7fc640 1 --2- 172.21.15.6:0/3436318615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c06d7e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7160009dc0 tx=0x7f716002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c701bc31e9d15913 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.957+0000 7f7169ffb640 1 -- 172.21.15.6:0/3436318615 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160007740 con 0x7f716c06d3d0 2024-05-20T18:00:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.957+0000 7f7169ffb640 1 -- 172.21.15.6:0/3436318615 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71600078e0 con 0x7f716c06d3d0 2024-05-20T18:00:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.957+0000 7f7169ffb640 1 -- 172.21.15.6:0/3436318615 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160007cb0 con 0x7f716c06d3d0 2024-05-20T18:00:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.958+0000 7f717146c640 1 -- 172.21.15.6:0/3436318615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 msgr2=0x7f716c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.958+0000 7f717146c640 1 --2- 172.21.15.6:0/3436318615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c06d7e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7160009dc0 tx=0x7f716002a6d0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.958+0000 7f717146c640 1 -- 172.21.15.6:0/3436318615 shutdown_connections 2024-05-20T18:00:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.958+0000 7f717146c640 1 --2- 172.21.15.6:0/3436318615 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c06d7e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.958+0000 7f717146c640 1 -- 172.21.15.6:0/3436318615 >> 172.21.15.6:0/3436318615 conn(0x7f716c0d4bd0 msgr2=0x7f716c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:57.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.958+0000 7f717146c640 1 -- 172.21.15.6:0/3436318615 shutdown_connections 2024-05-20T18:00:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.958+0000 7f717146c640 1 -- 172.21.15.6:0/3436318615 wait complete. 2024-05-20T18:00:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.960+0000 7f717146c640 1 Processor -- start 2024-05-20T18:00:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.960+0000 7f717146c640 1 -- start start 2024-05-20T18:00:57.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.961+0000 7f717146c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.961+0000 7f717146c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f716c0b8190 0x7f716c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.961+0000 7f717146c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c162820 0x7f716c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.961+0000 7f717146c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f716c0d0300 con 0x7f716c162820 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.961+0000 7f717146c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f716c0d4260 con 0x7f716c0b8190 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f717146c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f716c0b4050 con 0x7f716c06d3d0 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c162820 0x7f716c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c162820 0x7f716c0cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52954/0 (socket says 172.21.15.6:52954) 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716affd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716a7fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f716c0b8190 0x7f716c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 -- 172.21.15.6:0/1542394503 learned_addr learned my addr 172.21.15.6:0/1542394503 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 -- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 msgr2=0x7f716c15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c15bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 -- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f716c0b8190 msgr2=0x7f716c0ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f716c0b8190 0x7f716c0ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 -- 172.21.15.6:0/1542394503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c1f5710 con 0x7f716c162820 2024-05-20T18:00:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716affd640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716a7fc640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f716c0b8190 0x7f716c0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.962+0000 7f716b7fe640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c162820 0x7f716c0cddb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f716400c730 tx=0x7f716400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.964+0000 7f71537fe640 1 -- 172.21.15.6:0/1542394503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164017070 con 0x7f716c162820 2024-05-20T18:00:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.964+0000 7f71537fe640 1 -- 172.21.15.6:0/1542394503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7164005ab0 con 0x7f716c162820 2024-05-20T18:00:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.964+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716c1f59f0 con 0x7f716c162820 2024-05-20T18:00:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.964+0000 7f71537fe640 1 -- 172.21.15.6:0/1542394503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164007070 con 0x7f716c162820 2024-05-20T18:00:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.964+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716c1f5fb0 con 0x7f716c162820 2024-05-20T18:00:57.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.965+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716c075b00 con 0x7f716c162820 2024-05-20T18:00:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.965+0000 7f71537fe640 1 -- 172.21.15.6:0/1542394503 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f716401a070 con 0x7f716c162820 2024-05-20T18:00:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.966+0000 7f71537fe640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f715806be30 0x7f715806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.966+0000 7f71537fe640 1 -- 172.21.15.6:0/1542394503 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f716408a4d0 con 0x7f716c162820 2024-05-20T18:00:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.966+0000 7f716affd640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f715806be30 0x7f715806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:57.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.967+0000 7f716affd640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f715806be30 0x7f715806e340 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f715c007fd0 tx=0x7f715c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:57.971+0000 7f71537fe640 1 -- 172.21.15.6:0/1542394503 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f716c06dd20 con 0x7f716c162820 2024-05-20T18:00:58.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.155+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f716c068810 con 0x7f716c162820 2024-05-20T18:00:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.160+0000 7f71537fe640 1 -- 172.21.15.6:0/1542394503 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v38)=0 v38) ==== 119+0+0 (secure 0 0 0) 0x7f7164058610 con 0x7f716c162820 2024-05-20T18:00:58.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f715806be30 msgr2=0x7f715806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f715806be30 0x7f715806e340 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f715c007fd0 tx=0x7f715c009040 comp rx=0 tx=0).stop 2024-05-20T18:00:58.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c162820 msgr2=0x7f716c0cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c162820 0x7f716c0cddb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f716400c730 tx=0x7f716400cbf0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 shutdown_connections 2024-05-20T18:00:58.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f715806be30 0x7f715806e340 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c162820 0x7f716c0cddb0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f716c0b8190 0x7f716c0ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 --2- 172.21.15.6:0/1542394503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f716c06d3d0 0x7f716c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 >> 172.21.15.6:0/1542394503 conn(0x7f716c0d4bd0 msgr2=0x7f716c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 shutdown_connections 2024-05-20T18:00:58.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.163+0000 7f717146c640 1 -- 172.21.15.6:0/1542394503 wait complete. 2024-05-20T18:00:58.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 800 2024-05-20T18:00:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.292+0000 7f2992579640 1 Processor -- start 2024-05-20T18:00:58.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.292+0000 7f2992579640 1 -- start start 2024-05-20T18:00:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2992579640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f298c0d20f0 0x7f298c0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2992579640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f298c0b4020 0x7f298c0b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2992579640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f298c0d3ae0 con 0x7f298c15f6a0 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2992579640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f298c0d3370 con 0x7f298c0d20f0 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2992579640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f298c0d4680 con 0x7f298c0b4020 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2983fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f298c0d20f0 0x7f298c0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2983fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f298c0d20f0 0x7f298c0b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52962/0 (socket says 172.21.15.6:52962) 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2983fff640 1 -- 172.21.15.6:0/4277395430 learned_addr learned my addr 172.21.15.6:0/4277395430 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2990b16640 1 --2- 172.21.15.6:0/4277395430 >> v2:172.21.15.171:3300/0 conn(0x7f298c0b4020 0x7f298c0b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2983fff640 1 -- 172.21.15.6:0/4277395430 >> v2:172.21.15.171:3300/0 conn(0x7f298c0b4020 msgr2=0x7f298c0b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2983fff640 1 --2- 172.21.15.6:0/4277395430 >> v2:172.21.15.171:3300/0 conn(0x7f298c0b4020 0x7f298c0b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2983fff640 1 -- 172.21.15.6:0/4277395430 >> v1:172.21.15.171:6789/0 conn(0x7f298c15f6a0 legacy=0x7f298c0d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.294+0000 7f2983fff640 1 -- 172.21.15.6:0/4277395430 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0d3d50 con 0x7f298c0d20f0 2024-05-20T18:00:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.295+0000 7f2983fff640 1 --2- 172.21.15.6:0/4277395430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0d20f0 0x7f298c0b3ae0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f298c0d45f0 tx=0x7f297402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2e6be3b2a2f38b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.295+0000 7f298b7fe640 1 -- 172.21.15.6:0/4277395430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974037070 con 0x7f298c0d20f0 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.295+0000 7f298b7fe640 1 -- 172.21.15.6:0/4277395430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2974032440 con 0x7f298c0d20f0 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.295+0000 7f298b7fe640 1 -- 172.21.15.6:0/4277395430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974032810 con 0x7f298c0d20f0 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.296+0000 7f2992579640 1 -- 172.21.15.6:0/4277395430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0d20f0 msgr2=0x7f298c0b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.296+0000 7f2992579640 1 --2- 172.21.15.6:0/4277395430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0d20f0 0x7f298c0b3ae0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f298c0d45f0 tx=0x7f297402a270 comp rx=0 tx=0).stop 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.296+0000 7f2992579640 1 -- 172.21.15.6:0/4277395430 shutdown_connections 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.296+0000 7f2992579640 1 --2- 172.21.15.6:0/4277395430 >> v2:172.21.15.171:3300/0 conn(0x7f298c0b4020 0x7f298c0b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.296+0000 7f2992579640 1 --2- 172.21.15.6:0/4277395430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0d20f0 0x7f298c0b3ae0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.296+0000 7f2992579640 1 -- 172.21.15.6:0/4277395430 >> 172.21.15.6:0/4277395430 conn(0x7f298c06d400 msgr2=0x7f298c06d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.296+0000 7f2992579640 1 -- 172.21.15.6:0/4277395430 shutdown_connections 2024-05-20T18:00:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.296+0000 7f2992579640 1 -- 172.21.15.6:0/4277395430 wait complete. 2024-05-20T18:00:58.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.298+0000 7f2992579640 1 Processor -- start 2024-05-20T18:00:58.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.298+0000 7f2992579640 1 -- start start 2024-05-20T18:00:58.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f2992579640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0b4020 0x7f298c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f2992579640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f298c0d20f0 0x7f298c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f2992579640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f298c15f6a0 0x7f298c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f2992579640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f298c0b4430 con 0x7f298c0b4020 2024-05-20T18:00:58.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f2992579640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f298c0d4310 con 0x7f298c15f6a0 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f2992579640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f298c0b8920 con 0x7f298c0d20f0 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f298bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0b4020 0x7f298c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f298bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0b4020 0x7f298c157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52978/0 (socket says 172.21.15.6:52978) 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f298bfff640 1 -- 172.21.15.6:0/3809414222 learned_addr learned my addr 172.21.15.6:0/3809414222 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f2983fff640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f298c0d20f0 0x7f298c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.299+0000 7f2990b16640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f298c15f6a0 0x7f298c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f298bfff640 1 -- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f298c0d20f0 msgr2=0x7f298c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f298bfff640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f298c0d20f0 0x7f298c0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f298bfff640 1 -- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f298c15f6a0 msgr2=0x7f298c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f298bfff640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f298c15f6a0 0x7f298c0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f298bfff640 1 -- 172.21.15.6:0/3809414222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0b5830 con 0x7f298c0b4020 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f298bfff640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0b4020 0x7f298c157540 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c470 tx=0x7f297c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f29897fa640 1 -- 172.21.15.6:0/3809414222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c0052d0 con 0x7f298c0b4020 2024-05-20T18:00:58.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f29897fa640 1 -- 172.21.15.6:0/3809414222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c005490 con 0x7f298c0b4020 2024-05-20T18:00:58.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c0cdc40 con 0x7f298c0b4020 2024-05-20T18:00:58.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f29897fa640 1 -- 172.21.15.6:0/3809414222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c007260 con 0x7f298c0b4020 2024-05-20T18:00:58.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.300+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c0ce200 con 0x7f298c0b4020 2024-05-20T18:00:58.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.301+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f298c0690b0 con 0x7f298c0b4020 2024-05-20T18:00:58.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.302+0000 7f29897fa640 1 -- 172.21.15.6:0/3809414222 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f297c007400 con 0x7f298c0b4020 2024-05-20T18:00:58.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.302+0000 7f29897fa640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f296c06be60 0x7f296c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.302+0000 7f29897fa640 1 -- 172.21.15.6:0/3809414222 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f297c08a3e0 con 0x7f298c0b4020 2024-05-20T18:00:58.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.303+0000 7f2983fff640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f296c06be60 0x7f296c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.303+0000 7f2983fff640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f296c06be60 0x7f296c06e370 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2974034000 tx=0x7f297402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.307+0000 7f29897fa640 1 -- 172.21.15.6:0/3809414222 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f297c0585b0 con 0x7f298c0b4020 2024-05-20T18:00:58.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.490+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f298c067930 con 0x7f298c0b4020 2024-05-20T18:00:58.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.495+0000 7f29897fa640 1 -- 172.21.15.6:0/3809414222 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v39)=0 v39) ==== 128+0+0 (secure 0 0 0) 0x7f297c05c8b0 con 0x7f298c0b4020 2024-05-20T18:00:58.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f296c06be60 msgr2=0x7f296c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f296c06be60 0x7f296c06e370 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2974034000 tx=0x7f297402e000 comp rx=0 tx=0).stop 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0b4020 msgr2=0x7f298c157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0b4020 0x7f298c157540 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c470 tx=0x7f297c00c930 comp rx=0 tx=0).stop 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 shutdown_connections 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f296c06be60 0x7f296c06e370 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f298c15f6a0 0x7f298c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f298c0d20f0 0x7f298c0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 --2- 172.21.15.6:0/3809414222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f298c0b4020 0x7f298c157540 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 >> 172.21.15.6:0/3809414222 conn(0x7f298c06d400 msgr2=0x7f298c0b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 shutdown_connections 2024-05-20T18:00:58.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.497+0000 7f2992579640 1 -- 172.21.15.6:0/3809414222 wait complete. 2024-05-20T18:00:58.507 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-05-20T18:00:58.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.625+0000 7f332305a640 1 Processor -- start 2024-05-20T18:00:58.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.625+0000 7f332305a640 1 -- start start 2024-05-20T18:00:58.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f332305a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 0x7f331c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f332305a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f331c0d14f0 0x7f331c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f332305a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c0d1ac0 con 0x7f331c0cd4d0 2024-05-20T18:00:58.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f332305a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f331c0d1da0 con 0x7f331c0d14f0 2024-05-20T18:00:58.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f332305a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f331c0d2080 con 0x7f331c0d10e0 2024-05-20T18:00:58.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f33215f7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f331c0cd4d0 0x7f331c0cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43456/0 (socket says 172.21.15.6:43456) 2024-05-20T18:00:58.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f33215f7640 1 -- 172.21.15.6:0/2807211494 learned_addr learned my addr 172.21.15.6:0/2807211494 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:58.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223849000 0 0) 0x7f331c0d1ac0 con 0x7f331c0cd4d0 2024-05-20T18:00:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331bfff640 1 --2- 172.21.15.6:0/2807211494 >> v2:172.21.15.171:3300/0 conn(0x7f331c0d14f0 0x7f331c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3304003520 con 0x7f331c0cd4d0 2024-05-20T18:00:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f3320df6640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 0x7f331c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3600914025 0 0) 0x7f3304003520 con 0x7f331c0cd4d0 2024-05-20T18:00:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 msgr2=0x7f331c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 0x7f331c0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 >> v2:172.21.15.171:3300/0 conn(0x7f331c0d14f0 msgr2=0x7f331c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:58.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 --2- 172.21.15.6:0/2807211494 >> v2:172.21.15.171:3300/0 conn(0x7f331c0d14f0 0x7f331c0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c0d2360 con 0x7f331c0cd4d0 2024-05-20T18:00:58.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f33140019f0 con 0x7f331c0cd4d0 2024-05-20T18:00:58.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 >> v1:172.21.15.6:6789/0 conn(0x7f331c0cd4d0 legacy=0x7f331c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33040039b0 0x7f3304003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.627+0000 7f331b7fe640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 0x7f3304004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f331b7fe640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f3304005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f331c0d1da0 con 0x7f3304004d40 2024-05-20T18:00:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f331c0d2080 con 0x7f33040039b0 2024-05-20T18:00:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f330400b9c0 con 0x7f331c0d10e0 2024-05-20T18:00:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f331bfff640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 0x7f3304004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f33215f7640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f3304005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f3320df6640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33040039b0 0x7f3304003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f33215f7640 1 -- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 msgr2=0x7f3304004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f33215f7640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 0x7f3304004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f33215f7640 1 -- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33040039b0 msgr2=0x7f3304003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f33215f7640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33040039b0 0x7f3304003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f33215f7640 1 -- 172.21.15.6:0/2807211494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3304003520 con 0x7f3304004d40 2024-05-20T18:00:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f3320df6640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33040039b0 0x7f3304003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:58.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.628+0000 7f331bfff640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0d10e0 0x7f3304004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:00:58.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.629+0000 7f33215f7640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f3304005150 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f331c0d02d0 tx=0x7f3304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738cef8f85556cc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.629+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331400a4a0 con 0x7f3304004d40 2024-05-20T18:00:58.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.629+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331402f070 con 0x7f3304004d40 2024-05-20T18:00:58.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.629+0000 7f331b7fe640 1 -- 172.21.15.6:0/2807211494 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331402bc50 con 0x7f3304004d40 2024-05-20T18:00:58.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.630+0000 7f332305a640 1 -- 172.21.15.6:0/2807211494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 msgr2=0x7f3304005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.630+0000 7f332305a640 1 --2- 172.21.15.6:0/2807211494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f3304005150 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f331c0d02d0 tx=0x7f3304005830 comp rx=0 tx=0).stop 2024-05-20T18:00:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.630+0000 7f33215f7640 1 -- 172.21.15.6:0/2807211494 reap_dead start 2024-05-20T18:00:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.630+0000 7f332305a640 1 -- 172.21.15.6:0/2807211494 shutdown_connections 2024-05-20T18:00:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.630+0000 7f332305a640 1 -- 172.21.15.6:0/2807211494 >> 172.21.15.6:0/2807211494 conn(0x7f331c0b44d0 msgr2=0x7f331c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.630+0000 7f332305a640 1 -- 172.21.15.6:0/2807211494 shutdown_connections 2024-05-20T18:00:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.630+0000 7f332305a640 1 -- 172.21.15.6:0/2807211494 wait complete. 2024-05-20T18:00:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.632+0000 7f332305a640 1 Processor -- start 2024-05-20T18:00:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.632+0000 7f332305a640 1 -- start start 2024-05-20T18:00:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f332305a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f331c1578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f332305a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331c1f60d0 0x7f331c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f332305a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0cf980 0x7f331c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f332305a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f331c0b8440 con 0x7f3304004d40 2024-05-20T18:00:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f332305a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f331c0b82c0 con 0x7f331c1f60d0 2024-05-20T18:00:58.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f332305a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f331c0709f0 con 0x7f331c0cf980 2024-05-20T18:00:58.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f3320df6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f331c1578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f3320df6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f331c1578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52994/0 (socket says 172.21.15.6:52994) 2024-05-20T18:00:58.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f3320df6640 1 -- 172.21.15.6:0/4042122446 learned_addr learned my addr 172.21.15.6:0/4042122446 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:58.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f331bfff640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331c1f60d0 0x7f331c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.633+0000 7f33215f7640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0cf980 0x7f331c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f3320df6640 1 -- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0cf980 msgr2=0x7f331c0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f3320df6640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0cf980 0x7f331c0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f3320df6640 1 -- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331c1f60d0 msgr2=0x7f331c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f3320df6640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331c1f60d0 0x7f331c0cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f3320df6640 1 -- 172.21.15.6:0/4042122446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c0cfd90 con 0x7f3304004d40 2024-05-20T18:00:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f33215f7640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0cf980 0x7f331c0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f3320df6640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f331c1578e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f330c011cd0 tx=0x7f330c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f33197fa640 1 -- 172.21.15.6:0/4042122446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c011d00 con 0x7f3304004d40 2024-05-20T18:00:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f33197fa640 1 -- 172.21.15.6:0/4042122446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c014440 con 0x7f3304004d40 2024-05-20T18:00:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331c157e20 con 0x7f3304004d40 2024-05-20T18:00:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f33197fa640 1 -- 172.21.15.6:0/4042122446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c011ea0 con 0x7f3304004d40 2024-05-20T18:00:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.634+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331c158610 con 0x7f3304004d40 2024-05-20T18:00:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.635+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c075b00 con 0x7f3304004d40 2024-05-20T18:00:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.636+0000 7f33197fa640 1 -- 172.21.15.6:0/4042122446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f330c012040 con 0x7f3304004d40 2024-05-20T18:00:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.636+0000 7f33197fa640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f330806be60 0x7f330806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.636+0000 7f33197fa640 1 -- 172.21.15.6:0/4042122446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f330c08b820 con 0x7f3304004d40 2024-05-20T18:00:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.636+0000 7f331bfff640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f330806be60 0x7f330806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.637+0000 7f331bfff640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f330806be60 0x7f330806e370 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f331c157650 tx=0x7f3310009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.641+0000 7f33197fa640 1 -- 172.21.15.6:0/4042122446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f331c0cfd90 con 0x7f3304004d40 2024-05-20T18:00:58.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.825+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f331c1576a0 con 0x7f3304004d40 2024-05-20T18:00:58.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.826+0000 7f33197fa640 1 -- 172.21.15.6:0/4042122446 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v39) ==== 106+0+4 (secure 0 0 0) 0x7f330c019030 con 0x7f3304004d40 2024-05-20T18:00:58.824 INFO:teuthology.orchestra.run.smithi006.stdout:100 2024-05-20T18:00:58.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f330806be60 msgr2=0x7f330806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f330806be60 0x7f330806e370 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f331c157650 tx=0x7f3310009190 comp rx=0 tx=0).stop 2024-05-20T18:00:58.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 msgr2=0x7f331c1578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f331c1578e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f330c011cd0 tx=0x7f330c00f610 comp rx=0 tx=0).stop 2024-05-20T18:00:58.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 shutdown_connections 2024-05-20T18:00:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f330806be60 0x7f330806e370 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f331c0cf980 0x7f331c0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f331c1f60d0 0x7f331c0cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 --2- 172.21.15.6:0/4042122446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3304004d40 0x7f331c1578e0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 >> 172.21.15.6:0/4042122446 conn(0x7f331c0b44d0 msgr2=0x7f331c0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 shutdown_connections 2024-05-20T18:00:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.828+0000 7f332305a640 1 -- 172.21.15.6:0/4042122446 wait complete. 2024-05-20T18:00:58.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-05-20T18:00:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.957+0000 7fa2ce32c640 1 Processor -- start 2024-05-20T18:00:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.957+0000 7fa2ce32c640 1 -- start start 2024-05-20T18:00:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2ce32c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8168050 0x7fa2c816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2ce32c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c80d0630 con 0x7fa2c806d3d0 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2ce32c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c80d39c0 con 0x7fa2c8162820 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2ce32c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c80d3ca0 con 0x7fa2c8168050 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2c77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa2c806d3d0 0x7fa2c806d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43468/0 (socket says 172.21.15.6:43468) 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2c77fe640 1 -- 172.21.15.6:0/1226531281 learned_addr learned my addr 172.21.15.6:0/1226531281 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2cc8c9640 1 --2- 172.21.15.6:0/1226531281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8168050 0x7fa2c816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2c6ffd640 1 -- 172.21.15.6:0/1226531281 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349545650 0 0) 0x7fa2c80d0630 con 0x7fa2c806d3d0 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.959+0000 7fa2c6ffd640 1 -- 172.21.15.6:0/1226531281 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b0003520 con 0x7fa2c806d3d0 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.960+0000 7fa2c6ffd640 1 -- 172.21.15.6:0/1226531281 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1942732552 0 0) 0x7fa2b0003520 con 0x7fa2c806d3d0 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.960+0000 7fa2cc8c9640 1 -- 172.21.15.6:0/1226531281 >> v1:172.21.15.171:6789/0 conn(0x7fa2c8162820 legacy=0x7fa2c80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.960+0000 7fa2cc8c9640 1 -- 172.21.15.6:0/1226531281 >> v1:172.21.15.6:6789/0 conn(0x7fa2c806d3d0 legacy=0x7fa2c806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.960+0000 7fa2cc8c9640 1 -- 172.21.15.6:0/1226531281 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c80d3f80 con 0x7fa2c8168050 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.960+0000 7fa2cc8c9640 1 --2- 172.21.15.6:0/1226531281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8168050 0x7fa2c816a470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009dc0 tx=0x7fa2c002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a4c414dbfad9bb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2c6ffd640 1 -- 172.21.15.6:0/1226531281 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc001670 con 0x7fa2c8168050 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2c6ffd640 1 -- 172.21.15.6:0/1226531281 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c0007540 con 0x7fa2c8168050 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2c6ffd640 1 -- 172.21.15.6:0/1226531281 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00078f0 con 0x7fa2c8168050 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2ce32c640 1 -- 172.21.15.6:0/1226531281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8168050 msgr2=0x7fa2c816a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2ce32c640 1 --2- 172.21.15.6:0/1226531281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8168050 0x7fa2c816a470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009dc0 tx=0x7fa2c002a660 comp rx=0 tx=0).stop 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2ce32c640 1 -- 172.21.15.6:0/1226531281 shutdown_connections 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2ce32c640 1 --2- 172.21.15.6:0/1226531281 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8168050 0x7fa2c816a470 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2ce32c640 1 -- 172.21.15.6:0/1226531281 >> 172.21.15.6:0/1226531281 conn(0x7fa2c80d4bd0 msgr2=0x7fa2c80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2ce32c640 1 -- 172.21.15.6:0/1226531281 shutdown_connections 2024-05-20T18:00:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.961+0000 7fa2ce32c640 1 -- 172.21.15.6:0/1226531281 wait complete. 2024-05-20T18:00:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.963+0000 7fa2ce32c640 1 Processor -- start 2024-05-20T18:00:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.963+0000 7fa2ce32c640 1 -- start start 2024-05-20T18:00:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2ce32c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2c806d3d0 0x7fa2c80b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2ce32c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8162820 0x7fa2c8156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2ce32c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2c8168050 0x7fa2c8159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2ce32c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c80b91a0 con 0x7fa2c806d3d0 2024-05-20T18:00:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2ce32c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c80d0300 con 0x7fa2c8168050 2024-05-20T18:00:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2ce32c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c80b4050 con 0x7fa2c8162820 2024-05-20T18:00:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2c806d3d0 0x7fa2c80b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2c806d3d0 0x7fa2c80b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53008/0 (socket says 172.21.15.6:53008) 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 -- 172.21.15.6:0/442894058 learned_addr learned my addr 172.21.15.6:0/442894058 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2cc8c9640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2c8168050 0x7fa2c8159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c77fe640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8162820 0x7fa2c8156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 -- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8162820 msgr2=0x7fa2c8156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8162820 0x7fa2c8156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 -- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2c8168050 msgr2=0x7fa2c8159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2c8168050 0x7fa2c8159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 -- 172.21.15.6:0/442894058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c80b7120 con 0x7fa2c806d3d0 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c77fe640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8162820 0x7fa2c8156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c7fff640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2c806d3d0 0x7fa2c80b6be0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c400 tx=0x7fa2b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.965+0000 7fa2c4ff9640 1 -- 172.21.15.6:0/442894058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8017070 con 0x7fa2c806d3d0 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.966+0000 7fa2c4ff9640 1 -- 172.21.15.6:0/442894058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b80052d0 con 0x7fa2c806d3d0 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.966+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c80b5910 con 0x7fa2c806d3d0 2024-05-20T18:00:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.966+0000 7fa2c4ff9640 1 -- 172.21.15.6:0/442894058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8003830 con 0x7fa2c806d3d0 2024-05-20T18:00:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.966+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c80b5ed0 con 0x7fa2c806d3d0 2024-05-20T18:00:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.967+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c8075b00 con 0x7fa2c806d3d0 2024-05-20T18:00:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.967+0000 7fa2c4ff9640 1 -- 172.21.15.6:0/442894058 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2b801a070 con 0x7fa2c806d3d0 2024-05-20T18:00:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.968+0000 7fa2c4ff9640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2b406be60 0x7fa2b406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.968+0000 7fa2c4ff9640 1 -- 172.21.15.6:0/442894058 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fa2b808a290 con 0x7fa2c806d3d0 2024-05-20T18:00:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.968+0000 7fa2c77fe640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2b406be60 0x7fa2b406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.968+0000 7fa2c77fe640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2b406be60 0x7fa2b406e370 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80cf010 tx=0x7fa2bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:58.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:58.972+0000 7fa2c4ff9640 1 -- 172.21.15.6:0/442894058 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa2b8058460 con 0x7fa2c806d3d0 2024-05-20T18:00:59.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.158+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7fa2c815d370 con 0x7fa2c806d3d0 2024-05-20T18:00:59.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.161+0000 7fa2c4ff9640 1 -- 172.21.15.6:0/442894058 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v40)=0 v40) ==== 124+0+0 (secure 0 0 0) 0x7fa2b805c760 con 0x7fa2c806d3d0 2024-05-20T18:00:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2b406be60 msgr2=0x7fa2b406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2b406be60 0x7fa2b406e370 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80cf010 tx=0x7fa2bc009040 comp rx=0 tx=0).stop 2024-05-20T18:00:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2c806d3d0 msgr2=0x7fa2c80b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2c806d3d0 0x7fa2c80b6be0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800c400 tx=0x7fa2b800c8c0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 shutdown_connections 2024-05-20T18:00:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2b406be60 0x7fa2b406e370 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2c8168050 0x7fa2c8159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2c8162820 0x7fa2c8156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 --2- 172.21.15.6:0/442894058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2c806d3d0 0x7fa2c80b6be0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 >> 172.21.15.6:0/442894058 conn(0x7fa2c80d4bd0 msgr2=0x7fa2c81568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 shutdown_connections 2024-05-20T18:00:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.164+0000 7fa2ce32c640 1 -- 172.21.15.6:0/442894058 wait complete. 2024-05-20T18:00:59.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-05-20T18:00:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.293+0000 7f71b1936640 1 Processor -- start 2024-05-20T18:00:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.293+0000 7f71b1936640 1 -- start start 2024-05-20T18:00:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.294+0000 7f71b1936640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71ac0b2f10 0x7f71ac0d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.294+0000 7f71b1936640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac06d290 0x7f71ac06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.294+0000 7f71b1936640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f71ac15d940 0x7f71ac15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.294+0000 7f71b1936640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f71ac0d2400 con 0x7f71ac0b2f10 2024-05-20T18:00:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.294+0000 7f71b1936640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f71ac0d1a30 con 0x7f71ac15d940 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.294+0000 7f71b1936640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac0b3320 con 0x7f71ac06d290 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.294+0000 7f71aaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71ac0b2f10 0x7f71ac0d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71aaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f71ac0b2f10 0x7f71ac0d1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53010/0 (socket says 172.21.15.6:53010) 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71aaffd640 1 -- 172.21.15.6:0/1901191553 learned_addr learned my addr 172.21.15.6:0/1901191553 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71a3fff640 1 --2- 172.21.15.6:0/1901191553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac06d290 0x7f71ac06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71ab7fe640 1 --2- 172.21.15.6:0/1901191553 >> v2:172.21.15.171:3300/0 conn(0x7f71ac15d940 0x7f71ac15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71aaffd640 1 -- 172.21.15.6:0/1901191553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac06d290 msgr2=0x7f71ac06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71aaffd640 1 --2- 172.21.15.6:0/1901191553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac06d290 0x7f71ac06d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71aaffd640 1 -- 172.21.15.6:0/1901191553 >> v2:172.21.15.171:3300/0 conn(0x7f71ac15d940 msgr2=0x7f71ac15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71aaffd640 1 --2- 172.21.15.6:0/1901191553 >> v2:172.21.15.171:3300/0 conn(0x7f71ac15d940 0x7f71ac15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71aaffd640 1 -- 172.21.15.6:0/1901191553 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac15e6b0 con 0x7f71ac0b2f10 2024-05-20T18:00:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71a3fff640 1 --2- 172.21.15.6:0/1901191553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac06d290 0x7f71ac06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.295+0000 7f71ab7fe640 1 --2- 172.21.15.6:0/1901191553 >> v2:172.21.15.171:3300/0 conn(0x7f71ac15d940 0x7f71ac15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:00:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.296+0000 7f71aaffd640 1 --2- 172.21.15.6:0/1901191553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac0b2f10 0x7f71ac0d1ec0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0b7400 tx=0x7f719c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1a74389520eb72 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.296+0000 7f71aa7fc640 1 -- 172.21.15.6:0/1901191553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c037070 con 0x7f71ac0b2f10 2024-05-20T18:00:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.296+0000 7f71aa7fc640 1 -- 172.21.15.6:0/1901191553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719c032440 con 0x7f71ac0b2f10 2024-05-20T18:00:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.296+0000 7f71aa7fc640 1 -- 172.21.15.6:0/1901191553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c032810 con 0x7f71ac0b2f10 2024-05-20T18:00:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.296+0000 7f71b1936640 1 -- 172.21.15.6:0/1901191553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac0b2f10 msgr2=0x7f71ac0d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.297+0000 7f71b1936640 1 --2- 172.21.15.6:0/1901191553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac0b2f10 0x7f71ac0d1ec0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0b7400 tx=0x7f719c02a140 comp rx=0 tx=0).stop 2024-05-20T18:00:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.297+0000 7f71b1936640 1 -- 172.21.15.6:0/1901191553 shutdown_connections 2024-05-20T18:00:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.297+0000 7f71b1936640 1 --2- 172.21.15.6:0/1901191553 >> v2:172.21.15.171:3300/0 conn(0x7f71ac15d940 0x7f71ac15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.297+0000 7f71b1936640 1 --2- 172.21.15.6:0/1901191553 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac06d290 0x7f71ac06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.297+0000 7f71b1936640 1 --2- 172.21.15.6:0/1901191553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac0b2f10 0x7f71ac0d1ec0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.297+0000 7f71b1936640 1 -- 172.21.15.6:0/1901191553 >> 172.21.15.6:0/1901191553 conn(0x7f71ac0b6670 msgr2=0x7f71ac0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.297+0000 7f71b1936640 1 -- 172.21.15.6:0/1901191553 shutdown_connections 2024-05-20T18:00:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.297+0000 7f71b1936640 1 -- 172.21.15.6:0/1901191553 wait complete. 2024-05-20T18:00:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.298+0000 7f71b1936640 1 Processor -- start 2024-05-20T18:00:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.298+0000 7f71b1936640 1 -- start start 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71b1936640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71ac06d290 0x7f71ac155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71b1936640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac0b2f10 0x7f71ac1f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71b1936640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac15d940 0x7f71ac152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71b1936640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac0d16c0 con 0x7f71ac15d940 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71b1936640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac0d13e0 con 0x7f71ac06d290 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71b1936640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac06dbe0 con 0x7f71ac0b2f10 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac15d940 0x7f71ac152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac15d940 0x7f71ac152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53026/0 (socket says 172.21.15.6:53026) 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 -- 172.21.15.6:0/340575214 learned_addr learned my addr 172.21.15.6:0/340575214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71a3fff640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac0b2f10 0x7f71ac1f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71aaffd640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71ac06d290 0x7f71ac155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 -- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac0b2f10 msgr2=0x7f71ac1f7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac0b2f10 0x7f71ac1f7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 -- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71ac06d290 msgr2=0x7f71ac155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71ac06d290 0x7f71ac155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 -- 172.21.15.6:0/340575214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac1f3750 con 0x7f71ac15d940 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.300+0000 7f71ab7fe640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac15d940 0x7f71ac152460 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f71a400cd40 tx=0x7f71a400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.301+0000 7f71a8ff9640 1 -- 172.21.15.6:0/340575214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4003b90 con 0x7f71ac15d940 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.301+0000 7f71a8ff9640 1 -- 172.21.15.6:0/340575214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a4003d50 con 0x7f71ac15d940 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.301+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1f3a30 con 0x7f71ac15d940 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.301+0000 7f71a8ff9640 1 -- 172.21.15.6:0/340575214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4004260 con 0x7f71ac15d940 2024-05-20T18:00:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.301+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1559e0 con 0x7f71ac15d940 2024-05-20T18:00:59.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.302+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac075b00 con 0x7f71ac15d940 2024-05-20T18:00:59.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.302+0000 7f71a8ff9640 1 -- 172.21.15.6:0/340575214 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71a4004400 con 0x7f71ac15d940 2024-05-20T18:00:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.303+0000 7f71a8ff9640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f718c06be60 0x7f718c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.303+0000 7f71a8ff9640 1 -- 172.21.15.6:0/340575214 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f71a408ba40 con 0x7f71ac15d940 2024-05-20T18:00:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.303+0000 7f71aaffd640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f718c06be60 0x7f718c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.304+0000 7f71aaffd640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f718c06be60 0x7f718c06e370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f719c034000 tx=0x7f719c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.307+0000 7f71a8ff9640 1 -- 172.21.15.6:0/340575214 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f71a4014030 con 0x7f71ac15d940 2024-05-20T18:00:59.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.492+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7f71ac06b9a0 con 0x7f71ac15d940 2024-05-20T18:00:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.493+0000 7f71a8ff9640 1 -- 172.21.15.6:0/340575214 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v40) ==== 106+0+8 (secure 0 0 0) 0x7f71a408be20 con 0x7f71ac15d940 2024-05-20T18:00:59.491 INFO:teuthology.orchestra.run.smithi006.stdout:1048576 2024-05-20T18:00:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f718c06be60 msgr2=0x7f718c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f718c06be60 0x7f718c06e370 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f719c034000 tx=0x7f719c02e000 comp rx=0 tx=0).stop 2024-05-20T18:00:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac15d940 msgr2=0x7f71ac152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac15d940 0x7f71ac152460 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f71a400cd40 tx=0x7f71a400a650 comp rx=0 tx=0).stop 2024-05-20T18:00:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 shutdown_connections 2024-05-20T18:00:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f718c06be60 0x7f718c06e370 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71ac15d940 0x7f71ac152460 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f71ac0b2f10 0x7f71ac1f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 --2- 172.21.15.6:0/340575214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71ac06d290 0x7f71ac155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 >> 172.21.15.6:0/340575214 conn(0x7f71ac0b6670 msgr2=0x7f71ac070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 shutdown_connections 2024-05-20T18:00:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.495+0000 7f71b1936640 1 -- 172.21.15.6:0/340575214 wait complete. 2024-05-20T18:00:59.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-05-20T18:00:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.623+0000 7fe118284640 1 Processor -- start 2024-05-20T18:00:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.623+0000 7fe118284640 1 -- start start 2024-05-20T18:00:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe118284640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe11006d3d0 0x7fe11006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe118284640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1100b8190 0x7fe1100b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe118284640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe11006dd20 con 0x7fe110162820 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe118284640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe1100d0630 con 0x7fe1100b8190 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe118284640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1100d39c0 con 0x7fe11006d3d0 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe116821640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1100b8190 0x7fe1100b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe116821640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1100b8190 0x7fe1100b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53040/0 (socket says 172.21.15.6:53040) 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe116821640 1 -- 172.21.15.6:0/2737930859 learned_addr learned my addr 172.21.15.6:0/2737930859 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe11581f640 1 --2- 172.21.15.6:0/2737930859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe11006d3d0 0x7fe11006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe116821640 1 -- 172.21.15.6:0/2737930859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe11006d3d0 msgr2=0x7fe11006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe116821640 1 --2- 172.21.15.6:0/2737930859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe11006d3d0 0x7fe11006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe116821640 1 -- 172.21.15.6:0/2737930859 >> v1:172.21.15.171:6789/0 conn(0x7fe110162820 legacy=0x7fe1100b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.625+0000 7fe116821640 1 -- 172.21.15.6:0/2737930859 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1100d3ca0 con 0x7fe1100b8190 2024-05-20T18:00:59.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.626+0000 7fe116821640 1 --2- 172.21.15.6:0/2737930859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100b85a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fe108009870 tx=0x7fe10802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5e771fb6469b9c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.626+0000 7fe11501e640 1 -- 172.21.15.6:0/2737930859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108037070 con 0x7fe1100b8190 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.626+0000 7fe11501e640 1 -- 172.21.15.6:0/2737930859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe108032440 con 0x7fe1100b8190 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.626+0000 7fe11501e640 1 -- 172.21.15.6:0/2737930859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108032810 con 0x7fe1100b8190 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.627+0000 7fe118284640 1 -- 172.21.15.6:0/2737930859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 msgr2=0x7fe1100b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.627+0000 7fe118284640 1 --2- 172.21.15.6:0/2737930859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100b85a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fe108009870 tx=0x7fe10802a270 comp rx=0 tx=0).stop 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.627+0000 7fe118284640 1 -- 172.21.15.6:0/2737930859 shutdown_connections 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.627+0000 7fe118284640 1 --2- 172.21.15.6:0/2737930859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100b85a0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.627+0000 7fe118284640 1 --2- 172.21.15.6:0/2737930859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe11006d3d0 0x7fe11006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.627+0000 7fe118284640 1 -- 172.21.15.6:0/2737930859 >> 172.21.15.6:0/2737930859 conn(0x7fe1100d4bd0 msgr2=0x7fe1100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.627+0000 7fe118284640 1 -- 172.21.15.6:0/2737930859 shutdown_connections 2024-05-20T18:00:59.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.627+0000 7fe118284640 1 -- 172.21.15.6:0/2737930859 wait complete. 2024-05-20T18:00:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.629+0000 7fe118284640 1 Processor -- start 2024-05-20T18:00:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.629+0000 7fe118284640 1 -- start start 2024-05-20T18:00:59.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe118284640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe11006d3d0 0x7fe1100b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe118284640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe118284640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe110162820 0x7fe1100b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe118284640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100d0300 con 0x7fe1100b8190 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe118284640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100d4260 con 0x7fe11006d3d0 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe118284640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1100b4050 con 0x7fe110162820 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe11581f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe11581f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53048/0 (socket says 172.21.15.6:53048) 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.630+0000 7fe11581f640 1 -- 172.21.15.6:0/3951365189 learned_addr learned my addr 172.21.15.6:0/3951365189 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe116821640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe110162820 0x7fe1100b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe116020640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe11006d3d0 0x7fe1100b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe11581f640 1 -- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe110162820 msgr2=0x7fe1100b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe11581f640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe110162820 0x7fe1100b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe11581f640 1 -- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe11006d3d0 msgr2=0x7fe1100b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe11581f640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe11006d3d0 0x7fe1100b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe11581f640 1 -- 172.21.15.6:0/3951365189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1101f4fb0 con 0x7fe1100b8190 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe11581f640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100cb2f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fe104007e40 tx=0x7fe10400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe10effd640 1 -- 172.21.15.6:0/3951365189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104014620 con 0x7fe1100b8190 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1100b5420 con 0x7fe1100b8190 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe10effd640 1 -- 172.21.15.6:0/3951365189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe104019070 con 0x7fe1100b8190 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe10effd640 1 -- 172.21.15.6:0/3951365189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104014a00 con 0x7fe1100b8190 2024-05-20T18:00:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.631+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1100b59e0 con 0x7fe1100b8190 2024-05-20T18:00:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.632+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe110075b00 con 0x7fe1100b8190 2024-05-20T18:00:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.633+0000 7fe10effd640 1 -- 172.21.15.6:0/3951365189 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe104014ba0 con 0x7fe1100b8190 2024-05-20T18:00:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.633+0000 7fe10effd640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0fc06be30 0x7fe0fc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:00:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.633+0000 7fe10effd640 1 -- 172.21.15.6:0/3951365189 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fe10408b800 con 0x7fe1100b8190 2024-05-20T18:00:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.634+0000 7fe116020640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0fc06be30 0x7fe0fc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:00:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.634+0000 7fe116020640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0fc06be30 0x7fe0fc06e340 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe1000016e0 tx=0x7fe100009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:00:59.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.638+0000 7fe10effd640 1 -- 172.21.15.6:0/3951365189 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe1040598c0 con 0x7fe1100b8190 2024-05-20T18:00:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.823+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7fe110161b80 con 0x7fe1100b8190 2024-05-20T18:00:59.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.823+0000 7fe10effd640 1 -- 172.21.15.6:0/3951365189 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v40) ==== 112+0+10 (secure 0 0 0) 0x7fe10405dbc0 con 0x7fe1100b8190 2024-05-20T18:00:59.821 INFO:teuthology.orchestra.run.smithi006.stdout:60.000000 2024-05-20T18:00:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0fc06be30 msgr2=0x7fe0fc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0fc06be30 0x7fe0fc06e340 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe1000016e0 tx=0x7fe100009040 comp rx=0 tx=0).stop 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 msgr2=0x7fe1100cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100cb2f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fe104007e40 tx=0x7fe10400e4b0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 shutdown_connections 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe0fc06be30 0x7fe0fc06e340 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe110162820 0x7fe1100b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1100b8190 0x7fe1100cb2f0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 --2- 172.21.15.6:0/3951365189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe11006d3d0 0x7fe1100b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 >> 172.21.15.6:0/3951365189 conn(0x7fe1100d4bd0 msgr2=0x7fe1100ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 shutdown_connections 2024-05-20T18:00:59.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59.825+0000 7fe118284640 1 -- 172.21.15.6:0/3951365189 wait complete. 2024-05-20T18:00:59.835 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:59.835 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:59.851 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:00:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:00:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:00:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:00:59.951 INFO:teuthology.orchestra.run.smithi006.stdout:client7612 2024-05-20T18:00:59.952 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:00:59.952 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:00:59.968 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T18:00:59.968 DEBUG:teuthology.orchestra.run.smithi006:> import fcntl 2024-05-20T18:00:59.968 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2024-05-20T18:00:59.968 DEBUG:teuthology.orchestra.run.smithi006:> import time 2024-05-20T18:00:59.968 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T18:00:59.968 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:00:59.968 DEBUG:teuthology.orchestra.run.smithi006:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> n = 800 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> if not os.path.exists(abs_path): 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(abs_path) 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> handles = [] 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(0, n): 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> fname = "file_"+str(i) 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> path = os.path.join(abs_path, fname) 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> handles.append(open(path, '"'"'w'"'"')) 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> print("waiting with handles open", file=sys.stderr) 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> while True: 2024-05-20T18:00:59.969 DEBUG:teuthology.orchestra.run.smithi006:> print("open_n_background: keeping files open", file=sys.stderr) 2024-05-20T18:00:59.970 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T18:00:59.970 DEBUG:teuthology.orchestra.run.smithi006:> if os.read(0, 4096) == b"": 2024-05-20T18:00:59.970 DEBUG:teuthology.orchestra.run.smithi006:> break 2024-05-20T18:00:59.970 DEBUG:teuthology.orchestra.run.smithi006:> except BlockingIOError: 2024-05-20T18:00:59.970 DEBUG:teuthology.orchestra.run.smithi006:> pass 2024-05-20T18:00:59.970 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(2) 2024-05-20T18:00:59.970 DEBUG:teuthology.orchestra.run.smithi006:> print("stdin closed, goodbye!", file=sys.stderr) 2024-05-20T18:00:59.970 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T18:01:00.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:00.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.145+0000 7fa2e7e06640 1 Processor -- start 2024-05-20T18:01:00.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.145+0000 7fa2e7e06640 1 -- start start 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e7e06640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e006c6b0 0x7fa2e00d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e7e06640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2e00b4b70 0x7fa2e00cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e7e06640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2e0163020 con 0x7fa2e015f2d0 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e7e06640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e006cac0 con 0x7fa2e00b4b70 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e7e06640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e0163300 con 0x7fa2e006c6b0 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e63a3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2e00b4b70 0x7fa2e00cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e63a3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2e00b4b70 0x7fa2e00cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53050/0 (socket says 172.21.15.6:53050) 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e63a3640 1 -- 172.21.15.6:0/2919820180 learned_addr learned my addr 172.21.15.6:0/2919820180 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e5ba2640 1 --2- 172.21.15.6:0/2919820180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e006c6b0 0x7fa2e00d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:00.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e63a3640 1 -- 172.21.15.6:0/2919820180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e006c6b0 msgr2=0x7fa2e00d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e63a3640 1 --2- 172.21.15.6:0/2919820180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e006c6b0 0x7fa2e00d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e63a3640 1 -- 172.21.15.6:0/2919820180 >> v1:172.21.15.171:6789/0 conn(0x7fa2e015f2d0 legacy=0x7fa2e00b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.147+0000 7fa2e63a3640 1 -- 172.21.15.6:0/2919820180 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e01635e0 con 0x7fa2e00b4b70 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.148+0000 7fa2e63a3640 1 --2- 172.21.15.6:0/2919820180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e00b4b70 0x7fa2e00cd8a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009e50 tx=0x7fa2d802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08f475a1af1146f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.148+0000 7fa2e4ba0640 1 -- 172.21.15.6:0/2919820180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8036070 con 0x7fa2e00b4b70 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.148+0000 7fa2e4ba0640 1 -- 172.21.15.6:0/2919820180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8031600 con 0x7fa2e00b4b70 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.148+0000 7fa2e4ba0640 1 -- 172.21.15.6:0/2919820180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80319d0 con 0x7fa2e00b4b70 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.149+0000 7fa2e7e06640 1 -- 172.21.15.6:0/2919820180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e00b4b70 msgr2=0x7fa2e00cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.149+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/2919820180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e00b4b70 0x7fa2e00cd8a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009e50 tx=0x7fa2d802a680 comp rx=0 tx=0).stop 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.149+0000 7fa2e7e06640 1 -- 172.21.15.6:0/2919820180 shutdown_connections 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.149+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/2919820180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e00b4b70 0x7fa2e00cd8a0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.149+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/2919820180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e006c6b0 0x7fa2e00d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.149+0000 7fa2e7e06640 1 -- 172.21.15.6:0/2919820180 >> 172.21.15.6:0/2919820180 conn(0x7fa2e00cf460 msgr2=0x7fa2e00cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:00.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.149+0000 7fa2e7e06640 1 -- 172.21.15.6:0/2919820180 shutdown_connections 2024-05-20T18:01:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.150+0000 7fa2e7e06640 1 -- 172.21.15.6:0/2919820180 wait complete. 2024-05-20T18:01:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.151+0000 7fa2e7e06640 1 Processor -- start 2024-05-20T18:01:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.151+0000 7fa2e7e06640 1 -- start start 2024-05-20T18:01:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e7e06640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e006c6b0 0x7fa2e014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e7e06640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e015f2d0 0x7fa2e0160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e7e06640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e0160a40 0x7fa2e00b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e7e06640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e015f6e0 con 0x7fa2e006c6b0 2024-05-20T18:01:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e7e06640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0163ba0 con 0x7fa2e0160a40 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e7e06640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e015f860 con 0x7fa2e015f2d0 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e006c6b0 0x7fa2e014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e006c6b0 0x7fa2e014f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53054/0 (socket says 172.21.15.6:53054) 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 -- 172.21.15.6:0/3326025623 learned_addr learned my addr 172.21.15.6:0/3326025623 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e53a1640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e015f2d0 0x7fa2e0160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e63a3640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e0160a40 0x7fa2e00b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 -- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e015f2d0 msgr2=0x7fa2e0160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e015f2d0 0x7fa2e0160500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 -- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e0160a40 msgr2=0x7fa2e00b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e0160a40 0x7fa2e00b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 -- 172.21.15.6:0/3326025623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e00b5300 con 0x7fa2e006c6b0 2024-05-20T18:01:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.153+0000 7fa2e5ba2640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e006c6b0 0x7fa2e014f250 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00d5d0 tx=0x7fa2dc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.154+0000 7fa2d67fc640 1 -- 172.21.15.6:0/3326025623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc004240 con 0x7fa2e006c6b0 2024-05-20T18:01:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.154+0000 7fa2d67fc640 1 -- 172.21.15.6:0/3326025623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2dc0043e0 con 0x7fa2e006c6b0 2024-05-20T18:01:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.154+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e014c860 con 0x7fa2e006c6b0 2024-05-20T18:01:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.154+0000 7fa2d67fc640 1 -- 172.21.15.6:0/3326025623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc003830 con 0x7fa2e006c6b0 2024-05-20T18:01:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.154+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e00b5850 con 0x7fa2e006c6b0 2024-05-20T18:01:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.155+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e014ca30 con 0x7fa2e006c6b0 2024-05-20T18:01:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.156+0000 7fa2d67fc640 1 -- 172.21.15.6:0/3326025623 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2dc0039d0 con 0x7fa2e006c6b0 2024-05-20T18:01:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.156+0000 7fa2d67fc640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2c406be30 0x7fa2c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.156+0000 7fa2d67fc640 1 -- 172.21.15.6:0/3326025623 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fa2dc08b1a0 con 0x7fa2e006c6b0 2024-05-20T18:01:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.156+0000 7fa2e53a1640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2c406be30 0x7fa2c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.157+0000 7fa2e53a1640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2c406be30 0x7fa2c406e340 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa2e01f8ee0 tx=0x7fa2d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.161+0000 7fa2d67fc640 1 -- 172.21.15.6:0/3326025623 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa2dc0592e0 con 0x7fa2e006c6b0 2024-05-20T18:01:00.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.410+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2e0075b00 con 0x7fa2e006c6b0 2024-05-20T18:01:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.410+0000 7fa2d67fc640 1 -- 172.21.15.6:0/3326025623 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5177 (secure 0 0 0) 0x7fa2dc05d5e0 con 0x7fa2e006c6b0 2024-05-20T18:01:00.409 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:00.409 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:00:47.310018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:01:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 74 2024-05-20T18:01:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.412+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2c406be30 msgr2=0x7fa2c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.412+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2c406be30 0x7fa2c406e340 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa2e01f8ee0 tx=0x7fa2d0009040 comp rx=0 tx=0).stop 2024-05-20T18:01:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.412+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e006c6b0 msgr2=0x7fa2e014f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.412+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e006c6b0 0x7fa2e014f250 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00d5d0 tx=0x7fa2dc00da90 comp rx=0 tx=0).stop 2024-05-20T18:01:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.413+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 shutdown_connections 2024-05-20T18:01:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.413+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2c406be30 0x7fa2c406e340 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.413+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2e0160a40 0x7fa2e00b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.413+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2e015f2d0 0x7fa2e0160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.413+0000 7fa2e7e06640 1 --2- 172.21.15.6:0/3326025623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2e006c6b0 0x7fa2e014f250 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.413+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 >> 172.21.15.6:0/3326025623 conn(0x7fa2e00cf460 msgr2=0x7fa2e00b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.413+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 shutdown_connections 2024-05-20T18:01:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:00.413+0000 7fa2e7e06640 1 -- 172.21.15.6:0/3326025623 wait complete. 2024-05-20T18:01:00.423 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-20T18:01:00.561 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":7618,"entity":{"name":{"type":"client","num":7618},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":170972652}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":3.2109627519999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9904562429210158,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7618 192.168.0.1:0/170972652","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":7612,"entity":{"name":{"type":"client","num":7612},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":2549548364}},"state":"open","num_leases":1,"num_caps":472,"request_load_avg":495,"uptime":4.3399496539999998,"requests_in_flight":470,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":944.48729954853195,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7612 172.21.15.6:0/2549548364","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T18:01:00.562 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 170972652, "type": "any" }, "name": { "num": 7618, "type": "client" } }, "id": 7618, "inst": "client.7618 192.168.0.1:0/170972652", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9904562429210158 }, "state": "open", "uptime": 3.210962752 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 2549548364, "type": "any" }, "name": { "num": 7612, "type": "client" } }, "id": 7612, "inst": "client.7612 172.21.15.6:0/2549548364", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 472, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 495, "requests_in_flight": 470, "session_cache_liveness": { "halflife": 300, "value": 944.487299548532 }, "state": "open", "uptime": 4.339949654 } ] 2024-05-20T18:01:00.562 DEBUG:tasks.ceph_test_case:wait_until_equal: 472 != 802, waiting (timeout=600)... 2024-05-20T18:01:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:waiting with handles open 2024-05-20T18:01:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:02.944 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:04.946 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:05.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.696+0000 7fa6c4bc7640 1 Processor -- start 2024-05-20T18:01:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.696+0000 7fa6c4bc7640 1 -- start start 2024-05-20T18:01:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.697+0000 7fa6c4bc7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6c015d5f0 0x7fa6c01576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.697+0000 7fa6c4bc7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c006b900 con 0x7fa6c00cedd0 2024-05-20T18:01:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.697+0000 7fa6c4bc7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c006bbe0 con 0x7fa6c006c9a0 2024-05-20T18:01:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.697+0000 7fa6c4bc7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa6c006bec0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.697+0000 7fa6be59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6c015d5f0 0x7fa6c01576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.697+0000 7fa6be59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6c015d5f0 0x7fa6c01576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53058/0 (socket says 172.21.15.6:53058) 2024-05-20T18:01:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.697+0000 7fa6be59c640 1 -- 172.21.15.6:0/3272012962 learned_addr learned my addr 172.21.15.6:0/3272012962 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.698+0000 7fa6be59c640 1 -- 172.21.15.6:0/3272012962 >> v1:172.21.15.171:6789/0 conn(0x7fa6c006c9a0 legacy=0x7fa6c00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.698+0000 7fa6be59c640 1 -- 172.21.15.6:0/3272012962 >> v1:172.21.15.6:6789/0 conn(0x7fa6c00cedd0 legacy=0x7fa6c006e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.698+0000 7fa6be59c640 1 -- 172.21.15.6:0/3272012962 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c006c1a0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.698+0000 7fa6bd59a640 1 -- 172.21.15.6:0/3272012962 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990164969 0 0) 0x7fa6c006b900 con 0x7fa6c00cedd0 2024-05-20T18:01:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.699+0000 7fa6be59c640 1 --2- 172.21.15.6:0/3272012962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c01576d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009e50 tx=0x7fa6b802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e6a7cf5a8d22ae server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.699+0000 7fa6bd59a640 1 -- 172.21.15.6:0/3272012962 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8036070 con 0x7fa6c015d5f0 2024-05-20T18:01:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.699+0000 7fa6bd59a640 1 -- 172.21.15.6:0/3272012962 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b8031600 con 0x7fa6c015d5f0 2024-05-20T18:01:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.699+0000 7fa6bd59a640 1 -- 172.21.15.6:0/3272012962 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80319d0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.699+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/3272012962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 msgr2=0x7fa6c01576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.699+0000 7fa6c4bc7640 1 --2- 172.21.15.6:0/3272012962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c01576d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009e50 tx=0x7fa6b802a6d0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.700+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/3272012962 shutdown_connections 2024-05-20T18:01:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.700+0000 7fa6c4bc7640 1 --2- 172.21.15.6:0/3272012962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c01576d0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.700+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/3272012962 >> 172.21.15.6:0/3272012962 conn(0x7fa6c00cd2a0 msgr2=0x7fa6c00cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.700+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/3272012962 shutdown_connections 2024-05-20T18:01:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.700+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/3272012962 wait complete. 2024-05-20T18:01:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.702+0000 7fa6c4bc7640 1 Processor -- start 2024-05-20T18:01:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.702+0000 7fa6c4bc7640 1 -- start start 2024-05-20T18:01:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6c4bc7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6c006c9a0 0x7fa6c0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6c4bc7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6c00cedd0 0x7fa6c0144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6c4bc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c013dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6c4bc7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c00cf1e0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6c4bc7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c006cdb0 con 0x7fa6c006c9a0 2024-05-20T18:01:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6c4bc7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c006b520 con 0x7fa6c00cedd0 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c013dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6bed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c013dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53064/0 (socket says 172.21.15.6:53064) 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6bed9d640 1 -- 172.21.15.6:0/191335987 learned_addr learned my addr 172.21.15.6:0/191335987 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6be59c640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6c006c9a0 0x7fa6c0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.703+0000 7fa6bdd9b640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6c00cedd0 0x7fa6c0144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6bed9d640 1 -- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6c00cedd0 msgr2=0x7fa6c0144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6bed9d640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6c00cedd0 0x7fa6c0144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6bed9d640 1 -- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6c006c9a0 msgr2=0x7fa6c0154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6bed9d640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6c006c9a0 0x7fa6c0154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6bed9d640 1 -- 172.21.15.6:0/191335987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c01568b0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6bed9d640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c013dd60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000c410 tx=0x7fa6b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6b6ffd640 1 -- 172.21.15.6:0/191335987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0017070 con 0x7fa6c015d5f0 2024-05-20T18:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6b6ffd640 1 -- 172.21.15.6:0/191335987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b00035f0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c0155810 con 0x7fa6c015d5f0 2024-05-20T18:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6b6ffd640 1 -- 172.21.15.6:0/191335987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b00039e0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.704+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c0155dd0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.705+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c0155580 con 0x7fa6c015d5f0 2024-05-20T18:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.706+0000 7fa6b6ffd640 1 -- 172.21.15.6:0/191335987 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6b001a070 con 0x7fa6c015d5f0 2024-05-20T18:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.706+0000 7fa6b6ffd640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa6a006be30 0x7fa6a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.707+0000 7fa6b6ffd640 1 -- 172.21.15.6:0/191335987 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fa6b008a350 con 0x7fa6c015d5f0 2024-05-20T18:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.707+0000 7fa6be59c640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa6a006be30 0x7fa6a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.707+0000 7fa6be59c640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa6a006be30 0x7fa6a006e340 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8033000 tx=0x7fa6b8009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.711+0000 7fa6b6ffd640 1 -- 172.21.15.6:0/191335987 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa6b00584b0 con 0x7fa6c015d5f0 2024-05-20T18:01:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.933+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6c0068140 con 0x7fa6c015d5f0 2024-05-20T18:01:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.934+0000 7fa6b6ffd640 1 -- 172.21.15.6:0/191335987 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5177 (secure 0 0 0) 0x7fa6c0068140 con 0x7fa6c015d5f0 2024-05-20T18:01:05.932 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:05.932 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:01:04.959577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:01:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2024-05-20T18:01:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa6a006be30 msgr2=0x7fa6a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa6a006be30 0x7fa6a006e340 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8033000 tx=0x7fa6b8009000 comp rx=0 tx=0).stop 2024-05-20T18:01:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 msgr2=0x7fa6c013dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c013dd60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000c410 tx=0x7fa6b000c8d0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 shutdown_connections 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa6a006be30 0x7fa6a006e340 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6c015d5f0 0x7fa6c013dd60 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6c00cedd0 0x7fa6c0144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 --2- 172.21.15.6:0/191335987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6c006c9a0 0x7fa6c0154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 >> 172.21.15.6:0/191335987 conn(0x7fa6c00cd2a0 msgr2=0x7fa6c01614a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 shutdown_connections 2024-05-20T18:01:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:05.936+0000 7fa6c4bc7640 1 -- 172.21.15.6:0/191335987 wait complete. 2024-05-20T18:01:05.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-20T18:01:06.079 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":7618,"entity":{"name":{"type":"client","num":7618},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":170972652}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":8.7318988619999995,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9525520391055822,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7618 192.168.0.1:0/170972652","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":7612,"entity":{"name":{"type":"client","num":7612},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":2549548364}},"state":"open","num_leases":1,"num_caps":802,"request_load_avg":775,"uptime":9.8608857640000007,"requests_in_flight":0,"num_completed_requests":299,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":2328.4212155138202,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":951.11278565225052,"halflife":1.5},"recall_caps_throttle2o":{"value":440.963112591293,"halflife":0.5},"session_cache_liveness":{"value":1584.5252607221487,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":530,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7612 172.21.15.6:0/2549548364","completed_requests":[{"tid":530,"created_ino":"0x100000003e9"},{"tid":531,"created_ino":"0x100000003ea"},{"tid":532,"created_ino":"0x100000003eb"},{"tid":533,"created_ino":"0x100000003ec"},{"tid":534,"created_ino":"0x100000003ed"},{"tid":535,"created_ino":"0x100000003ee"},{"tid":536,"created_ino":"0x100000003ef"},{"tid":537,"created_ino":"0x100000003f0"},{"tid":538,"created_ino":"0x100000003f1"},{"tid":539,"created_ino":"0x100000003f2"},{"tid":540,"created_ino":"0x100000003f3"},{"tid":541,"created_ino":"0x100000003f4"},{"tid":542,"created_ino":"0x100000003f5"},{"tid":543,"created_ino":"0x100000003f6"},{"tid":544,"created_ino":"0x100000003f7"},{"tid":545,"created_ino":"0x100000003f8"},{"tid":546,"created_ino":"0x100000003f9"},{"tid":547,"created_ino":"0x100000003fa"},{"tid":548,"created_ino":"0x100000003fb"},{"tid":549,"created_ino":"0x100000003fc"},{"tid":550,"created_ino":"0x100000003fd"},{"tid":551,"created_ino":"0x100000003fe"},{"tid":552,"created_ino":"0x100000003ff"},{"tid":553,"created_ino":"0x10000000400"},{"tid":554,"created_ino":"0x10000000401"},{"tid":555,"created_ino":"0x10000000402"},{"tid":556,"created_ino":"0x10000000403"},{"tid":557,"created_ino":"0x10000000404"},{"tid":558,"created_ino":"0x10000000405"},{"tid":559,"created_ino":"0x10000000406"},{"tid":560,"created_ino":"0x10000000407"},{"tid":561,"created_ino":"0x10000000408"},{"tid":562,"created_ino":"0x10000000409"},{"tid":563,"created_ino":"0x1000000040a"},{"tid":564,"created_ino":"0x1000000040b"},{"tid":565,"created_ino":"0x1000000040c"},{"tid":566,"created_ino":"0x1000000040d"},{"tid":567,"created_ino":"0x1000000040e"},{"tid":568,"created_ino":"0x1000000040f"},{"tid":569,"created_ino":"0x10000000410"},{"tid":570,"created_ino":"0x10000000411"},{"tid":571,"created_ino":"0x10000000412"},{"tid":572,"created_ino":"0x10000000413"},{"tid":573,"created_ino":"0x10000000414"},{"tid":574,"created_ino":"0x10000000415"},{"tid":575,"created_ino":"0x10000000416"},{"tid":576,"created_ino":"0x10000000417"},{"tid":577,"created_ino":"0x10000000418"},{"tid":578,"created_ino":"0x10000000419"},{"tid":579,"created_ino":"0x1000000041a"},{"tid":580,"created_ino":"0x1000000041b"},{"tid":581,"created_ino":"0x1000000041c"},{"tid":582,"created_ino":"0x1000000041d"},{"tid":583,"created_ino":"0x1000000041e"},{"tid":584,"created_ino":"0x1000000041f"},{"tid":585,"created_ino":"0x10000000420"},{"tid":586,"created_ino":"0x10000000421"},{"tid":587,"created_ino":"0x10000000422"},{"tid":588,"created_ino":"0x10000000423"},{"tid":589,"created_ino":"0x10000000424"},{"tid":590,"created_ino":"0x10000000425"},{"tid":591,"created_ino":"0x10000000426"},{"tid":592,"created_ino":"0x10000000427"},{"tid":593,"created_ino":"0x10000000428"},{"tid":594,"created_ino":"0x10000000429"},{"tid":595,"created_ino":"0x1000000042a"},{"tid":596,"created_ino":"0x1000000042b"},{"tid":597,"created_ino":"0x1000000042c"},{"tid":598,"created_ino":"0x1000000042d"},{"tid":599,"created_ino":"0x1000000042e"},{"tid":600,"created_ino":"0x1000000042f"},{"tid":601,"created_ino":"0x10000000430"},{"tid":602,"created_ino":"0x10000000431"},{"tid":603,"created_ino":"0x10000000432"},{"tid":604,"created_ino":"0x10000000433"},{"tid":605,"created_ino":"0x10000000434"},{"tid":606,"created_ino":"0x10000000435"},{"tid":607,"created_ino":"0x10000000436"},{"tid":608,"created_ino":"0x10000000437"},{"tid":609,"created_ino":"0x10000000438"},{"tid":610,"created_ino":"0x10000000439"},{"tid":611,"created_ino":"0x1000000043a"},{"tid":612,"created_ino":"0x1000000043b"},{"tid":613,"created_ino":"0x1000000043c"},{"tid":614,"created_ino":"0x1000000043d"},{"tid":615,"created_ino":"0x1000000043e"},{"tid":616,"created_ino":"0x1000000043f"},{"tid":617,"created_ino":"0x10000000440"},{"tid":618,"created_ino":"0x10000000441"},{"tid":619,"created_ino":"0x10000000442"},{"tid":620,"created_ino":"0x10000000443"},{"tid":621,"created_ino":"0x10000000444"},{"tid":622,"created_ino":"0x10000000445"},{"tid":623,"created_ino":"0x10000000446"},{"tid":624,"created_ino":"0x10000000447"},{"tid":625,"created_ino":"0x10000000448"},{"tid":626,"created_ino":"0x10000000449"},{"tid":627,"created_ino":"0x1000000044a"},{"tid":628,"created_ino":"0x1000000044b"},{"tid":629,"created_ino":"0x1000000044c"},{"tid":630,"created_ino":"0x1000000044d"},{"tid":631,"created_ino":"0x1000000044e"},{"tid":632,"created_ino":"0x1000000044f"},{"tid":633,"created_ino":"0x10000000450"},{"tid":634,"created_ino":"0x10000000451"},{"tid":635,"created_ino":"0x10000000452"},{"tid":636,"created_ino":"0x10000000453"},{"tid":637,"created_ino":"0x10000000454"},{"tid":638,"created_ino":"0x10000000455"},{"tid":639,"created_ino":"0x10000000456"},{"tid":640,"created_ino":"0x10000000457"},{"tid":641,"created_ino":"0x10000000458"},{"tid":642,"created_ino":"0x10000000459"},{"tid":643,"created_ino":"0x1000000045a"},{"tid":644,"created_ino":"0x1000000045b"},{"tid":645,"created_ino":"0x1000000045c"},{"tid":646,"created_ino":"0x1000000045d"},{"tid":647,"created_ino":"0x1000000045e"},{"tid":648,"created_ino":"0x1000000045f"},{"tid":649,"created_ino":"0x10000000460"},{"tid":650,"created_ino":"0x10000000461"},{"tid":651,"created_ino":"0x10000000462"},{"tid":652,"created_ino":"0x10000000463"},{"tid":653,"created_ino":"0x10000000464"},{"tid":654,"created_ino":"0x10000000465"},{"tid":655,"created_ino":"0x10000000466"},{"tid":656,"created_ino":"0x10000000467"},{"tid":657,"created_ino":"0x10000000468"},{"tid":658,"created_ino":"0x10000000469"},{"tid":659,"created_ino":"0x1000000046a"},{"tid":660,"created_ino":"0x1000000046b"},{"tid":661,"created_ino":"0x1000000046c"},{"tid":662,"created_ino":"0x1000000046d"},{"tid":663,"created_ino":"0x1000000046e"},{"tid":664,"created_ino":"0x1000000046f"},{"tid":665,"created_ino":"0x10000000470"},{"tid":666,"created_ino":"0x10000000471"},{"tid":667,"created_ino":"0x10000000472"},{"tid":668,"created_ino":"0x10000000473"},{"tid":669,"created_ino":"0x10000000474"},{"tid":670,"created_ino":"0x10000000475"},{"tid":671,"created_ino":"0x10000000476"},{"tid":672,"created_ino":"0x10000000477"},{"tid":673,"created_ino":"0x10000000478"},{"tid":674,"created_ino":"0x10000000479"},{"tid":675,"created_ino":"0x1000000047a"},{"tid":676,"created_ino":"0x1000000047b"},{"tid":677,"created_ino":"0x1000000047c"},{"tid":678,"created_ino":"0x1000000047d"},{"tid":679,"created_ino":"0x1000000047e"},{"tid":680,"created_ino":"0x1000000047f"},{"tid":681,"created_ino":"0x10000000480"},{"tid":682,"created_ino":"0x10000000481"},{"tid":683,"created_ino":"0x10000000482"},{"tid":684,"created_ino":"0x10000000483"},{"tid":685,"created_ino":"0x10000000484"},{"tid":686,"created_ino":"0x10000000485"},{"tid":687,"created_ino":"0x10000000486"},{"tid":688,"created_ino":"0x10000000487"},{"tid":689,"created_ino":"0x10000000488"},{"tid":690,"created_ino":"0x10000000489"},{"tid":691,"created_ino":"0x1000000048a"},{"tid":692,"created_ino":"0x1000000048b"},{"tid":693,"created_ino":"0x1000000048c"},{"tid":694,"created_ino":"0x1000000048d"},{"tid":695,"created_ino":"0x1000000048e"},{"tid":696,"created_ino":"0x1000000048f"},{"tid":697,"created_ino":"0x10000000490"},{"tid":698,"created_ino":"0x10000000491"},{"tid":699,"created_ino":"0x10000000492"},{"tid":700,"created_ino":"0x10000000493"},{"tid":701,"created_ino":"0x10000000494"},{"tid":702,"created_ino":"0x10000000495"},{"tid":703,"created_ino":"0x10000000496"},{"tid":704,"created_ino":"0x10000000497"},{"tid":705,"created_ino":"0x10000000498"},{"tid":706,"created_ino":"0x10000000499"},{"tid":707,"created_ino":"0x1000000049a"},{"tid":708,"created_ino":"0x1000000049b"},{"tid":709,"created_ino":"0x1000000049c"},{"tid":710,"created_ino":"0x1000000049d"},{"tid":711,"created_ino":"0x1000000049e"},{"tid":712,"created_ino":"0x1000000049f"},{"tid":713,"created_ino":"0x100000004a0"},{"tid":714,"created_ino":"0x100000004a1"},{"tid":715,"created_ino":"0x100000004a2"},{"tid":716,"created_ino":"0x100000004a3"},{"tid":717,"created_ino":"0x100000004a4"},{"tid":718,"created_ino":"0x100000004a5"},{"tid":719,"created_ino":"0x100000004a6"},{"tid":720,"created_ino":"0x100000004a7"},{"tid":721,"created_ino":"0x100000004a8"},{"tid":722,"created_ino":"0x100000004a9"},{"tid":723,"created_ino":"0x100000004aa"},{"tid":724,"created_ino":"0x100000004ab"},{"tid":725,"created_ino":"0x100000004ac"},{"tid":726,"created_ino":"0x100000004ad"},{"tid":727,"created_ino":"0x100000004ae"},{"tid":728,"created_ino":"0x100000004af"},{"tid":729,"created_ino":"0x100000004b0"},{"tid":730,"created_ino":"0x100000004b1"},{"tid":731,"created_ino":"0x100000004b2"},{"tid":732,"created_ino":"0x100000004b3"},{"tid":733,"created_ino":"0x100000004b4"},{"tid":734,"created_ino":"0x100000004b5"},{"tid":735,"created_ino":"0x100000004b6"},{"tid":736,"created_ino":"0x100000004b7"},{"tid":737,"created_ino":"0x100000004b8"},{"tid":738,"created_ino":"0x100000004b9"},{"tid":739,"created_ino":"0x100000004ba"},{"tid":740,"created_ino":"0x100000004bb"},{"tid":741,"created_ino":"0x100000004bc"},{"tid":742,"created_ino":"0x100000004bd"},{"tid":743,"created_ino":"0x100000004be"},{"tid":744,"created_ino":"0x100000004bf"},{"tid":745,"created_ino":"0x100000004c0"},{"tid":746,"created_ino":"0x100000004c1"},{"tid":747,"created_ino":"0x100000004c2"},{"tid":748,"created_ino":"0x100000004c3"},{"tid":749,"created_ino":"0x100000004c4"},{"tid":750,"created_ino":"0x100000004c5"},{"tid":751,"created_ino":"0x100000004c6"},{"tid":752,"created_ino":"0x100000004c7"},{"tid":753,"created_ino":"0x100000004c8"},{"tid":754,"created_ino":"0x100000004c9"},{"tid":755,"created_ino":"0x100000004ca"},{"tid":756,"created_ino":"0x100000004cb"},{"tid":757,"created_ino":"0x100000004cc"},{"tid":758,"created_ino":"0x100000004cd"},{"tid":759,"created_ino":"0x100000004ce"},{"tid":760,"created_ino":"0x100000004cf"},{"tid":761,"created_ino":"0x100000004d0"},{"tid":762,"created_ino":"0x100000004d1"},{"tid":763,"created_ino":"0x100000004d2"},{"tid":764,"created_ino":"0x100000004d3"},{"tid":765,"created_ino":"0x100000004d4"},{"tid":766,"created_ino":"0x100000004d5"},{"tid":767,"created_ino":"0x100000004d6"},{"tid":768,"created_ino":"0x100000004d7"},{"tid":769,"created_ino":"0x100000004d8"},{"tid":770,"created_ino":"0x100000004d9"},{"tid":771,"created_ino":"0x100000004da"},{"tid":772,"created_ino":"0x100000004db"},{"tid":773,"created_ino":"0x100000004dc"},{"tid":774,"created_ino":"0x100000004dd"},{"tid":775,"created_ino":"0x100000004de"},{"tid":776,"created_ino":"0x100000004df"},{"tid":777,"created_ino":"0x100000004e0"},{"tid":778,"created_ino":"0x100000004e1"},{"tid":779,"created_ino":"0x100000004e2"},{"tid":780,"created_ino":"0x100000004e3"},{"tid":781,"created_ino":"0x100000004e4"},{"tid":782,"created_ino":"0x100000004e5"},{"tid":783,"created_ino":"0x100000004e6"},{"tid":784,"created_ino":"0x100000004e7"},{"tid":785,"created_ino":"0x100000004e8"},{"tid":786,"created_ino":"0x100000004e9"},{"tid":787,"created_ino":"0x100000004ea"},{"tid":788,"created_ino":"0x100000004eb"},{"tid":789,"created_ino":"0x100000004ec"},{"tid":790,"created_ino":"0x100000004ed"},{"tid":791,"created_ino":"0x100000004ee"},{"tid":792,"created_ino":"0x100000004ef"},{"tid":793,"created_ino":"0x100000004f0"},{"tid":794,"created_ino":"0x100000004f1"},{"tid":795,"created_ino":"0x100000004f2"},{"tid":796,"created_ino":"0x100000004f3"},{"tid":797,"created_ino":"0x100000004f4"},{"tid":798,"created_ino":"0x100000004f5"},{"tid":799,"created_ino":"0x100000004f6"},{"tid":800,"created_ino":"0x100000004f7"},{"tid":801,"created_ino":"0x100000004f8"},{"tid":802,"created_ino":"0x100000004f9"},{"tid":803,"created_ino":"0x100000004fa"},{"tid":804,"created_ino":"0x100000004fb"},{"tid":805,"created_ino":"0x100000004fc"},{"tid":806,"created_ino":"0x100000004fd"},{"tid":807,"created_ino":"0x100000004fe"},{"tid":808,"created_ino":"0x100000004ff"},{"tid":809,"created_ino":"0x10000000500"},{"tid":810,"created_ino":"0x10000000501"},{"tid":811,"created_ino":"0x10000000502"},{"tid":812,"created_ino":"0x10000000503"},{"tid":813,"created_ino":"0x10000000504"},{"tid":814,"created_ino":"0x10000000505"},{"tid":815,"created_ino":"0x10000000506"},{"tid":816,"created_ino":"0x10000000507"},{"tid":817,"created_ino":"0x10000000508"},{"tid":818,"created_ino":"0x10000000509"},{"tid":819,"created_ino":"0x1000000050a"},{"tid":820,"created_ino":"0x1000000050b"},{"tid":821,"created_ino":"0x1000000050c"},{"tid":822,"created_ino":"0x1000000050d"},{"tid":823,"created_ino":"0x1000000050e"},{"tid":824,"created_ino":"0x1000000050f"},{"tid":825,"created_ino":"0x10000000510"},{"tid":826,"created_ino":"0x10000000511"},{"tid":827,"created_ino":"0x10000000512"},{"tid":828,"created_ino":"0x10000000513"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000514","length":203},{"start":"0x100000005e0","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T18:01:06.082 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 170972652, "type": "any" }, "name": { "num": 7618, "type": "client" } }, "id": 7618, "inst": "client.7618 192.168.0.1:0/170972652", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.952552039105582 }, "state": "open", "uptime": 8.731898862 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000003e9", "tid": 530 }, { "created_ino": "0x100000003ea", "tid": 531 }, { "created_ino": "0x100000003eb", "tid": 532 }, { "created_ino": "0x100000003ec", "tid": 533 }, { "created_ino": "0x100000003ed", "tid": 534 }, { "created_ino": "0x100000003ee", "tid": 535 }, { "created_ino": "0x100000003ef", "tid": 536 }, { "created_ino": "0x100000003f0", "tid": 537 }, { "created_ino": "0x100000003f1", "tid": 538 }, { "created_ino": "0x100000003f2", "tid": 539 }, { "created_ino": "0x100000003f3", "tid": 540 }, { "created_ino": "0x100000003f4", "tid": 541 }, { "created_ino": "0x100000003f5", "tid": 542 }, { "created_ino": "0x100000003f6", "tid": 543 }, { "created_ino": "0x100000003f7", "tid": 544 }, { "created_ino": "0x100000003f8", "tid": 545 }, { "created_ino": "0x100000003f9", "tid": 546 }, { "created_ino": "0x100000003fa", "tid": 547 }, { "created_ino": "0x100000003fb", "tid": 548 }, { "created_ino": "0x100000003fc", "tid": 549 }, { "created_ino": "0x100000003fd", "tid": 550 }, { "created_ino": "0x100000003fe", "tid": 551 }, { "created_ino": "0x100000003ff", "tid": 552 }, { "created_ino": "0x10000000400", "tid": 553 }, { "created_ino": "0x10000000401", "tid": 554 }, { "created_ino": "0x10000000402", "tid": 555 }, { "created_ino": "0x10000000403", "tid": 556 }, { "created_ino": "0x10000000404", "tid": 557 }, { "created_ino": "0x10000000405", "tid": 558 }, { "created_ino": "0x10000000406", "tid": 559 }, { "created_ino": "0x10000000407", "tid": 560 }, { "created_ino": "0x10000000408", "tid": 561 }, { "created_ino": "0x10000000409", "tid": 562 }, { "created_ino": "0x1000000040a", "tid": 563 }, { "created_ino": "0x1000000040b", "tid": 564 }, { "created_ino": "0x1000000040c", "tid": 565 }, { "created_ino": "0x1000000040d", "tid": 566 }, { "created_ino": "0x1000000040e", "tid": 567 }, { "created_ino": "0x1000000040f", "tid": 568 }, { "created_ino": "0x10000000410", "tid": 569 }, { "created_ino": "0x10000000411", "tid": 570 }, { "created_ino": "0x10000000412", "tid": 571 }, { "created_ino": "0x10000000413", "tid": 572 }, { "created_ino": "0x10000000414", "tid": 573 }, { "created_ino": "0x10000000415", "tid": 574 }, { "created_ino": "0x10000000416", "tid": 575 }, { "created_ino": "0x10000000417", "tid": 576 }, { "created_ino": "0x10000000418", "tid": 577 }, { "created_ino": "0x10000000419", "tid": 578 }, { "created_ino": "0x1000000041a", "tid": 579 }, { "created_ino": "0x1000000041b", "tid": 580 }, { "created_ino": "0x1000000041c", "tid": 581 }, { "created_ino": "0x1000000041d", "tid": 582 }, { "created_ino": "0x1000000041e", "tid": 583 }, { "created_ino": "0x1000000041f", "tid": 584 }, { "created_ino": "0x10000000420", "tid": 585 }, { "created_ino": "0x10000000421", "tid": 586 }, { "created_ino": "0x10000000422", "tid": 587 }, { "created_ino": "0x10000000423", "tid": 588 }, { "created_ino": "0x10000000424", "tid": 589 }, { "created_ino": "0x10000000425", "tid": 590 }, { "created_ino": "0x10000000426", "tid": 591 }, { "created_ino": "0x10000000427", "tid": 592 }, { "created_ino": "0x10000000428", "tid": 593 }, { "created_ino": "0x10000000429", "tid": 594 }, { "created_ino": "0x1000000042a", "tid": 595 }, { "created_ino": "0x1000000042b", "tid": 596 }, { "created_ino": "0x1000000042c", "tid": 597 }, { "created_ino": "0x1000000042d", "tid": 598 }, { "created_ino": "0x1000000042e", "tid": 599 }, { "created_ino": "0x1000000042f", "tid": 600 }, { "created_ino": "0x10000000430", "tid": 601 }, { "created_ino": "0x10000000431", "tid": 602 }, { "created_ino": "0x10000000432", "tid": 603 }, { "created_ino": "0x10000000433", "tid": 604 }, { "created_ino": "0x10000000434", "tid": 605 }, { "created_ino": "0x10000000435", "tid": 606 }, { "created_ino": "0x10000000436", "tid": 607 }, { "created_ino": "0x10000000437", "tid": 608 }, { "created_ino": "0x10000000438", "tid": 609 }, { "created_ino": "0x10000000439", "tid": 610 }, { "created_ino": "0x1000000043a", "tid": 611 }, { "created_ino": "0x1000000043b", "tid": 612 }, { "created_ino": "0x1000000043c", "tid": 613 }, { "created_ino": "0x1000000043d", "tid": 614 }, { "created_ino": "0x1000000043e", "tid": 615 }, { "created_ino": "0x1000000043f", "tid": 616 }, { "created_ino": "0x10000000440", "tid": 617 }, { "created_ino": "0x10000000441", "tid": 618 }, { "created_ino": "0x10000000442", "tid": 619 }, { "created_ino": "0x10000000443", "tid": 620 }, { "created_ino": "0x10000000444", "tid": 621 }, { "created_ino": "0x10000000445", "tid": 622 }, { "created_ino": "0x10000000446", "tid": 623 }, { "created_ino": "0x10000000447", "tid": 624 }, { "created_ino": "0x10000000448", "tid": 625 }, { "created_ino": "0x10000000449", "tid": 626 }, { "created_ino": "0x1000000044a", "tid": 627 }, { "created_ino": "0x1000000044b", "tid": 628 }, { "created_ino": "0x1000000044c", "tid": 629 }, { "created_ino": "0x1000000044d", "tid": 630 }, { "created_ino": "0x1000000044e", "tid": 631 }, { "created_ino": "0x1000000044f", "tid": 632 }, { "created_ino": "0x10000000450", "tid": 633 }, { "created_ino": "0x10000000451", "tid": 634 }, { "created_ino": "0x10000000452", "tid": 635 }, { "created_ino": "0x10000000453", "tid": 636 }, { "created_ino": "0x10000000454", "tid": 637 }, { "created_ino": "0x10000000455", "tid": 638 }, { "created_ino": "0x10000000456", "tid": 639 }, { "created_ino": "0x10000000457", "tid": 640 }, { "created_ino": "0x10000000458", "tid": 641 }, { "created_ino": "0x10000000459", "tid": 642 }, { "created_ino": "0x1000000045a", "tid": 643 }, { "created_ino": "0x1000000045b", "tid": 644 }, { "created_ino": "0x1000000045c", "tid": 645 }, { "created_ino": "0x1000000045d", "tid": 646 }, { "created_ino": "0x1000000045e", "tid": 647 }, { "created_ino": "0x1000000045f", "tid": 648 }, { "created_ino": "0x10000000460", "tid": 649 }, { "created_ino": "0x10000000461", "tid": 650 }, { "created_ino": "0x10000000462", "tid": 651 }, { "created_ino": "0x10000000463", "tid": 652 }, { "created_ino": "0x10000000464", "tid": 653 }, { "created_ino": "0x10000000465", "tid": 654 }, { "created_ino": "0x10000000466", "tid": 655 }, { "created_ino": "0x10000000467", "tid": 656 }, { "created_ino": "0x10000000468", "tid": 657 }, { "created_ino": "0x10000000469", "tid": 658 }, { "created_ino": "0x1000000046a", "tid": 659 }, { "created_ino": "0x1000000046b", "tid": 660 }, { "created_ino": "0x1000000046c", "tid": 661 }, { "created_ino": "0x1000000046d", "tid": 662 }, { "created_ino": "0x1000000046e", "tid": 663 }, { "created_ino": "0x1000000046f", "tid": 664 }, { "created_ino": "0x10000000470", "tid": 665 }, { "created_ino": "0x10000000471", "tid": 666 }, { "created_ino": "0x10000000472", "tid": 667 }, { "created_ino": "0x10000000473", "tid": 668 }, { "created_ino": "0x10000000474", "tid": 669 }, { "created_ino": "0x10000000475", "tid": 670 }, { "created_ino": "0x10000000476", "tid": 671 }, { "created_ino": "0x10000000477", "tid": 672 }, { "created_ino": "0x10000000478", "tid": 673 }, { "created_ino": "0x10000000479", "tid": 674 }, { "created_ino": "0x1000000047a", "tid": 675 }, { "created_ino": "0x1000000047b", "tid": 676 }, { "created_ino": "0x1000000047c", "tid": 677 }, { "created_ino": "0x1000000047d", "tid": 678 }, { "created_ino": "0x1000000047e", "tid": 679 }, { "created_ino": "0x1000000047f", "tid": 680 }, { "created_ino": "0x10000000480", "tid": 681 }, { "created_ino": "0x10000000481", "tid": 682 }, { "created_ino": "0x10000000482", "tid": 683 }, { "created_ino": "0x10000000483", "tid": 684 }, { "created_ino": "0x10000000484", "tid": 685 }, { "created_ino": "0x10000000485", "tid": 686 }, { "created_ino": "0x10000000486", "tid": 687 }, { "created_ino": "0x10000000487", "tid": 688 }, { "created_ino": "0x10000000488", "tid": 689 }, { "created_ino": "0x10000000489", "tid": 690 }, { "created_ino": "0x1000000048a", "tid": 691 }, { "created_ino": "0x1000000048b", "tid": 692 }, { "created_ino": "0x1000000048c", "tid": 693 }, { "created_ino": "0x1000000048d", "tid": 694 }, { "created_ino": "0x1000000048e", "tid": 695 }, { "created_ino": "0x1000000048f", "tid": 696 }, { "created_ino": "0x10000000490", "tid": 697 }, { "created_ino": "0x10000000491", "tid": 698 }, { "created_ino": "0x10000000492", "tid": 699 }, { "created_ino": "0x10000000493", "tid": 700 }, { "created_ino": "0x10000000494", "tid": 701 }, { "created_ino": "0x10000000495", "tid": 702 }, { "created_ino": "0x10000000496", "tid": 703 }, { "created_ino": "0x10000000497", "tid": 704 }, { "created_ino": "0x10000000498", "tid": 705 }, { "created_ino": "0x10000000499", "tid": 706 }, { "created_ino": "0x1000000049a", "tid": 707 }, { "created_ino": "0x1000000049b", "tid": 708 }, { "created_ino": "0x1000000049c", "tid": 709 }, { "created_ino": "0x1000000049d", "tid": 710 }, { "created_ino": "0x1000000049e", "tid": 711 }, { "created_ino": "0x1000000049f", "tid": 712 }, { "created_ino": "0x100000004a0", "tid": 713 }, { "created_ino": "0x100000004a1", "tid": 714 }, { "created_ino": "0x100000004a2", "tid": 715 }, { "created_ino": "0x100000004a3", "tid": 716 }, { "created_ino": "0x100000004a4", "tid": 717 }, { "created_ino": "0x100000004a5", "tid": 718 }, { "created_ino": "0x100000004a6", "tid": 719 }, { "created_ino": "0x100000004a7", "tid": 720 }, { "created_ino": "0x100000004a8", "tid": 721 }, { "created_ino": "0x100000004a9", "tid": 722 }, { "created_ino": "0x100000004aa", "tid": 723 }, { "created_ino": "0x100000004ab", "tid": 724 }, { "created_ino": "0x100000004ac", "tid": 725 }, { "created_ino": "0x100000004ad", "tid": 726 }, { "created_ino": "0x100000004ae", "tid": 727 }, { "created_ino": "0x100000004af", "tid": 728 }, { "created_ino": "0x100000004b0", "tid": 729 }, { "created_ino": "0x100000004b1", "tid": 730 }, { "created_ino": "0x100000004b2", "tid": 731 }, { "created_ino": "0x100000004b3", "tid": 732 }, { "created_ino": "0x100000004b4", "tid": 733 }, { "created_ino": "0x100000004b5", "tid": 734 }, { "created_ino": "0x100000004b6", "tid": 735 }, { "created_ino": "0x100000004b7", "tid": 736 }, { "created_ino": "0x100000004b8", "tid": 737 }, { "created_ino": "0x100000004b9", "tid": 738 }, { "created_ino": "0x100000004ba", "tid": 739 }, { "created_ino": "0x100000004bb", "tid": 740 }, { "created_ino": "0x100000004bc", "tid": 741 }, { "created_ino": "0x100000004bd", "tid": 742 }, { "created_ino": "0x100000004be", "tid": 743 }, { "created_ino": "0x100000004bf", "tid": 744 }, { "created_ino": "0x100000004c0", "tid": 745 }, { "created_ino": "0x100000004c1", "tid": 746 }, { "created_ino": "0x100000004c2", "tid": 747 }, { "created_ino": "0x100000004c3", "tid": 748 }, { "created_ino": "0x100000004c4", "tid": 749 }, { "created_ino": "0x100000004c5", "tid": 750 }, { "created_ino": "0x100000004c6", "tid": 751 }, { "created_ino": "0x100000004c7", "tid": 752 }, { "created_ino": "0x100000004c8", "tid": 753 }, { "created_ino": "0x100000004c9", "tid": 754 }, { "created_ino": "0x100000004ca", "tid": 755 }, { "created_ino": "0x100000004cb", "tid": 756 }, { "created_ino": "0x100000004cc", "tid": 757 }, { "created_ino": "0x100000004cd", "tid": 758 }, { "created_ino": "0x100000004ce", "tid": 759 }, { "created_ino": "0x100000004cf", "tid": 760 }, { "created_ino": "0x100000004d0", "tid": 761 }, { "created_ino": "0x100000004d1", "tid": 762 }, { "created_ino": "0x100000004d2", "tid": 763 }, { "created_ino": "0x100000004d3", "tid": 764 }, { "created_ino": "0x100000004d4", "tid": 765 }, { "created_ino": "0x100000004d5", "tid": 766 }, { "created_ino": "0x100000004d6", "tid": 767 }, { "created_ino": "0x100000004d7", "tid": 768 }, { "created_ino": "0x100000004d8", "tid": 769 }, { "created_ino": "0x100000004d9", "tid": 770 }, { "created_ino": "0x100000004da", "tid": 771 }, { "created_ino": "0x100000004db", "tid": 772 }, { "created_ino": "0x100000004dc", "tid": 773 }, { "created_ino": "0x100000004dd", "tid": 774 }, { "created_ino": "0x100000004de", "tid": 775 }, { "created_ino": "0x100000004df", "tid": 776 }, { "created_ino": "0x100000004e0", "tid": 777 }, { "created_ino": "0x100000004e1", "tid": 778 }, { "created_ino": "0x100000004e2", "tid": 779 }, { "created_ino": "0x100000004e3", "tid": 780 }, { "created_ino": "0x100000004e4", "tid": 781 }, { "created_ino": "0x100000004e5", "tid": 782 }, { "created_ino": "0x100000004e6", "tid": 783 }, { "created_ino": "0x100000004e7", "tid": 784 }, { "created_ino": "0x100000004e8", "tid": 785 }, { "created_ino": "0x100000004e9", "tid": 786 }, { "created_ino": "0x100000004ea", "tid": 787 }, { "created_ino": "0x100000004eb", "tid": 788 }, { "created_ino": "0x100000004ec", "tid": 789 }, { "created_ino": "0x100000004ed", "tid": 790 }, { "created_ino": "0x100000004ee", "tid": 791 }, { "created_ino": "0x100000004ef", "tid": 792 }, { "created_ino": "0x100000004f0", "tid": 793 }, { "created_ino": "0x100000004f1", "tid": 794 }, { "created_ino": "0x100000004f2", "tid": 795 }, { "created_ino": "0x100000004f3", "tid": 796 }, { "created_ino": "0x100000004f4", "tid": 797 }, { "created_ino": "0x100000004f5", "tid": 798 }, { "created_ino": "0x100000004f6", "tid": 799 }, { "created_ino": "0x100000004f7", "tid": 800 }, { "created_ino": "0x100000004f8", "tid": 801 }, { "created_ino": "0x100000004f9", "tid": 802 }, { "created_ino": "0x100000004fa", "tid": 803 }, { "created_ino": "0x100000004fb", "tid": 804 }, { "created_ino": "0x100000004fc", "tid": 805 }, { "created_ino": "0x100000004fd", "tid": 806 }, { "created_ino": "0x100000004fe", "tid": 807 }, { "created_ino": "0x100000004ff", "tid": 808 }, { "created_ino": "0x10000000500", "tid": 809 }, { "created_ino": "0x10000000501", "tid": 810 }, { "created_ino": "0x10000000502", "tid": 811 }, { "created_ino": "0x10000000503", "tid": 812 }, { "created_ino": "0x10000000504", "tid": 813 }, { "created_ino": "0x10000000505", "tid": 814 }, { "created_ino": "0x10000000506", "tid": 815 }, { "created_ino": "0x10000000507", "tid": 816 }, { "created_ino": "0x10000000508", "tid": 817 }, { "created_ino": "0x10000000509", "tid": 818 }, { "created_ino": "0x1000000050a", "tid": 819 }, { "created_ino": "0x1000000050b", "tid": 820 }, { "created_ino": "0x1000000050c", "tid": 821 }, { "created_ino": "0x1000000050d", "tid": 822 }, { "created_ino": "0x1000000050e", "tid": 823 }, { "created_ino": "0x1000000050f", "tid": 824 }, { "created_ino": "0x10000000510", "tid": 825 }, { "created_ino": "0x10000000511", "tid": 826 }, { "created_ino": "0x10000000512", "tid": 827 }, { "created_ino": "0x10000000513", "tid": 828 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 2549548364, "type": "any" }, "name": { "num": 7612, "type": "client" } }, "id": 7612, "inst": "client.7612 172.21.15.6:0/2549548364", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 530, "num_caps": 802, "num_completed_flushes": 0, "num_completed_requests": 299, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 203, "start": "0x10000000514" }, { "length": 501, "start": "0x100000005e0" } ], "recall_caps": { "halflife": 60, "value": 2328.4212155138202 }, "recall_caps_throttle": { "halflife": 1.5, "value": 951.1127856522505 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 440.963112591293 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 775, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1584.5252607221487 }, "state": "open", "uptime": 9.860885764 } ] 2024-05-20T18:01:06.082 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-05-20T18:01:06.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T18:01:06.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.198+0000 7f6d606ab640 1 Processor -- start 2024-05-20T18:01:06.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.198+0000 7f6d606ab640 1 -- start start 2024-05-20T18:01:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.199+0000 7f6d606ab640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d580d4120 0x7f6d580d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.199+0000 7f6d606ab640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5815fe30 0x7f6d58160960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.199+0000 7f6d606ab640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d580d5440 con 0x7f6d580d5030 2024-05-20T18:01:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.199+0000 7f6d606ab640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6d58160380 con 0x7f6d580d4120 2024-05-20T18:01:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.199+0000 7f6d606ab640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6d58160660 con 0x7f6d5815fe30 2024-05-20T18:01:06.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.199+0000 7f6d5e447640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d580d4120 0x7f6d580d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.199+0000 7f6d5e447640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d580d4120 0x7f6d580d4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53076/0 (socket says 172.21.15.6:53076) 2024-05-20T18:01:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.199+0000 7f6d5e447640 1 -- 172.21.15.6:0/3953285398 learned_addr learned my addr 172.21.15.6:0/3953285398 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.200+0000 7f6d5ec48640 1 --2- 172.21.15.6:0/3953285398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5815fe30 0x7f6d58160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.200+0000 7f6d5e447640 1 -- 172.21.15.6:0/3953285398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5815fe30 msgr2=0x7f6d58160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.200+0000 7f6d5e447640 1 --2- 172.21.15.6:0/3953285398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5815fe30 0x7f6d58160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.200+0000 7f6d5e447640 1 -- 172.21.15.6:0/3953285398 >> v1:172.21.15.171:6789/0 conn(0x7f6d580d5030 legacy=0x7f6d5815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:06.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.200+0000 7f6d5e447640 1 -- 172.21.15.6:0/3953285398 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d580d3640 con 0x7f6d580d4120 2024-05-20T18:01:06.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.201+0000 7f6d5e447640 1 --2- 172.21.15.6:0/3953285398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d580d4af0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009870 tx=0x7f6d5402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191a033311286124 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:06.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.201+0000 7f6d5d445640 1 -- 172.21.15.6:0/3953285398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54037070 con 0x7f6d580d4120 2024-05-20T18:01:06.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.201+0000 7f6d5d445640 1 -- 172.21.15.6:0/3953285398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d54032440 con 0x7f6d580d4120 2024-05-20T18:01:06.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.201+0000 7f6d5d445640 1 -- 172.21.15.6:0/3953285398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54032810 con 0x7f6d580d4120 2024-05-20T18:01:06.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.201+0000 7f6d606ab640 1 -- 172.21.15.6:0/3953285398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 msgr2=0x7f6d580d4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.201+0000 7f6d606ab640 1 --2- 172.21.15.6:0/3953285398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d580d4af0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009870 tx=0x7f6d5402a210 comp rx=0 tx=0).stop 2024-05-20T18:01:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.202+0000 7f6d606ab640 1 -- 172.21.15.6:0/3953285398 shutdown_connections 2024-05-20T18:01:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.202+0000 7f6d606ab640 1 --2- 172.21.15.6:0/3953285398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d5815fe30 0x7f6d58160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.202+0000 7f6d606ab640 1 --2- 172.21.15.6:0/3953285398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d580d4af0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.202+0000 7f6d606ab640 1 -- 172.21.15.6:0/3953285398 >> 172.21.15.6:0/3953285398 conn(0x7f6d5806b520 msgr2=0x7f6d5806b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.202+0000 7f6d606ab640 1 -- 172.21.15.6:0/3953285398 shutdown_connections 2024-05-20T18:01:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.202+0000 7f6d606ab640 1 -- 172.21.15.6:0/3953285398 wait complete. 2024-05-20T18:01:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.203+0000 7f6d606ab640 1 Processor -- start 2024-05-20T18:01:06.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.203+0000 7f6d606ab640 1 -- start start 2024-05-20T18:01:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d606ab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d581f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d606ab640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d580d5030 0x7f6d581e9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d606ab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d5815fe30 0x7f6d581e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d606ab640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6d580d4530 con 0x7f6d580d4120 2024-05-20T18:01:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d606ab640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6d580d31a0 con 0x7f6d5815fe30 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d606ab640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6d580d46b0 con 0x7f6d580d5030 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d581f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d581f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53084/0 (socket says 172.21.15.6:53084) 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 -- 172.21.15.6:0/1803601925 learned_addr learned my addr 172.21.15.6:0/1803601925 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5ec48640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d5815fe30 0x7f6d581e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 -- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d580d5030 msgr2=0x7f6d581e9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5dc46640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d580d5030 0x7f6d581e9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d580d5030 0x7f6d581e9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 -- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d5815fe30 msgr2=0x7f6d581e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d5815fe30 0x7f6d581e9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 -- 172.21.15.6:0/1803601925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d580cca60 con 0x7f6d580d4120 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5ec48640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d5815fe30 0x7f6d581e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:06.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5dc46640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d580d5030 0x7f6d581e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d5e447640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d581f86c0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f6d54000c00 tx=0x7f6d540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.205+0000 7f6d4effd640 1 -- 172.21.15.6:0/1803601925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54041070 con 0x7f6d580d4120 2024-05-20T18:01:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.206+0000 7f6d4effd640 1 -- 172.21.15.6:0/1803601925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5403c870 con 0x7f6d580d4120 2024-05-20T18:01:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.206+0000 7f6d4effd640 1 -- 172.21.15.6:0/1803601925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54037040 con 0x7f6d580d4120 2024-05-20T18:01:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.206+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d580ccd40 con 0x7f6d580d4120 2024-05-20T18:01:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.206+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d580cd300 con 0x7f6d580d4120 2024-05-20T18:01:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.207+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d580690b0 con 0x7f6d580d4120 2024-05-20T18:01:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.207+0000 7f6d4effd640 1 -- 172.21.15.6:0/1803601925 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d54044070 con 0x7f6d580d4120 2024-05-20T18:01:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.208+0000 7f6d4effd640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d3c06be60 0x7f6d3c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.208+0000 7f6d4effd640 1 -- 172.21.15.6:0/1803601925 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f6d540abb80 con 0x7f6d580d4120 2024-05-20T18:01:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.208+0000 7f6d5dc46640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d3c06be60 0x7f6d3c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.209+0000 7f6d5dc46640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d3c06be60 0x7f6d3c06e370 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6d5815bf10 tx=0x7f6d48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:06.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.213+0000 7f6d4effd640 1 -- 172.21.15.6:0/1803601925 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6d580d5440 con 0x7f6d580d4120 2024-05-20T18:01:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.436+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6d580cfea0 con 0x7f6d580d4120 2024-05-20T18:01:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.437+0000 7f6d4effd640 1 -- 172.21.15.6:0/1803601925 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f6d5407a310 con 0x7f6d580d4120 2024-05-20T18:01:06.435 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:06.435 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-05-20T18:01:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d3c06be60 msgr2=0x7f6d3c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d3c06be60 0x7f6d3c06e370 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6d5815bf10 tx=0x7f6d48008040 comp rx=0 tx=0).stop 2024-05-20T18:01:06.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 msgr2=0x7f6d581f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d581f86c0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f6d54000c00 tx=0x7f6d540046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 shutdown_connections 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6d3c06be60 0x7f6d3c06e370 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d5815fe30 0x7f6d581e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6d580d5030 0x7f6d581e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 --2- 172.21.15.6:0/1803601925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d580d4120 0x7f6d581f86c0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 >> 172.21.15.6:0/1803601925 conn(0x7f6d5806b520 msgr2=0x7f6d580cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 shutdown_connections 2024-05-20T18:01:06.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.439+0000 7f6d606ab640 1 -- 172.21.15.6:0/1803601925 wait complete. 2024-05-20T18:01:06.448 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-20T18:01:06.448 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-05-20T18:01:06.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T18:01:06.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.564+0000 7f3406aa2640 1 Processor -- start 2024-05-20T18:01:06.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.564+0000 7f3406aa2640 1 -- start start 2024-05-20T18:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f3406aa2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f34000cea10 0x7f34000cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f3406aa2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 0x7f34000d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f3406aa2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340015f7b0 con 0x7f34000b2240 2024-05-20T18:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f3406aa2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f34000cc8a0 con 0x7f34000cea10 2024-05-20T18:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f3406aa2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f34000cef40 con 0x7f34000cc490 2024-05-20T18:01:06.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f340483e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34000b2240 0x7f340009adc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43482/0 (socket says 172.21.15.6:43482) 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f340483e640 1 -- 172.21.15.6:0/3980455444 learned_addr learned my addr 172.21.15.6:0/3980455444 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f33fffff640 1 --2- 172.21.15.6:0/3980455444 >> v2:172.21.15.171:3300/0 conn(0x7f34000cea10 0x7f34000cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f340503f640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 0x7f34000d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316164747 0 0) 0x7f340015f7b0 con 0x7f34000b2240 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33e8003520 con 0x7f34000b2240 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.566+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2407995395 0 0) 0x7f33e8003520 con 0x7f34000b2240 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 msgr2=0x7f34000d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 0x7f34000d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 >> v2:172.21.15.171:3300/0 conn(0x7f34000cea10 msgr2=0x7f34000cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 --2- 172.21.15.6:0/3980455444 >> v2:172.21.15.171:3300/0 conn(0x7f34000cea10 0x7f34000cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34000b2c70 con 0x7f34000b2240 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f33f0001670 con 0x7f34000b2240 2024-05-20T18:01:06.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 >> v1:172.21.15.6:6789/0 conn(0x7f34000b2240 legacy=0x7f340009adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e80039b0 0x7f33e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 0x7f33e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33e8004d40 0x7f33e8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34000cc8a0 con 0x7f33e80039b0 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f34000cef40 con 0x7f33e8004d40 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33e800ba40 con 0x7f34000cc490 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f340483e640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e80039b0 0x7f33e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33fffff640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 0x7f33e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f340503f640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33e8004d40 0x7f33e8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f340483e640 1 -- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 msgr2=0x7f33e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f340483e640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 0x7f33e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f340483e640 1 -- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33e8004d40 msgr2=0x7f33e8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:06.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f340483e640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33e8004d40 0x7f33e8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f340483e640 1 -- 172.21.15.6:0/3980455444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e8003520 con 0x7f33e80039b0 2024-05-20T18:01:06.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.567+0000 7f33fffff640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34000cc490 0x7f33e8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:06.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.568+0000 7f340483e640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e80039b0 0x7f33e8003e20 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f33f0001eb0 tx=0x7f33e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9a04a53ee8237c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:06.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.568+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0007d70 con 0x7f33e80039b0 2024-05-20T18:01:06.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.568+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f0005af0 con 0x7f33e80039b0 2024-05-20T18:01:06.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.568+0000 7f33ff7fe640 1 -- 172.21.15.6:0/3980455444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0007070 con 0x7f33e80039b0 2024-05-20T18:01:06.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.569+0000 7f3406aa2640 1 -- 172.21.15.6:0/3980455444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e80039b0 msgr2=0x7f33e8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.569+0000 7f3406aa2640 1 --2- 172.21.15.6:0/3980455444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e80039b0 0x7f33e8003e20 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f33f0001eb0 tx=0x7f33e8005830 comp rx=0 tx=0).stop 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.569+0000 7f340503f640 1 -- 172.21.15.6:0/3980455444 reap_dead start 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.569+0000 7f3406aa2640 1 -- 172.21.15.6:0/3980455444 shutdown_connections 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.569+0000 7f3406aa2640 1 -- 172.21.15.6:0/3980455444 >> 172.21.15.6:0/3980455444 conn(0x7f34000b6620 msgr2=0x7f34000b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.569+0000 7f3406aa2640 1 -- 172.21.15.6:0/3980455444 shutdown_connections 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.569+0000 7f3406aa2640 1 -- 172.21.15.6:0/3980455444 wait complete. 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.570+0000 7f3406aa2640 1 Processor -- start 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.571+0000 7f3406aa2640 1 -- start start 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f3406aa2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33e80039b0 0x7f34000c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f3406aa2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34000c7cf0 0x7f34000c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f3406aa2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34000c5eb0 0x7f34000ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f3406aa2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34000d0ee0 con 0x7f34000c5eb0 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f3406aa2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f34000b3230 con 0x7f34000c7cf0 2024-05-20T18:01:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f3406aa2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f34000d1060 con 0x7f33e80039b0 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340503f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34000c5eb0 0x7f34000ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340503f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34000c5eb0 0x7f34000ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53096/0 (socket says 172.21.15.6:53096) 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340503f640 1 -- 172.21.15.6:0/481407317 learned_addr learned my addr 172.21.15.6:0/481407317 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340483e640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33e80039b0 0x7f34000c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f33fffff640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34000c7cf0 0x7f34000c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340503f640 1 -- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33e80039b0 msgr2=0x7f34000c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340503f640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33e80039b0 0x7f34000c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340503f640 1 -- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34000c7cf0 msgr2=0x7f34000c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340503f640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34000c7cf0 0x7f34000c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.572+0000 7f340503f640 1 -- 172.21.15.6:0/481407317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34001531e0 con 0x7f34000c5eb0 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.573+0000 7f340503f640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34000c5eb0 0x7f34000ca6c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3400071f90 tx=0x7f33f80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.573+0000 7f33fd7fa640 1 -- 172.21.15.6:0/481407317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8011e40 con 0x7f34000c5eb0 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.573+0000 7f33fd7fa640 1 -- 172.21.15.6:0/481407317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f801b070 con 0x7f34000c5eb0 2024-05-20T18:01:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.573+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34000c6670 con 0x7f34000c5eb0 2024-05-20T18:01:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.573+0000 7f33fd7fa640 1 -- 172.21.15.6:0/481407317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8003990 con 0x7f34000c5eb0 2024-05-20T18:01:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.573+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34000b0c30 con 0x7f34000c5eb0 2024-05-20T18:01:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.574+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34001f54c0 con 0x7f34000c5eb0 2024-05-20T18:01:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.575+0000 7f33fd7fa640 1 -- 172.21.15.6:0/481407317 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33f8005d10 con 0x7f34000c5eb0 2024-05-20T18:01:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.575+0000 7f33fd7fa640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33ec06be60 0x7f33ec06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.575+0000 7f33fd7fa640 1 -- 172.21.15.6:0/481407317 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f33f808b580 con 0x7f34000c5eb0 2024-05-20T18:01:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.575+0000 7f340483e640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33ec06be60 0x7f33ec06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.576+0000 7f340483e640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33ec06be60 0x7f33ec06e370 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f33f0033000 tx=0x7f33f0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:06.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.580+0000 7f33fd7fa640 1 -- 172.21.15.6:0/481407317 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f33f8025020 con 0x7f34000c5eb0 2024-05-20T18:01:06.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.801+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f34000690b0 con 0x7f34000c5eb0 2024-05-20T18:01:06.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.801+0000 7f33fd7fa640 1 -- 172.21.15.6:0/481407317 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f33f8014350 con 0x7f34000c5eb0 2024-05-20T18:01:06.799 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:06.799 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-05-20T18:01:06.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33ec06be60 msgr2=0x7f33ec06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33ec06be60 0x7f33ec06e370 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f33f0033000 tx=0x7f33f0009030 comp rx=0 tx=0).stop 2024-05-20T18:01:06.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34000c5eb0 msgr2=0x7f34000ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:06.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34000c5eb0 0x7f34000ca6c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3400071f90 tx=0x7f33f80115a0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 shutdown_connections 2024-05-20T18:01:06.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33ec06be60 0x7f33ec06e370 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34000c5eb0 0x7f34000ca6c0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34000c7cf0 0x7f34000c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 --2- 172.21.15.6:0/481407317 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33e80039b0 0x7f34000c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:06.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 >> 172.21.15.6:0/481407317 conn(0x7f34000b6620 msgr2=0x7f340006fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:06.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 shutdown_connections 2024-05-20T18:01:06.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06.803+0000 7f3406aa2640 1 -- 172.21.15.6:0/481407317 wait complete. 2024-05-20T18:01:06.813 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-20T18:01:06.813 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-05-20T18:01:06.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-05-20T18:01:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:stdin closed, goodbye! 2024-05-20T18:01:06.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:01:06.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:07.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:01:07.123 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:01:07.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.125+0000 7f8e635f5640 1 Processor -- start 2024-05-20T18:01:07.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.126+0000 7f8e635f5640 1 -- start start 2024-05-20T18:01:07.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.127+0000 7f8e635f5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e5c06da80 0x7f8e5c1602f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.127+0000 7f8e635f5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c0af9d0 con 0x7f8e5c09ac00 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.127+0000 7f8e635f5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5c0af410 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.127+0000 7f8e635f5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8e5c159da0 con 0x7f8e5c06da80 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.127+0000 7f8e61391640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e5c06da80 0x7f8e5c1602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.127+0000 7f8e61391640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e5c06da80 0x7f8e5c1602f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53102/0 (socket says 172.21.15.6:53102) 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.127+0000 7f8e61391640 1 -- 172.21.15.6:0/1919613526 learned_addr learned my addr 172.21.15.6:0/1919613526 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.127+0000 7f8e61b92640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8e5c09ac00 0x7f8e5c0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:43488/0 (socket says 172.21.15.6:43488) 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.128+0000 7f8e61391640 1 -- 172.21.15.6:0/1919613526 >> v1:172.21.15.171:6789/0 conn(0x7f8e5c0b1c80 legacy=0x7f8e5c09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.128+0000 7f8e61391640 1 -- 172.21.15.6:0/1919613526 >> v1:172.21.15.6:6789/0 conn(0x7f8e5c09ac00 legacy=0x7f8e5c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.128+0000 7f8e5bfff640 1 -- 172.21.15.6:0/1919613526 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205589975 0 0) 0x7f8e5c0af9d0 con 0x7f8e5c09ac00 2024-05-20T18:01:07.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.128+0000 7f8e61391640 1 -- 172.21.15.6:0/1919613526 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c0af6f0 con 0x7f8e5c06da80 2024-05-20T18:01:07.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.128+0000 7f8e61391640 1 --2- 172.21.15.6:0/1919613526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c06da80 0x7f8e5c1602f0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009870 tx=0x7f8e4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71e19ac95da1e82 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:07.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e5bfff640 1 -- 172.21.15.6:0/1919613526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c037070 con 0x7f8e5c06da80 2024-05-20T18:01:07.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e5bfff640 1 -- 172.21.15.6:0/1919613526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c032440 con 0x7f8e5c06da80 2024-05-20T18:01:07.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e5bfff640 1 -- 172.21.15.6:0/1919613526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c032810 con 0x7f8e5c06da80 2024-05-20T18:01:07.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e635f5640 1 -- 172.21.15.6:0/1919613526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c06da80 msgr2=0x7f8e5c1602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e635f5640 1 --2- 172.21.15.6:0/1919613526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c06da80 0x7f8e5c1602f0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009870 tx=0x7f8e4c02a270 comp rx=0 tx=0).stop 2024-05-20T18:01:07.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e635f5640 1 -- 172.21.15.6:0/1919613526 shutdown_connections 2024-05-20T18:01:07.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e635f5640 1 --2- 172.21.15.6:0/1919613526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c06da80 0x7f8e5c1602f0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e635f5640 1 -- 172.21.15.6:0/1919613526 >> 172.21.15.6:0/1919613526 conn(0x7f8e5c0b6670 msgr2=0x7f8e5c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:07.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.129+0000 7f8e635f5640 1 -- 172.21.15.6:0/1919613526 shutdown_connections 2024-05-20T18:01:07.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.130+0000 7f8e635f5640 1 -- 172.21.15.6:0/1919613526 wait complete. 2024-05-20T18:01:07.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.131+0000 7f8e635f5640 1 Processor -- start 2024-05-20T18:01:07.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.131+0000 7f8e635f5640 1 -- start start 2024-05-20T18:01:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e635f5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e5c06da80 0x7f8e5c14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e635f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c0b1c80 0x7f8e5c1f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e635f5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e5c1f93e0 0x7f8e5c1f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e635f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c0d17b0 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e635f5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c0af1c0 con 0x7f8e5c1f93e0 2024-05-20T18:01:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e635f5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c0b2090 con 0x7f8e5c06da80 2024-05-20T18:01:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c0b1c80 0x7f8e5c1f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c0b1c80 0x7f8e5c1f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53116/0 (socket says 172.21.15.6:53116) 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 -- 172.21.15.6:0/1103670320 learned_addr learned my addr 172.21.15.6:0/1103670320 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e61b92640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e5c1f93e0 0x7f8e5c1f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e61391640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e5c06da80 0x7f8e5c14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 -- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e5c06da80 msgr2=0x7f8e5c14a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e5c06da80 0x7f8e5c14a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 -- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e5c1f93e0 msgr2=0x7f8e5c1f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e5c1f93e0 0x7f8e5c1f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 -- 172.21.15.6:0/1103670320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c09daa0 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e61b92640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e5c1f93e0 0x7f8e5c1f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.133+0000 7f8e60b90640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c0b1c80 0x7f8e5c1f86f0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000c760 tx=0x7f8e5000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.134+0000 7f8e59ffb640 1 -- 172.21.15.6:0/1103670320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50003bc0 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.134+0000 7f8e59ffb640 1 -- 172.21.15.6:0/1103670320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50003d80 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.134+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c1566c0 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.134+0000 7f8e59ffb640 1 -- 172.21.15.6:0/1103670320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000aa30 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.134+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c09bc80 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.135+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5c075b00 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.136+0000 7f8e59ffb640 1 -- 172.21.15.6:0/1103670320 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e5000abd0 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.136+0000 7f8e59ffb640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e4806be30 0x7f8e4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.136+0000 7f8e59ffb640 1 -- 172.21.15.6:0/1103670320 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f8e5008af30 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.137+0000 7f8e61391640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e4806be30 0x7f8e4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.137+0000 7f8e61391640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e4806be30 0x7f8e4806e340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c034000 tx=0x7f8e4c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.141+0000 7f8e59ffb640 1 -- 172.21.15.6:0/1103670320 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8e5c09daa0 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.363+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e5c06cf00 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.363+0000 7f8e59ffb640 1 -- 172.21.15.6:0/1103670320 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5177 (secure 0 0 0) 0x7f8e500596d0 con 0x7f8e5c0b1c80 2024-05-20T18:01:07.362 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:07.362 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:01:04.959577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:01:07.362 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e4806be30 msgr2=0x7f8e4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e4806be30 0x7f8e4806e340 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c034000 tx=0x7f8e4c02e000 comp rx=0 tx=0).stop 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c0b1c80 msgr2=0x7f8e5c1f86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c0b1c80 0x7f8e5c1f86f0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000c760 tx=0x7f8e5000cc20 comp rx=0 tx=0).stop 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 shutdown_connections 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8e4806be30 0x7f8e4806e340 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e5c1f93e0 0x7f8e5c1f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c0b1c80 0x7f8e5c1f86f0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 --2- 172.21.15.6:0/1103670320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e5c06da80 0x7f8e5c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.365+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 >> 172.21.15.6:0/1103670320 conn(0x7f8e5c0b6670 msgr2=0x7f8e5c067790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:07.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.366+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 shutdown_connections 2024-05-20T18:01:07.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.366+0000 7f8e635f5640 1 -- 172.21.15.6:0/1103670320 wait complete. 2024-05-20T18:01:07.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-20T18:01:07.508 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":7618,"entity":{"name":{"type":"client","num":7618},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":170972652}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":10.161882404,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9428130123883016,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7618 192.168.0.1:0/170972652","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":7612,"entity":{"name":{"type":"client","num":7612},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":2549548364}},"state":"open","num_leases":1,"num_caps":802,"request_load_avg":762,"uptime":11.290869305999999,"requests_in_flight":0,"num_completed_requests":299,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":2687.6651842204114,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":799.13902341319101,"halflife":1.5},"recall_caps_throttle2o":{"value":243.25357060964322,"halflife":0.5},"session_cache_liveness":{"value":1579.2986860017065,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":530,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7612 172.21.15.6:0/2549548364","completed_requests":[{"tid":530,"created_ino":"0x100000003e9"},{"tid":531,"created_ino":"0x100000003ea"},{"tid":532,"created_ino":"0x100000003eb"},{"tid":533,"created_ino":"0x100000003ec"},{"tid":534,"created_ino":"0x100000003ed"},{"tid":535,"created_ino":"0x100000003ee"},{"tid":536,"created_ino":"0x100000003ef"},{"tid":537,"created_ino":"0x100000003f0"},{"tid":538,"created_ino":"0x100000003f1"},{"tid":539,"created_ino":"0x100000003f2"},{"tid":540,"created_ino":"0x100000003f3"},{"tid":541,"created_ino":"0x100000003f4"},{"tid":542,"created_ino":"0x100000003f5"},{"tid":543,"created_ino":"0x100000003f6"},{"tid":544,"created_ino":"0x100000003f7"},{"tid":545,"created_ino":"0x100000003f8"},{"tid":546,"created_ino":"0x100000003f9"},{"tid":547,"created_ino":"0x100000003fa"},{"tid":548,"created_ino":"0x100000003fb"},{"tid":549,"created_ino":"0x100000003fc"},{"tid":550,"created_ino":"0x100000003fd"},{"tid":551,"created_ino":"0x100000003fe"},{"tid":552,"created_ino":"0x100000003ff"},{"tid":553,"created_ino":"0x10000000400"},{"tid":554,"created_ino":"0x10000000401"},{"tid":555,"created_ino":"0x10000000402"},{"tid":556,"created_ino":"0x10000000403"},{"tid":557,"created_ino":"0x10000000404"},{"tid":558,"created_ino":"0x10000000405"},{"tid":559,"created_ino":"0x10000000406"},{"tid":560,"created_ino":"0x10000000407"},{"tid":561,"created_ino":"0x10000000408"},{"tid":562,"created_ino":"0x10000000409"},{"tid":563,"created_ino":"0x1000000040a"},{"tid":564,"created_ino":"0x1000000040b"},{"tid":565,"created_ino":"0x1000000040c"},{"tid":566,"created_ino":"0x1000000040d"},{"tid":567,"created_ino":"0x1000000040e"},{"tid":568,"created_ino":"0x1000000040f"},{"tid":569,"created_ino":"0x10000000410"},{"tid":570,"created_ino":"0x10000000411"},{"tid":571,"created_ino":"0x10000000412"},{"tid":572,"created_ino":"0x10000000413"},{"tid":573,"created_ino":"0x10000000414"},{"tid":574,"created_ino":"0x10000000415"},{"tid":575,"created_ino":"0x10000000416"},{"tid":576,"created_ino":"0x10000000417"},{"tid":577,"created_ino":"0x10000000418"},{"tid":578,"created_ino":"0x10000000419"},{"tid":579,"created_ino":"0x1000000041a"},{"tid":580,"created_ino":"0x1000000041b"},{"tid":581,"created_ino":"0x1000000041c"},{"tid":582,"created_ino":"0x1000000041d"},{"tid":583,"created_ino":"0x1000000041e"},{"tid":584,"created_ino":"0x1000000041f"},{"tid":585,"created_ino":"0x10000000420"},{"tid":586,"created_ino":"0x10000000421"},{"tid":587,"created_ino":"0x10000000422"},{"tid":588,"created_ino":"0x10000000423"},{"tid":589,"created_ino":"0x10000000424"},{"tid":590,"created_ino":"0x10000000425"},{"tid":591,"created_ino":"0x10000000426"},{"tid":592,"created_ino":"0x10000000427"},{"tid":593,"created_ino":"0x10000000428"},{"tid":594,"created_ino":"0x10000000429"},{"tid":595,"created_ino":"0x1000000042a"},{"tid":596,"created_ino":"0x1000000042b"},{"tid":597,"created_ino":"0x1000000042c"},{"tid":598,"created_ino":"0x1000000042d"},{"tid":599,"created_ino":"0x1000000042e"},{"tid":600,"created_ino":"0x1000000042f"},{"tid":601,"created_ino":"0x10000000430"},{"tid":602,"created_ino":"0x10000000431"},{"tid":603,"created_ino":"0x10000000432"},{"tid":604,"created_ino":"0x10000000433"},{"tid":605,"created_ino":"0x10000000434"},{"tid":606,"created_ino":"0x10000000435"},{"tid":607,"created_ino":"0x10000000436"},{"tid":608,"created_ino":"0x10000000437"},{"tid":609,"created_ino":"0x10000000438"},{"tid":610,"created_ino":"0x10000000439"},{"tid":611,"created_ino":"0x1000000043a"},{"tid":612,"created_ino":"0x1000000043b"},{"tid":613,"created_ino":"0x1000000043c"},{"tid":614,"created_ino":"0x1000000043d"},{"tid":615,"created_ino":"0x1000000043e"},{"tid":616,"created_ino":"0x1000000043f"},{"tid":617,"created_ino":"0x10000000440"},{"tid":618,"created_ino":"0x10000000441"},{"tid":619,"created_ino":"0x10000000442"},{"tid":620,"created_ino":"0x10000000443"},{"tid":621,"created_ino":"0x10000000444"},{"tid":622,"created_ino":"0x10000000445"},{"tid":623,"created_ino":"0x10000000446"},{"tid":624,"created_ino":"0x10000000447"},{"tid":625,"created_ino":"0x10000000448"},{"tid":626,"created_ino":"0x10000000449"},{"tid":627,"created_ino":"0x1000000044a"},{"tid":628,"created_ino":"0x1000000044b"},{"tid":629,"created_ino":"0x1000000044c"},{"tid":630,"created_ino":"0x1000000044d"},{"tid":631,"created_ino":"0x1000000044e"},{"tid":632,"created_ino":"0x1000000044f"},{"tid":633,"created_ino":"0x10000000450"},{"tid":634,"created_ino":"0x10000000451"},{"tid":635,"created_ino":"0x10000000452"},{"tid":636,"created_ino":"0x10000000453"},{"tid":637,"created_ino":"0x10000000454"},{"tid":638,"created_ino":"0x10000000455"},{"tid":639,"created_ino":"0x10000000456"},{"tid":640,"created_ino":"0x10000000457"},{"tid":641,"created_ino":"0x10000000458"},{"tid":642,"created_ino":"0x10000000459"},{"tid":643,"created_ino":"0x1000000045a"},{"tid":644,"created_ino":"0x1000000045b"},{"tid":645,"created_ino":"0x1000000045c"},{"tid":646,"created_ino":"0x1000000045d"},{"tid":647,"created_ino":"0x1000000045e"},{"tid":648,"created_ino":"0x1000000045f"},{"tid":649,"created_ino":"0x10000000460"},{"tid":650,"created_ino":"0x10000000461"},{"tid":651,"created_ino":"0x10000000462"},{"tid":652,"created_ino":"0x10000000463"},{"tid":653,"created_ino":"0x10000000464"},{"tid":654,"created_ino":"0x10000000465"},{"tid":655,"created_ino":"0x10000000466"},{"tid":656,"created_ino":"0x10000000467"},{"tid":657,"created_ino":"0x10000000468"},{"tid":658,"created_ino":"0x10000000469"},{"tid":659,"created_ino":"0x1000000046a"},{"tid":660,"created_ino":"0x1000000046b"},{"tid":661,"created_ino":"0x1000000046c"},{"tid":662,"created_ino":"0x1000000046d"},{"tid":663,"created_ino":"0x1000000046e"},{"tid":664,"created_ino":"0x1000000046f"},{"tid":665,"created_ino":"0x10000000470"},{"tid":666,"created_ino":"0x10000000471"},{"tid":667,"created_ino":"0x10000000472"},{"tid":668,"created_ino":"0x10000000473"},{"tid":669,"created_ino":"0x10000000474"},{"tid":670,"created_ino":"0x10000000475"},{"tid":671,"created_ino":"0x10000000476"},{"tid":672,"created_ino":"0x10000000477"},{"tid":673,"created_ino":"0x10000000478"},{"tid":674,"created_ino":"0x10000000479"},{"tid":675,"created_ino":"0x1000000047a"},{"tid":676,"created_ino":"0x1000000047b"},{"tid":677,"created_ino":"0x1000000047c"},{"tid":678,"created_ino":"0x1000000047d"},{"tid":679,"created_ino":"0x1000000047e"},{"tid":680,"created_ino":"0x1000000047f"},{"tid":681,"created_ino":"0x10000000480"},{"tid":682,"created_ino":"0x10000000481"},{"tid":683,"created_ino":"0x10000000482"},{"tid":684,"created_ino":"0x10000000483"},{"tid":685,"created_ino":"0x10000000484"},{"tid":686,"created_ino":"0x10000000485"},{"tid":687,"created_ino":"0x10000000486"},{"tid":688,"created_ino":"0x10000000487"},{"tid":689,"created_ino":"0x10000000488"},{"tid":690,"created_ino":"0x10000000489"},{"tid":691,"created_ino":"0x1000000048a"},{"tid":692,"created_ino":"0x1000000048b"},{"tid":693,"created_ino":"0x1000000048c"},{"tid":694,"created_ino":"0x1000000048d"},{"tid":695,"created_ino":"0x1000000048e"},{"tid":696,"created_ino":"0x1000000048f"},{"tid":697,"created_ino":"0x10000000490"},{"tid":698,"created_ino":"0x10000000491"},{"tid":699,"created_ino":"0x10000000492"},{"tid":700,"created_ino":"0x10000000493"},{"tid":701,"created_ino":"0x10000000494"},{"tid":702,"created_ino":"0x10000000495"},{"tid":703,"created_ino":"0x10000000496"},{"tid":704,"created_ino":"0x10000000497"},{"tid":705,"created_ino":"0x10000000498"},{"tid":706,"created_ino":"0x10000000499"},{"tid":707,"created_ino":"0x1000000049a"},{"tid":708,"created_ino":"0x1000000049b"},{"tid":709,"created_ino":"0x1000000049c"},{"tid":710,"created_ino":"0x1000000049d"},{"tid":711,"created_ino":"0x1000000049e"},{"tid":712,"created_ino":"0x1000000049f"},{"tid":713,"created_ino":"0x100000004a0"},{"tid":714,"created_ino":"0x100000004a1"},{"tid":715,"created_ino":"0x100000004a2"},{"tid":716,"created_ino":"0x100000004a3"},{"tid":717,"created_ino":"0x100000004a4"},{"tid":718,"created_ino":"0x100000004a5"},{"tid":719,"created_ino":"0x100000004a6"},{"tid":720,"created_ino":"0x100000004a7"},{"tid":721,"created_ino":"0x100000004a8"},{"tid":722,"created_ino":"0x100000004a9"},{"tid":723,"created_ino":"0x100000004aa"},{"tid":724,"created_ino":"0x100000004ab"},{"tid":725,"created_ino":"0x100000004ac"},{"tid":726,"created_ino":"0x100000004ad"},{"tid":727,"created_ino":"0x100000004ae"},{"tid":728,"created_ino":"0x100000004af"},{"tid":729,"created_ino":"0x100000004b0"},{"tid":730,"created_ino":"0x100000004b1"},{"tid":731,"created_ino":"0x100000004b2"},{"tid":732,"created_ino":"0x100000004b3"},{"tid":733,"created_ino":"0x100000004b4"},{"tid":734,"created_ino":"0x100000004b5"},{"tid":735,"created_ino":"0x100000004b6"},{"tid":736,"created_ino":"0x100000004b7"},{"tid":737,"created_ino":"0x100000004b8"},{"tid":738,"created_ino":"0x100000004b9"},{"tid":739,"created_ino":"0x100000004ba"},{"tid":740,"created_ino":"0x100000004bb"},{"tid":741,"created_ino":"0x100000004bc"},{"tid":742,"created_ino":"0x100000004bd"},{"tid":743,"created_ino":"0x100000004be"},{"tid":744,"created_ino":"0x100000004bf"},{"tid":745,"created_ino":"0x100000004c0"},{"tid":746,"created_ino":"0x100000004c1"},{"tid":747,"created_ino":"0x100000004c2"},{"tid":748,"created_ino":"0x100000004c3"},{"tid":749,"created_ino":"0x100000004c4"},{"tid":750,"created_ino":"0x100000004c5"},{"tid":751,"created_ino":"0x100000004c6"},{"tid":752,"created_ino":"0x100000004c7"},{"tid":753,"created_ino":"0x100000004c8"},{"tid":754,"created_ino":"0x100000004c9"},{"tid":755,"created_ino":"0x100000004ca"},{"tid":756,"created_ino":"0x100000004cb"},{"tid":757,"created_ino":"0x100000004cc"},{"tid":758,"created_ino":"0x100000004cd"},{"tid":759,"created_ino":"0x100000004ce"},{"tid":760,"created_ino":"0x100000004cf"},{"tid":761,"created_ino":"0x100000004d0"},{"tid":762,"created_ino":"0x100000004d1"},{"tid":763,"created_ino":"0x100000004d2"},{"tid":764,"created_ino":"0x100000004d3"},{"tid":765,"created_ino":"0x100000004d4"},{"tid":766,"created_ino":"0x100000004d5"},{"tid":767,"created_ino":"0x100000004d6"},{"tid":768,"created_ino":"0x100000004d7"},{"tid":769,"created_ino":"0x100000004d8"},{"tid":770,"created_ino":"0x100000004d9"},{"tid":771,"created_ino":"0x100000004da"},{"tid":772,"created_ino":"0x100000004db"},{"tid":773,"created_ino":"0x100000004dc"},{"tid":774,"created_ino":"0x100000004dd"},{"tid":775,"created_ino":"0x100000004de"},{"tid":776,"created_ino":"0x100000004df"},{"tid":777,"created_ino":"0x100000004e0"},{"tid":778,"created_ino":"0x100000004e1"},{"tid":779,"created_ino":"0x100000004e2"},{"tid":780,"created_ino":"0x100000004e3"},{"tid":781,"created_ino":"0x100000004e4"},{"tid":782,"created_ino":"0x100000004e5"},{"tid":783,"created_ino":"0x100000004e6"},{"tid":784,"created_ino":"0x100000004e7"},{"tid":785,"created_ino":"0x100000004e8"},{"tid":786,"created_ino":"0x100000004e9"},{"tid":787,"created_ino":"0x100000004ea"},{"tid":788,"created_ino":"0x100000004eb"},{"tid":789,"created_ino":"0x100000004ec"},{"tid":790,"created_ino":"0x100000004ed"},{"tid":791,"created_ino":"0x100000004ee"},{"tid":792,"created_ino":"0x100000004ef"},{"tid":793,"created_ino":"0x100000004f0"},{"tid":794,"created_ino":"0x100000004f1"},{"tid":795,"created_ino":"0x100000004f2"},{"tid":796,"created_ino":"0x100000004f3"},{"tid":797,"created_ino":"0x100000004f4"},{"tid":798,"created_ino":"0x100000004f5"},{"tid":799,"created_ino":"0x100000004f6"},{"tid":800,"created_ino":"0x100000004f7"},{"tid":801,"created_ino":"0x100000004f8"},{"tid":802,"created_ino":"0x100000004f9"},{"tid":803,"created_ino":"0x100000004fa"},{"tid":804,"created_ino":"0x100000004fb"},{"tid":805,"created_ino":"0x100000004fc"},{"tid":806,"created_ino":"0x100000004fd"},{"tid":807,"created_ino":"0x100000004fe"},{"tid":808,"created_ino":"0x100000004ff"},{"tid":809,"created_ino":"0x10000000500"},{"tid":810,"created_ino":"0x10000000501"},{"tid":811,"created_ino":"0x10000000502"},{"tid":812,"created_ino":"0x10000000503"},{"tid":813,"created_ino":"0x10000000504"},{"tid":814,"created_ino":"0x10000000505"},{"tid":815,"created_ino":"0x10000000506"},{"tid":816,"created_ino":"0x10000000507"},{"tid":817,"created_ino":"0x10000000508"},{"tid":818,"created_ino":"0x10000000509"},{"tid":819,"created_ino":"0x1000000050a"},{"tid":820,"created_ino":"0x1000000050b"},{"tid":821,"created_ino":"0x1000000050c"},{"tid":822,"created_ino":"0x1000000050d"},{"tid":823,"created_ino":"0x1000000050e"},{"tid":824,"created_ino":"0x1000000050f"},{"tid":825,"created_ino":"0x10000000510"},{"tid":826,"created_ino":"0x10000000511"},{"tid":827,"created_ino":"0x10000000512"},{"tid":828,"created_ino":"0x10000000513"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000514","length":203},{"start":"0x100000005e0","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T18:01:07.511 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 170972652, "type": "any" }, "name": { "num": 7618, "type": "client" } }, "id": 7618, "inst": "client.7618 192.168.0.1:0/170972652", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9428130123883016 }, "state": "open", "uptime": 10.161882404 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000003e9", "tid": 530 }, { "created_ino": "0x100000003ea", "tid": 531 }, { "created_ino": "0x100000003eb", "tid": 532 }, { "created_ino": "0x100000003ec", "tid": 533 }, { "created_ino": "0x100000003ed", "tid": 534 }, { "created_ino": "0x100000003ee", "tid": 535 }, { "created_ino": "0x100000003ef", "tid": 536 }, { "created_ino": "0x100000003f0", "tid": 537 }, { "created_ino": "0x100000003f1", "tid": 538 }, { "created_ino": "0x100000003f2", "tid": 539 }, { "created_ino": "0x100000003f3", "tid": 540 }, { "created_ino": "0x100000003f4", "tid": 541 }, { "created_ino": "0x100000003f5", "tid": 542 }, { "created_ino": "0x100000003f6", "tid": 543 }, { "created_ino": "0x100000003f7", "tid": 544 }, { "created_ino": "0x100000003f8", "tid": 545 }, { "created_ino": "0x100000003f9", "tid": 546 }, { "created_ino": "0x100000003fa", "tid": 547 }, { "created_ino": "0x100000003fb", "tid": 548 }, { "created_ino": "0x100000003fc", "tid": 549 }, { "created_ino": "0x100000003fd", "tid": 550 }, { "created_ino": "0x100000003fe", "tid": 551 }, { "created_ino": "0x100000003ff", "tid": 552 }, { "created_ino": "0x10000000400", "tid": 553 }, { "created_ino": "0x10000000401", "tid": 554 }, { "created_ino": "0x10000000402", "tid": 555 }, { "created_ino": "0x10000000403", "tid": 556 }, { "created_ino": "0x10000000404", "tid": 557 }, { "created_ino": "0x10000000405", "tid": 558 }, { "created_ino": "0x10000000406", "tid": 559 }, { "created_ino": "0x10000000407", "tid": 560 }, { "created_ino": "0x10000000408", "tid": 561 }, { "created_ino": "0x10000000409", "tid": 562 }, { "created_ino": "0x1000000040a", "tid": 563 }, { "created_ino": "0x1000000040b", "tid": 564 }, { "created_ino": "0x1000000040c", "tid": 565 }, { "created_ino": "0x1000000040d", "tid": 566 }, { "created_ino": "0x1000000040e", "tid": 567 }, { "created_ino": "0x1000000040f", "tid": 568 }, { "created_ino": "0x10000000410", "tid": 569 }, { "created_ino": "0x10000000411", "tid": 570 }, { "created_ino": "0x10000000412", "tid": 571 }, { "created_ino": "0x10000000413", "tid": 572 }, { "created_ino": "0x10000000414", "tid": 573 }, { "created_ino": "0x10000000415", "tid": 574 }, { "created_ino": "0x10000000416", "tid": 575 }, { "created_ino": "0x10000000417", "tid": 576 }, { "created_ino": "0x10000000418", "tid": 577 }, { "created_ino": "0x10000000419", "tid": 578 }, { "created_ino": "0x1000000041a", "tid": 579 }, { "created_ino": "0x1000000041b", "tid": 580 }, { "created_ino": "0x1000000041c", "tid": 581 }, { "created_ino": "0x1000000041d", "tid": 582 }, { "created_ino": "0x1000000041e", "tid": 583 }, { "created_ino": "0x1000000041f", "tid": 584 }, { "created_ino": "0x10000000420", "tid": 585 }, { "created_ino": "0x10000000421", "tid": 586 }, { "created_ino": "0x10000000422", "tid": 587 }, { "created_ino": "0x10000000423", "tid": 588 }, { "created_ino": "0x10000000424", "tid": 589 }, { "created_ino": "0x10000000425", "tid": 590 }, { "created_ino": "0x10000000426", "tid": 591 }, { "created_ino": "0x10000000427", "tid": 592 }, { "created_ino": "0x10000000428", "tid": 593 }, { "created_ino": "0x10000000429", "tid": 594 }, { "created_ino": "0x1000000042a", "tid": 595 }, { "created_ino": "0x1000000042b", "tid": 596 }, { "created_ino": "0x1000000042c", "tid": 597 }, { "created_ino": "0x1000000042d", "tid": 598 }, { "created_ino": "0x1000000042e", "tid": 599 }, { "created_ino": "0x1000000042f", "tid": 600 }, { "created_ino": "0x10000000430", "tid": 601 }, { "created_ino": "0x10000000431", "tid": 602 }, { "created_ino": "0x10000000432", "tid": 603 }, { "created_ino": "0x10000000433", "tid": 604 }, { "created_ino": "0x10000000434", "tid": 605 }, { "created_ino": "0x10000000435", "tid": 606 }, { "created_ino": "0x10000000436", "tid": 607 }, { "created_ino": "0x10000000437", "tid": 608 }, { "created_ino": "0x10000000438", "tid": 609 }, { "created_ino": "0x10000000439", "tid": 610 }, { "created_ino": "0x1000000043a", "tid": 611 }, { "created_ino": "0x1000000043b", "tid": 612 }, { "created_ino": "0x1000000043c", "tid": 613 }, { "created_ino": "0x1000000043d", "tid": 614 }, { "created_ino": "0x1000000043e", "tid": 615 }, { "created_ino": "0x1000000043f", "tid": 616 }, { "created_ino": "0x10000000440", "tid": 617 }, { "created_ino": "0x10000000441", "tid": 618 }, { "created_ino": "0x10000000442", "tid": 619 }, { "created_ino": "0x10000000443", "tid": 620 }, { "created_ino": "0x10000000444", "tid": 621 }, { "created_ino": "0x10000000445", "tid": 622 }, { "created_ino": "0x10000000446", "tid": 623 }, { "created_ino": "0x10000000447", "tid": 624 }, { "created_ino": "0x10000000448", "tid": 625 }, { "created_ino": "0x10000000449", "tid": 626 }, { "created_ino": "0x1000000044a", "tid": 627 }, { "created_ino": "0x1000000044b", "tid": 628 }, { "created_ino": "0x1000000044c", "tid": 629 }, { "created_ino": "0x1000000044d", "tid": 630 }, { "created_ino": "0x1000000044e", "tid": 631 }, { "created_ino": "0x1000000044f", "tid": 632 }, { "created_ino": "0x10000000450", "tid": 633 }, { "created_ino": "0x10000000451", "tid": 634 }, { "created_ino": "0x10000000452", "tid": 635 }, { "created_ino": "0x10000000453", "tid": 636 }, { "created_ino": "0x10000000454", "tid": 637 }, { "created_ino": "0x10000000455", "tid": 638 }, { "created_ino": "0x10000000456", "tid": 639 }, { "created_ino": "0x10000000457", "tid": 640 }, { "created_ino": "0x10000000458", "tid": 641 }, { "created_ino": "0x10000000459", "tid": 642 }, { "created_ino": "0x1000000045a", "tid": 643 }, { "created_ino": "0x1000000045b", "tid": 644 }, { "created_ino": "0x1000000045c", "tid": 645 }, { "created_ino": "0x1000000045d", "tid": 646 }, { "created_ino": "0x1000000045e", "tid": 647 }, { "created_ino": "0x1000000045f", "tid": 648 }, { "created_ino": "0x10000000460", "tid": 649 }, { "created_ino": "0x10000000461", "tid": 650 }, { "created_ino": "0x10000000462", "tid": 651 }, { "created_ino": "0x10000000463", "tid": 652 }, { "created_ino": "0x10000000464", "tid": 653 }, { "created_ino": "0x10000000465", "tid": 654 }, { "created_ino": "0x10000000466", "tid": 655 }, { "created_ino": "0x10000000467", "tid": 656 }, { "created_ino": "0x10000000468", "tid": 657 }, { "created_ino": "0x10000000469", "tid": 658 }, { "created_ino": "0x1000000046a", "tid": 659 }, { "created_ino": "0x1000000046b", "tid": 660 }, { "created_ino": "0x1000000046c", "tid": 661 }, { "created_ino": "0x1000000046d", "tid": 662 }, { "created_ino": "0x1000000046e", "tid": 663 }, { "created_ino": "0x1000000046f", "tid": 664 }, { "created_ino": "0x10000000470", "tid": 665 }, { "created_ino": "0x10000000471", "tid": 666 }, { "created_ino": "0x10000000472", "tid": 667 }, { "created_ino": "0x10000000473", "tid": 668 }, { "created_ino": "0x10000000474", "tid": 669 }, { "created_ino": "0x10000000475", "tid": 670 }, { "created_ino": "0x10000000476", "tid": 671 }, { "created_ino": "0x10000000477", "tid": 672 }, { "created_ino": "0x10000000478", "tid": 673 }, { "created_ino": "0x10000000479", "tid": 674 }, { "created_ino": "0x1000000047a", "tid": 675 }, { "created_ino": "0x1000000047b", "tid": 676 }, { "created_ino": "0x1000000047c", "tid": 677 }, { "created_ino": "0x1000000047d", "tid": 678 }, { "created_ino": "0x1000000047e", "tid": 679 }, { "created_ino": "0x1000000047f", "tid": 680 }, { "created_ino": "0x10000000480", "tid": 681 }, { "created_ino": "0x10000000481", "tid": 682 }, { "created_ino": "0x10000000482", "tid": 683 }, { "created_ino": "0x10000000483", "tid": 684 }, { "created_ino": "0x10000000484", "tid": 685 }, { "created_ino": "0x10000000485", "tid": 686 }, { "created_ino": "0x10000000486", "tid": 687 }, { "created_ino": "0x10000000487", "tid": 688 }, { "created_ino": "0x10000000488", "tid": 689 }, { "created_ino": "0x10000000489", "tid": 690 }, { "created_ino": "0x1000000048a", "tid": 691 }, { "created_ino": "0x1000000048b", "tid": 692 }, { "created_ino": "0x1000000048c", "tid": 693 }, { "created_ino": "0x1000000048d", "tid": 694 }, { "created_ino": "0x1000000048e", "tid": 695 }, { "created_ino": "0x1000000048f", "tid": 696 }, { "created_ino": "0x10000000490", "tid": 697 }, { "created_ino": "0x10000000491", "tid": 698 }, { "created_ino": "0x10000000492", "tid": 699 }, { "created_ino": "0x10000000493", "tid": 700 }, { "created_ino": "0x10000000494", "tid": 701 }, { "created_ino": "0x10000000495", "tid": 702 }, { "created_ino": "0x10000000496", "tid": 703 }, { "created_ino": "0x10000000497", "tid": 704 }, { "created_ino": "0x10000000498", "tid": 705 }, { "created_ino": "0x10000000499", "tid": 706 }, { "created_ino": "0x1000000049a", "tid": 707 }, { "created_ino": "0x1000000049b", "tid": 708 }, { "created_ino": "0x1000000049c", "tid": 709 }, { "created_ino": "0x1000000049d", "tid": 710 }, { "created_ino": "0x1000000049e", "tid": 711 }, { "created_ino": "0x1000000049f", "tid": 712 }, { "created_ino": "0x100000004a0", "tid": 713 }, { "created_ino": "0x100000004a1", "tid": 714 }, { "created_ino": "0x100000004a2", "tid": 715 }, { "created_ino": "0x100000004a3", "tid": 716 }, { "created_ino": "0x100000004a4", "tid": 717 }, { "created_ino": "0x100000004a5", "tid": 718 }, { "created_ino": "0x100000004a6", "tid": 719 }, { "created_ino": "0x100000004a7", "tid": 720 }, { "created_ino": "0x100000004a8", "tid": 721 }, { "created_ino": "0x100000004a9", "tid": 722 }, { "created_ino": "0x100000004aa", "tid": 723 }, { "created_ino": "0x100000004ab", "tid": 724 }, { "created_ino": "0x100000004ac", "tid": 725 }, { "created_ino": "0x100000004ad", "tid": 726 }, { "created_ino": "0x100000004ae", "tid": 727 }, { "created_ino": "0x100000004af", "tid": 728 }, { "created_ino": "0x100000004b0", "tid": 729 }, { "created_ino": "0x100000004b1", "tid": 730 }, { "created_ino": "0x100000004b2", "tid": 731 }, { "created_ino": "0x100000004b3", "tid": 732 }, { "created_ino": "0x100000004b4", "tid": 733 }, { "created_ino": "0x100000004b5", "tid": 734 }, { "created_ino": "0x100000004b6", "tid": 735 }, { "created_ino": "0x100000004b7", "tid": 736 }, { "created_ino": "0x100000004b8", "tid": 737 }, { "created_ino": "0x100000004b9", "tid": 738 }, { "created_ino": "0x100000004ba", "tid": 739 }, { "created_ino": "0x100000004bb", "tid": 740 }, { "created_ino": "0x100000004bc", "tid": 741 }, { "created_ino": "0x100000004bd", "tid": 742 }, { "created_ino": "0x100000004be", "tid": 743 }, { "created_ino": "0x100000004bf", "tid": 744 }, { "created_ino": "0x100000004c0", "tid": 745 }, { "created_ino": "0x100000004c1", "tid": 746 }, { "created_ino": "0x100000004c2", "tid": 747 }, { "created_ino": "0x100000004c3", "tid": 748 }, { "created_ino": "0x100000004c4", "tid": 749 }, { "created_ino": "0x100000004c5", "tid": 750 }, { "created_ino": "0x100000004c6", "tid": 751 }, { "created_ino": "0x100000004c7", "tid": 752 }, { "created_ino": "0x100000004c8", "tid": 753 }, { "created_ino": "0x100000004c9", "tid": 754 }, { "created_ino": "0x100000004ca", "tid": 755 }, { "created_ino": "0x100000004cb", "tid": 756 }, { "created_ino": "0x100000004cc", "tid": 757 }, { "created_ino": "0x100000004cd", "tid": 758 }, { "created_ino": "0x100000004ce", "tid": 759 }, { "created_ino": "0x100000004cf", "tid": 760 }, { "created_ino": "0x100000004d0", "tid": 761 }, { "created_ino": "0x100000004d1", "tid": 762 }, { "created_ino": "0x100000004d2", "tid": 763 }, { "created_ino": "0x100000004d3", "tid": 764 }, { "created_ino": "0x100000004d4", "tid": 765 }, { "created_ino": "0x100000004d5", "tid": 766 }, { "created_ino": "0x100000004d6", "tid": 767 }, { "created_ino": "0x100000004d7", "tid": 768 }, { "created_ino": "0x100000004d8", "tid": 769 }, { "created_ino": "0x100000004d9", "tid": 770 }, { "created_ino": "0x100000004da", "tid": 771 }, { "created_ino": "0x100000004db", "tid": 772 }, { "created_ino": "0x100000004dc", "tid": 773 }, { "created_ino": "0x100000004dd", "tid": 774 }, { "created_ino": "0x100000004de", "tid": 775 }, { "created_ino": "0x100000004df", "tid": 776 }, { "created_ino": "0x100000004e0", "tid": 777 }, { "created_ino": "0x100000004e1", "tid": 778 }, { "created_ino": "0x100000004e2", "tid": 779 }, { "created_ino": "0x100000004e3", "tid": 780 }, { "created_ino": "0x100000004e4", "tid": 781 }, { "created_ino": "0x100000004e5", "tid": 782 }, { "created_ino": "0x100000004e6", "tid": 783 }, { "created_ino": "0x100000004e7", "tid": 784 }, { "created_ino": "0x100000004e8", "tid": 785 }, { "created_ino": "0x100000004e9", "tid": 786 }, { "created_ino": "0x100000004ea", "tid": 787 }, { "created_ino": "0x100000004eb", "tid": 788 }, { "created_ino": "0x100000004ec", "tid": 789 }, { "created_ino": "0x100000004ed", "tid": 790 }, { "created_ino": "0x100000004ee", "tid": 791 }, { "created_ino": "0x100000004ef", "tid": 792 }, { "created_ino": "0x100000004f0", "tid": 793 }, { "created_ino": "0x100000004f1", "tid": 794 }, { "created_ino": "0x100000004f2", "tid": 795 }, { "created_ino": "0x100000004f3", "tid": 796 }, { "created_ino": "0x100000004f4", "tid": 797 }, { "created_ino": "0x100000004f5", "tid": 798 }, { "created_ino": "0x100000004f6", "tid": 799 }, { "created_ino": "0x100000004f7", "tid": 800 }, { "created_ino": "0x100000004f8", "tid": 801 }, { "created_ino": "0x100000004f9", "tid": 802 }, { "created_ino": "0x100000004fa", "tid": 803 }, { "created_ino": "0x100000004fb", "tid": 804 }, { "created_ino": "0x100000004fc", "tid": 805 }, { "created_ino": "0x100000004fd", "tid": 806 }, { "created_ino": "0x100000004fe", "tid": 807 }, { "created_ino": "0x100000004ff", "tid": 808 }, { "created_ino": "0x10000000500", "tid": 809 }, { "created_ino": "0x10000000501", "tid": 810 }, { "created_ino": "0x10000000502", "tid": 811 }, { "created_ino": "0x10000000503", "tid": 812 }, { "created_ino": "0x10000000504", "tid": 813 }, { "created_ino": "0x10000000505", "tid": 814 }, { "created_ino": "0x10000000506", "tid": 815 }, { "created_ino": "0x10000000507", "tid": 816 }, { "created_ino": "0x10000000508", "tid": 817 }, { "created_ino": "0x10000000509", "tid": 818 }, { "created_ino": "0x1000000050a", "tid": 819 }, { "created_ino": "0x1000000050b", "tid": 820 }, { "created_ino": "0x1000000050c", "tid": 821 }, { "created_ino": "0x1000000050d", "tid": 822 }, { "created_ino": "0x1000000050e", "tid": 823 }, { "created_ino": "0x1000000050f", "tid": 824 }, { "created_ino": "0x10000000510", "tid": 825 }, { "created_ino": "0x10000000511", "tid": 826 }, { "created_ino": "0x10000000512", "tid": 827 }, { "created_ino": "0x10000000513", "tid": 828 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 2549548364, "type": "any" }, "name": { "num": 7612, "type": "client" } }, "id": 7612, "inst": "client.7612 172.21.15.6:0/2549548364", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 530, "num_caps": 802, "num_completed_flushes": 0, "num_completed_requests": 299, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 203, "start": "0x10000000514" }, { "length": 501, "start": "0x100000005e0" } ], "recall_caps": { "halflife": 60, "value": 2687.6651842204114 }, "recall_caps_throttle": { "halflife": 1.5, "value": 799.139023413191 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 243.25357060964322 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 762, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1579.2986860017065 }, "state": "open", "uptime": 11.290869306 } ] 2024-05-20T18:01:07.511 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-20T18:01:07.511 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:01:07.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:01:07.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:01:07.601 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:01:07.601 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:01:07.601 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 800\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi006') 2024-05-20T18:01:07.601 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:07.602 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:07.618 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:07.618 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:07.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:07.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.829+0000 7f8d2341b640 1 Processor -- start 2024-05-20T18:01:07.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.829+0000 7f8d2341b640 1 -- start start 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d2341b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8d1c162820 0x7f8d1c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d2341b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1c0d0630 con 0x7f8d1c0b3e80 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d2341b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1c0d39c0 con 0x7f8d1c06dae0 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d2341b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8d1c0d3ca0 con 0x7f8d1c162820 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d209b6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8d1c0b3e80 0x7f8d1c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59490/0 (socket says 172.21.15.6:59490) 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d209b6640 1 -- 172.21.15.6:0/2392435647 learned_addr learned my addr 172.21.15.6:0/2392435647 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d211b7640 1 --2- 172.21.15.6:0/2392435647 >> v2:172.21.15.171:3300/0 conn(0x7f8d1c162820 0x7f8d1c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884609304 0 0) 0x7f8d1c0d0630 con 0x7f8d1c0b3e80 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d08003520 con 0x7f8d1c0b3e80 2024-05-20T18:01:07.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2539379934 0 0) 0x7f8d08003520 con 0x7f8d1c0b3e80 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 >> v2:172.21.15.171:3300/0 conn(0x7f8d1c162820 msgr2=0x7f8d1c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 --2- 172.21.15.6:0/2392435647 >> v2:172.21.15.171:3300/0 conn(0x7f8d1c162820 0x7f8d1c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 >> v1:172.21.15.171:6789/0 conn(0x7f8d1c06dae0 legacy=0x7f8d1c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c0d3f80 con 0x7f8d1c0b3e80 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f8d0c001670 con 0x7f8d1c0b3e80 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 >> v1:172.21.15.6:6789/0 conn(0x7f8d1c0b3e80 legacy=0x7f8d1c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080039b0 0x7f8d08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d08004800 0x7f8d08004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080051c0 0x7f8d0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c0d3ca0 con 0x7f8d08004800 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0800c160 con 0x7f8d080051c0 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.831+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0800c360 con 0x7f8d080039b0 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d209b6640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d08004800 0x7f8d08004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d219b8640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080051c0 0x7f8d0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d211b7640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080039b0 0x7f8d08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d209b6640 1 -- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080039b0 msgr2=0x7f8d08003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d209b6640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080039b0 0x7f8d08003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d209b6640 1 -- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080051c0 msgr2=0x7f8d0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d209b6640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d080051c0 0x7f8d0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d209b6640 1 -- 172.21.15.6:0/2392435647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d08003520 con 0x7f8d08004800 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d219b8640 1 -- 172.21.15.6:0/2392435647 reap_dead start 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.832+0000 7f8d211b7640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d080039b0 0x7f8d08003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.833+0000 7f8d209b6640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d08004800 0x7f8d08004c10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c240 tx=0x7f8d08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deeb5c1a602da44f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.833+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c007cf0 con 0x7f8d08004800 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.833+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c0058d0 con 0x7f8d08004800 2024-05-20T18:01:07.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.833+0000 7f8d13fff640 1 -- 172.21.15.6:0/2392435647 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c005d20 con 0x7f8d08004800 2024-05-20T18:01:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.833+0000 7f8d2341b640 1 -- 172.21.15.6:0/2392435647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d08004800 msgr2=0x7f8d08004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.833+0000 7f8d2341b640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d08004800 0x7f8d08004c10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c240 tx=0x7f8d08005830 comp rx=0 tx=0).stop 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.834+0000 7f8d2341b640 1 -- 172.21.15.6:0/2392435647 shutdown_connections 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.834+0000 7f8d2341b640 1 --2- 172.21.15.6:0/2392435647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d08004800 0x7f8d08004c10 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.834+0000 7f8d2341b640 1 -- 172.21.15.6:0/2392435647 >> 172.21.15.6:0/2392435647 conn(0x7f8d1c0d4bd0 msgr2=0x7f8d1c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.834+0000 7f8d2341b640 1 -- 172.21.15.6:0/2392435647 shutdown_connections 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.834+0000 7f8d2341b640 1 -- 172.21.15.6:0/2392435647 wait complete. 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.835+0000 7f8d2341b640 1 Processor -- start 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.836+0000 7f8d2341b640 1 -- start start 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d2341b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d08004800 0x7f8d1c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d2341b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d1c0cd5c0 0x7f8d1c0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d2341b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1c0c9200 0x7f8d1c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d2341b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c0d4780 con 0x7f8d1c0c9200 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d2341b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c0d0300 con 0x7f8d08004800 2024-05-20T18:01:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d2341b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1c0d4900 con 0x7f8d1c0cd5c0 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d219b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1c0c9200 0x7f8d1c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d219b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1c0c9200 0x7f8d1c0cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43710/0 (socket says 172.21.15.6:43710) 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d219b8640 1 -- 172.21.15.6:0/1273630731 learned_addr learned my addr 172.21.15.6:0/1273630731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d211b7640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d08004800 0x7f8d1c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d209b6640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d1c0cd5c0 0x7f8d1c0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d219b8640 1 -- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d1c0cd5c0 msgr2=0x7f8d1c0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d219b8640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d1c0cd5c0 0x7f8d1c0c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d219b8640 1 -- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d08004800 msgr2=0x7f8d1c154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d219b8640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d08004800 0x7f8d1c154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.837+0000 7f8d219b8640 1 -- 172.21.15.6:0/1273630731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c0c9610 con 0x7f8d1c0c9200 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.838+0000 7f8d219b8640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1c0c9200 0x7f8d1c0cdcd0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0cf670 tx=0x7f8d1400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.838+0000 7f8d11ffb640 1 -- 172.21.15.6:0/1273630731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1401a070 con 0x7f8d1c0c9200 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.838+0000 7f8d11ffb640 1 -- 172.21.15.6:0/1273630731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d14006d60 con 0x7f8d1c0c9200 2024-05-20T18:01:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.838+0000 7f8d11ffb640 1 -- 172.21.15.6:0/1273630731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14003bb0 con 0x7f8d1c0c9200 2024-05-20T18:01:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.838+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c0ced00 con 0x7f8d1c0c9200 2024-05-20T18:01:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.838+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c0ccdc0 con 0x7f8d1c0c9200 2024-05-20T18:01:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.839+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1c0cc910 con 0x7f8d1c0c9200 2024-05-20T18:01:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.839+0000 7f8d11ffb640 1 -- 172.21.15.6:0/1273630731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d1401d070 con 0x7f8d1c0c9200 2024-05-20T18:01:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.840+0000 7f8d11ffb640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d0006be30 0x7f8d0006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.840+0000 7f8d11ffb640 1 -- 172.21.15.6:0/1273630731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f8d1408a4f0 con 0x7f8d1c0c9200 2024-05-20T18:01:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.840+0000 7f8d211b7640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d0006be30 0x7f8d0006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.841+0000 7f8d211b7640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d0006be30 0x7f8d0006e340 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c06a030 tx=0x7f8d18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:07.845+0000 7f8d11ffb640 1 -- 172.21.15.6:0/1273630731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8d140586c0 con 0x7f8d1c0c9200 2024-05-20T18:01:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.060+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d1c0cea70 con 0x7f8d1c0c9200 2024-05-20T18:01:08.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.061+0000 7f8d11ffb640 1 -- 172.21.15.6:0/1273630731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16904 (secure 0 0 0) 0x7f8d1405c9c0 con 0x7f8d1c0c9200 2024-05-20T18:01:08.059 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:08.060 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":113,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:45.915316+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:42.005763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:43.283834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.063+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d0006be30 msgr2=0x7f8d0006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.063+0000 7f8d2341b640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d0006be30 0x7f8d0006e340 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c06a030 tx=0x7f8d18008040 comp rx=0 tx=0).stop 2024-05-20T18:01:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1c0c9200 msgr2=0x7f8d1c0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1c0c9200 0x7f8d1c0cdcd0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0cf670 tx=0x7f8d1400fc90 comp rx=0 tx=0).stop 2024-05-20T18:01:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 shutdown_connections 2024-05-20T18:01:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d0006be30 0x7f8d0006e340 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d1c0c9200 0x7f8d1c0cdcd0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d1c0cd5c0 0x7f8d1c0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 --2- 172.21.15.6:0/1273630731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d08004800 0x7f8d1c154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 >> 172.21.15.6:0/1273630731 conn(0x7f8d1c0d4bd0 msgr2=0x7f8d1c1e7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:08.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 shutdown_connections 2024-05-20T18:01:08.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.064+0000 7f8d2341b640 1 -- 172.21.15.6:0/1273630731 wait complete. 2024-05-20T18:01:08.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:00:42.005763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:00:43.283834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:01:08.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:01:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.193+0000 7fe9e8b96640 1 Processor -- start 2024-05-20T18:01:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.193+0000 7fe9e8b96640 1 -- start start 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e8b96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9e406d3d0 0x7fe9e406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e8b96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e406dd20 con 0x7fe9e4162820 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e8b96640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e40d0630 con 0x7fe9e40b8190 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e8b96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e40d39c0 con 0x7fe9e406d3d0 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e1d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9e406d3d0 0x7fe9e406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe9e4162820 0x7fe9e40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59500/0 (socket says 172.21.15.6:59500) 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e259c640 1 -- 172.21.15.6:0/1400137223 learned_addr learned my addr 172.21.15.6:0/1400137223 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e1d9b640 1 -- 172.21.15.6:0/1400137223 >> v1:172.21.15.171:6789/0 conn(0x7fe9e40b8190 legacy=0x7fe9e40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e1d9b640 1 -- 172.21.15.6:0/1400137223 >> v1:172.21.15.6:6789/0 conn(0x7fe9e4162820 legacy=0x7fe9e40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e159a640 1 -- 172.21.15.6:0/1400137223 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941846783 0 0) 0x7fe9d4001110 con 0x7fe9e4162820 2024-05-20T18:01:08.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.195+0000 7fe9e1d9b640 1 -- 172.21.15.6:0/1400137223 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e40d3ca0 con 0x7fe9e406d3d0 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.196+0000 7fe9e1d9b640 1 --2- 172.21.15.6:0/1400137223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e406d3d0 0x7fe9e406d7e0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80097a0 tx=0x7fe9d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6821b7b55aeec99 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.196+0000 7fe9e159a640 1 -- 172.21.15.6:0/1400137223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8037070 con 0x7fe9e406d3d0 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.196+0000 7fe9e159a640 1 -- 172.21.15.6:0/1400137223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d8032440 con 0x7fe9e406d3d0 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.196+0000 7fe9e159a640 1 -- 172.21.15.6:0/1400137223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8032810 con 0x7fe9e406d3d0 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.197+0000 7fe9e8b96640 1 -- 172.21.15.6:0/1400137223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e406d3d0 msgr2=0x7fe9e406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.197+0000 7fe9e8b96640 1 --2- 172.21.15.6:0/1400137223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e406d3d0 0x7fe9e406d7e0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80097a0 tx=0x7fe9d802a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.197+0000 7fe9e8b96640 1 -- 172.21.15.6:0/1400137223 shutdown_connections 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.197+0000 7fe9e8b96640 1 --2- 172.21.15.6:0/1400137223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e406d3d0 0x7fe9e406d7e0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.197+0000 7fe9e8b96640 1 -- 172.21.15.6:0/1400137223 >> 172.21.15.6:0/1400137223 conn(0x7fe9e40d4bd0 msgr2=0x7fe9e40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.197+0000 7fe9e8b96640 1 -- 172.21.15.6:0/1400137223 shutdown_connections 2024-05-20T18:01:08.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.197+0000 7fe9e8b96640 1 -- 172.21.15.6:0/1400137223 wait complete. 2024-05-20T18:01:08.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.199+0000 7fe9e8b96640 1 Processor -- start 2024-05-20T18:01:08.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.199+0000 7fe9e8b96640 1 -- start start 2024-05-20T18:01:08.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e8b96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e406d3d0 0x7fe9e40b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e8b96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9e40b8190 0x7fe9e41ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e8b96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e4162820 0x7fe9e41f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e8b96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e40d0300 con 0x7fe9e4162820 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e8b96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e40d42e0 con 0x7fe9e406d3d0 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e8b96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e40b4050 con 0x7fe9e40b8190 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e4162820 0x7fe9e41f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e4162820 0x7fe9e41f95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43728/0 (socket says 172.21.15.6:43728) 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e2d9d640 1 -- 172.21.15.6:0/2652911372 learned_addr learned my addr 172.21.15.6:0/2652911372 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e1d9b640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9e40b8190 0x7fe9e41ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.200+0000 7fe9e259c640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e406d3d0 0x7fe9e40b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e2d9d640 1 -- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9e40b8190 msgr2=0x7fe9e41ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e2d9d640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9e40b8190 0x7fe9e41ea060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e2d9d640 1 -- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e406d3d0 msgr2=0x7fe9e40b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e2d9d640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e406d3d0 0x7fe9e40b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e2d9d640 1 -- 172.21.15.6:0/2652911372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e415a5b0 con 0x7fe9e4162820 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e1d9b640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9e40b8190 0x7fe9e41ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e2d9d640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e4162820 0x7fe9e41f95f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00b970 tx=0x7fe9dc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9d2ffd640 1 -- 172.21.15.6:0/2652911372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc019070 con 0x7fe9e4162820 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9d2ffd640 1 -- 172.21.15.6:0/2652911372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9dc00cb40 con 0x7fe9e4162820 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e41f9b30 con 0x7fe9e4162820 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9d2ffd640 1 -- 172.21.15.6:0/2652911372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc014440 con 0x7fe9e4162820 2024-05-20T18:01:08.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.201+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e40b47f0 con 0x7fe9e4162820 2024-05-20T18:01:08.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.202+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e40b4530 con 0x7fe9e4162820 2024-05-20T18:01:08.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.203+0000 7fe9d2ffd640 1 -- 172.21.15.6:0/2652911372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9dc01c070 con 0x7fe9e4162820 2024-05-20T18:01:08.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.203+0000 7fe9d2ffd640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe9c406be30 0x7fe9c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.203+0000 7fe9d2ffd640 1 -- 172.21.15.6:0/2652911372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fe9dc08aca0 con 0x7fe9e4162820 2024-05-20T18:01:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.204+0000 7fe9e259c640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe9c406be30 0x7fe9c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.204+0000 7fe9e259c640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe9c406be30 0x7fe9c406e340 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4000f60 tx=0x7fe9d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.208+0000 7fe9d2ffd640 1 -- 172.21.15.6:0/2652911372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe9e41f9b30 con 0x7fe9e4162820 2024-05-20T18:01:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.392+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe9e4075b00 con 0x7fe9e4162820 2024-05-20T18:01:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.393+0000 7fe9d2ffd640 1 -- 172.21.15.6:0/2652911372 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) ==== 93+0+10 (secure 0 0 0) 0x7fe9e415a5b0 con 0x7fe9e4162820 2024-05-20T18:01:08.391 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:01:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.394+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe9c406be30 msgr2=0x7fe9c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.394+0000 7fe9e8b96640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe9c406be30 0x7fe9c406e340 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4000f60 tx=0x7fe9d4009040 comp rx=0 tx=0).stop 2024-05-20T18:01:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.394+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e4162820 msgr2=0x7fe9e41f95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.394+0000 7fe9e8b96640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e4162820 0x7fe9e41f95f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00b970 tx=0x7fe9dc00be30 comp rx=0 tx=0).stop 2024-05-20T18:01:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.395+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 shutdown_connections 2024-05-20T18:01:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.395+0000 7fe9e8b96640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe9c406be30 0x7fe9c406e340 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.395+0000 7fe9e8b96640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e4162820 0x7fe9e41f95f0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.395+0000 7fe9e8b96640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9e40b8190 0x7fe9e41ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.395+0000 7fe9e8b96640 1 --2- 172.21.15.6:0/2652911372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e406d3d0 0x7fe9e40b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.395+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 >> 172.21.15.6:0/2652911372 conn(0x7fe9e40d4bd0 msgr2=0x7fe9e40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.395+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 shutdown_connections 2024-05-20T18:01:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.395+0000 7fe9e8b96640 1 -- 172.21.15.6:0/2652911372 wait complete. 2024-05-20T18:01:08.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:01:08.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.525+0000 7f8aab796640 1 Processor -- start 2024-05-20T18:01:08.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.526+0000 7f8aab796640 1 -- start start 2024-05-20T18:01:08.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.527+0000 7f8aab796640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8aa406d3d0 0x7f8aa406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.527+0000 7f8aab796640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa406dd20 con 0x7f8aa40b8190 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.527+0000 7f8aab796640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa40d0630 con 0x7f8aa4162820 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.527+0000 7f8aab796640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8aa40d39c0 con 0x7f8aa406d3d0 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.527+0000 7f8aa8d31640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8aa406d3d0 0x7f8aa406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.527+0000 7f8aa9d33640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8aa40b8190 0x7f8aa40b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59516/0 (socket says 172.21.15.6:59516) 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.527+0000 7f8aa9d33640 1 -- 172.21.15.6:0/299672361 learned_addr learned my addr 172.21.15.6:0/299672361 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.528+0000 7f8aa8d31640 1 -- 172.21.15.6:0/299672361 >> v1:172.21.15.171:6789/0 conn(0x7f8aa4162820 legacy=0x7f8aa40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.528+0000 7f8aa8d31640 1 -- 172.21.15.6:0/299672361 >> v1:172.21.15.6:6789/0 conn(0x7f8aa40b8190 legacy=0x7f8aa40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.528+0000 7f8aa3fff640 1 -- 172.21.15.6:0/299672361 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2502884190 0 0) 0x7f8a9c001110 con 0x7f8aa40b8190 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.528+0000 7f8aa8d31640 1 -- 172.21.15.6:0/299672361 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa40d3ca0 con 0x7f8aa406d3d0 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.528+0000 7f8aa8d31640 1 --2- 172.21.15.6:0/299672361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa406d3d0 0x7f8aa406d7e0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009d90 tx=0x7f8a9802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b85f22b1fa4b15f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.528+0000 7f8aa3fff640 1 -- 172.21.15.6:0/299672361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98007740 con 0x7f8aa406d3d0 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aa3fff640 1 -- 172.21.15.6:0/299672361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a980078e0 con 0x7f8aa406d3d0 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aa3fff640 1 -- 172.21.15.6:0/299672361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98007cb0 con 0x7f8aa406d3d0 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aab796640 1 -- 172.21.15.6:0/299672361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa406d3d0 msgr2=0x7f8aa406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aab796640 1 --2- 172.21.15.6:0/299672361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa406d3d0 0x7f8aa406d7e0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009d90 tx=0x7f8a9802a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aab796640 1 -- 172.21.15.6:0/299672361 shutdown_connections 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aab796640 1 --2- 172.21.15.6:0/299672361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa406d3d0 0x7f8aa406d7e0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aab796640 1 -- 172.21.15.6:0/299672361 >> 172.21.15.6:0/299672361 conn(0x7f8aa40d4bd0 msgr2=0x7f8aa40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aab796640 1 -- 172.21.15.6:0/299672361 shutdown_connections 2024-05-20T18:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.529+0000 7f8aab796640 1 -- 172.21.15.6:0/299672361 wait complete. 2024-05-20T18:01:08.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.531+0000 7f8aab796640 1 Processor -- start 2024-05-20T18:01:08.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.531+0000 7f8aab796640 1 -- start start 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.532+0000 7f8aab796640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aa406d3d0 0x7f8aa414c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.532+0000 7f8aab796640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa40b8190 0x7f8aa40b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.532+0000 7f8aab796640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aa4162820 0x7f8aa40b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.532+0000 7f8aab796640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa40d0300 con 0x7f8aa40b8190 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.532+0000 7f8aab796640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa40d42e0 con 0x7f8aa406d3d0 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.532+0000 7f8aab796640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa40b4050 con 0x7f8aa4162820 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa40b8190 0x7f8aa40b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa40b8190 0x7f8aa40b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43738/0 (socket says 172.21.15.6:43738) 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 -- 172.21.15.6:0/232625524 learned_addr learned my addr 172.21.15.6:0/232625524 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa9d33640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aa4162820 0x7f8aa40b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa9532640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aa406d3d0 0x7f8aa414c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 -- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aa4162820 msgr2=0x7f8aa40b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aa4162820 0x7f8aa40b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 -- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aa406d3d0 msgr2=0x7f8aa414c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aa406d3d0 0x7f8aa414c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 -- 172.21.15.6:0/232625524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa40c9b10 con 0x7f8aa40b8190 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa9d33640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aa4162820 0x7f8aa40b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa9532640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aa406d3d0 0x7f8aa414c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa8d31640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa40b8190 0x7f8aa40b4350 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009d90 tx=0x7f8a98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa1ffb640 1 -- 172.21.15.6:0/232625524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98040070 con 0x7f8aa40b8190 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa1ffb640 1 -- 172.21.15.6:0/232625524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a98031c40 con 0x7f8aa40b8190 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aa1ffb640 1 -- 172.21.15.6:0/232625524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9803c420 con 0x7f8aa40b8190 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.533+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa40c9df0 con 0x7f8aa40b8190 2024-05-20T18:01:08.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.534+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa40ca3b0 con 0x7f8aa40b8190 2024-05-20T18:01:08.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.534+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa4075b00 con 0x7f8aa40b8190 2024-05-20T18:01:08.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.535+0000 7f8aa1ffb640 1 -- 172.21.15.6:0/232625524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a98039040 con 0x7f8aa40b8190 2024-05-20T18:01:08.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.536+0000 7f8aa1ffb640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a9006be60 0x7f8a9006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.536+0000 7f8aa1ffb640 1 -- 172.21.15.6:0/232625524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f8a980ac6a0 con 0x7f8aa40b8190 2024-05-20T18:01:08.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.536+0000 7f8aa9532640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a9006be60 0x7f8a9006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.536+0000 7f8aa9532640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a9006be60 0x7f8a9006e370 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400a830 tx=0x7f8a94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.540+0000 7f8aa1ffb640 1 -- 172.21.15.6:0/232625524 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8a9807a860 con 0x7f8aa40b8190 2024-05-20T18:01:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.723+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8aa415e3e0 con 0x7f8aa40b8190 2024-05-20T18:01:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.724+0000 7f8aa1ffb640 1 -- 172.21.15.6:0/232625524 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) ==== 104+0+11 (secure 0 0 0) 0x7f8a9807eb60 con 0x7f8aa40b8190 2024-05-20T18:01:08.722 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a9006be60 msgr2=0x7f8a9006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a9006be60 0x7f8a9006e370 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400a830 tx=0x7f8a94008040 comp rx=0 tx=0).stop 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa40b8190 msgr2=0x7f8aa40b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa40b8190 0x7f8aa40b4350 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009d90 tx=0x7f8a98004a40 comp rx=0 tx=0).stop 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 shutdown_connections 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8a9006be60 0x7f8a9006e370 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aa4162820 0x7f8aa40b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8aa40b8190 0x7f8aa40b4350 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 --2- 172.21.15.6:0/232625524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aa406d3d0 0x7f8aa414c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 >> 172.21.15.6:0/232625524 conn(0x7f8aa40d4bd0 msgr2=0x7f8aa415d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:08.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 shutdown_connections 2024-05-20T18:01:08.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.726+0000 7f8aab796640 1 -- 172.21.15.6:0/232625524 wait complete. 2024-05-20T18:01:08.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:01:08.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.855+0000 7fb7a2c99640 1 Processor -- start 2024-05-20T18:01:08.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.855+0000 7fb7a2c99640 1 -- start start 2024-05-20T18:01:08.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a2c99640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb79c0d10e0 0x7fb79c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a2c99640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb79c0b7210 0x7fb79c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a2c99640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb79c0d1ac0 con 0x7fb79c0d14f0 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a2c99640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb79c0d1da0 con 0x7fb79c0d10e0 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a2c99640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb79c0d2080 con 0x7fb79c0b7210 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a0a35640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb79c0d10e0 0x7fb79c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb79bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb79c0d14f0 0x7fb79c0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59520/0 (socket says 172.21.15.6:59520) 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb79bfff640 1 -- 172.21.15.6:0/2841087930 learned_addr learned my addr 172.21.15.6:0/2841087930 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a0a35640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb79c0d10e0 0x7fb79c0cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43740/0 (socket says 172.21.15.6:43740) 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a1236640 1 --2- 172.21.15.6:0/2841087930 >> v2:172.21.15.171:3300/0 conn(0x7fb79c0b7210 0x7fb79c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a0a35640 1 -- 172.21.15.6:0/2841087930 >> v2:172.21.15.171:3300/0 conn(0x7fb79c0b7210 msgr2=0x7fb79c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a0a35640 1 --2- 172.21.15.6:0/2841087930 >> v2:172.21.15.171:3300/0 conn(0x7fb79c0b7210 0x7fb79c0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a0a35640 1 -- 172.21.15.6:0/2841087930 >> v1:172.21.15.6:6789/0 conn(0x7fb79c0d14f0 legacy=0x7fb79c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.857+0000 7fb7a0a35640 1 -- 172.21.15.6:0/2841087930 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79c0d2360 con 0x7fb79c0d10e0 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.858+0000 7fb7a0a35640 1 --2- 172.21.15.6:0/2841087930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d10e0 0x7fb79c0cf140 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0b58a0 tx=0x7fb78c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ea6537738d6118 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.858+0000 7fb79b7fe640 1 -- 172.21.15.6:0/2841087930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c037070 con 0x7fb79c0d10e0 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.858+0000 7fb79b7fe640 1 -- 172.21.15.6:0/2841087930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78c032440 con 0x7fb79c0d10e0 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.858+0000 7fb79b7fe640 1 -- 172.21.15.6:0/2841087930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c032810 con 0x7fb79c0d10e0 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.859+0000 7fb7a2c99640 1 -- 172.21.15.6:0/2841087930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d10e0 msgr2=0x7fb79c0cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.859+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/2841087930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d10e0 0x7fb79c0cf140 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0b58a0 tx=0x7fb78c02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.859+0000 7fb7a2c99640 1 -- 172.21.15.6:0/2841087930 shutdown_connections 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.859+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/2841087930 >> v2:172.21.15.171:3300/0 conn(0x7fb79c0b7210 0x7fb79c0cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.859+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/2841087930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d10e0 0x7fb79c0cf140 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.859+0000 7fb7a2c99640 1 -- 172.21.15.6:0/2841087930 >> 172.21.15.6:0/2841087930 conn(0x7fb79c0b44d0 msgr2=0x7fb79c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:08.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.859+0000 7fb7a2c99640 1 -- 172.21.15.6:0/2841087930 shutdown_connections 2024-05-20T18:01:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.859+0000 7fb7a2c99640 1 -- 172.21.15.6:0/2841087930 wait complete. 2024-05-20T18:01:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.861+0000 7fb7a2c99640 1 Processor -- start 2024-05-20T18:01:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.861+0000 7fb7a2c99640 1 -- start start 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.862+0000 7fb7a2c99640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb79c0b7210 0x7fb79c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.862+0000 7fb7a2c99640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb79c0d10e0 0x7fb79c15f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.862+0000 7fb7a2c99640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d14f0 0x7fb79c15f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.862+0000 7fb7a2c99640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c0b8440 con 0x7fb79c0d14f0 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.862+0000 7fb7a2c99640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c0b82c0 con 0x7fb79c0b7210 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.862+0000 7fb7a2c99640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb79c0709f0 con 0x7fb79c0d10e0 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.862+0000 7fb7a1236640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d14f0 0x7fb79c15f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a1236640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d14f0 0x7fb79c15f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43742/0 (socket says 172.21.15.6:43742) 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a1236640 1 -- 172.21.15.6:0/3002161042 learned_addr learned my addr 172.21.15.6:0/3002161042 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb79bfff640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb79c0d10e0 0x7fb79c15f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a0a35640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb79c0b7210 0x7fb79c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a1236640 1 -- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb79c0d10e0 msgr2=0x7fb79c15f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a1236640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb79c0d10e0 0x7fb79c15f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a1236640 1 -- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb79c0b7210 msgr2=0x7fb79c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a1236640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb79c0b7210 0x7fb79c155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a1236640 1 -- 172.21.15.6:0/3002161042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79c0c6fa0 con 0x7fb79c0d14f0 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a1236640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d14f0 0x7fb79c15f830 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb794009fd0 tx=0x7fb79400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7997fa640 1 -- 172.21.15.6:0/3002161042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794014420 con 0x7fb79c0d14f0 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7997fa640 1 -- 172.21.15.6:0/3002161042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb794019070 con 0x7fb79c0d14f0 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79c0c7280 con 0x7fb79c0d14f0 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7997fa640 1 -- 172.21.15.6:0/3002161042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794014800 con 0x7fb79c0d14f0 2024-05-20T18:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.863+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79c0c7840 con 0x7fb79c0d14f0 2024-05-20T18:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.864+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79c0c92a0 con 0x7fb79c0d14f0 2024-05-20T18:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.865+0000 7fb7997fa640 1 -- 172.21.15.6:0/3002161042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7940149a0 con 0x7fb79c0d14f0 2024-05-20T18:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.865+0000 7fb7997fa640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb78806be30 0x7fb78806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.866+0000 7fb7997fa640 1 -- 172.21.15.6:0/3002161042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fb79408b9a0 con 0x7fb79c0d14f0 2024-05-20T18:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.866+0000 7fb7a0a35640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb78806be30 0x7fb78806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.866+0000 7fb7a0a35640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb78806be30 0x7fb78806e340 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb78c034000 tx=0x7fb78c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:08.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:08.870+0000 7fb7997fa640 1 -- 172.21.15.6:0/3002161042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb79405a090 con 0x7fb79c0d14f0 2024-05-20T18:01:09.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.076+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb79c075b00 con 0x7fb79c0d14f0 2024-05-20T18:01:09.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.076+0000 7fb7997fa640 1 -- 172.21.15.6:0/3002161042 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) ==== 100+0+11 (secure 0 0 0) 0x7fb794059990 con 0x7fb79c0d14f0 2024-05-20T18:01:09.074 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:01:09.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb78806be30 msgr2=0x7fb78806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb78806be30 0x7fb78806e340 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb78c034000 tx=0x7fb78c02e000 comp rx=0 tx=0).stop 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d14f0 msgr2=0x7fb79c15f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d14f0 0x7fb79c15f830 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb794009fd0 tx=0x7fb79400e4b0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 shutdown_connections 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb78806be30 0x7fb78806e340 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb79c0d14f0 0x7fb79c15f830 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb79c0d10e0 0x7fb79c15f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 --2- 172.21.15.6:0/3002161042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb79c0b7210 0x7fb79c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 >> 172.21.15.6:0/3002161042 conn(0x7fb79c0b44d0 msgr2=0x7fb79c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 shutdown_connections 2024-05-20T18:01:09.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.078+0000 7fb7a2c99640 1 -- 172.21.15.6:0/3002161042 wait complete. 2024-05-20T18:01:09.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:01:09.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.209+0000 7f023c691640 1 Processor -- start 2024-05-20T18:01:09.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.209+0000 7f023c691640 1 -- start start 2024-05-20T18:01:09.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.210+0000 7f023c691640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0234168050 0x7f023416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.210+0000 7f023c691640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02340d0630 con 0x7f0234162820 2024-05-20T18:01:09.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.210+0000 7f023c691640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02340d39c0 con 0x7f023406d3d0 2024-05-20T18:01:09.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.210+0000 7f023c691640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f02340d3ca0 con 0x7f0234168050 2024-05-20T18:01:09.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.210+0000 7f023a42d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0234162820 0x7f02340b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59530/0 (socket says 172.21.15.6:59530) 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.210+0000 7f023a42d640 1 -- 172.21.15.6:0/2595247768 learned_addr learned my addr 172.21.15.6:0/2595247768 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023ac2e640 1 --2- 172.21.15.6:0/2595247768 >> v2:172.21.15.171:3300/0 conn(0x7f0234168050 0x7f023416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199842979 0 0) 0x7f02340d0630 con 0x7f0234162820 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0220003520 con 0x7f0234162820 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3239675421 0 0) 0x7f0220003520 con 0x7f0234162820 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 >> v2:172.21.15.171:3300/0 conn(0x7f0234168050 msgr2=0x7f023416a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 --2- 172.21.15.6:0/2595247768 >> v2:172.21.15.171:3300/0 conn(0x7f0234168050 0x7f023416a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 >> v1:172.21.15.171:6789/0 conn(0x7f023406d3d0 legacy=0x7f023406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02340d3f80 con 0x7f0234162820 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f0230001670 con 0x7f0234162820 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 >> v1:172.21.15.6:6789/0 conn(0x7f0234162820 legacy=0x7f02340b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0220003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220004800 0x7f0220004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02200051c0 0x7f022000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f02340d3ca0 con 0x7f02200039b0 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f022000c160 con 0x7f0220004800 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f022000c360 con 0x7f02200051c0 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023a42d640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0220003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f0239c2c640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220004800 0x7f0220004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.211+0000 7f023ac2e640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02200051c0 0x7f022000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.212+0000 7f023a42d640 1 -- 172.21.15.6:0/2595247768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02200051c0 msgr2=0x7f022000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.212+0000 7f023a42d640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02200051c0 0x7f022000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.212+0000 7f023a42d640 1 -- 172.21.15.6:0/2595247768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220004800 msgr2=0x7f0220004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.212+0000 7f023a42d640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220004800 0x7f0220004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.212+0000 7f023ac2e640 1 -- 172.21.15.6:0/2595247768 reap_dead start 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.212+0000 7f023a42d640 1 -- 172.21.15.6:0/2595247768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0220003520 con 0x7f02200039b0 2024-05-20T18:01:09.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.212+0000 7f023a42d640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0220003e20 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f023000c240 tx=0x7f0220005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6894b94655f4ccb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230007cf0 con 0x7f02200039b0 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0230005af0 con 0x7f02200039b0 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023942b640 1 -- 172.21.15.6:0/2595247768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230007070 con 0x7f02200039b0 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023c691640 1 -- 172.21.15.6:0/2595247768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 msgr2=0x7f0220003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023c691640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0220003e20 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f023000c240 tx=0x7f0220005830 comp rx=0 tx=0).stop 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023c691640 1 -- 172.21.15.6:0/2595247768 shutdown_connections 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023c691640 1 --2- 172.21.15.6:0/2595247768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0220003e20 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023c691640 1 -- 172.21.15.6:0/2595247768 >> 172.21.15.6:0/2595247768 conn(0x7f02340d4bd0 msgr2=0x7f02340d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023c691640 1 -- 172.21.15.6:0/2595247768 shutdown_connections 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.213+0000 7f023c691640 1 -- 172.21.15.6:0/2595247768 wait complete. 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.215+0000 7f023c691640 1 Processor -- start 2024-05-20T18:01:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.215+0000 7f023c691640 1 -- start start 2024-05-20T18:01:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.216+0000 7f023c691640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0234158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.216+0000 7f023c691640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02341591f0 0x7f023415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.216+0000 7f023c691640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0234158bc0 0x7f023415f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.216+0000 7f023c691640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f02340d4780 con 0x7f02200039b0 2024-05-20T18:01:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.216+0000 7f023c691640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f02340d0300 con 0x7f02341591f0 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.216+0000 7f023c691640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f02340d4900 con 0x7f0234158bc0 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0234158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0234158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43760/0 (socket says 172.21.15.6:43760) 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 -- 172.21.15.6:0/772079701 learned_addr learned my addr 172.21.15.6:0/772079701 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023ac2e640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0234158bc0 0x7f023415f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f0239c2c640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02341591f0 0x7f023415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 -- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0234158bc0 msgr2=0x7f023415f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0234158bc0 0x7f023415f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 -- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02341591f0 msgr2=0x7f023415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02341591f0 0x7f023415efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 -- 172.21.15.6:0/772079701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02340cbd90 con 0x7f02200039b0 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f0239c2c640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02341591f0 0x7f023415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023ac2e640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0234158bc0 0x7f023415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023a42d640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0234158560 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f0230001970 tx=0x7f02340d0800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f022affd640 1 -- 172.21.15.6:0/772079701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230037040 con 0x7f02200039b0 2024-05-20T18:01:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f022affd640 1 -- 172.21.15.6:0/772079701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0230041070 con 0x7f02200039b0 2024-05-20T18:01:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02340cc030 con 0x7f02200039b0 2024-05-20T18:01:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f022affd640 1 -- 172.21.15.6:0/772079701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02300049e0 con 0x7f02200039b0 2024-05-20T18:01:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.217+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02340c91b0 con 0x7f02200039b0 2024-05-20T18:01:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.218+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0234075b00 con 0x7f02200039b0 2024-05-20T18:01:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.219+0000 7f022affd640 1 -- 172.21.15.6:0/772079701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0230004b80 con 0x7f02200039b0 2024-05-20T18:01:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.219+0000 7f022affd640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f021806be60 0x7f021806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.220+0000 7f022affd640 1 -- 172.21.15.6:0/772079701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f02300aafc0 con 0x7f02200039b0 2024-05-20T18:01:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.220+0000 7f0239c2c640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f021806be60 0x7f021806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.220+0000 7f0239c2c640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f021806be60 0x7f021806e370 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0234161b30 tx=0x7f0224009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:09.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.224+0000 7f022affd640 1 -- 172.21.15.6:0/772079701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0230079900 con 0x7f02200039b0 2024-05-20T18:01:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.420+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0234161e40 con 0x7f02200039b0 2024-05-20T18:01:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.420+0000 7f022affd640 1 -- 172.21.15.6:0/772079701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7f0230079200 con 0x7f02200039b0 2024-05-20T18:01:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:01:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f021806be60 msgr2=0x7f021806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f021806be60 0x7f021806e370 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0234161b30 tx=0x7f0224009040 comp rx=0 tx=0).stop 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 msgr2=0x7f0234158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0234158560 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f0230001970 tx=0x7f02340d0800 comp rx=0 tx=0).stop 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 shutdown_connections 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f021806be60 0x7f021806e370 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0234158bc0 0x7f023415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02341591f0 0x7f023415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 --2- 172.21.15.6:0/772079701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02200039b0 0x7f0234158560 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 >> 172.21.15.6:0/772079701 conn(0x7f02340d4bd0 msgr2=0x7f02340b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 shutdown_connections 2024-05-20T18:01:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.422+0000 7f023c691640 1 -- 172.21.15.6:0/772079701 wait complete. 2024-05-20T18:01:09.432 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T18:01:09.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:09.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T18:01:09.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:01:09.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:09.529 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T18:01:09.544 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:01:09.545 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:09.545 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:09.563 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:09.563 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:09.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.738+0000 7f38bb680640 1 Processor -- start 2024-05-20T18:01:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.738+0000 7f38bb680640 1 -- start start 2024-05-20T18:01:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.739+0000 7f38bb680640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f38b4168050 0x7f38b416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.739+0000 7f38bb680640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b40d0630 con 0x7f38b4162820 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.739+0000 7f38bb680640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b40d39c0 con 0x7f38b406d3d0 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.739+0000 7f38bb680640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f38b40d3ca0 con 0x7f38b4168050 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38b941c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f38b4162820 0x7f38b40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59538/0 (socket says 172.21.15.6:59538) 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38b941c640 1 -- 172.21.15.6:0/1787336938 learned_addr learned my addr 172.21.15.6:0/1787336938 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38b9c1d640 1 --2- 172.21.15.6:0/1787336938 >> v2:172.21.15.171:3300/0 conn(0x7f38b4168050 0x7f38b416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323431338 0 0) 0x7f38b40d0630 con 0x7f38b4162820 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38a0003520 con 0x7f38b4162820 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 870146445 0 0) 0x7f38a0003520 con 0x7f38b4162820 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 >> v2:172.21.15.171:3300/0 conn(0x7f38b4168050 msgr2=0x7f38b416a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 --2- 172.21.15.6:0/1787336938 >> v2:172.21.15.171:3300/0 conn(0x7f38b4168050 0x7f38b416a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 >> v1:172.21.15.171:6789/0 conn(0x7f38b406d3d0 legacy=0x7f38b406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40d3f80 con 0x7f38b4162820 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f38b0001670 con 0x7f38b4162820 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 >> v1:172.21.15.6:6789/0 conn(0x7f38b4162820 legacy=0x7f38b40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a00039b0 0x7f38a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a0004800 0x7f38a0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38a00051c0 0x7f38a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40d3ca0 con 0x7f38a00039b0 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38a000c160 con 0x7f38a0004800 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f38a000c360 con 0x7f38a00051c0 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38b941c640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a00039b0 0x7f38a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38b8c1b640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a0004800 0x7f38a0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.740+0000 7f38b9c1d640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38a00051c0 0x7f38a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.741+0000 7f38b941c640 1 -- 172.21.15.6:0/1787336938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38a00051c0 msgr2=0x7f38a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.741+0000 7f38b941c640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38a00051c0 0x7f38a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.741+0000 7f38b941c640 1 -- 172.21.15.6:0/1787336938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a0004800 msgr2=0x7f38a0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.741+0000 7f38b941c640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a0004800 0x7f38a0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.741+0000 7f38b941c640 1 -- 172.21.15.6:0/1787336938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a0003520 con 0x7f38a00039b0 2024-05-20T18:01:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.741+0000 7f38b9c1d640 1 -- 172.21.15.6:0/1787336938 reap_dead start 2024-05-20T18:01:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.741+0000 7f38b941c640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a00039b0 0x7f38a0003e20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f38b000c240 tx=0x7f38a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e14f6c5ec580e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0007cf0 con 0x7f38a00039b0 2024-05-20T18:01:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b0005af0 con 0x7f38a00039b0 2024-05-20T18:01:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38abfff640 1 -- 172.21.15.6:0/1787336938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0007070 con 0x7f38a00039b0 2024-05-20T18:01:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38bb680640 1 -- 172.21.15.6:0/1787336938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a00039b0 msgr2=0x7f38a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38bb680640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a00039b0 0x7f38a0003e20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f38b000c240 tx=0x7f38a0005830 comp rx=0 tx=0).stop 2024-05-20T18:01:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38bb680640 1 -- 172.21.15.6:0/1787336938 shutdown_connections 2024-05-20T18:01:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38bb680640 1 --2- 172.21.15.6:0/1787336938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a00039b0 0x7f38a0003e20 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38bb680640 1 -- 172.21.15.6:0/1787336938 >> 172.21.15.6:0/1787336938 conn(0x7f38b40d4bd0 msgr2=0x7f38b40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38bb680640 1 -- 172.21.15.6:0/1787336938 shutdown_connections 2024-05-20T18:01:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.742+0000 7f38bb680640 1 -- 172.21.15.6:0/1787336938 wait complete. 2024-05-20T18:01:09.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.744+0000 7f38bb680640 1 Processor -- start 2024-05-20T18:01:09.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.744+0000 7f38bb680640 1 -- start start 2024-05-20T18:01:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38bb680640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a00039b0 0x7f38b40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38bb680640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b41600a0 0x7f38b41567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38bb680640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b40b5f50 0x7f38b40b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38bb680640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40d4780 con 0x7f38b40b5f50 2024-05-20T18:01:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38bb680640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40d0300 con 0x7f38a00039b0 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38bb680640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f38b40d4900 con 0x7f38b41600a0 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b40b5f50 0x7f38b40b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b40b5f50 0x7f38b40b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43788/0 (socket says 172.21.15.6:43788) 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 -- 172.21.15.6:0/3429350103 learned_addr learned my addr 172.21.15.6:0/3429350103 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b8c1b640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b41600a0 0x7f38b41567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b941c640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a00039b0 0x7f38b40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 -- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b41600a0 msgr2=0x7f38b41567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b41600a0 0x7f38b41567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 -- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a00039b0 msgr2=0x7f38b40c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a00039b0 0x7f38b40c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 -- 172.21.15.6:0/3429350103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40b68a0 con 0x7f38b40b5f50 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b941c640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a00039b0 0x7f38b40c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38b9c1d640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b40b5f50 0x7f38b40b6360 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f38b40cf670 tx=0x7f38ac00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38a9ffb640 1 -- 172.21.15.6:0/3429350103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00fd80 con 0x7f38b40b5f50 2024-05-20T18:01:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38a9ffb640 1 -- 172.21.15.6:0/3429350103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac01d070 con 0x7f38b40b5f50 2024-05-20T18:01:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.746+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b41570b0 con 0x7f38b40b5f50 2024-05-20T18:01:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.747+0000 7f38a9ffb640 1 -- 172.21.15.6:0/3429350103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac015670 con 0x7f38b40b5f50 2024-05-20T18:01:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.747+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b4157670 con 0x7f38b40b5f50 2024-05-20T18:01:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.748+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b4075b00 con 0x7f38b40b5f50 2024-05-20T18:01:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.748+0000 7f38a9ffb640 1 -- 172.21.15.6:0/3429350103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38ac015810 con 0x7f38b40b5f50 2024-05-20T18:01:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.749+0000 7f38a9ffb640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f389806be30 0x7f389806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.749+0000 7f38a9ffb640 1 -- 172.21.15.6:0/3429350103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f38ac08b880 con 0x7f38b40b5f50 2024-05-20T18:01:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.749+0000 7f38b941c640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f389806be30 0x7f389806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.750+0000 7f38b941c640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f389806be30 0x7f389806e340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f38b0032000 tx=0x7f38b0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:09.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.754+0000 7f38a9ffb640 1 -- 172.21.15.6:0/3429350103 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f38b40b68a0 con 0x7f38b40b5f50 2024-05-20T18:01:09.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.941+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38b40c7490 con 0x7f38b40b5f50 2024-05-20T18:01:09.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.942+0000 7f38a9ffb640 1 -- 172.21.15.6:0/3429350103 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16904 (secure 0 0 0) 0x7f38ac010040 con 0x7f38b40b5f50 2024-05-20T18:01:09.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:09.941 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":113,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:45.915316+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:42.005763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:43.283834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f389806be30 msgr2=0x7f389806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f389806be30 0x7f389806e340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f38b0032000 tx=0x7f38b0009030 comp rx=0 tx=0).stop 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b40b5f50 msgr2=0x7f38b40b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b40b5f50 0x7f38b40b6360 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f38b40cf670 tx=0x7f38ac00f580 comp rx=0 tx=0).stop 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 shutdown_connections 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f389806be30 0x7f389806e340 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38b40b5f50 0x7f38b40b6360 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38b41600a0 0x7f38b41567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 --2- 172.21.15.6:0/3429350103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38a00039b0 0x7f38b40c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 >> 172.21.15.6:0/3429350103 conn(0x7f38b40d4bd0 msgr2=0x7f38b41598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 shutdown_connections 2024-05-20T18:01:09.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:09.944+0000 7f38bb680640 1 -- 172.21.15.6:0/3429350103 wait complete. 2024-05-20T18:01:09.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:00:42.005763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:00:43.283834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:01:09.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:01:10.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.074+0000 7f733cc73640 1 Processor -- start 2024-05-20T18:01:10.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.074+0000 7f733cc73640 1 -- start start 2024-05-20T18:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.075+0000 7f733cc73640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f733815d530 0x7f733815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.075+0000 7f733cc73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73380b1700 0x7f73380b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.075+0000 7f733cc73640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73380cd580 con 0x7f7338070850 2024-05-20T18:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.075+0000 7f733cc73640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f73380ce190 con 0x7f733815d530 2024-05-20T18:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.075+0000 7f733cc73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f73380cd860 con 0x7f73380b1700 2024-05-20T18:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.075+0000 7f7335d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73380b1700 0x7f73380b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.075+0000 7f733659c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f733815d530 0x7f733815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.076+0000 7f7335d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73380b1700 0x7f73380b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:35460/0 (socket says 172.21.15.6:35460) 2024-05-20T18:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.076+0000 7f7335d9b640 1 -- 172.21.15.6:0/3118989086 learned_addr learned my addr 172.21.15.6:0/3118989086 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.076+0000 7f7336d9d640 1 --1- 172.21.15.6:0/3118989086 >> v1:172.21.15.171:6789/0 conn(0x7f7338070850 0x7f7338070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:39546/0 (socket says 172.21.15.6:39546) 2024-05-20T18:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.076+0000 7f7335d9b640 1 -- 172.21.15.6:0/3118989086 >> v2:172.21.15.171:3300/0 conn(0x7f733815d530 msgr2=0x7f733815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.076+0000 7f7335d9b640 1 --2- 172.21.15.6:0/3118989086 >> v2:172.21.15.171:3300/0 conn(0x7f733815d530 0x7f733815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.076+0000 7f7335d9b640 1 -- 172.21.15.6:0/3118989086 >> v1:172.21.15.171:6789/0 conn(0x7f7338070850 legacy=0x7f7338070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.076+0000 7f7335d9b640 1 -- 172.21.15.6:0/3118989086 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73380cdb40 con 0x7f73380b1700 2024-05-20T18:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.076+0000 7f733659c640 1 --2- 172.21.15.6:0/3118989086 >> v2:172.21.15.171:3300/0 conn(0x7f733815d530 0x7f733815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.077+0000 7f7335d9b640 1 --2- 172.21.15.6:0/3118989086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73380b1700 0x7f73380b1b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7320009870 tx=0x7f732002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c9f5078cc77d06 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.077+0000 7f733559a640 1 -- 172.21.15.6:0/3118989086 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320037070 con 0x7f73380b1700 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.077+0000 7f733559a640 1 -- 172.21.15.6:0/3118989086 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7320032440 con 0x7f73380b1700 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.077+0000 7f733559a640 1 -- 172.21.15.6:0/3118989086 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320032810 con 0x7f73380b1700 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.078+0000 7f733cc73640 1 -- 172.21.15.6:0/3118989086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73380b1700 msgr2=0x7f73380b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.078+0000 7f733cc73640 1 --2- 172.21.15.6:0/3118989086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73380b1700 0x7f73380b1b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7320009870 tx=0x7f732002a270 comp rx=0 tx=0).stop 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.078+0000 7f733cc73640 1 -- 172.21.15.6:0/3118989086 shutdown_connections 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.078+0000 7f733cc73640 1 --2- 172.21.15.6:0/3118989086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73380b1700 0x7f73380b1b10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.078+0000 7f733cc73640 1 --2- 172.21.15.6:0/3118989086 >> v2:172.21.15.171:3300/0 conn(0x7f733815d530 0x7f733815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.078+0000 7f733cc73640 1 -- 172.21.15.6:0/3118989086 >> 172.21.15.6:0/3118989086 conn(0x7f73380d29d0 msgr2=0x7f73380d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.078+0000 7f733cc73640 1 -- 172.21.15.6:0/3118989086 shutdown_connections 2024-05-20T18:01:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.078+0000 7f733cc73640 1 -- 172.21.15.6:0/3118989086 wait complete. 2024-05-20T18:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.080+0000 7f733cc73640 1 Processor -- start 2024-05-20T18:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.080+0000 7f733cc73640 1 -- start start 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f733cc73640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7338070850 0x7f73380c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f733cc73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73380b1700 0x7f73381f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f733cc73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f733815d530 0x7f733815e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f733cc73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f73380b2050 con 0x7f73380b1700 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f733cc73640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f73380cd230 con 0x7f7338070850 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f733cc73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7338071370 con 0x7f733815d530 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f7335d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73380b1700 0x7f73381f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f7335d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73380b1700 0x7f73381f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43796/0 (socket says 172.21.15.6:43796) 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f7335d9b640 1 -- 172.21.15.6:0/2014691114 learned_addr learned my addr 172.21.15.6:0/2014691114 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f733659c640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7338070850 0x7f73380c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.081+0000 7f7336d9d640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f733815d530 0x7f733815e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f7335d9b640 1 -- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f733815d530 msgr2=0x7f733815e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f7335d9b640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f733815d530 0x7f733815e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f7335d9b640 1 -- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7338070850 msgr2=0x7f73380c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f7335d9b640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7338070850 0x7f73380c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f7335d9b640 1 -- 172.21.15.6:0/2014691114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73380c7e50 con 0x7f73380b1700 2024-05-20T18:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f7335d9b640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73380b1700 0x7f73381f2c40 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7320000c00 tx=0x7f73200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f732effd640 1 -- 172.21.15.6:0/2014691114 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320037040 con 0x7f73380b1700 2024-05-20T18:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f732effd640 1 -- 172.21.15.6:0/2014691114 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7320042070 con 0x7f73380b1700 2024-05-20T18:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73380c8130 con 0x7f73380b1700 2024-05-20T18:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f732effd640 1 -- 172.21.15.6:0/2014691114 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320030880 con 0x7f73380b1700 2024-05-20T18:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.082+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73380c9b20 con 0x7f73380b1700 2024-05-20T18:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.083+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f733815ddc0 con 0x7f73380b1700 2024-05-20T18:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.084+0000 7f732effd640 1 -- 172.21.15.6:0/2014691114 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7320030a20 con 0x7f73380b1700 2024-05-20T18:01:10.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.084+0000 7f732effd640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f731806be30 0x7f731806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.084+0000 7f732effd640 1 -- 172.21.15.6:0/2014691114 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f73200ab7c0 con 0x7f73380b1700 2024-05-20T18:01:10.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.084+0000 7f733659c640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f731806be30 0x7f731806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.085+0000 7f733659c640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f731806be30 0x7f731806e340 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7330009560 tx=0x7f7330009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.089+0000 7f732effd640 1 -- 172.21.15.6:0/2014691114 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f733815ddc0 con 0x7f73380b1700 2024-05-20T18:01:10.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.273+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73380c7be0 con 0x7f73380b1700 2024-05-20T18:01:10.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.274+0000 7f732effd640 1 -- 172.21.15.6:0/2014691114 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) ==== 93+0+10 (secure 0 0 0) 0x7f7320079900 con 0x7f73380b1700 2024-05-20T18:01:10.272 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:01:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f731806be30 msgr2=0x7f731806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f731806be30 0x7f731806e340 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7330009560 tx=0x7f7330009190 comp rx=0 tx=0).stop 2024-05-20T18:01:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73380b1700 msgr2=0x7f73381f2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73380b1700 0x7f73381f2c40 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7320000c00 tx=0x7f73200046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 shutdown_connections 2024-05-20T18:01:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f731806be30 0x7f731806e340 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f733815d530 0x7f733815e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73380b1700 0x7f73381f2c40 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 --2- 172.21.15.6:0/2014691114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7338070850 0x7f73380c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 >> 172.21.15.6:0/2014691114 conn(0x7f73380d29d0 msgr2=0x7f73380b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 shutdown_connections 2024-05-20T18:01:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.276+0000 7f733cc73640 1 -- 172.21.15.6:0/2014691114 wait complete. 2024-05-20T18:01:10.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:01:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.405+0000 7fc766b96640 1 Processor -- start 2024-05-20T18:01:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.405+0000 7fc766b96640 1 -- start start 2024-05-20T18:01:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.406+0000 7fc766b96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7600cf250 0x7fc76015f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.406+0000 7fc766b96640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc7600b6680 0x7fc7600b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.406+0000 7fc766b96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc760163020 0x7fc760163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.406+0000 7fc766b96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc76015f9a0 con 0x7fc7600cf250 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.406+0000 7fc766b96640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc7600d0b10 con 0x7fc7600b6680 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.406+0000 7fc766b96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7600d27d0 con 0x7fc760163020 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.406+0000 7fc764932640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7600cf250 0x7fc76015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc764932640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7600cf250 0x7fc76015f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43800/0 (socket says 172.21.15.6:43800) 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc764932640 1 -- 172.21.15.6:0/2127518383 learned_addr learned my addr 172.21.15.6:0/2127518383 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc765133640 1 --2- 172.21.15.6:0/2127518383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc760163020 0x7fc760163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc757fff640 1 --2- 172.21.15.6:0/2127518383 >> v2:172.21.15.171:3300/0 conn(0x7fc7600b6680 0x7fc7600b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc764932640 1 -- 172.21.15.6:0/2127518383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc760163020 msgr2=0x7fc760163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc764932640 1 --2- 172.21.15.6:0/2127518383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc760163020 0x7fc760163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc764932640 1 -- 172.21.15.6:0/2127518383 >> v2:172.21.15.171:3300/0 conn(0x7fc7600b6680 msgr2=0x7fc7600b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc764932640 1 --2- 172.21.15.6:0/2127518383 >> v2:172.21.15.171:3300/0 conn(0x7fc7600b6680 0x7fc7600b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.407+0000 7fc764932640 1 -- 172.21.15.6:0/2127518383 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7600b6fd0 con 0x7fc7600cf250 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.408+0000 7fc764932640 1 --2- 172.21.15.6:0/2127518383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015f460 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fc7600d4bb0 tx=0x7fc75c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afd2c953b017c2e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.408+0000 7fc7577fe640 1 -- 172.21.15.6:0/2127518383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c037070 con 0x7fc7600cf250 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.408+0000 7fc7577fe640 1 -- 172.21.15.6:0/2127518383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc75c032440 con 0x7fc7600cf250 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.408+0000 7fc7577fe640 1 -- 172.21.15.6:0/2127518383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c032810 con 0x7fc7600cf250 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.408+0000 7fc766b96640 1 -- 172.21.15.6:0/2127518383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 msgr2=0x7fc76015f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.408+0000 7fc766b96640 1 --2- 172.21.15.6:0/2127518383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015f460 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fc7600d4bb0 tx=0x7fc75c02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.409+0000 7fc766b96640 1 -- 172.21.15.6:0/2127518383 shutdown_connections 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.409+0000 7fc766b96640 1 --2- 172.21.15.6:0/2127518383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc760163020 0x7fc760163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.409+0000 7fc766b96640 1 --2- 172.21.15.6:0/2127518383 >> v2:172.21.15.171:3300/0 conn(0x7fc7600b6680 0x7fc7600b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.409+0000 7fc766b96640 1 --2- 172.21.15.6:0/2127518383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015f460 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.409+0000 7fc766b96640 1 -- 172.21.15.6:0/2127518383 >> 172.21.15.6:0/2127518383 conn(0x7fc7600d1860 msgr2=0x7fc7600d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.409+0000 7fc766b96640 1 -- 172.21.15.6:0/2127518383 shutdown_connections 2024-05-20T18:01:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.409+0000 7fc766b96640 1 -- 172.21.15.6:0/2127518383 wait complete. 2024-05-20T18:01:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.410+0000 7fc766b96640 1 Processor -- start 2024-05-20T18:01:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.410+0000 7fc766b96640 1 -- start start 2024-05-20T18:01:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc766b96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7600b6680 0x7fc7600ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc766b96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc766b96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc760163020 0x7fc760161e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc766b96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7600d2a20 con 0x7fc7600cf250 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc766b96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7600d0830 con 0x7fc760163020 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc766b96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7600d2d00 con 0x7fc7600b6680 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc757fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc757fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43812/0 (socket says 172.21.15.6:43812) 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc757fff640 1 -- 172.21.15.6:0/4237702182 learned_addr learned my addr 172.21.15.6:0/4237702182 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc764932640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7600b6680 0x7fc7600ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc765133640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc760163020 0x7fc760161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc757fff640 1 -- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7600b6680 msgr2=0x7fc7600ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc757fff640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7600b6680 0x7fc7600ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc757fff640 1 -- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc760163020 msgr2=0x7fc760161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc757fff640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc760163020 0x7fc760161e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc757fff640 1 -- 172.21.15.6:0/4237702182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc760159990 con 0x7fc7600cf250 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.412+0000 7fc765133640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc760163020 0x7fc760161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.413+0000 7fc757fff640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015fb20 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fc75000d620 tx=0x7fc75000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.413+0000 7fc7557fa640 1 -- 172.21.15.6:0/4237702182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500125f0 con 0x7fc7600cf250 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.413+0000 7fc7557fa640 1 -- 172.21.15.6:0/4237702182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc750019070 con 0x7fc7600cf250 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.413+0000 7fc7557fa640 1 -- 172.21.15.6:0/4237702182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500129d0 con 0x7fc7600cf250 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.413+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc760160690 con 0x7fc7600cf250 2024-05-20T18:01:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.413+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc760160c50 con 0x7fc7600cf250 2024-05-20T18:01:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.414+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc760160400 con 0x7fc7600cf250 2024-05-20T18:01:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.415+0000 7fc7557fa640 1 -- 172.21.15.6:0/4237702182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc750012b70 con 0x7fc7600cf250 2024-05-20T18:01:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.415+0000 7fc7557fa640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc74c06be60 0x7fc74c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.415+0000 7fc7557fa640 1 -- 172.21.15.6:0/4237702182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fc75008b270 con 0x7fc7600cf250 2024-05-20T18:01:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.416+0000 7fc764932640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc74c06be60 0x7fc74c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.416+0000 7fc764932640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc74c06be60 0x7fc74c06e370 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc75c034000 tx=0x7fc75c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.420+0000 7fc7557fa640 1 -- 172.21.15.6:0/4237702182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc750059a90 con 0x7fc7600cf250 2024-05-20T18:01:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.603+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc760075b00 con 0x7fc7600cf250 2024-05-20T18:01:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.603+0000 7fc7557fa640 1 -- 172.21.15.6:0/4237702182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) ==== 104+0+11 (secure 0 0 0) 0x7fc750059390 con 0x7fc7600cf250 2024-05-20T18:01:10.602 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:01:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc74c06be60 msgr2=0x7fc74c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc74c06be60 0x7fc74c06e370 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc75c034000 tx=0x7fc75c02e000 comp rx=0 tx=0).stop 2024-05-20T18:01:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 msgr2=0x7fc76015fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015fb20 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fc75000d620 tx=0x7fc75000dae0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 shutdown_connections 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc74c06be60 0x7fc74c06e370 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc760163020 0x7fc760161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7600cf250 0x7fc76015fb20 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 --2- 172.21.15.6:0/4237702182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7600b6680 0x7fc7600ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 >> 172.21.15.6:0/4237702182 conn(0x7fc7600d1860 msgr2=0x7fc76015dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 shutdown_connections 2024-05-20T18:01:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.606+0000 7fc766b96640 1 -- 172.21.15.6:0/4237702182 wait complete. 2024-05-20T18:01:10.615 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:01:10.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.735+0000 7f8c6186c640 1 Processor -- start 2024-05-20T18:01:10.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.735+0000 7f8c6186c640 1 -- start start 2024-05-20T18:01:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c6186c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c5c162820 0x7f8c5c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c6186c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c0b3e80 0x7f8c5c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c6186c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c5c06dd20 con 0x7f8c5c06d910 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c6186c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5c0d0630 con 0x7f8c5c162820 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c6186c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5c0d39c0 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c5affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c5c162820 0x7f8c5c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c5affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c5c162820 0x7f8c5c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43816/0 (socket says 172.21.15.6:43816) 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c5affd640 1 -- 172.21.15.6:0/3927533278 learned_addr learned my addr 172.21.15.6:0/3927533278 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c5a7fc640 1 --2- 172.21.15.6:0/3927533278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c0b3e80 0x7f8c5c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c5affd640 1 -- 172.21.15.6:0/3927533278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c0b3e80 msgr2=0x7f8c5c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c5affd640 1 --2- 172.21.15.6:0/3927533278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c0b3e80 0x7f8c5c06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c5affd640 1 -- 172.21.15.6:0/3927533278 >> v1:172.21.15.171:6789/0 conn(0x7f8c5c06d910 legacy=0x7f8c5c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.737+0000 7f8c5affd640 1 -- 172.21.15.6:0/3927533278 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c0d3ca0 con 0x7f8c5c162820 2024-05-20T18:01:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.738+0000 7f8c5affd640 1 --2- 172.21.15.6:0/3927533278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c162820 0x7f8c5c0b3940 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009e50 tx=0x7f8c4c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23594840e7fd1db server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.738+0000 7f8c59ffb640 1 -- 172.21.15.6:0/3927533278 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c036070 con 0x7f8c5c162820 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.738+0000 7f8c59ffb640 1 -- 172.21.15.6:0/3927533278 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4c031600 con 0x7f8c5c162820 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.738+0000 7f8c59ffb640 1 -- 172.21.15.6:0/3927533278 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0319d0 con 0x7f8c5c162820 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.739+0000 7f8c6186c640 1 -- 172.21.15.6:0/3927533278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c162820 msgr2=0x7f8c5c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.739+0000 7f8c6186c640 1 --2- 172.21.15.6:0/3927533278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c162820 0x7f8c5c0b3940 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009e50 tx=0x7f8c4c02a6c0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.739+0000 7f8c6186c640 1 -- 172.21.15.6:0/3927533278 shutdown_connections 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.739+0000 7f8c6186c640 1 --2- 172.21.15.6:0/3927533278 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c0b3e80 0x7f8c5c06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.739+0000 7f8c6186c640 1 --2- 172.21.15.6:0/3927533278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c162820 0x7f8c5c0b3940 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.739+0000 7f8c6186c640 1 -- 172.21.15.6:0/3927533278 >> 172.21.15.6:0/3927533278 conn(0x7f8c5c0d4bd0 msgr2=0x7f8c5c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.739+0000 7f8c6186c640 1 -- 172.21.15.6:0/3927533278 shutdown_connections 2024-05-20T18:01:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.739+0000 7f8c6186c640 1 -- 172.21.15.6:0/3927533278 wait complete. 2024-05-20T18:01:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.741+0000 7f8c6186c640 1 Processor -- start 2024-05-20T18:01:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.741+0000 7f8c6186c640 1 -- start start 2024-05-20T18:01:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c6186c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c06d910 0x7f8c5c0ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c6186c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c0b3e80 0x7f8c5c148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c6186c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c162820 0x7f8c5c149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c6186c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c0d0300 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c6186c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c0d4260 con 0x7f8c5c162820 2024-05-20T18:01:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c6186c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5c0b91a0 con 0x7f8c5c06d910 2024-05-20T18:01:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c5a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c0b3e80 0x7f8c5c148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c5a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c0b3e80 0x7f8c5c148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43832/0 (socket says 172.21.15.6:43832) 2024-05-20T18:01:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.742+0000 7f8c5a7fc640 1 -- 172.21.15.6:0/2002493540 learned_addr learned my addr 172.21.15.6:0/2002493540 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c5affd640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c06d910 0x7f8c5c0ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c5b7fe640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c162820 0x7f8c5c149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c5a7fc640 1 -- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c06d910 msgr2=0x7f8c5c0ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c5a7fc640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c06d910 0x7f8c5c0ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c5a7fc640 1 -- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c162820 msgr2=0x7f8c5c149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c5a7fc640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c162820 0x7f8c5c149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c5a7fc640 1 -- 172.21.15.6:0/2002493540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c1470c0 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c5a7fc640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c0b3e80 0x7f8c5c148fd0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000c820 tx=0x7f8c5000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c43fff640 1 -- 172.21.15.6:0/2002493540 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50015070 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c43fff640 1 -- 172.21.15.6:0/2002493540 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c50004020 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c43fff640 1 -- 172.21.15.6:0/2002493540 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c500043f0 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5c1473a0 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.743+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c5c147960 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.744+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c5c075b00 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.745+0000 7f8c43fff640 1 -- 172.21.15.6:0/2002493540 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c50007830 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.745+0000 7f8c43fff640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c4806be30 0x7f8c4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.745+0000 7f8c43fff640 1 -- 172.21.15.6:0/2002493540 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f8c5008af10 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.746+0000 7f8c5affd640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c4806be30 0x7f8c4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.746+0000 7f8c5affd640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c4806be30 0x7f8c4806e340 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c033000 tx=0x7f8c4c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.750+0000 7f8c43fff640 1 -- 172.21.15.6:0/2002493540 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8c50059600 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.934+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8c5c0d51f0 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.934+0000 7f8c43fff640 1 -- 172.21.15.6:0/2002493540 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) ==== 100+0+11 (secure 0 0 0) 0x7f8c50058f00 con 0x7f8c5c0b3e80 2024-05-20T18:01:10.933 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:01:10.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c4806be30 msgr2=0x7f8c4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c4806be30 0x7f8c4806e340 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c033000 tx=0x7f8c4c009000 comp rx=0 tx=0).stop 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c0b3e80 msgr2=0x7f8c5c148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c0b3e80 0x7f8c5c148fd0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000c820 tx=0x7f8c5000cce0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 shutdown_connections 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c4806be30 0x7f8c4806e340 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c5c162820 0x7f8c5c149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c0b3e80 0x7f8c5c148fd0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 --2- 172.21.15.6:0/2002493540 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c5c06d910 0x7f8c5c0ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 >> 172.21.15.6:0/2002493540 conn(0x7f8c5c0d4bd0 msgr2=0x7f8c5c0b9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 shutdown_connections 2024-05-20T18:01:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:10.936+0000 7f8c6186c640 1 -- 172.21.15.6:0/2002493540 wait complete. 2024-05-20T18:01:10.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:01:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.063+0000 7f6e63baa640 1 Processor -- start 2024-05-20T18:01:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.063+0000 7f6e63baa640 1 -- start start 2024-05-20T18:01:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e63baa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e63baa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e5c0b8190 0x7f6e5c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e63baa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e5c06dd20 con 0x7f6e5c162820 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e63baa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6e5c0d0630 con 0x7f6e5c0b8190 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e63baa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c0d39c0 con 0x7f6e5c06d3d0 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e62147640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6e5c0b8190 0x7f6e5c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e61946640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6e5c162820 0x7f6e5c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59542/0 (socket says 172.21.15.6:59542) 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e61946640 1 -- 172.21.15.6:0/679548532 learned_addr learned my addr 172.21.15.6:0/679548532 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e61145640 1 --2- 172.21.15.6:0/679548532 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e62147640 1 -- 172.21.15.6:0/679548532 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 msgr2=0x7f6e5c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e62147640 1 --2- 172.21.15.6:0/679548532 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e62147640 1 -- 172.21.15.6:0/679548532 >> v1:172.21.15.6:6789/0 conn(0x7f6e5c162820 legacy=0x7f6e5c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e60944640 1 -- 172.21.15.6:0/679548532 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949087142 0 0) 0x7f6e58001110 con 0x7f6e5c162820 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e62147640 1 -- 172.21.15.6:0/679548532 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0d3ca0 con 0x7f6e5c0b8190 2024-05-20T18:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.065+0000 7f6e61145640 1 --2- 172.21.15.6:0/679548532 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.066+0000 7f6e62147640 1 --2- 172.21.15.6:0/679548532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0b8190 0x7f6e5c0b85a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009d90 tx=0x7f6e5402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e10c0efe3c81b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.066+0000 7f6e60944640 1 -- 172.21.15.6:0/679548532 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54007740 con 0x7f6e5c0b8190 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.066+0000 7f6e60944640 1 -- 172.21.15.6:0/679548532 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e540078e0 con 0x7f6e5c0b8190 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.066+0000 7f6e60944640 1 -- 172.21.15.6:0/679548532 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54007cb0 con 0x7f6e5c0b8190 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.067+0000 7f6e63baa640 1 -- 172.21.15.6:0/679548532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0b8190 msgr2=0x7f6e5c0b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.067+0000 7f6e63baa640 1 --2- 172.21.15.6:0/679548532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0b8190 0x7f6e5c0b85a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009d90 tx=0x7f6e5402a660 comp rx=0 tx=0).stop 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.067+0000 7f6e63baa640 1 -- 172.21.15.6:0/679548532 shutdown_connections 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.067+0000 7f6e63baa640 1 --2- 172.21.15.6:0/679548532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c0b8190 0x7f6e5c0b85a0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.067+0000 7f6e63baa640 1 --2- 172.21.15.6:0/679548532 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.067+0000 7f6e63baa640 1 -- 172.21.15.6:0/679548532 >> 172.21.15.6:0/679548532 conn(0x7f6e5c0d4bd0 msgr2=0x7f6e5c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.067+0000 7f6e63baa640 1 -- 172.21.15.6:0/679548532 shutdown_connections 2024-05-20T18:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.067+0000 7f6e63baa640 1 -- 172.21.15.6:0/679548532 wait complete. 2024-05-20T18:01:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.069+0000 7f6e63baa640 1 Processor -- start 2024-05-20T18:01:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.069+0000 7f6e63baa640 1 -- start start 2024-05-20T18:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e63baa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e63baa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c0b8190 0x7f6e5c0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e63baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c162820 0x7f6e5c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e63baa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0d0300 con 0x7f6e5c162820 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e63baa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c0d4260 con 0x7f6e5c0b8190 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e63baa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6e5c0b4050 con 0x7f6e5c06d3d0 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e62147640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c162820 0x7f6e5c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e62147640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c162820 0x7f6e5c0b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43850/0 (socket says 172.21.15.6:43850) 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e62147640 1 -- 172.21.15.6:0/1532050327 learned_addr learned my addr 172.21.15.6:0/1532050327 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e61946640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.070+0000 7f6e61145640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c0b8190 0x7f6e5c0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e62147640 1 -- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 msgr2=0x7f6e5c0ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e62147640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c0ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e62147640 1 -- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c0b8190 msgr2=0x7f6e5c0b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e62147640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c0b8190 0x7f6e5c0b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e62147640 1 -- 172.21.15.6:0/1532050327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c0c8700 con 0x7f6e5c162820 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e62147640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c162820 0x7f6e5c0b4e40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6e5402ac50 tx=0x7f6e54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e527fc640 1 -- 172.21.15.6:0/1532050327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5403f070 con 0x7f6e5c162820 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e527fc640 1 -- 172.21.15.6:0/1532050327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e54031bc0 con 0x7f6e5c162820 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c0b56b0 con 0x7f6e5c162820 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e527fc640 1 -- 172.21.15.6:0/1532050327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54044460 con 0x7f6e5c162820 2024-05-20T18:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.071+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c0b5c70 con 0x7f6e5c162820 2024-05-20T18:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.072+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c075b00 con 0x7f6e5c162820 2024-05-20T18:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.073+0000 7f6e527fc640 1 -- 172.21.15.6:0/1532050327 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e54007790 con 0x7f6e5c162820 2024-05-20T18:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.073+0000 7f6e527fc640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4006be60 0x7f6e4006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.073+0000 7f6e527fc640 1 -- 172.21.15.6:0/1532050327 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f6e540ac730 con 0x7f6e5c162820 2024-05-20T18:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.074+0000 7f6e61946640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4006be60 0x7f6e4006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.074+0000 7f6e61946640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4006be60 0x7f6e4006e370 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6e58007fd0 tx=0x7f6e58007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.078+0000 7f6e527fc640 1 -- 172.21.15.6:0/1532050327 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6e5407a870 con 0x7f6e5c162820 2024-05-20T18:01:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.276+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6e5c0b5400 con 0x7f6e5c162820 2024-05-20T18:01:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.276+0000 7f6e527fc640 1 -- 172.21.15.6:0/1532050327 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7f6e5407eb70 con 0x7f6e5c162820 2024-05-20T18:01:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4006be60 msgr2=0x7f6e4006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4006be60 0x7f6e4006e370 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6e58007fd0 tx=0x7f6e58007de0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c162820 msgr2=0x7f6e5c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c162820 0x7f6e5c0b4e40 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6e5402ac50 tx=0x7f6e54004a40 comp rx=0 tx=0).stop 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 shutdown_connections 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6e4006be60 0x7f6e4006e370 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e5c162820 0x7f6e5c0b4e40 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e5c0b8190 0x7f6e5c0b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 --2- 172.21.15.6:0/1532050327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6e5c06d3d0 0x7f6e5c0ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 >> 172.21.15.6:0/1532050327 conn(0x7f6e5c0d4bd0 msgr2=0x7f6e5c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 shutdown_connections 2024-05-20T18:01:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.278+0000 7f6e63baa640 1 -- 172.21.15.6:0/1532050327 wait complete. 2024-05-20T18:01:11.288 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T18:01:11.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:11.288 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T18:01:11.322 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:01:11.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:11.322 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T18:01:11.380 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:01:11.380 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:11.380 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:11.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:01:11.399 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:01:11.399 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:11.399 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:11.438 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:01:11.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:11.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.555+0000 7fed5650f640 1 Processor -- start 2024-05-20T18:01:11.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.555+0000 7fed5650f640 1 -- start start 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed5650f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed500b2f10 0x7fed500d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed5650f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed5006d290 0x7fed5006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed5650f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5015e6b0 con 0x7fed5015d940 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed5650f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fed500d2400 con 0x7fed500b2f10 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed5650f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fed500d1a30 con 0x7fed5006d290 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed4ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed500b2f10 0x7fed500d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed4ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed500b2f10 0x7fed500d1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43860/0 (socket says 172.21.15.6:43860) 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed4ffff640 1 -- 172.21.15.6:0/1552689683 learned_addr learned my addr 172.21.15.6:0/1552689683 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed54aac640 1 --1- 172.21.15.6:0/1552689683 >> v1:172.21.15.6:6789/0 conn(0x7fed5015d940 0x7fed5015dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59552/0 (socket says 172.21.15.6:59552) 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed47fff640 1 --2- 172.21.15.6:0/1552689683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed5006d290 0x7fed5006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed4ffff640 1 -- 172.21.15.6:0/1552689683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed5006d290 msgr2=0x7fed5006d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:11.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed4ffff640 1 --2- 172.21.15.6:0/1552689683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed5006d290 0x7fed5006d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed4ffff640 1 -- 172.21.15.6:0/1552689683 >> v1:172.21.15.6:6789/0 conn(0x7fed5015d940 legacy=0x7fed5015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed4ffff640 1 -- 172.21.15.6:0/1552689683 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed500d1100 con 0x7fed500b2f10 2024-05-20T18:01:11.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed4f7fe640 1 -- 172.21.15.6:0/1552689683 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341784177 0 0) 0x7fed5015e6b0 con 0x7fed5015d940 2024-05-20T18:01:11.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.557+0000 7fed47fff640 1 --2- 172.21.15.6:0/1552689683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed5006d290 0x7fed5006d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:11.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.558+0000 7fed4ffff640 1 --2- 172.21.15.6:0/1552689683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed500b2f10 0x7fed500d1ec0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed4002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507852bdd5207e10 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.558+0000 7fed4f7fe640 1 -- 172.21.15.6:0/1552689683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40037070 con 0x7fed500b2f10 2024-05-20T18:01:11.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.558+0000 7fed4f7fe640 1 -- 172.21.15.6:0/1552689683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40032440 con 0x7fed500b2f10 2024-05-20T18:01:11.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.558+0000 7fed4f7fe640 1 -- 172.21.15.6:0/1552689683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40032810 con 0x7fed500b2f10 2024-05-20T18:01:11.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.559+0000 7fed5650f640 1 -- 172.21.15.6:0/1552689683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed500b2f10 msgr2=0x7fed500d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.559+0000 7fed5650f640 1 --2- 172.21.15.6:0/1552689683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed500b2f10 0x7fed500d1ec0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fed40009870 tx=0x7fed4002a1c0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.559+0000 7fed5650f640 1 -- 172.21.15.6:0/1552689683 shutdown_connections 2024-05-20T18:01:11.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.559+0000 7fed5650f640 1 --2- 172.21.15.6:0/1552689683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed5006d290 0x7fed5006d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.559+0000 7fed5650f640 1 --2- 172.21.15.6:0/1552689683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed500b2f10 0x7fed500d1ec0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.559+0000 7fed5650f640 1 -- 172.21.15.6:0/1552689683 >> 172.21.15.6:0/1552689683 conn(0x7fed500b6670 msgr2=0x7fed500b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:11.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.559+0000 7fed5650f640 1 -- 172.21.15.6:0/1552689683 shutdown_connections 2024-05-20T18:01:11.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.559+0000 7fed5650f640 1 -- 172.21.15.6:0/1552689683 wait complete. 2024-05-20T18:01:11.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.561+0000 7fed5650f640 1 Processor -- start 2024-05-20T18:01:11.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.561+0000 7fed5650f640 1 -- start start 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed5650f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed5006d290 0x7fed501524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed5650f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed500b2f10 0x7fed501f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed5650f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5015d940 0x7fed50157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed5650f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fed5015e460 con 0x7fed5015d940 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed5650f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fed500b3320 con 0x7fed5006d290 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed5650f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fed500d16c0 con 0x7fed500b2f10 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed54aac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5015d940 0x7fed50157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed54aac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5015d940 0x7fed50157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43874/0 (socket says 172.21.15.6:43874) 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.562+0000 7fed54aac640 1 -- 172.21.15.6:0/1942940767 learned_addr learned my addr 172.21.15.6:0/1942940767 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:11.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed47fff640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed500b2f10 0x7fed501f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed4ffff640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed5006d290 0x7fed501524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed54aac640 1 -- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed500b2f10 msgr2=0x7fed501f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed54aac640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed500b2f10 0x7fed501f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed54aac640 1 -- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed5006d290 msgr2=0x7fed501524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed54aac640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed5006d290 0x7fed501524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed54aac640 1 -- 172.21.15.6:0/1942940767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed501f3b50 con 0x7fed5015d940 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed47fff640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed500b2f10 0x7fed501f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed54aac640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5015d940 0x7fed50157c00 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fed4800c780 tx=0x7fed4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed4d7fa640 1 -- 172.21.15.6:0/1942940767 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48018070 con 0x7fed5015d940 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed4d7fa640 1 -- 172.21.15.6:0/1942940767 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed48004d80 con 0x7fed5015d940 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed4d7fa640 1 -- 172.21.15.6:0/1942940767 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4800a880 con 0x7fed5015d940 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed501f3e30 con 0x7fed5015d940 2024-05-20T18:01:11.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.563+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5009deb0 con 0x7fed5015d940 2024-05-20T18:01:11.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.564+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed501f38c0 con 0x7fed5015d940 2024-05-20T18:01:11.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.565+0000 7fed4d7fa640 1 -- 172.21.15.6:0/1942940767 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed4800aa20 con 0x7fed5015d940 2024-05-20T18:01:11.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.565+0000 7fed4d7fa640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed3006be30 0x7fed3006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.566+0000 7fed4d7fa640 1 -- 172.21.15.6:0/1942940767 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fed4808a460 con 0x7fed5015d940 2024-05-20T18:01:11.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.566+0000 7fed4ffff640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed3006be30 0x7fed3006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.566+0000 7fed4ffff640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed3006be30 0x7fed3006e340 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fed40034000 tx=0x7fed4002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.570+0000 7fed4d7fa640 1 -- 172.21.15.6:0/1942940767 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fed48058d10 con 0x7fed5015d940 2024-05-20T18:01:11.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.794+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed50075b00 con 0x7fed5015d940 2024-05-20T18:01:11.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.795+0000 7fed4d7fa640 1 -- 172.21.15.6:0/1942940767 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5177 (secure 0 0 0) 0x7fed48058610 con 0x7fed5015d940 2024-05-20T18:01:11.793 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:11.793 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:01:04.959577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:01:11.794 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 76 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed3006be30 msgr2=0x7fed3006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed3006be30 0x7fed3006e340 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fed40034000 tx=0x7fed4002e000 comp rx=0 tx=0).stop 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5015d940 msgr2=0x7fed50157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5015d940 0x7fed50157c00 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fed4800c780 tx=0x7fed4800cc40 comp rx=0 tx=0).stop 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 shutdown_connections 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fed3006be30 0x7fed3006e340 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5015d940 0x7fed50157c00 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed500b2f10 0x7fed501f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 --2- 172.21.15.6:0/1942940767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fed5006d290 0x7fed501524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 >> 172.21.15.6:0/1942940767 conn(0x7fed500b6670 msgr2=0x7fed5006f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 shutdown_connections 2024-05-20T18:01:11.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.797+0000 7fed5650f640 1 -- 172.21.15.6:0/1942940767 wait complete. 2024-05-20T18:01:11.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.924+0000 7fc5ffe0d640 1 Processor -- start 2024-05-20T18:01:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.924+0000 7fc5ffe0d640 1 -- start start 2024-05-20T18:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.925+0000 7fc5ffe0d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc5f815d530 0x7fc5f815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.925+0000 7fc5ffe0d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5f80b1700 0x7fc5f80b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.925+0000 7fc5ffe0d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f8070850 0x7fc5f8070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.925+0000 7fc5ffe0d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f80ce190 con 0x7fc5f80b1700 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.925+0000 7fc5ffe0d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f80cd580 con 0x7fc5f815d530 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.925+0000 7fc5ffe0d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f80cd860 con 0x7fc5f8070850 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fd3a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5f80b1700 0x7fc5f80b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fd3a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5f80b1700 0x7fc5f80b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43884/0 (socket says 172.21.15.6:43884) 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fd3a8640 1 -- 172.21.15.6:0/4253317750 learned_addr learned my addr 172.21.15.6:0/4253317750 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fdba9640 1 --2- 172.21.15.6:0/4253317750 >> v2:172.21.15.171:3300/0 conn(0x7fc5f815d530 0x7fc5f815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fe3aa640 1 --2- 172.21.15.6:0/4253317750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f8070850 0x7fc5f8070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fd3a8640 1 -- 172.21.15.6:0/4253317750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f8070850 msgr2=0x7fc5f8070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fd3a8640 1 --2- 172.21.15.6:0/4253317750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f8070850 0x7fc5f8070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fd3a8640 1 -- 172.21.15.6:0/4253317750 >> v2:172.21.15.171:3300/0 conn(0x7fc5f815d530 msgr2=0x7fc5f815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fd3a8640 1 --2- 172.21.15.6:0/4253317750 >> v2:172.21.15.171:3300/0 conn(0x7fc5f815d530 0x7fc5f815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.926+0000 7fc5fd3a8640 1 -- 172.21.15.6:0/4253317750 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80cdb40 con 0x7fc5f80b1700 2024-05-20T18:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.927+0000 7fc5fd3a8640 1 --2- 172.21.15.6:0/4253317750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f80b1b10 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc5f804f790 tx=0x7fc5e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4230b8c210a405d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.927+0000 7fc5fcba7640 1 -- 172.21.15.6:0/4253317750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8037070 con 0x7fc5f80b1700 2024-05-20T18:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.927+0000 7fc5fcba7640 1 -- 172.21.15.6:0/4253317750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8032440 con 0x7fc5f80b1700 2024-05-20T18:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.927+0000 7fc5fcba7640 1 -- 172.21.15.6:0/4253317750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8032810 con 0x7fc5f80b1700 2024-05-20T18:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.927+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/4253317750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 msgr2=0x7fc5f80b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.927+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/4253317750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f80b1b10 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc5f804f790 tx=0x7fc5e802a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.928+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/4253317750 shutdown_connections 2024-05-20T18:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.928+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/4253317750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f8070850 0x7fc5f8070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.928+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/4253317750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f80b1b10 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.928+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/4253317750 >> v2:172.21.15.171:3300/0 conn(0x7fc5f815d530 0x7fc5f815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.928+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/4253317750 >> 172.21.15.6:0/4253317750 conn(0x7fc5f80d29d0 msgr2=0x7fc5f80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.928+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/4253317750 shutdown_connections 2024-05-20T18:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.928+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/4253317750 wait complete. 2024-05-20T18:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.929+0000 7fc5ffe0d640 1 Processor -- start 2024-05-20T18:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.929+0000 7fc5ffe0d640 1 -- start start 2024-05-20T18:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5ffe0d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5f8070850 0x7fc5f81585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5ffe0d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f8145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5ffe0d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f815d530 0x7fc5f80d1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5ffe0d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80b2050 con 0x7fc5f80b1700 2024-05-20T18:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5ffe0d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f80cd230 con 0x7fc5f8070850 2024-05-20T18:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5ffe0d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f80711a0 con 0x7fc5f815d530 2024-05-20T18:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f8145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f8145ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43890/0 (socket says 172.21.15.6:43890) 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 -- 172.21.15.6:0/1807668434 learned_addr learned my addr 172.21.15.6:0/1807668434 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fdba9640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5f8070850 0x7fc5f81585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fe3aa640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f815d530 0x7fc5f80d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 -- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f815d530 msgr2=0x7fc5f80d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f815d530 0x7fc5f80d1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 -- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5f8070850 msgr2=0x7fc5f81585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5f8070850 0x7fc5f81585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 -- 172.21.15.6:0/1807668434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f80b6d40 con 0x7fc5f80b1700 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.931+0000 7fc5fd3a8640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f8145ee0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc5e802a220 tx=0x7fc5e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.932+0000 7fc5ee7fc640 1 -- 172.21.15.6:0/1807668434 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8041020 con 0x7fc5f80b1700 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.932+0000 7fc5ee7fc640 1 -- 172.21.15.6:0/1807668434 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e803d620 con 0x7fc5f80b1700 2024-05-20T18:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.932+0000 7fc5ee7fc640 1 -- 172.21.15.6:0/1807668434 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8037040 con 0x7fc5f80b1700 2024-05-20T18:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.932+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f80b6fe0 con 0x7fc5f80b1700 2024-05-20T18:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.932+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f80b75a0 con 0x7fc5f80b1700 2024-05-20T18:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.933+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f8075b00 con 0x7fc5f80b1700 2024-05-20T18:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.933+0000 7fc5ee7fc640 1 -- 172.21.15.6:0/1807668434 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5e8044020 con 0x7fc5f80b1700 2024-05-20T18:01:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.934+0000 7fc5ee7fc640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5dc06be30 0x7fc5dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.934+0000 7fc5ee7fc640 1 -- 172.21.15.6:0/1807668434 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fc5e80ab560 con 0x7fc5f80b1700 2024-05-20T18:01:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.934+0000 7fc5fdba9640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5dc06be30 0x7fc5dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.934+0000 7fc5fdba9640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5dc06be30 0x7fc5dc06e340 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80d29a0 tx=0x7fc5f4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:11.938+0000 7fc5ee7fc640 1 -- 172.21.15.6:0/1807668434 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc5e804b030 con 0x7fc5f80b1700 2024-05-20T18:01:12.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.122+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5f8158b20 con 0x7fc5f80b1700 2024-05-20T18:01:12.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.124+0000 7fc5ee7fc640 1 -- 172.21.15.6:0/1807668434 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16904 (secure 0 0 0) 0x7fc5e8079730 con 0x7fc5f80b1700 2024-05-20T18:01:12.122 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:12.122 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":113,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:45.915316+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:42.005763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:43.283834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:12.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5dc06be30 msgr2=0x7fc5dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5dc06be30 0x7fc5dc06e340 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80d29a0 tx=0x7fc5f4009190 comp rx=0 tx=0).stop 2024-05-20T18:01:12.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 msgr2=0x7fc5f8145ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f8145ee0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc5e802a220 tx=0x7fc5e80046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 shutdown_connections 2024-05-20T18:01:12.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc5dc06be30 0x7fc5dc06e340 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5f815d530 0x7fc5f80d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5f80b1700 0x7fc5f8145ee0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 --2- 172.21.15.6:0/1807668434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5f8070850 0x7fc5f81585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 >> 172.21.15.6:0/1807668434 conn(0x7fc5f80d29d0 msgr2=0x7fc5f80c5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 shutdown_connections 2024-05-20T18:01:12.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.126+0000 7fc5ffe0d640 1 -- 172.21.15.6:0/1807668434 wait complete. 2024-05-20T18:01:12.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:00:42.005763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:00:43.283834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:01:12.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:01:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.255+0000 7f3983902640 1 Processor -- start 2024-05-20T18:01:12.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.256+0000 7f3983902640 1 -- start start 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.257+0000 7f3983902640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c15f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.257+0000 7f3983902640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c06d0f0 con 0x7f397c0cfae0 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.257+0000 7f3983902640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c06d3d0 con 0x7f397c06c6c0 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.257+0000 7f3983902640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f397c0cda90 con 0x7f397c0cd680 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.257+0000 7f3981e9f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f397c0cfae0 0x7f397c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59564/0 (socket says 172.21.15.6:59564) 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.257+0000 7f3981e9f640 1 -- 172.21.15.6:0/41615334 learned_addr learned my addr 172.21.15.6:0/41615334 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.257+0000 7f398169e640 1 --2- 172.21.15.6:0/41615334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c15f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.257+0000 7f397bfff640 1 -- 172.21.15.6:0/41615334 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972622843 0 0) 0x7f397c06d0f0 con 0x7f397c0cfae0 2024-05-20T18:01:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.258+0000 7f397bfff640 1 -- 172.21.15.6:0/41615334 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3964003520 con 0x7f397c0cfae0 2024-05-20T18:01:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.258+0000 7f397bfff640 1 -- 172.21.15.6:0/41615334 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494759601 0 0) 0x7f397c06d3d0 con 0x7f397c06c6c0 2024-05-20T18:01:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.258+0000 7f397bfff640 1 -- 172.21.15.6:0/41615334 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f397c06d0f0 con 0x7f397c06c6c0 2024-05-20T18:01:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.258+0000 7f398169e640 1 -- 172.21.15.6:0/41615334 >> v1:172.21.15.171:6789/0 conn(0x7f397c06c6c0 legacy=0x7f397c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.258+0000 7f398169e640 1 -- 172.21.15.6:0/41615334 >> v1:172.21.15.6:6789/0 conn(0x7f397c0cfae0 legacy=0x7f397c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.258+0000 7f397bfff640 1 -- 172.21.15.6:0/41615334 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2994707157 0 0) 0x7f3964003520 con 0x7f397c0cfae0 2024-05-20T18:01:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.258+0000 7f398169e640 1 -- 172.21.15.6:0/41615334 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c06d6b0 con 0x7f397c0cd680 2024-05-20T18:01:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.259+0000 7f398169e640 1 --2- 172.21.15.6:0/41615334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c15f220 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f396c0097d0 tx=0x7f396c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=228b0993a217e5de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.259+0000 7f397bfff640 1 -- 172.21.15.6:0/41615334 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c037070 con 0x7f397c0cd680 2024-05-20T18:01:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.259+0000 7f397bfff640 1 -- 172.21.15.6:0/41615334 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c02ab90 con 0x7f397c0cd680 2024-05-20T18:01:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.259+0000 7f397bfff640 1 -- 172.21.15.6:0/41615334 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39740019f0 con 0x7f397c0cd680 2024-05-20T18:01:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.260+0000 7f3983902640 1 -- 172.21.15.6:0/41615334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 msgr2=0x7f397c15f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.260+0000 7f3983902640 1 --2- 172.21.15.6:0/41615334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c15f220 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f396c0097d0 tx=0x7f396c02a100 comp rx=0 tx=0).stop 2024-05-20T18:01:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.260+0000 7f3983902640 1 -- 172.21.15.6:0/41615334 shutdown_connections 2024-05-20T18:01:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.260+0000 7f3983902640 1 --2- 172.21.15.6:0/41615334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c15f220 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.260+0000 7f3983902640 1 -- 172.21.15.6:0/41615334 >> 172.21.15.6:0/41615334 conn(0x7f397c0b44d0 msgr2=0x7f397c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.260+0000 7f3983902640 1 -- 172.21.15.6:0/41615334 shutdown_connections 2024-05-20T18:01:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.260+0000 7f3983902640 1 -- 172.21.15.6:0/41615334 wait complete. 2024-05-20T18:01:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.261+0000 7f3983902640 1 Processor -- start 2024-05-20T18:01:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.262+0000 7f3983902640 1 -- start start 2024-05-20T18:01:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f3983902640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f397c06c6c0 0x7f397c0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f3983902640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f3983902640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f397c0c9f80 0x7f397c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f3983902640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f397c0d2460 con 0x7f397c06c6c0 2024-05-20T18:01:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f3983902640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f397c06d990 con 0x7f397c0c9f80 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f3983902640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f397c0d25e0 con 0x7f397c0cd680 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f398169e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f397c06c6c0 0x7f397c0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f398169e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f397c06c6c0 0x7f397c0c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43898/0 (socket says 172.21.15.6:43898) 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f398169e640 1 -- 172.21.15.6:0/2313478363 learned_addr learned my addr 172.21.15.6:0/2313478363 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f3981e9f640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f397c0c9f80 0x7f397c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f3980e9d640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f398169e640 1 -- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 msgr2=0x7f397c0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f398169e640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f398169e640 1 -- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f397c0c9f80 msgr2=0x7f397c0b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f398169e640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f397c0c9f80 0x7f397c0b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.263+0000 7f398169e640 1 -- 172.21.15.6:0/2313478363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c160720 con 0x7f397c06c6c0 2024-05-20T18:01:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.264+0000 7f398169e640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f397c06c6c0 0x7f397c0c8420 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f396c0097d0 tx=0x7f396c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.264+0000 7f3979ffb640 1 -- 172.21.15.6:0/2313478363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c041020 con 0x7f397c06c6c0 2024-05-20T18:01:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.264+0000 7f3979ffb640 1 -- 172.21.15.6:0/2313478363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c03d640 con 0x7f397c06c6c0 2024-05-20T18:01:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.264+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c0ca7e0 con 0x7f397c06c6c0 2024-05-20T18:01:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.264+0000 7f3979ffb640 1 -- 172.21.15.6:0/2313478363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c037040 con 0x7f397c06c6c0 2024-05-20T18:01:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.264+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c15fc40 con 0x7f397c06c6c0 2024-05-20T18:01:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.265+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397c075b00 con 0x7f397c06c6c0 2024-05-20T18:01:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.266+0000 7f3979ffb640 1 -- 172.21.15.6:0/2313478363 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f396c044020 con 0x7f397c06c6c0 2024-05-20T18:01:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.266+0000 7f3979ffb640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396806be30 0x7f396806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.266+0000 7f3979ffb640 1 -- 172.21.15.6:0/2313478363 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f396c0ab180 con 0x7f397c06c6c0 2024-05-20T18:01:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.266+0000 7f3980e9d640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396806be30 0x7f396806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.267+0000 7f3980e9d640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396806be30 0x7f396806e340 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f397c163ee0 tx=0x7f3970009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.271+0000 7f3979ffb640 1 -- 172.21.15.6:0/2313478363 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f396c04b070 con 0x7f397c06c6c0 2024-05-20T18:01:12.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.454+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f397c0b8940 con 0x7f397c06c6c0 2024-05-20T18:01:12.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.455+0000 7f3979ffb640 1 -- 172.21.15.6:0/2313478363 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) ==== 93+0+10 (secure 0 0 0) 0x7f396c079350 con 0x7f397c06c6c0 2024-05-20T18:01:12.453 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:01:12.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396806be30 msgr2=0x7f396806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396806be30 0x7f396806e340 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f397c163ee0 tx=0x7f3970009040 comp rx=0 tx=0).stop 2024-05-20T18:01:12.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f397c06c6c0 msgr2=0x7f397c0c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f397c06c6c0 0x7f397c0c8420 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f396c0097d0 tx=0x7f396c0046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 shutdown_connections 2024-05-20T18:01:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f396806be30 0x7f396806e340 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f397c0c9f80 0x7f397c0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f397c0cd680 0x7f397c0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 --2- 172.21.15.6:0/2313478363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f397c06c6c0 0x7f397c0c8420 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 >> 172.21.15.6:0/2313478363 conn(0x7f397c0b44d0 msgr2=0x7f397c0cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 shutdown_connections 2024-05-20T18:01:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.457+0000 7f3983902640 1 -- 172.21.15.6:0/2313478363 wait complete. 2024-05-20T18:01:12.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:01:12.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.587+0000 7f115feca640 1 Processor -- start 2024-05-20T18:01:12.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.587+0000 7f115feca640 1 -- start start 2024-05-20T18:01:12.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115feca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1158163a10 0x7f11580d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115feca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 0x7f11580cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115feca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f11580d14b0 0x7f11580d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115feca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f11580d3ca0 con 0x7f1158163a10 2024-05-20T18:01:12.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115feca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f11580d0370 con 0x7f11580d14b0 2024-05-20T18:01:12.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115feca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f11580d0650 con 0x7f11580b4010 2024-05-20T18:01:12.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115dc66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1158163a10 0x7f11580d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115dc66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1158163a10 0x7f11580d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43912/0 (socket says 172.21.15.6:43912) 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.588+0000 7f115dc66640 1 -- 172.21.15.6:0/2340228885 learned_addr learned my addr 172.21.15.6:0/2340228885 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.589+0000 7f115e467640 1 --2- 172.21.15.6:0/2340228885 >> v2:172.21.15.171:3300/0 conn(0x7f11580d14b0 0x7f11580d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.589+0000 7f115d465640 1 --2- 172.21.15.6:0/2340228885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 0x7f11580cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.589+0000 7f115dc66640 1 -- 172.21.15.6:0/2340228885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 msgr2=0x7f11580cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.589+0000 7f115dc66640 1 --2- 172.21.15.6:0/2340228885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 0x7f11580cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.589+0000 7f115dc66640 1 -- 172.21.15.6:0/2340228885 >> v2:172.21.15.171:3300/0 conn(0x7f11580d14b0 msgr2=0x7f11580d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.589+0000 7f115dc66640 1 --2- 172.21.15.6:0/2340228885 >> v2:172.21.15.171:3300/0 conn(0x7f11580d14b0 0x7f11580d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.589+0000 7f115dc66640 1 -- 172.21.15.6:0/2340228885 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11580d3650 con 0x7f1158163a10 2024-05-20T18:01:12.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.589+0000 7f115dc66640 1 --2- 172.21.15.6:0/2340228885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11580d4130 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f115808dea0 tx=0x7f115402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d19d0d47f6ac1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115cc64640 1 -- 172.21.15.6:0/2340228885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154036070 con 0x7f1158163a10 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115cc64640 1 -- 172.21.15.6:0/2340228885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1154031600 con 0x7f1158163a10 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115cc64640 1 -- 172.21.15.6:0/2340228885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11540319d0 con 0x7f1158163a10 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 -- 172.21.15.6:0/2340228885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 msgr2=0x7f11580d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 --2- 172.21.15.6:0/2340228885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11580d4130 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f115808dea0 tx=0x7f115402a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 -- 172.21.15.6:0/2340228885 shutdown_connections 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 --2- 172.21.15.6:0/2340228885 >> v2:172.21.15.171:3300/0 conn(0x7f11580d14b0 0x7f11580d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 --2- 172.21.15.6:0/2340228885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 0x7f11580cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 --2- 172.21.15.6:0/2340228885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11580d4130 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 -- 172.21.15.6:0/2340228885 >> 172.21.15.6:0/2340228885 conn(0x7f115806d240 msgr2=0x7f115806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 -- 172.21.15.6:0/2340228885 shutdown_connections 2024-05-20T18:01:12.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.590+0000 7f115feca640 1 -- 172.21.15.6:0/2340228885 wait complete. 2024-05-20T18:01:12.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.592+0000 7f115feca640 1 Processor -- start 2024-05-20T18:01:12.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.592+0000 7f115feca640 1 -- start start 2024-05-20T18:01:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115feca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 0x7f11580cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115feca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11580d14b0 0x7f11580b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115feca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11581f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115feca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f11580d1e00 con 0x7f1158163a10 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115feca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f11580d0040 con 0x7f11580d14b0 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115feca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f11580b8210 con 0x7f11580b4010 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11581f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11581f8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43926/0 (socket says 172.21.15.6:43926) 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 -- 172.21.15.6:0/2468183955 learned_addr learned my addr 172.21.15.6:0/2468183955 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115d465640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11580d14b0 0x7f11580b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115dc66640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 0x7f11580cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 -- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 msgr2=0x7f11580cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 0x7f11580cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 -- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11580d14b0 msgr2=0x7f11580b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11580d14b0 0x7f11580b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 -- 172.21.15.6:0/2468183955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11580ce040 con 0x7f1158163a10 2024-05-20T18:01:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f115e467640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11581f8a10 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f115000d4e0 tx=0x7f115000d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f114e7fc640 1 -- 172.21.15.6:0/2468183955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11500125f0 con 0x7f1158163a10 2024-05-20T18:01:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.594+0000 7f114e7fc640 1 -- 172.21.15.6:0/2468183955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1150019070 con 0x7f1158163a10 2024-05-20T18:01:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.595+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1158156320 con 0x7f1158163a10 2024-05-20T18:01:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.595+0000 7f114e7fc640 1 -- 172.21.15.6:0/2468183955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11500129d0 con 0x7f1158163a10 2024-05-20T18:01:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.595+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11580b4b50 con 0x7f1158163a10 2024-05-20T18:01:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.596+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1158156090 con 0x7f1158163a10 2024-05-20T18:01:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.596+0000 7f114e7fc640 1 -- 172.21.15.6:0/2468183955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1150012b70 con 0x7f1158163a10 2024-05-20T18:01:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.597+0000 7f114e7fc640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113c06be30 0x7f113c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.597+0000 7f114e7fc640 1 -- 172.21.15.6:0/2468183955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f115008b220 con 0x7f1158163a10 2024-05-20T18:01:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.597+0000 7f115dc66640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113c06be30 0x7f113c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.597+0000 7f115dc66640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113c06be30 0x7f113c06e340 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1154033000 tx=0x7f1154009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.601+0000 7f114e7fc640 1 -- 172.21.15.6:0/2468183955 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1150059350 con 0x7f1158163a10 2024-05-20T18:01:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.783+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1158075b00 con 0x7f1158163a10 2024-05-20T18:01:12.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.784+0000 7f114e7fc640 1 -- 172.21.15.6:0/2468183955 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) ==== 104+0+11 (secure 0 0 0) 0x7f115005d650 con 0x7f1158163a10 2024-05-20T18:01:12.782 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:01:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113c06be30 msgr2=0x7f113c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113c06be30 0x7f113c06e340 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1154033000 tx=0x7f1154009000 comp rx=0 tx=0).stop 2024-05-20T18:01:12.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 msgr2=0x7f11581f8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11581f8a10 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f115000d4e0 tx=0x7f115000d9a0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 shutdown_connections 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f113c06be30 0x7f113c06e340 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1158163a10 0x7f11581f8a10 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11580d14b0 0x7f11580b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 --2- 172.21.15.6:0/2468183955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11580b4010 0x7f11580cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 >> 172.21.15.6:0/2468183955 conn(0x7f115806d240 msgr2=0x7f11581611f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 shutdown_connections 2024-05-20T18:01:12.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.786+0000 7f115feca640 1 -- 172.21.15.6:0/2468183955 wait complete. 2024-05-20T18:01:12.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:01:12.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.916+0000 7fe6def77640 1 Processor -- start 2024-05-20T18:01:12.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.916+0000 7fe6def77640 1 -- start start 2024-05-20T18:01:12.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.917+0000 7fe6def77640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6d8162820 0x7fe6d80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.917+0000 7fe6def77640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe6d806dae0 0x7fe6d80b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.917+0000 7fe6def77640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d80d0630 con 0x7fe6d80b3e80 2024-05-20T18:01:12.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.917+0000 7fe6def77640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe6d80d39c0 con 0x7fe6d8162820 2024-05-20T18:01:12.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.917+0000 7fe6def77640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe6d80d3ca0 con 0x7fe6d806dae0 2024-05-20T18:01:12.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.917+0000 7fe6dcd13640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6d8162820 0x7fe6d80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.917+0000 7fe6d7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe6d80b3e80 0x7fe6d806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59580/0 (socket says 172.21.15.6:59580) 2024-05-20T18:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.917+0000 7fe6d7fff640 1 -- 172.21.15.6:0/1551464467 learned_addr learned my addr 172.21.15.6:0/1551464467 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.918+0000 7fe6dd514640 1 --2- 172.21.15.6:0/1551464467 >> v2:172.21.15.171:3300/0 conn(0x7fe6d806dae0 0x7fe6d80b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.918+0000 7fe6dcd13640 1 -- 172.21.15.6:0/1551464467 >> v2:172.21.15.171:3300/0 conn(0x7fe6d806dae0 msgr2=0x7fe6d80b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.918+0000 7fe6dcd13640 1 --2- 172.21.15.6:0/1551464467 >> v2:172.21.15.171:3300/0 conn(0x7fe6d806dae0 0x7fe6d80b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.918+0000 7fe6dcd13640 1 -- 172.21.15.6:0/1551464467 >> v1:172.21.15.6:6789/0 conn(0x7fe6d80b3e80 legacy=0x7fe6d806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.918+0000 7fe6d77fe640 1 -- 172.21.15.6:0/1551464467 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 468990514 0 0) 0x7fe6d80d0630 con 0x7fe6d80b3e80 2024-05-20T18:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.918+0000 7fe6dcd13640 1 -- 172.21.15.6:0/1551464467 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d80d3f80 con 0x7fe6d8162820 2024-05-20T18:01:12.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.918+0000 7fe6dcd13640 1 --2- 172.21.15.6:0/1551464467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8162820 0x7fe6d80b3940 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe6d808e070 tx=0x7fe6c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40324c17cb7b4dbd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6d77fe640 1 -- 172.21.15.6:0/1551464467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0037070 con 0x7fe6d8162820 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6d77fe640 1 -- 172.21.15.6:0/1551464467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c0032440 con 0x7fe6d8162820 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6d77fe640 1 -- 172.21.15.6:0/1551464467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0032810 con 0x7fe6d8162820 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6def77640 1 -- 172.21.15.6:0/1551464467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8162820 msgr2=0x7fe6d80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6def77640 1 --2- 172.21.15.6:0/1551464467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8162820 0x7fe6d80b3940 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe6d808e070 tx=0x7fe6c002a1a0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6def77640 1 -- 172.21.15.6:0/1551464467 shutdown_connections 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6def77640 1 --2- 172.21.15.6:0/1551464467 >> v2:172.21.15.171:3300/0 conn(0x7fe6d806dae0 0x7fe6d80b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6def77640 1 --2- 172.21.15.6:0/1551464467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8162820 0x7fe6d80b3940 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6def77640 1 -- 172.21.15.6:0/1551464467 >> 172.21.15.6:0/1551464467 conn(0x7fe6d80d4bd0 msgr2=0x7fe6d80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6def77640 1 -- 172.21.15.6:0/1551464467 shutdown_connections 2024-05-20T18:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.919+0000 7fe6def77640 1 -- 172.21.15.6:0/1551464467 wait complete. 2024-05-20T18:01:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.921+0000 7fe6def77640 1 Processor -- start 2024-05-20T18:01:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.921+0000 7fe6def77640 1 -- start start 2024-05-20T18:01:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6def77640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6d80b3e80 0x7fe6d80b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6def77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6d8162820 0x7fe6d80b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6def77640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8158410 0x7fe6d8158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6def77640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d80d4780 con 0x7fe6d8158410 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6def77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d80d0300 con 0x7fe6d8162820 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6def77640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d80d4900 con 0x7fe6d80b3e80 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dd514640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8158410 0x7fe6d8158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dd514640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8158410 0x7fe6d8158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43952/0 (socket says 172.21.15.6:43952) 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dd514640 1 -- 172.21.15.6:0/2565952052 learned_addr learned my addr 172.21.15.6:0/2565952052 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6d7fff640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6d8162820 0x7fe6d80b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dcd13640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6d80b3e80 0x7fe6d80b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dd514640 1 -- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6d80b3e80 msgr2=0x7fe6d80b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dd514640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6d80b3e80 0x7fe6d80b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dd514640 1 -- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6d8162820 msgr2=0x7fe6d80b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dd514640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6d8162820 0x7fe6d80b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.923+0000 7fe6dd514640 1 -- 172.21.15.6:0/2565952052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d81592c0 con 0x7fe6d8158410 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.924+0000 7fe6dd514640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8158410 0x7fe6d8158820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000d5d0 tx=0x7fe6d000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.924+0000 7fe6d57fa640 1 -- 172.21.15.6:0/2565952052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00125f0 con 0x7fe6d8158410 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.924+0000 7fe6d57fa640 1 -- 172.21.15.6:0/2565952052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d0019070 con 0x7fe6d8158410 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.924+0000 7fe6d57fa640 1 -- 172.21.15.6:0/2565952052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00129f0 con 0x7fe6d8158410 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.924+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d81595a0 con 0x7fe6d8158410 2024-05-20T18:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.924+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d80b4740 con 0x7fe6d8158410 2024-05-20T18:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.925+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d8068ad0 con 0x7fe6d8158410 2024-05-20T18:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.926+0000 7fe6d57fa640 1 -- 172.21.15.6:0/2565952052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6d0012b90 con 0x7fe6d8158410 2024-05-20T18:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.926+0000 7fe6d57fa640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6b806be30 0x7fe6b806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.926+0000 7fe6d57fa640 1 -- 172.21.15.6:0/2565952052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fe6d008b260 con 0x7fe6d8158410 2024-05-20T18:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.926+0000 7fe6dcd13640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6b806be30 0x7fe6b806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.927+0000 7fe6dcd13640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6b806be30 0x7fe6b806e340 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0034000 tx=0x7fe6c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:12.931+0000 7fe6d57fa640 1 -- 172.21.15.6:0/2565952052 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe6d8068ad0 con 0x7fe6d8158410 2024-05-20T18:01:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.114+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe6d80b3c70 con 0x7fe6d8158410 2024-05-20T18:01:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.114+0000 7fe6d57fa640 1 -- 172.21.15.6:0/2565952052 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) ==== 100+0+11 (secure 0 0 0) 0x7fe6d80b3c70 con 0x7fe6d8158410 2024-05-20T18:01:13.113 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:01:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6b806be30 msgr2=0x7fe6b806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6b806be30 0x7fe6b806e340 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0034000 tx=0x7fe6c002e000 comp rx=0 tx=0).stop 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8158410 msgr2=0x7fe6d8158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8158410 0x7fe6d8158820 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000d5d0 tx=0x7fe6d000da90 comp rx=0 tx=0).stop 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 shutdown_connections 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe6b806be30 0x7fe6b806e340 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6d8158410 0x7fe6d8158820 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6d8162820 0x7fe6d80b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.116+0000 7fe6def77640 1 --2- 172.21.15.6:0/2565952052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6d80b3e80 0x7fe6d80b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.117+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 >> 172.21.15.6:0/2565952052 conn(0x7fe6d80d4bd0 msgr2=0x7fe6d815e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.117+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 shutdown_connections 2024-05-20T18:01:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.117+0000 7fe6def77640 1 -- 172.21.15.6:0/2565952052 wait complete. 2024-05-20T18:01:13.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.243+0000 7f8514738640 1 Processor -- start 2024-05-20T18:01:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.243+0000 7f8514738640 1 -- start start 2024-05-20T18:01:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8514738640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f850c163a10 0x7f850c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8514738640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0b4010 0x7f850c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8514738640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f850c0d14b0 0x7f850c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8514738640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f850c0d3ca0 con 0x7f850c0d14b0 2024-05-20T18:01:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8514738640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f850c0d0370 con 0x7f850c163a10 2024-05-20T18:01:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8514738640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f850c0d0650 con 0x7f850c0b4010 2024-05-20T18:01:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8512cd5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f850c0d14b0 0x7f850c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8512cd5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f850c0d14b0 0x7f850c0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43968/0 (socket says 172.21.15.6:43968) 2024-05-20T18:01:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.244+0000 7f8512cd5640 1 -- 172.21.15.6:0/679149808 learned_addr learned my addr 172.21.15.6:0/679149808 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.245+0000 7f8511cd3640 1 --2- 172.21.15.6:0/679149808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0b4010 0x7f850c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.245+0000 7f85124d4640 1 --2- 172.21.15.6:0/679149808 >> v2:172.21.15.171:3300/0 conn(0x7f850c163a10 0x7f850c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.245+0000 7f8512cd5640 1 -- 172.21.15.6:0/679149808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0b4010 msgr2=0x7f850c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.245+0000 7f8512cd5640 1 --2- 172.21.15.6:0/679149808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0b4010 0x7f850c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.245+0000 7f8512cd5640 1 -- 172.21.15.6:0/679149808 >> v2:172.21.15.171:3300/0 conn(0x7f850c163a10 msgr2=0x7f850c0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.245+0000 7f8512cd5640 1 --2- 172.21.15.6:0/679149808 >> v2:172.21.15.171:3300/0 conn(0x7f850c163a10 0x7f850c0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.245+0000 7f8512cd5640 1 -- 172.21.15.6:0/679149808 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c0d3650 con 0x7f850c0d14b0 2024-05-20T18:01:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.245+0000 7f8512cd5640 1 --2- 172.21.15.6:0/679149808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0d14b0 0x7f850c0d18c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f850c0cf1c0 tx=0x7f850402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3af7988fbeda63a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f85114d2640 1 -- 172.21.15.6:0/679149808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504036070 con 0x7f850c0d14b0 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f85114d2640 1 -- 172.21.15.6:0/679149808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504031600 con 0x7f850c0d14b0 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f85114d2640 1 -- 172.21.15.6:0/679149808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85040319d0 con 0x7f850c0d14b0 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f8514738640 1 -- 172.21.15.6:0/679149808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0d14b0 msgr2=0x7f850c0d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f8514738640 1 --2- 172.21.15.6:0/679149808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0d14b0 0x7f850c0d18c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f850c0cf1c0 tx=0x7f850402a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f8514738640 1 -- 172.21.15.6:0/679149808 shutdown_connections 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f8514738640 1 --2- 172.21.15.6:0/679149808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0d14b0 0x7f850c0d18c0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f8514738640 1 --2- 172.21.15.6:0/679149808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0b4010 0x7f850c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f8514738640 1 --2- 172.21.15.6:0/679149808 >> v2:172.21.15.171:3300/0 conn(0x7f850c163a10 0x7f850c0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.246+0000 7f8514738640 1 -- 172.21.15.6:0/679149808 >> 172.21.15.6:0/679149808 conn(0x7f850c06d240 msgr2=0x7f850c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.247+0000 7f8514738640 1 -- 172.21.15.6:0/679149808 shutdown_connections 2024-05-20T18:01:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.247+0000 7f8514738640 1 -- 172.21.15.6:0/679149808 wait complete. 2024-05-20T18:01:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.248+0000 7f8514738640 1 Processor -- start 2024-05-20T18:01:13.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.248+0000 7f8514738640 1 -- start start 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8514738640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0b4010 0x7f850c0d4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8514738640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0d14b0 0x7f850c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8514738640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c163a10 0x7f850c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8514738640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0d1e00 con 0x7f850c0b4010 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8514738640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0d0040 con 0x7f850c0d14b0 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8514738640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f850c0b8210 con 0x7f850c163a10 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0b4010 0x7f850c0d4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0b4010 0x7f850c0d4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43974/0 (socket says 172.21.15.6:43974) 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 -- 172.21.15.6:0/1437724788 learned_addr learned my addr 172.21.15.6:0/1437724788 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:13.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8511cd3640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0d14b0 0x7f850c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8512cd5640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c163a10 0x7f850c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 -- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c163a10 msgr2=0x7f850c0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c163a10 0x7f850c0ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 -- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0d14b0 msgr2=0x7f850c14f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0d14b0 0x7f850c14f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 -- 172.21.15.6:0/1437724788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c150040 con 0x7f850c0b4010 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8511cd3640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0d14b0 0x7f850c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f85124d4640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0b4010 0x7f850c0d4d50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f850800d5d0 tx=0x7f850800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8502ffd640 1 -- 172.21.15.6:0/1437724788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508004240 con 0x7f850c0b4010 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8502ffd640 1 -- 172.21.15.6:0/1437724788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85080043e0 con 0x7f850c0b4010 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c14d490 con 0x7f850c0b4010 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.250+0000 7f8502ffd640 1 -- 172.21.15.6:0/1437724788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508003830 con 0x7f850c0b4010 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.251+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c14eff0 con 0x7f850c0b4010 2024-05-20T18:01:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.251+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c075b00 con 0x7f850c0b4010 2024-05-20T18:01:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.252+0000 7f8502ffd640 1 -- 172.21.15.6:0/1437724788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85080039d0 con 0x7f850c0b4010 2024-05-20T18:01:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.253+0000 7f8502ffd640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f006be30 0x7f84f006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.253+0000 7f8502ffd640 1 -- 172.21.15.6:0/1437724788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f850808b270 con 0x7f850c0b4010 2024-05-20T18:01:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.253+0000 7f8511cd3640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f006be30 0x7f84f006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.253+0000 7f8511cd3640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f006be30 0x7f84f006e340 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f850c1604e0 tx=0x7f84fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.257+0000 7f8502ffd640 1 -- 172.21.15.6:0/1437724788 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f850801c360 con 0x7f850c0b4010 2024-05-20T18:01:13.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.479+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f850c0d3050 con 0x7f850c0b4010 2024-05-20T18:01:13.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.480+0000 7f8502ffd640 1 -- 172.21.15.6:0/1437724788 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5178 (secure 0 0 0) 0x7f8508059b20 con 0x7f850c0b4010 2024-05-20T18:01:13.478 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:13.478 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":77,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:01:12.960250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:01:13.478 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 77 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.481+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f006be30 msgr2=0x7f84f006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.481+0000 7f8514738640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f006be30 0x7f84f006e340 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f850c1604e0 tx=0x7f84fc008040 comp rx=0 tx=0).stop 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.481+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0b4010 msgr2=0x7f850c0d4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.481+0000 7f8514738640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0b4010 0x7f850c0d4d50 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f850800d5d0 tx=0x7f850800da90 comp rx=0 tx=0).stop 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.482+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 shutdown_connections 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.482+0000 7f8514738640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84f006be30 0x7f84f006e340 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.482+0000 7f8514738640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c163a10 0x7f850c0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.482+0000 7f8514738640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0d14b0 0x7f850c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.482+0000 7f8514738640 1 --2- 172.21.15.6:0/1437724788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f850c0b4010 0x7f850c0d4d50 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.482+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 >> 172.21.15.6:0/1437724788 conn(0x7f850c06d240 msgr2=0x7f850c0ba3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.482+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 shutdown_connections 2024-05-20T18:01:13.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.482+0000 7f8514738640 1 -- 172.21.15.6:0/1437724788 wait complete. 2024-05-20T18:01:13.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.607+0000 7f0044196640 1 Processor -- start 2024-05-20T18:01:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.607+0000 7f0044196640 1 -- start start 2024-05-20T18:01:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0044196640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f003c162820 0x7f003c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0044196640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c06dae0 0x7f003c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0044196640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003c0d0630 con 0x7f003c0b3e80 2024-05-20T18:01:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0044196640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f003c0d39c0 con 0x7f003c162820 2024-05-20T18:01:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0044196640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f003c0d3ca0 con 0x7f003c06dae0 2024-05-20T18:01:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0042733640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c06dae0 0x7f003c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0041f32640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f003c162820 0x7f003c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0041731640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f003c0b3e80 0x7f003c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:39566/0 (socket says 172.21.15.6:39566) 2024-05-20T18:01:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.609+0000 7f0041731640 1 -- 172.21.15.6:0/2704990714 learned_addr learned my addr 172.21.15.6:0/2704990714 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.610+0000 7f0042733640 1 -- 172.21.15.6:0/2704990714 >> v2:172.21.15.171:3300/0 conn(0x7f003c162820 msgr2=0x7f003c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.610+0000 7f0042733640 1 --2- 172.21.15.6:0/2704990714 >> v2:172.21.15.171:3300/0 conn(0x7f003c162820 0x7f003c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.610+0000 7f0042733640 1 -- 172.21.15.6:0/2704990714 >> v1:172.21.15.171:6789/0 conn(0x7f003c0b3e80 legacy=0x7f003c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.610+0000 7f0040f30640 1 -- 172.21.15.6:0/2704990714 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575631803 0 0) 0x7f003c0d0630 con 0x7f003c0b3e80 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.610+0000 7f0042733640 1 -- 172.21.15.6:0/2704990714 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c0d3f80 con 0x7f003c06dae0 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.610+0000 7f0041f32640 1 --2- 172.21.15.6:0/2704990714 >> v2:172.21.15.171:3300/0 conn(0x7f003c162820 0x7f003c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.610+0000 7f0042733640 1 --2- 172.21.15.6:0/2704990714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c06dae0 0x7f003c0b8190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0034009d90 tx=0x7f003402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9493a27481313e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0040f30640 1 -- 172.21.15.6:0/2704990714 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034007740 con 0x7f003c06dae0 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0040f30640 1 -- 172.21.15.6:0/2704990714 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00340078e0 con 0x7f003c06dae0 2024-05-20T18:01:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0040f30640 1 -- 172.21.15.6:0/2704990714 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034007cb0 con 0x7f003c06dae0 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0044196640 1 -- 172.21.15.6:0/2704990714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c06dae0 msgr2=0x7f003c0b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0044196640 1 --2- 172.21.15.6:0/2704990714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c06dae0 0x7f003c0b8190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0034009d90 tx=0x7f003402a660 comp rx=0 tx=0).stop 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0044196640 1 -- 172.21.15.6:0/2704990714 shutdown_connections 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0044196640 1 --2- 172.21.15.6:0/2704990714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c06dae0 0x7f003c0b8190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0044196640 1 --2- 172.21.15.6:0/2704990714 >> v2:172.21.15.171:3300/0 conn(0x7f003c162820 0x7f003c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0044196640 1 -- 172.21.15.6:0/2704990714 >> 172.21.15.6:0/2704990714 conn(0x7f003c0d4bd0 msgr2=0x7f003c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.611+0000 7f0044196640 1 -- 172.21.15.6:0/2704990714 shutdown_connections 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.612+0000 7f0044196640 1 -- 172.21.15.6:0/2704990714 wait complete. 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.613+0000 7f0044196640 1 Processor -- start 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.613+0000 7f0044196640 1 -- start start 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0044196640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f003c0b3e80 0x7f003c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0044196640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f003c162820 0x7f003c0b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0044196640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c1f4cb0 0x7f003c1f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0044196640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0d4780 con 0x7f003c0b3e80 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0044196640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0d0300 con 0x7f003c162820 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0044196640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f003c0d4900 con 0x7f003c1f4cb0 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f003c0b3e80 0x7f003c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f003c0b3e80 0x7f003c156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43988/0 (socket says 172.21.15.6:43988) 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 -- 172.21.15.6:0/1449303296 learned_addr learned my addr 172.21.15.6:0/1449303296 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041731640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f003c162820 0x7f003c0b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0042733640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c1f4cb0 0x7f003c1f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 -- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c1f4cb0 msgr2=0x7f003c1f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c1f4cb0 0x7f003c1f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 -- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f003c162820 msgr2=0x7f003c0b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f003c162820 0x7f003c0b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 -- 172.21.15.6:0/1449303296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c0b5210 con 0x7f003c0b3e80 2024-05-20T18:01:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0041f32640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f003c0b3e80 0x7f003c156060 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f003800e990 tx=0x7f003800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f00327fc640 1 -- 172.21.15.6:0/1449303296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038017070 con 0x7f003c0b3e80 2024-05-20T18:01:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f00327fc640 1 -- 172.21.15.6:0/1449303296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003800c9e0 con 0x7f003c0b3e80 2024-05-20T18:01:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c0b54f0 con 0x7f003c0b3e80 2024-05-20T18:01:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.615+0000 7f00327fc640 1 -- 172.21.15.6:0/1449303296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003800cdb0 con 0x7f003c0b3e80 2024-05-20T18:01:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.616+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c0b5ab0 con 0x7f003c0b3e80 2024-05-20T18:01:13.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.616+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003c1f5e80 con 0x7f003c0b3e80 2024-05-20T18:01:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.617+0000 7f00327fc640 1 -- 172.21.15.6:0/1449303296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f003801a070 con 0x7f003c0b3e80 2024-05-20T18:01:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.617+0000 7f00327fc640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f002006be60 0x7f002006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.618+0000 7f00327fc640 1 -- 172.21.15.6:0/1449303296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f003808b240 con 0x7f003c0b3e80 2024-05-20T18:01:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.618+0000 7f0041731640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f002006be60 0x7f002006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.618+0000 7f0041731640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f002006be60 0x7f002006e370 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b7680 tx=0x7f002c007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.622+0000 7f00327fc640 1 -- 172.21.15.6:0/1449303296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f00380599e0 con 0x7f003c0b3e80 2024-05-20T18:01:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.807+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f003c075b00 con 0x7f003c0b3e80 2024-05-20T18:01:13.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.808+0000 7f00327fc640 1 -- 172.21.15.6:0/1449303296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16904 (secure 0 0 0) 0x7f00380592e0 con 0x7f003c0b3e80 2024-05-20T18:01:13.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:13.807 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":113,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:45.915316+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:42.005763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:43.283834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:13.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f002006be60 msgr2=0x7f002006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f002006be60 0x7f002006e370 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b7680 tx=0x7f002c007c00 comp rx=0 tx=0).stop 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f003c0b3e80 msgr2=0x7f003c156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f003c0b3e80 0x7f003c156060 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f003800e990 tx=0x7f003800ee50 comp rx=0 tx=0).stop 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 shutdown_connections 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f002006be60 0x7f002006e370 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f003c1f4cb0 0x7f003c1f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f003c162820 0x7f003c0b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 --2- 172.21.15.6:0/1449303296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f003c0b3e80 0x7f003c156060 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 >> 172.21.15.6:0/1449303296 conn(0x7f003c0d4bd0 msgr2=0x7f003c15e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 shutdown_connections 2024-05-20T18:01:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.810+0000 7f0044196640 1 -- 172.21.15.6:0/1449303296 wait complete. 2024-05-20T18:01:13.820 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T18:01:13.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:13.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.936+0000 7f9058c13640 1 Processor -- start 2024-05-20T18:01:13.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.936+0000 7f9058c13640 1 -- start start 2024-05-20T18:01:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.937+0000 7f9058c13640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f90540af030 0x7f90540af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f9058c13640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90540af980 con 0x7f905415f700 2024-05-20T18:01:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f9058c13640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9054160430 con 0x7f905406c180 2024-05-20T18:01:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f9058c13640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f905406bcf0 con 0x7f90540af030 2024-05-20T18:01:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f905259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f90540af030 0x7f90540af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f905259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f90540af030 0x7f90540af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43994/0 (socket says 172.21.15.6:43994) 2024-05-20T18:01:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f905259c640 1 -- 172.21.15.6:0/1624177062 learned_addr learned my addr 172.21.15.6:0/1624177062 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f904bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f905415f700 0x7f905415fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59584/0 (socket says 172.21.15.6:59584) 2024-05-20T18:01:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f905259c640 1 -- 172.21.15.6:0/1624177062 >> v1:172.21.15.171:6789/0 conn(0x7f905406c180 legacy=0x7f905406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f905259c640 1 -- 172.21.15.6:0/1624177062 >> v1:172.21.15.6:6789/0 conn(0x7f905415f700 legacy=0x7f905415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f905259c640 1 -- 172.21.15.6:0/1624177062 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905406b6a0 con 0x7f90540af030 2024-05-20T18:01:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.938+0000 7f9051d9b640 1 -- 172.21.15.6:0/1624177062 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 196124465 0 0) 0x7f903c001110 con 0x7f905415f700 2024-05-20T18:01:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.939+0000 7f905259c640 1 --2- 172.21.15.6:0/1624177062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90540af030 0x7f90540af440 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9044009870 tx=0x7f904402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe482a82eea129d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.939+0000 7f9051d9b640 1 -- 172.21.15.6:0/1624177062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044037070 con 0x7f90540af030 2024-05-20T18:01:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.939+0000 7f9051d9b640 1 -- 172.21.15.6:0/1624177062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9044032440 con 0x7f90540af030 2024-05-20T18:01:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.939+0000 7f9051d9b640 1 -- 172.21.15.6:0/1624177062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044032810 con 0x7f90540af030 2024-05-20T18:01:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.940+0000 7f9058c13640 1 -- 172.21.15.6:0/1624177062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90540af030 msgr2=0x7f90540af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.940+0000 7f9058c13640 1 --2- 172.21.15.6:0/1624177062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90540af030 0x7f90540af440 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9044009870 tx=0x7f904402a2a0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.940+0000 7f9058c13640 1 -- 172.21.15.6:0/1624177062 shutdown_connections 2024-05-20T18:01:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.940+0000 7f9058c13640 1 --2- 172.21.15.6:0/1624177062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90540af030 0x7f90540af440 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.940+0000 7f9058c13640 1 -- 172.21.15.6:0/1624177062 >> 172.21.15.6:0/1624177062 conn(0x7f90540b6620 msgr2=0x7f90540b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.940+0000 7f9058c13640 1 -- 172.21.15.6:0/1624177062 shutdown_connections 2024-05-20T18:01:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.940+0000 7f9058c13640 1 -- 172.21.15.6:0/1624177062 wait complete. 2024-05-20T18:01:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.942+0000 7f9058c13640 1 Processor -- start 2024-05-20T18:01:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.942+0000 7f9058c13640 1 -- start start 2024-05-20T18:01:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f9058c13640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406c180 0x7f905409c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f9058c13640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90540af030 0x7f905415e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f9058c13640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f905415f700 0x7f905415e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f9058c13640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f905406cca0 con 0x7f905406c180 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f9058c13640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9054159aa0 con 0x7f90540af030 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f9058c13640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f905406ce20 con 0x7f905415f700 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f905259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406c180 0x7f905409c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f905259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406c180 0x7f905409c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44006/0 (socket says 172.21.15.6:44006) 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f905259c640 1 -- 172.21.15.6:0/4225123594 learned_addr learned my addr 172.21.15.6:0/4225123594 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f904bfff640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90540af030 0x7f905415e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f9052d9d640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f905415f700 0x7f905415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f905259c640 1 -- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f905415f700 msgr2=0x7f905415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f905259c640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f905415f700 0x7f905415e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f905259c640 1 -- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90540af030 msgr2=0x7f905415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f905259c640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90540af030 0x7f905415e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f905259c640 1 -- 172.21.15.6:0/4225123594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9054156950 con 0x7f905406c180 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.943+0000 7f904bfff640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90540af030 0x7f905415e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.944+0000 7f905259c640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406c180 0x7f905409c5c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9044009870 tx=0x7f90440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.944+0000 7f904affd640 1 -- 172.21.15.6:0/4225123594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044041070 con 0x7f905406c180 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.944+0000 7f904affd640 1 -- 172.21.15.6:0/4225123594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904403c870 con 0x7f905406c180 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.944+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905409cb00 con 0x7f905406c180 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.944+0000 7f904affd640 1 -- 172.21.15.6:0/4225123594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044037040 con 0x7f905406c180 2024-05-20T18:01:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.944+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90541f5f40 con 0x7f905406c180 2024-05-20T18:01:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.945+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f905406d820 con 0x7f905406c180 2024-05-20T18:01:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.945+0000 7f904affd640 1 -- 172.21.15.6:0/4225123594 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9044044070 con 0x7f905406c180 2024-05-20T18:01:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.946+0000 7f904affd640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f903406be30 0x7f903406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.946+0000 7f904affd640 1 -- 172.21.15.6:0/4225123594 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f90440abb90 con 0x7f905406c180 2024-05-20T18:01:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.946+0000 7f904bfff640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f903406be30 0x7f903406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.947+0000 7f904bfff640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f903406be30 0x7f903406e340 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f905409bca0 tx=0x7f903c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:13.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:13.950+0000 7f904affd640 1 -- 172.21.15.6:0/4225123594 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f905406d820 con 0x7f905406c180 2024-05-20T18:01:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.170+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90540d1df0 con 0x7f905406c180 2024-05-20T18:01:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.171+0000 7f904affd640 1 -- 172.21.15.6:0/4225123594 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5178 (secure 0 0 0) 0x7f904407a3b0 con 0x7f905406c180 2024-05-20T18:01:14.170 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:14.170 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":77,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:01:12.960250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:01:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 77 2024-05-20T18:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f903406be30 msgr2=0x7f903406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f903406be30 0x7f903406e340 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f905409bca0 tx=0x7f903c009040 comp rx=0 tx=0).stop 2024-05-20T18:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406c180 msgr2=0x7f905409c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406c180 0x7f905409c5c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9044009870 tx=0x7f90440046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 shutdown_connections 2024-05-20T18:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f903406be30 0x7f903406e340 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f905415f700 0x7f905415e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90540af030 0x7f905415e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 --2- 172.21.15.6:0/4225123594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406c180 0x7f905409c5c0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 >> 172.21.15.6:0/4225123594 conn(0x7f90540b6620 msgr2=0x7f90540b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 shutdown_connections 2024-05-20T18:01:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.173+0000 7f9058c13640 1 -- 172.21.15.6:0/4225123594 wait complete. 2024-05-20T18:01:14.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:14.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.299+0000 7f8ebec0d640 1 Processor -- start 2024-05-20T18:01:14.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.299+0000 7f8ebec0d640 1 -- start start 2024-05-20T18:01:14.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.300+0000 7f8ebec0d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8eb806d3d0 0x7f8eb806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.300+0000 7f8ebec0d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8eb80b8190 0x7f8eb80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.300+0000 7f8ebec0d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb806dd20 con 0x7f8eb8162820 2024-05-20T18:01:14.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.300+0000 7f8ebec0d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb80d0630 con 0x7f8eb806d3d0 2024-05-20T18:01:14.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.300+0000 7f8ebec0d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb80d39c0 con 0x7f8eb80b8190 2024-05-20T18:01:14.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.301+0000 7f8eb7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8eb806d3d0 0x7f8eb806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.301+0000 7f8eb7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8eb806d3d0 0x7f8eb806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44010/0 (socket says 172.21.15.6:44010) 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.301+0000 7f8eb7fff640 1 -- 172.21.15.6:0/356588596 learned_addr learned my addr 172.21.15.6:0/356588596 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.301+0000 7f8ebd1aa640 1 --2- 172.21.15.6:0/356588596 >> v2:172.21.15.171:3300/0 conn(0x7f8eb80b8190 0x7f8eb80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.301+0000 7f8eb7fff640 1 -- 172.21.15.6:0/356588596 >> v2:172.21.15.171:3300/0 conn(0x7f8eb80b8190 msgr2=0x7f8eb80b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.301+0000 7f8eb7fff640 1 --2- 172.21.15.6:0/356588596 >> v2:172.21.15.171:3300/0 conn(0x7f8eb80b8190 0x7f8eb80b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.301+0000 7f8eb7fff640 1 -- 172.21.15.6:0/356588596 >> v1:172.21.15.171:6789/0 conn(0x7f8eb8162820 legacy=0x7f8eb80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.301+0000 7f8eb7fff640 1 -- 172.21.15.6:0/356588596 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb80d3ca0 con 0x7f8eb806d3d0 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.302+0000 7f8eb7fff640 1 --2- 172.21.15.6:0/356588596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb806d3d0 0x7f8eb806d7e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f8eb808e070 tx=0x7f8eac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9500961c5efe5e1f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.302+0000 7f8eb77fe640 1 -- 172.21.15.6:0/356588596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac037070 con 0x7f8eb806d3d0 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.302+0000 7f8eb77fe640 1 -- 172.21.15.6:0/356588596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac032440 con 0x7f8eb806d3d0 2024-05-20T18:01:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.302+0000 7f8eb77fe640 1 -- 172.21.15.6:0/356588596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac032810 con 0x7f8eb806d3d0 2024-05-20T18:01:14.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.303+0000 7f8ebec0d640 1 -- 172.21.15.6:0/356588596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb806d3d0 msgr2=0x7f8eb806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.303+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/356588596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb806d3d0 0x7f8eb806d7e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f8eb808e070 tx=0x7f8eac02a230 comp rx=0 tx=0).stop 2024-05-20T18:01:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.303+0000 7f8ebec0d640 1 -- 172.21.15.6:0/356588596 shutdown_connections 2024-05-20T18:01:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.303+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/356588596 >> v2:172.21.15.171:3300/0 conn(0x7f8eb80b8190 0x7f8eb80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.303+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/356588596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb806d3d0 0x7f8eb806d7e0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.303+0000 7f8ebec0d640 1 -- 172.21.15.6:0/356588596 >> 172.21.15.6:0/356588596 conn(0x7f8eb80d4bd0 msgr2=0x7f8eb80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.303+0000 7f8ebec0d640 1 -- 172.21.15.6:0/356588596 shutdown_connections 2024-05-20T18:01:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.303+0000 7f8ebec0d640 1 -- 172.21.15.6:0/356588596 wait complete. 2024-05-20T18:01:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.304+0000 7f8ebec0d640 1 Processor -- start 2024-05-20T18:01:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.304+0000 7f8ebec0d640 1 -- start start 2024-05-20T18:01:14.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebec0d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8eb806d3d0 0x7f8eb81f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebec0d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eb80b8190 0x7f8eb814a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebec0d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb8162820 0x7f8eb814ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebec0d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb80d0300 con 0x7f8eb8162820 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebec0d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb80d4260 con 0x7f8eb80b8190 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebec0d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb80b4050 con 0x7f8eb806d3d0 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebd1aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb8162820 0x7f8eb814ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebd1aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb8162820 0x7f8eb814ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44012/0 (socket says 172.21.15.6:44012) 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebd1aa640 1 -- 172.21.15.6:0/844347690 learned_addr learned my addr 172.21.15.6:0/844347690 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8eb7fff640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eb80b8190 0x7f8eb814a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebc9a9640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8eb806d3d0 0x7f8eb81f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebd1aa640 1 -- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8eb806d3d0 msgr2=0x7f8eb81f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebd1aa640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8eb806d3d0 0x7f8eb81f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebd1aa640 1 -- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eb80b8190 msgr2=0x7f8eb814a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebd1aa640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eb80b8190 0x7f8eb814a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.306+0000 7f8ebd1aa640 1 -- 172.21.15.6:0/844347690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb80b64b0 con 0x7f8eb8162820 2024-05-20T18:01:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.307+0000 7f8ebd1aa640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb8162820 0x7f8eb814ac20 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000cc60 tx=0x7f8eb000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.307+0000 7f8eb57fa640 1 -- 172.21.15.6:0/844347690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0003990 con 0x7f8eb8162820 2024-05-20T18:01:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.307+0000 7f8eb57fa640 1 -- 172.21.15.6:0/844347690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb0003b30 con 0x7f8eb8162820 2024-05-20T18:01:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.307+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb80b6790 con 0x7f8eb8162820 2024-05-20T18:01:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.307+0000 7f8eb57fa640 1 -- 172.21.15.6:0/844347690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0004020 con 0x7f8eb8162820 2024-05-20T18:01:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.307+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb80b6d50 con 0x7f8eb8162820 2024-05-20T18:01:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.308+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb815e9e0 con 0x7f8eb8162820 2024-05-20T18:01:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.308+0000 7f8eb57fa640 1 -- 172.21.15.6:0/844347690 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8eb00041c0 con 0x7f8eb8162820 2024-05-20T18:01:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.309+0000 7f8eb57fa640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ea406be30 0x7f8ea406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.309+0000 7f8eb57fa640 1 -- 172.21.15.6:0/844347690 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f8eb008b4d0 con 0x7f8eb8162820 2024-05-20T18:01:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.309+0000 7f8ebc9a9640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ea406be30 0x7f8ea406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.310+0000 7f8ebc9a9640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ea406be30 0x7f8ea406e340 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8006fd0 tx=0x7f8ea8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:14.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.314+0000 7f8eb57fa640 1 -- 172.21.15.6:0/844347690 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8eb815e9e0 con 0x7f8eb8162820 2024-05-20T18:01:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.537+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8eb8075b00 con 0x7f8eb8162820 2024-05-20T18:01:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.537+0000 7f8eb57fa640 1 -- 172.21.15.6:0/844347690 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5178 (secure 0 0 0) 0x7f8eb0014030 con 0x7f8eb8162820 2024-05-20T18:01:14.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:14.536 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":77,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:00:44.304102+0000","modified":"2024-05-20T18:01:12.960250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":10,"addr":"172.21.15.6:6834/3266600943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3266600943},{"type":"v1","addr":"172.21.15.6:6834","nonce":3266600943}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8118,"qdb_cluster":[8118]},"id":8}]} 2024-05-20T18:01:14.536 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 77 2024-05-20T18:01:14.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ea406be30 msgr2=0x7f8ea406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ea406be30 0x7f8ea406e340 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8006fd0 tx=0x7f8ea8009060 comp rx=0 tx=0).stop 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb8162820 msgr2=0x7f8eb814ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb8162820 0x7f8eb814ac20 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000cc60 tx=0x7f8eb000a5c0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 shutdown_connections 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8ea406be30 0x7f8ea406e340 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb8162820 0x7f8eb814ac20 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8eb80b8190 0x7f8eb814a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 --2- 172.21.15.6:0/844347690 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8eb806d3d0 0x7f8eb81f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 >> 172.21.15.6:0/844347690 conn(0x7f8eb80d4bd0 msgr2=0x7f8eb815e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 shutdown_connections 2024-05-20T18:01:14.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.539+0000 7f8ebec0d640 1 -- 172.21.15.6:0/844347690 wait complete. 2024-05-20T18:01:14.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.665+0000 7f5e9abea640 1 Processor -- start 2024-05-20T18:01:14.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.665+0000 7f5e9abea640 1 -- start start 2024-05-20T18:01:14.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e9abea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5e940b0020 0x7f5e9415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e9abea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e9415ca00 0x7f5e9406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e9abea640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e940b51c0 con 0x7f5e940b4c00 2024-05-20T18:01:14.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e9abea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9415bf20 con 0x7f5e9415ca00 2024-05-20T18:01:14.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e9abea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9415c200 con 0x7f5e940b0020 2024-05-20T18:01:14.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e8bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e9415ca00 0x7f5e9406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e8bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5e9415ca00 0x7f5e9406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44028/0 (socket says 172.21.15.6:44028) 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3451378758 learned_addr learned my addr 172.21.15.6:0/3451378758 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.666+0000 7f5e99187640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5e940b4c00 0x7f5e940ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59600/0 (socket says 172.21.15.6:59600) 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.667+0000 7f5e98986640 1 --2- 172.21.15.6:0/3451378758 >> v2:172.21.15.171:3300/0 conn(0x7f5e940b0020 0x7f5e9415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.667+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3451378758 >> v2:172.21.15.171:3300/0 conn(0x7f5e940b0020 msgr2=0x7f5e9415fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.667+0000 7f5e8bfff640 1 --2- 172.21.15.6:0/3451378758 >> v2:172.21.15.171:3300/0 conn(0x7f5e940b0020 0x7f5e9415fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.667+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3451378758 >> v1:172.21.15.6:6789/0 conn(0x7f5e940b4c00 legacy=0x7f5e940ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.667+0000 7f5e8bfff640 1 -- 172.21.15.6:0/3451378758 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9415c4e0 con 0x7f5e9415ca00 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.667+0000 7f5e8b7fe640 1 -- 172.21.15.6:0/3451378758 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528028551 0 0) 0x7f5e940b51c0 con 0x7f5e940b4c00 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.667+0000 7f5e98986640 1 --2- 172.21.15.6:0/3451378758 >> v2:172.21.15.171:3300/0 conn(0x7f5e940b0020 0x7f5e9415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e8bfff640 1 --2- 172.21.15.6:0/3451378758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9406bdb0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f5e94073a40 tx=0x7f5e8402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb33a06a2805fd90 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e8b7fe640 1 -- 172.21.15.6:0/3451378758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84037070 con 0x7f5e9415ca00 2024-05-20T18:01:14.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e8b7fe640 1 -- 172.21.15.6:0/3451378758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e84032440 con 0x7f5e9415ca00 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e8b7fe640 1 -- 172.21.15.6:0/3451378758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84032810 con 0x7f5e9415ca00 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e9abea640 1 -- 172.21.15.6:0/3451378758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 msgr2=0x7f5e9406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e9abea640 1 --2- 172.21.15.6:0/3451378758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9406bdb0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f5e94073a40 tx=0x7f5e8402a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e9abea640 1 -- 172.21.15.6:0/3451378758 shutdown_connections 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e9abea640 1 --2- 172.21.15.6:0/3451378758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9406bdb0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e9abea640 1 --2- 172.21.15.6:0/3451378758 >> v2:172.21.15.171:3300/0 conn(0x7f5e940b0020 0x7f5e9415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.668+0000 7f5e9abea640 1 -- 172.21.15.6:0/3451378758 >> 172.21.15.6:0/3451378758 conn(0x7f5e940cd2a0 msgr2=0x7f5e940cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.669+0000 7f5e9abea640 1 -- 172.21.15.6:0/3451378758 shutdown_connections 2024-05-20T18:01:14.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.669+0000 7f5e9abea640 1 -- 172.21.15.6:0/3451378758 wait complete. 2024-05-20T18:01:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.670+0000 7f5e9abea640 1 Processor -- start 2024-05-20T18:01:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.670+0000 7f5e9abea640 1 -- start start 2024-05-20T18:01:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e9abea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e940b0020 0x7f5e941f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e9abea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e940b4c00 0x7f5e94148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e9abea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e9abea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9406c2f0 con 0x7f5e9415ca00 2024-05-20T18:01:14.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e9abea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5e940b54a0 con 0x7f5e940b0020 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e9abea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9406c470 con 0x7f5e940b4c00 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e99187640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e99187640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44044/0 (socket says 172.21.15.6:44044) 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e99187640 1 -- 172.21.15.6:0/834125057 learned_addr learned my addr 172.21.15.6:0/834125057 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e98986640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e940b0020 0x7f5e941f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e8bfff640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e940b4c00 0x7f5e94148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e99187640 1 -- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e940b4c00 msgr2=0x7f5e94148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e99187640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e940b4c00 0x7f5e94148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e99187640 1 -- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e940b0020 msgr2=0x7f5e941f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e99187640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e940b0020 0x7f5e941f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e99187640 1 -- 172.21.15.6:0/834125057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e941f56b0 con 0x7f5e9415ca00 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.672+0000 7f5e98986640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e940b0020 0x7f5e941f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:14.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.673+0000 7f5e99187640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9415d900 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00eb60 tx=0x7f5e8c00c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:14.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.673+0000 7f5e897fa640 1 -- 172.21.15.6:0/834125057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c01a070 con 0x7f5e9415ca00 2024-05-20T18:01:14.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.673+0000 7f5e897fa640 1 -- 172.21.15.6:0/834125057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c00cd40 con 0x7f5e9415ca00 2024-05-20T18:01:14.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.673+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e94148790 con 0x7f5e9415ca00 2024-05-20T18:01:14.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.673+0000 7f5e897fa640 1 -- 172.21.15.6:0/834125057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0135a0 con 0x7f5e9415ca00 2024-05-20T18:01:14.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.673+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e94158ad0 con 0x7f5e9415ca00 2024-05-20T18:01:14.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.674+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e94158840 con 0x7f5e9415ca00 2024-05-20T18:01:14.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.675+0000 7f5e897fa640 1 -- 172.21.15.6:0/834125057 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e8c01d070 con 0x7f5e9415ca00 2024-05-20T18:01:14.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.675+0000 7f5e897fa640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e8006be60 0x7f5e8006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.675+0000 7f5e897fa640 1 -- 172.21.15.6:0/834125057 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f5e8c08cb80 con 0x7f5e9415ca00 2024-05-20T18:01:14.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.675+0000 7f5e98986640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e8006be60 0x7f5e8006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.676+0000 7f5e98986640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e8006be60 0x7f5e8006e370 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5e90006fd0 tx=0x7f5e90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:14.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.680+0000 7f5e897fa640 1 -- 172.21.15.6:0/834125057 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5e94148790 con 0x7f5e9415ca00 2024-05-20T18:01:14.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.865+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e9406cd30 con 0x7f5e9415ca00 2024-05-20T18:01:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.866+0000 7f5e897fa640 1 -- 172.21.15.6:0/834125057 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16904 (secure 0 0 0) 0x7f5e941f56b0 con 0x7f5e9415ca00 2024-05-20T18:01:14.864 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:14.864 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":113,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:00:45.915316+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:00:42.005763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-05-20T18:00:43.283834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e8006be60 msgr2=0x7f5e8006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e8006be60 0x7f5e8006e370 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5e90006fd0 tx=0x7f5e90008040 comp rx=0 tx=0).stop 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 msgr2=0x7f5e9415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9415d900 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00eb60 tx=0x7f5e8c00c430 comp rx=0 tx=0).stop 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 shutdown_connections 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5e8006be60 0x7f5e8006e370 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e9415ca00 0x7f5e9415d900 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5e940b4c00 0x7f5e94148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 --2- 172.21.15.6:0/834125057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5e940b0020 0x7f5e941f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 >> 172.21.15.6:0/834125057 conn(0x7f5e940cd2a0 msgr2=0x7f5e9406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 shutdown_connections 2024-05-20T18:01:14.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.868+0000 7f5e9abea640 1 -- 172.21.15.6:0/834125057 wait complete. 2024-05-20T18:01:14.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T18:01:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.995+0000 7fb2cf0a2640 1 Processor -- start 2024-05-20T18:01:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.995+0000 7fb2cf0a2640 1 -- start start 2024-05-20T18:01:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2cf0a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2c8162820 0x7fb2c80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2cf0a2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c80d0630 con 0x7fb2c80b3e80 2024-05-20T18:01:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2cf0a2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c80d39c0 con 0x7fb2c806dae0 2024-05-20T18:01:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2cf0a2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c80d3ca0 con 0x7fb2c8162820 2024-05-20T18:01:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2cce3e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2c8162820 0x7fb2c80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2c7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2c80b3e80 0x7fb2c806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59604/0 (socket says 172.21.15.6:59604) 2024-05-20T18:01:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2c7fff640 1 -- 172.21.15.6:0/1051646560 learned_addr learned my addr 172.21.15.6:0/1051646560 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2cce3e640 1 -- 172.21.15.6:0/1051646560 >> v1:172.21.15.171:6789/0 conn(0x7fb2c806dae0 legacy=0x7fb2c80b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2cce3e640 1 -- 172.21.15.6:0/1051646560 >> v1:172.21.15.6:6789/0 conn(0x7fb2c80b3e80 legacy=0x7fb2c806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2cce3e640 1 -- 172.21.15.6:0/1051646560 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c80d3f80 con 0x7fb2c8162820 2024-05-20T18:01:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.997+0000 7fb2c77fe640 1 -- 172.21.15.6:0/1051646560 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788986691 0 0) 0x7fb2c80d0630 con 0x7fb2c80b3e80 2024-05-20T18:01:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.998+0000 7fb2cce3e640 1 --2- 172.21.15.6:0/1051646560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c8162820 0x7fb2c80b3940 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009d90 tx=0x7fb2c002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f65c30b063a5a38 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.998+0000 7fb2c77fe640 1 -- 172.21.15.6:0/1051646560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0007740 con 0x7fb2c8162820 2024-05-20T18:01:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.998+0000 7fb2c77fe640 1 -- 172.21.15.6:0/1051646560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c00078e0 con 0x7fb2c8162820 2024-05-20T18:01:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.998+0000 7fb2c77fe640 1 -- 172.21.15.6:0/1051646560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0007cb0 con 0x7fb2c8162820 2024-05-20T18:01:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.999+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/1051646560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c8162820 msgr2=0x7fb2c80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.999+0000 7fb2cf0a2640 1 --2- 172.21.15.6:0/1051646560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c8162820 0x7fb2c80b3940 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009d90 tx=0x7fb2c002a6f0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.999+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/1051646560 shutdown_connections 2024-05-20T18:01:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.999+0000 7fb2cf0a2640 1 --2- 172.21.15.6:0/1051646560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c8162820 0x7fb2c80b3940 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.999+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/1051646560 >> 172.21.15.6:0/1051646560 conn(0x7fb2c80d4bd0 msgr2=0x7fb2c80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.999+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/1051646560 shutdown_connections 2024-05-20T18:01:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:14.999+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/1051646560 wait complete. 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.001+0000 7fb2cf0a2640 1 Processor -- start 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.001+0000 7fb2cf0a2640 1 -- start start 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cf0a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c80b3e80 0x7fb2c8153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cf0a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2c8162820 0x7fb2c80b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cf0a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2c80ccae0 0x7fb2c80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cf0a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c80d4780 con 0x7fb2c80b3e80 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cf0a2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c80d0300 con 0x7fb2c8162820 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cf0a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c80d4900 con 0x7fb2c80ccae0 2024-05-20T18:01:15.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cce3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c80b3e80 0x7fb2c8153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cce3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c80b3e80 0x7fb2c8153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44060/0 (socket says 172.21.15.6:44060) 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.002+0000 7fb2cce3e640 1 -- 172.21.15.6:0/628971551 learned_addr learned my addr 172.21.15.6:0/628971551 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2c7fff640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2c8162820 0x7fb2c80b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cce3e640 1 -- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2c80ccae0 msgr2=0x7fb2c80c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cd63f640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2c80ccae0 0x7fb2c80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cce3e640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2c80ccae0 0x7fb2c80c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cce3e640 1 -- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2c8162820 msgr2=0x7fb2c80b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cce3e640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2c8162820 0x7fb2c80b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cce3e640 1 -- 172.21.15.6:0/628971551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c80b7170 con 0x7fb2c80b3e80 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2c7fff640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2c8162820 0x7fb2c80b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cd63f640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2c80ccae0 0x7fb2c80c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cce3e640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c80b3e80 0x7fb2c8153fd0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009d90 tx=0x7fb2c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2c57fa640 1 -- 172.21.15.6:0/628971551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c003f070 con 0x7fb2c80b3e80 2024-05-20T18:01:15.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2c57fa640 1 -- 172.21.15.6:0/628971551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c0031d00 con 0x7fb2c80b3e80 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c80b5b90 con 0x7fb2c80b3e80 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2c57fa640 1 -- 172.21.15.6:0/628971551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0044660 con 0x7fb2c80b3e80 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.003+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c80b6430 con 0x7fb2c80b3e80 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.004+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c8075b00 con 0x7fb2c80b3e80 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.005+0000 7fb2c57fa640 1 -- 172.21.15.6:0/628971551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2c003b410 con 0x7fb2c80b3e80 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.005+0000 7fb2c57fa640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb2b406be30 0x7fb2b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.006+0000 7fb2c57fa640 1 -- 172.21.15.6:0/628971551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fb2c00aca70 con 0x7fb2c80b3e80 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.006+0000 7fb2c7fff640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb2b406be30 0x7fb2b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.006+0000 7fb2c7fff640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb2b406be30 0x7fb2b406e340 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80b3a70 tx=0x7fb2bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:15.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.010+0000 7fb2c57fa640 1 -- 172.21.15.6:0/628971551 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb2c007abb0 con 0x7fb2c80b3e80 2024-05-20T18:01:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.233+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb2c815e820 con 0x7fb2c80b3e80 2024-05-20T18:01:15.232 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T18:01:15.234+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T18:01:15.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.235+0000 7fb2c57fa640 1 -- 172.21.15.6:0/628971551 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) ==== 161+0+0 (secure 0 0 0) 0x7fb2c007eeb0 con 0x7fb2c80b3e80 2024-05-20T18:01:15.233 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T18:01:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb2b406be30 msgr2=0x7fb2b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb2b406be30 0x7fb2b406e340 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80b3a70 tx=0x7fb2bc009040 comp rx=0 tx=0).stop 2024-05-20T18:01:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c80b3e80 msgr2=0x7fb2c8153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c80b3e80 0x7fb2c8153fd0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009d90 tx=0x7fb2c0004a40 comp rx=0 tx=0).stop 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 shutdown_connections 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb2b406be30 0x7fb2b406e340 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2c80ccae0 0x7fb2c80c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2c8162820 0x7fb2c80b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 --2- 172.21.15.6:0/628971551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2c80b3e80 0x7fb2c8153fd0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 >> 172.21.15.6:0/628971551 conn(0x7fb2c80d4bd0 msgr2=0x7fb2c806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 shutdown_connections 2024-05-20T18:01:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.239+0000 7fb2cf0a2640 1 -- 172.21.15.6:0/628971551 wait complete. 2024-05-20T18:01:15.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T18:01:15.302 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T18:01:15.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.370+0000 7f7e3439d640 1 Processor -- start 2024-05-20T18:01:15.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.370+0000 7f7e3439d640 1 -- start start 2024-05-20T18:01:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.371+0000 7f7e3439d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7e2c15d530 0x7f7e2c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.371+0000 7f7e3439d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.371+0000 7f7e3439d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c0cd580 con 0x7f7e2c0b1700 2024-05-20T18:01:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.371+0000 7f7e3439d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c0ce190 con 0x7f7e2c15d530 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.371+0000 7f7e3439d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c0cd860 con 0x7f7e2c070850 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.371+0000 7f7e31938640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7e2c0b1700 0x7f7e2c0b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59634/0 (socket says 172.21.15.6:59634) 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.371+0000 7f7e31938640 1 -- 172.21.15.6:0/2003739382 learned_addr learned my addr 172.21.15.6:0/2003739382 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e32139640 1 --2- 172.21.15.6:0/2003739382 >> v2:172.21.15.171:3300/0 conn(0x7f7e2c15d530 0x7f7e2c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e3293a640 1 --2- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e31137640 1 -- 172.21.15.6:0/2003739382 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192099557 0 0) 0x7f7e2c0cd580 con 0x7f7e2c0b1700 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e31137640 1 -- 172.21.15.6:0/2003739382 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e18003520 con 0x7f7e2c0b1700 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e32139640 1 -- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 msgr2=0x7f7e2c070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e32139640 1 --2- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e31137640 1 -- 172.21.15.6:0/2003739382 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 432514634 0 0) 0x7f7e18003520 con 0x7f7e2c0b1700 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e32139640 1 -- 172.21.15.6:0/2003739382 >> v1:172.21.15.6:6789/0 conn(0x7f7e2c0b1700 legacy=0x7f7e2c0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e32139640 1 -- 172.21.15.6:0/2003739382 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c0cdb40 con 0x7f7e2c15d530 2024-05-20T18:01:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.372+0000 7f7e3293a640 1 --2- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.373+0000 7f7e32139640 1 --2- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c15d530 0x7f7e2c15aaa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7e280097a0 tx=0x7f7e2802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a0ecbdd5a9b0bf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.373+0000 7f7e31137640 1 -- 172.21.15.6:0/2003739382 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28037070 con 0x7f7e2c15d530 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.373+0000 7f7e31137640 1 -- 172.21.15.6:0/2003739382 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2802aba0 con 0x7f7e2c15d530 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.373+0000 7f7e31137640 1 -- 172.21.15.6:0/2003739382 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c001670 con 0x7f7e2c15d530 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.374+0000 7f7e3439d640 1 -- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c15d530 msgr2=0x7f7e2c15aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.374+0000 7f7e3439d640 1 --2- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c15d530 0x7f7e2c15aaa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7e280097a0 tx=0x7f7e2802a110 comp rx=0 tx=0).stop 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.374+0000 7f7e3439d640 1 -- 172.21.15.6:0/2003739382 shutdown_connections 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.374+0000 7f7e3439d640 1 --2- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.374+0000 7f7e3439d640 1 --2- 172.21.15.6:0/2003739382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c15d530 0x7f7e2c15aaa0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.374+0000 7f7e3439d640 1 -- 172.21.15.6:0/2003739382 >> 172.21.15.6:0/2003739382 conn(0x7f7e2c0d29d0 msgr2=0x7f7e2c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.374+0000 7f7e3439d640 1 -- 172.21.15.6:0/2003739382 shutdown_connections 2024-05-20T18:01:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.374+0000 7f7e3439d640 1 -- 172.21.15.6:0/2003739382 wait complete. 2024-05-20T18:01:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.376+0000 7f7e3439d640 1 Processor -- start 2024-05-20T18:01:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.376+0000 7f7e3439d640 1 -- start start 2024-05-20T18:01:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3439d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c1f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3439d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c0b1700 0x7f7e2c0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3439d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e2c15d530 0x7f7e2c0b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3439d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c0711a0 con 0x7f7e2c15d530 2024-05-20T18:01:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3439d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c0cd230 con 0x7f7e2c0b1700 2024-05-20T18:01:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3439d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c071320 con 0x7f7e2c070850 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3293a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e2c15d530 0x7f7e2c0b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3293a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e2c15d530 0x7f7e2c0b6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44078/0 (socket says 172.21.15.6:44078) 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3293a640 1 -- 172.21.15.6:0/249394040 learned_addr learned my addr 172.21.15.6:0/249394040 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e32139640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c1f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e31938640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c0b1700 0x7f7e2c0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3293a640 1 -- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 msgr2=0x7f7e2c1f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3293a640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c1f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3293a640 1 -- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c0b1700 msgr2=0x7f7e2c0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3293a640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c0b1700 0x7f7e2c0cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.377+0000 7f7e3293a640 1 -- 172.21.15.6:0/249394040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c0c66a0 con 0x7f7e2c15d530 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.378+0000 7f7e3293a640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e2c15d530 0x7f7e2c0b6ca0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400efc0 tx=0x7f7e2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.378+0000 7f7e22ffd640 1 -- 172.21.15.6:0/249394040 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24018020 con 0x7f7e2c15d530 2024-05-20T18:01:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.378+0000 7f7e22ffd640 1 -- 172.21.15.6:0/249394040 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24014480 con 0x7f7e2c15d530 2024-05-20T18:01:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.378+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c0c6980 con 0x7f7e2c15d530 2024-05-20T18:01:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.378+0000 7f7e22ffd640 1 -- 172.21.15.6:0/249394040 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24014870 con 0x7f7e2c15d530 2024-05-20T18:01:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.378+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c0c9fb0 con 0x7f7e2c15d530 2024-05-20T18:01:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.379+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e2c075b00 con 0x7f7e2c15d530 2024-05-20T18:01:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.380+0000 7f7e22ffd640 1 -- 172.21.15.6:0/249394040 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e24005d10 con 0x7f7e2c15d530 2024-05-20T18:01:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.380+0000 7f7e22ffd640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e1006be60 0x7f7e1006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.380+0000 7f7e22ffd640 1 -- 172.21.15.6:0/249394040 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6187+0+0 (secure 0 0 0) 0x7f7e2408bbd0 con 0x7f7e2c15d530 2024-05-20T18:01:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.380+0000 7f7e32139640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e1006be60 0x7f7e1006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.381+0000 7f7e32139640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e1006be60 0x7f7e1006e370 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7e28034000 tx=0x7f7e2802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:15.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.385+0000 7f7e22ffd640 1 -- 172.21.15.6:0/249394040 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7e24022030 con 0x7f7e2c15d530 2024-05-20T18:01:15.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:15.610+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7e2c15de00 con 0x7f7e2c15d530 2024-05-20T18:01:16.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.237+0000 7f7e22ffd640 1 -- 172.21.15.6:0/249394040 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) ==== 104+0+0 (secure 0 0 0) 0x7f7e24010040 con 0x7f7e2c15d530 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e1006be60 msgr2=0x7f7e1006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e1006be60 0x7f7e1006e370 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7e28034000 tx=0x7f7e2802e000 comp rx=0 tx=0).stop 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e2c15d530 msgr2=0x7f7e2c0b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e2c15d530 0x7f7e2c0b6ca0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400efc0 tx=0x7f7e2400c490 comp rx=0 tx=0).stop 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 shutdown_connections 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7e1006be60 0x7f7e1006e370 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e2c15d530 0x7f7e2c0b6ca0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e2c0b1700 0x7f7e2c0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 --2- 172.21.15.6:0/249394040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e2c070850 0x7f7e2c1f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 >> 172.21.15.6:0/249394040 conn(0x7f7e2c0d29d0 msgr2=0x7f7e2c0b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 shutdown_connections 2024-05-20T18:01:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.240+0000 7f7e3439d640 1 -- 172.21.15.6:0/249394040 wait complete. 2024-05-20T18:01:16.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T18:01:16.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.377+0000 7efe368bc640 1 Processor -- start 2024-05-20T18:01:16.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.377+0000 7efe368bc640 1 -- start start 2024-05-20T18:01:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe368bc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe300b3860 0x7efe300d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe368bc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efe3006d870 0x7efe3015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe368bc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe300d0450 con 0x7efe3008bd20 2024-05-20T18:01:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe368bc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7efe300d3b10 con 0x7efe300b3860 2024-05-20T18:01:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe368bc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efe300d3df0 con 0x7efe3006d870 2024-05-20T18:01:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe2ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe300b3860 0x7efe300d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe2ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe300b3860 0x7efe300d45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44084/0 (socket says 172.21.15.6:44084) 2024-05-20T18:01:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe2ffff640 1 -- 172.21.15.6:0/357666611 learned_addr learned my addr 172.21.15.6:0/357666611 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe2ffff640 1 -- 172.21.15.6:0/357666611 >> v2:172.21.15.171:3300/0 conn(0x7efe3006d870 msgr2=0x7efe3015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe2ffff640 1 --2- 172.21.15.6:0/357666611 >> v2:172.21.15.171:3300/0 conn(0x7efe3006d870 0x7efe3015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe2ffff640 1 -- 172.21.15.6:0/357666611 >> v1:172.21.15.171:6789/0 conn(0x7efe3008bd20 legacy=0x7efe3008c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.379+0000 7efe2ffff640 1 -- 172.21.15.6:0/357666611 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe300d40d0 con 0x7efe300b3860 2024-05-20T18:01:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.380+0000 7efe2ffff640 1 --2- 172.21.15.6:0/357666611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe300b3860 0x7efe300d45f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7efe300d14f0 tx=0x7efe2002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0316c0bd8967374 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.380+0000 7efe2effd640 1 -- 172.21.15.6:0/357666611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20037070 con 0x7efe300b3860 2024-05-20T18:01:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.380+0000 7efe2effd640 1 -- 172.21.15.6:0/357666611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2002ae20 con 0x7efe300b3860 2024-05-20T18:01:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.380+0000 7efe2effd640 1 -- 172.21.15.6:0/357666611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20032660 con 0x7efe300b3860 2024-05-20T18:01:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.381+0000 7efe368bc640 1 -- 172.21.15.6:0/357666611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe300b3860 msgr2=0x7efe300d45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.381+0000 7efe368bc640 1 --2- 172.21.15.6:0/357666611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe300b3860 0x7efe300d45f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7efe300d14f0 tx=0x7efe2002a110 comp rx=0 tx=0).stop 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.381+0000 7efe368bc640 1 -- 172.21.15.6:0/357666611 shutdown_connections 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.381+0000 7efe368bc640 1 --2- 172.21.15.6:0/357666611 >> v2:172.21.15.171:3300/0 conn(0x7efe3006d870 0x7efe3015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.381+0000 7efe368bc640 1 --2- 172.21.15.6:0/357666611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe300b3860 0x7efe300d45f0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.381+0000 7efe368bc640 1 -- 172.21.15.6:0/357666611 >> 172.21.15.6:0/357666611 conn(0x7efe300b6d10 msgr2=0x7efe3006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.381+0000 7efe368bc640 1 -- 172.21.15.6:0/357666611 shutdown_connections 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.381+0000 7efe368bc640 1 -- 172.21.15.6:0/357666611 wait complete. 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.383+0000 7efe368bc640 1 Processor -- start 2024-05-20T18:01:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.383+0000 7efe368bc640 1 -- start start 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe368bc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe3006d870 0x7efe301f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe368bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe3008bd20 0x7efe301e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe368bc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe300b3860 0x7efe301e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe368bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efe300b81b0 con 0x7efe3008bd20 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe368bc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efe3015f770 con 0x7efe300b3860 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe368bc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efe300b8330 con 0x7efe3006d870 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe3008bd20 0x7efe301e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe3008bd20 0x7efe301e7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44098/0 (socket says 172.21.15.6:44098) 2024-05-20T18:01:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe2f7fe640 1 -- 172.21.15.6:0/91510123 learned_addr learned my addr 172.21.15.6:0/91510123 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe34e59640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe300b3860 0x7efe301e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.384+0000 7efe2ffff640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe3006d870 0x7efe301f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2f7fe640 1 -- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe3006d870 msgr2=0x7efe301f83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2f7fe640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe3006d870 0x7efe301f83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2f7fe640 1 -- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe300b3860 msgr2=0x7efe301e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2f7fe640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe300b3860 0x7efe301e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2f7fe640 1 -- 172.21.15.6:0/91510123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe30159f70 con 0x7efe3008bd20 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2f7fe640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe3008bd20 0x7efe301e7870 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b410 tx=0x7efe2400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2cff9640 1 -- 172.21.15.6:0/91510123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24015020 con 0x7efe3008bd20 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2cff9640 1 -- 172.21.15.6:0/91510123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe24011850 con 0x7efe3008bd20 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe30158070 con 0x7efe3008bd20 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe2cff9640 1 -- 172.21.15.6:0/91510123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24011c40 con 0x7efe3008bd20 2024-05-20T18:01:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.385+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe30158310 con 0x7efe3008bd20 2024-05-20T18:01:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.386+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe300690b0 con 0x7efe3008bd20 2024-05-20T18:01:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.387+0000 7efe2cff9640 1 -- 172.21.15.6:0/91510123 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe24018020 con 0x7efe3008bd20 2024-05-20T18:01:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.387+0000 7efe2cff9640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe1c06be30 0x7efe1c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:16.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.387+0000 7efe2cff9640 1 -- 172.21.15.6:0/91510123 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6187+0+0 (secure 0 0 0) 0x7efe2408ae40 con 0x7efe3008bd20 2024-05-20T18:01:16.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.388+0000 7efe2ffff640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe1c06be30 0x7efe1c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:16.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.388+0000 7efe2ffff640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe1c06be30 0x7efe1c06e340 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7efe20034000 tx=0x7efe2002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:16.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.392+0000 7efe2cff9640 1 -- 172.21.15.6:0/91510123 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efe2401f020 con 0x7efe3008bd20 2024-05-20T18:01:16.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:16.575+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7efe3015a140 con 0x7efe3008bd20 2024-05-20T18:01:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.463+0000 7efe2cff9640 1 -- 172.21.15.6:0/91510123 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) ==== 181+0+0 (secure 0 0 0) 0x7efe24058fc0 con 0x7efe3008bd20 2024-05-20T18:01:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.466+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe1c06be30 msgr2=0x7efe1c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.466+0000 7efe368bc640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe1c06be30 0x7efe1c06e340 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7efe20034000 tx=0x7efe2002e000 comp rx=0 tx=0).stop 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.466+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe3008bd20 msgr2=0x7efe301e7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.466+0000 7efe368bc640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe3008bd20 0x7efe301e7870 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b410 tx=0x7efe2400b8d0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.467+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 shutdown_connections 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.467+0000 7efe368bc640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe1c06be30 0x7efe1c06e340 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.467+0000 7efe368bc640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe300b3860 0x7efe301e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.467+0000 7efe368bc640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe3008bd20 0x7efe301e7870 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.467+0000 7efe368bc640 1 --2- 172.21.15.6:0/91510123 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe3006d870 0x7efe301f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.467+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 >> 172.21.15.6:0/91510123 conn(0x7efe300b6d10 msgr2=0x7efe300b9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.468+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 shutdown_connections 2024-05-20T18:01:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.468+0000 7efe368bc640 1 -- 172.21.15.6:0/91510123 wait complete. 2024-05-20T18:01:17.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T18:01:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.610+0000 7efcf873e640 1 Processor -- start 2024-05-20T18:01:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.610+0000 7efcf873e640 1 -- start start 2024-05-20T18:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf873e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efcf00b3860 0x7efcf00d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf873e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf873e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf00d0450 con 0x7efcf008bd20 2024-05-20T18:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf873e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efcf00d3b10 con 0x7efcf00b3860 2024-05-20T18:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf873e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efcf00d3df0 con 0x7efcf006d870 2024-05-20T18:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf64da640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efcf00b3860 0x7efcf00d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf5cd9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf6cdb640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7efcf008bd20 0x7efcf008c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:39616/0 (socket says 172.21.15.6:39616) 2024-05-20T18:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.612+0000 7efcf6cdb640 1 -- 172.21.15.6:0/1296518674 learned_addr learned my addr 172.21.15.6:0/1296518674 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.613+0000 7efcf64da640 1 -- 172.21.15.6:0/1296518674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 msgr2=0x7efcf015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.613+0000 7efcf64da640 1 --2- 172.21.15.6:0/1296518674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.613+0000 7efcf64da640 1 -- 172.21.15.6:0/1296518674 >> v1:172.21.15.171:6789/0 conn(0x7efcf008bd20 legacy=0x7efcf008c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.613+0000 7efcf64da640 1 -- 172.21.15.6:0/1296518674 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf00d40d0 con 0x7efcf00b3860 2024-05-20T18:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.613+0000 7efcf5cd9640 1 --2- 172.21.15.6:0/1296518674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.614+0000 7efcf64da640 1 --2- 172.21.15.6:0/1296518674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 0x7efcf00d45f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efcec0097a0 tx=0x7efcec02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b36608d9122abbe server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.614+0000 7efcf54d8640 1 -- 172.21.15.6:0/1296518674 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec037070 con 0x7efcf00b3860 2024-05-20T18:01:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.614+0000 7efcf54d8640 1 -- 172.21.15.6:0/1296518674 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcec02adb0 con 0x7efcf00b3860 2024-05-20T18:01:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.614+0000 7efcf54d8640 1 -- 172.21.15.6:0/1296518674 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec032660 con 0x7efcf00b3860 2024-05-20T18:01:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.614+0000 7efcf873e640 1 -- 172.21.15.6:0/1296518674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 msgr2=0x7efcf00d45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.614+0000 7efcf873e640 1 --2- 172.21.15.6:0/1296518674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 0x7efcf00d45f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efcec0097a0 tx=0x7efcec02a060 comp rx=0 tx=0).stop 2024-05-20T18:01:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.614+0000 7efcf873e640 1 -- 172.21.15.6:0/1296518674 shutdown_connections 2024-05-20T18:01:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.615+0000 7efcf873e640 1 --2- 172.21.15.6:0/1296518674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.615+0000 7efcf873e640 1 --2- 172.21.15.6:0/1296518674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 0x7efcf00d45f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.615+0000 7efcf873e640 1 -- 172.21.15.6:0/1296518674 >> 172.21.15.6:0/1296518674 conn(0x7efcf00b6d10 msgr2=0x7efcf006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.615+0000 7efcf873e640 1 -- 172.21.15.6:0/1296518674 shutdown_connections 2024-05-20T18:01:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.615+0000 7efcf873e640 1 -- 172.21.15.6:0/1296518674 wait complete. 2024-05-20T18:01:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.616+0000 7efcf873e640 1 Processor -- start 2024-05-20T18:01:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.616+0000 7efcf873e640 1 -- start start 2024-05-20T18:01:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf873e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf873e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf008bd20 0x7efcf01f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf873e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 0x7efcf00ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf873e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efcf00b81b0 con 0x7efcf008bd20 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf873e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efcf015f770 con 0x7efcf00b3860 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf873e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efcf00b8330 con 0x7efcf006d870 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf008bd20 0x7efcf01f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf008bd20 0x7efcf01f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44112/0 (socket says 172.21.15.6:44112) 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf64da640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 -- 172.21.15.6:0/188954307 learned_addr learned my addr 172.21.15.6:0/188954307 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf6cdb640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 0x7efcf00ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 -- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 msgr2=0x7efcf014d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf014d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 -- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 msgr2=0x7efcf00ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 0x7efcf00ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 -- 172.21.15.6:0/188954307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf014df10 con 0x7efcf008bd20 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.618+0000 7efcf5cd9640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf008bd20 0x7efcf01f4f60 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7efce000e900 tx=0x7efce000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.619+0000 7efce6ffd640 1 -- 172.21.15.6:0/188954307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0017070 con 0x7efcf008bd20 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.619+0000 7efce6ffd640 1 -- 172.21.15.6:0/188954307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce000ca00 con 0x7efcf008bd20 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.619+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf014e1e0 con 0x7efcf008bd20 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.619+0000 7efce6ffd640 1 -- 172.21.15.6:0/188954307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce000cdf0 con 0x7efcf008bd20 2024-05-20T18:01:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.619+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf014e7a0 con 0x7efcf008bd20 2024-05-20T18:01:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.620+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf00690b0 con 0x7efcf008bd20 2024-05-20T18:01:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.620+0000 7efce6ffd640 1 -- 172.21.15.6:0/188954307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efce001a070 con 0x7efcf008bd20 2024-05-20T18:01:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.621+0000 7efce6ffd640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcd406be30 0x7efcd406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.621+0000 7efce6ffd640 1 -- 172.21.15.6:0/188954307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5749+0+0 (secure 0 0 0) 0x7efce008a8c0 con 0x7efcf008bd20 2024-05-20T18:01:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.621+0000 7efcf64da640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcd406be30 0x7efcd406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.622+0000 7efcf64da640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcd406be30 0x7efcd406e340 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efcec034000 tx=0x7efcec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.626+0000 7efce6ffd640 1 -- 172.21.15.6:0/188954307 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efce0058bf0 con 0x7efcf008bd20 2024-05-20T18:01:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:17.812+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7efcf006d300 con 0x7efcf008bd20 2024-05-20T18:01:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.471+0000 7efce6ffd640 1 -- 172.21.15.6:0/188954307 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) ==== 169+0+0 (secure 0 0 0) 0x7efce005cef0 con 0x7efcf008bd20 2024-05-20T18:01:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T18:01:18.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcd406be30 msgr2=0x7efcd406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcd406be30 0x7efcd406e340 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efcec034000 tx=0x7efcec02e000 comp rx=0 tx=0).stop 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf008bd20 msgr2=0x7efcf01f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf008bd20 0x7efcf01f4f60 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7efce000e900 tx=0x7efce000edc0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 shutdown_connections 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efcd406be30 0x7efcd406e340 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcf00b3860 0x7efcf00ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcf008bd20 0x7efcf01f4f60 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 --2- 172.21.15.6:0/188954307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efcf006d870 0x7efcf014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 >> 172.21.15.6:0/188954307 conn(0x7efcf00b6d10 msgr2=0x7efcf00b9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 shutdown_connections 2024-05-20T18:01:18.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.474+0000 7efcf873e640 1 -- 172.21.15.6:0/188954307 wait complete. 2024-05-20T18:01:18.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-05-20T18:01:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.615+0000 7f9525557640 1 Processor -- start 2024-05-20T18:01:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.615+0000 7f9525557640 1 -- start start 2024-05-20T18:01:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.616+0000 7f9525557640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95200d4400 0x7f952015f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.616+0000 7f9525557640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f952006cf00 0x7f952006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.616+0000 7f9525557640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952008d2a0 con 0x7f95200d2780 2024-05-20T18:01:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f9525557640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f95200d3f70 con 0x7f952006cf00 2024-05-20T18:01:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f9525557640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f952006d850 con 0x7f95200d4400 2024-05-20T18:01:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951e7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f952006cf00 0x7f952006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f95200d2780 0x7f95200d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33334/0 (socket says 172.21.15.6:33334) 2024-05-20T18:01:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951f7fe640 1 -- 172.21.15.6:0/553527212 learned_addr learned my addr 172.21.15.6:0/553527212 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951effd640 1 --2- 172.21.15.6:0/553527212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95200d4400 0x7f952015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951e7fc640 1 -- 172.21.15.6:0/553527212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95200d4400 msgr2=0x7f952015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951e7fc640 1 --2- 172.21.15.6:0/553527212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95200d4400 0x7f952015f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951e7fc640 1 -- 172.21.15.6:0/553527212 >> v1:172.21.15.6:6789/0 conn(0x7f95200d2780 legacy=0x7f95200d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951dffb640 1 -- 172.21.15.6:0/553527212 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018155444 0 0) 0x7f9518001110 con 0x7f95200d2780 2024-05-20T18:01:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.617+0000 7f951e7fc640 1 -- 172.21.15.6:0/553527212 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95200d4810 con 0x7f952006cf00 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.618+0000 7f951e7fc640 1 --2- 172.21.15.6:0/553527212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f952006cf00 0x7f952006d310 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f95140097a0 tx=0x7f951402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667c902eddcb2a4f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.618+0000 7f951dffb640 1 -- 172.21.15.6:0/553527212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514037070 con 0x7f952006cf00 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.618+0000 7f951dffb640 1 -- 172.21.15.6:0/553527212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9514032440 con 0x7f952006cf00 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.618+0000 7f951dffb640 1 -- 172.21.15.6:0/553527212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514032810 con 0x7f952006cf00 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.619+0000 7f9525557640 1 -- 172.21.15.6:0/553527212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f952006cf00 msgr2=0x7f952006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.619+0000 7f9525557640 1 --2- 172.21.15.6:0/553527212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f952006cf00 0x7f952006d310 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f95140097a0 tx=0x7f951402a210 comp rx=0 tx=0).stop 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.619+0000 7f9525557640 1 -- 172.21.15.6:0/553527212 shutdown_connections 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.619+0000 7f9525557640 1 --2- 172.21.15.6:0/553527212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f952006cf00 0x7f952006d310 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.619+0000 7f9525557640 1 --2- 172.21.15.6:0/553527212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95200d4400 0x7f952015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.619+0000 7f9525557640 1 -- 172.21.15.6:0/553527212 >> 172.21.15.6:0/553527212 conn(0x7f95200d4bb0 msgr2=0x7f95200d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.619+0000 7f9525557640 1 -- 172.21.15.6:0/553527212 shutdown_connections 2024-05-20T18:01:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.619+0000 7f9525557640 1 -- 172.21.15.6:0/553527212 wait complete. 2024-05-20T18:01:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.621+0000 7f9525557640 1 Processor -- start 2024-05-20T18:01:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.621+0000 7f9525557640 1 -- start start 2024-05-20T18:01:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f9525557640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952006cf00 0x7f9520152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f9525557640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95200d2780 0x7f952015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f9525557640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95200d4400 0x7f952015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f9525557640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f95200d3920 con 0x7f95200d2780 2024-05-20T18:01:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f9525557640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f95200d3640 con 0x7f95200d4400 2024-05-20T18:01:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f9525557640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f95200d3c00 con 0x7f952006cf00 2024-05-20T18:01:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f951e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95200d2780 0x7f952015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f951e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95200d2780 0x7f952015c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36214/0 (socket says 172.21.15.6:36214) 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.622+0000 7f951e7fc640 1 -- 172.21.15.6:0/3315949430 learned_addr learned my addr 172.21.15.6:0/3315949430 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f951effd640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952006cf00 0x7f9520152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f951f7fe640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95200d4400 0x7f952015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f951e7fc640 1 -- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952006cf00 msgr2=0x7f9520152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f951e7fc640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952006cf00 0x7f9520152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f951e7fc640 1 -- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95200d4400 msgr2=0x7f952015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f951e7fc640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95200d4400 0x7f952015cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f951e7fc640 1 -- 172.21.15.6:0/3315949430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95201f5660 con 0x7f95200d2780 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f951e7fc640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95200d2780 0x7f952015c9c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f9514035040 tx=0x7f95140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f95077fe640 1 -- 172.21.15.6:0/3315949430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514037050 con 0x7f95200d2780 2024-05-20T18:01:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f95077fe640 1 -- 172.21.15.6:0/3315949430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9514038040 con 0x7f95200d2780 2024-05-20T18:01:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9520154f10 con 0x7f95200d2780 2024-05-20T18:01:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f95077fe640 1 -- 172.21.15.6:0/3315949430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514004470 con 0x7f95200d2780 2024-05-20T18:01:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.623+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95200b5fb0 con 0x7f95200d2780 2024-05-20T18:01:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.624+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952008cf70 con 0x7f95200d2780 2024-05-20T18:01:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.625+0000 7f95077fe640 1 -- 172.21.15.6:0/3315949430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f951403c6d0 con 0x7f95200d2780 2024-05-20T18:01:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.625+0000 7f95077fe640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950c06be30 0x7f950c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.626+0000 7f95077fe640 1 -- 172.21.15.6:0/3315949430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f95140ab710 con 0x7f95200d2780 2024-05-20T18:01:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.626+0000 7f951effd640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950c06be30 0x7f950c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.626+0000 7f951effd640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950c06be30 0x7f950c06e340 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f95100073f0 tx=0x7f951000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:18.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.630+0000 7f95077fe640 1 -- 172.21.15.6:0/3315949430 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f952008cf70 con 0x7f95200d2780 2024-05-20T18:01:18.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.813+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f9520155c90 con 0x7f95200d2780 2024-05-20T18:01:18.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.816+0000 7f95077fe640 1 -- 172.21.15.6:0/3315949430 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v41) ==== 107+0+0 (secure 0 0 0) 0x7f951404c020 con 0x7f95200d2780 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950c06be30 msgr2=0x7f950c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950c06be30 0x7f950c06e340 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f95100073f0 tx=0x7f951000b040 comp rx=0 tx=0).stop 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95200d2780 msgr2=0x7f952015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95200d2780 0x7f952015c9c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f9514035040 tx=0x7f95140046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 shutdown_connections 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f950c06be30 0x7f950c06e340 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95200d4400 0x7f952015cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95200d2780 0x7f952015c9c0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 --2- 172.21.15.6:0/3315949430 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f952006cf00 0x7f9520152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 >> 172.21.15.6:0/3315949430 conn(0x7f95200d4bb0 msgr2=0x7f952015fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 shutdown_connections 2024-05-20T18:01:18.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.818+0000 7f9525557640 1 -- 172.21.15.6:0/3315949430 wait complete. 2024-05-20T18:01:18.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-05-20T18:01:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.952+0000 7f388bea2640 1 Processor -- start 2024-05-20T18:01:18.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.952+0000 7f388bea2640 1 -- start start 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f388bea2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38840b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f388bea2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f38840b3e80 0x7f388406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f388bea2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388406dd20 con 0x7f388406d910 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f388bea2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f38840d0630 con 0x7f38840b3e80 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f388bea2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f38840d39c0 con 0x7f3884162820 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f388a43f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f388406d910 0x7f38840d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33344/0 (socket says 172.21.15.6:33344) 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f388a43f640 1 -- 172.21.15.6:0/115656389 learned_addr learned my addr 172.21.15.6:0/115656389 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f388943d640 1 --2- 172.21.15.6:0/115656389 >> v2:172.21.15.171:3300/0 conn(0x7f38840b3e80 0x7f388406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f3889c3e640 1 --2- 172.21.15.6:0/115656389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38840b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f3888c3c640 1 -- 172.21.15.6:0/115656389 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909064045 0 0) 0x7f387c001110 con 0x7f388406d910 2024-05-20T18:01:18.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.954+0000 7f3888c3c640 1 -- 172.21.15.6:0/115656389 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3870003520 con 0x7f388406d910 2024-05-20T18:01:18.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.955+0000 7f3889c3e640 1 -- 172.21.15.6:0/115656389 >> v2:172.21.15.171:3300/0 conn(0x7f38840b3e80 msgr2=0x7f388406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:18.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.955+0000 7f3889c3e640 1 --2- 172.21.15.6:0/115656389 >> v2:172.21.15.171:3300/0 conn(0x7f38840b3e80 0x7f388406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.955+0000 7f3888c3c640 1 -- 172.21.15.6:0/115656389 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2359499127 0 0) 0x7f3870003520 con 0x7f388406d910 2024-05-20T18:01:18.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.955+0000 7f3889c3e640 1 -- 172.21.15.6:0/115656389 >> v1:172.21.15.6:6789/0 conn(0x7f388406d910 legacy=0x7f38840d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.955+0000 7f3889c3e640 1 -- 172.21.15.6:0/115656389 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38840d3ca0 con 0x7f3884162820 2024-05-20T18:01:18.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.955+0000 7f388943d640 1 --2- 172.21.15.6:0/115656389 >> v2:172.21.15.171:3300/0 conn(0x7f38840b3e80 0x7f388406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.955+0000 7f3889c3e640 1 --2- 172.21.15.6:0/115656389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38840b3940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3880009d90 tx=0x7f388002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698488f3d265e55d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f3888c3c640 1 -- 172.21.15.6:0/115656389 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c001840 con 0x7f3884162820 2024-05-20T18:01:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f3888c3c640 1 -- 172.21.15.6:0/115656389 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3880007540 con 0x7f3884162820 2024-05-20T18:01:18.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f3888c3c640 1 -- 172.21.15.6:0/115656389 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38800078f0 con 0x7f3884162820 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f388bea2640 1 -- 172.21.15.6:0/115656389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 msgr2=0x7f38840b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f388bea2640 1 --2- 172.21.15.6:0/115656389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38840b3940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3880009d90 tx=0x7f388002a5f0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f388bea2640 1 -- 172.21.15.6:0/115656389 shutdown_connections 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f388bea2640 1 --2- 172.21.15.6:0/115656389 >> v2:172.21.15.171:3300/0 conn(0x7f38840b3e80 0x7f388406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f388bea2640 1 --2- 172.21.15.6:0/115656389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38840b3940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f388bea2640 1 -- 172.21.15.6:0/115656389 >> 172.21.15.6:0/115656389 conn(0x7f38840d4bd0 msgr2=0x7f38840d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f388bea2640 1 -- 172.21.15.6:0/115656389 shutdown_connections 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.956+0000 7f388bea2640 1 -- 172.21.15.6:0/115656389 wait complete. 2024-05-20T18:01:18.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.958+0000 7f388bea2640 1 Processor -- start 2024-05-20T18:01:18.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.958+0000 7f388bea2640 1 -- start start 2024-05-20T18:01:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388bea2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388406d910 0x7f38840cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388bea2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38840b3e80 0x7f38840ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388bea2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38841f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388bea2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f38840d0300 con 0x7f38840b3e80 2024-05-20T18:01:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388bea2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38840d4260 con 0x7f388406d910 2024-05-20T18:01:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388bea2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f38840b91a0 con 0x7f3884162820 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38840b3e80 0x7f38840ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38840b3e80 0x7f38840ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36224/0 (socket says 172.21.15.6:36224) 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 -- 172.21.15.6:0/21167251 learned_addr learned my addr 172.21.15.6:0/21167251 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f3889c3e640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388406d910 0x7f38840cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388a43f640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38841f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 -- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 msgr2=0x7f38841f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38841f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 -- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388406d910 msgr2=0x7f38840cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388406d910 0x7f38840cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 -- 172.21.15.6:0/21167251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38841e87c0 con 0x7f38840b3e80 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f3889c3e640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388406d910 0x7f38840cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388943d640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38840b3e80 0x7f38840ced30 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f387400e900 tx=0x7f387400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f387a7fc640 1 -- 172.21.15.6:0/21167251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874017070 con 0x7f38840b3e80 2024-05-20T18:01:18.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f387a7fc640 1 -- 172.21.15.6:0/21167251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387400ca00 con 0x7f38840b3e80 2024-05-20T18:01:18.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.960+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38841f5f80 con 0x7f38840b3e80 2024-05-20T18:01:18.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.961+0000 7f387a7fc640 1 -- 172.21.15.6:0/21167251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387400cdf0 con 0x7f38840b3e80 2024-05-20T18:01:18.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.961+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38840cbcf0 con 0x7f38840b3e80 2024-05-20T18:01:18.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.962+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38841f5cf0 con 0x7f38840b3e80 2024-05-20T18:01:18.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.962+0000 7f387a7fc640 1 -- 172.21.15.6:0/21167251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f387401a070 con 0x7f38840b3e80 2024-05-20T18:01:18.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.963+0000 7f387a7fc640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f386806be60 0x7f386806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:18.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.963+0000 7f387a7fc640 1 -- 172.21.15.6:0/21167251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f387408a810 con 0x7f38840b3e80 2024-05-20T18:01:18.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.963+0000 7f3889c3e640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f386806be60 0x7f386806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:18.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.964+0000 7f3889c3e640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f386806be60 0x7f386806e370 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3880034000 tx=0x7f388002f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:18.967+0000 7f387a7fc640 1 -- 172.21.15.6:0/21167251 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f38841e87c0 con 0x7f38840b3e80 2024-05-20T18:01:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.151+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7f3884075b00 con 0x7f38840b3e80 2024-05-20T18:01:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.154+0000 7f387a7fc640 1 -- 172.21.15.6:0/21167251 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v42) ==== 105+0+0 (secure 0 0 0) 0x7f3874058bd0 con 0x7f38840b3e80 2024-05-20T18:01:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.156+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f386806be60 msgr2=0x7f386806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.156+0000 7f388bea2640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f386806be60 0x7f386806e370 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3880034000 tx=0x7f388002f000 comp rx=0 tx=0).stop 2024-05-20T18:01:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.156+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38840b3e80 msgr2=0x7f38840ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.156+0000 7f388bea2640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38840b3e80 0x7f38840ced30 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f387400e900 tx=0x7f387400edc0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.157+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 shutdown_connections 2024-05-20T18:01:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.157+0000 7f388bea2640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f386806be60 0x7f386806e370 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.157+0000 7f388bea2640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3884162820 0x7f38841f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.157+0000 7f388bea2640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38840b3e80 0x7f38840ced30 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.157+0000 7f388bea2640 1 --2- 172.21.15.6:0/21167251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f388406d910 0x7f38840cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.157+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 >> 172.21.15.6:0/21167251 conn(0x7f38840d4bd0 msgr2=0x7f38840d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.157+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 shutdown_connections 2024-05-20T18:01:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.157+0000 7f388bea2640 1 -- 172.21.15.6:0/21167251 wait complete. 2024-05-20T18:01:19.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-05-20T18:01:19.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.285+0000 7f038938b640 1 Processor -- start 2024-05-20T18:01:19.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.285+0000 7f038938b640 1 -- start start 2024-05-20T18:01:19.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.286+0000 7f038938b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f038406d9a0 0x7f03840d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.286+0000 7f038938b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038415e6b0 con 0x7f038415d940 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.286+0000 7f038938b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03840d1100 con 0x7f03840b2f10 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.286+0000 7f038938b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f03840d2400 con 0x7f038406d9a0 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.286+0000 7f03827fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f038406d9a0 0x7f03840d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.286+0000 7f03837fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f038415d940 0x7f038415dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33358/0 (socket says 172.21.15.6:33358) 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.286+0000 7f03837fe640 1 -- 172.21.15.6:0/1904287473 learned_addr learned my addr 172.21.15.6:0/1904287473 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.287+0000 7f03827fc640 1 -- 172.21.15.6:0/1904287473 >> v1:172.21.15.171:6789/0 conn(0x7f03840b2f10 legacy=0x7f038406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.287+0000 7f03827fc640 1 -- 172.21.15.6:0/1904287473 >> v1:172.21.15.6:6789/0 conn(0x7f038415d940 legacy=0x7f038415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.287+0000 7f03827fc640 1 -- 172.21.15.6:0/1904287473 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03840d13e0 con 0x7f038406d9a0 2024-05-20T18:01:19.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.287+0000 7f0381ffb640 1 -- 172.21.15.6:0/1904287473 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501006973 0 0) 0x7f038415e6b0 con 0x7f038415d940 2024-05-20T18:01:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.287+0000 7f03827fc640 1 --2- 172.21.15.6:0/1904287473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f038406d9a0 0x7f03840d1ec0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f036c009790 tx=0x7f036c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f061c5a3847fa24 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f0381ffb640 1 -- 172.21.15.6:0/1904287473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c037070 con 0x7f038406d9a0 2024-05-20T18:01:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f0381ffb640 1 -- 172.21.15.6:0/1904287473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c032440 con 0x7f038406d9a0 2024-05-20T18:01:19.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f0381ffb640 1 -- 172.21.15.6:0/1904287473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c032810 con 0x7f038406d9a0 2024-05-20T18:01:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f038938b640 1 -- 172.21.15.6:0/1904287473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f038406d9a0 msgr2=0x7f03840d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f038938b640 1 --2- 172.21.15.6:0/1904287473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f038406d9a0 0x7f03840d1ec0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f036c009790 tx=0x7f036c02a180 comp rx=0 tx=0).stop 2024-05-20T18:01:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f038938b640 1 -- 172.21.15.6:0/1904287473 shutdown_connections 2024-05-20T18:01:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f038938b640 1 --2- 172.21.15.6:0/1904287473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f038406d9a0 0x7f03840d1ec0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f038938b640 1 -- 172.21.15.6:0/1904287473 >> 172.21.15.6:0/1904287473 conn(0x7f03840b6670 msgr2=0x7f03840b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f038938b640 1 -- 172.21.15.6:0/1904287473 shutdown_connections 2024-05-20T18:01:19.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.288+0000 7f038938b640 1 -- 172.21.15.6:0/1904287473 wait complete. 2024-05-20T18:01:19.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.290+0000 7f038938b640 1 Processor -- start 2024-05-20T18:01:19.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.290+0000 7f038938b640 1 -- start start 2024-05-20T18:01:19.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f038938b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f038406d9a0 0x7f038413dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f038938b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03840b2f10 0x7f038414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f038938b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f038415d940 0x7f038415fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f038938b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f03840b3320 con 0x7f03840b2f10 2024-05-20T18:01:19.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f038938b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f03840d1a30 con 0x7f038406d9a0 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f038938b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f038415e460 con 0x7f038415d940 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03840b2f10 0x7f038414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03840b2f10 0x7f038414dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36242/0 (socket says 172.21.15.6:36242) 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 -- 172.21.15.6:0/69164788 learned_addr learned my addr 172.21.15.6:0/69164788 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f0382ffd640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f038406d9a0 0x7f038413dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03837fe640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f038415d940 0x7f038415fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 -- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f038415d940 msgr2=0x7f038415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f038415d940 0x7f038415fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 -- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f038406d9a0 msgr2=0x7f038413dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f038406d9a0 0x7f038413dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 -- 172.21.15.6:0/69164788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038414e720 con 0x7f03840b2f10 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03837fe640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f038415d940 0x7f038415fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:19.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.292+0000 7f03827fc640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03840b2f10 0x7f038414dad0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f036c0098b0 tx=0x7f036c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.293+0000 7f037b7fe640 1 -- 172.21.15.6:0/69164788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c041070 con 0x7f03840b2f10 2024-05-20T18:01:19.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.293+0000 7f037b7fe640 1 -- 172.21.15.6:0/69164788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c03c890 con 0x7f03840b2f10 2024-05-20T18:01:19.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.293+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038414fe30 con 0x7f03840b2f10 2024-05-20T18:01:19.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.293+0000 7f037b7fe640 1 -- 172.21.15.6:0/69164788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c037040 con 0x7f03840b2f10 2024-05-20T18:01:19.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.293+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03841503f0 con 0x7f03840b2f10 2024-05-20T18:01:19.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.294+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0384075b00 con 0x7f03840b2f10 2024-05-20T18:01:19.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.294+0000 7f037b7fe640 1 -- 172.21.15.6:0/69164788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f036c044070 con 0x7f03840b2f10 2024-05-20T18:01:19.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.295+0000 7f037b7fe640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f036406be30 0x7f036406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.295+0000 7f037b7fe640 1 -- 172.21.15.6:0/69164788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f036c0ab9d0 con 0x7f03840b2f10 2024-05-20T18:01:19.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.295+0000 7f0382ffd640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f036406be30 0x7f036406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.296+0000 7f0382ffd640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f036406be30 0x7f036406e340 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f037c0012e0 tx=0x7f037c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.300+0000 7f037b7fe640 1 -- 172.21.15.6:0/69164788 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f036c07a3e0 con 0x7f03840b2f10 2024-05-20T18:01:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.485+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7f038414e470 con 0x7f03840b2f10 2024-05-20T18:01:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.488+0000 7f037b7fe640 1 -- 172.21.15.6:0/69164788 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v43) ==== 111+0+0 (secure 0 0 0) 0x7f036c079ce0 con 0x7f03840b2f10 2024-05-20T18:01:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f036406be30 msgr2=0x7f036406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f036406be30 0x7f036406e340 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f037c0012e0 tx=0x7f037c009040 comp rx=0 tx=0).stop 2024-05-20T18:01:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03840b2f10 msgr2=0x7f038414dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03840b2f10 0x7f038414dad0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f036c0098b0 tx=0x7f036c0046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 shutdown_connections 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f036406be30 0x7f036406e340 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f038415d940 0x7f038415fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03840b2f10 0x7f038414dad0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 --2- 172.21.15.6:0/69164788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f038406d9a0 0x7f038413dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 >> 172.21.15.6:0/69164788 conn(0x7f03840b6670 msgr2=0x7f038415dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 shutdown_connections 2024-05-20T18:01:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.490+0000 7f038938b640 1 -- 172.21.15.6:0/69164788 wait complete. 2024-05-20T18:01:19.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T18:01:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.618+0000 7f01b7614640 1 Processor -- start 2024-05-20T18:01:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.618+0000 7f01b7614640 1 -- start start 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b7614640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01b0163a10 0x7f01b00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b7614640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f01b00b4010 0x7f01b00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b7614640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01b00d0370 con 0x7f01b00d14b0 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b7614640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f01b00d3ca0 con 0x7f01b0163a10 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b7614640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f01b00d0650 con 0x7f01b00b4010 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b53b0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01b0163a10 0x7f01b00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b53b0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01b0163a10 0x7f01b00d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36252/0 (socket says 172.21.15.6:36252) 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b53b0640 1 -- 172.21.15.6:0/1831331818 learned_addr learned my addr 172.21.15.6:0/1831331818 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b5bb1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f01b00d14b0 0x7f01b00d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33360/0 (socket says 172.21.15.6:33360) 2024-05-20T18:01:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.619+0000 7f01b4baf640 1 --2- 172.21.15.6:0/1831331818 >> v2:172.21.15.171:3300/0 conn(0x7f01b00b4010 0x7f01b00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.620+0000 7f01b53b0640 1 -- 172.21.15.6:0/1831331818 >> v2:172.21.15.171:3300/0 conn(0x7f01b00b4010 msgr2=0x7f01b00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.620+0000 7f01b53b0640 1 --2- 172.21.15.6:0/1831331818 >> v2:172.21.15.171:3300/0 conn(0x7f01b00b4010 0x7f01b00cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.620+0000 7f01b53b0640 1 -- 172.21.15.6:0/1831331818 >> v1:172.21.15.6:6789/0 conn(0x7f01b00d14b0 legacy=0x7f01b00d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.620+0000 7f01b53b0640 1 -- 172.21.15.6:0/1831331818 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b00d3650 con 0x7f01b0163a10 2024-05-20T18:01:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.620+0000 7f01affff640 1 -- 172.21.15.6:0/1831331818 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759395406 0 0) 0x7f01b00d0370 con 0x7f01b00d14b0 2024-05-20T18:01:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.620+0000 7f01b53b0640 1 --2- 172.21.15.6:0/1831331818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b0163a10 0x7f01b00d4130 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f01b00b7f80 tx=0x7f01a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8a06b2bf54f157 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01affff640 1 -- 172.21.15.6:0/1831331818 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8037070 con 0x7f01b0163a10 2024-05-20T18:01:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01affff640 1 -- 172.21.15.6:0/1831331818 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a8032440 con 0x7f01b0163a10 2024-05-20T18:01:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01affff640 1 -- 172.21.15.6:0/1831331818 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8032810 con 0x7f01b0163a10 2024-05-20T18:01:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01b7614640 1 -- 172.21.15.6:0/1831331818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b0163a10 msgr2=0x7f01b00d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01b7614640 1 --2- 172.21.15.6:0/1831331818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b0163a10 0x7f01b00d4130 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f01b00b7f80 tx=0x7f01a802a270 comp rx=0 tx=0).stop 2024-05-20T18:01:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01b7614640 1 -- 172.21.15.6:0/1831331818 shutdown_connections 2024-05-20T18:01:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01b7614640 1 --2- 172.21.15.6:0/1831331818 >> v2:172.21.15.171:3300/0 conn(0x7f01b00b4010 0x7f01b00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01b7614640 1 --2- 172.21.15.6:0/1831331818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b0163a10 0x7f01b00d4130 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.621+0000 7f01b7614640 1 -- 172.21.15.6:0/1831331818 >> 172.21.15.6:0/1831331818 conn(0x7f01b006d240 msgr2=0x7f01b006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.622+0000 7f01b7614640 1 -- 172.21.15.6:0/1831331818 shutdown_connections 2024-05-20T18:01:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.622+0000 7f01b7614640 1 -- 172.21.15.6:0/1831331818 wait complete. 2024-05-20T18:01:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.623+0000 7f01b7614640 1 Processor -- start 2024-05-20T18:01:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.623+0000 7f01b7614640 1 -- start start 2024-05-20T18:01:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b7614640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b00b4010 0x7f01b00b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b7614640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b00d14b0 0x7f01b00b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b7614640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01b0163a10 0x7f01b0159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b7614640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f01b00b8210 con 0x7f01b00b4010 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b7614640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f01b00d0040 con 0x7f01b00d14b0 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b7614640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f01b00b8390 con 0x7f01b0163a10 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b00b4010 0x7f01b00b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b00b4010 0x7f01b00b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36266/0 (socket says 172.21.15.6:36266) 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 -- 172.21.15.6:0/1830244518 learned_addr learned my addr 172.21.15.6:0/1830244518 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b4baf640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b00d14b0 0x7f01b00b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b5bb1640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01b0163a10 0x7f01b0159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 -- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01b0163a10 msgr2=0x7f01b0159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01b0163a10 0x7f01b0159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 -- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b00d14b0 msgr2=0x7f01b00b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b00d14b0 0x7f01b00b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 -- 172.21.15.6:0/1830244518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b00ae0b0 con 0x7f01b00b4010 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b4baf640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b00d14b0 0x7f01b00b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01b53b0640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b00b4010 0x7f01b00b6f00 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f01a80090b0 tx=0x7f01a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.625+0000 7f01adffb640 1 -- 172.21.15.6:0/1830244518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8037040 con 0x7f01b00b4010 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.626+0000 7f01adffb640 1 -- 172.21.15.6:0/1830244518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a8004030 con 0x7f01b00b4010 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.626+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b00adaf0 con 0x7f01b00b4010 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.626+0000 7f01adffb640 1 -- 172.21.15.6:0/1830244518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a8004400 con 0x7f01b00b4010 2024-05-20T18:01:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.626+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b00ab720 con 0x7f01b00b4010 2024-05-20T18:01:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.627+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b0075b00 con 0x7f01b00b4010 2024-05-20T18:01:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.627+0000 7f01adffb640 1 -- 172.21.15.6:0/1830244518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01a803a070 con 0x7f01b00b4010 2024-05-20T18:01:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.628+0000 7f01adffb640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f019c06be60 0x7f019c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.628+0000 7f01adffb640 1 -- 172.21.15.6:0/1830244518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f01a80ab360 con 0x7f01b00b4010 2024-05-20T18:01:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.628+0000 7f01b4baf640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f019c06be60 0x7f019c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.629+0000 7f01b4baf640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f019c06be60 0x7f019c06e370 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f01b015e380 tx=0x7f01a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.632+0000 7f01adffb640 1 -- 172.21.15.6:0/1830244518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f01b00ae0b0 con 0x7f01b00b4010 2024-05-20T18:01:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.816+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f01b015d670 con 0x7f01b00b4010 2024-05-20T18:01:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.819+0000 7f01adffb640 1 -- 172.21.15.6:0/1830244518 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v44) ==== 104+0+0 (secure 0 0 0) 0x7f01a80a9e20 con 0x7f01b00b4010 2024-05-20T18:01:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f019c06be60 msgr2=0x7f019c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f019c06be60 0x7f019c06e370 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f01b015e380 tx=0x7f01a4008040 comp rx=0 tx=0).stop 2024-05-20T18:01:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b00b4010 msgr2=0x7f01b00b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b00b4010 0x7f01b00b6f00 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f01a80090b0 tx=0x7f01a80046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 shutdown_connections 2024-05-20T18:01:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f019c06be60 0x7f019c06e370 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01b0163a10 0x7f01b0159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b00d14b0 0x7f01b00b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 --2- 172.21.15.6:0/1830244518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b00b4010 0x7f01b00b6f00 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 >> 172.21.15.6:0/1830244518 conn(0x7f01b006d240 msgr2=0x7f01b00676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 shutdown_connections 2024-05-20T18:01:19.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.821+0000 7f01b7614640 1 -- 172.21.15.6:0/1830244518 wait complete. 2024-05-20T18:01:19.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-05-20T18:01:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.951+0000 7f3de7ae9640 1 Processor -- start 2024-05-20T18:01:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.951+0000 7f3de7ae9640 1 -- start start 2024-05-20T18:01:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.952+0000 7f3de7ae9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de015f220 0x7f3de00d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.952+0000 7f3de7ae9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de00cfae0 0x7f3de00ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.952+0000 7f3de7ae9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de00cda20 con 0x7f3de00d0e00 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.952+0000 7f3de7ae9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3de00cdd00 con 0x7f3de015f220 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.952+0000 7f3de7ae9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00cdfe0 con 0x7f3de00cfae0 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de5885640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de015f220 0x7f3de00d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de5885640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de015f220 0x7f3de00d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36282/0 (socket says 172.21.15.6:36282) 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de5885640 1 -- 172.21.15.6:0/704152717 learned_addr learned my addr 172.21.15.6:0/704152717 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de6086640 1 --2- 172.21.15.6:0/704152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de00cfae0 0x7f3de00ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de5885640 1 -- 172.21.15.6:0/704152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de00cfae0 msgr2=0x7f3de00ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de5885640 1 --2- 172.21.15.6:0/704152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de00cfae0 0x7f3de00ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de5885640 1 -- 172.21.15.6:0/704152717 >> v1:172.21.15.171:6789/0 conn(0x7f3de00d0e00 legacy=0x7f3de00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de5885640 1 -- 172.21.15.6:0/704152717 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de00ce2c0 con 0x7f3de015f220 2024-05-20T18:01:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.953+0000 7f3de6086640 1 --2- 172.21.15.6:0/704152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de00cfae0 0x7f3de00ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.954+0000 7f3de5885640 1 --2- 172.21.15.6:0/704152717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de015f220 0x7f3de00d08c0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009870 tx=0x7f3ddc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dab0ddc1b8c449 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.954+0000 7f3de4883640 1 -- 172.21.15.6:0/704152717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc037070 con 0x7f3de015f220 2024-05-20T18:01:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.954+0000 7f3de4883640 1 -- 172.21.15.6:0/704152717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc032440 con 0x7f3de015f220 2024-05-20T18:01:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.954+0000 7f3de4883640 1 -- 172.21.15.6:0/704152717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc032810 con 0x7f3de015f220 2024-05-20T18:01:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.955+0000 7f3de7ae9640 1 -- 172.21.15.6:0/704152717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de015f220 msgr2=0x7f3de00d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.955+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/704152717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de015f220 0x7f3de00d08c0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009870 tx=0x7f3ddc02a1c0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.955+0000 7f3de7ae9640 1 -- 172.21.15.6:0/704152717 shutdown_connections 2024-05-20T18:01:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.955+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/704152717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de00cfae0 0x7f3de00ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.955+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/704152717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de015f220 0x7f3de00d08c0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.955+0000 7f3de7ae9640 1 -- 172.21.15.6:0/704152717 >> 172.21.15.6:0/704152717 conn(0x7f3de00b44d0 msgr2=0x7f3de00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.955+0000 7f3de7ae9640 1 -- 172.21.15.6:0/704152717 shutdown_connections 2024-05-20T18:01:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.955+0000 7f3de7ae9640 1 -- 172.21.15.6:0/704152717 wait complete. 2024-05-20T18:01:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.957+0000 7f3de7ae9640 1 Processor -- start 2024-05-20T18:01:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.957+0000 7f3de7ae9640 1 -- start start 2024-05-20T18:01:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de7ae9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de00d0e00 0x7f3de00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de7ae9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de015f220 0x7f3de00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de7ae9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3de0152050 0x7f3de00b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de7ae9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3de015f7b0 con 0x7f3de00d0e00 2024-05-20T18:01:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de7ae9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3de015f630 con 0x7f3de0152050 2024-05-20T18:01:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de7ae9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00ced20 con 0x7f3de015f220 2024-05-20T18:01:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5885640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de00d0e00 0x7f3de00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5885640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de00d0e00 0x7f3de00b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36290/0 (socket says 172.21.15.6:36290) 2024-05-20T18:01:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5885640 1 -- 172.21.15.6:0/674429694 learned_addr learned my addr 172.21.15.6:0/674429694 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de6086640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3de0152050 0x7f3de00b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5084640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de015f220 0x7f3de00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5885640 1 -- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de015f220 msgr2=0x7f3de00b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5885640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de015f220 0x7f3de00b77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5885640 1 -- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3de0152050 msgr2=0x7f3de00b7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5885640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3de0152050 0x7f3de00b7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5885640 1 -- 172.21.15.6:0/674429694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de00b7060 con 0x7f3de00d0e00 2024-05-20T18:01:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.958+0000 7f3de5084640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de015f220 0x7f3de00b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.959+0000 7f3de5885640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de00d0e00 0x7f3de00b55e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc000c00 tx=0x7f3ddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.959+0000 7f3dd67fc640 1 -- 172.21.15.6:0/674429694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc041020 con 0x7f3de00d0e00 2024-05-20T18:01:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.959+0000 7f3dd67fc640 1 -- 172.21.15.6:0/674429694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0306c0 con 0x7f3de00d0e00 2024-05-20T18:01:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.959+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de00b5fc0 con 0x7f3de00d0e00 2024-05-20T18:01:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.959+0000 7f3dd67fc640 1 -- 172.21.15.6:0/674429694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc037040 con 0x7f3de00d0e00 2024-05-20T18:01:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.959+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de00b6580 con 0x7f3de00d0e00 2024-05-20T18:01:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.960+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de0075b00 con 0x7f3de00d0e00 2024-05-20T18:01:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.960+0000 7f3dd67fc640 1 -- 172.21.15.6:0/674429694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ddc044020 con 0x7f3de00d0e00 2024-05-20T18:01:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.961+0000 7f3dd67fc640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3dc406be60 0x7f3dc406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.961+0000 7f3dd67fc640 1 -- 172.21.15.6:0/674429694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f3ddc0ab190 con 0x7f3de00d0e00 2024-05-20T18:01:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.961+0000 7f3de5084640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3dc406be60 0x7f3dc406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.962+0000 7f3de5084640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3dc406be60 0x7f3dc406e370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3de0158a50 tx=0x7f3dd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:19.966+0000 7f3dd67fc640 1 -- 172.21.15.6:0/674429694 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3ddc04b070 con 0x7f3de00d0e00 2024-05-20T18:01:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.153+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7f3de0162c60 con 0x7f3de00d0e00 2024-05-20T18:01:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.157+0000 7f3dd67fc640 1 -- 172.21.15.6:0/674429694 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v45) ==== 102+0+0 (secure 0 0 0) 0x7f3ddc079c20 con 0x7f3de00d0e00 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3dc406be60 msgr2=0x7f3dc406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3dc406be60 0x7f3dc406e370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3de0158a50 tx=0x7f3dd0009040 comp rx=0 tx=0).stop 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de00d0e00 msgr2=0x7f3de00b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de00d0e00 0x7f3de00b55e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc000c00 tx=0x7f3ddc0046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 shutdown_connections 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3dc406be60 0x7f3dc406e370 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3de0152050 0x7f3de00b7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3de015f220 0x7f3de00b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 --2- 172.21.15.6:0/674429694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de00d0e00 0x7f3de00b55e0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.159+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 >> 172.21.15.6:0/674429694 conn(0x7f3de00b44d0 msgr2=0x7f3de00d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.160+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 shutdown_connections 2024-05-20T18:01:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.160+0000 7f3de7ae9640 1 -- 172.21.15.6:0/674429694 wait complete. 2024-05-20T18:01:20.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin' 2024-05-20T18:01:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.286+0000 7fef3157e640 1 Processor -- start 2024-05-20T18:01:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.286+0000 7fef3157e640 1 -- start start 2024-05-20T18:01:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef3157e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c09ac00 0x7fef2c0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef3157e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef2c160700 con 0x7fef2c06da80 2024-05-20T18:01:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef3157e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef2c0af9d0 con 0x7fef2c1602f0 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef3157e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef2c159da0 con 0x7fef2c09ac00 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef2affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef2c06da80 0x7fef2c0b1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33376/0 (socket says 172.21.15.6:33376) 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef2affd640 1 -- 172.21.15.6:0/3743251677 learned_addr learned my addr 172.21.15.6:0/3743251677 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef2b7fe640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c09ac00 0x7fef2c0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865167406 0 0) 0x7fef24001490 con 0x7fef2c06da80 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.287+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef18003520 con 0x7fef2c06da80 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 613832598 0 0) 0x7fef18003520 con 0x7fef2c06da80 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c09ac00 msgr2=0x7fef2c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c09ac00 0x7fef2c0d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 >> v1:172.21.15.171:6789/0 conn(0x7fef2c1602f0 legacy=0x7fef2c09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c0af410 con 0x7fef2c06da80 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fef24001bc0 con 0x7fef2c06da80 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 >> v1:172.21.15.6:6789/0 conn(0x7fef2c06da80 legacy=0x7fef2c0b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef180039e0 0x7fef18003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef18004800 0x7fef18004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef18005150 0x7fef1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fef1800bfb0 con 0x7fef180039e0 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef1800c130 con 0x7fef18005150 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef1800c300 con 0x7fef18004800 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2affd640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef180039e0 0x7fef18003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2a7fc640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef18004800 0x7fef18004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2b7fe640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef18005150 0x7fef1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2affd640 1 -- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef18004800 msgr2=0x7fef18004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2affd640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef18004800 0x7fef18004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2affd640 1 -- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef18005150 msgr2=0x7fef1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2affd640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef18005150 0x7fef1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2affd640 1 -- 172.21.15.6:0/3743251677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef18003520 con 0x7fef180039e0 2024-05-20T18:01:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.288+0000 7fef2a7fc640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef18004800 0x7fef18004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.289+0000 7fef2affd640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef180039e0 0x7fef18003e50 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fef2400aa00 tx=0x7fef18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1a371a87c8375e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.289+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2400a650 con 0x7fef180039e0 2024-05-20T18:01:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.289+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2402f070 con 0x7fef180039e0 2024-05-20T18:01:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.289+0000 7fef29ffb640 1 -- 172.21.15.6:0/3743251677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24034470 con 0x7fef180039e0 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.290+0000 7fef3157e640 1 -- 172.21.15.6:0/3743251677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef180039e0 msgr2=0x7fef18003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.290+0000 7fef3157e640 1 --2- 172.21.15.6:0/3743251677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef180039e0 0x7fef18003e50 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fef2400aa00 tx=0x7fef18005830 comp rx=0 tx=0).stop 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.290+0000 7fef2b7fe640 1 -- 172.21.15.6:0/3743251677 reap_dead start 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.290+0000 7fef3157e640 1 -- 172.21.15.6:0/3743251677 shutdown_connections 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.290+0000 7fef3157e640 1 -- 172.21.15.6:0/3743251677 >> 172.21.15.6:0/3743251677 conn(0x7fef2c0b6670 msgr2=0x7fef2c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.290+0000 7fef3157e640 1 -- 172.21.15.6:0/3743251677 shutdown_connections 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.290+0000 7fef3157e640 1 -- 172.21.15.6:0/3743251677 wait complete. 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.292+0000 7fef3157e640 1 Processor -- start 2024-05-20T18:01:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.292+0000 7fef3157e640 1 -- start start 2024-05-20T18:01:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef3157e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef180039e0 0x7fef2c15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef3157e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c1570f0 0x7fef2c1f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef3157e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c157cb0 0x7fef2c1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef3157e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c0d17b0 con 0x7fef2c1570f0 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef3157e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef2c0af1c0 con 0x7fef2c157cb0 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef3157e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef2c0b2390 con 0x7fef180039e0 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef2a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c1570f0 0x7fef2c1f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef2a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c1570f0 0x7fef2c1f7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36304/0 (socket says 172.21.15.6:36304) 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.293+0000 7fef2a7fc640 1 -- 172.21.15.6:0/634490935 learned_addr learned my addr 172.21.15.6:0/634490935 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2affd640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef180039e0 0x7fef2c15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2b7fe640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c157cb0 0x7fef2c1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2a7fc640 1 -- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef180039e0 msgr2=0x7fef2c15ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2a7fc640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef180039e0 0x7fef2c15ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2a7fc640 1 -- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c157cb0 msgr2=0x7fef2c1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2a7fc640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c157cb0 0x7fef2c1580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2a7fc640 1 -- 172.21.15.6:0/634490935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2c158600 con 0x7fef2c1570f0 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2b7fe640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c157cb0 0x7fef2c1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef2a7fc640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c1570f0 0x7fef2c1f7f30 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fef1400e4a0 tx=0x7fef1400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef237fe640 1 -- 172.21.15.6:0/634490935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef140052e0 con 0x7fef2c1570f0 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef237fe640 1 -- 172.21.15.6:0/634490935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef14018070 con 0x7fef2c1570f0 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2c159e30 con 0x7fef2c1570f0 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef237fe640 1 -- 172.21.15.6:0/634490935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14003860 con 0x7fef2c1570f0 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.294+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2c15a3f0 con 0x7fef2c1570f0 2024-05-20T18:01:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.295+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef2c075b00 con 0x7fef2c1570f0 2024-05-20T18:01:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.296+0000 7fef237fe640 1 -- 172.21.15.6:0/634490935 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef14003a00 con 0x7fef2c1570f0 2024-05-20T18:01:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.296+0000 7fef237fe640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef0c06be30 0x7fef0c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.297+0000 7fef237fe640 1 -- 172.21.15.6:0/634490935 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7fef1408a9e0 con 0x7fef2c1570f0 2024-05-20T18:01:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.297+0000 7fef2affd640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef0c06be30 0x7fef0c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:20.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.297+0000 7fef2affd640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef0c06be30 0x7fef0c06e340 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fef24033000 tx=0x7fef24009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.301+0000 7fef237fe640 1 -- 172.21.15.6:0/634490935 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fef2c158600 con 0x7fef2c1570f0 2024-05-20T18:01:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:20.559+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]} v 0) -- 0x7fef2c159ba0 con 0x7fef2c1570f0 2024-05-20T18:01:21.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.476+0000 7fef237fe640 1 -- 172.21.15.6:0/634490935 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]}]=0 v430) ==== 143+0+0 (secure 0 0 0) 0x7fef14059470 con 0x7fef2c1570f0 2024-05-20T18:01:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef0c06be30 msgr2=0x7fef0c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef0c06be30 0x7fef0c06e340 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fef24033000 tx=0x7fef24009030 comp rx=0 tx=0).stop 2024-05-20T18:01:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c1570f0 msgr2=0x7fef2c1f7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c1570f0 0x7fef2c1f7f30 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fef1400e4a0 tx=0x7fef1400e960 comp rx=0 tx=0).stop 2024-05-20T18:01:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 shutdown_connections 2024-05-20T18:01:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef0c06be30 0x7fef0c06e340 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c157cb0 0x7fef2c1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2c1570f0 0x7fef2c1f7f30 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 --2- 172.21.15.6:0/634490935 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef180039e0 0x7fef2c15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 >> 172.21.15.6:0/634490935 conn(0x7fef2c0b6670 msgr2=0x7fef2c067490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 shutdown_connections 2024-05-20T18:01:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.479+0000 7fef3157e640 1 -- 172.21.15.6:0/634490935 wait complete. 2024-05-20T18:01:21.491 INFO:tasks.cephfs_test_runner:test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-05-20T18:01:21.491 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin_mincaps (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T18:01:21.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.616+0000 7f99e64c3640 1 Processor -- start 2024-05-20T18:01:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.616+0000 7f99e64c3640 1 -- start start 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99e64c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99e00ce7a0 0x7f99e00afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99e64c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 0x7f99e00b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99e64c3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f99e00b21f0 0x7f99e006b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99e64c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f99e00d17f0 con 0x7f99e00ce7a0 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99e64c3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f99e00d0c00 con 0x7f99e00b21f0 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99e64c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f99e00d0ec0 con 0x7f99e015f3f0 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99e00ce7a0 0x7f99e00afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99e00ce7a0 0x7f99e00afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36308/0 (socket says 172.21.15.6:36308) 2024-05-20T18:01:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.617+0000 7f99dffff640 1 -- 172.21.15.6:0/376070134 learned_addr learned my addr 172.21.15.6:0/376070134 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.618+0000 7f99e4a60640 1 --2- 172.21.15.6:0/376070134 >> v2:172.21.15.171:3300/0 conn(0x7f99e00b21f0 0x7f99e006b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.618+0000 7f99d7fff640 1 --2- 172.21.15.6:0/376070134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 0x7f99e00b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.618+0000 7f99dffff640 1 -- 172.21.15.6:0/376070134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 msgr2=0x7f99e00b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.618+0000 7f99dffff640 1 --2- 172.21.15.6:0/376070134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 0x7f99e00b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.618+0000 7f99dffff640 1 -- 172.21.15.6:0/376070134 >> v2:172.21.15.171:3300/0 conn(0x7f99e00b21f0 msgr2=0x7f99e006b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.618+0000 7f99dffff640 1 --2- 172.21.15.6:0/376070134 >> v2:172.21.15.171:3300/0 conn(0x7f99e00b21f0 0x7f99e006b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.618+0000 7f99dffff640 1 -- 172.21.15.6:0/376070134 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e00d11a0 con 0x7f99e00ce7a0 2024-05-20T18:01:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.618+0000 7f99dffff640 1 --2- 172.21.15.6:0/376070134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e00afe30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f99e0073620 tx=0x7f99d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ac4375aa52a30f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99df7fe640 1 -- 172.21.15.6:0/376070134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0037070 con 0x7f99e00ce7a0 2024-05-20T18:01:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99df7fe640 1 -- 172.21.15.6:0/376070134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d0032440 con 0x7f99e00ce7a0 2024-05-20T18:01:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99df7fe640 1 -- 172.21.15.6:0/376070134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0032810 con 0x7f99e00ce7a0 2024-05-20T18:01:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 -- 172.21.15.6:0/376070134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 msgr2=0x7f99e00afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 --2- 172.21.15.6:0/376070134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e00afe30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f99e0073620 tx=0x7f99d002a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 -- 172.21.15.6:0/376070134 shutdown_connections 2024-05-20T18:01:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 --2- 172.21.15.6:0/376070134 >> v2:172.21.15.171:3300/0 conn(0x7f99e00b21f0 0x7f99e006b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 --2- 172.21.15.6:0/376070134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 0x7f99e00b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 --2- 172.21.15.6:0/376070134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e00afe30 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 -- 172.21.15.6:0/376070134 >> 172.21.15.6:0/376070134 conn(0x7f99e009a4f0 msgr2=0x7f99e00b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 -- 172.21.15.6:0/376070134 shutdown_connections 2024-05-20T18:01:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.619+0000 7f99e64c3640 1 -- 172.21.15.6:0/376070134 wait complete. 2024-05-20T18:01:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.621+0000 7f99e64c3640 1 Processor -- start 2024-05-20T18:01:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.621+0000 7f99e64c3640 1 -- start start 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.622+0000 7f99e64c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00b21f0 0x7f99e0162050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.622+0000 7f99e64c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e014d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99e64c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 0x7f99e0157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99e64c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f99e00b6460 con 0x7f99e00ce7a0 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99e64c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f99e00b2600 con 0x7f99e00b21f0 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99e64c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f99e00b65e0 con 0x7f99e015f3f0 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e014d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e014d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36316/0 (socket says 172.21.15.6:36316) 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 -- 172.21.15.6:0/2079948343 learned_addr learned my addr 172.21.15.6:0/2079948343 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99dffff640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00b21f0 0x7f99e0162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99e4a60640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 0x7f99e0157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 -- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 msgr2=0x7f99e0157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 0x7f99e0157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 -- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00b21f0 msgr2=0x7f99e0162050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00b21f0 0x7f99e0162050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 -- 172.21.15.6:0/2079948343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e01564b0 con 0x7f99e00ce7a0 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99d7fff640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e014d620 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f99c800d620 tx=0x7f99c800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99dd7fa640 1 -- 172.21.15.6:0/2079948343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c800b620 con 0x7f99e00ce7a0 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99dd7fa640 1 -- 172.21.15.6:0/2079948343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c8019070 con 0x7f99e00ce7a0 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e0156790 con 0x7f99e00ce7a0 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.623+0000 7f99dd7fa640 1 -- 172.21.15.6:0/2079948343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c800ba00 con 0x7f99e00ce7a0 2024-05-20T18:01:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.624+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e0156d50 con 0x7f99e00ce7a0 2024-05-20T18:01:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.625+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e0075b00 con 0x7f99e00ce7a0 2024-05-20T18:01:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.625+0000 7f99dd7fa640 1 -- 172.21.15.6:0/2079948343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99c800bba0 con 0x7f99e00ce7a0 2024-05-20T18:01:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.626+0000 7f99dd7fa640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f99c006be60 0x7f99c006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.626+0000 7f99dd7fa640 1 -- 172.21.15.6:0/2079948343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f99c808b000 con 0x7f99e00ce7a0 2024-05-20T18:01:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.626+0000 7f99dffff640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f99c006be60 0x7f99c006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.627+0000 7f99dffff640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f99c006be60 0x7f99c006e370 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f99d0034000 tx=0x7f99d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:21.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.631+0000 7f99dd7fa640 1 -- 172.21.15.6:0/2079948343 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f99c8059430 con 0x7f99e00ce7a0 2024-05-20T18:01:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.813+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99e0068a90 con 0x7f99e00ce7a0 2024-05-20T18:01:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.814+0000 7f99dd7fa640 1 -- 172.21.15.6:0/2079948343 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+13253 (secure 0 0 0) 0x7f99c805d730 con 0x7f99e00ce7a0 2024-05-20T18:01:21.814 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:21.814 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":116,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:18.465130+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/3266600943":"2024-05-21T18:01:15.235126+0000","172.21.15.6:6832/3266600943":"2024-05-21T18:01:15.235126+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f99c006be60 msgr2=0x7f99c006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f99c006be60 0x7f99c006e370 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f99d0034000 tx=0x7f99d002e000 comp rx=0 tx=0).stop 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 msgr2=0x7f99e014d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e014d620 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f99c800d620 tx=0x7f99c800dae0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 shutdown_connections 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f99c006be60 0x7f99c006e370 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f99e015f3f0 0x7f99e0157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e00ce7a0 0x7f99e014d620 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 --2- 172.21.15.6:0/2079948343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99e00b21f0 0x7f99e0162050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 >> 172.21.15.6:0/2079948343 conn(0x7f99e009a4f0 msgr2=0x7f99e006e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 shutdown_connections 2024-05-20T18:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.816+0000 7f99e64c3640 1 -- 172.21.15.6:0/2079948343 wait complete. 2024-05-20T18:01:21.826 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:01:21.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:01:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.946+0000 7f473639d640 1 Processor -- start 2024-05-20T18:01:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.946+0000 7f473639d640 1 -- start start 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f473639d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47300b00b0 0x7f47300b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f473639d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f473015fd80 0x7f473006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f473639d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473006c700 con 0x7f473006c2f0 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f473639d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f473015c690 con 0x7f473015fd80 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f473639d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f47300b4860 con 0x7f47300b00b0 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f472f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f473015fd80 0x7f473006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f472f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f473015fd80 0x7f473006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36320/0 (socket says 172.21.15.6:36320) 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f472f7fe640 1 -- 172.21.15.6:0/2358762306 learned_addr learned my addr 172.21.15.6:0/2358762306 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.947+0000 7f472ffff640 1 --2- 172.21.15.6:0/2358762306 >> v2:172.21.15.171:3300/0 conn(0x7f47300b00b0 0x7f47300b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.948+0000 7f472f7fe640 1 -- 172.21.15.6:0/2358762306 >> v2:172.21.15.171:3300/0 conn(0x7f47300b00b0 msgr2=0x7f47300b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.948+0000 7f472f7fe640 1 --2- 172.21.15.6:0/2358762306 >> v2:172.21.15.171:3300/0 conn(0x7f47300b00b0 0x7f47300b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.948+0000 7f472f7fe640 1 -- 172.21.15.6:0/2358762306 >> v1:172.21.15.171:6789/0 conn(0x7f473006c2f0 legacy=0x7f47300ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.948+0000 7f472f7fe640 1 -- 172.21.15.6:0/2358762306 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47300b52e0 con 0x7f473015fd80 2024-05-20T18:01:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.948+0000 7f472f7fe640 1 --2- 172.21.15.6:0/2358762306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473015fd80 0x7f473006bdb0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f4730073a40 tx=0x7f472402c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84464dec3660faa server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.948+0000 7f472effd640 1 -- 172.21.15.6:0/2358762306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472403a070 con 0x7f473015fd80 2024-05-20T18:01:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f472effd640 1 -- 172.21.15.6:0/2358762306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4724032480 con 0x7f473015fd80 2024-05-20T18:01:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f472effd640 1 -- 172.21.15.6:0/2358762306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724032650 con 0x7f473015fd80 2024-05-20T18:01:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f473639d640 1 -- 172.21.15.6:0/2358762306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473015fd80 msgr2=0x7f473006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f473639d640 1 --2- 172.21.15.6:0/2358762306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473015fd80 0x7f473006bdb0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f4730073a40 tx=0x7f472402c620 comp rx=0 tx=0).stop 2024-05-20T18:01:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f473639d640 1 -- 172.21.15.6:0/2358762306 shutdown_connections 2024-05-20T18:01:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f473639d640 1 --2- 172.21.15.6:0/2358762306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473015fd80 0x7f473006bdb0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f473639d640 1 --2- 172.21.15.6:0/2358762306 >> v2:172.21.15.171:3300/0 conn(0x7f47300b00b0 0x7f47300b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f473639d640 1 -- 172.21.15.6:0/2358762306 >> 172.21.15.6:0/2358762306 conn(0x7f47300cd2a0 msgr2=0x7f47300cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f473639d640 1 -- 172.21.15.6:0/2358762306 shutdown_connections 2024-05-20T18:01:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.949+0000 7f473639d640 1 -- 172.21.15.6:0/2358762306 wait complete. 2024-05-20T18:01:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.951+0000 7f473639d640 1 Processor -- start 2024-05-20T18:01:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.951+0000 7f473639d640 1 -- start start 2024-05-20T18:01:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f473639d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473006c2f0 0x7f4730153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f473639d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47300b00b0 0x7f47300b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f473639d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f473015fd80 0x7f47301f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f473639d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4730160190 con 0x7f473006c2f0 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f473639d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f473015c320 con 0x7f473015fd80 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f473639d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f473015bc30 con 0x7f47300b00b0 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473006c2f0 0x7f4730153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473006c2f0 0x7f4730153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36332/0 (socket says 172.21.15.6:36332) 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 -- 172.21.15.6:0/2862331685 learned_addr learned my addr 172.21.15.6:0/2862331685 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472f7fe640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47300b00b0 0x7f47300b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f473493a640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f473015fd80 0x7f47301f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 -- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47300b00b0 msgr2=0x7f47300b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47300b00b0 0x7f47300b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 -- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f473015fd80 msgr2=0x7f47301f9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f473015fd80 0x7f47301f9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 -- 172.21.15.6:0/2862331685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473015cee0 con 0x7f473006c2f0 2024-05-20T18:01:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.953+0000 7f472ffff640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473006c2f0 0x7f4730153c20 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f472000d5a0 tx=0x7f472000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.954+0000 7f472cff9640 1 -- 172.21.15.6:0/2862331685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720019070 con 0x7f473006c2f0 2024-05-20T18:01:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.954+0000 7f472cff9640 1 -- 172.21.15.6:0/2862331685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4720004240 con 0x7f473006c2f0 2024-05-20T18:01:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.954+0000 7f472cff9640 1 -- 172.21.15.6:0/2862331685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720003610 con 0x7f473006c2f0 2024-05-20T18:01:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.954+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473015d1c0 con 0x7f473006c2f0 2024-05-20T18:01:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.954+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473015d780 con 0x7f473006c2f0 2024-05-20T18:01:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.955+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473015b8a0 con 0x7f473006c2f0 2024-05-20T18:01:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.955+0000 7f472cff9640 1 -- 172.21.15.6:0/2862331685 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f472001c070 con 0x7f473006c2f0 2024-05-20T18:01:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.956+0000 7f472cff9640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f471c06be60 0x7f471c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.956+0000 7f472cff9640 1 -- 172.21.15.6:0/2862331685 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f472008a540 con 0x7f473006c2f0 2024-05-20T18:01:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.956+0000 7f472f7fe640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f471c06be60 0x7f471c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.957+0000 7f472f7fe640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f471c06be60 0x7f471c06e370 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4724037000 tx=0x7f4724030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:21.960+0000 7f472cff9640 1 -- 172.21.15.6:0/2862331685 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f473015b8a0 con 0x7f473006c2f0 2024-05-20T18:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.142+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4730075b00 con 0x7f473006c2f0 2024-05-20T18:01:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.142+0000 7f472cff9640 1 -- 172.21.15.6:0/2862331685 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) ==== 93+0+10 (secure 0 0 0) 0x7f4720058a10 con 0x7f473006c2f0 2024-05-20T18:01:22.140 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:01:22.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f471c06be60 msgr2=0x7f471c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:22.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f471c06be60 0x7f471c06e370 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4724037000 tx=0x7f4724030000 comp rx=0 tx=0).stop 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473006c2f0 msgr2=0x7f4730153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473006c2f0 0x7f4730153c20 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f472000d5a0 tx=0x7f472000da60 comp rx=0 tx=0).stop 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 shutdown_connections 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f471c06be60 0x7f471c06e370 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f473015fd80 0x7f47301f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47300b00b0 0x7f47300b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 --2- 172.21.15.6:0/2862331685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f473006c2f0 0x7f4730153c20 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 >> 172.21.15.6:0/2862331685 conn(0x7f47300cd2a0 msgr2=0x7f47300b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 shutdown_connections 2024-05-20T18:01:22.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.144+0000 7f473639d640 1 -- 172.21.15.6:0/2862331685 wait complete. 2024-05-20T18:01:22.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps' 2024-05-20T18:01:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.271+0000 7ff627b45640 1 Processor -- start 2024-05-20T18:01:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.271+0000 7ff627b45640 1 -- start start 2024-05-20T18:01:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.272+0000 7ff627b45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff620071630 0x7ff62015f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.272+0000 7ff627b45640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff620070850 0x7ff620070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.272+0000 7ff627b45640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6200711a0 con 0x7ff6200cd1b0 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.272+0000 7ff627b45640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff62015f790 con 0x7ff620071630 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.272+0000 7ff627b45640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff62006e590 con 0x7ff620070850 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.272+0000 7ff6258e1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff620071630 0x7ff62015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.272+0000 7ff6258e1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff620071630 0x7ff62015f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36346/0 (socket says 172.21.15.6:36346) 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.272+0000 7ff6258e1640 1 -- 172.21.15.6:0/1564371620 learned_addr learned my addr 172.21.15.6:0/1564371620 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.273+0000 7ff6260e2640 1 --2- 172.21.15.6:0/1564371620 >> v2:172.21.15.171:3300/0 conn(0x7ff620070850 0x7ff620070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.273+0000 7ff6258e1640 1 -- 172.21.15.6:0/1564371620 >> v2:172.21.15.171:3300/0 conn(0x7ff620070850 msgr2=0x7ff620070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.273+0000 7ff6258e1640 1 --2- 172.21.15.6:0/1564371620 >> v2:172.21.15.171:3300/0 conn(0x7ff620070850 0x7ff620070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.273+0000 7ff6258e1640 1 -- 172.21.15.6:0/1564371620 >> v1:172.21.15.6:6789/0 conn(0x7ff6200cd1b0 legacy=0x7ff62006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.273+0000 7ff6258e1640 1 -- 172.21.15.6:0/1564371620 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6200ce2b0 con 0x7ff620071630 2024-05-20T18:01:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.273+0000 7ff6248df640 1 -- 172.21.15.6:0/1564371620 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714319441 0 0) 0x7ff610001110 con 0x7ff6200cd1b0 2024-05-20T18:01:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.273+0000 7ff6260e2640 1 --2- 172.21.15.6:0/1564371620 >> v2:172.21.15.171:3300/0 conn(0x7ff620070850 0x7ff620070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff6258e1640 1 --2- 172.21.15.6:0/1564371620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620071630 0x7ff62015f250 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7ff6200cef20 tx=0x7ff61c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c1fe69b74631e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff6248df640 1 -- 172.21.15.6:0/1564371620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c036070 con 0x7ff620071630 2024-05-20T18:01:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff6248df640 1 -- 172.21.15.6:0/1564371620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61c031600 con 0x7ff620071630 2024-05-20T18:01:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff6248df640 1 -- 172.21.15.6:0/1564371620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c0319d0 con 0x7ff620071630 2024-05-20T18:01:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff627b45640 1 -- 172.21.15.6:0/1564371620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620071630 msgr2=0x7ff62015f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff627b45640 1 --2- 172.21.15.6:0/1564371620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620071630 0x7ff62015f250 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7ff6200cef20 tx=0x7ff61c02a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff627b45640 1 -- 172.21.15.6:0/1564371620 shutdown_connections 2024-05-20T18:01:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff627b45640 1 --2- 172.21.15.6:0/1564371620 >> v2:172.21.15.171:3300/0 conn(0x7ff620070850 0x7ff620070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff627b45640 1 --2- 172.21.15.6:0/1564371620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620071630 0x7ff62015f250 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.274+0000 7ff627b45640 1 -- 172.21.15.6:0/1564371620 >> 172.21.15.6:0/1564371620 conn(0x7ff6200d29d0 msgr2=0x7ff6200d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.275+0000 7ff627b45640 1 -- 172.21.15.6:0/1564371620 shutdown_connections 2024-05-20T18:01:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.275+0000 7ff627b45640 1 -- 172.21.15.6:0/1564371620 wait complete. 2024-05-20T18:01:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.276+0000 7ff627b45640 1 Processor -- start 2024-05-20T18:01:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.276+0000 7ff627b45640 1 -- start start 2024-05-20T18:01:22.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff627b45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620070850 0x7ff6200b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:22.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff627b45640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff620071630 0x7ff620156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:22.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff627b45640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6200cd1b0 0x7ff6201f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:22.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff627b45640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff62006ded0 con 0x7ff620070850 2024-05-20T18:01:22.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff627b45640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff62006cfc0 con 0x7ff620071630 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff627b45640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff62006d2a0 con 0x7ff6200cd1b0 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620070850 0x7ff6200b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620070850 0x7ff6200b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36362/0 (socket says 172.21.15.6:36362) 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 -- 172.21.15.6:0/3076676876 learned_addr learned my addr 172.21.15.6:0/3076676876 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6250e0640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff620071630 0x7ff620156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6260e2640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6200cd1b0 0x7ff6201f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 -- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6200cd1b0 msgr2=0x7ff6201f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6200cd1b0 0x7ff6201f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 -- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff620071630 msgr2=0x7ff620156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff620071630 0x7ff620156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 -- 172.21.15.6:0/3076676876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6201e9900 con 0x7ff620070850 2024-05-20T18:01:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6250e0640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff620071630 0x7ff620156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6258e1640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620070850 0x7ff6200b8270 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009f40 tx=0x7ff61c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6167fc640 1 -- 172.21.15.6:0/3076676876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c03f020 con 0x7ff620070850 2024-05-20T18:01:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6167fc640 1 -- 172.21.15.6:0/3076676876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61c037040 con 0x7ff620070850 2024-05-20T18:01:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff620156fa0 con 0x7ff620070850 2024-05-20T18:01:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.278+0000 7ff6167fc640 1 -- 172.21.15.6:0/3076676876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c036070 con 0x7ff620070850 2024-05-20T18:01:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.279+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6201e9ec0 con 0x7ff620070850 2024-05-20T18:01:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.280+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff62015b5a0 con 0x7ff620070850 2024-05-20T18:01:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.280+0000 7ff6167fc640 1 -- 172.21.15.6:0/3076676876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff61c042020 con 0x7ff620070850 2024-05-20T18:01:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.281+0000 7ff6167fc640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff60406be60 0x7ff60406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.281+0000 7ff6167fc640 1 -- 172.21.15.6:0/3076676876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7ff61c0ab340 con 0x7ff620070850 2024-05-20T18:01:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.281+0000 7ff6250e0640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff60406be60 0x7ff60406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.281+0000 7ff6250e0640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff60406be60 0x7ff60406e370 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff6200b4000 tx=0x7ff610009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.285+0000 7ff6167fc640 1 -- 172.21.15.6:0/3076676876 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff62015b5a0 con 0x7ff620070850 2024-05-20T18:01:22.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:22.541+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]} v 0) -- 0x7ff620075b00 con 0x7ff620070850 2024-05-20T18:01:23.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.484+0000 7ff6167fc640 1 -- 172.21.15.6:0/3076676876 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]}]=0 v432) ==== 154+0+0 (secure 0 0 0) 0x7ff61c049030 con 0x7ff620070850 2024-05-20T18:01:23.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff60406be60 msgr2=0x7ff60406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:23.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff60406be60 0x7ff60406e370 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff6200b4000 tx=0x7ff610009040 comp rx=0 tx=0).stop 2024-05-20T18:01:23.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620070850 msgr2=0x7ff6200b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:23.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620070850 0x7ff6200b8270 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009f40 tx=0x7ff61c004a40 comp rx=0 tx=0).stop 2024-05-20T18:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 shutdown_connections 2024-05-20T18:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff60406be60 0x7ff60406e370 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6200cd1b0 0x7ff6201f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff620071630 0x7ff620156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 --2- 172.21.15.6:0/3076676876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff620070850 0x7ff6200b8270 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 >> 172.21.15.6:0/3076676876 conn(0x7ff6200d29d0 msgr2=0x7ff6200cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 shutdown_connections 2024-05-20T18:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.487+0000 7ff627b45640 1 -- 172.21.15.6:0/3076676876 wait complete. 2024-05-20T18:01:23.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T18:01:23.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.625+0000 7fa4014fe640 1 Processor -- start 2024-05-20T18:01:23.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.626+0000 7fa4014fe640 1 -- start start 2024-05-20T18:01:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa4014fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa3fc162820 0x7fa3fc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa4014fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3fc0b3e80 0x7fa3fc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa4014fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 0x7fa3fc0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa4014fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa3fc06dd20 con 0x7fa3fc0b3e80 2024-05-20T18:01:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa4014fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa3fc0d0630 con 0x7fa3fc162820 2024-05-20T18:01:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa4014fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3fc0d39c0 con 0x7fa3fc06d910 2024-05-20T18:01:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fa7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3fc0b3e80 0x7fa3fc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fa7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3fc0b3e80 0x7fa3fc06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36378/0 (socket says 172.21.15.6:36378) 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fa7fc640 1 -- 172.21.15.6:0/629268581 learned_addr learned my addr 172.21.15.6:0/629268581 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3faffd640 1 --2- 172.21.15.6:0/629268581 >> v2:172.21.15.171:3300/0 conn(0x7fa3fc162820 0x7fa3fc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fb7fe640 1 --2- 172.21.15.6:0/629268581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 0x7fa3fc0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fa7fc640 1 -- 172.21.15.6:0/629268581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 msgr2=0x7fa3fc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fa7fc640 1 --2- 172.21.15.6:0/629268581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 0x7fa3fc0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fa7fc640 1 -- 172.21.15.6:0/629268581 >> v2:172.21.15.171:3300/0 conn(0x7fa3fc162820 msgr2=0x7fa3fc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fa7fc640 1 --2- 172.21.15.6:0/629268581 >> v2:172.21.15.171:3300/0 conn(0x7fa3fc162820 0x7fa3fc0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3fa7fc640 1 -- 172.21.15.6:0/629268581 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc0d3ca0 con 0x7fa3fc0b3e80 2024-05-20T18:01:23.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.627+0000 7fa3faffd640 1 --2- 172.21.15.6:0/629268581 >> v2:172.21.15.171:3300/0 conn(0x7fa3fc162820 0x7fa3fc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:23.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.628+0000 7fa3fa7fc640 1 --2- 172.21.15.6:0/629268581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc0b3e80 0x7fa3fc06d3d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0b7740 tx=0x7fa3e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afd34fc5f4ee3d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:23.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.628+0000 7fa3f9ffb640 1 -- 172.21.15.6:0/629268581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4037070 con 0x7fa3fc0b3e80 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.628+0000 7fa3f9ffb640 1 -- 172.21.15.6:0/629268581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e4032440 con 0x7fa3fc0b3e80 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.628+0000 7fa3f9ffb640 1 -- 172.21.15.6:0/629268581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4032810 con 0x7fa3fc0b3e80 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 -- 172.21.15.6:0/629268581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc0b3e80 msgr2=0x7fa3fc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 --2- 172.21.15.6:0/629268581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc0b3e80 0x7fa3fc06d3d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0b7740 tx=0x7fa3e402a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 -- 172.21.15.6:0/629268581 shutdown_connections 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 --2- 172.21.15.6:0/629268581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 0x7fa3fc0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 --2- 172.21.15.6:0/629268581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc0b3e80 0x7fa3fc06d3d0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 --2- 172.21.15.6:0/629268581 >> v2:172.21.15.171:3300/0 conn(0x7fa3fc162820 0x7fa3fc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 -- 172.21.15.6:0/629268581 >> 172.21.15.6:0/629268581 conn(0x7fa3fc0d4bd0 msgr2=0x7fa3fc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 -- 172.21.15.6:0/629268581 shutdown_connections 2024-05-20T18:01:23.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.629+0000 7fa4014fe640 1 -- 172.21.15.6:0/629268581 wait complete. 2024-05-20T18:01:23.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.631+0000 7fa4014fe640 1 Processor -- start 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.631+0000 7fa4014fe640 1 -- start start 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.632+0000 7fa4014fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 0x7fa3fc0ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.632+0000 7fa4014fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3fc0b3e80 0x7fa3fc1f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.632+0000 7fa4014fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc162820 0x7fa3fc0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.632+0000 7fa4014fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc0d0300 con 0x7fa3fc162820 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.632+0000 7fa4014fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc0d4260 con 0x7fa3fc0b3e80 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.632+0000 7fa4014fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3fc0d4780 con 0x7fa3fc06d910 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc162820 0x7fa3fc0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc162820 0x7fa3fc0b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36386/0 (socket says 172.21.15.6:36386) 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 -- 172.21.15.6:0/2968908427 learned_addr learned my addr 172.21.15.6:0/2968908427 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fa7fc640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3fc0b3e80 0x7fa3fc1f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:23.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3faffd640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 0x7fa3fc0ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 -- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 msgr2=0x7fa3fc0ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 0x7fa3fc0ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 -- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3fc0b3e80 msgr2=0x7fa3fc1f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3fc0b3e80 0x7fa3fc1f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 -- 172.21.15.6:0/2968908427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc0abc00 con 0x7fa3fc162820 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fa7fc640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3fc0b3e80 0x7fa3fc1f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3fb7fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc162820 0x7fa3fc0b32b0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00c4c0 tx=0x7fa3ec00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3f37fe640 1 -- 172.21.15.6:0/2968908427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec015070 con 0x7fa3fc162820 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3f37fe640 1 -- 172.21.15.6:0/2968908427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ec004220 con 0x7fa3fc162820 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa3f37fe640 1 -- 172.21.15.6:0/2968908427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec003610 con 0x7fa3fc162820 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3fc0b6440 con 0x7fa3fc162820 2024-05-20T18:01:23.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.633+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3fc0b6a00 con 0x7fa3fc162820 2024-05-20T18:01:23.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.634+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3fc0b61b0 con 0x7fa3fc162820 2024-05-20T18:01:23.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.635+0000 7fa3f37fe640 1 -- 172.21.15.6:0/2968908427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3ec0037b0 con 0x7fa3fc162820 2024-05-20T18:01:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.635+0000 7fa3f37fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa3dc06be30 0x7fa3dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.636+0000 7fa3f37fe640 1 -- 172.21.15.6:0/2968908427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7fa3ec08aab0 con 0x7fa3fc162820 2024-05-20T18:01:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.636+0000 7fa3faffd640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa3dc06be30 0x7fa3dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.636+0000 7fa3faffd640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa3dc06be30 0x7fa3dc06e340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4007510 tx=0x7fa3f40074a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.640+0000 7fa3f37fe640 1 -- 172.21.15.6:0/2968908427 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa3ec059530 con 0x7fa3fc162820 2024-05-20T18:01:23.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.823+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa3fc06df00 con 0x7fa3fc162820 2024-05-20T18:01:23.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.828+0000 7fa3f37fe640 1 -- 172.21.15.6:0/2968908427 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fa3fc06df00 con 0x7fa3fc162820 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa3dc06be30 msgr2=0x7fa3dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa3dc06be30 0x7fa3dc06e340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4007510 tx=0x7fa3f40074a0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc162820 msgr2=0x7fa3fc0b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc162820 0x7fa3fc0b32b0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00c4c0 tx=0x7fa3ec00c980 comp rx=0 tx=0).stop 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 shutdown_connections 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa3dc06be30 0x7fa3dc06e340 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3fc162820 0x7fa3fc0b32b0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3fc0b3e80 0x7fa3fc1f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 --2- 172.21.15.6:0/2968908427 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3fc06d910 0x7fa3fc0ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 >> 172.21.15.6:0/2968908427 conn(0x7fa3fc0d4bd0 msgr2=0x7fa3fc0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:23.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 shutdown_connections 2024-05-20T18:01:23.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:23.830+0000 7fa4014fe640 1 -- 172.21.15.6:0/2968908427 wait complete. 2024-05-20T18:01:23.840 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:01:23.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:01:23.875 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:01:23.926 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:01:23.926 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:23.926 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:23.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:01:23.942 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:23.942 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:23.960 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:01:23.961 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:23.961 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:23.999 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:01:23.999 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:23.999 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:24.018 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:01:24.018 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T18:01:24.018 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.156+0000 7f7c48102640 1 Processor -- start 2024-05-20T18:01:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.156+0000 7f7c48102640 1 -- start start 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.157+0000 7f7c48102640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c400b4010 0x7f7c400d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.157+0000 7f7c48102640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c400d0370 con 0x7f7c400d14b0 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.157+0000 7f7c48102640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c400d0650 con 0x7f7c40163a10 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.157+0000 7f7c48102640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c400d3ca0 con 0x7f7c400b4010 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.157+0000 7f7c4669f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7c400d14b0 0x7f7c400d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33400/0 (socket says 172.21.15.6:33400) 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.157+0000 7f7c4669f640 1 -- 172.21.15.6:0/3561814555 learned_addr learned my addr 172.21.15.6:0/3561814555 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c4569d640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c400b4010 0x7f7c400d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022173701 0 0) 0x7f7c400d0370 con 0x7f7c400d14b0 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c2c003520 con 0x7f7c400d14b0 2024-05-20T18:01:24.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1848701113 0 0) 0x7f7c2c003520 con 0x7f7c400d14b0 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c400b4010 msgr2=0x7f7c400d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c400b4010 0x7f7c400d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 >> v1:172.21.15.171:6789/0 conn(0x7f7c40163a10 legacy=0x7f7c400cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c400d3650 con 0x7f7c400d14b0 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f7c380019f0 con 0x7f7c400d14b0 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 >> v1:172.21.15.6:6789/0 conn(0x7f7c400d14b0 legacy=0x7f7c400d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c2c0039e0 0x7f7c2c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c400b4010 0x7f7c2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c2c004d40 0x7f7c2c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7c400d3ca0 con 0x7f7c2c004d40 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c00baf0 con 0x7f7c2c0039e0 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c00bcf0 con 0x7f7c400b4010 2024-05-20T18:01:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c4669f640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c2c004d40 0x7f7c2c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c45e9e640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c2c0039e0 0x7f7c2c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.158+0000 7f7c4569d640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c400b4010 0x7f7c2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.159+0000 7f7c4669f640 1 -- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c400b4010 msgr2=0x7f7c2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.159+0000 7f7c4669f640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c400b4010 0x7f7c2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.159+0000 7f7c4669f640 1 -- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c2c0039e0 msgr2=0x7f7c2c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.159+0000 7f7c4669f640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c2c0039e0 0x7f7c2c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.159+0000 7f7c4669f640 1 -- 172.21.15.6:0/3561814555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c003520 con 0x7f7c2c004d40 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.159+0000 7f7c4669f640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c2c004d40 0x7f7c2c005150 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f7c400b45b0 tx=0x7f7c2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7340245d238780 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800a4c0 con 0x7f7c2c004d40 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3802f070 con 0x7f7c2c004d40 2024-05-20T18:01:24.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c44e9c640 1 -- 172.21.15.6:0/3561814555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3802bc70 con 0x7f7c2c004d40 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c48102640 1 -- 172.21.15.6:0/3561814555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c2c004d40 msgr2=0x7f7c2c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c48102640 1 --2- 172.21.15.6:0/3561814555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c2c004d40 0x7f7c2c005150 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f7c400b45b0 tx=0x7f7c2c005830 comp rx=0 tx=0).stop 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c4669f640 1 -- 172.21.15.6:0/3561814555 reap_dead start 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c48102640 1 -- 172.21.15.6:0/3561814555 shutdown_connections 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c48102640 1 -- 172.21.15.6:0/3561814555 >> 172.21.15.6:0/3561814555 conn(0x7f7c4006d240 msgr2=0x7f7c4006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c48102640 1 -- 172.21.15.6:0/3561814555 shutdown_connections 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.160+0000 7f7c48102640 1 -- 172.21.15.6:0/3561814555 wait complete. 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.162+0000 7f7c48102640 1 Processor -- start 2024-05-20T18:01:24.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.162+0000 7f7c48102640 1 -- start start 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.163+0000 7f7c48102640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c2c004d40 0x7f7c400b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.163+0000 7f7c48102640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c400cd770 0x7f7c4015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.163+0000 7f7c48102640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c401562d0 0x7f7c401566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.163+0000 7f7c48102640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7c400d42b0 con 0x7f7c401562d0 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.163+0000 7f7c48102640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c400d4130 con 0x7f7c400cd770 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.163+0000 7f7c48102640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c400d4430 con 0x7f7c2c004d40 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c401562d0 0x7f7c401566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c401562d0 0x7f7c401566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36396/0 (socket says 172.21.15.6:36396) 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 -- 172.21.15.6:0/730249127 learned_addr learned my addr 172.21.15.6:0/730249127 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4569d640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c400cd770 0x7f7c4015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c45e9e640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c2c004d40 0x7f7c400b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 -- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c2c004d40 msgr2=0x7f7c400b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c2c004d40 0x7f7c400b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 -- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c400cd770 msgr2=0x7f7c4015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c400cd770 0x7f7c4015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 -- 172.21.15.6:0/730249127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c40156c20 con 0x7f7c401562d0 2024-05-20T18:01:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c4669f640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c401562d0 0x7f7c401566e0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800a9b0 tx=0x7f7c38001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c367fc640 1 -- 172.21.15.6:0/730249127 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800a4c0 con 0x7f7c401562d0 2024-05-20T18:01:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c367fc640 1 -- 172.21.15.6:0/730249127 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3802cb50 con 0x7f7c401562d0 2024-05-20T18:01:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c401596f0 con 0x7f7c401562d0 2024-05-20T18:01:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c367fc640 1 -- 172.21.15.6:0/730249127 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c38034470 con 0x7f7c401562d0 2024-05-20T18:01:24.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.164+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c40159cb0 con 0x7f7c401562d0 2024-05-20T18:01:24.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.165+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c40159460 con 0x7f7c401562d0 2024-05-20T18:01:24.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.166+0000 7f7c367fc640 1 -- 172.21.15.6:0/730249127 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c3803e070 con 0x7f7c401562d0 2024-05-20T18:01:24.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.166+0000 7f7c367fc640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c2406be30 0x7f7c2406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.167+0000 7f7c367fc640 1 -- 172.21.15.6:0/730249127 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f7c380aa810 con 0x7f7c401562d0 2024-05-20T18:01:24.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.167+0000 7f7c45e9e640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c2406be30 0x7f7c2406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.167+0000 7f7c45e9e640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c2406be30 0x7f7c2406e340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7c400d3020 tx=0x7f7c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:24.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.171+0000 7f7c367fc640 1 -- 172.21.15.6:0/730249127 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7c38046060 con 0x7f7c401562d0 2024-05-20T18:01:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.394+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c400b6030 con 0x7f7c401562d0 2024-05-20T18:01:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.394+0000 7f7c367fc640 1 -- 172.21.15.6:0/730249127 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+3860 (secure 0 0 0) 0x7f7c40156c20 con 0x7f7c401562d0 2024-05-20T18:01:24.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:24.392 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1465024750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1465024750},{"type":"v1","addr":"172.21.15.6:6835","nonce":1465024750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/502574969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":502574969},{"type":"v1","addr":"172.21.15.171:6836","nonce":502574969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/220368844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":220368844},{"type":"v1","addr":"172.21.15.171:6837","nonce":220368844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":8529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/139333506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":139333506},{"type":"v1","addr":"172.21.15.6:6834","nonce":139333506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[]} 2024-05-20T18:01:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 79 2024-05-20T18:01:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c2406be30 msgr2=0x7f7c2406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c2406be30 0x7f7c2406e340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7c400d3020 tx=0x7f7c3c009040 comp rx=0 tx=0).stop 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c401562d0 msgr2=0x7f7c401566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c401562d0 0x7f7c401566e0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800a9b0 tx=0x7f7c38001dc0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 shutdown_connections 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7c2406be30 0x7f7c2406e340 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c401562d0 0x7f7c401566e0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c400cd770 0x7f7c4015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 --2- 172.21.15.6:0/730249127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c2c004d40 0x7f7c400b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 >> 172.21.15.6:0/730249127 conn(0x7f7c4006d240 msgr2=0x7f7c40160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 shutdown_connections 2024-05-20T18:01:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.396+0000 7f7c48102640 1 -- 172.21.15.6:0/730249127 wait complete. 2024-05-20T18:01:24.406 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T18:01:24.406 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T18:01:24.406 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T18:01:24.406 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:01:24.406 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T18:01:24.406 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T18:01:24.407 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T18:01:24.407 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:01:24.407 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T18:01:24.407 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T18:01:24.407 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T18:01:24.407 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:01:24.407 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T18:01:24.407 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T18:01:24.408 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T18:01:24.408 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:01:24.415 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T18:01:24.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T18:01:24.418 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T18:01:24.419 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T18:01:24.420 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T18:01:24.420 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T18:01:24.420 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T18:01:24.421 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T18:01:24.461 INFO:tasks.ceph.mds.a:Started 2024-05-20T18:01:24.461 DEBUG:teuthology.parallel:result is None 2024-05-20T18:01:24.462 INFO:tasks.ceph.mds.c:Started 2024-05-20T18:01:24.462 DEBUG:teuthology.parallel:result is None 2024-05-20T18:01:24.463 INFO:tasks.ceph.mds.d:Started 2024-05-20T18:01:24.464 DEBUG:teuthology.parallel:result is None 2024-05-20T18:01:24.464 INFO:tasks.ceph.mds.b:Started 2024-05-20T18:01:24.464 DEBUG:teuthology.parallel:result is None 2024-05-20T18:01:24.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T18:01:24.552 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T18:01:24.552 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T18:01:24.559 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T18:01:24.559 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T18:01:24.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.589+0000 7fa509bf5640 1 Processor -- start 2024-05-20T18:01:24.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.589+0000 7fa509bf5640 1 -- start start 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.590+0000 7fa509bf5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5040d1610 0x7fa5040d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.590+0000 7fa509bf5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa50406c880 0x7fa50406cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.590+0000 7fa509bf5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa50415d430 con 0x7fa504156690 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.590+0000 7fa509bf5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa5040b29b0 con 0x7fa50406c880 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.590+0000 7fa509bf5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa5040b1910 con 0x7fa5040d1610 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.590+0000 7fa5037fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa504156690 0x7fa50415cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33424/0 (socket says 172.21.15.6:33424) 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.590+0000 7fa5037fe640 1 -- 172.21.15.6:0/3820977607 learned_addr learned my addr 172.21.15.6:0/3820977607 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa503fff640 1 --2- 172.21.15.6:0/3820977607 >> v2:172.21.15.171:3300/0 conn(0x7fa50406c880 0x7fa50406cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa502ffd640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5040d1610 0x7fa5040d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479283501 0 0) 0x7fa50415d430 con 0x7fa504156690 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4ec003520 con 0x7fa504156690 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3585356077 0 0) 0x7fa4ec003520 con 0x7fa504156690 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5040d1610 msgr2=0x7fa5040d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5040d1610 0x7fa5040d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 >> v2:172.21.15.171:3300/0 conn(0x7fa50406c880 msgr2=0x7fa50406cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 --2- 172.21.15.6:0/3820977607 >> v2:172.21.15.171:3300/0 conn(0x7fa50406c880 0x7fa50406cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5040b1bf0 con 0x7fa504156690 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fa4f4001670 con 0x7fa504156690 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 >> v1:172.21.15.6:6789/0 conn(0x7fa504156690 legacy=0x7fa50415cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4ec0039b0 0x7fa4ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5040d1610 0x7fa4ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec004d40 0x7fa4ec005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040b29b0 con 0x7fa4ec004d40 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040b1910 con 0x7fa4ec0039b0 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec00baf0 con 0x7fa5040d1610 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa503fff640 1 --2- 172.21.15.6:0/3820977607 >> v2:172.21.15.171:3300/0 conn(0x7fa50406c880 0x7fa50406cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa5037fe640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4ec0039b0 0x7fa4ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.591+0000 7fa503fff640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec004d40 0x7fa4ec005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.592+0000 7fa502ffd640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5040d1610 0x7fa4ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.592+0000 7fa5037fe640 1 -- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5040d1610 msgr2=0x7fa4ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.592+0000 7fa5037fe640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5040d1610 0x7fa4ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.592+0000 7fa5037fe640 1 -- 172.21.15.6:0/3820977607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec004d40 msgr2=0x7fa4ec005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.592+0000 7fa5037fe640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec004d40 0x7fa4ec005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.592+0000 7fa5037fe640 1 -- 172.21.15.6:0/3820977607 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec003520 con 0x7fa4ec0039b0 2024-05-20T18:01:24.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.592+0000 7fa503fff640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4ec004d40 0x7fa4ec005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa5037fe640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4ec0039b0 0x7fa4ec003e20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa504072f80 tx=0x7fa4ec005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dc1f7953bc4266d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4007d50 con 0x7fa4ec0039b0 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f40058d0 con 0x7fa4ec0039b0 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa5027fc640 1 -- 172.21.15.6:0/3820977607 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4005d00 con 0x7fa4ec0039b0 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa509bf5640 1 -- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4ec0039b0 msgr2=0x7fa4ec003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa509bf5640 1 --2- 172.21.15.6:0/3820977607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4ec0039b0 0x7fa4ec003e20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa504072f80 tx=0x7fa4ec005830 comp rx=0 tx=0).stop 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa503fff640 1 -- 172.21.15.6:0/3820977607 reap_dead start 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa509bf5640 1 -- 172.21.15.6:0/3820977607 shutdown_connections 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa509bf5640 1 -- 172.21.15.6:0/3820977607 >> 172.21.15.6:0/3820977607 conn(0x7fa5040b6670 msgr2=0x7fa5040b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa509bf5640 1 -- 172.21.15.6:0/3820977607 shutdown_connections 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.593+0000 7fa509bf5640 1 -- 172.21.15.6:0/3820977607 wait complete. 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.595+0000 7fa509bf5640 1 Processor -- start 2024-05-20T18:01:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.595+0000 7fa509bf5640 1 -- start start 2024-05-20T18:01:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa509bf5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4ec0039b0 0x7fa504153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa509bf5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa504154250 0x7fa5040cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa509bf5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa504154660 0x7fa5040cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa509bf5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040b2490 con 0x7fa504154660 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa509bf5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040b21b0 con 0x7fa504154250 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa509bf5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa50415c6e0 con 0x7fa4ec0039b0 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa504154660 0x7fa5040cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa504154660 0x7fa5040cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36434/0 (socket says 172.21.15.6:36434) 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 -- 172.21.15.6:0/1080532639 learned_addr learned my addr 172.21.15.6:0/1080532639 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa502ffd640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa504154250 0x7fa5040cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa5037fe640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4ec0039b0 0x7fa504153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 -- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4ec0039b0 msgr2=0x7fa504153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4ec0039b0 0x7fa504153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 -- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa504154250 msgr2=0x7fa5040cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa504154250 0x7fa5040cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 -- 172.21.15.6:0/1080532639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa504151d20 con 0x7fa504154660 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa503fff640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa504154660 0x7fa5040cf8d0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fa504074d80 tx=0x7fa4fc00f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:24.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa4ebfff640 1 -- 172.21.15.6:0/1080532639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc009dc0 con 0x7fa504154660 2024-05-20T18:01:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.597+0000 7fa4ebfff640 1 -- 172.21.15.6:0/1080532639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc01c070 con 0x7fa504154660 2024-05-20T18:01:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.598+0000 7fa4ebfff640 1 -- 172.21.15.6:0/1080532639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc003db0 con 0x7fa504154660 2024-05-20T18:01:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.598+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa504070ce0 con 0x7fa504154660 2024-05-20T18:01:24.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.598+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa504151520 con 0x7fa504154660 2024-05-20T18:01:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.599+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa504075b00 con 0x7fa504154660 2024-05-20T18:01:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.599+0000 7fa4ebfff640 1 -- 172.21.15.6:0/1080532639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4fc004030 con 0x7fa504154660 2024-05-20T18:01:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.600+0000 7fa4ebfff640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4f006be30 0x7fa4f006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.600+0000 7fa4ebfff640 1 -- 172.21.15.6:0/1080532639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7fa4fc08b890 con 0x7fa504154660 2024-05-20T18:01:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.600+0000 7fa5037fe640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4f006be30 0x7fa4f006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:24.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.601+0000 7fa5037fe640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4f006be30 0x7fa4f006e340 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4033000 tx=0x7fa4f4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:24.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.605+0000 7fa4ebfff640 1 -- 172.21.15.6:0/1080532639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa4fc026020 con 0x7fa504154660 2024-05-20T18:01:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:24.801+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa50406f570 con 0x7fa504154660 2024-05-20T18:01:25.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.852+0000 7fa4ebfff640 1 -- 172.21.15.6:0/1080532639 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v121) ==== 97+0+0 (secure 0 0 0) 0x7fa4fc010040 con 0x7fa504154660 2024-05-20T18:01:25.851 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T18:01:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4f006be30 msgr2=0x7fa4f006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4f006be30 0x7fa4f006e340 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4033000 tx=0x7fa4f4009030 comp rx=0 tx=0).stop 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa504154660 msgr2=0x7fa5040cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa504154660 0x7fa5040cf8d0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fa504074d80 tx=0x7fa4fc00f7b0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 shutdown_connections 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa4f006be30 0x7fa4f006e340 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa504154660 0x7fa5040cf8d0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa504154250 0x7fa5040cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 --2- 172.21.15.6:0/1080532639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4ec0039b0 0x7fa504153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 >> 172.21.15.6:0/1080532639 conn(0x7fa5040b6670 msgr2=0x7fa5040b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 shutdown_connections 2024-05-20T18:01:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.855+0000 7fa509bf5640 1 -- 172.21.15.6:0/1080532639 wait complete. 2024-05-20T18:01:25.868 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T18:01:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.992+0000 7fa37e910640 1 Processor -- start 2024-05-20T18:01:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.992+0000 7fa37e910640 1 -- start start 2024-05-20T18:01:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa37e910640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa378168050 0x7fa37816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa37e910640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3780d0630 con 0x7fa37806d3d0 2024-05-20T18:01:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa37e910640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3780d39c0 con 0x7fa378162820 2024-05-20T18:01:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa37e910640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa3780d3ca0 con 0x7fa378168050 2024-05-20T18:01:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa37cead640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa378168050 0x7fa37816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa3777fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa37806d3d0 0x7fa37806d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33426/0 (socket says 172.21.15.6:33426) 2024-05-20T18:01:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa3777fe640 1 -- 172.21.15.6:0/2351016126 learned_addr learned my addr 172.21.15.6:0/2351016126 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa37cead640 1 -- 172.21.15.6:0/2351016126 >> v1:172.21.15.171:6789/0 conn(0x7fa378162820 legacy=0x7fa3780b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa37cead640 1 -- 172.21.15.6:0/2351016126 >> v1:172.21.15.6:6789/0 conn(0x7fa37806d3d0 legacy=0x7fa37806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.994+0000 7fa37cead640 1 -- 172.21.15.6:0/2351016126 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780d3f80 con 0x7fa378168050 2024-05-20T18:01:25.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.995+0000 7fa37cead640 1 --2- 172.21.15.6:0/2351016126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378168050 0x7fa37816a470 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fa370009d90 tx=0x7fa37002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03b1920aef3a6da server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:25.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.995+0000 7fa376ffd640 1 -- 172.21.15.6:0/2351016126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370007740 con 0x7fa378168050 2024-05-20T18:01:25.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.995+0000 7fa376ffd640 1 -- 172.21.15.6:0/2351016126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3700078e0 con 0x7fa378168050 2024-05-20T18:01:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.995+0000 7fa376ffd640 1 -- 172.21.15.6:0/2351016126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370007cb0 con 0x7fa378168050 2024-05-20T18:01:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.996+0000 7fa37e910640 1 -- 172.21.15.6:0/2351016126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378168050 msgr2=0x7fa37816a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.996+0000 7fa37e910640 1 --2- 172.21.15.6:0/2351016126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378168050 0x7fa37816a470 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fa370009d90 tx=0x7fa37002a6f0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.996+0000 7fa37e910640 1 -- 172.21.15.6:0/2351016126 shutdown_connections 2024-05-20T18:01:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.996+0000 7fa37e910640 1 --2- 172.21.15.6:0/2351016126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378168050 0x7fa37816a470 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.996+0000 7fa37e910640 1 -- 172.21.15.6:0/2351016126 >> 172.21.15.6:0/2351016126 conn(0x7fa3780d4bd0 msgr2=0x7fa3780d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.996+0000 7fa37e910640 1 -- 172.21.15.6:0/2351016126 shutdown_connections 2024-05-20T18:01:25.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.996+0000 7fa37e910640 1 -- 172.21.15.6:0/2351016126 wait complete. 2024-05-20T18:01:25.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.998+0000 7fa37e910640 1 Processor -- start 2024-05-20T18:01:25.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.998+0000 7fa37e910640 1 -- start start 2024-05-20T18:01:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa37e910640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa37806d3d0 0x7fa378152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa37e910640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378162820 0x7fa378158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa37e910640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa378168050 0x7fa378158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa37e910640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780b91a0 con 0x7fa378162820 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa37e910640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780d0300 con 0x7fa378168050 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa37e910640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780b4050 con 0x7fa37806d3d0 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa3777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378162820 0x7fa378158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa3777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378162820 0x7fa378158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36466/0 (socket says 172.21.15.6:36466) 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:25.999+0000 7fa3777fe640 1 -- 172.21.15.6:0/225771128 learned_addr learned my addr 172.21.15.6:0/225771128 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa377fff640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa37806d3d0 0x7fa378152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa37cead640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa378168050 0x7fa378158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa3777fe640 1 -- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa37806d3d0 msgr2=0x7fa378152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa3777fe640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa37806d3d0 0x7fa378152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa3777fe640 1 -- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa378168050 msgr2=0x7fa378158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa3777fe640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa378168050 0x7fa378158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa3777fe640 1 -- 172.21.15.6:0/225771128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378157970 con 0x7fa378162820 2024-05-20T18:01:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa377fff640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa37806d3d0 0x7fa378152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa3777fe640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378162820 0x7fa378158660 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00c4b0 tx=0x7fa36c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa374ff9640 1 -- 172.21.15.6:0/225771128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c017070 con 0x7fa378162820 2024-05-20T18:01:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa374ff9640 1 -- 172.21.15.6:0/225771128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c005ce0 con 0x7fa378162820 2024-05-20T18:01:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa378157c50 con 0x7fa378162820 2024-05-20T18:01:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa374ff9640 1 -- 172.21.15.6:0/225771128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c007270 con 0x7fa378162820 2024-05-20T18:01:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.000+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa378153500 con 0x7fa378162820 2024-05-20T18:01:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.001+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3780689b0 con 0x7fa378162820 2024-05-20T18:01:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.002+0000 7fa374ff9640 1 -- 172.21.15.6:0/225771128 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa36c01a070 con 0x7fa378162820 2024-05-20T18:01:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.002+0000 7fa374ff9640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa36406be30 0x7fa36406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.003+0000 7fa374ff9640 1 -- 172.21.15.6:0/225771128 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5249+0+0 (secure 0 0 0) 0x7fa36c089eb0 con 0x7fa378162820 2024-05-20T18:01:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.003+0000 7fa377fff640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa36406be30 0x7fa36406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.003+0000 7fa377fff640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa36406be30 0x7fa36406e340 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa368001660 tx=0x7fa368009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.007+0000 7fa374ff9640 1 -- 172.21.15.6:0/225771128 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa3780689b0 con 0x7fa378162820 2024-05-20T18:01:26.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.259+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa378075b00 con 0x7fa378162820 2024-05-20T18:01:26.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.260+0000 7fa374ff9640 1 -- 172.21.15.6:0/225771128 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fa36c0583c0 con 0x7fa378162820 2024-05-20T18:01:26.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:26.258 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:01:26.258 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T18:01:26.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.258 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.259 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.260 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.261 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:01:26.262 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.266 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:01:26.268 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.270 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:01:26.271 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:01:26.272 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:01:26.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:26.272 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T18:01:26.272 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:01:26.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa36406be30 msgr2=0x7fa36406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa36406be30 0x7fa36406e340 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa368001660 tx=0x7fa368009040 comp rx=0 tx=0).stop 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378162820 msgr2=0x7fa378158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378162820 0x7fa378158660 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00c4b0 tx=0x7fa36c00c970 comp rx=0 tx=0).stop 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 shutdown_connections 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa36406be30 0x7fa36406e340 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa378168050 0x7fa378158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa378162820 0x7fa378158660 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 --2- 172.21.15.6:0/225771128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa37806d3d0 0x7fa378152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 >> 172.21.15.6:0/225771128 conn(0x7fa3780d4bd0 msgr2=0x7fa3780ba210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 shutdown_connections 2024-05-20T18:01:26.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.262+0000 7fa37e910640 1 -- 172.21.15.6:0/225771128 wait complete. 2024-05-20T18:01:26.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:26.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.391+0000 7f512c145640 1 Processor -- start 2024-05-20T18:01:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.391+0000 7f512c145640 1 -- start start 2024-05-20T18:01:26.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f512c145640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 0x7f51240b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f512c145640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51240d0630 con 0x7f51240b3e80 2024-05-20T18:01:26.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f512c145640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51240d39c0 con 0x7f512406dae0 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f512c145640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51240d3ca0 con 0x7f5124162820 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f51296e0640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51240b3e80 0x7f512406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33432/0 (socket says 172.21.15.6:33432) 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f51296e0640 1 -- 172.21.15.6:0/4229200613 learned_addr learned my addr 172.21.15.6:0/4229200613 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f5129ee1640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 0x7f51240b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50335390 0 0) 0x7f51240d0630 con 0x7f51240b3e80 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f510c003520 con 0x7f51240b3e80 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291966990 0 0) 0x7f51240d39c0 con 0x7f512406dae0 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51240d0630 con 0x7f512406dae0 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1355848742 0 0) 0x7f510c003520 con 0x7f51240b3e80 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.393+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 msgr2=0x7f51240b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 0x7f51240b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 >> v1:172.21.15.171:6789/0 conn(0x7f512406dae0 legacy=0x7f51240b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51240d3f80 con 0x7f51240b3e80 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5118001670 con 0x7f51240b3e80 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5129ee1640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 0x7f51240b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 >> v1:172.21.15.6:6789/0 conn(0x7f51240b3e80 legacy=0x7f512406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 0x7f510c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f510c0040d0 0x7f510c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f510c004d40 0x7f510c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51240d3ca0 con 0x7f510c004d40 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f510c00bb20 con 0x7f510c0040d0 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f510c00bd20 con 0x7f5124162820 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f512a6e2640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f510c004d40 0x7f510c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f5129ee1640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 0x7f510c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f51296e0640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f510c0040d0 0x7f510c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f512a6e2640 1 -- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 msgr2=0x7f510c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f512a6e2640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5124162820 0x7f510c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f512a6e2640 1 -- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f510c0040d0 msgr2=0x7f510c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f512a6e2640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f510c0040d0 0x7f510c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.394+0000 7f512a6e2640 1 -- 172.21.15.6:0/4229200613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c003520 con 0x7f510c004d40 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.395+0000 7f512a6e2640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f510c004d40 0x7f510c005150 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f5114001fd0 tx=0x7f510c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c870731f7f1500 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.395+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114001bf0 con 0x7f510c004d40 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.395+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114003b70 con 0x7f510c004d40 2024-05-20T18:01:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.395+0000 7f5128edf640 1 -- 172.21.15.6:0/4229200613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51140050d0 con 0x7f510c004d40 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.396+0000 7f512c145640 1 -- 172.21.15.6:0/4229200613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f510c004d40 msgr2=0x7f510c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.396+0000 7f512c145640 1 --2- 172.21.15.6:0/4229200613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f510c004d40 0x7f510c005150 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f5114001fd0 tx=0x7f510c005830 comp rx=0 tx=0).stop 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.396+0000 7f512a6e2640 1 -- 172.21.15.6:0/4229200613 reap_dead start 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.396+0000 7f512c145640 1 -- 172.21.15.6:0/4229200613 shutdown_connections 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.396+0000 7f512c145640 1 -- 172.21.15.6:0/4229200613 >> 172.21.15.6:0/4229200613 conn(0x7f51240d4bd0 msgr2=0x7f51240d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.396+0000 7f512c145640 1 -- 172.21.15.6:0/4229200613 shutdown_connections 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.396+0000 7f512c145640 1 -- 172.21.15.6:0/4229200613 wait complete. 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.398+0000 7f512c145640 1 Processor -- start 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.398+0000 7f512c145640 1 -- start start 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512c145640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f510c004d40 0x7f51241589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512c145640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51240cde20 0x7f51240b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512c145640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124155a40 0x7f5124155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512c145640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f51240d4780 con 0x7f5124155a40 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512c145640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f51240d0300 con 0x7f51240cde20 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512c145640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f51240d4900 con 0x7f510c004d40 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512a6e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124155a40 0x7f5124155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512a6e2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124155a40 0x7f5124155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36488/0 (socket says 172.21.15.6:36488) 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512a6e2640 1 -- 172.21.15.6:0/3224744096 learned_addr learned my addr 172.21.15.6:0/3224744096 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f51296e0640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51240cde20 0x7f51240b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f5129ee1640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f510c004d40 0x7f51241589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512a6e2640 1 -- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f510c004d40 msgr2=0x7f51241589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.399+0000 7f512a6e2640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f510c004d40 0x7f51241589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f512a6e2640 1 -- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51240cde20 msgr2=0x7f51240b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f512a6e2640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51240cde20 0x7f51240b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f512a6e2640 1 -- 172.21.15.6:0/3224744096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5124156390 con 0x7f5124155a40 2024-05-20T18:01:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f512a6e2640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124155a40 0x7f5124155e50 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f5114033040 tx=0x7f5114001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f51227fc640 1 -- 172.21.15.6:0/3224744096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114001bf0 con 0x7f5124155a40 2024-05-20T18:01:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f51227fc640 1 -- 172.21.15.6:0/3224744096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114043070 con 0x7f5124155a40 2024-05-20T18:01:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51240ccd80 con 0x7f5124155a40 2024-05-20T18:01:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f51227fc640 1 -- 172.21.15.6:0/3224744096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114005610 con 0x7f5124155a40 2024-05-20T18:01:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.400+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51240cd340 con 0x7f5124155a40 2024-05-20T18:01:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.401+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f512415e740 con 0x7f5124155a40 2024-05-20T18:01:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.402+0000 7f51227fc640 1 -- 172.21.15.6:0/3224744096 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f511403a040 con 0x7f5124155a40 2024-05-20T18:01:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.402+0000 7f51227fc640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f511006be30 0x7f511006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.402+0000 7f51227fc640 1 -- 172.21.15.6:0/3224744096 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5249+0+0 (secure 0 0 0) 0x7f51140ab360 con 0x7f5124155a40 2024-05-20T18:01:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.402+0000 7f5129ee1640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f511006be30 0x7f511006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.403+0000 7f5129ee1640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f511006be30 0x7f511006e340 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f511c009b10 tx=0x7f511c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.407+0000 7f51227fc640 1 -- 172.21.15.6:0/3224744096 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f512415e740 con 0x7f5124155a40 2024-05-20T18:01:26.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.596+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5124075b00 con 0x7f5124155a40 2024-05-20T18:01:26.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.596+0000 7f51227fc640 1 -- 172.21.15.6:0/3224744096 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+13126 (secure 0 0 0) 0x7f5124156390 con 0x7f5124155a40 2024-05-20T18:01:26.595 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:26.595 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":121,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:25.850368+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:26.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f511006be30 msgr2=0x7f511006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f511006be30 0x7f511006e340 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f511c009b10 tx=0x7f511c008040 comp rx=0 tx=0).stop 2024-05-20T18:01:26.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124155a40 msgr2=0x7f5124155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124155a40 0x7f5124155e50 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f5114033040 tx=0x7f5114001650 comp rx=0 tx=0).stop 2024-05-20T18:01:26.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 shutdown_connections 2024-05-20T18:01:26.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f511006be30 0x7f511006e340 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5124155a40 0x7f5124155e50 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51240cde20 0x7f51240b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 --2- 172.21.15.6:0/3224744096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f510c004d40 0x7f51241589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 >> 172.21.15.6:0/3224744096 conn(0x7f51240d4bd0 msgr2=0x7f5124161ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:26.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 shutdown_connections 2024-05-20T18:01:26.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.599+0000 7f512c145640 1 -- 172.21.15.6:0/3224744096 wait complete. 2024-05-20T18:01:26.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:01:26.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:01:26.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.729+0000 7f33fa261640 1 Processor -- start 2024-05-20T18:01:26.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.729+0000 7f33fa261640 1 -- start start 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.730+0000 7f33fa261640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33f406b520 0x7f33f406b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.730+0000 7f33fa261640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33f409ac70 con 0x7f33f415bf00 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.730+0000 7f33fa261640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33f40b0370 con 0x7f33f40b1600 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.730+0000 7f33fa261640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f33f40b0bb0 con 0x7f33f406b520 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.730+0000 7f33f2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33f406b520 0x7f33f406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.730+0000 7f33f37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33f415bf00 0x7f33f409a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33448/0 (socket says 172.21.15.6:33448) 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.730+0000 7f33f37fe640 1 -- 172.21.15.6:0/267045220 learned_addr learned my addr 172.21.15.6:0/267045220 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.731+0000 7f33f2ffd640 1 -- 172.21.15.6:0/267045220 >> v1:172.21.15.171:6789/0 conn(0x7f33f40b1600 legacy=0x7f33f40b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.731+0000 7f33f2ffd640 1 -- 172.21.15.6:0/267045220 >> v1:172.21.15.6:6789/0 conn(0x7f33f415bf00 legacy=0x7f33f409a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.731+0000 7f33f2ffd640 1 -- 172.21.15.6:0/267045220 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f40b0650 con 0x7f33f406b520 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.732+0000 7f33f2ffd640 1 --2- 172.21.15.6:0/267045220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f406b520 0x7f33f406b930 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f33e80097a0 tx=0x7f33e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b171e2c511f91f26 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.732+0000 7f33f27fc640 1 -- 172.21.15.6:0/267045220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8037070 con 0x7f33f406b520 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.732+0000 7f33f27fc640 1 -- 172.21.15.6:0/267045220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e8032440 con 0x7f33f406b520 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.732+0000 7f33f27fc640 1 -- 172.21.15.6:0/267045220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8032810 con 0x7f33f406b520 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.732+0000 7f33fa261640 1 -- 172.21.15.6:0/267045220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f406b520 msgr2=0x7f33f406b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.732+0000 7f33fa261640 1 --2- 172.21.15.6:0/267045220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f406b520 0x7f33f406b930 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f33e80097a0 tx=0x7f33e802a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.732+0000 7f33fa261640 1 -- 172.21.15.6:0/267045220 shutdown_connections 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.732+0000 7f33fa261640 1 --2- 172.21.15.6:0/267045220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f406b520 0x7f33f406b930 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.733+0000 7f33fa261640 1 -- 172.21.15.6:0/267045220 >> 172.21.15.6:0/267045220 conn(0x7f33f4072f30 msgr2=0x7f33f40b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.733+0000 7f33fa261640 1 -- 172.21.15.6:0/267045220 shutdown_connections 2024-05-20T18:01:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.733+0000 7f33fa261640 1 -- 172.21.15.6:0/267045220 wait complete. 2024-05-20T18:01:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.734+0000 7f33fa261640 1 Processor -- start 2024-05-20T18:01:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.735+0000 7f33fa261640 1 -- start start 2024-05-20T18:01:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33fa261640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33f406b520 0x7f33f4140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33fa261640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f40b1600 0x7f33f41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33fa261640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33f415bf00 0x7f33f415df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33fa261640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33f415c490 con 0x7f33f40b1600 2024-05-20T18:01:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33fa261640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33f415c310 con 0x7f33f415bf00 2024-05-20T18:01:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33fa261640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33f40afee0 con 0x7f33f406b520 2024-05-20T18:01:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f40b1600 0x7f33f41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f40b1600 0x7f33f41565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36496/0 (socket says 172.21.15.6:36496) 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f2ffd640 1 -- 172.21.15.6:0/2024412038 learned_addr learned my addr 172.21.15.6:0/2024412038 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f3fff640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33f415bf00 0x7f33f415df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f37fe640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33f406b520 0x7f33f4140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f2ffd640 1 -- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33f406b520 msgr2=0x7f33f4140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f2ffd640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33f406b520 0x7f33f4140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f2ffd640 1 -- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33f415bf00 msgr2=0x7f33f415df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f2ffd640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33f415bf00 0x7f33f415df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f2ffd640 1 -- 172.21.15.6:0/2024412038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f41f6480 con 0x7f33f40b1600 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f3fff640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33f415bf00 0x7f33f415df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.736+0000 7f33f37fe640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33f406b520 0x7f33f4140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.737+0000 7f33f2ffd640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f40b1600 0x7f33f41565c0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f33e80098c0 tx=0x7f33e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.737+0000 7f33dbfff640 1 -- 172.21.15.6:0/2024412038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8041070 con 0x7f33f40b1600 2024-05-20T18:01:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.737+0000 7f33dbfff640 1 -- 172.21.15.6:0/2024412038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e803c870 con 0x7f33f40b1600 2024-05-20T18:01:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.737+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f415d460 con 0x7f33f40b1600 2024-05-20T18:01:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.737+0000 7f33dbfff640 1 -- 172.21.15.6:0/2024412038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e8037040 con 0x7f33f40b1600 2024-05-20T18:01:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.737+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f415da20 con 0x7f33f40b1600 2024-05-20T18:01:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.738+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f4075b00 con 0x7f33f40b1600 2024-05-20T18:01:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.739+0000 7f33dbfff640 1 -- 172.21.15.6:0/2024412038 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33e8044070 con 0x7f33f40b1600 2024-05-20T18:01:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.739+0000 7f33dbfff640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33e006be30 0x7f33e006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.739+0000 7f33dbfff640 1 -- 172.21.15.6:0/2024412038 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5249+0+0 (secure 0 0 0) 0x7f33e80ab6a0 con 0x7f33f40b1600 2024-05-20T18:01:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.739+0000 7f33f37fe640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33e006be30 0x7f33e006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.740+0000 7f33f37fe640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33e006be30 0x7f33e006e340 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000f60 tx=0x7f33e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.744+0000 7f33dbfff640 1 -- 172.21.15.6:0/2024412038 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f33e807a210 con 0x7f33f40b1600 2024-05-20T18:01:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.934+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f33f4073910 con 0x7f33f40b1600 2024-05-20T18:01:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.934+0000 7f33dbfff640 1 -- 172.21.15.6:0/2024412038 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) ==== 93+0+10 (secure 0 0 0) 0x7f33e80ab070 con 0x7f33f40b1600 2024-05-20T18:01:26.932 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33e006be30 msgr2=0x7f33e006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33e006be30 0x7f33e006e340 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000f60 tx=0x7f33e4009040 comp rx=0 tx=0).stop 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f40b1600 msgr2=0x7f33f41565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f40b1600 0x7f33f41565c0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f33e80098c0 tx=0x7f33e80046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 shutdown_connections 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f33e006be30 0x7f33e006e340 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33f415bf00 0x7f33f415df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f40b1600 0x7f33f41565c0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 --2- 172.21.15.6:0/2024412038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33f406b520 0x7f33f4140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.936+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 >> 172.21.15.6:0/2024412038 conn(0x7f33f4072f30 msgr2=0x7f33f40d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.937+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 shutdown_connections 2024-05-20T18:01:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:26.937+0000 7f33fa261640 1 -- 172.21.15.6:0/2024412038 wait complete. 2024-05-20T18:01:26.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T18:01:27.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.063+0000 7f5669a3d640 1 Processor -- start 2024-05-20T18:01:27.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.063+0000 7f5669a3d640 1 -- start start 2024-05-20T18:01:27.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.064+0000 7f5669a3d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f566406d3d0 0x7f566406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.064+0000 7f5669a3d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f56640b8190 0x7f56640b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.064+0000 7f5669a3d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566406dd20 con 0x7f5664162820 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.064+0000 7f5669a3d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f56640d0630 con 0x7f566406d3d0 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.064+0000 7f5669a3d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f56640d39c0 con 0x7f56640b8190 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.065+0000 7f565bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f566406d3d0 0x7f566406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.065+0000 7f565bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f566406d3d0 0x7f566406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36502/0 (socket says 172.21.15.6:36502) 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.065+0000 7f565bfff640 1 -- 172.21.15.6:0/2526870567 learned_addr learned my addr 172.21.15.6:0/2526870567 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.065+0000 7f56637fe640 1 --2- 172.21.15.6:0/2526870567 >> v2:172.21.15.171:3300/0 conn(0x7f56640b8190 0x7f56640b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.065+0000 7f565bfff640 1 -- 172.21.15.6:0/2526870567 >> v2:172.21.15.171:3300/0 conn(0x7f56640b8190 msgr2=0x7f56640b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.065+0000 7f565bfff640 1 --2- 172.21.15.6:0/2526870567 >> v2:172.21.15.171:3300/0 conn(0x7f56640b8190 0x7f56640b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.065+0000 7f565bfff640 1 -- 172.21.15.6:0/2526870567 >> v1:172.21.15.171:6789/0 conn(0x7f5664162820 legacy=0x7f56640b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:27.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.065+0000 7f565bfff640 1 -- 172.21.15.6:0/2526870567 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56640d3ca0 con 0x7f566406d3d0 2024-05-20T18:01:27.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.066+0000 7f565bfff640 1 --2- 172.21.15.6:0/2526870567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f566406d7e0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f566408e070 tx=0x7f564c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a357604aed8aa9c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:27.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.066+0000 7f56627fc640 1 -- 172.21.15.6:0/2526870567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c037070 con 0x7f566406d3d0 2024-05-20T18:01:27.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.066+0000 7f56627fc640 1 -- 172.21.15.6:0/2526870567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564c032440 con 0x7f566406d3d0 2024-05-20T18:01:27.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.066+0000 7f56627fc640 1 -- 172.21.15.6:0/2526870567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c032810 con 0x7f566406d3d0 2024-05-20T18:01:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.067+0000 7f5669a3d640 1 -- 172.21.15.6:0/2526870567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 msgr2=0x7f566406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.067+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2526870567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f566406d7e0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f566408e070 tx=0x7f564c02a270 comp rx=0 tx=0).stop 2024-05-20T18:01:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.067+0000 7f5669a3d640 1 -- 172.21.15.6:0/2526870567 shutdown_connections 2024-05-20T18:01:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.067+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2526870567 >> v2:172.21.15.171:3300/0 conn(0x7f56640b8190 0x7f56640b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.067+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2526870567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f566406d7e0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.067+0000 7f5669a3d640 1 -- 172.21.15.6:0/2526870567 >> 172.21.15.6:0/2526870567 conn(0x7f56640d4bd0 msgr2=0x7f56640d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.067+0000 7f5669a3d640 1 -- 172.21.15.6:0/2526870567 shutdown_connections 2024-05-20T18:01:27.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.067+0000 7f5669a3d640 1 -- 172.21.15.6:0/2526870567 wait complete. 2024-05-20T18:01:27.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.069+0000 7f5669a3d640 1 Processor -- start 2024-05-20T18:01:27.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.069+0000 7f5669a3d640 1 -- start start 2024-05-20T18:01:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5669a3d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f56641f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5669a3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56640b8190 0x7f566414eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5669a3d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5664162820 0x7f566414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5669a3d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56640d0300 con 0x7f566406d3d0 2024-05-20T18:01:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5669a3d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f56640d4260 con 0x7f5664162820 2024-05-20T18:01:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5669a3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56640b4050 con 0x7f56640b8190 2024-05-20T18:01:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5662ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f56641f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5662ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f56641f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36508/0 (socket says 172.21.15.6:36508) 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5662ffd640 1 -- 172.21.15.6:0/2984034535 learned_addr learned my addr 172.21.15.6:0/2984034535 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f565bfff640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56640b8190 0x7f566414eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f56637fe640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5664162820 0x7f566414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5662ffd640 1 -- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56640b8190 msgr2=0x7f566414eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5662ffd640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56640b8190 0x7f566414eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5662ffd640 1 -- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5664162820 msgr2=0x7f566414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5662ffd640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5664162820 0x7f566414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f5662ffd640 1 -- 172.21.15.6:0/2984034535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56641f86e0 con 0x7f566406d3d0 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.070+0000 7f565bfff640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56640b8190 0x7f566414eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.071+0000 7f56637fe640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5664162820 0x7f566414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.071+0000 7f5662ffd640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f56641f81a0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f565400c3f0 tx=0x7f565400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:27.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.071+0000 7f5660ff9640 1 -- 172.21.15.6:0/2984034535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56540052d0 con 0x7f566406d3d0 2024-05-20T18:01:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.071+0000 7f5660ff9640 1 -- 172.21.15.6:0/2984034535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5654005490 con 0x7f566406d3d0 2024-05-20T18:01:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.071+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566414fa40 con 0x7f566406d3d0 2024-05-20T18:01:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.071+0000 7f5660ff9640 1 -- 172.21.15.6:0/2984034535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5654007260 con 0x7f566406d3d0 2024-05-20T18:01:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.071+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5664150000 con 0x7f566406d3d0 2024-05-20T18:01:27.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.072+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5664075b00 con 0x7f566406d3d0 2024-05-20T18:01:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.073+0000 7f5660ff9640 1 -- 172.21.15.6:0/2984034535 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5654007400 con 0x7f566406d3d0 2024-05-20T18:01:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.073+0000 7f5660ff9640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be60 0x7f564406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.073+0000 7f5660ff9640 1 -- 172.21.15.6:0/2984034535 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5249+0+0 (secure 0 0 0) 0x7f565408a130 con 0x7f566406d3d0 2024-05-20T18:01:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.073+0000 7f565bfff640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be60 0x7f564406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.074+0000 7f565bfff640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be60 0x7f564406e370 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f564c034000 tx=0x7f564c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:27.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.078+0000 7f5660ff9640 1 -- 172.21.15.6:0/2984034535 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f566406dd20 con 0x7f566406d3d0 2024-05-20T18:01:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.265+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f566415d590 con 0x7f566406d3d0 2024-05-20T18:01:27.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.265+0000 7f5660ff9640 1 -- 172.21.15.6:0/2984034535 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v121) ==== 84+0+65 (secure 0 0 0) 0x7f5654058c10 con 0x7f566406d3d0 2024-05-20T18:01:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:27.264 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T18:01:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:01:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T18:01:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T18:01:27.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:01:27.264 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T18:01:27.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.267+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be60 msgr2=0x7f564406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be60 0x7f564406e370 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f564c034000 tx=0x7f564c02e000 comp rx=0 tx=0).stop 2024-05-20T18:01:27.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 msgr2=0x7f56641f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f56641f81a0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f565400c3f0 tx=0x7f565400c8b0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 shutdown_connections 2024-05-20T18:01:27.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be60 0x7f564406e370 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5664162820 0x7f566414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56640b8190 0x7f566414eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 --2- 172.21.15.6:0/2984034535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f566406d3d0 0x7f56641f81a0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 >> 172.21.15.6:0/2984034535 conn(0x7f56640d4bd0 msgr2=0x7f5664160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:27.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 shutdown_connections 2024-05-20T18:01:27.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.268+0000 7f5669a3d640 1 -- 172.21.15.6:0/2984034535 wait complete. 2024-05-20T18:01:27.277 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T18:01:27.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T18:01:27.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.398+0000 7fb7dfeca640 1 Processor -- start 2024-05-20T18:01:27.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.398+0000 7fb7dfeca640 1 -- start start 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.399+0000 7fb7dfeca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7d80b6d50 0x7fb7d815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.399+0000 7fb7dfeca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d8162fb0 con 0x7fb7d80b3850 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.399+0000 7fb7dfeca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d8163290 con 0x7fb7d80d04a0 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.399+0000 7fb7dfeca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d8162d60 con 0x7fb7d80b6d50 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.399+0000 7fb7ddc66640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb7d80b3850 0x7fb7d80b6640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33452/0 (socket says 172.21.15.6:33452) 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.399+0000 7fb7dd465640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7d80b6d50 0x7fb7d815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.399+0000 7fb7ddc66640 1 -- 172.21.15.6:0/107448761 learned_addr learned my addr 172.21.15.6:0/107448761 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.400+0000 7fb7dd465640 1 -- 172.21.15.6:0/107448761 >> v1:172.21.15.171:6789/0 conn(0x7fb7d80d04a0 legacy=0x7fb7d80d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.400+0000 7fb7dd465640 1 -- 172.21.15.6:0/107448761 >> v1:172.21.15.6:6789/0 conn(0x7fb7d80b3850 legacy=0x7fb7d80b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.400+0000 7fb7dcc64640 1 -- 172.21.15.6:0/107448761 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191132677 0 0) 0x7fb7d8162fb0 con 0x7fb7d80b3850 2024-05-20T18:01:27.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.400+0000 7fb7dd465640 1 -- 172.21.15.6:0/107448761 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d8163570 con 0x7fb7d80b6d50 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dd465640 1 --2- 172.21.15.6:0/107448761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b6d50 0x7fb7d815f2c0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8162ee0 tx=0x7fb7c802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175e479e7fe728f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dcc64640 1 -- 172.21.15.6:0/107448761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8037070 con 0x7fb7d80b6d50 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dcc64640 1 -- 172.21.15.6:0/107448761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c802ae40 con 0x7fb7d80b6d50 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dcc64640 1 -- 172.21.15.6:0/107448761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8032660 con 0x7fb7d80b6d50 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dfeca640 1 -- 172.21.15.6:0/107448761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b6d50 msgr2=0x7fb7d815f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dfeca640 1 --2- 172.21.15.6:0/107448761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b6d50 0x7fb7d815f2c0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8162ee0 tx=0x7fb7c802a130 comp rx=0 tx=0).stop 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dfeca640 1 -- 172.21.15.6:0/107448761 shutdown_connections 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dfeca640 1 --2- 172.21.15.6:0/107448761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b6d50 0x7fb7d815f2c0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.401+0000 7fb7dfeca640 1 -- 172.21.15.6:0/107448761 >> 172.21.15.6:0/107448761 conn(0x7fb7d80d1820 msgr2=0x7fb7d80d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.402+0000 7fb7dfeca640 1 -- 172.21.15.6:0/107448761 shutdown_connections 2024-05-20T18:01:27.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.402+0000 7fb7dfeca640 1 -- 172.21.15.6:0/107448761 wait complete. 2024-05-20T18:01:27.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.403+0000 7fb7dfeca640 1 Processor -- start 2024-05-20T18:01:27.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.403+0000 7fb7dfeca640 1 -- start start 2024-05-20T18:01:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7dfeca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b3850 0x7fb7d81550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7dfeca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d80d04a0 0x7fb7d8161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7dfeca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d8156490 0x7fb7d80b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7dfeca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d80b8300 con 0x7fb7d80b3850 2024-05-20T18:01:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7dfeca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d80b8180 con 0x7fb7d8156490 2024-05-20T18:01:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7dfeca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d80b3da0 con 0x7fb7d80d04a0 2024-05-20T18:01:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7ddc66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b3850 0x7fb7d81550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7ddc66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b3850 0x7fb7d81550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36526/0 (socket says 172.21.15.6:36526) 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7ddc66640 1 -- 172.21.15.6:0/3977124547 learned_addr learned my addr 172.21.15.6:0/3977124547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7dd465640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d80d04a0 0x7fb7d8161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7de467640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d8156490 0x7fb7d80b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7ddc66640 1 -- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d80d04a0 msgr2=0x7fb7d8161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7ddc66640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d80d04a0 0x7fb7d8161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7ddc66640 1 -- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d8156490 msgr2=0x7fb7d80b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7ddc66640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d8156490 0x7fb7d80b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7ddc66640 1 -- 172.21.15.6:0/3977124547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d815f9e0 con 0x7fb7d80b3850 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.405+0000 7fb7de467640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d8156490 0x7fb7d80b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.406+0000 7fb7ddc66640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b3850 0x7fb7d81550d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400c440 tx=0x7fb7d400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.406+0000 7fb7ce7fc640 1 -- 172.21.15.6:0/3977124547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4018070 con 0x7fb7d80b3850 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.406+0000 7fb7ce7fc640 1 -- 172.21.15.6:0/3977124547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d40074e0 con 0x7fb7d80b3850 2024-05-20T18:01:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.406+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d815fcc0 con 0x7fb7d80b3850 2024-05-20T18:01:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.406+0000 7fb7ce7fc640 1 -- 172.21.15.6:0/3977124547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4004a20 con 0x7fb7d80b3850 2024-05-20T18:01:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.406+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d8155610 con 0x7fb7d80b3850 2024-05-20T18:01:27.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.407+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d80690b0 con 0x7fb7d80b3850 2024-05-20T18:01:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.408+0000 7fb7ce7fc640 1 -- 172.21.15.6:0/3977124547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7d401b070 con 0x7fb7d80b3850 2024-05-20T18:01:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.408+0000 7fb7ce7fc640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb7bc06be30 0x7fb7bc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.408+0000 7fb7ce7fc640 1 -- 172.21.15.6:0/3977124547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5249+0+0 (secure 0 0 0) 0x7fb7d4089f60 con 0x7fb7d80b3850 2024-05-20T18:01:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.409+0000 7fb7dd465640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb7bc06be30 0x7fb7bc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:27.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.409+0000 7fb7dd465640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb7bc06be30 0x7fb7bc06e340 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8034000 tx=0x7fb7c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:27.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.413+0000 7fb7ce7fc640 1 -- 172.21.15.6:0/3977124547 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb7d40583f0 con 0x7fb7d80b3850 2024-05-20T18:01:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:27.596+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb7d80d3050 con 0x7fb7d80b3850 2024-05-20T18:01:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.503+0000 7fb7ce7fc640 1 -- 172.21.15.6:0/3977124547 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v122) ==== 138+0+0 (secure 0 0 0) 0x7fb7d405c6f0 con 0x7fb7d80b3850 2024-05-20T18:01:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T18:01:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb7bc06be30 msgr2=0x7fb7bc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb7bc06be30 0x7fb7bc06e340 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8034000 tx=0x7fb7c802e000 comp rx=0 tx=0).stop 2024-05-20T18:01:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b3850 msgr2=0x7fb7d81550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b3850 0x7fb7d81550d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400c440 tx=0x7fb7d400c900 comp rx=0 tx=0).stop 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 shutdown_connections 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb7bc06be30 0x7fb7bc06e340 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7d8156490 0x7fb7d80b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7d80d04a0 0x7fb7d8161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 --2- 172.21.15.6:0/3977124547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7d80b3850 0x7fb7d81550d0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 >> 172.21.15.6:0/3977124547 conn(0x7fb7d80d1820 msgr2=0x7fb7d80d47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 shutdown_connections 2024-05-20T18:01:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.506+0000 7fb7dfeca640 1 -- 172.21.15.6:0/3977124547 wait complete. 2024-05-20T18:01:28.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T18:01:28.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.652+0000 7f8a01084640 1 Processor -- start 2024-05-20T18:01:28.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.652+0000 7f8a01084640 1 -- start start 2024-05-20T18:01:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.653+0000 7f8a01084640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89fc0d46e0 0x7f89fc0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.653+0000 7f8a01084640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f89fc15f320 0x7f89fc08bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.653+0000 7f8a01084640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.653+0000 7f8a01084640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f89fc08c700 con 0x7f89fc0d46e0 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.653+0000 7f8a01084640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f89fc0d2890 con 0x7f89fc15f320 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.653+0000 7f8a01084640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89fc0d2b70 con 0x7f89fc08c2f0 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89fc0d46e0 0x7f89fc0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89fc0d46e0 0x7f89fc0b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47952/0 (socket says 172.21.15.6:47952) 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fad9d640 1 -- 172.21.15.6:0/4117631481 learned_addr learned my addr 172.21.15.6:0/4117631481 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fa59c640 1 --2- 172.21.15.6:0/4117631481 >> v2:172.21.15.171:3300/0 conn(0x7f89fc15f320 0x7f89fc08bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fb59e640 1 --2- 172.21.15.6:0/4117631481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fad9d640 1 -- 172.21.15.6:0/4117631481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 msgr2=0x7f89fc0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fad9d640 1 --2- 172.21.15.6:0/4117631481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc0cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fad9d640 1 -- 172.21.15.6:0/4117631481 >> v2:172.21.15.171:3300/0 conn(0x7f89fc15f320 msgr2=0x7f89fc08bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fad9d640 1 --2- 172.21.15.6:0/4117631481 >> v2:172.21.15.171:3300/0 conn(0x7f89fc15f320 0x7f89fc08bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fad9d640 1 -- 172.21.15.6:0/4117631481 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc0d2e50 con 0x7f89fc0d46e0 2024-05-20T18:01:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fb59e640 1 --2- 172.21.15.6:0/4117631481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:28.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.654+0000 7f89fa59c640 1 --2- 172.21.15.6:0/4117631481 >> v2:172.21.15.171:3300/0 conn(0x7f89fc15f320 0x7f89fc08bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.655+0000 7f89fad9d640 1 --2- 172.21.15.6:0/4117631481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0b3cd0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f89fc08cb60 tx=0x7f89ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab221d2fed082de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.655+0000 7f89f9d9b640 1 -- 172.21.15.6:0/4117631481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec037070 con 0x7f89fc0d46e0 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.655+0000 7f89f9d9b640 1 -- 172.21.15.6:0/4117631481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec032440 con 0x7f89fc0d46e0 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.655+0000 7f89f9d9b640 1 -- 172.21.15.6:0/4117631481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec032810 con 0x7f89fc0d46e0 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.655+0000 7f8a01084640 1 -- 172.21.15.6:0/4117631481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 msgr2=0x7f89fc0b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.655+0000 7f8a01084640 1 --2- 172.21.15.6:0/4117631481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0b3cd0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f89fc08cb60 tx=0x7f89ec02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.656+0000 7f8a01084640 1 -- 172.21.15.6:0/4117631481 shutdown_connections 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.656+0000 7f8a01084640 1 --2- 172.21.15.6:0/4117631481 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.656+0000 7f8a01084640 1 --2- 172.21.15.6:0/4117631481 >> v2:172.21.15.171:3300/0 conn(0x7f89fc15f320 0x7f89fc08bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.656+0000 7f8a01084640 1 --2- 172.21.15.6:0/4117631481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0b3cd0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.656+0000 7f8a01084640 1 -- 172.21.15.6:0/4117631481 >> 172.21.15.6:0/4117631481 conn(0x7f89fc0d1cd0 msgr2=0x7f89fc0d4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:28.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.656+0000 7f8a01084640 1 -- 172.21.15.6:0/4117631481 shutdown_connections 2024-05-20T18:01:28.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.656+0000 7f8a01084640 1 -- 172.21.15.6:0/4117631481 wait complete. 2024-05-20T18:01:28.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.658+0000 7f8a01084640 1 Processor -- start 2024-05-20T18:01:28.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.658+0000 7f8a01084640 1 -- start start 2024-05-20T18:01:28.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f8a01084640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc1f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:28.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f8a01084640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:28.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f8a01084640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89fc15f320 0x7f89fc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f8a01084640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc08ddb0 con 0x7f89fc0d46e0 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f8a01084640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc0d3410 con 0x7f89fc15f320 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f8a01084640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89fc15f730 con 0x7f89fc08c2f0 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47958/0 (socket says 172.21.15.6:47958) 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f89fa59c640 1 -- 172.21.15.6:0/3992162557 learned_addr learned my addr 172.21.15.6:0/3992162557 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f89fb59e640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89fc15f320 0x7f89fc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.659+0000 7f89fad9d640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc1f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89fa59c640 1 -- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 msgr2=0x7f89fc1f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89fa59c640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc1f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89fa59c640 1 -- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89fc15f320 msgr2=0x7f89fc0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89fa59c640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89fc15f320 0x7f89fc0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89fa59c640 1 -- 172.21.15.6:0/3992162557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc0c8fe0 con 0x7f89fc0d46e0 2024-05-20T18:01:28.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89fa59c640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0c82d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f89f0007e60 tx=0x7f89f000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89e37fe640 1 -- 172.21.15.6:0/3992162557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f001a070 con 0x7f89fc0d46e0 2024-05-20T18:01:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89e37fe640 1 -- 172.21.15.6:0/3992162557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f0003b90 con 0x7f89fc0d46e0 2024-05-20T18:01:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc0c92c0 con 0x7f89fc0d46e0 2024-05-20T18:01:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f89e37fe640 1 -- 172.21.15.6:0/3992162557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f000de80 con 0x7f89fc0d46e0 2024-05-20T18:01:28.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.660+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc1e7e70 con 0x7f89fc0d46e0 2024-05-20T18:01:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.661+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc0690b0 con 0x7f89fc0d46e0 2024-05-20T18:01:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.662+0000 7f89e37fe640 1 -- 172.21.15.6:0/3992162557 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89f001d070 con 0x7f89fc0d46e0 2024-05-20T18:01:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.662+0000 7f89e37fe640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89e806be30 0x7f89e806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.662+0000 7f89e37fe640 1 -- 172.21.15.6:0/3992162557 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5619+0+0 (secure 0 0 0) 0x7f89f008afb0 con 0x7f89fc0d46e0 2024-05-20T18:01:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.662+0000 7f89fad9d640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89e806be30 0x7f89e806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:28.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.663+0000 7f89fad9d640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89e806be30 0x7f89e806e340 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f89ec034000 tx=0x7f89ec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:28.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.667+0000 7f89e37fe640 1 -- 172.21.15.6:0/3992162557 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f89f0010070 con 0x7f89fc0d46e0 2024-05-20T18:01:28.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:28.853+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f89fc0cf570 con 0x7f89fc0d46e0 2024-05-20T18:01:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.513+0000 7f89e37fe640 1 -- 172.21.15.6:0/3992162557 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v123) ==== 170+0+0 (secure 0 0 0) 0x7f89f00592e0 con 0x7f89fc0d46e0 2024-05-20T18:01:29.512 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.516+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89e806be30 msgr2=0x7f89e806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.516+0000 7f8a01084640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89e806be30 0x7f89e806e340 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f89ec034000 tx=0x7f89ec02e000 comp rx=0 tx=0).stop 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.516+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 msgr2=0x7f89fc0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.516+0000 7f8a01084640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0c82d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f89f0007e60 tx=0x7f89f000d4a0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.516+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 shutdown_connections 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.516+0000 7f8a01084640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89e806be30 0x7f89e806e340 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.517+0000 7f8a01084640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89fc15f320 0x7f89fc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.517+0000 7f8a01084640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89fc0d46e0 0x7f89fc0c82d0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.517+0000 7f8a01084640 1 --2- 172.21.15.6:0/3992162557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89fc08c2f0 0x7f89fc1f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.517+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 >> 172.21.15.6:0/3992162557 conn(0x7f89fc0d1cd0 msgr2=0x7f89fc0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:29.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.517+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 shutdown_connections 2024-05-20T18:01:29.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.517+0000 7f8a01084640 1 -- 172.21.15.6:0/3992162557 wait complete. 2024-05-20T18:01:29.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T18:01:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.667+0000 7f7769564640 1 Processor -- start 2024-05-20T18:01:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.667+0000 7f7769564640 1 -- start start 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.668+0000 7f7769564640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f776406b520 0x7f776415d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.668+0000 7f7769564640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77640d1f40 0x7f7764161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.668+0000 7f7769564640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7764160b90 con 0x7f7764161350 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.668+0000 7f7769564640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f776415de60 con 0x7f77640d1f40 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.668+0000 7f7769564640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f776415e140 con 0x7f776406b520 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.668+0000 7f77637fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77640d1f40 0x7f7764161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.668+0000 7f77627fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7764161350 0x7f77640d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35852/0 (socket says 172.21.15.6:35852) 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.668+0000 7f77627fc640 1 -- 172.21.15.6:0/3338900691 learned_addr learned my addr 172.21.15.6:0/3338900691 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.669+0000 7f7762ffd640 1 --2- 172.21.15.6:0/3338900691 >> v2:172.21.15.171:3300/0 conn(0x7f776406b520 0x7f776415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.669+0000 7f77637fe640 1 -- 172.21.15.6:0/3338900691 >> v2:172.21.15.171:3300/0 conn(0x7f776406b520 msgr2=0x7f776415d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.669+0000 7f77637fe640 1 --2- 172.21.15.6:0/3338900691 >> v2:172.21.15.171:3300/0 conn(0x7f776406b520 0x7f776415d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.669+0000 7f77637fe640 1 -- 172.21.15.6:0/3338900691 >> v1:172.21.15.6:6789/0 conn(0x7f7764161350 legacy=0x7f77640d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.669+0000 7f77637fe640 1 -- 172.21.15.6:0/3338900691 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776415e420 con 0x7f77640d1f40 2024-05-20T18:01:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.669+0000 7f7761ffb640 1 -- 172.21.15.6:0/3338900691 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866612028 0 0) 0x7f7764160b90 con 0x7f7764161350 2024-05-20T18:01:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.669+0000 7f7762ffd640 1 --2- 172.21.15.6:0/3338900691 >> v2:172.21.15.171:3300/0 conn(0x7f776406b520 0x7f776415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f77637fe640 1 --2- 172.21.15.6:0/3338900691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77640d1f40 0x7f7764161760 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f776409fb00 tx=0x7f775c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df385e66de9d743b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7761ffb640 1 -- 172.21.15.6:0/3338900691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c037070 con 0x7f77640d1f40 2024-05-20T18:01:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7761ffb640 1 -- 172.21.15.6:0/3338900691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c032440 con 0x7f77640d1f40 2024-05-20T18:01:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7761ffb640 1 -- 172.21.15.6:0/3338900691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c032810 con 0x7f77640d1f40 2024-05-20T18:01:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7769564640 1 -- 172.21.15.6:0/3338900691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77640d1f40 msgr2=0x7f7764161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7769564640 1 --2- 172.21.15.6:0/3338900691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77640d1f40 0x7f7764161760 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f776409fb00 tx=0x7f775c02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7769564640 1 -- 172.21.15.6:0/3338900691 shutdown_connections 2024-05-20T18:01:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7769564640 1 --2- 172.21.15.6:0/3338900691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77640d1f40 0x7f7764161760 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7769564640 1 --2- 172.21.15.6:0/3338900691 >> v2:172.21.15.171:3300/0 conn(0x7f776406b520 0x7f776415d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.670+0000 7f7769564640 1 -- 172.21.15.6:0/3338900691 >> 172.21.15.6:0/3338900691 conn(0x7f77640b6670 msgr2=0x7f77640b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.671+0000 7f7769564640 1 -- 172.21.15.6:0/3338900691 shutdown_connections 2024-05-20T18:01:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.671+0000 7f7769564640 1 -- 172.21.15.6:0/3338900691 wait complete. 2024-05-20T18:01:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.672+0000 7f7769564640 1 Processor -- start 2024-05-20T18:01:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.672+0000 7f7769564640 1 -- start start 2024-05-20T18:01:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f7769564640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f776406b520 0x7f776413f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f7769564640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77640d1f40 0x7f77641e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f7769564640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7764161350 0x7f7764159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f7769564640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f776415da80 con 0x7f7764161350 2024-05-20T18:01:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f7769564640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7764143740 con 0x7f77640d1f40 2024-05-20T18:01:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f7769564640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f776415dc00 con 0x7f776406b520 2024-05-20T18:01:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7764161350 0x7f7764159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7764161350 0x7f7764159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47974/0 (socket says 172.21.15.6:47974) 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 -- 172.21.15.6:0/2910767000 learned_addr learned my addr 172.21.15.6:0/2910767000 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77627fc640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77640d1f40 0x7f77641e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f7762ffd640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f776406b520 0x7f776413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 -- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f776406b520 msgr2=0x7f776413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f776406b520 0x7f776413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 -- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77640d1f40 msgr2=0x7f77641e69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77640d1f40 0x7f77641e69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 -- 172.21.15.6:0/2910767000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776413f960 con 0x7f7764161350 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f7762ffd640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f776406b520 0x7f776413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.674+0000 7f77637fe640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7764161350 0x7f7764159fb0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f775c02a1e0 tx=0x7f775c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.675+0000 7f775b7fe640 1 -- 172.21.15.6:0/2910767000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c037040 con 0x7f7764161350 2024-05-20T18:01:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.675+0000 7f775b7fe640 1 -- 172.21.15.6:0/2910767000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c042070 con 0x7f7764161350 2024-05-20T18:01:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.675+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77641e7690 con 0x7f7764161350 2024-05-20T18:01:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.675+0000 7f775b7fe640 1 -- 172.21.15.6:0/2910767000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c030b50 con 0x7f7764161350 2024-05-20T18:01:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.675+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7764153780 con 0x7f7764161350 2024-05-20T18:01:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.676+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7764075b00 con 0x7f7764161350 2024-05-20T18:01:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.677+0000 7f775b7fe640 1 -- 172.21.15.6:0/2910767000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f775c030cf0 con 0x7f7764161350 2024-05-20T18:01:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.677+0000 7f775b7fe640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f774406be30 0x7f774406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.677+0000 7f775b7fe640 1 -- 172.21.15.6:0/2910767000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 6001+0+0 (secure 0 0 0) 0x7f775c0abac0 con 0x7f7764161350 2024-05-20T18:01:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.677+0000 7f7762ffd640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f774406be30 0x7f774406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.678+0000 7f7762ffd640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f774406be30 0x7f774406e340 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f77640726e0 tx=0x7f7754003cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.682+0000 7f775b7fe640 1 -- 172.21.15.6:0/2910767000 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f775c04c020 con 0x7f7764161350 2024-05-20T18:01:29.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:29.904+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f776415cd70 con 0x7f7764161350 2024-05-20T18:01:30.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.536+0000 7f775b7fe640 1 -- 172.21.15.6:0/2910767000 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v81) ==== 174+0+0 (secure 0 0 0) 0x7f776413f960 con 0x7f7764161350 2024-05-20T18:01:30.535 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 19 and data pool 20 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.545+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f774406be30 msgr2=0x7f774406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.545+0000 7f7769564640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f774406be30 0x7f774406e340 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f77640726e0 tx=0x7f7754003cd0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.545+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7764161350 msgr2=0x7f7764159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.545+0000 7f7769564640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7764161350 0x7f7764159fb0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f775c02a1e0 tx=0x7f775c0046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.546+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 shutdown_connections 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.546+0000 7f7769564640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f774406be30 0x7f774406e340 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.546+0000 7f7769564640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7764161350 0x7f7764159fb0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.546+0000 7f7769564640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77640d1f40 0x7f77641e69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.546+0000 7f7769564640 1 --2- 172.21.15.6:0/2910767000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f776406b520 0x7f776413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.546+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 >> 172.21.15.6:0/2910767000 conn(0x7f77640b6670 msgr2=0x7f7764142830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:30.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.547+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 shutdown_connections 2024-05-20T18:01:30.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.548+0000 7f7769564640 1 -- 172.21.15.6:0/2910767000 wait complete. 2024-05-20T18:01:30.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.687+0000 7fb13c7b5640 1 Processor -- start 2024-05-20T18:01:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.687+0000 7fb13c7b5640 1 -- start start 2024-05-20T18:01:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.688+0000 7fb13c7b5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb134163a10 0x7fb1340d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.688+0000 7fb13c7b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1340d14b0 0x7fb1340d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.688+0000 7fb13c7b5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1340d0370 con 0x7fb1340b4010 2024-05-20T18:01:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.688+0000 7fb13c7b5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb1340d3ca0 con 0x7fb134163a10 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.688+0000 7fb13c7b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1340d0650 con 0x7fb1340d14b0 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.688+0000 7fb139d50640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1340b4010 0x7fb1340cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35858/0 (socket says 172.21.15.6:35858) 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb139d50640 1 -- 172.21.15.6:0/2196599689 learned_addr learned my addr 172.21.15.6:0/2196599689 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13a551640 1 --2- 172.21.15.6:0/2196599689 >> v2:172.21.15.171:3300/0 conn(0x7fb134163a10 0x7fb1340d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13ad52640 1 --2- 172.21.15.6:0/2196599689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1340d14b0 0x7fb1340d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13954f640 1 -- 172.21.15.6:0/2196599689 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388439824 0 0) 0x7fb1340d0370 con 0x7fb1340b4010 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13954f640 1 -- 172.21.15.6:0/2196599689 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb120003520 con 0x7fb1340b4010 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13ad52640 1 -- 172.21.15.6:0/2196599689 >> v2:172.21.15.171:3300/0 conn(0x7fb134163a10 msgr2=0x7fb1340d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13ad52640 1 --2- 172.21.15.6:0/2196599689 >> v2:172.21.15.171:3300/0 conn(0x7fb134163a10 0x7fb1340d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13ad52640 1 -- 172.21.15.6:0/2196599689 >> v1:172.21.15.6:6789/0 conn(0x7fb1340b4010 legacy=0x7fb1340cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13ad52640 1 -- 172.21.15.6:0/2196599689 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1340d3650 con 0x7fb1340d14b0 2024-05-20T18:01:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.689+0000 7fb13a551640 1 --2- 172.21.15.6:0/2196599689 >> v2:172.21.15.171:3300/0 conn(0x7fb134163a10 0x7fb1340d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.690+0000 7fb13ad52640 1 --2- 172.21.15.6:0/2196599689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1340d14b0 0x7fb1340d18c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009d90 tx=0x7fb12c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c2b306a9e45e04 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.690+0000 7fb13954f640 1 -- 172.21.15.6:0/2196599689 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c007740 con 0x7fb1340d14b0 2024-05-20T18:01:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.690+0000 7fb13954f640 1 -- 172.21.15.6:0/2196599689 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c0078e0 con 0x7fb1340d14b0 2024-05-20T18:01:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.690+0000 7fb13954f640 1 -- 172.21.15.6:0/2196599689 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c007cb0 con 0x7fb1340d14b0 2024-05-20T18:01:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.691+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2196599689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1340d14b0 msgr2=0x7fb1340d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.691+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2196599689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1340d14b0 0x7fb1340d18c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009d90 tx=0x7fb12c02a660 comp rx=0 tx=0).stop 2024-05-20T18:01:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.691+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2196599689 shutdown_connections 2024-05-20T18:01:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.691+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2196599689 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1340d14b0 0x7fb1340d18c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.691+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2196599689 >> v2:172.21.15.171:3300/0 conn(0x7fb134163a10 0x7fb1340d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.691+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2196599689 >> 172.21.15.6:0/2196599689 conn(0x7fb13406d240 msgr2=0x7fb13406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.691+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2196599689 shutdown_connections 2024-05-20T18:01:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.691+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2196599689 wait complete. 2024-05-20T18:01:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.693+0000 7fb13c7b5640 1 Processor -- start 2024-05-20T18:01:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.693+0000 7fb13c7b5640 1 -- start start 2024-05-20T18:01:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13c7b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1340b4010 0x7fb1341626a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13c7b5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1340d14b0 0x7fb13415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13c7b5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb134163a10 0x7fb1341f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13c7b5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb1340b8210 con 0x7fb1340b4010 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13c7b5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1340d1e00 con 0x7fb1340d14b0 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13c7b5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1340b8390 con 0x7fb134163a10 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13a551640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1340b4010 0x7fb1341626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13a551640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1340b4010 0x7fb1341626a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47988/0 (socket says 172.21.15.6:47988) 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13a551640 1 -- 172.21.15.6:0/2639566947 learned_addr learned my addr 172.21.15.6:0/2639566947 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb139d50640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1340d14b0 0x7fb13415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13ad52640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb134163a10 0x7fb1341f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13a551640 1 -- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb134163a10 msgr2=0x7fb1341f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13a551640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb134163a10 0x7fb1341f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13a551640 1 -- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1340d14b0 msgr2=0x7fb13415cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13a551640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1340d14b0 0x7fb13415cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.694+0000 7fb13a551640 1 -- 172.21.15.6:0/2639566947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1340aba60 con 0x7fb1340b4010 2024-05-20T18:01:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.695+0000 7fb13a551640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1340b4010 0x7fb1341626a0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fb13000e940 tx=0x7fb13000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.695+0000 7fb12affd640 1 -- 172.21.15.6:0/2639566947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb130017070 con 0x7fb1340b4010 2024-05-20T18:01:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.695+0000 7fb12affd640 1 -- 172.21.15.6:0/2639566947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13000c9a0 con 0x7fb1340b4010 2024-05-20T18:01:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.695+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1340abd40 con 0x7fb1340b4010 2024-05-20T18:01:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.695+0000 7fb12affd640 1 -- 172.21.15.6:0/2639566947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13000cd70 con 0x7fb1340b4010 2024-05-20T18:01:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.695+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1340ac300 con 0x7fb1340b4010 2024-05-20T18:01:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.696+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb134075b00 con 0x7fb1340b4010 2024-05-20T18:01:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.696+0000 7fb12affd640 1 -- 172.21.15.6:0/2639566947 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb13001a070 con 0x7fb1340b4010 2024-05-20T18:01:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.697+0000 7fb12affd640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11806be30 0x7fb11806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.697+0000 7fb12affd640 1 -- 172.21.15.6:0/2639566947 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 6101+0+0 (secure 0 0 0) 0x7fb13008b200 con 0x7fb1340b4010 2024-05-20T18:01:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.697+0000 7fb139d50640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11806be30 0x7fb11806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.698+0000 7fb139d50640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11806be30 0x7fb11806e340 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb124007fd0 tx=0x7fb124009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.702+0000 7fb12affd640 1 -- 172.21.15.6:0/2639566947 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb130059a20 con 0x7fb1340b4010 2024-05-20T18:01:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.891+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1340d3050 con 0x7fb1340b4010 2024-05-20T18:01:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.892+0000 7fb12affd640 1 -- 172.21.15.6:0/2639566947 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16865 (secure 0 0 0) 0x7fb130059320 con 0x7fb1340b4010 2024-05-20T18:01:30.890 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:30.890 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":124,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:29.905975+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:01:27.629166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-05-20T18:01:28.885867+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11806be30 msgr2=0x7fb11806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11806be30 0x7fb11806e340 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb124007fd0 tx=0x7fb124009040 comp rx=0 tx=0).stop 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1340b4010 msgr2=0x7fb1341626a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1340b4010 0x7fb1341626a0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fb13000e940 tx=0x7fb13000ee00 comp rx=0 tx=0).stop 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 shutdown_connections 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb11806be30 0x7fb11806e340 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb134163a10 0x7fb1341f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1340d14b0 0x7fb13415cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 --2- 172.21.15.6:0/2639566947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1340b4010 0x7fb1341626a0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 >> 172.21.15.6:0/2639566947 conn(0x7fb13406d240 msgr2=0x7fb1340cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 shutdown_connections 2024-05-20T18:01:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:30.894+0000 7fb13c7b5640 1 -- 172.21.15.6:0/2639566947 wait complete. 2024-05-20T18:01:30.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:31.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.020+0000 7f35a58ca640 1 Processor -- start 2024-05-20T18:01:31.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.020+0000 7f35a58ca640 1 -- start start 2024-05-20T18:01:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f35a58ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f35a0162820 0x7f35a00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f35a58ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a00d0630 con 0x7f35a006dae0 2024-05-20T18:01:31.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f35a58ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a00d39c0 con 0x7f35a00b3e80 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f35a58ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f35a00d3ca0 con 0x7f35a0162820 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f359f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f35a006dae0 0x7f35a00b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35870/0 (socket says 172.21.15.6:35870) 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f359f7fe640 1 -- 172.21.15.6:0/3246186481 learned_addr learned my addr 172.21.15.6:0/3246186481 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f359effd640 1 --2- 172.21.15.6:0/3246186481 >> v2:172.21.15.171:3300/0 conn(0x7f35a0162820 0x7f35a00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f359dffb640 1 -- 172.21.15.6:0/3246186481 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397934017 0 0) 0x7f35a00d0630 con 0x7f35a006dae0 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f359dffb640 1 -- 172.21.15.6:0/3246186481 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3588003520 con 0x7f35a006dae0 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f359effd640 1 -- 172.21.15.6:0/3246186481 >> v1:172.21.15.171:6789/0 conn(0x7f35a00b3e80 legacy=0x7f35a006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f359effd640 1 -- 172.21.15.6:0/3246186481 >> v1:172.21.15.6:6789/0 conn(0x7f35a006dae0 legacy=0x7f35a00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.022+0000 7f359effd640 1 -- 172.21.15.6:0/3246186481 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a00d3f80 con 0x7f35a0162820 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.023+0000 7f359effd640 1 --2- 172.21.15.6:0/3246186481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0162820 0x7f35a00b3940 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3590009d90 tx=0x7f359002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b6d5d670469649e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.023+0000 7f359dffb640 1 -- 172.21.15.6:0/3246186481 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3590007740 con 0x7f35a0162820 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.023+0000 7f359dffb640 1 -- 172.21.15.6:0/3246186481 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35900078e0 con 0x7f35a0162820 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.023+0000 7f359dffb640 1 -- 172.21.15.6:0/3246186481 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3590007cb0 con 0x7f35a0162820 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.024+0000 7f35a58ca640 1 -- 172.21.15.6:0/3246186481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0162820 msgr2=0x7f35a00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.024+0000 7f35a58ca640 1 --2- 172.21.15.6:0/3246186481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0162820 0x7f35a00b3940 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3590009d90 tx=0x7f359002a6f0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.024+0000 7f35a58ca640 1 -- 172.21.15.6:0/3246186481 shutdown_connections 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.024+0000 7f35a58ca640 1 --2- 172.21.15.6:0/3246186481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0162820 0x7f35a00b3940 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.024+0000 7f35a58ca640 1 -- 172.21.15.6:0/3246186481 >> 172.21.15.6:0/3246186481 conn(0x7f35a00d4bd0 msgr2=0x7f35a00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.024+0000 7f35a58ca640 1 -- 172.21.15.6:0/3246186481 shutdown_connections 2024-05-20T18:01:31.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.024+0000 7f35a58ca640 1 -- 172.21.15.6:0/3246186481 wait complete. 2024-05-20T18:01:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.026+0000 7f35a58ca640 1 Processor -- start 2024-05-20T18:01:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.026+0000 7f35a58ca640 1 -- start start 2024-05-20T18:01:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.027+0000 7f35a58ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a00b3e80 0x7f35a00b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.027+0000 7f35a58ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a0162820 0x7f35a0152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.027+0000 7f35a58ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0156450 0x7f35a00b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.027+0000 7f35a58ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35a00d4780 con 0x7f35a0162820 2024-05-20T18:01:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.027+0000 7f35a58ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35a00d0300 con 0x7f35a0156450 2024-05-20T18:01:31.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.027+0000 7f35a58ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f35a00d4900 con 0x7f35a00b3e80 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a0162820 0x7f35a0152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a0162820 0x7f35a0152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47992/0 (socket says 172.21.15.6:47992) 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 -- 172.21.15.6:0/1271157535 learned_addr learned my addr 172.21.15.6:0/1271157535 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359f7fe640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0156450 0x7f35a00b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359effd640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a00b3e80 0x7f35a00b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 -- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a00b3e80 msgr2=0x7f35a00b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a00b3e80 0x7f35a00b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 -- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0156450 msgr2=0x7f35a00b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0156450 0x7f35a00b91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 -- 172.21.15.6:0/1271157535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a0152ca0 con 0x7f35a0162820 2024-05-20T18:01:31.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359f7fe640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0156450 0x7f35a00b91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f359e7fc640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a0162820 0x7f35a0152760 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f359400c3c0 tx=0x7f359400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f3587fff640 1 -- 172.21.15.6:0/1271157535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35940052d0 con 0x7f35a0162820 2024-05-20T18:01:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f3587fff640 1 -- 172.21.15.6:0/1271157535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3594005490 con 0x7f35a0162820 2024-05-20T18:01:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a00b5010 con 0x7f35a0162820 2024-05-20T18:01:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f3587fff640 1 -- 172.21.15.6:0/1271157535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594007260 con 0x7f35a0162820 2024-05-20T18:01:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.028+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a00cbd20 con 0x7f35a0162820 2024-05-20T18:01:31.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.029+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a0075b00 con 0x7f35a0162820 2024-05-20T18:01:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.030+0000 7f3587fff640 1 -- 172.21.15.6:0/1271157535 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3594007400 con 0x7f35a0162820 2024-05-20T18:01:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.030+0000 7f3587fff640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.031+0000 7f3587fff640 1 -- 172.21.15.6:0/1271157535 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 6101+0+0 (secure 0 0 0) 0x7f359408a590 con 0x7f35a0162820 2024-05-20T18:01:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.031+0000 7f359effd640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.031+0000 7f359effd640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3590034000 tx=0x7f3590033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:31.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.035+0000 7f3587fff640 1 -- 172.21.15.6:0/1271157535 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3594058c90 con 0x7f35a0162820 2024-05-20T18:01:31.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.225+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35a00b4da0 con 0x7f35a0162820 2024-05-20T18:01:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.226+0000 7f3587fff640 1 -- 172.21.15.6:0/1271157535 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16865 (secure 0 0 0) 0x7f3594058590 con 0x7f35a0162820 2024-05-20T18:01:31.224 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:31.224 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":124,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:29.905975+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:01:27.629166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-05-20T18:01:28.885867+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:31.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 msgr2=0x7f358c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3590034000 tx=0x7f3590033040 comp rx=0 tx=0).stop 2024-05-20T18:01:31.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a0162820 msgr2=0x7f35a0152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a0162820 0x7f35a0152760 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f359400c3c0 tx=0x7f359400c880 comp rx=0 tx=0).stop 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 shutdown_connections 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a0156450 0x7f35a00b91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35a0162820 0x7f35a0152760 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 --2- 172.21.15.6:0/1271157535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a00b3e80 0x7f35a00b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 >> 172.21.15.6:0/1271157535 conn(0x7f35a00d4bd0 msgr2=0x7f35a0160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 shutdown_connections 2024-05-20T18:01:31.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.228+0000 7f35a58ca640 1 -- 172.21.15.6:0/1271157535 wait complete. 2024-05-20T18:01:31.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T18:01:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.357+0000 7f87258d7640 1 Processor -- start 2024-05-20T18:01:31.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.357+0000 7f87258d7640 1 -- start start 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.358+0000 7f87258d7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f87200d14f0 0x7f87200b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.358+0000 7f87258d7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87200d1ac0 con 0x7f87200cf850 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f87258d7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87200d1da0 con 0x7f87200d10e0 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f87258d7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f87200d2080 con 0x7f87200d14f0 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f8717fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f87200cf850 0x7f87200b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35874/0 (socket says 172.21.15.6:35874) 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f8717fff640 1 -- 172.21.15.6:0/2945906160 learned_addr learned my addr 172.21.15.6:0/2945906160 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788596523 0 0) 0x7f87200d1ac0 con 0x7f87200cf850 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871f7fe640 1 --2- 172.21.15.6:0/2945906160 >> v2:172.21.15.171:3300/0 conn(0x7f87200d14f0 0x7f87200b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f870c003520 con 0x7f87200cf850 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1417495364 0 0) 0x7f870c003520 con 0x7f87200cf850 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 >> v2:172.21.15.171:3300/0 conn(0x7f87200d14f0 msgr2=0x7f87200b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 --2- 172.21.15.6:0/2945906160 >> v2:172.21.15.171:3300/0 conn(0x7f87200d14f0 0x7f87200b6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 >> v1:172.21.15.171:6789/0 conn(0x7f87200d10e0 legacy=0x7f87200cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87200d2360 con 0x7f87200cf850 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f8708001670 con 0x7f87200cf850 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 >> v1:172.21.15.6:6789/0 conn(0x7f87200cf850 legacy=0x7f87200b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c0039b0 0x7f870c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c004800 0x7f870c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f870c0051c0 0x7f870c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f87200d2080 con 0x7f870c0039b0 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f870c00c160 con 0x7f870c0051c0 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f870c00c360 con 0x7f870c004800 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.359+0000 7f871effd640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c0039b0 0x7f870c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f8717fff640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c004800 0x7f870c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871f7fe640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f870c0051c0 0x7f870c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871effd640 1 -- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c004800 msgr2=0x7f870c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871effd640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c004800 0x7f870c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871effd640 1 -- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f870c0051c0 msgr2=0x7f870c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871effd640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f870c0051c0 0x7f870c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871effd640 1 -- 172.21.15.6:0/2945906160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c003520 con 0x7f870c0039b0 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f8717fff640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c004800 0x7f870c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871f7fe640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f870c0051c0 0x7f870c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871f7fe640 1 -- 172.21.15.6:0/2945906160 reap_dead start 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.360+0000 7f871effd640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c0039b0 0x7f870c003e20 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f8710001750 tx=0x7f870c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd900efd23532f7a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710001370 con 0x7f870c0039b0 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87100052d0 con 0x7f870c0039b0 2024-05-20T18:01:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f871e7fc640 1 -- 172.21.15.6:0/2945906160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871002ab00 con 0x7f870c0039b0 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f87258d7640 1 -- 172.21.15.6:0/2945906160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c0039b0 msgr2=0x7f870c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f87258d7640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c0039b0 0x7f870c003e20 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f8710001750 tx=0x7f870c005830 comp rx=0 tx=0).stop 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f87258d7640 1 -- 172.21.15.6:0/2945906160 shutdown_connections 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f87258d7640 1 --2- 172.21.15.6:0/2945906160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c0039b0 0x7f870c003e20 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f87258d7640 1 -- 172.21.15.6:0/2945906160 >> 172.21.15.6:0/2945906160 conn(0x7f87200b44d0 msgr2=0x7f87200b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f87258d7640 1 -- 172.21.15.6:0/2945906160 shutdown_connections 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.361+0000 7f87258d7640 1 -- 172.21.15.6:0/2945906160 wait complete. 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.363+0000 7f87258d7640 1 Processor -- start 2024-05-20T18:01:31.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.363+0000 7f87258d7640 1 -- start start 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f87258d7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c0039b0 0x7f872015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f87258d7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87200cbd50 0x7f87200cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f87258d7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87201f3390 0x7f87201f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f87258d7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f87200b8440 con 0x7f87200cbd50 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f87258d7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f87200b82c0 con 0x7f87201f3390 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f87258d7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f87200709f0 con 0x7f870c0039b0 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87200cbd50 0x7f87200cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87200cbd50 0x7f87200cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48012/0 (socket says 172.21.15.6:48012) 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 -- 172.21.15.6:0/3542276805 learned_addr learned my addr 172.21.15.6:0/3542276805 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f871f7fe640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87201f3390 0x7f87201f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f871effd640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c0039b0 0x7f872015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 -- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c0039b0 msgr2=0x7f872015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c0039b0 0x7f872015beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 -- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87201f3390 msgr2=0x7f87201f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:31.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87201f3390 0x7f87201f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:31.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 -- 172.21.15.6:0/3542276805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87200cc670 con 0x7f87200cbd50 2024-05-20T18:01:31.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f8717fff640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87200cbd50 0x7f87200cb1b0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f870800e700 tx=0x7f870800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:31.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f871cff9640 1 -- 172.21.15.6:0/3542276805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870800c660 con 0x7f87200cbd50 2024-05-20T18:01:31.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.365+0000 7f871cff9640 1 -- 172.21.15.6:0/3542276805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8708018070 con 0x7f87200cbd50 2024-05-20T18:01:31.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.366+0000 7f871cff9640 1 -- 172.21.15.6:0/3542276805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870800ca00 con 0x7f87200cbd50 2024-05-20T18:01:31.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.366+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87200cc950 con 0x7f87200cbd50 2024-05-20T18:01:31.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.366+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87200cb6f0 con 0x7f87200cbd50 2024-05-20T18:01:31.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.367+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87200c6040 con 0x7f87200cbd50 2024-05-20T18:01:31.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.367+0000 7f871cff9640 1 -- 172.21.15.6:0/3542276805 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f870800cba0 con 0x7f87200cbd50 2024-05-20T18:01:31.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.368+0000 7f871cff9640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f870006be60 0x7f870006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:31.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.368+0000 7f871cff9640 1 -- 172.21.15.6:0/3542276805 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 6101+0+0 (secure 0 0 0) 0x7f870808add0 con 0x7f87200cbd50 2024-05-20T18:01:31.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.368+0000 7f871effd640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f870006be60 0x7f870006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:31.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.369+0000 7f871effd640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f870006be60 0x7f870006e370 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8710032000 tx=0x7f871002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:31.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.372+0000 7f871cff9640 1 -- 172.21.15.6:0/3542276805 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8708058df0 con 0x7f87200cbd50 2024-05-20T18:01:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:31.600+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8720075b00 con 0x7f87200cbd50 2024-05-20T18:01:32.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.548+0000 7f871cff9640 1 -- 172.21.15.6:0/3542276805 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) ==== 118+0+0 (secure 0 0 0) 0x7f870805d0f0 con 0x7f87200cbd50 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f870006be60 msgr2=0x7f870006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f870006be60 0x7f870006e370 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8710032000 tx=0x7f871002e000 comp rx=0 tx=0).stop 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87200cbd50 msgr2=0x7f87200cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87200cbd50 0x7f87200cb1b0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f870800e700 tx=0x7f870800ebc0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 shutdown_connections 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f870006be60 0x7f870006e370 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87201f3390 0x7f87201f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87200cbd50 0x7f87200cb1b0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 --2- 172.21.15.6:0/3542276805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f870c0039b0 0x7f872015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 >> 172.21.15.6:0/3542276805 conn(0x7f87200b44d0 msgr2=0x7f87200cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.551+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 shutdown_connections 2024-05-20T18:01:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.552+0000 7f87258d7640 1 -- 172.21.15.6:0/3542276805 wait complete. 2024-05-20T18:01:32.564 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T18:01:32.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T18:01:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.691+0000 7ff0f0c8b640 1 Processor -- start 2024-05-20T18:01:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.691+0000 7ff0f0c8b640 1 -- start start 2024-05-20T18:01:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.692+0000 7ff0f0c8b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec0b6620 0x7ff0ec0ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.692+0000 7ff0f0c8b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff0ec162ce0 0x7ff0ec0b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.692+0000 7ff0f0c8b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0ec1634a0 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.692+0000 7ff0f0c8b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff0ec0d3480 con 0x7ff0ec162ce0 2024-05-20T18:01:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.692+0000 7ff0f0c8b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ec163780 con 0x7ff0ec0b6620 2024-05-20T18:01:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0ea59c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec0b6620 0x7ff0ec0ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0e9d9b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff0ec162ce0 0x7ff0ec0b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0ead9d640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff0ec0b85b0 0x7ff0ec0d3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:47332/0 (socket says 172.21.15.6:47332) 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0ead9d640 1 -- 172.21.15.6:0/1469742371 learned_addr learned my addr 172.21.15.6:0/1469742371 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0e959a640 1 -- 172.21.15.6:0/1469742371 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613785979 0 0) 0x7ff0ec1634a0 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0e959a640 1 -- 172.21.15.6:0/1469742371 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0d8003520 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0e9d9b640 1 -- 172.21.15.6:0/1469742371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec0b6620 msgr2=0x7ff0ec0ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0e9d9b640 1 --2- 172.21.15.6:0/1469742371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec0b6620 0x7ff0ec0ba3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0e9d9b640 1 -- 172.21.15.6:0/1469742371 >> v1:172.21.15.171:6789/0 conn(0x7ff0ec0b85b0 legacy=0x7ff0ec0d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0e9d9b640 1 -- 172.21.15.6:0/1469742371 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec163a60 con 0x7ff0ec162ce0 2024-05-20T18:01:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.693+0000 7ff0ea59c640 1 --2- 172.21.15.6:0/1469742371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec0b6620 0x7ff0ec0ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.694+0000 7ff0e9d9b640 1 --2- 172.21.15.6:0/1469742371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec162ce0 0x7ff0ec0b8070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40097a0 tx=0x7ff0d402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5e6572453305a5c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.694+0000 7ff0e959a640 1 -- 172.21.15.6:0/1469742371 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4037070 con 0x7ff0ec162ce0 2024-05-20T18:01:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.694+0000 7ff0e959a640 1 -- 172.21.15.6:0/1469742371 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d4032440 con 0x7ff0ec162ce0 2024-05-20T18:01:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.694+0000 7ff0e959a640 1 -- 172.21.15.6:0/1469742371 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40327f0 con 0x7ff0ec162ce0 2024-05-20T18:01:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.695+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1469742371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec162ce0 msgr2=0x7ff0ec0b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.695+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1469742371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec162ce0 0x7ff0ec0b8070 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40097a0 tx=0x7ff0d402a180 comp rx=0 tx=0).stop 2024-05-20T18:01:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.695+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1469742371 shutdown_connections 2024-05-20T18:01:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.695+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1469742371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec162ce0 0x7ff0ec0b8070 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.695+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1469742371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec0b6620 0x7ff0ec0ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.695+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1469742371 >> 172.21.15.6:0/1469742371 conn(0x7ff0ec06d240 msgr2=0x7ff0ec06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.695+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1469742371 shutdown_connections 2024-05-20T18:01:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.695+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1469742371 wait complete. 2024-05-20T18:01:32.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.697+0000 7ff0f0c8b640 1 Processor -- start 2024-05-20T18:01:32.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.697+0000 7ff0f0c8b640 1 -- start start 2024-05-20T18:01:32.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0f0c8b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec0b6620 0x7ff0ec15a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0f0c8b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0ec0b85b0 0x7ff0ec1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0f0c8b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec162ce0 0x7ff0ec0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0f0c8b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec1630f0 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0f0c8b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec0d4300 con 0x7ff0ec0b6620 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0f0c8b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ec15bae0 con 0x7ff0ec162ce0 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0e9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0ec0b85b0 0x7ff0ec1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0e9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0ec0b85b0 0x7ff0ec1f5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48018/0 (socket says 172.21.15.6:48018) 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.698+0000 7ff0e9d9b640 1 -- 172.21.15.6:0/1108812581 learned_addr learned my addr 172.21.15.6:0/1108812581 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0ea59c640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec0b6620 0x7ff0ec15a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0ead9d640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec162ce0 0x7ff0ec0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:32.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e9d9b640 1 -- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec162ce0 msgr2=0x7ff0ec0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e9d9b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec162ce0 0x7ff0ec0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e9d9b640 1 -- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec0b6620 msgr2=0x7ff0ec15a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e9d9b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec0b6620 0x7ff0ec15a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e9d9b640 1 -- 172.21.15.6:0/1108812581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec1f8ea0 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0ea59c640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec0b6620 0x7ff0ec15a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e9d9b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0ec0b85b0 0x7ff0ec1f5990 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4000c00 tx=0x7ff0d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e2ffd640 1 -- 172.21.15.6:0/1108812581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4041020 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e2ffd640 1 -- 172.21.15.6:0/1108812581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d403d620 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ec1f66c0 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0e2ffd640 1 -- 172.21.15.6:0/1108812581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4037040 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.699+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ec1f9440 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.700+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ec1f6430 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.701+0000 7ff0e2ffd640 1 -- 172.21.15.6:0/1108812581 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0d4044020 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.701+0000 7ff0e2ffd640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0cc06be30 0x7ff0cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:32.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.701+0000 7ff0e2ffd640 1 -- 172.21.15.6:0/1108812581 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7ff0d40ab7f0 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.702+0000 7ff0ea59c640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0cc06be30 0x7ff0cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:32.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.702+0000 7ff0ea59c640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0cc06be30 0x7ff0cc06e340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009af0 tx=0x7ff0dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:32.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.706+0000 7ff0e2ffd640 1 -- 172.21.15.6:0/1108812581 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff0d404b030 con 0x7ff0ec0b85b0 2024-05-20T18:01:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:32.935+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff0ec075b00 con 0x7ff0ec0b85b0 2024-05-20T18:01:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.556+0000 7ff0e2ffd640 1 -- 172.21.15.6:0/1108812581 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) ==== 122+0+0 (secure 0 0 0) 0x7ff0d407a020 con 0x7ff0ec0b85b0 2024-05-20T18:01:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0cc06be30 msgr2=0x7ff0cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0cc06be30 0x7ff0cc06e340 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009af0 tx=0x7ff0dc008040 comp rx=0 tx=0).stop 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0ec0b85b0 msgr2=0x7ff0ec1f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0ec0b85b0 0x7ff0ec1f5990 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4000c00 tx=0x7ff0d40046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 shutdown_connections 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff0cc06be30 0x7ff0cc06e340 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff0ec162ce0 0x7ff0ec0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0ec0b85b0 0x7ff0ec1f5990 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 --2- 172.21.15.6:0/1108812581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0ec0b6620 0x7ff0ec15a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 >> 172.21.15.6:0/1108812581 conn(0x7ff0ec06d240 msgr2=0x7ff0ec161d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 shutdown_connections 2024-05-20T18:01:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.559+0000 7ff0f0c8b640 1 -- 172.21.15.6:0/1108812581 wait complete. 2024-05-20T18:01:33.571 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T18:01:33.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.696+0000 7fd991b57640 1 Processor -- start 2024-05-20T18:01:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.696+0000 7fd991b57640 1 -- start start 2024-05-20T18:01:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd991b57640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd98c15f220 0x7fd98c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd991b57640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd98c0d0e00 0x7fd98c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd991b57640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98c0cfd20 con 0x7fd98c0cf910 2024-05-20T18:01:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd991b57640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd98c0cda20 con 0x7fd98c15f220 2024-05-20T18:01:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd991b57640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd98c0cdd00 con 0x7fd98c0d0e00 2024-05-20T18:01:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd98b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd98c15f220 0x7fd98c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd98bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd98c0cf910 0x7fd98c0ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35886/0 (socket says 172.21.15.6:35886) 2024-05-20T18:01:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd98bfff640 1 -- 172.21.15.6:0/4056166939 learned_addr learned my addr 172.21.15.6:0/4056166939 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.697+0000 7fd98affd640 1 --2- 172.21.15.6:0/4056166939 >> v2:172.21.15.171:3300/0 conn(0x7fd98c0d0e00 0x7fd98c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.698+0000 7fd98b7fe640 1 -- 172.21.15.6:0/4056166939 >> v2:172.21.15.171:3300/0 conn(0x7fd98c0d0e00 msgr2=0x7fd98c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.698+0000 7fd98b7fe640 1 --2- 172.21.15.6:0/4056166939 >> v2:172.21.15.171:3300/0 conn(0x7fd98c0d0e00 0x7fd98c0cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.698+0000 7fd98b7fe640 1 -- 172.21.15.6:0/4056166939 >> v1:172.21.15.6:6789/0 conn(0x7fd98c0cf910 legacy=0x7fd98c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.698+0000 7fd98b7fe640 1 -- 172.21.15.6:0/4056166939 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c0cdfe0 con 0x7fd98c15f220 2024-05-20T18:01:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.698+0000 7fd98a7fc640 1 -- 172.21.15.6:0/4056166939 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384557039 0 0) 0x7fd984001490 con 0x7fd98c0cf910 2024-05-20T18:01:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.698+0000 7fd98b7fe640 1 --2- 172.21.15.6:0/4056166939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c15f220 0x7fd98c0d08c0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd98c068350 tx=0x7fd97c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac5409e4d184407 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd98a7fc640 1 -- 172.21.15.6:0/4056166939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c037070 con 0x7fd98c15f220 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd98a7fc640 1 -- 172.21.15.6:0/4056166939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97c032440 con 0x7fd98c15f220 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd98a7fc640 1 -- 172.21.15.6:0/4056166939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c02ae60 con 0x7fd98c15f220 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd991b57640 1 -- 172.21.15.6:0/4056166939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c15f220 msgr2=0x7fd98c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd991b57640 1 --2- 172.21.15.6:0/4056166939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c15f220 0x7fd98c0d08c0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd98c068350 tx=0x7fd97c02a110 comp rx=0 tx=0).stop 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd991b57640 1 -- 172.21.15.6:0/4056166939 shutdown_connections 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd991b57640 1 --2- 172.21.15.6:0/4056166939 >> v2:172.21.15.171:3300/0 conn(0x7fd98c0d0e00 0x7fd98c0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd991b57640 1 --2- 172.21.15.6:0/4056166939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c15f220 0x7fd98c0d08c0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd991b57640 1 -- 172.21.15.6:0/4056166939 >> 172.21.15.6:0/4056166939 conn(0x7fd98c0b44d0 msgr2=0x7fd98c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd991b57640 1 -- 172.21.15.6:0/4056166939 shutdown_connections 2024-05-20T18:01:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.699+0000 7fd991b57640 1 -- 172.21.15.6:0/4056166939 wait complete. 2024-05-20T18:01:33.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.701+0000 7fd991b57640 1 Processor -- start 2024-05-20T18:01:33.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.701+0000 7fd991b57640 1 -- start start 2024-05-20T18:01:33.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.702+0000 7fd991b57640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd98c0cf910 0x7fd98c0cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:33.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd991b57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c0d0e00 0x7fd98c14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:33.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd991b57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd98c15f220 0x7fd98c0ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:33.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd991b57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c0cd800 con 0x7fd98c0d0e00 2024-05-20T18:01:33.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd991b57640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c0cd680 con 0x7fd98c0cf910 2024-05-20T18:01:33.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd991b57640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd98c15f630 con 0x7fd98c15f220 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c0d0e00 0x7fd98c14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c0d0e00 0x7fd98c14dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48038/0 (socket says 172.21.15.6:48038) 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 -- 172.21.15.6:0/1568203236 learned_addr learned my addr 172.21.15.6:0/1568203236 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98bfff640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd98c15f220 0x7fd98c0ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98b7fe640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd98c0cf910 0x7fd98c0cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 -- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd98c15f220 msgr2=0x7fd98c0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd98c15f220 0x7fd98c0ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 -- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd98c0cf910 msgr2=0x7fd98c0cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd98c0cf910 0x7fd98c0cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 -- 172.21.15.6:0/1568203236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c0cae00 con 0x7fd98c0d0e00 2024-05-20T18:01:33.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd98affd640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c0d0e00 0x7fd98c14dd10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd98000d5a0 tx=0x7fd98000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:33.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.703+0000 7fd973fff640 1 -- 172.21.15.6:0/1568203236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980019070 con 0x7fd98c0d0e00 2024-05-20T18:01:33.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.704+0000 7fd973fff640 1 -- 172.21.15.6:0/1568203236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd980004240 con 0x7fd98c0d0e00 2024-05-20T18:01:33.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.704+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98c0cb300 con 0x7fd98c0d0e00 2024-05-20T18:01:33.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.704+0000 7fd973fff640 1 -- 172.21.15.6:0/1568203236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980003610 con 0x7fd98c0d0e00 2024-05-20T18:01:33.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.704+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98c0cb8c0 con 0x7fd98c0d0e00 2024-05-20T18:01:33.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.705+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98c075b00 con 0x7fd98c0d0e00 2024-05-20T18:01:33.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.705+0000 7fd973fff640 1 -- 172.21.15.6:0/1568203236 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd98001c070 con 0x7fd98c0d0e00 2024-05-20T18:01:33.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.706+0000 7fd973fff640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd97806be60 0x7fd97806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:33.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.706+0000 7fd973fff640 1 -- 172.21.15.6:0/1568203236 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fd98008a8f0 con 0x7fd98c0d0e00 2024-05-20T18:01:33.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.706+0000 7fd98b7fe640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd97806be60 0x7fd97806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:33.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.707+0000 7fd98b7fe640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd97806be60 0x7fd97806e370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd97c034000 tx=0x7fd97c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:33.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.710+0000 7fd973fff640 1 -- 172.21.15.6:0/1568203236 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd980058a20 con 0x7fd98c0d0e00 2024-05-20T18:01:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.931+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd98c162c60 con 0x7fd98c0d0e00 2024-05-20T18:01:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.932+0000 7fd973fff640 1 -- 172.21.15.6:0/1568203236 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5180 (secure 0 0 0) 0x7fd98005cd20 con 0x7fd98c0d0e00 2024-05-20T18:01:33.930 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:33.930 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:01:29.906318+0000","modified":"2024-05-20T18:01:32.936865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/524087551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":524087551},{"type":"v1","addr":"172.21.15.6:6835","nonce":524087551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-05-20T18:01:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 85 2024-05-20T18:01:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd97806be60 msgr2=0x7fd97806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd97806be60 0x7fd97806e370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd97c034000 tx=0x7fd97c02e000 comp rx=0 tx=0).stop 2024-05-20T18:01:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c0d0e00 msgr2=0x7fd98c14dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c0d0e00 0x7fd98c14dd10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd98000d5a0 tx=0x7fd98000da60 comp rx=0 tx=0).stop 2024-05-20T18:01:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 shutdown_connections 2024-05-20T18:01:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd97806be60 0x7fd97806e370 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd98c15f220 0x7fd98c0ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd98c0d0e00 0x7fd98c14dd10 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 --2- 172.21.15.6:0/1568203236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd98c0cf910 0x7fd98c0cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 >> 172.21.15.6:0/1568203236 conn(0x7fd98c0b44d0 msgr2=0x7fd98c0b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 shutdown_connections 2024-05-20T18:01:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:33.934+0000 7fd991b57640 1 -- 172.21.15.6:0/1568203236 wait complete. 2024-05-20T18:01:33.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.059+0000 7f66533ea640 1 Processor -- start 2024-05-20T18:01:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.060+0000 7f66533ea640 1 -- start start 2024-05-20T18:01:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f66533ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c06d3d0 0x7f664c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f66533ea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f664c0b8190 0x7f664c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f66533ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c06dd20 con 0x7f664c162820 2024-05-20T18:01:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f66533ea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f664c0d0630 con 0x7f664c0b8190 2024-05-20T18:01:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f66533ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f664c0d39c0 con 0x7f664c06d3d0 2024-05-20T18:01:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f6650985640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c06d3d0 0x7f664c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f6651987640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f664c0b8190 0x7f664c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f6651186640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f664c162820 0x7f664c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:47340/0 (socket says 172.21.15.6:47340) 2024-05-20T18:01:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.061+0000 7f6651186640 1 -- 172.21.15.6:0/3363923503 learned_addr learned my addr 172.21.15.6:0/3363923503 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.062+0000 7f664bfff640 1 -- 172.21.15.6:0/3363923503 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942719963 0 0) 0x7f663c001490 con 0x7f664c162820 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.062+0000 7f664bfff640 1 -- 172.21.15.6:0/3363923503 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6634003520 con 0x7f664c162820 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.062+0000 7f6651987640 1 -- 172.21.15.6:0/3363923503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c06d3d0 msgr2=0x7f664c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.062+0000 7f6651987640 1 --2- 172.21.15.6:0/3363923503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c06d3d0 0x7f664c06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.062+0000 7f6651987640 1 -- 172.21.15.6:0/3363923503 >> v1:172.21.15.171:6789/0 conn(0x7f664c162820 legacy=0x7f664c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.062+0000 7f6651987640 1 -- 172.21.15.6:0/3363923503 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c0d3ca0 con 0x7f664c0b8190 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.062+0000 7f6650985640 1 --2- 172.21.15.6:0/3363923503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c06d3d0 0x7f664c06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.062+0000 7f6651987640 1 --2- 172.21.15.6:0/3363923503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 0x7f664c0b85a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f66440097a0 tx=0x7f664402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1dc756179ce3a70 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f664bfff640 1 -- 172.21.15.6:0/3363923503 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644037070 con 0x7f664c0b8190 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f664bfff640 1 -- 172.21.15.6:0/3363923503 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6644032440 con 0x7f664c0b8190 2024-05-20T18:01:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f664bfff640 1 -- 172.21.15.6:0/3363923503 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66440327f0 con 0x7f664c0b8190 2024-05-20T18:01:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f66533ea640 1 -- 172.21.15.6:0/3363923503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 msgr2=0x7f664c0b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f66533ea640 1 --2- 172.21.15.6:0/3363923503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 0x7f664c0b85a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f66440097a0 tx=0x7f664402a180 comp rx=0 tx=0).stop 2024-05-20T18:01:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f66533ea640 1 -- 172.21.15.6:0/3363923503 shutdown_connections 2024-05-20T18:01:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f66533ea640 1 --2- 172.21.15.6:0/3363923503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 0x7f664c0b85a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f66533ea640 1 --2- 172.21.15.6:0/3363923503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c06d3d0 0x7f664c06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f66533ea640 1 -- 172.21.15.6:0/3363923503 >> 172.21.15.6:0/3363923503 conn(0x7f664c0d4bd0 msgr2=0x7f664c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.063+0000 7f66533ea640 1 -- 172.21.15.6:0/3363923503 shutdown_connections 2024-05-20T18:01:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.064+0000 7f66533ea640 1 -- 172.21.15.6:0/3363923503 wait complete. 2024-05-20T18:01:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.065+0000 7f66533ea640 1 Processor -- start 2024-05-20T18:01:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.065+0000 7f66533ea640 1 -- start start 2024-05-20T18:01:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f66533ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c06d3d0 0x7f664c154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f66533ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 0x7f664c157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f66533ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c162820 0x7f664c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f66533ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f664c0d0300 con 0x7f664c06d3d0 2024-05-20T18:01:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f66533ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f664c0d4260 con 0x7f664c0b8190 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f66533ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f664c0b4050 con 0x7f664c162820 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c06d3d0 0x7f664c154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c06d3d0 0x7f664c154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48048/0 (socket says 172.21.15.6:48048) 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 -- 172.21.15.6:0/2125321604 learned_addr learned my addr 172.21.15.6:0/2125321604 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651987640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c162820 0x7f664c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6650985640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 0x7f664c157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 -- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c162820 msgr2=0x7f664c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c162820 0x7f664c1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 -- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 msgr2=0x7f664c157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 0x7f664c157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 -- 172.21.15.6:0/2125321604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c0b74c0 con 0x7f664c06d3d0 2024-05-20T18:01:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6651186640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c06d3d0 0x7f664c154fe0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f663c00cb40 tx=0x7f663c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.067+0000 7f6649ffb640 1 -- 172.21.15.6:0/2125321604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c017070 con 0x7f664c06d3d0 2024-05-20T18:01:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.068+0000 7f6649ffb640 1 -- 172.21.15.6:0/2125321604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f663c00ac40 con 0x7f664c06d3d0 2024-05-20T18:01:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.068+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664c0b6f00 con 0x7f664c06d3d0 2024-05-20T18:01:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.068+0000 7f6649ffb640 1 -- 172.21.15.6:0/2125321604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c012400 con 0x7f664c06d3d0 2024-05-20T18:01:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.068+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f664c0b46d0 con 0x7f664c06d3d0 2024-05-20T18:01:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.069+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664c075b00 con 0x7f664c06d3d0 2024-05-20T18:01:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.070+0000 7f6649ffb640 1 -- 172.21.15.6:0/2125321604 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f663c01a070 con 0x7f664c06d3d0 2024-05-20T18:01:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.070+0000 7f6649ffb640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f663806be60 0x7f663806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.070+0000 7f6649ffb640 1 -- 172.21.15.6:0/2125321604 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f663c08ae10 con 0x7f664c06d3d0 2024-05-20T18:01:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.070+0000 7f6650985640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f663806be60 0x7f663806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.071+0000 7f6650985640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f663806be60 0x7f663806e370 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f664c155cb0 tx=0x7f6640009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.075+0000 7f6649ffb640 1 -- 172.21.15.6:0/2125321604 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f663c08e030 con 0x7f664c06d3d0 2024-05-20T18:01:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.258+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f664c157ef0 con 0x7f664c06d3d0 2024-05-20T18:01:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.260+0000 7f6649ffb640 1 -- 172.21.15.6:0/2125321604 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16852 (secure 0 0 0) 0x7f664c06dd20 con 0x7f664c06d3d0 2024-05-20T18:01:34.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:34.258 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":125,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:31.516805+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:01:27.629166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-05-20T18:01:28.885867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f663806be60 msgr2=0x7f663806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f663806be60 0x7f663806e370 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f664c155cb0 tx=0x7f6640009190 comp rx=0 tx=0).stop 2024-05-20T18:01:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c06d3d0 msgr2=0x7f664c154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c06d3d0 0x7f664c154fe0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f663c00cb40 tx=0x7f663c00a060 comp rx=0 tx=0).stop 2024-05-20T18:01:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 shutdown_connections 2024-05-20T18:01:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f663806be60 0x7f663806e370 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f664c162820 0x7f664c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f664c0b8190 0x7f664c157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 --2- 172.21.15.6:0/2125321604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f664c06d3d0 0x7f664c154fe0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 >> 172.21.15.6:0/2125321604 conn(0x7f664c0d4bd0 msgr2=0x7f664c15f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 shutdown_connections 2024-05-20T18:01:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.262+0000 7f66533ea640 1 -- 172.21.15.6:0/2125321604 wait complete. 2024-05-20T18:01:34.272 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T18:01:34.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:01:34.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.388+0000 7f586aebc640 1 Processor -- start 2024-05-20T18:01:34.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.388+0000 7f586aebc640 1 -- start start 2024-05-20T18:01:34.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f586aebc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f586406d3d0 0x7f586406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f586aebc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58640b8190 0x7f58640b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f586aebc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f586406dd20 con 0x7f5864162820 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f586aebc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f58640d0630 con 0x7f58640b8190 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f586aebc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f58640d39c0 con 0x7f586406d3d0 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f5868c58640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5864162820 0x7f58640b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35888/0 (socket says 172.21.15.6:35888) 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f5869459640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58640b8190 0x7f58640b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f5868c58640 1 -- 172.21.15.6:0/1573991971 learned_addr learned my addr 172.21.15.6:0/1573991971 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f5863fff640 1 --2- 172.21.15.6:0/1573991971 >> v2:172.21.15.171:3300/0 conn(0x7f586406d3d0 0x7f586406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f58637fe640 1 -- 172.21.15.6:0/1573991971 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962841275 0 0) 0x7f584c001110 con 0x7f5864162820 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f58637fe640 1 -- 172.21.15.6:0/1573991971 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5850003520 con 0x7f5864162820 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f5869459640 1 -- 172.21.15.6:0/1573991971 >> v2:172.21.15.171:3300/0 conn(0x7f586406d3d0 msgr2=0x7f586406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f5869459640 1 --2- 172.21.15.6:0/1573991971 >> v2:172.21.15.171:3300/0 conn(0x7f586406d3d0 0x7f586406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f5869459640 1 -- 172.21.15.6:0/1573991971 >> v1:172.21.15.6:6789/0 conn(0x7f5864162820 legacy=0x7f58640b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.390+0000 7f5869459640 1 -- 172.21.15.6:0/1573991971 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58640d3ca0 con 0x7f58640b8190 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.391+0000 7f5869459640 1 --2- 172.21.15.6:0/1573991971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f58640b85a0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f58640d1230 tx=0x7f585c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cc6853547b740 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.391+0000 7f58637fe640 1 -- 172.21.15.6:0/1573991971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c037070 con 0x7f58640b8190 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.391+0000 7f58637fe640 1 -- 172.21.15.6:0/1573991971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c032440 con 0x7f58640b8190 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.391+0000 7f58637fe640 1 -- 172.21.15.6:0/1573991971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c032810 con 0x7f58640b8190 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.392+0000 7f586aebc640 1 -- 172.21.15.6:0/1573991971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 msgr2=0x7f58640b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.392+0000 7f586aebc640 1 --2- 172.21.15.6:0/1573991971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f58640b85a0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f58640d1230 tx=0x7f585c02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.392+0000 7f586aebc640 1 -- 172.21.15.6:0/1573991971 shutdown_connections 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.392+0000 7f586aebc640 1 --2- 172.21.15.6:0/1573991971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f58640b85a0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.392+0000 7f586aebc640 1 --2- 172.21.15.6:0/1573991971 >> v2:172.21.15.171:3300/0 conn(0x7f586406d3d0 0x7f586406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.392+0000 7f586aebc640 1 -- 172.21.15.6:0/1573991971 >> 172.21.15.6:0/1573991971 conn(0x7f58640d4bd0 msgr2=0x7f58640d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.392+0000 7f586aebc640 1 -- 172.21.15.6:0/1573991971 shutdown_connections 2024-05-20T18:01:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.392+0000 7f586aebc640 1 -- 172.21.15.6:0/1573991971 wait complete. 2024-05-20T18:01:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.394+0000 7f586aebc640 1 Processor -- start 2024-05-20T18:01:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.394+0000 7f586aebc640 1 -- start start 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f586aebc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586406d3d0 0x7f58641f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f586aebc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f5864157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f586aebc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5864162820 0x7f5864156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f586aebc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f58640d0300 con 0x7f58640b8190 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f586aebc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58640d4260 con 0x7f586406d3d0 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f586aebc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58640b4050 con 0x7f5864162820 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f5863fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f5864157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f5863fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f5864157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48072/0 (socket says 172.21.15.6:48072) 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.395+0000 7f5863fff640 1 -- 172.21.15.6:0/1244257395 learned_addr learned my addr 172.21.15.6:0/1244257395 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5868c58640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586406d3d0 0x7f58641f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5869459640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5864162820 0x7f5864156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5863fff640 1 -- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5864162820 msgr2=0x7f5864156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5863fff640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5864162820 0x7f5864156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5863fff640 1 -- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586406d3d0 msgr2=0x7f58641f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5863fff640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586406d3d0 0x7f58641f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5863fff640 1 -- 172.21.15.6:0/1244257395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58641f5b50 con 0x7f58640b8190 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5869459640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5864162820 0x7f5864156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f5863fff640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f5864157e50 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f5854007e40 tx=0x7f585400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f58617fa640 1 -- 172.21.15.6:0/1244257395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854014620 con 0x7f58640b8190 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f58617fa640 1 -- 172.21.15.6:0/1244257395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5854019070 con 0x7f58640b8190 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58641f5e30 con 0x7f58640b8190 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f58617fa640 1 -- 172.21.15.6:0/1244257395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854014a00 con 0x7f58640b8190 2024-05-20T18:01:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.396+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586415b330 con 0x7f58640b8190 2024-05-20T18:01:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.397+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58641f58c0 con 0x7f58640b8190 2024-05-20T18:01:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.398+0000 7f58617fa640 1 -- 172.21.15.6:0/1244257395 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5854014ba0 con 0x7f58640b8190 2024-05-20T18:01:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.398+0000 7f58617fa640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.398+0000 7f58617fa640 1 -- 172.21.15.6:0/1244257395 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f585408b7a0 con 0x7f58640b8190 2024-05-20T18:01:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.399+0000 7f5868c58640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.399+0000 7f5868c58640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f584c005880 tx=0x7f584c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.403+0000 7f58617fa640 1 -- 172.21.15.6:0/1244257395 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5854059fc0 con 0x7f58640b8190 2024-05-20T18:01:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.583+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5864158390 con 0x7f584406be30 2024-05-20T18:01:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.590+0000 7f58617fa640 1 -- 172.21.15.6:0/1244257395 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7f5864158390 con 0x7f584406be30 2024-05-20T18:01:34.591 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 msgr2=0x7f584406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f584c005880 tx=0x7f584c009040 comp rx=0 tx=0).stop 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 msgr2=0x7f5864157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f5864157e50 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f5854007e40 tx=0x7f585400e4b0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 shutdown_connections 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5864162820 0x7f5864156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58640b8190 0x7f5864157e50 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 --2- 172.21.15.6:0/1244257395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f586406d3d0 0x7f58641f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 >> 172.21.15.6:0/1244257395 conn(0x7f58640d4bd0 msgr2=0x7f58640b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 shutdown_connections 2024-05-20T18:01:34.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.593+0000 7f586aebc640 1 -- 172.21.15.6:0/1244257395 wait complete. 2024-05-20T18:01:34.603 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2024-05-20T18:01:34.364828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271244,"kb_used_data":13448,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703476,"statfs":{"total":773094113280,"available":772816359424,"internally_reserved":0,"allocated":13770752,"data_stored":6983572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.857003"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524177+0000","last_change":"2024-05-20T18:01:30.543059+0000","last_active":"2024-05-20T18:01:31.524177+0000","last_peered":"2024-05-20T18:01:31.524177+0000","last_clean":"2024-05-20T18:01:31.524177+0000","last_became_active":"2024-05-20T18:01:30.542755+0000","last_became_peered":"2024-05-20T18:01:30.542755+0000","last_unstale":"2024-05-20T18:01:31.524177+0000","last_undegraded":"2024-05-20T18:01:31.524177+0000","last_fullsized":"2024-05-20T18:01:31.524177+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:34:35.691665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549249+0000","last_change":"2024-05-20T18:01:30.524254+0000","last_active":"2024-05-20T18:01:31.549249+0000","last_peered":"2024-05-20T18:01:31.549249+0000","last_clean":"2024-05-20T18:01:31.549249+0000","last_became_active":"2024-05-20T18:01:30.523914+0000","last_became_peered":"2024-05-20T18:01:30.523914+0000","last_unstale":"2024-05-20T18:01:31.549249+0000","last_undegraded":"2024-05-20T18:01:31.549249+0000","last_fullsized":"2024-05-20T18:01:31.549249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:32:46.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336348+0000","last_change":"2024-05-20T18:01:30.540135+0000","last_active":"2024-05-20T18:01:32.336348+0000","last_peered":"2024-05-20T18:01:32.336348+0000","last_clean":"2024-05-20T18:01:32.336348+0000","last_became_active":"2024-05-20T18:01:30.539707+0000","last_became_peered":"2024-05-20T18:01:30.539707+0000","last_unstale":"2024-05-20T18:01:32.336348+0000","last_undegraded":"2024-05-20T18:01:32.336348+0000","last_fullsized":"2024-05-20T18:01:32.336348+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:45:27.941563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549115+0000","last_change":"2024-05-20T18:01:30.535669+0000","last_active":"2024-05-20T18:01:31.549115+0000","last_peered":"2024-05-20T18:01:31.549115+0000","last_clean":"2024-05-20T18:01:31.549115+0000","last_became_active":"2024-05-20T18:01:30.535356+0000","last_became_peered":"2024-05-20T18:01:30.535356+0000","last_unstale":"2024-05-20T18:01:31.549115+0000","last_undegraded":"2024-05-20T18:01:31.549115+0000","last_fullsized":"2024-05-20T18:01:31.549115+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:44:02.726862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734494+0000","last_change":"2024-05-20T18:01:30.533924+0000","last_active":"2024-05-20T18:01:31.734494+0000","last_peered":"2024-05-20T18:01:31.734494+0000","last_clean":"2024-05-20T18:01:31.734494+0000","last_became_active":"2024-05-20T18:01:30.532425+0000","last_became_peered":"2024-05-20T18:01:30.532425+0000","last_unstale":"2024-05-20T18:01:31.734494+0000","last_undegraded":"2024-05-20T18:01:31.734494+0000","last_fullsized":"2024-05-20T18:01:31.734494+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:12.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015889+0000","last_change":"2024-05-20T18:01:30.541748+0000","last_active":"2024-05-20T18:01:32.015889+0000","last_peered":"2024-05-20T18:01:32.015889+0000","last_clean":"2024-05-20T18:01:32.015889+0000","last_became_active":"2024-05-20T18:01:30.541420+0000","last_became_peered":"2024-05-20T18:01:30.541420+0000","last_unstale":"2024-05-20T18:01:32.015889+0000","last_undegraded":"2024-05-20T18:01:32.015889+0000","last_fullsized":"2024-05-20T18:01:32.015889+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:54.115869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335709+0000","last_change":"2024-05-20T18:01:30.539828+0000","last_active":"2024-05-20T18:01:32.335709+0000","last_peered":"2024-05-20T18:01:32.335709+0000","last_clean":"2024-05-20T18:01:32.335709+0000","last_became_active":"2024-05-20T18:01:30.539498+0000","last_became_peered":"2024-05-20T18:01:30.539498+0000","last_unstale":"2024-05-20T18:01:32.335709+0000","last_undegraded":"2024-05-20T18:01:32.335709+0000","last_fullsized":"2024-05-20T18:01:32.335709+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:19.322566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524006+0000","last_change":"2024-05-20T18:01:30.538797+0000","last_active":"2024-05-20T18:01:31.524006+0000","last_peered":"2024-05-20T18:01:31.524006+0000","last_clean":"2024-05-20T18:01:31.524006+0000","last_became_active":"2024-05-20T18:01:30.538401+0000","last_became_peered":"2024-05-20T18:01:30.538401+0000","last_unstale":"2024-05-20T18:01:31.524006+0000","last_undegraded":"2024-05-20T18:01:31.524006+0000","last_fullsized":"2024-05-20T18:01:31.524006+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:32.270039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.016157+0000","last_change":"2024-05-20T18:01:30.527846+0000","last_active":"2024-05-20T18:01:32.016157+0000","last_peered":"2024-05-20T18:01:32.016157+0000","last_clean":"2024-05-20T18:01:32.016157+0000","last_became_active":"2024-05-20T18:01:30.527463+0000","last_became_peered":"2024-05-20T18:01:30.527463+0000","last_unstale":"2024-05-20T18:01:32.016157+0000","last_undegraded":"2024-05-20T18:01:32.016157+0000","last_fullsized":"2024-05-20T18:01:32.016157+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:20.788605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520515+0000","last_change":"2024-05-20T18:01:30.531047+0000","last_active":"2024-05-20T18:01:31.520515+0000","last_peered":"2024-05-20T18:01:31.520515+0000","last_clean":"2024-05-20T18:01:31.520515+0000","last_became_active":"2024-05-20T18:01:30.530700+0000","last_became_peered":"2024-05-20T18:01:30.530700+0000","last_unstale":"2024-05-20T18:01:31.520515+0000","last_undegraded":"2024-05-20T18:01:31.520515+0000","last_fullsized":"2024-05-20T18:01:31.520515+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:47.874155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549166+0000","last_change":"2024-05-20T18:01:30.541077+0000","last_active":"2024-05-20T18:01:31.549166+0000","last_peered":"2024-05-20T18:01:31.549166+0000","last_clean":"2024-05-20T18:01:31.549166+0000","last_became_active":"2024-05-20T18:01:30.540760+0000","last_became_peered":"2024-05-20T18:01:30.540760+0000","last_unstale":"2024-05-20T18:01:31.549166+0000","last_undegraded":"2024-05-20T18:01:31.549166+0000","last_fullsized":"2024-05-20T18:01:31.549166+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:24:09.049875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524125+0000","last_change":"2024-05-20T18:01:30.542151+0000","last_active":"2024-05-20T18:01:31.524125+0000","last_peered":"2024-05-20T18:01:31.524125+0000","last_clean":"2024-05-20T18:01:31.524125+0000","last_became_active":"2024-05-20T18:01:30.541814+0000","last_became_peered":"2024-05-20T18:01:30.541814+0000","last_unstale":"2024-05-20T18:01:31.524125+0000","last_undegraded":"2024-05-20T18:01:31.524125+0000","last_fullsized":"2024-05-20T18:01:31.524125+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:06.285028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015951+0000","last_change":"2024-05-20T18:01:30.543827+0000","last_active":"2024-05-20T18:01:32.015951+0000","last_peered":"2024-05-20T18:01:32.015951+0000","last_clean":"2024-05-20T18:01:32.015951+0000","last_became_active":"2024-05-20T18:01:30.543410+0000","last_became_peered":"2024-05-20T18:01:30.543410+0000","last_unstale":"2024-05-20T18:01:32.015951+0000","last_undegraded":"2024-05-20T18:01:32.015951+0000","last_fullsized":"2024-05-20T18:01:32.015951+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:39.183454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523753+0000","last_change":"2024-05-20T18:01:30.544588+0000","last_active":"2024-05-20T18:01:31.523753+0000","last_peered":"2024-05-20T18:01:31.523753+0000","last_clean":"2024-05-20T18:01:31.523753+0000","last_became_active":"2024-05-20T18:01:30.544256+0000","last_became_peered":"2024-05-20T18:01:30.544256+0000","last_unstale":"2024-05-20T18:01:31.523753+0000","last_undegraded":"2024-05-20T18:01:31.523753+0000","last_fullsized":"2024-05-20T18:01:31.523753+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:50.788212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523724+0000","last_change":"2024-05-20T18:01:30.545443+0000","last_active":"2024-05-20T18:01:31.523724+0000","last_peered":"2024-05-20T18:01:31.523724+0000","last_clean":"2024-05-20T18:01:31.523724+0000","last_became_active":"2024-05-20T18:01:30.545087+0000","last_became_peered":"2024-05-20T18:01:30.545087+0000","last_unstale":"2024-05-20T18:01:31.523724+0000","last_undegraded":"2024-05-20T18:01:31.523724+0000","last_fullsized":"2024-05-20T18:01:31.523724+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:56.971628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015534+0000","last_change":"2024-05-20T18:01:30.529625+0000","last_active":"2024-05-20T18:01:32.015534+0000","last_peered":"2024-05-20T18:01:32.015534+0000","last_clean":"2024-05-20T18:01:32.015534+0000","last_became_active":"2024-05-20T18:01:30.529278+0000","last_became_peered":"2024-05-20T18:01:30.529278+0000","last_unstale":"2024-05-20T18:01:32.015534+0000","last_undegraded":"2024-05-20T18:01:32.015534+0000","last_fullsized":"2024-05-20T18:01:32.015534+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:01.696479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.016163+0000","last_change":"2024-05-20T18:01:30.535507+0000","last_active":"2024-05-20T18:01:32.016163+0000","last_peered":"2024-05-20T18:01:32.016163+0000","last_clean":"2024-05-20T18:01:32.016163+0000","last_became_active":"2024-05-20T18:01:30.533092+0000","last_became_peered":"2024-05-20T18:01:30.533092+0000","last_unstale":"2024-05-20T18:01:32.016163+0000","last_undegraded":"2024-05-20T18:01:32.016163+0000","last_fullsized":"2024-05-20T18:01:32.016163+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:53.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734754+0000","last_change":"2024-05-20T18:01:30.539210+0000","last_active":"2024-05-20T18:01:31.734754+0000","last_peered":"2024-05-20T18:01:31.734754+0000","last_clean":"2024-05-20T18:01:31.734754+0000","last_became_active":"2024-05-20T18:01:30.538840+0000","last_became_peered":"2024-05-20T18:01:30.538840+0000","last_unstale":"2024-05-20T18:01:31.734754+0000","last_undegraded":"2024-05-20T18:01:31.734754+0000","last_fullsized":"2024-05-20T18:01:31.734754+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:16.742767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335339+0000","last_change":"2024-05-20T18:01:30.534483+0000","last_active":"2024-05-20T18:01:32.335339+0000","last_peered":"2024-05-20T18:01:32.335339+0000","last_clean":"2024-05-20T18:01:32.335339+0000","last_became_active":"2024-05-20T18:01:30.534167+0000","last_became_peered":"2024-05-20T18:01:30.534167+0000","last_unstale":"2024-05-20T18:01:32.335339+0000","last_undegraded":"2024-05-20T18:01:32.335339+0000","last_fullsized":"2024-05-20T18:01:32.335339+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:10:08.754119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734630+0000","last_change":"2024-05-20T18:01:30.535461+0000","last_active":"2024-05-20T18:01:31.734630+0000","last_peered":"2024-05-20T18:01:31.734630+0000","last_clean":"2024-05-20T18:01:31.734630+0000","last_became_active":"2024-05-20T18:01:30.535122+0000","last_became_peered":"2024-05-20T18:01:30.535122+0000","last_unstale":"2024-05-20T18:01:31.734630+0000","last_undegraded":"2024-05-20T18:01:31.734630+0000","last_fullsized":"2024-05-20T18:01:31.734630+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:05:35.260960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549119+0000","last_change":"2024-05-20T18:01:30.527652+0000","last_active":"2024-05-20T18:01:31.549119+0000","last_peered":"2024-05-20T18:01:31.549119+0000","last_clean":"2024-05-20T18:01:31.549119+0000","last_became_active":"2024-05-20T18:01:30.527327+0000","last_became_peered":"2024-05-20T18:01:30.527327+0000","last_unstale":"2024-05-20T18:01:31.549119+0000","last_undegraded":"2024-05-20T18:01:31.549119+0000","last_fullsized":"2024-05-20T18:01:31.549119+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:32:42.247888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523689+0000","last_change":"2024-05-20T18:01:30.540158+0000","last_active":"2024-05-20T18:01:31.523689+0000","last_peered":"2024-05-20T18:01:31.523689+0000","last_clean":"2024-05-20T18:01:31.523689+0000","last_became_active":"2024-05-20T18:01:30.539522+0000","last_became_peered":"2024-05-20T18:01:30.539522+0000","last_unstale":"2024-05-20T18:01:31.523689+0000","last_undegraded":"2024-05-20T18:01:31.523689+0000","last_fullsized":"2024-05-20T18:01:31.523689+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:21:20.833730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549063+0000","last_change":"2024-05-20T18:01:30.531758+0000","last_active":"2024-05-20T18:01:31.549063+0000","last_peered":"2024-05-20T18:01:31.549063+0000","last_clean":"2024-05-20T18:01:31.549063+0000","last_became_active":"2024-05-20T18:01:30.531432+0000","last_became_peered":"2024-05-20T18:01:30.531432+0000","last_unstale":"2024-05-20T18:01:31.549063+0000","last_undegraded":"2024-05-20T18:01:31.549063+0000","last_fullsized":"2024-05-20T18:01:31.549063+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:32.270039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015784+0000","last_change":"2024-05-20T18:01:30.527605+0000","last_active":"2024-05-20T18:01:32.015784+0000","last_peered":"2024-05-20T18:01:32.015784+0000","last_clean":"2024-05-20T18:01:32.015784+0000","last_became_active":"2024-05-20T18:01:30.526775+0000","last_became_peered":"2024-05-20T18:01:30.526775+0000","last_unstale":"2024-05-20T18:01:32.015784+0000","last_undegraded":"2024-05-20T18:01:32.015784+0000","last_fullsized":"2024-05-20T18:01:32.015784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:34:08.727478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336394+0000","last_change":"2024-05-20T18:01:30.540381+0000","last_active":"2024-05-20T18:01:32.336394+0000","last_peered":"2024-05-20T18:01:32.336394+0000","last_clean":"2024-05-20T18:01:32.336394+0000","last_became_active":"2024-05-20T18:01:30.539277+0000","last_became_peered":"2024-05-20T18:01:30.539277+0000","last_unstale":"2024-05-20T18:01:32.336394+0000","last_undegraded":"2024-05-20T18:01:32.336394+0000","last_fullsized":"2024-05-20T18:01:32.336394+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:20.788605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335786+0000","last_change":"2024-05-20T18:01:30.539492+0000","last_active":"2024-05-20T18:01:32.335786+0000","last_peered":"2024-05-20T18:01:32.335786+0000","last_clean":"2024-05-20T18:01:32.335786+0000","last_became_active":"2024-05-20T18:01:30.539178+0000","last_became_peered":"2024-05-20T18:01:30.539178+0000","last_unstale":"2024-05-20T18:01:32.335786+0000","last_undegraded":"2024-05-20T18:01:32.335786+0000","last_fullsized":"2024-05-20T18:01:32.335786+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:54.115869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335651+0000","last_change":"2024-05-20T18:01:30.548149+0000","last_active":"2024-05-20T18:01:32.335651+0000","last_peered":"2024-05-20T18:01:32.335651+0000","last_clean":"2024-05-20T18:01:32.335651+0000","last_became_active":"2024-05-20T18:01:30.547784+0000","last_became_peered":"2024-05-20T18:01:30.547784+0000","last_unstale":"2024-05-20T18:01:32.335651+0000","last_undegraded":"2024-05-20T18:01:32.335651+0000","last_fullsized":"2024-05-20T18:01:32.335651+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:12:55.055842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520393+0000","last_change":"2024-05-20T18:01:30.531897+0000","last_active":"2024-05-20T18:01:31.520393+0000","last_peered":"2024-05-20T18:01:31.520393+0000","last_clean":"2024-05-20T18:01:31.520393+0000","last_became_active":"2024-05-20T18:01:30.531581+0000","last_became_peered":"2024-05-20T18:01:30.531581+0000","last_unstale":"2024-05-20T18:01:31.520393+0000","last_undegraded":"2024-05-20T18:01:31.520393+0000","last_fullsized":"2024-05-20T18:01:31.520393+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:30:32.017799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335752+0000","last_change":"2024-05-20T18:01:30.543015+0000","last_active":"2024-05-20T18:01:32.335752+0000","last_peered":"2024-05-20T18:01:32.335752+0000","last_clean":"2024-05-20T18:01:32.335752+0000","last_became_active":"2024-05-20T18:01:30.542661+0000","last_became_peered":"2024-05-20T18:01:30.542661+0000","last_unstale":"2024-05-20T18:01:32.335752+0000","last_undegraded":"2024-05-20T18:01:32.335752+0000","last_fullsized":"2024-05-20T18:01:32.335752+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:42.846858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336139+0000","last_change":"2024-05-20T18:01:30.541893+0000","last_active":"2024-05-20T18:01:32.336139+0000","last_peered":"2024-05-20T18:01:32.336139+0000","last_clean":"2024-05-20T18:01:32.336139+0000","last_became_active":"2024-05-20T18:01:30.540658+0000","last_became_peered":"2024-05-20T18:01:30.540658+0000","last_unstale":"2024-05-20T18:01:32.336139+0000","last_undegraded":"2024-05-20T18:01:32.336139+0000","last_fullsized":"2024-05-20T18:01:32.336139+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:17.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523941+0000","last_change":"2024-05-20T18:01:30.531202+0000","last_active":"2024-05-20T18:01:31.523941+0000","last_peered":"2024-05-20T18:01:31.523941+0000","last_clean":"2024-05-20T18:01:31.523941+0000","last_became_active":"2024-05-20T18:01:30.530897+0000","last_became_peered":"2024-05-20T18:01:30.530897+0000","last_unstale":"2024-05-20T18:01:31.523941+0000","last_undegraded":"2024-05-20T18:01:31.523941+0000","last_fullsized":"2024-05-20T18:01:31.523941+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:26:39.968375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520172+0000","last_change":"2024-05-20T18:01:30.535973+0000","last_active":"2024-05-20T18:01:31.520172+0000","last_peered":"2024-05-20T18:01:31.520172+0000","last_clean":"2024-05-20T18:01:31.520172+0000","last_became_active":"2024-05-20T18:01:30.535646+0000","last_became_peered":"2024-05-20T18:01:30.535646+0000","last_unstale":"2024-05-20T18:01:31.520172+0000","last_undegraded":"2024-05-20T18:01:31.520172+0000","last_fullsized":"2024-05-20T18:01:31.520172+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:07.894449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523710+0000","last_change":"2024-05-20T18:01:30.534916+0000","last_active":"2024-05-20T18:01:31.523710+0000","last_peered":"2024-05-20T18:01:31.523710+0000","last_clean":"2024-05-20T18:01:31.523710+0000","last_became_active":"2024-05-20T18:01:30.534592+0000","last_became_peered":"2024-05-20T18:01:30.534592+0000","last_unstale":"2024-05-20T18:01:31.523710+0000","last_undegraded":"2024-05-20T18:01:31.523710+0000","last_fullsized":"2024-05-20T18:01:31.523710+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:25:40.073639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"124'4","reported_seq":18,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336402+0000","last_change":"2024-05-20T18:01:29.536905+0000","last_active":"2024-05-20T18:01:32.336402+0000","last_peered":"2024-05-20T18:01:32.336402+0000","last_clean":"2024-05-20T18:01:32.336402+0000","last_became_active":"2024-05-20T18:01:29.536535+0000","last_became_peered":"2024-05-20T18:01:29.536535+0000","last_unstale":"2024-05-20T18:01:32.336402+0000","last_undegraded":"2024-05-20T18:01:32.336402+0000","last_fullsized":"2024-05-20T18:01:32.336402+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:01:24.929131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523719+0000","last_change":"2024-05-20T18:01:30.539101+0000","last_active":"2024-05-20T18:01:31.523719+0000","last_peered":"2024-05-20T18:01:31.523719+0000","last_clean":"2024-05-20T18:01:31.523719+0000","last_became_active":"2024-05-20T18:01:30.538780+0000","last_became_peered":"2024-05-20T18:01:30.538780+0000","last_unstale":"2024-05-20T18:01:31.523719+0000","last_undegraded":"2024-05-20T18:01:31.523719+0000","last_fullsized":"2024-05-20T18:01:31.523719+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:25:43.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734832+0000","last_change":"2024-05-20T18:01:29.542313+0000","last_active":"2024-05-20T18:01:31.734832+0000","last_peered":"2024-05-20T18:01:31.734832+0000","last_clean":"2024-05-20T18:01:31.734832+0000","last_became_active":"2024-05-20T18:01:29.541874+0000","last_became_peered":"2024-05-20T18:01:29.541874+0000","last_unstale":"2024-05-20T18:01:31.734832+0000","last_undegraded":"2024-05-20T18:01:31.734832+0000","last_fullsized":"2024-05-20T18:01:31.734832+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:53.110048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549209+0000","last_change":"2024-05-20T18:01:30.535128+0000","last_active":"2024-05-20T18:01:31.549209+0000","last_peered":"2024-05-20T18:01:31.549209+0000","last_clean":"2024-05-20T18:01:31.549209+0000","last_became_active":"2024-05-20T18:01:30.534806+0000","last_became_peered":"2024-05-20T18:01:30.534806+0000","last_unstale":"2024-05-20T18:01:31.549209+0000","last_undegraded":"2024-05-20T18:01:31.549209+0000","last_fullsized":"2024-05-20T18:01:31.549209+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:08.913335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335717+0000","last_change":"2024-05-20T18:01:29.538639+0000","last_active":"2024-05-20T18:01:32.335717+0000","last_peered":"2024-05-20T18:01:32.335717+0000","last_clean":"2024-05-20T18:01:32.335717+0000","last_became_active":"2024-05-20T18:01:29.538329+0000","last_became_peered":"2024-05-20T18:01:29.538329+0000","last_unstale":"2024-05-20T18:01:32.335717+0000","last_undegraded":"2024-05-20T18:01:32.335717+0000","last_fullsized":"2024-05-20T18:01:32.335717+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:16.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523752+0000","last_change":"2024-05-20T18:01:30.547356+0000","last_active":"2024-05-20T18:01:31.523752+0000","last_peered":"2024-05-20T18:01:31.523752+0000","last_clean":"2024-05-20T18:01:31.523752+0000","last_became_active":"2024-05-20T18:01:30.546967+0000","last_became_peered":"2024-05-20T18:01:30.546967+0000","last_unstale":"2024-05-20T18:01:31.523752+0000","last_undegraded":"2024-05-20T18:01:31.523752+0000","last_fullsized":"2024-05-20T18:01:31.523752+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:52.158395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335211+0000","last_change":"2024-05-20T18:01:29.534809+0000","last_active":"2024-05-20T18:01:32.335211+0000","last_peered":"2024-05-20T18:01:32.335211+0000","last_clean":"2024-05-20T18:01:32.335211+0000","last_became_active":"2024-05-20T18:01:29.534469+0000","last_became_peered":"2024-05-20T18:01:29.534469+0000","last_unstale":"2024-05-20T18:01:32.335211+0000","last_undegraded":"2024-05-20T18:01:32.335211+0000","last_fullsized":"2024-05-20T18:01:32.335211+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:41.841037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524221+0000","last_change":"2024-05-20T18:01:30.528836+0000","last_active":"2024-05-20T18:01:31.524221+0000","last_peered":"2024-05-20T18:01:31.524221+0000","last_clean":"2024-05-20T18:01:31.524221+0000","last_became_active":"2024-05-20T18:01:30.528503+0000","last_became_peered":"2024-05-20T18:01:30.528503+0000","last_unstale":"2024-05-20T18:01:31.524221+0000","last_undegraded":"2024-05-20T18:01:31.524221+0000","last_fullsized":"2024-05-20T18:01:31.524221+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:32:42.247888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523844+0000","last_change":"2024-05-20T18:01:29.525291+0000","last_active":"2024-05-20T18:01:31.523844+0000","last_peered":"2024-05-20T18:01:31.523844+0000","last_clean":"2024-05-20T18:01:31.523844+0000","last_became_active":"2024-05-20T18:01:29.524953+0000","last_became_peered":"2024-05-20T18:01:29.524953+0000","last_unstale":"2024-05-20T18:01:31.523844+0000","last_undegraded":"2024-05-20T18:01:31.523844+0000","last_fullsized":"2024-05-20T18:01:31.523844+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:35.656627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524174+0000","last_change":"2024-05-20T18:01:30.532600+0000","last_active":"2024-05-20T18:01:31.524174+0000","last_peered":"2024-05-20T18:01:31.524174+0000","last_clean":"2024-05-20T18:01:31.524174+0000","last_became_active":"2024-05-20T18:01:30.531720+0000","last_became_peered":"2024-05-20T18:01:30.531720+0000","last_unstale":"2024-05-20T18:01:31.524174+0000","last_undegraded":"2024-05-20T18:01:31.524174+0000","last_fullsized":"2024-05-20T18:01:31.524174+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:44:02.726862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734327+0000","last_change":"2024-05-20T18:01:29.538523+0000","last_active":"2024-05-20T18:01:31.734327+0000","last_peered":"2024-05-20T18:01:31.734327+0000","last_clean":"2024-05-20T18:01:31.734327+0000","last_became_active":"2024-05-20T18:01:29.537340+0000","last_became_peered":"2024-05-20T18:01:29.537340+0000","last_unstale":"2024-05-20T18:01:31.734327+0000","last_undegraded":"2024-05-20T18:01:31.734327+0000","last_fullsized":"2024-05-20T18:01:31.734327+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:38.177633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734751+0000","last_change":"2024-05-20T18:01:30.538789+0000","last_active":"2024-05-20T18:01:31.734751+0000","last_peered":"2024-05-20T18:01:31.734751+0000","last_clean":"2024-05-20T18:01:31.734751+0000","last_became_active":"2024-05-20T18:01:30.538191+0000","last_became_peered":"2024-05-20T18:01:30.538191+0000","last_unstale":"2024-05-20T18:01:31.734751+0000","last_undegraded":"2024-05-20T18:01:31.734751+0000","last_fullsized":"2024-05-20T18:01:31.734751+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:12:55.055842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015483+0000","last_change":"2024-05-20T18:01:29.541163+0000","last_active":"2024-05-20T18:01:32.015483+0000","last_peered":"2024-05-20T18:01:32.015483+0000","last_clean":"2024-05-20T18:01:32.015483+0000","last_became_active":"2024-05-20T18:01:29.540842+0000","last_became_peered":"2024-05-20T18:01:29.540842+0000","last_unstale":"2024-05-20T18:01:32.015483+0000","last_undegraded":"2024-05-20T18:01:32.015483+0000","last_fullsized":"2024-05-20T18:01:32.015483+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:45.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336074+0000","last_change":"2024-05-20T18:01:30.548043+0000","last_active":"2024-05-20T18:01:32.336074+0000","last_peered":"2024-05-20T18:01:32.336074+0000","last_clean":"2024-05-20T18:01:32.336074+0000","last_became_active":"2024-05-20T18:01:30.547675+0000","last_became_peered":"2024-05-20T18:01:30.547675+0000","last_unstale":"2024-05-20T18:01:32.336074+0000","last_undegraded":"2024-05-20T18:01:32.336074+0000","last_fullsized":"2024-05-20T18:01:32.336074+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:52.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335251+0000","last_change":"2024-05-20T18:01:29.535025+0000","last_active":"2024-05-20T18:01:32.335251+0000","last_peered":"2024-05-20T18:01:32.335251+0000","last_clean":"2024-05-20T18:01:32.335251+0000","last_became_active":"2024-05-20T18:01:29.534706+0000","last_became_peered":"2024-05-20T18:01:29.534706+0000","last_unstale":"2024-05-20T18:01:32.335251+0000","last_undegraded":"2024-05-20T18:01:32.335251+0000","last_fullsized":"2024-05-20T18:01:32.335251+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:09.981177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523631+0000","last_change":"2024-05-20T18:01:30.539818+0000","last_active":"2024-05-20T18:01:31.523631+0000","last_peered":"2024-05-20T18:01:31.523631+0000","last_clean":"2024-05-20T18:01:31.523631+0000","last_became_active":"2024-05-20T18:01:30.539504+0000","last_became_peered":"2024-05-20T18:01:30.539504+0000","last_unstale":"2024-05-20T18:01:31.523631+0000","last_undegraded":"2024-05-20T18:01:31.523631+0000","last_fullsized":"2024-05-20T18:01:31.523631+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:25:16.566211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549279+0000","last_change":"2024-05-20T18:01:29.542102+0000","last_active":"2024-05-20T18:01:31.549279+0000","last_peered":"2024-05-20T18:01:31.549279+0000","last_clean":"2024-05-20T18:01:31.549279+0000","last_became_active":"2024-05-20T18:01:29.541817+0000","last_became_peered":"2024-05-20T18:01:29.541817+0000","last_unstale":"2024-05-20T18:01:31.549279+0000","last_undegraded":"2024-05-20T18:01:31.549279+0000","last_fullsized":"2024-05-20T18:01:31.549279+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:08:14.957610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015806+0000","last_change":"2024-05-20T18:01:30.534338+0000","last_active":"2024-05-20T18:01:32.015806+0000","last_peered":"2024-05-20T18:01:32.015806+0000","last_clean":"2024-05-20T18:01:32.015806+0000","last_became_active":"2024-05-20T18:01:30.533430+0000","last_became_peered":"2024-05-20T18:01:30.533430+0000","last_unstale":"2024-05-20T18:01:32.015806+0000","last_undegraded":"2024-05-20T18:01:32.015806+0000","last_fullsized":"2024-05-20T18:01:32.015806+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:42.846858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524019+0000","last_change":"2024-05-20T18:01:29.538182+0000","last_active":"2024-05-20T18:01:31.524019+0000","last_peered":"2024-05-20T18:01:31.524019+0000","last_clean":"2024-05-20T18:01:31.524019+0000","last_became_active":"2024-05-20T18:01:29.537834+0000","last_became_peered":"2024-05-20T18:01:29.537834+0000","last_unstale":"2024-05-20T18:01:31.524019+0000","last_undegraded":"2024-05-20T18:01:31.524019+0000","last_fullsized":"2024-05-20T18:01:31.524019+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:46.801504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336200+0000","last_change":"2024-05-20T18:01:30.541107+0000","last_active":"2024-05-20T18:01:32.336200+0000","last_peered":"2024-05-20T18:01:32.336200+0000","last_clean":"2024-05-20T18:01:32.336200+0000","last_became_active":"2024-05-20T18:01:30.540112+0000","last_became_peered":"2024-05-20T18:01:30.540112+0000","last_unstale":"2024-05-20T18:01:32.336200+0000","last_undegraded":"2024-05-20T18:01:32.336200+0000","last_fullsized":"2024-05-20T18:01:32.336200+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:25.218522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"124'3","reported_seq":17,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335868+0000","last_change":"2024-05-20T18:01:29.532837+0000","last_active":"2024-05-20T18:01:32.335868+0000","last_peered":"2024-05-20T18:01:32.335868+0000","last_clean":"2024-05-20T18:01:32.335868+0000","last_became_active":"2024-05-20T18:01:29.532357+0000","last_became_peered":"2024-05-20T18:01:29.532357+0000","last_unstale":"2024-05-20T18:01:32.335868+0000","last_undegraded":"2024-05-20T18:01:32.335868+0000","last_fullsized":"2024-05-20T18:01:32.335868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:24.212701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335955+0000","last_change":"2024-05-20T18:01:30.543643+0000","last_active":"2024-05-20T18:01:32.335955+0000","last_peered":"2024-05-20T18:01:32.335955+0000","last_clean":"2024-05-20T18:01:32.335955+0000","last_became_active":"2024-05-20T18:01:30.543325+0000","last_became_peered":"2024-05-20T18:01:30.543325+0000","last_unstale":"2024-05-20T18:01:32.335955+0000","last_undegraded":"2024-05-20T18:01:32.335955+0000","last_fullsized":"2024-05-20T18:01:32.335955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:39.183454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"124'6","reported_seq":20,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336051+0000","last_change":"2024-05-20T18:01:29.543445+0000","last_active":"2024-05-20T18:01:32.336051+0000","last_peered":"2024-05-20T18:01:32.336051+0000","last_clean":"2024-05-20T18:01:32.336051+0000","last_became_active":"2024-05-20T18:01:29.543139+0000","last_became_peered":"2024-05-20T18:01:29.543139+0000","last_unstale":"2024-05-20T18:01:32.336051+0000","last_undegraded":"2024-05-20T18:01:32.336051+0000","last_fullsized":"2024-05-20T18:01:32.336051+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:53.110048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520538+0000","last_change":"2024-05-20T18:01:30.534433+0000","last_active":"2024-05-20T18:01:31.520538+0000","last_peered":"2024-05-20T18:01:31.520538+0000","last_clean":"2024-05-20T18:01:31.520538+0000","last_became_active":"2024-05-20T18:01:30.534059+0000","last_became_peered":"2024-05-20T18:01:30.534059+0000","last_unstale":"2024-05-20T18:01:31.520538+0000","last_undegraded":"2024-05-20T18:01:31.520538+0000","last_fullsized":"2024-05-20T18:01:31.520538+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:20.110064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523876+0000","last_change":"2024-05-20T18:01:29.535590+0000","last_active":"2024-05-20T18:01:31.523876+0000","last_peered":"2024-05-20T18:01:31.523876+0000","last_clean":"2024-05-20T18:01:31.523876+0000","last_became_active":"2024-05-20T18:01:29.535046+0000","last_became_peered":"2024-05-20T18:01:29.535046+0000","last_unstale":"2024-05-20T18:01:31.523876+0000","last_undegraded":"2024-05-20T18:01:31.523876+0000","last_fullsized":"2024-05-20T18:01:31.523876+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:07.182612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335964+0000","last_change":"2024-05-20T18:01:30.538066+0000","last_active":"2024-05-20T18:01:32.335964+0000","last_peered":"2024-05-20T18:01:32.335964+0000","last_clean":"2024-05-20T18:01:32.335964+0000","last_became_active":"2024-05-20T18:01:30.537744+0000","last_became_peered":"2024-05-20T18:01:30.537744+0000","last_unstale":"2024-05-20T18:01:32.335964+0000","last_undegraded":"2024-05-20T18:01:32.335964+0000","last_fullsized":"2024-05-20T18:01:32.335964+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:05.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335237+0000","last_change":"2024-05-20T18:01:29.533247+0000","last_active":"2024-05-20T18:01:32.335237+0000","last_peered":"2024-05-20T18:01:32.335237+0000","last_clean":"2024-05-20T18:01:32.335237+0000","last_became_active":"2024-05-20T18:01:29.532955+0000","last_became_peered":"2024-05-20T18:01:29.532955+0000","last_unstale":"2024-05-20T18:01:32.335237+0000","last_undegraded":"2024-05-20T18:01:32.335237+0000","last_fullsized":"2024-05-20T18:01:32.335237+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:20:18.652619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734791+0000","last_change":"2024-05-20T18:01:30.536945+0000","last_active":"2024-05-20T18:01:31.734791+0000","last_peered":"2024-05-20T18:01:31.734791+0000","last_clean":"2024-05-20T18:01:31.734791+0000","last_became_active":"2024-05-20T18:01:30.536607+0000","last_became_peered":"2024-05-20T18:01:30.536607+0000","last_unstale":"2024-05-20T18:01:31.734791+0000","last_undegraded":"2024-05-20T18:01:31.734791+0000","last_fullsized":"2024-05-20T18:01:31.734791+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:19.322566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"124'8","reported_seq":22,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015631+0000","last_change":"2024-05-20T18:01:29.531947+0000","last_active":"2024-05-20T18:01:32.015631+0000","last_peered":"2024-05-20T18:01:32.015631+0000","last_clean":"2024-05-20T18:01:32.015631+0000","last_became_active":"2024-05-20T18:01:29.531588+0000","last_became_peered":"2024-05-20T18:01:29.531588+0000","last_unstale":"2024-05-20T18:01:32.015631+0000","last_undegraded":"2024-05-20T18:01:32.015631+0000","last_fullsized":"2024-05-20T18:01:32.015631+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:24.435039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335181+0000","last_change":"2024-05-20T18:01:30.543744+0000","last_active":"2024-05-20T18:01:32.335181+0000","last_peered":"2024-05-20T18:01:32.335181+0000","last_clean":"2024-05-20T18:01:32.335181+0000","last_became_active":"2024-05-20T18:01:30.543351+0000","last_became_peered":"2024-05-20T18:01:30.543351+0000","last_unstale":"2024-05-20T18:01:32.335181+0000","last_undegraded":"2024-05-20T18:01:32.335181+0000","last_fullsized":"2024-05-20T18:01:32.335181+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:34:08.727478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549358+0000","last_change":"2024-05-20T18:01:29.531744+0000","last_active":"2024-05-20T18:01:31.549358+0000","last_peered":"2024-05-20T18:01:31.549358+0000","last_clean":"2024-05-20T18:01:31.549358+0000","last_became_active":"2024-05-20T18:01:29.531417+0000","last_became_peered":"2024-05-20T18:01:29.531417+0000","last_unstale":"2024-05-20T18:01:31.549358+0000","last_undegraded":"2024-05-20T18:01:31.549358+0000","last_fullsized":"2024-05-20T18:01:31.549358+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:45.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335985+0000","last_change":"2024-05-20T18:01:30.542003+0000","last_active":"2024-05-20T18:01:32.335985+0000","last_peered":"2024-05-20T18:01:32.335985+0000","last_clean":"2024-05-20T18:01:32.335985+0000","last_became_active":"2024-05-20T18:01:30.541696+0000","last_became_peered":"2024-05-20T18:01:30.541696+0000","last_unstale":"2024-05-20T18:01:32.335985+0000","last_undegraded":"2024-05-20T18:01:32.335985+0000","last_fullsized":"2024-05-20T18:01:32.335985+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:23:19.507654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335855+0000","last_change":"2024-05-20T18:01:29.534742+0000","last_active":"2024-05-20T18:01:32.335855+0000","last_peered":"2024-05-20T18:01:32.335855+0000","last_clean":"2024-05-20T18:01:32.335855+0000","last_became_active":"2024-05-20T18:01:29.534350+0000","last_became_peered":"2024-05-20T18:01:29.534350+0000","last_unstale":"2024-05-20T18:01:32.335855+0000","last_undegraded":"2024-05-20T18:01:32.335855+0000","last_fullsized":"2024-05-20T18:01:32.335855+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:30:11.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335699+0000","last_change":"2024-05-20T18:01:30.536232+0000","last_active":"2024-05-20T18:01:32.335699+0000","last_peered":"2024-05-20T18:01:32.335699+0000","last_clean":"2024-05-20T18:01:32.335699+0000","last_became_active":"2024-05-20T18:01:30.535959+0000","last_became_peered":"2024-05-20T18:01:30.535959+0000","last_unstale":"2024-05-20T18:01:32.335699+0000","last_undegraded":"2024-05-20T18:01:32.335699+0000","last_fullsized":"2024-05-20T18:01:32.335699+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:16.742767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.016068+0000","last_change":"2024-05-20T18:01:29.540315+0000","last_active":"2024-05-20T18:01:32.016068+0000","last_peered":"2024-05-20T18:01:32.016068+0000","last_clean":"2024-05-20T18:01:32.016068+0000","last_became_active":"2024-05-20T18:01:29.540000+0000","last_became_peered":"2024-05-20T18:01:29.540000+0000","last_unstale":"2024-05-20T18:01:32.016068+0000","last_undegraded":"2024-05-20T18:01:32.016068+0000","last_fullsized":"2024-05-20T18:01:32.016068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:30:11.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520389+0000","last_change":"2024-05-20T18:01:30.545137+0000","last_active":"2024-05-20T18:01:31.520389+0000","last_peered":"2024-05-20T18:01:31.520389+0000","last_clean":"2024-05-20T18:01:31.520389+0000","last_became_active":"2024-05-20T18:01:30.544529+0000","last_became_peered":"2024-05-20T18:01:30.544529+0000","last_unstale":"2024-05-20T18:01:31.520389+0000","last_undegraded":"2024-05-20T18:01:31.520389+0000","last_fullsized":"2024-05-20T18:01:31.520389+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:18:38.195873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734849+0000","last_change":"2024-05-20T18:01:29.542085+0000","last_active":"2024-05-20T18:01:31.734849+0000","last_peered":"2024-05-20T18:01:31.734849+0000","last_clean":"2024-05-20T18:01:31.734849+0000","last_became_active":"2024-05-20T18:01:29.541275+0000","last_became_peered":"2024-05-20T18:01:29.541275+0000","last_unstale":"2024-05-20T18:01:31.734849+0000","last_undegraded":"2024-05-20T18:01:31.734849+0000","last_fullsized":"2024-05-20T18:01:31.734849+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:16.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734719+0000","last_change":"2024-05-20T18:01:30.537267+0000","last_active":"2024-05-20T18:01:31.734719+0000","last_peered":"2024-05-20T18:01:31.734719+0000","last_clean":"2024-05-20T18:01:31.734719+0000","last_became_active":"2024-05-20T18:01:30.536940+0000","last_became_peered":"2024-05-20T18:01:30.536940+0000","last_unstale":"2024-05-20T18:01:31.734719+0000","last_undegraded":"2024-05-20T18:01:31.734719+0000","last_fullsized":"2024-05-20T18:01:31.734719+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:10:08.754119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523853+0000","last_change":"2024-05-20T18:01:29.531456+0000","last_active":"2024-05-20T18:01:31.523853+0000","last_peered":"2024-05-20T18:01:31.523853+0000","last_clean":"2024-05-20T18:01:31.523853+0000","last_became_active":"2024-05-20T18:01:29.531085+0000","last_became_peered":"2024-05-20T18:01:29.531085+0000","last_unstale":"2024-05-20T18:01:31.523853+0000","last_undegraded":"2024-05-20T18:01:31.523853+0000","last_fullsized":"2024-05-20T18:01:31.523853+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:08:14.957610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524107+0000","last_change":"2024-05-20T18:01:30.540938+0000","last_active":"2024-05-20T18:01:31.524107+0000","last_peered":"2024-05-20T18:01:31.524107+0000","last_clean":"2024-05-20T18:01:31.524107+0000","last_became_active":"2024-05-20T18:01:30.540641+0000","last_became_peered":"2024-05-20T18:01:30.540641+0000","last_unstale":"2024-05-20T18:01:31.524107+0000","last_undegraded":"2024-05-20T18:01:31.524107+0000","last_fullsized":"2024-05-20T18:01:31.524107+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:31.784684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523756+0000","last_change":"2024-05-20T18:01:29.534592+0000","last_active":"2024-05-20T18:01:31.523756+0000","last_peered":"2024-05-20T18:01:31.523756+0000","last_clean":"2024-05-20T18:01:31.523756+0000","last_became_active":"2024-05-20T18:01:29.534212+0000","last_became_peered":"2024-05-20T18:01:29.534212+0000","last_unstale":"2024-05-20T18:01:31.523756+0000","last_undegraded":"2024-05-20T18:01:31.523756+0000","last_fullsized":"2024-05-20T18:01:31.523756+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:56.939961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734935+0000","last_change":"2024-05-20T18:01:30.543854+0000","last_active":"2024-05-20T18:01:31.734935+0000","last_peered":"2024-05-20T18:01:31.734935+0000","last_clean":"2024-05-20T18:01:31.734935+0000","last_became_active":"2024-05-20T18:01:30.543490+0000","last_became_peered":"2024-05-20T18:01:30.543490+0000","last_unstale":"2024-05-20T18:01:31.734935+0000","last_undegraded":"2024-05-20T18:01:31.734935+0000","last_fullsized":"2024-05-20T18:01:31.734935+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:05.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335778+0000","last_change":"2024-05-20T18:01:29.540086+0000","last_active":"2024-05-20T18:01:32.335778+0000","last_peered":"2024-05-20T18:01:32.335778+0000","last_clean":"2024-05-20T18:01:32.335778+0000","last_became_active":"2024-05-20T18:01:29.539835+0000","last_became_peered":"2024-05-20T18:01:29.539835+0000","last_unstale":"2024-05-20T18:01:32.335778+0000","last_undegraded":"2024-05-20T18:01:32.335778+0000","last_fullsized":"2024-05-20T18:01:32.335778+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:00.690658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549307+0000","last_change":"2024-05-20T18:01:30.540571+0000","last_active":"2024-05-20T18:01:31.549307+0000","last_peered":"2024-05-20T18:01:31.549307+0000","last_clean":"2024-05-20T18:01:31.549307+0000","last_became_active":"2024-05-20T18:01:30.540242+0000","last_became_peered":"2024-05-20T18:01:30.540242+0000","last_unstale":"2024-05-20T18:01:31.549307+0000","last_undegraded":"2024-05-20T18:01:31.549307+0000","last_fullsized":"2024-05-20T18:01:31.549307+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:01:29.426400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015861+0000","last_change":"2024-05-20T18:01:29.538953+0000","last_active":"2024-05-20T18:01:32.015861+0000","last_peered":"2024-05-20T18:01:32.015861+0000","last_clean":"2024-05-20T18:01:32.015861+0000","last_became_active":"2024-05-20T18:01:29.538631+0000","last_became_peered":"2024-05-20T18:01:29.538631+0000","last_unstale":"2024-05-20T18:01:32.015861+0000","last_undegraded":"2024-05-20T18:01:32.015861+0000","last_fullsized":"2024-05-20T18:01:32.015861+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:01:24.929131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734498+0000","last_change":"2024-05-20T18:01:30.536644+0000","last_active":"2024-05-20T18:01:31.734498+0000","last_peered":"2024-05-20T18:01:31.734498+0000","last_clean":"2024-05-20T18:01:31.734498+0000","last_became_active":"2024-05-20T18:01:30.534844+0000","last_became_peered":"2024-05-20T18:01:30.534844+0000","last_unstale":"2024-05-20T18:01:31.734498+0000","last_undegraded":"2024-05-20T18:01:31.734498+0000","last_fullsized":"2024-05-20T18:01:31.734498+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:44:12.059095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524124+0000","last_change":"2024-05-20T18:01:29.535301+0000","last_active":"2024-05-20T18:01:31.524124+0000","last_peered":"2024-05-20T18:01:31.524124+0000","last_clean":"2024-05-20T18:01:31.524124+0000","last_became_active":"2024-05-20T18:01:29.534967+0000","last_became_peered":"2024-05-20T18:01:29.534967+0000","last_unstale":"2024-05-20T18:01:31.524124+0000","last_undegraded":"2024-05-20T18:01:31.524124+0000","last_fullsized":"2024-05-20T18:01:31.524124+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:25.222146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335164+0000","last_change":"2024-05-20T18:01:30.543762+0000","last_active":"2024-05-20T18:01:32.335164+0000","last_peered":"2024-05-20T18:01:32.335164+0000","last_clean":"2024-05-20T18:01:32.335164+0000","last_became_active":"2024-05-20T18:01:30.543295+0000","last_became_peered":"2024-05-20T18:01:30.543295+0000","last_unstale":"2024-05-20T18:01:32.335164+0000","last_undegraded":"2024-05-20T18:01:32.335164+0000","last_fullsized":"2024-05-20T18:01:32.335164+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:01.696479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"125'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524291+0000","last_change":"2024-05-20T18:01:29.527271+0000","last_active":"2024-05-20T18:01:31.524291+0000","last_peered":"2024-05-20T18:01:31.524291+0000","last_clean":"2024-05-20T18:01:31.524291+0000","last_became_active":"2024-05-20T18:01:29.526960+0000","last_became_peered":"2024-05-20T18:01:29.526960+0000","last_unstale":"2024-05-20T18:01:31.524291+0000","last_undegraded":"2024-05-20T18:01:31.524291+0000","last_fullsized":"2024-05-20T18:01:31.524291+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:20.105416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335222+0000","last_change":"2024-05-20T18:01:30.541858+0000","last_active":"2024-05-20T18:01:32.335222+0000","last_peered":"2024-05-20T18:01:32.335222+0000","last_clean":"2024-05-20T18:01:32.335222+0000","last_became_active":"2024-05-20T18:01:30.541467+0000","last_became_peered":"2024-05-20T18:01:30.541467+0000","last_unstale":"2024-05-20T18:01:32.335222+0000","last_undegraded":"2024-05-20T18:01:32.335222+0000","last_fullsized":"2024-05-20T18:01:32.335222+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:05:35.260960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524176+0000","last_change":"2024-05-20T18:01:29.536476+0000","last_active":"2024-05-20T18:01:31.524176+0000","last_peered":"2024-05-20T18:01:31.524176+0000","last_clean":"2024-05-20T18:01:31.524176+0000","last_became_active":"2024-05-20T18:01:29.536130+0000","last_became_peered":"2024-05-20T18:01:29.536130+0000","last_unstale":"2024-05-20T18:01:31.524176+0000","last_undegraded":"2024-05-20T18:01:31.524176+0000","last_fullsized":"2024-05-20T18:01:31.524176+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:45.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520437+0000","last_change":"2024-05-20T18:01:30.529067+0000","last_active":"2024-05-20T18:01:31.520437+0000","last_peered":"2024-05-20T18:01:31.520437+0000","last_clean":"2024-05-20T18:01:31.520437+0000","last_became_active":"2024-05-20T18:01:30.528359+0000","last_became_peered":"2024-05-20T18:01:30.528359+0000","last_unstale":"2024-05-20T18:01:31.520437+0000","last_undegraded":"2024-05-20T18:01:31.520437+0000","last_fullsized":"2024-05-20T18:01:31.520437+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:35:32.505167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015748+0000","last_change":"2024-05-20T18:01:29.535107+0000","last_active":"2024-05-20T18:01:32.015748+0000","last_peered":"2024-05-20T18:01:32.015748+0000","last_clean":"2024-05-20T18:01:32.015748+0000","last_became_active":"2024-05-20T18:01:29.534799+0000","last_became_peered":"2024-05-20T18:01:29.534799+0000","last_unstale":"2024-05-20T18:01:32.015748+0000","last_undegraded":"2024-05-20T18:01:32.015748+0000","last_fullsized":"2024-05-20T18:01:32.015748+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:25:56.173674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015983+0000","last_change":"2024-05-20T18:01:30.536770+0000","last_active":"2024-05-20T18:01:32.015983+0000","last_peered":"2024-05-20T18:01:32.015983+0000","last_clean":"2024-05-20T18:01:32.015983+0000","last_became_active":"2024-05-20T18:01:30.536473+0000","last_became_peered":"2024-05-20T18:01:30.536473+0000","last_unstale":"2024-05-20T18:01:32.015983+0000","last_undegraded":"2024-05-20T18:01:32.015983+0000","last_fullsized":"2024-05-20T18:01:32.015983+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:17.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.548954+0000","last_change":"2024-05-20T18:01:29.535547+0000","last_active":"2024-05-20T18:01:31.548954+0000","last_peered":"2024-05-20T18:01:31.548954+0000","last_clean":"2024-05-20T18:01:31.548954+0000","last_became_active":"2024-05-20T18:01:29.535247+0000","last_became_peered":"2024-05-20T18:01:29.535247+0000","last_unstale":"2024-05-20T18:01:31.548954+0000","last_undegraded":"2024-05-20T18:01:31.548954+0000","last_fullsized":"2024-05-20T18:01:31.548954+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:20.105416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015991+0000","last_change":"2024-05-20T18:01:30.533668+0000","last_active":"2024-05-20T18:01:32.015991+0000","last_peered":"2024-05-20T18:01:32.015991+0000","last_clean":"2024-05-20T18:01:32.015991+0000","last_became_active":"2024-05-20T18:01:30.533259+0000","last_became_peered":"2024-05-20T18:01:30.533259+0000","last_unstale":"2024-05-20T18:01:32.015991+0000","last_undegraded":"2024-05-20T18:01:32.015991+0000","last_fullsized":"2024-05-20T18:01:32.015991+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:25.218522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335584+0000","last_change":"2024-05-20T18:01:29.534716+0000","last_active":"2024-05-20T18:01:32.335584+0000","last_peered":"2024-05-20T18:01:32.335584+0000","last_clean":"2024-05-20T18:01:32.335584+0000","last_became_active":"2024-05-20T18:01:29.533946+0000","last_became_peered":"2024-05-20T18:01:29.533946+0000","last_unstale":"2024-05-20T18:01:32.335584+0000","last_undegraded":"2024-05-20T18:01:32.335584+0000","last_fullsized":"2024-05-20T18:01:32.335584+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:38.177633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.016042+0000","last_change":"2024-05-20T18:01:30.534724+0000","last_active":"2024-05-20T18:01:32.016042+0000","last_peered":"2024-05-20T18:01:32.016042+0000","last_clean":"2024-05-20T18:01:32.016042+0000","last_became_active":"2024-05-20T18:01:30.534397+0000","last_became_peered":"2024-05-20T18:01:30.534397+0000","last_unstale":"2024-05-20T18:01:32.016042+0000","last_undegraded":"2024-05-20T18:01:32.016042+0000","last_fullsized":"2024-05-20T18:01:32.016042+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:45:27.941563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015656+0000","last_change":"2024-05-20T18:01:29.534296+0000","last_active":"2024-05-20T18:01:32.015656+0000","last_peered":"2024-05-20T18:01:32.015656+0000","last_clean":"2024-05-20T18:01:32.015656+0000","last_became_active":"2024-05-20T18:01:29.533926+0000","last_became_peered":"2024-05-20T18:01:29.533926+0000","last_unstale":"2024-05-20T18:01:32.015656+0000","last_undegraded":"2024-05-20T18:01:32.015656+0000","last_fullsized":"2024-05-20T18:01:32.015656+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:20:18.652619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336249+0000","last_change":"2024-05-20T18:01:30.543667+0000","last_active":"2024-05-20T18:01:32.336249+0000","last_peered":"2024-05-20T18:01:32.336249+0000","last_clean":"2024-05-20T18:01:32.336249+0000","last_became_active":"2024-05-20T18:01:30.543332+0000","last_became_peered":"2024-05-20T18:01:30.543332+0000","last_unstale":"2024-05-20T18:01:32.336249+0000","last_undegraded":"2024-05-20T18:01:32.336249+0000","last_fullsized":"2024-05-20T18:01:32.336249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:18.261742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734402+0000","last_change":"2024-05-20T18:01:29.535234+0000","last_active":"2024-05-20T18:01:31.734402+0000","last_peered":"2024-05-20T18:01:31.734402+0000","last_clean":"2024-05-20T18:01:31.734402+0000","last_became_active":"2024-05-20T18:01:29.534543+0000","last_became_peered":"2024-05-20T18:01:29.534543+0000","last_unstale":"2024-05-20T18:01:31.734402+0000","last_undegraded":"2024-05-20T18:01:31.734402+0000","last_fullsized":"2024-05-20T18:01:31.734402+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:41.841037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336406+0000","last_change":"2024-05-20T18:01:30.542728+0000","last_active":"2024-05-20T18:01:32.336406+0000","last_peered":"2024-05-20T18:01:32.336406+0000","last_clean":"2024-05-20T18:01:32.336406+0000","last_became_active":"2024-05-20T18:01:30.539361+0000","last_became_peered":"2024-05-20T18:01:30.539361+0000","last_unstale":"2024-05-20T18:01:32.336406+0000","last_undegraded":"2024-05-20T18:01:32.336406+0000","last_fullsized":"2024-05-20T18:01:32.336406+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:53.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335401+0000","last_change":"2024-05-20T18:01:29.540276+0000","last_active":"2024-05-20T18:01:32.335401+0000","last_peered":"2024-05-20T18:01:32.335401+0000","last_clean":"2024-05-20T18:01:32.335401+0000","last_became_active":"2024-05-20T18:01:29.539943+0000","last_became_peered":"2024-05-20T18:01:29.539943+0000","last_unstale":"2024-05-20T18:01:32.335401+0000","last_undegraded":"2024-05-20T18:01:32.335401+0000","last_fullsized":"2024-05-20T18:01:32.335401+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:34:07.721657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":362,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.334959+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:01:32.334959+0000","last_peered":"2024-05-20T18:01:32.334959+0000","last_clean":"2024-05-20T18:01:32.334959+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:01:32.334959+0000","last_undegraded":"2024-05-20T18:01:32.334959+0000","last_fullsized":"2024-05-20T18:01:32.334959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33304,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2174976,"data_stored":1316822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1572864,"data_stored":725424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1568768,"data_stored":724774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1564672,"data_stored":724752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1581056,"data_stored":726434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574956,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":725368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":724822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33300,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338540,"statfs":{"total":96636764160,"available":96602664960,"internally_reserved":0,"allocated":2166784,"data_stored":1315176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:01:34.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:01:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.761+0000 7eff3d39d640 1 Processor -- start 2024-05-20T18:01:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.761+0000 7eff3d39d640 1 -- start start 2024-05-20T18:01:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.762+0000 7eff3d39d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff3815fd30 0x7eff381607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.762+0000 7eff3d39d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff380d12a0 0x7eff380d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.762+0000 7eff3d39d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff38160270 con 0x7eff3815ce20 2024-05-20T18:01:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.762+0000 7eff3d39d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7eff380cfb20 con 0x7eff380d12a0 2024-05-20T18:01:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.762+0000 7eff3d39d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7eff38160550 con 0x7eff3815fd30 2024-05-20T18:01:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.763+0000 7eff3cb9c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff380d12a0 0x7eff380d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.763+0000 7eff3cb9c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff380d12a0 0x7eff380d16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48076/0 (socket says 172.21.15.6:48076) 2024-05-20T18:01:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.763+0000 7eff3cb9c640 1 -- 172.21.15.6:0/3771455395 learned_addr learned my addr 172.21.15.6:0/3771455395 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.763+0000 7eff377fe640 1 --2- 172.21.15.6:0/3771455395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff3815fd30 0x7eff381607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.763+0000 7eff3cb9c640 1 -- 172.21.15.6:0/3771455395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff3815fd30 msgr2=0x7eff381607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.763+0000 7eff3cb9c640 1 --2- 172.21.15.6:0/3771455395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff3815fd30 0x7eff381607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.763+0000 7eff3cb9c640 1 -- 172.21.15.6:0/3771455395 >> v1:172.21.15.171:6789/0 conn(0x7eff3815ce20 legacy=0x7eff3815f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.763+0000 7eff3cb9c640 1 -- 172.21.15.6:0/3771455395 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff380d2d60 con 0x7eff380d12a0 2024-05-20T18:01:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.764+0000 7eff3cb9c640 1 --2- 172.21.15.6:0/3771455395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff380d16b0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7eff30009e50 tx=0x7eff3002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5c89a3812fcabd server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.764+0000 7eff36ffd640 1 -- 172.21.15.6:0/3771455395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30036070 con 0x7eff380d12a0 2024-05-20T18:01:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.764+0000 7eff36ffd640 1 -- 172.21.15.6:0/3771455395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff30031600 con 0x7eff380d12a0 2024-05-20T18:01:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.764+0000 7eff36ffd640 1 -- 172.21.15.6:0/3771455395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff300319d0 con 0x7eff380d12a0 2024-05-20T18:01:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.765+0000 7eff3d39d640 1 -- 172.21.15.6:0/3771455395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 msgr2=0x7eff380d16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.765+0000 7eff3d39d640 1 --2- 172.21.15.6:0/3771455395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff380d16b0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7eff30009e50 tx=0x7eff3002a680 comp rx=0 tx=0).stop 2024-05-20T18:01:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.765+0000 7eff3d39d640 1 -- 172.21.15.6:0/3771455395 shutdown_connections 2024-05-20T18:01:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.765+0000 7eff3d39d640 1 --2- 172.21.15.6:0/3771455395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff380d16b0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.765+0000 7eff3d39d640 1 --2- 172.21.15.6:0/3771455395 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff3815fd30 0x7eff381607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.765+0000 7eff3d39d640 1 -- 172.21.15.6:0/3771455395 >> 172.21.15.6:0/3771455395 conn(0x7eff3806dbb0 msgr2=0x7eff3806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.765+0000 7eff3d39d640 1 -- 172.21.15.6:0/3771455395 shutdown_connections 2024-05-20T18:01:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.765+0000 7eff3d39d640 1 -- 172.21.15.6:0/3771455395 wait complete. 2024-05-20T18:01:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.766+0000 7eff3d39d640 1 Processor -- start 2024-05-20T18:01:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.767+0000 7eff3d39d640 1 -- start start 2024-05-20T18:01:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff3d39d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff381f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff3d39d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3815fd30 0x7eff3814ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff3d39d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff380b8920 0x7eff380b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff3d39d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7eff380d3840 con 0x7eff380d12a0 2024-05-20T18:01:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff3d39d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff380d1bf0 con 0x7eff3815fd30 2024-05-20T18:01:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff3d39d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7eff380d39c0 con 0x7eff380b8920 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff37fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff381f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff37fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff381f8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48092/0 (socket says 172.21.15.6:48092) 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff37fff640 1 -- 172.21.15.6:0/1703998541 learned_addr learned my addr 172.21.15.6:0/1703998541 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff377fe640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3815fd30 0x7eff3814ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff3cb9c640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff380b8920 0x7eff380b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff37fff640 1 -- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff380b8920 msgr2=0x7eff380b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff37fff640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff380b8920 0x7eff380b8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff37fff640 1 -- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3815fd30 msgr2=0x7eff3814ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff37fff640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3815fd30 0x7eff3814ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff37fff640 1 -- 172.21.15.6:0/1703998541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff380b9270 con 0x7eff380d12a0 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.768+0000 7eff3cb9c640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff380b8920 0x7eff380b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.769+0000 7eff37fff640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff381f8f80 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c440 tx=0x7eff2800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.769+0000 7eff34ff9640 1 -- 172.21.15.6:0/1703998541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff280052d0 con 0x7eff380d12a0 2024-05-20T18:01:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.769+0000 7eff34ff9640 1 -- 172.21.15.6:0/1703998541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff28005470 con 0x7eff380d12a0 2024-05-20T18:01:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.769+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff380c8c70 con 0x7eff380d12a0 2024-05-20T18:01:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.769+0000 7eff34ff9640 1 -- 172.21.15.6:0/1703998541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28007260 con 0x7eff380d12a0 2024-05-20T18:01:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.769+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff380c9230 con 0x7eff380d12a0 2024-05-20T18:01:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.770+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff38075980 con 0x7eff380d12a0 2024-05-20T18:01:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.771+0000 7eff34ff9640 1 -- 172.21.15.6:0/1703998541 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff28007400 con 0x7eff380d12a0 2024-05-20T18:01:34.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.771+0000 7eff34ff9640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff2406be60 0x7eff2406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:34.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.771+0000 7eff34ff9640 1 -- 172.21.15.6:0/1703998541 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7eff2808a520 con 0x7eff380d12a0 2024-05-20T18:01:34.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.772+0000 7eff377fe640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff2406be60 0x7eff2406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:34.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.772+0000 7eff377fe640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff2406be60 0x7eff2406e370 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7eff2c006fd0 tx=0x7eff2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:34.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.776+0000 7eff34ff9640 1 -- 172.21.15.6:0/1703998541 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7eff380b9270 con 0x7eff380d12a0 2024-05-20T18:01:34.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.956+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff380c8a20 con 0x7eff2406be60 2024-05-20T18:01:34.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.963+0000 7eff34ff9640 1 -- 172.21.15.6:0/1703998541 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7eff380c8a20 con 0x7eff2406be60 2024-05-20T18:01:34.963 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:34.965 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:01:34.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff2406be60 msgr2=0x7eff2406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff2406be60 0x7eff2406e370 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7eff2c006fd0 tx=0x7eff2c008040 comp rx=0 tx=0).stop 2024-05-20T18:01:34.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 msgr2=0x7eff381f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:34.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff381f8f80 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c440 tx=0x7eff2800c900 comp rx=0 tx=0).stop 2024-05-20T18:01:34.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 shutdown_connections 2024-05-20T18:01:34.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7eff2406be60 0x7eff2406e370 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7eff380b8920 0x7eff380b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff3815fd30 0x7eff3814ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 --2- 172.21.15.6:0/1703998541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff380d12a0 0x7eff381f8f80 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:34.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 >> 172.21.15.6:0/1703998541 conn(0x7eff3806dbb0 msgr2=0x7eff380b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:34.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 shutdown_connections 2024-05-20T18:01:34.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:34.966+0000 7eff3d39d640 1 -- 172.21.15.6:0/1703998541 wait complete. 2024-05-20T18:01:34.976 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2024-05-20T18:01:34.364828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271244,"kb_used_data":13448,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703476,"statfs":{"total":773094113280,"available":772816359424,"internally_reserved":0,"allocated":13770752,"data_stored":6983572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.857003"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524177+0000","last_change":"2024-05-20T18:01:30.543059+0000","last_active":"2024-05-20T18:01:31.524177+0000","last_peered":"2024-05-20T18:01:31.524177+0000","last_clean":"2024-05-20T18:01:31.524177+0000","last_became_active":"2024-05-20T18:01:30.542755+0000","last_became_peered":"2024-05-20T18:01:30.542755+0000","last_unstale":"2024-05-20T18:01:31.524177+0000","last_undegraded":"2024-05-20T18:01:31.524177+0000","last_fullsized":"2024-05-20T18:01:31.524177+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:34:35.691665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549249+0000","last_change":"2024-05-20T18:01:30.524254+0000","last_active":"2024-05-20T18:01:31.549249+0000","last_peered":"2024-05-20T18:01:31.549249+0000","last_clean":"2024-05-20T18:01:31.549249+0000","last_became_active":"2024-05-20T18:01:30.523914+0000","last_became_peered":"2024-05-20T18:01:30.523914+0000","last_unstale":"2024-05-20T18:01:31.549249+0000","last_undegraded":"2024-05-20T18:01:31.549249+0000","last_fullsized":"2024-05-20T18:01:31.549249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:32:46.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336348+0000","last_change":"2024-05-20T18:01:30.540135+0000","last_active":"2024-05-20T18:01:32.336348+0000","last_peered":"2024-05-20T18:01:32.336348+0000","last_clean":"2024-05-20T18:01:32.336348+0000","last_became_active":"2024-05-20T18:01:30.539707+0000","last_became_peered":"2024-05-20T18:01:30.539707+0000","last_unstale":"2024-05-20T18:01:32.336348+0000","last_undegraded":"2024-05-20T18:01:32.336348+0000","last_fullsized":"2024-05-20T18:01:32.336348+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:45:27.941563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549115+0000","last_change":"2024-05-20T18:01:30.535669+0000","last_active":"2024-05-20T18:01:31.549115+0000","last_peered":"2024-05-20T18:01:31.549115+0000","last_clean":"2024-05-20T18:01:31.549115+0000","last_became_active":"2024-05-20T18:01:30.535356+0000","last_became_peered":"2024-05-20T18:01:30.535356+0000","last_unstale":"2024-05-20T18:01:31.549115+0000","last_undegraded":"2024-05-20T18:01:31.549115+0000","last_fullsized":"2024-05-20T18:01:31.549115+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:44:02.726862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734494+0000","last_change":"2024-05-20T18:01:30.533924+0000","last_active":"2024-05-20T18:01:31.734494+0000","last_peered":"2024-05-20T18:01:31.734494+0000","last_clean":"2024-05-20T18:01:31.734494+0000","last_became_active":"2024-05-20T18:01:30.532425+0000","last_became_peered":"2024-05-20T18:01:30.532425+0000","last_unstale":"2024-05-20T18:01:31.734494+0000","last_undegraded":"2024-05-20T18:01:31.734494+0000","last_fullsized":"2024-05-20T18:01:31.734494+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:12.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015889+0000","last_change":"2024-05-20T18:01:30.541748+0000","last_active":"2024-05-20T18:01:32.015889+0000","last_peered":"2024-05-20T18:01:32.015889+0000","last_clean":"2024-05-20T18:01:32.015889+0000","last_became_active":"2024-05-20T18:01:30.541420+0000","last_became_peered":"2024-05-20T18:01:30.541420+0000","last_unstale":"2024-05-20T18:01:32.015889+0000","last_undegraded":"2024-05-20T18:01:32.015889+0000","last_fullsized":"2024-05-20T18:01:32.015889+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:54.115869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335709+0000","last_change":"2024-05-20T18:01:30.539828+0000","last_active":"2024-05-20T18:01:32.335709+0000","last_peered":"2024-05-20T18:01:32.335709+0000","last_clean":"2024-05-20T18:01:32.335709+0000","last_became_active":"2024-05-20T18:01:30.539498+0000","last_became_peered":"2024-05-20T18:01:30.539498+0000","last_unstale":"2024-05-20T18:01:32.335709+0000","last_undegraded":"2024-05-20T18:01:32.335709+0000","last_fullsized":"2024-05-20T18:01:32.335709+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:19.322566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524006+0000","last_change":"2024-05-20T18:01:30.538797+0000","last_active":"2024-05-20T18:01:31.524006+0000","last_peered":"2024-05-20T18:01:31.524006+0000","last_clean":"2024-05-20T18:01:31.524006+0000","last_became_active":"2024-05-20T18:01:30.538401+0000","last_became_peered":"2024-05-20T18:01:30.538401+0000","last_unstale":"2024-05-20T18:01:31.524006+0000","last_undegraded":"2024-05-20T18:01:31.524006+0000","last_fullsized":"2024-05-20T18:01:31.524006+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:32.270039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.016157+0000","last_change":"2024-05-20T18:01:30.527846+0000","last_active":"2024-05-20T18:01:32.016157+0000","last_peered":"2024-05-20T18:01:32.016157+0000","last_clean":"2024-05-20T18:01:32.016157+0000","last_became_active":"2024-05-20T18:01:30.527463+0000","last_became_peered":"2024-05-20T18:01:30.527463+0000","last_unstale":"2024-05-20T18:01:32.016157+0000","last_undegraded":"2024-05-20T18:01:32.016157+0000","last_fullsized":"2024-05-20T18:01:32.016157+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:20.788605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520515+0000","last_change":"2024-05-20T18:01:30.531047+0000","last_active":"2024-05-20T18:01:31.520515+0000","last_peered":"2024-05-20T18:01:31.520515+0000","last_clean":"2024-05-20T18:01:31.520515+0000","last_became_active":"2024-05-20T18:01:30.530700+0000","last_became_peered":"2024-05-20T18:01:30.530700+0000","last_unstale":"2024-05-20T18:01:31.520515+0000","last_undegraded":"2024-05-20T18:01:31.520515+0000","last_fullsized":"2024-05-20T18:01:31.520515+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:47.874155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549166+0000","last_change":"2024-05-20T18:01:30.541077+0000","last_active":"2024-05-20T18:01:31.549166+0000","last_peered":"2024-05-20T18:01:31.549166+0000","last_clean":"2024-05-20T18:01:31.549166+0000","last_became_active":"2024-05-20T18:01:30.540760+0000","last_became_peered":"2024-05-20T18:01:30.540760+0000","last_unstale":"2024-05-20T18:01:31.549166+0000","last_undegraded":"2024-05-20T18:01:31.549166+0000","last_fullsized":"2024-05-20T18:01:31.549166+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:24:09.049875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524125+0000","last_change":"2024-05-20T18:01:30.542151+0000","last_active":"2024-05-20T18:01:31.524125+0000","last_peered":"2024-05-20T18:01:31.524125+0000","last_clean":"2024-05-20T18:01:31.524125+0000","last_became_active":"2024-05-20T18:01:30.541814+0000","last_became_peered":"2024-05-20T18:01:30.541814+0000","last_unstale":"2024-05-20T18:01:31.524125+0000","last_undegraded":"2024-05-20T18:01:31.524125+0000","last_fullsized":"2024-05-20T18:01:31.524125+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:06.285028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015951+0000","last_change":"2024-05-20T18:01:30.543827+0000","last_active":"2024-05-20T18:01:32.015951+0000","last_peered":"2024-05-20T18:01:32.015951+0000","last_clean":"2024-05-20T18:01:32.015951+0000","last_became_active":"2024-05-20T18:01:30.543410+0000","last_became_peered":"2024-05-20T18:01:30.543410+0000","last_unstale":"2024-05-20T18:01:32.015951+0000","last_undegraded":"2024-05-20T18:01:32.015951+0000","last_fullsized":"2024-05-20T18:01:32.015951+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:39.183454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523753+0000","last_change":"2024-05-20T18:01:30.544588+0000","last_active":"2024-05-20T18:01:31.523753+0000","last_peered":"2024-05-20T18:01:31.523753+0000","last_clean":"2024-05-20T18:01:31.523753+0000","last_became_active":"2024-05-20T18:01:30.544256+0000","last_became_peered":"2024-05-20T18:01:30.544256+0000","last_unstale":"2024-05-20T18:01:31.523753+0000","last_undegraded":"2024-05-20T18:01:31.523753+0000","last_fullsized":"2024-05-20T18:01:31.523753+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:01:50.788212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523724+0000","last_change":"2024-05-20T18:01:30.545443+0000","last_active":"2024-05-20T18:01:31.523724+0000","last_peered":"2024-05-20T18:01:31.523724+0000","last_clean":"2024-05-20T18:01:31.523724+0000","last_became_active":"2024-05-20T18:01:30.545087+0000","last_became_peered":"2024-05-20T18:01:30.545087+0000","last_unstale":"2024-05-20T18:01:31.523724+0000","last_undegraded":"2024-05-20T18:01:31.523724+0000","last_fullsized":"2024-05-20T18:01:31.523724+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:57:56.971628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015534+0000","last_change":"2024-05-20T18:01:30.529625+0000","last_active":"2024-05-20T18:01:32.015534+0000","last_peered":"2024-05-20T18:01:32.015534+0000","last_clean":"2024-05-20T18:01:32.015534+0000","last_became_active":"2024-05-20T18:01:30.529278+0000","last_became_peered":"2024-05-20T18:01:30.529278+0000","last_unstale":"2024-05-20T18:01:32.015534+0000","last_undegraded":"2024-05-20T18:01:32.015534+0000","last_fullsized":"2024-05-20T18:01:32.015534+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:01.696479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.016163+0000","last_change":"2024-05-20T18:01:30.535507+0000","last_active":"2024-05-20T18:01:32.016163+0000","last_peered":"2024-05-20T18:01:32.016163+0000","last_clean":"2024-05-20T18:01:32.016163+0000","last_became_active":"2024-05-20T18:01:30.533092+0000","last_became_peered":"2024-05-20T18:01:30.533092+0000","last_unstale":"2024-05-20T18:01:32.016163+0000","last_undegraded":"2024-05-20T18:01:32.016163+0000","last_fullsized":"2024-05-20T18:01:32.016163+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:53.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734754+0000","last_change":"2024-05-20T18:01:30.539210+0000","last_active":"2024-05-20T18:01:31.734754+0000","last_peered":"2024-05-20T18:01:31.734754+0000","last_clean":"2024-05-20T18:01:31.734754+0000","last_became_active":"2024-05-20T18:01:30.538840+0000","last_became_peered":"2024-05-20T18:01:30.538840+0000","last_unstale":"2024-05-20T18:01:31.734754+0000","last_undegraded":"2024-05-20T18:01:31.734754+0000","last_fullsized":"2024-05-20T18:01:31.734754+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:16.742767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335339+0000","last_change":"2024-05-20T18:01:30.534483+0000","last_active":"2024-05-20T18:01:32.335339+0000","last_peered":"2024-05-20T18:01:32.335339+0000","last_clean":"2024-05-20T18:01:32.335339+0000","last_became_active":"2024-05-20T18:01:30.534167+0000","last_became_peered":"2024-05-20T18:01:30.534167+0000","last_unstale":"2024-05-20T18:01:32.335339+0000","last_undegraded":"2024-05-20T18:01:32.335339+0000","last_fullsized":"2024-05-20T18:01:32.335339+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:10:08.754119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734630+0000","last_change":"2024-05-20T18:01:30.535461+0000","last_active":"2024-05-20T18:01:31.734630+0000","last_peered":"2024-05-20T18:01:31.734630+0000","last_clean":"2024-05-20T18:01:31.734630+0000","last_became_active":"2024-05-20T18:01:30.535122+0000","last_became_peered":"2024-05-20T18:01:30.535122+0000","last_unstale":"2024-05-20T18:01:31.734630+0000","last_undegraded":"2024-05-20T18:01:31.734630+0000","last_fullsized":"2024-05-20T18:01:31.734630+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:05:35.260960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549119+0000","last_change":"2024-05-20T18:01:30.527652+0000","last_active":"2024-05-20T18:01:31.549119+0000","last_peered":"2024-05-20T18:01:31.549119+0000","last_clean":"2024-05-20T18:01:31.549119+0000","last_became_active":"2024-05-20T18:01:30.527327+0000","last_became_peered":"2024-05-20T18:01:30.527327+0000","last_unstale":"2024-05-20T18:01:31.549119+0000","last_undegraded":"2024-05-20T18:01:31.549119+0000","last_fullsized":"2024-05-20T18:01:31.549119+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:32:42.247888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523689+0000","last_change":"2024-05-20T18:01:30.540158+0000","last_active":"2024-05-20T18:01:31.523689+0000","last_peered":"2024-05-20T18:01:31.523689+0000","last_clean":"2024-05-20T18:01:31.523689+0000","last_became_active":"2024-05-20T18:01:30.539522+0000","last_became_peered":"2024-05-20T18:01:30.539522+0000","last_unstale":"2024-05-20T18:01:31.523689+0000","last_undegraded":"2024-05-20T18:01:31.523689+0000","last_fullsized":"2024-05-20T18:01:31.523689+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:21:20.833730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549063+0000","last_change":"2024-05-20T18:01:30.531758+0000","last_active":"2024-05-20T18:01:31.549063+0000","last_peered":"2024-05-20T18:01:31.549063+0000","last_clean":"2024-05-20T18:01:31.549063+0000","last_became_active":"2024-05-20T18:01:30.531432+0000","last_became_peered":"2024-05-20T18:01:30.531432+0000","last_unstale":"2024-05-20T18:01:31.549063+0000","last_undegraded":"2024-05-20T18:01:31.549063+0000","last_fullsized":"2024-05-20T18:01:31.549063+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:32.270039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015784+0000","last_change":"2024-05-20T18:01:30.527605+0000","last_active":"2024-05-20T18:01:32.015784+0000","last_peered":"2024-05-20T18:01:32.015784+0000","last_clean":"2024-05-20T18:01:32.015784+0000","last_became_active":"2024-05-20T18:01:30.526775+0000","last_became_peered":"2024-05-20T18:01:30.526775+0000","last_unstale":"2024-05-20T18:01:32.015784+0000","last_undegraded":"2024-05-20T18:01:32.015784+0000","last_fullsized":"2024-05-20T18:01:32.015784+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:34:08.727478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336394+0000","last_change":"2024-05-20T18:01:30.540381+0000","last_active":"2024-05-20T18:01:32.336394+0000","last_peered":"2024-05-20T18:01:32.336394+0000","last_clean":"2024-05-20T18:01:32.336394+0000","last_became_active":"2024-05-20T18:01:30.539277+0000","last_became_peered":"2024-05-20T18:01:30.539277+0000","last_unstale":"2024-05-20T18:01:32.336394+0000","last_undegraded":"2024-05-20T18:01:32.336394+0000","last_fullsized":"2024-05-20T18:01:32.336394+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:20.788605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335786+0000","last_change":"2024-05-20T18:01:30.539492+0000","last_active":"2024-05-20T18:01:32.335786+0000","last_peered":"2024-05-20T18:01:32.335786+0000","last_clean":"2024-05-20T18:01:32.335786+0000","last_became_active":"2024-05-20T18:01:30.539178+0000","last_became_peered":"2024-05-20T18:01:30.539178+0000","last_unstale":"2024-05-20T18:01:32.335786+0000","last_undegraded":"2024-05-20T18:01:32.335786+0000","last_fullsized":"2024-05-20T18:01:32.335786+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:54.115869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335651+0000","last_change":"2024-05-20T18:01:30.548149+0000","last_active":"2024-05-20T18:01:32.335651+0000","last_peered":"2024-05-20T18:01:32.335651+0000","last_clean":"2024-05-20T18:01:32.335651+0000","last_became_active":"2024-05-20T18:01:30.547784+0000","last_became_peered":"2024-05-20T18:01:30.547784+0000","last_unstale":"2024-05-20T18:01:32.335651+0000","last_undegraded":"2024-05-20T18:01:32.335651+0000","last_fullsized":"2024-05-20T18:01:32.335651+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:12:55.055842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520393+0000","last_change":"2024-05-20T18:01:30.531897+0000","last_active":"2024-05-20T18:01:31.520393+0000","last_peered":"2024-05-20T18:01:31.520393+0000","last_clean":"2024-05-20T18:01:31.520393+0000","last_became_active":"2024-05-20T18:01:30.531581+0000","last_became_peered":"2024-05-20T18:01:30.531581+0000","last_unstale":"2024-05-20T18:01:31.520393+0000","last_undegraded":"2024-05-20T18:01:31.520393+0000","last_fullsized":"2024-05-20T18:01:31.520393+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:30:32.017799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335752+0000","last_change":"2024-05-20T18:01:30.543015+0000","last_active":"2024-05-20T18:01:32.335752+0000","last_peered":"2024-05-20T18:01:32.335752+0000","last_clean":"2024-05-20T18:01:32.335752+0000","last_became_active":"2024-05-20T18:01:30.542661+0000","last_became_peered":"2024-05-20T18:01:30.542661+0000","last_unstale":"2024-05-20T18:01:32.335752+0000","last_undegraded":"2024-05-20T18:01:32.335752+0000","last_fullsized":"2024-05-20T18:01:32.335752+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:42.846858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336139+0000","last_change":"2024-05-20T18:01:30.541893+0000","last_active":"2024-05-20T18:01:32.336139+0000","last_peered":"2024-05-20T18:01:32.336139+0000","last_clean":"2024-05-20T18:01:32.336139+0000","last_became_active":"2024-05-20T18:01:30.540658+0000","last_became_peered":"2024-05-20T18:01:30.540658+0000","last_unstale":"2024-05-20T18:01:32.336139+0000","last_undegraded":"2024-05-20T18:01:32.336139+0000","last_fullsized":"2024-05-20T18:01:32.336139+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:17.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523941+0000","last_change":"2024-05-20T18:01:30.531202+0000","last_active":"2024-05-20T18:01:31.523941+0000","last_peered":"2024-05-20T18:01:31.523941+0000","last_clean":"2024-05-20T18:01:31.523941+0000","last_became_active":"2024-05-20T18:01:30.530897+0000","last_became_peered":"2024-05-20T18:01:30.530897+0000","last_unstale":"2024-05-20T18:01:31.523941+0000","last_undegraded":"2024-05-20T18:01:31.523941+0000","last_fullsized":"2024-05-20T18:01:31.523941+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:26:39.968375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520172+0000","last_change":"2024-05-20T18:01:30.535973+0000","last_active":"2024-05-20T18:01:31.520172+0000","last_peered":"2024-05-20T18:01:31.520172+0000","last_clean":"2024-05-20T18:01:31.520172+0000","last_became_active":"2024-05-20T18:01:30.535646+0000","last_became_peered":"2024-05-20T18:01:30.535646+0000","last_unstale":"2024-05-20T18:01:31.520172+0000","last_undegraded":"2024-05-20T18:01:31.520172+0000","last_fullsized":"2024-05-20T18:01:31.520172+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:07.894449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523710+0000","last_change":"2024-05-20T18:01:30.534916+0000","last_active":"2024-05-20T18:01:31.523710+0000","last_peered":"2024-05-20T18:01:31.523710+0000","last_clean":"2024-05-20T18:01:31.523710+0000","last_became_active":"2024-05-20T18:01:30.534592+0000","last_became_peered":"2024-05-20T18:01:30.534592+0000","last_unstale":"2024-05-20T18:01:31.523710+0000","last_undegraded":"2024-05-20T18:01:31.523710+0000","last_fullsized":"2024-05-20T18:01:31.523710+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:25:40.073639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"124'4","reported_seq":18,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336402+0000","last_change":"2024-05-20T18:01:29.536905+0000","last_active":"2024-05-20T18:01:32.336402+0000","last_peered":"2024-05-20T18:01:32.336402+0000","last_clean":"2024-05-20T18:01:32.336402+0000","last_became_active":"2024-05-20T18:01:29.536535+0000","last_became_peered":"2024-05-20T18:01:29.536535+0000","last_unstale":"2024-05-20T18:01:32.336402+0000","last_undegraded":"2024-05-20T18:01:32.336402+0000","last_fullsized":"2024-05-20T18:01:32.336402+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:01:24.929131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523719+0000","last_change":"2024-05-20T18:01:30.539101+0000","last_active":"2024-05-20T18:01:31.523719+0000","last_peered":"2024-05-20T18:01:31.523719+0000","last_clean":"2024-05-20T18:01:31.523719+0000","last_became_active":"2024-05-20T18:01:30.538780+0000","last_became_peered":"2024-05-20T18:01:30.538780+0000","last_unstale":"2024-05-20T18:01:31.523719+0000","last_undegraded":"2024-05-20T18:01:31.523719+0000","last_fullsized":"2024-05-20T18:01:31.523719+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:25:43.643838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734832+0000","last_change":"2024-05-20T18:01:29.542313+0000","last_active":"2024-05-20T18:01:31.734832+0000","last_peered":"2024-05-20T18:01:31.734832+0000","last_clean":"2024-05-20T18:01:31.734832+0000","last_became_active":"2024-05-20T18:01:29.541874+0000","last_became_peered":"2024-05-20T18:01:29.541874+0000","last_unstale":"2024-05-20T18:01:31.734832+0000","last_undegraded":"2024-05-20T18:01:31.734832+0000","last_fullsized":"2024-05-20T18:01:31.734832+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:53.110048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549209+0000","last_change":"2024-05-20T18:01:30.535128+0000","last_active":"2024-05-20T18:01:31.549209+0000","last_peered":"2024-05-20T18:01:31.549209+0000","last_clean":"2024-05-20T18:01:31.549209+0000","last_became_active":"2024-05-20T18:01:30.534806+0000","last_became_peered":"2024-05-20T18:01:30.534806+0000","last_unstale":"2024-05-20T18:01:31.549209+0000","last_undegraded":"2024-05-20T18:01:31.549209+0000","last_fullsized":"2024-05-20T18:01:31.549209+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:08.913335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335717+0000","last_change":"2024-05-20T18:01:29.538639+0000","last_active":"2024-05-20T18:01:32.335717+0000","last_peered":"2024-05-20T18:01:32.335717+0000","last_clean":"2024-05-20T18:01:32.335717+0000","last_became_active":"2024-05-20T18:01:29.538329+0000","last_became_peered":"2024-05-20T18:01:29.538329+0000","last_unstale":"2024-05-20T18:01:32.335717+0000","last_undegraded":"2024-05-20T18:01:32.335717+0000","last_fullsized":"2024-05-20T18:01:32.335717+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:16.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523752+0000","last_change":"2024-05-20T18:01:30.547356+0000","last_active":"2024-05-20T18:01:31.523752+0000","last_peered":"2024-05-20T18:01:31.523752+0000","last_clean":"2024-05-20T18:01:31.523752+0000","last_became_active":"2024-05-20T18:01:30.546967+0000","last_became_peered":"2024-05-20T18:01:30.546967+0000","last_unstale":"2024-05-20T18:01:31.523752+0000","last_undegraded":"2024-05-20T18:01:31.523752+0000","last_fullsized":"2024-05-20T18:01:31.523752+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:19:52.158395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335211+0000","last_change":"2024-05-20T18:01:29.534809+0000","last_active":"2024-05-20T18:01:32.335211+0000","last_peered":"2024-05-20T18:01:32.335211+0000","last_clean":"2024-05-20T18:01:32.335211+0000","last_became_active":"2024-05-20T18:01:29.534469+0000","last_became_peered":"2024-05-20T18:01:29.534469+0000","last_unstale":"2024-05-20T18:01:32.335211+0000","last_undegraded":"2024-05-20T18:01:32.335211+0000","last_fullsized":"2024-05-20T18:01:32.335211+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:41.841037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524221+0000","last_change":"2024-05-20T18:01:30.528836+0000","last_active":"2024-05-20T18:01:31.524221+0000","last_peered":"2024-05-20T18:01:31.524221+0000","last_clean":"2024-05-20T18:01:31.524221+0000","last_became_active":"2024-05-20T18:01:30.528503+0000","last_became_peered":"2024-05-20T18:01:30.528503+0000","last_unstale":"2024-05-20T18:01:31.524221+0000","last_undegraded":"2024-05-20T18:01:31.524221+0000","last_fullsized":"2024-05-20T18:01:31.524221+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:32:42.247888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523844+0000","last_change":"2024-05-20T18:01:29.525291+0000","last_active":"2024-05-20T18:01:31.523844+0000","last_peered":"2024-05-20T18:01:31.523844+0000","last_clean":"2024-05-20T18:01:31.523844+0000","last_became_active":"2024-05-20T18:01:29.524953+0000","last_became_peered":"2024-05-20T18:01:29.524953+0000","last_unstale":"2024-05-20T18:01:31.523844+0000","last_undegraded":"2024-05-20T18:01:31.523844+0000","last_fullsized":"2024-05-20T18:01:31.523844+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:46:35.656627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524174+0000","last_change":"2024-05-20T18:01:30.532600+0000","last_active":"2024-05-20T18:01:31.524174+0000","last_peered":"2024-05-20T18:01:31.524174+0000","last_clean":"2024-05-20T18:01:31.524174+0000","last_became_active":"2024-05-20T18:01:30.531720+0000","last_became_peered":"2024-05-20T18:01:30.531720+0000","last_unstale":"2024-05-20T18:01:31.524174+0000","last_undegraded":"2024-05-20T18:01:31.524174+0000","last_fullsized":"2024-05-20T18:01:31.524174+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:44:02.726862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734327+0000","last_change":"2024-05-20T18:01:29.538523+0000","last_active":"2024-05-20T18:01:31.734327+0000","last_peered":"2024-05-20T18:01:31.734327+0000","last_clean":"2024-05-20T18:01:31.734327+0000","last_became_active":"2024-05-20T18:01:29.537340+0000","last_became_peered":"2024-05-20T18:01:29.537340+0000","last_unstale":"2024-05-20T18:01:31.734327+0000","last_undegraded":"2024-05-20T18:01:31.734327+0000","last_fullsized":"2024-05-20T18:01:31.734327+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:38.177633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734751+0000","last_change":"2024-05-20T18:01:30.538789+0000","last_active":"2024-05-20T18:01:31.734751+0000","last_peered":"2024-05-20T18:01:31.734751+0000","last_clean":"2024-05-20T18:01:31.734751+0000","last_became_active":"2024-05-20T18:01:30.538191+0000","last_became_peered":"2024-05-20T18:01:30.538191+0000","last_unstale":"2024-05-20T18:01:31.734751+0000","last_undegraded":"2024-05-20T18:01:31.734751+0000","last_fullsized":"2024-05-20T18:01:31.734751+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:12:55.055842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015483+0000","last_change":"2024-05-20T18:01:29.541163+0000","last_active":"2024-05-20T18:01:32.015483+0000","last_peered":"2024-05-20T18:01:32.015483+0000","last_clean":"2024-05-20T18:01:32.015483+0000","last_became_active":"2024-05-20T18:01:29.540842+0000","last_became_peered":"2024-05-20T18:01:29.540842+0000","last_unstale":"2024-05-20T18:01:32.015483+0000","last_undegraded":"2024-05-20T18:01:32.015483+0000","last_fullsized":"2024-05-20T18:01:32.015483+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:45.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336074+0000","last_change":"2024-05-20T18:01:30.548043+0000","last_active":"2024-05-20T18:01:32.336074+0000","last_peered":"2024-05-20T18:01:32.336074+0000","last_clean":"2024-05-20T18:01:32.336074+0000","last_became_active":"2024-05-20T18:01:30.547675+0000","last_became_peered":"2024-05-20T18:01:30.547675+0000","last_unstale":"2024-05-20T18:01:32.336074+0000","last_undegraded":"2024-05-20T18:01:32.336074+0000","last_fullsized":"2024-05-20T18:01:32.336074+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:52.544236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335251+0000","last_change":"2024-05-20T18:01:29.535025+0000","last_active":"2024-05-20T18:01:32.335251+0000","last_peered":"2024-05-20T18:01:32.335251+0000","last_clean":"2024-05-20T18:01:32.335251+0000","last_became_active":"2024-05-20T18:01:29.534706+0000","last_became_peered":"2024-05-20T18:01:29.534706+0000","last_unstale":"2024-05-20T18:01:32.335251+0000","last_undegraded":"2024-05-20T18:01:32.335251+0000","last_fullsized":"2024-05-20T18:01:32.335251+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:40:09.981177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523631+0000","last_change":"2024-05-20T18:01:30.539818+0000","last_active":"2024-05-20T18:01:31.523631+0000","last_peered":"2024-05-20T18:01:31.523631+0000","last_clean":"2024-05-20T18:01:31.523631+0000","last_became_active":"2024-05-20T18:01:30.539504+0000","last_became_peered":"2024-05-20T18:01:30.539504+0000","last_unstale":"2024-05-20T18:01:31.523631+0000","last_undegraded":"2024-05-20T18:01:31.523631+0000","last_fullsized":"2024-05-20T18:01:31.523631+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:25:16.566211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549279+0000","last_change":"2024-05-20T18:01:29.542102+0000","last_active":"2024-05-20T18:01:31.549279+0000","last_peered":"2024-05-20T18:01:31.549279+0000","last_clean":"2024-05-20T18:01:31.549279+0000","last_became_active":"2024-05-20T18:01:29.541817+0000","last_became_peered":"2024-05-20T18:01:29.541817+0000","last_unstale":"2024-05-20T18:01:31.549279+0000","last_undegraded":"2024-05-20T18:01:31.549279+0000","last_fullsized":"2024-05-20T18:01:31.549279+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:08:14.957610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015806+0000","last_change":"2024-05-20T18:01:30.534338+0000","last_active":"2024-05-20T18:01:32.015806+0000","last_peered":"2024-05-20T18:01:32.015806+0000","last_clean":"2024-05-20T18:01:32.015806+0000","last_became_active":"2024-05-20T18:01:30.533430+0000","last_became_peered":"2024-05-20T18:01:30.533430+0000","last_unstale":"2024-05-20T18:01:32.015806+0000","last_undegraded":"2024-05-20T18:01:32.015806+0000","last_fullsized":"2024-05-20T18:01:32.015806+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:42.846858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524019+0000","last_change":"2024-05-20T18:01:29.538182+0000","last_active":"2024-05-20T18:01:31.524019+0000","last_peered":"2024-05-20T18:01:31.524019+0000","last_clean":"2024-05-20T18:01:31.524019+0000","last_became_active":"2024-05-20T18:01:29.537834+0000","last_became_peered":"2024-05-20T18:01:29.537834+0000","last_unstale":"2024-05-20T18:01:31.524019+0000","last_undegraded":"2024-05-20T18:01:31.524019+0000","last_fullsized":"2024-05-20T18:01:31.524019+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:21:46.801504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336200+0000","last_change":"2024-05-20T18:01:30.541107+0000","last_active":"2024-05-20T18:01:32.336200+0000","last_peered":"2024-05-20T18:01:32.336200+0000","last_clean":"2024-05-20T18:01:32.336200+0000","last_became_active":"2024-05-20T18:01:30.540112+0000","last_became_peered":"2024-05-20T18:01:30.540112+0000","last_unstale":"2024-05-20T18:01:32.336200+0000","last_undegraded":"2024-05-20T18:01:32.336200+0000","last_fullsized":"2024-05-20T18:01:32.336200+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:25.218522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"124'3","reported_seq":17,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335868+0000","last_change":"2024-05-20T18:01:29.532837+0000","last_active":"2024-05-20T18:01:32.335868+0000","last_peered":"2024-05-20T18:01:32.335868+0000","last_clean":"2024-05-20T18:01:32.335868+0000","last_became_active":"2024-05-20T18:01:29.532357+0000","last_became_peered":"2024-05-20T18:01:29.532357+0000","last_unstale":"2024-05-20T18:01:32.335868+0000","last_undegraded":"2024-05-20T18:01:32.335868+0000","last_fullsized":"2024-05-20T18:01:32.335868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:24.212701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335955+0000","last_change":"2024-05-20T18:01:30.543643+0000","last_active":"2024-05-20T18:01:32.335955+0000","last_peered":"2024-05-20T18:01:32.335955+0000","last_clean":"2024-05-20T18:01:32.335955+0000","last_became_active":"2024-05-20T18:01:30.543325+0000","last_became_peered":"2024-05-20T18:01:30.543325+0000","last_unstale":"2024-05-20T18:01:32.335955+0000","last_undegraded":"2024-05-20T18:01:32.335955+0000","last_fullsized":"2024-05-20T18:01:32.335955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:39.183454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"124'6","reported_seq":20,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336051+0000","last_change":"2024-05-20T18:01:29.543445+0000","last_active":"2024-05-20T18:01:32.336051+0000","last_peered":"2024-05-20T18:01:32.336051+0000","last_clean":"2024-05-20T18:01:32.336051+0000","last_became_active":"2024-05-20T18:01:29.543139+0000","last_became_peered":"2024-05-20T18:01:29.543139+0000","last_unstale":"2024-05-20T18:01:32.336051+0000","last_undegraded":"2024-05-20T18:01:32.336051+0000","last_fullsized":"2024-05-20T18:01:32.336051+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:09:53.110048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520538+0000","last_change":"2024-05-20T18:01:30.534433+0000","last_active":"2024-05-20T18:01:31.520538+0000","last_peered":"2024-05-20T18:01:31.520538+0000","last_clean":"2024-05-20T18:01:31.520538+0000","last_became_active":"2024-05-20T18:01:30.534059+0000","last_became_peered":"2024-05-20T18:01:30.534059+0000","last_unstale":"2024-05-20T18:01:31.520538+0000","last_undegraded":"2024-05-20T18:01:31.520538+0000","last_fullsized":"2024-05-20T18:01:31.520538+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:20.110064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523876+0000","last_change":"2024-05-20T18:01:29.535590+0000","last_active":"2024-05-20T18:01:31.523876+0000","last_peered":"2024-05-20T18:01:31.523876+0000","last_clean":"2024-05-20T18:01:31.523876+0000","last_became_active":"2024-05-20T18:01:29.535046+0000","last_became_peered":"2024-05-20T18:01:29.535046+0000","last_unstale":"2024-05-20T18:01:31.523876+0000","last_undegraded":"2024-05-20T18:01:31.523876+0000","last_fullsized":"2024-05-20T18:01:31.523876+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:07.182612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335964+0000","last_change":"2024-05-20T18:01:30.538066+0000","last_active":"2024-05-20T18:01:32.335964+0000","last_peered":"2024-05-20T18:01:32.335964+0000","last_clean":"2024-05-20T18:01:32.335964+0000","last_became_active":"2024-05-20T18:01:30.537744+0000","last_became_peered":"2024-05-20T18:01:30.537744+0000","last_unstale":"2024-05-20T18:01:32.335964+0000","last_undegraded":"2024-05-20T18:01:32.335964+0000","last_fullsized":"2024-05-20T18:01:32.335964+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:05.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335237+0000","last_change":"2024-05-20T18:01:29.533247+0000","last_active":"2024-05-20T18:01:32.335237+0000","last_peered":"2024-05-20T18:01:32.335237+0000","last_clean":"2024-05-20T18:01:32.335237+0000","last_became_active":"2024-05-20T18:01:29.532955+0000","last_became_peered":"2024-05-20T18:01:29.532955+0000","last_unstale":"2024-05-20T18:01:32.335237+0000","last_undegraded":"2024-05-20T18:01:32.335237+0000","last_fullsized":"2024-05-20T18:01:32.335237+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:20:18.652619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734791+0000","last_change":"2024-05-20T18:01:30.536945+0000","last_active":"2024-05-20T18:01:31.734791+0000","last_peered":"2024-05-20T18:01:31.734791+0000","last_clean":"2024-05-20T18:01:31.734791+0000","last_became_active":"2024-05-20T18:01:30.536607+0000","last_became_peered":"2024-05-20T18:01:30.536607+0000","last_unstale":"2024-05-20T18:01:31.734791+0000","last_undegraded":"2024-05-20T18:01:31.734791+0000","last_fullsized":"2024-05-20T18:01:31.734791+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:19.322566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"124'8","reported_seq":22,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015631+0000","last_change":"2024-05-20T18:01:29.531947+0000","last_active":"2024-05-20T18:01:32.015631+0000","last_peered":"2024-05-20T18:01:32.015631+0000","last_clean":"2024-05-20T18:01:32.015631+0000","last_became_active":"2024-05-20T18:01:29.531588+0000","last_became_peered":"2024-05-20T18:01:29.531588+0000","last_unstale":"2024-05-20T18:01:32.015631+0000","last_undegraded":"2024-05-20T18:01:32.015631+0000","last_fullsized":"2024-05-20T18:01:32.015631+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:06:24.435039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335181+0000","last_change":"2024-05-20T18:01:30.543744+0000","last_active":"2024-05-20T18:01:32.335181+0000","last_peered":"2024-05-20T18:01:32.335181+0000","last_clean":"2024-05-20T18:01:32.335181+0000","last_became_active":"2024-05-20T18:01:30.543351+0000","last_became_peered":"2024-05-20T18:01:30.543351+0000","last_unstale":"2024-05-20T18:01:32.335181+0000","last_undegraded":"2024-05-20T18:01:32.335181+0000","last_fullsized":"2024-05-20T18:01:32.335181+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:34:08.727478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549358+0000","last_change":"2024-05-20T18:01:29.531744+0000","last_active":"2024-05-20T18:01:31.549358+0000","last_peered":"2024-05-20T18:01:31.549358+0000","last_clean":"2024-05-20T18:01:31.549358+0000","last_became_active":"2024-05-20T18:01:29.531417+0000","last_became_peered":"2024-05-20T18:01:29.531417+0000","last_unstale":"2024-05-20T18:01:31.549358+0000","last_undegraded":"2024-05-20T18:01:31.549358+0000","last_fullsized":"2024-05-20T18:01:31.549358+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:45.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335985+0000","last_change":"2024-05-20T18:01:30.542003+0000","last_active":"2024-05-20T18:01:32.335985+0000","last_peered":"2024-05-20T18:01:32.335985+0000","last_clean":"2024-05-20T18:01:32.335985+0000","last_became_active":"2024-05-20T18:01:30.541696+0000","last_became_peered":"2024-05-20T18:01:30.541696+0000","last_unstale":"2024-05-20T18:01:32.335985+0000","last_undegraded":"2024-05-20T18:01:32.335985+0000","last_fullsized":"2024-05-20T18:01:32.335985+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:23:19.507654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335855+0000","last_change":"2024-05-20T18:01:29.534742+0000","last_active":"2024-05-20T18:01:32.335855+0000","last_peered":"2024-05-20T18:01:32.335855+0000","last_clean":"2024-05-20T18:01:32.335855+0000","last_became_active":"2024-05-20T18:01:29.534350+0000","last_became_peered":"2024-05-20T18:01:29.534350+0000","last_unstale":"2024-05-20T18:01:32.335855+0000","last_undegraded":"2024-05-20T18:01:32.335855+0000","last_fullsized":"2024-05-20T18:01:32.335855+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:30:11.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335699+0000","last_change":"2024-05-20T18:01:30.536232+0000","last_active":"2024-05-20T18:01:32.335699+0000","last_peered":"2024-05-20T18:01:32.335699+0000","last_clean":"2024-05-20T18:01:32.335699+0000","last_became_active":"2024-05-20T18:01:30.535959+0000","last_became_peered":"2024-05-20T18:01:30.535959+0000","last_unstale":"2024-05-20T18:01:32.335699+0000","last_undegraded":"2024-05-20T18:01:32.335699+0000","last_fullsized":"2024-05-20T18:01:32.335699+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:16.742767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.016068+0000","last_change":"2024-05-20T18:01:29.540315+0000","last_active":"2024-05-20T18:01:32.016068+0000","last_peered":"2024-05-20T18:01:32.016068+0000","last_clean":"2024-05-20T18:01:32.016068+0000","last_became_active":"2024-05-20T18:01:29.540000+0000","last_became_peered":"2024-05-20T18:01:29.540000+0000","last_unstale":"2024-05-20T18:01:32.016068+0000","last_undegraded":"2024-05-20T18:01:32.016068+0000","last_fullsized":"2024-05-20T18:01:32.016068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:30:11.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520389+0000","last_change":"2024-05-20T18:01:30.545137+0000","last_active":"2024-05-20T18:01:31.520389+0000","last_peered":"2024-05-20T18:01:31.520389+0000","last_clean":"2024-05-20T18:01:31.520389+0000","last_became_active":"2024-05-20T18:01:30.544529+0000","last_became_peered":"2024-05-20T18:01:30.544529+0000","last_unstale":"2024-05-20T18:01:31.520389+0000","last_undegraded":"2024-05-20T18:01:31.520389+0000","last_fullsized":"2024-05-20T18:01:31.520389+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:18:38.195873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734849+0000","last_change":"2024-05-20T18:01:29.542085+0000","last_active":"2024-05-20T18:01:31.734849+0000","last_peered":"2024-05-20T18:01:31.734849+0000","last_clean":"2024-05-20T18:01:31.734849+0000","last_became_active":"2024-05-20T18:01:29.541275+0000","last_became_peered":"2024-05-20T18:01:29.541275+0000","last_unstale":"2024-05-20T18:01:31.734849+0000","last_undegraded":"2024-05-20T18:01:31.734849+0000","last_fullsized":"2024-05-20T18:01:31.734849+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:16.591595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734719+0000","last_change":"2024-05-20T18:01:30.537267+0000","last_active":"2024-05-20T18:01:31.734719+0000","last_peered":"2024-05-20T18:01:31.734719+0000","last_clean":"2024-05-20T18:01:31.734719+0000","last_became_active":"2024-05-20T18:01:30.536940+0000","last_became_peered":"2024-05-20T18:01:30.536940+0000","last_unstale":"2024-05-20T18:01:31.734719+0000","last_undegraded":"2024-05-20T18:01:31.734719+0000","last_fullsized":"2024-05-20T18:01:31.734719+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:10:08.754119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523853+0000","last_change":"2024-05-20T18:01:29.531456+0000","last_active":"2024-05-20T18:01:31.523853+0000","last_peered":"2024-05-20T18:01:31.523853+0000","last_clean":"2024-05-20T18:01:31.523853+0000","last_became_active":"2024-05-20T18:01:29.531085+0000","last_became_peered":"2024-05-20T18:01:29.531085+0000","last_unstale":"2024-05-20T18:01:31.523853+0000","last_undegraded":"2024-05-20T18:01:31.523853+0000","last_fullsized":"2024-05-20T18:01:31.523853+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:08:14.957610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524107+0000","last_change":"2024-05-20T18:01:30.540938+0000","last_active":"2024-05-20T18:01:31.524107+0000","last_peered":"2024-05-20T18:01:31.524107+0000","last_clean":"2024-05-20T18:01:31.524107+0000","last_became_active":"2024-05-20T18:01:30.540641+0000","last_became_peered":"2024-05-20T18:01:30.540641+0000","last_unstale":"2024-05-20T18:01:31.524107+0000","last_undegraded":"2024-05-20T18:01:31.524107+0000","last_fullsized":"2024-05-20T18:01:31.524107+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:07:31.784684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.523756+0000","last_change":"2024-05-20T18:01:29.534592+0000","last_active":"2024-05-20T18:01:31.523756+0000","last_peered":"2024-05-20T18:01:31.523756+0000","last_clean":"2024-05-20T18:01:31.523756+0000","last_became_active":"2024-05-20T18:01:29.534212+0000","last_became_peered":"2024-05-20T18:01:29.534212+0000","last_unstale":"2024-05-20T18:01:31.523756+0000","last_undegraded":"2024-05-20T18:01:31.523756+0000","last_fullsized":"2024-05-20T18:01:31.523756+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:34:56.939961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734935+0000","last_change":"2024-05-20T18:01:30.543854+0000","last_active":"2024-05-20T18:01:31.734935+0000","last_peered":"2024-05-20T18:01:31.734935+0000","last_clean":"2024-05-20T18:01:31.734935+0000","last_became_active":"2024-05-20T18:01:30.543490+0000","last_became_peered":"2024-05-20T18:01:30.543490+0000","last_unstale":"2024-05-20T18:01:31.734935+0000","last_undegraded":"2024-05-20T18:01:31.734935+0000","last_fullsized":"2024-05-20T18:01:31.734935+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:05.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335778+0000","last_change":"2024-05-20T18:01:29.540086+0000","last_active":"2024-05-20T18:01:32.335778+0000","last_peered":"2024-05-20T18:01:32.335778+0000","last_clean":"2024-05-20T18:01:32.335778+0000","last_became_active":"2024-05-20T18:01:29.539835+0000","last_became_peered":"2024-05-20T18:01:29.539835+0000","last_unstale":"2024-05-20T18:01:32.335778+0000","last_undegraded":"2024-05-20T18:01:32.335778+0000","last_fullsized":"2024-05-20T18:01:32.335778+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:00.690658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.549307+0000","last_change":"2024-05-20T18:01:30.540571+0000","last_active":"2024-05-20T18:01:31.549307+0000","last_peered":"2024-05-20T18:01:31.549307+0000","last_clean":"2024-05-20T18:01:31.549307+0000","last_became_active":"2024-05-20T18:01:30.540242+0000","last_became_peered":"2024-05-20T18:01:30.540242+0000","last_unstale":"2024-05-20T18:01:31.549307+0000","last_undegraded":"2024-05-20T18:01:31.549307+0000","last_fullsized":"2024-05-20T18:01:31.549307+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:01:29.426400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015861+0000","last_change":"2024-05-20T18:01:29.538953+0000","last_active":"2024-05-20T18:01:32.015861+0000","last_peered":"2024-05-20T18:01:32.015861+0000","last_clean":"2024-05-20T18:01:32.015861+0000","last_became_active":"2024-05-20T18:01:29.538631+0000","last_became_peered":"2024-05-20T18:01:29.538631+0000","last_unstale":"2024-05-20T18:01:32.015861+0000","last_undegraded":"2024-05-20T18:01:32.015861+0000","last_fullsized":"2024-05-20T18:01:32.015861+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:01:24.929131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734498+0000","last_change":"2024-05-20T18:01:30.536644+0000","last_active":"2024-05-20T18:01:31.734498+0000","last_peered":"2024-05-20T18:01:31.734498+0000","last_clean":"2024-05-20T18:01:31.734498+0000","last_became_active":"2024-05-20T18:01:30.534844+0000","last_became_peered":"2024-05-20T18:01:30.534844+0000","last_unstale":"2024-05-20T18:01:31.734498+0000","last_undegraded":"2024-05-20T18:01:31.734498+0000","last_fullsized":"2024-05-20T18:01:31.734498+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:44:12.059095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524124+0000","last_change":"2024-05-20T18:01:29.535301+0000","last_active":"2024-05-20T18:01:31.524124+0000","last_peered":"2024-05-20T18:01:31.524124+0000","last_clean":"2024-05-20T18:01:31.524124+0000","last_became_active":"2024-05-20T18:01:29.534967+0000","last_became_peered":"2024-05-20T18:01:29.534967+0000","last_unstale":"2024-05-20T18:01:31.524124+0000","last_undegraded":"2024-05-20T18:01:31.524124+0000","last_fullsized":"2024-05-20T18:01:31.524124+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:25.222146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335164+0000","last_change":"2024-05-20T18:01:30.543762+0000","last_active":"2024-05-20T18:01:32.335164+0000","last_peered":"2024-05-20T18:01:32.335164+0000","last_clean":"2024-05-20T18:01:32.335164+0000","last_became_active":"2024-05-20T18:01:30.543295+0000","last_became_peered":"2024-05-20T18:01:30.543295+0000","last_unstale":"2024-05-20T18:01:32.335164+0000","last_undegraded":"2024-05-20T18:01:32.335164+0000","last_fullsized":"2024-05-20T18:01:32.335164+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:48:01.696479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"125'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524291+0000","last_change":"2024-05-20T18:01:29.527271+0000","last_active":"2024-05-20T18:01:31.524291+0000","last_peered":"2024-05-20T18:01:31.524291+0000","last_clean":"2024-05-20T18:01:31.524291+0000","last_became_active":"2024-05-20T18:01:29.526960+0000","last_became_peered":"2024-05-20T18:01:29.526960+0000","last_unstale":"2024-05-20T18:01:31.524291+0000","last_undegraded":"2024-05-20T18:01:31.524291+0000","last_fullsized":"2024-05-20T18:01:31.524291+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:20.105416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335222+0000","last_change":"2024-05-20T18:01:30.541858+0000","last_active":"2024-05-20T18:01:32.335222+0000","last_peered":"2024-05-20T18:01:32.335222+0000","last_clean":"2024-05-20T18:01:32.335222+0000","last_became_active":"2024-05-20T18:01:30.541467+0000","last_became_peered":"2024-05-20T18:01:30.541467+0000","last_unstale":"2024-05-20T18:01:32.335222+0000","last_undegraded":"2024-05-20T18:01:32.335222+0000","last_fullsized":"2024-05-20T18:01:32.335222+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:05:35.260960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.524176+0000","last_change":"2024-05-20T18:01:29.536476+0000","last_active":"2024-05-20T18:01:31.524176+0000","last_peered":"2024-05-20T18:01:31.524176+0000","last_clean":"2024-05-20T18:01:31.524176+0000","last_became_active":"2024-05-20T18:01:29.536130+0000","last_became_peered":"2024-05-20T18:01:29.536130+0000","last_unstale":"2024-05-20T18:01:31.524176+0000","last_undegraded":"2024-05-20T18:01:31.524176+0000","last_fullsized":"2024-05-20T18:01:31.524176+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:21:45.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.520437+0000","last_change":"2024-05-20T18:01:30.529067+0000","last_active":"2024-05-20T18:01:31.520437+0000","last_peered":"2024-05-20T18:01:31.520437+0000","last_clean":"2024-05-20T18:01:31.520437+0000","last_became_active":"2024-05-20T18:01:30.528359+0000","last_became_peered":"2024-05-20T18:01:30.528359+0000","last_unstale":"2024-05-20T18:01:31.520437+0000","last_undegraded":"2024-05-20T18:01:31.520437+0000","last_fullsized":"2024-05-20T18:01:31.520437+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:35:32.505167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015748+0000","last_change":"2024-05-20T18:01:29.535107+0000","last_active":"2024-05-20T18:01:32.015748+0000","last_peered":"2024-05-20T18:01:32.015748+0000","last_clean":"2024-05-20T18:01:32.015748+0000","last_became_active":"2024-05-20T18:01:29.534799+0000","last_became_peered":"2024-05-20T18:01:29.534799+0000","last_unstale":"2024-05-20T18:01:32.015748+0000","last_undegraded":"2024-05-20T18:01:32.015748+0000","last_fullsized":"2024-05-20T18:01:32.015748+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:25:56.173674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015983+0000","last_change":"2024-05-20T18:01:30.536770+0000","last_active":"2024-05-20T18:01:32.015983+0000","last_peered":"2024-05-20T18:01:32.015983+0000","last_clean":"2024-05-20T18:01:32.015983+0000","last_became_active":"2024-05-20T18:01:30.536473+0000","last_became_peered":"2024-05-20T18:01:30.536473+0000","last_unstale":"2024-05-20T18:01:32.015983+0000","last_undegraded":"2024-05-20T18:01:32.015983+0000","last_fullsized":"2024-05-20T18:01:32.015983+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:17.597416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.548954+0000","last_change":"2024-05-20T18:01:29.535547+0000","last_active":"2024-05-20T18:01:31.548954+0000","last_peered":"2024-05-20T18:01:31.548954+0000","last_clean":"2024-05-20T18:01:31.548954+0000","last_became_active":"2024-05-20T18:01:29.535247+0000","last_became_peered":"2024-05-20T18:01:29.535247+0000","last_unstale":"2024-05-20T18:01:31.548954+0000","last_undegraded":"2024-05-20T18:01:31.548954+0000","last_fullsized":"2024-05-20T18:01:31.548954+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:20.105416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015991+0000","last_change":"2024-05-20T18:01:30.533668+0000","last_active":"2024-05-20T18:01:32.015991+0000","last_peered":"2024-05-20T18:01:32.015991+0000","last_clean":"2024-05-20T18:01:32.015991+0000","last_became_active":"2024-05-20T18:01:30.533259+0000","last_became_peered":"2024-05-20T18:01:30.533259+0000","last_unstale":"2024-05-20T18:01:32.015991+0000","last_undegraded":"2024-05-20T18:01:32.015991+0000","last_fullsized":"2024-05-20T18:01:32.015991+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:25.218522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335584+0000","last_change":"2024-05-20T18:01:29.534716+0000","last_active":"2024-05-20T18:01:32.335584+0000","last_peered":"2024-05-20T18:01:32.335584+0000","last_clean":"2024-05-20T18:01:32.335584+0000","last_became_active":"2024-05-20T18:01:29.533946+0000","last_became_peered":"2024-05-20T18:01:29.533946+0000","last_unstale":"2024-05-20T18:01:32.335584+0000","last_undegraded":"2024-05-20T18:01:32.335584+0000","last_fullsized":"2024-05-20T18:01:32.335584+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:59:38.177633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.016042+0000","last_change":"2024-05-20T18:01:30.534724+0000","last_active":"2024-05-20T18:01:32.016042+0000","last_peered":"2024-05-20T18:01:32.016042+0000","last_clean":"2024-05-20T18:01:32.016042+0000","last_became_active":"2024-05-20T18:01:30.534397+0000","last_became_peered":"2024-05-20T18:01:30.534397+0000","last_unstale":"2024-05-20T18:01:32.016042+0000","last_undegraded":"2024-05-20T18:01:32.016042+0000","last_fullsized":"2024-05-20T18:01:32.016042+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:45:27.941563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.015656+0000","last_change":"2024-05-20T18:01:29.534296+0000","last_active":"2024-05-20T18:01:32.015656+0000","last_peered":"2024-05-20T18:01:32.015656+0000","last_clean":"2024-05-20T18:01:32.015656+0000","last_became_active":"2024-05-20T18:01:29.533926+0000","last_became_peered":"2024-05-20T18:01:29.533926+0000","last_unstale":"2024-05-20T18:01:32.015656+0000","last_undegraded":"2024-05-20T18:01:32.015656+0000","last_fullsized":"2024-05-20T18:01:32.015656+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:20:18.652619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336249+0000","last_change":"2024-05-20T18:01:30.543667+0000","last_active":"2024-05-20T18:01:32.336249+0000","last_peered":"2024-05-20T18:01:32.336249+0000","last_clean":"2024-05-20T18:01:32.336249+0000","last_became_active":"2024-05-20T18:01:30.543332+0000","last_became_peered":"2024-05-20T18:01:30.543332+0000","last_unstale":"2024-05-20T18:01:32.336249+0000","last_undegraded":"2024-05-20T18:01:32.336249+0000","last_fullsized":"2024-05-20T18:01:32.336249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:18.261742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:31.734402+0000","last_change":"2024-05-20T18:01:29.535234+0000","last_active":"2024-05-20T18:01:31.734402+0000","last_peered":"2024-05-20T18:01:31.734402+0000","last_clean":"2024-05-20T18:01:31.734402+0000","last_became_active":"2024-05-20T18:01:29.534543+0000","last_became_peered":"2024-05-20T18:01:29.534543+0000","last_unstale":"2024-05-20T18:01:31.734402+0000","last_undegraded":"2024-05-20T18:01:31.734402+0000","last_fullsized":"2024-05-20T18:01:31.734402+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:26:41.841037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.336406+0000","last_change":"2024-05-20T18:01:30.542728+0000","last_active":"2024-05-20T18:01:32.336406+0000","last_peered":"2024-05-20T18:01:32.336406+0000","last_clean":"2024-05-20T18:01:32.336406+0000","last_became_active":"2024-05-20T18:01:30.539361+0000","last_became_peered":"2024-05-20T18:01:30.539361+0000","last_unstale":"2024-05-20T18:01:32.336406+0000","last_undegraded":"2024-05-20T18:01:32.336406+0000","last_fullsized":"2024-05-20T18:01:32.336406+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:29.505172+0000","last_clean_scrub_stamp":"2024-05-20T18:01:29.505172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:00:53.043970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.335401+0000","last_change":"2024-05-20T18:01:29.540276+0000","last_active":"2024-05-20T18:01:32.335401+0000","last_peered":"2024-05-20T18:01:32.335401+0000","last_clean":"2024-05-20T18:01:32.335401+0000","last_became_active":"2024-05-20T18:01:29.539943+0000","last_became_peered":"2024-05-20T18:01:29.539943+0000","last_unstale":"2024-05-20T18:01:32.335401+0000","last_undegraded":"2024-05-20T18:01:32.335401+0000","last_fullsized":"2024-05-20T18:01:32.335401+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:01:28.499351+0000","last_clean_scrub_stamp":"2024-05-20T18:01:28.499351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:34:07.721657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":362,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-05-20T18:01:32.334959+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:01:32.334959+0000","last_peered":"2024-05-20T18:01:32.334959+0000","last_clean":"2024-05-20T18:01:32.334959+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:01:32.334959+0000","last_undegraded":"2024-05-20T18:01:32.334959+0000","last_fullsized":"2024-05-20T18:01:32.334959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33304,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2174976,"data_stored":1316822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1572864,"data_stored":725424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1568768,"data_stored":724774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1564672,"data_stored":724752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1581056,"data_stored":726434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574956,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":725368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1568768,"data_stored":724822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33300,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338540,"statfs":{"total":96636764160,"available":96602664960,"internally_reserved":0,"allocated":2166784,"data_stored":1315176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:01:34.980 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T18:01:34.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T18:01:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.139+0000 7f8977faa640 1 Processor -- start 2024-05-20T18:01:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.140+0000 7f8977faa640 1 -- start start 2024-05-20T18:01:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8977faa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cfae0 0x7f8970162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8977faa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f897006d6b0 0x7f897015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8977faa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f897006c8c0 con 0x7f89700cd710 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8977faa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f89700d0ba0 con 0x7f897006d6b0 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8977faa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f897006dac0 con 0x7f89700cfae0 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8976547640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f897006d6b0 0x7f897015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8976547640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f897006d6b0 0x7f897015f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48094/0 (socket says 172.21.15.6:48094) 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8976547640 1 -- 172.21.15.6:0/930654314 learned_addr learned my addr 172.21.15.6:0/930654314 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8975545640 1 --2- 172.21.15.6:0/930654314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cfae0 0x7f8970162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.141+0000 7f8976547640 1 -- 172.21.15.6:0/930654314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cfae0 msgr2=0x7f8970162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.142+0000 7f8976547640 1 --2- 172.21.15.6:0/930654314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cfae0 0x7f8970162e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.142+0000 7f8976547640 1 -- 172.21.15.6:0/930654314 >> v1:172.21.15.171:6789/0 conn(0x7f89700cd710 legacy=0x7f89700cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.142+0000 7f8976547640 1 -- 172.21.15.6:0/930654314 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89701633e0 con 0x7f897006d6b0 2024-05-20T18:01:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.142+0000 7f8975545640 1 --2- 172.21.15.6:0/930654314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cfae0 0x7f8970162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.142+0000 7f8976547640 1 --2- 172.21.15.6:0/930654314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f897015f2b0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f8968009870 tx=0x7f896802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f6cca546102d72 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.142+0000 7f8974d44640 1 -- 172.21.15.6:0/930654314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968037070 con 0x7f897006d6b0 2024-05-20T18:01:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8974d44640 1 -- 172.21.15.6:0/930654314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8968032440 con 0x7f897006d6b0 2024-05-20T18:01:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8974d44640 1 -- 172.21.15.6:0/930654314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968032810 con 0x7f897006d6b0 2024-05-20T18:01:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8977faa640 1 -- 172.21.15.6:0/930654314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 msgr2=0x7f897015f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8977faa640 1 --2- 172.21.15.6:0/930654314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f897015f2b0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f8968009870 tx=0x7f896802a270 comp rx=0 tx=0).stop 2024-05-20T18:01:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8977faa640 1 -- 172.21.15.6:0/930654314 shutdown_connections 2024-05-20T18:01:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8977faa640 1 --2- 172.21.15.6:0/930654314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f897015f2b0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8977faa640 1 --2- 172.21.15.6:0/930654314 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cfae0 0x7f8970162e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8977faa640 1 -- 172.21.15.6:0/930654314 >> 172.21.15.6:0/930654314 conn(0x7f89700b44d0 msgr2=0x7f89700b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8977faa640 1 -- 172.21.15.6:0/930654314 shutdown_connections 2024-05-20T18:01:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.143+0000 7f8977faa640 1 -- 172.21.15.6:0/930654314 wait complete. 2024-05-20T18:01:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.145+0000 7f8977faa640 1 Processor -- start 2024-05-20T18:01:35.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.145+0000 7f8977faa640 1 -- start start 2024-05-20T18:01:35.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.146+0000 7f8977faa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f89700cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.146+0000 7f8977faa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cd710 0x7f89701f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.146+0000 7f8977faa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89700ca330 0x7f89701f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.146+0000 7f8977faa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8970163c80 con 0x7f897006d6b0 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.146+0000 7f8977faa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89701639a0 con 0x7f89700ca330 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.146+0000 7f8977faa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89700d1030 con 0x7f89700cd710 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.146+0000 7f8975d46640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f89700cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975d46640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f89700cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48108/0 (socket says 172.21.15.6:48108) 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975d46640 1 -- 172.21.15.6:0/1696432652 learned_addr learned my addr 172.21.15.6:0/1696432652 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8976547640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89700ca330 0x7f89701f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975545640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cd710 0x7f89701f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975d46640 1 -- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cd710 msgr2=0x7f89701f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975d46640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cd710 0x7f89701f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975d46640 1 -- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89700ca330 msgr2=0x7f89701f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975d46640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89700ca330 0x7f89701f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975d46640 1 -- 172.21.15.6:0/1696432652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89700caa80 con 0x7f897006d6b0 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8976547640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89700ca330 0x7f89701f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975545640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cd710 0x7f89701f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8975d46640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f89700cc920 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f896000c690 tx=0x7f896000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f896e7fc640 1 -- 172.21.15.6:0/1696432652 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960003b70 con 0x7f897006d6b0 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f896e7fc640 1 -- 172.21.15.6:0/1696432652 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8960003d30 con 0x7f897006d6b0 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89700cad60 con 0x7f897006d6b0 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f896e7fc640 1 -- 172.21.15.6:0/1696432652 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960005310 con 0x7f897006d6b0 2024-05-20T18:01:35.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.147+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89700cb320 con 0x7f897006d6b0 2024-05-20T18:01:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.148+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8970162e00 con 0x7f897006d6b0 2024-05-20T18:01:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.149+0000 7f896e7fc640 1 -- 172.21.15.6:0/1696432652 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89600054b0 con 0x7f897006d6b0 2024-05-20T18:01:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.149+0000 7f896e7fc640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f895c06be30 0x7f895c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.149+0000 7f896e7fc640 1 -- 172.21.15.6:0/1696432652 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f896008aec0 con 0x7f897006d6b0 2024-05-20T18:01:35.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.150+0000 7f8975545640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f895c06be30 0x7f895c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.150+0000 7f8975545640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f895c06be30 0x7f895c06e340 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f89701f8cd0 tx=0x7f8964008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:35.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.154+0000 7f896e7fc640 1 -- 172.21.15.6:0/1696432652 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8970162e00 con 0x7f897006d6b0 2024-05-20T18:01:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.410+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f89700d0250 con 0x7f897006d6b0 2024-05-20T18:01:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.412+0000 7f896e7fc640 1 -- 172.21.15.6:0/1696432652 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f89700d0250 con 0x7f897006d6b0 2024-05-20T18:01:35.411 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T18:01:35.411 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T18:01:35.411 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T18:01:35.411 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T18:01:35.411 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T18:01:35.411 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.414+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f895c06be30 msgr2=0x7f895c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.414+0000 7f8977faa640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f895c06be30 0x7f895c06e340 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f89701f8cd0 tx=0x7f8964008040 comp rx=0 tx=0).stop 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.414+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 msgr2=0x7f89700cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.414+0000 7f8977faa640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f89700cc920 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f896000c690 tx=0x7f896000cb50 comp rx=0 tx=0).stop 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.415+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 shutdown_connections 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.415+0000 7f8977faa640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f895c06be30 0x7f895c06e340 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.415+0000 7f8977faa640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89700ca330 0x7f89701f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.415+0000 7f8977faa640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89700cd710 0x7f89701f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.415+0000 7f8977faa640 1 --2- 172.21.15.6:0/1696432652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f897006d6b0 0x7f89700cc920 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.415+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 >> 172.21.15.6:0/1696432652 conn(0x7f89700b44d0 msgr2=0x7f89700d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.415+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 shutdown_connections 2024-05-20T18:01:35.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.415+0000 7f8977faa640 1 -- 172.21.15.6:0/1696432652 wait complete. 2024-05-20T18:01:35.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:35.500 INFO:tasks.ceph.mds.c.smithi006.stderr:2024-05-20T18:01:35.501+0000 7f7470e6f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T18:01:35.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.540+0000 7f3e862e9640 1 Processor -- start 2024-05-20T18:01:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.541+0000 7f3e862e9640 1 -- start start 2024-05-20T18:01:35.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e862e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e80162820 0x7f3e800b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e862e9640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3e800b3e80 0x7f3e8006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e862e9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8006dd20 con 0x7f3e8006d910 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e862e9640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3e800d0630 con 0x7f3e800b3e80 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e862e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3e800d39c0 con 0x7f3e80162820 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e84886640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3e8006d910 0x7f3e800d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35894/0 (socket says 172.21.15.6:35894) 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e84886640 1 -- 172.21.15.6:0/2941263242 learned_addr learned my addr 172.21.15.6:0/2941263242 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e77fff640 1 --2- 172.21.15.6:0/2941263242 >> v2:172.21.15.171:3300/0 conn(0x7f3e800b3e80 0x7f3e8006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e7ffff640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e80162820 0x7f3e800b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881669112 0 0) 0x7f3e78001490 con 0x7f3e8006d910 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.542+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e6c003520 con 0x7f3e8006d910 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 964544355 0 0) 0x7f3e6c003520 con 0x7f3e8006d910 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e80162820 msgr2=0x7f3e800b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e80162820 0x7f3e800b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 >> v2:172.21.15.171:3300/0 conn(0x7f3e800b3e80 msgr2=0x7f3e8006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 --2- 172.21.15.6:0/2941263242 >> v2:172.21.15.171:3300/0 conn(0x7f3e800b3e80 0x7f3e8006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e800d3ca0 con 0x7f3e8006d910 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f3e78001bc0 con 0x7f3e8006d910 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 >> v1:172.21.15.6:6789/0 conn(0x7f3e8006d910 legacy=0x7f3e800d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e80162820 0x7f3e6c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6c003f30 0x7f3e6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e6c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3e800d0630 con 0x7f3e6c004d40 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3e800d39c0 con 0x7f3e6c003f30 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6c00ba10 con 0x7f3e80162820 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e84886640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e6c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e7ffff640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e80162820 0x7f3e6c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e77fff640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6c003f30 0x7f3e6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e84886640 1 -- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e80162820 msgr2=0x7f3e6c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:35.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e84886640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e80162820 0x7f3e6c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e84886640 1 -- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6c003f30 msgr2=0x7f3e6c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:35.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e84886640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e6c003f30 0x7f3e6c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.543+0000 7f3e84886640 1 -- 172.21.15.6:0/2941263242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c003520 con 0x7f3e6c004d40 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.544+0000 7f3e84886640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e6c005150 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800aa20 tx=0x7f3e6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bae863d4f26b183 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.544+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800a670 con 0x7f3e6c004d40 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.544+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7802f070 con 0x7f3e6c004d40 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.544+0000 7f3e7f7fe640 1 -- 172.21.15.6:0/2941263242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78034470 con 0x7f3e6c004d40 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.545+0000 7f3e862e9640 1 -- 172.21.15.6:0/2941263242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 msgr2=0x7f3e6c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.545+0000 7f3e862e9640 1 --2- 172.21.15.6:0/2941263242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e6c005150 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800aa20 tx=0x7f3e6c005830 comp rx=0 tx=0).stop 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.545+0000 7f3e84886640 1 -- 172.21.15.6:0/2941263242 reap_dead start 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.545+0000 7f3e862e9640 1 -- 172.21.15.6:0/2941263242 shutdown_connections 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.545+0000 7f3e862e9640 1 -- 172.21.15.6:0/2941263242 >> 172.21.15.6:0/2941263242 conn(0x7f3e800d4bd0 msgr2=0x7f3e800d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:35.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.545+0000 7f3e862e9640 1 -- 172.21.15.6:0/2941263242 shutdown_connections 2024-05-20T18:01:35.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.545+0000 7f3e862e9640 1 -- 172.21.15.6:0/2941263242 wait complete. 2024-05-20T18:01:35.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.547+0000 7f3e862e9640 1 Processor -- start 2024-05-20T18:01:35.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.547+0000 7f3e862e9640 1 -- start start 2024-05-20T18:01:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e862e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e8014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e862e9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e8014d320 0x7f3e8014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e862e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e8014d810 0x7f3e8014dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e862e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3e800d0300 con 0x7f3e6c004d40 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e862e9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3e800d4260 con 0x7f3e8014d320 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e862e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3e800b91a0 con 0x7f3e8014d810 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e8014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e8014ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48126/0 (socket says 172.21.15.6:48126) 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.548+0000 7f3e7ffff640 1 -- 172.21.15.6:0/687537181 learned_addr learned my addr 172.21.15.6:0/687537181 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7ffff640 1 -- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e8014d810 msgr2=0x7f3e8014dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e84886640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e8014d810 0x7f3e8014dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e77fff640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e8014d320 0x7f3e8014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7ffff640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e8014d810 0x7f3e8014dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7ffff640 1 -- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e8014d320 msgr2=0x7f3e8014b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7ffff640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e8014d320 0x7f3e8014b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7ffff640 1 -- 172.21.15.6:0/687537181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8014e160 con 0x7f3e6c004d40 2024-05-20T18:01:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7ffff640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e8014ae90 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f3e700119d0 tx=0x7f3e70011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7d7fa640 1 -- 172.21.15.6:0/687537181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000fb50 con 0x7f3e6c004d40 2024-05-20T18:01:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7d7fa640 1 -- 172.21.15.6:0/687537181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7000fcf0 con 0x7f3e6c004d40 2024-05-20T18:01:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8014c280 con 0x7f3e6c004d40 2024-05-20T18:01:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e7d7fa640 1 -- 172.21.15.6:0/687537181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000fea0 con 0x7f3e6c004d40 2024-05-20T18:01:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.549+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8014c840 con 0x7f3e6c004d40 2024-05-20T18:01:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.550+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e80075b00 con 0x7f3e6c004d40 2024-05-20T18:01:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.551+0000 7f3e7d7fa640 1 -- 172.21.15.6:0/687537181 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e70012040 con 0x7f3e6c004d40 2024-05-20T18:01:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.551+0000 7f3e7d7fa640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e6006be60 0x7f3e6006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.552+0000 7f3e7d7fa640 1 -- 172.21.15.6:0/687537181 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f3e7008b6f0 con 0x7f3e6c004d40 2024-05-20T18:01:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.552+0000 7f3e77fff640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e6006be60 0x7f3e6006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.552+0000 7f3e77fff640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e6006be60 0x7f3e6006e370 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3e80162310 tx=0x7f3e68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.556+0000 7f3e7d7fa640 1 -- 172.21.15.6:0/687537181 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3e8014e160 con 0x7f3e6c004d40 2024-05-20T18:01:35.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.777+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e801608a0 con 0x7f3e6c004d40 2024-05-20T18:01:35.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.778+0000 7f3e7d7fa640 1 -- 172.21.15.6:0/687537181 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5180 (secure 0 0 0) 0x7f3e70019030 con 0x7f3e6c004d40 2024-05-20T18:01:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:35.776 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:01:29.906318+0000","modified":"2024-05-20T18:01:32.936865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/524087551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":524087551},{"type":"v1","addr":"172.21.15.6:6835","nonce":524087551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-05-20T18:01:35.776 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 85 2024-05-20T18:01:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e6006be60 msgr2=0x7f3e6006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e6006be60 0x7f3e6006e370 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3e80162310 tx=0x7f3e68008040 comp rx=0 tx=0).stop 2024-05-20T18:01:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 msgr2=0x7f3e8014ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e8014ae90 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f3e700119d0 tx=0x7f3e70011e90 comp rx=0 tx=0).stop 2024-05-20T18:01:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 shutdown_connections 2024-05-20T18:01:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3e6006be60 0x7f3e6006e370 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3e8014d810 0x7f3e8014dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e8014d320 0x7f3e8014b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 --2- 172.21.15.6:0/687537181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e6c004d40 0x7f3e8014ae90 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 >> 172.21.15.6:0/687537181 conn(0x7f3e800d4bd0 msgr2=0x7f3e8015f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 shutdown_connections 2024-05-20T18:01:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:35.780+0000 7f3e862e9640 1 -- 172.21.15.6:0/687537181 wait complete. 2024-05-20T18:01:36.193 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T18:01:29.906318+0000', 'modified': '2024-05-20T18:01:32.936865+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8634': {'gid': 8634, 'name': 'c', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/524087551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 524087551}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 524087551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8634, 'qdb_cluster': [8634]} 2024-05-20T18:01:36.193 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T18:01:36.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-20T18:01:36.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.316+0000 7fe199b38640 1 Processor -- start 2024-05-20T18:01:36.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.316+0000 7fe199b38640 1 -- start start 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe199b38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe1940b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe199b38640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe1940b3e80 0x7fe19406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe199b38640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19406dd20 con 0x7fe19406d910 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe199b38640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe1940d0630 con 0x7fe1940b3e80 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe199b38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1940d39c0 con 0x7fe194162820 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe1937fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe1940b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe1937fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe1940b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:58594/0 (socket says 172.21.15.6:58594) 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe192ffd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe1940b3e80 0x7fe19406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.317+0000 7fe1937fe640 1 -- 172.21.15.6:0/4017033179 learned_addr learned my addr 172.21.15.6:0/4017033179 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.318+0000 7fe1927fc640 1 -- 172.21.15.6:0/4017033179 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 930665689 0 0) 0x7fe18c001490 con 0x7fe19406d910 2024-05-20T18:01:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.318+0000 7fe1927fc640 1 -- 172.21.15.6:0/4017033179 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe17c003520 con 0x7fe19406d910 2024-05-20T18:01:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.318+0000 7fe1937fe640 1 -- 172.21.15.6:0/4017033179 >> v2:172.21.15.171:3300/0 conn(0x7fe1940b3e80 msgr2=0x7fe19406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.318+0000 7fe1937fe640 1 --2- 172.21.15.6:0/4017033179 >> v2:172.21.15.171:3300/0 conn(0x7fe1940b3e80 0x7fe19406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.318+0000 7fe1937fe640 1 -- 172.21.15.6:0/4017033179 >> v1:172.21.15.171:6789/0 conn(0x7fe19406d910 legacy=0x7fe1940d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.318+0000 7fe1937fe640 1 -- 172.21.15.6:0/4017033179 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1940d3ca0 con 0x7fe194162820 2024-05-20T18:01:36.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.318+0000 7fe192ffd640 1 --2- 172.21.15.6:0/4017033179 >> v2:172.21.15.171:3300/0 conn(0x7fe1940b3e80 0x7fe19406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.319+0000 7fe1937fe640 1 --2- 172.21.15.6:0/4017033179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe1940b3940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe184009870 tx=0x7fe18402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4509a0e4e21ebcf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.319+0000 7fe1927fc640 1 -- 172.21.15.6:0/4017033179 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184037070 con 0x7fe194162820 2024-05-20T18:01:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.319+0000 7fe1927fc640 1 -- 172.21.15.6:0/4017033179 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe184032440 con 0x7fe194162820 2024-05-20T18:01:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.319+0000 7fe1927fc640 1 -- 172.21.15.6:0/4017033179 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184032810 con 0x7fe194162820 2024-05-20T18:01:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.320+0000 7fe199b38640 1 -- 172.21.15.6:0/4017033179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 msgr2=0x7fe1940b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.320+0000 7fe199b38640 1 --2- 172.21.15.6:0/4017033179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe1940b3940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe184009870 tx=0x7fe18402a250 comp rx=0 tx=0).stop 2024-05-20T18:01:36.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.320+0000 7fe199b38640 1 -- 172.21.15.6:0/4017033179 shutdown_connections 2024-05-20T18:01:36.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.320+0000 7fe199b38640 1 --2- 172.21.15.6:0/4017033179 >> v2:172.21.15.171:3300/0 conn(0x7fe1940b3e80 0x7fe19406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.320+0000 7fe199b38640 1 --2- 172.21.15.6:0/4017033179 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe1940b3940 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.320+0000 7fe199b38640 1 -- 172.21.15.6:0/4017033179 >> 172.21.15.6:0/4017033179 conn(0x7fe1940d4bd0 msgr2=0x7fe1940d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:36.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.320+0000 7fe199b38640 1 -- 172.21.15.6:0/4017033179 shutdown_connections 2024-05-20T18:01:36.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.320+0000 7fe199b38640 1 -- 172.21.15.6:0/4017033179 wait complete. 2024-05-20T18:01:36.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.322+0000 7fe199b38640 1 Processor -- start 2024-05-20T18:01:36.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.322+0000 7fe199b38640 1 -- start start 2024-05-20T18:01:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe199b38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe19406d910 0x7fe1940ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe199b38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1940b3e80 0x7fe19415f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe199b38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe19415fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe199b38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe1940d0300 con 0x7fe1940b3e80 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe199b38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1940d4260 con 0x7fe19406d910 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe199b38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe1940b91a0 con 0x7fe194162820 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe192ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1940b3e80 0x7fe19415f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe192ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1940b3e80 0x7fe19415f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48128/0 (socket says 172.21.15.6:48128) 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe192ffd640 1 -- 172.21.15.6:0/948309469 learned_addr learned my addr 172.21.15.6:0/948309469 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe1937fe640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe19406d910 0x7fe1940ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.323+0000 7fe193fff640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe19415fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe192ffd640 1 -- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 msgr2=0x7fe19415fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe192ffd640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe19415fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe192ffd640 1 -- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe19406d910 msgr2=0x7fe1940ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe192ffd640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe19406d910 0x7fe1940ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe192ffd640 1 -- 172.21.15.6:0/948309469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1941e9f30 con 0x7fe1940b3e80 2024-05-20T18:01:36.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe192ffd640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1940b3e80 0x7fe19415f550 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe18800e930 tx=0x7fe18800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe17bfff640 1 -- 172.21.15.6:0/948309469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188017070 con 0x7fe1940b3e80 2024-05-20T18:01:36.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe17bfff640 1 -- 172.21.15.6:0/948309469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18800ca00 con 0x7fe1940b3e80 2024-05-20T18:01:36.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe17bfff640 1 -- 172.21.15.6:0/948309469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18800cdf0 con 0x7fe1940b3e80 2024-05-20T18:01:36.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe199b38640 1 -- 172.21.15.6:0/948309469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1941ea210 con 0x7fe1940b3e80 2024-05-20T18:01:36.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.324+0000 7fe199b38640 1 -- 172.21.15.6:0/948309469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1941ea7d0 con 0x7fe1940b3e80 2024-05-20T18:01:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.326+0000 7fe17bfff640 1 -- 172.21.15.6:0/948309469 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe18801a070 con 0x7fe1940b3e80 2024-05-20T18:01:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.326+0000 7fe17bfff640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe18006be30 0x7fe18006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.327+0000 7fe17bfff640 1 -- 172.21.15.6:0/948309469 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fe18808ab10 con 0x7fe1940b3e80 2024-05-20T18:01:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.327+0000 7fe1937fe640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe18006be30 0x7fe18006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.327+0000 7fe1a09e7740 1 Processor -- start 2024-05-20T18:01:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.327+0000 7fe1937fe640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe18006be30 0x7fe18006e340 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe184034000 tx=0x7fe18402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.327+0000 7fe1a09e7740 1 -- start start 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 0x55c37abbd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37abba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37ab93360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c37aaf64d0 con 0x55c37a7d1590 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c37aa9e3e0 con 0x55c37a7f2270 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55c37aaf2490 con 0x55c37a7c93b0 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37ab93360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37ab93360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48132/0 (socket says 172.21.15.6:48132) 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 -- 172.21.15.6:0/2527105270 learned_addr learned my addr 172.21.15.6:0/2527105270 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe1937fe640 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 0x55c37abbd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe192ffd640 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37abba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 -- 172.21.15.6:0/2527105270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 msgr2=0x55c37abba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37abba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 -- 172.21.15.6:0/2527105270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 msgr2=0x55c37abbd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 0x55c37abbd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 -- 172.21.15.6:0/2527105270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37a80a2d0 con 0x55c37a7d1590 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.329+0000 7fe193fff640 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37ab93360 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fe18c001f50 tx=0x7fe18c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1c95674cbaa70c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.330+0000 7fe1797fa640 1 -- 172.21.15.6:0/2527105270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c00fdf0 con 0x55c37a7d1590 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.330+0000 7fe1797fa640 1 -- 172.21.15.6:0/2527105270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c018070 con 0x55c37a7d1590 2024-05-20T18:01:36.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.330+0000 7fe1797fa640 1 -- 172.21.15.6:0/2527105270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c003bb0 con 0x55c37a7d1590 2024-05-20T18:01:36.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.330+0000 7fe1a09e7740 1 -- 172.21.15.6:0/2527105270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 msgr2=0x55c37ab93360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.330+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37ab93360 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fe18c001f50 tx=0x7fe18c001250 comp rx=0 tx=0).stop 2024-05-20T18:01:36.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.330+0000 7fe1a09e7740 1 -- 172.21.15.6:0/2527105270 shutdown_connections 2024-05-20T18:01:36.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.331+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37ab93360 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.331+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37abba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.331+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/2527105270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 0x55c37abbd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.331+0000 7fe1a09e7740 1 -- 172.21.15.6:0/2527105270 >> 172.21.15.6:0/2527105270 conn(0x55c37a7e63c0 msgr2=0x55c37ab92af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:36.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.331+0000 7fe1a09e7740 1 -- 172.21.15.6:0/2527105270 shutdown_connections 2024-05-20T18:01:36.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.331+0000 7fe1a09e7740 1 -- 172.21.15.6:0/2527105270 wait complete. 2024-05-20T18:01:36.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.331+0000 7fe1a09e7740 1 -- start start 2024-05-20T18:01:36.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.332+0000 7fe1a09e7740 1 Processor -- start 2024-05-20T18:01:36.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37aba2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 0x55c37abb4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7f2270 0x55c37abb48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c37aab18e0 con 0x55c37a7f2270 2024-05-20T18:01:36.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c37abbee80 con 0x55c37a7d1590 2024-05-20T18:01:36.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55c37abba2c0 con 0x55c37a7c93b0 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe1a09e7740 10 client.0 _ll_register_callbacks cb 0x55c37aa7e9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe193fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7f2270 0x55c37abb48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe193fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7f2270 0x55c37abb48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48134/0 (socket says 172.21.15.6:48134) 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe193fff640 1 -- 172.21.15.6:0/1485742082 learned_addr learned my addr 172.21.15.6:0/1485742082 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe192ffd640 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 0x55c37abb4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37aba2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe193fff640 1 -- 172.21.15.6:0/1485742082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 msgr2=0x55c37aba2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe193fff640 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37aba2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe193fff640 1 -- 172.21.15.6:0/1485742082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 msgr2=0x55c37abb4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe193fff640 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 0x55c37abb4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.333+0000 7fe193fff640 1 -- 172.21.15.6:0/1485742082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37a8d46b0 con 0x55c37a7f2270 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe193fff640 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7f2270 0x55c37abb48b0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe18c015040 tx=0x7fe18c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8599aff2c378482e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1727fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1727fc640 1 -- 172.21.15.6:0/1485742082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0052d0 con 0x55c37a7f2270 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1727fc640 1 -- 172.21.15.6:0/1485742082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fe18c005470 con 0x55c37a7f2270 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1485742082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe18c018070 con 0x55c37a7f2270 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1727fc640 1 -- 172.21.15.6:0/1485742082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fe18c030050 con 0x55c37a7f2270 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 10 client.8775 fetch_fsmap learned FSMap version 85 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1485742082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55c37abbebc0 con 0x55c37a7f2270 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1727fc640 1 -- 172.21.15.6:0/1485742082 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c018070 con 0x55c37a7f2270 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1727fc640 1 -- 172.21.15.6:0/1485742082 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 85) ==== 3494+0+0 (secure 0 0 0) 0x7fe18c033020 con 0x55c37a7f2270 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 10 client.8775 fetch_fsmap finished waiting for FSMap version 85 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 10 client.8775 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 20 client.8775 populate_metadata read hostname 'smithi006' 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] conn(0x55c37a7b0e40 0x55c37abf50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 4 client.8775 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1485742082 --> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c37ab03c00 con 0x55c37a7b0e40 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.334+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] conn(0x55c37a7b0e40 0x55c37abf50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.335+0000 7fe1727fc640 10 client.8775 ms_handle_connect on v2:172.21.15.6:6833/524087551 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.335+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] conn(0x55c37a7b0e40 0x55c37abf50b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e6a6b5c5fb41126 server_cookie=38a86d0b907d253d in_seq=0 out_seq=0 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.335+0000 7fe1727fc640 1 -- 172.21.15.6:0/1485742082 <== mds.0 v2:172.21.15.6:6833/524087551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c37ab03c00 con 0x55c37a7b0e40 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.335+0000 7fe1727fc640 10 client.8775 handle_command_reply: tid=0 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.335+0000 7fe1a09e7740 1 client.8775 shutdown 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1485742082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7f2270 msgr2=0x55c37abb48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7f2270 0x55c37abb48b0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe18c015040 tx=0x7fe18c007f90 comp rx=0 tx=0).stop 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1485742082 shutdown_connections 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] conn(0x55c37a7b0e40 0x55c37abf50b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7f2270 0x55c37abb48b0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 0x55c37abb4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1727fc640 0 client.8775 ms_handle_reset on v2:172.21.15.6:6833/524087551 2024-05-20T18:01:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1485742082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37aba2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1485742082 >> 172.21.15.6:0/1485742082 conn(0x55c37a7e63c0 msgr2=0x55c37ab91e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1485742082 shutdown_connections 2024-05-20T18:01:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1485742082 wait complete. 2024-05-20T18:01:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.336+0000 7fe1a09e7740 20 client.8775 trim_cache size 0 max 16384 2024-05-20T18:01:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.355+0000 7fe1a09e7740 1 Processor -- start 2024-05-20T18:01:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.355+0000 7fe1a09e7740 1 -- start start 2024-05-20T18:01:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7c93b0 0x55c37abb9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 0x55c37abbd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7f2270 0x55c37abd3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe194201440 con 0x55c37a7c93b0 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe194200800 con 0x55c37a7d1590 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe194200e20 con 0x55c37a7f2270 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7c93b0 0x55c37abb9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7c93b0 0x55c37abb9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48142/0 (socket says 172.21.15.6:48142) 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.356+0000 7fe1937fe640 1 -- 172.21.15.6:0/1006332573 learned_addr learned my addr 172.21.15.6:0/1006332573 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe1937fe640 1 -- 172.21.15.6:0/1006332573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7f2270 msgr2=0x55c37abd3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1006332573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7f2270 0x55c37abd3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe1937fe640 1 -- 172.21.15.6:0/1006332573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 msgr2=0x55c37abbd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1006332573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 0x55c37abbd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe1937fe640 1 -- 172.21.15.6:0/1006332573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37abd6e30 con 0x55c37a7c93b0 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1006332573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7c93b0 0x55c37abb9560 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe18402a840 tx=0x7fe18402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaec43d64f04da5f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe178ff9640 1 -- 172.21.15.6:0/1006332573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184037040 con 0x55c37a7c93b0 2024-05-20T18:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe178ff9640 1 -- 172.21.15.6:0/1006332573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18404f020 con 0x55c37a7c93b0 2024-05-20T18:01:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.357+0000 7fe178ff9640 1 -- 172.21.15.6:0/1006332573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184050630 con 0x55c37a7c93b0 2024-05-20T18:01:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1006332573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7c93b0 msgr2=0x55c37abb9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1006332573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7c93b0 0x55c37abb9560 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe18402a840 tx=0x7fe18402c000 comp rx=0 tx=0).stop 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1006332573 shutdown_connections 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1006332573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7f2270 0x55c37abd3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1006332573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7d1590 0x55c37abbd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1006332573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7c93b0 0x55c37abb9560 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1006332573 >> 172.21.15.6:0/1006332573 conn(0x55c37a7e63c0 msgr2=0x55c37abd60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1006332573 shutdown_connections 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.358+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1006332573 wait complete. 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.359+0000 7fe1a09e7740 1 -- start start 2024-05-20T18:01:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.359+0000 7fe1a09e7740 1 Processor -- start 2024-05-20T18:01:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37abd3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37abf14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe1a09e7740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 0x55c37aba5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55c37abbd100 con 0x55c37a7d1590 2024-05-20T18:01:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c37abba7f0 con 0x55c37a7f2270 2024-05-20T18:01:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe1a09e7740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55c37abd7a50 con 0x55c37a7c93b0 2024-05-20T18:01:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe1a09e7740 10 client.0 _ll_register_callbacks cb 0x7fe17c0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:01:36.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe192ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37abf14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe192ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37abf14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48146/0 (socket says 172.21.15.6:48146) 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.360+0000 7fe192ffd640 1 -- 172.21.15.6:0/1027672477 learned_addr learned my addr 172.21.15.6:0/1027672477 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe192ffd640 1 -- 172.21.15.6:0/1027672477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 msgr2=0x55c37abd3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37abd3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe192ffd640 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37abd3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe192ffd640 1 -- 172.21.15.6:0/1027672477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 msgr2=0x55c37aba5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe193fff640 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 0x55c37aba5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe192ffd640 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 0x55c37aba5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe192ffd640 1 -- 172.21.15.6:0/1027672477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37abb8d60 con 0x55c37a7d1590 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe192ffd640 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37abf14c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe188058b40 tx=0x7fe188058810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451f4b917eb89a0f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1727fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:01:36.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1727fc640 1 -- 172.21.15.6:0/1027672477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188021040 con 0x55c37a7d1590 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1727fc640 1 -- 172.21.15.6:0/1027672477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fe188056eb0 con 0x55c37a7d1590 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1027672477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe18404f020 con 0x55c37a7d1590 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1727fc640 1 -- 172.21.15.6:0/1027672477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fe18807c050 con 0x55c37a7d1590 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1a09e7740 10 client.8781 fetch_fsmap learned FSMap version 85 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1027672477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55c37abd4100 con 0x55c37a7d1590 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1727fc640 1 -- 172.21.15.6:0/1027672477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18404f020 con 0x55c37a7d1590 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1727fc640 1 -- 172.21.15.6:0/1027672477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 85) ==== 3494+0+0 (secure 0 0 0) 0x7fe18807f020 con 0x55c37a7d1590 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.361+0000 7fe1a09e7740 10 client.8781 fetch_fsmap finished waiting for FSMap version 85 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1a09e7740 10 client.8781 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1a09e7740 20 client.8781 populate_metadata read hostname 'smithi006' 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] conn(0x55c37abf5a10 0x55c37abf5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1a09e7740 4 client.8781 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1027672477 --> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] -- command(tid 0: {"prefix": "status"}) -- 0x55c37aafdf50 con 0x55c37abf5a10 2024-05-20T18:01:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] conn(0x55c37abf5a10 0x55c37abf5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1727fc640 10 client.8781 ms_handle_connect on v2:172.21.15.6:6833/524087551 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1937fe640 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] conn(0x55c37abf5a10 0x55c37abf5e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1d873418b8e88a3 server_cookie=e981cc6feb262a08 in_seq=0 out_seq=0 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1727fc640 1 -- 172.21.15.6:0/1027672477 <== mds.0 v2:172.21.15.6:6833/524087551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55c37aafdf50 con 0x55c37abf5a10 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1727fc640 10 client.8781 handle_command_reply: tid=0 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.362+0000 7fe1a09e7740 1 client.8781 shutdown 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1027672477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 msgr2=0x55c37abf14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37abf14c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe188058b40 tx=0x7fe188058810 comp rx=0 tx=0).stop 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1027672477 shutdown_connections 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.6:6833/524087551,v1:172.21.15.6:6835/524087551] conn(0x55c37abf5a10 0x55c37abf5e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c37a7f2270 0x55c37aba5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c37a7d1590 0x55c37abf14c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1727fc640 0 client.8781 ms_handle_reset on v2:172.21.15.6:6833/524087551 2024-05-20T18:01:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 --2- 172.21.15.6:0/1027672477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55c37a7c93b0 0x55c37abd3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1027672477 >> 172.21.15.6:0/1027672477 conn(0x55c37a7e63c0 msgr2=0x55c37ab94360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1027672477 shutdown_connections 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 1 -- 172.21.15.6:0/1027672477 wait complete. 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe1a09e7740 20 client.8781 trim_cache size 0 max 16384 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8634, 2024-05-20T18:01:36.366 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T18:01:36.367 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T18:01:36.367 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T18:01:36.367 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.8319807279999996, 2024-05-20T18:01:36.367 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 85, 2024-05-20T18:01:36.367 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 125, 2024-05-20T18:01:36.367 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 125, 2024-05-20T18:01:36.367 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 11.806514694000001 2024-05-20T18:01:36.367 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 -- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe18006be30 msgr2=0x7fe18006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe18006be30 0x7fe18006e340 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe184034000 tx=0x7fe18402e000 comp rx=0 tx=0).stop 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 -- 172.21.15.6:0/948309469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1940b3e80 msgr2=0x7fe19415f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1940b3e80 0x7fe19415f550 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe18800e930 tx=0x7fe18800edf0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 -- 172.21.15.6:0/948309469 shutdown_connections 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe18006be30 0x7fe18006e340 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe194162820 0x7fe19415fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1940b3e80 0x7fe19415f550 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 --2- 172.21.15.6:0/948309469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe19406d910 0x7fe1940ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 -- 172.21.15.6:0/948309469 >> 172.21.15.6:0/948309469 conn(0x7fe1940d4bd0 msgr2=0x7fe1940b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.363+0000 7fe199b38640 1 -- 172.21.15.6:0/948309469 shutdown_connections 2024-05-20T18:01:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.364+0000 7fe199b38640 1 -- 172.21.15.6:0/948309469 wait complete. 2024-05-20T18:01:36.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:01:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.490+0000 7f882586c640 1 Processor -- start 2024-05-20T18:01:36.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.490+0000 7f882586c640 1 -- start start 2024-05-20T18:01:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.491+0000 7f882586c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8820163a10 0x7f88200d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.491+0000 7f882586c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88200b4010 0x7f88200cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.491+0000 7f882586c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88200d0370 con 0x7f88200d14b0 2024-05-20T18:01:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.491+0000 7f882586c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f88200d3ca0 con 0x7f88200b4010 2024-05-20T18:01:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.491+0000 7f882586c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f88200d0650 con 0x7f8820163a10 2024-05-20T18:01:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.491+0000 7f881e7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88200b4010 0x7f88200cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.491+0000 7f881f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f88200d14b0 0x7f88200d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35896/0 (socket says 172.21.15.6:35896) 2024-05-20T18:01:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.491+0000 7f881f7fe640 1 -- 172.21.15.6:0/2541319098 learned_addr learned my addr 172.21.15.6:0/2541319098 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.492+0000 7f881effd640 1 --2- 172.21.15.6:0/2541319098 >> v2:172.21.15.171:3300/0 conn(0x7f8820163a10 0x7f88200d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.492+0000 7f881e7fc640 1 -- 172.21.15.6:0/2541319098 >> v2:172.21.15.171:3300/0 conn(0x7f8820163a10 msgr2=0x7f88200d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.492+0000 7f881e7fc640 1 --2- 172.21.15.6:0/2541319098 >> v2:172.21.15.171:3300/0 conn(0x7f8820163a10 0x7f88200d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.492+0000 7f881e7fc640 1 -- 172.21.15.6:0/2541319098 >> v1:172.21.15.6:6789/0 conn(0x7f88200d14b0 legacy=0x7f88200d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.492+0000 7f881dffb640 1 -- 172.21.15.6:0/2541319098 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402155380 0 0) 0x7f88200d0370 con 0x7f88200d14b0 2024-05-20T18:01:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.492+0000 7f881e7fc640 1 -- 172.21.15.6:0/2541319098 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88200d3650 con 0x7f88200b4010 2024-05-20T18:01:36.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.492+0000 7f881effd640 1 --2- 172.21.15.6:0/2541319098 >> v2:172.21.15.171:3300/0 conn(0x7f8820163a10 0x7f88200d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f881e7fc640 1 --2- 172.21.15.6:0/2541319098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200cfb00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f88200cf1c0 tx=0x7f881402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53a28ab45a29d39 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f881dffb640 1 -- 172.21.15.6:0/2541319098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814037070 con 0x7f88200b4010 2024-05-20T18:01:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f881dffb640 1 -- 172.21.15.6:0/2541319098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8814032440 con 0x7f88200b4010 2024-05-20T18:01:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f881dffb640 1 -- 172.21.15.6:0/2541319098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814032810 con 0x7f88200b4010 2024-05-20T18:01:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f882586c640 1 -- 172.21.15.6:0/2541319098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 msgr2=0x7f88200cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f882586c640 1 --2- 172.21.15.6:0/2541319098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200cfb00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f88200cf1c0 tx=0x7f881402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f882586c640 1 -- 172.21.15.6:0/2541319098 shutdown_connections 2024-05-20T18:01:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f882586c640 1 --2- 172.21.15.6:0/2541319098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200cfb00 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f882586c640 1 --2- 172.21.15.6:0/2541319098 >> v2:172.21.15.171:3300/0 conn(0x7f8820163a10 0x7f88200d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.493+0000 7f882586c640 1 -- 172.21.15.6:0/2541319098 >> 172.21.15.6:0/2541319098 conn(0x7f882006d240 msgr2=0x7f882006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.494+0000 7f882586c640 1 -- 172.21.15.6:0/2541319098 shutdown_connections 2024-05-20T18:01:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.494+0000 7f882586c640 1 -- 172.21.15.6:0/2541319098 wait complete. 2024-05-20T18:01:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.495+0000 7f882586c640 1 Processor -- start 2024-05-20T18:01:36.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.495+0000 7f882586c640 1 -- start start 2024-05-20T18:01:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f882586c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f882586c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200d14b0 0x7f88200b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f882586c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8820163a10 0x7f882014ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f882586c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f88200b8210 con 0x7f88200b4010 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f882586c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f88200d0040 con 0x7f8820163a10 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f882586c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f88200b8390 con 0x7f88200d14b0 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48170/0 (socket says 172.21.15.6:48170) 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 -- 172.21.15.6:0/3210219788 learned_addr learned my addr 172.21.15.6:0/3210219788 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881e7fc640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200d14b0 0x7f88200b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881f7fe640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8820163a10 0x7f882014ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 -- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200d14b0 msgr2=0x7f88200b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200d14b0 0x7f88200b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 -- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8820163a10 msgr2=0x7f882014ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8820163a10 0x7f882014ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 -- 172.21.15.6:0/3210219788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882015d0a0 con 0x7f88200b4010 2024-05-20T18:01:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.497+0000 7f881effd640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200ac990 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f881000d800 tx=0x7f881000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.498+0000 7f8807fff640 1 -- 172.21.15.6:0/3210219788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88100096a0 con 0x7f88200b4010 2024-05-20T18:01:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.498+0000 7f8807fff640 1 -- 172.21.15.6:0/3210219788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8810019070 con 0x7f88200b4010 2024-05-20T18:01:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.498+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88200ab8f0 con 0x7f88200b4010 2024-05-20T18:01:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.498+0000 7f8807fff640 1 -- 172.21.15.6:0/3210219788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810009a80 con 0x7f88200b4010 2024-05-20T18:01:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.498+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88200abeb0 con 0x7f88200b4010 2024-05-20T18:01:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.499+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8820075b00 con 0x7f88200b4010 2024-05-20T18:01:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.499+0000 7f8807fff640 1 -- 172.21.15.6:0/3210219788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8810009c20 con 0x7f88200b4010 2024-05-20T18:01:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.500+0000 7f8807fff640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.500+0000 7f8807fff640 1 -- 172.21.15.6:0/3210219788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f881008b360 con 0x7f88200b4010 2024-05-20T18:01:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.500+0000 7f881e7fc640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.501+0000 7f881e7fc640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8814034000 tx=0x7f881402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.505+0000 7f8807fff640 1 -- 172.21.15.6:0/3210219788 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f88100594a0 con 0x7f88200b4010 2024-05-20T18:01:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.727+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f88200d3050 con 0x7f88200b4010 2024-05-20T18:01:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.727+0000 7f8807fff640 1 -- 172.21.15.6:0/3210219788 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) ==== 53+0+73 (secure 0 0 0) 0x7f881005d7a0 con 0x7f88200b4010 2024-05-20T18:01:36.726 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 msgr2=0x7f880c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8814034000 tx=0x7f881402e000 comp rx=0 tx=0).stop 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 msgr2=0x7f88200ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200ac990 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f881000d800 tx=0x7f881000dcc0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 shutdown_connections 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f880c06be30 0x7f880c06e340 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8820163a10 0x7f882014ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88200d14b0 0x7f88200b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 --2- 172.21.15.6:0/3210219788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88200b4010 0x7f88200ac990 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.729+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 >> 172.21.15.6:0/3210219788 conn(0x7f882006d240 msgr2=0x7f882015fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.730+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 shutdown_connections 2024-05-20T18:01:36.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36.730+0000 7f882586c640 1 -- 172.21.15.6:0/3210219788 wait complete. 2024-05-20T18:01:36.739 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:01:36.739 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:01:36.739 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T18:01:36.739 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T18:01:36.739 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T18:01:36.740 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:01:36.740 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:01:36.740 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:01:36.740 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:01:36.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:36.740 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T18:01:36.756 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T18:01:36.757 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42217sec preferred_lft 42217sec 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:36.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:36.759 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:01:36.821 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T18:01:36.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:36.823 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T18:01:36.880 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T18:01:36.880 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:01:36.880 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T18:01:36.880 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T18:01:36.881 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:01:36.881 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:01:36.881 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T18:01:36.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T18:01:36.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T18:01:36.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T18:01:36.881 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T18:01:36.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:01:37.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:01:37.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:37.011 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T18:01:37.027 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T18:01:37.027 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T18:01:37.028 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:01:37.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:37.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T18:01:37.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:01:37.094 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T18:01:37.150 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:01:37.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:01:37.150 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:01:37.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:01:37.192 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:01:37.206 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T18:01:37.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:37.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:01:37.300 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:01:37.300 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:01:37.309 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:01:37.309 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:01:37.309 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:01:37.309 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:01:37.309 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:01:37.310 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T18:01:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:01:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:01:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:01:37.310 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:01:37.312 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:01:37.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:37.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:01:37.379 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:01:37.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:01:37.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:01:37.485 INFO:teuthology.orchestra.run.smithi006.stdout:client8793 2024-05-20T18:01:37.485 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:37.485 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:37.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:01:37.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.660+0000 7f9f3fd4c640 1 Processor -- start 2024-05-20T18:01:37.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.660+0000 7f9f3fd4c640 1 -- start start 2024-05-20T18:01:37.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3fd4c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f380cd710 0x7f9f38162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:37.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3fd4c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9f3806d6b0 0x7f9f3815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:37.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3fd4c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3806c8c0 con 0x7f9f380cf3d0 2024-05-20T18:01:37.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3fd4c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9f380d0ba0 con 0x7f9f380cd710 2024-05-20T18:01:37.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3fd4c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9f3806dac0 con 0x7f9f3806d6b0 2024-05-20T18:01:37.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3dae8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f380cd710 0x7f9f38162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:37.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3e2e9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9f380cf3d0 0x7f9f380cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35904/0 (socket says 172.21.15.6:35904) 2024-05-20T18:01:37.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3e2e9640 1 -- 172.21.15.6:0/1630625776 learned_addr learned my addr 172.21.15.6:0/1630625776 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3d2e7640 1 --2- 172.21.15.6:0/1630625776 >> v2:172.21.15.171:3300/0 conn(0x7f9f3806d6b0 0x7f9f3815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3dae8640 1 -- 172.21.15.6:0/1630625776 >> v2:172.21.15.171:3300/0 conn(0x7f9f3806d6b0 msgr2=0x7f9f3815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3dae8640 1 --2- 172.21.15.6:0/1630625776 >> v2:172.21.15.171:3300/0 conn(0x7f9f3806d6b0 0x7f9f3815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3dae8640 1 -- 172.21.15.6:0/1630625776 >> v1:172.21.15.6:6789/0 conn(0x7f9f380cf3d0 legacy=0x7f9f380cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3dae8640 1 -- 172.21.15.6:0/1630625776 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f381633e0 con 0x7f9f380cd710 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3cae6640 1 -- 172.21.15.6:0/1630625776 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063634036 0 0) 0x7f9f3806c8c0 con 0x7f9f380cf3d0 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.662+0000 7f9f3d2e7640 1 --2- 172.21.15.6:0/1630625776 >> v2:172.21.15.171:3300/0 conn(0x7f9f3806d6b0 0x7f9f3815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.663+0000 7f9f3dae8640 1 --2- 172.21.15.6:0/1630625776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f380cd710 0x7f9f38162e00 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f9f38068210 tx=0x7f9f3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20b08a49c9f70de server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.663+0000 7f9f3cae6640 1 -- 172.21.15.6:0/1630625776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34037070 con 0x7f9f380cd710 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.663+0000 7f9f3cae6640 1 -- 172.21.15.6:0/1630625776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f34032440 con 0x7f9f380cd710 2024-05-20T18:01:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.663+0000 7f9f3cae6640 1 -- 172.21.15.6:0/1630625776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34032810 con 0x7f9f380cd710 2024-05-20T18:01:37.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.664+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/1630625776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f380cd710 msgr2=0x7f9f38162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:37.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.664+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/1630625776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f380cd710 0x7f9f38162e00 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f9f38068210 tx=0x7f9f3402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.664+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/1630625776 shutdown_connections 2024-05-20T18:01:37.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.664+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/1630625776 >> v2:172.21.15.171:3300/0 conn(0x7f9f3806d6b0 0x7f9f3815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.664+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/1630625776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f380cd710 0x7f9f38162e00 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.664+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/1630625776 >> 172.21.15.6:0/1630625776 conn(0x7f9f380b44d0 msgr2=0x7f9f380b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:37.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.664+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/1630625776 shutdown_connections 2024-05-20T18:01:37.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.664+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/1630625776 wait complete. 2024-05-20T18:01:37.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.666+0000 7f9f3fd4c640 1 Processor -- start 2024-05-20T18:01:37.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.666+0000 7f9f3fd4c640 1 -- start start 2024-05-20T18:01:37.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3fd4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3806d6b0 0x7f9f38155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:37.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3fd4c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f380cd710 0x7f9f38160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:37.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3fd4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f380cf3d0 0x7f9f381607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:37.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3fd4c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f38163c80 con 0x7f9f3806d6b0 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3fd4c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f381639a0 con 0x7f9f380cd710 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3fd4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f380d1030 con 0x7f9f380cf3d0 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3dae8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3806d6b0 0x7f9f38155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3dae8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3806d6b0 0x7f9f38155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48178/0 (socket says 172.21.15.6:48178) 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3dae8640 1 -- 172.21.15.6:0/2787332547 learned_addr learned my addr 172.21.15.6:0/2787332547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3d2e7640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f380cd710 0x7f9f38160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3e2e9640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f380cf3d0 0x7f9f381607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3dae8640 1 -- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f380cf3d0 msgr2=0x7f9f381607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:37.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3dae8640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f380cf3d0 0x7f9f381607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3dae8640 1 -- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f380cd710 msgr2=0x7f9f38160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3dae8640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f380cd710 0x7f9f38160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.667+0000 7f9f3dae8640 1 -- 172.21.15.6:0/2787332547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f38161050 con 0x7f9f3806d6b0 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.668+0000 7f9f3dae8640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3806d6b0 0x7f9f38155080 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f9f34000c00 tx=0x7f9f340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.668+0000 7f9f2e7fc640 1 -- 172.21.15.6:0/2787332547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34037040 con 0x7f9f3806d6b0 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.668+0000 7f9f2e7fc640 1 -- 172.21.15.6:0/2787332547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f34042070 con 0x7f9f3806d6b0 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.668+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f381f69c0 con 0x7f9f3806d6b0 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.668+0000 7f9f2e7fc640 1 -- 172.21.15.6:0/2787332547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34030a50 con 0x7f9f3806d6b0 2024-05-20T18:01:37.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.668+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f381f8520 con 0x7f9f3806d6b0 2024-05-20T18:01:37.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.669+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f38075b00 con 0x7f9f3806d6b0 2024-05-20T18:01:37.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.670+0000 7f9f2e7fc640 1 -- 172.21.15.6:0/2787332547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f34030bf0 con 0x7f9f3806d6b0 2024-05-20T18:01:37.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.670+0000 7f9f2e7fc640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f1c06be30 0x7f9f1c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:37.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.670+0000 7f9f2e7fc640 1 -- 172.21.15.6:0/2787332547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f9f340aba40 con 0x7f9f3806d6b0 2024-05-20T18:01:37.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.670+0000 7f9f3d2e7640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f1c06be30 0x7f9f1c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:37.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.671+0000 7f9f3d2e7640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f1c06be30 0x7f9f1c06e340 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9f380cc770 tx=0x7f9f28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:37.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.675+0000 7f9f2e7fc640 1 -- 172.21.15.6:0/2787332547 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f3407a2f0 con 0x7f9f3806d6b0 2024-05-20T18:01:37.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.896+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9f380b8940 con 0x7f9f3806d6b0 2024-05-20T18:01:37.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.897+0000 7f9f2e7fc640 1 -- 172.21.15.6:0/2787332547 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) ==== 53+0+73 (secure 0 0 0) 0x7f9f340abe20 con 0x7f9f3806d6b0 2024-05-20T18:01:37.895 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:01:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f1c06be30 msgr2=0x7f9f1c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f1c06be30 0x7f9f1c06e340 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9f380cc770 tx=0x7f9f28008040 comp rx=0 tx=0).stop 2024-05-20T18:01:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3806d6b0 msgr2=0x7f9f38155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3806d6b0 0x7f9f38155080 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f9f34000c00 tx=0x7f9f340046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 shutdown_connections 2024-05-20T18:01:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f1c06be30 0x7f9f1c06e340 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f380cf3d0 0x7f9f381607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f380cd710 0x7f9f38160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 --2- 172.21.15.6:0/2787332547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3806d6b0 0x7f9f38155080 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 >> 172.21.15.6:0/2787332547 conn(0x7f9f380b44d0 msgr2=0x7f9f380b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 shutdown_connections 2024-05-20T18:01:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:37.899+0000 7f9f3fd4c640 1 -- 172.21.15.6:0/2787332547 wait complete. 2024-05-20T18:01:37.908 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:01:37.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:01:37.909 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T18:01:37.909 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T18:01:37.909 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T18:01:37.909 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:01:37.909 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:01:37.909 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:01:37.909 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:01:37.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:37.910 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T18:01:37.930 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:01:37.930 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:01:37.930 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:01:37.930 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:37.930 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T18:01:37.930 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:37.930 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:01:37.930 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42227sec preferred_lft 42227sec 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T18:01:37.931 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T18:01:37.932 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:01:37.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:37.933 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:01:37.998 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T18:01:38.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:38.000 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T18:01:38.059 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T18:01:38.059 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:01:38.060 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T18:01:38.060 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T18:01:38.060 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:01:38.060 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:01:38.060 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T18:01:38.060 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T18:01:38.060 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T18:01:38.060 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T18:01:38.060 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T18:01:38.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:01:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:01:38.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:01:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:01:38.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:38.196 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T18:01:38.213 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T18:01:38.213 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T18:01:38.213 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:01:38.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:38.213 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T18:01:38.279 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:01:38.279 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T18:01:38.334 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:01:38.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:01:38.335 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:01:38.390 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T18:01:38.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:38.391 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:01:38.485 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:01:38.485 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:01:38.503 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:01:38.503 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:01:38.503 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:01:38.503 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:01:38.503 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:01:38.504 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T18:01:38.504 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:01:38.504 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:01:38.504 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:01:38.504 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:01:38.505 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:01:38.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:38.506 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:01:38.531 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:01:38.621 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:01:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:01:38.623 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:01:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:01:38.629 INFO:teuthology.orchestra.run.smithi171.stdout:client8805 2024-05-20T18:01:38.629 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:38.629 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:38.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-05-20T18:01:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.773+0000 7f8d3fc0d640 1 Processor -- start 2024-05-20T18:01:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.774+0000 7f8d3fc0d640 1 -- start start 2024-05-20T18:01:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3fc0d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cd680 0x7f8d3815f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3fc0d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d3806c6c0 0x7f8d3806cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3fc0d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3806d0f0 con 0x7f8d380cf3d0 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3fc0d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8d380cda90 con 0x7f8d3806c6c0 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3fc0d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3815f760 con 0x7f8d380cd680 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3d1a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8d3806c6c0 0x7f8d3806cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3e1aa640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8d380cf3d0 0x7f8d380cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51946/0 (socket says 172.21.15.6:51946) 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3e1aa640 1 -- 172.21.15.6:0/4087332029 learned_addr learned my addr 172.21.15.6:0/4087332029 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3d9a9640 1 --2- 172.21.15.6:0/4087332029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cd680 0x7f8d3815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3d1a8640 1 -- 172.21.15.6:0/4087332029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cd680 msgr2=0x7f8d3815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3d1a8640 1 --2- 172.21.15.6:0/4087332029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cd680 0x7f8d3815f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3d1a8640 1 -- 172.21.15.6:0/4087332029 >> v1:172.21.15.6:6789/0 conn(0x7f8d380cf3d0 legacy=0x7f8d380cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3d1a8640 1 -- 172.21.15.6:0/4087332029 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3806d3d0 con 0x7f8d3806c6c0 2024-05-20T18:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.775+0000 7f8d3c9a7640 1 -- 172.21.15.6:0/4087332029 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524489593 0 0) 0x7f8d3806d0f0 con 0x7f8d380cf3d0 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.776+0000 7f8d3d1a8640 1 --2- 172.21.15.6:0/4087332029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d3806cad0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8d280097a0 tx=0x7f8d2802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e9a43ba495ace4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.776+0000 7f8d3c9a7640 1 -- 172.21.15.6:0/4087332029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d28037070 con 0x7f8d3806c6c0 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.776+0000 7f8d3c9a7640 1 -- 172.21.15.6:0/4087332029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2802ae50 con 0x7f8d3806c6c0 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.776+0000 7f8d3c9a7640 1 -- 172.21.15.6:0/4087332029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d28032660 con 0x7f8d3806c6c0 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.777+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/4087332029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 msgr2=0x7f8d3806cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.777+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/4087332029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d3806cad0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8d280097a0 tx=0x7f8d2802a100 comp rx=0 tx=0).stop 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.777+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/4087332029 shutdown_connections 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.777+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/4087332029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d3806cad0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.777+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/4087332029 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cd680 0x7f8d3815f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.777+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/4087332029 >> 172.21.15.6:0/4087332029 conn(0x7f8d380b44d0 msgr2=0x7f8d380b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.777+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/4087332029 shutdown_connections 2024-05-20T18:01:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.777+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/4087332029 wait complete. 2024-05-20T18:01:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.779+0000 7f8d3fc0d640 1 Processor -- start 2024-05-20T18:01:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.779+0000 7f8d3fc0d640 1 -- start start 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.780+0000 7f8d3fc0d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d38160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.780+0000 7f8d3fc0d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d380cd680 0x7f8d38145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.780+0000 7f8d3fc0d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cf3d0 0x7f8d381462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.780+0000 7f8d3fc0d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3806d990 con 0x7f8d3806c6c0 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.780+0000 7f8d3fc0d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d380d0b40 con 0x7f8d380cd680 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.780+0000 7f8d3fc0d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d380d2460 con 0x7f8d380cf3d0 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.780+0000 7f8d3d9a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d38160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.780+0000 7f8d3d9a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d38160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39722/0 (socket says 172.21.15.6:39722) 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d9a9640 1 -- 172.21.15.6:0/1386804832 learned_addr learned my addr 172.21.15.6:0/1386804832 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d1a8640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d380cd680 0x7f8d38145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3e1aa640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cf3d0 0x7f8d381462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d9a9640 1 -- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cf3d0 msgr2=0x7f8d381462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d9a9640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cf3d0 0x7f8d381462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d9a9640 1 -- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d380cd680 msgr2=0x7f8d38145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d9a9640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d380cd680 0x7f8d38145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d9a9640 1 -- 172.21.15.6:0/1386804832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d38160990 con 0x7f8d3806c6c0 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d1a8640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d380cd680 0x7f8d38145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3e1aa640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cf3d0 0x7f8d381462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3d9a9640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d38160450 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e870 tx=0x7f8d3400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d2e7fc640 1 -- 172.21.15.6:0/1386804832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34017070 con 0x7f8d3806c6c0 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d2e7fc640 1 -- 172.21.15.6:0/1386804832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d3400c940 con 0x7f8d3806c6c0 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3815b4d0 con 0x7f8d3806c6c0 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d2e7fc640 1 -- 172.21.15.6:0/1386804832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400cd10 con 0x7f8d3806c6c0 2024-05-20T18:01:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.781+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3815ba90 con 0x7f8d3806c6c0 2024-05-20T18:01:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.782+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d38075b00 con 0x7f8d3806c6c0 2024-05-20T18:01:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.783+0000 7f8d2e7fc640 1 -- 172.21.15.6:0/1386804832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d3401a070 con 0x7f8d3806c6c0 2024-05-20T18:01:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.783+0000 7f8d2e7fc640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d1c06be30 0x7f8d1c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.784+0000 7f8d2e7fc640 1 -- 172.21.15.6:0/1386804832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f8d3408afa0 con 0x7f8d3806c6c0 2024-05-20T18:01:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.784+0000 7f8d3d1a8640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d1c06be30 0x7f8d1c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.784+0000 7f8d3d1a8640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d1c06be30 0x7f8d1c06e340 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8d28034000 tx=0x7f8d2802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.788+0000 7f8d2e7fc640 1 -- 172.21.15.6:0/1386804832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8d34059690 con 0x7f8d3806c6c0 2024-05-20T18:01:38.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.972+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f8d380b8940 con 0x7f8d3806c6c0 2024-05-20T18:01:38.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.976+0000 7f8d2e7fc640 1 -- 172.21.15.6:0/1386804832 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v47)=0 v47) ==== 121+0+0 (secure 0 0 0) 0x7f8d34058f90 con 0x7f8d3806c6c0 2024-05-20T18:01:38.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d1c06be30 msgr2=0x7f8d1c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:38.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d1c06be30 0x7f8d1c06e340 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8d28034000 tx=0x7f8d2802e000 comp rx=0 tx=0).stop 2024-05-20T18:01:38.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 msgr2=0x7f8d38160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:38.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d38160450 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e870 tx=0x7f8d3400ed30 comp rx=0 tx=0).stop 2024-05-20T18:01:38.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 shutdown_connections 2024-05-20T18:01:38.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8d1c06be30 0x7f8d1c06e340 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d380cf3d0 0x7f8d381462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d380cd680 0x7f8d38145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 --2- 172.21.15.6:0/1386804832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3806c6c0 0x7f8d38160450 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:38.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 >> 172.21.15.6:0/1386804832 conn(0x7f8d380b44d0 msgr2=0x7f8d380b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:38.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 shutdown_connections 2024-05-20T18:01:38.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:38.978+0000 7f8d3fc0d640 1 -- 172.21.15.6:0/1386804832 wait complete. 2024-05-20T18:01:38.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 100 2024-05-20T18:01:39.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.107+0000 7f8bff71d640 1 Processor -- start 2024-05-20T18:01:39.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.108+0000 7f8bff71d640 1 -- start start 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bff71d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf8162820 0x7f8bf80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bff71d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf80b3e80 0x7f8bf806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bff71d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8bf806d910 0x7f8bf80d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bff71d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf806dd20 con 0x7f8bf8162820 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bff71d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf80d0630 con 0x7f8bf806d910 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bff71d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf80d39c0 con 0x7f8bf80b3e80 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bfd4b9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf8162820 0x7f8bf80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bfd4b9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8bf8162820 0x7f8bf80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39736/0 (socket says 172.21.15.6:39736) 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bfd4b9640 1 -- 172.21.15.6:0/600079151 learned_addr learned my addr 172.21.15.6:0/600079151 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bfdcba640 1 --2- 172.21.15.6:0/600079151 >> v2:172.21.15.171:3300/0 conn(0x7f8bf806d910 0x7f8bf80d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.109+0000 7f8bfccb8640 1 --2- 172.21.15.6:0/600079151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf80b3e80 0x7f8bf806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.110+0000 7f8bfd4b9640 1 -- 172.21.15.6:0/600079151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf80b3e80 msgr2=0x7f8bf806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.110+0000 7f8bfd4b9640 1 --2- 172.21.15.6:0/600079151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf80b3e80 0x7f8bf806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.110+0000 7f8bfd4b9640 1 -- 172.21.15.6:0/600079151 >> v2:172.21.15.171:3300/0 conn(0x7f8bf806d910 msgr2=0x7f8bf80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.110+0000 7f8bfd4b9640 1 --2- 172.21.15.6:0/600079151 >> v2:172.21.15.171:3300/0 conn(0x7f8bf806d910 0x7f8bf80d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.110+0000 7f8bfd4b9640 1 -- 172.21.15.6:0/600079151 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf80d3ca0 con 0x7f8bf8162820 2024-05-20T18:01:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.110+0000 7f8bfd4b9640 1 --2- 172.21.15.6:0/600079151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf8162820 0x7f8bf80b3940 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8bf808d5e0 tx=0x7f8bf402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb27af0a080e17c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.110+0000 7f8beffff640 1 -- 172.21.15.6:0/600079151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4036070 con 0x7f8bf8162820 2024-05-20T18:01:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8beffff640 1 -- 172.21.15.6:0/600079151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf4031600 con 0x7f8bf8162820 2024-05-20T18:01:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8beffff640 1 -- 172.21.15.6:0/600079151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40319d0 con 0x7f8bf8162820 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 -- 172.21.15.6:0/600079151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf8162820 msgr2=0x7f8bf80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 --2- 172.21.15.6:0/600079151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf8162820 0x7f8bf80b3940 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8bf808d5e0 tx=0x7f8bf402a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 -- 172.21.15.6:0/600079151 shutdown_connections 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 --2- 172.21.15.6:0/600079151 >> v2:172.21.15.171:3300/0 conn(0x7f8bf806d910 0x7f8bf80d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 --2- 172.21.15.6:0/600079151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf80b3e80 0x7f8bf806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 --2- 172.21.15.6:0/600079151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf8162820 0x7f8bf80b3940 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 -- 172.21.15.6:0/600079151 >> 172.21.15.6:0/600079151 conn(0x7f8bf80d4bd0 msgr2=0x7f8bf80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 -- 172.21.15.6:0/600079151 shutdown_connections 2024-05-20T18:01:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.111+0000 7f8bff71d640 1 -- 172.21.15.6:0/600079151 wait complete. 2024-05-20T18:01:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.113+0000 7f8bff71d640 1 Processor -- start 2024-05-20T18:01:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.113+0000 7f8bff71d640 1 -- start start 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.114+0000 7f8bff71d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf806d910 0x7f8bf81f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.114+0000 7f8bff71d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80b3e80 0x7f8bf80b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.114+0000 7f8bff71d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bf8162820 0x7f8bf80b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.114+0000 7f8bff71d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf80d0300 con 0x7f8bf80b3e80 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.114+0000 7f8bff71d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf80d4260 con 0x7f8bf8162820 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.114+0000 7f8bff71d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf80d4780 con 0x7f8bf806d910 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80b3e80 0x7f8bf80b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80b3e80 0x7f8bf80b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39752/0 (socket says 172.21.15.6:39752) 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 -- 172.21.15.6:0/3535768116 learned_addr learned my addr 172.21.15.6:0/3535768116 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfd4b9640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf806d910 0x7f8bf81f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfdcba640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bf8162820 0x7f8bf80b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 -- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf806d910 msgr2=0x7f8bf81f81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf806d910 0x7f8bf81f81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 -- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bf8162820 msgr2=0x7f8bf80b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bf8162820 0x7f8bf80b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 -- 172.21.15.6:0/3535768116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf81f86e0 con 0x7f8bf80b3e80 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfdcba640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bf8162820 0x7f8bf80b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfd4b9640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf806d910 0x7f8bf81f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bfccb8640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80b3e80 0x7f8bf80b6770 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e8a0 tx=0x7f8be800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bedffb640 1 -- 172.21.15.6:0/3535768116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8017070 con 0x7f8bf80b3e80 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bedffb640 1 -- 172.21.15.6:0/3535768116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be800c940 con 0x7f8bf80b3e80 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bedffb640 1 -- 172.21.15.6:0/3535768116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be800cd30 con 0x7f8bf80b3e80 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.115+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf80ccee0 con 0x7f8bf80b3e80 2024-05-20T18:01:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.116+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf80cd4a0 con 0x7f8bf80b3e80 2024-05-20T18:01:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.117+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf8075b00 con 0x7f8bf80b3e80 2024-05-20T18:01:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.117+0000 7f8bedffb640 1 -- 172.21.15.6:0/3535768116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8be801a070 con 0x7f8bf80b3e80 2024-05-20T18:01:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.117+0000 7f8bedffb640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8bdc06be30 0x7f8bdc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.118+0000 7f8bedffb640 1 -- 172.21.15.6:0/3535768116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f8be808b370 con 0x7f8bf80b3e80 2024-05-20T18:01:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.118+0000 7f8bfd4b9640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8bdc06be30 0x7f8bdc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.118+0000 7f8bfd4b9640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8bdc06be30 0x7f8bdc06e340 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4033000 tx=0x7f8bf4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.122+0000 7f8bedffb640 1 -- 172.21.15.6:0/3535768116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8be8059a60 con 0x7f8bf80b3e80 2024-05-20T18:01:39.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.305+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f8bf815eae0 con 0x7f8bf80b3e80 2024-05-20T18:01:39.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.308+0000 7f8bedffb640 1 -- 172.21.15.6:0/3535768116 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v48)=0 v48) ==== 119+0+0 (secure 0 0 0) 0x7f8be8059360 con 0x7f8bf80b3e80 2024-05-20T18:01:39.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8bdc06be30 msgr2=0x7f8bdc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8bdc06be30 0x7f8bdc06e340 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4033000 tx=0x7f8bf4009000 comp rx=0 tx=0).stop 2024-05-20T18:01:39.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80b3e80 msgr2=0x7f8bf80b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80b3e80 0x7f8bf80b6770 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e8a0 tx=0x7f8be800ed60 comp rx=0 tx=0).stop 2024-05-20T18:01:39.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 shutdown_connections 2024-05-20T18:01:39.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8bdc06be30 0x7f8bdc06e340 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8bf8162820 0x7f8bf80b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf80b3e80 0x7f8bf80b6770 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 --2- 172.21.15.6:0/3535768116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8bf806d910 0x7f8bf81f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 >> 172.21.15.6:0/3535768116 conn(0x7f8bf80d4bd0 msgr2=0x7f8bf815eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:39.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 shutdown_connections 2024-05-20T18:01:39.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.311+0000 7f8bff71d640 1 -- 172.21.15.6:0/3535768116 wait complete. 2024-05-20T18:01:39.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 200 2024-05-20T18:01:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.441+0000 7f23cdf65640 1 Processor -- start 2024-05-20T18:01:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.441+0000 7f23cdf65640 1 -- start start 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.442+0000 7f23cdf65640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23c80d2100 0x7f23c80b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.442+0000 7f23cdf65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809b280 0x7f23c80cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.442+0000 7f23cdf65640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c80d1060 con 0x7f23c809bc40 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.442+0000 7f23cdf65640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f23c80d0e30 con 0x7f23c80d2100 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.442+0000 7f23cdf65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f23c80d1340 con 0x7f23c809b280 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.442+0000 7f23c77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23c80d2100 0x7f23c80b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.442+0000 7f23c77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f23c80d2100 0x7f23c80b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39764/0 (socket says 172.21.15.6:39764) 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.442+0000 7f23c77fe640 1 -- 172.21.15.6:0/2907183860 learned_addr learned my addr 172.21.15.6:0/2907183860 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.443+0000 7f23c7fff640 1 --2- 172.21.15.6:0/2907183860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809b280 0x7f23c80cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.443+0000 7f23c77fe640 1 -- 172.21.15.6:0/2907183860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809b280 msgr2=0x7f23c80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.443+0000 7f23c77fe640 1 --2- 172.21.15.6:0/2907183860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809b280 0x7f23c80cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.443+0000 7f23c77fe640 1 -- 172.21.15.6:0/2907183860 >> v1:172.21.15.171:6789/0 conn(0x7f23c809bc40 legacy=0x7f23c809ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.443+0000 7f23c77fe640 1 -- 172.21.15.6:0/2907183860 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c80d1620 con 0x7f23c80d2100 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.443+0000 7f23c7fff640 1 --2- 172.21.15.6:0/2907183860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809b280 0x7f23c80cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.443+0000 7f23c77fe640 1 --2- 172.21.15.6:0/2907183860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c80b3e30 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009870 tx=0x7f23b802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dd3c07c5ad8899 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23c67fc640 1 -- 172.21.15.6:0/2907183860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8037070 con 0x7f23c80d2100 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23c67fc640 1 -- 172.21.15.6:0/2907183860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b8032440 con 0x7f23c80d2100 2024-05-20T18:01:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23c67fc640 1 -- 172.21.15.6:0/2907183860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8032810 con 0x7f23c80d2100 2024-05-20T18:01:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23cdf65640 1 -- 172.21.15.6:0/2907183860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 msgr2=0x7f23c80b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2907183860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c80b3e30 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009870 tx=0x7f23b802a250 comp rx=0 tx=0).stop 2024-05-20T18:01:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23cdf65640 1 -- 172.21.15.6:0/2907183860 shutdown_connections 2024-05-20T18:01:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2907183860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809b280 0x7f23c80cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2907183860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c80b3e30 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23cdf65640 1 -- 172.21.15.6:0/2907183860 >> 172.21.15.6:0/2907183860 conn(0x7f23c80b44b0 msgr2=0x7f23c80b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23cdf65640 1 -- 172.21.15.6:0/2907183860 shutdown_connections 2024-05-20T18:01:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.444+0000 7f23cdf65640 1 -- 172.21.15.6:0/2907183860 wait complete. 2024-05-20T18:01:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.446+0000 7f23cdf65640 1 Processor -- start 2024-05-20T18:01:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.446+0000 7f23cdf65640 1 -- start start 2024-05-20T18:01:39.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23cdf65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809bc40 0x7f23c815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23cdf65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c814ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23cdf65640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81f8cc0 0x7f23c81f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23cdf65640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8163be0 con 0x7f23c80d2100 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23cdf65640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23c80d1be0 con 0x7f23c81f8cc0 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23cdf65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f23c8163d60 con 0x7f23c809bc40 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c814ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c814ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39770/0 (socket says 172.21.15.6:39770) 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 -- 172.21.15.6:0/2037284246 learned_addr learned my addr 172.21.15.6:0/2037284246 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c77fe640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809bc40 0x7f23c815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c7fff640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81f8cc0 0x7f23c81f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 -- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809bc40 msgr2=0x7f23c815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809bc40 0x7f23c815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 -- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81f8cc0 msgr2=0x7f23c81f90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81f8cc0 0x7f23c81f90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 -- 172.21.15.6:0/2037284246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c81596c0 con 0x7f23c80d2100 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.448+0000 7f23c6ffd640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c814ddf0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00c3f0 tx=0x7f23bc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.449+0000 7f23affff640 1 -- 172.21.15.6:0/2037284246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0052d0 con 0x7f23c80d2100 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.449+0000 7f23affff640 1 -- 172.21.15.6:0/2037284246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc005490 con 0x7f23c80d2100 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.449+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c809c800 con 0x7f23c80d2100 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.449+0000 7f23affff640 1 -- 172.21.15.6:0/2037284246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc007260 con 0x7f23c80d2100 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.449+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c815b040 con 0x7f23c80d2100 2024-05-20T18:01:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.450+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c80690b0 con 0x7f23c80d2100 2024-05-20T18:01:39.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.450+0000 7f23affff640 1 -- 172.21.15.6:0/2037284246 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23bc007400 con 0x7f23c80d2100 2024-05-20T18:01:39.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.451+0000 7f23affff640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23b406be30 0x7f23b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.451+0000 7f23affff640 1 -- 172.21.15.6:0/2037284246 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f23bc08a410 con 0x7f23c80d2100 2024-05-20T18:01:39.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.451+0000 7f23c77fe640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23b406be30 0x7f23b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.451+0000 7f23c77fe640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23b406be30 0x7f23b406e340 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f23b8034000 tx=0x7f23b802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.455+0000 7f23affff640 1 -- 172.21.15.6:0/2037284246 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f23bc0585e0 con 0x7f23c80d2100 2024-05-20T18:01:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.639+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f23c80d2650 con 0x7f23c80d2100 2024-05-20T18:01:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.642+0000 7f23affff640 1 -- 172.21.15.6:0/2037284246 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v49)=0 v49) ==== 128+0+0 (secure 0 0 0) 0x7f23bc05c8e0 con 0x7f23c80d2100 2024-05-20T18:01:39.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.644+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23b406be30 msgr2=0x7f23b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.644+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23b406be30 0x7f23b406e340 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f23b8034000 tx=0x7f23b802e000 comp rx=0 tx=0).stop 2024-05-20T18:01:39.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.644+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 msgr2=0x7f23c814ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.644+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c814ddf0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00c3f0 tx=0x7f23bc00c8b0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.644+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 shutdown_connections 2024-05-20T18:01:39.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.644+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f23b406be30 0x7f23b406e340 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.645+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81f8cc0 0x7f23c81f90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.645+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23c80d2100 0x7f23c814ddf0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.645+0000 7f23cdf65640 1 --2- 172.21.15.6:0/2037284246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c809bc40 0x7f23c815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.645+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 >> 172.21.15.6:0/2037284246 conn(0x7f23c80b44b0 msgr2=0x7f23c8071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.645+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 shutdown_connections 2024-05-20T18:01:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.645+0000 7f23cdf65640 1 -- 172.21.15.6:0/2037284246 wait complete. 2024-05-20T18:01:39.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-05-20T18:01:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.773+0000 7fcf28510640 1 Processor -- start 2024-05-20T18:01:39.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.773+0000 7fcf28510640 1 -- start start 2024-05-20T18:01:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.774+0000 7fcf28510640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf200cf3d0 0x7fcf200cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.774+0000 7fcf28510640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcf200ce7e0 0x7fcf200cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.774+0000 7fcf28510640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf200cfd20 con 0x7fcf2015f220 2024-05-20T18:01:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.774+0000 7fcf28510640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcf200cf130 con 0x7fcf200cf3d0 2024-05-20T18:01:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.774+0000 7fcf28510640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcf200cda20 con 0x7fcf200ce7e0 2024-05-20T18:01:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.775+0000 7fcf25aab640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf200cf3d0 0x7fcf200cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.775+0000 7fcf25aab640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf200cf3d0 0x7fcf200cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39774/0 (socket says 172.21.15.6:39774) 2024-05-20T18:01:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.775+0000 7fcf25aab640 1 -- 172.21.15.6:0/4130292026 learned_addr learned my addr 172.21.15.6:0/4130292026 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.775+0000 7fcf26aad640 1 --2- 172.21.15.6:0/4130292026 >> v2:172.21.15.171:3300/0 conn(0x7fcf200ce7e0 0x7fcf200cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.775+0000 7fcf25aab640 1 -- 172.21.15.6:0/4130292026 >> v2:172.21.15.171:3300/0 conn(0x7fcf200ce7e0 msgr2=0x7fcf200cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.775+0000 7fcf25aab640 1 --2- 172.21.15.6:0/4130292026 >> v2:172.21.15.171:3300/0 conn(0x7fcf200ce7e0 0x7fcf200cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.775+0000 7fcf25aab640 1 -- 172.21.15.6:0/4130292026 >> v1:172.21.15.171:6789/0 conn(0x7fcf2015f220 legacy=0x7fcf200d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.775+0000 7fcf25aab640 1 -- 172.21.15.6:0/4130292026 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf200cdd00 con 0x7fcf200cf3d0 2024-05-20T18:01:39.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.776+0000 7fcf25aab640 1 --2- 172.21.15.6:0/4130292026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200cf3d0 0x7fcf200cf7e0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fcf2006e3e0 tx=0x7fcf1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25594ad17d4e93f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.776+0000 7fcf252aa640 1 -- 172.21.15.6:0/4130292026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10037070 con 0x7fcf200cf3d0 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.776+0000 7fcf252aa640 1 -- 172.21.15.6:0/4130292026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf10032440 con 0x7fcf200cf3d0 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.776+0000 7fcf252aa640 1 -- 172.21.15.6:0/4130292026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10032810 con 0x7fcf200cf3d0 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.776+0000 7fcf28510640 1 -- 172.21.15.6:0/4130292026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200cf3d0 msgr2=0x7fcf200cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.776+0000 7fcf28510640 1 --2- 172.21.15.6:0/4130292026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200cf3d0 0x7fcf200cf7e0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fcf2006e3e0 tx=0x7fcf1002a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.777+0000 7fcf28510640 1 -- 172.21.15.6:0/4130292026 shutdown_connections 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.777+0000 7fcf28510640 1 --2- 172.21.15.6:0/4130292026 >> v2:172.21.15.171:3300/0 conn(0x7fcf200ce7e0 0x7fcf200cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.777+0000 7fcf28510640 1 --2- 172.21.15.6:0/4130292026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200cf3d0 0x7fcf200cf7e0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.777+0000 7fcf28510640 1 -- 172.21.15.6:0/4130292026 >> 172.21.15.6:0/4130292026 conn(0x7fcf200b44d0 msgr2=0x7fcf200b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.777+0000 7fcf28510640 1 -- 172.21.15.6:0/4130292026 shutdown_connections 2024-05-20T18:01:39.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.777+0000 7fcf28510640 1 -- 172.21.15.6:0/4130292026 wait complete. 2024-05-20T18:01:39.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.778+0000 7fcf28510640 1 Processor -- start 2024-05-20T18:01:39.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.778+0000 7fcf28510640 1 -- start start 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf28510640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200ce7e0 0x7fcf200b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf28510640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf200cf3d0 0x7fcf20157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf28510640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf2015f220 0x7fcf200c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf28510640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcf200d0fd0 con 0x7fcf200ce7e0 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf28510640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcf200ce2c0 con 0x7fcf2015f220 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf28510640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcf200cd680 con 0x7fcf200cf3d0 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200ce7e0 0x7fcf200b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200ce7e0 0x7fcf200b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39786/0 (socket says 172.21.15.6:39786) 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 -- 172.21.15.6:0/2191429719 learned_addr learned my addr 172.21.15.6:0/2191429719 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf25aab640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf200cf3d0 0x7fcf20157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf26aad640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf2015f220 0x7fcf200c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 -- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf200cf3d0 msgr2=0x7fcf20157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf200cf3d0 0x7fcf20157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 -- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf2015f220 msgr2=0x7fcf200c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf2015f220 0x7fcf200c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 -- 172.21.15.6:0/2191429719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf200c8ea0 con 0x7fcf200ce7e0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf262ac640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200ce7e0 0x7fcf200b72a0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c470 tx=0x7fcf1c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf16ffd640 1 -- 172.21.15.6:0/2191429719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0052d0 con 0x7fcf200ce7e0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf16ffd640 1 -- 172.21.15.6:0/2191429719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1c005490 con 0x7fcf200ce7e0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf200b64e0 con 0x7fcf200ce7e0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf16ffd640 1 -- 172.21.15.6:0/2191429719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c007260 con 0x7fcf200ce7e0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.781+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf200b6aa0 con 0x7fcf200ce7e0 2024-05-20T18:01:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.782+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf20157770 con 0x7fcf200ce7e0 2024-05-20T18:01:39.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.782+0000 7fcf16ffd640 1 -- 172.21.15.6:0/2191429719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf1c007400 con 0x7fcf200ce7e0 2024-05-20T18:01:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.783+0000 7fcf16ffd640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf0406be30 0x7fcf0406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.783+0000 7fcf16ffd640 1 -- 172.21.15.6:0/2191429719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fcf1c08a540 con 0x7fcf200ce7e0 2024-05-20T18:01:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.783+0000 7fcf25aab640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf0406be30 0x7fcf0406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:39.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.783+0000 7fcf25aab640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf0406be30 0x7fcf0406e340 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcf10034000 tx=0x7fcf1002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:39.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.787+0000 7fcf16ffd640 1 -- 172.21.15.6:0/2191429719 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcf200cfd20 con 0x7fcf200ce7e0 2024-05-20T18:01:39.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.974+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7fcf20075b00 con 0x7fcf200ce7e0 2024-05-20T18:01:39.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.975+0000 7fcf16ffd640 1 -- 172.21.15.6:0/2191429719 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v49) ==== 106+0+4 (secure 0 0 0) 0x7fcf1c058cd0 con 0x7fcf200ce7e0 2024-05-20T18:01:39.974 INFO:teuthology.orchestra.run.smithi006.stdout:100 2024-05-20T18:01:39.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf0406be30 msgr2=0x7fcf0406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf0406be30 0x7fcf0406e340 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcf10034000 tx=0x7fcf1002e000 comp rx=0 tx=0).stop 2024-05-20T18:01:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200ce7e0 msgr2=0x7fcf200b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200ce7e0 0x7fcf200b72a0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c470 tx=0x7fcf1c00c930 comp rx=0 tx=0).stop 2024-05-20T18:01:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 shutdown_connections 2024-05-20T18:01:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf0406be30 0x7fcf0406e340 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf2015f220 0x7fcf200c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf200cf3d0 0x7fcf20157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 --2- 172.21.15.6:0/2191429719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf200ce7e0 0x7fcf200b72a0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 >> 172.21.15.6:0/2191429719 conn(0x7fcf200b44d0 msgr2=0x7fcf20158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 shutdown_connections 2024-05-20T18:01:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:39.978+0000 7fcf28510640 1 -- 172.21.15.6:0/2191429719 wait complete. 2024-05-20T18:01:39.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-05-20T18:01:40.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.107+0000 7efded206640 1 Processor -- start 2024-05-20T18:01:40.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.107+0000 7efded206640 1 -- start start 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efded206640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efde815d530 0x7efde815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efded206640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efde8070850 0x7efde8070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efded206640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde80cd580 con 0x7efde80b1700 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efded206640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7efde80ce190 con 0x7efde815d530 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efded206640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efde80cd860 con 0x7efde8070850 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efde6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efde815d530 0x7efde815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efde6d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efde815d530 0x7efde815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39788/0 (socket says 172.21.15.6:39788) 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efde6d9d640 1 -- 172.21.15.6:0/3063639313 learned_addr learned my addr 172.21.15.6:0/3063639313 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:40.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.108+0000 7efde759e640 1 --2- 172.21.15.6:0/3063639313 >> v2:172.21.15.171:3300/0 conn(0x7efde8070850 0x7efde8070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.109+0000 7efde6d9d640 1 -- 172.21.15.6:0/3063639313 >> v2:172.21.15.171:3300/0 conn(0x7efde8070850 msgr2=0x7efde8070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:40.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.109+0000 7efde6d9d640 1 --2- 172.21.15.6:0/3063639313 >> v2:172.21.15.171:3300/0 conn(0x7efde8070850 0x7efde8070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.109+0000 7efde6d9d640 1 -- 172.21.15.6:0/3063639313 >> v1:172.21.15.171:6789/0 conn(0x7efde80b1700 legacy=0x7efde80b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:40.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.109+0000 7efde6d9d640 1 -- 172.21.15.6:0/3063639313 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde80cdb40 con 0x7efde815d530 2024-05-20T18:01:40.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.109+0000 7efde6d9d640 1 --2- 172.21.15.6:0/3063639313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde815d530 0x7efde815aaa0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7efde80b8400 tx=0x7efdd802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3e97e4cfd5ef26 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.109+0000 7efde659c640 1 -- 172.21.15.6:0/3063639313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8037070 con 0x7efde815d530 2024-05-20T18:01:40.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efde659c640 1 -- 172.21.15.6:0/3063639313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd8032440 con 0x7efde815d530 2024-05-20T18:01:40.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efde659c640 1 -- 172.21.15.6:0/3063639313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8032810 con 0x7efde815d530 2024-05-20T18:01:40.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efded206640 1 -- 172.21.15.6:0/3063639313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde815d530 msgr2=0x7efde815aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efded206640 1 --2- 172.21.15.6:0/3063639313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde815d530 0x7efde815aaa0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7efde80b8400 tx=0x7efdd802a230 comp rx=0 tx=0).stop 2024-05-20T18:01:40.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efded206640 1 -- 172.21.15.6:0/3063639313 shutdown_connections 2024-05-20T18:01:40.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efded206640 1 --2- 172.21.15.6:0/3063639313 >> v2:172.21.15.171:3300/0 conn(0x7efde8070850 0x7efde8070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efded206640 1 --2- 172.21.15.6:0/3063639313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde815d530 0x7efde815aaa0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efded206640 1 -- 172.21.15.6:0/3063639313 >> 172.21.15.6:0/3063639313 conn(0x7efde80d29d0 msgr2=0x7efde80d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:40.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efded206640 1 -- 172.21.15.6:0/3063639313 shutdown_connections 2024-05-20T18:01:40.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.110+0000 7efded206640 1 -- 172.21.15.6:0/3063639313 wait complete. 2024-05-20T18:01:40.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.112+0000 7efded206640 1 Processor -- start 2024-05-20T18:01:40.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.112+0000 7efded206640 1 -- start start 2024-05-20T18:01:40.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efded206640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde8070850 0x7efde80c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efded206640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde80b1700 0x7efde80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efded206640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efde815d530 0x7efde81f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efded206640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efde80711a0 con 0x7efde80b1700 2024-05-20T18:01:40.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efded206640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efde80cd230 con 0x7efde815d530 2024-05-20T18:01:40.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efded206640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efde8071320 con 0x7efde8070850 2024-05-20T18:01:40.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde80b1700 0x7efde80c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde80b1700 0x7efde80c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39804/0 (socket says 172.21.15.6:39804) 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 -- 172.21.15.6:0/3458008609 learned_addr learned my addr 172.21.15.6:0/3458008609 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efde759e640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efde815d530 0x7efde81f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efde6d9d640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde8070850 0x7efde80c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 -- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde8070850 msgr2=0x7efde80c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde8070850 0x7efde80c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 -- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efde815d530 msgr2=0x7efde81f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efde815d530 0x7efde81f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 -- 172.21.15.6:0/3458008609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde80cc8d0 con 0x7efde80b1700 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efdde59c640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde80b1700 0x7efde80c6f10 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b420 tx=0x7efdd000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efddffff640 1 -- 172.21.15.6:0/3458008609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011830 con 0x7efde80b1700 2024-05-20T18:01:40.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efddffff640 1 -- 172.21.15.6:0/3458008609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd0016070 con 0x7efde80b1700 2024-05-20T18:01:40.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde80c7450 con 0x7efde80b1700 2024-05-20T18:01:40.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efddffff640 1 -- 172.21.15.6:0/3458008609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011c10 con 0x7efde80b1700 2024-05-20T18:01:40.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.115+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde80ca3f0 con 0x7efde80b1700 2024-05-20T18:01:40.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.116+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde80b5630 con 0x7efde80b1700 2024-05-20T18:01:40.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.116+0000 7efddffff640 1 -- 172.21.15.6:0/3458008609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdd001b460 con 0x7efde80b1700 2024-05-20T18:01:40.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.117+0000 7efddffff640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efdc806be30 0x7efdc806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.117+0000 7efddffff640 1 -- 172.21.15.6:0/3458008609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7efdd008ac10 con 0x7efde80b1700 2024-05-20T18:01:40.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.117+0000 7efde6d9d640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efdc806be30 0x7efdc806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.118+0000 7efde6d9d640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efdc806be30 0x7efdc806e340 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7efdd8034000 tx=0x7efdd802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.121+0000 7efddffff640 1 -- 172.21.15.6:0/3458008609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efde80b5630 con 0x7efde80b1700 2024-05-20T18:01:40.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.303+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7efde8075b00 con 0x7efde80b1700 2024-05-20T18:01:40.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.307+0000 7efddffff640 1 -- 172.21.15.6:0/3458008609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v50)=0 v50) ==== 124+0+0 (secure 0 0 0) 0x7efde80cc8d0 con 0x7efde80b1700 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efdc806be30 msgr2=0x7efdc806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efdc806be30 0x7efdc806e340 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7efdd8034000 tx=0x7efdd802e000 comp rx=0 tx=0).stop 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde80b1700 msgr2=0x7efde80c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde80b1700 0x7efde80c6f10 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b420 tx=0x7efdd000b8e0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 shutdown_connections 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efdc806be30 0x7efdc806e340 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efde815d530 0x7efde81f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efde80b1700 0x7efde80c6f10 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.309+0000 7efded206640 1 --2- 172.21.15.6:0/3458008609 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efde8070850 0x7efde80c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.310+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 >> 172.21.15.6:0/3458008609 conn(0x7efde80d29d0 msgr2=0x7efde80b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:40.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.310+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 shutdown_connections 2024-05-20T18:01:40.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.310+0000 7efded206640 1 -- 172.21.15.6:0/3458008609 wait complete. 2024-05-20T18:01:40.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-05-20T18:01:40.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.439+0000 7fb0630eb640 1 Processor -- start 2024-05-20T18:01:40.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.439+0000 7fb0630eb640 1 -- start start 2024-05-20T18:01:40.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb0630eb640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb05c0d10e0 0x7fb05c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb0630eb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c0b7210 0x7fb05c0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb0630eb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb05c0d1ac0 con 0x7fb05c0d14f0 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb0630eb640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb05c0d1da0 con 0x7fb05c0d10e0 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb0630eb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb05c0d2080 con 0x7fb05c0b7210 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb05c0d14f0 0x7fb05c0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51960/0 (socket says 172.21.15.6:51960) 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05bfff640 1 -- 172.21.15.6:0/1206791622 learned_addr learned my addr 172.21.15.6:0/1206791622 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb060e87640 1 --2- 172.21.15.6:0/1206791622 >> v2:172.21.15.171:3300/0 conn(0x7fb05c0d10e0 0x7fb05c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb061688640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c0b7210 0x7fb05c0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277444477 0 0) 0x7fb05c0d1ac0 con 0x7fb05c0d14f0 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb04c003520 con 0x7fb05c0d14f0 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3275603434 0 0) 0x7fb04c003520 con 0x7fb05c0d14f0 2024-05-20T18:01:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c0b7210 msgr2=0x7fb05c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c0b7210 0x7fb05c0cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 >> v2:172.21.15.171:3300/0 conn(0x7fb05c0d10e0 msgr2=0x7fb05c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 --2- 172.21.15.6:0/1206791622 >> v2:172.21.15.171:3300/0 conn(0x7fb05c0d10e0 0x7fb05c0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05c0d2360 con 0x7fb05c0d14f0 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fb048001670 con 0x7fb05c0d14f0 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 >> v1:172.21.15.6:6789/0 conn(0x7fb05c0d14f0 legacy=0x7fb05c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c0b7210 0x7fb04c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb04c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb04c004d40 0x7fb04c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c0d1da0 con 0x7fb04c003f30 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c0d2080 con 0x7fb04c004d40 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.440+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb04c00ba10 con 0x7fb05c0b7210 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.441+0000 7fb05bfff640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb04c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.441+0000 7fb060e87640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c0b7210 0x7fb04c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.441+0000 7fb061688640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb04c004d40 0x7fb04c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.441+0000 7fb05bfff640 1 -- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c0b7210 msgr2=0x7fb04c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.441+0000 7fb05bfff640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c0b7210 0x7fb04c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.441+0000 7fb05bfff640 1 -- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb04c004d40 msgr2=0x7fb04c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.441+0000 7fb05bfff640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb04c004d40 0x7fb04c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.441+0000 7fb05bfff640 1 -- 172.21.15.6:0/1206791622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04c003520 con 0x7fb04c003f30 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.442+0000 7fb05bfff640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb04c004800 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fb04800c210 tx=0x7fb04c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cb99922671696b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.442+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb048007d30 con 0x7fb04c003f30 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.442+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb048005ad0 con 0x7fb04c003f30 2024-05-20T18:01:40.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.442+0000 7fb05b7fe640 1 -- 172.21.15.6:0/1206791622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb048007070 con 0x7fb04c003f30 2024-05-20T18:01:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.442+0000 7fb0630eb640 1 -- 172.21.15.6:0/1206791622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 msgr2=0x7fb04c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.442+0000 7fb0630eb640 1 --2- 172.21.15.6:0/1206791622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb04c004800 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fb04800c210 tx=0x7fb04c005830 comp rx=0 tx=0).stop 2024-05-20T18:01:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.442+0000 7fb061688640 1 -- 172.21.15.6:0/1206791622 reap_dead start 2024-05-20T18:01:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.443+0000 7fb0630eb640 1 -- 172.21.15.6:0/1206791622 shutdown_connections 2024-05-20T18:01:40.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.443+0000 7fb0630eb640 1 -- 172.21.15.6:0/1206791622 >> 172.21.15.6:0/1206791622 conn(0x7fb05c0b44d0 msgr2=0x7fb05c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.443+0000 7fb0630eb640 1 -- 172.21.15.6:0/1206791622 shutdown_connections 2024-05-20T18:01:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.443+0000 7fb0630eb640 1 -- 172.21.15.6:0/1206791622 wait complete. 2024-05-20T18:01:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.444+0000 7fb0630eb640 1 Processor -- start 2024-05-20T18:01:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.444+0000 7fb0630eb640 1 -- start start 2024-05-20T18:01:40.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb0630eb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb05c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb0630eb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c1f3040 0x7fb05c1e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb0630eb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb05c0cb920 0x7fb05c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb0630eb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c0b8440 con 0x7fb04c003f30 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb0630eb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c0b82c0 con 0x7fb05c0cb920 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb0630eb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb05c0709f0 con 0x7fb05c1f3040 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb05c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb05c15bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39826/0 (socket says 172.21.15.6:39826) 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 -- 172.21.15.6:0/111493501 learned_addr learned my addr 172.21.15.6:0/111493501 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb05bfff640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c1f3040 0x7fb05c1e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb061688640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb05c0cb920 0x7fb05c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 -- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c1f3040 msgr2=0x7fb05c1e6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c1f3040 0x7fb05c1e6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 -- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb05c0cb920 msgr2=0x7fb05c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb05c0cb920 0x7fb05c0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 -- 172.21.15.6:0/111493501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05c15ec40 con 0x7fb04c003f30 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.446+0000 7fb060e87640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb05c15bba0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fb050011960 tx=0x7fb050011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.447+0000 7fb0597fa640 1 -- 172.21.15.6:0/111493501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05000faf0 con 0x7fb04c003f30 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.447+0000 7fb0597fa640 1 -- 172.21.15.6:0/111493501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05000fc90 con 0x7fb04c003f30 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.447+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05c0cc270 con 0x7fb04c003f30 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.447+0000 7fb0597fa640 1 -- 172.21.15.6:0/111493501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050014440 con 0x7fb04c003f30 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.447+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb05c15f190 con 0x7fb04c003f30 2024-05-20T18:01:40.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.448+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05c075b00 con 0x7fb04c003f30 2024-05-20T18:01:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.448+0000 7fb0597fa640 1 -- 172.21.15.6:0/111493501 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb050012040 con 0x7fb04c003f30 2024-05-20T18:01:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.449+0000 7fb0597fa640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb04006be60 0x7fb04006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.449+0000 7fb0597fa640 1 -- 172.21.15.6:0/111493501 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fb05008b7f0 con 0x7fb04c003f30 2024-05-20T18:01:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.450+0000 7fb05bfff640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb04006be60 0x7fb04006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.450+0000 7fb05bfff640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb04006be60 0x7fb04006e370 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb048033000 tx=0x7fb048009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.455+0000 7fb0597fa640 1 -- 172.21.15.6:0/111493501 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb05c0cc270 con 0x7fb04c003f30 2024-05-20T18:01:40.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.640+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7fb05c0b6db0 con 0x7fb04c003f30 2024-05-20T18:01:40.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.640+0000 7fb0597fa640 1 -- 172.21.15.6:0/111493501 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v50) ==== 106+0+8 (secure 0 0 0) 0x7fb050019030 con 0x7fb04c003f30 2024-05-20T18:01:40.638 INFO:teuthology.orchestra.run.smithi006.stdout:1048576 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb04006be60 msgr2=0x7fb04006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb04006be60 0x7fb04006e370 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb048033000 tx=0x7fb048009030 comp rx=0 tx=0).stop 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 msgr2=0x7fb05c15bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb05c15bba0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fb050011960 tx=0x7fb050011e20 comp rx=0 tx=0).stop 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 shutdown_connections 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb04006be60 0x7fb04006e370 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb05c0cb920 0x7fb05c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb05c1f3040 0x7fb05c1e6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 --2- 172.21.15.6:0/111493501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb04c003f30 0x7fb05c15bba0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 >> 172.21.15.6:0/111493501 conn(0x7fb05c0b44d0 msgr2=0x7fb05c0b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 shutdown_connections 2024-05-20T18:01:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.642+0000 7fb0630eb640 1 -- 172.21.15.6:0/111493501 wait complete. 2024-05-20T18:01:40.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-05-20T18:01:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.771+0000 7fe22657e640 1 Processor -- start 2024-05-20T18:01:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.771+0000 7fe22657e640 1 -- start start 2024-05-20T18:01:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe22657e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2200b2f10 0x7fe2200d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe22657e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe22015d940 0x7fe22015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe22657e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe22015e6b0 con 0x7fe22006d290 2024-05-20T18:01:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe22657e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe2200d2400 con 0x7fe2200b2f10 2024-05-20T18:01:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe22657e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe2200d1a30 con 0x7fe22015d940 2024-05-20T18:01:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe21ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2200b2f10 0x7fe2200d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe21ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2200b2f10 0x7fe2200d1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39842/0 (socket says 172.21.15.6:39842) 2024-05-20T18:01:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe21ffff640 1 -- 172.21.15.6:0/43874777 learned_addr learned my addr 172.21.15.6:0/43874777 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe224b1b640 1 --2- 172.21.15.6:0/43874777 >> v2:172.21.15.171:3300/0 conn(0x7fe22015d940 0x7fe22015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe21ffff640 1 -- 172.21.15.6:0/43874777 >> v2:172.21.15.171:3300/0 conn(0x7fe22015d940 msgr2=0x7fe22015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe21ffff640 1 --2- 172.21.15.6:0/43874777 >> v2:172.21.15.171:3300/0 conn(0x7fe22015d940 0x7fe22015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe21ffff640 1 -- 172.21.15.6:0/43874777 >> v1:172.21.15.171:6789/0 conn(0x7fe22006d290 legacy=0x7fe22006d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe21ffff640 1 -- 172.21.15.6:0/43874777 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2200d1100 con 0x7fe2200b2f10 2024-05-20T18:01:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.773+0000 7fe224b1b640 1 --2- 172.21.15.6:0/43874777 >> v2:172.21.15.171:3300/0 conn(0x7fe22015d940 0x7fe22015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.774+0000 7fe21ffff640 1 --2- 172.21.15.6:0/43874777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2200d1ec0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fe220073460 tx=0x7fe21002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecd454731ca60e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.774+0000 7fe21f7fe640 1 -- 172.21.15.6:0/43874777 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210037070 con 0x7fe2200b2f10 2024-05-20T18:01:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.774+0000 7fe21f7fe640 1 -- 172.21.15.6:0/43874777 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe210032440 con 0x7fe2200b2f10 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.774+0000 7fe21f7fe640 1 -- 172.21.15.6:0/43874777 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210032810 con 0x7fe2200b2f10 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.775+0000 7fe22657e640 1 -- 172.21.15.6:0/43874777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 msgr2=0x7fe2200d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.775+0000 7fe22657e640 1 --2- 172.21.15.6:0/43874777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2200d1ec0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fe220073460 tx=0x7fe21002a1e0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.775+0000 7fe22657e640 1 -- 172.21.15.6:0/43874777 shutdown_connections 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.775+0000 7fe22657e640 1 --2- 172.21.15.6:0/43874777 >> v2:172.21.15.171:3300/0 conn(0x7fe22015d940 0x7fe22015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.775+0000 7fe22657e640 1 --2- 172.21.15.6:0/43874777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2200d1ec0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.775+0000 7fe22657e640 1 -- 172.21.15.6:0/43874777 >> 172.21.15.6:0/43874777 conn(0x7fe2200b6670 msgr2=0x7fe2200b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.775+0000 7fe22657e640 1 -- 172.21.15.6:0/43874777 shutdown_connections 2024-05-20T18:01:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.775+0000 7fe22657e640 1 -- 172.21.15.6:0/43874777 wait complete. 2024-05-20T18:01:40.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.777+0000 7fe22657e640 1 Processor -- start 2024-05-20T18:01:40.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.777+0000 7fe22657e640 1 -- start start 2024-05-20T18:01:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe22657e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22006d290 0x7fe2201f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe22657e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2201f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe22657e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22015d940 0x7fe220159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe22657e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe2200d16c0 con 0x7fe2200b2f10 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe22657e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe2200b3320 con 0x7fe22015d940 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe22657e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe22015e290 con 0x7fe22006d290 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe217fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2201f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe217fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2201f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39850/0 (socket says 172.21.15.6:39850) 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe217fff640 1 -- 172.21.15.6:0/929529120 learned_addr learned my addr 172.21.15.6:0/929529120 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe21ffff640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22006d290 0x7fe2201f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe224b1b640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22015d940 0x7fe220159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe217fff640 1 -- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22006d290 msgr2=0x7fe2201f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe217fff640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22006d290 0x7fe2201f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe217fff640 1 -- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22015d940 msgr2=0x7fe220159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.778+0000 7fe217fff640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22015d940 0x7fe220159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.779+0000 7fe217fff640 1 -- 172.21.15.6:0/929529120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2201f3390 con 0x7fe2200b2f10 2024-05-20T18:01:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.779+0000 7fe224b1b640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22015d940 0x7fe220159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.779+0000 7fe217fff640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2201f2e50 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fe20800c3c0 tx=0x7fe20800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.779+0000 7fe21d7fa640 1 -- 172.21.15.6:0/929529120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208017070 con 0x7fe2200b2f10 2024-05-20T18:01:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.779+0000 7fe21d7fa640 1 -- 172.21.15.6:0/929529120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2080052d0 con 0x7fe2200b2f10 2024-05-20T18:01:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.779+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22015cc30 con 0x7fe2200b2f10 2024-05-20T18:01:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.779+0000 7fe21d7fa640 1 -- 172.21.15.6:0/929529120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208003680 con 0x7fe2200b2f10 2024-05-20T18:01:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.779+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22009ed70 con 0x7fe2200b2f10 2024-05-20T18:01:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.780+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22009efb0 con 0x7fe2200b2f10 2024-05-20T18:01:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.781+0000 7fe21d7fa640 1 -- 172.21.15.6:0/929529120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe20801a070 con 0x7fe2200b2f10 2024-05-20T18:01:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.781+0000 7fe21d7fa640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe20006be30 0x7fe20006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.781+0000 7fe21d7fa640 1 -- 172.21.15.6:0/929529120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fe20808a270 con 0x7fe2200b2f10 2024-05-20T18:01:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.782+0000 7fe21ffff640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe20006be30 0x7fe20006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.782+0000 7fe21ffff640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe20006be30 0x7fe20006e340 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe210034000 tx=0x7fe21002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:40.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.786+0000 7fe21d7fa640 1 -- 172.21.15.6:0/929529120 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe22009efb0 con 0x7fe2200b2f10 2024-05-20T18:01:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.977+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7fe22009f660 con 0x7fe2200b2f10 2024-05-20T18:01:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.979+0000 7fe21d7fa640 1 -- 172.21.15.6:0/929529120 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v50) ==== 112+0+10 (secure 0 0 0) 0x7fe2080584d0 con 0x7fe2200b2f10 2024-05-20T18:01:40.977 INFO:teuthology.orchestra.run.smithi006.stdout:60.000000 2024-05-20T18:01:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe20006be30 msgr2=0x7fe20006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe20006be30 0x7fe20006e340 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe210034000 tx=0x7fe21002e000 comp rx=0 tx=0).stop 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 msgr2=0x7fe2201f2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2201f2e50 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fe20800c3c0 tx=0x7fe20800c7c0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 shutdown_connections 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe20006be30 0x7fe20006e340 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe22015d940 0x7fe220159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2200b2f10 0x7fe2201f2e50 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 --2- 172.21.15.6:0/929529120 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe22006d290 0x7fe2201f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 >> 172.21.15.6:0/929529120 conn(0x7fe2200b6670 msgr2=0x7fe22006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 shutdown_connections 2024-05-20T18:01:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:40.981+0000 7fe22657e640 1 -- 172.21.15.6:0/929529120 wait complete. 2024-05-20T18:01:40.991 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:40.991 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:41.007 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:01:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:01:41.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:01:41.106 INFO:teuthology.orchestra.run.smithi006.stdout:client8793 2024-05-20T18:01:41.106 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:41.106 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:41.122 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> import fcntl 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> import time 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> n = 200 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> if not os.path.exists(abs_path): 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(abs_path) 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> handles = [] 2024-05-20T18:01:41.123 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(0, n): 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> fname = "file_"+str(i) 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> path = os.path.join(abs_path, fname) 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> handles.append(open(path, '"'"'w'"'"')) 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> print("waiting with handles open", file=sys.stderr) 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> while True: 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> print("open_n_background: keeping files open", file=sys.stderr) 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> if os.read(0, 4096) == b"": 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> break 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> except BlockingIOError: 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> pass 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(2) 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> print("stdin closed, goodbye!", file=sys.stderr) 2024-05-20T18:01:41.124 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T18:01:41.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:41.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.284+0000 7efe92684640 1 Processor -- start 2024-05-20T18:01:41.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.284+0000 7efe92684640 1 -- start start 2024-05-20T18:01:41.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.285+0000 7efe92684640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c071630 0x7efe8c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.285+0000 7efe92684640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe8c070850 0x7efe8c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.285+0000 7efe92684640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8c0711a0 con 0x7efe8c0cd1b0 2024-05-20T18:01:41.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe92684640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7efe8c15f790 con 0x7efe8c070850 2024-05-20T18:01:41.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe92684640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efe8c06e590 con 0x7efe8c071630 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe90c21640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe8c070850 0x7efe8c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe90c21640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe8c070850 0x7efe8c070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39856/0 (socket says 172.21.15.6:39856) 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe90c21640 1 -- 172.21.15.6:0/3313198664 learned_addr learned my addr 172.21.15.6:0/3313198664 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe8bfff640 1 --2- 172.21.15.6:0/3313198664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c071630 0x7efe8c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe90c21640 1 -- 172.21.15.6:0/3313198664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c071630 msgr2=0x7efe8c15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe90c21640 1 --2- 172.21.15.6:0/3313198664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c071630 0x7efe8c15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe90c21640 1 -- 172.21.15.6:0/3313198664 >> v1:172.21.15.6:6789/0 conn(0x7efe8c0cd1b0 legacy=0x7efe8c06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe90c21640 1 -- 172.21.15.6:0/3313198664 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c0ce2b0 con 0x7efe8c070850 2024-05-20T18:01:41.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.286+0000 7efe8affd640 1 -- 172.21.15.6:0/3313198664 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687835361 0 0) 0x7efe80001110 con 0x7efe8c0cd1b0 2024-05-20T18:01:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.287+0000 7efe90c21640 1 --2- 172.21.15.6:0/3313198664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c070850 0x7efe8c070c60 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7efe84009e50 tx=0x7efe8402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c367387b4dc09d7a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.287+0000 7efe8affd640 1 -- 172.21.15.6:0/3313198664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84036070 con 0x7efe8c070850 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.287+0000 7efe8affd640 1 -- 172.21.15.6:0/3313198664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe84031600 con 0x7efe8c070850 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.287+0000 7efe8affd640 1 -- 172.21.15.6:0/3313198664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe840319d0 con 0x7efe8c070850 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.288+0000 7efe92684640 1 -- 172.21.15.6:0/3313198664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c070850 msgr2=0x7efe8c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.288+0000 7efe92684640 1 --2- 172.21.15.6:0/3313198664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c070850 0x7efe8c070c60 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7efe84009e50 tx=0x7efe8402a680 comp rx=0 tx=0).stop 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.288+0000 7efe92684640 1 -- 172.21.15.6:0/3313198664 shutdown_connections 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.288+0000 7efe92684640 1 --2- 172.21.15.6:0/3313198664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c070850 0x7efe8c070c60 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.288+0000 7efe92684640 1 --2- 172.21.15.6:0/3313198664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c071630 0x7efe8c15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.288+0000 7efe92684640 1 -- 172.21.15.6:0/3313198664 >> 172.21.15.6:0/3313198664 conn(0x7efe8c0d29d0 msgr2=0x7efe8c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.288+0000 7efe92684640 1 -- 172.21.15.6:0/3313198664 shutdown_connections 2024-05-20T18:01:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.288+0000 7efe92684640 1 -- 172.21.15.6:0/3313198664 wait complete. 2024-05-20T18:01:41.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.291+0000 7efe92684640 1 Processor -- start 2024-05-20T18:01:41.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.291+0000 7efe92684640 1 -- start start 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe92684640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c070850 0x7efe8c0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe92684640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c071630 0x7efe8c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe92684640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe8c0cd1b0 0x7efe8c1e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe92684640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c06ded0 con 0x7efe8c071630 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe92684640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c06cfc0 con 0x7efe8c0cd1b0 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe92684640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efe8c06d2a0 con 0x7efe8c070850 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c071630 0x7efe8c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c071630 0x7efe8c158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39870/0 (socket says 172.21.15.6:39870) 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 -- 172.21.15.6:0/1018426311 learned_addr learned my addr 172.21.15.6:0/1018426311 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8bfff640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c070850 0x7efe8c0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe90c21640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe8c0cd1b0 0x7efe8c1e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 -- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c070850 msgr2=0x7efe8c0c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c070850 0x7efe8c0c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 -- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe8c0cd1b0 msgr2=0x7efe8c1e7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe8c0cd1b0 0x7efe8c1e7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 -- 172.21.15.6:0/1018426311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c1e8880 con 0x7efe8c071630 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.294+0000 7efe8b7fe640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c071630 0x7efe8c158050 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c440 tx=0x7efe8000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.295+0000 7efe88ff9640 1 -- 172.21.15.6:0/1018426311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80017070 con 0x7efe8c071630 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.295+0000 7efe88ff9640 1 -- 172.21.15.6:0/1018426311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe80005480 con 0x7efe8c071630 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.295+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8c1e8b60 con 0x7efe8c071630 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.295+0000 7efe88ff9640 1 -- 172.21.15.6:0/1018426311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80003830 con 0x7efe8c071630 2024-05-20T18:01:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.295+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe8c1e6e20 con 0x7efe8c071630 2024-05-20T18:01:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.296+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8c1e5670 con 0x7efe8c071630 2024-05-20T18:01:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.297+0000 7efe88ff9640 1 -- 172.21.15.6:0/1018426311 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe8001a070 con 0x7efe8c071630 2024-05-20T18:01:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.297+0000 7efe88ff9640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe7806be30 0x7efe7806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.297+0000 7efe88ff9640 1 -- 172.21.15.6:0/1018426311 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7efe8008a2e0 con 0x7efe8c071630 2024-05-20T18:01:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.298+0000 7efe8bfff640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe7806be30 0x7efe7806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.298+0000 7efe8bfff640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe7806be30 0x7efe7806e340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efe7c006fd0 tx=0x7efe7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:41.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.302+0000 7efe88ff9640 1 -- 172.21.15.6:0/1018426311 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efe8c0711a0 con 0x7efe8c071630 2024-05-20T18:01:41.379 INFO:teuthology.orchestra.run.smithi006.stderr:waiting with handles open 2024-05-20T18:01:41.379 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.539+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe8c075b00 con 0x7efe8c071630 2024-05-20T18:01:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.539+0000 7efe88ff9640 1 -- 172.21.15.6:0/1018426311 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5180 (secure 0 0 0) 0x7efe80058b00 con 0x7efe8c071630 2024-05-20T18:01:41.537 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:01:29.906318+0000","modified":"2024-05-20T18:01:32.936865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/524087551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":524087551},{"type":"v1","addr":"172.21.15.6:6835","nonce":524087551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-05-20T18:01:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 85 2024-05-20T18:01:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.541+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe7806be30 msgr2=0x7efe7806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.541+0000 7efe92684640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe7806be30 0x7efe7806e340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efe7c006fd0 tx=0x7efe7c008040 comp rx=0 tx=0).stop 2024-05-20T18:01:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.541+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c071630 msgr2=0x7efe8c158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.541+0000 7efe92684640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c071630 0x7efe8c158050 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c440 tx=0x7efe8000c900 comp rx=0 tx=0).stop 2024-05-20T18:01:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.542+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 shutdown_connections 2024-05-20T18:01:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.542+0000 7efe92684640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe7806be30 0x7efe7806e340 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.542+0000 7efe92684640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe8c0cd1b0 0x7efe8c1e7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.542+0000 7efe92684640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8c071630 0x7efe8c158050 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.542+0000 7efe92684640 1 --2- 172.21.15.6:0/1018426311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe8c070850 0x7efe8c0c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.542+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 >> 172.21.15.6:0/1018426311 conn(0x7efe8c0d29d0 msgr2=0x7efe8c0b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.542+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 shutdown_connections 2024-05-20T18:01:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.542+0000 7efe92684640 1 -- 172.21.15.6:0/1018426311 wait complete. 2024-05-20T18:01:41.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-20T18:01:41.685 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":8805,"entity":{"name":{"type":"client","num":8805},"addr":{"type":"any","addr":"172.21.15.171:0","nonce":1279037514}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":3.183963356,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9906520470562645,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8805 172.21.15.171:0/1279037514","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":8793,"entity":{"name":{"type":"client","num":8793},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2738321712}},"state":"open","num_leases":1,"num_caps":202,"request_load_avg":225,"uptime":4.3689497169999996,"requests_in_flight":200,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":99.85570021103581,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":94.38749398836427,"halflife":1.5},"recall_caps_throttle2o":{"value":84.089809157506608,"halflife":0.5},"session_cache_liveness":{"value":404.64867594475407,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.8793 192.168.0.1:0/2738321712","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T18:01:41.686 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.171:0", "nonce": 1279037514, "type": "any" }, "name": { "num": 8805, "type": "client" } }, "id": 8805, "inst": "client.8805 172.21.15.171:0/1279037514", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9906520470562645 }, "state": "open", "uptime": 3.183963356 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2738321712, "type": "any" }, "name": { "num": 8793, "type": "client" } }, "id": 8793, "inst": "client.8793 192.168.0.1:0/2738321712", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 202, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 99.85570021103581 }, "recall_caps_throttle": { "halflife": 1.5, "value": 94.38749398836427 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 84.08980915750661 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 225, "requests_in_flight": 200, "session_cache_liveness": { "halflife": 300, "value": 404.6486759447541 }, "state": "open", "uptime": 4.368949717 } ] 2024-05-20T18:01:41.687 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-05-20T18:01:41.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T18:01:41.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.803+0000 7f3935d96640 1 Processor -- start 2024-05-20T18:01:41.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.803+0000 7f3935d96640 1 -- start start 2024-05-20T18:01:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.804+0000 7f3935d96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d4120 0x7f39300d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.804+0000 7f3935d96640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f39300d5030 0x7f393015f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.804+0000 7f3935d96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f393015fc60 0x7f3930160960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.804+0000 7f3935d96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f39300d5440 con 0x7f393015fc60 2024-05-20T18:01:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.804+0000 7f3935d96640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3930160380 con 0x7f39300d5030 2024-05-20T18:01:41.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.804+0000 7f3935d96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3930160660 con 0x7f39300d4120 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f393015fc60 0x7f3930160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f393015fc60 0x7f3930160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39880/0 (socket says 172.21.15.6:39880) 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392ffff640 1 -- 172.21.15.6:0/2994200724 learned_addr learned my addr 172.21.15.6:0/2994200724 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f3927fff640 1 --2- 172.21.15.6:0/2994200724 >> v2:172.21.15.171:3300/0 conn(0x7f39300d5030 0x7f393015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392f7fe640 1 --2- 172.21.15.6:0/2994200724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d4120 0x7f39300d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392ffff640 1 -- 172.21.15.6:0/2994200724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d4120 msgr2=0x7f39300d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392ffff640 1 --2- 172.21.15.6:0/2994200724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d4120 0x7f39300d4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392ffff640 1 -- 172.21.15.6:0/2994200724 >> v2:172.21.15.171:3300/0 conn(0x7f39300d5030 msgr2=0x7f393015f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392ffff640 1 --2- 172.21.15.6:0/2994200724 >> v2:172.21.15.171:3300/0 conn(0x7f39300d5030 0x7f393015f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.805+0000 7f392ffff640 1 -- 172.21.15.6:0/2994200724 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39300d3640 con 0x7f393015fc60 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.806+0000 7f392ffff640 1 --2- 172.21.15.6:0/2994200724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f3930160960 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f393006e7a0 tx=0x7f392802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a69fae8fe44314 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.806+0000 7f392effd640 1 -- 172.21.15.6:0/2994200724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928036070 con 0x7f393015fc60 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.806+0000 7f392effd640 1 -- 172.21.15.6:0/2994200724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3928031600 con 0x7f393015fc60 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.806+0000 7f392effd640 1 -- 172.21.15.6:0/2994200724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39280319d0 con 0x7f393015fc60 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 -- 172.21.15.6:0/2994200724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 msgr2=0x7f3930160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 --2- 172.21.15.6:0/2994200724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f3930160960 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f393006e7a0 tx=0x7f392802a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 -- 172.21.15.6:0/2994200724 shutdown_connections 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 --2- 172.21.15.6:0/2994200724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f3930160960 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 --2- 172.21.15.6:0/2994200724 >> v2:172.21.15.171:3300/0 conn(0x7f39300d5030 0x7f393015f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 --2- 172.21.15.6:0/2994200724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d4120 0x7f39300d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 -- 172.21.15.6:0/2994200724 >> 172.21.15.6:0/2994200724 conn(0x7f393006b520 msgr2=0x7f393006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 -- 172.21.15.6:0/2994200724 shutdown_connections 2024-05-20T18:01:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.807+0000 7f3935d96640 1 -- 172.21.15.6:0/2994200724 wait complete. 2024-05-20T18:01:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.809+0000 7f3935d96640 1 Processor -- start 2024-05-20T18:01:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.809+0000 7f3935d96640 1 -- start start 2024-05-20T18:01:41.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f3935d96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39300d4120 0x7f39301e6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f3935d96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d5030 0x7f39301e6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f3935d96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f39301e7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f3935d96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3930160070 con 0x7f393015fc60 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f3935d96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f39300d31a0 con 0x7f39300d4120 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f3935d96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f39300d4530 con 0x7f39300d5030 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f39301e7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f39301e7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39884/0 (socket says 172.21.15.6:39884) 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392ffff640 1 -- 172.21.15.6:0/565671068 learned_addr learned my addr 172.21.15.6:0/565671068 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392f7fe640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39300d4120 0x7f39301e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f3927fff640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d5030 0x7f39301e6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392ffff640 1 -- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d5030 msgr2=0x7f39301e6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392ffff640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d5030 0x7f39301e6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392ffff640 1 -- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39300d4120 msgr2=0x7f39301e6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392ffff640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39300d4120 0x7f39301e6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.810+0000 7f392ffff640 1 -- 172.21.15.6:0/565671068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39301e8a60 con 0x7f393015fc60 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.811+0000 7f392ffff640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f39301e7510 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f3928009f40 tx=0x7f3928004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:41.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.811+0000 7f392cff9640 1 -- 172.21.15.6:0/565671068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392803f020 con 0x7f393015fc60 2024-05-20T18:01:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.811+0000 7f392cff9640 1 -- 172.21.15.6:0/565671068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3928037040 con 0x7f393015fc60 2024-05-20T18:01:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.811+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39301e8d40 con 0x7f393015fc60 2024-05-20T18:01:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.811+0000 7f392cff9640 1 -- 172.21.15.6:0/565671068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928036070 con 0x7f393015fc60 2024-05-20T18:01:41.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.811+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39301e9300 con 0x7f393015fc60 2024-05-20T18:01:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.812+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39300690b0 con 0x7f393015fc60 2024-05-20T18:01:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.813+0000 7f392cff9640 1 -- 172.21.15.6:0/565671068 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3928042020 con 0x7f393015fc60 2024-05-20T18:01:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.813+0000 7f392cff9640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f391006be30 0x7f391006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.813+0000 7f392cff9640 1 -- 172.21.15.6:0/565671068 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f39280ab710 con 0x7f393015fc60 2024-05-20T18:01:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.813+0000 7f392f7fe640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f391006be30 0x7f391006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:41.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.814+0000 7f392f7fe640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f391006be30 0x7f391006e340 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3920003610 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:41.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:41.818+0000 7f392cff9640 1 -- 172.21.15.6:0/565671068 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3928049020 con 0x7f393015fc60 2024-05-20T18:01:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.044+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f39301e6db0 con 0x7f393015fc60 2024-05-20T18:01:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.044+0000 7f392cff9640 1 -- 172.21.15.6:0/565671068 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f39280798e0 con 0x7f393015fc60 2024-05-20T18:01:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:42.041 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-20T18:01:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f391006be30 msgr2=0x7f391006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f391006be30 0x7f391006e340 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3920003610 tx=0x7f3920008040 comp rx=0 tx=0).stop 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 msgr2=0x7f39301e7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f39301e7510 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f3928009f40 tx=0x7f3928004a40 comp rx=0 tx=0).stop 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 shutdown_connections 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f391006be30 0x7f391006e340 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393015fc60 0x7f39301e7510 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39300d5030 0x7f39301e6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 --2- 172.21.15.6:0/565671068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39300d4120 0x7f39301e6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 >> 172.21.15.6:0/565671068 conn(0x7f393006b520 msgr2=0x7f39300cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 shutdown_connections 2024-05-20T18:01:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:42.046+0000 7f3935d96640 1 -- 172.21.15.6:0/565671068 wait complete. 2024-05-20T18:01:42.054 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-05-20T18:01:42.055 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T18:01:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:47.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T18:01:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.188+0000 7ff8dec44640 1 Processor -- start 2024-05-20T18:01:47.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.188+0000 7ff8dec44640 1 -- start start 2024-05-20T18:01:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.189+0000 7ff8dec44640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff8d80d4120 0x7ff8d80d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.189+0000 7ff8dec44640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d815f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.189+0000 7ff8dec44640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8d815fc60 0x7ff8d8160960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.189+0000 7ff8dec44640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d80d5440 con 0x7ff8d815fc60 2024-05-20T18:01:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.189+0000 7ff8dec44640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d8160380 con 0x7ff8d80d4120 2024-05-20T18:01:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.189+0000 7ff8dec44640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d8160660 con 0x7ff8d80d5030 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dd1e1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8d815fc60 0x7ff8d8160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dd1e1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8d815fc60 0x7ff8d8160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39892/0 (socket says 172.21.15.6:39892) 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dd1e1640 1 -- 172.21.15.6:0/704051719 learned_addr learned my addr 172.21.15.6:0/704051719 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8cffff640 1 --2- 172.21.15.6:0/704051719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d815f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dc9e0640 1 --2- 172.21.15.6:0/704051719 >> v2:172.21.15.171:3300/0 conn(0x7ff8d80d4120 0x7ff8d80d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dd1e1640 1 -- 172.21.15.6:0/704051719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 msgr2=0x7ff8d815f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dd1e1640 1 --2- 172.21.15.6:0/704051719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d815f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dd1e1640 1 -- 172.21.15.6:0/704051719 >> v2:172.21.15.171:3300/0 conn(0x7ff8d80d4120 msgr2=0x7ff8d80d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dd1e1640 1 --2- 172.21.15.6:0/704051719 >> v2:172.21.15.171:3300/0 conn(0x7ff8d80d4120 0x7ff8d80d4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8dd1e1640 1 -- 172.21.15.6:0/704051719 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d80d3640 con 0x7ff8d815fc60 2024-05-20T18:01:47.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.190+0000 7ff8cffff640 1 --2- 172.21.15.6:0/704051719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d815f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.191+0000 7ff8dd1e1640 1 --2- 172.21.15.6:0/704051719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d8160960 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80d27a0 tx=0x7ff8d002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ad1cdf0dd12175 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.191+0000 7ff8cf7fe640 1 -- 172.21.15.6:0/704051719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0036070 con 0x7ff8d815fc60 2024-05-20T18:01:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.191+0000 7ff8cf7fe640 1 -- 172.21.15.6:0/704051719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d0031600 con 0x7ff8d815fc60 2024-05-20T18:01:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.191+0000 7ff8cf7fe640 1 -- 172.21.15.6:0/704051719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00319d0 con 0x7ff8d815fc60 2024-05-20T18:01:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 -- 172.21.15.6:0/704051719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 msgr2=0x7ff8d8160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 --2- 172.21.15.6:0/704051719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d8160960 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80d27a0 tx=0x7ff8d002a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 -- 172.21.15.6:0/704051719 shutdown_connections 2024-05-20T18:01:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 --2- 172.21.15.6:0/704051719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d8160960 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 --2- 172.21.15.6:0/704051719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d815f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 --2- 172.21.15.6:0/704051719 >> v2:172.21.15.171:3300/0 conn(0x7ff8d80d4120 0x7ff8d80d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 -- 172.21.15.6:0/704051719 >> 172.21.15.6:0/704051719 conn(0x7ff8d806b520 msgr2=0x7ff8d806b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 -- 172.21.15.6:0/704051719 shutdown_connections 2024-05-20T18:01:47.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.192+0000 7ff8dec44640 1 -- 172.21.15.6:0/704051719 wait complete. 2024-05-20T18:01:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.194+0000 7ff8dec44640 1 Processor -- start 2024-05-20T18:01:47.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.194+0000 7ff8dec44640 1 -- start start 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dec44640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8d80d4120 0x7ff8d81593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dec44640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d8157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dec44640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d81579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dec44640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d8160070 con 0x7ff8d815fc60 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dec44640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d80d31a0 con 0x7ff8d80d4120 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dec44640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d80d4530 con 0x7ff8d80d5030 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dd1e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d81579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dd1e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d81579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39898/0 (socket says 172.21.15.6:39898) 2024-05-20T18:01:47.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dd1e1640 1 -- 172.21.15.6:0/3672510650 learned_addr learned my addr 172.21.15.6:0/3672510650 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8dc9e0640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8d80d4120 0x7ff8d81593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.195+0000 7ff8cffff640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d8157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8dd1e1640 1 -- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 msgr2=0x7ff8d8157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8dd1e1640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d8157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8dd1e1640 1 -- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8d80d4120 msgr2=0x7ff8d81593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8dd1e1640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8d80d4120 0x7ff8d81593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8dd1e1640 1 -- 172.21.15.6:0/3672510650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d8148b20 con 0x7ff8d815fc60 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8dd1e1640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d81579b0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0034040 tx=0x7ff8d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/3672510650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0036050 con 0x7ff8d815fc60 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/3672510650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d0042070 con 0x7ff8d815fc60 2024-05-20T18:01:47.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d8148e00 con 0x7ff8d815fc60 2024-05-20T18:01:47.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/3672510650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0009510 con 0x7ff8d815fc60 2024-05-20T18:01:47.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.196+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d81567e0 con 0x7ff8d815fc60 2024-05-20T18:01:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.197+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d8159cc0 con 0x7ff8d815fc60 2024-05-20T18:01:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.198+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/3672510650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8d0007bd0 con 0x7ff8d815fc60 2024-05-20T18:01:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.199+0000 7ff8cd7fa640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff8c406be30 0x7ff8c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.199+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/3672510650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7ff8d00abdf0 con 0x7ff8d815fc60 2024-05-20T18:01:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.199+0000 7ff8dc9e0640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff8c406be30 0x7ff8c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.200+0000 7ff8dc9e0640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff8c406be30 0x7ff8c406e340 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4003610 tx=0x7ff8d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:47.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.203+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/3672510650 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff8d0079f30 con 0x7ff8d815fc60 2024-05-20T18:01:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.425+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8d80690b0 con 0x7ff8d815fc60 2024-05-20T18:01:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.426+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/3672510650 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7ff8d007e230 con 0x7ff8d815fc60 2024-05-20T18:01:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:47.423 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-05-20T18:01:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.427+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff8c406be30 msgr2=0x7ff8c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.427+0000 7ff8dec44640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff8c406be30 0x7ff8c406e340 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4003610 tx=0x7ff8d4008040 comp rx=0 tx=0).stop 2024-05-20T18:01:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.427+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 msgr2=0x7ff8d81579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.427+0000 7ff8dec44640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d81579b0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0034040 tx=0x7ff8d0004a40 comp rx=0 tx=0).stop 2024-05-20T18:01:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.428+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 shutdown_connections 2024-05-20T18:01:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.428+0000 7ff8dec44640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff8c406be30 0x7ff8c406e340 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.428+0000 7ff8dec44640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d815fc60 0x7ff8d81579b0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.428+0000 7ff8dec44640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8d80d5030 0x7ff8d8157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.428+0000 7ff8dec44640 1 --2- 172.21.15.6:0/3672510650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8d80d4120 0x7ff8d81593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.428+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 >> 172.21.15.6:0/3672510650 conn(0x7ff8d806b520 msgr2=0x7ff8d80cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.428+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 shutdown_connections 2024-05-20T18:01:47.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.428+0000 7ff8dec44640 1 -- 172.21.15.6:0/3672510650 wait complete. 2024-05-20T18:01:47.436 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-05-20T18:01:47.436 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-05-20T18:01:47.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T18:01:47.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.553+0000 7f845d46c640 1 Processor -- start 2024-05-20T18:01:47.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.553+0000 7f845d46c640 1 -- start start 2024-05-20T18:01:47.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.554+0000 7f845d46c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84580d1590 0x7f84580cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.554+0000 7f845d46c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84580b41f0 con 0x7f84580b81e0 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.554+0000 7f845d46c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f845808cbb0 con 0x7f84580cddc0 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.554+0000 7f845d46c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f84580b3000 con 0x7f84580d1590 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.554+0000 7f84567fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84580d1590 0x7f84580cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.554+0000 7f84567fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84580d1590 0x7f84580cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39902/0 (socket says 172.21.15.6:39902) 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.554+0000 7f84567fc640 1 -- 172.21.15.6:0/1794722941 learned_addr learned my addr 172.21.15.6:0/1794722941 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.554+0000 7f8456ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f84580b81e0 0x7f84580d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51976/0 (socket says 172.21.15.6:51976) 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.555+0000 7f84567fc640 1 -- 172.21.15.6:0/1794722941 >> v1:172.21.15.171:6789/0 conn(0x7f84580cddc0 legacy=0x7f84580ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.555+0000 7f84567fc640 1 -- 172.21.15.6:0/1794722941 >> v1:172.21.15.6:6789/0 conn(0x7f84580b81e0 legacy=0x7f84580d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.555+0000 7f8455ffb640 1 -- 172.21.15.6:0/1794722941 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560427907 0 0) 0x7f84580b41f0 con 0x7f84580b81e0 2024-05-20T18:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.555+0000 7f84567fc640 1 -- 172.21.15.6:0/1794722941 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845808ce70 con 0x7f84580d1590 2024-05-20T18:01:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.555+0000 7f84567fc640 1 --2- 172.21.15.6:0/1794722941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580cd880 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f8440009870 tx=0x7f844002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60503ba4e5b8997 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f8455ffb640 1 -- 172.21.15.6:0/1794722941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440037070 con 0x7f84580d1590 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f8455ffb640 1 -- 172.21.15.6:0/1794722941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f844002ae50 con 0x7f84580d1590 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f8455ffb640 1 -- 172.21.15.6:0/1794722941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440032860 con 0x7f84580d1590 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f845d46c640 1 -- 172.21.15.6:0/1794722941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 msgr2=0x7f84580cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f845d46c640 1 --2- 172.21.15.6:0/1794722941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580cd880 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f8440009870 tx=0x7f844002a300 comp rx=0 tx=0).stop 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f845d46c640 1 -- 172.21.15.6:0/1794722941 shutdown_connections 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f845d46c640 1 --2- 172.21.15.6:0/1794722941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580cd880 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f845d46c640 1 -- 172.21.15.6:0/1794722941 >> 172.21.15.6:0/1794722941 conn(0x7f84580b44f0 msgr2=0x7f84580b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f845d46c640 1 -- 172.21.15.6:0/1794722941 shutdown_connections 2024-05-20T18:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.556+0000 7f845d46c640 1 -- 172.21.15.6:0/1794722941 wait complete. 2024-05-20T18:01:47.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.558+0000 7f845d46c640 1 Processor -- start 2024-05-20T18:01:47.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.558+0000 7f845d46c640 1 -- start start 2024-05-20T18:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f845d46c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84580b81e0 0x7f845809d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f845d46c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84580cddc0 0x7f84581e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f845d46c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f845d46c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f84580b3490 con 0x7f84580d1590 2024-05-20T18:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f845d46c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f84580ce8e0 con 0x7f84580cddc0 2024-05-20T18:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f845d46c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f845809e370 con 0x7f84580b81e0 2024-05-20T18:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39904/0 (socket says 172.21.15.6:39904) 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 -- 172.21.15.6:0/3331800863 learned_addr learned my addr 172.21.15.6:0/3331800863 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84567fc640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84580cddc0 0x7f84581e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f8456ffd640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84580b81e0 0x7f845809d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 -- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84580b81e0 msgr2=0x7f845809d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84580b81e0 0x7f845809d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 -- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84580cddc0 msgr2=0x7f84581e15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84580cddc0 0x7f84581e15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 -- 172.21.15.6:0/3331800863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84580c65d0 con 0x7f84580d1590 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.560+0000 7f84577fe640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580c7670 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f845000c3f0 tx=0x7f845000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.561+0000 7f844f7fe640 1 -- 172.21.15.6:0/3331800863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450017070 con 0x7f84580d1590 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.561+0000 7f844f7fe640 1 -- 172.21.15.6:0/3331800863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84500052d0 con 0x7f84580d1590 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.561+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84580c68b0 con 0x7f84580d1590 2024-05-20T18:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.561+0000 7f844f7fe640 1 -- 172.21.15.6:0/3331800863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450003830 con 0x7f84580d1590 2024-05-20T18:01:47.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.561+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84580c6e70 con 0x7f84580d1590 2024-05-20T18:01:47.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.562+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84580690b0 con 0x7f84580d1590 2024-05-20T18:01:47.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.562+0000 7f844f7fe640 1 -- 172.21.15.6:0/3331800863 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f845001a070 con 0x7f84580d1590 2024-05-20T18:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.563+0000 7f844f7fe640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f843806be30 0x7f843806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.563+0000 7f844f7fe640 1 -- 172.21.15.6:0/3331800863 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f845008a290 con 0x7f84580d1590 2024-05-20T18:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.563+0000 7f8456ffd640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f843806be30 0x7f843806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.563+0000 7f8456ffd640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f843806be30 0x7f843806e340 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8458070430 tx=0x7f8448009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.567+0000 7f844f7fe640 1 -- 172.21.15.6:0/3331800863 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8450058490 con 0x7f84580d1590 2024-05-20T18:01:47.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.788+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f845808c790 con 0x7f84580d1590 2024-05-20T18:01:47.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.789+0000 7f844f7fe640 1 -- 172.21.15.6:0/3331800863 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f845005c790 con 0x7f84580d1590 2024-05-20T18:01:47.786 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:47.786 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-05-20T18:01:47.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f843806be30 msgr2=0x7f843806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f843806be30 0x7f843806e340 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8458070430 tx=0x7f8448009040 comp rx=0 tx=0).stop 2024-05-20T18:01:47.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 msgr2=0x7f84580c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580c7670 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f845000c3f0 tx=0x7f845000c7f0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 shutdown_connections 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f843806be30 0x7f843806e340 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84580d1590 0x7f84580c7670 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84580cddc0 0x7f84581e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 --2- 172.21.15.6:0/3331800863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84580b81e0 0x7f845809d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 >> 172.21.15.6:0/3331800863 conn(0x7f84580b44f0 msgr2=0x7f84580af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 shutdown_connections 2024-05-20T18:01:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47.791+0000 7f845d46c640 1 -- 172.21.15.6:0/3331800863 wait complete. 2024-05-20T18:01:47.799 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-20T18:01:47.799 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-05-20T18:01:47.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:47 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-05-20T18:01:49.388 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:01:49.388 INFO:teuthology.orchestra.run.smithi006.stderr:stdin closed, goodbye! 2024-05-20T18:01:49.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:01:49.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:49.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.584+0000 7f836d673640 1 Processor -- start 2024-05-20T18:01:49.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.584+0000 7f836d673640 1 -- start start 2024-05-20T18:01:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f836d673640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f836815d530 0x7f836815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:49.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f836d673640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83680cd580 con 0x7f83680b1700 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f836d673640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83680cd860 con 0x7f8368070850 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f836d673640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f83680ce190 con 0x7f836815d530 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f83667fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f83680b1700 0x7f83680b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42458/0 (socket says 172.21.15.6:42458) 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f83667fc640 1 -- 172.21.15.6:0/636333096 learned_addr learned my addr 172.21.15.6:0/636333096 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f8366ffd640 1 --2- 172.21.15.6:0/636333096 >> v2:172.21.15.171:3300/0 conn(0x7f836815d530 0x7f836815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145719470 0 0) 0x7f83680cd580 con 0x7f83680b1700 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.587+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8350003520 con 0x7f83680b1700 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3349132929 0 0) 0x7f8350003520 con 0x7f83680b1700 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 >> v2:172.21.15.171:3300/0 conn(0x7f836815d530 msgr2=0x7f836815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 --2- 172.21.15.6:0/636333096 >> v2:172.21.15.171:3300/0 conn(0x7f836815d530 0x7f836815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 >> v1:172.21.15.171:6789/0 conn(0x7f8368070850 legacy=0x7f8368070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83680cdb40 con 0x7f83680b1700 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f835c001670 con 0x7f83680b1700 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 >> v1:172.21.15.6:6789/0 conn(0x7f83680b1700 legacy=0x7f83680b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f8350003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8350004800 0x7f8350004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83500051c0 0x7f835000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83680ce190 con 0x7f83500039b0 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f835000c160 con 0x7f8350004800 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f835000c360 con 0x7f83500051c0 2024-05-20T18:01:49.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8366ffd640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f8350003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f83667fc640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8350004800 0x7f8350004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f83677fe640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83500051c0 0x7f835000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8366ffd640 1 -- 172.21.15.6:0/636333096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83500051c0 msgr2=0x7f835000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8366ffd640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83500051c0 0x7f835000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8366ffd640 1 -- 172.21.15.6:0/636333096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8350004800 msgr2=0x7f8350004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8366ffd640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8350004800 0x7f8350004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f8366ffd640 1 -- 172.21.15.6:0/636333096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8350003520 con 0x7f83500039b0 2024-05-20T18:01:49.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.588+0000 7f83677fe640 1 -- 172.21.15.6:0/636333096 reap_dead start 2024-05-20T18:01:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.589+0000 7f8366ffd640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f8350003e20 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f8358009a90 tx=0x7f8350005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814c07ac47e98be3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.589+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358036070 con 0x7f83500039b0 2024-05-20T18:01:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.589+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8358031400 con 0x7f83500039b0 2024-05-20T18:01:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.589+0000 7f8365ffb640 1 -- 172.21.15.6:0/636333096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358009690 con 0x7f83500039b0 2024-05-20T18:01:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.590+0000 7f836d673640 1 -- 172.21.15.6:0/636333096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 msgr2=0x7f8350003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.590+0000 7f836d673640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f8350003e20 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f8358009a90 tx=0x7f8350005830 comp rx=0 tx=0).stop 2024-05-20T18:01:49.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.590+0000 7f836d673640 1 -- 172.21.15.6:0/636333096 shutdown_connections 2024-05-20T18:01:49.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.590+0000 7f836d673640 1 --2- 172.21.15.6:0/636333096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f8350003e20 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.590+0000 7f836d673640 1 -- 172.21.15.6:0/636333096 >> 172.21.15.6:0/636333096 conn(0x7f83680d29d0 msgr2=0x7f83680d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:49.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.591+0000 7f836d673640 1 -- 172.21.15.6:0/636333096 shutdown_connections 2024-05-20T18:01:49.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.591+0000 7f836d673640 1 -- 172.21.15.6:0/636333096 wait complete. 2024-05-20T18:01:49.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.593+0000 7f836d673640 1 Processor -- start 2024-05-20T18:01:49.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.593+0000 7f836d673640 1 -- start start 2024-05-20T18:01:49.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f836d673640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f83680cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:49.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f836d673640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83680c9af0 0x7f83680b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:49.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f836d673640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83680c8ac0 0x7f83680b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f836d673640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f836815aaa0 con 0x7f83500039b0 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f836d673640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f83680cd230 con 0x7f83680c8ac0 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f836d673640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f836815ac20 con 0x7f83680c9af0 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f8366ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f83680cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f8366ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f83680cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59218/0 (socket says 172.21.15.6:59218) 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f8366ffd640 1 -- 172.21.15.6:0/2074504611 learned_addr learned my addr 172.21.15.6:0/2074504611 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f83677fe640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83680c8ac0 0x7f83680b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f83667fc640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83680c9af0 0x7f83680b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f8366ffd640 1 -- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83680c9af0 msgr2=0x7f83680b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f8366ffd640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83680c9af0 0x7f83680b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f8366ffd640 1 -- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83680c8ac0 msgr2=0x7f83680b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:49.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f8366ffd640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83680c8ac0 0x7f83680b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.594+0000 7f8366ffd640 1 -- 172.21.15.6:0/2074504611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83680c7a20 con 0x7f83500039b0 2024-05-20T18:01:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.595+0000 7f8366ffd640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f83680cb7f0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f835802aac0 tx=0x7f8358004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.595+0000 7f834f7fe640 1 -- 172.21.15.6:0/2074504611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358040020 con 0x7f83500039b0 2024-05-20T18:01:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.595+0000 7f834f7fe640 1 -- 172.21.15.6:0/2074504611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835803b680 con 0x7f83500039b0 2024-05-20T18:01:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.595+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83680c7d00 con 0x7f83500039b0 2024-05-20T18:01:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.595+0000 7f834f7fe640 1 -- 172.21.15.6:0/2074504611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358036040 con 0x7f83500039b0 2024-05-20T18:01:49.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.595+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83680c82c0 con 0x7f83500039b0 2024-05-20T18:01:49.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.596+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83680c7540 con 0x7f83500039b0 2024-05-20T18:01:49.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.597+0000 7f834f7fe640 1 -- 172.21.15.6:0/2074504611 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8358043020 con 0x7f83500039b0 2024-05-20T18:01:49.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.597+0000 7f834f7fe640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f835406be30 0x7f835406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:49.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.597+0000 7f834f7fe640 1 -- 172.21.15.6:0/2074504611 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f83580ab5a0 con 0x7f83500039b0 2024-05-20T18:01:49.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.597+0000 7f83667fc640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f835406be30 0x7f835406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:49.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.598+0000 7f83667fc640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f835406be30 0x7f835406e340 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f836806e7e0 tx=0x7f835c000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:49.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.602+0000 7f834f7fe640 1 -- 172.21.15.6:0/2074504611 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f83680c7540 con 0x7f83500039b0 2024-05-20T18:01:49.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.823+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8368075b00 con 0x7f83500039b0 2024-05-20T18:01:49.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.824+0000 7f834f7fe640 1 -- 172.21.15.6:0/2074504611 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5180 (secure 0 0 0) 0x7f835804a030 con 0x7f83500039b0 2024-05-20T18:01:49.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:49.821 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":87,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:01:29.906318+0000","modified":"2024-05-20T18:01:46.562607+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6835/524087551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":524087551},{"type":"v1","addr":"172.21.15.6:6835","nonce":524087551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-05-20T18:01:49.821 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 87 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.825+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f835406be30 msgr2=0x7f835406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.825+0000 7f836d673640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f835406be30 0x7f835406e340 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f836806e7e0 tx=0x7f835c000ed0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.825+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 msgr2=0x7f83680cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.825+0000 7f836d673640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f83680cb7f0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f835802aac0 tx=0x7f8358004730 comp rx=0 tx=0).stop 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.826+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 shutdown_connections 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.826+0000 7f836d673640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f835406be30 0x7f835406e340 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.826+0000 7f836d673640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83680c8ac0 0x7f83680b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.826+0000 7f836d673640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83680c9af0 0x7f83680b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.826+0000 7f836d673640 1 --2- 172.21.15.6:0/2074504611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83500039b0 0x7f83680cb7f0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.826+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 >> 172.21.15.6:0/2074504611 conn(0x7f83680d29d0 msgr2=0x7f836815e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.826+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 shutdown_connections 2024-05-20T18:01:49.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:49.826+0000 7f836d673640 1 -- 172.21.15.6:0/2074504611 wait complete. 2024-05-20T18:01:49.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-20T18:01:49.969 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":8805,"entity":{"name":{"type":"client","num":8805},"addr":{"type":"any","addr":"172.21.15.171:0","nonce":1279037514}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":11.469867989000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9339420689260196,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8805 172.21.15.171:0/1279037514","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":8793,"entity":{"name":{"type":"client","num":8793},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2738321712}},"state":"open","num_leases":1,"num_caps":102,"request_load_avg":205,"uptime":12.654854350000001,"requests_in_flight":0,"num_completed_requests":200,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":756.11113873097543,"halflife":60},"release_caps":{"value":99.578077690696773,"halflife":60},"recall_caps_throttle":{"value":220.38629397992281,"halflife":1.5},"recall_caps_throttle2o":{"value":75.912778423441381,"halflife":0.5},"session_cache_liveness":{"value":396.97556078384901,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.8793 192.168.0.1:0/2738321712","completed_requests":[{"tid":29,"created_ino":"0x10000000001"},{"tid":30,"created_ino":"0x100000001f6"},{"tid":31,"created_ino":"0x100000001f7"},{"tid":32,"created_ino":"0x100000001f8"},{"tid":33,"created_ino":"0x100000001f9"},{"tid":34,"created_ino":"0x100000001fa"},{"tid":35,"created_ino":"0x100000001fb"},{"tid":36,"created_ino":"0x100000001fc"},{"tid":37,"created_ino":"0x100000001fd"},{"tid":38,"created_ino":"0x100000001fe"},{"tid":39,"created_ino":"0x100000001ff"},{"tid":40,"created_ino":"0x10000000200"},{"tid":41,"created_ino":"0x10000000201"},{"tid":42,"created_ino":"0x10000000202"},{"tid":43,"created_ino":"0x10000000203"},{"tid":44,"created_ino":"0x10000000204"},{"tid":45,"created_ino":"0x10000000205"},{"tid":46,"created_ino":"0x10000000206"},{"tid":47,"created_ino":"0x10000000207"},{"tid":48,"created_ino":"0x10000000208"},{"tid":49,"created_ino":"0x10000000209"},{"tid":50,"created_ino":"0x1000000020a"},{"tid":51,"created_ino":"0x1000000020b"},{"tid":52,"created_ino":"0x1000000020c"},{"tid":53,"created_ino":"0x1000000020d"},{"tid":54,"created_ino":"0x1000000020e"},{"tid":55,"created_ino":"0x1000000020f"},{"tid":56,"created_ino":"0x10000000210"},{"tid":57,"created_ino":"0x10000000211"},{"tid":58,"created_ino":"0x10000000212"},{"tid":59,"created_ino":"0x10000000213"},{"tid":60,"created_ino":"0x10000000214"},{"tid":61,"created_ino":"0x10000000215"},{"tid":62,"created_ino":"0x10000000216"},{"tid":63,"created_ino":"0x10000000217"},{"tid":64,"created_ino":"0x10000000218"},{"tid":65,"created_ino":"0x10000000219"},{"tid":66,"created_ino":"0x1000000021a"},{"tid":67,"created_ino":"0x1000000021b"},{"tid":68,"created_ino":"0x1000000021c"},{"tid":69,"created_ino":"0x1000000021d"},{"tid":70,"created_ino":"0x1000000021e"},{"tid":71,"created_ino":"0x1000000021f"},{"tid":72,"created_ino":"0x10000000220"},{"tid":73,"created_ino":"0x10000000221"},{"tid":74,"created_ino":"0x10000000222"},{"tid":75,"created_ino":"0x10000000223"},{"tid":76,"created_ino":"0x10000000224"},{"tid":77,"created_ino":"0x10000000225"},{"tid":78,"created_ino":"0x10000000226"},{"tid":79,"created_ino":"0x10000000227"},{"tid":80,"created_ino":"0x10000000228"},{"tid":81,"created_ino":"0x10000000229"},{"tid":82,"created_ino":"0x1000000022a"},{"tid":83,"created_ino":"0x1000000022b"},{"tid":84,"created_ino":"0x1000000022c"},{"tid":85,"created_ino":"0x1000000022d"},{"tid":86,"created_ino":"0x1000000022e"},{"tid":87,"created_ino":"0x1000000022f"},{"tid":88,"created_ino":"0x10000000230"},{"tid":89,"created_ino":"0x10000000231"},{"tid":90,"created_ino":"0x10000000232"},{"tid":91,"created_ino":"0x10000000233"},{"tid":92,"created_ino":"0x10000000234"},{"tid":93,"created_ino":"0x10000000235"},{"tid":94,"created_ino":"0x10000000236"},{"tid":95,"created_ino":"0x10000000237"},{"tid":96,"created_ino":"0x10000000238"},{"tid":97,"created_ino":"0x10000000239"},{"tid":98,"created_ino":"0x1000000023a"},{"tid":99,"created_ino":"0x1000000023b"},{"tid":100,"created_ino":"0x1000000023c"},{"tid":101,"created_ino":"0x1000000023d"},{"tid":102,"created_ino":"0x1000000023e"},{"tid":103,"created_ino":"0x1000000023f"},{"tid":104,"created_ino":"0x10000000240"},{"tid":105,"created_ino":"0x10000000241"},{"tid":106,"created_ino":"0x10000000242"},{"tid":107,"created_ino":"0x10000000243"},{"tid":108,"created_ino":"0x10000000244"},{"tid":109,"created_ino":"0x10000000245"},{"tid":110,"created_ino":"0x10000000246"},{"tid":111,"created_ino":"0x10000000247"},{"tid":112,"created_ino":"0x10000000248"},{"tid":113,"created_ino":"0x10000000249"},{"tid":114,"created_ino":"0x1000000024a"},{"tid":115,"created_ino":"0x1000000024b"},{"tid":116,"created_ino":"0x1000000024c"},{"tid":117,"created_ino":"0x1000000024d"},{"tid":118,"created_ino":"0x1000000024e"},{"tid":119,"created_ino":"0x1000000024f"},{"tid":120,"created_ino":"0x10000000250"},{"tid":121,"created_ino":"0x10000000251"},{"tid":122,"created_ino":"0x10000000252"},{"tid":123,"created_ino":"0x10000000253"},{"tid":124,"created_ino":"0x10000000254"},{"tid":125,"created_ino":"0x10000000255"},{"tid":126,"created_ino":"0x10000000256"},{"tid":127,"created_ino":"0x10000000257"},{"tid":128,"created_ino":"0x10000000258"},{"tid":129,"created_ino":"0x10000000259"},{"tid":130,"created_ino":"0x1000000025a"},{"tid":131,"created_ino":"0x1000000025b"},{"tid":132,"created_ino":"0x1000000025c"},{"tid":133,"created_ino":"0x1000000025d"},{"tid":134,"created_ino":"0x1000000025e"},{"tid":135,"created_ino":"0x1000000025f"},{"tid":136,"created_ino":"0x10000000260"},{"tid":137,"created_ino":"0x10000000261"},{"tid":138,"created_ino":"0x10000000262"},{"tid":139,"created_ino":"0x10000000263"},{"tid":140,"created_ino":"0x10000000264"},{"tid":141,"created_ino":"0x10000000265"},{"tid":142,"created_ino":"0x10000000266"},{"tid":143,"created_ino":"0x10000000267"},{"tid":144,"created_ino":"0x10000000268"},{"tid":145,"created_ino":"0x10000000269"},{"tid":146,"created_ino":"0x1000000026a"},{"tid":147,"created_ino":"0x1000000026b"},{"tid":148,"created_ino":"0x1000000026c"},{"tid":149,"created_ino":"0x1000000026d"},{"tid":150,"created_ino":"0x1000000026e"},{"tid":151,"created_ino":"0x1000000026f"},{"tid":152,"created_ino":"0x10000000270"},{"tid":153,"created_ino":"0x10000000271"},{"tid":154,"created_ino":"0x10000000272"},{"tid":155,"created_ino":"0x10000000273"},{"tid":156,"created_ino":"0x10000000274"},{"tid":157,"created_ino":"0x10000000275"},{"tid":158,"created_ino":"0x10000000276"},{"tid":159,"created_ino":"0x10000000277"},{"tid":160,"created_ino":"0x10000000278"},{"tid":161,"created_ino":"0x10000000279"},{"tid":162,"created_ino":"0x1000000027a"},{"tid":163,"created_ino":"0x1000000027b"},{"tid":164,"created_ino":"0x1000000027c"},{"tid":165,"created_ino":"0x1000000027d"},{"tid":166,"created_ino":"0x1000000027e"},{"tid":167,"created_ino":"0x1000000027f"},{"tid":168,"created_ino":"0x10000000280"},{"tid":169,"created_ino":"0x10000000281"},{"tid":170,"created_ino":"0x10000000282"},{"tid":171,"created_ino":"0x10000000283"},{"tid":172,"created_ino":"0x10000000284"},{"tid":173,"created_ino":"0x10000000285"},{"tid":174,"created_ino":"0x10000000286"},{"tid":175,"created_ino":"0x10000000287"},{"tid":176,"created_ino":"0x10000000288"},{"tid":177,"created_ino":"0x10000000289"},{"tid":178,"created_ino":"0x1000000028a"},{"tid":179,"created_ino":"0x1000000028b"},{"tid":180,"created_ino":"0x1000000028c"},{"tid":181,"created_ino":"0x1000000028d"},{"tid":182,"created_ino":"0x1000000028e"},{"tid":183,"created_ino":"0x1000000028f"},{"tid":184,"created_ino":"0x10000000290"},{"tid":185,"created_ino":"0x10000000291"},{"tid":186,"created_ino":"0x10000000292"},{"tid":187,"created_ino":"0x10000000293"},{"tid":188,"created_ino":"0x10000000294"},{"tid":189,"created_ino":"0x10000000295"},{"tid":190,"created_ino":"0x10000000296"},{"tid":191,"created_ino":"0x10000000297"},{"tid":192,"created_ino":"0x10000000298"},{"tid":193,"created_ino":"0x10000000299"},{"tid":194,"created_ino":"0x1000000029a"},{"tid":195,"created_ino":"0x1000000029b"},{"tid":196,"created_ino":"0x1000000029c"},{"tid":197,"created_ino":"0x1000000029d"},{"tid":198,"created_ino":"0x1000000029e"},{"tid":199,"created_ino":"0x1000000029f"},{"tid":200,"created_ino":"0x100000002a0"},{"tid":201,"created_ino":"0x100000002a1"},{"tid":202,"created_ino":"0x100000002a2"},{"tid":203,"created_ino":"0x100000002a3"},{"tid":204,"created_ino":"0x100000002a4"},{"tid":205,"created_ino":"0x100000002a5"},{"tid":206,"created_ino":"0x100000002a6"},{"tid":207,"created_ino":"0x100000002a7"},{"tid":208,"created_ino":"0x100000002a8"},{"tid":209,"created_ino":"0x100000002a9"},{"tid":210,"created_ino":"0x100000002aa"},{"tid":211,"created_ino":"0x100000002ab"},{"tid":212,"created_ino":"0x100000002ac"},{"tid":213,"created_ino":"0x100000002ad"},{"tid":214,"created_ino":"0x100000002ae"},{"tid":215,"created_ino":"0x100000002af"},{"tid":216,"created_ino":"0x100000002b0"},{"tid":217,"created_ino":"0x100000002b1"},{"tid":218,"created_ino":"0x100000002b2"},{"tid":219,"created_ino":"0x100000002b3"},{"tid":220,"created_ino":"0x100000002b4"},{"tid":221,"created_ino":"0x100000002b5"},{"tid":222,"created_ino":"0x100000002b6"},{"tid":223,"created_ino":"0x100000002b7"},{"tid":224,"created_ino":"0x100000002b8"},{"tid":225,"created_ino":"0x100000002b9"},{"tid":226,"created_ino":"0x100000002ba"},{"tid":227,"created_ino":"0x100000002bb"},{"tid":228,"created_ino":"0x100000002bc"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x100000002bd","length":802}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T18:01:49.973 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.171:0", "nonce": 1279037514, "type": "any" }, "name": { "num": 8805, "type": "client" } }, "id": 8805, "inst": "client.8805 172.21.15.171:0/1279037514", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9339420689260196 }, "state": "open", "uptime": 11.469867989 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 29 }, { "created_ino": "0x100000001f6", "tid": 30 }, { "created_ino": "0x100000001f7", "tid": 31 }, { "created_ino": "0x100000001f8", "tid": 32 }, { "created_ino": "0x100000001f9", "tid": 33 }, { "created_ino": "0x100000001fa", "tid": 34 }, { "created_ino": "0x100000001fb", "tid": 35 }, { "created_ino": "0x100000001fc", "tid": 36 }, { "created_ino": "0x100000001fd", "tid": 37 }, { "created_ino": "0x100000001fe", "tid": 38 }, { "created_ino": "0x100000001ff", "tid": 39 }, { "created_ino": "0x10000000200", "tid": 40 }, { "created_ino": "0x10000000201", "tid": 41 }, { "created_ino": "0x10000000202", "tid": 42 }, { "created_ino": "0x10000000203", "tid": 43 }, { "created_ino": "0x10000000204", "tid": 44 }, { "created_ino": "0x10000000205", "tid": 45 }, { "created_ino": "0x10000000206", "tid": 46 }, { "created_ino": "0x10000000207", "tid": 47 }, { "created_ino": "0x10000000208", "tid": 48 }, { "created_ino": "0x10000000209", "tid": 49 }, { "created_ino": "0x1000000020a", "tid": 50 }, { "created_ino": "0x1000000020b", "tid": 51 }, { "created_ino": "0x1000000020c", "tid": 52 }, { "created_ino": "0x1000000020d", "tid": 53 }, { "created_ino": "0x1000000020e", "tid": 54 }, { "created_ino": "0x1000000020f", "tid": 55 }, { "created_ino": "0x10000000210", "tid": 56 }, { "created_ino": "0x10000000211", "tid": 57 }, { "created_ino": "0x10000000212", "tid": 58 }, { "created_ino": "0x10000000213", "tid": 59 }, { "created_ino": "0x10000000214", "tid": 60 }, { "created_ino": "0x10000000215", "tid": 61 }, { "created_ino": "0x10000000216", "tid": 62 }, { "created_ino": "0x10000000217", "tid": 63 }, { "created_ino": "0x10000000218", "tid": 64 }, { "created_ino": "0x10000000219", "tid": 65 }, { "created_ino": "0x1000000021a", "tid": 66 }, { "created_ino": "0x1000000021b", "tid": 67 }, { "created_ino": "0x1000000021c", "tid": 68 }, { "created_ino": "0x1000000021d", "tid": 69 }, { "created_ino": "0x1000000021e", "tid": 70 }, { "created_ino": "0x1000000021f", "tid": 71 }, { "created_ino": "0x10000000220", "tid": 72 }, { "created_ino": "0x10000000221", "tid": 73 }, { "created_ino": "0x10000000222", "tid": 74 }, { "created_ino": "0x10000000223", "tid": 75 }, { "created_ino": "0x10000000224", "tid": 76 }, { "created_ino": "0x10000000225", "tid": 77 }, { "created_ino": "0x10000000226", "tid": 78 }, { "created_ino": "0x10000000227", "tid": 79 }, { "created_ino": "0x10000000228", "tid": 80 }, { "created_ino": "0x10000000229", "tid": 81 }, { "created_ino": "0x1000000022a", "tid": 82 }, { "created_ino": "0x1000000022b", "tid": 83 }, { "created_ino": "0x1000000022c", "tid": 84 }, { "created_ino": "0x1000000022d", "tid": 85 }, { "created_ino": "0x1000000022e", "tid": 86 }, { "created_ino": "0x1000000022f", "tid": 87 }, { "created_ino": "0x10000000230", "tid": 88 }, { "created_ino": "0x10000000231", "tid": 89 }, { "created_ino": "0x10000000232", "tid": 90 }, { "created_ino": "0x10000000233", "tid": 91 }, { "created_ino": "0x10000000234", "tid": 92 }, { "created_ino": "0x10000000235", "tid": 93 }, { "created_ino": "0x10000000236", "tid": 94 }, { "created_ino": "0x10000000237", "tid": 95 }, { "created_ino": "0x10000000238", "tid": 96 }, { "created_ino": "0x10000000239", "tid": 97 }, { "created_ino": "0x1000000023a", "tid": 98 }, { "created_ino": "0x1000000023b", "tid": 99 }, { "created_ino": "0x1000000023c", "tid": 100 }, { "created_ino": "0x1000000023d", "tid": 101 }, { "created_ino": "0x1000000023e", "tid": 102 }, { "created_ino": "0x1000000023f", "tid": 103 }, { "created_ino": "0x10000000240", "tid": 104 }, { "created_ino": "0x10000000241", "tid": 105 }, { "created_ino": "0x10000000242", "tid": 106 }, { "created_ino": "0x10000000243", "tid": 107 }, { "created_ino": "0x10000000244", "tid": 108 }, { "created_ino": "0x10000000245", "tid": 109 }, { "created_ino": "0x10000000246", "tid": 110 }, { "created_ino": "0x10000000247", "tid": 111 }, { "created_ino": "0x10000000248", "tid": 112 }, { "created_ino": "0x10000000249", "tid": 113 }, { "created_ino": "0x1000000024a", "tid": 114 }, { "created_ino": "0x1000000024b", "tid": 115 }, { "created_ino": "0x1000000024c", "tid": 116 }, { "created_ino": "0x1000000024d", "tid": 117 }, { "created_ino": "0x1000000024e", "tid": 118 }, { "created_ino": "0x1000000024f", "tid": 119 }, { "created_ino": "0x10000000250", "tid": 120 }, { "created_ino": "0x10000000251", "tid": 121 }, { "created_ino": "0x10000000252", "tid": 122 }, { "created_ino": "0x10000000253", "tid": 123 }, { "created_ino": "0x10000000254", "tid": 124 }, { "created_ino": "0x10000000255", "tid": 125 }, { "created_ino": "0x10000000256", "tid": 126 }, { "created_ino": "0x10000000257", "tid": 127 }, { "created_ino": "0x10000000258", "tid": 128 }, { "created_ino": "0x10000000259", "tid": 129 }, { "created_ino": "0x1000000025a", "tid": 130 }, { "created_ino": "0x1000000025b", "tid": 131 }, { "created_ino": "0x1000000025c", "tid": 132 }, { "created_ino": "0x1000000025d", "tid": 133 }, { "created_ino": "0x1000000025e", "tid": 134 }, { "created_ino": "0x1000000025f", "tid": 135 }, { "created_ino": "0x10000000260", "tid": 136 }, { "created_ino": "0x10000000261", "tid": 137 }, { "created_ino": "0x10000000262", "tid": 138 }, { "created_ino": "0x10000000263", "tid": 139 }, { "created_ino": "0x10000000264", "tid": 140 }, { "created_ino": "0x10000000265", "tid": 141 }, { "created_ino": "0x10000000266", "tid": 142 }, { "created_ino": "0x10000000267", "tid": 143 }, { "created_ino": "0x10000000268", "tid": 144 }, { "created_ino": "0x10000000269", "tid": 145 }, { "created_ino": "0x1000000026a", "tid": 146 }, { "created_ino": "0x1000000026b", "tid": 147 }, { "created_ino": "0x1000000026c", "tid": 148 }, { "created_ino": "0x1000000026d", "tid": 149 }, { "created_ino": "0x1000000026e", "tid": 150 }, { "created_ino": "0x1000000026f", "tid": 151 }, { "created_ino": "0x10000000270", "tid": 152 }, { "created_ino": "0x10000000271", "tid": 153 }, { "created_ino": "0x10000000272", "tid": 154 }, { "created_ino": "0x10000000273", "tid": 155 }, { "created_ino": "0x10000000274", "tid": 156 }, { "created_ino": "0x10000000275", "tid": 157 }, { "created_ino": "0x10000000276", "tid": 158 }, { "created_ino": "0x10000000277", "tid": 159 }, { "created_ino": "0x10000000278", "tid": 160 }, { "created_ino": "0x10000000279", "tid": 161 }, { "created_ino": "0x1000000027a", "tid": 162 }, { "created_ino": "0x1000000027b", "tid": 163 }, { "created_ino": "0x1000000027c", "tid": 164 }, { "created_ino": "0x1000000027d", "tid": 165 }, { "created_ino": "0x1000000027e", "tid": 166 }, { "created_ino": "0x1000000027f", "tid": 167 }, { "created_ino": "0x10000000280", "tid": 168 }, { "created_ino": "0x10000000281", "tid": 169 }, { "created_ino": "0x10000000282", "tid": 170 }, { "created_ino": "0x10000000283", "tid": 171 }, { "created_ino": "0x10000000284", "tid": 172 }, { "created_ino": "0x10000000285", "tid": 173 }, { "created_ino": "0x10000000286", "tid": 174 }, { "created_ino": "0x10000000287", "tid": 175 }, { "created_ino": "0x10000000288", "tid": 176 }, { "created_ino": "0x10000000289", "tid": 177 }, { "created_ino": "0x1000000028a", "tid": 178 }, { "created_ino": "0x1000000028b", "tid": 179 }, { "created_ino": "0x1000000028c", "tid": 180 }, { "created_ino": "0x1000000028d", "tid": 181 }, { "created_ino": "0x1000000028e", "tid": 182 }, { "created_ino": "0x1000000028f", "tid": 183 }, { "created_ino": "0x10000000290", "tid": 184 }, { "created_ino": "0x10000000291", "tid": 185 }, { "created_ino": "0x10000000292", "tid": 186 }, { "created_ino": "0x10000000293", "tid": 187 }, { "created_ino": "0x10000000294", "tid": 188 }, { "created_ino": "0x10000000295", "tid": 189 }, { "created_ino": "0x10000000296", "tid": 190 }, { "created_ino": "0x10000000297", "tid": 191 }, { "created_ino": "0x10000000298", "tid": 192 }, { "created_ino": "0x10000000299", "tid": 193 }, { "created_ino": "0x1000000029a", "tid": 194 }, { "created_ino": "0x1000000029b", "tid": 195 }, { "created_ino": "0x1000000029c", "tid": 196 }, { "created_ino": "0x1000000029d", "tid": 197 }, { "created_ino": "0x1000000029e", "tid": 198 }, { "created_ino": "0x1000000029f", "tid": 199 }, { "created_ino": "0x100000002a0", "tid": 200 }, { "created_ino": "0x100000002a1", "tid": 201 }, { "created_ino": "0x100000002a2", "tid": 202 }, { "created_ino": "0x100000002a3", "tid": 203 }, { "created_ino": "0x100000002a4", "tid": 204 }, { "created_ino": "0x100000002a5", "tid": 205 }, { "created_ino": "0x100000002a6", "tid": 206 }, { "created_ino": "0x100000002a7", "tid": 207 }, { "created_ino": "0x100000002a8", "tid": 208 }, { "created_ino": "0x100000002a9", "tid": 209 }, { "created_ino": "0x100000002aa", "tid": 210 }, { "created_ino": "0x100000002ab", "tid": 211 }, { "created_ino": "0x100000002ac", "tid": 212 }, { "created_ino": "0x100000002ad", "tid": 213 }, { "created_ino": "0x100000002ae", "tid": 214 }, { "created_ino": "0x100000002af", "tid": 215 }, { "created_ino": "0x100000002b0", "tid": 216 }, { "created_ino": "0x100000002b1", "tid": 217 }, { "created_ino": "0x100000002b2", "tid": 218 }, { "created_ino": "0x100000002b3", "tid": 219 }, { "created_ino": "0x100000002b4", "tid": 220 }, { "created_ino": "0x100000002b5", "tid": 221 }, { "created_ino": "0x100000002b6", "tid": 222 }, { "created_ino": "0x100000002b7", "tid": 223 }, { "created_ino": "0x100000002b8", "tid": 224 }, { "created_ino": "0x100000002b9", "tid": 225 }, { "created_ino": "0x100000002ba", "tid": 226 }, { "created_ino": "0x100000002bb", "tid": 227 }, { "created_ino": "0x100000002bc", "tid": 228 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2738321712, "type": "any" }, "name": { "num": 8793, "type": "client" } }, "id": 8793, "inst": "client.8793 192.168.0.1:0/2738321712", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 102, "num_completed_flushes": 0, "num_completed_requests": 200, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 802, "start": "0x100000002bd" } ], "recall_caps": { "halflife": 60, "value": 756.1111387309754 }, "recall_caps_throttle": { "halflife": 1.5, "value": 220.3862939799228 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 75.91277842344138 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 99.57807769069677 }, "request_load_avg": 205, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 396.975560783849 }, "state": "open", "uptime": 12.65485435 } ] 2024-05-20T18:01:49.973 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-20T18:01:49.974 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:01:49.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:01:50.029 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:01:50.073 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:01:50.073 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:01:50.073 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 200\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi006') 2024-05-20T18:01:50.074 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:50.074 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:50.091 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:50.091 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:50.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:50.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.304+0000 7efc5dc73640 1 Processor -- start 2024-05-20T18:01:50.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.304+0000 7efc5dc73640 1 -- start start 2024-05-20T18:01:50.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.305+0000 7efc5dc73640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc580d4400 0x7efc5815f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.305+0000 7efc5dc73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 0x7efc5806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.305+0000 7efc5dc73640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc5808d2a0 con 0x7efc580d2780 2024-05-20T18:01:50.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.305+0000 7efc5dc73640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7efc580d3f70 con 0x7efc580d4400 2024-05-20T18:01:50.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.305+0000 7efc5dc73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc5806d850 con 0x7efc5806cf00 2024-05-20T18:01:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.305+0000 7efc577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc580d4400 0x7efc5815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.305+0000 7efc577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc580d4400 0x7efc5815f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59224/0 (socket says 172.21.15.6:59224) 2024-05-20T18:01:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.305+0000 7efc577fe640 1 -- 172.21.15.6:0/1909344158 learned_addr learned my addr 172.21.15.6:0/1909344158 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.306+0000 7efc4ffff640 1 --2- 172.21.15.6:0/1909344158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 0x7efc5806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.306+0000 7efc577fe640 1 -- 172.21.15.6:0/1909344158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 msgr2=0x7efc5806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.306+0000 7efc577fe640 1 --2- 172.21.15.6:0/1909344158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 0x7efc5806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.306+0000 7efc577fe640 1 -- 172.21.15.6:0/1909344158 >> v1:172.21.15.171:6789/0 conn(0x7efc580d2780 legacy=0x7efc580d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.306+0000 7efc577fe640 1 -- 172.21.15.6:0/1909344158 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc580d4810 con 0x7efc580d4400 2024-05-20T18:01:50.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.307+0000 7efc577fe640 1 --2- 172.21.15.6:0/1909344158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d4400 0x7efc5815f440 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7efc480098a0 tx=0x7efc4802a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9881bf30fa59bf24 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.307+0000 7efc56ffd640 1 -- 172.21.15.6:0/1909344158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48037070 con 0x7efc580d4400 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.307+0000 7efc56ffd640 1 -- 172.21.15.6:0/1909344158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc48032640 con 0x7efc580d4400 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.307+0000 7efc56ffd640 1 -- 172.21.15.6:0/1909344158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48032a10 con 0x7efc580d4400 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.308+0000 7efc5dc73640 1 -- 172.21.15.6:0/1909344158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d4400 msgr2=0x7efc5815f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.308+0000 7efc5dc73640 1 --2- 172.21.15.6:0/1909344158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d4400 0x7efc5815f440 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7efc480098a0 tx=0x7efc4802a320 comp rx=0 tx=0).stop 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.308+0000 7efc5dc73640 1 -- 172.21.15.6:0/1909344158 shutdown_connections 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.308+0000 7efc5dc73640 1 --2- 172.21.15.6:0/1909344158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 0x7efc5806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.308+0000 7efc5dc73640 1 --2- 172.21.15.6:0/1909344158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d4400 0x7efc5815f440 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.308+0000 7efc5dc73640 1 -- 172.21.15.6:0/1909344158 >> 172.21.15.6:0/1909344158 conn(0x7efc580d4bb0 msgr2=0x7efc580d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.308+0000 7efc5dc73640 1 -- 172.21.15.6:0/1909344158 shutdown_connections 2024-05-20T18:01:50.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.308+0000 7efc5dc73640 1 -- 172.21.15.6:0/1909344158 wait complete. 2024-05-20T18:01:50.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.309+0000 7efc5dc73640 1 Processor -- start 2024-05-20T18:01:50.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.309+0000 7efc5dc73640 1 -- start start 2024-05-20T18:01:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc5dc73640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 0x7efc581f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc5dc73640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d2780 0x7efc580cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc5dc73640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc580d4400 0x7efc580b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc5dc73640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc580d3920 con 0x7efc580d2780 2024-05-20T18:01:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc5dc73640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc580d3640 con 0x7efc580d4400 2024-05-20T18:01:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc5dc73640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc580d3c00 con 0x7efc5806cf00 2024-05-20T18:01:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d2780 0x7efc580cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d2780 0x7efc580cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59240/0 (socket says 172.21.15.6:59240) 2024-05-20T18:01:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 -- 172.21.15.6:0/2953081832 learned_addr learned my addr 172.21.15.6:0/2953081832 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc577fe640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 0x7efc581f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc57fff640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc580d4400 0x7efc580b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 -- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 msgr2=0x7efc581f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 0x7efc581f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 -- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc580d4400 msgr2=0x7efc580b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc580d4400 0x7efc580b9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 -- 172.21.15.6:0/2953081832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc580cdca0 con 0x7efc580d2780 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc57fff640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc580d4400 0x7efc580b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.311+0000 7efc4ffff640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d2780 0x7efc580cd760 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7efc4000d5d0 tx=0x7efc4000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.312+0000 7efc54ff9640 1 -- 172.21.15.6:0/2953081832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc400125f0 con 0x7efc580d2780 2024-05-20T18:01:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.312+0000 7efc54ff9640 1 -- 172.21.15.6:0/2953081832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc40019070 con 0x7efc580d2780 2024-05-20T18:01:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.312+0000 7efc54ff9640 1 -- 172.21.15.6:0/2953081832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc400129f0 con 0x7efc580d2780 2024-05-20T18:01:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.312+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc581561f0 con 0x7efc580d2780 2024-05-20T18:01:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.312+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc581568e0 con 0x7efc580d2780 2024-05-20T18:01:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.313+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc580735a0 con 0x7efc580d2780 2024-05-20T18:01:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.313+0000 7efc54ff9640 1 -- 172.21.15.6:0/2953081832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc40012b90 con 0x7efc580d2780 2024-05-20T18:01:50.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.314+0000 7efc54ff9640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc3806be60 0x7efc3806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.314+0000 7efc54ff9640 1 -- 172.21.15.6:0/2953081832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7efc4008b3f0 con 0x7efc580d2780 2024-05-20T18:01:50.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.314+0000 7efc577fe640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc3806be60 0x7efc3806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.315+0000 7efc577fe640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc3806be60 0x7efc3806e370 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7efc48034000 tx=0x7efc4802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.319+0000 7efc54ff9640 1 -- 172.21.15.6:0/2953081832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efc580735a0 con 0x7efc580d2780 2024-05-20T18:01:50.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.502+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc58075b00 con 0x7efc580d2780 2024-05-20T18:01:50.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.503+0000 7efc54ff9640 1 -- 172.21.15.6:0/2953081832 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16852 (secure 0 0 0) 0x7efc580cdca0 con 0x7efc580d2780 2024-05-20T18:01:50.501 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:50.501 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":125,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:31.516805+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:01:27.629166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-05-20T18:01:28.885867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.505+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc3806be60 msgr2=0x7efc3806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.505+0000 7efc5dc73640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc3806be60 0x7efc3806e370 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7efc48034000 tx=0x7efc4802e000 comp rx=0 tx=0).stop 2024-05-20T18:01:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.505+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d2780 msgr2=0x7efc580cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.505+0000 7efc5dc73640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d2780 0x7efc580cd760 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7efc4000d5d0 tx=0x7efc4000da90 comp rx=0 tx=0).stop 2024-05-20T18:01:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.505+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 shutdown_connections 2024-05-20T18:01:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.505+0000 7efc5dc73640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc3806be60 0x7efc3806e370 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.506+0000 7efc5dc73640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc580d4400 0x7efc580b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.506+0000 7efc5dc73640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc580d2780 0x7efc580cd760 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.506+0000 7efc5dc73640 1 --2- 172.21.15.6:0/2953081832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc5806cf00 0x7efc581f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.506+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 >> 172.21.15.6:0/2953081832 conn(0x7efc580d4bb0 msgr2=0x7efc5815fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.506+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 shutdown_connections 2024-05-20T18:01:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.506+0000 7efc5dc73640 1 -- 172.21.15.6:0/2953081832 wait complete. 2024-05-20T18:01:50.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:01:27.629166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:01:28.885867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:01:50.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:01:50.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.636+0000 7f22a506e640 1 Processor -- start 2024-05-20T18:01:50.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.636+0000 7f22a506e640 1 -- start start 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f22a506e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f22a0162820 0x7f22a00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f22a506e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22a00b3e80 0x7f22a006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f22a506e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a006dd20 con 0x7f22a006d910 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f22a506e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f22a00d0630 con 0x7f22a00b3e80 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f22a506e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f22a00d39c0 con 0x7f22a0162820 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f229e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22a00b3e80 0x7f22a006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f229e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f22a00b3e80 0x7f22a006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59250/0 (socket says 172.21.15.6:59250) 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f229e59c640 1 -- 172.21.15.6:0/2884933705 learned_addr learned my addr 172.21.15.6:0/2884933705 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f229ed9d640 1 --2- 172.21.15.6:0/2884933705 >> v2:172.21.15.171:3300/0 conn(0x7f22a0162820 0x7f22a00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f229e59c640 1 -- 172.21.15.6:0/2884933705 >> v2:172.21.15.171:3300/0 conn(0x7f22a0162820 msgr2=0x7f22a00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f229e59c640 1 --2- 172.21.15.6:0/2884933705 >> v2:172.21.15.171:3300/0 conn(0x7f22a0162820 0x7f22a00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f229e59c640 1 -- 172.21.15.6:0/2884933705 >> v1:172.21.15.171:6789/0 conn(0x7f22a006d910 legacy=0x7f22a00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.638+0000 7f229e59c640 1 -- 172.21.15.6:0/2884933705 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a00d3ca0 con 0x7f22a00b3e80 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.639+0000 7f229e59c640 1 --2- 172.21.15.6:0/2884933705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a00b3e80 0x7f22a006d3d0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f22a00b7740 tx=0x7f229002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6060e39d707d0f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.639+0000 7f229dd9b640 1 -- 172.21.15.6:0/2884933705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290037070 con 0x7f22a00b3e80 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.639+0000 7f229dd9b640 1 -- 172.21.15.6:0/2884933705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2290032440 con 0x7f22a00b3e80 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.639+0000 7f229dd9b640 1 -- 172.21.15.6:0/2884933705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290032810 con 0x7f22a00b3e80 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.640+0000 7f22a506e640 1 -- 172.21.15.6:0/2884933705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a00b3e80 msgr2=0x7f22a006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.640+0000 7f22a506e640 1 --2- 172.21.15.6:0/2884933705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a00b3e80 0x7f22a006d3d0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f22a00b7740 tx=0x7f229002a270 comp rx=0 tx=0).stop 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.640+0000 7f22a506e640 1 -- 172.21.15.6:0/2884933705 shutdown_connections 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.640+0000 7f22a506e640 1 --2- 172.21.15.6:0/2884933705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a00b3e80 0x7f22a006d3d0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.640+0000 7f22a506e640 1 --2- 172.21.15.6:0/2884933705 >> v2:172.21.15.171:3300/0 conn(0x7f22a0162820 0x7f22a00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.640+0000 7f22a506e640 1 -- 172.21.15.6:0/2884933705 >> 172.21.15.6:0/2884933705 conn(0x7f22a00d4bd0 msgr2=0x7f22a00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:50.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.640+0000 7f22a506e640 1 -- 172.21.15.6:0/2884933705 shutdown_connections 2024-05-20T18:01:50.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.640+0000 7f22a506e640 1 -- 172.21.15.6:0/2884933705 wait complete. 2024-05-20T18:01:50.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.642+0000 7f22a506e640 1 Processor -- start 2024-05-20T18:01:50.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.642+0000 7f22a506e640 1 -- start start 2024-05-20T18:01:50.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.643+0000 7f22a506e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a006d910 0x7f22a01539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f22a506e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22a00b3e80 0x7f22a00c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f22a506e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22a0162820 0x7f22a00b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f22a506e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f22a00d0300 con 0x7f22a006d910 2024-05-20T18:01:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f22a506e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22a00d4260 con 0x7f22a0162820 2024-05-20T18:01:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f22a506e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22a00b91a0 con 0x7f22a00b3e80 2024-05-20T18:01:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a006d910 0x7f22a01539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a006d910 0x7f22a01539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59256/0 (socket says 172.21.15.6:59256) 2024-05-20T18:01:50.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 -- 172.21.15.6:0/3506826547 learned_addr learned my addr 172.21.15.6:0/3506826547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:50.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229f59e640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22a0162820 0x7f22a00b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229e59c640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22a00b3e80 0x7f22a00c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 -- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22a00b3e80 msgr2=0x7f22a00c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22a00b3e80 0x7f22a00c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 -- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22a0162820 msgr2=0x7f22a00b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22a0162820 0x7f22a00b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 -- 172.21.15.6:0/3506826547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a015ac30 con 0x7f22a006d910 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229e59c640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22a00b3e80 0x7f22a00c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f229ed9d640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a006d910 0x7f22a01539c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f228800e870 tx=0x7f228800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f22977fe640 1 -- 172.21.15.6:0/3506826547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288017070 con 0x7f22a006d910 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f22977fe640 1 -- 172.21.15.6:0/3506826547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228800c940 con 0x7f22a006d910 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.644+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a015af10 con 0x7f22a006d910 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.645+0000 7f22977fe640 1 -- 172.21.15.6:0/3506826547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228800cd30 con 0x7f22a006d910 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.645+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a00b5e20 con 0x7f22a006d910 2024-05-20T18:01:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.645+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a00d12c0 con 0x7f22a006d910 2024-05-20T18:01:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.646+0000 7f22977fe640 1 -- 172.21.15.6:0/3506826547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f228801a070 con 0x7f22a006d910 2024-05-20T18:01:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.647+0000 7f22977fe640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f228006be30 0x7f228006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.647+0000 7f22977fe640 1 -- 172.21.15.6:0/3506826547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f228808b1a0 con 0x7f22a006d910 2024-05-20T18:01:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.647+0000 7f229e59c640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f228006be30 0x7f228006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.648+0000 7f229e59c640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f228006be30 0x7f228006e340 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2290034000 tx=0x7f229002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.651+0000 7f22977fe640 1 -- 172.21.15.6:0/3506826547 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f22a00d12c0 con 0x7f22a006d910 2024-05-20T18:01:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.834+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22a0075b00 con 0x7f22a006d910 2024-05-20T18:01:50.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.834+0000 7f22977fe640 1 -- 172.21.15.6:0/3506826547 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) ==== 93+0+10 (secure 0 0 0) 0x7f2288059370 con 0x7f22a006d910 2024-05-20T18:01:50.831 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:01:50.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f228006be30 msgr2=0x7f228006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f228006be30 0x7f228006e340 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2290034000 tx=0x7f229002e000 comp rx=0 tx=0).stop 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a006d910 msgr2=0x7f22a01539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a006d910 0x7f22a01539c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f228800e870 tx=0x7f228800ed30 comp rx=0 tx=0).stop 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 shutdown_connections 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f228006be30 0x7f228006e340 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22a0162820 0x7f22a00b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22a00b3e80 0x7f22a00c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 --2- 172.21.15.6:0/3506826547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a006d910 0x7f22a01539c0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 >> 172.21.15.6:0/3506826547 conn(0x7f22a00d4bd0 msgr2=0x7f22a00ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 shutdown_connections 2024-05-20T18:01:50.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.836+0000 7f22a506e640 1 -- 172.21.15.6:0/3506826547 wait complete. 2024-05-20T18:01:50.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:01:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.965+0000 7f3ade426640 1 Processor -- start 2024-05-20T18:01:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.965+0000 7f3ade426640 1 -- start start 2024-05-20T18:01:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ade426640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ad8162820 0x7f3ad80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ade426640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ade426640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad806dd20 con 0x7f3ad806d910 2024-05-20T18:01:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ade426640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad80d0630 con 0x7f3ad8162820 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ade426640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad80d39c0 con 0x7f3ad80b3e80 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ad7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ad8162820 0x7f3ad80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3adc9c3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3ad806d910 0x7f3ad80d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42472/0 (socket says 172.21.15.6:42472) 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ad7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3ad8162820 0x7f3ad80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59272/0 (socket says 172.21.15.6:59272) 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3adc9c3640 1 -- 172.21.15.6:0/2959445457 learned_addr learned my addr 172.21.15.6:0/2959445457 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3acffff640 1 --2- 172.21.15.6:0/2959445457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ad7fff640 1 -- 172.21.15.6:0/2959445457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 msgr2=0x7f3ad806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ad7fff640 1 --2- 172.21.15.6:0/2959445457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ad7fff640 1 -- 172.21.15.6:0/2959445457 >> v1:172.21.15.6:6789/0 conn(0x7f3ad806d910 legacy=0x7f3ad80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ad7fff640 1 -- 172.21.15.6:0/2959445457 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad80d3ca0 con 0x7f3ad8162820 2024-05-20T18:01:50.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.967+0000 7f3ad77fe640 1 -- 172.21.15.6:0/2959445457 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638317761 0 0) 0x7f3ad0001490 con 0x7f3ad806d910 2024-05-20T18:01:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.968+0000 7f3ad7fff640 1 --2- 172.21.15.6:0/2959445457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad8162820 0x7f3ad80b3940 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80097a0 tx=0x7f3ac802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62f8088d883b89c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.968+0000 7f3ad77fe640 1 -- 172.21.15.6:0/2959445457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8037070 con 0x7f3ad8162820 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.968+0000 7f3ad77fe640 1 -- 172.21.15.6:0/2959445457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac8032440 con 0x7f3ad8162820 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.968+0000 7f3ad77fe640 1 -- 172.21.15.6:0/2959445457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8032810 con 0x7f3ad8162820 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.969+0000 7f3ade426640 1 -- 172.21.15.6:0/2959445457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad8162820 msgr2=0x7f3ad80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.969+0000 7f3ade426640 1 --2- 172.21.15.6:0/2959445457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad8162820 0x7f3ad80b3940 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80097a0 tx=0x7f3ac802a180 comp rx=0 tx=0).stop 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.969+0000 7f3ade426640 1 -- 172.21.15.6:0/2959445457 shutdown_connections 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.969+0000 7f3ade426640 1 --2- 172.21.15.6:0/2959445457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.969+0000 7f3ade426640 1 --2- 172.21.15.6:0/2959445457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad8162820 0x7f3ad80b3940 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.969+0000 7f3ade426640 1 -- 172.21.15.6:0/2959445457 >> 172.21.15.6:0/2959445457 conn(0x7f3ad80d4bd0 msgr2=0x7f3ad80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.969+0000 7f3ade426640 1 -- 172.21.15.6:0/2959445457 shutdown_connections 2024-05-20T18:01:50.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.969+0000 7f3ade426640 1 -- 172.21.15.6:0/2959445457 wait complete. 2024-05-20T18:01:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.971+0000 7f3ade426640 1 Processor -- start 2024-05-20T18:01:50.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.971+0000 7f3ade426640 1 -- start start 2024-05-20T18:01:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ade426640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad806d910 0x7f3ad80cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ade426640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad81f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ade426640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ad8162820 0x7f3ad80cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ade426640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad80d0300 con 0x7f3ad806d910 2024-05-20T18:01:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ade426640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad80d4260 con 0x7f3ad8162820 2024-05-20T18:01:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ade426640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad80b91a0 con 0x7f3ad80b3e80 2024-05-20T18:01:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ad7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad806d910 0x7f3ad80cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ad7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad806d910 0x7f3ad80cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59288/0 (socket says 172.21.15.6:59288) 2024-05-20T18:01:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3ad7fff640 1 -- 172.21.15.6:0/1548405547 learned_addr learned my addr 172.21.15.6:0/1548405547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3acffff640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad81f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.972+0000 7f3adc9c3640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ad8162820 0x7f3ad80cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad7fff640 1 -- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 msgr2=0x7f3ad81f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad7fff640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad81f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad7fff640 1 -- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ad8162820 msgr2=0x7f3ad80cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad7fff640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ad8162820 0x7f3ad80cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad7fff640 1 -- 172.21.15.6:0/1548405547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad80ce840 con 0x7f3ad806d910 2024-05-20T18:01:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3acffff640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad81f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3adc9c3640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ad8162820 0x7f3ad80cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad7fff640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad806d910 0x7f3ad80cdf40 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000c00 tx=0x7f3ac80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad57fa640 1 -- 172.21.15.6:0/1548405547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8037040 con 0x7f3ad806d910 2024-05-20T18:01:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad57fa640 1 -- 172.21.15.6:0/1548405547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac8042070 con 0x7f3ad806d910 2024-05-20T18:01:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad80ceb20 con 0x7f3ad806d910 2024-05-20T18:01:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ad57fa640 1 -- 172.21.15.6:0/1548405547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8030bb0 con 0x7f3ad806d910 2024-05-20T18:01:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.973+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad80cf0e0 con 0x7f3ad806d910 2024-05-20T18:01:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.974+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad8075b00 con 0x7f3ad806d910 2024-05-20T18:01:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.975+0000 7f3ad57fa640 1 -- 172.21.15.6:0/1548405547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ac8047460 con 0x7f3ad806d910 2024-05-20T18:01:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.975+0000 7f3ad57fa640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ab806be30 0x7f3ab806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.975+0000 7f3ad57fa640 1 -- 172.21.15.6:0/1548405547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f3ac80abcc0 con 0x7f3ad806d910 2024-05-20T18:01:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.975+0000 7f3acffff640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ab806be30 0x7f3ab806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.976+0000 7f3acffff640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ab806be30 0x7f3ab806e340 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0006fd0 tx=0x7f3ac0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:50.980+0000 7f3ad57fa640 1 -- 172.21.15.6:0/1548405547 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3ac8032e20 con 0x7f3ad806d910 2024-05-20T18:01:51.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.163+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3ad80ba920 con 0x7f3ad806d910 2024-05-20T18:01:51.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.163+0000 7f3ad57fa640 1 -- 172.21.15.6:0/1548405547 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) ==== 104+0+11 (secure 0 0 0) 0x7f3ac807a450 con 0x7f3ad806d910 2024-05-20T18:01:51.161 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:01:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ab806be30 msgr2=0x7f3ab806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ab806be30 0x7f3ab806e340 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0006fd0 tx=0x7f3ac0008040 comp rx=0 tx=0).stop 2024-05-20T18:01:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad806d910 msgr2=0x7f3ad80cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad806d910 0x7f3ad80cdf40 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000c00 tx=0x7f3ac80046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 shutdown_connections 2024-05-20T18:01:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ab806be30 0x7f3ab806e340 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ad8162820 0x7f3ad80cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ad80b3e80 0x7f3ad81f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 --2- 172.21.15.6:0/1548405547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad806d910 0x7f3ad80cdf40 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.165+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 >> 172.21.15.6:0/1548405547 conn(0x7f3ad80d4bd0 msgr2=0x7f3ad80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.166+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 shutdown_connections 2024-05-20T18:01:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.166+0000 7f3ade426640 1 -- 172.21.15.6:0/1548405547 wait complete. 2024-05-20T18:01:51.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:01:51.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.296+0000 7f313db45640 1 Processor -- start 2024-05-20T18:01:51.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.296+0000 7f313db45640 1 -- start start 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f313db45640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f313815f220 0x7f31380cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f313db45640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31380cf910 0x7f31380d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f313db45640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31380cfd20 con 0x7f31380cd680 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f313db45640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f31380cda90 con 0x7f31380cf910 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f313db45640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f313806d0f0 con 0x7f313815f220 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f3137fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31380cf910 0x7f31380d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f3137fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31380cf910 0x7f31380d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59304/0 (socket says 172.21.15.6:59304) 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f3137fff640 1 -- 172.21.15.6:0/3258894774 learned_addr learned my addr 172.21.15.6:0/3258894774 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.297+0000 7f3136ffd640 1 --2- 172.21.15.6:0/3258894774 >> v2:172.21.15.171:3300/0 conn(0x7f313815f220 0x7f31380cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.298+0000 7f3137fff640 1 -- 172.21.15.6:0/3258894774 >> v2:172.21.15.171:3300/0 conn(0x7f313815f220 msgr2=0x7f31380cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.298+0000 7f3137fff640 1 --2- 172.21.15.6:0/3258894774 >> v2:172.21.15.171:3300/0 conn(0x7f313815f220 0x7f31380cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.298+0000 7f3137fff640 1 -- 172.21.15.6:0/3258894774 >> v1:172.21.15.171:6789/0 conn(0x7f31380cd680 legacy=0x7f313806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.298+0000 7f3137fff640 1 -- 172.21.15.6:0/3258894774 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313806d3d0 con 0x7f31380cf910 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.298+0000 7f3137fff640 1 --2- 172.21.15.6:0/3258894774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31380cf910 0x7f31380d1060 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3138070110 tx=0x7f313002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41da2f9dafa2246 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.298+0000 7f31367fc640 1 -- 172.21.15.6:0/3258894774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130036070 con 0x7f31380cf910 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f31367fc640 1 -- 172.21.15.6:0/3258894774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130031600 con 0x7f31380cf910 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f31367fc640 1 -- 172.21.15.6:0/3258894774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31300319d0 con 0x7f31380cf910 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f313db45640 1 -- 172.21.15.6:0/3258894774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31380cf910 msgr2=0x7f31380d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f313db45640 1 --2- 172.21.15.6:0/3258894774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31380cf910 0x7f31380d1060 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3138070110 tx=0x7f313002a610 comp rx=0 tx=0).stop 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f313db45640 1 -- 172.21.15.6:0/3258894774 shutdown_connections 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f313db45640 1 --2- 172.21.15.6:0/3258894774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31380cf910 0x7f31380d1060 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f313db45640 1 --2- 172.21.15.6:0/3258894774 >> v2:172.21.15.171:3300/0 conn(0x7f313815f220 0x7f31380cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f313db45640 1 -- 172.21.15.6:0/3258894774 >> 172.21.15.6:0/3258894774 conn(0x7f31380b44d0 msgr2=0x7f31380b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:51.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f313db45640 1 -- 172.21.15.6:0/3258894774 shutdown_connections 2024-05-20T18:01:51.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.299+0000 7f313db45640 1 -- 172.21.15.6:0/3258894774 wait complete. 2024-05-20T18:01:51.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.301+0000 7f313db45640 1 Processor -- start 2024-05-20T18:01:51.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.301+0000 7f313db45640 1 -- start start 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.302+0000 7f313db45640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31380cd680 0x7f3138157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f313db45640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31380cf910 0x7f31380cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f313db45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f313815f220 0x7f31380ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f313db45640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f313806d990 con 0x7f313815f220 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f313db45640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f31380d0b80 con 0x7f31380cf910 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f313db45640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f313806cdd0 con 0x7f31380cd680 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f313815f220 0x7f31380ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f313815f220 0x7f31380ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59316/0 (socket says 172.21.15.6:59316) 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 -- 172.21.15.6:0/2950428129 learned_addr learned my addr 172.21.15.6:0/2950428129 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3136ffd640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31380cf910 0x7f31380cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f31377fe640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31380cd680 0x7f3138157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 -- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31380cd680 msgr2=0x7f3138157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31380cd680 0x7f3138157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 -- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31380cf910 msgr2=0x7f31380cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31380cf910 0x7f31380cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 -- 172.21.15.6:0/2950428129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3138157fd0 con 0x7f313815f220 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f3137fff640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f313815f220 0x7f31380ce160 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f313002ac00 tx=0x7f3130004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f311ffff640 1 -- 172.21.15.6:0/2950428129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313003f020 con 0x7f313815f220 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f311ffff640 1 -- 172.21.15.6:0/2950428129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130037040 con 0x7f313815f220 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.303+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3138160490 con 0x7f313815f220 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.304+0000 7f311ffff640 1 -- 172.21.15.6:0/2950428129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130036070 con 0x7f313815f220 2024-05-20T18:01:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.304+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3138160a50 con 0x7f313815f220 2024-05-20T18:01:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.304+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31381601f0 con 0x7f313815f220 2024-05-20T18:01:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.305+0000 7f311ffff640 1 -- 172.21.15.6:0/2950428129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3130042020 con 0x7f313815f220 2024-05-20T18:01:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.305+0000 7f311ffff640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f312406be60 0x7f312406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.306+0000 7f311ffff640 1 -- 172.21.15.6:0/2950428129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f31300ab330 con 0x7f313815f220 2024-05-20T18:01:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.306+0000 7f31377fe640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f312406be60 0x7f312406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.306+0000 7f31377fe640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f312406be60 0x7f312406e370 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f31380b1cd0 tx=0x7f3128009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.310+0000 7f311ffff640 1 -- 172.21.15.6:0/2950428129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f31381601f0 con 0x7f313815f220 2024-05-20T18:01:51.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.492+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3138075b00 con 0x7f313815f220 2024-05-20T18:01:51.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.492+0000 7f311ffff640 1 -- 172.21.15.6:0/2950428129 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) ==== 100+0+11 (secure 0 0 0) 0x7f3130049030 con 0x7f313815f220 2024-05-20T18:01:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:01:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f312406be60 msgr2=0x7f312406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f312406be60 0x7f312406e370 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f31380b1cd0 tx=0x7f3128009040 comp rx=0 tx=0).stop 2024-05-20T18:01:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f313815f220 msgr2=0x7f31380ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f313815f220 0x7f31380ce160 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f313002ac00 tx=0x7f3130004a40 comp rx=0 tx=0).stop 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 shutdown_connections 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f312406be60 0x7f312406e370 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f313815f220 0x7f31380ce160 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31380cf910 0x7f31380cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 --2- 172.21.15.6:0/2950428129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31380cd680 0x7f3138157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 >> 172.21.15.6:0/2950428129 conn(0x7f31380b44d0 msgr2=0x7f31380b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 shutdown_connections 2024-05-20T18:01:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.494+0000 7f313db45640 1 -- 172.21.15.6:0/2950428129 wait complete. 2024-05-20T18:01:51.503 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:01:51.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.621+0000 7fc24b1ce640 1 Processor -- start 2024-05-20T18:01:51.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.621+0000 7fc24b1ce640 1 -- start start 2024-05-20T18:01:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc24b1ce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc244162820 0x7fc2440b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc24b1ce640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc24406dae0 0x7fc2440b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc24b1ce640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2440d0630 con 0x7fc2440b3e80 2024-05-20T18:01:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc24b1ce640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc2440d39c0 con 0x7fc244162820 2024-05-20T18:01:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc24b1ce640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc2440d3ca0 con 0x7fc24406dae0 2024-05-20T18:01:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc248f6a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc244162820 0x7fc2440b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc248f6a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc244162820 0x7fc2440b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59322/0 (socket says 172.21.15.6:59322) 2024-05-20T18:01:51.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc248f6a640 1 -- 172.21.15.6:0/2839139123 learned_addr learned my addr 172.21.15.6:0/2839139123 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc248f6a640 1 -- 172.21.15.6:0/2839139123 >> v2:172.21.15.171:3300/0 conn(0x7fc24406dae0 msgr2=0x7fc2440b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc24976b640 1 --2- 172.21.15.6:0/2839139123 >> v2:172.21.15.171:3300/0 conn(0x7fc24406dae0 0x7fc2440b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc248f6a640 1 --2- 172.21.15.6:0/2839139123 >> v2:172.21.15.171:3300/0 conn(0x7fc24406dae0 0x7fc2440b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc248f6a640 1 -- 172.21.15.6:0/2839139123 >> v1:172.21.15.171:6789/0 conn(0x7fc2440b3e80 legacy=0x7fc24406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.623+0000 7fc248f6a640 1 -- 172.21.15.6:0/2839139123 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2440d3f80 con 0x7fc244162820 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.624+0000 7fc248f6a640 1 --2- 172.21.15.6:0/2839139123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc244162820 0x7fc2440b3940 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fc24408e070 tx=0x7fc23802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21123343dfbd51d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.624+0000 7fc2437fe640 1 -- 172.21.15.6:0/2839139123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238037070 con 0x7fc244162820 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.624+0000 7fc2437fe640 1 -- 172.21.15.6:0/2839139123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc238032440 con 0x7fc244162820 2024-05-20T18:01:51.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.624+0000 7fc2437fe640 1 -- 172.21.15.6:0/2839139123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238032810 con 0x7fc244162820 2024-05-20T18:01:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.625+0000 7fc24b1ce640 1 -- 172.21.15.6:0/2839139123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc244162820 msgr2=0x7fc2440b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.625+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/2839139123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc244162820 0x7fc2440b3940 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fc24408e070 tx=0x7fc23802a230 comp rx=0 tx=0).stop 2024-05-20T18:01:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.625+0000 7fc24b1ce640 1 -- 172.21.15.6:0/2839139123 shutdown_connections 2024-05-20T18:01:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.625+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/2839139123 >> v2:172.21.15.171:3300/0 conn(0x7fc24406dae0 0x7fc2440b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.625+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/2839139123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc244162820 0x7fc2440b3940 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.625+0000 7fc24b1ce640 1 -- 172.21.15.6:0/2839139123 >> 172.21.15.6:0/2839139123 conn(0x7fc2440d4bd0 msgr2=0x7fc2440d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.625+0000 7fc24b1ce640 1 -- 172.21.15.6:0/2839139123 shutdown_connections 2024-05-20T18:01:51.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.625+0000 7fc24b1ce640 1 -- 172.21.15.6:0/2839139123 wait complete. 2024-05-20T18:01:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.627+0000 7fc24b1ce640 1 Processor -- start 2024-05-20T18:01:51.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.627+0000 7fc24b1ce640 1 -- start start 2024-05-20T18:01:51.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc24b1ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2440b3e80 0x7fc2440cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc24b1ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc244162820 0x7fc2441f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc24b1ce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2441f4ea0 0x7fc2441f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc24b1ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc2440d4780 con 0x7fc2440b3e80 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc24b1ce640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc2440d0300 con 0x7fc2441f4ea0 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc24b1ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc2440d4900 con 0x7fc244162820 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc248f6a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2440b3e80 0x7fc2440cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc248f6a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2440b3e80 0x7fc2440cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59336/0 (socket says 172.21.15.6:59336) 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.628+0000 7fc248f6a640 1 -- 172.21.15.6:0/1554080675 learned_addr learned my addr 172.21.15.6:0/1554080675 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc24976b640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2441f4ea0 0x7fc2441f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc243fff640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc244162820 0x7fc2441f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc248f6a640 1 -- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc244162820 msgr2=0x7fc2441f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc248f6a640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc244162820 0x7fc2441f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc248f6a640 1 -- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2441f4ea0 msgr2=0x7fc2441f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc248f6a640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2441f4ea0 0x7fc2441f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc248f6a640 1 -- 172.21.15.6:0/1554080675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2440ccc50 con 0x7fc2440b3e80 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc24976b640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2441f4ea0 0x7fc2441f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc248f6a640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2440b3e80 0x7fc2440cad40 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc238000c00 tx=0x7fc2380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc2417fa640 1 -- 172.21.15.6:0/1554080675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238041020 con 0x7fc2440b3e80 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc2417fa640 1 -- 172.21.15.6:0/1554080675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc238030970 con 0x7fc2440b3e80 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2440ccf30 con 0x7fc2440b3e80 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc2417fa640 1 -- 172.21.15.6:0/1554080675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238037040 con 0x7fc2440b3e80 2024-05-20T18:01:51.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.629+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2440cd4f0 con 0x7fc2440b3e80 2024-05-20T18:01:51.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.630+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2440cdbf0 con 0x7fc2440b3e80 2024-05-20T18:01:51.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.631+0000 7fc2417fa640 1 -- 172.21.15.6:0/1554080675 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc238044020 con 0x7fc2440b3e80 2024-05-20T18:01:51.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.631+0000 7fc2417fa640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc22806be30 0x7fc22806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:51.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.631+0000 7fc2417fa640 1 -- 172.21.15.6:0/1554080675 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fc2380abbd0 con 0x7fc2440b3e80 2024-05-20T18:01:51.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.632+0000 7fc243fff640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc22806be30 0x7fc22806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:51.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.632+0000 7fc243fff640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc22806be30 0x7fc22806e340 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc230006fd0 tx=0x7fc230008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:51.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.636+0000 7fc2417fa640 1 -- 172.21.15.6:0/1554080675 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc23804b030 con 0x7fc2440b3e80 2024-05-20T18:01:51.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.834+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc244075b00 con 0x7fc2440b3e80 2024-05-20T18:01:51.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.835+0000 7fc2417fa640 1 -- 172.21.15.6:0/1554080675 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v125) ==== 80+0+0 (secure 0 0 0) 0x7fc23807a2e0 con 0x7fc2440b3e80 2024-05-20T18:01:51.832 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:01:51.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc22806be30 msgr2=0x7fc22806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc22806be30 0x7fc22806e340 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc230006fd0 tx=0x7fc230008040 comp rx=0 tx=0).stop 2024-05-20T18:01:51.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2440b3e80 msgr2=0x7fc2440cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:51.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2440b3e80 0x7fc2440cad40 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fc238000c00 tx=0x7fc2380046c0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 shutdown_connections 2024-05-20T18:01:51.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc22806be30 0x7fc22806e340 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2441f4ea0 0x7fc2441f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc244162820 0x7fc2441f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 --2- 172.21.15.6:0/1554080675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2440b3e80 0x7fc2440cad40 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:51.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 >> 172.21.15.6:0/1554080675 conn(0x7fc2440d4bd0 msgr2=0x7fc24415e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:51.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 shutdown_connections 2024-05-20T18:01:51.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:51.837+0000 7fc24b1ce640 1 -- 172.21.15.6:0/1554080675 wait complete. 2024-05-20T18:01:51.845 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T18:01:51.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:51.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T18:01:51.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:01:51.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:51.936 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T18:01:51.952 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:01:51.952 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:51.952 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:51.969 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:51.970 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:52.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:52.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.144+0000 7f8940856640 1 Processor -- start 2024-05-20T18:01:52.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.144+0000 7f8940856640 1 -- start start 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f8940856640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c0d2780 0x7f893c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f8940856640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893c08d2a0 con 0x7f893c0d4400 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f8940856640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893c0d30d0 con 0x7f893c06cf00 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f8940856640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f893c0d3f70 con 0x7f893c0d2780 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f893a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f893c0d4400 0x7f893c15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42486/0 (socket says 172.21.15.6:42486) 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f893a59c640 1 -- 172.21.15.6:0/1735935814 learned_addr learned my addr 172.21.15.6:0/1735935814 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f893ad9d640 1 --2- 172.21.15.6:0/1735935814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c0d2780 0x7f893c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f8939d9b640 1 -- 172.21.15.6:0/1735935814 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025881596 0 0) 0x7f892c001110 con 0x7f893c0d4400 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.146+0000 7f8939d9b640 1 -- 172.21.15.6:0/1735935814 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8928003520 con 0x7f893c0d4400 2024-05-20T18:01:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.147+0000 7f8939d9b640 1 -- 172.21.15.6:0/1735935814 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831511528 0 0) 0x7f893c0d30d0 con 0x7f893c06cf00 2024-05-20T18:01:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.147+0000 7f8939d9b640 1 -- 172.21.15.6:0/1735935814 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f892c001110 con 0x7f893c06cf00 2024-05-20T18:01:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.147+0000 7f893ad9d640 1 -- 172.21.15.6:0/1735935814 >> v1:172.21.15.171:6789/0 conn(0x7f893c06cf00 legacy=0x7f893c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.147+0000 7f893ad9d640 1 -- 172.21.15.6:0/1735935814 >> v1:172.21.15.6:6789/0 conn(0x7f893c0d4400 legacy=0x7f893c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.147+0000 7f893ad9d640 1 -- 172.21.15.6:0/1735935814 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c0d4810 con 0x7f893c0d2780 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.147+0000 7f893ad9d640 1 --2- 172.21.15.6:0/1735935814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c0d2780 0x7f893c0d2b90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8934009dc0 tx=0x7f893402a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea340f27d6d15a49 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8939d9b640 1 -- 172.21.15.6:0/1735935814 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934007740 con 0x7f893c0d2780 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8939d9b640 1 -- 172.21.15.6:0/1735935814 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89340078e0 con 0x7f893c0d2780 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8939d9b640 1 -- 172.21.15.6:0/1735935814 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934007cb0 con 0x7f893c0d2780 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8940856640 1 -- 172.21.15.6:0/1735935814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c0d2780 msgr2=0x7f893c0d2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8940856640 1 --2- 172.21.15.6:0/1735935814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c0d2780 0x7f893c0d2b90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8934009dc0 tx=0x7f893402a760 comp rx=0 tx=0).stop 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8940856640 1 -- 172.21.15.6:0/1735935814 shutdown_connections 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8940856640 1 --2- 172.21.15.6:0/1735935814 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c0d2780 0x7f893c0d2b90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8940856640 1 -- 172.21.15.6:0/1735935814 >> 172.21.15.6:0/1735935814 conn(0x7f893c0d4bb0 msgr2=0x7f893c0d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8940856640 1 -- 172.21.15.6:0/1735935814 shutdown_connections 2024-05-20T18:01:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.148+0000 7f8940856640 1 -- 172.21.15.6:0/1735935814 wait complete. 2024-05-20T18:01:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.150+0000 7f8940856640 1 Processor -- start 2024-05-20T18:01:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.150+0000 7f8940856640 1 -- start start 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8940856640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c06cf00 0x7f893c15c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8940856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f893c0d2780 0x7f893c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8940856640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f893c0d4400 0x7f893c1f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8940856640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f893c0d3920 con 0x7f893c0d2780 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8940856640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f893c0d3640 con 0x7f893c0d4400 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8940856640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f893c0d3c00 con 0x7f893c06cf00 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f893c0d2780 0x7f893c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f893c0d2780 0x7f893c15d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59342/0 (socket says 172.21.15.6:59342) 2024-05-20T18:01:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 -- 172.21.15.6:0/1443464232 learned_addr learned my addr 172.21.15.6:0/1443464232 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f893a59c640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c06cf00 0x7f893c15c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f893ad9d640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f893c0d4400 0x7f893c1f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 -- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c06cf00 msgr2=0x7f893c15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c06cf00 0x7f893c15c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 -- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f893c0d4400 msgr2=0x7f893c1f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f893c0d4400 0x7f893c1f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 -- 172.21.15.6:0/1443464232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c15b540 con 0x7f893c0d2780 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.152+0000 7f8933fff640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f893c0d2780 0x7f893c15d4b0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f892400c460 tx=0x7f892400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.153+0000 7f8932ffd640 1 -- 172.21.15.6:0/1443464232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924017070 con 0x7f893c0d2780 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.153+0000 7f8932ffd640 1 -- 172.21.15.6:0/1443464232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89240052f0 con 0x7f893c0d2780 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.153+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893c15b820 con 0x7f893c0d2780 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.153+0000 7f8932ffd640 1 -- 172.21.15.6:0/1443464232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924003830 con 0x7f893c0d2780 2024-05-20T18:01:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.153+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893c15bde0 con 0x7f893c0d2780 2024-05-20T18:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.154+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f893c0735a0 con 0x7f893c0d2780 2024-05-20T18:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.154+0000 7f8932ffd640 1 -- 172.21.15.6:0/1443464232 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f892401a070 con 0x7f893c0d2780 2024-05-20T18:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.155+0000 7f8932ffd640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f891c06be60 0x7f891c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.155+0000 7f8932ffd640 1 -- 172.21.15.6:0/1443464232 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f892408a4b0 con 0x7f893c0d2780 2024-05-20T18:01:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.155+0000 7f893a59c640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f891c06be60 0x7f891c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.156+0000 7f893a59c640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f891c06be60 0x7f891c06e370 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f892c0013b0 tx=0x7f892c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.160+0000 7f8932ffd640 1 -- 172.21.15.6:0/1443464232 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f893c0735a0 con 0x7f893c0d2780 2024-05-20T18:01:52.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.344+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f893c15b2d0 con 0x7f893c0d2780 2024-05-20T18:01:52.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.345+0000 7f8932ffd640 1 -- 172.21.15.6:0/1443464232 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16852 (secure 0 0 0) 0x7f89240584d0 con 0x7f893c0d2780 2024-05-20T18:01:52.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:52.343 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":125,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:31.516805+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:01:27.629166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-05-20T18:01:28.885867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:52.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f891c06be60 msgr2=0x7f891c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f891c06be60 0x7f891c06e370 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f892c0013b0 tx=0x7f892c007d30 comp rx=0 tx=0).stop 2024-05-20T18:01:52.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f893c0d2780 msgr2=0x7f893c15d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f893c0d2780 0x7f893c15d4b0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f892400c460 tx=0x7f892400c920 comp rx=0 tx=0).stop 2024-05-20T18:01:52.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 shutdown_connections 2024-05-20T18:01:52.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f891c06be60 0x7f891c06e370 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f893c0d4400 0x7f893c1f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f893c0d2780 0x7f893c15d4b0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 --2- 172.21.15.6:0/1443464232 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f893c06cf00 0x7f893c15c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.347+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 >> 172.21.15.6:0/1443464232 conn(0x7f893c0d4bb0 msgr2=0x7f893c0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:52.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.348+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 shutdown_connections 2024-05-20T18:01:52.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.348+0000 7f8940856640 1 -- 172.21.15.6:0/1443464232 wait complete. 2024-05-20T18:01:52.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:01:27.629166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:01:28.885867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:01:52.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:01:52.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.477+0000 7f371d357640 1 Processor -- start 2024-05-20T18:01:52.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.477+0000 7f371d357640 1 -- start start 2024-05-20T18:01:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f371d357640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f371806d3d0 0x7f371806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f371d357640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37180b8190 0x7f37180b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f371d357640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371806dd20 con 0x7f3718162820 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f371d357640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f37180d0630 con 0x7f371806d3d0 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f371d357640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f37180d39c0 con 0x7f37180b8190 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f37167fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f371806d3d0 0x7f371806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f3716ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3718162820 0x7f37180b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42500/0 (socket says 172.21.15.6:42500) 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f3716ffd640 1 -- 172.21.15.6:0/4279054361 learned_addr learned my addr 172.21.15.6:0/4279054361 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f37177fe640 1 --2- 172.21.15.6:0/4279054361 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37180b8190 0x7f37180b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f37167fc640 1 -- 172.21.15.6:0/4279054361 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37180b8190 msgr2=0x7f37180b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f37167fc640 1 --2- 172.21.15.6:0/4279054361 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37180b8190 0x7f37180b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f37167fc640 1 -- 172.21.15.6:0/4279054361 >> v1:172.21.15.6:6789/0 conn(0x7f3718162820 legacy=0x7f37180b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f37167fc640 1 -- 172.21.15.6:0/4279054361 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37180d3ca0 con 0x7f371806d3d0 2024-05-20T18:01:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.479+0000 7f3715ffb640 1 -- 172.21.15.6:0/4279054361 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942242651 0 0) 0x7f3708001490 con 0x7f3718162820 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.480+0000 7f37167fc640 1 --2- 172.21.15.6:0/4279054361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f371806d3d0 0x7f371806d7e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f370c0097a0 tx=0x7f370c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b5ca7483298dda server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.480+0000 7f3715ffb640 1 -- 172.21.15.6:0/4279054361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c037070 con 0x7f371806d3d0 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.480+0000 7f3715ffb640 1 -- 172.21.15.6:0/4279054361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f370c032440 con 0x7f371806d3d0 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.480+0000 7f3715ffb640 1 -- 172.21.15.6:0/4279054361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c032810 con 0x7f371806d3d0 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.481+0000 7f371d357640 1 -- 172.21.15.6:0/4279054361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f371806d3d0 msgr2=0x7f371806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.481+0000 7f371d357640 1 --2- 172.21.15.6:0/4279054361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f371806d3d0 0x7f371806d7e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f370c0097a0 tx=0x7f370c02a180 comp rx=0 tx=0).stop 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.481+0000 7f371d357640 1 -- 172.21.15.6:0/4279054361 shutdown_connections 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.481+0000 7f371d357640 1 --2- 172.21.15.6:0/4279054361 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37180b8190 0x7f37180b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.481+0000 7f371d357640 1 --2- 172.21.15.6:0/4279054361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f371806d3d0 0x7f371806d7e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.481+0000 7f371d357640 1 -- 172.21.15.6:0/4279054361 >> 172.21.15.6:0/4279054361 conn(0x7f37180d4bd0 msgr2=0x7f37180d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:52.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.481+0000 7f371d357640 1 -- 172.21.15.6:0/4279054361 shutdown_connections 2024-05-20T18:01:52.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.481+0000 7f371d357640 1 -- 172.21.15.6:0/4279054361 wait complete. 2024-05-20T18:01:52.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.483+0000 7f371d357640 1 Processor -- start 2024-05-20T18:01:52.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.483+0000 7f371d357640 1 -- start start 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f371d357640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f371806d3d0 0x7f37181f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f371d357640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37180b8190 0x7f37181f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f371d357640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3718162820 0x7f37181f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f371d357640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f37180d0300 con 0x7f3718162820 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f371d357640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f37180d4260 con 0x7f37180b8190 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f371d357640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f37180b4050 con 0x7f371806d3d0 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f37177fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3718162820 0x7f37181f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f37177fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3718162820 0x7f37181f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59374/0 (socket says 172.21.15.6:59374) 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.484+0000 7f37177fe640 1 -- 172.21.15.6:0/2289653854 learned_addr learned my addr 172.21.15.6:0/2289653854 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f3716ffd640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f371806d3d0 0x7f37181f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f37167fc640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37180b8190 0x7f37181f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f37177fe640 1 -- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f371806d3d0 msgr2=0x7f37181f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f37177fe640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f371806d3d0 0x7f37181f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f37177fe640 1 -- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37180b8190 msgr2=0x7f37181f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f37177fe640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37180b8190 0x7f37181f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f37177fe640 1 -- 172.21.15.6:0/2289653854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37180b62e0 con 0x7f3718162820 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f37177fe640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3718162820 0x7f37181f56b0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f371000d4e0 tx=0x7f371000d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f36ff7fe640 1 -- 172.21.15.6:0/2289653854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37100125f0 con 0x7f3718162820 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f36ff7fe640 1 -- 172.21.15.6:0/2289653854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3710019070 con 0x7f3718162820 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37180b65c0 con 0x7f3718162820 2024-05-20T18:01:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f36ff7fe640 1 -- 172.21.15.6:0/2289653854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37100129f0 con 0x7f3718162820 2024-05-20T18:01:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.485+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37180b70a0 con 0x7f3718162820 2024-05-20T18:01:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.486+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37181f5ca0 con 0x7f3718162820 2024-05-20T18:01:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.487+0000 7f36ff7fe640 1 -- 172.21.15.6:0/2289653854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3710012b90 con 0x7f3718162820 2024-05-20T18:01:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.487+0000 7f36ff7fe640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f370406be60 0x7f370406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.488+0000 7f36ff7fe640 1 -- 172.21.15.6:0/2289653854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f371008b310 con 0x7f3718162820 2024-05-20T18:01:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.488+0000 7f3716ffd640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f370406be60 0x7f370406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.488+0000 7f3716ffd640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f370406be60 0x7f370406e370 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f37080012e0 tx=0x7f3708001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.492+0000 7f36ff7fe640 1 -- 172.21.15.6:0/2289653854 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f37100593b0 con 0x7f3718162820 2024-05-20T18:01:52.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.675+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3718075b00 con 0x7f3718162820 2024-05-20T18:01:52.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.675+0000 7f36ff7fe640 1 -- 172.21.15.6:0/2289653854 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) ==== 93+0+10 (secure 0 0 0) 0x7f371005d6b0 con 0x7f3718162820 2024-05-20T18:01:52.673 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f370406be60 msgr2=0x7f370406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f370406be60 0x7f370406e370 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f37080012e0 tx=0x7f3708001630 comp rx=0 tx=0).stop 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3718162820 msgr2=0x7f37181f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3718162820 0x7f37181f56b0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f371000d4e0 tx=0x7f371000d9a0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 shutdown_connections 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f370406be60 0x7f370406e370 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3718162820 0x7f37181f56b0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37180b8190 0x7f37181f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 --2- 172.21.15.6:0/2289653854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f371806d3d0 0x7f37181f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 >> 172.21.15.6:0/2289653854 conn(0x7f37180d4bd0 msgr2=0x7f371815d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:52.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 shutdown_connections 2024-05-20T18:01:52.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.677+0000 7f371d357640 1 -- 172.21.15.6:0/2289653854 wait complete. 2024-05-20T18:01:52.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:01:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.807+0000 7fa51aef7640 1 Processor -- start 2024-05-20T18:01:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.808+0000 7fa51aef7640 1 -- start start 2024-05-20T18:01:52.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa51aef7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa514162820 0x7fa5140b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa51aef7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa51406dae0 0x7fa5140b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa51aef7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5140d0630 con 0x7fa5140b3e80 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa51aef7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa5140d39c0 con 0x7fa514162820 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa51aef7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa5140d3ca0 con 0x7fa51406dae0 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa513fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa5140b3e80 0x7fa51406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42514/0 (socket says 172.21.15.6:42514) 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa513fff640 1 -- 172.21.15.6:0/2559427665 learned_addr learned my addr 172.21.15.6:0/2559427665 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa518c93640 1 --2- 172.21.15.6:0/2559427665 >> v2:172.21.15.171:3300/0 conn(0x7fa514162820 0x7fa5140b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa519494640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa51406dae0 0x7fa5140b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630620943 0 0) 0x7fa5140d0630 con 0x7fa5140b3e80 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.809+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4fc003520 con 0x7fa5140b3e80 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3816883638 0 0) 0x7fa4fc003520 con 0x7fa5140b3e80 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa51406dae0 msgr2=0x7fa5140b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa51406dae0 0x7fa5140b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 >> v2:172.21.15.171:3300/0 conn(0x7fa514162820 msgr2=0x7fa5140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 --2- 172.21.15.6:0/2559427665 >> v2:172.21.15.171:3300/0 conn(0x7fa514162820 0x7fa5140b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5140d3f80 con 0x7fa5140b3e80 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fa508001670 con 0x7fa5140b3e80 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa518c93640 1 --2- 172.21.15.6:0/2559427665 >> v2:172.21.15.171:3300/0 conn(0x7fa514162820 0x7fa5140b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 >> v1:172.21.15.6:6789/0 conn(0x7fa5140b3e80 legacy=0x7fa51406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc0039b0 0x7fa4fc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc004800 0x7fa4fc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc005150 0x7fa4fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140d39c0 con 0x7fa4fc0039b0 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140d3ca0 con 0x7fa4fc004800 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc00bf00 con 0x7fa4fc005150 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa518c93640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc0039b0 0x7fa4fc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa513fff640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc004800 0x7fa4fc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa519494640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc005150 0x7fa4fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa518c93640 1 -- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc005150 msgr2=0x7fa4fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:52.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa518c93640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4fc005150 0x7fa4fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa518c93640 1 -- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc004800 msgr2=0x7fa4fc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:52.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa518c93640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc004800 0x7fa4fc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa518c93640 1 -- 172.21.15.6:0/2559427665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc003520 con 0x7fa4fc0039b0 2024-05-20T18:01:52.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.810+0000 7fa513fff640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc004800 0x7fa4fc004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.811+0000 7fa518c93640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc0039b0 0x7fa4fc003e20 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa504009c90 tx=0x7fa4fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8780edc0262346 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.811+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504036070 con 0x7fa4fc0039b0 2024-05-20T18:01:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.811+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa504031400 con 0x7fa4fc0039b0 2024-05-20T18:01:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.811+0000 7fa5137fe640 1 -- 172.21.15.6:0/2559427665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504009860 con 0x7fa4fc0039b0 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.812+0000 7fa51aef7640 1 -- 172.21.15.6:0/2559427665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc0039b0 msgr2=0x7fa4fc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.812+0000 7fa51aef7640 1 --2- 172.21.15.6:0/2559427665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4fc0039b0 0x7fa4fc003e20 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa504009c90 tx=0x7fa4fc005830 comp rx=0 tx=0).stop 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.812+0000 7fa519494640 1 -- 172.21.15.6:0/2559427665 reap_dead start 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.812+0000 7fa51aef7640 1 -- 172.21.15.6:0/2559427665 shutdown_connections 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.812+0000 7fa51aef7640 1 -- 172.21.15.6:0/2559427665 >> 172.21.15.6:0/2559427665 conn(0x7fa5140d4bd0 msgr2=0x7fa5140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.812+0000 7fa51aef7640 1 -- 172.21.15.6:0/2559427665 shutdown_connections 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.812+0000 7fa51aef7640 1 -- 172.21.15.6:0/2559427665 wait complete. 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.814+0000 7fa51aef7640 1 Processor -- start 2024-05-20T18:01:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.814+0000 7fa51aef7640 1 -- start start 2024-05-20T18:01:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa51aef7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0039b0 0x7fa5140b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa51aef7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5140cbc80 0x7fa5140b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa51aef7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5141f4610 0x7fa5141f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa51aef7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140d4780 con 0x7fa5140cbc80 2024-05-20T18:01:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa51aef7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140d0300 con 0x7fa4fc0039b0 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa51aef7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa5140d4900 con 0x7fa5141f4610 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa513fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5140cbc80 0x7fa5140b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa513fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5140cbc80 0x7fa5140b7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59388/0 (socket says 172.21.15.6:59388) 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa513fff640 1 -- 172.21.15.6:0/4109370245 learned_addr learned my addr 172.21.15.6:0/4109370245 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa518c93640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0039b0 0x7fa5140b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.815+0000 7fa519494640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5141f4610 0x7fa5141f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa513fff640 1 -- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5141f4610 msgr2=0x7fa5141f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa513fff640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5141f4610 0x7fa5141f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa513fff640 1 -- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0039b0 msgr2=0x7fa5140b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa513fff640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0039b0 0x7fa5140b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa513fff640 1 -- 172.21.15.6:0/4109370245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5140cc3b0 con 0x7fa5140cbc80 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa519494640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5141f4610 0x7fa5141f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa513fff640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5140cbc80 0x7fa5140b7210 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa50800e7f0 tx=0x7fa50800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa5117fa640 1 -- 172.21.15.6:0/4109370245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50800c8d0 con 0x7fa5140cbc80 2024-05-20T18:01:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa5117fa640 1 -- 172.21.15.6:0/4109370245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa508018070 con 0x7fa5140cbc80 2024-05-20T18:01:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5140ce4f0 con 0x7fa5140cbc80 2024-05-20T18:01:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa5117fa640 1 -- 172.21.15.6:0/4109370245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50800cc70 con 0x7fa5140cbc80 2024-05-20T18:01:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.816+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5140ceab0 con 0x7fa5140cbc80 2024-05-20T18:01:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.817+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5140cc120 con 0x7fa5140cbc80 2024-05-20T18:01:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.818+0000 7fa5117fa640 1 -- 172.21.15.6:0/4109370245 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa50801d460 con 0x7fa5140cbc80 2024-05-20T18:01:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.818+0000 7fa5117fa640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa50006be30 0x7fa50006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.818+0000 7fa5117fa640 1 -- 172.21.15.6:0/4109370245 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fa50808aeb0 con 0x7fa5140cbc80 2024-05-20T18:01:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.818+0000 7fa518c93640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa50006be30 0x7fa50006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.819+0000 7fa518c93640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa50006be30 0x7fa50006e340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa504033000 tx=0x7fa504008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:52.823+0000 7fa5117fa640 1 -- 172.21.15.6:0/4109370245 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa508059640 con 0x7fa5140cbc80 2024-05-20T18:01:53.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.005+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa514075b00 con 0x7fa5140cbc80 2024-05-20T18:01:53.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.006+0000 7fa5117fa640 1 -- 172.21.15.6:0/4109370245 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) ==== 104+0+11 (secure 0 0 0) 0x7fa508058f40 con 0x7fa5140cbc80 2024-05-20T18:01:53.003 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:01:53.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa50006be30 msgr2=0x7fa50006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa50006be30 0x7fa50006e340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa504033000 tx=0x7fa504008030 comp rx=0 tx=0).stop 2024-05-20T18:01:53.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5140cbc80 msgr2=0x7fa5140b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5140cbc80 0x7fa5140b7210 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa50800e7f0 tx=0x7fa50800ecb0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 shutdown_connections 2024-05-20T18:01:53.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa50006be30 0x7fa50006e340 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5141f4610 0x7fa5141f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5140cbc80 0x7fa5140b7210 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 --2- 172.21.15.6:0/4109370245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4fc0039b0 0x7fa5140b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 >> 172.21.15.6:0/4109370245 conn(0x7fa5140d4bd0 msgr2=0x7fa5140b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:53.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 shutdown_connections 2024-05-20T18:01:53.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.008+0000 7fa51aef7640 1 -- 172.21.15.6:0/4109370245 wait complete. 2024-05-20T18:01:53.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:01:53.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.139+0000 7f212392f640 1 Processor -- start 2024-05-20T18:01:53.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.139+0000 7f212392f640 1 -- start start 2024-05-20T18:01:53.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f212392f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f211c15f220 0x7f211c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f212392f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c0cda20 con 0x7f211c0cfae0 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f212392f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c0cdd00 con 0x7f211c0d0e00 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f212392f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f211c0cdfe0 con 0x7f211c15f220 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f21216cb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f211c15f220 0x7f211c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f2121ecc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f211c0cfae0 0x7f211c0ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42524/0 (socket says 172.21.15.6:42524) 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f2121ecc640 1 -- 172.21.15.6:0/932364228 learned_addr learned my addr 172.21.15.6:0/932364228 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f21216cb640 1 -- 172.21.15.6:0/932364228 >> v1:172.21.15.171:6789/0 conn(0x7f211c0d0e00 legacy=0x7f211c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f21216cb640 1 -- 172.21.15.6:0/932364228 >> v1:172.21.15.6:6789/0 conn(0x7f211c0cfae0 legacy=0x7f211c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f21216cb640 1 -- 172.21.15.6:0/932364228 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c0ce2c0 con 0x7f211c15f220 2024-05-20T18:01:53.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.141+0000 7f211bfff640 1 -- 172.21.15.6:0/932364228 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1542685482 0 0) 0x7f211c0cda20 con 0x7f211c0cfae0 2024-05-20T18:01:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.142+0000 7f21216cb640 1 --2- 172.21.15.6:0/932364228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c15f220 0x7f211c0d08c0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f210c009d90 tx=0x7f210c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e122d2dfe86b2c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.142+0000 7f211bfff640 1 -- 172.21.15.6:0/932364228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c031600 con 0x7f211c15f220 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.142+0000 7f211bfff640 1 -- 172.21.15.6:0/932364228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210c0317a0 con 0x7f211c15f220 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.142+0000 7f211bfff640 1 -- 172.21.15.6:0/932364228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c031b70 con 0x7f211c15f220 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.143+0000 7f212392f640 1 -- 172.21.15.6:0/932364228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c15f220 msgr2=0x7f211c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.143+0000 7f212392f640 1 --2- 172.21.15.6:0/932364228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c15f220 0x7f211c0d08c0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f210c009d90 tx=0x7f210c02a610 comp rx=0 tx=0).stop 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.143+0000 7f212392f640 1 -- 172.21.15.6:0/932364228 shutdown_connections 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.143+0000 7f212392f640 1 --2- 172.21.15.6:0/932364228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c15f220 0x7f211c0d08c0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.143+0000 7f212392f640 1 -- 172.21.15.6:0/932364228 >> 172.21.15.6:0/932364228 conn(0x7f211c0b44d0 msgr2=0x7f211c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.143+0000 7f212392f640 1 -- 172.21.15.6:0/932364228 shutdown_connections 2024-05-20T18:01:53.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.143+0000 7f212392f640 1 -- 172.21.15.6:0/932364228 wait complete. 2024-05-20T18:01:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.145+0000 7f212392f640 1 Processor -- start 2024-05-20T18:01:53.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.145+0000 7f212392f640 1 -- start start 2024-05-20T18:01:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f212392f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c0d0e00 0x7f211c0b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f212392f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f211c15f220 0x7f211c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f212392f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211c1484d0 0x7f211c1488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f212392f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f211c15f7b0 con 0x7f211c0d0e00 2024-05-20T18:01:53.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f212392f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f211c15f630 con 0x7f211c1484d0 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f212392f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f211c0ceef0 con 0x7f211c15f220 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f21216cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c0d0e00 0x7f211c0b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f21216cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c0d0e00 0x7f211c0b7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59404/0 (socket says 172.21.15.6:59404) 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f21216cb640 1 -- 172.21.15.6:0/312368894 learned_addr learned my addr 172.21.15.6:0/312368894 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f2120eca640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f211c15f220 0x7f211c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.146+0000 7f2121ecc640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211c1484d0 0x7f211c1488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f21216cb640 1 -- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f211c15f220 msgr2=0x7f211c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f21216cb640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f211c15f220 0x7f211c0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f21216cb640 1 -- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211c1484d0 msgr2=0x7f211c1488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f21216cb640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211c1484d0 0x7f211c1488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f21216cb640 1 -- 172.21.15.6:0/312368894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c0cc970 con 0x7f211c0d0e00 2024-05-20T18:01:53.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f21216cb640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c0d0e00 0x7f211c0b7d10 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f210c009eb0 tx=0x7f210c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f2119ffb640 1 -- 172.21.15.6:0/312368894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c040070 con 0x7f211c0d0e00 2024-05-20T18:01:53.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f2119ffb640 1 -- 172.21.15.6:0/312368894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210c030be0 con 0x7f211c0d0e00 2024-05-20T18:01:53.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c160b60 con 0x7f211c0d0e00 2024-05-20T18:01:53.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f2119ffb640 1 -- 172.21.15.6:0/312368894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c009450 con 0x7f211c0d0e00 2024-05-20T18:01:53.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.147+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c0b6970 con 0x7f211c0d0e00 2024-05-20T18:01:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.148+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f211c075b00 con 0x7f211c0d0e00 2024-05-20T18:01:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.149+0000 7f2119ffb640 1 -- 172.21.15.6:0/312368894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f210c039040 con 0x7f211c0d0e00 2024-05-20T18:01:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.149+0000 7f2119ffb640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f210806be30 0x7f210806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.149+0000 7f2119ffb640 1 -- 172.21.15.6:0/312368894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f210c0abaa0 con 0x7f211c0d0e00 2024-05-20T18:01:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.150+0000 7f2120eca640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f210806be30 0x7f210806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.150+0000 7f2120eca640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f210806be30 0x7f210806e340 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f211c0ceda0 tx=0x7f2110009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.154+0000 7f2119ffb640 1 -- 172.21.15.6:0/312368894 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f210c079b40 con 0x7f211c0d0e00 2024-05-20T18:01:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.336+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f211c162c60 con 0x7f211c0d0e00 2024-05-20T18:01:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.337+0000 7f2119ffb640 1 -- 172.21.15.6:0/312368894 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) ==== 100+0+11 (secure 0 0 0) 0x7f210c07de40 con 0x7f211c0d0e00 2024-05-20T18:01:53.334 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:01:53.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f210806be30 msgr2=0x7f210806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f210806be30 0x7f210806e340 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f211c0ceda0 tx=0x7f2110009060 comp rx=0 tx=0).stop 2024-05-20T18:01:53.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c0d0e00 msgr2=0x7f211c0b7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c0d0e00 0x7f211c0b7d10 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f210c009eb0 tx=0x7f210c004a40 comp rx=0 tx=0).stop 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 shutdown_connections 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f210806be30 0x7f210806e340 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f211c1484d0 0x7f211c1488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f211c15f220 0x7f211c0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 --2- 172.21.15.6:0/312368894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f211c0d0e00 0x7f211c0b7d10 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 >> 172.21.15.6:0/312368894 conn(0x7f211c0b44d0 msgr2=0x7f211c0d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 shutdown_connections 2024-05-20T18:01:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.339+0000 7f212392f640 1 -- 172.21.15.6:0/312368894 wait complete. 2024-05-20T18:01:53.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:01:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.466+0000 7f170733e640 1 Processor -- start 2024-05-20T18:01:53.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.466+0000 7f170733e640 1 -- start start 2024-05-20T18:01:53.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f170733e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d14f0 0x7f17000b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f170733e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17000d1ac0 con 0x7f17000d10e0 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f170733e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17000d1da0 con 0x7f17000cf850 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f170733e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17000d2080 con 0x7f17000d14f0 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f17050da640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f17000d10e0 0x7f17000cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42532/0 (socket says 172.21.15.6:42532) 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f17050da640 1 -- 172.21.15.6:0/3059568387 learned_addr learned my addr 172.21.15.6:0/3059568387 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f17058db640 1 --2- 172.21.15.6:0/3059568387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d14f0 0x7f17000b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f16f7fff640 1 -- 172.21.15.6:0/3059568387 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553400238 0 0) 0x7f17000d1ac0 con 0x7f17000d10e0 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f16f7fff640 1 -- 172.21.15.6:0/3059568387 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16ec003520 con 0x7f17000d10e0 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f16f7fff640 1 -- 172.21.15.6:0/3059568387 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381997235 0 0) 0x7f17000d1da0 con 0x7f17000cf850 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f16f7fff640 1 -- 172.21.15.6:0/3059568387 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17000d1ac0 con 0x7f17000cf850 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f17058db640 1 -- 172.21.15.6:0/3059568387 >> v1:172.21.15.171:6789/0 conn(0x7f17000cf850 legacy=0x7f17000b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f17058db640 1 -- 172.21.15.6:0/3059568387 >> v1:172.21.15.6:6789/0 conn(0x7f17000d10e0 legacy=0x7f17000cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.468+0000 7f17058db640 1 -- 172.21.15.6:0/3059568387 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17000d2360 con 0x7f17000d14f0 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.469+0000 7f17058db640 1 --2- 172.21.15.6:0/3059568387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d14f0 0x7f17000b6910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009dc0 tx=0x7f16f802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=228f5b57d92ed48a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.469+0000 7f16f7fff640 1 -- 172.21.15.6:0/3059568387 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8007740 con 0x7f17000d14f0 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f16f7fff640 1 -- 172.21.15.6:0/3059568387 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f80078e0 con 0x7f17000d14f0 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f16f7fff640 1 -- 172.21.15.6:0/3059568387 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8007cb0 con 0x7f17000d14f0 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f170733e640 1 -- 172.21.15.6:0/3059568387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d14f0 msgr2=0x7f17000b6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f170733e640 1 --2- 172.21.15.6:0/3059568387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d14f0 0x7f17000b6910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009dc0 tx=0x7f16f802a6d0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f170733e640 1 -- 172.21.15.6:0/3059568387 shutdown_connections 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f170733e640 1 --2- 172.21.15.6:0/3059568387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d14f0 0x7f17000b6910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f170733e640 1 -- 172.21.15.6:0/3059568387 >> 172.21.15.6:0/3059568387 conn(0x7f17000b44d0 msgr2=0x7f17000b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f170733e640 1 -- 172.21.15.6:0/3059568387 shutdown_connections 2024-05-20T18:01:53.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.470+0000 7f170733e640 1 -- 172.21.15.6:0/3059568387 wait complete. 2024-05-20T18:01:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.472+0000 7f170733e640 1 Processor -- start 2024-05-20T18:01:53.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.472+0000 7f170733e640 1 -- start start 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.473+0000 7f170733e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf850 0x7f17001f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.473+0000 7f170733e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d10e0 0x7f170006d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f170733e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17000d14f0 0x7f170006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f170733e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f17000b8440 con 0x7f17000cf850 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f170733e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17000b82c0 con 0x7f17000d14f0 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f170733e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17000709f0 con 0x7f17000d10e0 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf850 0x7f17001f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf850 0x7f17001f8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59408/0 (socket says 172.21.15.6:59408) 2024-05-20T18:01:53.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 -- 172.21.15.6:0/3371672053 learned_addr learned my addr 172.21.15.6:0/3371672053 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17058db640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17000d14f0 0x7f170006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17048d9640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d10e0 0x7f170006d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 -- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d10e0 msgr2=0x7f170006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d10e0 0x7f170006d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 -- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17000d14f0 msgr2=0x7f170006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17000d14f0 0x7f170006da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 -- 172.21.15.6:0/3371672053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170006dfa0 con 0x7f17000cf850 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17048d9640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d10e0 0x7f170006d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17058db640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17000d14f0 0x7f170006da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f17050da640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf850 0x7f17001f8c00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c410 tx=0x7f16fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f16f5ffb640 1 -- 172.21.15.6:0/3371672053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc017070 con 0x7f17000cf850 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f16f5ffb640 1 -- 172.21.15.6:0/3371672053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16fc005ce0 con 0x7f17000cf850 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170006c760 con 0x7f17000cf850 2024-05-20T18:01:53.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.474+0000 7f16f5ffb640 1 -- 172.21.15.6:0/3371672053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0072d0 con 0x7f17000cf850 2024-05-20T18:01:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.475+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170006cd20 con 0x7f17000cf850 2024-05-20T18:01:53.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.476+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1700075b00 con 0x7f17000cf850 2024-05-20T18:01:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.476+0000 7f16f5ffb640 1 -- 172.21.15.6:0/3371672053 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16fc01a070 con 0x7f17000cf850 2024-05-20T18:01:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.477+0000 7f16f5ffb640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16e406be30 0x7f16e406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.477+0000 7f16f5ffb640 1 -- 172.21.15.6:0/3371672053 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f16fc08a320 con 0x7f17000cf850 2024-05-20T18:01:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.477+0000 7f17048d9640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16e406be30 0x7f16e406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.478+0000 7f17048d9640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16e406be30 0x7f16e406e340 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f170006e810 tx=0x7f16f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.481+0000 7f16f5ffb640 1 -- 172.21.15.6:0/3371672053 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f16fc058450 con 0x7f17000cf850 2024-05-20T18:01:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.686+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f17000b23e0 con 0x7f17000cf850 2024-05-20T18:01:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.687+0000 7f16f5ffb640 1 -- 172.21.15.6:0/3371672053 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v125) ==== 80+0+0 (secure 0 0 0) 0x7f16fc05c750 con 0x7f17000cf850 2024-05-20T18:01:53.684 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:01:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16e406be30 msgr2=0x7f16e406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16e406be30 0x7f16e406e340 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f170006e810 tx=0x7f16f0009040 comp rx=0 tx=0).stop 2024-05-20T18:01:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf850 msgr2=0x7f17001f8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf850 0x7f17001f8c00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c410 tx=0x7f16fc00c8d0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 shutdown_connections 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f16e406be30 0x7f16e406e340 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17000d14f0 0x7f170006da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17000d10e0 0x7f170006d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 --2- 172.21.15.6:0/3371672053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf850 0x7f17001f8c00 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 >> 172.21.15.6:0/3371672053 conn(0x7f17000b44d0 msgr2=0x7f17000b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 shutdown_connections 2024-05-20T18:01:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.689+0000 7f170733e640 1 -- 172.21.15.6:0/3371672053 wait complete. 2024-05-20T18:01:53.697 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T18:01:53.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:53.697 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T18:01:53.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:01:53.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:01:53.732 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T18:01:53.790 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:01:53.791 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:01:53.791 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:53.807 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:01:53.808 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:01:53.808 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:01:53.808 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:01:53.849 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:01:53.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:53.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.967+0000 7f29f90ca640 1 Processor -- start 2024-05-20T18:01:53.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.967+0000 7f29f90ca640 1 -- start start 2024-05-20T18:01:53.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.968+0000 7f29f90ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f40cf3d0 0x7f29f40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.968+0000 7f29f90ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f40cfd20 con 0x7f29f40ce7e0 2024-05-20T18:01:53.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.968+0000 7f29f90ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f40cda20 con 0x7f29f415f220 2024-05-20T18:01:53.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.968+0000 7f29f90ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f29f40cdd00 con 0x7f29f40cf3d0 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29f359e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f29f40ce7e0 0x7f29f40cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42546/0 (socket says 172.21.15.6:42546) 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29f359e640 1 -- 172.21.15.6:0/2079494211 learned_addr learned my addr 172.21.15.6:0/2079494211 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29ebfff640 1 --2- 172.21.15.6:0/2079494211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f40cf3d0 0x7f29f40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29f259c640 1 -- 172.21.15.6:0/2079494211 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680324593 0 0) 0x7f29ec001490 con 0x7f29f40ce7e0 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29f259c640 1 -- 172.21.15.6:0/2079494211 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e0003520 con 0x7f29f40ce7e0 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29f259c640 1 -- 172.21.15.6:0/2079494211 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341720452 0 0) 0x7f29f40cda20 con 0x7f29f415f220 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29f259c640 1 -- 172.21.15.6:0/2079494211 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29ec001490 con 0x7f29f415f220 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29f259c640 1 -- 172.21.15.6:0/2079494211 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3919427111 0 0) 0x7f29e0003520 con 0x7f29f40ce7e0 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29ebfff640 1 -- 172.21.15.6:0/2079494211 >> v1:172.21.15.171:6789/0 conn(0x7f29f415f220 legacy=0x7f29f40d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29ebfff640 1 -- 172.21.15.6:0/2079494211 >> v1:172.21.15.6:6789/0 conn(0x7f29f40ce7e0 legacy=0x7f29f40cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.969+0000 7f29ebfff640 1 -- 172.21.15.6:0/2079494211 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f40cdfe0 con 0x7f29f40cf3d0 2024-05-20T18:01:53.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.970+0000 7f29ebfff640 1 --2- 172.21.15.6:0/2079494211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f40cf3d0 0x7f29f40cf7e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0097d0 tx=0x7f29dc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64c036617b9fc42 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.970+0000 7f29f259c640 1 -- 172.21.15.6:0/2079494211 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc037070 con 0x7f29f40cf3d0 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.970+0000 7f29f259c640 1 -- 172.21.15.6:0/2079494211 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29dc02ab90 con 0x7f29f40cf3d0 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.970+0000 7f29f259c640 1 -- 172.21.15.6:0/2079494211 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec001bc0 con 0x7f29f40cf3d0 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.971+0000 7f29f90ca640 1 -- 172.21.15.6:0/2079494211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f40cf3d0 msgr2=0x7f29f40cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.971+0000 7f29f90ca640 1 --2- 172.21.15.6:0/2079494211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f40cf3d0 0x7f29f40cf7e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0097d0 tx=0x7f29dc02a100 comp rx=0 tx=0).stop 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.971+0000 7f29f90ca640 1 -- 172.21.15.6:0/2079494211 shutdown_connections 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.971+0000 7f29f90ca640 1 --2- 172.21.15.6:0/2079494211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f40cf3d0 0x7f29f40cf7e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.971+0000 7f29f90ca640 1 -- 172.21.15.6:0/2079494211 >> 172.21.15.6:0/2079494211 conn(0x7f29f40b44d0 msgr2=0x7f29f40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.971+0000 7f29f90ca640 1 -- 172.21.15.6:0/2079494211 shutdown_connections 2024-05-20T18:01:53.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.971+0000 7f29f90ca640 1 -- 172.21.15.6:0/2079494211 wait complete. 2024-05-20T18:01:53.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.973+0000 7f29f90ca640 1 Processor -- start 2024-05-20T18:01:53.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.973+0000 7f29f90ca640 1 -- start start 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f90ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29f40ce7e0 0x7f29f4147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f90ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29f40cf3d0 0x7f29f414b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f90ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f415f220 0x7f29f415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f90ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f29f40cd680 con 0x7f29f40ce7e0 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f90ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f29f40d0fd0 con 0x7f29f40cf3d0 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f90ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f29f40cd800 con 0x7f29f415f220 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29f40ce7e0 0x7f29f4147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29f40ce7e0 0x7f29f4147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59420/0 (socket says 172.21.15.6:59420) 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.974+0000 7f29f2d9d640 1 -- 172.21.15.6:0/1463287076 learned_addr learned my addr 172.21.15.6:0/1463287076 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f359e640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f415f220 0x7f29f415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29ebfff640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29f40cf3d0 0x7f29f414b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f2d9d640 1 -- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f415f220 msgr2=0x7f29f415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f2d9d640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f415f220 0x7f29f415d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f2d9d640 1 -- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29f40cf3d0 msgr2=0x7f29f414b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f2d9d640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29f40cf3d0 0x7f29f414b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f2d9d640 1 -- 172.21.15.6:0/1463287076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f40b5b50 con 0x7f29f40ce7e0 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f359e640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f415f220 0x7f29f415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29ebfff640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29f40cf3d0 0x7f29f414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f2d9d640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29f40ce7e0 0x7f29f4147eb0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f29e400c3c0 tx=0x7f29e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29eb7fe640 1 -- 172.21.15.6:0/1463287076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4017070 con 0x7f29f40ce7e0 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29eb7fe640 1 -- 172.21.15.6:0/1463287076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e40052f0 con 0x7f29f40ce7e0 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f40b5e30 con 0x7f29f40ce7e0 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29eb7fe640 1 -- 172.21.15.6:0/1463287076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4003830 con 0x7f29f40ce7e0 2024-05-20T18:01:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.975+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f40b63f0 con 0x7f29f40ce7e0 2024-05-20T18:01:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.976+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f406d5c0 con 0x7f29f40ce7e0 2024-05-20T18:01:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.977+0000 7f29eb7fe640 1 -- 172.21.15.6:0/1463287076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29e401a070 con 0x7f29f40ce7e0 2024-05-20T18:01:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.977+0000 7f29eb7fe640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29d406be30 0x7f29d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.977+0000 7f29eb7fe640 1 -- 172.21.15.6:0/1463287076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f29e408a430 con 0x7f29f40ce7e0 2024-05-20T18:01:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.978+0000 7f29ebfff640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29d406be30 0x7f29d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.978+0000 7f29ebfff640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29d406be30 0x7f29d406e340 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f29dc034000 tx=0x7f29dc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:53.982+0000 7f29eb7fe640 1 -- 172.21.15.6:0/1463287076 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f29f406d5c0 con 0x7f29f40ce7e0 2024-05-20T18:01:54.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.203+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29f4075b00 con 0x7f29f40ce7e0 2024-05-20T18:01:54.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.204+0000 7f29eb7fe640 1 -- 172.21.15.6:0/1463287076 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5180 (secure 0 0 0) 0x7f29e4058c80 con 0x7f29f40ce7e0 2024-05-20T18:01:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:54.201 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:01:29.906318+0000","modified":"2024-05-20T18:01:50.563387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6835/524087551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":524087551},{"type":"v1","addr":"172.21.15.6:6835","nonce":524087551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-05-20T18:01:54.202 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 88 2024-05-20T18:01:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29d406be30 msgr2=0x7f29d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29d406be30 0x7f29d406e340 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f29dc034000 tx=0x7f29dc02e000 comp rx=0 tx=0).stop 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29f40ce7e0 msgr2=0x7f29f4147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29f40ce7e0 0x7f29f4147eb0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f29e400c3c0 tx=0x7f29e400c880 comp rx=0 tx=0).stop 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 shutdown_connections 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29d406be30 0x7f29d406e340 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29f415f220 0x7f29f415d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29f40cf3d0 0x7f29f414b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 --2- 172.21.15.6:0/1463287076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29f40ce7e0 0x7f29f4147eb0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 >> 172.21.15.6:0/1463287076 conn(0x7f29f40b44d0 msgr2=0x7f29f40d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 shutdown_connections 2024-05-20T18:01:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.206+0000 7f29f90ca640 1 -- 172.21.15.6:0/1463287076 wait complete. 2024-05-20T18:01:54.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:54.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.333+0000 7f58f860d640 1 Processor -- start 2024-05-20T18:01:54.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.333+0000 7f58f860d640 1 -- start start 2024-05-20T18:01:54.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f860d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f58f00d10e0 0x7f58f00cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f860d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58f00d14f0 0x7f58f00cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f860d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f00d1ac0 con 0x7f58f00cd4d0 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f860d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f58f00d1da0 con 0x7f58f00d14f0 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f860d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f58f00d2080 con 0x7f58f00d10e0 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f5ba8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58f00d14f0 0x7f58f00cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f5ba8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58f00d14f0 0x7f58f00cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59422/0 (socket says 172.21.15.6:59422) 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f5ba8640 1 -- 172.21.15.6:0/1937020968 learned_addr learned my addr 172.21.15.6:0/1937020968 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f63a9640 1 --2- 172.21.15.6:0/1937020968 >> v2:172.21.15.171:3300/0 conn(0x7f58f00d10e0 0x7f58f00cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f5ba8640 1 -- 172.21.15.6:0/1937020968 >> v2:172.21.15.171:3300/0 conn(0x7f58f00d10e0 msgr2=0x7f58f00cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f5ba8640 1 --2- 172.21.15.6:0/1937020968 >> v2:172.21.15.171:3300/0 conn(0x7f58f00d10e0 0x7f58f00cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f5ba8640 1 -- 172.21.15.6:0/1937020968 >> v1:172.21.15.171:6789/0 conn(0x7f58f00cd4d0 legacy=0x7f58f00cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.335+0000 7f58f5ba8640 1 -- 172.21.15.6:0/1937020968 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f00d2360 con 0x7f58f00d14f0 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.336+0000 7f58f5ba8640 1 --2- 172.21.15.6:0/1937020968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f00cf680 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f58f00ccfc0 tx=0x7f58e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d07ec83328bdbb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.336+0000 7f58f53a7640 1 -- 172.21.15.6:0/1937020968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0037070 con 0x7f58f00d14f0 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.336+0000 7f58f53a7640 1 -- 172.21.15.6:0/1937020968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e0032440 con 0x7f58f00d14f0 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.336+0000 7f58f53a7640 1 -- 172.21.15.6:0/1937020968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0032810 con 0x7f58f00d14f0 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.337+0000 7f58f860d640 1 -- 172.21.15.6:0/1937020968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 msgr2=0x7f58f00cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.337+0000 7f58f860d640 1 --2- 172.21.15.6:0/1937020968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f00cf680 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f58f00ccfc0 tx=0x7f58e002a230 comp rx=0 tx=0).stop 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.337+0000 7f58f860d640 1 -- 172.21.15.6:0/1937020968 shutdown_connections 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.337+0000 7f58f860d640 1 --2- 172.21.15.6:0/1937020968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f00cf680 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.337+0000 7f58f860d640 1 --2- 172.21.15.6:0/1937020968 >> v2:172.21.15.171:3300/0 conn(0x7f58f00d10e0 0x7f58f00cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.337+0000 7f58f860d640 1 -- 172.21.15.6:0/1937020968 >> 172.21.15.6:0/1937020968 conn(0x7f58f00b44d0 msgr2=0x7f58f00b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:54.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.337+0000 7f58f860d640 1 -- 172.21.15.6:0/1937020968 shutdown_connections 2024-05-20T18:01:54.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.337+0000 7f58f860d640 1 -- 172.21.15.6:0/1937020968 wait complete. 2024-05-20T18:01:54.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.339+0000 7f58f860d640 1 Processor -- start 2024-05-20T18:01:54.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.339+0000 7f58f860d640 1 -- start start 2024-05-20T18:01:54.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f860d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58f00cd4d0 0x7f58f014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f860d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58f00d10e0 0x7f58f015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f860d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f860d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00b8440 con 0x7f58f00d14f0 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f860d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00b82c0 con 0x7f58f00d10e0 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f860d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58f00709f0 con 0x7f58f00cd4d0 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f6baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f6baa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f015b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59432/0 (socket says 172.21.15.6:59432) 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.340+0000 7f58f6baa640 1 -- 172.21.15.6:0/2245625017 learned_addr learned my addr 172.21.15.6:0/2245625017 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f5ba8640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58f00d10e0 0x7f58f015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f6baa640 1 -- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58f00cd4d0 msgr2=0x7f58f014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f6baa640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58f00cd4d0 0x7f58f014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f6baa640 1 -- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58f00d10e0 msgr2=0x7f58f015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f6baa640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58f00d10e0 0x7f58f015b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f6baa640 1 -- 172.21.15.6:0/2245625017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f00caa10 con 0x7f58f00d14f0 2024-05-20T18:01:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f6baa640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f015b6c0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b9e0 tx=0x7f58e800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58e6ffd640 1 -- 172.21.15.6:0/2245625017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8019070 con 0x7f58f00d14f0 2024-05-20T18:01:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58e6ffd640 1 -- 172.21.15.6:0/2245625017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e800cb20 con 0x7f58f00d14f0 2024-05-20T18:01:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58e6ffd640 1 -- 172.21.15.6:0/2245625017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8014440 con 0x7f58f00d14f0 2024-05-20T18:01:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f00cac90 con 0x7f58f00d14f0 2024-05-20T18:01:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.341+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f00cb250 con 0x7f58f00d14f0 2024-05-20T18:01:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.342+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f015bc00 con 0x7f58f00d14f0 2024-05-20T18:01:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.343+0000 7f58e6ffd640 1 -- 172.21.15.6:0/2245625017 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58e801c070 con 0x7f58f00d14f0 2024-05-20T18:01:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.343+0000 7f58e6ffd640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f58d406be30 0x7f58d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.343+0000 7f58e6ffd640 1 -- 172.21.15.6:0/2245625017 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f58e808ad00 con 0x7f58f00d14f0 2024-05-20T18:01:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.343+0000 7f58f63a9640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f58d406be30 0x7f58d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.344+0000 7f58f63a9640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f58d406be30 0x7f58d406e340 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00a810 tx=0x7f58ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.348+0000 7f58e6ffd640 1 -- 172.21.15.6:0/2245625017 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f58f00caa10 con 0x7f58f00d14f0 2024-05-20T18:01:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.532+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58f00ce880 con 0x7f58f00d14f0 2024-05-20T18:01:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.533+0000 7f58e6ffd640 1 -- 172.21.15.6:0/2245625017 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16852 (secure 0 0 0) 0x7f58e8059520 con 0x7f58f00d14f0 2024-05-20T18:01:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:54.531 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":125,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:31.516805+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:01:27.629166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-05-20T18:01:28.885867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f58d406be30 msgr2=0x7f58d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f58d406be30 0x7f58d406e340 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00a810 tx=0x7f58ec008040 comp rx=0 tx=0).stop 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 msgr2=0x7f58f015b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f015b6c0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b9e0 tx=0x7f58e800bea0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 shutdown_connections 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f58d406be30 0x7f58d406e340 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58f00d14f0 0x7f58f015b6c0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58f00d10e0 0x7f58f015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 --2- 172.21.15.6:0/2245625017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58f00cd4d0 0x7f58f014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.535+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 >> 172.21.15.6:0/2245625017 conn(0x7f58f00b44d0 msgr2=0x7f58f00b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.536+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 shutdown_connections 2024-05-20T18:01:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.536+0000 7f58f860d640 1 -- 172.21.15.6:0/2245625017 wait complete. 2024-05-20T18:01:54.545 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:01:27.629166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:01:28.885867+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:01:54.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:01:54.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.665+0000 7fcfe965a640 1 Processor -- start 2024-05-20T18:01:54.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.665+0000 7fcfe965a640 1 -- start start 2024-05-20T18:01:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe965a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcfe4162820 0x7fcfe40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe965a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe40d0630 con 0x7fcfe40b3e80 2024-05-20T18:01:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe965a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe40d39c0 con 0x7fcfe406dae0 2024-05-20T18:01:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe965a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe40d3ca0 con 0x7fcfe4162820 2024-05-20T18:01:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe27fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcfe40b3e80 0x7fcfe406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42552/0 (socket says 172.21.15.6:42552) 2024-05-20T18:01:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe27fc640 1 -- 172.21.15.6:0/3775692095 learned_addr learned my addr 172.21.15.6:0/3775692095 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:54.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894201084 0 0) 0x7fcfe40d0630 con 0x7fcfe40b3e80 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/3775692095 >> v2:172.21.15.171:3300/0 conn(0x7fcfe4162820 0x7fcfe40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfcc003520 con 0x7fcfe40b3e80 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1906965982 0 0) 0x7fcfcc003520 con 0x7fcfe40b3e80 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 >> v2:172.21.15.171:3300/0 conn(0x7fcfe4162820 msgr2=0x7fcfe40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe1ffb640 1 --2- 172.21.15.6:0/3775692095 >> v2:172.21.15.171:3300/0 conn(0x7fcfe4162820 0x7fcfe40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 >> v1:172.21.15.171:6789/0 conn(0x7fcfe406dae0 legacy=0x7fcfe40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.667+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe40d3f80 con 0x7fcfe40b3e80 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fcfd8001670 con 0x7fcfe40b3e80 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 >> v1:172.21.15.6:6789/0 conn(0x7fcfe40b3e80 legacy=0x7fcfe406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe1ffb640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc0039b0 0x7fcfcc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe1ffb640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc004800 0x7fcfcc004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe1ffb640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe40d3ca0 con 0x7fcfcc0039b0 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfcc00c160 con 0x7fcfcc0051c0 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfcc00c360 con 0x7fcfcc004800 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc0039b0 0x7fcfcc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe37fe640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe27fc640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc004800 0x7fcfcc004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc004800 msgr2=0x7fcfcc004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc004800 0x7fcfcc004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfcc0051c0 msgr2=0x7fcfcc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/3775692095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfcc003520 con 0x7fcfcc0039b0 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe37fe640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfcc0051c0 0x7fcfcc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.668+0000 7fcfe37fe640 1 -- 172.21.15.6:0/3775692095 reap_dead start 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.669+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc0039b0 0x7fcfcc003e20 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009ac0 tx=0x7fcfcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575e4483fe50ba5f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:54.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.669+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4036070 con 0x7fcfcc0039b0 2024-05-20T18:01:54.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.669+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd4031400 con 0x7fcfcc0039b0 2024-05-20T18:01:54.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.669+0000 7fcfe1ffb640 1 -- 172.21.15.6:0/3775692095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4009690 con 0x7fcfcc0039b0 2024-05-20T18:01:54.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.670+0000 7fcfe965a640 1 -- 172.21.15.6:0/3775692095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc0039b0 msgr2=0x7fcfcc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.670+0000 7fcfe965a640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc0039b0 0x7fcfcc003e20 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009ac0 tx=0x7fcfcc005830 comp rx=0 tx=0).stop 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.670+0000 7fcfe965a640 1 -- 172.21.15.6:0/3775692095 shutdown_connections 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.670+0000 7fcfe965a640 1 --2- 172.21.15.6:0/3775692095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc0039b0 0x7fcfcc003e20 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.670+0000 7fcfe965a640 1 -- 172.21.15.6:0/3775692095 >> 172.21.15.6:0/3775692095 conn(0x7fcfe40d4bd0 msgr2=0x7fcfe40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.670+0000 7fcfe965a640 1 -- 172.21.15.6:0/3775692095 shutdown_connections 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.670+0000 7fcfe965a640 1 -- 172.21.15.6:0/3775692095 wait complete. 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.672+0000 7fcfe965a640 1 Processor -- start 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.672+0000 7fcfe965a640 1 -- start start 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe965a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc0039b0 0x7fcfe40cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe965a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe41546e0 0x7fcfe4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe965a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe4157d50 0x7fcfe414ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe965a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe40d4780 con 0x7fcfe4157d50 2024-05-20T18:01:54.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe965a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe40d0300 con 0x7fcfe41546e0 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe965a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe40d4900 con 0x7fcfcc0039b0 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe4157d50 0x7fcfe414ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe4157d50 0x7fcfe414ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59436/0 (socket says 172.21.15.6:59436) 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe37fe640 1 -- 172.21.15.6:0/801527869 learned_addr learned my addr 172.21.15.6:0/801527869 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.673+0000 7fcfe27fc640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe41546e0 0x7fcfe4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc0039b0 0x7fcfe40cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe37fe640 1 -- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc0039b0 msgr2=0x7fcfe40cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe37fe640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc0039b0 0x7fcfe40cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe37fe640 1 -- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe41546e0 msgr2=0x7fcfe4157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe37fe640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe41546e0 0x7fcfe4157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe37fe640 1 -- 172.21.15.6:0/801527869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe40ce7c0 con 0x7fcfe4157d50 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe27fc640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe41546e0 0x7fcfe4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc0039b0 0x7fcfe40cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:54.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe37fe640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe4157d50 0x7fcfe414ac10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fcfe408d500 tx=0x7fcfdc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/801527869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc003970 con 0x7fcfe4157d50 2024-05-20T18:01:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/801527869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfdc018070 con 0x7fcfe4157d50 2024-05-20T18:01:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe40ceaa0 con 0x7fcfe4157d50 2024-05-20T18:01:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/801527869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc003d50 con 0x7fcfe4157d50 2024-05-20T18:01:54.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.674+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe40b6690 con 0x7fcfe4157d50 2024-05-20T18:01:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.675+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe40b68f0 con 0x7fcfe4157d50 2024-05-20T18:01:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.676+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/801527869 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfdc0050d0 con 0x7fcfe4157d50 2024-05-20T18:01:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.676+0000 7fcfcb7fe640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd006be60 0x7fcfd006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.676+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/801527869 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fcfdc08ab10 con 0x7fcfe4157d50 2024-05-20T18:01:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.677+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd006be60 0x7fcfd006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.677+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd006be60 0x7fcfd006e370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4033000 tx=0x7fcfd4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:54.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.681+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/801527869 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcfdc059480 con 0x7fcfe4157d50 2024-05-20T18:01:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.867+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcfe40ce550 con 0x7fcfe4157d50 2024-05-20T18:01:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.868+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/801527869 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) ==== 93+0+10 (secure 0 0 0) 0x7fcfdc01be40 con 0x7fcfe4157d50 2024-05-20T18:01:54.865 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:01:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd006be60 msgr2=0x7fcfd006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd006be60 0x7fcfd006e370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4033000 tx=0x7fcfd4008030 comp rx=0 tx=0).stop 2024-05-20T18:01:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe4157d50 msgr2=0x7fcfe414ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe4157d50 0x7fcfe414ac10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fcfe408d500 tx=0x7fcfdc00eb90 comp rx=0 tx=0).stop 2024-05-20T18:01:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 shutdown_connections 2024-05-20T18:01:54.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfd006be60 0x7fcfd006e370 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfe4157d50 0x7fcfe414ac10 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe41546e0 0x7fcfe4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 --2- 172.21.15.6:0/801527869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfcc0039b0 0x7fcfe40cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 >> 172.21.15.6:0/801527869 conn(0x7fcfe40d4bd0 msgr2=0x7fcfe40b8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 shutdown_connections 2024-05-20T18:01:54.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.870+0000 7fcfe965a640 1 -- 172.21.15.6:0/801527869 wait complete. 2024-05-20T18:01:54.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:01:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.999+0000 7f87e6e28640 1 Processor -- start 2024-05-20T18:01:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:54.999+0000 7f87e6e28640 1 -- start start 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.000+0000 7f87e6e28640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.000+0000 7f87e6e28640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87e00d14b0 0x7f87e00d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.000+0000 7f87e6e28640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e00d0370 con 0x7f87e00b4010 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.000+0000 7f87e6e28640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f87e00d3ca0 con 0x7f87e00d14b0 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.000+0000 7f87e6e28640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f87e00d0650 con 0x7f87e0163a10 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.000+0000 7f87e53c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87e00d14b0 0x7f87e00d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.000+0000 7f87e53c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87e00d14b0 0x7f87e00d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59440/0 (socket says 172.21.15.6:59440) 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.000+0000 7f87e53c5640 1 -- 172.21.15.6:0/2362015981 learned_addr learned my addr 172.21.15.6:0/2362015981 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.001+0000 7f87e4bc4640 1 --2- 172.21.15.6:0/2362015981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.001+0000 7f87e53c5640 1 -- 172.21.15.6:0/2362015981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 msgr2=0x7f87e00d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.001+0000 7f87e53c5640 1 --2- 172.21.15.6:0/2362015981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e00d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.001+0000 7f87e53c5640 1 -- 172.21.15.6:0/2362015981 >> v1:172.21.15.171:6789/0 conn(0x7f87e00b4010 legacy=0x7f87e00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.001+0000 7f87e53c5640 1 -- 172.21.15.6:0/2362015981 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e00d3650 con 0x7f87e00d14b0 2024-05-20T18:01:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.001+0000 7f87e4bc4640 1 --2- 172.21.15.6:0/2362015981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e00d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.001+0000 7f87e53c5640 1 --2- 172.21.15.6:0/2362015981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00d18c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009870 tx=0x7f87d802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a049b1728b1d9434 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87df7fe640 1 -- 172.21.15.6:0/2362015981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8037070 con 0x7f87e00d14b0 2024-05-20T18:01:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87df7fe640 1 -- 172.21.15.6:0/2362015981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d8032440 con 0x7f87e00d14b0 2024-05-20T18:01:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87df7fe640 1 -- 172.21.15.6:0/2362015981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8032810 con 0x7f87e00d14b0 2024-05-20T18:01:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87e6e28640 1 -- 172.21.15.6:0/2362015981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 msgr2=0x7f87e00d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87e6e28640 1 --2- 172.21.15.6:0/2362015981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00d18c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009870 tx=0x7f87d802a200 comp rx=0 tx=0).stop 2024-05-20T18:01:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87e6e28640 1 -- 172.21.15.6:0/2362015981 shutdown_connections 2024-05-20T18:01:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87e6e28640 1 --2- 172.21.15.6:0/2362015981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00d18c0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87e6e28640 1 --2- 172.21.15.6:0/2362015981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e00d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87e6e28640 1 -- 172.21.15.6:0/2362015981 >> 172.21.15.6:0/2362015981 conn(0x7f87e006d240 msgr2=0x7f87e006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87e6e28640 1 -- 172.21.15.6:0/2362015981 shutdown_connections 2024-05-20T18:01:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.002+0000 7f87e6e28640 1 -- 172.21.15.6:0/2362015981 wait complete. 2024-05-20T18:01:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.004+0000 7f87e6e28640 1 Processor -- start 2024-05-20T18:01:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.004+0000 7f87e6e28640 1 -- start start 2024-05-20T18:01:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87e6e28640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e00b4010 0x7f87e0158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87e6e28640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87e6e28640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e01f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87e6e28640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f87e00b8210 con 0x7f87e00d14b0 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87e6e28640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f87e00d1e00 con 0x7f87e00b4010 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87e6e28640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f87e00b8390 con 0x7f87e0163a10 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59454/0 (socket says 172.21.15.6:59454) 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87e4bc4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e00b4010 0x7f87e0158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 -- 172.21.15.6:0/1712122707 learned_addr learned my addr 172.21.15.6:0/1712122707 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87e53c5640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e01f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 -- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 msgr2=0x7f87e01f8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e01f8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 -- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e00b4010 msgr2=0x7f87e0158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e00b4010 0x7f87e0158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 -- 172.21.15.6:0/1712122707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e01599c0 con 0x7f87e00d14b0 2024-05-20T18:01:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dffff640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00ce0e0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f87d400b3e0 tx=0x7f87d4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.006+0000 7f87dd7fa640 1 -- 172.21.15.6:0/1712122707 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4015030 con 0x7f87e00d14b0 2024-05-20T18:01:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.007+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e0159ca0 con 0x7f87e00d14b0 2024-05-20T18:01:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.007+0000 7f87dd7fa640 1 -- 172.21.15.6:0/1712122707 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d4004020 con 0x7f87e00d14b0 2024-05-20T18:01:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.007+0000 7f87dd7fa640 1 -- 172.21.15.6:0/1712122707 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4004410 con 0x7f87e00d14b0 2024-05-20T18:01:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.007+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e015a260 con 0x7f87e00d14b0 2024-05-20T18:01:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.008+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e0075b00 con 0x7f87e00d14b0 2024-05-20T18:01:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.008+0000 7f87dd7fa640 1 -- 172.21.15.6:0/1712122707 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87d4018070 con 0x7f87e00d14b0 2024-05-20T18:01:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.009+0000 7f87dd7fa640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f87cc06be30 0x7f87cc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.009+0000 7f87dd7fa640 1 -- 172.21.15.6:0/1712122707 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f87d408aa70 con 0x7f87e00d14b0 2024-05-20T18:01:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.009+0000 7f87e4bc4640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f87cc06be30 0x7f87cc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.010+0000 7f87e4bc4640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f87cc06be30 0x7f87cc06e340 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f87e00d3020 tx=0x7f87d00077c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.013+0000 7f87dd7fa640 1 -- 172.21.15.6:0/1712122707 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f87d4058b30 con 0x7f87e00d14b0 2024-05-20T18:01:55.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.200+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f87e00d3050 con 0x7f87e00d14b0 2024-05-20T18:01:55.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.201+0000 7f87dd7fa640 1 -- 172.21.15.6:0/1712122707 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) ==== 104+0+11 (secure 0 0 0) 0x7f87d405ce30 con 0x7f87e00d14b0 2024-05-20T18:01:55.198 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:01:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f87cc06be30 msgr2=0x7f87cc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f87cc06be30 0x7f87cc06e340 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f87e00d3020 tx=0x7f87d00077c0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 msgr2=0x7f87e00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00ce0e0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f87d400b3e0 tx=0x7f87d4009f90 comp rx=0 tx=0).stop 2024-05-20T18:01:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 shutdown_connections 2024-05-20T18:01:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f87cc06be30 0x7f87cc06e340 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e0163a10 0x7f87e01f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00d14b0 0x7f87e00ce0e0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 --2- 172.21.15.6:0/1712122707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e00b4010 0x7f87e0158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 >> 172.21.15.6:0/1712122707 conn(0x7f87e006d240 msgr2=0x7f87e0160810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:55.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 shutdown_connections 2024-05-20T18:01:55.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.203+0000 7f87e6e28640 1 -- 172.21.15.6:0/1712122707 wait complete. 2024-05-20T18:01:55.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:01:55.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.332+0000 7f6b5c0fe640 1 Processor -- start 2024-05-20T18:01:55.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.332+0000 7f6b5c0fe640 1 -- start start 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5c0fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6b540cf250 0x7f6b5415f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5c0fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b540b6680 0x7f6b540b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5c0fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b54163020 0x7f6b54163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5c0fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5415f9a0 con 0x7f6b54163020 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5c0fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6b540d0b10 con 0x7f6b540cf250 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5c0fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6b540d27d0 con 0x7f6b540b6680 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5a69b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b54163020 0x7f6b54163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5a69b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b54163020 0x7f6b54163430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59470/0 (socket says 172.21.15.6:59470) 2024-05-20T18:01:55.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.333+0000 7f6b5a69b640 1 -- 172.21.15.6:0/2189461064 learned_addr learned my addr 172.21.15.6:0/2189461064 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.334+0000 7f6b59e9a640 1 --2- 172.21.15.6:0/2189461064 >> v2:172.21.15.171:3300/0 conn(0x7f6b540cf250 0x7f6b5415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.334+0000 7f6b59699640 1 --2- 172.21.15.6:0/2189461064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b540b6680 0x7f6b540b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.334+0000 7f6b5a69b640 1 -- 172.21.15.6:0/2189461064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b540b6680 msgr2=0x7f6b540b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.334+0000 7f6b5a69b640 1 --2- 172.21.15.6:0/2189461064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b540b6680 0x7f6b540b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.334+0000 7f6b5a69b640 1 -- 172.21.15.6:0/2189461064 >> v2:172.21.15.171:3300/0 conn(0x7f6b540cf250 msgr2=0x7f6b5415f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.334+0000 7f6b5a69b640 1 --2- 172.21.15.6:0/2189461064 >> v2:172.21.15.171:3300/0 conn(0x7f6b540cf250 0x7f6b5415f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.334+0000 7f6b5a69b640 1 -- 172.21.15.6:0/2189461064 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b540b6fd0 con 0x7f6b54163020 2024-05-20T18:01:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.335+0000 7f6b5a69b640 1 --2- 172.21.15.6:0/2189461064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b54163020 0x7f6b54163430 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f6b5408c360 tx=0x7f6b4c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f049a18522f3880e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.335+0000 7f6b58e98640 1 -- 172.21.15.6:0/2189461064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c036070 con 0x7f6b54163020 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.335+0000 7f6b58e98640 1 -- 172.21.15.6:0/2189461064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4c031600 con 0x7f6b54163020 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.335+0000 7f6b58e98640 1 -- 172.21.15.6:0/2189461064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0319d0 con 0x7f6b54163020 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.335+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/2189461064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b54163020 msgr2=0x7f6b54163430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.335+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/2189461064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b54163020 0x7f6b54163430 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f6b5408c360 tx=0x7f6b4c02a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.335+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/2189461064 shutdown_connections 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.335+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/2189461064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b54163020 0x7f6b54163430 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.336+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/2189461064 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b540b6680 0x7f6b540b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.336+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/2189461064 >> v2:172.21.15.171:3300/0 conn(0x7f6b540cf250 0x7f6b5415f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.336+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/2189461064 >> 172.21.15.6:0/2189461064 conn(0x7f6b540d1860 msgr2=0x7f6b540d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.336+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/2189461064 shutdown_connections 2024-05-20T18:01:55.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.336+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/2189461064 wait complete. 2024-05-20T18:01:55.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.337+0000 7f6b5c0fe640 1 Processor -- start 2024-05-20T18:01:55.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.338+0000 7f6b5c0fe640 1 -- start start 2024-05-20T18:01:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b5c0fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b540b6680 0x7f6b541e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b5c0fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b540cf250 0x7f6b54149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b5c0fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b54163020 0x7f6b541466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b5c0fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6b540d2a20 con 0x7f6b540b6680 2024-05-20T18:01:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b5c0fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6b540d0830 con 0x7f6b540cf250 2024-05-20T18:01:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b5c0fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6b540d2d00 con 0x7f6b54163020 2024-05-20T18:01:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b540b6680 0x7f6b541e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b540b6680 0x7f6b541e8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59480/0 (socket says 172.21.15.6:59480) 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 -- 172.21.15.6:0/627462954 learned_addr learned my addr 172.21.15.6:0/627462954 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59699640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b540cf250 0x7f6b54149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b5a69b640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b54163020 0x7f6b541466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 -- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b54163020 msgr2=0x7f6b541466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b54163020 0x7f6b541466d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 -- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b540cf250 msgr2=0x7f6b54149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b540cf250 0x7f6b54149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 -- 172.21.15.6:0/627462954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b54162340 con 0x7f6b540b6680 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b5a69b640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b54163020 0x7f6b541466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:55.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.339+0000 7f6b59e9a640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b540b6680 0x7f6b541e8df0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000e8a0 tx=0x7f6b5000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.340+0000 7f6b4a7fc640 1 -- 172.21.15.6:0/627462954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50017070 con 0x7f6b540b6680 2024-05-20T18:01:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.340+0000 7f6b4a7fc640 1 -- 172.21.15.6:0/627462954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5000c940 con 0x7f6b540b6680 2024-05-20T18:01:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.340+0000 7f6b4a7fc640 1 -- 172.21.15.6:0/627462954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000cd30 con 0x7f6b540b6680 2024-05-20T18:01:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.340+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b541475e0 con 0x7f6b540b6680 2024-05-20T18:01:55.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.340+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b54147ba0 con 0x7f6b540b6680 2024-05-20T18:01:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.341+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b54075b00 con 0x7f6b540b6680 2024-05-20T18:01:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.341+0000 7f6b4a7fc640 1 -- 172.21.15.6:0/627462954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b5001a070 con 0x7f6b540b6680 2024-05-20T18:01:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.342+0000 7f6b4a7fc640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6b3806be30 0x7f6b3806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.342+0000 7f6b4a7fc640 1 -- 172.21.15.6:0/627462954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f6b5008b1a0 con 0x7f6b540b6680 2024-05-20T18:01:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.342+0000 7f6b59699640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6b3806be30 0x7f6b3806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.343+0000 7f6b59699640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6b3806be30 0x7f6b3806e340 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6b541f9260 tx=0x7f6b44009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.346+0000 7f6b4a7fc640 1 -- 172.21.15.6:0/627462954 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6b500592d0 con 0x7f6b540b6680 2024-05-20T18:01:55.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.528+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6b540b7440 con 0x7f6b540b6680 2024-05-20T18:01:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.528+0000 7f6b4a7fc640 1 -- 172.21.15.6:0/627462954 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) ==== 100+0+11 (secure 0 0 0) 0x7f6b5005d5d0 con 0x7f6b540b6680 2024-05-20T18:01:55.615 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:01:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6b3806be30 msgr2=0x7f6b3806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6b3806be30 0x7f6b3806e340 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6b541f9260 tx=0x7f6b44009190 comp rx=0 tx=0).stop 2024-05-20T18:01:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b540b6680 msgr2=0x7f6b541e8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b540b6680 0x7f6b541e8df0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000e8a0 tx=0x7f6b5000ed60 comp rx=0 tx=0).stop 2024-05-20T18:01:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 shutdown_connections 2024-05-20T18:01:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6b3806be30 0x7f6b3806e340 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b54163020 0x7f6b541466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b540cf250 0x7f6b54149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 --2- 172.21.15.6:0/627462954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b540b6680 0x7f6b541e8df0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 >> 172.21.15.6:0/627462954 conn(0x7f6b540d1860 msgr2=0x7f6b5415bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 shutdown_connections 2024-05-20T18:01:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.530+0000 7f6b5c0fe640 1 -- 172.21.15.6:0/627462954 wait complete. 2024-05-20T18:01:55.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.735+0000 7fcbe5de0640 1 Processor -- start 2024-05-20T18:01:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.735+0000 7fcbe5de0640 1 -- start start 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbe5de0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbe0162820 0x7fcbe00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbe5de0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe00d0630 con 0x7fcbe00b3e80 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbe5de0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe00d39c0 con 0x7fcbe006dae0 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbe5de0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00d3ca0 con 0x7fcbe0162820 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbdeffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcbe00b3e80 0x7fcbe006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42564/0 (socket says 172.21.15.6:42564) 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbdeffd640 1 -- 172.21.15.6:0/1500935953 learned_addr learned my addr 172.21.15.6:0/1500935953 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbdf7fe640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbe0162820 0x7fcbe00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694968386 0 0) 0x7fcbe00d0630 con 0x7fcbe00b3e80 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbc8003520 con 0x7fcbe00b3e80 2024-05-20T18:01:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2079498747 0 0) 0x7fcbc8003520 con 0x7fcbe00b3e80 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbe0162820 msgr2=0x7fcbe00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbe0162820 0x7fcbe00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 >> v1:172.21.15.171:6789/0 conn(0x7fcbe006dae0 legacy=0x7fcbe00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe00d3f80 con 0x7fcbe00b3e80 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fcbd4001670 con 0x7fcbe00b3e80 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 >> v1:172.21.15.6:6789/0 conn(0x7fcbe00b3e80 legacy=0x7fcbe006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.737+0000 7fcbde7fc640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc80039e0 0x7fcbc8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbde7fc640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbe0162820 0x7fcbc8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbde7fc640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbc8004d40 0x7fcbc8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d3ca0 con 0x7fcbc80039e0 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc800ba70 con 0x7fcbc8004d40 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc800bc70 con 0x7fcbe0162820 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbdf7fe640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc80039e0 0x7fcbc8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbdeffd640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbe0162820 0x7fcbc8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbdffff640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbc8004d40 0x7fcbc8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbdf7fe640 1 -- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbe0162820 msgr2=0x7fcbc8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbdf7fe640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbe0162820 0x7fcbc8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbdf7fe640 1 -- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbc8004d40 msgr2=0x7fcbc8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbdf7fe640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbc8004d40 0x7fcbc8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.738+0000 7fcbdf7fe640 1 -- 172.21.15.6:0/1500935953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc8003520 con 0x7fcbc80039e0 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.739+0000 7fcbdf7fe640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc80039e0 0x7fcbc8003e10 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009ac0 tx=0x7fcbc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5667d9721e4b902e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.739+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0036070 con 0x7fcbc80039e0 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.739+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd0031400 con 0x7fcbc80039e0 2024-05-20T18:01:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.739+0000 7fcbde7fc640 1 -- 172.21.15.6:0/1500935953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0009690 con 0x7fcbc80039e0 2024-05-20T18:01:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.740+0000 7fcbe5de0640 1 -- 172.21.15.6:0/1500935953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc80039e0 msgr2=0x7fcbc8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.740+0000 7fcbe5de0640 1 --2- 172.21.15.6:0/1500935953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbc80039e0 0x7fcbc8003e10 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009ac0 tx=0x7fcbc8005830 comp rx=0 tx=0).stop 2024-05-20T18:01:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.740+0000 7fcbdffff640 1 -- 172.21.15.6:0/1500935953 reap_dead start 2024-05-20T18:01:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.740+0000 7fcbe5de0640 1 -- 172.21.15.6:0/1500935953 shutdown_connections 2024-05-20T18:01:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.740+0000 7fcbe5de0640 1 -- 172.21.15.6:0/1500935953 >> 172.21.15.6:0/1500935953 conn(0x7fcbe00d4bd0 msgr2=0x7fcbe00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.740+0000 7fcbe5de0640 1 -- 172.21.15.6:0/1500935953 shutdown_connections 2024-05-20T18:01:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.740+0000 7fcbe5de0640 1 -- 172.21.15.6:0/1500935953 wait complete. 2024-05-20T18:01:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.741+0000 7fcbe5de0640 1 Processor -- start 2024-05-20T18:01:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.742+0000 7fcbe5de0640 1 -- start start 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbe5de0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbc80039e0 0x7fcbe00ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbe5de0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbe01f4fe0 0x7fcbe014f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbe5de0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe00b6bd0 0x7fcbe00b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbe5de0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d4780 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbe5de0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d0300 con 0x7fcbe01f4fe0 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbe5de0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00d4900 con 0x7fcbc80039e0 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe00b6bd0 0x7fcbe00b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe00b6bd0 0x7fcbe00b6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59506/0 (socket says 172.21.15.6:59506) 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdffff640 1 -- 172.21.15.6:0/3827244804 learned_addr learned my addr 172.21.15.6:0/3827244804 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdf7fe640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbc80039e0 0x7fcbe00ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdeffd640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbe01f4fe0 0x7fcbe014f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdffff640 1 -- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbc80039e0 msgr2=0x7fcbe00ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdffff640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbc80039e0 0x7fcbe00ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdffff640 1 -- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbe01f4fe0 msgr2=0x7fcbe014f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdffff640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbe01f4fe0 0x7fcbe014f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.743+0000 7fcbdffff640 1 -- 172.21.15.6:0/3827244804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe00b5b30 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.744+0000 7fcbdffff640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe00b6bd0 0x7fcbe00b6fe0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00b76d0 tx=0x7fcbd800feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.744+0000 7fcbc7fff640 1 -- 172.21.15.6:0/3827244804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8019070 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.744+0000 7fcbc7fff640 1 -- 172.21.15.6:0/3827244804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd8006e20 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.744+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe00b5e10 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.744+0000 7fcbc7fff640 1 -- 172.21.15.6:0/3827244804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8003b90 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.744+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe00b63d0 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.745+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe00cc0c0 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.745+0000 7fcbc7fff640 1 -- 172.21.15.6:0/3827244804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbd801c070 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.746+0000 7fcbc7fff640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcbcc06be30 0x7fcbcc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.746+0000 7fcbc7fff640 1 -- 172.21.15.6:0/3827244804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fcbd808a1f0 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.746+0000 7fcbdf7fe640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcbcc06be30 0x7fcbcc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:55.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.747+0000 7fcbdf7fe640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcbcc06be30 0x7fcbcc06e340 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0033000 tx=0x7fcbd0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.751+0000 7fcbc7fff640 1 -- 172.21.15.6:0/3827244804 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcbd8058330 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.973+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbe0075b00 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.973+0000 7fcbc7fff640 1 -- 172.21.15.6:0/3827244804 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5180 (secure 0 0 0) 0x7fcbd805c630 con 0x7fcbe00b6bd0 2024-05-20T18:01:55.970 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:55.970 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:01:29.906318+0000","modified":"2024-05-20T18:01:50.563387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6835/524087551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":524087551},{"type":"v1","addr":"172.21.15.6:6835","nonce":524087551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-05-20T18:01:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 88 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcbcc06be30 msgr2=0x7fcbcc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcbcc06be30 0x7fcbcc06e340 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0033000 tx=0x7fcbd0008030 comp rx=0 tx=0).stop 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe00b6bd0 msgr2=0x7fcbe00b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe00b6bd0 0x7fcbe00b6fe0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00b76d0 tx=0x7fcbd800feb0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 shutdown_connections 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcbcc06be30 0x7fcbcc06e340 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe00b6bd0 0x7fcbe00b6fe0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbe01f4fe0 0x7fcbe014f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 --2- 172.21.15.6:0/3827244804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbc80039e0 0x7fcbe00ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 >> 172.21.15.6:0/3827244804 conn(0x7fcbe00d4bd0 msgr2=0x7fcbe00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 shutdown_connections 2024-05-20T18:01:55.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:55.975+0000 7fcbe5de0640 1 -- 172.21.15.6:0/3827244804 wait complete. 2024-05-20T18:01:55.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:56.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.104+0000 7f64b8879640 1 Processor -- start 2024-05-20T18:01:56.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.104+0000 7f64b8879640 1 -- start start 2024-05-20T18:01:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.105+0000 7f64b8879640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f64b415d530 0x7f64b415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.105+0000 7f64b8879640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b40cd580 con 0x7f64b40b1700 2024-05-20T18:01:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.105+0000 7f64b8879640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b40cd860 con 0x7f64b4070850 2024-05-20T18:01:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.105+0000 7f64b8879640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f64b40ce190 con 0x7f64b415d530 2024-05-20T18:01:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.105+0000 7f64b1d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f64b40b1700 0x7f64b40b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42578/0 (socket says 172.21.15.6:42578) 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.105+0000 7f64b1d9b640 1 -- 172.21.15.6:0/3482325243 learned_addr learned my addr 172.21.15.6:0/3482325243 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448162302 0 0) 0x7f64b40cd580 con 0x7f64b40b1700 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64a0003520 con 0x7f64b40b1700 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b259c640 1 --2- 172.21.15.6:0/3482325243 >> v2:172.21.15.171:3300/0 conn(0x7f64b415d530 0x7f64b415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2465225597 0 0) 0x7f64a0003520 con 0x7f64b40b1700 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 >> v2:172.21.15.171:3300/0 conn(0x7f64b415d530 msgr2=0x7f64b415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 --2- 172.21.15.6:0/3482325243 >> v2:172.21.15.171:3300/0 conn(0x7f64b415d530 0x7f64b415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 >> v1:172.21.15.171:6789/0 conn(0x7f64b4070850 legacy=0x7f64b4070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b40cdb40 con 0x7f64b40b1700 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f649c001670 con 0x7f64b40b1700 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 >> v1:172.21.15.6:6789/0 conn(0x7f64b40b1700 legacy=0x7f64b40b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a00039b0 0x7f64a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a0004800 0x7f64a0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64a00051c0 0x7f64a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f64b40ce190 con 0x7f64a00039b0 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f64a000c160 con 0x7f64a0004800 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f64a000c360 con 0x7f64a00051c0 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b259c640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a00039b0 0x7f64a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b1d9b640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a0004800 0x7f64a0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b2d9d640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64a00051c0 0x7f64a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b259c640 1 -- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64a00051c0 msgr2=0x7f64a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b259c640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64a00051c0 0x7f64a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b259c640 1 -- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a0004800 msgr2=0x7f64a0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b259c640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a0004800 0x7f64a0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b259c640 1 -- 172.21.15.6:0/3482325243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a0003520 con 0x7f64a00039b0 2024-05-20T18:01:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.106+0000 7f64b2d9d640 1 -- 172.21.15.6:0/3482325243 reap_dead start 2024-05-20T18:01:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.107+0000 7f64b1d9b640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a0004800 0x7f64a0004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.107+0000 7f64b259c640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a00039b0 0x7f64a0003e20 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009f90 tx=0x7f64a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d91fface247acb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.107+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4037070 con 0x7f64a00039b0 2024-05-20T18:01:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.107+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a40325f0 con 0x7f64a00039b0 2024-05-20T18:01:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.107+0000 7f64b159a640 1 -- 172.21.15.6:0/3482325243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4009c10 con 0x7f64a00039b0 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.108+0000 7f64b8879640 1 -- 172.21.15.6:0/3482325243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a00039b0 msgr2=0x7f64a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.108+0000 7f64b8879640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a00039b0 0x7f64a0003e20 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009f90 tx=0x7f64a0005830 comp rx=0 tx=0).stop 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.108+0000 7f64b8879640 1 -- 172.21.15.6:0/3482325243 shutdown_connections 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.108+0000 7f64b8879640 1 --2- 172.21.15.6:0/3482325243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64a00039b0 0x7f64a0003e20 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.108+0000 7f64b8879640 1 -- 172.21.15.6:0/3482325243 >> 172.21.15.6:0/3482325243 conn(0x7f64b40d29d0 msgr2=0x7f64b40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.108+0000 7f64b8879640 1 -- 172.21.15.6:0/3482325243 shutdown_connections 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.108+0000 7f64b8879640 1 -- 172.21.15.6:0/3482325243 wait complete. 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.110+0000 7f64b8879640 1 Processor -- start 2024-05-20T18:01:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.110+0000 7f64b8879640 1 -- start start 2024-05-20T18:01:56.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.111+0000 7f64b8879640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a00039b0 0x7f64b4154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.111+0000 7f64b8879640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64b40cbe20 0x7f64b40cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b8879640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64b415b850 0x7f64b415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b8879640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f64b415aaa0 con 0x7f64b40cbe20 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b8879640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f64b40cd230 con 0x7f64a00039b0 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b8879640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f64b415ac20 con 0x7f64b415b850 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64b40cbe20 0x7f64b40cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64b40cbe20 0x7f64b40cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59530/0 (socket says 172.21.15.6:59530) 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 -- 172.21.15.6:0/4108681328 learned_addr learned my addr 172.21.15.6:0/4108681328 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b2d9d640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64b415b850 0x7f64b415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b259c640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a00039b0 0x7f64b4154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 -- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64b415b850 msgr2=0x7f64b415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64b415b850 0x7f64b415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 -- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a00039b0 msgr2=0x7f64b4154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a00039b0 0x7f64b4154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 -- 172.21.15.6:0/4108681328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b40cc770 con 0x7f64b40cbe20 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b2d9d640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64b415b850 0x7f64b415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b1d9b640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64b40cbe20 0x7f64b40cc230 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f649c00e7b0 tx=0x7f649c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64aaffd640 1 -- 172.21.15.6:0/4108681328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c00ee60 con 0x7f64b40cbe20 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64aaffd640 1 -- 172.21.15.6:0/4108681328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c018070 con 0x7f64b40cbe20 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b41584e0 con 0x7f64b40cbe20 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64aaffd640 1 -- 172.21.15.6:0/4108681328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c00cad0 con 0x7f64b40cbe20 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.112+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b415b050 con 0x7f64b40cbe20 2024-05-20T18:01:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.113+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b4075b00 con 0x7f64b40cbe20 2024-05-20T18:01:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.114+0000 7f64aaffd640 1 -- 172.21.15.6:0/4108681328 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f649c00cc70 con 0x7f64b40cbe20 2024-05-20T18:01:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.114+0000 7f64aaffd640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f649406be60 0x7f649406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.115+0000 7f64aaffd640 1 -- 172.21.15.6:0/4108681328 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f649c08ae80 con 0x7f64b40cbe20 2024-05-20T18:01:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.115+0000 7f64b259c640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f649406be60 0x7f649406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.115+0000 7f64b259c640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f649406be60 0x7f649406e370 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f64a4034000 tx=0x7f64a402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.119+0000 7f64aaffd640 1 -- 172.21.15.6:0/4108681328 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f64b40cc770 con 0x7f64b40cbe20 2024-05-20T18:01:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.303+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64b40b3f40 con 0x7f64b40cbe20 2024-05-20T18:01:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.304+0000 7f64aaffd640 1 -- 172.21.15.6:0/4108681328 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16852 (secure 0 0 0) 0x7f649c059600 con 0x7f64b40cbe20 2024-05-20T18:01:56.302 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:56.302 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":125,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:31.516805+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:01:27.629166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-05-20T18:01:28.885867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f649406be60 msgr2=0x7f649406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f649406be60 0x7f649406e370 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f64a4034000 tx=0x7f64a402f000 comp rx=0 tx=0).stop 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64b40cbe20 msgr2=0x7f64b40cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64b40cbe20 0x7f64b40cc230 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f649c00e7b0 tx=0x7f649c00ec70 comp rx=0 tx=0).stop 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 shutdown_connections 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f649406be60 0x7f649406e370 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f64b415b850 0x7f64b415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64b40cbe20 0x7f64b40cc230 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 --2- 172.21.15.6:0/4108681328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64a00039b0 0x7f64b4154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 >> 172.21.15.6:0/4108681328 conn(0x7f64b40d29d0 msgr2=0x7f64b415f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 shutdown_connections 2024-05-20T18:01:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.306+0000 7f64b8879640 1 -- 172.21.15.6:0/4108681328 wait complete. 2024-05-20T18:01:56.315 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T18:01:56.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.433+0000 7f55aeb0f640 1 Processor -- start 2024-05-20T18:01:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.433+0000 7f55aeb0f640 1 -- start start 2024-05-20T18:01:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.434+0000 7f55aeb0f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f55a80b4010 0x7f55a80d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.434+0000 7f55aeb0f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a80d0370 con 0x7f55a80d14b0 2024-05-20T18:01:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.434+0000 7f55aeb0f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a80d0650 con 0x7f55a8163a10 2024-05-20T18:01:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.434+0000 7f55aeb0f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f55a80d3ca0 con 0x7f55a80b4010 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.434+0000 7f55ad0ac640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f55a80d14b0 0x7f55a80d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42588/0 (socket says 172.21.15.6:42588) 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.434+0000 7f55ad0ac640 1 -- 172.21.15.6:0/464352135 learned_addr learned my addr 172.21.15.6:0/464352135 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3593183888 0 0) 0x7f55a80d0370 con 0x7f55a80d14b0 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5594003520 con 0x7f55a80d14b0 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a7fff640 1 --2- 172.21.15.6:0/464352135 >> v2:172.21.15.171:3300/0 conn(0x7f55a80b4010 0x7f55a80d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3388871853 0 0) 0x7f5594003520 con 0x7f55a80d14b0 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 >> v2:172.21.15.171:3300/0 conn(0x7f55a80b4010 msgr2=0x7f55a80d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 --2- 172.21.15.6:0/464352135 >> v2:172.21.15.171:3300/0 conn(0x7f55a80b4010 0x7f55a80d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 >> v1:172.21.15.171:6789/0 conn(0x7f55a8163a10 legacy=0x7f55a80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a80d3650 con 0x7f55a80d14b0 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f55a00019f0 con 0x7f55a80d14b0 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a7fff640 1 --2- 172.21.15.6:0/464352135 >> v2:172.21.15.171:3300/0 conn(0x7f55a80b4010 0x7f55a80d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:56.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 >> v1:172.21.15.6:6789/0 conn(0x7f55a80d14b0 legacy=0x7f55a80d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55940039b0 0x7f5594003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5594004800 0x7f5594004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5594005270 0x7f559400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55a80d3ca0 con 0x7f55940039b0 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f559400c200 con 0x7f5594004800 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f559400c400 con 0x7f5594005270 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55ac8ab640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55940039b0 0x7f5594003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55ad0ac640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5594005270 0x7f559400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a7fff640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5594004800 0x7f5594004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55ac8ab640 1 -- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5594005270 msgr2=0x7f559400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55ac8ab640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5594005270 0x7f559400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55ac8ab640 1 -- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5594004800 msgr2=0x7f5594004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55ac8ab640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5594004800 0x7f5594004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55ad0ac640 1 -- 172.21.15.6:0/464352135 reap_dead start 2024-05-20T18:01:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55ac8ab640 1 -- 172.21.15.6:0/464352135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5594003520 con 0x7f55940039b0 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.435+0000 7f55a7fff640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5594004800 0x7f5594004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.436+0000 7f55ac8ab640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55940039b0 0x7f5594003e20 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f5598001720 tx=0x7f5594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b439228b5550189 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.436+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598001370 con 0x7f55940039b0 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.436+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55980052d0 con 0x7f55940039b0 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.436+0000 7f55a77fe640 1 -- 172.21.15.6:0/464352135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559802abc0 con 0x7f55940039b0 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.437+0000 7f55aeb0f640 1 -- 172.21.15.6:0/464352135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55940039b0 msgr2=0x7f5594003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.437+0000 7f55aeb0f640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55940039b0 0x7f5594003e20 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f5598001720 tx=0x7f5594005830 comp rx=0 tx=0).stop 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.437+0000 7f55aeb0f640 1 -- 172.21.15.6:0/464352135 shutdown_connections 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.437+0000 7f55aeb0f640 1 --2- 172.21.15.6:0/464352135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55940039b0 0x7f5594003e20 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.437+0000 7f55aeb0f640 1 -- 172.21.15.6:0/464352135 >> 172.21.15.6:0/464352135 conn(0x7f55a806d240 msgr2=0x7f55a806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.437+0000 7f55aeb0f640 1 -- 172.21.15.6:0/464352135 shutdown_connections 2024-05-20T18:01:56.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.437+0000 7f55aeb0f640 1 -- 172.21.15.6:0/464352135 wait complete. 2024-05-20T18:01:56.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.439+0000 7f55aeb0f640 1 Processor -- start 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.439+0000 7f55aeb0f640 1 -- start start 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.440+0000 7f55aeb0f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55940039b0 0x7f55a81f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.440+0000 7f55aeb0f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55a81f9ab0 0x7f55a81f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.440+0000 7f55aeb0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a81f9330 0x7f55a80b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.440+0000 7f55aeb0f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f55a80d42b0 con 0x7f55a81f9330 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.440+0000 7f55aeb0f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f55a80d4130 con 0x7f55a81f9ab0 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.440+0000 7f55aeb0f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f55a80d4430 con 0x7f55940039b0 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a81f9330 0x7f55a80b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a81f9330 0x7f55a80b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59546/0 (socket says 172.21.15.6:59546) 2024-05-20T18:01:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 -- 172.21.15.6:0/1622976619 learned_addr learned my addr 172.21.15.6:0/1622976619 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ac8ab640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55940039b0 0x7f55a81f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55a7fff640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55a81f9ab0 0x7f55a81f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 -- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55940039b0 msgr2=0x7f55a81f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55940039b0 0x7f55a81f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 -- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55a81f9ab0 msgr2=0x7f55a81f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55a81f9ab0 0x7f55a81f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 -- 172.21.15.6:0/1622976619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a81f9740 con 0x7f55a81f9330 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55a7fff640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55a81f9ab0 0x7f55a81f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55ad0ac640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a81f9330 0x7f55a80b2720 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f55a808d9d0 tx=0x7f55a0007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55a57fa640 1 -- 172.21.15.6:0/1622976619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a000abc0 con 0x7f55a81f9330 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55a57fa640 1 -- 172.21.15.6:0/1622976619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a0018070 con 0x7f55a81f9330 2024-05-20T18:01:56.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a80b61c0 con 0x7f55a81f9330 2024-05-20T18:01:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55a57fa640 1 -- 172.21.15.6:0/1622976619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a00133f0 con 0x7f55a81f9330 2024-05-20T18:01:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.441+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a81583b0 con 0x7f55a81f9330 2024-05-20T18:01:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.442+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a80b5f30 con 0x7f55a81f9330 2024-05-20T18:01:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.443+0000 7f55a57fa640 1 -- 172.21.15.6:0/1622976619 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55a0013590 con 0x7f55a81f9330 2024-05-20T18:01:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.443+0000 7f55a57fa640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f558806be30 0x7f558806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.443+0000 7f55a57fa640 1 -- 172.21.15.6:0/1622976619 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f55a008b770 con 0x7f55a81f9330 2024-05-20T18:01:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.444+0000 7f55ac8ab640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f558806be30 0x7f558806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.444+0000 7f55ac8ab640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f558806be30 0x7f558806e340 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5598032000 tx=0x7f559802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.448+0000 7f55a57fa640 1 -- 172.21.15.6:0/1622976619 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f55a81f9740 con 0x7f55a81f9330 2024-05-20T18:01:56.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.669+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55a8075b00 con 0x7f55a81f9330 2024-05-20T18:01:56.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.669+0000 7f55a57fa640 1 -- 172.21.15.6:0/1622976619 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5180 (secure 0 0 0) 0x7f55a0059e60 con 0x7f55a81f9330 2024-05-20T18:01:56.666 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:56.667 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:01:29.906318+0000","modified":"2024-05-20T18:01:50.563387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6835/524087551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":524087551},{"type":"v1","addr":"172.21.15.6:6835","nonce":524087551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-05-20T18:01:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 88 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.671+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f558806be30 msgr2=0x7f558806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.671+0000 7f55aeb0f640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f558806be30 0x7f558806e340 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5598032000 tx=0x7f559802e000 comp rx=0 tx=0).stop 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.671+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a81f9330 msgr2=0x7f55a80b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.671+0000 7f55aeb0f640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a81f9330 0x7f55a80b2720 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f55a808d9d0 tx=0x7f55a0007b20 comp rx=0 tx=0).stop 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.672+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 shutdown_connections 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.672+0000 7f55aeb0f640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f558806be30 0x7f558806e340 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.672+0000 7f55aeb0f640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a81f9330 0x7f55a80b2720 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.672+0000 7f55aeb0f640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55a81f9ab0 0x7f55a81f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.672+0000 7f55aeb0f640 1 --2- 172.21.15.6:0/1622976619 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f55940039b0 0x7f55a81f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.672+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 >> 172.21.15.6:0/1622976619 conn(0x7f55a806d240 msgr2=0x7f55a815fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.672+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 shutdown_connections 2024-05-20T18:01:56.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.672+0000 7f55aeb0f640 1 -- 172.21.15.6:0/1622976619 wait complete. 2024-05-20T18:01:56.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:01:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.798+0000 7fd0949aa640 1 Processor -- start 2024-05-20T18:01:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.798+0000 7fd0949aa640 1 -- start start 2024-05-20T18:01:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd0949aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd09015f220 0x7fd0900cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd0949aa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0900cfd20 con 0x7fd0900cd680 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd0949aa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd09006d0f0 con 0x7fd0900cf910 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd0949aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd0900cda90 con 0x7fd09015f220 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd087fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd09015f220 0x7fd0900cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd08e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd0900cd680 0x7fd09006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42600/0 (socket says 172.21.15.6:42600) 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd087fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd09015f220 0x7fd0900cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59554/0 (socket says 172.21.15.6:59554) 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd08e59c640 1 -- 172.21.15.6:0/3171738574 learned_addr learned my addr 172.21.15.6:0/3171738574 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.799+0000 7fd087fff640 1 -- 172.21.15.6:0/3171738574 >> v1:172.21.15.171:6789/0 conn(0x7fd0900cf910 legacy=0x7fd0900d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.800+0000 7fd087fff640 1 -- 172.21.15.6:0/3171738574 >> v1:172.21.15.6:6789/0 conn(0x7fd0900cd680 legacy=0x7fd09006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.800+0000 7fd087fff640 1 -- 172.21.15.6:0/3171738574 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09006d3d0 con 0x7fd09015f220 2024-05-20T18:01:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.800+0000 7fd08dd9b640 1 -- 172.21.15.6:0/3171738574 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280510085 0 0) 0x7fd080001110 con 0x7fd0900cd680 2024-05-20T18:01:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.800+0000 7fd087fff640 1 --2- 172.21.15.6:0/3171738574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900cf3d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fd0780097a0 tx=0x7fd07802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b5174b1144c6a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.800+0000 7fd08dd9b640 1 -- 172.21.15.6:0/3171738574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078037070 con 0x7fd09015f220 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.800+0000 7fd08dd9b640 1 -- 172.21.15.6:0/3171738574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078032440 con 0x7fd09015f220 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.801+0000 7fd08dd9b640 1 -- 172.21.15.6:0/3171738574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07802ae60 con 0x7fd09015f220 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.801+0000 7fd0949aa640 1 -- 172.21.15.6:0/3171738574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 msgr2=0x7fd0900cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.801+0000 7fd0949aa640 1 --2- 172.21.15.6:0/3171738574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900cf3d0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fd0780097a0 tx=0x7fd07802a110 comp rx=0 tx=0).stop 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.801+0000 7fd0949aa640 1 -- 172.21.15.6:0/3171738574 shutdown_connections 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.801+0000 7fd0949aa640 1 --2- 172.21.15.6:0/3171738574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900cf3d0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.801+0000 7fd0949aa640 1 -- 172.21.15.6:0/3171738574 >> 172.21.15.6:0/3171738574 conn(0x7fd0900b44d0 msgr2=0x7fd0900b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.801+0000 7fd0949aa640 1 -- 172.21.15.6:0/3171738574 shutdown_connections 2024-05-20T18:01:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.801+0000 7fd0949aa640 1 -- 172.21.15.6:0/3171738574 wait complete. 2024-05-20T18:01:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.803+0000 7fd0949aa640 1 Processor -- start 2024-05-20T18:01:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.803+0000 7fd0949aa640 1 -- start start 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd0949aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0900cd680 0x7fd0901eb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd0949aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0900cf910 0x7fd090151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd0949aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd0949aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd09006cdd0 con 0x7fd09015f220 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd0949aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd09006d990 con 0x7fd0900cf910 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd0949aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd09015f630 con 0x7fd0900cd680 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900d2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59558/0 (socket says 172.21.15.6:59558) 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 -- 172.21.15.6:0/1223275446 learned_addr learned my addr 172.21.15.6:0/1223275446 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd087fff640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0900cf910 0x7fd090151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08e59c640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0900cd680 0x7fd0901eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 -- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0900cd680 msgr2=0x7fd0901eb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0900cd680 0x7fd0901eb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 -- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0900cf910 msgr2=0x7fd090151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0900cf910 0x7fd090151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 -- 172.21.15.6:0/1223275446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09015f8a0 con 0x7fd09015f220 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd08ed9d640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900d2d00 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fd08800c6b0 tx=0x7fd08800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd086ffd640 1 -- 172.21.15.6:0/1223275446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088003b70 con 0x7fd09015f220 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.805+0000 7fd086ffd640 1 -- 172.21.15.6:0/1223275446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd088003d30 con 0x7fd09015f220 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.806+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0900b6570 con 0x7fd09015f220 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.806+0000 7fd086ffd640 1 -- 172.21.15.6:0/1223275446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd088005310 con 0x7fd09015f220 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.806+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0900b6b30 con 0x7fd09015f220 2024-05-20T18:01:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.807+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09015fa70 con 0x7fd09015f220 2024-05-20T18:01:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.807+0000 7fd086ffd640 1 -- 172.21.15.6:0/1223275446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0880054b0 con 0x7fd09015f220 2024-05-20T18:01:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.808+0000 7fd086ffd640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd07006be30 0x7fd07006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.808+0000 7fd086ffd640 1 -- 172.21.15.6:0/1223275446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fd08808acf0 con 0x7fd09015f220 2024-05-20T18:01:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.808+0000 7fd08e59c640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd07006be30 0x7fd07006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.808+0000 7fd08e59c640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd07006be30 0x7fd07006e340 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd080000f60 tx=0x7fd080007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:56.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:56.812+0000 7fd086ffd640 1 -- 172.21.15.6:0/1223275446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd08808f070 con 0x7fd09015f220 2024-05-20T18:01:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.033+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0900c6160 con 0x7fd09015f220 2024-05-20T18:01:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.034+0000 7fd086ffd640 1 -- 172.21.15.6:0/1223275446 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5180 (secure 0 0 0) 0x7fd088058ed0 con 0x7fd09015f220 2024-05-20T18:01:57.031 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:57.031 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:01:29.906318+0000","modified":"2024-05-20T18:01:50.563387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"c","rank":0,"incarnation":81,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6835/524087551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":524087551},{"type":"v1","addr":"172.21.15.6:6835","nonce":524087551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-05-20T18:01:57.031 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 88 2024-05-20T18:01:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd07006be30 msgr2=0x7fd07006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd07006be30 0x7fd07006e340 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd080000f60 tx=0x7fd080007e40 comp rx=0 tx=0).stop 2024-05-20T18:01:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 msgr2=0x7fd0900d2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900d2d00 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fd08800c6b0 tx=0x7fd08800cb70 comp rx=0 tx=0).stop 2024-05-20T18:01:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 shutdown_connections 2024-05-20T18:01:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd07006be30 0x7fd07006e340 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd09015f220 0x7fd0900d2d00 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0900cf910 0x7fd090151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 --2- 172.21.15.6:0/1223275446 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0900cd680 0x7fd0901eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 >> 172.21.15.6:0/1223275446 conn(0x7fd0900b44d0 msgr2=0x7fd0900b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 shutdown_connections 2024-05-20T18:01:57.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.036+0000 7fd0949aa640 1 -- 172.21.15.6:0/1223275446 wait complete. 2024-05-20T18:01:57.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:01:57.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.163+0000 7f8ddb14b640 1 Processor -- start 2024-05-20T18:01:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.163+0000 7f8ddb14b640 1 -- start start 2024-05-20T18:01:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8ddb14b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dd4162820 0x7f8dd40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8ddb14b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8dd406dae0 0x7f8dd40b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8ddb14b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd40d0630 con 0x7f8dd40b3e80 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8ddb14b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8dd40d39c0 con 0x7f8dd4162820 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8ddb14b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8dd40d3ca0 con 0x7f8dd406dae0 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd8ee7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dd4162820 0x7f8dd40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd8ee7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dd4162820 0x7f8dd40b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59574/0 (socket says 172.21.15.6:59574) 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd8ee7640 1 -- 172.21.15.6:0/1085879596 learned_addr learned my addr 172.21.15.6:0/1085879596 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd96e8640 1 --2- 172.21.15.6:0/1085879596 >> v2:172.21.15.171:3300/0 conn(0x7f8dd406dae0 0x7f8dd40b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd8ee7640 1 -- 172.21.15.6:0/1085879596 >> v2:172.21.15.171:3300/0 conn(0x7f8dd406dae0 msgr2=0x7f8dd40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd8ee7640 1 --2- 172.21.15.6:0/1085879596 >> v2:172.21.15.171:3300/0 conn(0x7f8dd406dae0 0x7f8dd40b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd8ee7640 1 -- 172.21.15.6:0/1085879596 >> v1:172.21.15.171:6789/0 conn(0x7f8dd40b3e80 legacy=0x7f8dd406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd8ee7640 1 -- 172.21.15.6:0/1085879596 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd40d3f80 con 0x7f8dd4162820 2024-05-20T18:01:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.165+0000 7f8dd96e8640 1 --2- 172.21.15.6:0/1085879596 >> v2:172.21.15.171:3300/0 conn(0x7f8dd406dae0 0x7f8dd40b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.166+0000 7f8dd8ee7640 1 --2- 172.21.15.6:0/1085879596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b3940 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f8dd408e070 tx=0x7f8dc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b67229cd288508 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.166+0000 7f8dd37fe640 1 -- 172.21.15.6:0/1085879596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4037070 con 0x7f8dd4162820 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.166+0000 7f8dd37fe640 1 -- 172.21.15.6:0/1085879596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc4032440 con 0x7f8dd4162820 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.166+0000 7f8dd37fe640 1 -- 172.21.15.6:0/1085879596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4032810 con 0x7f8dd4162820 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.167+0000 7f8ddb14b640 1 -- 172.21.15.6:0/1085879596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 msgr2=0x7f8dd40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.167+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/1085879596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b3940 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f8dd408e070 tx=0x7f8dc402a270 comp rx=0 tx=0).stop 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.167+0000 7f8ddb14b640 1 -- 172.21.15.6:0/1085879596 shutdown_connections 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.167+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/1085879596 >> v2:172.21.15.171:3300/0 conn(0x7f8dd406dae0 0x7f8dd40b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.167+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/1085879596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b3940 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.167+0000 7f8ddb14b640 1 -- 172.21.15.6:0/1085879596 >> 172.21.15.6:0/1085879596 conn(0x7f8dd40d4bd0 msgr2=0x7f8dd40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.167+0000 7f8ddb14b640 1 -- 172.21.15.6:0/1085879596 shutdown_connections 2024-05-20T18:01:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.167+0000 7f8ddb14b640 1 -- 172.21.15.6:0/1085879596 wait complete. 2024-05-20T18:01:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.169+0000 7f8ddb14b640 1 Processor -- start 2024-05-20T18:01:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.169+0000 7f8ddb14b640 1 -- start start 2024-05-20T18:01:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8ddb14b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd40b3e80 0x7f8dd415b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8ddb14b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8ddb14b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd40cdc90 0x7f8dd40ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8ddb14b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd40d4780 con 0x7f8dd4162820 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8ddb14b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd40d0300 con 0x7f8dd40cdc90 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8ddb14b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd40d4900 con 0x7f8dd40b3e80 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8dd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8dd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59576/0 (socket says 172.21.15.6:59576) 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.170+0000 7f8dd3fff640 1 -- 172.21.15.6:0/3053975171 learned_addr learned my addr 172.21.15.6:0/3053975171 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd8ee7640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd40b3e80 0x7f8dd415b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd96e8640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd40cdc90 0x7f8dd40ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd3fff640 1 -- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd40b3e80 msgr2=0x7f8dd415b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd3fff640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd40b3e80 0x7f8dd415b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd3fff640 1 -- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd40cdc90 msgr2=0x7f8dd40ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd3fff640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd40cdc90 0x7f8dd40ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd3fff640 1 -- 172.21.15.6:0/3053975171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd40ce5e0 con 0x7f8dd4162820 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd8ee7640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd40b3e80 0x7f8dd415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd3fff640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b4320 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800c3c0 tx=0x7f8dc800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd17fa640 1 -- 172.21.15.6:0/3053975171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80052d0 con 0x7f8dd4162820 2024-05-20T18:01:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd17fa640 1 -- 172.21.15.6:0/3053975171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc8005490 con 0x7f8dd4162820 2024-05-20T18:01:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd40b4860 con 0x7f8dd4162820 2024-05-20T18:01:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8dd17fa640 1 -- 172.21.15.6:0/3053975171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8007260 con 0x7f8dd4162820 2024-05-20T18:01:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.171+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd40b5050 con 0x7f8dd4162820 2024-05-20T18:01:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.172+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd4075b00 con 0x7f8dd4162820 2024-05-20T18:01:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.173+0000 7f8dd17fa640 1 -- 172.21.15.6:0/3053975171 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8dc8007400 con 0x7f8dd4162820 2024-05-20T18:01:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.173+0000 7f8dd17fa640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8dc006be30 0x7f8dc006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.173+0000 7f8dd17fa640 1 -- 172.21.15.6:0/3053975171 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f8dc808a4b0 con 0x7f8dd4162820 2024-05-20T18:01:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.173+0000 7f8dd8ee7640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8dc006be30 0x7f8dc006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.174+0000 7f8dd8ee7640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8dc006be30 0x7f8dc006e340 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4034000 tx=0x7f8dc402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.178+0000 7f8dd17fa640 1 -- 172.21.15.6:0/3053975171 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8dd40ce5e0 con 0x7f8dd4162820 2024-05-20T18:01:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.362+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dd40b4b00 con 0x7f8dd4162820 2024-05-20T18:01:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.363+0000 7f8dd17fa640 1 -- 172.21.15.6:0/3053975171 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16852 (secure 0 0 0) 0x7f8dc80871f0 con 0x7f8dd4162820 2024-05-20T18:01:57.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:01:57.361 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":125,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:01:31.516805+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:01:27.629166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-05-20T18:01:28.885867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:01:57.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8dc006be30 msgr2=0x7f8dc006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8dc006be30 0x7f8dc006e340 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4034000 tx=0x7f8dc402e000 comp rx=0 tx=0).stop 2024-05-20T18:01:57.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 msgr2=0x7f8dd40b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b4320 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800c3c0 tx=0x7f8dc800c880 comp rx=0 tx=0).stop 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 shutdown_connections 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8dc006be30 0x7f8dc006e340 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dd40cdc90 0x7f8dd40ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dd4162820 0x7f8dd40b4320 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 --2- 172.21.15.6:0/3053975171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8dd40b3e80 0x7f8dd415b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 >> 172.21.15.6:0/3053975171 conn(0x7f8dd40d4bd0 msgr2=0x7f8dd415d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 shutdown_connections 2024-05-20T18:01:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.365+0000 7f8ddb14b640 1 -- 172.21.15.6:0/3053975171 wait complete. 2024-05-20T18:01:57.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T18:01:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.493+0000 7fc55b0d3640 1 Processor -- start 2024-05-20T18:01:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.493+0000 7fc55b0d3640 1 -- start start 2024-05-20T18:01:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.494+0000 7fc55b0d3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc554163a10 0x7fc5540d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.494+0000 7fc55b0d3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5540d0370 con 0x7fc5540b4010 2024-05-20T18:01:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.494+0000 7fc55b0d3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5540d0650 con 0x7fc5540d14b0 2024-05-20T18:01:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.494+0000 7fc55b0d3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5540d3ca0 con 0x7fc554163a10 2024-05-20T18:01:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.494+0000 7fc553fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc5540b4010 0x7fc5540cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42612/0 (socket says 172.21.15.6:42612) 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.494+0000 7fc553fff640 1 -- 172.21.15.6:0/3256929484 learned_addr learned my addr 172.21.15.6:0/3256929484 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.494+0000 7fc558e6f640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc554163a10 0x7fc5540d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103343626 0 0) 0x7fc5540d0370 con 0x7fc5540b4010 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc540003520 con 0x7fc5540b4010 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797751594 0 0) 0x7fc5540d0650 con 0x7fc5540d14b0 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5540d0370 con 0x7fc5540d14b0 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3246458873 0 0) 0x7fc540003520 con 0x7fc5540b4010 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc554163a10 msgr2=0x7fc5540d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc554163a10 0x7fc5540d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 >> v1:172.21.15.171:6789/0 conn(0x7fc5540d14b0 legacy=0x7fc5540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5540d3650 con 0x7fc5540b4010 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fc5440019f0 con 0x7fc5540b4010 2024-05-20T18:01:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 >> v1:172.21.15.6:6789/0 conn(0x7fc5540b4010 legacy=0x7fc5540cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc540003b70 0x7fc540003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc540004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc554163a10 0x7fc540005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540d3ca0 con 0x7fc540004800 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc54000bad0 con 0x7fc540003b70 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc54000bcd0 con 0x7fc554163a10 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc553fff640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc540004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc558e6f640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc540003b70 0x7fc540003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc559670640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc554163a10 0x7fc540005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc553fff640 1 -- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc554163a10 msgr2=0x7fc540005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc553fff640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc554163a10 0x7fc540005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc553fff640 1 -- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc540003b70 msgr2=0x7fc540003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc553fff640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc540003b70 0x7fc540003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.495+0000 7fc553fff640 1 -- 172.21.15.6:0/3256929484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540003520 con 0x7fc540004800 2024-05-20T18:01:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.496+0000 7fc553fff640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc540004c10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc5540b7f80 tx=0x7fc540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538ae3bdb8b16b37 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.496+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54400a460 con 0x7fc540004800 2024-05-20T18:01:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.496+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54402f070 con 0x7fc540004800 2024-05-20T18:01:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.496+0000 7fc5537fe640 1 -- 172.21.15.6:0/3256929484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54402bba0 con 0x7fc540004800 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.497+0000 7fc55b0d3640 1 -- 172.21.15.6:0/3256929484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 msgr2=0x7fc540004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.497+0000 7fc55b0d3640 1 --2- 172.21.15.6:0/3256929484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc540004c10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc5540b7f80 tx=0x7fc540005830 comp rx=0 tx=0).stop 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.497+0000 7fc559670640 1 -- 172.21.15.6:0/3256929484 reap_dead start 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.497+0000 7fc55b0d3640 1 -- 172.21.15.6:0/3256929484 shutdown_connections 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.497+0000 7fc55b0d3640 1 -- 172.21.15.6:0/3256929484 >> 172.21.15.6:0/3256929484 conn(0x7fc55406d240 msgr2=0x7fc55406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.497+0000 7fc55b0d3640 1 -- 172.21.15.6:0/3256929484 shutdown_connections 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.497+0000 7fc55b0d3640 1 -- 172.21.15.6:0/3256929484 wait complete. 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.499+0000 7fc55b0d3640 1 Processor -- start 2024-05-20T18:01:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.499+0000 7fc55b0d3640 1 -- start start 2024-05-20T18:01:57.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.500+0000 7fc55b0d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc554158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.500+0000 7fc55b0d3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5541544f0 0x7fc5541478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.500+0000 7fc55b0d3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55414a5e0 0x7fc554147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc55b0d3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540d42b0 con 0x7fc540004800 2024-05-20T18:01:57.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc55b0d3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540d4130 con 0x7fc55414a5e0 2024-05-20T18:01:57.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc55b0d3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc5540d4430 con 0x7fc5541544f0 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc554158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc554158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59588/0 (socket says 172.21.15.6:59588) 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 -- 172.21.15.6:0/1316649442 learned_addr learned my addr 172.21.15.6:0/1316649442 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc559670640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55414a5e0 0x7fc554147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc553fff640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5541544f0 0x7fc5541478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 -- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5541544f0 msgr2=0x7fc5541478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5541544f0 0x7fc5541478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 -- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55414a5e0 msgr2=0x7fc554147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55414a5e0 0x7fc554147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 -- 172.21.15.6:0/1316649442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55415a020 con 0x7fc540004800 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc553fff640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5541544f0 0x7fc5541478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc558e6f640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc554158610 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc53c011960 tx=0x7fc53c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc5517fa640 1 -- 172.21.15.6:0/1316649442 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00faf0 con 0x7fc540004800 2024-05-20T18:01:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc5517fa640 1 -- 172.21.15.6:0/1316649442 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c00fc90 con 0x7fc540004800 2024-05-20T18:01:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc554158f80 con 0x7fc540004800 2024-05-20T18:01:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc5517fa640 1 -- 172.21.15.6:0/1316649442 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c014440 con 0x7fc540004800 2024-05-20T18:01:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.501+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc554159540 con 0x7fc540004800 2024-05-20T18:01:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.502+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc554075b00 con 0x7fc540004800 2024-05-20T18:01:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.503+0000 7fc5517fa640 1 -- 172.21.15.6:0/1316649442 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc53c012040 con 0x7fc540004800 2024-05-20T18:01:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.503+0000 7fc5517fa640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be30 0x7fc53406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.504+0000 7fc5517fa640 1 -- 172.21.15.6:0/1316649442 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fc53c08b680 con 0x7fc540004800 2024-05-20T18:01:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.504+0000 7fc553fff640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be30 0x7fc53406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.504+0000 7fc553fff640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be30 0x7fc53406e340 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc544033000 tx=0x7fc544007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.508+0000 7fc5517fa640 1 -- 172.21.15.6:0/1316649442 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc53c019030 con 0x7fc540004800 2024-05-20T18:01:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.729+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc55415d880 con 0x7fc540004800 2024-05-20T18:01:57.726 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T18:01:57.729+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T18:01:57.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.731+0000 7fc5517fa640 1 -- 172.21.15.6:0/1316649442 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) ==== 161+0+0 (secure 0 0 0) 0x7fc53c059e00 con 0x7fc540004800 2024-05-20T18:01:57.728 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T18:01:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be30 msgr2=0x7fc53406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be30 0x7fc53406e340 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc544033000 tx=0x7fc544007000 comp rx=0 tx=0).stop 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 msgr2=0x7fc554158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc554158610 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc53c011960 tx=0x7fc53c011e20 comp rx=0 tx=0).stop 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 shutdown_connections 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc53406be30 0x7fc53406e340 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc55414a5e0 0x7fc554147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc5541544f0 0x7fc5541478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 --2- 172.21.15.6:0/1316649442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc540004800 0x7fc554158610 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 >> 172.21.15.6:0/1316649442 conn(0x7fc55406d240 msgr2=0x7fc554067490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.734+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 shutdown_connections 2024-05-20T18:01:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.735+0000 7fc55b0d3640 1 -- 172.21.15.6:0/1316649442 wait complete. 2024-05-20T18:01:57.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T18:01:57.797 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T18:01:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.867+0000 7fa4a3d65640 1 Processor -- start 2024-05-20T18:01:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.867+0000 7fa4a3d65640 1 -- start start 2024-05-20T18:01:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a3d65640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa49c162820 0x7fa49c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a3d65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c06dae0 0x7fa49c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a3d65640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c0d0630 con 0x7fa49c0b3e80 2024-05-20T18:01:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a3d65640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c0d39c0 con 0x7fa49c162820 2024-05-20T18:01:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a3d65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c0d3ca0 con 0x7fa49c06dae0 2024-05-20T18:01:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a2302640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c06dae0 0x7fa49c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a1b01640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa49c162820 0x7fa49c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a1300640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa49c0b3e80 0x7fa49c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:52874/0 (socket says 172.21.15.6:52874) 2024-05-20T18:01:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a1b01640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa49c162820 0x7fa49c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:36240/0 (socket says 172.21.15.6:36240) 2024-05-20T18:01:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a2302640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c06dae0 0x7fa49c0b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:45102/0 (socket says 172.21.15.6:45102) 2024-05-20T18:01:57.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a1300640 1 -- 172.21.15.6:0/4031350497 learned_addr learned my addr 172.21.15.6:0/4031350497 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a1b01640 1 -- 172.21.15.6:0/4031350497 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c06dae0 msgr2=0x7fa49c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a1b01640 1 --2- 172.21.15.6:0/4031350497 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c06dae0 0x7fa49c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a1b01640 1 -- 172.21.15.6:0/4031350497 >> v1:172.21.15.171:6789/0 conn(0x7fa49c0b3e80 legacy=0x7fa49c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.869+0000 7fa4a1b01640 1 -- 172.21.15.6:0/4031350497 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c0d3f80 con 0x7fa49c162820 2024-05-20T18:01:57.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.870+0000 7fa4a1b01640 1 --2- 172.21.15.6:0/4031350497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 0x7fa49c0b3940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa4980097a0 tx=0x7fa49802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=142c4dc000980fd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.870+0000 7fa4a0aff640 1 -- 172.21.15.6:0/4031350497 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498037070 con 0x7fa49c162820 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.870+0000 7fa4a0aff640 1 -- 172.21.15.6:0/4031350497 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa498032440 con 0x7fa49c162820 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.870+0000 7fa4a0aff640 1 -- 172.21.15.6:0/4031350497 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498032810 con 0x7fa49c162820 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.871+0000 7fa4a3d65640 1 -- 172.21.15.6:0/4031350497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 msgr2=0x7fa49c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.871+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/4031350497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 0x7fa49c0b3940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa4980097a0 tx=0x7fa49802a180 comp rx=0 tx=0).stop 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.871+0000 7fa4a3d65640 1 -- 172.21.15.6:0/4031350497 shutdown_connections 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.871+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/4031350497 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c06dae0 0x7fa49c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.871+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/4031350497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 0x7fa49c0b3940 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.871+0000 7fa4a3d65640 1 -- 172.21.15.6:0/4031350497 >> 172.21.15.6:0/4031350497 conn(0x7fa49c0d4bd0 msgr2=0x7fa49c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.871+0000 7fa4a3d65640 1 -- 172.21.15.6:0/4031350497 shutdown_connections 2024-05-20T18:01:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.871+0000 7fa4a3d65640 1 -- 172.21.15.6:0/4031350497 wait complete. 2024-05-20T18:01:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.873+0000 7fa4a3d65640 1 Processor -- start 2024-05-20T18:01:57.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.873+0000 7fa4a3d65640 1 -- start start 2024-05-20T18:01:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.874+0000 7fa4a3d65640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c0b3e80 0x7fa49c0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.874+0000 7fa4a3d65640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 0x7fa49c15a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.874+0000 7fa4a3d65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa49c15b050 0x7fa49c0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.874+0000 7fa4a3d65640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0d4780 con 0x7fa49c15b050 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.874+0000 7fa4a3d65640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0d0300 con 0x7fa49c162820 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.874+0000 7fa4a3d65640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c0d4900 con 0x7fa49c0b3e80 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.874+0000 7fa4a2302640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa49c15b050 0x7fa49c0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.874+0000 7fa4a2302640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa49c15b050 0x7fa49c0cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49390/0 (socket says 172.21.15.6:49390) 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a2302640 1 -- 172.21.15.6:0/3507185263 learned_addr learned my addr 172.21.15.6:0/3507185263 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a1300640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 0x7fa49c15a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a1b01640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c0b3e80 0x7fa49c0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a2302640 1 -- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c0b3e80 msgr2=0x7fa49c0ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a2302640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c0b3e80 0x7fa49c0ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a2302640 1 -- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 msgr2=0x7fa49c15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a2302640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 0x7fa49c15a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a2302640 1 -- 172.21.15.6:0/3507185263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c0ca710 con 0x7fa49c15b050 2024-05-20T18:01:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a2302640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa49c15b050 0x7fa49c0cd3e0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fa49400efc0 tx=0x7fa49400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4927fc640 1 -- 172.21.15.6:0/3507185263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494018020 con 0x7fa49c15b050 2024-05-20T18:01:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4927fc640 1 -- 172.21.15.6:0/3507185263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa494014480 con 0x7fa49c15b050 2024-05-20T18:01:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4927fc640 1 -- 172.21.15.6:0/3507185263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494009e60 con 0x7fa49c15b050 2024-05-20T18:01:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c0b5a70 con 0x7fa49c15b050 2024-05-20T18:01:57.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.875+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c0c96f0 con 0x7fa49c15b050 2024-05-20T18:01:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.877+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c0b57e0 con 0x7fa49c15b050 2024-05-20T18:01:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.877+0000 7fa4927fc640 1 -- 172.21.15.6:0/3507185263 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa494005d10 con 0x7fa49c15b050 2024-05-20T18:01:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.877+0000 7fa4927fc640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa48006be60 0x7fa48006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.878+0000 7fa4927fc640 1 -- 172.21.15.6:0/3507185263 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 6187+0+0 (secure 0 0 0) 0x7fa49408bce0 con 0x7fa49c15b050 2024-05-20T18:01:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.878+0000 7fa4a1b01640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa48006be60 0x7fa48006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:57.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.878+0000 7fa4a1b01640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa48006be60 0x7fa48006e370 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa498034000 tx=0x7fa49802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:57.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:57.882+0000 7fa4927fc640 1 -- 172.21.15.6:0/3507185263 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa494022030 con 0x7fa49c15b050 2024-05-20T18:01:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.107+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa49c075b00 con 0x7fa49c15b050 2024-05-20T18:01:58.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.733+0000 7fa4927fc640 1 -- 172.21.15.6:0/3507185263 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) ==== 104+0+0 (secure 0 0 0) 0x7fa494010040 con 0x7fa49c15b050 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.735+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa48006be60 msgr2=0x7fa48006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.735+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa48006be60 0x7fa48006e370 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa498034000 tx=0x7fa49802e000 comp rx=0 tx=0).stop 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.735+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa49c15b050 msgr2=0x7fa49c0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa49c15b050 0x7fa49c0cd3e0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fa49400efc0 tx=0x7fa49400c490 comp rx=0 tx=0).stop 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 shutdown_connections 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa48006be60 0x7fa48006e370 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa49c15b050 0x7fa49c0cd3e0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa49c162820 0x7fa49c15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:58.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 --2- 172.21.15.6:0/3507185263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa49c0b3e80 0x7fa49c0ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:58.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 >> 172.21.15.6:0/3507185263 conn(0x7fa49c0d4bd0 msgr2=0x7fa49c161cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:58.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 shutdown_connections 2024-05-20T18:01:58.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.736+0000 7fa4a3d65640 1 -- 172.21.15.6:0/3507185263 wait complete. 2024-05-20T18:01:58.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T18:01:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.876+0000 7fd0ee6e7640 1 Processor -- start 2024-05-20T18:01:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.876+0000 7fd0ee6e7640 1 -- start start 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.877+0000 7fd0ee6e7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0e80d3c60 0x7fd0e816a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.877+0000 7fd0ee6e7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e8160170 con 0x7fd0e80b6db0 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.877+0000 7fd0ee6e7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e8160410 con 0x7fd0e8163950 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.877+0000 7fd0ee6e7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e81606f0 con 0x7fd0e80d3c60 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.877+0000 7fd0ecc84640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0e80d3c60 0x7fd0e816a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.877+0000 7fd0e77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd0e80b6db0 0x7fd0e80d3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52196/0 (socket says 172.21.15.6:52196) 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.877+0000 7fd0e77fe640 1 -- 172.21.15.6:0/2741041901 learned_addr learned my addr 172.21.15.6:0/2741041901 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.878+0000 7fd0ecc84640 1 -- 172.21.15.6:0/2741041901 >> v1:172.21.15.171:6789/0 conn(0x7fd0e8163950 legacy=0x7fd0e80b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.878+0000 7fd0ecc84640 1 -- 172.21.15.6:0/2741041901 >> v1:172.21.15.6:6789/0 conn(0x7fd0e80b6db0 legacy=0x7fd0e80d3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.878+0000 7fd0ecc84640 1 -- 172.21.15.6:0/2741041901 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e8162e70 con 0x7fd0e80d3c60 2024-05-20T18:01:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.878+0000 7fd0e6ffd640 1 -- 172.21.15.6:0/2741041901 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832114807 0 0) 0x7fd0e8160170 con 0x7fd0e80b6db0 2024-05-20T18:01:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0ecc84640 1 --2- 172.21.15.6:0/2741041901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e80d3c60 0x7fd0e816a060 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009d90 tx=0x7fd0e002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169de8ead7d5edc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0e6ffd640 1 -- 172.21.15.6:0/2741041901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0007740 con 0x7fd0e80d3c60 2024-05-20T18:01:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0e6ffd640 1 -- 172.21.15.6:0/2741041901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e00078e0 con 0x7fd0e80d3c60 2024-05-20T18:01:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0e6ffd640 1 -- 172.21.15.6:0/2741041901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0007cb0 con 0x7fd0e80d3c60 2024-05-20T18:01:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/2741041901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e80d3c60 msgr2=0x7fd0e816a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0ee6e7640 1 --2- 172.21.15.6:0/2741041901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e80d3c60 0x7fd0e816a060 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009d90 tx=0x7fd0e002a6a0 comp rx=0 tx=0).stop 2024-05-20T18:01:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/2741041901 shutdown_connections 2024-05-20T18:01:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0ee6e7640 1 --2- 172.21.15.6:0/2741041901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e80d3c60 0x7fd0e816a060 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/2741041901 >> 172.21.15.6:0/2741041901 conn(0x7fd0e80d16a0 msgr2=0x7fd0e80d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.879+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/2741041901 shutdown_connections 2024-05-20T18:01:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.880+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/2741041901 wait complete. 2024-05-20T18:01:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.881+0000 7fd0ee6e7640 1 Processor -- start 2024-05-20T18:01:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.881+0000 7fd0ee6e7640 1 -- start start 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0ee6e7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80d3c60 0x7fd0e815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0ee6e7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e8163950 0x7fd0e80ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0ee6e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e80ab5a0 0x7fd0e80ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0ee6e7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80d4070 con 0x7fd0e8163950 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0ee6e7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8163430 con 0x7fd0e80ab5a0 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0ee6e7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e80d41f0 con 0x7fd0e80d3c60 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e8163950 0x7fd0e80ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e8163950 0x7fd0e80ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49416/0 (socket says 172.21.15.6:49416) 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 -- 172.21.15.6:0/3099963140 learned_addr learned my addr 172.21.15.6:0/3099963140 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0ecc84640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e80ab5a0 0x7fd0e80ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e7fff640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80d3c60 0x7fd0e815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 -- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80d3c60 msgr2=0x7fd0e815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80d3c60 0x7fd0e815e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 -- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e80ab5a0 msgr2=0x7fd0e80ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e80ab5a0 0x7fd0e80ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 -- 172.21.15.6:0/3099963140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80abef0 con 0x7fd0e8163950 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0ecc84640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e80ab5a0 0x7fd0e80ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.883+0000 7fd0e77fe640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e8163950 0x7fd0e80ce8d0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00c400 tx=0x7fd0dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.884+0000 7fd0e4ff9640 1 -- 172.21.15.6:0/3099963140 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc017070 con 0x7fd0e8163950 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.884+0000 7fd0e4ff9640 1 -- 172.21.15.6:0/3099963140 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc005ce0 con 0x7fd0e8163950 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.884+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e80ccca0 con 0x7fd0e8163950 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.884+0000 7fd0e4ff9640 1 -- 172.21.15.6:0/3099963140 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc007310 con 0x7fd0e8163950 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.884+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e80cd260 con 0x7fd0e8163950 2024-05-20T18:01:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.885+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e80690b0 con 0x7fd0e8163950 2024-05-20T18:01:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.886+0000 7fd0e4ff9640 1 -- 172.21.15.6:0/3099963140 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0dc01a070 con 0x7fd0e8163950 2024-05-20T18:01:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.886+0000 7fd0e4ff9640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0d406be30 0x7fd0d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.886+0000 7fd0e4ff9640 1 -- 172.21.15.6:0/3099963140 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 6187+0+0 (secure 0 0 0) 0x7fd0dc08a510 con 0x7fd0e8163950 2024-05-20T18:01:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.886+0000 7fd0e7fff640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0d406be30 0x7fd0d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.887+0000 7fd0e7fff640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0d406be30 0x7fd0d406e340 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8006fd0 tx=0x7fd0d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:58.891+0000 7fd0e4ff9640 1 -- 172.21.15.6:0/3099963140 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd0e80abef0 con 0x7fd0e8163950 2024-05-20T18:01:59.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.073+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd0e80d3070 con 0x7fd0e8163950 2024-05-20T18:01:59.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.735+0000 7fd0e4ff9640 1 -- 172.21.15.6:0/3099963140 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) ==== 181+0+0 (secure 0 0 0) 0x7fd0dc058c50 con 0x7fd0e8163950 2024-05-20T18:01:59.732 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0d406be30 msgr2=0x7fd0d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0d406be30 0x7fd0d406e340 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8006fd0 tx=0x7fd0d8008040 comp rx=0 tx=0).stop 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e8163950 msgr2=0x7fd0e80ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e8163950 0x7fd0e80ce8d0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00c400 tx=0x7fd0dc00c8c0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 shutdown_connections 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd0d406be30 0x7fd0d406e340 secure :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8006fd0 tx=0x7fd0d8008040 comp rx=0 tx=0).stop 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0e80ab5a0 0x7fd0e80ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0e8163950 0x7fd0e80ce8d0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 --2- 172.21.15.6:0/3099963140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0e80d3c60 0x7fd0e815e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.739+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 >> 172.21.15.6:0/3099963140 conn(0x7fd0e80d16a0 msgr2=0x7fd0e8160910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:59.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.740+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 shutdown_connections 2024-05-20T18:01:59.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.740+0000 7fd0ee6e7640 1 -- 172.21.15.6:0/3099963140 wait complete. 2024-05-20T18:01:59.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T18:01:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.882+0000 7f6f0d256640 1 Processor -- start 2024-05-20T18:01:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.882+0000 7f6f0d256640 1 -- start start 2024-05-20T18:01:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0d256640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6f080b3860 0x7f6f080d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0d256640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f0806d870 0x7f6f0815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0d256640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f0808bd20 0x7f6f0808c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0d256640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0808c670 con 0x7f6f0806d870 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0d256640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6f080d0450 con 0x7f6f080b3860 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0d256640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6f080d3b10 con 0x7f6f0808bd20 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f0806d870 0x7f6f0815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f0806d870 0x7f6f0815f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49420/0 (socket says 172.21.15.6:49420) 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0659c640 1 -- 172.21.15.6:0/3983513452 learned_addr learned my addr 172.21.15.6:0/3983513452 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f06d9d640 1 --2- 172.21.15.6:0/3983513452 >> v2:172.21.15.171:3300/0 conn(0x7f6f080b3860 0x7f6f080d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0759e640 1 --2- 172.21.15.6:0/3983513452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f0808bd20 0x7f6f0808c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0659c640 1 -- 172.21.15.6:0/3983513452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f0808bd20 msgr2=0x7f6f0808c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0659c640 1 --2- 172.21.15.6:0/3983513452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f0808bd20 0x7f6f0808c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0659c640 1 -- 172.21.15.6:0/3983513452 >> v2:172.21.15.171:3300/0 conn(0x7f6f080b3860 msgr2=0x7f6f080d45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:01:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0659c640 1 --2- 172.21.15.6:0/3983513452 >> v2:172.21.15.171:3300/0 conn(0x7f6f080b3860 0x7f6f080d45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.884+0000 7f6f0659c640 1 -- 172.21.15.6:0/3983513452 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f080d3df0 con 0x7f6f0806d870 2024-05-20T18:01:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.885+0000 7f6f0659c640 1 --2- 172.21.15.6:0/3983513452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0806d870 0x7f6f0815f230 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f6f0808dcf0 tx=0x7f6efc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99db206f9af568a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.885+0000 7f6f05d9b640 1 -- 172.21.15.6:0/3983513452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc037070 con 0x7f6f0806d870 2024-05-20T18:01:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.885+0000 7f6f05d9b640 1 -- 172.21.15.6:0/3983513452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc02ae00 con 0x7f6f0806d870 2024-05-20T18:01:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.885+0000 7f6f05d9b640 1 -- 172.21.15.6:0/3983513452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc032660 con 0x7f6f0806d870 2024-05-20T18:01:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 -- 172.21.15.6:0/3983513452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0806d870 msgr2=0x7f6f0815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 --2- 172.21.15.6:0/3983513452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0806d870 0x7f6f0815f230 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f6f0808dcf0 tx=0x7f6efc02a0b0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 -- 172.21.15.6:0/3983513452 shutdown_connections 2024-05-20T18:01:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 --2- 172.21.15.6:0/3983513452 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f0808bd20 0x7f6f0808c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 --2- 172.21.15.6:0/3983513452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0806d870 0x7f6f0815f230 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 --2- 172.21.15.6:0/3983513452 >> v2:172.21.15.171:3300/0 conn(0x7f6f080b3860 0x7f6f080d45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 -- 172.21.15.6:0/3983513452 >> 172.21.15.6:0/3983513452 conn(0x7f6f080b6d10 msgr2=0x7f6f0806d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:01:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 -- 172.21.15.6:0/3983513452 shutdown_connections 2024-05-20T18:01:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.886+0000 7f6f0d256640 1 -- 172.21.15.6:0/3983513452 wait complete. 2024-05-20T18:01:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.888+0000 7f6f0d256640 1 Processor -- start 2024-05-20T18:01:59.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.888+0000 7f6f0d256640 1 -- start start 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0d256640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f0806d870 0x7f6f081f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0d256640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0808bd20 0x7f6f081e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0d256640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f080b3860 0x7f6f081e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0d256640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0815f770 con 0x7f6f0808bd20 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0d256640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6f080d0730 con 0x7f6f0806d870 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0d256640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6f080d27c0 con 0x7f6f080b3860 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0808bd20 0x7f6f081e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0808bd20 0x7f6f081e8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49422/0 (socket says 172.21.15.6:49422) 2024-05-20T18:01:59.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 -- 172.21.15.6:0/2790537249 learned_addr learned my addr 172.21.15.6:0/2790537249 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f06d9d640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f0806d870 0x7f6f081f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0759e640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f080b3860 0x7f6f081e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 -- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f080b3860 msgr2=0x7f6f081e8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f080b3860 0x7f6f081e8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 -- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f0806d870 msgr2=0x7f6f081f7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f0806d870 0x7f6f081f7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 -- 172.21.15.6:0/2790537249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f080c8490 con 0x7f6f0808bd20 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0759e640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f080b3860 0x7f6f081e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6f0659c640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0808bd20 0x7f6f081e8850 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f6efc02a0f0 tx=0x7f6efc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.890+0000 7f6eef7fe640 1 -- 172.21.15.6:0/2790537249 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc041030 con 0x7f6f0808bd20 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.891+0000 7f6eef7fe640 1 -- 172.21.15.6:0/2790537249 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc02ac00 con 0x7f6f0808bd20 2024-05-20T18:01:59.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.891+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f08159660 con 0x7f6f0808bd20 2024-05-20T18:01:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.891+0000 7f6eef7fe640 1 -- 172.21.15.6:0/2790537249 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc037040 con 0x7f6f0808bd20 2024-05-20T18:01:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.891+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f08159c20 con 0x7f6f0808bd20 2024-05-20T18:01:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.892+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f080690b0 con 0x7f6f0808bd20 2024-05-20T18:01:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.892+0000 7f6eef7fe640 1 -- 172.21.15.6:0/2790537249 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6efc044070 con 0x7f6f0808bd20 2024-05-20T18:01:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.893+0000 7f6eef7fe640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ef406be30 0x7f6ef406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:01:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.893+0000 7f6eef7fe640 1 -- 172.21.15.6:0/2790537249 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5749+0+0 (secure 0 0 0) 0x7f6efc0ab270 con 0x7f6f0808bd20 2024-05-20T18:01:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.893+0000 7f6f06d9d640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ef406be30 0x7f6ef406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:01:59.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.894+0000 7f6f06d9d640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ef406be30 0x7f6ef406e340 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8006fd0 tx=0x7f6ef8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:01:59.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:01:59.898+0000 7f6eef7fe640 1 -- 172.21.15.6:0/2790537249 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6efc04b070 con 0x7f6f0808bd20 2024-05-20T18:02:00.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.083+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6f0806d400 con 0x7f6f0808bd20 2024-05-20T18:02:00.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.737+0000 7f6eef7fe640 1 -- 172.21.15.6:0/2790537249 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) ==== 169+0+0 (secure 0 0 0) 0x7f6efc079b60 con 0x7f6f0808bd20 2024-05-20T18:02:00.734 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T18:02:00.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ef406be30 msgr2=0x7f6ef406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:00.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ef406be30 0x7f6ef406e340 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8006fd0 tx=0x7f6ef8008040 comp rx=0 tx=0).stop 2024-05-20T18:02:00.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0808bd20 msgr2=0x7f6f081e8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:00.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0808bd20 0x7f6f081e8850 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f6efc02a0f0 tx=0x7f6efc0046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 shutdown_connections 2024-05-20T18:02:00.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6ef406be30 0x7f6ef406e340 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f080b3860 0x7f6f081e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f0808bd20 0x7f6f081e8850 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 --2- 172.21.15.6:0/2790537249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f0806d870 0x7f6f081f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.741+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 >> 172.21.15.6:0/2790537249 conn(0x7f6f080b6d10 msgr2=0x7f6f0815d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:00.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.742+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 shutdown_connections 2024-05-20T18:02:00.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.743+0000 7f6f0d256640 1 -- 172.21.15.6:0/2790537249 wait complete. 2024-05-20T18:02:00.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-05-20T18:02:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.884+0000 7f9f84984640 1 Processor -- start 2024-05-20T18:02:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.884+0000 7f9f84984640 1 -- start start 2024-05-20T18:02:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f84984640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f8006d3d0 0x7f9f8006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f84984640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f800b8190 0x7f9f800b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f84984640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8006dd20 con 0x7f9f80162820 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f84984640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9f800d0630 con 0x7f9f800b8190 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f84984640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f800d39c0 con 0x7f9f8006d3d0 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f800b8190 0x7f9f800b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9f80162820 0x7f9f800b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52204/0 (socket says 172.21.15.6:52204) 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7e59c640 1 -- 172.21.15.6:0/466267394 learned_addr learned my addr 172.21.15.6:0/466267394 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7dd9b640 1 --2- 172.21.15.6:0/466267394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f8006d3d0 0x7f9f8006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7ed9d640 1 -- 172.21.15.6:0/466267394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f8006d3d0 msgr2=0x7f9f8006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7ed9d640 1 --2- 172.21.15.6:0/466267394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f8006d3d0 0x7f9f8006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7ed9d640 1 -- 172.21.15.6:0/466267394 >> v1:172.21.15.6:6789/0 conn(0x7f9f80162820 legacy=0x7f9f800b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7d59a640 1 -- 172.21.15.6:0/466267394 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2512708929 0 0) 0x7f9f70001490 con 0x7f9f80162820 2024-05-20T18:02:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.886+0000 7f9f7ed9d640 1 -- 172.21.15.6:0/466267394 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f800d3ca0 con 0x7f9f800b8190 2024-05-20T18:02:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.887+0000 7f9f7ed9d640 1 --2- 172.21.15.6:0/466267394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f800b8190 0x7f9f800b85a0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f9f780097a0 tx=0x7f9f7802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4186024a83ebde7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.887+0000 7f9f7d59a640 1 -- 172.21.15.6:0/466267394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78037070 con 0x7f9f800b8190 2024-05-20T18:02:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.887+0000 7f9f7d59a640 1 -- 172.21.15.6:0/466267394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f78032440 con 0x7f9f800b8190 2024-05-20T18:02:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.887+0000 7f9f7d59a640 1 -- 172.21.15.6:0/466267394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78032810 con 0x7f9f800b8190 2024-05-20T18:02:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.888+0000 7f9f84984640 1 -- 172.21.15.6:0/466267394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f800b8190 msgr2=0x7f9f800b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.888+0000 7f9f84984640 1 --2- 172.21.15.6:0/466267394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f800b8190 0x7f9f800b85a0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f9f780097a0 tx=0x7f9f7802a180 comp rx=0 tx=0).stop 2024-05-20T18:02:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.888+0000 7f9f84984640 1 -- 172.21.15.6:0/466267394 shutdown_connections 2024-05-20T18:02:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.888+0000 7f9f84984640 1 --2- 172.21.15.6:0/466267394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f800b8190 0x7f9f800b85a0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.888+0000 7f9f84984640 1 --2- 172.21.15.6:0/466267394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f8006d3d0 0x7f9f8006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.888+0000 7f9f84984640 1 -- 172.21.15.6:0/466267394 >> 172.21.15.6:0/466267394 conn(0x7f9f800d4bd0 msgr2=0x7f9f800d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.888+0000 7f9f84984640 1 -- 172.21.15.6:0/466267394 shutdown_connections 2024-05-20T18:02:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.888+0000 7f9f84984640 1 -- 172.21.15.6:0/466267394 wait complete. 2024-05-20T18:02:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.890+0000 7f9f84984640 1 Processor -- start 2024-05-20T18:02:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.890+0000 7f9f84984640 1 -- start start 2024-05-20T18:02:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f84984640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f8006d3d0 0x7f9f800b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f84984640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f800b8190 0x7f9f800b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f84984640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f80162820 0x7f9f80153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f84984640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9f800d0300 con 0x7f9f8006d3d0 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f84984640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f800d4260 con 0x7f9f80162820 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f84984640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9f800b4050 con 0x7f9f800b8190 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f7e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f8006d3d0 0x7f9f800b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f7e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f8006d3d0 0x7f9f800b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49436/0 (socket says 172.21.15.6:49436) 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f7e59c640 1 -- 172.21.15.6:0/4163490988 learned_addr learned my addr 172.21.15.6:0/4163490988 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f7ed9d640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f80162820 0x7f9f80153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.891+0000 7f9f7dd9b640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f800b8190 0x7f9f800b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f7e59c640 1 -- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f800b8190 msgr2=0x7f9f800b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f7e59c640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f800b8190 0x7f9f800b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f7e59c640 1 -- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f80162820 msgr2=0x7f9f80153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f7e59c640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f80162820 0x7f9f80153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f7e59c640 1 -- 172.21.15.6:0/4163490988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f800cc8e0 con 0x7f9f8006d3d0 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f7e59c640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f8006d3d0 0x7f9f800b6f30 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000c7f0 tx=0x7f9f7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f6effd640 1 -- 172.21.15.6:0/4163490988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70018070 con 0x7f9f8006d3d0 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f6effd640 1 -- 172.21.15.6:0/4163490988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f7000a640 con 0x7f9f8006d3d0 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f6effd640 1 -- 172.21.15.6:0/4163490988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000aa30 con 0x7f9f8006d3d0 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8015aa00 con 0x7f9f8006d3d0 2024-05-20T18:02:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.892+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f800b7470 con 0x7f9f8006d3d0 2024-05-20T18:02:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.893+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f80075b00 con 0x7f9f8006d3d0 2024-05-20T18:02:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.894+0000 7f9f6effd640 1 -- 172.21.15.6:0/4163490988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f7001b070 con 0x7f9f8006d3d0 2024-05-20T18:02:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.894+0000 7f9f6effd640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f6006be30 0x7f9f6006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.894+0000 7f9f6effd640 1 -- 172.21.15.6:0/4163490988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f9f7008a2c0 con 0x7f9f8006d3d0 2024-05-20T18:02:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.894+0000 7f9f7dd9b640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f6006be30 0x7f9f6006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.895+0000 7f9f7dd9b640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f6006be30 0x7f9f6006e340 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9f74006fd0 tx=0x7f9f74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:00.899+0000 7f9f6effd640 1 -- 172.21.15.6:0/4163490988 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f8006dd20 con 0x7f9f8006d3d0 2024-05-20T18:02:01.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.084+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f9f8006e110 con 0x7f9f8006d3d0 2024-05-20T18:02:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.092+0000 7f9f6effd640 1 -- 172.21.15.6:0/4163490988 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v51) ==== 107+0+0 (secure 0 0 0) 0x7f9f70058de0 con 0x7f9f8006d3d0 2024-05-20T18:02:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f6006be30 msgr2=0x7f9f6006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f6006be30 0x7f9f6006e340 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9f74006fd0 tx=0x7f9f74008040 comp rx=0 tx=0).stop 2024-05-20T18:02:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f8006d3d0 msgr2=0x7f9f800b6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f8006d3d0 0x7f9f800b6f30 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000c7f0 tx=0x7f9f7000ccb0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 shutdown_connections 2024-05-20T18:02:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9f6006be30 0x7f9f6006e340 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f80162820 0x7f9f80153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9f800b8190 0x7f9f800b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 --2- 172.21.15.6:0/4163490988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f8006d3d0 0x7f9f800b6f30 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 >> 172.21.15.6:0/4163490988 conn(0x7f9f800d4bd0 msgr2=0x7f9f8015d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 shutdown_connections 2024-05-20T18:02:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.095+0000 7f9f84984640 1 -- 172.21.15.6:0/4163490988 wait complete. 2024-05-20T18:02:01.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-05-20T18:02:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.227+0000 7ff3241e0640 1 Processor -- start 2024-05-20T18:02:01.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.227+0000 7ff3241e0640 1 -- start start 2024-05-20T18:02:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.228+0000 7ff3241e0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff31c06d3d0 0x7ff31c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.228+0000 7ff3241e0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.228+0000 7ff3241e0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff31c06dd20 con 0x7ff31c162820 2024-05-20T18:02:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.228+0000 7ff3241e0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff31c0d0630 con 0x7ff31c06d3d0 2024-05-20T18:02:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.228+0000 7ff3241e0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c0d39c0 con 0x7ff31c0b8190 2024-05-20T18:02:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff32177b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff31c06d3d0 0x7ff31c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff321f7c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff31c162820 0x7ff31c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52210/0 (socket says 172.21.15.6:52210) 2024-05-20T18:02:01.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff321f7c640 1 -- 172.21.15.6:0/2929904181 learned_addr learned my addr 172.21.15.6:0/2929904181 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:01.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff32277d640 1 --2- 172.21.15.6:0/2929904181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff32177b640 1 -- 172.21.15.6:0/2929904181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 msgr2=0x7ff31c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:01.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff32177b640 1 --2- 172.21.15.6:0/2929904181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff32177b640 1 -- 172.21.15.6:0/2929904181 >> v1:172.21.15.6:6789/0 conn(0x7ff31c162820 legacy=0x7ff31c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff32177b640 1 -- 172.21.15.6:0/2929904181 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c0d3ca0 con 0x7ff31c06d3d0 2024-05-20T18:02:01.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.229+0000 7ff320f7a640 1 -- 172.21.15.6:0/2929904181 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130659312 0 0) 0x7ff318001490 con 0x7ff31c162820 2024-05-20T18:02:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.230+0000 7ff32177b640 1 --2- 172.21.15.6:0/2929904181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c06d3d0 0x7ff31c06d7e0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0097a0 tx=0x7ff30c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d756edfbbaec2c38 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.230+0000 7ff320f7a640 1 -- 172.21.15.6:0/2929904181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c037070 con 0x7ff31c06d3d0 2024-05-20T18:02:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.230+0000 7ff320f7a640 1 -- 172.21.15.6:0/2929904181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff30c032440 con 0x7ff31c06d3d0 2024-05-20T18:02:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.230+0000 7ff320f7a640 1 -- 172.21.15.6:0/2929904181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30c032810 con 0x7ff31c06d3d0 2024-05-20T18:02:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.231+0000 7ff3241e0640 1 -- 172.21.15.6:0/2929904181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c06d3d0 msgr2=0x7ff31c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.231+0000 7ff3241e0640 1 --2- 172.21.15.6:0/2929904181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c06d3d0 0x7ff31c06d7e0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0097a0 tx=0x7ff30c02a180 comp rx=0 tx=0).stop 2024-05-20T18:02:01.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.231+0000 7ff3241e0640 1 -- 172.21.15.6:0/2929904181 shutdown_connections 2024-05-20T18:02:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.231+0000 7ff3241e0640 1 --2- 172.21.15.6:0/2929904181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.231+0000 7ff3241e0640 1 --2- 172.21.15.6:0/2929904181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c06d3d0 0x7ff31c06d7e0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.231+0000 7ff3241e0640 1 -- 172.21.15.6:0/2929904181 >> 172.21.15.6:0/2929904181 conn(0x7ff31c0d4bd0 msgr2=0x7ff31c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.231+0000 7ff3241e0640 1 -- 172.21.15.6:0/2929904181 shutdown_connections 2024-05-20T18:02:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.231+0000 7ff3241e0640 1 -- 172.21.15.6:0/2929904181 wait complete. 2024-05-20T18:02:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.233+0000 7ff3241e0640 1 Processor -- start 2024-05-20T18:02:01.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.233+0000 7ff3241e0640 1 -- start start 2024-05-20T18:02:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff3241e0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff31c06d3d0 0x7ff31c1f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff3241e0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c14a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff3241e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c162820 0x7ff31c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff3241e0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c0d0300 con 0x7ff31c162820 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff3241e0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c0d4260 con 0x7ff31c06d3d0 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff3241e0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c0b4050 con 0x7ff31c0b8190 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32277d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c162820 0x7ff31c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32277d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c162820 0x7ff31c0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49456/0 (socket says 172.21.15.6:49456) 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32277d640 1 -- 172.21.15.6:0/325232152 learned_addr learned my addr 172.21.15.6:0/325232152 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff321f7c640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff31c06d3d0 0x7ff31c1f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32177b640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c14a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32277d640 1 -- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 msgr2=0x7ff31c14a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32277d640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c14a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32277d640 1 -- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff31c06d3d0 msgr2=0x7ff31c1f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32277d640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff31c06d3d0 0x7ff31c1f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32277d640 1 -- 172.21.15.6:0/325232152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c0b5390 con 0x7ff31c162820 2024-05-20T18:02:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.234+0000 7ff32177b640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c14a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.235+0000 7ff32277d640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c162820 0x7ff31c0cbc80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7ff31400d4e0 tx=0x7ff31400d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.235+0000 7ff3127fc640 1 -- 172.21.15.6:0/325232152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3140125f0 con 0x7ff31c162820 2024-05-20T18:02:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.235+0000 7ff3127fc640 1 -- 172.21.15.6:0/325232152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff314019070 con 0x7ff31c162820 2024-05-20T18:02:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.235+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31c1f95d0 con 0x7ff31c162820 2024-05-20T18:02:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.235+0000 7ff3127fc640 1 -- 172.21.15.6:0/325232152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3140129f0 con 0x7ff31c162820 2024-05-20T18:02:01.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.235+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31c1f92f0 con 0x7ff31c162820 2024-05-20T18:02:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.236+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31c0b5560 con 0x7ff31c162820 2024-05-20T18:02:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.236+0000 7ff3127fc640 1 -- 172.21.15.6:0/325232152 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff314012b90 con 0x7ff31c162820 2024-05-20T18:02:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.237+0000 7ff3127fc640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff30006be60 0x7ff30006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.237+0000 7ff3127fc640 1 -- 172.21.15.6:0/325232152 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7ff31408afa0 con 0x7ff31c162820 2024-05-20T18:02:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.237+0000 7ff321f7c640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff30006be60 0x7ff30006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.238+0000 7ff321f7c640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff30006be60 0x7ff30006e370 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff3180012e0 tx=0x7ff318001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.241+0000 7ff3127fc640 1 -- 172.21.15.6:0/325232152 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff314059ab0 con 0x7ff31c162820 2024-05-20T18:02:01.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.425+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7ff31c075b00 con 0x7ff31c162820 2024-05-20T18:02:01.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.429+0000 7ff3127fc640 1 -- 172.21.15.6:0/325232152 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v52) ==== 105+0+0 (secure 0 0 0) 0x7ff3140593b0 con 0x7ff31c162820 2024-05-20T18:02:01.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff30006be60 msgr2=0x7ff30006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff30006be60 0x7ff30006e370 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff3180012e0 tx=0x7ff318001630 comp rx=0 tx=0).stop 2024-05-20T18:02:01.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c162820 msgr2=0x7ff31c0cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c162820 0x7ff31c0cbc80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7ff31400d4e0 tx=0x7ff31400d9a0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 shutdown_connections 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff30006be60 0x7ff30006e370 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff31c162820 0x7ff31c0cbc80 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff31c0b8190 0x7ff31c14a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 --2- 172.21.15.6:0/325232152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff31c06d3d0 0x7ff31c1f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 >> 172.21.15.6:0/325232152 conn(0x7ff31c0d4bd0 msgr2=0x7ff31c15fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 shutdown_connections 2024-05-20T18:02:01.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.431+0000 7ff3241e0640 1 -- 172.21.15.6:0/325232152 wait complete. 2024-05-20T18:02:01.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-05-20T18:02:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.560+0000 7fc3eadf5640 1 Processor -- start 2024-05-20T18:02:01.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.560+0000 7fc3eadf5640 1 -- start start 2024-05-20T18:02:01.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3eadf5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e415d530 0x7fc3e415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3eadf5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc3e40b1700 0x7fc3e40b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3eadf5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3e4070850 0x7fc3e4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3eadf5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e40ce190 con 0x7fc3e4070850 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3eadf5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e40cd580 con 0x7fc3e40b1700 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3eadf5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e40cd860 con 0x7fc3e415d530 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3e9392640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3e4070850 0x7fc3e4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3e9392640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3e4070850 0x7fc3e4070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49472/0 (socket says 172.21.15.6:49472) 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.561+0000 7fc3e9392640 1 -- 172.21.15.6:0/962064171 learned_addr learned my addr 172.21.15.6:0/962064171 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.562+0000 7fc3e3fff640 1 --2- 172.21.15.6:0/962064171 >> v2:172.21.15.171:3300/0 conn(0x7fc3e40b1700 0x7fc3e40b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.562+0000 7fc3e8b91640 1 --2- 172.21.15.6:0/962064171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e415d530 0x7fc3e415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.562+0000 7fc3e9392640 1 -- 172.21.15.6:0/962064171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e415d530 msgr2=0x7fc3e415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:01.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.562+0000 7fc3e9392640 1 --2- 172.21.15.6:0/962064171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e415d530 0x7fc3e415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.562+0000 7fc3e9392640 1 -- 172.21.15.6:0/962064171 >> v2:172.21.15.171:3300/0 conn(0x7fc3e40b1700 msgr2=0x7fc3e40b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.562+0000 7fc3e9392640 1 --2- 172.21.15.6:0/962064171 >> v2:172.21.15.171:3300/0 conn(0x7fc3e40b1700 0x7fc3e40b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.562+0000 7fc3e9392640 1 -- 172.21.15.6:0/962064171 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e40cdb40 con 0x7fc3e4070850 2024-05-20T18:02:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.562+0000 7fc3e9392640 1 --2- 172.21.15.6:0/962064171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e4070c60 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fc3e406c2f0 tx=0x7fc3d402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd0422e461200af server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3e37fe640 1 -- 172.21.15.6:0/962064171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4036070 con 0x7fc3e4070850 2024-05-20T18:02:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3e37fe640 1 -- 172.21.15.6:0/962064171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d4031600 con 0x7fc3e4070850 2024-05-20T18:02:01.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3e37fe640 1 -- 172.21.15.6:0/962064171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40319d0 con 0x7fc3e4070850 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3eadf5640 1 -- 172.21.15.6:0/962064171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 msgr2=0x7fc3e4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/962064171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e4070c60 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fc3e406c2f0 tx=0x7fc3d402a6a0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3eadf5640 1 -- 172.21.15.6:0/962064171 shutdown_connections 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/962064171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e4070c60 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/962064171 >> v2:172.21.15.171:3300/0 conn(0x7fc3e40b1700 0x7fc3e40b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/962064171 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e415d530 0x7fc3e415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.563+0000 7fc3eadf5640 1 -- 172.21.15.6:0/962064171 >> 172.21.15.6:0/962064171 conn(0x7fc3e40d29d0 msgr2=0x7fc3e40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.564+0000 7fc3eadf5640 1 -- 172.21.15.6:0/962064171 shutdown_connections 2024-05-20T18:02:01.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.564+0000 7fc3eadf5640 1 -- 172.21.15.6:0/962064171 wait complete. 2024-05-20T18:02:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.565+0000 7fc3eadf5640 1 Processor -- start 2024-05-20T18:02:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.565+0000 7fc3eadf5640 1 -- start start 2024-05-20T18:02:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3eadf5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e406c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3eadf5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e40b1700 0x7fc3e415a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3eadf5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3e415d530 0x7fc3e41f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3eadf5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e40b2050 con 0x7fc3e4070850 2024-05-20T18:02:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3eadf5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e40cd230 con 0x7fc3e415d530 2024-05-20T18:02:01.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3eadf5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e40711a0 con 0x7fc3e40b1700 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49484/0 (socket says 172.21.15.6:49484) 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 -- 172.21.15.6:0/2314736878 learned_addr learned my addr 172.21.15.6:0/2314736878 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e9392640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3e415d530 0x7fc3e41f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e3fff640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e40b1700 0x7fc3e415a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 -- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e40b1700 msgr2=0x7fc3e415a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e40b1700 0x7fc3e415a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 -- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3e415d530 msgr2=0x7fc3e41f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3e415d530 0x7fc3e41f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 -- 172.21.15.6:0/2314736878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e40cbec0 con 0x7fc3e4070850 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.567+0000 7fc3e8b91640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e406c630 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00d600 tx=0x7fc3dc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.568+0000 7fc3e17fa640 1 -- 172.21.15.6:0/2314736878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc004240 con 0x7fc3e4070850 2024-05-20T18:02:01.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.568+0000 7fc3e17fa640 1 -- 172.21.15.6:0/2314736878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3dc0043e0 con 0x7fc3e4070850 2024-05-20T18:02:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.568+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e40b1500 con 0x7fc3e4070850 2024-05-20T18:02:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.568+0000 7fc3e17fa640 1 -- 172.21.15.6:0/2314736878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc003830 con 0x7fc3e4070850 2024-05-20T18:02:01.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.568+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e40b1220 con 0x7fc3e4070850 2024-05-20T18:02:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.569+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e406cba0 con 0x7fc3e4070850 2024-05-20T18:02:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.569+0000 7fc3e17fa640 1 -- 172.21.15.6:0/2314736878 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3dc0039d0 con 0x7fc3e4070850 2024-05-20T18:02:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.570+0000 7fc3e17fa640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3c406be60 0x7fc3c406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.570+0000 7fc3e17fa640 1 -- 172.21.15.6:0/2314736878 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7fc3dc08aef0 con 0x7fc3e4070850 2024-05-20T18:02:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.570+0000 7fc3e3fff640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3c406be60 0x7fc3c406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.571+0000 7fc3e3fff640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3c406be60 0x7fc3c406e370 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc3e415e740 tx=0x7fc3cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.575+0000 7fc3e17fa640 1 -- 172.21.15.6:0/2314736878 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc3e40cbec0 con 0x7fc3e4070850 2024-05-20T18:02:01.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.758+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7fc3e4075b00 con 0x7fc3e4070850 2024-05-20T18:02:01.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.764+0000 7fc3e17fa640 1 -- 172.21.15.6:0/2314736878 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v53) ==== 111+0+0 (secure 0 0 0) 0x7fc3dc01c360 con 0x7fc3e4070850 2024-05-20T18:02:01.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3c406be60 msgr2=0x7fc3c406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3c406be60 0x7fc3c406e370 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc3e415e740 tx=0x7fc3cc008040 comp rx=0 tx=0).stop 2024-05-20T18:02:01.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 msgr2=0x7fc3e406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e406c630 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00d600 tx=0x7fc3dc00dac0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 shutdown_connections 2024-05-20T18:02:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc3c406be60 0x7fc3c406e370 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc3e415d530 0x7fc3e41f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc3e40b1700 0x7fc3e415a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 --2- 172.21.15.6:0/2314736878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e4070850 0x7fc3e406c630 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 >> 172.21.15.6:0/2314736878 conn(0x7fc3e40d29d0 msgr2=0x7fc3e415fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 shutdown_connections 2024-05-20T18:02:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.766+0000 7fc3eadf5640 1 -- 172.21.15.6:0/2314736878 wait complete. 2024-05-20T18:02:01.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T18:02:01.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.894+0000 7f0cbb044640 1 Processor -- start 2024-05-20T18:02:01.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.894+0000 7f0cbb044640 1 -- start start 2024-05-20T18:02:01.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cbb044640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cb4162820 0x7f0cb40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cbb044640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb40b3e80 0x7f0cb406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cbb044640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0cb406d910 0x7f0cb40d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cbb044640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0cb406dd20 con 0x7f0cb4162820 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cbb044640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0cb40d0630 con 0x7f0cb406d910 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cbb044640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb40d39c0 con 0x7f0cb40b3e80 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb8de0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cb4162820 0x7f0cb40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb8de0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cb4162820 0x7f0cb40b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49494/0 (socket says 172.21.15.6:49494) 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb8de0640 1 -- 172.21.15.6:0/2281961535 learned_addr learned my addr 172.21.15.6:0/2281961535 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb3fff640 1 --2- 172.21.15.6:0/2281961535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb40b3e80 0x7f0cb406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb95e1640 1 --2- 172.21.15.6:0/2281961535 >> v2:172.21.15.171:3300/0 conn(0x7f0cb406d910 0x7f0cb40d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb8de0640 1 -- 172.21.15.6:0/2281961535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb40b3e80 msgr2=0x7f0cb406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb8de0640 1 --2- 172.21.15.6:0/2281961535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb40b3e80 0x7f0cb406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb8de0640 1 -- 172.21.15.6:0/2281961535 >> v2:172.21.15.171:3300/0 conn(0x7f0cb406d910 msgr2=0x7f0cb40d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb8de0640 1 --2- 172.21.15.6:0/2281961535 >> v2:172.21.15.171:3300/0 conn(0x7f0cb406d910 0x7f0cb40d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.896+0000 7f0cb8de0640 1 -- 172.21.15.6:0/2281961535 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb40d3ca0 con 0x7f0cb4162820 2024-05-20T18:02:01.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.897+0000 7f0cb8de0640 1 --2- 172.21.15.6:0/2281961535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb4162820 0x7f0cb40b3940 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f0cb408d5e0 tx=0x7f0cac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad32e19a1a29c35d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.897+0000 7f0cb37fe640 1 -- 172.21.15.6:0/2281961535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac037070 con 0x7f0cb4162820 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.897+0000 7f0cb37fe640 1 -- 172.21.15.6:0/2281961535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cac032440 con 0x7f0cb4162820 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.897+0000 7f0cb37fe640 1 -- 172.21.15.6:0/2281961535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac032810 con 0x7f0cb4162820 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 -- 172.21.15.6:0/2281961535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb4162820 msgr2=0x7f0cb40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2281961535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb4162820 0x7f0cb40b3940 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f0cb408d5e0 tx=0x7f0cac02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 -- 172.21.15.6:0/2281961535 shutdown_connections 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2281961535 >> v2:172.21.15.171:3300/0 conn(0x7f0cb406d910 0x7f0cb40d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2281961535 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb40b3e80 0x7f0cb406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2281961535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb4162820 0x7f0cb40b3940 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 -- 172.21.15.6:0/2281961535 >> 172.21.15.6:0/2281961535 conn(0x7f0cb40d4bd0 msgr2=0x7f0cb40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 -- 172.21.15.6:0/2281961535 shutdown_connections 2024-05-20T18:02:01.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.898+0000 7f0cbb044640 1 -- 172.21.15.6:0/2281961535 wait complete. 2024-05-20T18:02:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.900+0000 7f0cbb044640 1 Processor -- start 2024-05-20T18:02:01.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.900+0000 7f0cbb044640 1 -- start start 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.901+0000 7f0cbb044640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cb406d910 0x7f0cb41f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.901+0000 7f0cbb044640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb40b3e80 0x7f0cb40b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.901+0000 7f0cbb044640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb4162820 0x7f0cb40b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.901+0000 7f0cbb044640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb40d0300 con 0x7f0cb40b3e80 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.901+0000 7f0cbb044640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb40d4260 con 0x7f0cb406d910 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.901+0000 7f0cbb044640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb40d4780 con 0x7f0cb4162820 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.901+0000 7f0cb3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb40b3e80 0x7f0cb40b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.901+0000 7f0cb3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb40b3e80 0x7f0cb40b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49498/0 (socket says 172.21.15.6:49498) 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb3fff640 1 -- 172.21.15.6:0/2865375348 learned_addr learned my addr 172.21.15.6:0/2865375348 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb95e1640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb4162820 0x7f0cb40b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb8de0640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cb406d910 0x7f0cb41f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb3fff640 1 -- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb4162820 msgr2=0x7f0cb40b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb3fff640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb4162820 0x7f0cb40b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb3fff640 1 -- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cb406d910 msgr2=0x7f0cb41f81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb3fff640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cb406d910 0x7f0cb41f81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb3fff640 1 -- 172.21.15.6:0/2865375348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb41f86e0 con 0x7f0cb40b3e80 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb3fff640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb40b3e80 0x7f0cb40b6770 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4007e70 tx=0x7f0ca400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb17fa640 1 -- 172.21.15.6:0/2865375348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4014620 con 0x7f0cb40b3e80 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb17fa640 1 -- 172.21.15.6:0/2865375348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca4019070 con 0x7f0cb40b3e80 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cb17fa640 1 -- 172.21.15.6:0/2865375348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4014a00 con 0x7f0cb40b3e80 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb40ccee0 con 0x7f0cb40b3e80 2024-05-20T18:02:01.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.902+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb40cd4a0 con 0x7f0cb40b3e80 2024-05-20T18:02:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.903+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb4075b00 con 0x7f0cb40b3e80 2024-05-20T18:02:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.904+0000 7f0cb17fa640 1 -- 172.21.15.6:0/2865375348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ca4014ba0 con 0x7f0cb40b3e80 2024-05-20T18:02:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.904+0000 7f0cb17fa640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c9406be30 0x7f0c9406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.904+0000 7f0cb17fa640 1 -- 172.21.15.6:0/2865375348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f0ca408b4a0 con 0x7f0cb40b3e80 2024-05-20T18:02:01.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.905+0000 7f0cb8de0640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c9406be30 0x7f0c9406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:01.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.905+0000 7f0cb8de0640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c9406be30 0x7f0c9406e340 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0cac034000 tx=0x7f0cac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:01.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:01.909+0000 7f0cb17fa640 1 -- 172.21.15.6:0/2865375348 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0ca40598e0 con 0x7f0cb40b3e80 2024-05-20T18:02:02.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.094+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0cb408d930 con 0x7f0cb40b3e80 2024-05-20T18:02:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.097+0000 7f0cb17fa640 1 -- 172.21.15.6:0/2865375348 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v54) ==== 104+0+0 (secure 0 0 0) 0x7f0ca405dbe0 con 0x7f0cb40b3e80 2024-05-20T18:02:02.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c9406be30 msgr2=0x7f0c9406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c9406be30 0x7f0c9406e340 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0cac034000 tx=0x7f0cac02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:02.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb40b3e80 msgr2=0x7f0cb40b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb40b3e80 0x7f0cb40b6770 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4007e70 tx=0x7f0ca400e4b0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 shutdown_connections 2024-05-20T18:02:02.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0c9406be30 0x7f0c9406e340 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cb4162820 0x7f0cb40b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb40b3e80 0x7f0cb40b6770 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 --2- 172.21.15.6:0/2865375348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cb406d910 0x7f0cb41f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 >> 172.21.15.6:0/2865375348 conn(0x7f0cb40d4bd0 msgr2=0x7f0cb415eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:02.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 shutdown_connections 2024-05-20T18:02:02.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.100+0000 7f0cbb044640 1 -- 172.21.15.6:0/2865375348 wait complete. 2024-05-20T18:02:02.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-05-20T18:02:02.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.227+0000 7f6c2c673640 1 Processor -- start 2024-05-20T18:02:02.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.227+0000 7f6c2c673640 1 -- start start 2024-05-20T18:02:02.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c2c673640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2406d3d0 0x7f6c2406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c2c673640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2406dd20 con 0x7f6c24162820 2024-05-20T18:02:02.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c2c673640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c240d0630 con 0x7f6c240b8190 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c2c673640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6c240d39c0 con 0x7f6c2406d3d0 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c2a40f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6c24162820 0x7f6c240b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52214/0 (socket says 172.21.15.6:52214) 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c2a40f640 1 -- 172.21.15.6:0/3919830111 learned_addr learned my addr 172.21.15.6:0/3919830111 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c29c0e640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2406d3d0 0x7f6c2406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338849046 0 0) 0x7f6c20001110 con 0x7f6c24162820 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.229+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c10003520 con 0x7f6c24162820 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250081759 0 0) 0x7f6c240d0630 con 0x7f6c240b8190 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c20001110 con 0x7f6c240b8190 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2322777235 0 0) 0x7f6c10003520 con 0x7f6c24162820 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2406d3d0 msgr2=0x7f6c2406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2406d3d0 0x7f6c2406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 >> v1:172.21.15.171:6789/0 conn(0x7f6c240b8190 legacy=0x7f6c240b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c240d3ca0 con 0x7f6c24162820 2024-05-20T18:02:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f6c20001840 con 0x7f6c24162820 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 >> v1:172.21.15.6:6789/0 conn(0x7f6c24162820 legacy=0x7f6c240b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2406d3d0 0x7f6c10003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100040d0 0x7f6c10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c10004d40 0x7f6c10005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240d39c0 con 0x7f6c100040d0 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1000bb20 con 0x7f6c10004d40 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1000bd20 con 0x7f6c2406d3d0 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c29c0e640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100040d0 0x7f6c10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2a40f640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2406d3d0 0x7f6c10003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c2ac10640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c10004d40 0x7f6c10005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c29c0e640 1 -- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2406d3d0 msgr2=0x7f6c10003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c29c0e640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c2406d3d0 0x7f6c10003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c29c0e640 1 -- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c10004d40 msgr2=0x7f6c10005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c29c0e640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c10004d40 0x7f6c10005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.230+0000 7f6c29c0e640 1 -- 172.21.15.6:0/3919830111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c10003520 con 0x7f6c100040d0 2024-05-20T18:02:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.231+0000 7f6c29c0e640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100040d0 0x7f6c10004800 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009ac0 tx=0x7f6c10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce14d181b93d37cf server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.231+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14036070 con 0x7f6c100040d0 2024-05-20T18:02:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.231+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14031400 con 0x7f6c100040d0 2024-05-20T18:02:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.231+0000 7f6c2940d640 1 -- 172.21.15.6:0/3919830111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14009690 con 0x7f6c100040d0 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.232+0000 7f6c2c673640 1 -- 172.21.15.6:0/3919830111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100040d0 msgr2=0x7f6c10004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.232+0000 7f6c2c673640 1 --2- 172.21.15.6:0/3919830111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c100040d0 0x7f6c10004800 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009ac0 tx=0x7f6c10005830 comp rx=0 tx=0).stop 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.232+0000 7f6c2ac10640 1 -- 172.21.15.6:0/3919830111 reap_dead start 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.232+0000 7f6c2c673640 1 -- 172.21.15.6:0/3919830111 shutdown_connections 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.232+0000 7f6c2c673640 1 -- 172.21.15.6:0/3919830111 >> 172.21.15.6:0/3919830111 conn(0x7f6c240d4bd0 msgr2=0x7f6c240d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.232+0000 7f6c2c673640 1 -- 172.21.15.6:0/3919830111 shutdown_connections 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.232+0000 7f6c2c673640 1 -- 172.21.15.6:0/3919830111 wait complete. 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.234+0000 7f6c2c673640 1 Processor -- start 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.234+0000 7f6c2c673640 1 -- start start 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c2c673640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c100040d0 0x7f6c240b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c2c673640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2414bc50 0x7f6c240c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c2c673640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c24148ed0 0x7f6c241492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c2c673640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240d0300 con 0x7f6c2414bc50 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c2c673640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240d4260 con 0x7f6c24148ed0 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c2c673640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6c240b4050 con 0x7f6c100040d0 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c29c0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2414bc50 0x7f6c240c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c29c0e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2414bc50 0x7f6c240c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49516/0 (socket says 172.21.15.6:49516) 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c29c0e640 1 -- 172.21.15.6:0/1078180724 learned_addr learned my addr 172.21.15.6:0/1078180724 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c2a40f640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c100040d0 0x7f6c240b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.235+0000 7f6c2ac10640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c24148ed0 0x7f6c241492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c29c0e640 1 -- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c100040d0 msgr2=0x7f6c240b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c29c0e640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c100040d0 0x7f6c240b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c29c0e640 1 -- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c24148ed0 msgr2=0x7f6c241492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c29c0e640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c24148ed0 0x7f6c241492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c29c0e640 1 -- 172.21.15.6:0/1078180724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c240b4c40 con 0x7f6c2414bc50 2024-05-20T18:02:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c29c0e640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2414bc50 0x7f6c240c7870 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f6c14034040 tx=0x7f6c14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c1affd640 1 -- 172.21.15.6:0/1078180724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14040020 con 0x7f6c2414bc50 2024-05-20T18:02:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c1affd640 1 -- 172.21.15.6:0/1078180724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14003a40 con 0x7f6c2414bc50 2024-05-20T18:02:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c240b4f20 con 0x7f6c2414bc50 2024-05-20T18:02:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c1affd640 1 -- 172.21.15.6:0/1078180724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14036040 con 0x7f6c2414bc50 2024-05-20T18:02:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.236+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c240b54e0 con 0x7f6c2414bc50 2024-05-20T18:02:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.237+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c240b4990 con 0x7f6c2414bc50 2024-05-20T18:02:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.238+0000 7f6c1affd640 1 -- 172.21.15.6:0/1078180724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c14043020 con 0x7f6c2414bc50 2024-05-20T18:02:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.238+0000 7f6c1affd640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0806be30 0x7f6c0806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.238+0000 7f6c1affd640 1 -- 172.21.15.6:0/1078180724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f6c140aaed0 con 0x7f6c2414bc50 2024-05-20T18:02:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.239+0000 7f6c2a40f640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0806be30 0x7f6c0806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.239+0000 7f6c2a40f640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0806be30 0x7f6c0806e340 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6c200017e0 tx=0x7f6c20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.243+0000 7f6c1affd640 1 -- 172.21.15.6:0/1078180724 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6c1404a070 con 0x7f6c2414bc50 2024-05-20T18:02:02.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.427+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7f6c24075b00 con 0x7f6c2414bc50 2024-05-20T18:02:02.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.430+0000 7f6c1affd640 1 -- 172.21.15.6:0/1078180724 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v55) ==== 102+0+0 (secure 0 0 0) 0x7f6c140799f0 con 0x7f6c2414bc50 2024-05-20T18:02:02.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0806be30 msgr2=0x7f6c0806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0806be30 0x7f6c0806e340 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6c200017e0 tx=0x7f6c20009040 comp rx=0 tx=0).stop 2024-05-20T18:02:02.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2414bc50 msgr2=0x7f6c240c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2414bc50 0x7f6c240c7870 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f6c14034040 tx=0x7f6c14004730 comp rx=0 tx=0).stop 2024-05-20T18:02:02.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 shutdown_connections 2024-05-20T18:02:02.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f6c0806be30 0x7f6c0806e340 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c24148ed0 0x7f6c241492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2414bc50 0x7f6c240c7870 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 --2- 172.21.15.6:0/1078180724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c100040d0 0x7f6c240b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 >> 172.21.15.6:0/1078180724 conn(0x7f6c240d4bd0 msgr2=0x7f6c240d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 shutdown_connections 2024-05-20T18:02:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.433+0000 7f6c2c673640 1 -- 172.21.15.6:0/1078180724 wait complete. 2024-05-20T18:02:02.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps' 2024-05-20T18:02:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.560+0000 7f3370006640 1 Processor -- start 2024-05-20T18:02:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.560+0000 7f3370006640 1 -- start start 2024-05-20T18:02:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.561+0000 7f3370006640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336806d3d0 0x7f336806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.561+0000 7f3370006640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336806dd20 con 0x7f33680b8190 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.561+0000 7f3370006640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33680d0630 con 0x7f3368162820 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.561+0000 7f3370006640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33680d39c0 con 0x7f336806d3d0 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.561+0000 7f336e5a3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33680b8190 0x7f33680b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52222/0 (socket says 172.21.15.6:52222) 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.561+0000 7f336e5a3640 1 -- 172.21.15.6:0/2396536021 learned_addr learned my addr 172.21.15.6:0/2396536021 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336d5a1640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336806d3d0 0x7f336806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363613808 0 0) 0x7f3360001490 con 0x7f33680b8190 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3354003520 con 0x7f33680b8190 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970998542 0 0) 0x7f33680d0630 con 0x7f3368162820 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3360001490 con 0x7f3368162820 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 656976221 0 0) 0x7f3354003520 con 0x7f33680b8190 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336806d3d0 msgr2=0x7f336806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336806d3d0 0x7f336806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 >> v1:172.21.15.171:6789/0 conn(0x7f3368162820 legacy=0x7f33680b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33680d3ca0 con 0x7f33680b8190 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f3360001bc0 con 0x7f33680b8190 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 >> v1:172.21.15.6:6789/0 conn(0x7f33680b8190 legacy=0x7f33680b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f3354003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354004800 0x7f3354004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336806d3d0 0x7f3354005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33680d39c0 con 0x7f3354003b70 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f335400bad0 con 0x7f3354004800 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f335400bcd0 con 0x7f336806d3d0 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336dda2640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f3354003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336e5a3640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336806d3d0 0x7f3354005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.562+0000 7f336d5a1640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354004800 0x7f3354004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.563+0000 7f336dda2640 1 -- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336806d3d0 msgr2=0x7f3354005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.563+0000 7f336dda2640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336806d3d0 0x7f3354005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.563+0000 7f336dda2640 1 -- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354004800 msgr2=0x7f3354004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.563+0000 7f336dda2640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3354004800 0x7f3354004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.563+0000 7f336dda2640 1 -- 172.21.15.6:0/2396536021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3354003520 con 0x7f3354003b70 2024-05-20T18:02:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.563+0000 7f336dda2640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f3354003fc0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f33640018d0 tx=0x7f3354005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd9b0c79264e70a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33640014f0 con 0x7f3354003b70 2024-05-20T18:02:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33640052d0 con 0x7f3354003b70 2024-05-20T18:02:02.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f336cda0640 1 -- 172.21.15.6:0/2396536021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336402aca0 con 0x7f3354003b70 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f3370006640 1 -- 172.21.15.6:0/2396536021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 msgr2=0x7f3354003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f3370006640 1 --2- 172.21.15.6:0/2396536021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f3354003fc0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f33640018d0 tx=0x7f3354005830 comp rx=0 tx=0).stop 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f336e5a3640 1 -- 172.21.15.6:0/2396536021 reap_dead start 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f3370006640 1 -- 172.21.15.6:0/2396536021 shutdown_connections 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f3370006640 1 -- 172.21.15.6:0/2396536021 >> 172.21.15.6:0/2396536021 conn(0x7f33680d4bd0 msgr2=0x7f33680d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f3370006640 1 -- 172.21.15.6:0/2396536021 shutdown_connections 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.564+0000 7f3370006640 1 -- 172.21.15.6:0/2396536021 wait complete. 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.566+0000 7f3370006640 1 Processor -- start 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.566+0000 7f3370006640 1 -- start start 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f3370006640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f33681f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f3370006640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336815c230 0x7f3368154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f3370006640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33681f87c0 0x7f33681f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f3370006640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f33680d0300 con 0x7f3354003b70 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f3370006640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f33680d4260 con 0x7f33681f87c0 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f3370006640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f33680b4050 con 0x7f336815c230 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f33681f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f33681f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49522/0 (socket says 172.21.15.6:49522) 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 -- 172.21.15.6:0/2121819875 learned_addr learned my addr 172.21.15.6:0/2121819875 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336e5a3640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33681f87c0 0x7f33681f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336d5a1640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336815c230 0x7f3368154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 -- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336815c230 msgr2=0x7f3368154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336815c230 0x7f3368154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 -- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33681f87c0 msgr2=0x7f33681f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33681f87c0 0x7f33681f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 -- 172.21.15.6:0/2121819875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33681f51f0 con 0x7f3354003b70 2024-05-20T18:02:02.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f336dda2640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f33681f5cb0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f3364005040 tx=0x7f33640012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f335e7fc640 1 -- 172.21.15.6:0/2121819875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336403f020 con 0x7f3354003b70 2024-05-20T18:02:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f335e7fc640 1 -- 172.21.15.6:0/2121819875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3364006e50 con 0x7f3354003b70 2024-05-20T18:02:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.568+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3368157e40 con 0x7f3354003b70 2024-05-20T18:02:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.569+0000 7f335e7fc640 1 -- 172.21.15.6:0/2121819875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3364037040 con 0x7f3354003b70 2024-05-20T18:02:02.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.569+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33681f54b0 con 0x7f3354003b70 2024-05-20T18:02:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.570+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3368075b00 con 0x7f3354003b70 2024-05-20T18:02:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.570+0000 7f335e7fc640 1 -- 172.21.15.6:0/2121819875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3364042020 con 0x7f3354003b70 2024-05-20T18:02:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.570+0000 7f335e7fc640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334c06be30 0x7f334c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.571+0000 7f335e7fc640 1 -- 172.21.15.6:0/2121819875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f33640aa8d0 con 0x7f3354003b70 2024-05-20T18:02:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.571+0000 7f336d5a1640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334c06be30 0x7f334c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:02.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.571+0000 7f336d5a1640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334c06be30 0x7f334c06e340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f336815ca70 tx=0x7f3358009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:02.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.575+0000 7f335e7fc640 1 -- 172.21.15.6:0/2121819875 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3364049030 con 0x7f3354003b70 2024-05-20T18:02:02.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:02.831+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]} v 0) -- 0x7f336815dda0 con 0x7f3354003b70 2024-05-20T18:02:03.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.090+0000 7f335e7fc640 1 -- 172.21.15.6:0/2121819875 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]}]=0 v469) ==== 151+0+0 (secure 0 0 0) 0x7f33640793f0 con 0x7f3354003b70 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334c06be30 msgr2=0x7f334c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334c06be30 0x7f334c06e340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f336815ca70 tx=0x7f3358009190 comp rx=0 tx=0).stop 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 msgr2=0x7f33681f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f33681f5cb0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f3364005040 tx=0x7f33640012d0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 shutdown_connections 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f334c06be30 0x7f334c06e340 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33681f87c0 0x7f33681f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f336815c230 0x7f3368154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 --2- 172.21.15.6:0/2121819875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3354003b70 0x7f33681f5cb0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 >> 172.21.15.6:0/2121819875 conn(0x7f33680d4bd0 msgr2=0x7f336815e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.092+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 shutdown_connections 2024-05-20T18:02:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.093+0000 7f3370006640 1 -- 172.21.15.6:0/2121819875 wait complete. 2024-05-20T18:02:03.102 INFO:tasks.cephfs_test_runner:test_client_pin_mincaps (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-05-20T18:02:03.102 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T18:02:03.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.222+0000 7f60a1b38640 1 Processor -- start 2024-05-20T18:02:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.222+0000 7f60a1b38640 1 -- start start 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.223+0000 7f60a1b38640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f609c15f220 0x7f609c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.223+0000 7f60a1b38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 0x7f609c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.223+0000 7f60a1b38640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c0cfd20 con 0x7f609c0cf910 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.223+0000 7f60a1b38640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f609c0cda20 con 0x7f609c15f220 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.223+0000 7f60a1b38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f609c0cdd00 con 0x7f609c0d0e00 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.223+0000 7f609b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f609c15f220 0x7f609c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.223+0000 7f609bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f609c0cf910 0x7f609c0ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52230/0 (socket says 172.21.15.6:52230) 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.223+0000 7f609bfff640 1 -- 172.21.15.6:0/2644489416 learned_addr learned my addr 172.21.15.6:0/2644489416 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.224+0000 7f609b7fe640 1 -- 172.21.15.6:0/2644489416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 msgr2=0x7f609c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.224+0000 7f6093fff640 1 --2- 172.21.15.6:0/2644489416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 0x7f609c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.224+0000 7f609b7fe640 1 --2- 172.21.15.6:0/2644489416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 0x7f609c0cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.224+0000 7f609b7fe640 1 -- 172.21.15.6:0/2644489416 >> v1:172.21.15.6:6789/0 conn(0x7f609c0cf910 legacy=0x7f609c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.224+0000 7f609affd640 1 -- 172.21.15.6:0/2644489416 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330629828 0 0) 0x7f6094001490 con 0x7f609c0cf910 2024-05-20T18:02:03.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.224+0000 7f609b7fe640 1 -- 172.21.15.6:0/2644489416 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c0cdfe0 con 0x7f609c15f220 2024-05-20T18:02:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.225+0000 7f609b7fe640 1 --2- 172.21.15.6:0/2644489416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c0d08c0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f608c0097a0 tx=0x7f608c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a414a986016ab0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.225+0000 7f609affd640 1 -- 172.21.15.6:0/2644489416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c037070 con 0x7f609c15f220 2024-05-20T18:02:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.225+0000 7f609affd640 1 -- 172.21.15.6:0/2644489416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f608c02ae50 con 0x7f609c15f220 2024-05-20T18:02:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.225+0000 7f609affd640 1 -- 172.21.15.6:0/2644489416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c032660 con 0x7f609c15f220 2024-05-20T18:02:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.225+0000 7f60a1b38640 1 -- 172.21.15.6:0/2644489416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 msgr2=0x7f609c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.225+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2644489416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c0d08c0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f608c0097a0 tx=0x7f608c02a100 comp rx=0 tx=0).stop 2024-05-20T18:02:03.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.225+0000 7f60a1b38640 1 -- 172.21.15.6:0/2644489416 shutdown_connections 2024-05-20T18:02:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.226+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2644489416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 0x7f609c0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.226+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2644489416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c0d08c0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.226+0000 7f60a1b38640 1 -- 172.21.15.6:0/2644489416 >> 172.21.15.6:0/2644489416 conn(0x7f609c0b44d0 msgr2=0x7f609c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.226+0000 7f60a1b38640 1 -- 172.21.15.6:0/2644489416 shutdown_connections 2024-05-20T18:02:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.226+0000 7f60a1b38640 1 -- 172.21.15.6:0/2644489416 wait complete. 2024-05-20T18:02:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.227+0000 7f60a1b38640 1 Processor -- start 2024-05-20T18:02:03.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.227+0000 7f60a1b38640 1 -- start start 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f60a1b38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f609c0cf910 0x7f609c0b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f60a1b38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 0x7f609c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f60a1b38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f60a1b38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0cd800 con 0x7f609c15f220 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f60a1b38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f609c0cd680 con 0x7f609c0cf910 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f60a1b38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f609c15f630 con 0x7f609c0d0e00 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c15d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49526/0 (socket says 172.21.15.6:49526) 2024-05-20T18:02:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 -- 172.21.15.6:0/2855462267 learned_addr learned my addr 172.21.15.6:0/2855462267 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f6093fff640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 0x7f609c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609b7fe640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f609c0cf910 0x7f609c0b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 -- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 msgr2=0x7f609c0c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 0x7f609c0c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 -- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f609c0cf910 msgr2=0x7f609c0b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f609c0cf910 0x7f609c0b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 -- 172.21.15.6:0/2855462267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c0ca490 con 0x7f609c15f220 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609b7fe640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f609c0cf910 0x7f609c0b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f609bfff640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c15d8f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f609400c700 tx=0x7f609400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f6098ff9640 1 -- 172.21.15.6:0/2855462267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094018070 con 0x7f609c15f220 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f6098ff9640 1 -- 172.21.15.6:0/2855462267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609400ce10 con 0x7f609c15f220 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c0ca770 con 0x7f609c15f220 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.229+0000 7f6098ff9640 1 -- 172.21.15.6:0/2855462267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609400a880 con 0x7f609c15f220 2024-05-20T18:02:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.230+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c0cad30 con 0x7f609c15f220 2024-05-20T18:02:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.230+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609c075b00 con 0x7f609c15f220 2024-05-20T18:02:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.231+0000 7f6098ff9640 1 -- 172.21.15.6:0/2855462267 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f609401b070 con 0x7f609c15f220 2024-05-20T18:02:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.231+0000 7f6098ff9640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f607c06be30 0x7f607c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.232+0000 7f6098ff9640 1 -- 172.21.15.6:0/2855462267 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f609408a2c0 con 0x7f609c15f220 2024-05-20T18:02:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.232+0000 7f609b7fe640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f607c06be30 0x7f607c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.232+0000 7f609b7fe640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f607c06be30 0x7f607c06e340 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f608c034000 tx=0x7f608c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.236+0000 7f6098ff9640 1 -- 172.21.15.6:0/2855462267 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f609c0cfd20 con 0x7f609c15f220 2024-05-20T18:02:03.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.422+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f609c163420 con 0x7f609c15f220 2024-05-20T18:02:03.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.423+0000 7f6098ff9640 1 -- 172.21.15.6:0/2855462267 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+13251 (secure 0 0 0) 0x7f6094058700 con 0x7f609c15f220 2024-05-20T18:02:03.420 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:03.420 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":128,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:00.735211+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/524087551":"2024-05-21T18:01:57.729875+0000","172.21.15.6:6833/524087551":"2024-05-21T18:01:57.729875+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:03.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f607c06be30 msgr2=0x7f607c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f607c06be30 0x7f607c06e340 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f608c034000 tx=0x7f608c02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 msgr2=0x7f609c15d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c15d8f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f609400c700 tx=0x7f609400cbc0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 shutdown_connections 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f607c06be30 0x7f607c06e340 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f609c15f220 0x7f609c15d8f0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f609c0d0e00 0x7f609c0c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 --2- 172.21.15.6:0/2855462267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f609c0cf910 0x7f609c0b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 >> 172.21.15.6:0/2855462267 conn(0x7f609c0b44d0 msgr2=0x7f609c151340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 shutdown_connections 2024-05-20T18:02:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.425+0000 7f60a1b38640 1 -- 172.21.15.6:0/2855462267 wait complete. 2024-05-20T18:02:03.434 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:02:03.434 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:02:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.554+0000 7f5d455c3640 1 Processor -- start 2024-05-20T18:02:03.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.554+0000 7f5d455c3640 1 -- start start 2024-05-20T18:02:03.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d455c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d40168050 0x7f5d4016a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d455c3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d400d0630 con 0x7f5d40162820 2024-05-20T18:02:03.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d455c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d400d39c0 con 0x7f5d4006d3d0 2024-05-20T18:02:03.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d455c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5d400d3ca0 con 0x7f5d40168050 2024-05-20T18:02:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d3f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d40168050 0x7f5d4016a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d3f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5d40168050 0x7f5d4016a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49540/0 (socket says 172.21.15.6:49540) 2024-05-20T18:02:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d3effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5d40162820 0x7f5d400b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52242/0 (socket says 172.21.15.6:52242) 2024-05-20T18:02:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d3f7fe640 1 -- 172.21.15.6:0/1281313170 learned_addr learned my addr 172.21.15.6:0/1281313170 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d3f7fe640 1 -- 172.21.15.6:0/1281313170 >> v1:172.21.15.171:6789/0 conn(0x7f5d4006d3d0 legacy=0x7f5d4006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d3f7fe640 1 -- 172.21.15.6:0/1281313170 >> v1:172.21.15.6:6789/0 conn(0x7f5d40162820 legacy=0x7f5d400b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d3f7fe640 1 -- 172.21.15.6:0/1281313170 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d400d3f80 con 0x7f5d40168050 2024-05-20T18:02:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.556+0000 7f5d3dffb640 1 -- 172.21.15.6:0/1281313170 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081247529 0 0) 0x7f5d400d0630 con 0x7f5d40162820 2024-05-20T18:02:03.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.557+0000 7f5d3f7fe640 1 --2- 172.21.15.6:0/1281313170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40168050 0x7f5d4016a470 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009870 tx=0x7f5d3802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5081b9dda79d6bb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.557+0000 7f5d3dffb640 1 -- 172.21.15.6:0/1281313170 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d38037070 con 0x7f5d40168050 2024-05-20T18:02:03.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.557+0000 7f5d3dffb640 1 -- 172.21.15.6:0/1281313170 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d38032440 con 0x7f5d40168050 2024-05-20T18:02:03.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.557+0000 7f5d3dffb640 1 -- 172.21.15.6:0/1281313170 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d38032810 con 0x7f5d40168050 2024-05-20T18:02:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.558+0000 7f5d455c3640 1 -- 172.21.15.6:0/1281313170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40168050 msgr2=0x7f5d4016a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.558+0000 7f5d455c3640 1 --2- 172.21.15.6:0/1281313170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40168050 0x7f5d4016a470 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009870 tx=0x7f5d3802a2a0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.558+0000 7f5d455c3640 1 -- 172.21.15.6:0/1281313170 shutdown_connections 2024-05-20T18:02:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.558+0000 7f5d455c3640 1 --2- 172.21.15.6:0/1281313170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40168050 0x7f5d4016a470 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.558+0000 7f5d455c3640 1 -- 172.21.15.6:0/1281313170 >> 172.21.15.6:0/1281313170 conn(0x7f5d400d4bd0 msgr2=0x7f5d400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.558+0000 7f5d455c3640 1 -- 172.21.15.6:0/1281313170 shutdown_connections 2024-05-20T18:02:03.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.558+0000 7f5d455c3640 1 -- 172.21.15.6:0/1281313170 wait complete. 2024-05-20T18:02:03.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.560+0000 7f5d455c3640 1 Processor -- start 2024-05-20T18:02:03.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.560+0000 7f5d455c3640 1 -- start start 2024-05-20T18:02:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d455c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d4006d3d0 0x7f5d401557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d455c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40162820 0x7f5d40154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d455c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d40168050 0x7f5d4015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d455c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400b91a0 con 0x7f5d40162820 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d455c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400d0300 con 0x7f5d4006d3d0 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d455c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5d400b4050 con 0x7f5d40168050 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d3e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40162820 0x7f5d40154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d3e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40162820 0x7f5d40154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49542/0 (socket says 172.21.15.6:49542) 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d3e7fc640 1 -- 172.21.15.6:0/2446797210 learned_addr learned my addr 172.21.15.6:0/2446797210 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.561+0000 7f5d3effd640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d4006d3d0 0x7f5d401557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d3f7fe640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d40168050 0x7f5d4015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d3e7fc640 1 -- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d40168050 msgr2=0x7f5d4015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d3e7fc640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d40168050 0x7f5d4015ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d3e7fc640 1 -- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d4006d3d0 msgr2=0x7f5d401557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d3e7fc640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d4006d3d0 0x7f5d401557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d3e7fc640 1 -- 172.21.15.6:0/2446797210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d400b4640 con 0x7f5d40162820 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d3effd640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d4006d3d0 0x7f5d401557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d3e7fc640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40162820 0x7f5d40154b70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b3f0 tx=0x7f5d3400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d277fe640 1 -- 172.21.15.6:0/2446797210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34015020 con 0x7f5d40162820 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d277fe640 1 -- 172.21.15.6:0/2446797210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d34011830 con 0x7f5d40162820 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d400b4920 con 0x7f5d40162820 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d277fe640 1 -- 172.21.15.6:0/2446797210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34011c20 con 0x7f5d40162820 2024-05-20T18:02:03.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.562+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4015dcb0 con 0x7f5d40162820 2024-05-20T18:02:03.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.563+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d40075b00 con 0x7f5d40162820 2024-05-20T18:02:03.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.564+0000 7f5d277fe640 1 -- 172.21.15.6:0/2446797210 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d34018020 con 0x7f5d40162820 2024-05-20T18:02:03.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.564+0000 7f5d277fe640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d2c06be60 0x7f5d2c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.564+0000 7f5d277fe640 1 -- 172.21.15.6:0/2446797210 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f5d3408ad60 con 0x7f5d40162820 2024-05-20T18:02:03.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.564+0000 7f5d3effd640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d2c06be60 0x7f5d2c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.565+0000 7f5d3effd640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d2c06be60 0x7f5d2c06e370 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5d300012e0 tx=0x7f5d30005b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.569+0000 7f5d277fe640 1 -- 172.21.15.6:0/2446797210 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5d3401f020 con 0x7f5d40162820 2024-05-20T18:02:03.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.750+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5d400b3620 con 0x7f5d40162820 2024-05-20T18:02:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.751+0000 7f5d277fe640 1 -- 172.21.15.6:0/2446797210 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) ==== 93+0+10 (secure 0 0 0) 0x7f5d340172c0 con 0x7f5d40162820 2024-05-20T18:02:03.748 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:02:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d2c06be60 msgr2=0x7f5d2c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d2c06be60 0x7f5d2c06e370 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5d300012e0 tx=0x7f5d30005b90 comp rx=0 tx=0).stop 2024-05-20T18:02:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40162820 msgr2=0x7f5d40154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40162820 0x7f5d40154b70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b3f0 tx=0x7f5d3400b8b0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 shutdown_connections 2024-05-20T18:02:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5d2c06be60 0x7f5d2c06e370 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d40168050 0x7f5d4015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d40162820 0x7f5d40154b70 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 --2- 172.21.15.6:0/2446797210 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d4006d3d0 0x7f5d401557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 >> 172.21.15.6:0/2446797210 conn(0x7f5d400d4bd0 msgr2=0x7f5d401610f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 shutdown_connections 2024-05-20T18:02:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.753+0000 7f5d455c3640 1 -- 172.21.15.6:0/2446797210 wait complete. 2024-05-20T18:02:03.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root' 2024-05-20T18:02:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.879+0000 7fef97357640 1 Processor -- start 2024-05-20T18:02:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.879+0000 7fef97357640 1 -- start start 2024-05-20T18:02:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.880+0000 7fef97357640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef90162820 0x7fef900b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.880+0000 7fef97357640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef9006dae0 0x7fef900b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.880+0000 7fef97357640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef900d0630 con 0x7fef900b3e80 2024-05-20T18:02:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.880+0000 7fef97357640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fef900d39c0 con 0x7fef90162820 2024-05-20T18:02:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.880+0000 7fef97357640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef900d3ca0 con 0x7fef9006dae0 2024-05-20T18:02:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef950f3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef90162820 0x7fef900b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef950f3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fef90162820 0x7fef900b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49558/0 (socket says 172.21.15.6:49558) 2024-05-20T18:02:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef948f2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fef900b3e80 0x7fef9006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52244/0 (socket says 172.21.15.6:52244) 2024-05-20T18:02:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef950f3640 1 -- 172.21.15.6:0/3270696158 learned_addr learned my addr 172.21.15.6:0/3270696158 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef958f4640 1 --2- 172.21.15.6:0/3270696158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef9006dae0 0x7fef900b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef950f3640 1 -- 172.21.15.6:0/3270696158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef9006dae0 msgr2=0x7fef900b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef950f3640 1 --2- 172.21.15.6:0/3270696158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef9006dae0 0x7fef900b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef950f3640 1 -- 172.21.15.6:0/3270696158 >> v1:172.21.15.6:6789/0 conn(0x7fef900b3e80 legacy=0x7fef9006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef950f3640 1 -- 172.21.15.6:0/3270696158 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef900d3f80 con 0x7fef90162820 2024-05-20T18:02:03.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.881+0000 7fef87fff640 1 -- 172.21.15.6:0/3270696158 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756576893 0 0) 0x7fef900d0630 con 0x7fef900b3e80 2024-05-20T18:02:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.882+0000 7fef950f3640 1 --2- 172.21.15.6:0/3270696158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef900b3940 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009870 tx=0x7fef8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a443ed8e3e381e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.882+0000 7fef87fff640 1 -- 172.21.15.6:0/3270696158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c037070 con 0x7fef90162820 2024-05-20T18:02:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.882+0000 7fef87fff640 1 -- 172.21.15.6:0/3270696158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8c032440 con 0x7fef90162820 2024-05-20T18:02:03.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.882+0000 7fef87fff640 1 -- 172.21.15.6:0/3270696158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c032810 con 0x7fef90162820 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.882+0000 7fef97357640 1 -- 172.21.15.6:0/3270696158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 msgr2=0x7fef900b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.882+0000 7fef97357640 1 --2- 172.21.15.6:0/3270696158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef900b3940 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009870 tx=0x7fef8c02a270 comp rx=0 tx=0).stop 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.883+0000 7fef97357640 1 -- 172.21.15.6:0/3270696158 shutdown_connections 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.883+0000 7fef97357640 1 --2- 172.21.15.6:0/3270696158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef9006dae0 0x7fef900b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.883+0000 7fef97357640 1 --2- 172.21.15.6:0/3270696158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef900b3940 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.883+0000 7fef97357640 1 -- 172.21.15.6:0/3270696158 >> 172.21.15.6:0/3270696158 conn(0x7fef900d4bd0 msgr2=0x7fef900d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.883+0000 7fef97357640 1 -- 172.21.15.6:0/3270696158 shutdown_connections 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.883+0000 7fef97357640 1 -- 172.21.15.6:0/3270696158 wait complete. 2024-05-20T18:02:03.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.884+0000 7fef97357640 1 Processor -- start 2024-05-20T18:02:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.885+0000 7fef97357640 1 -- start start 2024-05-20T18:02:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef97357640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef900b3e80 0x7fef900caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef97357640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef9014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef97357640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef900b9310 0x7fef900b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef97357640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fef900d4780 con 0x7fef90162820 2024-05-20T18:02:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef97357640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fef900d0300 con 0x7fef900b3e80 2024-05-20T18:02:03.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef97357640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fef900d4900 con 0x7fef900b9310 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef9014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef9014ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49566/0 (socket says 172.21.15.6:49566) 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 -- 172.21.15.6:0/4152304538 learned_addr learned my addr 172.21.15.6:0/4152304538 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef958f4640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef900b9310 0x7fef900b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef950f3640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef900b3e80 0x7fef900caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 -- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef900b9310 msgr2=0x7fef900b9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef900b9310 0x7fef900b9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 -- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef900b3e80 msgr2=0x7fef900caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef900b3e80 0x7fef900caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 -- 172.21.15.6:0/4152304538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef900cb530 con 0x7fef90162820 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.886+0000 7fef948f2640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef9014ced0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fef8000c460 tx=0x7fef8000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.887+0000 7fef85ffb640 1 -- 172.21.15.6:0/4152304538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80018070 con 0x7fef90162820 2024-05-20T18:02:03.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.887+0000 7fef85ffb640 1 -- 172.21.15.6:0/4152304538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef80007500 con 0x7fef90162820 2024-05-20T18:02:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.887+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef900b9c60 con 0x7fef90162820 2024-05-20T18:02:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.887+0000 7fef85ffb640 1 -- 172.21.15.6:0/4152304538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80004a20 con 0x7fef90162820 2024-05-20T18:02:03.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.887+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef900b4990 con 0x7fef90162820 2024-05-20T18:02:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.888+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef90075b00 con 0x7fef90162820 2024-05-20T18:02:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.888+0000 7fef85ffb640 1 -- 172.21.15.6:0/4152304538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef8001b070 con 0x7fef90162820 2024-05-20T18:02:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.889+0000 7fef85ffb640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef7406be30 0x7fef7406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.889+0000 7fef85ffb640 1 -- 172.21.15.6:0/4152304538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7fef80089f80 con 0x7fef90162820 2024-05-20T18:02:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.889+0000 7fef950f3640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef7406be30 0x7fef7406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:03.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.890+0000 7fef950f3640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef7406be30 0x7fef7406e340 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fef8c034000 tx=0x7fef8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:03.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:03.893+0000 7fef85ffb640 1 -- 172.21.15.6:0/4152304538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fef900b9c60 con 0x7fef90162820 2024-05-20T18:02:04.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:04.146+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]} v 0) -- 0x7fef901617f0 con 0x7fef90162820 2024-05-20T18:02:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.097+0000 7fef85ffb640 1 -- 172.21.15.6:0/4152304538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]}]=0 v471) ==== 151+0+0 (secure 0 0 0) 0x7fef900cb530 con 0x7fef90162820 2024-05-20T18:02:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef7406be30 msgr2=0x7fef7406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef7406be30 0x7fef7406e340 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fef8c034000 tx=0x7fef8c02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 msgr2=0x7fef9014ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef9014ced0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fef8000c460 tx=0x7fef8000c920 comp rx=0 tx=0).stop 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 shutdown_connections 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fef7406be30 0x7fef7406e340 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef900b9310 0x7fef900b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef90162820 0x7fef9014ced0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 --2- 172.21.15.6:0/4152304538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef900b3e80 0x7fef900caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 >> 172.21.15.6:0/4152304538 conn(0x7fef900d4bd0 msgr2=0x7fef9015e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 shutdown_connections 2024-05-20T18:02:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.100+0000 7fef97357640 1 -- 172.21.15.6:0/4152304538 wait complete. 2024-05-20T18:02:05.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T18:02:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.239+0000 7ff26e699640 1 Processor -- start 2024-05-20T18:02:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.239+0000 7ff26e699640 1 -- start start 2024-05-20T18:02:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff26e699640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff268168050 0x7ff26816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff26e699640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2680d0630 con 0x7ff268162820 2024-05-20T18:02:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff26e699640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2680d39c0 con 0x7ff26806d3d0 2024-05-20T18:02:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff26e699640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ff2680d3ca0 con 0x7ff268168050 2024-05-20T18:02:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff26cc36640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff268168050 0x7ff26816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff267fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff268162820 0x7ff2680b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52250/0 (socket says 172.21.15.6:52250) 2024-05-20T18:02:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff267fff640 1 -- 172.21.15.6:0/1710166178 learned_addr learned my addr 172.21.15.6:0/1710166178 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff266ffd640 1 -- 172.21.15.6:0/1710166178 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2711304476 0 0) 0x7ff2680d0630 con 0x7ff268162820 2024-05-20T18:02:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff266ffd640 1 -- 172.21.15.6:0/1710166178 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff254003520 con 0x7ff268162820 2024-05-20T18:02:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff26cc36640 1 -- 172.21.15.6:0/1710166178 >> v1:172.21.15.171:6789/0 conn(0x7ff26806d3d0 legacy=0x7ff26806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff26cc36640 1 -- 172.21.15.6:0/1710166178 >> v1:172.21.15.6:6789/0 conn(0x7ff268162820 legacy=0x7ff2680b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.241+0000 7ff26cc36640 1 -- 172.21.15.6:0/1710166178 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2680d3f80 con 0x7ff268168050 2024-05-20T18:02:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.242+0000 7ff26cc36640 1 --2- 172.21.15.6:0/1710166178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268168050 0x7ff26816a470 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ff260009d90 tx=0x7ff26002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c429f16baaad2547 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.242+0000 7ff266ffd640 1 -- 172.21.15.6:0/1710166178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260007740 con 0x7ff268168050 2024-05-20T18:02:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.242+0000 7ff266ffd640 1 -- 172.21.15.6:0/1710166178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2600078e0 con 0x7ff268168050 2024-05-20T18:02:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.242+0000 7ff266ffd640 1 -- 172.21.15.6:0/1710166178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260007cb0 con 0x7ff268168050 2024-05-20T18:02:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.243+0000 7ff26e699640 1 -- 172.21.15.6:0/1710166178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268168050 msgr2=0x7ff26816a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.243+0000 7ff26e699640 1 --2- 172.21.15.6:0/1710166178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268168050 0x7ff26816a470 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ff260009d90 tx=0x7ff26002a6f0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.243+0000 7ff26e699640 1 -- 172.21.15.6:0/1710166178 shutdown_connections 2024-05-20T18:02:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.243+0000 7ff26e699640 1 --2- 172.21.15.6:0/1710166178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268168050 0x7ff26816a470 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.243+0000 7ff26e699640 1 -- 172.21.15.6:0/1710166178 >> 172.21.15.6:0/1710166178 conn(0x7ff2680d4bd0 msgr2=0x7ff2680d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.243+0000 7ff26e699640 1 -- 172.21.15.6:0/1710166178 shutdown_connections 2024-05-20T18:02:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.243+0000 7ff26e699640 1 -- 172.21.15.6:0/1710166178 wait complete. 2024-05-20T18:02:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.245+0000 7ff26e699640 1 Processor -- start 2024-05-20T18:02:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.245+0000 7ff26e699640 1 -- start start 2024-05-20T18:02:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.246+0000 7ff26e699640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26806d3d0 0x7ff2681f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.246+0000 7ff26e699640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268162820 0x7ff2680cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.246+0000 7ff26e699640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff268168050 0x7ff268152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.246+0000 7ff26e699640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680b91a0 con 0x7ff268162820 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.246+0000 7ff26e699640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680d0300 con 0x7ff26806d3d0 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.246+0000 7ff26e699640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff2680b4050 con 0x7ff268168050 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268162820 0x7ff2680cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268162820 0x7ff2680cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49584/0 (socket says 172.21.15.6:49584) 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 -- 172.21.15.6:0/1386203478 learned_addr learned my addr 172.21.15.6:0/1386203478 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff267fff640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26806d3d0 0x7ff2681f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff26cc36640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff268168050 0x7ff268152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 -- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff268168050 msgr2=0x7ff268152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff268168050 0x7ff268152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 -- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26806d3d0 msgr2=0x7ff2681f95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26806d3d0 0x7ff2681f95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 -- 172.21.15.6:0/1386203478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff268152e80 con 0x7ff268162820 2024-05-20T18:02:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff2677fe640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268162820 0x7ff2680cb150 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff25000c3c0 tx=0x7ff25000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff264ff9640 1 -- 172.21.15.6:0/1386203478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2500052d0 con 0x7ff268162820 2024-05-20T18:02:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff264ff9640 1 -- 172.21.15.6:0/1386203478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff250005490 con 0x7ff268162820 2024-05-20T18:02:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2681f5a70 con 0x7ff268162820 2024-05-20T18:02:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff264ff9640 1 -- 172.21.15.6:0/1386203478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250007240 con 0x7ff268162820 2024-05-20T18:02:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.247+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2681f6030 con 0x7ff268162820 2024-05-20T18:02:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.249+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff268075b00 con 0x7ff268162820 2024-05-20T18:02:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.249+0000 7ff264ff9640 1 -- 172.21.15.6:0/1386203478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2500073e0 con 0x7ff268162820 2024-05-20T18:02:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.250+0000 7ff264ff9640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff24806be30 0x7ff24806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.250+0000 7ff264ff9640 1 -- 172.21.15.6:0/1386203478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7ff25008a240 con 0x7ff268162820 2024-05-20T18:02:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.250+0000 7ff267fff640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff24806be30 0x7ff24806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.250+0000 7ff267fff640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff24806be30 0x7ff24806e340 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff2580011e0 tx=0x7ff258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.254+0000 7ff264ff9640 1 -- 172.21.15.6:0/1386203478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff250058cd0 con 0x7ff268162820 2024-05-20T18:02:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.438+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff2680b7a10 con 0x7ff268162820 2024-05-20T18:02:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.442+0000 7ff264ff9640 1 -- 172.21.15.6:0/1386203478 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v56)=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7ff2500585d0 con 0x7ff268162820 2024-05-20T18:02:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff24806be30 msgr2=0x7ff24806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff24806be30 0x7ff24806e340 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff2580011e0 tx=0x7ff258009040 comp rx=0 tx=0).stop 2024-05-20T18:02:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268162820 msgr2=0x7ff2680cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268162820 0x7ff2680cb150 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff25000c3c0 tx=0x7ff25000c880 comp rx=0 tx=0).stop 2024-05-20T18:02:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 shutdown_connections 2024-05-20T18:02:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff24806be30 0x7ff24806e340 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff268168050 0x7ff268152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff268162820 0x7ff2680cb150 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 --2- 172.21.15.6:0/1386203478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff26806d3d0 0x7ff2681f95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 >> 172.21.15.6:0/1386203478 conn(0x7ff2680d4bd0 msgr2=0x7ff2680ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 shutdown_connections 2024-05-20T18:02:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.444+0000 7ff26e699640 1 -- 172.21.15.6:0/1386203478 wait complete. 2024-05-20T18:02:05.452 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:02:05.452 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:02:05.491 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:02:05.539 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:02:05.539 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:05.539 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:05.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:02:05.556 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:02:05.556 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:05.574 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:02:05.574 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:05.574 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:05.612 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:02:05.612 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:02:05.612 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:05.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:02:05.632 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T18:02:05.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:05.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.770+0000 7f747018b640 1 Processor -- start 2024-05-20T18:02:05.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.770+0000 7f747018b640 1 -- start start 2024-05-20T18:02:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.771+0000 7f747018b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74680b1e10 0x7f746815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.771+0000 7f747018b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 0x7f7468070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.771+0000 7f747018b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74680cd580 con 0x7f746815d530 2024-05-20T18:02:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.771+0000 7f747018b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f74680ce190 con 0x7f74680b1e10 2024-05-20T18:02:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.771+0000 7f747018b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74680cd860 con 0x7f7468070850 2024-05-20T18:02:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.771+0000 7f746d726640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74680b1e10 0x7f746815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.771+0000 7f746d726640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74680b1e10 0x7f746815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49592/0 (socket says 172.21.15.6:49592) 2024-05-20T18:02:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.771+0000 7f746d726640 1 -- 172.21.15.6:0/2938258253 learned_addr learned my addr 172.21.15.6:0/2938258253 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.772+0000 7f746e728640 1 --2- 172.21.15.6:0/2938258253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 0x7f7468070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.772+0000 7f746d726640 1 -- 172.21.15.6:0/2938258253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 msgr2=0x7f7468070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.772+0000 7f746d726640 1 --2- 172.21.15.6:0/2938258253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 0x7f7468070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.772+0000 7f746d726640 1 -- 172.21.15.6:0/2938258253 >> v1:172.21.15.171:6789/0 conn(0x7f746815d530 legacy=0x7f74680b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.772+0000 7f746d726640 1 -- 172.21.15.6:0/2938258253 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74680cdb40 con 0x7f74680b1e10 2024-05-20T18:02:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.772+0000 7f746d726640 1 --2- 172.21.15.6:0/2938258253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74680b1e10 0x7f746815aaa0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f745c009e50 tx=0x7f745c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8593db06c5d3f7f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f746cf25640 1 -- 172.21.15.6:0/2938258253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c036070 con 0x7f74680b1e10 2024-05-20T18:02:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f746cf25640 1 -- 172.21.15.6:0/2938258253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745c031600 con 0x7f74680b1e10 2024-05-20T18:02:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f746cf25640 1 -- 172.21.15.6:0/2938258253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0319d0 con 0x7f74680b1e10 2024-05-20T18:02:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f747018b640 1 -- 172.21.15.6:0/2938258253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74680b1e10 msgr2=0x7f746815aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f747018b640 1 --2- 172.21.15.6:0/2938258253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74680b1e10 0x7f746815aaa0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f745c009e50 tx=0x7f745c02a710 comp rx=0 tx=0).stop 2024-05-20T18:02:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f747018b640 1 -- 172.21.15.6:0/2938258253 shutdown_connections 2024-05-20T18:02:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f747018b640 1 --2- 172.21.15.6:0/2938258253 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 0x7f7468070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f747018b640 1 --2- 172.21.15.6:0/2938258253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74680b1e10 0x7f746815aaa0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.773+0000 7f747018b640 1 -- 172.21.15.6:0/2938258253 >> 172.21.15.6:0/2938258253 conn(0x7f74680d29d0 msgr2=0x7f74680d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.774+0000 7f747018b640 1 -- 172.21.15.6:0/2938258253 shutdown_connections 2024-05-20T18:02:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.774+0000 7f747018b640 1 -- 172.21.15.6:0/2938258253 wait complete. 2024-05-20T18:02:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.775+0000 7f747018b640 1 Processor -- start 2024-05-20T18:02:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.775+0000 7f747018b640 1 -- start start 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f747018b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 0x7f746814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f747018b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b1e10 0x7f74680cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f747018b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746815d530 0x7f74680cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f747018b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74680711a0 con 0x7f746815d530 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f747018b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74680cd230 con 0x7f74680b1e10 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f747018b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7468071320 con 0x7f7468070850 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746815d530 0x7f74680cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746815d530 0x7f74680cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49602/0 (socket says 172.21.15.6:49602) 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 -- 172.21.15.6:0/3615212470 learned_addr learned my addr 172.21.15.6:0/3615212470 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746d726640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b1e10 0x7f74680cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746df27640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 0x7f746814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 -- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 msgr2=0x7f746814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 0x7f746814ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 -- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b1e10 msgr2=0x7f74680cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b1e10 0x7f74680cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 -- 172.21.15.6:0/3615212470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74680c6ce0 con 0x7f746815d530 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f746e728640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746815d530 0x7f74680cb6b0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f746000d510 tx=0x7f746000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.777+0000 7f74667fc640 1 -- 172.21.15.6:0/3615212470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600125f0 con 0x7f746815d530 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.778+0000 7f74667fc640 1 -- 172.21.15.6:0/3615212470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7460019070 con 0x7f746815d530 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.778+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74680c6fc0 con 0x7f746815d530 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.778+0000 7f74667fc640 1 -- 172.21.15.6:0/3615212470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600129f0 con 0x7f746815d530 2024-05-20T18:02:05.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.778+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74680c7580 con 0x7f746815d530 2024-05-20T18:02:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.778+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74680c6a50 con 0x7f746815d530 2024-05-20T18:02:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.779+0000 7f74667fc640 1 -- 172.21.15.6:0/3615212470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7460012b90 con 0x7f746815d530 2024-05-20T18:02:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.780+0000 7f74667fc640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f745406be30 0x7f745406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.780+0000 7f74667fc640 1 -- 172.21.15.6:0/3615212470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f746008af70 con 0x7f746815d530 2024-05-20T18:02:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.780+0000 7f746df27640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f745406be30 0x7f745406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:05.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.780+0000 7f746df27640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f745406be30 0x7f745406e340 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f74680d29a0 tx=0x7f7458009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:05.784+0000 7f74667fc640 1 -- 172.21.15.6:0/3615212470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f74600593b0 con 0x7f746815d530 2024-05-20T18:02:06.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.007+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7468067ec0 con 0x7f746815d530 2024-05-20T18:02:06.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.008+0000 7f74667fc640 1 -- 172.21.15.6:0/3615212470 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+3869 (secure 0 0 0) 0x7f746005d6b0 con 0x7f746815d530 2024-05-20T18:02:06.006 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:06.006 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":90,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1498838017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1498838017},{"type":"v1","addr":"172.21.15.171:6836","nonce":1498838017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1665765550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1665765550},{"type":"v1","addr":"172.21.15.171:6837","nonce":1665765550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2251103441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2251103441},{"type":"v1","addr":"172.21.15.6:6834","nonce":2251103441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":9030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/4074274028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4074274028},{"type":"v1","addr":"172.21.15.6:6835","nonce":4074274028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[]} 2024-05-20T18:02:06.007 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 90 2024-05-20T18:02:06.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f745406be30 msgr2=0x7f745406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:06.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f745406be30 0x7f745406e340 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f74680d29a0 tx=0x7f7458009040 comp rx=0 tx=0).stop 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746815d530 msgr2=0x7f74680cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746815d530 0x7f74680cb6b0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f746000d510 tx=0x7f746000d9d0 comp rx=0 tx=0).stop 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 shutdown_connections 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f745406be30 0x7f745406e340 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f746815d530 0x7f74680cb6b0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74680b1e10 0x7f74680cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 --2- 172.21.15.6:0/3615212470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7468070850 0x7f746814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 >> 172.21.15.6:0/3615212470 conn(0x7f74680d29d0 msgr2=0x7f746815e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 shutdown_connections 2024-05-20T18:02:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.010+0000 7f747018b640 1 -- 172.21.15.6:0/3615212470 wait complete. 2024-05-20T18:02:06.019 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T18:02:06.019 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T18:02:06.020 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T18:02:06.020 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:02:06.020 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T18:02:06.020 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T18:02:06.020 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T18:02:06.020 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:02:06.020 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T18:02:06.020 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T18:02:06.021 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T18:02:06.021 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:02:06.021 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T18:02:06.021 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T18:02:06.021 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T18:02:06.021 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:02:06.029 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T18:02:06.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T18:02:06.032 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T18:02:06.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T18:02:06.036 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T18:02:06.036 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T18:02:06.037 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T18:02:06.037 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T18:02:06.075 INFO:tasks.ceph.mds.a:Started 2024-05-20T18:02:06.075 DEBUG:teuthology.parallel:result is None 2024-05-20T18:02:06.076 INFO:tasks.ceph.mds.c:Started 2024-05-20T18:02:06.076 DEBUG:teuthology.parallel:result is None 2024-05-20T18:02:06.078 INFO:tasks.ceph.mds.d:Started 2024-05-20T18:02:06.079 DEBUG:teuthology.parallel:result is None 2024-05-20T18:02:06.079 INFO:tasks.ceph.mds.b:Started 2024-05-20T18:02:06.079 DEBUG:teuthology.parallel:result is None 2024-05-20T18:02:06.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T18:02:06.167 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T18:02:06.168 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T18:02:06.176 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T18:02:06.177 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T18:02:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.204+0000 7f5bbc4eb640 1 Processor -- start 2024-05-20T18:02:06.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.204+0000 7f5bbc4eb640 1 -- start start 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.205+0000 7f5bbc4eb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bb406d9a0 0x7f5bb40d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.205+0000 7f5bbc4eb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bb415e6b0 con 0x7f5bb415d940 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.205+0000 7f5bbc4eb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bb40d1100 con 0x7f5bb40b2f10 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.205+0000 7f5bbc4eb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb40d2400 con 0x7f5bb406d9a0 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.206+0000 7f5bb9a86640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bb406d9a0 0x7f5bb40d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.206+0000 7f5bbaa88640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5bb415d940 0x7f5bb415dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52266/0 (socket says 172.21.15.6:52266) 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.206+0000 7f5bbaa88640 1 -- 172.21.15.6:0/886291639 learned_addr learned my addr 172.21.15.6:0/886291639 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.206+0000 7f5bb9a86640 1 -- 172.21.15.6:0/886291639 >> v1:172.21.15.171:6789/0 conn(0x7f5bb40b2f10 legacy=0x7f5bb406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.206+0000 7f5bb9a86640 1 -- 172.21.15.6:0/886291639 >> v1:172.21.15.6:6789/0 conn(0x7f5bb415d940 legacy=0x7f5bb415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:06.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.206+0000 7f5bb9a86640 1 -- 172.21.15.6:0/886291639 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb40d13e0 con 0x7f5bb406d9a0 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.207+0000 7f5bb9a86640 1 --2- 172.21.15.6:0/886291639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb406d9a0 0x7f5bb40d1ec0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009790 tx=0x7f5ba402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f222d47350cc4e65 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.207+0000 7f5bb9285640 1 -- 172.21.15.6:0/886291639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4037070 con 0x7f5bb406d9a0 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.207+0000 7f5bb9285640 1 -- 172.21.15.6:0/886291639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4032440 con 0x7f5bb406d9a0 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.207+0000 7f5bb9285640 1 -- 172.21.15.6:0/886291639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4032810 con 0x7f5bb406d9a0 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.208+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/886291639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb406d9a0 msgr2=0x7f5bb40d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.208+0000 7f5bbc4eb640 1 --2- 172.21.15.6:0/886291639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb406d9a0 0x7f5bb40d1ec0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009790 tx=0x7f5ba402a180 comp rx=0 tx=0).stop 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.208+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/886291639 shutdown_connections 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.208+0000 7f5bbc4eb640 1 --2- 172.21.15.6:0/886291639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb406d9a0 0x7f5bb40d1ec0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.208+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/886291639 >> 172.21.15.6:0/886291639 conn(0x7f5bb40b6670 msgr2=0x7f5bb40b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.208+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/886291639 shutdown_connections 2024-05-20T18:02:06.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.208+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/886291639 wait complete. 2024-05-20T18:02:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.210+0000 7f5bbc4eb640 1 Processor -- start 2024-05-20T18:02:06.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.210+0000 7f5bbc4eb640 1 -- start start 2024-05-20T18:02:06.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbc4eb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bb406d9a0 0x7f5bb414cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:06.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbc4eb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5bb40b2f10 0x7f5bb409ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbc4eb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb415d940 0x7f5bb414ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbc4eb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40b3320 con 0x7f5bb415d940 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbc4eb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40d1a30 con 0x7f5bb406d9a0 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbc4eb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb415e460 con 0x7f5bb40b2f10 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbaa88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb415d940 0x7f5bb414ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbaa88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb415d940 0x7f5bb414ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49646/0 (socket says 172.21.15.6:49646) 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbaa88640 1 -- 172.21.15.6:0/4105402789 learned_addr learned my addr 172.21.15.6:0/4105402789 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bba287640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bb406d9a0 0x7f5bb414cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bb9a86640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5bb40b2f10 0x7f5bb409ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbaa88640 1 -- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5bb40b2f10 msgr2=0x7f5bb409ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbaa88640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5bb40b2f10 0x7f5bb409ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbaa88640 1 -- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bb406d9a0 msgr2=0x7f5bb414cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:06.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbaa88640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bb406d9a0 0x7f5bb414cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.211+0000 7f5bbaa88640 1 -- 172.21.15.6:0/4105402789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb409e090 con 0x7f5bb415d940 2024-05-20T18:02:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.212+0000 7f5bbaa88640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb415d940 0x7f5bb414ab80 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00caa0 tx=0x7f5bac00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.212+0000 7f5baaffd640 1 -- 172.21.15.6:0/4105402789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac017070 con 0x7f5bb415d940 2024-05-20T18:02:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.212+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41e6740 con 0x7f5bb415d940 2024-05-20T18:02:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.212+0000 7f5baaffd640 1 -- 172.21.15.6:0/4105402789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bac00aba0 con 0x7f5bb415d940 2024-05-20T18:02:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.212+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb409e630 con 0x7f5bb415d940 2024-05-20T18:02:06.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.212+0000 7f5baaffd640 1 -- 172.21.15.6:0/4105402789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac021060 con 0x7f5bb415d940 2024-05-20T18:02:06.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.213+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb406d250 con 0x7f5bb415d940 2024-05-20T18:02:06.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.214+0000 7f5baaffd640 1 -- 172.21.15.6:0/4105402789 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bac01a070 con 0x7f5bb415d940 2024-05-20T18:02:06.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.214+0000 7f5baaffd640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b9806be30 0x7f5b9806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:06.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.214+0000 7f5baaffd640 1 -- 172.21.15.6:0/4105402789 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f5bac08a8f0 con 0x7f5bb415d940 2024-05-20T18:02:06.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.214+0000 7f5bba287640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b9806be30 0x7f5b9806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:06.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.215+0000 7f5bba287640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b9806be30 0x7f5b9806e340 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40cde90 tx=0x7f5bb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.219+0000 7f5baaffd640 1 -- 172.21.15.6:0/4105402789 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5bb406d250 con 0x7f5bb415d940 2024-05-20T18:02:06.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:06.414+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5bb4075b00 con 0x7f5bb415d940 2024-05-20T18:02:07.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:02:07.257 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:02:07.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.887+0000 7f5baaffd640 1 -- 172.21.15.6:0/4105402789 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v133) ==== 97+0+0 (secure 0 0 0) 0x7f5bac058d40 con 0x7f5bb415d940 2024-05-20T18:02:07.885 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T18:02:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b9806be30 msgr2=0x7f5b9806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b9806be30 0x7f5b9806e340 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40cde90 tx=0x7f5bb0009040 comp rx=0 tx=0).stop 2024-05-20T18:02:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb415d940 msgr2=0x7f5bb414ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb415d940 0x7f5bb414ab80 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00caa0 tx=0x7f5bac00cf60 comp rx=0 tx=0).stop 2024-05-20T18:02:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 shutdown_connections 2024-05-20T18:02:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5b9806be30 0x7f5b9806e340 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bb415d940 0x7f5bb414ab80 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:07.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5bb40b2f10 0x7f5bb409ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 --2- 172.21.15.6:0/4105402789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bb406d9a0 0x7f5bb414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 >> 172.21.15.6:0/4105402789 conn(0x7f5bb40b6670 msgr2=0x7f5bb4070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 shutdown_connections 2024-05-20T18:02:07.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:07.891+0000 7f5bbc4eb640 1 -- 172.21.15.6:0/4105402789 wait complete. 2024-05-20T18:02:07.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T18:02:08.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.026+0000 7f2ae3eb1640 1 Processor -- start 2024-05-20T18:02:08.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.027+0000 7f2ae3eb1640 1 -- start start 2024-05-20T18:02:08.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae3eb1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc162820 0x7f2adc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae3eb1640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2adc06dae0 0x7f2adc0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae3eb1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2adc0d0630 con 0x7f2adc0b3e80 2024-05-20T18:02:08.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae3eb1640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2adc0d39c0 con 0x7f2adc06dae0 2024-05-20T18:02:08.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae3eb1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2adc0d3ca0 con 0x7f2adc162820 2024-05-20T18:02:08.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae144c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2adc0b3e80 0x7f2adc06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46596/0 (socket says 172.21.15.6:46596) 2024-05-20T18:02:08.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae144c640 1 -- 172.21.15.6:0/1635748950 learned_addr learned my addr 172.21.15.6:0/1635748950 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae1c4d640 1 --2- 172.21.15.6:0/1635748950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc162820 0x7f2adc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae244e640 1 --2- 172.21.15.6:0/1635748950 >> v2:172.21.15.171:3300/0 conn(0x7f2adc06dae0 0x7f2adc0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.028+0000 7f2ae0c4b640 1 -- 172.21.15.6:0/1635748950 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746764417 0 0) 0x7f2adc0d0630 con 0x7f2adc0b3e80 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.029+0000 7f2ae0c4b640 1 -- 172.21.15.6:0/1635748950 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac4003520 con 0x7f2adc0b3e80 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.029+0000 7f2ae0c4b640 1 -- 172.21.15.6:0/1635748950 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3319600486 0 0) 0x7f2ac4003520 con 0x7f2adc0b3e80 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.029+0000 7f2ae1c4d640 1 -- 172.21.15.6:0/1635748950 >> v2:172.21.15.171:3300/0 conn(0x7f2adc06dae0 msgr2=0x7f2adc0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.029+0000 7f2ae1c4d640 1 --2- 172.21.15.6:0/1635748950 >> v2:172.21.15.171:3300/0 conn(0x7f2adc06dae0 0x7f2adc0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.029+0000 7f2ae1c4d640 1 -- 172.21.15.6:0/1635748950 >> v1:172.21.15.6:6789/0 conn(0x7f2adc0b3e80 legacy=0x7f2adc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.029+0000 7f2ae1c4d640 1 -- 172.21.15.6:0/1635748950 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc0d3f80 con 0x7f2adc162820 2024-05-20T18:02:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.029+0000 7f2ae244e640 1 --2- 172.21.15.6:0/1635748950 >> v2:172.21.15.171:3300/0 conn(0x7f2adc06dae0 0x7f2adc0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:08.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.030+0000 7f2ae1c4d640 1 --2- 172.21.15.6:0/1635748950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc162820 0x7f2adc0b3940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40097a0 tx=0x7f2ad402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9bd9d5bf859006e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.030+0000 7f2ae0c4b640 1 -- 172.21.15.6:0/1635748950 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4037070 con 0x7f2adc162820 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.030+0000 7f2ae0c4b640 1 -- 172.21.15.6:0/1635748950 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad402aba0 con 0x7f2adc162820 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.030+0000 7f2ae0c4b640 1 -- 172.21.15.6:0/1635748950 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0001670 con 0x7f2adc162820 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.031+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/1635748950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc162820 msgr2=0x7f2adc0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.031+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/1635748950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc162820 0x7f2adc0b3940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40097a0 tx=0x7f2ad402a110 comp rx=0 tx=0).stop 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.031+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/1635748950 shutdown_connections 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.031+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/1635748950 >> v2:172.21.15.171:3300/0 conn(0x7f2adc06dae0 0x7f2adc0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.031+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/1635748950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc162820 0x7f2adc0b3940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.031+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/1635748950 >> 172.21.15.6:0/1635748950 conn(0x7f2adc0d4bd0 msgr2=0x7f2adc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.031+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/1635748950 shutdown_connections 2024-05-20T18:02:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.031+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/1635748950 wait complete. 2024-05-20T18:02:08.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.032+0000 7f2ae3eb1640 1 Processor -- start 2024-05-20T18:02:08.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.033+0000 7f2ae3eb1640 1 -- start start 2024-05-20T18:02:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae3eb1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc0b3e80 0x7f2adc156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae3eb1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc162820 0x7f2adc0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae3eb1640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0cb150 0x7f2adc0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae3eb1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc0d4780 con 0x7f2adc162820 2024-05-20T18:02:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae3eb1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc0d0300 con 0x7f2adc0b3e80 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae3eb1640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2adc0d4900 con 0x7f2adc0cb150 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc162820 0x7f2adc0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc162820 0x7f2adc0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55628/0 (socket says 172.21.15.6:55628) 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 -- 172.21.15.6:0/2858122310 learned_addr learned my addr 172.21.15.6:0/2858122310 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae1c4d640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc0b3e80 0x7f2adc156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae244e640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0cb150 0x7f2adc0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 -- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0cb150 msgr2=0x7f2adc0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0cb150 0x7f2adc0cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 -- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc0b3e80 msgr2=0x7f2adc156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc0b3e80 0x7f2adc156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 -- 172.21.15.6:0/2858122310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc0cb560 con 0x7f2adc162820 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae1c4d640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc0b3e80 0x7f2adc156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae244e640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0cb150 0x7f2adc0cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.034+0000 7f2ae144c640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc162820 0x7f2adc0cac10 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c700 tx=0x7f2ad000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.035+0000 7f2ada7fc640 1 -- 172.21.15.6:0/2858122310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0017070 con 0x7f2adc162820 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.035+0000 7f2ada7fc640 1 -- 172.21.15.6:0/2858122310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad0005ad0 con 0x7f2adc162820 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.035+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2adc0b5600 con 0x7f2adc162820 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.035+0000 7f2ada7fc640 1 -- 172.21.15.6:0/2858122310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0007070 con 0x7f2adc162820 2024-05-20T18:02:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.035+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2adc0b5bc0 con 0x7f2adc162820 2024-05-20T18:02:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.036+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2adc162430 con 0x7f2adc162820 2024-05-20T18:02:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.036+0000 7f2ada7fc640 1 -- 172.21.15.6:0/2858122310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ad001a070 con 0x7f2adc162820 2024-05-20T18:02:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.037+0000 7f2ada7fc640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ac806be60 0x7f2ac806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.037+0000 7f2ada7fc640 1 -- 172.21.15.6:0/2858122310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5249+0+0 (secure 0 0 0) 0x7f2ad008a030 con 0x7f2adc162820 2024-05-20T18:02:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.037+0000 7f2ae1c4d640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ac806be60 0x7f2ac806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.038+0000 7f2ae1c4d640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ac806be60 0x7f2ac806e370 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4034000 tx=0x7f2ad402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.041+0000 7f2ada7fc640 1 -- 172.21.15.6:0/2858122310 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2adc162430 con 0x7f2adc162820 2024-05-20T18:02:08.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.295+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2adc075b00 con 0x7f2adc162820 2024-05-20T18:02:08.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.295+0000 7f2ada7fc640 1 -- 172.21.15.6:0/2858122310 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f2adc0cb560 con 0x7f2adc162820 2024-05-20T18:02:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T18:02:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T18:02:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T18:02:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T18:02:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T18:02:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T18:02:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:02:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:02:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T18:02:08.307 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:02:08.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ac806be60 msgr2=0x7f2ac806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ac806be60 0x7f2ac806e370 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4034000 tx=0x7f2ad402e000 comp rx=0 tx=0).stop 2024-05-20T18:02:08.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc162820 msgr2=0x7f2adc0cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc162820 0x7f2adc0cac10 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c700 tx=0x7f2ad000cbc0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 shutdown_connections 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2ac806be60 0x7f2ac806e370 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0cb150 0x7f2adc0cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc162820 0x7f2adc0cac10 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 --2- 172.21.15.6:0/2858122310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc0b3e80 0x7f2adc156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 >> 172.21.15.6:0/2858122310 conn(0x7f2adc0d4bd0 msgr2=0x7f2adc15e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 shutdown_connections 2024-05-20T18:02:08.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.297+0000 7f2ae3eb1640 1 -- 172.21.15.6:0/2858122310 wait complete. 2024-05-20T18:02:08.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.426+0000 7f36f418f640 1 Processor -- start 2024-05-20T18:02:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.427+0000 7f36f418f640 1 -- start start 2024-05-20T18:02:08.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.428+0000 7f36f418f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36ec0ce7e0 0x7f36ec0cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.428+0000 7f36f418f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ec0cf130 con 0x7f36ec0cf3d0 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.428+0000 7f36f418f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ec0cda20 con 0x7f36ec15f220 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.428+0000 7f36f418f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f36ec0cdd00 con 0x7f36ec0ce7e0 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.428+0000 7f36f272c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36ec0ce7e0 0x7f36ec0cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.428+0000 7f36f172a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f36ec0cf3d0 0x7f36ec0cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46602/0 (socket says 172.21.15.6:46602) 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.428+0000 7f36f172a640 1 -- 172.21.15.6:0/2877301472 learned_addr learned my addr 172.21.15.6:0/2877301472 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.429+0000 7f36f272c640 1 -- 172.21.15.6:0/2877301472 >> v1:172.21.15.171:6789/0 conn(0x7f36ec15f220 legacy=0x7f36ec0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.429+0000 7f36f272c640 1 -- 172.21.15.6:0/2877301472 >> v1:172.21.15.6:6789/0 conn(0x7f36ec0cf3d0 legacy=0x7f36ec0cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.429+0000 7f36f0f29640 1 -- 172.21.15.6:0/2877301472 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333713913 0 0) 0x7f36ec0cf130 con 0x7f36ec0cf3d0 2024-05-20T18:02:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.429+0000 7f36f272c640 1 -- 172.21.15.6:0/2877301472 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec0cdfe0 con 0x7f36ec0ce7e0 2024-05-20T18:02:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.429+0000 7f36f272c640 1 --2- 172.21.15.6:0/2877301472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec0ce7e0 0x7f36ec0cebf0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f36e40097a0 tx=0x7f36e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf83d781d37d345 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f0f29640 1 -- 172.21.15.6:0/2877301472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e4037070 con 0x7f36ec0ce7e0 2024-05-20T18:02:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f0f29640 1 -- 172.21.15.6:0/2877301472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e4032440 con 0x7f36ec0ce7e0 2024-05-20T18:02:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f0f29640 1 -- 172.21.15.6:0/2877301472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e4032810 con 0x7f36ec0ce7e0 2024-05-20T18:02:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f418f640 1 -- 172.21.15.6:0/2877301472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec0ce7e0 msgr2=0x7f36ec0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f418f640 1 --2- 172.21.15.6:0/2877301472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec0ce7e0 0x7f36ec0cebf0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f36e40097a0 tx=0x7f36e402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f418f640 1 -- 172.21.15.6:0/2877301472 shutdown_connections 2024-05-20T18:02:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f418f640 1 --2- 172.21.15.6:0/2877301472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec0ce7e0 0x7f36ec0cebf0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f418f640 1 -- 172.21.15.6:0/2877301472 >> 172.21.15.6:0/2877301472 conn(0x7f36ec0b44d0 msgr2=0x7f36ec0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f418f640 1 -- 172.21.15.6:0/2877301472 shutdown_connections 2024-05-20T18:02:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.430+0000 7f36f418f640 1 -- 172.21.15.6:0/2877301472 wait complete. 2024-05-20T18:02:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.432+0000 7f36f418f640 1 Processor -- start 2024-05-20T18:02:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.432+0000 7f36f418f640 1 -- start start 2024-05-20T18:02:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.433+0000 7f36f418f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36ec0ce7e0 0x7f36ec152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.433+0000 7f36f418f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36ec0cf3d0 0x7f36ec1e9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.433+0000 7f36f418f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec15f220 0x7f36ec1e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.433+0000 7f36f418f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec0cd680 con 0x7f36ec15f220 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.433+0000 7f36f418f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec0d0fd0 con 0x7f36ec0cf3d0 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.433+0000 7f36f418f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36ec0cd800 con 0x7f36ec0ce7e0 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec15f220 0x7f36ec1e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec15f220 0x7f36ec1e9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55652/0 (socket says 172.21.15.6:55652) 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 -- 172.21.15.6:0/578041273 learned_addr learned my addr 172.21.15.6:0/578041273 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f172a640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36ec0cf3d0 0x7f36ec1e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f1f2b640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36ec0ce7e0 0x7f36ec152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 -- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36ec0ce7e0 msgr2=0x7f36ec152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36ec0ce7e0 0x7f36ec152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 -- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36ec0cf3d0 msgr2=0x7f36ec1e9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36ec0cf3d0 0x7f36ec1e9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 -- 172.21.15.6:0/578041273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec0c72a0 con 0x7f36ec15f220 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f172a640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36ec0cf3d0 0x7f36ec1e9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f1f2b640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36ec0ce7e0 0x7f36ec152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f272c640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec15f220 0x7f36ec1e9ea0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f36e40097a0 tx=0x7f36e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36e27fc640 1 -- 172.21.15.6:0/578041273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e4037040 con 0x7f36ec15f220 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36e27fc640 1 -- 172.21.15.6:0/578041273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e4004230 con 0x7f36ec15f220 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec0c7580 con 0x7f36ec15f220 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36e27fc640 1 -- 172.21.15.6:0/578041273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e4032e20 con 0x7f36ec15f220 2024-05-20T18:02:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.434+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec0c90e0 con 0x7f36ec15f220 2024-05-20T18:02:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.436+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ec0c7000 con 0x7f36ec15f220 2024-05-20T18:02:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.436+0000 7f36e27fc640 1 -- 172.21.15.6:0/578041273 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36e4030770 con 0x7f36ec15f220 2024-05-20T18:02:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.437+0000 7f36e27fc640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36d006be30 0x7f36d006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.437+0000 7f36e27fc640 1 -- 172.21.15.6:0/578041273 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5249+0+0 (secure 0 0 0) 0x7f36e40abe40 con 0x7f36ec15f220 2024-05-20T18:02:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.437+0000 7f36f1f2b640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36d006be30 0x7f36d006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.437+0000 7f36f1f2b640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36d006be30 0x7f36d006e340 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f36e80012e0 tx=0x7f36e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.441+0000 7f36e27fc640 1 -- 172.21.15.6:0/578041273 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f36e404c070 con 0x7f36ec15f220 2024-05-20T18:02:08.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.629+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36ec075b00 con 0x7f36ec15f220 2024-05-20T18:02:08.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.630+0000 7f36e27fc640 1 -- 172.21.15.6:0/578041273 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+13126 (secure 0 0 0) 0x7f36e407a920 con 0x7f36ec15f220 2024-05-20T18:02:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:08.628 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":133,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:07.887144+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:08.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36d006be30 msgr2=0x7f36d006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36d006be30 0x7f36d006e340 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f36e80012e0 tx=0x7f36e8009040 comp rx=0 tx=0).stop 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec15f220 msgr2=0x7f36ec1e9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec15f220 0x7f36ec1e9ea0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f36e40097a0 tx=0x7f36e40046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 shutdown_connections 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f36d006be30 0x7f36d006e340 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ec15f220 0x7f36ec1e9ea0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36ec0cf3d0 0x7f36ec1e9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 --2- 172.21.15.6:0/578041273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36ec0ce7e0 0x7f36ec152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 >> 172.21.15.6:0/578041273 conn(0x7f36ec0b44d0 msgr2=0x7f36ec0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 shutdown_connections 2024-05-20T18:02:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.632+0000 7f36f418f640 1 -- 172.21.15.6:0/578041273 wait complete. 2024-05-20T18:02:08.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:02:08.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:02:08.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.761+0000 7ffbf5051640 1 Processor -- start 2024-05-20T18:02:08.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.762+0000 7ffbf5051640 1 -- start start 2024-05-20T18:02:08.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbf5051640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffbf006d3d0 0x7ffbf006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbf5051640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbf006dd20 con 0x7ffbf0162820 2024-05-20T18:02:08.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbf5051640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbf00d0630 con 0x7ffbf00b8190 2024-05-20T18:02:08.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbf5051640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf00d39c0 con 0x7ffbf006d3d0 2024-05-20T18:02:08.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbeed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffbf0162820 0x7ffbf00b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46610/0 (socket says 172.21.15.6:46610) 2024-05-20T18:02:08.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbeed9d640 1 -- 172.21.15.6:0/4094868740 learned_addr learned my addr 172.21.15.6:0/4094868740 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:08.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbee59c640 1 --2- 172.21.15.6:0/4094868740 >> v2:172.21.15.171:3300/0 conn(0x7ffbf006d3d0 0x7ffbf006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662744576 0 0) 0x7ffbe0001110 con 0x7ffbf0162820 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.763+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd8003520 con 0x7ffbf0162820 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1249429360 0 0) 0x7ffbd8003520 con 0x7ffbf0162820 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 >> v2:172.21.15.171:3300/0 conn(0x7ffbf006d3d0 msgr2=0x7ffbf006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 --2- 172.21.15.6:0/4094868740 >> v2:172.21.15.171:3300/0 conn(0x7ffbf006d3d0 0x7ffbf006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 >> v1:172.21.15.171:6789/0 conn(0x7ffbf00b8190 legacy=0x7ffbf00b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf00d3ca0 con 0x7ffbf0162820 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ffbe0001840 con 0x7ffbf0162820 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 >> v1:172.21.15.6:6789/0 conn(0x7ffbf0162820 legacy=0x7ffbf00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbd80039b0 0x7ffbd8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd8004800 0x7ffbd8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80051c0 0x7ffbd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf00d39c0 con 0x7ffbd80039b0 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd800c160 con 0x7ffbd80051c0 2024-05-20T18:02:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd800c360 con 0x7ffbd8004800 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbeed9d640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbd80039b0 0x7ffbd8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbee59c640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd8004800 0x7ffbd8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbef59e640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80051c0 0x7ffbd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbeed9d640 1 -- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd8004800 msgr2=0x7ffbd8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbeed9d640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbd8004800 0x7ffbd8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbeed9d640 1 -- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80051c0 msgr2=0x7ffbd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbeed9d640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80051c0 0x7ffbd800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbeed9d640 1 -- 172.21.15.6:0/4094868740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd8003520 con 0x7ffbd80039b0 2024-05-20T18:02:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbef59e640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80051c0 0x7ffbd800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.764+0000 7ffbef59e640 1 -- 172.21.15.6:0/4094868740 reap_dead start 2024-05-20T18:02:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.765+0000 7ffbeed9d640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbd80039b0 0x7ffbd8003e20 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000c4c0 tx=0x7ffbd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4ea421eaba923f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.765+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0036070 con 0x7ffbd80039b0 2024-05-20T18:02:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.765+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe0005af0 con 0x7ffbd80039b0 2024-05-20T18:02:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.765+0000 7ffbedd9b640 1 -- 172.21.15.6:0/4094868740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe000c0e0 con 0x7ffbd80039b0 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.766+0000 7ffbf5051640 1 -- 172.21.15.6:0/4094868740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbd80039b0 msgr2=0x7ffbd8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.766+0000 7ffbf5051640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbd80039b0 0x7ffbd8003e20 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000c4c0 tx=0x7ffbd8005830 comp rx=0 tx=0).stop 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.766+0000 7ffbf5051640 1 -- 172.21.15.6:0/4094868740 shutdown_connections 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.766+0000 7ffbf5051640 1 --2- 172.21.15.6:0/4094868740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbd80039b0 0x7ffbd8003e20 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.766+0000 7ffbf5051640 1 -- 172.21.15.6:0/4094868740 >> 172.21.15.6:0/4094868740 conn(0x7ffbf00d4bd0 msgr2=0x7ffbf00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.766+0000 7ffbf5051640 1 -- 172.21.15.6:0/4094868740 shutdown_connections 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.766+0000 7ffbf5051640 1 -- 172.21.15.6:0/4094868740 wait complete. 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.768+0000 7ffbf5051640 1 Processor -- start 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.768+0000 7ffbf5051640 1 -- start start 2024-05-20T18:02:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbf5051640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80039b0 0x7ffbf00b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbf5051640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbf01560c0 0x7ffbf00ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbf5051640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbf0160fd0 0x7ffbf01613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbf5051640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf00d0300 con 0x7ffbf0160fd0 2024-05-20T18:02:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbf5051640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf00d4260 con 0x7ffbd80039b0 2024-05-20T18:02:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbf5051640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf00d4780 con 0x7ffbf01560c0 2024-05-20T18:02:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbef59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbf0160fd0 0x7ffbf01613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbef59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbf0160fd0 0x7ffbf01613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55662/0 (socket says 172.21.15.6:55662) 2024-05-20T18:02:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.769+0000 7ffbef59e640 1 -- 172.21.15.6:0/2936155134 learned_addr learned my addr 172.21.15.6:0/2936155134 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbee59c640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbf01560c0 0x7ffbf00ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbeed9d640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80039b0 0x7ffbf00b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbef59e640 1 -- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbf01560c0 msgr2=0x7ffbf00ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbef59e640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbf01560c0 0x7ffbf00ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbef59e640 1 -- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80039b0 msgr2=0x7ffbf00b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbef59e640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80039b0 0x7ffbf00b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbef59e640 1 -- 172.21.15.6:0/2936155134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf0158210 con 0x7ffbf0160fd0 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbeed9d640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80039b0 0x7ffbf00b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbef59e640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbf0160fd0 0x7ffbf01613e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7ffbf008d5e0 tx=0x7ffbe800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbd77fe640 1 -- 172.21.15.6:0/2936155134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8003970 con 0x7ffbf0160fd0 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbd77fe640 1 -- 172.21.15.6:0/2936155134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe8018070 con 0x7ffbf0160fd0 2024-05-20T18:02:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbd77fe640 1 -- 172.21.15.6:0/2936155134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8003d50 con 0x7ffbf0160fd0 2024-05-20T18:02:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf0161920 con 0x7ffbf0160fd0 2024-05-20T18:02:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.770+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf015c640 con 0x7ffbf0160fd0 2024-05-20T18:02:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.771+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf0157f80 con 0x7ffbf0160fd0 2024-05-20T18:02:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.772+0000 7ffbd77fe640 1 -- 172.21.15.6:0/2936155134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbe80050d0 con 0x7ffbf0160fd0 2024-05-20T18:02:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.772+0000 7ffbd77fe640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffbdc06be30 0x7ffbdc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.772+0000 7ffbd77fe640 1 -- 172.21.15.6:0/2936155134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5249+0+0 (secure 0 0 0) 0x7ffbe808a8e0 con 0x7ffbf0160fd0 2024-05-20T18:02:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.772+0000 7ffbeed9d640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffbdc06be30 0x7ffbdc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.773+0000 7ffbeed9d640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffbdc06be30 0x7ffbdc06e340 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0033000 tx=0x7ffbe0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.777+0000 7ffbd77fe640 1 -- 172.21.15.6:0/2936155134 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffbf0161920 con 0x7ffbf0160fd0 2024-05-20T18:02:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.959+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffbf006e3f0 con 0x7ffbf0160fd0 2024-05-20T18:02:08.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.959+0000 7ffbd77fe640 1 -- 172.21.15.6:0/2936155134 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) ==== 93+0+10 (secure 0 0 0) 0x7ffbf0158210 con 0x7ffbf0160fd0 2024-05-20T18:02:08.957 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:02:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffbdc06be30 msgr2=0x7ffbdc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffbdc06be30 0x7ffbdc06e340 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0033000 tx=0x7ffbe0009030 comp rx=0 tx=0).stop 2024-05-20T18:02:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbf0160fd0 msgr2=0x7ffbf01613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbf0160fd0 0x7ffbf01613e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7ffbf008d5e0 tx=0x7ffbe800eb90 comp rx=0 tx=0).stop 2024-05-20T18:02:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 shutdown_connections 2024-05-20T18:02:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffbdc06be30 0x7ffbdc06e340 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffbf0160fd0 0x7ffbf01613e0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbf01560c0 0x7ffbf00ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 --2- 172.21.15.6:0/2936155134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd80039b0 0x7ffbf00b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 >> 172.21.15.6:0/2936155134 conn(0x7ffbf00d4bd0 msgr2=0x7ffbf00b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 shutdown_connections 2024-05-20T18:02:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:08.961+0000 7ffbf5051640 1 -- 172.21.15.6:0/2936155134 wait complete. 2024-05-20T18:02:08.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T18:02:09.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.088+0000 7fccd5d38640 1 Processor -- start 2024-05-20T18:02:09.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.088+0000 7fccd5d38640 1 -- start start 2024-05-20T18:02:09.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fccd5d38640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fccd006d3d0 0x7fccd006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fccd5d38640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fccd00b8190 0x7fccd00b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fccd5d38640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd006dd20 con 0x7fccd0162820 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fccd5d38640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fccd00d0630 con 0x7fccd00b8190 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fccd5d38640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fccd00d39c0 con 0x7fccd006d3d0 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fcccffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fccd00b8190 0x7fccd00b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fcccffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fccd00b8190 0x7fccd00b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55678/0 (socket says 172.21.15.6:55678) 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fcccffff640 1 -- 172.21.15.6:0/1864923582 learned_addr learned my addr 172.21.15.6:0/1864923582 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fccceffd640 1 --2- 172.21.15.6:0/1864923582 >> v2:172.21.15.171:3300/0 conn(0x7fccd006d3d0 0x7fccd006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fcccffff640 1 -- 172.21.15.6:0/1864923582 >> v2:172.21.15.171:3300/0 conn(0x7fccd006d3d0 msgr2=0x7fccd006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fcccffff640 1 --2- 172.21.15.6:0/1864923582 >> v2:172.21.15.171:3300/0 conn(0x7fccd006d3d0 0x7fccd006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fcccffff640 1 -- 172.21.15.6:0/1864923582 >> v1:172.21.15.171:6789/0 conn(0x7fccd0162820 legacy=0x7fccd00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:09.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.089+0000 7fcccffff640 1 -- 172.21.15.6:0/1864923582 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd00d3ca0 con 0x7fccd00b8190 2024-05-20T18:02:09.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.090+0000 7fcccffff640 1 --2- 172.21.15.6:0/1864923582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd00b85a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fccd00d1230 tx=0x7fccc802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1e38e3b5dcf5bb server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:09.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.090+0000 7fccce7fc640 1 -- 172.21.15.6:0/1864923582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8036070 con 0x7fccd00b8190 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.090+0000 7fccce7fc640 1 -- 172.21.15.6:0/1864923582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc8031600 con 0x7fccd00b8190 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.090+0000 7fccce7fc640 1 -- 172.21.15.6:0/1864923582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc80319d0 con 0x7fccd00b8190 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.091+0000 7fccd5d38640 1 -- 172.21.15.6:0/1864923582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 msgr2=0x7fccd00b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.091+0000 7fccd5d38640 1 --2- 172.21.15.6:0/1864923582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd00b85a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fccd00d1230 tx=0x7fccc802a6f0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.091+0000 7fccd5d38640 1 -- 172.21.15.6:0/1864923582 shutdown_connections 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.091+0000 7fccd5d38640 1 --2- 172.21.15.6:0/1864923582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd00b85a0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.091+0000 7fccd5d38640 1 --2- 172.21.15.6:0/1864923582 >> v2:172.21.15.171:3300/0 conn(0x7fccd006d3d0 0x7fccd006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.091+0000 7fccd5d38640 1 -- 172.21.15.6:0/1864923582 >> 172.21.15.6:0/1864923582 conn(0x7fccd00d4bd0 msgr2=0x7fccd00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.091+0000 7fccd5d38640 1 -- 172.21.15.6:0/1864923582 shutdown_connections 2024-05-20T18:02:09.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.091+0000 7fccd5d38640 1 -- 172.21.15.6:0/1864923582 wait complete. 2024-05-20T18:02:09.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.093+0000 7fccd5d38640 1 Processor -- start 2024-05-20T18:02:09.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.093+0000 7fccd5d38640 1 -- start start 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.094+0000 7fccd5d38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccd006d3d0 0x7fccd014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.094+0000 7fccd5d38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd01e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.094+0000 7fccd5d38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccd0162820 0x7fccd01e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.094+0000 7fccd5d38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fccd00d0300 con 0x7fccd00b8190 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.094+0000 7fccd5d38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fccd00d4260 con 0x7fccd0162820 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.094+0000 7fccd5d38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fccd00b4050 con 0x7fccd006d3d0 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd01e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd01e8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55680/0 (socket says 172.21.15.6:55680) 2024-05-20T18:02:09.094 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 -- 172.21.15.6:0/3200120534 learned_addr learned my addr 172.21.15.6:0/3200120534 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fcccffff640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccd0162820 0x7fccd01e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fcccf7fe640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccd006d3d0 0x7fccd014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 -- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccd006d3d0 msgr2=0x7fccd014dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccd006d3d0 0x7fccd014dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 -- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccd0162820 msgr2=0x7fccd01e90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccd0162820 0x7fccd01e90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 -- 172.21.15.6:0/3200120534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd01e7ae0 con 0x7fccd00b8190 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fcccffff640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccd0162820 0x7fccd01e90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccceffd640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd01e8b80 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fccc400d650 tx=0x7fccc400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccb7fff640 1 -- 172.21.15.6:0/3200120534 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc400b660 con 0x7fccd00b8190 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccb7fff640 1 -- 172.21.15.6:0/3200120534 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc4019070 con 0x7fccd00b8190 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd01e7dc0 con 0x7fccd00b8190 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccb7fff640 1 -- 172.21.15.6:0/3200120534 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc400ba40 con 0x7fccd00b8190 2024-05-20T18:02:09.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.095+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd01e8380 con 0x7fccd00b8190 2024-05-20T18:02:09.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.097+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd0075b00 con 0x7fccd00b8190 2024-05-20T18:02:09.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.097+0000 7fccb7fff640 1 -- 172.21.15.6:0/3200120534 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccc400bbe0 con 0x7fccd00b8190 2024-05-20T18:02:09.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.098+0000 7fccb7fff640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccbc06be30 0x7fccbc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.098+0000 7fccb7fff640 1 -- 172.21.15.6:0/3200120534 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5249+0+0 (secure 0 0 0) 0x7fccc408b0e0 con 0x7fccd00b8190 2024-05-20T18:02:09.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.098+0000 7fcccf7fe640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccbc06be30 0x7fccbc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.098+0000 7fcccf7fe640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccbc06be30 0x7fccbc06e340 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fccc0006fd0 tx=0x7fccc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:09.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.102+0000 7fccb7fff640 1 -- 172.21.15.6:0/3200120534 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fccc4059bc0 con 0x7fccd00b8190 2024-05-20T18:02:09.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.288+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fccd00d1230 con 0x7fccd00b8190 2024-05-20T18:02:09.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.288+0000 7fccb7fff640 1 -- 172.21.15.6:0/3200120534 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v133) ==== 84+0+65 (secure 0 0 0) 0x7fccc40594c0 con 0x7fccd00b8190 2024-05-20T18:02:09.287 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:09.287 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T18:02:09.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:09.287 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T18:02:09.287 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T18:02:09.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:09.287 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccbc06be30 msgr2=0x7fccbc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccbc06be30 0x7fccbc06e340 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fccc0006fd0 tx=0x7fccc0008040 comp rx=0 tx=0).stop 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 msgr2=0x7fccd01e8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd01e8b80 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fccc400d650 tx=0x7fccc400db10 comp rx=0 tx=0).stop 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 shutdown_connections 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fccbc06be30 0x7fccbc06e340 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fccd0162820 0x7fccd01e90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00b8190 0x7fccd01e8b80 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 --2- 172.21.15.6:0/3200120534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fccd006d3d0 0x7fccd014dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 >> 172.21.15.6:0/3200120534 conn(0x7fccd00d4bd0 msgr2=0x7fccd015e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.290+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 shutdown_connections 2024-05-20T18:02:09.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.291+0000 7fccd5d38640 1 -- 172.21.15.6:0/3200120534 wait complete. 2024-05-20T18:02:09.300 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T18:02:09.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T18:02:09.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.420+0000 7f565d656640 1 Processor -- start 2024-05-20T18:02:09.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.420+0000 7f565d656640 1 -- start start 2024-05-20T18:02:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f565d656640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580d45f0 0x7f565806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f565d656640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f565808bd20 0x7f565808c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f565d656640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565808c670 con 0x7f56580b3860 2024-05-20T18:02:09.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f565d656640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f56580d0450 con 0x7f565808bd20 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f565d656640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56580d3b10 con 0x7f56580d45f0 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f56577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f565808bd20 0x7f565808c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f56577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f565808bd20 0x7f565808c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55682/0 (socket says 172.21.15.6:55682) 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f56577fe640 1 -- 172.21.15.6:0/179221112 learned_addr learned my addr 172.21.15.6:0/179221112 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f56567fc640 1 --2- 172.21.15.6:0/179221112 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580d45f0 0x7f565806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f56577fe640 1 -- 172.21.15.6:0/179221112 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580d45f0 msgr2=0x7f565806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f56577fe640 1 --2- 172.21.15.6:0/179221112 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580d45f0 0x7f565806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f56577fe640 1 -- 172.21.15.6:0/179221112 >> v1:172.21.15.171:6789/0 conn(0x7f56580b3860 legacy=0x7f565815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.422+0000 7f56577fe640 1 -- 172.21.15.6:0/179221112 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56580d3df0 con 0x7f565808bd20 2024-05-20T18:02:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.423+0000 7f56577fe640 1 --2- 172.21.15.6:0/179221112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565808c130 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e50 tx=0x7f565002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd13949d2cb85d2a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:09.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.423+0000 7f5655ffb640 1 -- 172.21.15.6:0/179221112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650036070 con 0x7f565808bd20 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.423+0000 7f5655ffb640 1 -- 172.21.15.6:0/179221112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5650031600 con 0x7f565808bd20 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.423+0000 7f5655ffb640 1 -- 172.21.15.6:0/179221112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500319d0 con 0x7f565808bd20 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.424+0000 7f565d656640 1 -- 172.21.15.6:0/179221112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 msgr2=0x7f565808c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.424+0000 7f565d656640 1 --2- 172.21.15.6:0/179221112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565808c130 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e50 tx=0x7f565002a5f0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.424+0000 7f565d656640 1 -- 172.21.15.6:0/179221112 shutdown_connections 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.424+0000 7f565d656640 1 --2- 172.21.15.6:0/179221112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565808c130 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.424+0000 7f565d656640 1 --2- 172.21.15.6:0/179221112 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580d45f0 0x7f565806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.424+0000 7f565d656640 1 -- 172.21.15.6:0/179221112 >> 172.21.15.6:0/179221112 conn(0x7f56580b6d10 msgr2=0x7f565806d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.424+0000 7f565d656640 1 -- 172.21.15.6:0/179221112 shutdown_connections 2024-05-20T18:02:09.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.424+0000 7f565d656640 1 -- 172.21.15.6:0/179221112 wait complete. 2024-05-20T18:02:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.426+0000 7f565d656640 1 Processor -- start 2024-05-20T18:02:09.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.426+0000 7f565d656640 1 -- start start 2024-05-20T18:02:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f565d656640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f565d656640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580b3860 0x7f56581e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f565d656640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56580d45f0 0x7f56581e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f565d656640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f56580b81b0 con 0x7f565808bd20 2024-05-20T18:02:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f565d656640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f56580d0730 con 0x7f56580d45f0 2024-05-20T18:02:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f565d656640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f56580b8330 con 0x7f56580b3860 2024-05-20T18:02:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f5656ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f5656ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565815a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55688/0 (socket says 172.21.15.6:55688) 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.427+0000 7f5656ffd640 1 -- 172.21.15.6:0/1418718961 learned_addr learned my addr 172.21.15.6:0/1418718961 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f56567fc640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580b3860 0x7f56581e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f56577fe640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56580d45f0 0x7f56581e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f5656ffd640 1 -- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580b3860 msgr2=0x7f56581e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f5656ffd640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580b3860 0x7f56581e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f5656ffd640 1 -- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56580d45f0 msgr2=0x7f56581e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f5656ffd640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56580d45f0 0x7f56581e4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f5656ffd640 1 -- 172.21.15.6:0/1418718961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5658157e50 con 0x7f565808bd20 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f5656ffd640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565815a0c0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f564800c440 tx=0x7f564800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f563f7fe640 1 -- 172.21.15.6:0/1418718961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56480052d0 con 0x7f565808bd20 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f563f7fe640 1 -- 172.21.15.6:0/1418718961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5648005470 con 0x7f565808bd20 2024-05-20T18:02:09.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5658157920 con 0x7f565808bd20 2024-05-20T18:02:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f563f7fe640 1 -- 172.21.15.6:0/1418718961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648007260 con 0x7f565808bd20 2024-05-20T18:02:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.428+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56581e8200 con 0x7f565808bd20 2024-05-20T18:02:09.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.429+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56580b9a40 con 0x7f565808bd20 2024-05-20T18:02:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.430+0000 7f563f7fe640 1 -- 172.21.15.6:0/1418718961 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5648007400 con 0x7f565808bd20 2024-05-20T18:02:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.430+0000 7f563f7fe640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be30 0x7f564406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.430+0000 7f563f7fe640 1 -- 172.21.15.6:0/1418718961 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5249+0+0 (secure 0 0 0) 0x7f564808a0e0 con 0x7f565808bd20 2024-05-20T18:02:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.430+0000 7f56567fc640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be30 0x7f564406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:09.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.431+0000 7f56567fc640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be30 0x7f564406e340 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f565815c840 tx=0x7f564c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:09.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.435+0000 7f563f7fe640 1 -- 172.21.15.6:0/1418718961 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f56580b9a40 con 0x7f565808bd20 2024-05-20T18:02:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:09.619+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f56580690b0 con 0x7f565808bd20 2024-05-20T18:02:10.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.121+0000 7f563f7fe640 1 -- 172.21.15.6:0/1418718961 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v134) ==== 138+0+0 (secure 0 0 0) 0x7f565808c670 con 0x7f565808bd20 2024-05-20T18:02:10.120 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be30 msgr2=0x7f564406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be30 0x7f564406e340 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f565815c840 tx=0x7f564c009190 comp rx=0 tx=0).stop 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 msgr2=0x7f565815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565815a0c0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f564800c440 tx=0x7f564800c900 comp rx=0 tx=0).stop 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 shutdown_connections 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f564406be30 0x7f564406e340 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56580d45f0 0x7f56581e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f56580b3860 0x7f56581e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 --2- 172.21.15.6:0/1418718961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f565808bd20 0x7f565815a0c0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.124+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 >> 172.21.15.6:0/1418718961 conn(0x7f56580b6d10 msgr2=0x7f56580b9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:10.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.125+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 shutdown_connections 2024-05-20T18:02:10.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.125+0000 7f565d656640 1 -- 172.21.15.6:0/1418718961 wait complete. 2024-05-20T18:02:10.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T18:02:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.267+0000 7fbcb02de640 1 Processor -- start 2024-05-20T18:02:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.267+0000 7fbcb02de640 1 -- start start 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.268+0000 7fbcb02de640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbca80d2100 0x7fbca80b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.268+0000 7fbcb02de640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbca809bc40 0x7fbca809ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.268+0000 7fbcb02de640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca809b4c0 con 0x7fbca809b0b0 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.268+0000 7fbcb02de640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbca80d0e30 con 0x7fbca80d2100 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.268+0000 7fbcb02de640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbca80d1060 con 0x7fbca809bc40 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.268+0000 7fbcae07a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbca80d2100 0x7fbca80b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.268+0000 7fbcae87b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbca809b0b0 0x7fbca80cd010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46622/0 (socket says 172.21.15.6:46622) 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.268+0000 7fbcae87b640 1 -- 172.21.15.6:0/923851240 learned_addr learned my addr 172.21.15.6:0/923851240 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.269+0000 7fbcad879640 1 --2- 172.21.15.6:0/923851240 >> v2:172.21.15.171:3300/0 conn(0x7fbca809bc40 0x7fbca809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.269+0000 7fbcae07a640 1 -- 172.21.15.6:0/923851240 >> v2:172.21.15.171:3300/0 conn(0x7fbca809bc40 msgr2=0x7fbca809ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.269+0000 7fbcae07a640 1 --2- 172.21.15.6:0/923851240 >> v2:172.21.15.171:3300/0 conn(0x7fbca809bc40 0x7fbca809ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.269+0000 7fbcae07a640 1 -- 172.21.15.6:0/923851240 >> v1:172.21.15.6:6789/0 conn(0x7fbca809b0b0 legacy=0x7fbca80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.269+0000 7fbcae07a640 1 -- 172.21.15.6:0/923851240 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca80d1340 con 0x7fbca80d2100 2024-05-20T18:02:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.269+0000 7fbcad078640 1 -- 172.21.15.6:0/923851240 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542142262 0 0) 0x7fbca0001490 con 0x7fbca809b0b0 2024-05-20T18:02:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.270+0000 7fbcae07a640 1 --2- 172.21.15.6:0/923851240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca80b3e30 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fbca80a08a0 tx=0x7fbca402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d9064d54f63469 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.270+0000 7fbcad078640 1 -- 172.21.15.6:0/923851240 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4037070 con 0x7fbca80d2100 2024-05-20T18:02:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.270+0000 7fbcad078640 1 -- 172.21.15.6:0/923851240 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca4032440 con 0x7fbca80d2100 2024-05-20T18:02:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.270+0000 7fbcad078640 1 -- 172.21.15.6:0/923851240 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4032810 con 0x7fbca80d2100 2024-05-20T18:02:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.270+0000 7fbcb02de640 1 -- 172.21.15.6:0/923851240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 msgr2=0x7fbca80b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.270+0000 7fbcb02de640 1 --2- 172.21.15.6:0/923851240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca80b3e30 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fbca80a08a0 tx=0x7fbca402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.271+0000 7fbcb02de640 1 -- 172.21.15.6:0/923851240 shutdown_connections 2024-05-20T18:02:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.271+0000 7fbcb02de640 1 --2- 172.21.15.6:0/923851240 >> v2:172.21.15.171:3300/0 conn(0x7fbca809bc40 0x7fbca809ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.271+0000 7fbcb02de640 1 --2- 172.21.15.6:0/923851240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca80b3e30 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.271+0000 7fbcb02de640 1 -- 172.21.15.6:0/923851240 >> 172.21.15.6:0/923851240 conn(0x7fbca80b44b0 msgr2=0x7fbca80b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.271+0000 7fbcb02de640 1 -- 172.21.15.6:0/923851240 shutdown_connections 2024-05-20T18:02:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.271+0000 7fbcb02de640 1 -- 172.21.15.6:0/923851240 wait complete. 2024-05-20T18:02:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.272+0000 7fbcb02de640 1 Processor -- start 2024-05-20T18:02:10.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.272+0000 7fbcb02de640 1 -- start start 2024-05-20T18:02:10.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcb02de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbca809b0b0 0x7fbca8153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:10.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcb02de640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbca809bc40 0x7fbca81e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcb02de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca81eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcb02de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbca80d1be0 con 0x7fbca80d2100 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcb02de640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbca80d1900 con 0x7fbca809bc40 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcb02de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbca8163be0 con 0x7fbca809b0b0 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca81eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca81eaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55710/0 (socket says 172.21.15.6:55710) 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 -- 172.21.15.6:0/701902965 learned_addr learned my addr 172.21.15.6:0/701902965 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae07a640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbca809b0b0 0x7fbca8153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcad879640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbca809bc40 0x7fbca81e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 -- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbca809b0b0 msgr2=0x7fbca8153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbca809b0b0 0x7fbca8153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 -- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbca809bc40 msgr2=0x7fbca81e8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbca809bc40 0x7fbca81e8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 -- 172.21.15.6:0/701902965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca81e9680 con 0x7fbca80d2100 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.274+0000 7fbcae87b640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca81eaa00 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fbca000cb20 tx=0x7fbca0002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.275+0000 7fbc9affd640 1 -- 172.21.15.6:0/701902965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca000abd0 con 0x7fbca80d2100 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.275+0000 7fbc9affd640 1 -- 172.21.15.6:0/701902965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca000ad90 con 0x7fbca80d2100 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.275+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca81e9960 con 0x7fbca80d2100 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.275+0000 7fbc9affd640 1 -- 172.21.15.6:0/701902965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0012640 con 0x7fbca80d2100 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.275+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca81e9f20 con 0x7fbca80d2100 2024-05-20T18:02:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.275+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca80690b0 con 0x7fbca80d2100 2024-05-20T18:02:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.276+0000 7fbc9affd640 1 -- 172.21.15.6:0/701902965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbca00127e0 con 0x7fbca80d2100 2024-05-20T18:02:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.277+0000 7fbc9affd640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc8c06be60 0x7fbc8c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.277+0000 7fbc9affd640 1 -- 172.21.15.6:0/701902965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5619+0+0 (secure 0 0 0) 0x7fbca008b360 con 0x7fbca80d2100 2024-05-20T18:02:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.277+0000 7fbcae07a640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc8c06be60 0x7fbc8c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.278+0000 7fbcae07a640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc8c06be60 0x7fbc8c06e370 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbca4034000 tx=0x7fbca402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:10.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.282+0000 7fbc9affd640 1 -- 172.21.15.6:0/701902965 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbca809b4c0 con 0x7fbca80d2100 2024-05-20T18:02:10.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:10.466+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbca8154500 con 0x7fbca80d2100 2024-05-20T18:02:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.128+0000 7fbc9affd640 1 -- 172.21.15.6:0/701902965 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v135) ==== 170+0+0 (secure 0 0 0) 0x7fbca0059600 con 0x7fbca80d2100 2024-05-20T18:02:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T18:02:11.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc8c06be60 msgr2=0x7fbc8c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:11.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc8c06be60 0x7fbc8c06e370 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbca4034000 tx=0x7fbca402e000 comp rx=0 tx=0).stop 2024-05-20T18:02:11.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 msgr2=0x7fbca81eaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:11.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca81eaa00 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fbca000cb20 tx=0x7fbca0002160 comp rx=0 tx=0).stop 2024-05-20T18:02:11.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 shutdown_connections 2024-05-20T18:02:11.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbc8c06be60 0x7fbc8c06e370 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbca80d2100 0x7fbca81eaa00 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbca809bc40 0x7fbca81e8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 --2- 172.21.15.6:0/701902965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbca809b0b0 0x7fbca8153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 >> 172.21.15.6:0/701902965 conn(0x7fbca80b44b0 msgr2=0x7fbca815eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:11.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 shutdown_connections 2024-05-20T18:02:11.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.131+0000 7fbcb02de640 1 -- 172.21.15.6:0/701902965 wait complete. 2024-05-20T18:02:11.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T18:02:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.279+0000 7ff5348c3640 1 Processor -- start 2024-05-20T18:02:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.279+0000 7ff5348c3640 1 -- start start 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.281+0000 7ff5348c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff530162820 0x7ff5300b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.281+0000 7ff5348c3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5300d0630 con 0x7ff5300b3e80 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.281+0000 7ff5348c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5300d39c0 con 0x7ff53006dae0 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.281+0000 7ff5348c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5300d3ca0 con 0x7ff530162820 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.281+0000 7ff52dd9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff5300b3e80 0x7ff53006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46634/0 (socket says 172.21.15.6:46634) 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.281+0000 7ff52dd9b640 1 -- 172.21.15.6:0/1687164695 learned_addr learned my addr 172.21.15.6:0/1687164695 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52e59c640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff530162820 0x7ff5300b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428101634 0 0) 0x7ff5300d0630 con 0x7ff5300b3e80 2024-05-20T18:02:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff518003520 con 0x7ff5300b3e80 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3508223225 0 0) 0x7ff518003520 con 0x7ff5300b3e80 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff530162820 msgr2=0x7ff5300b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff530162820 0x7ff5300b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 >> v1:172.21.15.171:6789/0 conn(0x7ff53006dae0 legacy=0x7ff5300b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5300d3f80 con 0x7ff5300b3e80 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ff524001670 con 0x7ff5300b3e80 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 >> v1:172.21.15.6:6789/0 conn(0x7ff5300b3e80 legacy=0x7ff53006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5180039e0 0x7ff518003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff530162820 0x7ff518004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff518005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5300d3ca0 con 0x7ff518004d40 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff51800ba70 con 0x7ff5180039e0 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff51800bc70 con 0x7ff530162820 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52ed9d640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff518005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52e59c640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5180039e0 0x7ff518003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.282+0000 7ff52dd9b640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff530162820 0x7ff518004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52ed9d640 1 -- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff530162820 msgr2=0x7ff518004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52ed9d640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff530162820 0x7ff518004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52ed9d640 1 -- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5180039e0 msgr2=0x7ff518003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52ed9d640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5180039e0 0x7ff518003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52ed9d640 1 -- 172.21.15.6:0/1687164695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff518003520 con 0x7ff518004d40 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52e59c640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5180039e0 0x7ff518003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52ed9d640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff518005150 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff528001860 tx=0x7ff518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6b1940dae55368 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528037070 con 0x7ff518004d40 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52802ac30 con 0x7ff518004d40 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.283+0000 7ff52d59a640 1 -- 172.21.15.6:0/1687164695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528001430 con 0x7ff518004d40 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.284+0000 7ff5348c3640 1 -- 172.21.15.6:0/1687164695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 msgr2=0x7ff518005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.284+0000 7ff5348c3640 1 --2- 172.21.15.6:0/1687164695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff518004d40 0x7ff518005150 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff528001860 tx=0x7ff518005830 comp rx=0 tx=0).stop 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.284+0000 7ff52ed9d640 1 -- 172.21.15.6:0/1687164695 reap_dead start 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.284+0000 7ff5348c3640 1 -- 172.21.15.6:0/1687164695 shutdown_connections 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.284+0000 7ff5348c3640 1 -- 172.21.15.6:0/1687164695 >> 172.21.15.6:0/1687164695 conn(0x7ff5300d4bd0 msgr2=0x7ff5300d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.284+0000 7ff5348c3640 1 -- 172.21.15.6:0/1687164695 shutdown_connections 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.284+0000 7ff5348c3640 1 -- 172.21.15.6:0/1687164695 wait complete. 2024-05-20T18:02:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.286+0000 7ff5348c3640 1 Processor -- start 2024-05-20T18:02:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.286+0000 7ff5348c3640 1 -- start start 2024-05-20T18:02:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff5348c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff518004d40 0x7ff530154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff5348c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5300c8280 0x7ff5300ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff5348c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530154ef0 0x7ff5300ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff5348c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff5300d4780 con 0x7ff530154ef0 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff5348c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff5300d0300 con 0x7ff518004d40 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff5348c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff5300d4900 con 0x7ff5300c8280 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530154ef0 0x7ff5300ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530154ef0 0x7ff5300ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55730/0 (socket says 172.21.15.6:55730) 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 -- 172.21.15.6:0/3543136325 learned_addr learned my addr 172.21.15.6:0/3543136325 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52dd9b640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5300c8280 0x7ff5300ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52e59c640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff518004d40 0x7ff530154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 -- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5300c8280 msgr2=0x7ff5300ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5300c8280 0x7ff5300ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 -- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff518004d40 msgr2=0x7ff530154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff518004d40 0x7ff530154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 -- 172.21.15.6:0/3543136325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5300c89f0 con 0x7ff530154ef0 2024-05-20T18:02:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff52ed9d640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530154ef0 0x7ff5300ce6b0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7ff528001980 tx=0x7ff528001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.288+0000 7ff51effd640 1 -- 172.21.15.6:0/3543136325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528037040 con 0x7ff530154ef0 2024-05-20T18:02:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.289+0000 7ff51effd640 1 -- 172.21.15.6:0/3543136325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff528042070 con 0x7ff530154ef0 2024-05-20T18:02:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.289+0000 7ff51effd640 1 -- 172.21.15.6:0/3543136325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520009c10 con 0x7ff530154ef0 2024-05-20T18:02:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.289+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5300c8cd0 con 0x7ff530154ef0 2024-05-20T18:02:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.289+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5300c9290 con 0x7ff530154ef0 2024-05-20T18:02:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.290+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53015f8a0 con 0x7ff530154ef0 2024-05-20T18:02:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.291+0000 7ff51effd640 1 -- 172.21.15.6:0/3543136325 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff52803a070 con 0x7ff530154ef0 2024-05-20T18:02:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.291+0000 7ff51effd640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff51006be30 0x7ff51006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.291+0000 7ff51effd640 1 -- 172.21.15.6:0/3543136325 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 6001+0+0 (secure 0 0 0) 0x7ff5280aa6c0 con 0x7ff530154ef0 2024-05-20T18:02:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.291+0000 7ff52e59c640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff51006be30 0x7ff51006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.292+0000 7ff52e59c640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff51006be30 0x7ff51006e340 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff520009fd0 tx=0x7ff52000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.296+0000 7ff51effd640 1 -- 172.21.15.6:0/3543136325 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff53015f8a0 con 0x7ff530154ef0 2024-05-20T18:02:11.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:11.517+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff530075b00 con 0x7ff530154ef0 2024-05-20T18:02:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.130+0000 7ff51effd640 1 -- 172.21.15.6:0/3543136325 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v92) ==== 174+0+0 (secure 0 0 0) 0x7ff52804c020 con 0x7ff530154ef0 2024-05-20T18:02:12.128 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 21 and data pool 22 2024-05-20T18:02:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.135+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff51006be30 msgr2=0x7ff51006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.135+0000 7ff5348c3640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff51006be30 0x7ff51006e340 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff520009fd0 tx=0x7ff52000b040 comp rx=0 tx=0).stop 2024-05-20T18:02:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.135+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530154ef0 msgr2=0x7ff5300ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.135+0000 7ff5348c3640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530154ef0 0x7ff5300ce6b0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7ff528001980 tx=0x7ff528001230 comp rx=0 tx=0).stop 2024-05-20T18:02:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.137+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 shutdown_connections 2024-05-20T18:02:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.137+0000 7ff5348c3640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff51006be30 0x7ff51006e340 secure :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff520009fd0 tx=0x7ff52000b040 comp rx=0 tx=0).stop 2024-05-20T18:02:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.137+0000 7ff5348c3640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530154ef0 0x7ff5300ce6b0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.137+0000 7ff5348c3640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5300c8280 0x7ff5300ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.137+0000 7ff5348c3640 1 --2- 172.21.15.6:0/3543136325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff518004d40 0x7ff530154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.137+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 >> 172.21.15.6:0/3543136325 conn(0x7ff5300d4bd0 msgr2=0x7ff530161d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:12.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.150+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 shutdown_connections 2024-05-20T18:02:12.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.152+0000 7ff5348c3640 1 -- 172.21.15.6:0/3543136325 wait complete. 2024-05-20T18:02:12.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:12.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.294+0000 7f8f54dc3640 1 Processor -- start 2024-05-20T18:02:12.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.294+0000 7f8f54dc3640 1 -- start start 2024-05-20T18:02:12.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.295+0000 7f8f54dc3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8f500b2080 0x7f8f500d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.295+0000 7f8f54dc3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f50160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.295+0000 7f8f54dc3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f500d18d0 con 0x7f8f5015cf50 2024-05-20T18:02:12.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.295+0000 7f8f54dc3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8f500c9400 con 0x7f8f500b2080 2024-05-20T18:02:12.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.295+0000 7f8f54dc3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8f500c8f70 con 0x7f8f500d1230 2024-05-20T18:02:12.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4ed9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f50160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4dd9b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8f500b2080 0x7f8f500d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4ed9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f50160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:39788/0 (socket says 172.21.15.6:39788) 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4ed9d640 1 -- 172.21.15.6:0/4161905937 learned_addr learned my addr 172.21.15.6:0/4161905937 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4e59c640 1 --1- 172.21.15.6:0/4161905937 >> v1:172.21.15.171:6789/0 conn(0x7f8f5015cf50 0x7f8f500b1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:59296/0 (socket says 172.21.15.6:59296) 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4ed9d640 1 -- 172.21.15.6:0/4161905937 >> v2:172.21.15.171:3300/0 conn(0x7f8f500b2080 msgr2=0x7f8f500d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4ed9d640 1 --2- 172.21.15.6:0/4161905937 >> v2:172.21.15.171:3300/0 conn(0x7f8f500b2080 0x7f8f500d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4ed9d640 1 -- 172.21.15.6:0/4161905937 >> v1:172.21.15.171:6789/0 conn(0x7f8f5015cf50 legacy=0x7f8f500b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4ed9d640 1 -- 172.21.15.6:0/4161905937 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f500ccde0 con 0x7f8f500d1230 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4d59a640 1 -- 172.21.15.6:0/4161905937 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730976001 0 0) 0x7f8f48001490 con 0x7f8f5015cf50 2024-05-20T18:02:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.296+0000 7f8f4dd9b640 1 --2- 172.21.15.6:0/4161905937 >> v2:172.21.15.171:3300/0 conn(0x7f8f500b2080 0x7f8f500d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.297+0000 7f8f4ed9d640 1 --2- 172.21.15.6:0/4161905937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f50160b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009870 tx=0x7f8f4002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde6a64c6bc90e30 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.297+0000 7f8f4d59a640 1 -- 172.21.15.6:0/4161905937 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40037070 con 0x7f8f500d1230 2024-05-20T18:02:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.297+0000 7f8f4d59a640 1 -- 172.21.15.6:0/4161905937 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f40032440 con 0x7f8f500d1230 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.297+0000 7f8f4d59a640 1 -- 172.21.15.6:0/4161905937 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40032810 con 0x7f8f500d1230 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.298+0000 7f8f54dc3640 1 -- 172.21.15.6:0/4161905937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 msgr2=0x7f8f50160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.298+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/4161905937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f50160b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009870 tx=0x7f8f4002a1c0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.298+0000 7f8f54dc3640 1 -- 172.21.15.6:0/4161905937 shutdown_connections 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.298+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/4161905937 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f50160b20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.298+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/4161905937 >> v2:172.21.15.171:3300/0 conn(0x7f8f500b2080 0x7f8f500d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.298+0000 7f8f54dc3640 1 -- 172.21.15.6:0/4161905937 >> 172.21.15.6:0/4161905937 conn(0x7f8f5006f2b0 msgr2=0x7f8f500b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.298+0000 7f8f54dc3640 1 -- 172.21.15.6:0/4161905937 shutdown_connections 2024-05-20T18:02:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.298+0000 7f8f54dc3640 1 -- 172.21.15.6:0/4161905937 wait complete. 2024-05-20T18:02:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.300+0000 7f8f54dc3640 1 Processor -- start 2024-05-20T18:02:12.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.300+0000 7f8f54dc3640 1 -- start start 2024-05-20T18:02:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.301+0000 7f8f54dc3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f5006d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.301+0000 7f8f54dc3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f5015cf50 0x7f8f500b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.301+0000 7f8f54dc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f5006e410 0x7f8f500cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.301+0000 7f8f54dc3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8f500c8920 con 0x7f8f5006e410 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.301+0000 7f8f54dc3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8f500d1640 con 0x7f8f5015cf50 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.301+0000 7f8f54dc3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8f500c8c00 con 0x7f8f500d1230 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f5006e410 0x7f8f500cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f5006e410 0x7f8f500cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55746/0 (socket says 172.21.15.6:55746) 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 -- 172.21.15.6:0/630773182 learned_addr learned my addr 172.21.15.6:0/630773182 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4e59c640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f5006d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4dd9b640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f5015cf50 0x7f8f500b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 -- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 msgr2=0x7f8f5006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f5006d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 -- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f5015cf50 msgr2=0x7f8f500b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f5015cf50 0x7f8f500b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 -- 172.21.15.6:0/630773182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5015fa70 con 0x7f8f5006e410 2024-05-20T18:02:12.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4dd9b640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f5015cf50 0x7f8f500b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:12.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f4ed9d640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f5006e410 0x7f8f500cb250 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f8f400090b0 tx=0x7f8f400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f46ffd640 1 -- 172.21.15.6:0/630773182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40037040 con 0x7f8f5006e410 2024-05-20T18:02:12.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f46ffd640 1 -- 172.21.15.6:0/630773182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f40004030 con 0x7f8f5006e410 2024-05-20T18:02:12.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f46ffd640 1 -- 172.21.15.6:0/630773182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40004420 con 0x7f8f5006e410 2024-05-20T18:02:12.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5015e9d0 con 0x7f8f5006e410 2024-05-20T18:02:12.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.302+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f5015ef90 con 0x7f8f5006e410 2024-05-20T18:02:12.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.303+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f50075b00 con 0x7f8f5006e410 2024-05-20T18:02:12.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.304+0000 7f8f46ffd640 1 -- 172.21.15.6:0/630773182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f4003a070 con 0x7f8f5006e410 2024-05-20T18:02:12.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.304+0000 7f8f46ffd640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f3006be60 0x7f8f3006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.305+0000 7f8f46ffd640 1 -- 172.21.15.6:0/630773182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 6101+0+0 (secure 0 0 0) 0x7f8f400ab7f0 con 0x7f8f5006e410 2024-05-20T18:02:12.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.305+0000 7f8f4e59c640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f3006be60 0x7f8f3006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.305+0000 7f8f4e59c640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f3006be60 0x7f8f3006e370 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8f480012e0 tx=0x7f8f48001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.309+0000 7f8f46ffd640 1 -- 172.21.15.6:0/630773182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8f40041020 con 0x7f8f5006e410 2024-05-20T18:02:12.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.499+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f500b1b90 con 0x7f8f5006e410 2024-05-20T18:02:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.500+0000 7f8f46ffd640 1 -- 172.21.15.6:0/630773182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16857 (secure 0 0 0) 0x7f8f40079930 con 0x7f8f5006e410 2024-05-20T18:02:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:12.499 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":136,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:11.518748+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:09.651858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:10.498810+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f3006be60 msgr2=0x7f8f3006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f3006be60 0x7f8f3006e370 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8f480012e0 tx=0x7f8f48001630 comp rx=0 tx=0).stop 2024-05-20T18:02:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f5006e410 msgr2=0x7f8f500cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f5006e410 0x7f8f500cb250 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f8f400090b0 tx=0x7f8f400046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 shutdown_connections 2024-05-20T18:02:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8f3006be60 0x7f8f3006e370 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f5006e410 0x7f8f500cb250 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f5015cf50 0x7f8f500b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 --2- 172.21.15.6:0/630773182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8f500d1230 0x7f8f5006d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 >> 172.21.15.6:0/630773182 conn(0x7f8f5006f2b0 msgr2=0x7f8f500708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 shutdown_connections 2024-05-20T18:02:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.503+0000 7f8f54dc3640 1 -- 172.21.15.6:0/630773182 wait complete. 2024-05-20T18:02:12.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.629+0000 7f1cc3628640 1 Processor -- start 2024-05-20T18:02:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.630+0000 7f1cc3628640 1 -- start start 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc3628640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cbc162820 0x7f1cbc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc3628640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc0b3e80 0x7f1cbc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc3628640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1cbc06d910 0x7f1cbc0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc3628640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1cbc06dd20 con 0x7f1cbc162820 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc3628640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1cbc0d0630 con 0x7f1cbc06d910 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc3628640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1cbc0d39c0 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc13c4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cbc162820 0x7f1cbc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc13c4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cbc162820 0x7f1cbc0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55756/0 (socket says 172.21.15.6:55756) 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc13c4640 1 -- 172.21.15.6:0/444015988 learned_addr learned my addr 172.21.15.6:0/444015988 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc0bc3640 1 --2- 172.21.15.6:0/444015988 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc0b3e80 0x7f1cbc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.631+0000 7f1cc1bc5640 1 --2- 172.21.15.6:0/444015988 >> v2:172.21.15.171:3300/0 conn(0x7f1cbc06d910 0x7f1cbc0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.632+0000 7f1cc13c4640 1 -- 172.21.15.6:0/444015988 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc0b3e80 msgr2=0x7f1cbc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.632+0000 7f1cc13c4640 1 --2- 172.21.15.6:0/444015988 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc0b3e80 0x7f1cbc06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.632+0000 7f1cc13c4640 1 -- 172.21.15.6:0/444015988 >> v2:172.21.15.171:3300/0 conn(0x7f1cbc06d910 msgr2=0x7f1cbc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.632+0000 7f1cc13c4640 1 --2- 172.21.15.6:0/444015988 >> v2:172.21.15.171:3300/0 conn(0x7f1cbc06d910 0x7f1cbc0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.632+0000 7f1cc13c4640 1 -- 172.21.15.6:0/444015988 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc0d3ca0 con 0x7f1cbc162820 2024-05-20T18:02:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.632+0000 7f1cc1bc5640 1 --2- 172.21.15.6:0/444015988 >> v2:172.21.15.171:3300/0 conn(0x7f1cbc06d910 0x7f1cbc0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.632+0000 7f1cc13c4640 1 --2- 172.21.15.6:0/444015988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc162820 0x7f1cbc0b3940 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc08d5e0 tx=0x7f1cb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1458fd7a6b6f4b6f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cb3fff640 1 -- 172.21.15.6:0/444015988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8037070 con 0x7f1cbc162820 2024-05-20T18:02:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cb3fff640 1 -- 172.21.15.6:0/444015988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb8032440 con 0x7f1cbc162820 2024-05-20T18:02:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cb3fff640 1 -- 172.21.15.6:0/444015988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8032810 con 0x7f1cbc162820 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 -- 172.21.15.6:0/444015988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc162820 msgr2=0x7f1cbc0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 --2- 172.21.15.6:0/444015988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc162820 0x7f1cbc0b3940 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc08d5e0 tx=0x7f1cb802a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 -- 172.21.15.6:0/444015988 shutdown_connections 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 --2- 172.21.15.6:0/444015988 >> v2:172.21.15.171:3300/0 conn(0x7f1cbc06d910 0x7f1cbc0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 --2- 172.21.15.6:0/444015988 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc0b3e80 0x7f1cbc06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 --2- 172.21.15.6:0/444015988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc162820 0x7f1cbc0b3940 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 -- 172.21.15.6:0/444015988 >> 172.21.15.6:0/444015988 conn(0x7f1cbc0d4bd0 msgr2=0x7f1cbc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 -- 172.21.15.6:0/444015988 shutdown_connections 2024-05-20T18:02:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.633+0000 7f1cc3628640 1 -- 172.21.15.6:0/444015988 wait complete. 2024-05-20T18:02:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.635+0000 7f1cc3628640 1 Processor -- start 2024-05-20T18:02:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.635+0000 7f1cc3628640 1 -- start start 2024-05-20T18:02:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.636+0000 7f1cc3628640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cbc06d910 0x7f1cbc154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc3628640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc0b3e80 0x7f1cbc0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc3628640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc162820 0x7f1cbc0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc3628640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc0d0300 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc3628640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc0d4260 con 0x7f1cbc06d910 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc3628640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1cbc0d4780 con 0x7f1cbc162820 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc0b3e80 0x7f1cbc0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc0b3e80 0x7f1cbc0c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55766/0 (socket says 172.21.15.6:55766) 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 -- 172.21.15.6:0/3499880144 learned_addr learned my addr 172.21.15.6:0/3499880144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc1bc5640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc162820 0x7f1cbc0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc13c4640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cbc06d910 0x7f1cbc154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 -- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc162820 msgr2=0x7f1cbc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc162820 0x7f1cbc0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 -- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cbc06d910 msgr2=0x7f1cbc154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cbc06d910 0x7f1cbc154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 -- 172.21.15.6:0/3499880144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc0c8c40 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc0bc3640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc0b3e80 0x7f1cbc0c8700 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00e8a0 tx=0x7f1cac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cb1ffb640 1 -- 172.21.15.6:0/3499880144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac017070 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cb1ffb640 1 -- 172.21.15.6:0/3499880144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cac00c940 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cbc0c9150 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.637+0000 7f1cb1ffb640 1 -- 172.21.15.6:0/3499880144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00cd30 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.638+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cbc0c9c30 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.639+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cbc075b00 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.639+0000 7f1cb1ffb640 1 -- 172.21.15.6:0/3499880144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cac01a070 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.640+0000 7f1cb1ffb640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ca006be30 0x7f1ca006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.640+0000 7f1cb1ffb640 1 -- 172.21.15.6:0/3499880144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 6101+0+0 (secure 0 0 0) 0x7f1cac08afc0 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.640+0000 7f1cc13c4640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ca006be30 0x7f1ca006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.641+0000 7f1cc13c4640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ca006be30 0x7f1ca006e340 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8034000 tx=0x7f1cb802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.645+0000 7f1cb1ffb640 1 -- 172.21.15.6:0/3499880144 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1cac058fe0 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.830+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cbc0b74e0 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.831+0000 7f1cb1ffb640 1 -- 172.21.15.6:0/3499880144 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16857 (secure 0 0 0) 0x7f1cac05d2e0 con 0x7f1cbc0b3e80 2024-05-20T18:02:12.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:12.830 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":136,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:11.518748+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:09.651858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:10.498810+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.833+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ca006be30 msgr2=0x7f1ca006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.833+0000 7f1cc3628640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ca006be30 0x7f1ca006e340 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8034000 tx=0x7f1cb802e000 comp rx=0 tx=0).stop 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.833+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc0b3e80 msgr2=0x7f1cbc0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.833+0000 7f1cc3628640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc0b3e80 0x7f1cbc0c8700 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00e8a0 tx=0x7f1cac00ed60 comp rx=0 tx=0).stop 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.834+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 shutdown_connections 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.834+0000 7f1cc3628640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1ca006be30 0x7f1ca006e340 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.834+0000 7f1cc3628640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cbc162820 0x7f1cbc0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.834+0000 7f1cc3628640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cbc0b3e80 0x7f1cbc0c8700 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.834+0000 7f1cc3628640 1 --2- 172.21.15.6:0/3499880144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cbc06d910 0x7f1cbc154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.834+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 >> 172.21.15.6:0/3499880144 conn(0x7f1cbc0d4bd0 msgr2=0x7f1cbc0ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.834+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 shutdown_connections 2024-05-20T18:02:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.834+0000 7f1cc3628640 1 -- 172.21.15.6:0/3499880144 wait complete. 2024-05-20T18:02:12.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T18:02:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.963+0000 7f3d2ffaa640 1 Processor -- start 2024-05-20T18:02:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.964+0000 7f3d2ffaa640 1 -- start start 2024-05-20T18:02:12.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2ffaa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3d2806d3d0 0x7f3d2806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2ffaa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d280b8190 0x7f3d280b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2ffaa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d2806dd20 con 0x7f3d28162820 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2ffaa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f3d280d0630 con 0x7f3d280b8190 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2ffaa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3d280d39c0 con 0x7f3d2806d3d0 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2e547640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d280b8190 0x7f3d280b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2e547640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d280b8190 0x7f3d280b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55770/0 (socket says 172.21.15.6:55770) 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2e547640 1 -- 172.21.15.6:0/2116861311 learned_addr learned my addr 172.21.15.6:0/2116861311 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2d545640 1 --2- 172.21.15.6:0/2116861311 >> v2:172.21.15.171:3300/0 conn(0x7f3d2806d3d0 0x7f3d2806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2e547640 1 -- 172.21.15.6:0/2116861311 >> v2:172.21.15.171:3300/0 conn(0x7f3d2806d3d0 msgr2=0x7f3d2806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2e547640 1 --2- 172.21.15.6:0/2116861311 >> v2:172.21.15.171:3300/0 conn(0x7f3d2806d3d0 0x7f3d2806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.965+0000 7f3d2e547640 1 -- 172.21.15.6:0/2116861311 >> v1:172.21.15.171:6789/0 conn(0x7f3d28162820 legacy=0x7f3d280b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.966+0000 7f3d2e547640 1 -- 172.21.15.6:0/2116861311 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d280d3ca0 con 0x7f3d280b8190 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.966+0000 7f3d2e547640 1 --2- 172.21.15.6:0/2116861311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d280b85a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f3d280d1230 tx=0x7f3d2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7a6ff1f8ae85f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.966+0000 7f3d2cd44640 1 -- 172.21.15.6:0/2116861311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20037070 con 0x7f3d280b8190 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.966+0000 7f3d2cd44640 1 -- 172.21.15.6:0/2116861311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d20032440 con 0x7f3d280b8190 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.966+0000 7f3d2cd44640 1 -- 172.21.15.6:0/2116861311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20032810 con 0x7f3d280b8190 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.967+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/2116861311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 msgr2=0x7f3d280b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.967+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/2116861311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d280b85a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f3d280d1230 tx=0x7f3d2002a270 comp rx=0 tx=0).stop 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.967+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/2116861311 shutdown_connections 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.967+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/2116861311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d280b85a0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.967+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/2116861311 >> v2:172.21.15.171:3300/0 conn(0x7f3d2806d3d0 0x7f3d2806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.967+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/2116861311 >> 172.21.15.6:0/2116861311 conn(0x7f3d280d4bd0 msgr2=0x7f3d280d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:12.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.967+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/2116861311 shutdown_connections 2024-05-20T18:02:12.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.967+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/2116861311 wait complete. 2024-05-20T18:02:12.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.969+0000 7f3d2ffaa640 1 Processor -- start 2024-05-20T18:02:12.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.969+0000 7f3d2ffaa640 1 -- start start 2024-05-20T18:02:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.970+0000 7f3d2ffaa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d2806d3d0 0x7f3d281f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.970+0000 7f3d2ffaa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d28147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.970+0000 7f3d2ffaa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d28162820 0x7f3d280b9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.970+0000 7f3d2ffaa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3d280d0300 con 0x7f3d280b8190 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.970+0000 7f3d2ffaa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3d280d4260 con 0x7f3d28162820 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.970+0000 7f3d2ffaa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3d280b4050 con 0x7f3d2806d3d0 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d28147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d28147c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55776/0 (socket says 172.21.15.6:55776) 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 -- 172.21.15.6:0/3449450599 learned_addr learned my addr 172.21.15.6:0/3449450599 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2dd46640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d2806d3d0 0x7f3d281f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2e547640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d28162820 0x7f3d280b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 -- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d2806d3d0 msgr2=0x7f3d281f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d2806d3d0 0x7f3d281f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 -- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d28162820 msgr2=0x7f3d280b9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d28162820 0x7f3d280b9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 -- 172.21.15.6:0/3449450599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d281e7940 con 0x7f3d280b8190 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2d545640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d28147c50 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800e8a0 tx=0x7f3d1800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d1e7fc640 1 -- 172.21.15.6:0/3449450599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18017070 con 0x7f3d280b8190 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d1e7fc640 1 -- 172.21.15.6:0/3449450599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1800c940 con 0x7f3d280b8190 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d1e7fc640 1 -- 172.21.15.6:0/3449450599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800cd30 con 0x7f3d280b8190 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d281e7db0 con 0x7f3d280b8190 2024-05-20T18:02:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.971+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281e8370 con 0x7f3d280b8190 2024-05-20T18:02:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.972+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d28075b00 con 0x7f3d280b8190 2024-05-20T18:02:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.973+0000 7f3d1e7fc640 1 -- 172.21.15.6:0/3449450599 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d1801a070 con 0x7f3d280b8190 2024-05-20T18:02:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.974+0000 7f3d1e7fc640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0c06be30 0x7f3d0c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.974+0000 7f3d1e7fc640 1 -- 172.21.15.6:0/3449450599 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 6101+0+0 (secure 0 0 0) 0x7f3d1808ae90 con 0x7f3d280b8190 2024-05-20T18:02:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.974+0000 7f3d2dd46640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0c06be30 0x7f3d0c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.974+0000 7f3d2dd46640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0c06be30 0x7f3d0c06e340 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3d24001e70 tx=0x7f3d24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:12.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:12.978+0000 7f3d1e7fc640 1 -- 172.21.15.6:0/3449450599 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3d18058fd0 con 0x7f3d280b8190 2024-05-20T18:02:13.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:13.204+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3d281e7b10 con 0x7f3d280b8190 2024-05-20T18:02:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.162+0000 7f3d1e7fc640 1 -- 172.21.15.6:0/3449450599 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v95) ==== 118+0+0 (secure 0 0 0) 0x7f3d1805d2d0 con 0x7f3d280b8190 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.164+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0c06be30 msgr2=0x7f3d0c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.164+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0c06be30 0x7f3d0c06e340 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3d24001e70 tx=0x7f3d24009040 comp rx=0 tx=0).stop 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.164+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 msgr2=0x7f3d28147c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.164+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d28147c50 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800e8a0 tx=0x7f3d1800ed60 comp rx=0 tx=0).stop 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.165+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 shutdown_connections 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.165+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3d0c06be30 0x7f3d0c06e340 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.165+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d28162820 0x7f3d280b9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.165+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d280b8190 0x7f3d28147c50 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.165+0000 7f3d2ffaa640 1 --2- 172.21.15.6:0/3449450599 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3d2806d3d0 0x7f3d281f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.165+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 >> 172.21.15.6:0/3449450599 conn(0x7f3d280d4bd0 msgr2=0x7f3d2815f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:14.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.165+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 shutdown_connections 2024-05-20T18:02:14.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.165+0000 7f3d2ffaa640 1 -- 172.21.15.6:0/3449450599 wait complete. 2024-05-20T18:02:14.176 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T18:02:14.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T18:02:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.303+0000 7fa75aa1b640 1 Processor -- start 2024-05-20T18:02:14.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.303+0000 7fa75aa1b640 1 -- start start 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.304+0000 7fa75aa1b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa754162820 0x7fa7540b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.304+0000 7fa75aa1b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7540d0630 con 0x7fa75406dae0 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.304+0000 7fa75aa1b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7540d39c0 con 0x7fa7540b3e80 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.304+0000 7fa75aa1b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa7540d3ca0 con 0x7fa754162820 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.304+0000 7fa758fb8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa75406dae0 0x7fa7540b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46638/0 (socket says 172.21.15.6:46638) 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa758fb8640 1 -- 172.21.15.6:0/2706026774 learned_addr learned my addr 172.21.15.6:0/2706026774 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa753fff640 1 --2- 172.21.15.6:0/2706026774 >> v2:172.21.15.171:3300/0 conn(0x7fa754162820 0x7fa7540b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248873329 0 0) 0x7fa7540d0630 con 0x7fa75406dae0 2024-05-20T18:02:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa73c003520 con 0x7fa75406dae0 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712831634 0 0) 0x7fa7540d39c0 con 0x7fa7540b3e80 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7540d0630 con 0x7fa7540b3e80 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2582110918 0 0) 0x7fa73c003520 con 0x7fa75406dae0 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 >> v2:172.21.15.171:3300/0 conn(0x7fa754162820 msgr2=0x7fa7540b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 --2- 172.21.15.6:0/2706026774 >> v2:172.21.15.171:3300/0 conn(0x7fa754162820 0x7fa7540b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 >> v1:172.21.15.171:6789/0 conn(0x7fa7540b3e80 legacy=0x7fa75406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7540d3f80 con 0x7fa75406dae0 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fa74c001970 con 0x7fa75406dae0 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 >> v1:172.21.15.6:6789/0 conn(0x7fa75406dae0 legacy=0x7fa7540b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c003b90 0x7fa73c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:14.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa73c004800 0x7fa73c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa73c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7540d3ca0 con 0x7fa73c005210 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c00c190 con 0x7fa73c003b90 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa73c00c390 con 0x7fa73c004800 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa753fff640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c003b90 0x7fa73c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.305+0000 7fa758fb8640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa73c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.306+0000 7fa7537fe640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa73c004800 0x7fa73c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.306+0000 7fa758fb8640 1 -- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa73c004800 msgr2=0x7fa73c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.306+0000 7fa758fb8640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa73c004800 0x7fa73c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.306+0000 7fa758fb8640 1 -- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c003b90 msgr2=0x7fa73c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:14.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.306+0000 7fa758fb8640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c003b90 0x7fa73c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.306+0000 7fa758fb8640 1 -- 172.21.15.6:0/2706026774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c003520 con 0x7fa73c005210 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.306+0000 7fa753fff640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c003b90 0x7fa73c003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.307+0000 7fa758fb8640 1 -- 172.21.15.6:0/2706026774 reap_dead start 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.307+0000 7fa758fb8640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa73c00b9c0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00a690 tx=0x7fa73c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78019a0b824c2d2a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.307+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744009690 con 0x7fa73c005210 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.307+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa74c02f070 con 0x7fa73c005210 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.307+0000 7fa752ffd640 1 -- 172.21.15.6:0/2706026774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00a2b0 con 0x7fa73c005210 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.308+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2706026774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 msgr2=0x7fa73c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.308+0000 7fa75aa1b640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa73c00b9c0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00a690 tx=0x7fa73c005830 comp rx=0 tx=0).stop 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.308+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2706026774 shutdown_connections 2024-05-20T18:02:14.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.308+0000 7fa75aa1b640 1 --2- 172.21.15.6:0/2706026774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa73c00b9c0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.308+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2706026774 >> 172.21.15.6:0/2706026774 conn(0x7fa7540d4bd0 msgr2=0x7fa7540d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:14.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.308+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2706026774 shutdown_connections 2024-05-20T18:02:14.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.308+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2706026774 wait complete. 2024-05-20T18:02:14.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.310+0000 7fa75aa1b640 1 Processor -- start 2024-05-20T18:02:14.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.310+0000 7fa75aa1b640 1 -- start start 2024-05-20T18:02:14.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa75aa1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa7540c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa75aa1b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa754155270 0x7fa75415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa75aa1b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7541578b0 0x7fa75415b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa75aa1b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa7540d4780 con 0x7fa73c005210 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa75aa1b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa7540d0300 con 0x7fa754155270 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa75aa1b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa7540d4900 con 0x7fa7541578b0 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa753fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa7540c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa753fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa7540c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55794/0 (socket says 172.21.15.6:55794) 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa753fff640 1 -- 172.21.15.6:0/2367765073 learned_addr learned my addr 172.21.15.6:0/2367765073 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa758fb8640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7541578b0 0x7fa75415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:14.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa7537fe640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa754155270 0x7fa75415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa753fff640 1 -- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7541578b0 msgr2=0x7fa75415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa753fff640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7541578b0 0x7fa75415b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa753fff640 1 -- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa754155270 msgr2=0x7fa75415a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa753fff640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa754155270 0x7fa75415a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.311+0000 7fa753fff640 1 -- 172.21.15.6:0/2367765073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa754156550 con 0x7fa73c005210 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.312+0000 7fa753fff640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa7540c9d50 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fa744011960 tx=0x7fa744011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.312+0000 7fa750ff9640 1 -- 172.21.15.6:0/2367765073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74400fa90 con 0x7fa73c005210 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.312+0000 7fa750ff9640 1 -- 172.21.15.6:0/2367765073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa74400fc30 con 0x7fa73c005210 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.312+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa754159610 con 0x7fa73c005210 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.312+0000 7fa750ff9640 1 -- 172.21.15.6:0/2367765073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744014440 con 0x7fa73c005210 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.312+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa754156af0 con 0x7fa73c005210 2024-05-20T18:02:14.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.313+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa754075b00 con 0x7fa73c005210 2024-05-20T18:02:14.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.314+0000 7fa750ff9640 1 -- 172.21.15.6:0/2367765073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa744012040 con 0x7fa73c005210 2024-05-20T18:02:14.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.314+0000 7fa750ff9640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa74006be30 0x7fa74006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:14.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.314+0000 7fa750ff9640 1 -- 172.21.15.6:0/2367765073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fa74408b670 con 0x7fa73c005210 2024-05-20T18:02:14.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.314+0000 7fa7537fe640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa74006be30 0x7fa74006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:14.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.315+0000 7fa7537fe640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa74006be30 0x7fa74006e340 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa754159a00 tx=0x7fa748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:14.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.319+0000 7fa750ff9640 1 -- 172.21.15.6:0/2367765073 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa744019030 con 0x7fa73c005210 2024-05-20T18:02:14.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:14.541+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa75406c530 con 0x7fa73c005210 2024-05-20T18:02:15.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.167+0000 7fa750ff9640 1 -- 172.21.15.6:0/2367765073 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v96) ==== 122+0+0 (secure 0 0 0) 0x7fa744059e90 con 0x7fa73c005210 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa74006be30 msgr2=0x7fa74006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa74006be30 0x7fa74006e340 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa754159a00 tx=0x7fa748009040 comp rx=0 tx=0).stop 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 msgr2=0x7fa7540c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa7540c9d50 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fa744011960 tx=0x7fa744011e20 comp rx=0 tx=0).stop 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 shutdown_connections 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa74006be30 0x7fa74006e340 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa7541578b0 0x7fa75415b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa754155270 0x7fa75415a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 --2- 172.21.15.6:0/2367765073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c005210 0x7fa7540c9d50 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.169+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 >> 172.21.15.6:0/2367765073 conn(0x7fa7540d4bd0 msgr2=0x7fa7540c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.170+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 shutdown_connections 2024-05-20T18:02:15.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.170+0000 7fa75aa1b640 1 -- 172.21.15.6:0/2367765073 wait complete. 2024-05-20T18:02:15.181 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T18:02:15.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:15.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.306+0000 7fcf1f138640 1 Processor -- start 2024-05-20T18:02:15.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.306+0000 7fcf1f138640 1 -- start start 2024-05-20T18:02:15.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf1f138640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf1806d3d0 0x7fcf1806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf1f138640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcf180b8190 0x7fcf180b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf1f138640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf1806dd20 con 0x7fcf18162820 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf1f138640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcf180d0630 con 0x7fcf1806d3d0 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf1f138640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcf180d39c0 con 0x7fcf180b8190 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf17fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf1806d3d0 0x7fcf1806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf1ced4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcf18162820 0x7fcf180b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46640/0 (socket says 172.21.15.6:46640) 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf1ced4640 1 -- 172.21.15.6:0/240696698 learned_addr learned my addr 172.21.15.6:0/240696698 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.307+0000 7fcf1d6d5640 1 --2- 172.21.15.6:0/240696698 >> v2:172.21.15.171:3300/0 conn(0x7fcf180b8190 0x7fcf180b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.308+0000 7fcf17fff640 1 -- 172.21.15.6:0/240696698 >> v2:172.21.15.171:3300/0 conn(0x7fcf180b8190 msgr2=0x7fcf180b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.308+0000 7fcf17fff640 1 --2- 172.21.15.6:0/240696698 >> v2:172.21.15.171:3300/0 conn(0x7fcf180b8190 0x7fcf180b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.308+0000 7fcf17fff640 1 -- 172.21.15.6:0/240696698 >> v1:172.21.15.6:6789/0 conn(0x7fcf18162820 legacy=0x7fcf180b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.308+0000 7fcf177fe640 1 -- 172.21.15.6:0/240696698 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345544872 0 0) 0x7fcf00001110 con 0x7fcf18162820 2024-05-20T18:02:15.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.308+0000 7fcf17fff640 1 -- 172.21.15.6:0/240696698 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf180d3ca0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.308+0000 7fcf17fff640 1 --2- 172.21.15.6:0/240696698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf1806d7e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcf1808e070 tx=0x7fcf0802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b26e031de01145 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf177fe640 1 -- 172.21.15.6:0/240696698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08007740 con 0x7fcf1806d3d0 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf177fe640 1 -- 172.21.15.6:0/240696698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf080078e0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf177fe640 1 -- 172.21.15.6:0/240696698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08007cb0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf1f138640 1 -- 172.21.15.6:0/240696698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 msgr2=0x7fcf1806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf1f138640 1 --2- 172.21.15.6:0/240696698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf1806d7e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcf1808e070 tx=0x7fcf0802a680 comp rx=0 tx=0).stop 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf1f138640 1 -- 172.21.15.6:0/240696698 shutdown_connections 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf1f138640 1 --2- 172.21.15.6:0/240696698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf1806d7e0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf1f138640 1 --2- 172.21.15.6:0/240696698 >> v2:172.21.15.171:3300/0 conn(0x7fcf180b8190 0x7fcf180b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf1f138640 1 -- 172.21.15.6:0/240696698 >> 172.21.15.6:0/240696698 conn(0x7fcf180d4bd0 msgr2=0x7fcf180d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf1f138640 1 -- 172.21.15.6:0/240696698 shutdown_connections 2024-05-20T18:02:15.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.309+0000 7fcf1f138640 1 -- 172.21.15.6:0/240696698 wait complete. 2024-05-20T18:02:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.311+0000 7fcf1f138640 1 Processor -- start 2024-05-20T18:02:15.309 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.311+0000 7fcf1f138640 1 -- start start 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1f138640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf181590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1f138640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf180b8190 0x7fcf18153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1f138640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf18162820 0x7fcf180ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1f138640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcf180d0300 con 0x7fcf1806d3d0 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1f138640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcf180d4260 con 0x7fcf180b8190 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1f138640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcf180b4050 con 0x7fcf18162820 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf181590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf181590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55820/0 (socket says 172.21.15.6:55820) 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 -- 172.21.15.6:0/3242568623 learned_addr learned my addr 172.21.15.6:0/3242568623 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1d6d5640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf18162820 0x7fcf180ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf17fff640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf180b8190 0x7fcf18153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 -- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf18162820 msgr2=0x7fcf180ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf18162820 0x7fcf180ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 -- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf180b8190 msgr2=0x7fcf18153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf180b8190 0x7fcf18153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 -- 172.21.15.6:0/3242568623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1815b2f0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf1ced4640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf181590b0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c430 tx=0x7fcf0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.313+0000 7fcf157fa640 1 -- 172.21.15.6:0/3242568623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000074e0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.314+0000 7fcf157fa640 1 -- 172.21.15.6:0/3242568623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf000047e0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.314+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf180b59f0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.314+0000 7fcf157fa640 1 -- 172.21.15.6:0/3242568623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00004bd0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.314+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf180b5fb0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.315+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf18075b00 con 0x7fcf1806d3d0 2024-05-20T18:02:15.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.315+0000 7fcf157fa640 1 -- 172.21.15.6:0/3242568623 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf00011070 con 0x7fcf1806d3d0 2024-05-20T18:02:15.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.316+0000 7fcf157fa640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef806be30 0x7fcef806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.316+0000 7fcf157fa640 1 -- 172.21.15.6:0/3242568623 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fcf0008add0 con 0x7fcf1806d3d0 2024-05-20T18:02:15.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.316+0000 7fcf17fff640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef806be30 0x7fcef806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.317+0000 7fcf17fff640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef806be30 0x7fcef806e340 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcf08034000 tx=0x7fcf08033040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:15.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.321+0000 7fcf157fa640 1 -- 172.21.15.6:0/3242568623 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcf1806dd20 con 0x7fcf1806d3d0 2024-05-20T18:02:15.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.544+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf18160b60 con 0x7fcf1806d3d0 2024-05-20T18:02:15.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.544+0000 7fcf157fa640 1 -- 172.21.15.6:0/3242568623 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5182 (secure 0 0 0) 0x7fcf0000e280 con 0x7fcf1806d3d0 2024-05-20T18:02:15.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:15.543 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":96,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:11.519092+0000","modified":"2024-05-20T18:02:14.543277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1253645410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1253645410},{"type":"v1","addr":"172.21.15.6:6835","nonce":1253645410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":10}]} 2024-05-20T18:02:15.543 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 96 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.546+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef806be30 msgr2=0x7fcef806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.546+0000 7fcf1f138640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef806be30 0x7fcef806e340 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcf08034000 tx=0x7fcf08033040 comp rx=0 tx=0).stop 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.546+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 msgr2=0x7fcf181590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.546+0000 7fcf1f138640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf181590b0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000c430 tx=0x7fcf0000c8f0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.547+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 shutdown_connections 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.547+0000 7fcf1f138640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcef806be30 0x7fcef806e340 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.547+0000 7fcf1f138640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf18162820 0x7fcf180ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.547+0000 7fcf1f138640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf180b8190 0x7fcf18153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.547+0000 7fcf1f138640 1 --2- 172.21.15.6:0/3242568623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf1806d3d0 0x7fcf181590b0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.547+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 >> 172.21.15.6:0/3242568623 conn(0x7fcf180d4bd0 msgr2=0x7fcf180ba5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:15.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.547+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 shutdown_connections 2024-05-20T18:02:15.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.547+0000 7fcf1f138640 1 -- 172.21.15.6:0/3242568623 wait complete. 2024-05-20T18:02:15.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:15.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.672+0000 7f3594eb6640 1 Processor -- start 2024-05-20T18:02:15.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.672+0000 7f3594eb6640 1 -- start start 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.673+0000 7f3594eb6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3590163a10 0x7f35900d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.673+0000 7f3594eb6640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f35900d14b0 0x7f35900d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.673+0000 7f3594eb6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35900d0370 con 0x7f35900b4010 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.673+0000 7f3594eb6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f35900d3ca0 con 0x7f3590163a10 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.673+0000 7f3594eb6640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f35900d0650 con 0x7f35900d14b0 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.673+0000 7f358e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3590163a10 0x7f35900d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.673+0000 7f358e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3590163a10 0x7f35900d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55828/0 (socket says 172.21.15.6:55828) 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.673+0000 7f358e59c640 1 -- 172.21.15.6:0/2234993273 learned_addr learned my addr 172.21.15.6:0/2234993273 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.674+0000 7f358ed9d640 1 --2- 172.21.15.6:0/2234993273 >> v2:172.21.15.171:3300/0 conn(0x7f35900d14b0 0x7f35900d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.674+0000 7f358e59c640 1 -- 172.21.15.6:0/2234993273 >> v2:172.21.15.171:3300/0 conn(0x7f35900d14b0 msgr2=0x7f35900d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.674+0000 7f358e59c640 1 --2- 172.21.15.6:0/2234993273 >> v2:172.21.15.171:3300/0 conn(0x7f35900d14b0 0x7f35900d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.674+0000 7f358e59c640 1 -- 172.21.15.6:0/2234993273 >> v1:172.21.15.171:6789/0 conn(0x7f35900b4010 legacy=0x7f35900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.674+0000 7f358e59c640 1 -- 172.21.15.6:0/2234993273 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35900d3650 con 0x7f3590163a10 2024-05-20T18:02:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.674+0000 7f358ed9d640 1 --2- 172.21.15.6:0/2234993273 >> v2:172.21.15.171:3300/0 conn(0x7f35900d14b0 0x7f35900d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.674+0000 7f358e59c640 1 --2- 172.21.15.6:0/2234993273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3590163a10 0x7f35900d4130 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f35900b4590 tx=0x7f358002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e2d0b28e5e0100 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f358dd9b640 1 -- 172.21.15.6:0/2234993273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580037070 con 0x7f3590163a10 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f358dd9b640 1 -- 172.21.15.6:0/2234993273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3580032440 con 0x7f3590163a10 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f358dd9b640 1 -- 172.21.15.6:0/2234993273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580032810 con 0x7f3590163a10 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f3594eb6640 1 -- 172.21.15.6:0/2234993273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3590163a10 msgr2=0x7f35900d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f3594eb6640 1 --2- 172.21.15.6:0/2234993273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3590163a10 0x7f35900d4130 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f35900b4590 tx=0x7f358002a270 comp rx=0 tx=0).stop 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f3594eb6640 1 -- 172.21.15.6:0/2234993273 shutdown_connections 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f3594eb6640 1 --2- 172.21.15.6:0/2234993273 >> v2:172.21.15.171:3300/0 conn(0x7f35900d14b0 0x7f35900d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f3594eb6640 1 --2- 172.21.15.6:0/2234993273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3590163a10 0x7f35900d4130 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f3594eb6640 1 -- 172.21.15.6:0/2234993273 >> 172.21.15.6:0/2234993273 conn(0x7f359006d240 msgr2=0x7f359006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f3594eb6640 1 -- 172.21.15.6:0/2234993273 shutdown_connections 2024-05-20T18:02:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.675+0000 7f3594eb6640 1 -- 172.21.15.6:0/2234993273 wait complete. 2024-05-20T18:02:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.677+0000 7f3594eb6640 1 Processor -- start 2024-05-20T18:02:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.678+0000 7f3594eb6640 1 -- start start 2024-05-20T18:02:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3594eb6640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35900b4010 0x7f35900b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3594eb6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35900d14b0 0x7f35900cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3594eb6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3590163a10 0x7f35900b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3594eb6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35900b8210 con 0x7f35900d14b0 2024-05-20T18:02:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3594eb6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35900d1e00 con 0x7f3590163a10 2024-05-20T18:02:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3594eb6640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f35900b8390 con 0x7f35900b4010 2024-05-20T18:02:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3585d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35900d14b0 0x7f35900cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3585d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35900d14b0 0x7f35900cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55840/0 (socket says 172.21.15.6:55840) 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3585d9b640 1 -- 172.21.15.6:0/3993588586 learned_addr learned my addr 172.21.15.6:0/3993588586 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f358e59c640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35900b4010 0x7f35900b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f358ed9d640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3590163a10 0x7f35900b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3585d9b640 1 -- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35900b4010 msgr2=0x7f35900b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3585d9b640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35900b4010 0x7f35900b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3585d9b640 1 -- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3590163a10 msgr2=0x7f35900b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3585d9b640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3590163a10 0x7f35900b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.679+0000 7f3585d9b640 1 -- 172.21.15.6:0/3993588586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35900b4f90 con 0x7f35900d14b0 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.680+0000 7f3585d9b640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35900d14b0 0x7f35900cd020 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f357800c3f0 tx=0x7f357800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.680+0000 7f35877fe640 1 -- 172.21.15.6:0/3993588586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780052d0 con 0x7f35900d14b0 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.680+0000 7f35877fe640 1 -- 172.21.15.6:0/3993588586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578005490 con 0x7f35900d14b0 2024-05-20T18:02:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.680+0000 7f35877fe640 1 -- 172.21.15.6:0/3993588586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578007260 con 0x7f35900d14b0 2024-05-20T18:02:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.680+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35900b5270 con 0x7f35900d14b0 2024-05-20T18:02:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.680+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35900b5830 con 0x7f35900d14b0 2024-05-20T18:02:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.681+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35900b4d00 con 0x7f35900d14b0 2024-05-20T18:02:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.681+0000 7f35877fe640 1 -- 172.21.15.6:0/3993588586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3578007400 con 0x7f35900d14b0 2024-05-20T18:02:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.682+0000 7f35877fe640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f357006be30 0x7f357006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.682+0000 7f35877fe640 1 -- 172.21.15.6:0/3993588586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f357808a550 con 0x7f35900d14b0 2024-05-20T18:02:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.682+0000 7f358e59c640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f357006be30 0x7f357006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:15.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.683+0000 7f358e59c640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f357006be30 0x7f357006e340 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3580034000 tx=0x7f358002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:15.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.686+0000 7f35877fe640 1 -- 172.21.15.6:0/3993588586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3578058600 con 0x7f35900d14b0 2024-05-20T18:02:15.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.870+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3590075b00 con 0x7f35900d14b0 2024-05-20T18:02:15.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.872+0000 7f35877fe640 1 -- 172.21.15.6:0/3993588586 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16844 (secure 0 0 0) 0x7f357805c900 con 0x7f35900d14b0 2024-05-20T18:02:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:15.870 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":137,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:13.150220+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:09.651858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:10.498810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f357006be30 msgr2=0x7f357006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f357006be30 0x7f357006e340 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3580034000 tx=0x7f358002e000 comp rx=0 tx=0).stop 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35900d14b0 msgr2=0x7f35900cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35900d14b0 0x7f35900cd020 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f357800c3f0 tx=0x7f357800c8b0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 shutdown_connections 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f357006be30 0x7f357006e340 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3590163a10 0x7f35900b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35900d14b0 0x7f35900cd020 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 --2- 172.21.15.6:0/3993588586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35900b4010 0x7f35900b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 >> 172.21.15.6:0/3993588586 conn(0x7f359006d240 msgr2=0x7f3590160390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 shutdown_connections 2024-05-20T18:02:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:15.874+0000 7f3594eb6640 1 -- 172.21.15.6:0/3993588586 wait complete. 2024-05-20T18:02:15.883 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T18:02:15.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:02:15.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.001+0000 7fc4d074c640 1 Processor -- start 2024-05-20T18:02:15.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.001+0000 7fc4d074c640 1 -- start start 2024-05-20T18:02:16.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.002+0000 7fc4d074c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 0x7fc4c809a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.002+0000 7fc4d074c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc4c809aa30 0x7fc4c80d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.002+0000 7fc4d074c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c8160700 con 0x7fc4c806da80 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.002+0000 7fc4d074c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc4c8159da0 con 0x7fc4c809aa30 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.002+0000 7fc4d074c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c80af1c0 con 0x7fc4c81602f0 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.002+0000 7fc4ce4e8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc4c806da80 0x7fc4c80b1c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46644/0 (socket says 172.21.15.6:46644) 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.002+0000 7fc4ce4e8640 1 -- 172.21.15.6:0/2319977614 learned_addr learned my addr 172.21.15.6:0/2319977614 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cdce7640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 0x7fc4c809a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cece9640 1 --2- 172.21.15.6:0/2319977614 >> v2:172.21.15.171:3300/0 conn(0x7fc4c809aa30 0x7fc4c80d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204355953 0 0) 0x7fc4c0001110 con 0x7fc4c806da80 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4b0003520 con 0x7fc4c806da80 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255802711 0 0) 0x7fc4b0003520 con 0x7fc4c806da80 2024-05-20T18:02:16.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 msgr2=0x7fc4c809a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 0x7fc4c809a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 >> v2:172.21.15.171:3300/0 conn(0x7fc4c809aa30 msgr2=0x7fc4c80d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 --2- 172.21.15.6:0/2319977614 >> v2:172.21.15.171:3300/0 conn(0x7fc4c809aa30 0x7fc4c80d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c809ae40 con 0x7fc4c806da80 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fc4c0001840 con 0x7fc4c806da80 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cece9640 1 --2- 172.21.15.6:0/2319977614 >> v2:172.21.15.171:3300/0 conn(0x7fc4c809aa30 0x7fc4c80d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cdce7640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 0x7fc4c809a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 >> v1:172.21.15.6:6789/0 conn(0x7fc4c806da80 legacy=0x7fc4c80b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4b00039b0 0x7fc4b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4b0004800 0x7fc4b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 0x7fc4b0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c80af1c0 con 0x7fc4b0004800 2024-05-20T18:02:16.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b000ba70 con 0x7fc4b00039b0 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b000bbf0 con 0x7fc4c81602f0 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cdce7640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4b0004800 0x7fc4b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4ce4e8640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4b00039b0 0x7fc4b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.003+0000 7fc4cece9640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 0x7fc4b0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cdce7640 1 -- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 msgr2=0x7fc4b0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cdce7640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4c81602f0 0x7fc4b0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cdce7640 1 -- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4b00039b0 msgr2=0x7fc4b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cdce7640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4b00039b0 0x7fc4b0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cdce7640 1 -- 172.21.15.6:0/2319977614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b0003520 con 0x7fc4b0004800 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cdce7640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4b0004800 0x7fc4b0004c10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8072ca0 tx=0x7fc4b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe40253bd1d1a53 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc036070 con 0x7fc4b0004800 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc031400 con 0x7fc4b0004800 2024-05-20T18:02:16.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.004+0000 7fc4cd4e6640 1 -- 172.21.15.6:0/2319977614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc009850 con 0x7fc4b0004800 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.005+0000 7fc4d074c640 1 -- 172.21.15.6:0/2319977614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4b0004800 msgr2=0x7fc4b0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.005+0000 7fc4d074c640 1 --2- 172.21.15.6:0/2319977614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4b0004800 0x7fc4b0004c10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8072ca0 tx=0x7fc4b0005830 comp rx=0 tx=0).stop 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.005+0000 7fc4cece9640 1 -- 172.21.15.6:0/2319977614 reap_dead start 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.005+0000 7fc4d074c640 1 -- 172.21.15.6:0/2319977614 shutdown_connections 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.005+0000 7fc4d074c640 1 -- 172.21.15.6:0/2319977614 >> 172.21.15.6:0/2319977614 conn(0x7fc4c80b6670 msgr2=0x7fc4c80b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.005+0000 7fc4d074c640 1 -- 172.21.15.6:0/2319977614 shutdown_connections 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.005+0000 7fc4d074c640 1 -- 172.21.15.6:0/2319977614 wait complete. 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.007+0000 7fc4d074c640 1 Processor -- start 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.007+0000 7fc4d074c640 1 -- start start 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.008+0000 7fc4d074c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4b0004800 0x7fc4c809e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.008+0000 7fc4d074c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c81f8f90 0x7fc4c814e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.008+0000 7fc4d074c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4c81f93a0 0x7fc4c806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.008+0000 7fc4d074c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c80b2390 con 0x7fc4c81f93a0 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.008+0000 7fc4d074c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c80d17b0 con 0x7fc4c81f8f90 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.008+0000 7fc4d074c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c80af410 con 0x7fc4b0004800 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4c81f93a0 0x7fc4c806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4c81f93a0 0x7fc4c806f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55852/0 (socket says 172.21.15.6:55852) 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 -- 172.21.15.6:0/2100459129 learned_addr learned my addr 172.21.15.6:0/2100459129 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4ce4e8640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4b0004800 0x7fc4c809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 -- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4b0004800 msgr2=0x7fc4c809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4b0004800 0x7fc4c809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cdce7640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c81f8f90 0x7fc4c814e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 -- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c81f8f90 msgr2=0x7fc4c814e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c81f8f90 0x7fc4c814e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 -- 172.21.15.6:0/2100459129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c8158690 con 0x7fc4c81f93a0 2024-05-20T18:02:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4cece9640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4c81f93a0 0x7fc4c806f9d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8072f80 tx=0x7fc4b800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4c6ffd640 1 -- 172.21.15.6:0/2100459129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8003990 con 0x7fc4c81f93a0 2024-05-20T18:02:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4c6ffd640 1 -- 172.21.15.6:0/2100459129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b8003b30 con 0x7fc4c81f93a0 2024-05-20T18:02:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c81f9b00 con 0x7fc4c81f93a0 2024-05-20T18:02:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4c6ffd640 1 -- 172.21.15.6:0/2100459129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8004020 con 0x7fc4c81f93a0 2024-05-20T18:02:16.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.009+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c8158d60 con 0x7fc4c81f93a0 2024-05-20T18:02:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.010+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c80b2ab0 con 0x7fc4c81f93a0 2024-05-20T18:02:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.011+0000 7fc4c6ffd640 1 -- 172.21.15.6:0/2100459129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4b801f020 con 0x7fc4c81f93a0 2024-05-20T18:02:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.012+0000 7fc4c6ffd640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc4b406be30 0x7fc4b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.012+0000 7fc4c6ffd640 1 -- 172.21.15.6:0/2100459129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fc4b808b5a0 con 0x7fc4c81f93a0 2024-05-20T18:02:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.012+0000 7fc4ce4e8640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc4b406be30 0x7fc4b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.012+0000 7fc4ce4e8640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc4b406be30 0x7fc4b406e340 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00012f0 tx=0x7fc4c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.016+0000 7fc4c6ffd640 1 -- 172.21.15.6:0/2100459129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc4c80b2ab0 con 0x7fc4c81f93a0 2024-05-20T18:02:16.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.201+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4c81f9890 con 0x7fc4b406be30 2024-05-20T18:02:16.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.208+0000 7fc4c6ffd640 1 -- 172.21.15.6:0/2100459129 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252461 (secure 0 0 0) 0x7fc4c81f9890 con 0x7fc4b406be30 2024-05-20T18:02:16.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:02:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc4b406be30 msgr2=0x7fc4b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc4b406be30 0x7fc4b406e340 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc4c00012f0 tx=0x7fc4c0009040 comp rx=0 tx=0).stop 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4c81f93a0 msgr2=0x7fc4c806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4c81f93a0 0x7fc4c806f9d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8072f80 tx=0x7fc4b800f580 comp rx=0 tx=0).stop 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 shutdown_connections 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc4b406be30 0x7fc4b406e340 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4c81f93a0 0x7fc4c806f9d0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4c81f8f90 0x7fc4c814e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 --2- 172.21.15.6:0/2100459129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc4b0004800 0x7fc4c809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 >> 172.21.15.6:0/2100459129 conn(0x7fc4c80b6670 msgr2=0x7fc4c806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 shutdown_connections 2024-05-20T18:02:16.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.211+0000 7fc4d074c640 1 -- 172.21.15.6:0/2100459129 wait complete. 2024-05-20T18:02:16.220 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":410,"stamp":"2024-05-20T18:02:14.374914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272412,"kb_used_data":14616,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702308,"statfs":{"total":773094113280,"available":772815163392,"internally_reserved":0,"allocated":14966784,"data_stored":7542556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.248605"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161059+0000","last_change":"2024-05-20T18:02:12.149205+0000","last_active":"2024-05-20T18:02:13.161059+0000","last_peered":"2024-05-20T18:02:13.161059+0000","last_clean":"2024-05-20T18:02:13.161059+0000","last_became_active":"2024-05-20T18:02:12.148873+0000","last_became_peered":"2024-05-20T18:02:12.148873+0000","last_unstale":"2024-05-20T18:02:13.161059+0000","last_undegraded":"2024-05-20T18:02:13.161059+0000","last_fullsized":"2024-05-20T18:02:13.161059+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:47:01.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.163521+0000","last_change":"2024-05-20T18:02:12.155235+0000","last_active":"2024-05-20T18:02:12.163521+0000","last_peered":"2024-05-20T18:02:12.163521+0000","last_clean":"2024-05-20T18:02:12.163521+0000","last_became_active":"2024-05-20T18:02:12.154902+0000","last_became_peered":"2024-05-20T18:02:12.154902+0000","last_unstale":"2024-05-20T18:02:12.163521+0000","last_undegraded":"2024-05-20T18:02:12.163521+0000","last_fullsized":"2024-05-20T18:02:12.163521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:47:01.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.156495+0000","last_change":"2024-05-20T18:02:12.150937+0000","last_active":"2024-05-20T18:02:12.156495+0000","last_peered":"2024-05-20T18:02:12.156495+0000","last_clean":"2024-05-20T18:02:12.156495+0000","last_became_active":"2024-05-20T18:02:12.150628+0000","last_became_peered":"2024-05-20T18:02:12.150628+0000","last_unstale":"2024-05-20T18:02:12.156495+0000","last_undegraded":"2024-05-20T18:02:12.156495+0000","last_fullsized":"2024-05-20T18:02:12.156495+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:14.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155478+0000","last_change":"2024-05-20T18:02:12.149499+0000","last_active":"2024-05-20T18:02:12.155478+0000","last_peered":"2024-05-20T18:02:12.155478+0000","last_clean":"2024-05-20T18:02:12.155478+0000","last_became_active":"2024-05-20T18:02:12.149175+0000","last_became_peered":"2024-05-20T18:02:12.149175+0000","last_unstale":"2024-05-20T18:02:12.155478+0000","last_undegraded":"2024-05-20T18:02:12.155478+0000","last_fullsized":"2024-05-20T18:02:12.155478+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:49.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159145+0000","last_change":"2024-05-20T18:02:12.161557+0000","last_active":"2024-05-20T18:02:13.159145+0000","last_peered":"2024-05-20T18:02:13.159145+0000","last_clean":"2024-05-20T18:02:13.159145+0000","last_became_active":"2024-05-20T18:02:12.160538+0000","last_became_peered":"2024-05-20T18:02:12.160538+0000","last_unstale":"2024-05-20T18:02:13.159145+0000","last_undegraded":"2024-05-20T18:02:13.159145+0000","last_fullsized":"2024-05-20T18:02:13.159145+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:27:35.169332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159188+0000","last_change":"2024-05-20T18:02:12.161144+0000","last_active":"2024-05-20T18:02:13.159188+0000","last_peered":"2024-05-20T18:02:13.159188+0000","last_clean":"2024-05-20T18:02:13.159188+0000","last_became_active":"2024-05-20T18:02:12.160859+0000","last_became_peered":"2024-05-20T18:02:12.160859+0000","last_unstale":"2024-05-20T18:02:13.159188+0000","last_undegraded":"2024-05-20T18:02:13.159188+0000","last_fullsized":"2024-05-20T18:02:13.159188+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:16.126148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159871+0000","last_change":"2024-05-20T18:02:12.151245+0000","last_active":"2024-05-20T18:02:13.159871+0000","last_peered":"2024-05-20T18:02:13.159871+0000","last_clean":"2024-05-20T18:02:13.159871+0000","last_became_active":"2024-05-20T18:02:12.150927+0000","last_became_peered":"2024-05-20T18:02:12.150927+0000","last_unstale":"2024-05-20T18:02:13.159871+0000","last_undegraded":"2024-05-20T18:02:13.159871+0000","last_fullsized":"2024-05-20T18:02:13.159871+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:31:13.636171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159627+0000","last_change":"2024-05-20T18:02:12.143728+0000","last_active":"2024-05-20T18:02:13.159627+0000","last_peered":"2024-05-20T18:02:13.159627+0000","last_clean":"2024-05-20T18:02:13.159627+0000","last_became_active":"2024-05-20T18:02:12.143197+0000","last_became_peered":"2024-05-20T18:02:12.143197+0000","last_unstale":"2024-05-20T18:02:13.159627+0000","last_undegraded":"2024-05-20T18:02:13.159627+0000","last_fullsized":"2024-05-20T18:02:13.159627+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:17:34.162608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159242+0000","last_change":"2024-05-20T18:02:12.160712+0000","last_active":"2024-05-20T18:02:13.159242+0000","last_peered":"2024-05-20T18:02:13.159242+0000","last_clean":"2024-05-20T18:02:13.159242+0000","last_became_active":"2024-05-20T18:02:12.160381+0000","last_became_peered":"2024-05-20T18:02:12.160381+0000","last_unstale":"2024-05-20T18:02:13.159242+0000","last_undegraded":"2024-05-20T18:02:13.159242+0000","last_fullsized":"2024-05-20T18:02:13.159242+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:08.180732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159501+0000","last_change":"2024-05-20T18:02:12.159415+0000","last_active":"2024-05-20T18:02:13.159501+0000","last_peered":"2024-05-20T18:02:13.159501+0000","last_clean":"2024-05-20T18:02:13.159501+0000","last_became_active":"2024-05-20T18:02:12.158922+0000","last_became_peered":"2024-05-20T18:02:12.158922+0000","last_unstale":"2024-05-20T18:02:13.159501+0000","last_undegraded":"2024-05-20T18:02:13.159501+0000","last_fullsized":"2024-05-20T18:02:13.159501+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:46:32.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.159263+0000","last_change":"2024-05-20T18:02:12.155039+0000","last_active":"2024-05-20T18:02:12.159263+0000","last_peered":"2024-05-20T18:02:12.159263+0000","last_clean":"2024-05-20T18:02:12.159263+0000","last_became_active":"2024-05-20T18:02:12.154731+0000","last_became_peered":"2024-05-20T18:02:12.154731+0000","last_unstale":"2024-05-20T18:02:12.159263+0000","last_undegraded":"2024-05-20T18:02:12.159263+0000","last_fullsized":"2024-05-20T18:02:12.159263+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:22:28.285395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.166676+0000","last_change":"2024-05-20T18:02:12.162163+0000","last_active":"2024-05-20T18:02:12.166676+0000","last_peered":"2024-05-20T18:02:12.166676+0000","last_clean":"2024-05-20T18:02:12.166676+0000","last_became_active":"2024-05-20T18:02:12.161856+0000","last_became_peered":"2024-05-20T18:02:12.161856+0000","last_unstale":"2024-05-20T18:02:12.166676+0000","last_undegraded":"2024-05-20T18:02:12.166676+0000","last_fullsized":"2024-05-20T18:02:12.166676+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:14.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158934+0000","last_change":"2024-05-20T18:02:12.166927+0000","last_active":"2024-05-20T18:02:13.158934+0000","last_peered":"2024-05-20T18:02:13.158934+0000","last_clean":"2024-05-20T18:02:13.158934+0000","last_became_active":"2024-05-20T18:02:12.166556+0000","last_became_peered":"2024-05-20T18:02:12.166556+0000","last_unstale":"2024-05-20T18:02:13.158934+0000","last_undegraded":"2024-05-20T18:02:13.158934+0000","last_fullsized":"2024-05-20T18:02:13.158934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:36:15.063213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.166585+0000","last_change":"2024-05-20T18:02:12.164249+0000","last_active":"2024-05-20T18:02:12.166585+0000","last_peered":"2024-05-20T18:02:12.166585+0000","last_clean":"2024-05-20T18:02:12.166585+0000","last_became_active":"2024-05-20T18:02:12.163934+0000","last_became_peered":"2024-05-20T18:02:12.163934+0000","last_unstale":"2024-05-20T18:02:12.166585+0000","last_undegraded":"2024-05-20T18:02:12.166585+0000","last_fullsized":"2024-05-20T18:02:12.166585+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:17:29.492527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.163676+0000","last_change":"2024-05-20T18:02:12.156187+0000","last_active":"2024-05-20T18:02:12.163676+0000","last_peered":"2024-05-20T18:02:12.163676+0000","last_clean":"2024-05-20T18:02:12.163676+0000","last_became_active":"2024-05-20T18:02:12.154130+0000","last_became_peered":"2024-05-20T18:02:12.154130+0000","last_unstale":"2024-05-20T18:02:12.163676+0000","last_undegraded":"2024-05-20T18:02:12.163676+0000","last_fullsized":"2024-05-20T18:02:12.163676+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:27.928918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158668+0000","last_change":"2024-05-20T18:02:12.163898+0000","last_active":"2024-05-20T18:02:13.158668+0000","last_peered":"2024-05-20T18:02:13.158668+0000","last_clean":"2024-05-20T18:02:13.158668+0000","last_became_active":"2024-05-20T18:02:12.163544+0000","last_became_peered":"2024-05-20T18:02:12.163544+0000","last_unstale":"2024-05-20T18:02:13.158668+0000","last_undegraded":"2024-05-20T18:02:13.158668+0000","last_fullsized":"2024-05-20T18:02:13.158668+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:25.892292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.168041+0000","last_change":"2024-05-20T18:02:12.166881+0000","last_active":"2024-05-20T18:02:12.168041+0000","last_peered":"2024-05-20T18:02:12.168041+0000","last_clean":"2024-05-20T18:02:12.168041+0000","last_became_active":"2024-05-20T18:02:12.166526+0000","last_became_peered":"2024-05-20T18:02:12.166526+0000","last_unstale":"2024-05-20T18:02:12.168041+0000","last_undegraded":"2024-05-20T18:02:12.168041+0000","last_fullsized":"2024-05-20T18:02:12.168041+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:12:09.836870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.160571+0000","last_change":"2024-05-20T18:02:12.155820+0000","last_active":"2024-05-20T18:02:12.160571+0000","last_peered":"2024-05-20T18:02:12.160571+0000","last_clean":"2024-05-20T18:02:12.160571+0000","last_became_active":"2024-05-20T18:02:12.155540+0000","last_became_peered":"2024-05-20T18:02:12.155540+0000","last_unstale":"2024-05-20T18:02:12.160571+0000","last_undegraded":"2024-05-20T18:02:12.160571+0000","last_fullsized":"2024-05-20T18:02:12.160571+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:26:38.797868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141067+0000","last_change":"2024-05-20T18:02:12.161484+0000","last_active":"2024-05-20T18:02:14.141067+0000","last_peered":"2024-05-20T18:02:14.141067+0000","last_clean":"2024-05-20T18:02:14.141067+0000","last_became_active":"2024-05-20T18:02:12.160800+0000","last_became_peered":"2024-05-20T18:02:12.160800+0000","last_unstale":"2024-05-20T18:02:14.141067+0000","last_undegraded":"2024-05-20T18:02:14.141067+0000","last_fullsized":"2024-05-20T18:02:14.141067+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:27:53.780079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255412+0000","last_change":"2024-05-20T18:02:12.158055+0000","last_active":"2024-05-20T18:02:14.255412+0000","last_peered":"2024-05-20T18:02:14.255412+0000","last_clean":"2024-05-20T18:02:14.255412+0000","last_became_active":"2024-05-20T18:02:12.157759+0000","last_became_peered":"2024-05-20T18:02:12.157759+0000","last_unstale":"2024-05-20T18:02:14.255412+0000","last_undegraded":"2024-05-20T18:02:14.255412+0000","last_fullsized":"2024-05-20T18:02:14.255412+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:14:49.066464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158968+0000","last_change":"2024-05-20T18:02:12.156265+0000","last_active":"2024-05-20T18:02:13.158968+0000","last_peered":"2024-05-20T18:02:13.158968+0000","last_clean":"2024-05-20T18:02:13.158968+0000","last_became_active":"2024-05-20T18:02:12.152272+0000","last_became_peered":"2024-05-20T18:02:12.152272+0000","last_unstale":"2024-05-20T18:02:13.158968+0000","last_undegraded":"2024-05-20T18:02:13.158968+0000","last_fullsized":"2024-05-20T18:02:13.158968+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:53:32.169356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160362+0000","last_change":"2024-05-20T18:02:12.151987+0000","last_active":"2024-05-20T18:02:13.160362+0000","last_peered":"2024-05-20T18:02:13.160362+0000","last_clean":"2024-05-20T18:02:13.160362+0000","last_became_active":"2024-05-20T18:02:12.151677+0000","last_became_peered":"2024-05-20T18:02:12.151677+0000","last_unstale":"2024-05-20T18:02:13.160362+0000","last_undegraded":"2024-05-20T18:02:13.160362+0000","last_fullsized":"2024-05-20T18:02:13.160362+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:14.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160836+0000","last_change":"2024-05-20T18:02:12.151020+0000","last_active":"2024-05-20T18:02:13.160836+0000","last_peered":"2024-05-20T18:02:13.160836+0000","last_clean":"2024-05-20T18:02:13.160836+0000","last_became_active":"2024-05-20T18:02:12.150710+0000","last_became_peered":"2024-05-20T18:02:12.150710+0000","last_unstale":"2024-05-20T18:02:13.160836+0000","last_undegraded":"2024-05-20T18:02:13.160836+0000","last_fullsized":"2024-05-20T18:02:13.160836+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:19.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.166211+0000","last_change":"2024-05-20T18:02:12.163659+0000","last_active":"2024-05-20T18:02:12.166211+0000","last_peered":"2024-05-20T18:02:12.166211+0000","last_clean":"2024-05-20T18:02:12.166211+0000","last_became_active":"2024-05-20T18:02:12.162161+0000","last_became_peered":"2024-05-20T18:02:12.162161+0000","last_unstale":"2024-05-20T18:02:12.166211+0000","last_undegraded":"2024-05-20T18:02:12.166211+0000","last_fullsized":"2024-05-20T18:02:12.166211+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:07.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161244+0000","last_change":"2024-05-20T18:02:12.150686+0000","last_active":"2024-05-20T18:02:13.161244+0000","last_peered":"2024-05-20T18:02:13.161244+0000","last_clean":"2024-05-20T18:02:13.161244+0000","last_became_active":"2024-05-20T18:02:12.150330+0000","last_became_peered":"2024-05-20T18:02:12.150330+0000","last_unstale":"2024-05-20T18:02:13.161244+0000","last_undegraded":"2024-05-20T18:02:13.161244+0000","last_fullsized":"2024-05-20T18:02:13.161244+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:27.928918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161194+0000","last_change":"2024-05-20T18:02:12.164624+0000","last_active":"2024-05-20T18:02:13.161194+0000","last_peered":"2024-05-20T18:02:13.161194+0000","last_clean":"2024-05-20T18:02:13.161194+0000","last_became_active":"2024-05-20T18:02:12.162281+0000","last_became_peered":"2024-05-20T18:02:12.162281+0000","last_unstale":"2024-05-20T18:02:13.161194+0000","last_undegraded":"2024-05-20T18:02:13.161194+0000","last_fullsized":"2024-05-20T18:02:13.161194+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:12:09.836870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159073+0000","last_change":"2024-05-20T18:02:12.150778+0000","last_active":"2024-05-20T18:02:13.159073+0000","last_peered":"2024-05-20T18:02:13.159073+0000","last_clean":"2024-05-20T18:02:13.159073+0000","last_became_active":"2024-05-20T18:02:12.149355+0000","last_became_peered":"2024-05-20T18:02:12.149355+0000","last_unstale":"2024-05-20T18:02:13.159073+0000","last_undegraded":"2024-05-20T18:02:13.159073+0000","last_fullsized":"2024-05-20T18:02:13.159073+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:05:17.575860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.154049+0000","last_change":"2024-05-20T18:02:12.149162+0000","last_active":"2024-05-20T18:02:12.154049+0000","last_peered":"2024-05-20T18:02:12.154049+0000","last_clean":"2024-05-20T18:02:12.154049+0000","last_became_active":"2024-05-20T18:02:12.148854+0000","last_became_peered":"2024-05-20T18:02:12.148854+0000","last_unstale":"2024-05-20T18:02:12.154049+0000","last_undegraded":"2024-05-20T18:02:12.154049+0000","last_fullsized":"2024-05-20T18:02:12.154049+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:02.729609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160184+0000","last_change":"2024-05-20T18:02:12.152841+0000","last_active":"2024-05-20T18:02:13.160184+0000","last_peered":"2024-05-20T18:02:13.160184+0000","last_clean":"2024-05-20T18:02:13.160184+0000","last_became_active":"2024-05-20T18:02:12.152507+0000","last_became_peered":"2024-05-20T18:02:12.152507+0000","last_unstale":"2024-05-20T18:02:13.160184+0000","last_undegraded":"2024-05-20T18:02:13.160184+0000","last_fullsized":"2024-05-20T18:02:13.160184+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:33:13.570772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.160095+0000","last_change":"2024-05-20T18:02:12.155945+0000","last_active":"2024-05-20T18:02:12.160095+0000","last_peered":"2024-05-20T18:02:12.160095+0000","last_clean":"2024-05-20T18:02:12.160095+0000","last_became_active":"2024-05-20T18:02:12.155477+0000","last_became_peered":"2024-05-20T18:02:12.155477+0000","last_unstale":"2024-05-20T18:02:12.160095+0000","last_undegraded":"2024-05-20T18:02:12.160095+0000","last_fullsized":"2024-05-20T18:02:12.160095+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:07.059232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158675+0000","last_change":"2024-05-20T18:02:12.164517+0000","last_active":"2024-05-20T18:02:13.158675+0000","last_peered":"2024-05-20T18:02:13.158675+0000","last_clean":"2024-05-20T18:02:13.158675+0000","last_became_active":"2024-05-20T18:02:12.164193+0000","last_became_peered":"2024-05-20T18:02:12.164193+0000","last_unstale":"2024-05-20T18:02:13.158675+0000","last_undegraded":"2024-05-20T18:02:13.158675+0000","last_fullsized":"2024-05-20T18:02:13.158675+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:27:53.780079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160937+0000","last_change":"2024-05-20T18:02:12.144841+0000","last_active":"2024-05-20T18:02:13.160937+0000","last_peered":"2024-05-20T18:02:13.160937+0000","last_clean":"2024-05-20T18:02:13.160937+0000","last_became_active":"2024-05-20T18:02:12.144463+0000","last_became_peered":"2024-05-20T18:02:12.144463+0000","last_unstale":"2024-05-20T18:02:13.160937+0000","last_undegraded":"2024-05-20T18:02:13.160937+0000","last_fullsized":"2024-05-20T18:02:13.160937+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:31:13.636171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155877+0000","last_change":"2024-05-20T18:02:12.149580+0000","last_active":"2024-05-20T18:02:12.155877+0000","last_peered":"2024-05-20T18:02:12.155877+0000","last_clean":"2024-05-20T18:02:12.155877+0000","last_became_active":"2024-05-20T18:02:12.149246+0000","last_became_peered":"2024-05-20T18:02:12.149246+0000","last_unstale":"2024-05-20T18:02:12.155877+0000","last_undegraded":"2024-05-20T18:02:12.155877+0000","last_fullsized":"2024-05-20T18:02:12.155877+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:31:13.636171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"136'4","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159371+0000","last_change":"2024-05-20T18:02:11.153964+0000","last_active":"2024-05-20T18:02:13.159371+0000","last_peered":"2024-05-20T18:02:13.159371+0000","last_clean":"2024-05-20T18:02:13.159371+0000","last_became_active":"2024-05-20T18:02:11.153649+0000","last_became_peered":"2024-05-20T18:02:11.153649+0000","last_unstale":"2024-05-20T18:02:13.159371+0000","last_undegraded":"2024-05-20T18:02:13.159371+0000","last_fullsized":"2024-05-20T18:02:13.159371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:51:50.446430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.163473+0000","last_change":"2024-05-20T18:02:12.153593+0000","last_active":"2024-05-20T18:02:12.163473+0000","last_peered":"2024-05-20T18:02:12.163473+0000","last_clean":"2024-05-20T18:02:12.163473+0000","last_became_active":"2024-05-20T18:02:12.153238+0000","last_became_peered":"2024-05-20T18:02:12.153238+0000","last_unstale":"2024-05-20T18:02:12.163473+0000","last_undegraded":"2024-05-20T18:02:12.163473+0000","last_fullsized":"2024-05-20T18:02:12.163473+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:26:53.011849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140727+0000","last_change":"2024-05-20T18:02:11.147913+0000","last_active":"2024-05-20T18:02:14.140727+0000","last_peered":"2024-05-20T18:02:14.140727+0000","last_clean":"2024-05-20T18:02:14.140727+0000","last_became_active":"2024-05-20T18:02:11.147620+0000","last_became_peered":"2024-05-20T18:02:11.147620+0000","last_unstale":"2024-05-20T18:02:14.140727+0000","last_undegraded":"2024-05-20T18:02:14.140727+0000","last_fullsized":"2024-05-20T18:02:14.140727+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:13.701021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159815+0000","last_change":"2024-05-20T18:02:12.157510+0000","last_active":"2024-05-20T18:02:13.159815+0000","last_peered":"2024-05-20T18:02:13.159815+0000","last_clean":"2024-05-20T18:02:13.159815+0000","last_became_active":"2024-05-20T18:02:12.155354+0000","last_became_peered":"2024-05-20T18:02:12.155354+0000","last_unstale":"2024-05-20T18:02:13.159815+0000","last_undegraded":"2024-05-20T18:02:13.159815+0000","last_fullsized":"2024-05-20T18:02:13.159815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:59.880114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141168+0000","last_change":"2024-05-20T18:02:11.148664+0000","last_active":"2024-05-20T18:02:14.141168+0000","last_peered":"2024-05-20T18:02:14.141168+0000","last_clean":"2024-05-20T18:02:14.141168+0000","last_became_active":"2024-05-20T18:02:11.148366+0000","last_became_peered":"2024-05-20T18:02:11.148366+0000","last_unstale":"2024-05-20T18:02:14.141168+0000","last_undegraded":"2024-05-20T18:02:14.141168+0000","last_fullsized":"2024-05-20T18:02:14.141168+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:11.804758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141113+0000","last_change":"2024-05-20T18:02:12.152569+0000","last_active":"2024-05-20T18:02:14.141113+0000","last_peered":"2024-05-20T18:02:14.141113+0000","last_clean":"2024-05-20T18:02:14.141113+0000","last_became_active":"2024-05-20T18:02:12.152116+0000","last_became_peered":"2024-05-20T18:02:12.152116+0000","last_unstale":"2024-05-20T18:02:14.141113+0000","last_undegraded":"2024-05-20T18:02:14.141113+0000","last_fullsized":"2024-05-20T18:02:14.141113+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:14:49.066464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.164488+0000","last_change":"2024-05-20T18:02:11.141982+0000","last_active":"2024-05-20T18:02:12.164488+0000","last_peered":"2024-05-20T18:02:12.164488+0000","last_clean":"2024-05-20T18:02:12.164488+0000","last_became_active":"2024-05-20T18:02:11.141599+0000","last_became_peered":"2024-05-20T18:02:11.141599+0000","last_unstale":"2024-05-20T18:02:12.164488+0000","last_undegraded":"2024-05-20T18:02:12.164488+0000","last_fullsized":"2024-05-20T18:02:12.164488+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:46:39.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255331+0000","last_change":"2024-05-20T18:02:12.157923+0000","last_active":"2024-05-20T18:02:14.255331+0000","last_peered":"2024-05-20T18:02:14.255331+0000","last_clean":"2024-05-20T18:02:14.255331+0000","last_became_active":"2024-05-20T18:02:12.157587+0000","last_became_peered":"2024-05-20T18:02:12.157587+0000","last_unstale":"2024-05-20T18:02:14.255331+0000","last_undegraded":"2024-05-20T18:02:14.255331+0000","last_fullsized":"2024-05-20T18:02:14.255331+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:27:53.780079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160311+0000","last_change":"2024-05-20T18:02:11.149426+0000","last_active":"2024-05-20T18:02:13.160311+0000","last_peered":"2024-05-20T18:02:13.160311+0000","last_clean":"2024-05-20T18:02:13.160311+0000","last_became_active":"2024-05-20T18:02:11.149109+0000","last_became_peered":"2024-05-20T18:02:11.149109+0000","last_unstale":"2024-05-20T18:02:13.160311+0000","last_undegraded":"2024-05-20T18:02:13.160311+0000","last_fullsized":"2024-05-20T18:02:13.160311+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:46:25.262299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155513+0000","last_change":"2024-05-20T18:02:12.151015+0000","last_active":"2024-05-20T18:02:12.155513+0000","last_peered":"2024-05-20T18:02:12.155513+0000","last_clean":"2024-05-20T18:02:12.155513+0000","last_became_active":"2024-05-20T18:02:12.150065+0000","last_became_peered":"2024-05-20T18:02:12.150065+0000","last_unstale":"2024-05-20T18:02:12.155513+0000","last_undegraded":"2024-05-20T18:02:12.155513+0000","last_fullsized":"2024-05-20T18:02:12.155513+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:31:13.636171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159000+0000","last_change":"2024-05-20T18:02:11.148927+0000","last_active":"2024-05-20T18:02:13.159000+0000","last_peered":"2024-05-20T18:02:13.159000+0000","last_clean":"2024-05-20T18:02:13.159000+0000","last_became_active":"2024-05-20T18:02:11.148531+0000","last_became_peered":"2024-05-20T18:02:11.148531+0000","last_unstale":"2024-05-20T18:02:13.159000+0000","last_undegraded":"2024-05-20T18:02:13.159000+0000","last_fullsized":"2024-05-20T18:02:13.159000+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:32.369579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.153718+0000","last_change":"2024-05-20T18:02:12.148756+0000","last_active":"2024-05-20T18:02:12.153718+0000","last_peered":"2024-05-20T18:02:12.153718+0000","last_clean":"2024-05-20T18:02:12.153718+0000","last_became_active":"2024-05-20T18:02:12.148430+0000","last_became_peered":"2024-05-20T18:02:12.148430+0000","last_unstale":"2024-05-20T18:02:12.153718+0000","last_undegraded":"2024-05-20T18:02:12.153718+0000","last_fullsized":"2024-05-20T18:02:12.153718+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:49.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159989+0000","last_change":"2024-05-20T18:02:11.147931+0000","last_active":"2024-05-20T18:02:13.159989+0000","last_peered":"2024-05-20T18:02:13.159989+0000","last_clean":"2024-05-20T18:02:13.159989+0000","last_became_active":"2024-05-20T18:02:11.147624+0000","last_became_peered":"2024-05-20T18:02:11.147624+0000","last_unstale":"2024-05-20T18:02:13.159989+0000","last_undegraded":"2024-05-20T18:02:13.159989+0000","last_fullsized":"2024-05-20T18:02:13.159989+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:13:35.668126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160641+0000","last_change":"2024-05-20T18:02:12.152814+0000","last_active":"2024-05-20T18:02:13.160641+0000","last_peered":"2024-05-20T18:02:13.160641+0000","last_clean":"2024-05-20T18:02:13.160641+0000","last_became_active":"2024-05-20T18:02:12.152524+0000","last_became_peered":"2024-05-20T18:02:12.152524+0000","last_unstale":"2024-05-20T18:02:13.160641+0000","last_undegraded":"2024-05-20T18:02:13.160641+0000","last_fullsized":"2024-05-20T18:02:13.160641+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:17:29.492527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158666+0000","last_change":"2024-05-20T18:02:11.148658+0000","last_active":"2024-05-20T18:02:13.158666+0000","last_peered":"2024-05-20T18:02:13.158666+0000","last_clean":"2024-05-20T18:02:13.158666+0000","last_became_active":"2024-05-20T18:02:11.144560+0000","last_became_peered":"2024-05-20T18:02:11.144560+0000","last_unstale":"2024-05-20T18:02:13.158666+0000","last_undegraded":"2024-05-20T18:02:13.158666+0000","last_fullsized":"2024-05-20T18:02:13.158666+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:32:27.082785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160776+0000","last_change":"2024-05-20T18:02:12.160009+0000","last_active":"2024-05-20T18:02:13.160776+0000","last_peered":"2024-05-20T18:02:13.160776+0000","last_clean":"2024-05-20T18:02:13.160776+0000","last_became_active":"2024-05-20T18:02:12.159714+0000","last_became_peered":"2024-05-20T18:02:12.159714+0000","last_unstale":"2024-05-20T18:02:13.160776+0000","last_undegraded":"2024-05-20T18:02:13.160776+0000","last_fullsized":"2024-05-20T18:02:13.160776+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:00.294485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141097+0000","last_change":"2024-05-20T18:02:11.150186+0000","last_active":"2024-05-20T18:02:14.141097+0000","last_peered":"2024-05-20T18:02:14.141097+0000","last_clean":"2024-05-20T18:02:14.141097+0000","last_became_active":"2024-05-20T18:02:11.149853+0000","last_became_peered":"2024-05-20T18:02:11.149853+0000","last_unstale":"2024-05-20T18:02:14.141097+0000","last_undegraded":"2024-05-20T18:02:14.141097+0000","last_fullsized":"2024-05-20T18:02:14.141097+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:04:30.333569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155187+0000","last_change":"2024-05-20T18:02:12.153757+0000","last_active":"2024-05-20T18:02:12.155187+0000","last_peered":"2024-05-20T18:02:12.155187+0000","last_clean":"2024-05-20T18:02:12.155187+0000","last_became_active":"2024-05-20T18:02:12.153452+0000","last_became_peered":"2024-05-20T18:02:12.153452+0000","last_unstale":"2024-05-20T18:02:12.155187+0000","last_undegraded":"2024-05-20T18:02:12.155187+0000","last_fullsized":"2024-05-20T18:02:12.155187+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:08:57.581804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161698+0000","last_change":"2024-05-20T18:02:11.150474+0000","last_active":"2024-05-20T18:02:13.161698+0000","last_peered":"2024-05-20T18:02:13.161698+0000","last_clean":"2024-05-20T18:02:13.161698+0000","last_became_active":"2024-05-20T18:02:11.150144+0000","last_became_peered":"2024-05-20T18:02:11.150144+0000","last_unstale":"2024-05-20T18:02:13.161698+0000","last_undegraded":"2024-05-20T18:02:13.161698+0000","last_fullsized":"2024-05-20T18:02:13.161698+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:59.934850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.160598+0000","last_change":"2024-05-20T18:02:12.157123+0000","last_active":"2024-05-20T18:02:12.160598+0000","last_peered":"2024-05-20T18:02:12.160598+0000","last_clean":"2024-05-20T18:02:12.160598+0000","last_became_active":"2024-05-20T18:02:12.156564+0000","last_became_peered":"2024-05-20T18:02:12.156564+0000","last_unstale":"2024-05-20T18:02:12.160598+0000","last_undegraded":"2024-05-20T18:02:12.160598+0000","last_fullsized":"2024-05-20T18:02:12.160598+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:21:01.276812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"136'3","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.156204+0000","last_change":"2024-05-20T18:02:11.149993+0000","last_active":"2024-05-20T18:02:12.156204+0000","last_peered":"2024-05-20T18:02:12.156204+0000","last_clean":"2024-05-20T18:02:12.156204+0000","last_became_active":"2024-05-20T18:02:11.149388+0000","last_became_peered":"2024-05-20T18:02:11.149388+0000","last_unstale":"2024-05-20T18:02:12.156204+0000","last_undegraded":"2024-05-20T18:02:12.156204+0000","last_fullsized":"2024-05-20T18:02:12.156204+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:25:37.942903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160087+0000","last_change":"2024-05-20T18:02:12.159258+0000","last_active":"2024-05-20T18:02:13.160087+0000","last_peered":"2024-05-20T18:02:13.160087+0000","last_clean":"2024-05-20T18:02:13.160087+0000","last_became_active":"2024-05-20T18:02:12.158903+0000","last_became_peered":"2024-05-20T18:02:12.158903+0000","last_unstale":"2024-05-20T18:02:13.160087+0000","last_undegraded":"2024-05-20T18:02:13.160087+0000","last_fullsized":"2024-05-20T18:02:13.160087+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:46:40.670710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159165+0000","last_change":"2024-05-20T18:02:11.153863+0000","last_active":"2024-05-20T18:02:13.159165+0000","last_peered":"2024-05-20T18:02:13.159165+0000","last_clean":"2024-05-20T18:02:13.159165+0000","last_became_active":"2024-05-20T18:02:11.153075+0000","last_became_peered":"2024-05-20T18:02:11.153075+0000","last_unstale":"2024-05-20T18:02:13.159165+0000","last_undegraded":"2024-05-20T18:02:13.159165+0000","last_fullsized":"2024-05-20T18:02:13.159165+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:55:47.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.163652+0000","last_change":"2024-05-20T18:02:12.155928+0000","last_active":"2024-05-20T18:02:12.163652+0000","last_peered":"2024-05-20T18:02:12.163652+0000","last_clean":"2024-05-20T18:02:12.163652+0000","last_became_active":"2024-05-20T18:02:12.153738+0000","last_became_peered":"2024-05-20T18:02:12.153738+0000","last_unstale":"2024-05-20T18:02:12.163652+0000","last_undegraded":"2024-05-20T18:02:12.163652+0000","last_fullsized":"2024-05-20T18:02:12.163652+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:12:09.836870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.147524+0000","last_change":"2024-05-20T18:02:11.151284+0000","last_active":"2024-05-20T18:02:12.147524+0000","last_peered":"2024-05-20T18:02:12.147524+0000","last_clean":"2024-05-20T18:02:12.147524+0000","last_became_active":"2024-05-20T18:02:11.150950+0000","last_became_peered":"2024-05-20T18:02:11.150950+0000","last_unstale":"2024-05-20T18:02:12.147524+0000","last_undegraded":"2024-05-20T18:02:12.147524+0000","last_fullsized":"2024-05-20T18:02:12.147524+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:39.585870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158860+0000","last_change":"2024-05-20T18:02:12.151454+0000","last_active":"2024-05-20T18:02:13.158860+0000","last_peered":"2024-05-20T18:02:13.158860+0000","last_clean":"2024-05-20T18:02:13.158860+0000","last_became_active":"2024-05-20T18:02:12.151099+0000","last_became_peered":"2024-05-20T18:02:12.151099+0000","last_unstale":"2024-05-20T18:02:13.158860+0000","last_undegraded":"2024-05-20T18:02:13.158860+0000","last_fullsized":"2024-05-20T18:02:13.158860+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:14:49.066464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.145374+0000","last_change":"2024-05-20T18:02:11.151079+0000","last_active":"2024-05-20T18:02:12.145374+0000","last_peered":"2024-05-20T18:02:12.145374+0000","last_clean":"2024-05-20T18:02:12.145374+0000","last_became_active":"2024-05-20T18:02:11.150763+0000","last_became_peered":"2024-05-20T18:02:11.150763+0000","last_unstale":"2024-05-20T18:02:12.145374+0000","last_undegraded":"2024-05-20T18:02:12.145374+0000","last_fullsized":"2024-05-20T18:02:12.145374+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:33:12.564683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155674+0000","last_change":"2024-05-20T18:02:12.148756+0000","last_active":"2024-05-20T18:02:12.155674+0000","last_peered":"2024-05-20T18:02:12.155674+0000","last_clean":"2024-05-20T18:02:12.155674+0000","last_became_active":"2024-05-20T18:02:12.148183+0000","last_became_peered":"2024-05-20T18:02:12.148183+0000","last_unstale":"2024-05-20T18:02:12.155674+0000","last_undegraded":"2024-05-20T18:02:12.155674+0000","last_fullsized":"2024-05-20T18:02:12.155674+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:19.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"136'8","reported_seq":22,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159531+0000","last_change":"2024-05-20T18:02:11.147054+0000","last_active":"2024-05-20T18:02:13.159531+0000","last_peered":"2024-05-20T18:02:13.159531+0000","last_clean":"2024-05-20T18:02:13.159531+0000","last_became_active":"2024-05-20T18:02:11.146731+0000","last_became_peered":"2024-05-20T18:02:11.146731+0000","last_unstale":"2024-05-20T18:02:13.159531+0000","last_undegraded":"2024-05-20T18:02:13.159531+0000","last_fullsized":"2024-05-20T18:02:13.159531+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:06:15.873244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141010+0000","last_change":"2024-05-20T18:02:12.165862+0000","last_active":"2024-05-20T18:02:14.141010+0000","last_peered":"2024-05-20T18:02:14.141010+0000","last_clean":"2024-05-20T18:02:14.141010+0000","last_became_active":"2024-05-20T18:02:12.165524+0000","last_became_peered":"2024-05-20T18:02:12.165524+0000","last_unstale":"2024-05-20T18:02:14.141010+0000","last_undegraded":"2024-05-20T18:02:14.141010+0000","last_fullsized":"2024-05-20T18:02:14.141010+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:25.892292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.158996+0000","last_change":"2024-05-20T18:02:11.150542+0000","last_active":"2024-05-20T18:02:12.158996+0000","last_peered":"2024-05-20T18:02:12.158996+0000","last_clean":"2024-05-20T18:02:12.158996+0000","last_became_active":"2024-05-20T18:02:11.150127+0000","last_became_peered":"2024-05-20T18:02:11.150127+0000","last_unstale":"2024-05-20T18:02:12.158996+0000","last_undegraded":"2024-05-20T18:02:12.158996+0000","last_fullsized":"2024-05-20T18:02:12.158996+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:49:11.841060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141157+0000","last_change":"2024-05-20T18:02:12.161784+0000","last_active":"2024-05-20T18:02:14.141157+0000","last_peered":"2024-05-20T18:02:14.141157+0000","last_clean":"2024-05-20T18:02:14.141157+0000","last_became_active":"2024-05-20T18:02:12.161193+0000","last_became_peered":"2024-05-20T18:02:12.161193+0000","last_unstale":"2024-05-20T18:02:14.141157+0000","last_undegraded":"2024-05-20T18:02:14.141157+0000","last_fullsized":"2024-05-20T18:02:14.141157+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:36:15.063213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140814+0000","last_change":"2024-05-20T18:02:11.146276+0000","last_active":"2024-05-20T18:02:14.140814+0000","last_peered":"2024-05-20T18:02:14.140814+0000","last_clean":"2024-05-20T18:02:14.140814+0000","last_became_active":"2024-05-20T18:02:11.145934+0000","last_became_peered":"2024-05-20T18:02:11.145934+0000","last_unstale":"2024-05-20T18:02:14.140814+0000","last_undegraded":"2024-05-20T18:02:14.140814+0000","last_fullsized":"2024-05-20T18:02:14.140814+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:37:06.048950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161462+0000","last_change":"2024-05-20T18:02:12.164955+0000","last_active":"2024-05-20T18:02:13.161462+0000","last_peered":"2024-05-20T18:02:13.161462+0000","last_clean":"2024-05-20T18:02:13.161462+0000","last_became_active":"2024-05-20T18:02:12.164300+0000","last_became_peered":"2024-05-20T18:02:12.164300+0000","last_unstale":"2024-05-20T18:02:13.161462+0000","last_undegraded":"2024-05-20T18:02:13.161462+0000","last_fullsized":"2024-05-20T18:02:13.161462+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:33.375668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.167824+0000","last_change":"2024-05-20T18:02:11.151150+0000","last_active":"2024-05-20T18:02:12.167824+0000","last_peered":"2024-05-20T18:02:12.167824+0000","last_clean":"2024-05-20T18:02:12.167824+0000","last_became_active":"2024-05-20T18:02:11.150644+0000","last_became_peered":"2024-05-20T18:02:11.150644+0000","last_unstale":"2024-05-20T18:02:12.167824+0000","last_undegraded":"2024-05-20T18:02:12.167824+0000","last_fullsized":"2024-05-20T18:02:12.167824+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:33:12.564683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161440+0000","last_change":"2024-05-20T18:02:12.159864+0000","last_active":"2024-05-20T18:02:13.161440+0000","last_peered":"2024-05-20T18:02:13.161440+0000","last_clean":"2024-05-20T18:02:13.161440+0000","last_became_active":"2024-05-20T18:02:12.159564+0000","last_became_peered":"2024-05-20T18:02:12.159564+0000","last_unstale":"2024-05-20T18:02:13.161440+0000","last_undegraded":"2024-05-20T18:02:13.161440+0000","last_fullsized":"2024-05-20T18:02:13.161440+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:26:53.011849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.145387+0000","last_change":"2024-05-20T18:02:11.151728+0000","last_active":"2024-05-20T18:02:12.145387+0000","last_peered":"2024-05-20T18:02:12.145387+0000","last_clean":"2024-05-20T18:02:12.145387+0000","last_became_active":"2024-05-20T18:02:11.151305+0000","last_became_peered":"2024-05-20T18:02:11.151305+0000","last_unstale":"2024-05-20T18:02:12.145387+0000","last_undegraded":"2024-05-20T18:02:12.145387+0000","last_fullsized":"2024-05-20T18:02:12.145387+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:16.315426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140713+0000","last_change":"2024-05-20T18:02:12.162681+0000","last_active":"2024-05-20T18:02:14.140713+0000","last_peered":"2024-05-20T18:02:14.140713+0000","last_clean":"2024-05-20T18:02:14.140713+0000","last_became_active":"2024-05-20T18:02:12.162362+0000","last_became_peered":"2024-05-20T18:02:12.162362+0000","last_unstale":"2024-05-20T18:02:14.140713+0000","last_undegraded":"2024-05-20T18:02:14.140713+0000","last_fullsized":"2024-05-20T18:02:14.140713+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:48:47.582128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255313+0000","last_change":"2024-05-20T18:02:11.151747+0000","last_active":"2024-05-20T18:02:14.255313+0000","last_peered":"2024-05-20T18:02:14.255313+0000","last_clean":"2024-05-20T18:02:14.255313+0000","last_became_active":"2024-05-20T18:02:11.151421+0000","last_became_peered":"2024-05-20T18:02:11.151421+0000","last_unstale":"2024-05-20T18:02:14.255313+0000","last_undegraded":"2024-05-20T18:02:14.255313+0000","last_fullsized":"2024-05-20T18:02:14.255313+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:01:22.438976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.154447+0000","last_change":"2024-05-20T18:02:12.153228+0000","last_active":"2024-05-20T18:02:12.154447+0000","last_peered":"2024-05-20T18:02:12.154447+0000","last_clean":"2024-05-20T18:02:12.154447+0000","last_became_active":"2024-05-20T18:02:12.152904+0000","last_became_peered":"2024-05-20T18:02:12.152904+0000","last_unstale":"2024-05-20T18:02:12.154447+0000","last_undegraded":"2024-05-20T18:02:12.154447+0000","last_fullsized":"2024-05-20T18:02:12.154447+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:17:29.492527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159951+0000","last_change":"2024-05-20T18:02:11.148027+0000","last_active":"2024-05-20T18:02:13.159951+0000","last_peered":"2024-05-20T18:02:13.159951+0000","last_clean":"2024-05-20T18:02:13.159951+0000","last_became_active":"2024-05-20T18:02:11.147037+0000","last_became_peered":"2024-05-20T18:02:11.147037+0000","last_unstale":"2024-05-20T18:02:13.159951+0000","last_undegraded":"2024-05-20T18:02:13.159951+0000","last_fullsized":"2024-05-20T18:02:13.159951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:27:08.558145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140760+0000","last_change":"2024-05-20T18:02:12.159761+0000","last_active":"2024-05-20T18:02:14.140760+0000","last_peered":"2024-05-20T18:02:14.140760+0000","last_clean":"2024-05-20T18:02:14.140760+0000","last_became_active":"2024-05-20T18:02:12.159404+0000","last_became_peered":"2024-05-20T18:02:12.159404+0000","last_unstale":"2024-05-20T18:02:14.140760+0000","last_undegraded":"2024-05-20T18:02:14.140760+0000","last_fullsized":"2024-05-20T18:02:14.140760+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:30:19.598070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255204+0000","last_change":"2024-05-20T18:02:11.150989+0000","last_active":"2024-05-20T18:02:14.255204+0000","last_peered":"2024-05-20T18:02:14.255204+0000","last_clean":"2024-05-20T18:02:14.255204+0000","last_became_active":"2024-05-20T18:02:11.150640+0000","last_became_peered":"2024-05-20T18:02:11.150640+0000","last_unstale":"2024-05-20T18:02:14.255204+0000","last_undegraded":"2024-05-20T18:02:14.255204+0000","last_fullsized":"2024-05-20T18:02:14.255204+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:40:57.819469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155650+0000","last_change":"2024-05-20T18:02:12.148487+0000","last_active":"2024-05-20T18:02:12.155650+0000","last_peered":"2024-05-20T18:02:12.155650+0000","last_clean":"2024-05-20T18:02:12.155650+0000","last_became_active":"2024-05-20T18:02:12.147770+0000","last_became_peered":"2024-05-20T18:02:12.147770+0000","last_unstale":"2024-05-20T18:02:12.155650+0000","last_undegraded":"2024-05-20T18:02:12.155650+0000","last_fullsized":"2024-05-20T18:02:12.155650+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:00.294485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160412+0000","last_change":"2024-05-20T18:02:11.144130+0000","last_active":"2024-05-20T18:02:13.160412+0000","last_peered":"2024-05-20T18:02:13.160412+0000","last_clean":"2024-05-20T18:02:13.160412+0000","last_became_active":"2024-05-20T18:02:11.143793+0000","last_became_peered":"2024-05-20T18:02:11.143793+0000","last_unstale":"2024-05-20T18:02:13.160412+0000","last_undegraded":"2024-05-20T18:02:13.160412+0000","last_fullsized":"2024-05-20T18:02:13.160412+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:39:56.735691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159055+0000","last_change":"2024-05-20T18:02:12.166680+0000","last_active":"2024-05-20T18:02:13.159055+0000","last_peered":"2024-05-20T18:02:13.159055+0000","last_clean":"2024-05-20T18:02:13.159055+0000","last_became_active":"2024-05-20T18:02:12.166233+0000","last_became_peered":"2024-05-20T18:02:12.166233+0000","last_unstale":"2024-05-20T18:02:13.159055+0000","last_undegraded":"2024-05-20T18:02:13.159055+0000","last_fullsized":"2024-05-20T18:02:13.159055+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:31:57.757145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.165951+0000","last_change":"2024-05-20T18:02:11.157250+0000","last_active":"2024-05-20T18:02:12.165951+0000","last_peered":"2024-05-20T18:02:12.165951+0000","last_clean":"2024-05-20T18:02:12.165951+0000","last_became_active":"2024-05-20T18:02:11.156918+0000","last_became_peered":"2024-05-20T18:02:11.156918+0000","last_unstale":"2024-05-20T18:02:12.165951+0000","last_undegraded":"2024-05-20T18:02:12.165951+0000","last_fullsized":"2024-05-20T18:02:12.165951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:05:59.288396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155453+0000","last_change":"2024-05-20T18:02:12.150752+0000","last_active":"2024-05-20T18:02:12.155453+0000","last_peered":"2024-05-20T18:02:12.155453+0000","last_clean":"2024-05-20T18:02:12.155453+0000","last_became_active":"2024-05-20T18:02:12.150182+0000","last_became_peered":"2024-05-20T18:02:12.150182+0000","last_unstale":"2024-05-20T18:02:12.155453+0000","last_undegraded":"2024-05-20T18:02:12.155453+0000","last_fullsized":"2024-05-20T18:02:12.155453+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:19.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"137'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140064+0000","last_change":"2024-05-20T18:02:11.148128+0000","last_active":"2024-05-20T18:02:14.140064+0000","last_peered":"2024-05-20T18:02:14.140064+0000","last_clean":"2024-05-20T18:02:14.140064+0000","last_became_active":"2024-05-20T18:02:11.147759+0000","last_became_peered":"2024-05-20T18:02:11.147759+0000","last_unstale":"2024-05-20T18:02:14.140064+0000","last_undegraded":"2024-05-20T18:02:14.140064+0000","last_fullsized":"2024-05-20T18:02:14.140064+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:46.131330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161707+0000","last_change":"2024-05-20T18:02:12.156044+0000","last_active":"2024-05-20T18:02:13.161707+0000","last_peered":"2024-05-20T18:02:13.161707+0000","last_clean":"2024-05-20T18:02:13.161707+0000","last_became_active":"2024-05-20T18:02:12.155626+0000","last_became_peered":"2024-05-20T18:02:12.155626+0000","last_unstale":"2024-05-20T18:02:13.161707+0000","last_undegraded":"2024-05-20T18:02:13.161707+0000","last_fullsized":"2024-05-20T18:02:13.161707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:32:28.088874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.137612+0000","last_change":"2024-05-20T18:02:11.147229+0000","last_active":"2024-05-20T18:02:12.137612+0000","last_peered":"2024-05-20T18:02:12.137612+0000","last_clean":"2024-05-20T18:02:12.137612+0000","last_became_active":"2024-05-20T18:02:11.146901+0000","last_became_peered":"2024-05-20T18:02:11.146901+0000","last_unstale":"2024-05-20T18:02:12.137612+0000","last_undegraded":"2024-05-20T18:02:12.137612+0000","last_fullsized":"2024-05-20T18:02:12.137612+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:16.315426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159274+0000","last_change":"2024-05-20T18:02:12.160062+0000","last_active":"2024-05-20T18:02:13.159274+0000","last_peered":"2024-05-20T18:02:13.159274+0000","last_clean":"2024-05-20T18:02:13.159274+0000","last_became_active":"2024-05-20T18:02:12.159684+0000","last_became_peered":"2024-05-20T18:02:12.159684+0000","last_unstale":"2024-05-20T18:02:13.159274+0000","last_undegraded":"2024-05-20T18:02:13.159274+0000","last_fullsized":"2024-05-20T18:02:13.159274+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:33.882657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159170+0000","last_change":"2024-05-20T18:02:11.156407+0000","last_active":"2024-05-20T18:02:13.159170+0000","last_peered":"2024-05-20T18:02:13.159170+0000","last_clean":"2024-05-20T18:02:13.159170+0000","last_became_active":"2024-05-20T18:02:11.156102+0000","last_became_peered":"2024-05-20T18:02:11.156102+0000","last_unstale":"2024-05-20T18:02:13.159170+0000","last_undegraded":"2024-05-20T18:02:13.159170+0000","last_fullsized":"2024-05-20T18:02:13.159170+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:13.701021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160283+0000","last_change":"2024-05-20T18:02:12.146913+0000","last_active":"2024-05-20T18:02:13.160283+0000","last_peered":"2024-05-20T18:02:13.160283+0000","last_clean":"2024-05-20T18:02:13.160283+0000","last_became_active":"2024-05-20T18:02:12.146560+0000","last_became_peered":"2024-05-20T18:02:12.146560+0000","last_unstale":"2024-05-20T18:02:13.160283+0000","last_undegraded":"2024-05-20T18:02:13.160283+0000","last_fullsized":"2024-05-20T18:02:13.160283+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:17.321515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160759+0000","last_change":"2024-05-20T18:02:11.150425+0000","last_active":"2024-05-20T18:02:13.160759+0000","last_peered":"2024-05-20T18:02:13.160759+0000","last_clean":"2024-05-20T18:02:13.160759+0000","last_became_active":"2024-05-20T18:02:11.150110+0000","last_became_peered":"2024-05-20T18:02:11.150110+0000","last_unstale":"2024-05-20T18:02:13.160759+0000","last_undegraded":"2024-05-20T18:02:13.160759+0000","last_fullsized":"2024-05-20T18:02:13.160759+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:10:49.366403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.168056+0000","last_change":"2024-05-20T18:02:12.166814+0000","last_active":"2024-05-20T18:02:12.168056+0000","last_peered":"2024-05-20T18:02:12.168056+0000","last_clean":"2024-05-20T18:02:12.168056+0000","last_became_active":"2024-05-20T18:02:12.166459+0000","last_became_peered":"2024-05-20T18:02:12.166459+0000","last_unstale":"2024-05-20T18:02:12.168056+0000","last_undegraded":"2024-05-20T18:02:12.168056+0000","last_fullsized":"2024-05-20T18:02:12.168056+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:47:01.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.138357+0000","last_change":"2024-05-20T18:02:11.154890+0000","last_active":"2024-05-20T18:02:12.138357+0000","last_peered":"2024-05-20T18:02:12.138357+0000","last_clean":"2024-05-20T18:02:12.138357+0000","last_became_active":"2024-05-20T18:02:11.154527+0000","last_became_peered":"2024-05-20T18:02:11.154527+0000","last_unstale":"2024-05-20T18:02:12.138357+0000","last_undegraded":"2024-05-20T18:02:12.138357+0000","last_fullsized":"2024-05-20T18:02:12.138357+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:17.274732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.153694+0000","last_change":"2024-05-20T18:02:12.147688+0000","last_active":"2024-05-20T18:02:12.153694+0000","last_peered":"2024-05-20T18:02:12.153694+0000","last_clean":"2024-05-20T18:02:12.153694+0000","last_became_active":"2024-05-20T18:02:12.147384+0000","last_became_peered":"2024-05-20T18:02:12.147384+0000","last_unstale":"2024-05-20T18:02:12.153694+0000","last_undegraded":"2024-05-20T18:02:12.153694+0000","last_fullsized":"2024-05-20T18:02:12.153694+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:40.591958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160093+0000","last_change":"2024-05-20T18:02:11.152851+0000","last_active":"2024-05-20T18:02:13.160093+0000","last_peered":"2024-05-20T18:02:13.160093+0000","last_clean":"2024-05-20T18:02:13.160093+0000","last_became_active":"2024-05-20T18:02:11.152483+0000","last_became_peered":"2024-05-20T18:02:11.152483+0000","last_unstale":"2024-05-20T18:02:13.160093+0000","last_undegraded":"2024-05-20T18:02:13.160093+0000","last_fullsized":"2024-05-20T18:02:13.160093+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:57.355050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160697+0000","last_change":"2024-05-20T18:02:12.163607+0000","last_active":"2024-05-20T18:02:13.160697+0000","last_peered":"2024-05-20T18:02:13.160697+0000","last_clean":"2024-05-20T18:02:13.160697+0000","last_became_active":"2024-05-20T18:02:12.163287+0000","last_became_peered":"2024-05-20T18:02:12.163287+0000","last_unstale":"2024-05-20T18:02:13.160697+0000","last_undegraded":"2024-05-20T18:02:13.160697+0000","last_fullsized":"2024-05-20T18:02:13.160697+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:40.591958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140654+0000","last_change":"2024-05-20T18:02:11.150921+0000","last_active":"2024-05-20T18:02:14.140654+0000","last_peered":"2024-05-20T18:02:14.140654+0000","last_clean":"2024-05-20T18:02:14.140654+0000","last_became_active":"2024-05-20T18:02:11.150636+0000","last_became_peered":"2024-05-20T18:02:11.150636+0000","last_unstale":"2024-05-20T18:02:14.140654+0000","last_undegraded":"2024-05-20T18:02:14.140654+0000","last_fullsized":"2024-05-20T18:02:14.140654+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:52:56.254944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160782+0000","last_change":"2024-05-20T18:02:12.146413+0000","last_active":"2024-05-20T18:02:13.160782+0000","last_peered":"2024-05-20T18:02:13.160782+0000","last_clean":"2024-05-20T18:02:13.160782+0000","last_became_active":"2024-05-20T18:02:12.144532+0000","last_became_peered":"2024-05-20T18:02:12.144532+0000","last_unstale":"2024-05-20T18:02:13.160782+0000","last_undegraded":"2024-05-20T18:02:13.160782+0000","last_fullsized":"2024-05-20T18:02:13.160782+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:49.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"136'6","reported_seq":20,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255448+0000","last_change":"2024-05-20T18:02:11.151042+0000","last_active":"2024-05-20T18:02:14.255448+0000","last_peered":"2024-05-20T18:02:14.255448+0000","last_clean":"2024-05-20T18:02:14.255448+0000","last_became_active":"2024-05-20T18:02:11.150666+0000","last_became_peered":"2024-05-20T18:02:11.150666+0000","last_unstale":"2024-05-20T18:02:14.255448+0000","last_undegraded":"2024-05-20T18:02:14.255448+0000","last_fullsized":"2024-05-20T18:02:14.255448+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:49.044816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":384,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140803+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:02:14.140803+0000","last_peered":"2024-05-20T18:02:14.140803+0000","last_clean":"2024-05-20T18:02:14.140803+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:02:14.140803+0000","last_undegraded":"2024-05-20T18:02:14.140803+0000","last_fullsized":"2024-05-20T18:02:14.140803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33436,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338404,"statfs":{"total":96636764160,"available":96602525696,"internally_reserved":0,"allocated":2306048,"data_stored":1381669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37012,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334828,"statfs":{"total":96636764160,"available":96598863872,"internally_reserved":0,"allocated":1712128,"data_stored":791349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1720320,"data_stored":797971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1732608,"data_stored":799583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1728512,"data_stored":798587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1716224,"data_stored":791391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32856,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338984,"statfs":{"total":96636764160,"available":96603119616,"internally_reserved":0,"allocated":1712128,"data_stored":791349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2338816,"data_stored":1390657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:02:16.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:02:16.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.377+0000 7f89dfa79640 1 Processor -- start 2024-05-20T18:02:16.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.377+0000 7f89dfa79640 1 -- start start 2024-05-20T18:02:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dfa79640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89d806d3d0 0x7f89d806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dfa79640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f89d80b8190 0x7f89d80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dfa79640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d806dd20 con 0x7f89d8162820 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dfa79640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f89d80d0630 con 0x7f89d806d3d0 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dfa79640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f89d80d39c0 con 0x7f89d80b8190 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dd014640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89d806d3d0 0x7f89d806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dd014640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f89d806d3d0 0x7f89d806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55862/0 (socket says 172.21.15.6:55862) 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dd014640 1 -- 172.21.15.6:0/2410372705 learned_addr learned my addr 172.21.15.6:0/2410372705 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89de016640 1 --2- 172.21.15.6:0/2410372705 >> v2:172.21.15.171:3300/0 conn(0x7f89d80b8190 0x7f89d80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dd014640 1 -- 172.21.15.6:0/2410372705 >> v2:172.21.15.171:3300/0 conn(0x7f89d80b8190 msgr2=0x7f89d80b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dd014640 1 --2- 172.21.15.6:0/2410372705 >> v2:172.21.15.171:3300/0 conn(0x7f89d80b8190 0x7f89d80b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dd014640 1 -- 172.21.15.6:0/2410372705 >> v1:172.21.15.171:6789/0 conn(0x7f89d8162820 legacy=0x7f89d80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89dd014640 1 -- 172.21.15.6:0/2410372705 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d80d3ca0 con 0x7f89d806d3d0 2024-05-20T18:02:16.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.379+0000 7f89de016640 1 --2- 172.21.15.6:0/2410372705 >> v2:172.21.15.171:3300/0 conn(0x7f89d80b8190 0x7f89d80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:16.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.380+0000 7f89dd014640 1 --2- 172.21.15.6:0/2410372705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d806d7e0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f89d808e070 tx=0x7f89cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d29b60c264f6f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.380+0000 7f89dc813640 1 -- 172.21.15.6:0/2410372705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc037070 con 0x7f89d806d3d0 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.380+0000 7f89dc813640 1 -- 172.21.15.6:0/2410372705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc032440 con 0x7f89d806d3d0 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.380+0000 7f89dc813640 1 -- 172.21.15.6:0/2410372705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc032810 con 0x7f89d806d3d0 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.381+0000 7f89dfa79640 1 -- 172.21.15.6:0/2410372705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 msgr2=0x7f89d806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.381+0000 7f89dfa79640 1 --2- 172.21.15.6:0/2410372705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d806d7e0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f89d808e070 tx=0x7f89cc02a270 comp rx=0 tx=0).stop 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.381+0000 7f89dfa79640 1 -- 172.21.15.6:0/2410372705 shutdown_connections 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.381+0000 7f89dfa79640 1 --2- 172.21.15.6:0/2410372705 >> v2:172.21.15.171:3300/0 conn(0x7f89d80b8190 0x7f89d80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.381+0000 7f89dfa79640 1 --2- 172.21.15.6:0/2410372705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d806d7e0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.381+0000 7f89dfa79640 1 -- 172.21.15.6:0/2410372705 >> 172.21.15.6:0/2410372705 conn(0x7f89d80d4bd0 msgr2=0x7f89d80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.381+0000 7f89dfa79640 1 -- 172.21.15.6:0/2410372705 shutdown_connections 2024-05-20T18:02:16.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.381+0000 7f89dfa79640 1 -- 172.21.15.6:0/2410372705 wait complete. 2024-05-20T18:02:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.383+0000 7f89dfa79640 1 Processor -- start 2024-05-20T18:02:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.383+0000 7f89dfa79640 1 -- start start 2024-05-20T18:02:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dfa79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d8155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dfa79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89d80b8190 0x7f89d80c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dfa79640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89d8162820 0x7f89d80b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dfa79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f89d80d0300 con 0x7f89d806d3d0 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dfa79640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89d80d4260 con 0x7f89d8162820 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dfa79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89d80b4050 con 0x7f89d80b8190 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dd815640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d8155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dd815640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d8155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55872/0 (socket says 172.21.15.6:55872) 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dd815640 1 -- 172.21.15.6:0/749938861 learned_addr learned my addr 172.21.15.6:0/749938861 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89dd014640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89d80b8190 0x7f89d80c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.384+0000 7f89de016640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89d8162820 0x7f89d80b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89dd815640 1 -- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89d80b8190 msgr2=0x7f89d80c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89dd815640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89d80b8190 0x7f89d80c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89dd815640 1 -- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89d8162820 msgr2=0x7f89d80b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89dd815640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89d8162820 0x7f89d80b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89dd815640 1 -- 172.21.15.6:0/749938861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d80c87a0 con 0x7f89d806d3d0 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89de016640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89d8162820 0x7f89d80b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89dd815640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d8155dc0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c760 tx=0x7f89c800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89d67fc640 1 -- 172.21.15.6:0/749938861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8016020 con 0x7f89d806d3d0 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89d67fc640 1 -- 172.21.15.6:0/749938861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c8006d50 con 0x7f89d806d3d0 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d8156300 con 0x7f89d806d3d0 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89d67fc640 1 -- 172.21.15.6:0/749938861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8003bb0 con 0x7f89d806d3d0 2024-05-20T18:02:16.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.385+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d80c8d60 con 0x7f89d806d3d0 2024-05-20T18:02:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.386+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d8075b00 con 0x7f89d806d3d0 2024-05-20T18:02:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.387+0000 7f89d67fc640 1 -- 172.21.15.6:0/749938861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89c800a850 con 0x7f89d806d3d0 2024-05-20T18:02:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.387+0000 7f89d67fc640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89c406be30 0x7f89c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.388+0000 7f89d67fc640 1 -- 172.21.15.6:0/749938861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f89c808ab20 con 0x7f89d806d3d0 2024-05-20T18:02:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.388+0000 7f89dd014640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89c406be30 0x7f89c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.388+0000 7f89dd014640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89c406be30 0x7f89c406e340 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f89cc034000 tx=0x7f89cc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.392+0000 7f89d67fc640 1 -- 172.21.15.6:0/749938861 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f89c8020020 con 0x7f89d806d3d0 2024-05-20T18:02:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.573+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89d80cade0 con 0x7f89c406be30 2024-05-20T18:02:16.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.580+0000 7f89d67fc640 1 -- 172.21.15.6:0/749938861 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252461 (secure 0 0 0) 0x7f89d80cade0 con 0x7f89c406be30 2024-05-20T18:02:16.580 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:16.581 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:02:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.582+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89c406be30 msgr2=0x7f89c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.582+0000 7f89dfa79640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89c406be30 0x7f89c406e340 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f89cc034000 tx=0x7f89cc02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.582+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 msgr2=0x7f89d8155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.582+0000 7f89dfa79640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d8155dc0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c760 tx=0x7f89c800cc20 comp rx=0 tx=0).stop 2024-05-20T18:02:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.583+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 shutdown_connections 2024-05-20T18:02:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.583+0000 7f89dfa79640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f89c406be30 0x7f89c406e340 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.583+0000 7f89dfa79640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89d8162820 0x7f89d80b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.583+0000 7f89dfa79640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89d80b8190 0x7f89d80c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.583+0000 7f89dfa79640 1 --2- 172.21.15.6:0/749938861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89d806d3d0 0x7f89d8155dc0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.583+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 >> 172.21.15.6:0/749938861 conn(0x7f89d80d4bd0 msgr2=0x7f89d80cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.583+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 shutdown_connections 2024-05-20T18:02:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.583+0000 7f89dfa79640 1 -- 172.21.15.6:0/749938861 wait complete. 2024-05-20T18:02:16.592 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-05-20T18:02:16.375477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272412,"kb_used_data":14616,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702308,"statfs":{"total":773094113280,"available":772815163392,"internally_reserved":0,"allocated":14966784,"data_stored":7542556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001408"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161059+0000","last_change":"2024-05-20T18:02:12.149205+0000","last_active":"2024-05-20T18:02:13.161059+0000","last_peered":"2024-05-20T18:02:13.161059+0000","last_clean":"2024-05-20T18:02:13.161059+0000","last_became_active":"2024-05-20T18:02:12.148873+0000","last_became_peered":"2024-05-20T18:02:12.148873+0000","last_unstale":"2024-05-20T18:02:13.161059+0000","last_undegraded":"2024-05-20T18:02:13.161059+0000","last_fullsized":"2024-05-20T18:02:13.161059+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:47:01.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.163521+0000","last_change":"2024-05-20T18:02:12.155235+0000","last_active":"2024-05-20T18:02:12.163521+0000","last_peered":"2024-05-20T18:02:12.163521+0000","last_clean":"2024-05-20T18:02:12.163521+0000","last_became_active":"2024-05-20T18:02:12.154902+0000","last_became_peered":"2024-05-20T18:02:12.154902+0000","last_unstale":"2024-05-20T18:02:12.163521+0000","last_undegraded":"2024-05-20T18:02:12.163521+0000","last_fullsized":"2024-05-20T18:02:12.163521+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:47:01.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.156495+0000","last_change":"2024-05-20T18:02:12.150937+0000","last_active":"2024-05-20T18:02:12.156495+0000","last_peered":"2024-05-20T18:02:12.156495+0000","last_clean":"2024-05-20T18:02:12.156495+0000","last_became_active":"2024-05-20T18:02:12.150628+0000","last_became_peered":"2024-05-20T18:02:12.150628+0000","last_unstale":"2024-05-20T18:02:12.156495+0000","last_undegraded":"2024-05-20T18:02:12.156495+0000","last_fullsized":"2024-05-20T18:02:12.156495+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:14.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155478+0000","last_change":"2024-05-20T18:02:12.149499+0000","last_active":"2024-05-20T18:02:12.155478+0000","last_peered":"2024-05-20T18:02:12.155478+0000","last_clean":"2024-05-20T18:02:12.155478+0000","last_became_active":"2024-05-20T18:02:12.149175+0000","last_became_peered":"2024-05-20T18:02:12.149175+0000","last_unstale":"2024-05-20T18:02:12.155478+0000","last_undegraded":"2024-05-20T18:02:12.155478+0000","last_fullsized":"2024-05-20T18:02:12.155478+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:49.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159145+0000","last_change":"2024-05-20T18:02:12.161557+0000","last_active":"2024-05-20T18:02:13.159145+0000","last_peered":"2024-05-20T18:02:13.159145+0000","last_clean":"2024-05-20T18:02:13.159145+0000","last_became_active":"2024-05-20T18:02:12.160538+0000","last_became_peered":"2024-05-20T18:02:12.160538+0000","last_unstale":"2024-05-20T18:02:13.159145+0000","last_undegraded":"2024-05-20T18:02:13.159145+0000","last_fullsized":"2024-05-20T18:02:13.159145+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:27:35.169332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159188+0000","last_change":"2024-05-20T18:02:12.161144+0000","last_active":"2024-05-20T18:02:13.159188+0000","last_peered":"2024-05-20T18:02:13.159188+0000","last_clean":"2024-05-20T18:02:13.159188+0000","last_became_active":"2024-05-20T18:02:12.160859+0000","last_became_peered":"2024-05-20T18:02:12.160859+0000","last_unstale":"2024-05-20T18:02:13.159188+0000","last_undegraded":"2024-05-20T18:02:13.159188+0000","last_fullsized":"2024-05-20T18:02:13.159188+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:16.126148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159871+0000","last_change":"2024-05-20T18:02:12.151245+0000","last_active":"2024-05-20T18:02:13.159871+0000","last_peered":"2024-05-20T18:02:13.159871+0000","last_clean":"2024-05-20T18:02:13.159871+0000","last_became_active":"2024-05-20T18:02:12.150927+0000","last_became_peered":"2024-05-20T18:02:12.150927+0000","last_unstale":"2024-05-20T18:02:13.159871+0000","last_undegraded":"2024-05-20T18:02:13.159871+0000","last_fullsized":"2024-05-20T18:02:13.159871+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:31:13.636171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159627+0000","last_change":"2024-05-20T18:02:12.143728+0000","last_active":"2024-05-20T18:02:13.159627+0000","last_peered":"2024-05-20T18:02:13.159627+0000","last_clean":"2024-05-20T18:02:13.159627+0000","last_became_active":"2024-05-20T18:02:12.143197+0000","last_became_peered":"2024-05-20T18:02:12.143197+0000","last_unstale":"2024-05-20T18:02:13.159627+0000","last_undegraded":"2024-05-20T18:02:13.159627+0000","last_fullsized":"2024-05-20T18:02:13.159627+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:17:34.162608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159242+0000","last_change":"2024-05-20T18:02:12.160712+0000","last_active":"2024-05-20T18:02:13.159242+0000","last_peered":"2024-05-20T18:02:13.159242+0000","last_clean":"2024-05-20T18:02:13.159242+0000","last_became_active":"2024-05-20T18:02:12.160381+0000","last_became_peered":"2024-05-20T18:02:12.160381+0000","last_unstale":"2024-05-20T18:02:13.159242+0000","last_undegraded":"2024-05-20T18:02:13.159242+0000","last_fullsized":"2024-05-20T18:02:13.159242+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:08.180732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159501+0000","last_change":"2024-05-20T18:02:12.159415+0000","last_active":"2024-05-20T18:02:13.159501+0000","last_peered":"2024-05-20T18:02:13.159501+0000","last_clean":"2024-05-20T18:02:13.159501+0000","last_became_active":"2024-05-20T18:02:12.158922+0000","last_became_peered":"2024-05-20T18:02:12.158922+0000","last_unstale":"2024-05-20T18:02:13.159501+0000","last_undegraded":"2024-05-20T18:02:13.159501+0000","last_fullsized":"2024-05-20T18:02:13.159501+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:46:32.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.159263+0000","last_change":"2024-05-20T18:02:12.155039+0000","last_active":"2024-05-20T18:02:12.159263+0000","last_peered":"2024-05-20T18:02:12.159263+0000","last_clean":"2024-05-20T18:02:12.159263+0000","last_became_active":"2024-05-20T18:02:12.154731+0000","last_became_peered":"2024-05-20T18:02:12.154731+0000","last_unstale":"2024-05-20T18:02:12.159263+0000","last_undegraded":"2024-05-20T18:02:12.159263+0000","last_fullsized":"2024-05-20T18:02:12.159263+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:22:28.285395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.166676+0000","last_change":"2024-05-20T18:02:12.162163+0000","last_active":"2024-05-20T18:02:12.166676+0000","last_peered":"2024-05-20T18:02:12.166676+0000","last_clean":"2024-05-20T18:02:12.166676+0000","last_became_active":"2024-05-20T18:02:12.161856+0000","last_became_peered":"2024-05-20T18:02:12.161856+0000","last_unstale":"2024-05-20T18:02:12.166676+0000","last_undegraded":"2024-05-20T18:02:12.166676+0000","last_fullsized":"2024-05-20T18:02:12.166676+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:14.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158934+0000","last_change":"2024-05-20T18:02:12.166927+0000","last_active":"2024-05-20T18:02:13.158934+0000","last_peered":"2024-05-20T18:02:13.158934+0000","last_clean":"2024-05-20T18:02:13.158934+0000","last_became_active":"2024-05-20T18:02:12.166556+0000","last_became_peered":"2024-05-20T18:02:12.166556+0000","last_unstale":"2024-05-20T18:02:13.158934+0000","last_undegraded":"2024-05-20T18:02:13.158934+0000","last_fullsized":"2024-05-20T18:02:13.158934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:36:15.063213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.166585+0000","last_change":"2024-05-20T18:02:12.164249+0000","last_active":"2024-05-20T18:02:12.166585+0000","last_peered":"2024-05-20T18:02:12.166585+0000","last_clean":"2024-05-20T18:02:12.166585+0000","last_became_active":"2024-05-20T18:02:12.163934+0000","last_became_peered":"2024-05-20T18:02:12.163934+0000","last_unstale":"2024-05-20T18:02:12.166585+0000","last_undegraded":"2024-05-20T18:02:12.166585+0000","last_fullsized":"2024-05-20T18:02:12.166585+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:17:29.492527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.163676+0000","last_change":"2024-05-20T18:02:12.156187+0000","last_active":"2024-05-20T18:02:12.163676+0000","last_peered":"2024-05-20T18:02:12.163676+0000","last_clean":"2024-05-20T18:02:12.163676+0000","last_became_active":"2024-05-20T18:02:12.154130+0000","last_became_peered":"2024-05-20T18:02:12.154130+0000","last_unstale":"2024-05-20T18:02:12.163676+0000","last_undegraded":"2024-05-20T18:02:12.163676+0000","last_fullsized":"2024-05-20T18:02:12.163676+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:27.928918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158668+0000","last_change":"2024-05-20T18:02:12.163898+0000","last_active":"2024-05-20T18:02:13.158668+0000","last_peered":"2024-05-20T18:02:13.158668+0000","last_clean":"2024-05-20T18:02:13.158668+0000","last_became_active":"2024-05-20T18:02:12.163544+0000","last_became_peered":"2024-05-20T18:02:12.163544+0000","last_unstale":"2024-05-20T18:02:13.158668+0000","last_undegraded":"2024-05-20T18:02:13.158668+0000","last_fullsized":"2024-05-20T18:02:13.158668+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:25.892292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.168041+0000","last_change":"2024-05-20T18:02:12.166881+0000","last_active":"2024-05-20T18:02:12.168041+0000","last_peered":"2024-05-20T18:02:12.168041+0000","last_clean":"2024-05-20T18:02:12.168041+0000","last_became_active":"2024-05-20T18:02:12.166526+0000","last_became_peered":"2024-05-20T18:02:12.166526+0000","last_unstale":"2024-05-20T18:02:12.168041+0000","last_undegraded":"2024-05-20T18:02:12.168041+0000","last_fullsized":"2024-05-20T18:02:12.168041+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:12:09.836870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.160571+0000","last_change":"2024-05-20T18:02:12.155820+0000","last_active":"2024-05-20T18:02:12.160571+0000","last_peered":"2024-05-20T18:02:12.160571+0000","last_clean":"2024-05-20T18:02:12.160571+0000","last_became_active":"2024-05-20T18:02:12.155540+0000","last_became_peered":"2024-05-20T18:02:12.155540+0000","last_unstale":"2024-05-20T18:02:12.160571+0000","last_undegraded":"2024-05-20T18:02:12.160571+0000","last_fullsized":"2024-05-20T18:02:12.160571+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:26:38.797868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141067+0000","last_change":"2024-05-20T18:02:12.161484+0000","last_active":"2024-05-20T18:02:14.141067+0000","last_peered":"2024-05-20T18:02:14.141067+0000","last_clean":"2024-05-20T18:02:14.141067+0000","last_became_active":"2024-05-20T18:02:12.160800+0000","last_became_peered":"2024-05-20T18:02:12.160800+0000","last_unstale":"2024-05-20T18:02:14.141067+0000","last_undegraded":"2024-05-20T18:02:14.141067+0000","last_fullsized":"2024-05-20T18:02:14.141067+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:27:53.780079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255412+0000","last_change":"2024-05-20T18:02:12.158055+0000","last_active":"2024-05-20T18:02:14.255412+0000","last_peered":"2024-05-20T18:02:14.255412+0000","last_clean":"2024-05-20T18:02:14.255412+0000","last_became_active":"2024-05-20T18:02:12.157759+0000","last_became_peered":"2024-05-20T18:02:12.157759+0000","last_unstale":"2024-05-20T18:02:14.255412+0000","last_undegraded":"2024-05-20T18:02:14.255412+0000","last_fullsized":"2024-05-20T18:02:14.255412+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:14:49.066464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158968+0000","last_change":"2024-05-20T18:02:12.156265+0000","last_active":"2024-05-20T18:02:13.158968+0000","last_peered":"2024-05-20T18:02:13.158968+0000","last_clean":"2024-05-20T18:02:13.158968+0000","last_became_active":"2024-05-20T18:02:12.152272+0000","last_became_peered":"2024-05-20T18:02:12.152272+0000","last_unstale":"2024-05-20T18:02:13.158968+0000","last_undegraded":"2024-05-20T18:02:13.158968+0000","last_fullsized":"2024-05-20T18:02:13.158968+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:53:32.169356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160362+0000","last_change":"2024-05-20T18:02:12.151987+0000","last_active":"2024-05-20T18:02:13.160362+0000","last_peered":"2024-05-20T18:02:13.160362+0000","last_clean":"2024-05-20T18:02:13.160362+0000","last_became_active":"2024-05-20T18:02:12.151677+0000","last_became_peered":"2024-05-20T18:02:12.151677+0000","last_unstale":"2024-05-20T18:02:13.160362+0000","last_undegraded":"2024-05-20T18:02:13.160362+0000","last_fullsized":"2024-05-20T18:02:13.160362+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:14.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160836+0000","last_change":"2024-05-20T18:02:12.151020+0000","last_active":"2024-05-20T18:02:13.160836+0000","last_peered":"2024-05-20T18:02:13.160836+0000","last_clean":"2024-05-20T18:02:13.160836+0000","last_became_active":"2024-05-20T18:02:12.150710+0000","last_became_peered":"2024-05-20T18:02:12.150710+0000","last_unstale":"2024-05-20T18:02:13.160836+0000","last_undegraded":"2024-05-20T18:02:13.160836+0000","last_fullsized":"2024-05-20T18:02:13.160836+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:19.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.166211+0000","last_change":"2024-05-20T18:02:12.163659+0000","last_active":"2024-05-20T18:02:12.166211+0000","last_peered":"2024-05-20T18:02:12.166211+0000","last_clean":"2024-05-20T18:02:12.166211+0000","last_became_active":"2024-05-20T18:02:12.162161+0000","last_became_peered":"2024-05-20T18:02:12.162161+0000","last_unstale":"2024-05-20T18:02:12.166211+0000","last_undegraded":"2024-05-20T18:02:12.166211+0000","last_fullsized":"2024-05-20T18:02:12.166211+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:02:07.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161244+0000","last_change":"2024-05-20T18:02:12.150686+0000","last_active":"2024-05-20T18:02:13.161244+0000","last_peered":"2024-05-20T18:02:13.161244+0000","last_clean":"2024-05-20T18:02:13.161244+0000","last_became_active":"2024-05-20T18:02:12.150330+0000","last_became_peered":"2024-05-20T18:02:12.150330+0000","last_unstale":"2024-05-20T18:02:13.161244+0000","last_undegraded":"2024-05-20T18:02:13.161244+0000","last_fullsized":"2024-05-20T18:02:13.161244+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:01:27.928918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161194+0000","last_change":"2024-05-20T18:02:12.164624+0000","last_active":"2024-05-20T18:02:13.161194+0000","last_peered":"2024-05-20T18:02:13.161194+0000","last_clean":"2024-05-20T18:02:13.161194+0000","last_became_active":"2024-05-20T18:02:12.162281+0000","last_became_peered":"2024-05-20T18:02:12.162281+0000","last_unstale":"2024-05-20T18:02:13.161194+0000","last_undegraded":"2024-05-20T18:02:13.161194+0000","last_fullsized":"2024-05-20T18:02:13.161194+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:12:09.836870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159073+0000","last_change":"2024-05-20T18:02:12.150778+0000","last_active":"2024-05-20T18:02:13.159073+0000","last_peered":"2024-05-20T18:02:13.159073+0000","last_clean":"2024-05-20T18:02:13.159073+0000","last_became_active":"2024-05-20T18:02:12.149355+0000","last_became_peered":"2024-05-20T18:02:12.149355+0000","last_unstale":"2024-05-20T18:02:13.159073+0000","last_undegraded":"2024-05-20T18:02:13.159073+0000","last_fullsized":"2024-05-20T18:02:13.159073+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:05:17.575860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.154049+0000","last_change":"2024-05-20T18:02:12.149162+0000","last_active":"2024-05-20T18:02:12.154049+0000","last_peered":"2024-05-20T18:02:12.154049+0000","last_clean":"2024-05-20T18:02:12.154049+0000","last_became_active":"2024-05-20T18:02:12.148854+0000","last_became_peered":"2024-05-20T18:02:12.148854+0000","last_unstale":"2024-05-20T18:02:12.154049+0000","last_undegraded":"2024-05-20T18:02:12.154049+0000","last_fullsized":"2024-05-20T18:02:12.154049+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:02.729609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160184+0000","last_change":"2024-05-20T18:02:12.152841+0000","last_active":"2024-05-20T18:02:13.160184+0000","last_peered":"2024-05-20T18:02:13.160184+0000","last_clean":"2024-05-20T18:02:13.160184+0000","last_became_active":"2024-05-20T18:02:12.152507+0000","last_became_peered":"2024-05-20T18:02:12.152507+0000","last_unstale":"2024-05-20T18:02:13.160184+0000","last_undegraded":"2024-05-20T18:02:13.160184+0000","last_fullsized":"2024-05-20T18:02:13.160184+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:33:13.570772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.160095+0000","last_change":"2024-05-20T18:02:12.155945+0000","last_active":"2024-05-20T18:02:12.160095+0000","last_peered":"2024-05-20T18:02:12.160095+0000","last_clean":"2024-05-20T18:02:12.160095+0000","last_became_active":"2024-05-20T18:02:12.155477+0000","last_became_peered":"2024-05-20T18:02:12.155477+0000","last_unstale":"2024-05-20T18:02:12.160095+0000","last_undegraded":"2024-05-20T18:02:12.160095+0000","last_fullsized":"2024-05-20T18:02:12.160095+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:07:07.059232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158675+0000","last_change":"2024-05-20T18:02:12.164517+0000","last_active":"2024-05-20T18:02:13.158675+0000","last_peered":"2024-05-20T18:02:13.158675+0000","last_clean":"2024-05-20T18:02:13.158675+0000","last_became_active":"2024-05-20T18:02:12.164193+0000","last_became_peered":"2024-05-20T18:02:12.164193+0000","last_unstale":"2024-05-20T18:02:13.158675+0000","last_undegraded":"2024-05-20T18:02:13.158675+0000","last_fullsized":"2024-05-20T18:02:13.158675+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:27:53.780079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160937+0000","last_change":"2024-05-20T18:02:12.144841+0000","last_active":"2024-05-20T18:02:13.160937+0000","last_peered":"2024-05-20T18:02:13.160937+0000","last_clean":"2024-05-20T18:02:13.160937+0000","last_became_active":"2024-05-20T18:02:12.144463+0000","last_became_peered":"2024-05-20T18:02:12.144463+0000","last_unstale":"2024-05-20T18:02:13.160937+0000","last_undegraded":"2024-05-20T18:02:13.160937+0000","last_fullsized":"2024-05-20T18:02:13.160937+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:31:13.636171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155877+0000","last_change":"2024-05-20T18:02:12.149580+0000","last_active":"2024-05-20T18:02:12.155877+0000","last_peered":"2024-05-20T18:02:12.155877+0000","last_clean":"2024-05-20T18:02:12.155877+0000","last_became_active":"2024-05-20T18:02:12.149246+0000","last_became_peered":"2024-05-20T18:02:12.149246+0000","last_unstale":"2024-05-20T18:02:12.155877+0000","last_undegraded":"2024-05-20T18:02:12.155877+0000","last_fullsized":"2024-05-20T18:02:12.155877+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:31:13.636171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"136'4","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159371+0000","last_change":"2024-05-20T18:02:11.153964+0000","last_active":"2024-05-20T18:02:13.159371+0000","last_peered":"2024-05-20T18:02:13.159371+0000","last_clean":"2024-05-20T18:02:13.159371+0000","last_became_active":"2024-05-20T18:02:11.153649+0000","last_became_peered":"2024-05-20T18:02:11.153649+0000","last_unstale":"2024-05-20T18:02:13.159371+0000","last_undegraded":"2024-05-20T18:02:13.159371+0000","last_fullsized":"2024-05-20T18:02:13.159371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:51:50.446430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.163473+0000","last_change":"2024-05-20T18:02:12.153593+0000","last_active":"2024-05-20T18:02:12.163473+0000","last_peered":"2024-05-20T18:02:12.163473+0000","last_clean":"2024-05-20T18:02:12.163473+0000","last_became_active":"2024-05-20T18:02:12.153238+0000","last_became_peered":"2024-05-20T18:02:12.153238+0000","last_unstale":"2024-05-20T18:02:12.163473+0000","last_undegraded":"2024-05-20T18:02:12.163473+0000","last_fullsized":"2024-05-20T18:02:12.163473+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:26:53.011849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140727+0000","last_change":"2024-05-20T18:02:11.147913+0000","last_active":"2024-05-20T18:02:14.140727+0000","last_peered":"2024-05-20T18:02:14.140727+0000","last_clean":"2024-05-20T18:02:14.140727+0000","last_became_active":"2024-05-20T18:02:11.147620+0000","last_became_peered":"2024-05-20T18:02:11.147620+0000","last_unstale":"2024-05-20T18:02:14.140727+0000","last_undegraded":"2024-05-20T18:02:14.140727+0000","last_fullsized":"2024-05-20T18:02:14.140727+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:13.701021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159815+0000","last_change":"2024-05-20T18:02:12.157510+0000","last_active":"2024-05-20T18:02:13.159815+0000","last_peered":"2024-05-20T18:02:13.159815+0000","last_clean":"2024-05-20T18:02:13.159815+0000","last_became_active":"2024-05-20T18:02:12.155354+0000","last_became_peered":"2024-05-20T18:02:12.155354+0000","last_unstale":"2024-05-20T18:02:13.159815+0000","last_undegraded":"2024-05-20T18:02:13.159815+0000","last_fullsized":"2024-05-20T18:02:13.159815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:09:59.880114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141168+0000","last_change":"2024-05-20T18:02:11.148664+0000","last_active":"2024-05-20T18:02:14.141168+0000","last_peered":"2024-05-20T18:02:14.141168+0000","last_clean":"2024-05-20T18:02:14.141168+0000","last_became_active":"2024-05-20T18:02:11.148366+0000","last_became_peered":"2024-05-20T18:02:11.148366+0000","last_unstale":"2024-05-20T18:02:14.141168+0000","last_undegraded":"2024-05-20T18:02:14.141168+0000","last_fullsized":"2024-05-20T18:02:14.141168+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:41:11.804758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141113+0000","last_change":"2024-05-20T18:02:12.152569+0000","last_active":"2024-05-20T18:02:14.141113+0000","last_peered":"2024-05-20T18:02:14.141113+0000","last_clean":"2024-05-20T18:02:14.141113+0000","last_became_active":"2024-05-20T18:02:12.152116+0000","last_became_peered":"2024-05-20T18:02:12.152116+0000","last_unstale":"2024-05-20T18:02:14.141113+0000","last_undegraded":"2024-05-20T18:02:14.141113+0000","last_fullsized":"2024-05-20T18:02:14.141113+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:14:49.066464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.164488+0000","last_change":"2024-05-20T18:02:11.141982+0000","last_active":"2024-05-20T18:02:12.164488+0000","last_peered":"2024-05-20T18:02:12.164488+0000","last_clean":"2024-05-20T18:02:12.164488+0000","last_became_active":"2024-05-20T18:02:11.141599+0000","last_became_peered":"2024-05-20T18:02:11.141599+0000","last_unstale":"2024-05-20T18:02:12.164488+0000","last_undegraded":"2024-05-20T18:02:12.164488+0000","last_fullsized":"2024-05-20T18:02:12.164488+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:46:39.664621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255331+0000","last_change":"2024-05-20T18:02:12.157923+0000","last_active":"2024-05-20T18:02:14.255331+0000","last_peered":"2024-05-20T18:02:14.255331+0000","last_clean":"2024-05-20T18:02:14.255331+0000","last_became_active":"2024-05-20T18:02:12.157587+0000","last_became_peered":"2024-05-20T18:02:12.157587+0000","last_unstale":"2024-05-20T18:02:14.255331+0000","last_undegraded":"2024-05-20T18:02:14.255331+0000","last_fullsized":"2024-05-20T18:02:14.255331+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:27:53.780079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160311+0000","last_change":"2024-05-20T18:02:11.149426+0000","last_active":"2024-05-20T18:02:13.160311+0000","last_peered":"2024-05-20T18:02:13.160311+0000","last_clean":"2024-05-20T18:02:13.160311+0000","last_became_active":"2024-05-20T18:02:11.149109+0000","last_became_peered":"2024-05-20T18:02:11.149109+0000","last_unstale":"2024-05-20T18:02:13.160311+0000","last_undegraded":"2024-05-20T18:02:13.160311+0000","last_fullsized":"2024-05-20T18:02:13.160311+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:46:25.262299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155513+0000","last_change":"2024-05-20T18:02:12.151015+0000","last_active":"2024-05-20T18:02:12.155513+0000","last_peered":"2024-05-20T18:02:12.155513+0000","last_clean":"2024-05-20T18:02:12.155513+0000","last_became_active":"2024-05-20T18:02:12.150065+0000","last_became_peered":"2024-05-20T18:02:12.150065+0000","last_unstale":"2024-05-20T18:02:12.155513+0000","last_undegraded":"2024-05-20T18:02:12.155513+0000","last_fullsized":"2024-05-20T18:02:12.155513+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:31:13.636171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159000+0000","last_change":"2024-05-20T18:02:11.148927+0000","last_active":"2024-05-20T18:02:13.159000+0000","last_peered":"2024-05-20T18:02:13.159000+0000","last_clean":"2024-05-20T18:02:13.159000+0000","last_became_active":"2024-05-20T18:02:11.148531+0000","last_became_peered":"2024-05-20T18:02:11.148531+0000","last_unstale":"2024-05-20T18:02:13.159000+0000","last_undegraded":"2024-05-20T18:02:13.159000+0000","last_fullsized":"2024-05-20T18:02:13.159000+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:32.369579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.153718+0000","last_change":"2024-05-20T18:02:12.148756+0000","last_active":"2024-05-20T18:02:12.153718+0000","last_peered":"2024-05-20T18:02:12.153718+0000","last_clean":"2024-05-20T18:02:12.153718+0000","last_became_active":"2024-05-20T18:02:12.148430+0000","last_became_peered":"2024-05-20T18:02:12.148430+0000","last_unstale":"2024-05-20T18:02:12.153718+0000","last_undegraded":"2024-05-20T18:02:12.153718+0000","last_fullsized":"2024-05-20T18:02:12.153718+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:49.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159989+0000","last_change":"2024-05-20T18:02:11.147931+0000","last_active":"2024-05-20T18:02:13.159989+0000","last_peered":"2024-05-20T18:02:13.159989+0000","last_clean":"2024-05-20T18:02:13.159989+0000","last_became_active":"2024-05-20T18:02:11.147624+0000","last_became_peered":"2024-05-20T18:02:11.147624+0000","last_unstale":"2024-05-20T18:02:13.159989+0000","last_undegraded":"2024-05-20T18:02:13.159989+0000","last_fullsized":"2024-05-20T18:02:13.159989+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:13:35.668126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160641+0000","last_change":"2024-05-20T18:02:12.152814+0000","last_active":"2024-05-20T18:02:13.160641+0000","last_peered":"2024-05-20T18:02:13.160641+0000","last_clean":"2024-05-20T18:02:13.160641+0000","last_became_active":"2024-05-20T18:02:12.152524+0000","last_became_peered":"2024-05-20T18:02:12.152524+0000","last_unstale":"2024-05-20T18:02:13.160641+0000","last_undegraded":"2024-05-20T18:02:13.160641+0000","last_fullsized":"2024-05-20T18:02:13.160641+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:17:29.492527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158666+0000","last_change":"2024-05-20T18:02:11.148658+0000","last_active":"2024-05-20T18:02:13.158666+0000","last_peered":"2024-05-20T18:02:13.158666+0000","last_clean":"2024-05-20T18:02:13.158666+0000","last_became_active":"2024-05-20T18:02:11.144560+0000","last_became_peered":"2024-05-20T18:02:11.144560+0000","last_unstale":"2024-05-20T18:02:13.158666+0000","last_undegraded":"2024-05-20T18:02:13.158666+0000","last_fullsized":"2024-05-20T18:02:13.158666+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:32:27.082785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160776+0000","last_change":"2024-05-20T18:02:12.160009+0000","last_active":"2024-05-20T18:02:13.160776+0000","last_peered":"2024-05-20T18:02:13.160776+0000","last_clean":"2024-05-20T18:02:13.160776+0000","last_became_active":"2024-05-20T18:02:12.159714+0000","last_became_peered":"2024-05-20T18:02:12.159714+0000","last_unstale":"2024-05-20T18:02:13.160776+0000","last_undegraded":"2024-05-20T18:02:13.160776+0000","last_fullsized":"2024-05-20T18:02:13.160776+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:00.294485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141097+0000","last_change":"2024-05-20T18:02:11.150186+0000","last_active":"2024-05-20T18:02:14.141097+0000","last_peered":"2024-05-20T18:02:14.141097+0000","last_clean":"2024-05-20T18:02:14.141097+0000","last_became_active":"2024-05-20T18:02:11.149853+0000","last_became_peered":"2024-05-20T18:02:11.149853+0000","last_unstale":"2024-05-20T18:02:14.141097+0000","last_undegraded":"2024-05-20T18:02:14.141097+0000","last_fullsized":"2024-05-20T18:02:14.141097+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:04:30.333569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155187+0000","last_change":"2024-05-20T18:02:12.153757+0000","last_active":"2024-05-20T18:02:12.155187+0000","last_peered":"2024-05-20T18:02:12.155187+0000","last_clean":"2024-05-20T18:02:12.155187+0000","last_became_active":"2024-05-20T18:02:12.153452+0000","last_became_peered":"2024-05-20T18:02:12.153452+0000","last_unstale":"2024-05-20T18:02:12.155187+0000","last_undegraded":"2024-05-20T18:02:12.155187+0000","last_fullsized":"2024-05-20T18:02:12.155187+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:08:57.581804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161698+0000","last_change":"2024-05-20T18:02:11.150474+0000","last_active":"2024-05-20T18:02:13.161698+0000","last_peered":"2024-05-20T18:02:13.161698+0000","last_clean":"2024-05-20T18:02:13.161698+0000","last_became_active":"2024-05-20T18:02:11.150144+0000","last_became_peered":"2024-05-20T18:02:11.150144+0000","last_unstale":"2024-05-20T18:02:13.161698+0000","last_undegraded":"2024-05-20T18:02:13.161698+0000","last_fullsized":"2024-05-20T18:02:13.161698+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:34:59.934850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.160598+0000","last_change":"2024-05-20T18:02:12.157123+0000","last_active":"2024-05-20T18:02:12.160598+0000","last_peered":"2024-05-20T18:02:12.160598+0000","last_clean":"2024-05-20T18:02:12.160598+0000","last_became_active":"2024-05-20T18:02:12.156564+0000","last_became_peered":"2024-05-20T18:02:12.156564+0000","last_unstale":"2024-05-20T18:02:12.160598+0000","last_undegraded":"2024-05-20T18:02:12.160598+0000","last_fullsized":"2024-05-20T18:02:12.160598+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:21:01.276812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"136'3","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.156204+0000","last_change":"2024-05-20T18:02:11.149993+0000","last_active":"2024-05-20T18:02:12.156204+0000","last_peered":"2024-05-20T18:02:12.156204+0000","last_clean":"2024-05-20T18:02:12.156204+0000","last_became_active":"2024-05-20T18:02:11.149388+0000","last_became_peered":"2024-05-20T18:02:11.149388+0000","last_unstale":"2024-05-20T18:02:12.156204+0000","last_undegraded":"2024-05-20T18:02:12.156204+0000","last_fullsized":"2024-05-20T18:02:12.156204+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:25:37.942903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160087+0000","last_change":"2024-05-20T18:02:12.159258+0000","last_active":"2024-05-20T18:02:13.160087+0000","last_peered":"2024-05-20T18:02:13.160087+0000","last_clean":"2024-05-20T18:02:13.160087+0000","last_became_active":"2024-05-20T18:02:12.158903+0000","last_became_peered":"2024-05-20T18:02:12.158903+0000","last_unstale":"2024-05-20T18:02:13.160087+0000","last_undegraded":"2024-05-20T18:02:13.160087+0000","last_fullsized":"2024-05-20T18:02:13.160087+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:46:40.670710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159165+0000","last_change":"2024-05-20T18:02:11.153863+0000","last_active":"2024-05-20T18:02:13.159165+0000","last_peered":"2024-05-20T18:02:13.159165+0000","last_clean":"2024-05-20T18:02:13.159165+0000","last_became_active":"2024-05-20T18:02:11.153075+0000","last_became_peered":"2024-05-20T18:02:11.153075+0000","last_unstale":"2024-05-20T18:02:13.159165+0000","last_undegraded":"2024-05-20T18:02:13.159165+0000","last_fullsized":"2024-05-20T18:02:13.159165+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:55:47.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.163652+0000","last_change":"2024-05-20T18:02:12.155928+0000","last_active":"2024-05-20T18:02:12.163652+0000","last_peered":"2024-05-20T18:02:12.163652+0000","last_clean":"2024-05-20T18:02:12.163652+0000","last_became_active":"2024-05-20T18:02:12.153738+0000","last_became_peered":"2024-05-20T18:02:12.153738+0000","last_unstale":"2024-05-20T18:02:12.163652+0000","last_undegraded":"2024-05-20T18:02:12.163652+0000","last_fullsized":"2024-05-20T18:02:12.163652+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:12:09.836870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.147524+0000","last_change":"2024-05-20T18:02:11.151284+0000","last_active":"2024-05-20T18:02:12.147524+0000","last_peered":"2024-05-20T18:02:12.147524+0000","last_clean":"2024-05-20T18:02:12.147524+0000","last_became_active":"2024-05-20T18:02:11.150950+0000","last_became_peered":"2024-05-20T18:02:11.150950+0000","last_unstale":"2024-05-20T18:02:12.147524+0000","last_undegraded":"2024-05-20T18:02:12.147524+0000","last_fullsized":"2024-05-20T18:02:12.147524+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:39.585870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.158860+0000","last_change":"2024-05-20T18:02:12.151454+0000","last_active":"2024-05-20T18:02:13.158860+0000","last_peered":"2024-05-20T18:02:13.158860+0000","last_clean":"2024-05-20T18:02:13.158860+0000","last_became_active":"2024-05-20T18:02:12.151099+0000","last_became_peered":"2024-05-20T18:02:12.151099+0000","last_unstale":"2024-05-20T18:02:13.158860+0000","last_undegraded":"2024-05-20T18:02:13.158860+0000","last_fullsized":"2024-05-20T18:02:13.158860+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:14:49.066464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.145374+0000","last_change":"2024-05-20T18:02:11.151079+0000","last_active":"2024-05-20T18:02:12.145374+0000","last_peered":"2024-05-20T18:02:12.145374+0000","last_clean":"2024-05-20T18:02:12.145374+0000","last_became_active":"2024-05-20T18:02:11.150763+0000","last_became_peered":"2024-05-20T18:02:11.150763+0000","last_unstale":"2024-05-20T18:02:12.145374+0000","last_undegraded":"2024-05-20T18:02:12.145374+0000","last_fullsized":"2024-05-20T18:02:12.145374+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:33:12.564683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155674+0000","last_change":"2024-05-20T18:02:12.148756+0000","last_active":"2024-05-20T18:02:12.155674+0000","last_peered":"2024-05-20T18:02:12.155674+0000","last_clean":"2024-05-20T18:02:12.155674+0000","last_became_active":"2024-05-20T18:02:12.148183+0000","last_became_peered":"2024-05-20T18:02:12.148183+0000","last_unstale":"2024-05-20T18:02:12.155674+0000","last_undegraded":"2024-05-20T18:02:12.155674+0000","last_fullsized":"2024-05-20T18:02:12.155674+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:19.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"136'8","reported_seq":22,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159531+0000","last_change":"2024-05-20T18:02:11.147054+0000","last_active":"2024-05-20T18:02:13.159531+0000","last_peered":"2024-05-20T18:02:13.159531+0000","last_clean":"2024-05-20T18:02:13.159531+0000","last_became_active":"2024-05-20T18:02:11.146731+0000","last_became_peered":"2024-05-20T18:02:11.146731+0000","last_unstale":"2024-05-20T18:02:13.159531+0000","last_undegraded":"2024-05-20T18:02:13.159531+0000","last_fullsized":"2024-05-20T18:02:13.159531+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:06:15.873244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141010+0000","last_change":"2024-05-20T18:02:12.165862+0000","last_active":"2024-05-20T18:02:14.141010+0000","last_peered":"2024-05-20T18:02:14.141010+0000","last_clean":"2024-05-20T18:02:14.141010+0000","last_became_active":"2024-05-20T18:02:12.165524+0000","last_became_peered":"2024-05-20T18:02:12.165524+0000","last_unstale":"2024-05-20T18:02:14.141010+0000","last_undegraded":"2024-05-20T18:02:14.141010+0000","last_fullsized":"2024-05-20T18:02:14.141010+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:32:25.892292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.158996+0000","last_change":"2024-05-20T18:02:11.150542+0000","last_active":"2024-05-20T18:02:12.158996+0000","last_peered":"2024-05-20T18:02:12.158996+0000","last_clean":"2024-05-20T18:02:12.158996+0000","last_became_active":"2024-05-20T18:02:11.150127+0000","last_became_peered":"2024-05-20T18:02:11.150127+0000","last_unstale":"2024-05-20T18:02:12.158996+0000","last_undegraded":"2024-05-20T18:02:12.158996+0000","last_fullsized":"2024-05-20T18:02:12.158996+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:49:11.841060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.141157+0000","last_change":"2024-05-20T18:02:12.161784+0000","last_active":"2024-05-20T18:02:14.141157+0000","last_peered":"2024-05-20T18:02:14.141157+0000","last_clean":"2024-05-20T18:02:14.141157+0000","last_became_active":"2024-05-20T18:02:12.161193+0000","last_became_peered":"2024-05-20T18:02:12.161193+0000","last_unstale":"2024-05-20T18:02:14.141157+0000","last_undegraded":"2024-05-20T18:02:14.141157+0000","last_fullsized":"2024-05-20T18:02:14.141157+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:36:15.063213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140814+0000","last_change":"2024-05-20T18:02:11.146276+0000","last_active":"2024-05-20T18:02:14.140814+0000","last_peered":"2024-05-20T18:02:14.140814+0000","last_clean":"2024-05-20T18:02:14.140814+0000","last_became_active":"2024-05-20T18:02:11.145934+0000","last_became_peered":"2024-05-20T18:02:11.145934+0000","last_unstale":"2024-05-20T18:02:14.140814+0000","last_undegraded":"2024-05-20T18:02:14.140814+0000","last_fullsized":"2024-05-20T18:02:14.140814+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:37:06.048950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161462+0000","last_change":"2024-05-20T18:02:12.164955+0000","last_active":"2024-05-20T18:02:13.161462+0000","last_peered":"2024-05-20T18:02:13.161462+0000","last_clean":"2024-05-20T18:02:13.161462+0000","last_became_active":"2024-05-20T18:02:12.164300+0000","last_became_peered":"2024-05-20T18:02:12.164300+0000","last_unstale":"2024-05-20T18:02:13.161462+0000","last_undegraded":"2024-05-20T18:02:13.161462+0000","last_fullsized":"2024-05-20T18:02:13.161462+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:11:33.375668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"136'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.167824+0000","last_change":"2024-05-20T18:02:11.151150+0000","last_active":"2024-05-20T18:02:12.167824+0000","last_peered":"2024-05-20T18:02:12.167824+0000","last_clean":"2024-05-20T18:02:12.167824+0000","last_became_active":"2024-05-20T18:02:11.150644+0000","last_became_peered":"2024-05-20T18:02:11.150644+0000","last_unstale":"2024-05-20T18:02:12.167824+0000","last_undegraded":"2024-05-20T18:02:12.167824+0000","last_fullsized":"2024-05-20T18:02:12.167824+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:33:12.564683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161440+0000","last_change":"2024-05-20T18:02:12.159864+0000","last_active":"2024-05-20T18:02:13.161440+0000","last_peered":"2024-05-20T18:02:13.161440+0000","last_clean":"2024-05-20T18:02:13.161440+0000","last_became_active":"2024-05-20T18:02:12.159564+0000","last_became_peered":"2024-05-20T18:02:12.159564+0000","last_unstale":"2024-05-20T18:02:13.161440+0000","last_undegraded":"2024-05-20T18:02:13.161440+0000","last_fullsized":"2024-05-20T18:02:13.161440+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:26:53.011849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.145387+0000","last_change":"2024-05-20T18:02:11.151728+0000","last_active":"2024-05-20T18:02:12.145387+0000","last_peered":"2024-05-20T18:02:12.145387+0000","last_clean":"2024-05-20T18:02:12.145387+0000","last_became_active":"2024-05-20T18:02:11.151305+0000","last_became_peered":"2024-05-20T18:02:11.151305+0000","last_unstale":"2024-05-20T18:02:12.145387+0000","last_undegraded":"2024-05-20T18:02:12.145387+0000","last_fullsized":"2024-05-20T18:02:12.145387+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:16.315426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140713+0000","last_change":"2024-05-20T18:02:12.162681+0000","last_active":"2024-05-20T18:02:14.140713+0000","last_peered":"2024-05-20T18:02:14.140713+0000","last_clean":"2024-05-20T18:02:14.140713+0000","last_became_active":"2024-05-20T18:02:12.162362+0000","last_became_peered":"2024-05-20T18:02:12.162362+0000","last_unstale":"2024-05-20T18:02:14.140713+0000","last_undegraded":"2024-05-20T18:02:14.140713+0000","last_fullsized":"2024-05-20T18:02:14.140713+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:48:47.582128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255313+0000","last_change":"2024-05-20T18:02:11.151747+0000","last_active":"2024-05-20T18:02:14.255313+0000","last_peered":"2024-05-20T18:02:14.255313+0000","last_clean":"2024-05-20T18:02:14.255313+0000","last_became_active":"2024-05-20T18:02:11.151421+0000","last_became_peered":"2024-05-20T18:02:11.151421+0000","last_unstale":"2024-05-20T18:02:14.255313+0000","last_undegraded":"2024-05-20T18:02:14.255313+0000","last_fullsized":"2024-05-20T18:02:14.255313+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:01:22.438976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.154447+0000","last_change":"2024-05-20T18:02:12.153228+0000","last_active":"2024-05-20T18:02:12.154447+0000","last_peered":"2024-05-20T18:02:12.154447+0000","last_clean":"2024-05-20T18:02:12.154447+0000","last_became_active":"2024-05-20T18:02:12.152904+0000","last_became_peered":"2024-05-20T18:02:12.152904+0000","last_unstale":"2024-05-20T18:02:12.154447+0000","last_undegraded":"2024-05-20T18:02:12.154447+0000","last_fullsized":"2024-05-20T18:02:12.154447+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:17:29.492527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159951+0000","last_change":"2024-05-20T18:02:11.148027+0000","last_active":"2024-05-20T18:02:13.159951+0000","last_peered":"2024-05-20T18:02:13.159951+0000","last_clean":"2024-05-20T18:02:13.159951+0000","last_became_active":"2024-05-20T18:02:11.147037+0000","last_became_peered":"2024-05-20T18:02:11.147037+0000","last_unstale":"2024-05-20T18:02:13.159951+0000","last_undegraded":"2024-05-20T18:02:13.159951+0000","last_fullsized":"2024-05-20T18:02:13.159951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:27:08.558145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140760+0000","last_change":"2024-05-20T18:02:12.159761+0000","last_active":"2024-05-20T18:02:14.140760+0000","last_peered":"2024-05-20T18:02:14.140760+0000","last_clean":"2024-05-20T18:02:14.140760+0000","last_became_active":"2024-05-20T18:02:12.159404+0000","last_became_peered":"2024-05-20T18:02:12.159404+0000","last_unstale":"2024-05-20T18:02:14.140760+0000","last_undegraded":"2024-05-20T18:02:14.140760+0000","last_fullsized":"2024-05-20T18:02:14.140760+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:30:19.598070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255204+0000","last_change":"2024-05-20T18:02:11.150989+0000","last_active":"2024-05-20T18:02:14.255204+0000","last_peered":"2024-05-20T18:02:14.255204+0000","last_clean":"2024-05-20T18:02:14.255204+0000","last_became_active":"2024-05-20T18:02:11.150640+0000","last_became_peered":"2024-05-20T18:02:11.150640+0000","last_unstale":"2024-05-20T18:02:14.255204+0000","last_undegraded":"2024-05-20T18:02:14.255204+0000","last_fullsized":"2024-05-20T18:02:14.255204+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:40:57.819469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155650+0000","last_change":"2024-05-20T18:02:12.148487+0000","last_active":"2024-05-20T18:02:12.155650+0000","last_peered":"2024-05-20T18:02:12.155650+0000","last_clean":"2024-05-20T18:02:12.155650+0000","last_became_active":"2024-05-20T18:02:12.147770+0000","last_became_peered":"2024-05-20T18:02:12.147770+0000","last_unstale":"2024-05-20T18:02:12.155650+0000","last_undegraded":"2024-05-20T18:02:12.155650+0000","last_fullsized":"2024-05-20T18:02:12.155650+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:06:00.294485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160412+0000","last_change":"2024-05-20T18:02:11.144130+0000","last_active":"2024-05-20T18:02:13.160412+0000","last_peered":"2024-05-20T18:02:13.160412+0000","last_clean":"2024-05-20T18:02:13.160412+0000","last_became_active":"2024-05-20T18:02:11.143793+0000","last_became_peered":"2024-05-20T18:02:11.143793+0000","last_unstale":"2024-05-20T18:02:13.160412+0000","last_undegraded":"2024-05-20T18:02:13.160412+0000","last_fullsized":"2024-05-20T18:02:13.160412+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:39:56.735691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159055+0000","last_change":"2024-05-20T18:02:12.166680+0000","last_active":"2024-05-20T18:02:13.159055+0000","last_peered":"2024-05-20T18:02:13.159055+0000","last_clean":"2024-05-20T18:02:13.159055+0000","last_became_active":"2024-05-20T18:02:12.166233+0000","last_became_peered":"2024-05-20T18:02:12.166233+0000","last_unstale":"2024-05-20T18:02:13.159055+0000","last_undegraded":"2024-05-20T18:02:13.159055+0000","last_fullsized":"2024-05-20T18:02:13.159055+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:31:57.757145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"136'2","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.165951+0000","last_change":"2024-05-20T18:02:11.157250+0000","last_active":"2024-05-20T18:02:12.165951+0000","last_peered":"2024-05-20T18:02:12.165951+0000","last_clean":"2024-05-20T18:02:12.165951+0000","last_became_active":"2024-05-20T18:02:11.156918+0000","last_became_peered":"2024-05-20T18:02:11.156918+0000","last_unstale":"2024-05-20T18:02:12.165951+0000","last_undegraded":"2024-05-20T18:02:12.165951+0000","last_fullsized":"2024-05-20T18:02:12.165951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:05:59.288396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.155453+0000","last_change":"2024-05-20T18:02:12.150752+0000","last_active":"2024-05-20T18:02:12.155453+0000","last_peered":"2024-05-20T18:02:12.155453+0000","last_clean":"2024-05-20T18:02:12.155453+0000","last_became_active":"2024-05-20T18:02:12.150182+0000","last_became_peered":"2024-05-20T18:02:12.150182+0000","last_unstale":"2024-05-20T18:02:12.155453+0000","last_undegraded":"2024-05-20T18:02:12.155453+0000","last_fullsized":"2024-05-20T18:02:12.155453+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:19:19.814245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"137'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140064+0000","last_change":"2024-05-20T18:02:11.148128+0000","last_active":"2024-05-20T18:02:14.140064+0000","last_peered":"2024-05-20T18:02:14.140064+0000","last_clean":"2024-05-20T18:02:14.140064+0000","last_became_active":"2024-05-20T18:02:11.147759+0000","last_became_peered":"2024-05-20T18:02:11.147759+0000","last_unstale":"2024-05-20T18:02:14.140064+0000","last_undegraded":"2024-05-20T18:02:14.140064+0000","last_fullsized":"2024-05-20T18:02:14.140064+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:46.131330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.161707+0000","last_change":"2024-05-20T18:02:12.156044+0000","last_active":"2024-05-20T18:02:13.161707+0000","last_peered":"2024-05-20T18:02:13.161707+0000","last_clean":"2024-05-20T18:02:13.161707+0000","last_became_active":"2024-05-20T18:02:12.155626+0000","last_became_peered":"2024-05-20T18:02:12.155626+0000","last_unstale":"2024-05-20T18:02:13.161707+0000","last_undegraded":"2024-05-20T18:02:13.161707+0000","last_fullsized":"2024-05-20T18:02:13.161707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:32:28.088874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.137612+0000","last_change":"2024-05-20T18:02:11.147229+0000","last_active":"2024-05-20T18:02:12.137612+0000","last_peered":"2024-05-20T18:02:12.137612+0000","last_clean":"2024-05-20T18:02:12.137612+0000","last_became_active":"2024-05-20T18:02:11.146901+0000","last_became_peered":"2024-05-20T18:02:11.146901+0000","last_unstale":"2024-05-20T18:02:12.137612+0000","last_undegraded":"2024-05-20T18:02:12.137612+0000","last_fullsized":"2024-05-20T18:02:12.137612+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:16.315426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159274+0000","last_change":"2024-05-20T18:02:12.160062+0000","last_active":"2024-05-20T18:02:13.159274+0000","last_peered":"2024-05-20T18:02:13.159274+0000","last_clean":"2024-05-20T18:02:13.159274+0000","last_became_active":"2024-05-20T18:02:12.159684+0000","last_became_peered":"2024-05-20T18:02:12.159684+0000","last_unstale":"2024-05-20T18:02:13.159274+0000","last_undegraded":"2024-05-20T18:02:13.159274+0000","last_fullsized":"2024-05-20T18:02:13.159274+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:37:33.882657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.159170+0000","last_change":"2024-05-20T18:02:11.156407+0000","last_active":"2024-05-20T18:02:13.159170+0000","last_peered":"2024-05-20T18:02:13.159170+0000","last_clean":"2024-05-20T18:02:13.159170+0000","last_became_active":"2024-05-20T18:02:11.156102+0000","last_became_peered":"2024-05-20T18:02:11.156102+0000","last_unstale":"2024-05-20T18:02:13.159170+0000","last_undegraded":"2024-05-20T18:02:13.159170+0000","last_fullsized":"2024-05-20T18:02:13.159170+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:10:13.701021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160283+0000","last_change":"2024-05-20T18:02:12.146913+0000","last_active":"2024-05-20T18:02:13.160283+0000","last_peered":"2024-05-20T18:02:13.160283+0000","last_clean":"2024-05-20T18:02:13.160283+0000","last_became_active":"2024-05-20T18:02:12.146560+0000","last_became_peered":"2024-05-20T18:02:12.146560+0000","last_unstale":"2024-05-20T18:02:13.160283+0000","last_undegraded":"2024-05-20T18:02:13.160283+0000","last_fullsized":"2024-05-20T18:02:13.160283+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:17.321515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160759+0000","last_change":"2024-05-20T18:02:11.150425+0000","last_active":"2024-05-20T18:02:13.160759+0000","last_peered":"2024-05-20T18:02:13.160759+0000","last_clean":"2024-05-20T18:02:13.160759+0000","last_became_active":"2024-05-20T18:02:11.150110+0000","last_became_peered":"2024-05-20T18:02:11.150110+0000","last_unstale":"2024-05-20T18:02:13.160759+0000","last_undegraded":"2024-05-20T18:02:13.160759+0000","last_fullsized":"2024-05-20T18:02:13.160759+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:10:49.366403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.168056+0000","last_change":"2024-05-20T18:02:12.166814+0000","last_active":"2024-05-20T18:02:12.168056+0000","last_peered":"2024-05-20T18:02:12.168056+0000","last_clean":"2024-05-20T18:02:12.168056+0000","last_became_active":"2024-05-20T18:02:12.166459+0000","last_became_peered":"2024-05-20T18:02:12.166459+0000","last_unstale":"2024-05-20T18:02:12.168056+0000","last_undegraded":"2024-05-20T18:02:12.168056+0000","last_fullsized":"2024-05-20T18:02:12.168056+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:47:01.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.138357+0000","last_change":"2024-05-20T18:02:11.154890+0000","last_active":"2024-05-20T18:02:12.138357+0000","last_peered":"2024-05-20T18:02:12.138357+0000","last_clean":"2024-05-20T18:02:12.138357+0000","last_became_active":"2024-05-20T18:02:11.154527+0000","last_became_peered":"2024-05-20T18:02:11.154527+0000","last_unstale":"2024-05-20T18:02:12.138357+0000","last_undegraded":"2024-05-20T18:02:12.138357+0000","last_fullsized":"2024-05-20T18:02:12.138357+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:47:17.274732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-05-20T18:02:12.153694+0000","last_change":"2024-05-20T18:02:12.147688+0000","last_active":"2024-05-20T18:02:12.153694+0000","last_peered":"2024-05-20T18:02:12.153694+0000","last_clean":"2024-05-20T18:02:12.153694+0000","last_became_active":"2024-05-20T18:02:12.147384+0000","last_became_peered":"2024-05-20T18:02:12.147384+0000","last_unstale":"2024-05-20T18:02:12.153694+0000","last_undegraded":"2024-05-20T18:02:12.153694+0000","last_fullsized":"2024-05-20T18:02:12.153694+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:40.591958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160093+0000","last_change":"2024-05-20T18:02:11.152851+0000","last_active":"2024-05-20T18:02:13.160093+0000","last_peered":"2024-05-20T18:02:13.160093+0000","last_clean":"2024-05-20T18:02:13.160093+0000","last_became_active":"2024-05-20T18:02:11.152483+0000","last_became_peered":"2024-05-20T18:02:11.152483+0000","last_unstale":"2024-05-20T18:02:13.160093+0000","last_undegraded":"2024-05-20T18:02:13.160093+0000","last_fullsized":"2024-05-20T18:02:13.160093+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:44:57.355050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160697+0000","last_change":"2024-05-20T18:02:12.163607+0000","last_active":"2024-05-20T18:02:13.160697+0000","last_peered":"2024-05-20T18:02:13.160697+0000","last_clean":"2024-05-20T18:02:13.160697+0000","last_became_active":"2024-05-20T18:02:12.163287+0000","last_became_peered":"2024-05-20T18:02:12.163287+0000","last_unstale":"2024-05-20T18:02:13.160697+0000","last_undegraded":"2024-05-20T18:02:13.160697+0000","last_fullsized":"2024-05-20T18:02:13.160697+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:40.591958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140654+0000","last_change":"2024-05-20T18:02:11.150921+0000","last_active":"2024-05-20T18:02:14.140654+0000","last_peered":"2024-05-20T18:02:14.140654+0000","last_clean":"2024-05-20T18:02:14.140654+0000","last_became_active":"2024-05-20T18:02:11.150636+0000","last_became_peered":"2024-05-20T18:02:11.150636+0000","last_unstale":"2024-05-20T18:02:14.140654+0000","last_undegraded":"2024-05-20T18:02:14.140654+0000","last_fullsized":"2024-05-20T18:02:14.140654+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:52:56.254944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:13.160782+0000","last_change":"2024-05-20T18:02:12.146413+0000","last_active":"2024-05-20T18:02:13.160782+0000","last_peered":"2024-05-20T18:02:13.160782+0000","last_clean":"2024-05-20T18:02:13.160782+0000","last_became_active":"2024-05-20T18:02:12.144532+0000","last_became_peered":"2024-05-20T18:02:12.144532+0000","last_unstale":"2024-05-20T18:02:13.160782+0000","last_undegraded":"2024-05-20T18:02:13.160782+0000","last_fullsized":"2024-05-20T18:02:13.160782+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:11.123544+0000","last_clean_scrub_stamp":"2024-05-20T18:02:11.123544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:27:49.512822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"136'6","reported_seq":20,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.255448+0000","last_change":"2024-05-20T18:02:11.151042+0000","last_active":"2024-05-20T18:02:14.255448+0000","last_peered":"2024-05-20T18:02:14.255448+0000","last_clean":"2024-05-20T18:02:14.255448+0000","last_became_active":"2024-05-20T18:02:11.150666+0000","last_became_peered":"2024-05-20T18:02:11.150666+0000","last_unstale":"2024-05-20T18:02:14.255448+0000","last_undegraded":"2024-05-20T18:02:14.255448+0000","last_fullsized":"2024-05-20T18:02:14.255448+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:10.117455+0000","last_clean_scrub_stamp":"2024-05-20T18:02:10.117455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:45:49.044816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":384,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-05-20T18:02:14.140803+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:02:14.140803+0000","last_peered":"2024-05-20T18:02:14.140803+0000","last_clean":"2024-05-20T18:02:14.140803+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:02:14.140803+0000","last_undegraded":"2024-05-20T18:02:14.140803+0000","last_fullsized":"2024-05-20T18:02:14.140803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33436,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338404,"statfs":{"total":96636764160,"available":96602525696,"internally_reserved":0,"allocated":2306048,"data_stored":1381669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37012,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334828,"statfs":{"total":96636764160,"available":96598863872,"internally_reserved":0,"allocated":1712128,"data_stored":791349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32868,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338972,"statfs":{"total":96636764160,"available":96603107328,"internally_reserved":0,"allocated":1720320,"data_stored":797971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1732608,"data_stored":799583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1728512,"data_stored":798587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1716224,"data_stored":791391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32856,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338984,"statfs":{"total":96636764160,"available":96603119616,"internally_reserved":0,"allocated":1712128,"data_stored":791349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2338816,"data_stored":1390657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:02:16.596 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T18:02:16.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T18:02:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.756+0000 7fec41c7a640 1 Processor -- start 2024-05-20T18:02:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.756+0000 7fec41c7a640 1 -- start start 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.757+0000 7fec41c7a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fec3c1599a0 0x7fec3c0b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.757+0000 7fec41c7a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec3c06d980 0x7fec3c09a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.757+0000 7fec41c7a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c09ae40 con 0x7fec3c09aa30 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.757+0000 7fec41c7a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fec3c1607a0 con 0x7fec3c06d980 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.757+0000 7fec41c7a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fec3c09b2d0 con 0x7fec3c1599a0 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.757+0000 7fec3affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec3c06d980 0x7fec3c09a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.757+0000 7fec3affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fec3c06d980 0x7fec3c09a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55888/0 (socket says 172.21.15.6:55888) 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.757+0000 7fec3affd640 1 -- 172.21.15.6:0/4026471927 learned_addr learned my addr 172.21.15.6:0/4026471927 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.758+0000 7fec3b7fe640 1 --2- 172.21.15.6:0/4026471927 >> v2:172.21.15.171:3300/0 conn(0x7fec3c1599a0 0x7fec3c0b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.758+0000 7fec3affd640 1 -- 172.21.15.6:0/4026471927 >> v2:172.21.15.171:3300/0 conn(0x7fec3c1599a0 msgr2=0x7fec3c0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.758+0000 7fec3affd640 1 --2- 172.21.15.6:0/4026471927 >> v2:172.21.15.171:3300/0 conn(0x7fec3c1599a0 0x7fec3c0b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.758+0000 7fec3affd640 1 -- 172.21.15.6:0/4026471927 >> v1:172.21.15.171:6789/0 conn(0x7fec3c09aa30 legacy=0x7fec3c0d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.758+0000 7fec3affd640 1 -- 172.21.15.6:0/4026471927 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c15fc20 con 0x7fec3c06d980 2024-05-20T18:02:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.758+0000 7fec3b7fe640 1 --2- 172.21.15.6:0/4026471927 >> v2:172.21.15.171:3300/0 conn(0x7fec3c1599a0 0x7fec3c0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec3affd640 1 --2- 172.21.15.6:0/4026471927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c06d980 0x7fec3c09a4f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0b7510 tx=0x7fec2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6eba446d56a7e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec3a7fc640 1 -- 172.21.15.6:0/4026471927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24037070 con 0x7fec3c06d980 2024-05-20T18:02:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec3a7fc640 1 -- 172.21.15.6:0/4026471927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec24032440 con 0x7fec3c06d980 2024-05-20T18:02:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec3a7fc640 1 -- 172.21.15.6:0/4026471927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24032810 con 0x7fec3c06d980 2024-05-20T18:02:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec41c7a640 1 -- 172.21.15.6:0/4026471927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c06d980 msgr2=0x7fec3c09a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec41c7a640 1 --2- 172.21.15.6:0/4026471927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c06d980 0x7fec3c09a4f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0b7510 tx=0x7fec2402a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec41c7a640 1 -- 172.21.15.6:0/4026471927 shutdown_connections 2024-05-20T18:02:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec41c7a640 1 --2- 172.21.15.6:0/4026471927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c06d980 0x7fec3c09a4f0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec41c7a640 1 --2- 172.21.15.6:0/4026471927 >> v2:172.21.15.171:3300/0 conn(0x7fec3c1599a0 0x7fec3c0b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.759+0000 7fec41c7a640 1 -- 172.21.15.6:0/4026471927 >> 172.21.15.6:0/4026471927 conn(0x7fec3c0b6670 msgr2=0x7fec3c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.760+0000 7fec41c7a640 1 -- 172.21.15.6:0/4026471927 shutdown_connections 2024-05-20T18:02:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.760+0000 7fec41c7a640 1 -- 172.21.15.6:0/4026471927 wait complete. 2024-05-20T18:02:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.761+0000 7fec41c7a640 1 Processor -- start 2024-05-20T18:02:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.761+0000 7fec41c7a640 1 -- start start 2024-05-20T18:02:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec41c7a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3c06d980 0x7fec3c06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec41c7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c09aa30 0x7fec3c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec41c7a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec3c1599a0 0x7fec3c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec41c7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c1604c0 con 0x7fec3c09aa30 2024-05-20T18:02:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec41c7a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c1601e0 con 0x7fec3c06d980 2024-05-20T18:02:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec41c7a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fec3c06dd90 con 0x7fec3c1599a0 2024-05-20T18:02:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c09aa30 0x7fec3c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c09aa30 0x7fec3c151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55896/0 (socket says 172.21.15.6:55896) 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 -- 172.21.15.6:0/903777211 learned_addr learned my addr 172.21.15.6:0/903777211 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3b7fe640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3c06d980 0x7fec3c06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3bfff640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec3c1599a0 0x7fec3c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 -- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec3c1599a0 msgr2=0x7fec3c1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec3c1599a0 0x7fec3c1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 -- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3c06d980 msgr2=0x7fec3c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3c06d980 0x7fec3c06bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 -- 172.21.15.6:0/903777211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c1586d0 con 0x7fec3c09aa30 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.763+0000 7fec3affd640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c09aa30 0x7fec3c151e40 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fec2402a220 tx=0x7fec240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.764+0000 7fec33fff640 1 -- 172.21.15.6:0/903777211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24041020 con 0x7fec3c09aa30 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.764+0000 7fec33fff640 1 -- 172.21.15.6:0/903777211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec240306c0 con 0x7fec3c09aa30 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.764+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3c1589b0 con 0x7fec3c09aa30 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.764+0000 7fec33fff640 1 -- 172.21.15.6:0/903777211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24037040 con 0x7fec3c09aa30 2024-05-20T18:02:16.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.764+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3c15e470 con 0x7fec3c09aa30 2024-05-20T18:02:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.765+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3c075b00 con 0x7fec3c09aa30 2024-05-20T18:02:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.765+0000 7fec33fff640 1 -- 172.21.15.6:0/903777211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec24044020 con 0x7fec3c09aa30 2024-05-20T18:02:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.766+0000 7fec33fff640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec1c06be60 0x7fec1c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.766+0000 7fec33fff640 1 -- 172.21.15.6:0/903777211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fec240ab6e0 con 0x7fec3c09aa30 2024-05-20T18:02:16.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.766+0000 7fec3b7fe640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec1c06be60 0x7fec1c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:16.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.767+0000 7fec3b7fe640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec1c06be60 0x7fec1c06e370 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fec2c006fd0 tx=0x7fec2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:16.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:16.770+0000 7fec33fff640 1 -- 172.21.15.6:0/903777211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fec2404b030 con 0x7fec3c09aa30 2024-05-20T18:02:17.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.033+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fec3c06c320 con 0x7fec3c09aa30 2024-05-20T18:02:17.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.036+0000 7fec33fff640 1 -- 172.21.15.6:0/903777211 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7fec24079820 con 0x7fec3c09aa30 2024-05-20T18:02:17.034 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T18:02:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T18:02:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T18:02:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T18:02:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T18:02:17.035 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.038+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec1c06be60 msgr2=0x7fec1c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.038+0000 7fec41c7a640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec1c06be60 0x7fec1c06e370 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fec2c006fd0 tx=0x7fec2c008040 comp rx=0 tx=0).stop 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.038+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c09aa30 msgr2=0x7fec3c151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.038+0000 7fec41c7a640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c09aa30 0x7fec3c151e40 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fec2402a220 tx=0x7fec240046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.039+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 shutdown_connections 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.039+0000 7fec41c7a640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec1c06be60 0x7fec1c06e370 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.039+0000 7fec41c7a640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec3c1599a0 0x7fec3c1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.039+0000 7fec41c7a640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec3c09aa30 0x7fec3c151e40 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.039+0000 7fec41c7a640 1 --2- 172.21.15.6:0/903777211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec3c06d980 0x7fec3c06bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.039+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 >> 172.21.15.6:0/903777211 conn(0x7fec3c0b6670 msgr2=0x7fec3c1540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.039+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 shutdown_connections 2024-05-20T18:02:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.039+0000 7fec41c7a640 1 -- 172.21.15.6:0/903777211 wait complete. 2024-05-20T18:02:17.049 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:17.113 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-20T18:02:17.115+0000 7feff3ae9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T18:02:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.166+0000 7f8516996640 1 Processor -- start 2024-05-20T18:02:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.166+0000 7f8516996640 1 -- start start 2024-05-20T18:02:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f8516996640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f8516996640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f851006dd20 con 0x7f85100b8190 2024-05-20T18:02:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f8516996640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85100d0630 con 0x7f8510162820 2024-05-20T18:02:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f8516996640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f85100d39c0 con 0x7f851006d3d0 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f8514f33640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f85100b8190 0x7f85100b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46650/0 (socket says 172.21.15.6:46650) 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f8514f33640 1 -- 172.21.15.6:0/1195286121 learned_addr learned my addr 172.21.15.6:0/1195286121 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f850f7fe640 1 --2- 172.21.15.6:0/1195286121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f850effd640 1 -- 172.21.15.6:0/1195286121 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629772737 0 0) 0x7f85100d0630 con 0x7f8510162820 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f850effd640 1 -- 172.21.15.6:0/1195286121 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84f8003520 con 0x7f8510162820 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f850f7fe640 1 -- 172.21.15.6:0/1195286121 >> v1:172.21.15.171:6789/0 conn(0x7f8510162820 legacy=0x7f85100b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f850f7fe640 1 -- 172.21.15.6:0/1195286121 >> v1:172.21.15.6:6789/0 conn(0x7f85100b8190 legacy=0x7f85100b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.168+0000 7f850f7fe640 1 -- 172.21.15.6:0/1195286121 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85100d3ca0 con 0x7f851006d3d0 2024-05-20T18:02:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.169+0000 7f850f7fe640 1 --2- 172.21.15.6:0/1195286121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851006d7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85040097d0 tx=0x7f850402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f802c2361a319624 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.172+0000 7f850effd640 1 -- 172.21.15.6:0/1195286121 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504037070 con 0x7f851006d3d0 2024-05-20T18:02:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.172+0000 7f850effd640 1 -- 172.21.15.6:0/1195286121 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504032440 con 0x7f851006d3d0 2024-05-20T18:02:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.172+0000 7f850effd640 1 -- 172.21.15.6:0/1195286121 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504032810 con 0x7f851006d3d0 2024-05-20T18:02:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.173+0000 7f8516996640 1 -- 172.21.15.6:0/1195286121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 msgr2=0x7f851006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.173+0000 7f8516996640 1 --2- 172.21.15.6:0/1195286121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851006d7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f85040097d0 tx=0x7f850402a1c0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.173+0000 7f8516996640 1 -- 172.21.15.6:0/1195286121 shutdown_connections 2024-05-20T18:02:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.173+0000 7f8516996640 1 --2- 172.21.15.6:0/1195286121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851006d7e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.173+0000 7f8516996640 1 -- 172.21.15.6:0/1195286121 >> 172.21.15.6:0/1195286121 conn(0x7f85100d4bd0 msgr2=0x7f85100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.173+0000 7f8516996640 1 -- 172.21.15.6:0/1195286121 shutdown_connections 2024-05-20T18:02:17.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.173+0000 7f8516996640 1 -- 172.21.15.6:0/1195286121 wait complete. 2024-05-20T18:02:17.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.175+0000 7f8516996640 1 Processor -- start 2024-05-20T18:02:17.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.175+0000 7f8516996640 1 -- start start 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.176+0000 7f8516996640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851014cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.176+0000 7f8516996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85100b8190 0x7f851014bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.176+0000 7f8516996640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8510162820 0x7f85100ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.176+0000 7f8516996640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f85100d0300 con 0x7f85100b8190 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.176+0000 7f8516996640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f85100d4260 con 0x7f8510162820 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.176+0000 7f8516996640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f85100b4050 con 0x7f851006d3d0 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.176+0000 7f850f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85100b8190 0x7f851014bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.176+0000 7f850f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85100b8190 0x7f851014bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55910/0 (socket says 172.21.15.6:55910) 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850f7fe640 1 -- 172.21.15.6:0/1311617023 learned_addr learned my addr 172.21.15.6:0/1311617023 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850ffff640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851014cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f8514f33640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8510162820 0x7f85100ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850f7fe640 1 -- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 msgr2=0x7f851014cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850f7fe640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851014cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850f7fe640 1 -- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8510162820 msgr2=0x7f85100ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850f7fe640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8510162820 0x7f85100ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850f7fe640 1 -- 172.21.15.6:0/1311617023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85100cd6f0 con 0x7f85100b8190 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850f7fe640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85100b8190 0x7f851014bf50 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f85040098f0 tx=0x7f85040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850cff9640 1 -- 172.21.15.6:0/1311617023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504037040 con 0x7f85100b8190 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850cff9640 1 -- 172.21.15.6:0/1311617023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504042070 con 0x7f85100b8190 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85100cd9d0 con 0x7f85100b8190 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f850cff9640 1 -- 172.21.15.6:0/1311617023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504030940 con 0x7f85100b8190 2024-05-20T18:02:17.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.177+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85100cdf90 con 0x7f85100b8190 2024-05-20T18:02:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.179+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8510075b00 con 0x7f85100b8190 2024-05-20T18:02:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.179+0000 7f850cff9640 1 -- 172.21.15.6:0/1311617023 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8504030ae0 con 0x7f85100b8190 2024-05-20T18:02:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.179+0000 7f850cff9640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84fc06be60 0x7f84fc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.179+0000 7f850cff9640 1 -- 172.21.15.6:0/1311617023 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f85040ab7a0 con 0x7f85100b8190 2024-05-20T18:02:17.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.180+0000 7f850ffff640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84fc06be60 0x7f84fc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.180+0000 7f850ffff640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84fc06be60 0x7f84fc06e370 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8500000f60 tx=0x7f8500009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.184+0000 7f850cff9640 1 -- 172.21.15.6:0/1311617023 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8504079970 con 0x7f85100b8190 2024-05-20T18:02:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.408+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85100cd480 con 0x7f85100b8190 2024-05-20T18:02:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.409+0000 7f850cff9640 1 -- 172.21.15.6:0/1311617023 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5182 (secure 0 0 0) 0x7f850407dc70 con 0x7f85100b8190 2024-05-20T18:02:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":96,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:11.519092+0000","modified":"2024-05-20T18:02:14.543277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1253645410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1253645410},{"type":"v1","addr":"172.21.15.6:6835","nonce":1253645410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":10}]} 2024-05-20T18:02:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 96 2024-05-20T18:02:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84fc06be60 msgr2=0x7f84fc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84fc06be60 0x7f84fc06e370 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8500000f60 tx=0x7f8500009040 comp rx=0 tx=0).stop 2024-05-20T18:02:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85100b8190 msgr2=0x7f851014bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85100b8190 0x7f851014bf50 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f85040098f0 tx=0x7f85040046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 shutdown_connections 2024-05-20T18:02:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f84fc06be60 0x7f84fc06e370 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8510162820 0x7f85100ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85100b8190 0x7f851014bf50 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 --2- 172.21.15.6:0/1311617023 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851006d3d0 0x7f851014cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 >> 172.21.15.6:0/1311617023 conn(0x7f85100d4bd0 msgr2=0x7f851015fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 shutdown_connections 2024-05-20T18:02:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.411+0000 7f8516996640 1 -- 172.21.15.6:0/1311617023 wait complete. 2024-05-20T18:02:17.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T18:02:11.519092+0000', 'modified': '2024-05-20T18:02:14.543277+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9141}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9141': {'gid': 9141, 'name': 'a', 'rank': 0, 'incarnation': 92, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/1253645410', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 1253645410}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1253645410}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9141, 'qdb_cluster': [9141]} 2024-05-20T18:02:17.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T18:02:17.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-20T18:02:17.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.947+0000 7f76a18fe640 1 Processor -- start 2024-05-20T18:02:17.945 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.947+0000 7f76a18fe640 1 -- start start 2024-05-20T18:02:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.948+0000 7f76a18fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f769c162820 0x7f769c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.948+0000 7f76a18fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c06dae0 0x7f769c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.948+0000 7f76a18fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769c0d0630 con 0x7f769c0b3e80 2024-05-20T18:02:17.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.948+0000 7f76a18fe640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f769c0d39c0 con 0x7f769c162820 2024-05-20T18:02:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.948+0000 7f76a18fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f769c0d3ca0 con 0x7f769c06dae0 2024-05-20T18:02:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.949+0000 7f769affd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f769c162820 0x7f769c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.949+0000 7f769a7fc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f769c0b3e80 0x7f769c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:51928/0 (socket says 172.21.15.6:51928) 2024-05-20T18:02:17.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.949+0000 7f769b7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c06dae0 0x7f769c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.949+0000 7f769a7fc640 1 -- 172.21.15.6:0/309142359 learned_addr learned my addr 172.21.15.6:0/309142359 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.949+0000 7f769affd640 1 -- 172.21.15.6:0/309142359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c06dae0 msgr2=0x7f769c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.949+0000 7f769affd640 1 --2- 172.21.15.6:0/309142359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c06dae0 0x7f769c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.949+0000 7f769affd640 1 -- 172.21.15.6:0/309142359 >> v1:172.21.15.171:6789/0 conn(0x7f769c0b3e80 legacy=0x7f769c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.949+0000 7f769affd640 1 -- 172.21.15.6:0/309142359 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c0d3f80 con 0x7f769c162820 2024-05-20T18:02:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.950+0000 7f769affd640 1 --2- 172.21.15.6:0/309142359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c162820 0x7f769c0b3940 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f768c0097a0 tx=0x7f768c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d9009166086de6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.950+0000 7f7699ffb640 1 -- 172.21.15.6:0/309142359 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c037070 con 0x7f769c162820 2024-05-20T18:02:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.950+0000 7f7699ffb640 1 -- 172.21.15.6:0/309142359 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f768c032440 con 0x7f769c162820 2024-05-20T18:02:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.950+0000 7f7699ffb640 1 -- 172.21.15.6:0/309142359 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768c032810 con 0x7f769c162820 2024-05-20T18:02:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.951+0000 7f76a18fe640 1 -- 172.21.15.6:0/309142359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c162820 msgr2=0x7f769c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.951+0000 7f76a18fe640 1 --2- 172.21.15.6:0/309142359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c162820 0x7f769c0b3940 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f768c0097a0 tx=0x7f768c02a180 comp rx=0 tx=0).stop 2024-05-20T18:02:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.951+0000 7f76a18fe640 1 -- 172.21.15.6:0/309142359 shutdown_connections 2024-05-20T18:02:17.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.951+0000 7f76a18fe640 1 --2- 172.21.15.6:0/309142359 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c06dae0 0x7f769c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.951+0000 7f76a18fe640 1 --2- 172.21.15.6:0/309142359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c162820 0x7f769c0b3940 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.951+0000 7f76a18fe640 1 -- 172.21.15.6:0/309142359 >> 172.21.15.6:0/309142359 conn(0x7f769c0d4bd0 msgr2=0x7f769c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.951+0000 7f76a18fe640 1 -- 172.21.15.6:0/309142359 shutdown_connections 2024-05-20T18:02:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.951+0000 7f76a18fe640 1 -- 172.21.15.6:0/309142359 wait complete. 2024-05-20T18:02:17.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.953+0000 7f76a18fe640 1 Processor -- start 2024-05-20T18:02:17.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.953+0000 7f76a18fe640 1 -- start start 2024-05-20T18:02:17.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f76a18fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c0b3e80 0x7f769c1f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f76a18fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f769c162820 0x7f769c0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f76a18fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c0cd4a0 0x7f769c0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f76a18fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0d4780 con 0x7f769c162820 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f76a18fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0d0300 con 0x7f769c0b3e80 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f76a18fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f769c0d4900 con 0x7f769c0cd4a0 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f769a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f769c162820 0x7f769c0ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f769a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f769c162820 0x7f769c0ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42974/0 (socket says 172.21.15.6:42974) 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.954+0000 7f769a7fc640 1 -- 172.21.15.6:0/2191984466 learned_addr learned my addr 172.21.15.6:0/2191984466 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f769affd640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c0b3e80 0x7f769c1f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f769b7fe640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c0cd4a0 0x7f769c0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f769a7fc640 1 -- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c0cd4a0 msgr2=0x7f769c0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f769a7fc640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c0cd4a0 0x7f769c0cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f769a7fc640 1 -- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c0b3e80 msgr2=0x7f769c1f91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f769a7fc640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c0b3e80 0x7f769c1f91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f769a7fc640 1 -- 172.21.15.6:0/2191984466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c1f9710 con 0x7f769c162820 2024-05-20T18:02:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f769a7fc640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f769c162820 0x7f769c0ca270 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f769000c3f0 tx=0x7f769000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f7683fff640 1 -- 172.21.15.6:0/2191984466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690017070 con 0x7f769c162820 2024-05-20T18:02:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f7683fff640 1 -- 172.21.15.6:0/2191984466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7690005ce0 con 0x7f769c162820 2024-05-20T18:02:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f76a18fe640 1 -- 172.21.15.6:0/2191984466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c0ca7b0 con 0x7f769c162820 2024-05-20T18:02:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f7683fff640 1 -- 172.21.15.6:0/2191984466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76900072f0 con 0x7f769c162820 2024-05-20T18:02:17.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.955+0000 7f76a18fe640 1 -- 172.21.15.6:0/2191984466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c0cc290 con 0x7f769c162820 2024-05-20T18:02:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.957+0000 7f7683fff640 1 -- 172.21.15.6:0/2191984466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f769001a070 con 0x7f769c162820 2024-05-20T18:02:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.958+0000 7f7683fff640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f768806be30 0x7f768806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.958+0000 7f7683fff640 1 -- 172.21.15.6:0/2191984466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f769008a370 con 0x7f769c162820 2024-05-20T18:02:17.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.958+0000 7f769affd640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f768806be30 0x7f768806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.959+0000 7f769affd640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f768806be30 0x7f768806e340 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f768c034000 tx=0x7f768c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.959+0000 7f76a87a2740 1 Processor -- start 2024-05-20T18:02:17.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.959+0000 7f76a87a2740 1 -- start start 2024-05-20T18:02:17.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.960+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 0x55d2c4dd7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.960+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.960+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49eb590 0x55d2c4dad360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.960+0000 7f76a87a2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d2c4d104d0 con 0x55d2c49e33b0 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.960+0000 7f76a87a2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d2c4cb83e0 con 0x55d2c49eb590 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.960+0000 7f76a87a2740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55d2c4d0c490 con 0x55d2c4a0c270 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42982/0 (socket says 172.21.15.6:42982) 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 -- 172.21.15.6:0/4084883559 learned_addr learned my addr 172.21.15.6:0/4084883559 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769affd640 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 0x55d2c4dd7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769b7fe640 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49eb590 0x55d2c4dad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 -- 172.21.15.6:0/4084883559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 msgr2=0x55d2c4dd7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 0x55d2c4dd7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 -- 172.21.15.6:0/4084883559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49eb590 msgr2=0x55d2c4dad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49eb590 0x55d2c4dad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 -- 172.21.15.6:0/4084883559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2c4a242d0 con 0x55d2c49e33b0 2024-05-20T18:02:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f769a7fc640 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd40a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f7690000fb0 tx=0x7f76900547d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a668d2febe47f0f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f76817fa640 1 -- 172.21.15.6:0/4084883559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76900567b0 con 0x55d2c49e33b0 2024-05-20T18:02:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f76817fa640 1 -- 172.21.15.6:0/4084883559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769008a070 con 0x55d2c49e33b0 2024-05-20T18:02:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.961+0000 7f76817fa640 1 -- 172.21.15.6:0/4084883559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690007490 con 0x55d2c49e33b0 2024-05-20T18:02:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 -- 172.21.15.6:0/4084883559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49e33b0 msgr2=0x55d2c4dd40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd40a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f7690000fb0 tx=0x7f76900547d0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 -- 172.21.15.6:0/4084883559 shutdown_connections 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49eb590 0x55d2c4dad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd40a0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 --2- 172.21.15.6:0/4084883559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 0x55d2c4dd7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 -- 172.21.15.6:0/4084883559 >> 172.21.15.6:0/4084883559 conn(0x55d2c4a003c0 msgr2=0x55d2c4dacaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 -- 172.21.15.6:0/4084883559 shutdown_connections 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.962+0000 7f76a87a2740 1 -- 172.21.15.6:0/4084883559 wait complete. 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.963+0000 7f76a87a2740 1 -- start start 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.963+0000 7f76a87a2740 1 Processor -- start 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.964+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4df1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.964+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 0x55d2c4df2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.964+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.964+0000 7f76a87a2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d2c4ccb8e0 con 0x55d2c4a0c270 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.964+0000 7f76a87a2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d2c4df1300 con 0x55d2c49e33b0 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.964+0000 7f76a87a2740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55d2c4df15e0 con 0x55d2c49eb590 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.964+0000 7f76a87a2740 10 client.0 _ll_register_callbacks cb 0x55d2c4c989c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42988/0 (socket says 172.21.15.6:42988) 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 -- 172.21.15.6:0/2992108712 learned_addr learned my addr 172.21.15.6:0/2992108712 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769affd640 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4df1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769a7fc640 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 0x55d2c4df2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 -- 172.21.15.6:0/2992108712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 msgr2=0x55d2c4df2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 0x55d2c4df2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 -- 172.21.15.6:0/2992108712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 msgr2=0x55d2c4df1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4df1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 -- 172.21.15.6:0/2992108712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2c4aee6b0 con 0x55d2c4a0c270 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f769b7fe640 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df2860 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f7694007da0 tx=0x7f7694013620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124324e9a34c7c61 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f767a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f767a7fc640 1 -- 172.21.15.6:0/2992108712 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769401d020 con 0x55d2c4a0c270 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f76a87a2740 1 -- 172.21.15.6:0/2992108712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f769008a070 con 0x55d2c4a0c270 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.965+0000 7f767a7fc640 1 -- 172.21.15.6:0/2992108712 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f7694019480 con 0x55d2c4a0c270 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f767a7fc640 1 -- 172.21.15.6:0/2992108712 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f7694027050 con 0x55d2c4a0c270 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f76a87a2740 10 client.9279 fetch_fsmap learned FSMap version 96 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f76a87a2740 1 -- 172.21.15.6:0/2992108712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55d2c4ddb090 con 0x55d2c4a0c270 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f767a7fc640 1 -- 172.21.15.6:0/2992108712 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769008a070 con 0x55d2c4a0c270 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f767a7fc640 1 -- 172.21.15.6:0/2992108712 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 96) ==== 3494+0+0 (secure 0 0 0) 0x7f769402a020 con 0x55d2c4a0c270 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f76a87a2740 10 client.9279 fetch_fsmap finished waiting for FSMap version 96 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f76a87a2740 10 client.9279 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T18:02:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f76a87a2740 20 client.9279 populate_metadata read hostname 'smithi006' 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] conn(0x55d2c49cae40 0x55d2c4e0f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f76a87a2740 4 client.9279 mds_command: new command op to 9141 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f76a87a2740 1 -- 172.21.15.6:0/2992108712 --> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2c4d1dc00 con 0x55d2c49cae40 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f769affd640 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] conn(0x55d2c49cae40 0x55d2c4e0f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f767a7fc640 10 client.9279 ms_handle_connect on v2:172.21.15.6:6832/1253645410 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.966+0000 7f769affd640 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] conn(0x55d2c49cae40 0x55d2c4e0f480 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab122813bdc48e8 server_cookie=db3e6ee252cd665a in_seq=0 out_seq=0 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f767a7fc640 1 -- 172.21.15.6:0/2992108712 <== mds.0 v2:172.21.15.6:6832/1253645410 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d2c4d1dc00 con 0x55d2c49cae40 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f767a7fc640 10 client.9279 handle_command_reply: tid=0 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 client.9279 shutdown 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 -- 172.21.15.6:0/2992108712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 msgr2=0x55d2c4df2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df2860 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f7694007da0 tx=0x7f7694013620 comp rx=0 tx=0).stop 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 -- 172.21.15.6:0/2992108712 shutdown_connections 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] conn(0x55d2c49cae40 0x55d2c4e0f480 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df2860 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 0x55d2c4df2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f767a7fc640 0 client.9279 ms_handle_reset on v2:172.21.15.6:6832/1253645410 2024-05-20T18:02:17.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2992108712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4df1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 -- 172.21.15.6:0/2992108712 >> 172.21.15.6:0/2992108712 conn(0x55d2c4a003c0 msgr2=0x55d2c4dacaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:17.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 -- 172.21.15.6:0/2992108712 shutdown_connections 2024-05-20T18:02:17.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.967+0000 7f76a87a2740 1 -- 172.21.15.6:0/2992108712 wait complete. 2024-05-20T18:02:17.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.968+0000 7f76a87a2740 20 client.9279 trim_cache size 0 max 16384 2024-05-20T18:02:17.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.987+0000 7f76a87a2740 1 Processor -- start 2024-05-20T18:02:17.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.987+0000 7f76a87a2740 1 -- start start 2024-05-20T18:02:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 0x55d2c4dd7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f76a87a2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f769c2014d0 con 0x55d2c4a0c270 2024-05-20T18:02:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f76a87a2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0c94e0 con 0x55d2c49e33b0 2024-05-20T18:02:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f76a87a2740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f769c200eb0 con 0x55d2c49eb590 2024-05-20T18:02:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42990/0 (socket says 172.21.15.6:42990) 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769b7fe640 1 -- 172.21.15.6:0/2231763903 learned_addr learned my addr 172.21.15.6:0/2231763903 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769a7fc640 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 0x55d2c4dd7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769affd640 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769b7fe640 1 -- 172.21.15.6:0/2231763903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 msgr2=0x55d2c4dd7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769b7fe640 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 0x55d2c4dd7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769b7fe640 1 -- 172.21.15.6:0/2231763903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 msgr2=0x55d2c4dd7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.988+0000 7f769b7fe640 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.989+0000 7f769b7fe640 1 -- 172.21.15.6:0/2231763903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2c4da6220 con 0x55d2c4a0c270 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.989+0000 7f769b7fe640 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df1dc0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f7694014010 tx=0x7f7694019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5fc53e8b9eaf5b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.989+0000 7f7680ff9640 1 -- 172.21.15.6:0/2231763903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769401d040 con 0x55d2c4a0c270 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.989+0000 7f7680ff9640 1 -- 172.21.15.6:0/2231763903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76940198a0 con 0x55d2c4a0c270 2024-05-20T18:02:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.989+0000 7f7680ff9640 1 -- 172.21.15.6:0/2231763903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694019c70 con 0x55d2c4a0c270 2024-05-20T18:02:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 -- 172.21.15.6:0/2231763903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 msgr2=0x55d2c4df1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df1dc0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f7694014010 tx=0x7f7694019000 comp rx=0 tx=0).stop 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 -- 172.21.15.6:0/2231763903 shutdown_connections 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c4a0c270 0x55d2c4df1dc0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c49eb590 0x55d2c4dd7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 --2- 172.21.15.6:0/2231763903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4dd7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 -- 172.21.15.6:0/2231763903 >> 172.21.15.6:0/2231763903 conn(0x55d2c4a003c0 msgr2=0x55d2c4da2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 -- 172.21.15.6:0/2231763903 shutdown_connections 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.990+0000 7f76a87a2740 1 -- 172.21.15.6:0/2231763903 wait complete. 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.991+0000 7f76a87a2740 1 -- start start 2024-05-20T18:02:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.991+0000 7f76a87a2740 1 Processor -- start 2024-05-20T18:02:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4e51dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49eb590 0x55d2c4dc7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f76a87a2740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 0x55d2c4dd7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f76a87a2740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55d2c4e0b080 con 0x55d2c49eb590 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f76a87a2740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d2c4e0ad20 con 0x55d2c49e33b0 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f76a87a2740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55d2c4e0b640 con 0x55d2c4a0c270 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f76a87a2740 10 client.0 _ll_register_callbacks cb 0x7f7694009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49eb590 0x55d2c4dc7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769a7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49eb590 0x55d2c4dc7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42998/0 (socket says 172.21.15.6:42998) 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769a7fc640 1 -- 172.21.15.6:0/1503931404 learned_addr learned my addr 172.21.15.6:0/1503931404 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769b7fe640 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 0x55d2c4dd7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769affd640 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4e51dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769a7fc640 1 -- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 msgr2=0x55d2c4dd7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769a7fc640 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 0x55d2c4dd7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769a7fc640 1 -- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 msgr2=0x55d2c4e51dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769a7fc640 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4e51dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769a7fc640 1 -- 172.21.15.6:0/1503931404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2c4dd71b0 con 0x55d2c49eb590 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.992+0000 7f769affd640 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4e51dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f769a7fc640 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49eb590 0x55d2c4dc7090 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f7690011000 tx=0x7f769001e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f96c55d48954e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f767a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f767a7fc640 1 -- 172.21.15.6:0/1503931404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690070040 con 0x55d2c49eb590 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f767a7fc640 1 -- 172.21.15.6:0/1503931404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f769008a070 con 0x55d2c49eb590 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 1 -- 172.21.15.6:0/1503931404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76940198a0 con 0x55d2c49eb590 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f767a7fc640 1 -- 172.21.15.6:0/1503931404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f7690007490 con 0x55d2c49eb590 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 10 client.9285 fetch_fsmap learned FSMap version 96 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 1 -- 172.21.15.6:0/1503931404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55d2c4da6550 con 0x55d2c49eb590 2024-05-20T18:02:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f767a7fc640 1 -- 172.21.15.6:0/1503931404 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76940198a0 con 0x55d2c49eb590 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f767a7fc640 1 -- 172.21.15.6:0/1503931404 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 96) ==== 3494+0+0 (secure 0 0 0) 0x7f76900772a0 con 0x55d2c49eb590 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 10 client.9285 fetch_fsmap finished waiting for FSMap version 96 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 10 client.9285 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 20 client.9285 populate_metadata read hostname 'smithi006' 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] conn(0x55d2c4dc75d0 0x55d2c4e54c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 4 client.9285 mds_command: new command op to 9141 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f76a87a2740 1 -- 172.21.15.6:0/1503931404 --> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] -- command(tid 0: {"prefix": "status"}) -- 0x55d2c4deb030 con 0x55d2c4dc75d0 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.993+0000 7f769affd640 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] conn(0x55d2c4dc75d0 0x55d2c4e54c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f769affd640 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] conn(0x55d2c4dc75d0 0x55d2c4e54c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95fbf35148596f73 server_cookie=47957aba2f03f7ca in_seq=0 out_seq=0 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f767a7fc640 10 client.9285 ms_handle_connect on v2:172.21.15.6:6832/1253645410 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f767a7fc640 1 -- 172.21.15.6:0/1503931404 <== mds.0 v2:172.21.15.6:6832/1253645410 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55d2c4deb030 con 0x55d2c4dc75d0 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f767a7fc640 10 client.9285 handle_command_reply: tid=0 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 client.9285 shutdown 2024-05-20T18:02:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 -- 172.21.15.6:0/1503931404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49eb590 msgr2=0x55d2c4dc7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49eb590 0x55d2c4dc7090 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f7690011000 tx=0x7f769001e070 comp rx=0 tx=0).stop 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 -- 172.21.15.6:0/1503931404 shutdown_connections 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.6:6832/1253645410,v1:172.21.15.6:6835/1253645410] conn(0x55d2c4dc75d0 0x55d2c4e54c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55d2c4a0c270 0x55d2c4dd7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2c49eb590 0x55d2c4dc7090 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 --2- 172.21.15.6:0/1503931404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d2c49e33b0 0x55d2c4e51dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f767a7fc640 0 client.9285 ms_handle_reset on v2:172.21.15.6:6832/1253645410 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 -- 172.21.15.6:0/1503931404 >> 172.21.15.6:0/1503931404 conn(0x55d2c4a003c0 msgr2=0x55d2c4da2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 -- 172.21.15.6:0/1503931404 shutdown_connections 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 1 -- 172.21.15.6:0/1503931404 wait complete. 2024-05-20T18:02:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.994+0000 7f76a87a2740 20 client.9285 trim_cache size 0 max 16384 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9141, 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.8634875060000002, 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 96, 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 137, 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 137, 2024-05-20T18:02:17.998 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 11.823019031999999 2024-05-20T18:02:17.999 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:02:17.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 -- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f768806be30 msgr2=0x7f768806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:17.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f768806be30 0x7f768806e340 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f768c034000 tx=0x7f768c02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:17.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 -- 172.21.15.6:0/2191984466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f769c162820 msgr2=0x7f769c0ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f769c162820 0x7f769c0ca270 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f769000c3f0 tx=0x7f769000c8b0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 -- 172.21.15.6:0/2191984466 shutdown_connections 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f768806be30 0x7f768806e340 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f769c0cd4a0 0x7f769c0cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f769c162820 0x7f769c0ca270 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 --2- 172.21.15.6:0/2191984466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f769c0b3e80 0x7f769c1f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 -- 172.21.15.6:0/2191984466 >> 172.21.15.6:0/2191984466 conn(0x7f769c0d4bd0 msgr2=0x7f769c0b9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 -- 172.21.15.6:0/2191984466 shutdown_connections 2024-05-20T18:02:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:17.995+0000 7f76a18fe640 1 -- 172.21.15.6:0/2191984466 wait complete. 2024-05-20T18:02:18.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:02:18.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.121+0000 7fa301516640 1 Processor -- start 2024-05-20T18:02:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.121+0000 7fa301516640 1 -- start start 2024-05-20T18:02:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa301516640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2fc0d10e0 0x7fa2fc0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa301516640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2fc0ce2f0 con 0x7fa2fc0b7210 2024-05-20T18:02:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa301516640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2fc0d1ac0 con 0x7fa2fc0d14f0 2024-05-20T18:02:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa301516640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa2fc0d1da0 con 0x7fa2fc0d10e0 2024-05-20T18:02:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa2faffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2fc0d10e0 0x7fa2fc0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa2fb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa2fc0b7210 0x7fa2fc0cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42428/0 (socket says 172.21.15.6:42428) 2024-05-20T18:02:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa2fb7fe640 1 -- 172.21.15.6:0/4099886072 learned_addr learned my addr 172.21.15.6:0/4099886072 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa2faffd640 1 -- 172.21.15.6:0/4099886072 >> v1:172.21.15.171:6789/0 conn(0x7fa2fc0d14f0 legacy=0x7fa2fc0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa2faffd640 1 -- 172.21.15.6:0/4099886072 >> v1:172.21.15.6:6789/0 conn(0x7fa2fc0b7210 legacy=0x7fa2fc0cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa2f9ffb640 1 -- 172.21.15.6:0/4099886072 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800689276 0 0) 0x7fa2fc0ce2f0 con 0x7fa2fc0b7210 2024-05-20T18:02:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.123+0000 7fa2faffd640 1 -- 172.21.15.6:0/4099886072 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc0d2080 con 0x7fa2fc0d10e0 2024-05-20T18:02:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.124+0000 7fa2faffd640 1 --2- 172.21.15.6:0/4099886072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0d10e0 0x7fa2fc0cf140 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0097a0 tx=0x7fa2ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0c8212a03023a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.124+0000 7fa2f9ffb640 1 -- 172.21.15.6:0/4099886072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec037070 con 0x7fa2fc0d10e0 2024-05-20T18:02:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.124+0000 7fa2f9ffb640 1 -- 172.21.15.6:0/4099886072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec032440 con 0x7fa2fc0d10e0 2024-05-20T18:02:18.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.124+0000 7fa2f9ffb640 1 -- 172.21.15.6:0/4099886072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec032810 con 0x7fa2fc0d10e0 2024-05-20T18:02:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.125+0000 7fa301516640 1 -- 172.21.15.6:0/4099886072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0d10e0 msgr2=0x7fa2fc0cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.125+0000 7fa301516640 1 --2- 172.21.15.6:0/4099886072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0d10e0 0x7fa2fc0cf140 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0097a0 tx=0x7fa2ec02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.125+0000 7fa301516640 1 -- 172.21.15.6:0/4099886072 shutdown_connections 2024-05-20T18:02:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.125+0000 7fa301516640 1 --2- 172.21.15.6:0/4099886072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0d10e0 0x7fa2fc0cf140 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.125+0000 7fa301516640 1 -- 172.21.15.6:0/4099886072 >> 172.21.15.6:0/4099886072 conn(0x7fa2fc0b44d0 msgr2=0x7fa2fc0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.125+0000 7fa301516640 1 -- 172.21.15.6:0/4099886072 shutdown_connections 2024-05-20T18:02:18.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.125+0000 7fa301516640 1 -- 172.21.15.6:0/4099886072 wait complete. 2024-05-20T18:02:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.127+0000 7fa301516640 1 Processor -- start 2024-05-20T18:02:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.127+0000 7fa301516640 1 -- start start 2024-05-20T18:02:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.128+0000 7fa301516640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0b7210 0x7fa2fc1f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.128+0000 7fa301516640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2fc0d10e0 0x7fa2fc1f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.128+0000 7fa301516640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2fc0d14f0 0x7fa2fc0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.128+0000 7fa301516640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc0b82c0 con 0x7fa2fc0b7210 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.128+0000 7fa301516640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc0d2640 con 0x7fa2fc0d10e0 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.128+0000 7fa301516640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa2fc0b8440 con 0x7fa2fc0d14f0 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.128+0000 7fa2faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0b7210 0x7fa2fc1f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0b7210 0x7fa2fc1f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43014/0 (socket says 172.21.15.6:43014) 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2faffd640 1 -- 172.21.15.6:0/2775754371 learned_addr learned my addr 172.21.15.6:0/2775754371 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2fb7fe640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2fc0d14f0 0x7fa2fc0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2fa7fc640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2fc0d10e0 0x7fa2fc1f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2faffd640 1 -- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2fc0d14f0 msgr2=0x7fa2fc0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2faffd640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2fc0d14f0 0x7fa2fc0c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2faffd640 1 -- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2fc0d10e0 msgr2=0x7fa2fc1f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2faffd640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2fc0d10e0 0x7fa2fc1f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2faffd640 1 -- 172.21.15.6:0/2775754371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc15b130 con 0x7fa2fc0b7210 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2faffd640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0b7210 0x7fa2fc1f29b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0098c0 tx=0x7fa2ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2e37fe640 1 -- 172.21.15.6:0/2775754371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec041070 con 0x7fa2fc0b7210 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2e37fe640 1 -- 172.21.15.6:0/2775754371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec03c870 con 0x7fa2fc0b7210 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc159610 con 0x7fa2fc0b7210 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa2e37fe640 1 -- 172.21.15.6:0/2775754371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec037040 con 0x7fa2fc0b7210 2024-05-20T18:02:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.129+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc1598b0 con 0x7fa2fc0b7210 2024-05-20T18:02:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.130+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2fc075b00 con 0x7fa2fc0b7210 2024-05-20T18:02:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.131+0000 7fa2e37fe640 1 -- 172.21.15.6:0/2775754371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa2ec044070 con 0x7fa2fc0b7210 2024-05-20T18:02:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.132+0000 7fa2e37fe640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2e806be30 0x7fa2e806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.132+0000 7fa2e37fe640 1 -- 172.21.15.6:0/2775754371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fa2ec0ab910 con 0x7fa2fc0b7210 2024-05-20T18:02:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.132+0000 7fa2fa7fc640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2e806be30 0x7fa2e806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.133+0000 7fa2fa7fc640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2e806be30 0x7fa2e806e340 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0b1a80 tx=0x7fa2f000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.137+0000 7fa2e37fe640 1 -- 172.21.15.6:0/2775754371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa2ec079a50 con 0x7fa2fc0b7210 2024-05-20T18:02:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.359+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa2fc0ccac0 con 0x7fa2fc0b7210 2024-05-20T18:02:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.359+0000 7fa2e37fe640 1 -- 172.21.15.6:0/2775754371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) ==== 53+0+73 (secure 0 0 0) 0x7fa2ec07dd50 con 0x7fa2fc0b7210 2024-05-20T18:02:18.358 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:02:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2e806be30 msgr2=0x7fa2e806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2e806be30 0x7fa2e806e340 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0b1a80 tx=0x7fa2f000d040 comp rx=0 tx=0).stop 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0b7210 msgr2=0x7fa2fc1f29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0b7210 0x7fa2fc1f29b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0098c0 tx=0x7fa2ec0046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 shutdown_connections 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa2e806be30 0x7fa2e806e340 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa2fc0d14f0 0x7fa2fc0c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2fc0d10e0 0x7fa2fc1f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 --2- 172.21.15.6:0/2775754371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2fc0b7210 0x7fa2fc1f29b0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 >> 172.21.15.6:0/2775754371 conn(0x7fa2fc0b44d0 msgr2=0x7fa2fc0d29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 shutdown_connections 2024-05-20T18:02:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18.361+0000 7fa301516640 1 -- 172.21.15.6:0/2775754371 wait complete. 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:02:18.371 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:02:18.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:18.372 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T18:02:18.388 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42176sec preferred_lft 42176sec 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:02:18.389 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T18:02:18.390 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:18.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:18.391 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:02:18.452 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T18:02:18.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:18.454 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T18:02:18.510 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T18:02:18.511 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:02:18.511 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T18:02:18.511 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T18:02:18.511 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:02:18.511 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:02:18.511 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T18:02:18.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T18:02:18.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T18:02:18.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T18:02:18.512 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T18:02:18.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:02:18.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:02:18.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:18.641 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T18:02:18.657 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T18:02:18.657 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T18:02:18.657 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:02:18.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:18.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T18:02:18.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:02:18.723 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T18:02:18.779 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:02:18.779 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:02:18.779 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:02:18.834 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T18:02:18.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:18.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:02:18.930 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:02:18.930 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:02:18.939 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:02:18.939 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:02:18.939 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:02:18.939 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:02:18.940 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:02:18.940 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T18:02:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:02:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:02:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:02:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:02:18.942 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:02:18.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:18.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:02:18.969 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:02:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:02:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:02:19.072 INFO:teuthology.orchestra.run.smithi006.stdout:client7400 2024-05-20T18:02:19.072 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:19.072 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:19.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:02:19.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.247+0000 7f544e856640 1 Processor -- start 2024-05-20T18:02:19.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.247+0000 7f544e856640 1 -- start start 2024-05-20T18:02:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.248+0000 7f544e856640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54480b6d90 0x7f544815f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:19.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.248+0000 7f544e856640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54480d0550 con 0x7f54480cf250 2024-05-20T18:02:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.248+0000 7f544e856640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54480d0830 con 0x7f54480d3220 2024-05-20T18:02:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.248+0000 7f544e856640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f544815f9a0 con 0x7f54480b6d90 2024-05-20T18:02:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.248+0000 7f54477fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54480b6d90 0x7f544815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.248+0000 7f5447fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f54480cf250 0x7f54480b6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42432/0 (socket says 172.21.15.6:42432) 2024-05-20T18:02:19.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.248+0000 7f5447fff640 1 -- 172.21.15.6:0/1488252115 learned_addr learned my addr 172.21.15.6:0/1488252115 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.249+0000 7f54477fe640 1 -- 172.21.15.6:0/1488252115 >> v1:172.21.15.171:6789/0 conn(0x7f54480d3220 legacy=0x7f54480d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.249+0000 7f54477fe640 1 -- 172.21.15.6:0/1488252115 >> v1:172.21.15.6:6789/0 conn(0x7f54480cf250 legacy=0x7f54480b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.249+0000 7f5446ffd640 1 -- 172.21.15.6:0/1488252115 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215676612 0 0) 0x7f54480d0550 con 0x7f54480cf250 2024-05-20T18:02:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.249+0000 7f54477fe640 1 -- 172.21.15.6:0/1488252115 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54480d2a20 con 0x7f54480b6d90 2024-05-20T18:02:19.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.249+0000 7f54477fe640 1 --2- 172.21.15.6:0/1488252115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480b6d90 0x7f544815f460 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f543c0097a0 tx=0x7f543c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35936bc1ecf5f36 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f5446ffd640 1 -- 172.21.15.6:0/1488252115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c037070 con 0x7f54480b6d90 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f5446ffd640 1 -- 172.21.15.6:0/1488252115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543c032440 con 0x7f54480b6d90 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f5446ffd640 1 -- 172.21.15.6:0/1488252115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c032810 con 0x7f54480b6d90 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f544e856640 1 -- 172.21.15.6:0/1488252115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480b6d90 msgr2=0x7f544815f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f544e856640 1 --2- 172.21.15.6:0/1488252115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480b6d90 0x7f544815f460 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f543c0097a0 tx=0x7f543c02a230 comp rx=0 tx=0).stop 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f544e856640 1 -- 172.21.15.6:0/1488252115 shutdown_connections 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f544e856640 1 --2- 172.21.15.6:0/1488252115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480b6d90 0x7f544815f460 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f544e856640 1 -- 172.21.15.6:0/1488252115 >> 172.21.15.6:0/1488252115 conn(0x7f54480d1860 msgr2=0x7f54480d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f544e856640 1 -- 172.21.15.6:0/1488252115 shutdown_connections 2024-05-20T18:02:19.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.250+0000 7f544e856640 1 -- 172.21.15.6:0/1488252115 wait complete. 2024-05-20T18:02:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.252+0000 7f544e856640 1 Processor -- start 2024-05-20T18:02:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.252+0000 7f544e856640 1 -- start start 2024-05-20T18:02:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f544e856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480cf250 0x7f5448148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f544e856640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54480d3220 0x7f54481f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f544e856640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f544815cae0 0x7f544815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f544e856640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f54480d27d0 con 0x7f54480cf250 2024-05-20T18:02:19.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f544e856640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f54480d0140 con 0x7f54480d3220 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f544e856640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f54480d02c0 con 0x7f544815cae0 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480cf250 0x7f5448148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480cf250 0x7f5448148e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43038/0 (socket says 172.21.15.6:43038) 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 -- 172.21.15.6:0/753345852 learned_addr learned my addr 172.21.15.6:0/753345852 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f54477fe640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54480d3220 0x7f54481f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f544cdf3640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f544815cae0 0x7f544815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 -- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f544815cae0 msgr2=0x7f544815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f544815cae0 0x7f544815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 -- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54480d3220 msgr2=0x7f54481f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54480d3220 0x7f54481f96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 -- 172.21.15.6:0/753345852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544815d430 con 0x7f54480cf250 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f54477fe640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54480d3220 0x7f54481f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5447fff640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480cf250 0x7f5448148e30 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f543800c420 tx=0x7f543800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5444ff9640 1 -- 172.21.15.6:0/753345852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380074e0 con 0x7f54480cf250 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.254+0000 7f5444ff9640 1 -- 172.21.15.6:0/753345852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54380047e0 con 0x7f54480cf250 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.255+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54481497f0 con 0x7f54480cf250 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.255+0000 7f5444ff9640 1 -- 172.21.15.6:0/753345852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438004c10 con 0x7f54480cf250 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.255+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54481582f0 con 0x7f54480cf250 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.256+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5448075b00 con 0x7f54480cf250 2024-05-20T18:02:19.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.256+0000 7f5444ff9640 1 -- 172.21.15.6:0/753345852 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5438011070 con 0x7f54480cf250 2024-05-20T18:02:19.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.257+0000 7f5444ff9640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f543406be30 0x7f543406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:19.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.257+0000 7f5444ff9640 1 -- 172.21.15.6:0/753345852 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f543808abf0 con 0x7f54480cf250 2024-05-20T18:02:19.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.257+0000 7f54477fe640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f543406be30 0x7f543406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:19.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.258+0000 7f54477fe640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f543406be30 0x7f543406e340 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f543c034000 tx=0x7f543c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:19.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.262+0000 7f5444ff9640 1 -- 172.21.15.6:0/753345852 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f544815d430 con 0x7f54480cf250 2024-05-20T18:02:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.483+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f54480b7440 con 0x7f54480cf250 2024-05-20T18:02:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.484+0000 7f5444ff9640 1 -- 172.21.15.6:0/753345852 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) ==== 53+0+73 (secure 0 0 0) 0x7f5438059410 con 0x7f54480cf250 2024-05-20T18:02:19.482 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:02:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f543406be30 msgr2=0x7f543406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f543406be30 0x7f543406e340 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f543c034000 tx=0x7f543c02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480cf250 msgr2=0x7f5448148e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480cf250 0x7f5448148e30 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f543800c420 tx=0x7f543800c8e0 comp rx=0 tx=0).stop 2024-05-20T18:02:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 shutdown_connections 2024-05-20T18:02:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f543406be30 0x7f543406e340 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f544815cae0 0x7f544815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54480d3220 0x7f54481f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 --2- 172.21.15.6:0/753345852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54480cf250 0x7f5448148e30 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 >> 172.21.15.6:0/753345852 conn(0x7f54480d1860 msgr2=0x7f544815a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 shutdown_connections 2024-05-20T18:02:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:19.486+0000 7f544e856640 1 -- 172.21.15.6:0/753345852 wait complete. 2024-05-20T18:02:19.495 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:02:19.496 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:02:19.496 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T18:02:19.496 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T18:02:19.496 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T18:02:19.496 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:02:19.496 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:02:19.496 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:02:19.496 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:02:19.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:19.496 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T18:02:19.516 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:02:19.516 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:02:19.516 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:02:19.517 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42185sec preferred_lft 42185sec 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:02:19.518 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T18:02:19.519 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T18:02:19.519 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:19.519 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:02:19.519 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T18:02:19.519 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T18:02:19.519 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:19.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:19.519 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:02:19.586 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T18:02:19.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:19.588 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T18:02:19.647 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T18:02:19.648 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:02:19.648 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T18:02:19.648 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T18:02:19.648 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:02:19.649 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:02:19.649 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T18:02:19.649 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T18:02:19.649 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T18:02:19.649 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T18:02:19.649 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T18:02:19.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:02:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:02:19.776 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:02:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:02:19.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:19.783 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T18:02:19.800 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T18:02:19.800 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T18:02:19.800 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:02:19.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:19.800 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T18:02:19.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:02:19.866 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T18:02:19.921 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:02:19.922 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:02:19.922 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:02:19.977 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T18:02:19.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:19.977 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:02:20.071 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:02:20.071 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:02:20.080 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:02:20.081 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:02:20.081 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:02:20.081 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:02:20.081 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:02:20.081 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T18:02:20.081 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:02:20.081 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:02:20.082 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:02:20.082 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:02:20.083 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:02:20.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:20.083 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:02:20.108 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:02:20.199 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:02:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:02:20.201 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:02:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:02:20.207 INFO:teuthology.orchestra.run.smithi171.stdout:client7406 2024-05-20T18:02:20.207 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:02:20.207 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:20.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-05-20T18:02:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.356+0000 7fe3838a2640 1 Processor -- start 2024-05-20T18:02:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.356+0000 7fe3838a2640 1 -- start start 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.357+0000 7fe3838a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe37c163a10 0x7fe37c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.357+0000 7fe3838a2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe37c0d0370 con 0x7fe37c0b4010 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.357+0000 7fe3838a2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe37c0d0650 con 0x7fe37c0d14b0 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.357+0000 7fe3838a2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe37c0d3ca0 con 0x7fe37c163a10 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.357+0000 7fe38163e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe37c163a10 0x7fe37c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.357+0000 7fe380e3d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe37c0b4010 0x7fe37c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42438/0 (socket says 172.21.15.6:42438) 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.358+0000 7fe380e3d640 1 -- 172.21.15.6:0/1485179444 learned_addr learned my addr 172.21.15.6:0/1485179444 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.358+0000 7fe38163e640 1 -- 172.21.15.6:0/1485179444 >> v1:172.21.15.171:6789/0 conn(0x7fe37c0d14b0 legacy=0x7fe37c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.358+0000 7fe38163e640 1 -- 172.21.15.6:0/1485179444 >> v1:172.21.15.6:6789/0 conn(0x7fe37c0b4010 legacy=0x7fe37c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.358+0000 7fe373fff640 1 -- 172.21.15.6:0/1485179444 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749749226 0 0) 0x7fe37c0d0370 con 0x7fe37c0b4010 2024-05-20T18:02:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.358+0000 7fe38163e640 1 -- 172.21.15.6:0/1485179444 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c0d3650 con 0x7fe37c163a10 2024-05-20T18:02:20.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.359+0000 7fe38163e640 1 --2- 172.21.15.6:0/1485179444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c163a10 0x7fe37c0d4130 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe3780097a0 tx=0x7fe37802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631cefbef50db81f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.359+0000 7fe373fff640 1 -- 172.21.15.6:0/1485179444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378037070 con 0x7fe37c163a10 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.359+0000 7fe373fff640 1 -- 172.21.15.6:0/1485179444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe378032440 con 0x7fe37c163a10 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.359+0000 7fe373fff640 1 -- 172.21.15.6:0/1485179444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378032810 con 0x7fe37c163a10 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.359+0000 7fe3838a2640 1 -- 172.21.15.6:0/1485179444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c163a10 msgr2=0x7fe37c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.359+0000 7fe3838a2640 1 --2- 172.21.15.6:0/1485179444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c163a10 0x7fe37c0d4130 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe3780097a0 tx=0x7fe37802a230 comp rx=0 tx=0).stop 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.360+0000 7fe3838a2640 1 -- 172.21.15.6:0/1485179444 shutdown_connections 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.360+0000 7fe3838a2640 1 --2- 172.21.15.6:0/1485179444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c163a10 0x7fe37c0d4130 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.360+0000 7fe3838a2640 1 -- 172.21.15.6:0/1485179444 >> 172.21.15.6:0/1485179444 conn(0x7fe37c06d240 msgr2=0x7fe37c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.360+0000 7fe3838a2640 1 -- 172.21.15.6:0/1485179444 shutdown_connections 2024-05-20T18:02:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.360+0000 7fe3838a2640 1 -- 172.21.15.6:0/1485179444 wait complete. 2024-05-20T18:02:20.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.361+0000 7fe3838a2640 1 Processor -- start 2024-05-20T18:02:20.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.361+0000 7fe3838a2640 1 -- start start 2024-05-20T18:02:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe3838a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c0b4010 0x7fe37c149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe3838a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe37c0d14b0 0x7fe37c15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe3838a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe37c163a10 0x7fe37c156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe3838a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c0b8390 con 0x7fe37c0b4010 2024-05-20T18:02:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe3838a2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c0b8210 con 0x7fe37c0d14b0 2024-05-20T18:02:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe3838a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe37c0b8510 con 0x7fe37c163a10 2024-05-20T18:02:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c0b4010 0x7fe37c149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c0b4010 0x7fe37c149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43064/0 (socket says 172.21.15.6:43064) 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 -- 172.21.15.6:0/3270689961 learned_addr learned my addr 172.21.15.6:0/3270689961 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe380e3d640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe37c0d14b0 0x7fe37c15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe381e3f640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe37c163a10 0x7fe37c156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 -- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe37c163a10 msgr2=0x7fe37c156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe37c163a10 0x7fe37c156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 -- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe37c0d14b0 msgr2=0x7fe37c15a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe37c0d14b0 0x7fe37c15a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 -- 172.21.15.6:0/3270689961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c1555f0 con 0x7fe37c0b4010 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.363+0000 7fe38163e640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c0b4010 0x7fe37c149bd0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fe3780098c0 tx=0x7fe3780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.364+0000 7fe371ffb640 1 -- 172.21.15.6:0/3270689961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378037040 con 0x7fe37c0b4010 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.364+0000 7fe371ffb640 1 -- 172.21.15.6:0/3270689961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe378042070 con 0x7fe37c0b4010 2024-05-20T18:02:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.364+0000 7fe371ffb640 1 -- 172.21.15.6:0/3270689961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe378030a70 con 0x7fe37c0b4010 2024-05-20T18:02:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.364+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c1558d0 con 0x7fe37c0b4010 2024-05-20T18:02:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.364+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c155e90 con 0x7fe37c0b4010 2024-05-20T18:02:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.365+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37c0cead0 con 0x7fe37c0b4010 2024-05-20T18:02:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.366+0000 7fe371ffb640 1 -- 172.21.15.6:0/3270689961 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe378030c10 con 0x7fe37c0b4010 2024-05-20T18:02:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.366+0000 7fe371ffb640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36006be60 0x7fe36006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.366+0000 7fe371ffb640 1 -- 172.21.15.6:0/3270689961 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fe3780ab940 con 0x7fe37c0b4010 2024-05-20T18:02:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.366+0000 7fe380e3d640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36006be60 0x7fe36006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.367+0000 7fe380e3d640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36006be60 0x7fe36006e370 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe37c15f300 tx=0x7fe36c007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.371+0000 7fe371ffb640 1 -- 172.21.15.6:0/3270689961 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe378079a80 con 0x7fe37c0b4010 2024-05-20T18:02:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.555+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7fe37c156060 con 0x7fe37c0b4010 2024-05-20T18:02:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.559+0000 7fe371ffb640 1 -- 172.21.15.6:0/3270689961 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v57)=0 v57) ==== 121+0+0 (secure 0 0 0) 0x7fe37807dd80 con 0x7fe37c0b4010 2024-05-20T18:02:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36006be60 msgr2=0x7fe36006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36006be60 0x7fe36006e370 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe37c15f300 tx=0x7fe36c007e40 comp rx=0 tx=0).stop 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c0b4010 msgr2=0x7fe37c149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c0b4010 0x7fe37c149bd0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fe3780098c0 tx=0x7fe3780046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 shutdown_connections 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe36006be60 0x7fe36006e370 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe37c163a10 0x7fe37c156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe37c0d14b0 0x7fe37c15a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 --2- 172.21.15.6:0/3270689961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe37c0b4010 0x7fe37c149bd0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 >> 172.21.15.6:0/3270689961 conn(0x7fe37c06d240 msgr2=0x7fe37c0b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 shutdown_connections 2024-05-20T18:02:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.561+0000 7fe3838a2640 1 -- 172.21.15.6:0/3270689961 wait complete. 2024-05-20T18:02:20.571 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 200 2024-05-20T18:02:20.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.690+0000 7fb50617e640 1 Processor -- start 2024-05-20T18:02:20.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.690+0000 7fb50617e640 1 -- start start 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.691+0000 7fb50617e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 0x7fb5000cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.691+0000 7fb50617e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5000cfd20 con 0x7fb50015f220 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.691+0000 7fb50617e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5000cda20 con 0x7fb5000ce7e0 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.691+0000 7fb50617e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5000cdd00 con 0x7fb5000cf3d0 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4ff7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb50015f220 0x7fb5000d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42450/0 (socket says 172.21.15.6:42450) 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4ff7fe640 1 -- 172.21.15.6:0/2810411144 learned_addr learned my addr 172.21.15.6:0/2810411144 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4feffd640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 0x7fb5000cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158754225 0 0) 0x7fb4f0001110 con 0x7fb50015f220 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e8003520 con 0x7fb50015f220 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3916100370 0 0) 0x7fb5000cda20 con 0x7fb5000ce7e0 2024-05-20T18:02:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f0001110 con 0x7fb5000ce7e0 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 865157305 0 0) 0x7fb4e8003520 con 0x7fb50015f220 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 msgr2=0x7fb5000cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 0x7fb5000cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 >> v1:172.21.15.171:6789/0 conn(0x7fb5000ce7e0 legacy=0x7fb5000cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5000cdfe0 con 0x7fb50015f220 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fb4f0001840 con 0x7fb50015f220 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 >> v1:172.21.15.6:6789/0 conn(0x7fb50015f220 legacy=0x7fb5000d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 0x7fb4e8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4e8004120 0x7fb4e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e8004d40 0x7fb4e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5000cdd00 con 0x7fb4e8004d40 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e800bc20 con 0x7fb4e8004120 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.692+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e800be20 con 0x7fb5000cf3d0 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4ff7fe640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 0x7fb4e8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4feffd640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4e8004120 0x7fb4e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4fffff640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e8004d40 0x7fb4e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4ff7fe640 1 -- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4e8004120 msgr2=0x7fb4e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4ff7fe640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4e8004120 0x7fb4e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4ff7fe640 1 -- 172.21.15.6:0/2810411144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e8004d40 msgr2=0x7fb4e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4ff7fe640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e8004d40 0x7fb4e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4ff7fe640 1 -- 172.21.15.6:0/2810411144 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e8003520 con 0x7fb5000cf3d0 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4feffd640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4e8004120 0x7fb4e8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.693+0000 7fb4fffff640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4e8004d40 0x7fb4e8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.694+0000 7fb4ff7fe640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 0x7fb4e8003b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c2f0 tx=0x7fb4e8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28b8bd754e5a4fe3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.694+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0036070 con 0x7fb5000cf3d0 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.694+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f0005af0 con 0x7fb5000cf3d0 2024-05-20T18:02:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.694+0000 7fb4fe7fc640 1 -- 172.21.15.6:0/2810411144 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0007d90 con 0x7fb5000cf3d0 2024-05-20T18:02:20.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.695+0000 7fb50617e640 1 -- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 msgr2=0x7fb4e8003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.695+0000 7fb50617e640 1 --2- 172.21.15.6:0/2810411144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cf3d0 0x7fb4e8003b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c2f0 tx=0x7fb4e8005830 comp rx=0 tx=0).stop 2024-05-20T18:02:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.695+0000 7fb4fffff640 1 -- 172.21.15.6:0/2810411144 reap_dead start 2024-05-20T18:02:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.695+0000 7fb50617e640 1 -- 172.21.15.6:0/2810411144 shutdown_connections 2024-05-20T18:02:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.695+0000 7fb50617e640 1 -- 172.21.15.6:0/2810411144 >> 172.21.15.6:0/2810411144 conn(0x7fb5000b44d0 msgr2=0x7fb5000b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.695+0000 7fb50617e640 1 -- 172.21.15.6:0/2810411144 shutdown_connections 2024-05-20T18:02:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.695+0000 7fb50617e640 1 -- 172.21.15.6:0/2810411144 wait complete. 2024-05-20T18:02:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.696+0000 7fb50617e640 1 Processor -- start 2024-05-20T18:02:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.697+0000 7fb50617e640 1 -- start start 2024-05-20T18:02:20.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb50617e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5000cf3d0 0x7fb5000c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb50617e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5000c64f0 0x7fb5000cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb50617e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cc470 0x7fb50015f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb50617e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5000cd680 con 0x7fb5000c64f0 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb50617e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5000d0fd0 con 0x7fb5000cf3d0 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb50617e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5000cd800 con 0x7fb5000cc470 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5000c64f0 0x7fb5000cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5000c64f0 0x7fb5000cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43084/0 (socket says 172.21.15.6:43084) 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4feffd640 1 -- 172.21.15.6:0/3593587699 learned_addr learned my addr 172.21.15.6:0/3593587699 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4fffff640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cc470 0x7fb50015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4feffd640 1 -- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cc470 msgr2=0x7fb50015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4ff7fe640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5000cf3d0 0x7fb5000c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4feffd640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cc470 0x7fb50015f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4feffd640 1 -- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5000cf3d0 msgr2=0x7fb5000c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4feffd640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5000cf3d0 0x7fb5000c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4feffd640 1 -- 172.21.15.6:0/3593587699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5000c6f40 con 0x7fb5000c64f0 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4fffff640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cc470 0x7fb50015f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.698+0000 7fb4ff7fe640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5000cf3d0 0x7fb5000c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.699+0000 7fb4feffd640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5000c64f0 0x7fb5000cbf30 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4011a80 tx=0x7fb4f4011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.699+0000 7fb4e7fff640 1 -- 172.21.15.6:0/3593587699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400fc10 con 0x7fb5000c64f0 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.699+0000 7fb4e7fff640 1 -- 172.21.15.6:0/3593587699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f400fdb0 con 0x7fb5000c64f0 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.699+0000 7fb4e7fff640 1 -- 172.21.15.6:0/3593587699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4014640 con 0x7fb5000c64f0 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.699+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5000c7220 con 0x7fb5000c64f0 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.699+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5000c8830 con 0x7fb5000c64f0 2024-05-20T18:02:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.700+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb500075b00 con 0x7fb5000c64f0 2024-05-20T18:02:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.700+0000 7fb4e7fff640 1 -- 172.21.15.6:0/3593587699 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4f4012040 con 0x7fb5000c64f0 2024-05-20T18:02:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.701+0000 7fb4e7fff640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb4ec06be60 0x7fb4ec06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.701+0000 7fb4e7fff640 1 -- 172.21.15.6:0/3593587699 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fb4f408b870 con 0x7fb5000c64f0 2024-05-20T18:02:20.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.701+0000 7fb4ff7fe640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb4ec06be60 0x7fb4ec06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:20.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.702+0000 7fb4ff7fe640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb4ec06be60 0x7fb4ec06e370 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0033000 tx=0x7fb4f0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.706+0000 7fb4e7fff640 1 -- 172.21.15.6:0/3593587699 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb4f4019030 con 0x7fb5000c64f0 2024-05-20T18:02:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.887+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7fb5000c6cd0 con 0x7fb5000c64f0 2024-05-20T18:02:20.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.891+0000 7fb4e7fff640 1 -- 172.21.15.6:0/3593587699 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v58)=0 v58) ==== 119+0+0 (secure 0 0 0) 0x7fb4f405a000 con 0x7fb5000c64f0 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb4ec06be60 msgr2=0x7fb4ec06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb4ec06be60 0x7fb4ec06e370 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0033000 tx=0x7fb4f0009030 comp rx=0 tx=0).stop 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5000c64f0 msgr2=0x7fb5000cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5000c64f0 0x7fb5000cbf30 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4011a80 tx=0x7fb4f4011f40 comp rx=0 tx=0).stop 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 shutdown_connections 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb4ec06be60 0x7fb4ec06e370 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5000cc470 0x7fb50015f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5000c64f0 0x7fb5000cbf30 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 --2- 172.21.15.6:0/3593587699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5000cf3d0 0x7fb5000c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 >> 172.21.15.6:0/3593587699 conn(0x7fb5000b44d0 msgr2=0x7fb5000cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 shutdown_connections 2024-05-20T18:02:20.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:20.893+0000 7fb50617e640 1 -- 172.21.15.6:0/3593587699 wait complete. 2024-05-20T18:02:20.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 400 2024-05-20T18:02:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.022+0000 7f81f7480640 1 Processor -- start 2024-05-20T18:02:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.022+0000 7f81f7480640 1 -- start start 2024-05-20T18:02:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f7480640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81f006fb10 0x7f81f015cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f7480640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f81f00cd6f0 0x7f81f00cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f7480640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f006e780 con 0x7f81f006c530 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f7480640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f81f0160a20 con 0x7f81f006fb10 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f7480640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f81f006ea60 con 0x7f81f00cd6f0 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f521c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81f006fb10 0x7f81f015cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f521c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81f006fb10 0x7f81f015cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43096/0 (socket says 172.21.15.6:43096) 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f521c640 1 -- 172.21.15.6:0/4044105105 learned_addr learned my addr 172.21.15.6:0/4044105105 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f4a1b640 1 --2- 172.21.15.6:0/4044105105 >> v2:172.21.15.171:3300/0 conn(0x7f81f00cd6f0 0x7f81f00cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f521c640 1 -- 172.21.15.6:0/4044105105 >> v2:172.21.15.171:3300/0 conn(0x7f81f00cd6f0 msgr2=0x7f81f00cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f521c640 1 --2- 172.21.15.6:0/4044105105 >> v2:172.21.15.171:3300/0 conn(0x7f81f00cd6f0 0x7f81f00cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f521c640 1 -- 172.21.15.6:0/4044105105 >> v1:172.21.15.171:6789/0 conn(0x7f81f006c530 legacy=0x7f81f006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f521c640 1 -- 172.21.15.6:0/4044105105 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f006ed40 con 0x7f81f006fb10 2024-05-20T18:02:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.024+0000 7f81f4a1b640 1 --2- 172.21.15.6:0/4044105105 >> v2:172.21.15.171:3300/0 conn(0x7f81f00cd6f0 0x7f81f00cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.025+0000 7f81f521c640 1 --2- 172.21.15.6:0/4044105105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f015cf30 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f81f00d0770 tx=0x7f81ec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a285ddbffb2e0d66 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.025+0000 7f81e7fff640 1 -- 172.21.15.6:0/4044105105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec036070 con 0x7f81f006fb10 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.025+0000 7f81e7fff640 1 -- 172.21.15.6:0/4044105105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec031600 con 0x7f81f006fb10 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.025+0000 7f81e7fff640 1 -- 172.21.15.6:0/4044105105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0319d0 con 0x7f81f006fb10 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.026+0000 7f81f7480640 1 -- 172.21.15.6:0/4044105105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 msgr2=0x7f81f015cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.026+0000 7f81f7480640 1 --2- 172.21.15.6:0/4044105105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f015cf30 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f81f00d0770 tx=0x7f81ec02a6f0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.026+0000 7f81f7480640 1 -- 172.21.15.6:0/4044105105 shutdown_connections 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.026+0000 7f81f7480640 1 --2- 172.21.15.6:0/4044105105 >> v2:172.21.15.171:3300/0 conn(0x7f81f00cd6f0 0x7f81f00cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.026+0000 7f81f7480640 1 --2- 172.21.15.6:0/4044105105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f015cf30 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.026+0000 7f81f7480640 1 -- 172.21.15.6:0/4044105105 >> 172.21.15.6:0/4044105105 conn(0x7f81f00723a0 msgr2=0x7f81f00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.026+0000 7f81f7480640 1 -- 172.21.15.6:0/4044105105 shutdown_connections 2024-05-20T18:02:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.026+0000 7f81f7480640 1 -- 172.21.15.6:0/4044105105 wait complete. 2024-05-20T18:02:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.028+0000 7f81f7480640 1 Processor -- start 2024-05-20T18:02:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.028+0000 7f81f7480640 1 -- start start 2024-05-20T18:02:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f7480640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f006c530 0x7f81f01f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f7480640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f009af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f7480640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00cd6f0 0x7f81f00add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f7480640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f81f006e560 con 0x7f81f006fb10 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f7480640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81f006e3e0 con 0x7f81f006c530 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f7480640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81f00b0110 con 0x7f81f00cd6f0 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f4a1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f009af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f4a1b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f009af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43100/0 (socket says 172.21.15.6:43100) 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f4a1b640 1 -- 172.21.15.6:0/1737874998 learned_addr learned my addr 172.21.15.6:0/1737874998 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f5a1d640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00cd6f0 0x7f81f00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.029+0000 7f81f521c640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f006c530 0x7f81f01f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81f4a1b640 1 -- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00cd6f0 msgr2=0x7f81f00add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81f4a1b640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00cd6f0 0x7f81f00add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81f4a1b640 1 -- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f006c530 msgr2=0x7f81f01f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81f4a1b640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f006c530 0x7f81f01f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81f4a1b640 1 -- 172.21.15.6:0/1737874998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f015d0b0 con 0x7f81f006fb10 2024-05-20T18:02:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81f4a1b640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f009af30 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c7c0 tx=0x7f81e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81e5ffb640 1 -- 172.21.15.6:0/1737874998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0015070 con 0x7f81f006fb10 2024-05-20T18:02:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81e5ffb640 1 -- 172.21.15.6:0/1737874998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e0007820 con 0x7f81f006fb10 2024-05-20T18:02:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f015d390 con 0x7f81f006fb10 2024-05-20T18:02:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81e5ffb640 1 -- 172.21.15.6:0/1737874998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0007bf0 con 0x7f81f006fb10 2024-05-20T18:02:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.030+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f015d950 con 0x7f81f006fb10 2024-05-20T18:02:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.031+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f00680e0 con 0x7f81f006fb10 2024-05-20T18:02:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.032+0000 7f81e5ffb640 1 -- 172.21.15.6:0/1737874998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81e0018070 con 0x7f81f006fb10 2024-05-20T18:02:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.033+0000 7f81e5ffb640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81d406be30 0x7f81d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.033+0000 7f81e5ffb640 1 -- 172.21.15.6:0/1737874998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f81e008af70 con 0x7f81f006fb10 2024-05-20T18:02:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.033+0000 7f81f521c640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81d406be30 0x7f81d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.033+0000 7f81f521c640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81d406be30 0x7f81d406e340 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f81ec033000 tx=0x7f81ec009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.037+0000 7f81e5ffb640 1 -- 172.21.15.6:0/1737874998 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f81f00680e0 con 0x7f81f006fb10 2024-05-20T18:02:21.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.220+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f81f00706a0 con 0x7f81f006fb10 2024-05-20T18:02:21.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.225+0000 7f81e5ffb640 1 -- 172.21.15.6:0/1737874998 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v59)=0 v59) ==== 128+0+0 (secure 0 0 0) 0x7f81f00706a0 con 0x7f81f006fb10 2024-05-20T18:02:21.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81d406be30 msgr2=0x7f81d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81d406be30 0x7f81d406e340 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f81ec033000 tx=0x7f81ec009000 comp rx=0 tx=0).stop 2024-05-20T18:02:21.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 msgr2=0x7f81f009af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f009af30 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c7c0 tx=0x7f81e000cc80 comp rx=0 tx=0).stop 2024-05-20T18:02:21.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 shutdown_connections 2024-05-20T18:02:21.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f81d406be30 0x7f81d406e340 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00cd6f0 0x7f81f00add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f006fb10 0x7f81f009af30 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 --2- 172.21.15.6:0/1737874998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f006c530 0x7f81f01f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 >> 172.21.15.6:0/1737874998 conn(0x7f81f00723a0 msgr2=0x7f81f0159d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:21.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 shutdown_connections 2024-05-20T18:02:21.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.227+0000 7f81f7480640 1 -- 172.21.15.6:0/1737874998 wait complete. 2024-05-20T18:02:21.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-05-20T18:02:21.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.355+0000 7f9e85273640 1 Processor -- start 2024-05-20T18:02:21.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.355+0000 7f9e85273640 1 -- start start 2024-05-20T18:02:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e85273640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e80162820 0x7f9e800b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e85273640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8006dae0 0x7f9e800b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e85273640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e800d0630 con 0x7f9e800b3e80 2024-05-20T18:02:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e85273640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9e800d39c0 con 0x7f9e80162820 2024-05-20T18:02:21.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e85273640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9e800d3ca0 con 0x7f9e8006dae0 2024-05-20T18:02:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e7effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e80162820 0x7f9e800b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e7effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e80162820 0x7f9e800b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43112/0 (socket says 172.21.15.6:43112) 2024-05-20T18:02:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e7effd640 1 -- 172.21.15.6:0/3984886082 learned_addr learned my addr 172.21.15.6:0/3984886082 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e7f7fe640 1 --2- 172.21.15.6:0/3984886082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8006dae0 0x7f9e800b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e7effd640 1 -- 172.21.15.6:0/3984886082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8006dae0 msgr2=0x7f9e800b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e7effd640 1 --2- 172.21.15.6:0/3984886082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8006dae0 0x7f9e800b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e7effd640 1 -- 172.21.15.6:0/3984886082 >> v1:172.21.15.171:6789/0 conn(0x7f9e800b3e80 legacy=0x7f9e8006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.357+0000 7f9e7effd640 1 -- 172.21.15.6:0/3984886082 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800d3f80 con 0x7f9e80162820 2024-05-20T18:02:21.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.358+0000 7f9e7effd640 1 --2- 172.21.15.6:0/3984886082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e80162820 0x7f9e800b3940 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009870 tx=0x7f9e7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f5a8f38479311a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.358+0000 7f9e7dffb640 1 -- 172.21.15.6:0/3984886082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70037070 con 0x7f9e80162820 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.358+0000 7f9e7dffb640 1 -- 172.21.15.6:0/3984886082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e70032440 con 0x7f9e80162820 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.358+0000 7f9e7dffb640 1 -- 172.21.15.6:0/3984886082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70032810 con 0x7f9e80162820 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.359+0000 7f9e85273640 1 -- 172.21.15.6:0/3984886082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e80162820 msgr2=0x7f9e800b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.359+0000 7f9e85273640 1 --2- 172.21.15.6:0/3984886082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e80162820 0x7f9e800b3940 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009870 tx=0x7f9e7002a270 comp rx=0 tx=0).stop 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.359+0000 7f9e85273640 1 -- 172.21.15.6:0/3984886082 shutdown_connections 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.359+0000 7f9e85273640 1 --2- 172.21.15.6:0/3984886082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e8006dae0 0x7f9e800b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.359+0000 7f9e85273640 1 --2- 172.21.15.6:0/3984886082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e80162820 0x7f9e800b3940 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.359+0000 7f9e85273640 1 -- 172.21.15.6:0/3984886082 >> 172.21.15.6:0/3984886082 conn(0x7f9e800d4bd0 msgr2=0x7f9e800d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.359+0000 7f9e85273640 1 -- 172.21.15.6:0/3984886082 shutdown_connections 2024-05-20T18:02:21.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.359+0000 7f9e85273640 1 -- 172.21.15.6:0/3984886082 wait complete. 2024-05-20T18:02:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.361+0000 7f9e85273640 1 Processor -- start 2024-05-20T18:02:21.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.361+0000 7f9e85273640 1 -- start start 2024-05-20T18:02:21.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.362+0000 7f9e85273640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e800b3e80 0x7f9e800ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.362+0000 7f9e85273640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e80162820 0x7f9e8015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.362+0000 7f9e85273640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8015b050 0x7f9e800cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.362+0000 7f9e85273640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800d4780 con 0x7f9e8015b050 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.362+0000 7f9e85273640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800d0300 con 0x7f9e80162820 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.362+0000 7f9e85273640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9e800d4900 con 0x7f9e800b3e80 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8015b050 0x7f9e800cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8015b050 0x7f9e800cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43122/0 (socket says 172.21.15.6:43122) 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 -- 172.21.15.6:0/1311846967 learned_addr learned my addr 172.21.15.6:0/1311846967 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7effd640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e800b3e80 0x7f9e800ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7e7fc640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e80162820 0x7f9e8015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 -- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e800b3e80 msgr2=0x7f9e800ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e800b3e80 0x7f9e800ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 -- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e80162820 msgr2=0x7f9e8015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e80162820 0x7f9e8015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 -- 172.21.15.6:0/1311846967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800ca710 con 0x7f9e8015b050 2024-05-20T18:02:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e7f7fe640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8015b050 0x7f9e800cd3e0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800efc0 tx=0x7f9e7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e777fe640 1 -- 172.21.15.6:0/1311846967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78018020 con 0x7f9e8015b050 2024-05-20T18:02:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e777fe640 1 -- 172.21.15.6:0/1311846967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e78014480 con 0x7f9e8015b050 2024-05-20T18:02:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e800b5a70 con 0x7f9e8015b050 2024-05-20T18:02:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.363+0000 7f9e777fe640 1 -- 172.21.15.6:0/1311846967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78009e60 con 0x7f9e8015b050 2024-05-20T18:02:21.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.364+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e800c96f0 con 0x7f9e8015b050 2024-05-20T18:02:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.364+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e800b57e0 con 0x7f9e8015b050 2024-05-20T18:02:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.365+0000 7f9e777fe640 1 -- 172.21.15.6:0/1311846967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e78005d10 con 0x7f9e8015b050 2024-05-20T18:02:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.366+0000 7f9e777fe640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e6006be60 0x7f9e6006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.366+0000 7f9e777fe640 1 -- 172.21.15.6:0/1311846967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f9e7808bbf0 con 0x7f9e8015b050 2024-05-20T18:02:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.366+0000 7f9e7effd640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e6006be60 0x7f9e6006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.366+0000 7f9e7effd640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e6006be60 0x7f9e6006e370 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e70034000 tx=0x7f9e7002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.370+0000 7f9e777fe640 1 -- 172.21.15.6:0/1311846967 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9e78022030 con 0x7f9e8015b050 2024-05-20T18:02:21.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.555+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f9e80075b00 con 0x7f9e8015b050 2024-05-20T18:02:21.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.556+0000 7f9e777fe640 1 -- 172.21.15.6:0/1311846967 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v59) ==== 106+0+4 (secure 0 0 0) 0x7f9e78010040 con 0x7f9e8015b050 2024-05-20T18:02:21.554 INFO:teuthology.orchestra.run.smithi006.stdout:100 2024-05-20T18:02:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e6006be60 msgr2=0x7f9e6006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e6006be60 0x7f9e6006e370 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e70034000 tx=0x7f9e7002e000 comp rx=0 tx=0).stop 2024-05-20T18:02:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8015b050 msgr2=0x7f9e800cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8015b050 0x7f9e800cd3e0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800efc0 tx=0x7f9e7800c490 comp rx=0 tx=0).stop 2024-05-20T18:02:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 shutdown_connections 2024-05-20T18:02:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9e6006be60 0x7f9e6006e370 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e8015b050 0x7f9e800cd3e0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e80162820 0x7f9e8015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 --2- 172.21.15.6:0/1311846967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e800b3e80 0x7f9e800ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 >> 172.21.15.6:0/1311846967 conn(0x7f9e800d4bd0 msgr2=0x7f9e80161cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 shutdown_connections 2024-05-20T18:02:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.558+0000 7f9e85273640 1 -- 172.21.15.6:0/1311846967 wait complete. 2024-05-20T18:02:21.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-05-20T18:02:21.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.687+0000 7fd72caca640 1 Processor -- start 2024-05-20T18:02:21.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.687+0000 7fd72caca640 1 -- start start 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72caca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd728070f60 0x7fd72815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72caca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7280ce2b0 con 0x7fd728071630 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72caca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72806cce0 con 0x7fd7280cd1b0 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72caca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd72815f790 con 0x7fd728070f60 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd728071630 0x7fd72806d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42460/0 (socket says 172.21.15.6:42460) 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72659c640 1 -- 172.21.15.6:0/1975471820 learned_addr learned my addr 172.21.15.6:0/1975471820 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd726d9d640 1 --2- 172.21.15.6:0/1975471820 >> v2:172.21.15.171:3300/0 conn(0x7fd728070f60 0x7fd72815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72559a640 1 -- 172.21.15.6:0/1975471820 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 706793128 0 0) 0x7fd7280ce2b0 con 0x7fd728071630 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72559a640 1 -- 172.21.15.6:0/1975471820 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd710003520 con 0x7fd728071630 2024-05-20T18:02:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72559a640 1 -- 172.21.15.6:0/1975471820 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911045713 0 0) 0x7fd72806cce0 con 0x7fd7280cd1b0 2024-05-20T18:02:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.689+0000 7fd72559a640 1 -- 172.21.15.6:0/1975471820 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7280ce2b0 con 0x7fd7280cd1b0 2024-05-20T18:02:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.690+0000 7fd726d9d640 1 -- 172.21.15.6:0/1975471820 >> v1:172.21.15.171:6789/0 conn(0x7fd7280cd1b0 legacy=0x7fd728070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.690+0000 7fd726d9d640 1 -- 172.21.15.6:0/1975471820 >> v1:172.21.15.6:6789/0 conn(0x7fd728071630 legacy=0x7fd72806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.690+0000 7fd72559a640 1 -- 172.21.15.6:0/1975471820 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218360647 0 0) 0x7fd710003520 con 0x7fd728071630 2024-05-20T18:02:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.690+0000 7fd726d9d640 1 -- 172.21.15.6:0/1975471820 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72806cfc0 con 0x7fd728070f60 2024-05-20T18:02:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.690+0000 7fd726d9d640 1 --2- 172.21.15.6:0/1975471820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728070f60 0x7fd72815f250 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd720009d90 tx=0x7fd72002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a69866ce24b61b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.691+0000 7fd72559a640 1 -- 172.21.15.6:0/1975471820 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718001670 con 0x7fd728070f60 2024-05-20T18:02:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.691+0000 7fd72559a640 1 -- 172.21.15.6:0/1975471820 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd720007540 con 0x7fd728070f60 2024-05-20T18:02:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.691+0000 7fd72559a640 1 -- 172.21.15.6:0/1975471820 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720007910 con 0x7fd728070f60 2024-05-20T18:02:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.691+0000 7fd72caca640 1 -- 172.21.15.6:0/1975471820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728070f60 msgr2=0x7fd72815f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.691+0000 7fd72caca640 1 --2- 172.21.15.6:0/1975471820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728070f60 0x7fd72815f250 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd720009d90 tx=0x7fd72002a5f0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.691+0000 7fd72caca640 1 -- 172.21.15.6:0/1975471820 shutdown_connections 2024-05-20T18:02:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.691+0000 7fd72caca640 1 --2- 172.21.15.6:0/1975471820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728070f60 0x7fd72815f250 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.692+0000 7fd72caca640 1 -- 172.21.15.6:0/1975471820 >> 172.21.15.6:0/1975471820 conn(0x7fd7280d29d0 msgr2=0x7fd7280d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.692+0000 7fd72caca640 1 -- 172.21.15.6:0/1975471820 shutdown_connections 2024-05-20T18:02:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.692+0000 7fd72caca640 1 -- 172.21.15.6:0/1975471820 wait complete. 2024-05-20T18:02:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.694+0000 7fd72caca640 1 Processor -- start 2024-05-20T18:02:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.694+0000 7fd72caca640 1 -- start start 2024-05-20T18:02:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd72caca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728071630 0x7fd72815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd72caca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7280cd1b0 0x7fd728162620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd72caca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7280ae3a0 0x7fd7280b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd72caca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd72806ded0 con 0x7fd7280ae3a0 2024-05-20T18:02:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd72caca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd72806c990 con 0x7fd728071630 2024-05-20T18:02:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd72caca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd728161df0 con 0x7fd7280cd1b0 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd726d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7280ae3a0 0x7fd7280b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd726d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7280ae3a0 0x7fd7280b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43134/0 (socket says 172.21.15.6:43134) 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd726d9d640 1 -- 172.21.15.6:0/1485331193 learned_addr learned my addr 172.21.15.6:0/1485331193 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd72659c640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728071630 0x7fd72815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.695+0000 7fd725d9b640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7280cd1b0 0x7fd728162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd726d9d640 1 -- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7280cd1b0 msgr2=0x7fd728162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd726d9d640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7280cd1b0 0x7fd728162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd726d9d640 1 -- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728071630 msgr2=0x7fd72815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd726d9d640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728071630 0x7fd72815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd726d9d640 1 -- 172.21.15.6:0/1485331193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd728162b60 con 0x7fd7280ae3a0 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd726d9d640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7280ae3a0 0x7fd7280b6db0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fd720009eb0 tx=0x7fd720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd716ffd640 1 -- 172.21.15.6:0/1485331193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72003f070 con 0x7fd7280ae3a0 2024-05-20T18:02:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd716ffd640 1 -- 172.21.15.6:0/1485331193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd720031bc0 con 0x7fd7280ae3a0 2024-05-20T18:02:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7280b0c00 con 0x7fd7280ae3a0 2024-05-20T18:02:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd716ffd640 1 -- 172.21.15.6:0/1485331193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720007e90 con 0x7fd7280ae3a0 2024-05-20T18:02:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.696+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7280b11c0 con 0x7fd7280ae3a0 2024-05-20T18:02:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.697+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd728075b00 con 0x7fd7280ae3a0 2024-05-20T18:02:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.698+0000 7fd716ffd640 1 -- 172.21.15.6:0/1485331193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd720043410 con 0x7fd7280ae3a0 2024-05-20T18:02:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.698+0000 7fd716ffd640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd70806be30 0x7fd70806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.698+0000 7fd716ffd640 1 -- 172.21.15.6:0/1485331193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fd7200ac1f0 con 0x7fd7280ae3a0 2024-05-20T18:02:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.698+0000 7fd72659c640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd70806be30 0x7fd70806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.699+0000 7fd72659c640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd70806be30 0x7fd70806e340 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd7180017e0 tx=0x7fd718001610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.703+0000 7fd716ffd640 1 -- 172.21.15.6:0/1485331193 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd72007a340 con 0x7fd7280ae3a0 2024-05-20T18:02:21.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.888+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7fd728071410 con 0x7fd7280ae3a0 2024-05-20T18:02:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.892+0000 7fd716ffd640 1 -- 172.21.15.6:0/1485331193 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v60)=0 v60) ==== 124+0+0 (secure 0 0 0) 0x7fd72007e640 con 0x7fd7280ae3a0 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd70806be30 msgr2=0x7fd70806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd70806be30 0x7fd70806e340 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd7180017e0 tx=0x7fd718001610 comp rx=0 tx=0).stop 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7280ae3a0 msgr2=0x7fd7280b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7280ae3a0 0x7fd7280b6db0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fd720009eb0 tx=0x7fd720004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 shutdown_connections 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd70806be30 0x7fd70806e340 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7280ae3a0 0x7fd7280b6db0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7280cd1b0 0x7fd728162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 --2- 172.21.15.6:0/1485331193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd728071630 0x7fd72815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 >> 172.21.15.6:0/1485331193 conn(0x7fd7280d29d0 msgr2=0x7fd72815b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.894+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 shutdown_connections 2024-05-20T18:02:21.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:21.895+0000 7fd72caca640 1 -- 172.21.15.6:0/1485331193 wait complete. 2024-05-20T18:02:21.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-05-20T18:02:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.023+0000 7f402baab640 1 Processor -- start 2024-05-20T18:02:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.023+0000 7f402baab640 1 -- start start 2024-05-20T18:02:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402baab640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 0x7f402415f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402baab640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40240cfae0 0x7f402406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402baab640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f402406d0f0 con 0x7f402406c6c0 2024-05-20T18:02:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402baab640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f40240cda90 con 0x7f40240cfae0 2024-05-20T18:02:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402baab640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f402415f760 con 0x7f40240cd680 2024-05-20T18:02:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402a048640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40240cfae0 0x7f402406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f4029046640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f402406c6c0 0x7f40240cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42470/0 (socket says 172.21.15.6:42470) 2024-05-20T18:02:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f4029046640 1 -- 172.21.15.6:0/2921433313 learned_addr learned my addr 172.21.15.6:0/2921433313 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f4029847640 1 --2- 172.21.15.6:0/2921433313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 0x7f402415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402a048640 1 -- 172.21.15.6:0/2921433313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 msgr2=0x7f402415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402a048640 1 --2- 172.21.15.6:0/2921433313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 0x7f402415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402a048640 1 -- 172.21.15.6:0/2921433313 >> v1:172.21.15.6:6789/0 conn(0x7f402406c6c0 legacy=0x7f40240cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f4028845640 1 -- 172.21.15.6:0/2921433313 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257277663 0 0) 0x7f402406d0f0 con 0x7f402406c6c0 2024-05-20T18:02:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.025+0000 7f402a048640 1 -- 172.21.15.6:0/2921433313 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402406d3d0 con 0x7f40240cfae0 2024-05-20T18:02:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.026+0000 7f402a048640 1 --2- 172.21.15.6:0/2921433313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40240cfae0 0x7f402406cad0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f4014009d90 tx=0x7f401402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aee930b7e3719c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.026+0000 7f4028845640 1 -- 172.21.15.6:0/2921433313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014031600 con 0x7f40240cfae0 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.026+0000 7f4028845640 1 -- 172.21.15.6:0/2921433313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40140317a0 con 0x7f40240cfae0 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.026+0000 7f4028845640 1 -- 172.21.15.6:0/2921433313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014031b70 con 0x7f40240cfae0 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.027+0000 7f402baab640 1 -- 172.21.15.6:0/2921433313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40240cfae0 msgr2=0x7f402406cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.027+0000 7f402baab640 1 --2- 172.21.15.6:0/2921433313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40240cfae0 0x7f402406cad0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f4014009d90 tx=0x7f401402a5d0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.027+0000 7f402baab640 1 -- 172.21.15.6:0/2921433313 shutdown_connections 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.027+0000 7f402baab640 1 --2- 172.21.15.6:0/2921433313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40240cfae0 0x7f402406cad0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.027+0000 7f402baab640 1 --2- 172.21.15.6:0/2921433313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 0x7f402415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.027+0000 7f402baab640 1 -- 172.21.15.6:0/2921433313 >> 172.21.15.6:0/2921433313 conn(0x7f40240b44d0 msgr2=0x7f40240b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.027+0000 7f402baab640 1 -- 172.21.15.6:0/2921433313 shutdown_connections 2024-05-20T18:02:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.027+0000 7f402baab640 1 -- 172.21.15.6:0/2921433313 wait complete. 2024-05-20T18:02:22.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.029+0000 7f402baab640 1 Processor -- start 2024-05-20T18:02:22.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.029+0000 7f402baab640 1 -- start start 2024-05-20T18:02:22.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402baab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f402406c6c0 0x7f40241f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402baab640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 0x7f40241f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402baab640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40241445d0 0x7f4024161570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402baab640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f402406d990 con 0x7f40241445d0 2024-05-20T18:02:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402baab640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40240d0b40 con 0x7f402406c6c0 2024-05-20T18:02:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402baab640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40240d2460 con 0x7f40240cd680 2024-05-20T18:02:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402a048640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40241445d0 0x7f4024161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402a048640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40241445d0 0x7f4024161570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43150/0 (socket says 172.21.15.6:43150) 2024-05-20T18:02:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.030+0000 7f402a048640 1 -- 172.21.15.6:0/2592090984 learned_addr learned my addr 172.21.15.6:0/2592090984 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f4029046640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 0x7f40241f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f4029847640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f402406c6c0 0x7f40241f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f402a048640 1 -- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 msgr2=0x7f40241f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f402a048640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 0x7f40241f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f402a048640 1 -- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f402406c6c0 msgr2=0x7f40241f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f402a048640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f402406c6c0 0x7f40241f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f402a048640 1 -- 172.21.15.6:0/2592090984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40241f6200 con 0x7f40241445d0 2024-05-20T18:02:22.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f4029847640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f402406c6c0 0x7f40241f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:22.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f402a048640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40241445d0 0x7f4024161570 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f401402abc0 tx=0x7f4014004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f40227fc640 1 -- 172.21.15.6:0/2592090984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401403f070 con 0x7f40241445d0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f40227fc640 1 -- 172.21.15.6:0/2592090984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4014030b60 con 0x7f40241445d0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40241f9280 con 0x7f40241445d0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f40227fc640 1 -- 172.21.15.6:0/2592090984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014009450 con 0x7f40241445d0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.031+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40241f54c0 con 0x7f40241445d0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.032+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4024075b00 con 0x7f40241445d0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.033+0000 7f40227fc640 1 -- 172.21.15.6:0/2592090984 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f401403b410 con 0x7f40241445d0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.033+0000 7f40227fc640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f401006be60 0x7f401006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.033+0000 7f40227fc640 1 -- 172.21.15.6:0/2592090984 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f40140ac6c0 con 0x7f40241445d0 2024-05-20T18:02:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.034+0000 7f4029847640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f401006be60 0x7f401006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.034+0000 7f4029847640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f401006be60 0x7f401006e370 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f401c006fd0 tx=0x7f401c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.038+0000 7f40227fc640 1 -- 172.21.15.6:0/2592090984 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f401407a7f0 con 0x7f40241445d0 2024-05-20T18:02:22.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.224+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7f4024163b80 con 0x7f40241445d0 2024-05-20T18:02:22.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.224+0000 7f40227fc640 1 -- 172.21.15.6:0/2592090984 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v60) ==== 106+0+8 (secure 0 0 0) 0x7f401407eaf0 con 0x7f40241445d0 2024-05-20T18:02:22.222 INFO:teuthology.orchestra.run.smithi006.stdout:1048576 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f401006be60 msgr2=0x7f401006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f401006be60 0x7f401006e370 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f401c006fd0 tx=0x7f401c008040 comp rx=0 tx=0).stop 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40241445d0 msgr2=0x7f4024161570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40241445d0 0x7f4024161570 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f401402abc0 tx=0x7f4014004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 shutdown_connections 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f401006be60 0x7f401006e370 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40241445d0 0x7f4024161570 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40240cd680 0x7f40241f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 --2- 172.21.15.6:0/2592090984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f402406c6c0 0x7f40241f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 >> 172.21.15.6:0/2592090984 conn(0x7f40240b44d0 msgr2=0x7f40240b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 shutdown_connections 2024-05-20T18:02:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.227+0000 7f402baab640 1 -- 172.21.15.6:0/2592090984 wait complete. 2024-05-20T18:02:22.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-05-20T18:02:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.355+0000 7f346eae9640 1 Processor -- start 2024-05-20T18:02:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.355+0000 7f346eae9640 1 -- start start 2024-05-20T18:02:22.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.356+0000 7f346eae9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3468168050 0x7f346816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.356+0000 7f346eae9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34680d0630 con 0x7f3468162820 2024-05-20T18:02:22.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.356+0000 7f346eae9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34680d39c0 con 0x7f346806d3d0 2024-05-20T18:02:22.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.356+0000 7f346eae9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f34680d3ca0 con 0x7f3468168050 2024-05-20T18:02:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.357+0000 7f346d086640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3468168050 0x7f346816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.357+0000 7f346c885640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3468162820 0x7f34680b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42474/0 (socket says 172.21.15.6:42474) 2024-05-20T18:02:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.357+0000 7f346c885640 1 -- 172.21.15.6:0/1226624217 learned_addr learned my addr 172.21.15.6:0/1226624217 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.357+0000 7f346d086640 1 -- 172.21.15.6:0/1226624217 >> v1:172.21.15.171:6789/0 conn(0x7f346806d3d0 legacy=0x7f346806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.357+0000 7f346d086640 1 -- 172.21.15.6:0/1226624217 >> v1:172.21.15.6:6789/0 conn(0x7f3468162820 legacy=0x7f34680b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.357+0000 7f34677fe640 1 -- 172.21.15.6:0/1226624217 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498750214 0 0) 0x7f34680d0630 con 0x7f3468162820 2024-05-20T18:02:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.357+0000 7f346d086640 1 -- 172.21.15.6:0/1226624217 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34680d3f80 con 0x7f3468168050 2024-05-20T18:02:22.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.358+0000 7f346d086640 1 --2- 172.21.15.6:0/1226624217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3468168050 0x7f346816a470 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f346002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc54242c1eed620 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.358+0000 7f34677fe640 1 -- 172.21.15.6:0/1226624217 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460007740 con 0x7f3468168050 2024-05-20T18:02:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.358+0000 7f34677fe640 1 -- 172.21.15.6:0/1226624217 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34600078e0 con 0x7f3468168050 2024-05-20T18:02:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.358+0000 7f34677fe640 1 -- 172.21.15.6:0/1226624217 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460007cb0 con 0x7f3468168050 2024-05-20T18:02:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.358+0000 7f346eae9640 1 -- 172.21.15.6:0/1226624217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3468168050 msgr2=0x7f346816a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.358+0000 7f346eae9640 1 --2- 172.21.15.6:0/1226624217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3468168050 0x7f346816a470 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f346002a6a0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.359+0000 7f346eae9640 1 -- 172.21.15.6:0/1226624217 shutdown_connections 2024-05-20T18:02:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.359+0000 7f346eae9640 1 --2- 172.21.15.6:0/1226624217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3468168050 0x7f346816a470 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.359+0000 7f346eae9640 1 -- 172.21.15.6:0/1226624217 >> 172.21.15.6:0/1226624217 conn(0x7f34680d4bd0 msgr2=0x7f34680d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:22.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.359+0000 7f346eae9640 1 -- 172.21.15.6:0/1226624217 shutdown_connections 2024-05-20T18:02:22.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.359+0000 7f346eae9640 1 -- 172.21.15.6:0/1226624217 wait complete. 2024-05-20T18:02:22.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.360+0000 7f346eae9640 1 Processor -- start 2024-05-20T18:02:22.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.360+0000 7f346eae9640 1 -- start start 2024-05-20T18:02:22.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346eae9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f346806d3d0 0x7f3468156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346eae9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3468162820 0x7f34680c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346eae9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3468168050 0x7f34681509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346eae9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f34680b91a0 con 0x7f346806d3d0 2024-05-20T18:02:22.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346eae9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f34680d0300 con 0x7f3468168050 2024-05-20T18:02:22.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346eae9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f34680b4050 con 0x7f3468162820 2024-05-20T18:02:22.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346c885640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f346806d3d0 0x7f3468156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346c885640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f346806d3d0 0x7f3468156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43170/0 (socket says 172.21.15.6:43170) 2024-05-20T18:02:22.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346c885640 1 -- 172.21.15.6:0/1976734524 learned_addr learned my addr 172.21.15.6:0/1976734524 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:22.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f3467fff640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3468162820 0x7f34680c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346d086640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3468168050 0x7f34681509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346c885640 1 -- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3468162820 msgr2=0x7f34680c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346c885640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3468162820 0x7f34680c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346c885640 1 -- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3468168050 msgr2=0x7f34681509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346c885640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3468168050 0x7f34681509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346c885640 1 -- 172.21.15.6:0/1976734524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3468150ee0 con 0x7f346806d3d0 2024-05-20T18:02:22.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.362+0000 7f346d086640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3468168050 0x7f34681509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:22.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.363+0000 7f346c885640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f346806d3d0 0x7f3468156c70 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f345c00c460 tx=0x7f345c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.363+0000 7f34657fa640 1 -- 172.21.15.6:0/1976734524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c018070 con 0x7f346806d3d0 2024-05-20T18:02:22.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.363+0000 7f34657fa640 1 -- 172.21.15.6:0/1976734524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345c007500 con 0x7f346806d3d0 2024-05-20T18:02:22.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.363+0000 7f34657fa640 1 -- 172.21.15.6:0/1976734524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c004a20 con 0x7f346806d3d0 2024-05-20T18:02:22.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.363+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34681585f0 con 0x7f346806d3d0 2024-05-20T18:02:22.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.363+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3468158bb0 con 0x7f346806d3d0 2024-05-20T18:02:22.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.364+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3468075b00 con 0x7f346806d3d0 2024-05-20T18:02:22.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.364+0000 7f34657fa640 1 -- 172.21.15.6:0/1976734524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f345c01b070 con 0x7f346806d3d0 2024-05-20T18:02:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.365+0000 7f34657fa640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f344c06be60 0x7f344c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.365+0000 7f34657fa640 1 -- 172.21.15.6:0/1976734524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f345c08a410 con 0x7f346806d3d0 2024-05-20T18:02:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.365+0000 7f3467fff640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f344c06be60 0x7f344c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.366+0000 7f3467fff640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f344c06be60 0x7f344c06e370 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3454006fd0 tx=0x7f3454008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.370+0000 7f34657fa640 1 -- 172.21.15.6:0/1976734524 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f345c058b00 con 0x7f346806d3d0 2024-05-20T18:02:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.555+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f346815ae80 con 0x7f346806d3d0 2024-05-20T18:02:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.555+0000 7f34657fa640 1 -- 172.21.15.6:0/1976734524 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v60) ==== 112+0+10 (secure 0 0 0) 0x7f345c058400 con 0x7f346806d3d0 2024-05-20T18:02:22.553 INFO:teuthology.orchestra.run.smithi006.stdout:60.000000 2024-05-20T18:02:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f344c06be60 msgr2=0x7f344c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f344c06be60 0x7f344c06e370 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3454006fd0 tx=0x7f3454008040 comp rx=0 tx=0).stop 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f346806d3d0 msgr2=0x7f3468156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f346806d3d0 0x7f3468156c70 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f345c00c460 tx=0x7f345c00c920 comp rx=0 tx=0).stop 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 shutdown_connections 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f344c06be60 0x7f344c06e370 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3468168050 0x7f34681509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3468162820 0x7f34680c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 --2- 172.21.15.6:0/1976734524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f346806d3d0 0x7f3468156c70 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 >> 172.21.15.6:0/1976734524 conn(0x7f34680d4bd0 msgr2=0x7f34680b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 shutdown_connections 2024-05-20T18:02:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.557+0000 7f346eae9640 1 -- 172.21.15.6:0/1976734524 wait complete. 2024-05-20T18:02:22.567 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:22.567 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:22.583 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:02:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:02:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:02:22.681 INFO:teuthology.orchestra.run.smithi006.stdout:client7400 2024-05-20T18:02:22.681 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:22.681 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:22.698 DEBUG:teuthology.orchestra.run.smithi006:> stdin-killer -- python3 -c ' 2024-05-20T18:02:22.698 DEBUG:teuthology.orchestra.run.smithi006:> import fcntl 2024-05-20T18:02:22.698 DEBUG:teuthology.orchestra.run.smithi006:> import sys 2024-05-20T18:02:22.698 DEBUG:teuthology.orchestra.run.smithi006:> import time 2024-05-20T18:02:22.698 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-05-20T18:02:22.698 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:02:22.698 DEBUG:teuthology.orchestra.run.smithi006:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> n = 400 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> abs_path = "/home/ubuntu/cephtest/mnt.0/." 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> if not os.path.exists(abs_path): 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> os.makedirs(abs_path) 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> handles = [] 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> for i in range(0, n): 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> fname = "file_"+str(i) 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> path = os.path.join(abs_path, fname) 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> handles.append(open(path, '"'"'w'"'"')) 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> 2024-05-20T18:02:22.699 DEBUG:teuthology.orchestra.run.smithi006:> print("waiting with handles open", file=sys.stderr) 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> while True: 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> print("open_n_background: keeping files open", file=sys.stderr) 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> try: 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> if os.read(0, 4096) == b"": 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> break 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> except BlockingIOError: 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> pass 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> time.sleep(2) 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> print("stdin closed, goodbye!", file=sys.stderr) 2024-05-20T18:02:22.700 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-05-20T18:02:22.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.858+0000 7fee80c2b640 1 Processor -- start 2024-05-20T18:02:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.859+0000 7fee80c2b640 1 -- start start 2024-05-20T18:02:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.861+0000 7fee80c2b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee7c0b1650 0x7fee7c0af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.861+0000 7fee80c2b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c09a740 con 0x7fee7c159ca0 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.861+0000 7fee80c2b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c09aa20 con 0x7fee7c0b23f0 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.861+0000 7fee80c2b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fee7c09a4f0 con 0x7fee7c0b1650 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.861+0000 7fee7a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fee7c159ca0 0x7fee7c0b1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42486/0 (socket says 172.21.15.6:42486) 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.861+0000 7fee7a59c640 1 -- 172.21.15.6:0/297422845 learned_addr learned my addr 172.21.15.6:0/297422845 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.861+0000 7fee7ad9d640 1 --2- 172.21.15.6:0/297422845 >> v2:172.21.15.6:3300/0 conn(0x7fee7c0b1650 0x7fee7c0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.861+0000 7fee7959a640 1 -- 172.21.15.6:0/297422845 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250613221 0 0) 0x7fee7c09a740 con 0x7fee7c159ca0 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.862+0000 7fee7959a640 1 -- 172.21.15.6:0/297422845 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee64003520 con 0x7fee7c159ca0 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.862+0000 7fee7ad9d640 1 -- 172.21.15.6:0/297422845 >> v1:172.21.15.171:6789/0 conn(0x7fee7c0b23f0 legacy=0x7fee7c15c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.862+0000 7fee7ad9d640 1 -- 172.21.15.6:0/297422845 >> v1:172.21.15.6:6789/0 conn(0x7fee7c159ca0 legacy=0x7fee7c0b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.862+0000 7fee7ad9d640 1 -- 172.21.15.6:0/297422845 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c09ad00 con 0x7fee7c0b1650 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.862+0000 7fee7ad9d640 1 --2- 172.21.15.6:0/297422845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c0b1650 0x7fee7c0af230 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fee74009d90 tx=0x7fee7402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437ab5214c298a5a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.863+0000 7fee7959a640 1 -- 172.21.15.6:0/297422845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74007740 con 0x7fee7c0b1650 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.863+0000 7fee7959a640 1 -- 172.21.15.6:0/297422845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee740078e0 con 0x7fee7c0b1650 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.863+0000 7fee7959a640 1 -- 172.21.15.6:0/297422845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74007c90 con 0x7fee7c0b1650 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.863+0000 7fee80c2b640 1 -- 172.21.15.6:0/297422845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c0b1650 msgr2=0x7fee7c0af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.863+0000 7fee80c2b640 1 --2- 172.21.15.6:0/297422845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c0b1650 0x7fee7c0af230 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fee74009d90 tx=0x7fee7402a660 comp rx=0 tx=0).stop 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.863+0000 7fee80c2b640 1 -- 172.21.15.6:0/297422845 shutdown_connections 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.863+0000 7fee80c2b640 1 --2- 172.21.15.6:0/297422845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c0b1650 0x7fee7c0af230 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.863+0000 7fee80c2b640 1 -- 172.21.15.6:0/297422845 >> 172.21.15.6:0/297422845 conn(0x7fee7c0b6620 msgr2=0x7fee7c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.864+0000 7fee80c2b640 1 -- 172.21.15.6:0/297422845 shutdown_connections 2024-05-20T18:02:22.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.864+0000 7fee80c2b640 1 -- 172.21.15.6:0/297422845 wait complete. 2024-05-20T18:02:22.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.866+0000 7fee80c2b640 1 Processor -- start 2024-05-20T18:02:22.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.866+0000 7fee80c2b640 1 -- start start 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.868+0000 7fee80c2b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee7c0b1650 0x7fee7c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.868+0000 7fee80c2b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee7c0b23f0 0x7fee7c09c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee80c2b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c159ca0 0x7fee7c158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee80c2b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c0af770 con 0x7fee7c159ca0 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee80c2b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c09b350 con 0x7fee7c0b23f0 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee80c2b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c06c630 con 0x7fee7c0b1650 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c159ca0 0x7fee7c158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c159ca0 0x7fee7c158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43180/0 (socket says 172.21.15.6:43180) 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 -- 172.21.15.6:0/3868733121 learned_addr learned my addr 172.21.15.6:0/3868733121 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7a59c640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee7c0b1650 0x7fee7c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee79d9b640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee7c0b23f0 0x7fee7c09c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 -- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee7c0b1650 msgr2=0x7fee7c14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee7c0b1650 0x7fee7c14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 -- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee7c0b23f0 msgr2=0x7fee7c09c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee7c0b23f0 0x7fee7c09c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 -- 172.21.15.6:0/3868733121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c14e610 con 0x7fee7c159ca0 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee7ad9d640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c159ca0 0x7fee7c158ac0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fee74009eb0 tx=0x7fee74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.869+0000 7fee6affd640 1 -- 172.21.15.6:0/3868733121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7403f070 con 0x7fee7c159ca0 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.870+0000 7fee6affd640 1 -- 172.21.15.6:0/3868733121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee74031c40 con 0x7fee7c159ca0 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.870+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c1f8860 con 0x7fee7c159ca0 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.870+0000 7fee6affd640 1 -- 172.21.15.6:0/3868733121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74009450 con 0x7fee7c159ca0 2024-05-20T18:02:22.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.870+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c1f8e20 con 0x7fee7c159ca0 2024-05-20T18:02:22.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.871+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7c075b00 con 0x7fee7c159ca0 2024-05-20T18:02:22.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.871+0000 7fee6affd640 1 -- 172.21.15.6:0/3868733121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee74003990 con 0x7fee7c159ca0 2024-05-20T18:02:22.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.872+0000 7fee6affd640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee5c06be30 0x7fee5c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:22.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.872+0000 7fee6affd640 1 -- 172.21.15.6:0/3868733121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fee740ac0c0 con 0x7fee7c159ca0 2024-05-20T18:02:22.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.872+0000 7fee7a59c640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee5c06be30 0x7fee5c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:22.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.873+0000 7fee7a59c640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee5c06be30 0x7fee5c06e340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0011e0 tx=0x7fee6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:22.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:22.877+0000 7fee6affd640 1 -- 172.21.15.6:0/3868733121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fee7407a8e0 con 0x7fee7c159ca0 2024-05-20T18:02:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:waiting with handles open 2024-05-20T18:02:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:02:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.137+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee7c155180 con 0x7fee7c159ca0 2024-05-20T18:02:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.138+0000 7fee6affd640 1 -- 172.21.15.6:0/3868733121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5182 (secure 0 0 0) 0x7fee7407a1e0 con 0x7fee7c159ca0 2024-05-20T18:02:23.136 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:23.136 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":96,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:11.519092+0000","modified":"2024-05-20T18:02:14.543277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1253645410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1253645410},{"type":"v1","addr":"172.21.15.6:6835","nonce":1253645410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":10}]} 2024-05-20T18:02:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 96 2024-05-20T18:02:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee5c06be30 msgr2=0x7fee5c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee5c06be30 0x7fee5c06e340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0011e0 tx=0x7fee6c009040 comp rx=0 tx=0).stop 2024-05-20T18:02:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c159ca0 msgr2=0x7fee7c158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c159ca0 0x7fee7c158ac0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fee74009eb0 tx=0x7fee74004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 shutdown_connections 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fee5c06be30 0x7fee5c06e340 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee7c159ca0 0x7fee7c158ac0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee7c0b23f0 0x7fee7c09c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 --2- 172.21.15.6:0/3868733121 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fee7c0b1650 0x7fee7c14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 >> 172.21.15.6:0/3868733121 conn(0x7fee7c0b6620 msgr2=0x7fee7c06fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 shutdown_connections 2024-05-20T18:02:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.140+0000 7fee80c2b640 1 -- 172.21.15.6:0/3868733121 wait complete. 2024-05-20T18:02:23.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-05-20T18:02:23.282 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":7406,"entity":{"name":{"type":"client","num":7406},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":1431183645}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":3.195963415,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9904999622368527,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7406 192.168.0.1:0/1431183645","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":7400,"entity":{"name":{"type":"client","num":7400},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":1252216099}},"state":"open","num_leases":400,"num_caps":401,"request_load_avg":424,"uptime":4.3379503430000002,"requests_in_flight":399,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":199.68833043583541,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":187.90468399572444,"halflife":1.5},"recall_caps_throttle2o":{"value":165.86426441470087,"halflife":0.5},"session_cache_liveness":{"value":1201.1095718965378,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7400 172.21.15.6:0/1252216099","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T18:02:23.283 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1431183645, "type": "any" }, "name": { "num": 7406, "type": "client" } }, "id": 7406, "inst": "client.7406 192.168.0.1:0/1431183645", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9904999622368527 }, "state": "open", "uptime": 3.195963415 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 1252216099, "type": "any" }, "name": { "num": 7400, "type": "client" } }, "id": 7400, "inst": "client.7400 172.21.15.6:0/1252216099", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 401, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 400, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 199.6883304358354 }, "recall_caps_throttle": { "halflife": 1.5, "value": 187.90468399572444 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 165.86426441470087 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 424, "requests_in_flight": 399, "session_cache_liveness": { "halflife": 300, "value": 1201.1095718965378 }, "state": "open", "uptime": 4.337950343 } ] 2024-05-20T18:02:23.283 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-05-20T18:02:23.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T18:02:23.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.399+0000 7fb5cff2f640 1 Processor -- start 2024-05-20T18:02:23.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.399+0000 7fb5cff2f640 1 -- start start 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cff2f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb5c80b4070 0x7fb5c80ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cff2f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 0x7fb5c806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cff2f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c806dd20 con 0x7fb5c806d910 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cff2f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c80b8490 con 0x7fb5c80b4070 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cff2f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c815fa90 con 0x7fb5c80d0560 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5ce4cc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb5c806d910 0x7fb5c80d27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42496/0 (socket says 172.21.15.6:42496) 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5ce4cc640 1 -- 172.21.15.6:0/1568069594 learned_addr learned my addr 172.21.15.6:0/1568069594 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cdccb640 1 --2- 172.21.15.6:0/1568069594 >> v2:172.21.15.171:3300/0 conn(0x7fb5c80b4070 0x7fb5c80ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cd4ca640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 0x7fb5c806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882461418 0 0) 0x7fb5c0001490 con 0x7fb5c806d910 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.401+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b4003520 con 0x7fb5c806d910 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2594116195 0 0) 0x7fb5b4003520 con 0x7fb5c806d910 2024-05-20T18:02:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 msgr2=0x7fb5c806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 0x7fb5c806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 >> v2:172.21.15.171:3300/0 conn(0x7fb5c80b4070 msgr2=0x7fb5c80ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 --2- 172.21.15.6:0/1568069594 >> v2:172.21.15.171:3300/0 conn(0x7fb5c80b4070 0x7fb5c80ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c80d3f00 con 0x7fb5c806d910 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fb5c0001bc0 con 0x7fb5c806d910 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cd4ca640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 0x7fb5c806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cdccb640 1 --2- 172.21.15.6:0/1568069594 >> v2:172.21.15.171:3300/0 conn(0x7fb5c80b4070 0x7fb5c80ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 >> v1:172.21.15.6:6789/0 conn(0x7fb5c806d910 legacy=0x7fb5c80d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 0x7fb5b40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b4003f10 0x7fb5b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b4004d40 0x7fb5b4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80b8490 con 0x7fb5b4003f10 2024-05-20T18:02:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c815fa90 con 0x7fb5b4004d40 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b400b9f0 con 0x7fb5c80d0560 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cd4ca640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b4003f10 0x7fb5b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cdccb640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 0x7fb5b40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5ce4cc640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b4004d40 0x7fb5b4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cd4ca640 1 -- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 msgr2=0x7fb5b40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cd4ca640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c80d0560 0x7fb5b40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cd4ca640 1 -- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b4004d40 msgr2=0x7fb5b4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cd4ca640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b4004d40 0x7fb5b4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5cd4ca640 1 -- 172.21.15.6:0/1568069594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b4003520 con 0x7fb5b4003f10 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.402+0000 7fb5ce4cc640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5b4004d40 0x7fb5b4005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.403+0000 7fb5cd4ca640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b4003f10 0x7fb5b4004800 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8074770 tx=0x7fb5b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613fcca3422a3c1d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.403+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8036070 con 0x7fb5b4003f10 2024-05-20T18:02:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.403+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8031400 con 0x7fb5b4003f10 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.403+0000 7fb5cccc9640 1 -- 172.21.15.6:0/1568069594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8009860 con 0x7fb5b4003f10 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.404+0000 7fb5cff2f640 1 -- 172.21.15.6:0/1568069594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b4003f10 msgr2=0x7fb5b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.404+0000 7fb5cff2f640 1 --2- 172.21.15.6:0/1568069594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b4003f10 0x7fb5b4004800 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8074770 tx=0x7fb5b4005830 comp rx=0 tx=0).stop 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.404+0000 7fb5ce4cc640 1 -- 172.21.15.6:0/1568069594 reap_dead start 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.404+0000 7fb5cff2f640 1 -- 172.21.15.6:0/1568069594 shutdown_connections 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.404+0000 7fb5cff2f640 1 -- 172.21.15.6:0/1568069594 >> 172.21.15.6:0/1568069594 conn(0x7fb5c80d4c10 msgr2=0x7fb5c80d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.404+0000 7fb5cff2f640 1 -- 172.21.15.6:0/1568069594 shutdown_connections 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.404+0000 7fb5cff2f640 1 -- 172.21.15.6:0/1568069594 wait complete. 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.406+0000 7fb5cff2f640 1 Processor -- start 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.406+0000 7fb5cff2f640 1 -- start start 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5cff2f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5c815d5f0 0x7fb5c8161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5cff2f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c8161c70 0x7fb5c80b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5cff2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c815da00 0x7fb5c80b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5cff2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80d47a0 con 0x7fb5c815da00 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5cff2f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80d44c0 con 0x7fb5c815d5f0 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5cff2f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c80bab00 con 0x7fb5c8161c70 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5ce4cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c815da00 0x7fb5c80b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5ce4cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c815da00 0x7fb5c80b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43194/0 (socket says 172.21.15.6:43194) 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.407+0000 7fb5ce4cc640 1 -- 172.21.15.6:0/569025216 learned_addr learned my addr 172.21.15.6:0/569025216 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5cdccb640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5c815d5f0 0x7fb5c8161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5cd4ca640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c8161c70 0x7fb5c80b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5ce4cc640 1 -- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c8161c70 msgr2=0x7fb5c80b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5ce4cc640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c8161c70 0x7fb5c80b6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5ce4cc640 1 -- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5c815d5f0 msgr2=0x7fb5c8161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5ce4cc640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5c815d5f0 0x7fb5c8161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5ce4cc640 1 -- 172.21.15.6:0/569025216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c8162180 con 0x7fb5c815da00 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5cd4ca640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c8161c70 0x7fb5c80b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5cdccb640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5c815d5f0 0x7fb5c8161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5ce4cc640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c815da00 0x7fb5c80b7320 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80d1580 tx=0x7fb5c000a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5be7fc640 1 -- 172.21.15.6:0/569025216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000ab10 con 0x7fb5c815da00 2024-05-20T18:02:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5be7fc640 1 -- 172.21.15.6:0/569025216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c000acb0 con 0x7fb5c815da00 2024-05-20T18:02:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c8162460 con 0x7fb5c815da00 2024-05-20T18:02:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5be7fc640 1 -- 172.21.15.6:0/569025216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0013420 con 0x7fb5c815da00 2024-05-20T18:02:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.408+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c80b4c10 con 0x7fb5c815da00 2024-05-20T18:02:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.409+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c80690b0 con 0x7fb5c815da00 2024-05-20T18:02:23.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.410+0000 7fb5be7fc640 1 -- 172.21.15.6:0/569025216 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5c001a020 con 0x7fb5c815da00 2024-05-20T18:02:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.410+0000 7fb5be7fc640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5ac06be30 0x7fb5ac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.410+0000 7fb5be7fc640 1 -- 172.21.15.6:0/569025216 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fb5c008ad70 con 0x7fb5c815da00 2024-05-20T18:02:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.411+0000 7fb5cdccb640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5ac06be30 0x7fb5ac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.411+0000 7fb5cdccb640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5ac06be30 0x7fb5ac06e340 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb5c808d920 tx=0x7fb5c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.415+0000 7fb5be7fc640 1 -- 172.21.15.6:0/569025216 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb5c806dd20 con 0x7fb5c815da00 2024-05-20T18:02:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.636+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb5c80ce7b0 con 0x7fb5c815da00 2024-05-20T18:02:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.637+0000 7fb5be7fc640 1 -- 172.21.15.6:0/569025216 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb5c0059620 con 0x7fb5c815da00 2024-05-20T18:02:23.635 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:23.635 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-20T18:02:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5ac06be30 msgr2=0x7fb5ac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5ac06be30 0x7fb5ac06e340 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb5c808d920 tx=0x7fb5c4008040 comp rx=0 tx=0).stop 2024-05-20T18:02:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c815da00 msgr2=0x7fb5c80b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c815da00 0x7fb5c80b7320 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80d1580 tx=0x7fb5c000a180 comp rx=0 tx=0).stop 2024-05-20T18:02:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 shutdown_connections 2024-05-20T18:02:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb5ac06be30 0x7fb5ac06e340 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c815da00 0x7fb5c80b7320 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5c8161c70 0x7fb5c80b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 --2- 172.21.15.6:0/569025216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5c815d5f0 0x7fb5c8161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 >> 172.21.15.6:0/569025216 conn(0x7fb5c80d4c10 msgr2=0x7fb5c80b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 shutdown_connections 2024-05-20T18:02:23.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:23.639+0000 7fb5cff2f640 1 -- 172.21.15.6:0/569025216 wait complete. 2024-05-20T18:02:23.648 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-05-20T18:02:23.648 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-05-20T18:02:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:02:27.098 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:02:28.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T18:02:28.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.780+0000 7fe2fbbb5640 1 Processor -- start 2024-05-20T18:02:28.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.780+0000 7fe2fbbb5640 1 -- start start 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.781+0000 7fe2fbbb5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2f40d5200 0x7fe2f415f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.781+0000 7fe2fbbb5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe2f415fc60 0x7fe2f4160960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.781+0000 7fe2fbbb5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f4160380 con 0x7fe2f40d4120 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.781+0000 7fe2fbbb5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f4160660 con 0x7fe2f40d5200 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.781+0000 7fe2fbbb5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f40d3640 con 0x7fe2f415fc60 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.782+0000 7fe2f9150640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2f40d5200 0x7fe2f415f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.782+0000 7fe2f9951640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe2f40d4120 0x7fe2f40d4af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47812/0 (socket says 172.21.15.6:47812) 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.782+0000 7fe2f9951640 1 -- 172.21.15.6:0/2521111724 learned_addr learned my addr 172.21.15.6:0/2521111724 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:28.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.782+0000 7fe2fa152640 1 --2- 172.21.15.6:0/2521111724 >> v2:172.21.15.171:3300/0 conn(0x7fe2f415fc60 0x7fe2f4160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:28.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.782+0000 7fe2f9150640 1 -- 172.21.15.6:0/2521111724 >> v2:172.21.15.171:3300/0 conn(0x7fe2f415fc60 msgr2=0x7fe2f4160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:28.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.782+0000 7fe2f9150640 1 --2- 172.21.15.6:0/2521111724 >> v2:172.21.15.171:3300/0 conn(0x7fe2f415fc60 0x7fe2f4160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:28.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.782+0000 7fe2f9150640 1 -- 172.21.15.6:0/2521111724 >> v1:172.21.15.6:6789/0 conn(0x7fe2f40d4120 legacy=0x7fe2f40d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:28.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.782+0000 7fe2f9150640 1 -- 172.21.15.6:0/2521111724 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f40d3920 con 0x7fe2f40d5200 2024-05-20T18:02:28.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.783+0000 7fe2f9150640 1 --2- 172.21.15.6:0/2521111724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d5200 0x7fe2f415f720 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fe2f408df10 tx=0x7fe2e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daaafcafb4be8baa server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:28.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.783+0000 7fe2f894f640 1 -- 172.21.15.6:0/2521111724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4037070 con 0x7fe2f40d5200 2024-05-20T18:02:28.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.783+0000 7fe2f894f640 1 -- 172.21.15.6:0/2521111724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e4032440 con 0x7fe2f40d5200 2024-05-20T18:02:28.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.783+0000 7fe2f894f640 1 -- 172.21.15.6:0/2521111724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4032810 con 0x7fe2f40d5200 2024-05-20T18:02:28.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.784+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/2521111724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d5200 msgr2=0x7fe2f415f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:28.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.784+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/2521111724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d5200 0x7fe2f415f720 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fe2f408df10 tx=0x7fe2e402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:02:28.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.784+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/2521111724 shutdown_connections 2024-05-20T18:02:28.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.784+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/2521111724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d5200 0x7fe2f415f720 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:28.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.784+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/2521111724 >> v2:172.21.15.171:3300/0 conn(0x7fe2f415fc60 0x7fe2f4160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:28.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.784+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/2521111724 >> 172.21.15.6:0/2521111724 conn(0x7fe2f406b520 msgr2=0x7fe2f406b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:28.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.784+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/2521111724 shutdown_connections 2024-05-20T18:02:28.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.784+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/2521111724 wait complete. 2024-05-20T18:02:28.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.786+0000 7fe2fbbb5640 1 Processor -- start 2024-05-20T18:02:28.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.786+0000 7fe2fbbb5640 1 -- start start 2024-05-20T18:02:28.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2fbbb5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d4120 0x7fe2f40cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:28.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2fbbb5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f415fc60 0x7fe2f41e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:28.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2fbbb5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2f41e6530 0x7fe2f41e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:28.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2fbbb5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f40d4530 con 0x7fe2f40d4120 2024-05-20T18:02:28.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2fbbb5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f4160070 con 0x7fe2f415fc60 2024-05-20T18:02:28.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2fbbb5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f40d46b0 con 0x7fe2f41e6530 2024-05-20T18:02:28.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9951640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d4120 0x7fe2f40cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9951640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d4120 0x7fe2f40cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43676/0 (socket says 172.21.15.6:43676) 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9951640 1 -- 172.21.15.6:0/4132233517 learned_addr learned my addr 172.21.15.6:0/4132233517 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9150640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f415fc60 0x7fe2f41e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2fa152640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2f41e6530 0x7fe2f41e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9951640 1 -- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2f41e6530 msgr2=0x7fe2f41e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9951640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2f41e6530 0x7fe2f41e6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9951640 1 -- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f415fc60 msgr2=0x7fe2f41e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9951640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f415fc60 0x7fe2f41e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.787+0000 7fe2f9951640 1 -- 172.21.15.6:0/4132233517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f41e6e80 con 0x7fe2f40d4120 2024-05-20T18:02:28.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.788+0000 7fe2f9951640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d4120 0x7fe2f40cdd80 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000c3f0 tx=0x7fe2f000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:28.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.788+0000 7fe2ea7fc640 1 -- 172.21.15.6:0/4132233517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0017070 con 0x7fe2f40d4120 2024-05-20T18:02:28.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.788+0000 7fe2ea7fc640 1 -- 172.21.15.6:0/4132233517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f0005ce0 con 0x7fe2f40d4120 2024-05-20T18:02:28.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.788+0000 7fe2ea7fc640 1 -- 172.21.15.6:0/4132233517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00072f0 con 0x7fe2f40d4120 2024-05-20T18:02:28.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.788+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f40cc8a0 con 0x7fe2f40d4120 2024-05-20T18:02:28.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.788+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f41e57f0 con 0x7fe2f40d4120 2024-05-20T18:02:28.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.789+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f414f950 con 0x7fe2f40d4120 2024-05-20T18:02:28.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.790+0000 7fe2ea7fc640 1 -- 172.21.15.6:0/4132233517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2f001a070 con 0x7fe2f40d4120 2024-05-20T18:02:28.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.790+0000 7fe2ea7fc640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2d806be60 0x7fe2d806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:28.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.790+0000 7fe2ea7fc640 1 -- 172.21.15.6:0/4132233517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fe2f008a330 con 0x7fe2f40d4120 2024-05-20T18:02:28.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.790+0000 7fe2f9150640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2d806be60 0x7fe2d806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:28.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.791+0000 7fe2f9150640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2d806be60 0x7fe2d806e370 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4034000 tx=0x7fe2e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:28.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:28.795+0000 7fe2ea7fc640 1 -- 172.21.15.6:0/4132233517 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe2f414f950 con 0x7fe2f40d4120 2024-05-20T18:02:29.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.020+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe2f40690b0 con 0x7fe2f40d4120 2024-05-20T18:02:29.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.020+0000 7fe2ea7fc640 1 -- 172.21.15.6:0/4132233517 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7fe2f0058470 con 0x7fe2f40d4120 2024-05-20T18:02:29.018 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:29.018 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2d806be60 msgr2=0x7fe2d806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2d806be60 0x7fe2d806e370 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4034000 tx=0x7fe2e402e000 comp rx=0 tx=0).stop 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d4120 msgr2=0x7fe2f40cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d4120 0x7fe2f40cdd80 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000c3f0 tx=0x7fe2f000c8b0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 shutdown_connections 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe2d806be60 0x7fe2d806e370 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2f41e6530 0x7fe2f41e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2f415fc60 0x7fe2f41e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 --2- 172.21.15.6:0/4132233517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2f40d4120 0x7fe2f40cdd80 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 >> 172.21.15.6:0/4132233517 conn(0x7fe2f406b520 msgr2=0x7fe2f415dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 shutdown_connections 2024-05-20T18:02:29.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.022+0000 7fe2fbbb5640 1 -- 172.21.15.6:0/4132233517 wait complete. 2024-05-20T18:02:29.031 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-05-20T18:02:29.031 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-05-20T18:02:29.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-20T18:02:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:02:29.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.147+0000 7f949174c640 1 Processor -- start 2024-05-20T18:02:29.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.148+0000 7f949174c640 1 -- start start 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f949174c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f948c0b4070 0x7f948c0ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f949174c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c06dae0 0x7f948c0b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f949174c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948c15fa90 con 0x7f948c0d0560 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f949174c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f948c0b8490 con 0x7f948c0b4070 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f949174c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f948c0d3f00 con 0x7f948c06dae0 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f948affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f948c0b4070 0x7f948c0ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f9483fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f948c0d0560 0x7f948c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47814/0 (socket says 172.21.15.6:47814) 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f9483fff640 1 -- 172.21.15.6:0/2999629115 learned_addr learned my addr 172.21.15.6:0/2999629115 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f948b7fe640 1 --2- 172.21.15.6:0/2999629115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c06dae0 0x7f948c0b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f948a7fc640 1 -- 172.21.15.6:0/2999629115 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150502583 0 0) 0x7f948c15fa90 con 0x7f948c0d0560 2024-05-20T18:02:29.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.149+0000 7f948a7fc640 1 -- 172.21.15.6:0/2999629115 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9478003520 con 0x7f948c0d0560 2024-05-20T18:02:29.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.150+0000 7f948affd640 1 -- 172.21.15.6:0/2999629115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c06dae0 msgr2=0x7f948c0b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:29.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.150+0000 7f948affd640 1 --2- 172.21.15.6:0/2999629115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c06dae0 0x7f948c0b8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.150+0000 7f948affd640 1 -- 172.21.15.6:0/2999629115 >> v1:172.21.15.6:6789/0 conn(0x7f948c0d0560 legacy=0x7f948c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:29.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.150+0000 7f948affd640 1 -- 172.21.15.6:0/2999629115 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c0d41e0 con 0x7f948c0b4070 2024-05-20T18:02:29.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.150+0000 7f948affd640 1 --2- 172.21.15.6:0/2999629115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0b4070 0x7f948c0ba5c0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f947c0097a0 tx=0x7f947c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e827410d31c09ed server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:29.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.150+0000 7f948a7fc640 1 -- 172.21.15.6:0/2999629115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c037070 con 0x7f948c0b4070 2024-05-20T18:02:29.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f948a7fc640 1 -- 172.21.15.6:0/2999629115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c032440 con 0x7f948c0b4070 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f948a7fc640 1 -- 172.21.15.6:0/2999629115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c032810 con 0x7f948c0b4070 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f949174c640 1 -- 172.21.15.6:0/2999629115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0b4070 msgr2=0x7f948c0ba5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f949174c640 1 --2- 172.21.15.6:0/2999629115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0b4070 0x7f948c0ba5c0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f947c0097a0 tx=0x7f947c02a180 comp rx=0 tx=0).stop 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f949174c640 1 -- 172.21.15.6:0/2999629115 shutdown_connections 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f949174c640 1 --2- 172.21.15.6:0/2999629115 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c06dae0 0x7f948c0b8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f949174c640 1 --2- 172.21.15.6:0/2999629115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0b4070 0x7f948c0ba5c0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f949174c640 1 -- 172.21.15.6:0/2999629115 >> 172.21.15.6:0/2999629115 conn(0x7f948c0d4c10 msgr2=0x7f948c0d5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f949174c640 1 -- 172.21.15.6:0/2999629115 shutdown_connections 2024-05-20T18:02:29.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.151+0000 7f949174c640 1 -- 172.21.15.6:0/2999629115 wait complete. 2024-05-20T18:02:29.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.153+0000 7f949174c640 1 Processor -- start 2024-05-20T18:02:29.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.153+0000 7f949174c640 1 -- start start 2024-05-20T18:02:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.154+0000 7f949174c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c0b4070 0x7f948c0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.154+0000 7f949174c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0d0560 0x7f948c156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f949174c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f948c1618a0 0x7f948c161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f949174c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0bab00 con 0x7f948c0d0560 2024-05-20T18:02:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f949174c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0d47a0 con 0x7f948c1618a0 2024-05-20T18:02:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f949174c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f948c0d3b20 con 0x7f948c0b4070 2024-05-20T18:02:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0d0560 0x7f948c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0d0560 0x7f948c156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43696/0 (socket says 172.21.15.6:43696) 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 -- 172.21.15.6:0/1322721347 learned_addr learned my addr 172.21.15.6:0/1322721347 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f948affd640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c0b4070 0x7f948c0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f948b7fe640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f948c1618a0 0x7f948c161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 -- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c0b4070 msgr2=0x7f948c0cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c0b4070 0x7f948c0cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 -- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f948c1618a0 msgr2=0x7f948c161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f948c1618a0 0x7f948c161cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 -- 172.21.15.6:0/1322721347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c1621f0 con 0x7f948c0d0560 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f948b7fe640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f948c1618a0 0x7f948c161cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f9483fff640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0d0560 0x7f948c156030 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f947400c3c0 tx=0x7f947400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f94837fe640 1 -- 172.21.15.6:0/1322721347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474017070 con 0x7f948c0d0560 2024-05-20T18:02:29.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f94837fe640 1 -- 172.21.15.6:0/1322721347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474005ce0 con 0x7f948c0d0560 2024-05-20T18:02:29.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c1606c0 con 0x7f948c0d0560 2024-05-20T18:02:29.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f94837fe640 1 -- 172.21.15.6:0/1322721347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474007310 con 0x7f948c0d0560 2024-05-20T18:02:29.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.155+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c160ea0 con 0x7f948c0d0560 2024-05-20T18:02:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.156+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948c0690b0 con 0x7f948c0d0560 2024-05-20T18:02:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.157+0000 7f94837fe640 1 -- 172.21.15.6:0/1322721347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f947401a070 con 0x7f948c0d0560 2024-05-20T18:02:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.158+0000 7f94837fe640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946c06be30 0x7f946c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.158+0000 7f94837fe640 1 -- 172.21.15.6:0/1322721347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f947408a340 con 0x7f948c0d0560 2024-05-20T18:02:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.158+0000 7f948affd640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946c06be30 0x7f946c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.158+0000 7f948affd640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946c06be30 0x7f946c06e340 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f947c034000 tx=0x7f947c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.162+0000 7f94837fe640 1 -- 172.21.15.6:0/1322721347 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f948c1621f0 con 0x7f948c0d0560 2024-05-20T18:02:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.389+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f948c08d360 con 0x7f948c0d0560 2024-05-20T18:02:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.390+0000 7f94837fe640 1 -- 172.21.15.6:0/1322721347 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f9474058480 con 0x7f948c0d0560 2024-05-20T18:02:29.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:29.388 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-05-20T18:02:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946c06be30 msgr2=0x7f946c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946c06be30 0x7f946c06e340 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f947c034000 tx=0x7f947c02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0d0560 msgr2=0x7f948c156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0d0560 0x7f948c156030 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f947400c3c0 tx=0x7f947400c880 comp rx=0 tx=0).stop 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 shutdown_connections 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f946c06be30 0x7f946c06e340 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f948c1618a0 0x7f948c161cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f948c0d0560 0x7f948c156030 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 --2- 172.21.15.6:0/1322721347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f948c0b4070 0x7f948c0cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 >> 172.21.15.6:0/1322721347 conn(0x7f948c0d4c10 msgr2=0x7f948c0cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 shutdown_connections 2024-05-20T18:02:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29.392+0000 7f949174c640 1 -- 172.21.15.6:0/1322721347 wait complete. 2024-05-20T18:02:29.401 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-20T18:02:29.401 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-05-20T18:02:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:29 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-05-20T18:02:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:open_n_background: keeping files open 2024-05-20T18:02:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:stdin closed, goodbye! 2024-05-20T18:02:31.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:02:31.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.290+0000 7f1001873640 1 Processor -- start 2024-05-20T18:02:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.291+0000 7f1001873640 1 -- start start 2024-05-20T18:02:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f1001873640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc0b47b0 0x7f0ffc0afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f1001873640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ffc0b58f0 0x7f0ffc06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f1001873640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ffc0b39f0 con 0x7f0ffc15d060 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f1001873640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f0ffc0b3cd0 con 0x7f0ffc0b58f0 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f1001873640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc0b3fb0 con 0x7f0ffc0b47b0 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f0ffb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ffc0b58f0 0x7f0ffc06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f0ffb7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ffc0b58f0 0x7f0ffc06f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43708/0 (socket says 172.21.15.6:43708) 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f0ffb7fe640 1 -- 172.21.15.6:0/1034590722 learned_addr learned my addr 172.21.15.6:0/1034590722 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f0ffaffd640 1 --2- 172.21.15.6:0/1034590722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc0b47b0 0x7f0ffc0afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f0ffb7fe640 1 -- 172.21.15.6:0/1034590722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc0b47b0 msgr2=0x7f0ffc0afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f0ffb7fe640 1 --2- 172.21.15.6:0/1034590722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc0b47b0 0x7f0ffc0afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.292+0000 7f0ffb7fe640 1 -- 172.21.15.6:0/1034590722 >> v1:172.21.15.171:6789/0 conn(0x7f0ffc15d060 legacy=0x7f0ffc0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.293+0000 7f0ffb7fe640 1 -- 172.21.15.6:0/1034590722 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc0b4290 con 0x7f0ffc0b58f0 2024-05-20T18:02:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.293+0000 7f0ffaffd640 1 --2- 172.21.15.6:0/1034590722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc0b47b0 0x7f0ffc0afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.293+0000 7f0ffb7fe640 1 --2- 172.21.15.6:0/1034590722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc0b58f0 0x7f0ffc06f3d0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009e50 tx=0x7f0ff402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cbbfba08055383 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.293+0000 7f0ff9ffb640 1 -- 172.21.15.6:0/1034590722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4036070 con 0x7f0ffc0b58f0 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.293+0000 7f0ff9ffb640 1 -- 172.21.15.6:0/1034590722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff4031600 con 0x7f0ffc0b58f0 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.293+0000 7f0ff9ffb640 1 -- 172.21.15.6:0/1034590722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40319d0 con 0x7f0ffc0b58f0 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.294+0000 7f1001873640 1 -- 172.21.15.6:0/1034590722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc0b58f0 msgr2=0x7f0ffc06f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.294+0000 7f1001873640 1 --2- 172.21.15.6:0/1034590722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc0b58f0 0x7f0ffc06f3d0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009e50 tx=0x7f0ff402a630 comp rx=0 tx=0).stop 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.294+0000 7f1001873640 1 -- 172.21.15.6:0/1034590722 shutdown_connections 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.294+0000 7f1001873640 1 --2- 172.21.15.6:0/1034590722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc0b58f0 0x7f0ffc06f3d0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.294+0000 7f1001873640 1 --2- 172.21.15.6:0/1034590722 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc0b47b0 0x7f0ffc0afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.294+0000 7f1001873640 1 -- 172.21.15.6:0/1034590722 >> 172.21.15.6:0/1034590722 conn(0x7f0ffc0cd2a0 msgr2=0x7f0ffc0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.294+0000 7f1001873640 1 -- 172.21.15.6:0/1034590722 shutdown_connections 2024-05-20T18:02:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.294+0000 7f1001873640 1 -- 172.21.15.6:0/1034590722 wait complete. 2024-05-20T18:02:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.296+0000 7f1001873640 1 Processor -- start 2024-05-20T18:02:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.296+0000 7f1001873640 1 -- start start 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.297+0000 7f1001873640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc15d060 0x7f0ffc145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f1001873640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc1427b0 0x7f0ffc157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f1001873640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ffc157970 0x7f0ffc154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f1001873640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc159de0 con 0x7f0ffc1427b0 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f1001873640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc159c60 con 0x7f0ffc157970 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f1001873640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc06f910 con 0x7f0ffc15d060 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc1427b0 0x7f0ffc157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc1427b0 0x7f0ffc157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43714/0 (socket says 172.21.15.6:43714) 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 -- 172.21.15.6:0/29920597 learned_addr learned my addr 172.21.15.6:0/29920597 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffaffd640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc15d060 0x7f0ffc145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffb7fe640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ffc157970 0x7f0ffc154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 -- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc15d060 msgr2=0x7f0ffc145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc15d060 0x7f0ffc145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 -- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ffc157970 msgr2=0x7f0ffc154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ffc157970 0x7f0ffc154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 -- 172.21.15.6:0/29920597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc146020 con 0x7f0ffc1427b0 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0ffa7fc640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc1427b0 0x7f0ffc157430 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000b420 tx=0x7f0ff000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0fe3fff640 1 -- 172.21.15.6:0/29920597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0011830 con 0x7f0ffc1427b0 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0fe3fff640 1 -- 172.21.15.6:0/29920597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff0016070 con 0x7f0ffc1427b0 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f0fe3fff640 1 -- 172.21.15.6:0/29920597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0011c10 con 0x7f0ffc1427b0 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.298+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ffc157d80 con 0x7f0ffc1427b0 2024-05-20T18:02:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.299+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ffc0b1f10 con 0x7f0ffc1427b0 2024-05-20T18:02:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.299+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ffc1531b0 con 0x7f0ffc1427b0 2024-05-20T18:02:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.300+0000 7f0fe3fff640 1 -- 172.21.15.6:0/29920597 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ff001b460 con 0x7f0ffc1427b0 2024-05-20T18:02:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.301+0000 7f0fe3fff640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe806be30 0x7f0fe806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.301+0000 7f0fe3fff640 1 -- 172.21.15.6:0/29920597 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f0ff008a910 con 0x7f0ffc1427b0 2024-05-20T18:02:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.301+0000 7f0ffaffd640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe806be30 0x7f0fe806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.302+0000 7f0ffaffd640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe806be30 0x7f0fe806e340 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc06cf20 tx=0x7f0fec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.305+0000 7f0fe3fff640 1 -- 172.21.15.6:0/29920597 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0ff0020020 con 0x7f0ffc1427b0 2024-05-20T18:02:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.525+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ffc067c80 con 0x7f0ffc1427b0 2024-05-20T18:02:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.526+0000 7f0fe3fff640 1 -- 172.21.15.6:0/29920597 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5182 (secure 0 0 0) 0x7f0ffc067c80 con 0x7f0ffc1427b0 2024-05-20T18:02:31.524 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:31.524 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":98,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:11.519092+0000","modified":"2024-05-20T18:02:28.172550+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":7,"addr":"172.21.15.6:6835/1253645410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1253645410},{"type":"v1","addr":"172.21.15.6:6835","nonce":1253645410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":10}]} 2024-05-20T18:02:31.524 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 98 2024-05-20T18:02:31.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe806be30 msgr2=0x7f0fe806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe806be30 0x7f0fe806e340 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc06cf20 tx=0x7f0fec008040 comp rx=0 tx=0).stop 2024-05-20T18:02:31.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc1427b0 msgr2=0x7f0ffc157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc1427b0 0x7f0ffc157430 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000b420 tx=0x7f0ff000b8e0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 shutdown_connections 2024-05-20T18:02:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f0fe806be30 0x7f0fe806e340 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ffc157970 0x7f0ffc154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ffc1427b0 0x7f0ffc157430 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 --2- 172.21.15.6:0/29920597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0ffc15d060 0x7f0ffc145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 >> 172.21.15.6:0/29920597 conn(0x7f0ffc0cd2a0 msgr2=0x7f0ffc158830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 shutdown_connections 2024-05-20T18:02:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.528+0000 7f1001873640 1 -- 172.21.15.6:0/29920597 wait complete. 2024-05-20T18:02:31.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-05-20T18:02:31.670 INFO:teuthology.orchestra.run.smithi006.stdout:[{"id":7406,"entity":{"name":{"type":"client","num":7406},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":1431183645}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":11.583867398000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9331015467856307,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7406 192.168.0.1:0/1431183645","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi171","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}},{"id":7400,"entity":{"name":{"type":"client","num":7400},"addr":{"type":"any","addr":"172.21.15.6:0","nonce":1252216099}},"state":"open","num_leases":400,"num_caps":201,"request_load_avg":385,"uptime":12.725854326,"requests_in_flight":0,"num_completed_requests":399,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":1510.2638664466913,"halflife":60},"release_caps":{"value":198.90599480380905,"halflife":60},"recall_caps_throttle":{"value":418.55096416337688,"halflife":1.5},"recall_caps_throttle2o":{"value":129.99162547357182,"halflife":0.5},"session_cache_liveness":{"value":1178.0559731402318,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7400 172.21.15.6:0/1252216099","completed_requests":[{"tid":29,"created_ino":"0x10000000001"},{"tid":30,"created_ino":"0x100000001f6"},{"tid":31,"created_ino":"0x100000001f7"},{"tid":32,"created_ino":"0x100000001f8"},{"tid":33,"created_ino":"0x100000001f9"},{"tid":34,"created_ino":"0x100000001fa"},{"tid":35,"created_ino":"0x100000001fb"},{"tid":36,"created_ino":"0x100000001fc"},{"tid":37,"created_ino":"0x100000001fd"},{"tid":38,"created_ino":"0x100000001fe"},{"tid":39,"created_ino":"0x100000001ff"},{"tid":40,"created_ino":"0x10000000200"},{"tid":41,"created_ino":"0x10000000201"},{"tid":42,"created_ino":"0x10000000202"},{"tid":43,"created_ino":"0x10000000203"},{"tid":44,"created_ino":"0x10000000204"},{"tid":45,"created_ino":"0x10000000205"},{"tid":46,"created_ino":"0x10000000206"},{"tid":47,"created_ino":"0x10000000207"},{"tid":48,"created_ino":"0x10000000208"},{"tid":49,"created_ino":"0x10000000209"},{"tid":50,"created_ino":"0x1000000020a"},{"tid":51,"created_ino":"0x1000000020b"},{"tid":52,"created_ino":"0x1000000020c"},{"tid":53,"created_ino":"0x1000000020d"},{"tid":54,"created_ino":"0x1000000020e"},{"tid":55,"created_ino":"0x1000000020f"},{"tid":56,"created_ino":"0x10000000210"},{"tid":57,"created_ino":"0x10000000211"},{"tid":58,"created_ino":"0x10000000212"},{"tid":59,"created_ino":"0x10000000213"},{"tid":60,"created_ino":"0x10000000214"},{"tid":61,"created_ino":"0x10000000215"},{"tid":62,"created_ino":"0x10000000216"},{"tid":63,"created_ino":"0x10000000217"},{"tid":64,"created_ino":"0x10000000218"},{"tid":65,"created_ino":"0x10000000219"},{"tid":66,"created_ino":"0x1000000021a"},{"tid":67,"created_ino":"0x1000000021b"},{"tid":68,"created_ino":"0x1000000021c"},{"tid":69,"created_ino":"0x1000000021d"},{"tid":70,"created_ino":"0x1000000021e"},{"tid":71,"created_ino":"0x1000000021f"},{"tid":72,"created_ino":"0x10000000220"},{"tid":73,"created_ino":"0x10000000221"},{"tid":74,"created_ino":"0x10000000222"},{"tid":75,"created_ino":"0x10000000223"},{"tid":76,"created_ino":"0x10000000224"},{"tid":77,"created_ino":"0x10000000225"},{"tid":78,"created_ino":"0x10000000226"},{"tid":79,"created_ino":"0x10000000227"},{"tid":80,"created_ino":"0x10000000228"},{"tid":81,"created_ino":"0x10000000229"},{"tid":82,"created_ino":"0x1000000022a"},{"tid":83,"created_ino":"0x1000000022b"},{"tid":84,"created_ino":"0x1000000022c"},{"tid":85,"created_ino":"0x1000000022d"},{"tid":86,"created_ino":"0x1000000022e"},{"tid":87,"created_ino":"0x1000000022f"},{"tid":88,"created_ino":"0x10000000230"},{"tid":89,"created_ino":"0x10000000231"},{"tid":90,"created_ino":"0x10000000232"},{"tid":91,"created_ino":"0x10000000233"},{"tid":92,"created_ino":"0x10000000234"},{"tid":93,"created_ino":"0x10000000235"},{"tid":94,"created_ino":"0x10000000236"},{"tid":95,"created_ino":"0x10000000237"},{"tid":96,"created_ino":"0x10000000238"},{"tid":97,"created_ino":"0x10000000239"},{"tid":98,"created_ino":"0x1000000023a"},{"tid":99,"created_ino":"0x1000000023b"},{"tid":100,"created_ino":"0x1000000023c"},{"tid":101,"created_ino":"0x1000000023d"},{"tid":102,"created_ino":"0x1000000023e"},{"tid":103,"created_ino":"0x1000000023f"},{"tid":104,"created_ino":"0x10000000240"},{"tid":105,"created_ino":"0x10000000241"},{"tid":106,"created_ino":"0x10000000242"},{"tid":107,"created_ino":"0x10000000243"},{"tid":108,"created_ino":"0x10000000244"},{"tid":109,"created_ino":"0x10000000245"},{"tid":110,"created_ino":"0x10000000246"},{"tid":111,"created_ino":"0x10000000247"},{"tid":112,"created_ino":"0x10000000248"},{"tid":113,"created_ino":"0x10000000249"},{"tid":114,"created_ino":"0x1000000024a"},{"tid":115,"created_ino":"0x1000000024b"},{"tid":116,"created_ino":"0x1000000024c"},{"tid":117,"created_ino":"0x1000000024d"},{"tid":118,"created_ino":"0x1000000024e"},{"tid":119,"created_ino":"0x1000000024f"},{"tid":120,"created_ino":"0x10000000250"},{"tid":121,"created_ino":"0x10000000251"},{"tid":122,"created_ino":"0x10000000252"},{"tid":123,"created_ino":"0x10000000253"},{"tid":124,"created_ino":"0x10000000254"},{"tid":125,"created_ino":"0x10000000255"},{"tid":126,"created_ino":"0x10000000256"},{"tid":127,"created_ino":"0x10000000257"},{"tid":128,"created_ino":"0x10000000258"},{"tid":129,"created_ino":"0x10000000259"},{"tid":130,"created_ino":"0x1000000025a"},{"tid":131,"created_ino":"0x1000000025b"},{"tid":132,"created_ino":"0x1000000025c"},{"tid":133,"created_ino":"0x1000000025d"},{"tid":134,"created_ino":"0x1000000025e"},{"tid":135,"created_ino":"0x1000000025f"},{"tid":136,"created_ino":"0x10000000260"},{"tid":137,"created_ino":"0x10000000261"},{"tid":138,"created_ino":"0x10000000262"},{"tid":139,"created_ino":"0x10000000263"},{"tid":140,"created_ino":"0x10000000264"},{"tid":141,"created_ino":"0x10000000265"},{"tid":142,"created_ino":"0x10000000266"},{"tid":143,"created_ino":"0x10000000267"},{"tid":144,"created_ino":"0x10000000268"},{"tid":145,"created_ino":"0x10000000269"},{"tid":146,"created_ino":"0x1000000026a"},{"tid":147,"created_ino":"0x1000000026b"},{"tid":148,"created_ino":"0x1000000026c"},{"tid":149,"created_ino":"0x1000000026d"},{"tid":150,"created_ino":"0x1000000026e"},{"tid":151,"created_ino":"0x1000000026f"},{"tid":152,"created_ino":"0x10000000270"},{"tid":153,"created_ino":"0x10000000271"},{"tid":154,"created_ino":"0x10000000272"},{"tid":155,"created_ino":"0x10000000273"},{"tid":156,"created_ino":"0x10000000274"},{"tid":157,"created_ino":"0x10000000275"},{"tid":158,"created_ino":"0x10000000276"},{"tid":159,"created_ino":"0x10000000277"},{"tid":160,"created_ino":"0x10000000278"},{"tid":161,"created_ino":"0x10000000279"},{"tid":162,"created_ino":"0x1000000027a"},{"tid":163,"created_ino":"0x1000000027b"},{"tid":164,"created_ino":"0x1000000027c"},{"tid":165,"created_ino":"0x1000000027d"},{"tid":166,"created_ino":"0x1000000027e"},{"tid":167,"created_ino":"0x1000000027f"},{"tid":168,"created_ino":"0x10000000280"},{"tid":169,"created_ino":"0x10000000281"},{"tid":170,"created_ino":"0x10000000282"},{"tid":171,"created_ino":"0x10000000283"},{"tid":172,"created_ino":"0x10000000284"},{"tid":173,"created_ino":"0x10000000285"},{"tid":174,"created_ino":"0x10000000286"},{"tid":175,"created_ino":"0x10000000287"},{"tid":176,"created_ino":"0x10000000288"},{"tid":177,"created_ino":"0x10000000289"},{"tid":178,"created_ino":"0x1000000028a"},{"tid":179,"created_ino":"0x1000000028b"},{"tid":180,"created_ino":"0x1000000028c"},{"tid":181,"created_ino":"0x1000000028d"},{"tid":182,"created_ino":"0x1000000028e"},{"tid":183,"created_ino":"0x1000000028f"},{"tid":184,"created_ino":"0x10000000290"},{"tid":185,"created_ino":"0x10000000291"},{"tid":186,"created_ino":"0x10000000292"},{"tid":187,"created_ino":"0x10000000293"},{"tid":188,"created_ino":"0x10000000294"},{"tid":189,"created_ino":"0x10000000295"},{"tid":190,"created_ino":"0x10000000296"},{"tid":191,"created_ino":"0x10000000297"},{"tid":192,"created_ino":"0x10000000298"},{"tid":193,"created_ino":"0x10000000299"},{"tid":194,"created_ino":"0x1000000029a"},{"tid":195,"created_ino":"0x1000000029b"},{"tid":196,"created_ino":"0x1000000029c"},{"tid":197,"created_ino":"0x1000000029d"},{"tid":198,"created_ino":"0x1000000029e"},{"tid":199,"created_ino":"0x1000000029f"},{"tid":200,"created_ino":"0x100000002a0"},{"tid":201,"created_ino":"0x100000002a1"},{"tid":202,"created_ino":"0x100000002a2"},{"tid":203,"created_ino":"0x100000002a3"},{"tid":204,"created_ino":"0x100000002a4"},{"tid":205,"created_ino":"0x100000002a5"},{"tid":206,"created_ino":"0x100000002a6"},{"tid":207,"created_ino":"0x100000002a7"},{"tid":208,"created_ino":"0x100000002a8"},{"tid":209,"created_ino":"0x100000002a9"},{"tid":210,"created_ino":"0x100000002aa"},{"tid":211,"created_ino":"0x100000002ab"},{"tid":212,"created_ino":"0x100000002ac"},{"tid":213,"created_ino":"0x100000002ad"},{"tid":214,"created_ino":"0x100000002ae"},{"tid":215,"created_ino":"0x100000002af"},{"tid":216,"created_ino":"0x100000002b0"},{"tid":217,"created_ino":"0x100000002b1"},{"tid":218,"created_ino":"0x100000002b2"},{"tid":219,"created_ino":"0x100000002b3"},{"tid":220,"created_ino":"0x100000002b4"},{"tid":221,"created_ino":"0x100000002b5"},{"tid":222,"created_ino":"0x100000002b6"},{"tid":223,"created_ino":"0x100000002b7"},{"tid":224,"created_ino":"0x100000002b8"},{"tid":225,"created_ino":"0x100000002b9"},{"tid":226,"created_ino":"0x100000002ba"},{"tid":227,"created_ino":"0x100000002bb"},{"tid":228,"created_ino":"0x100000002bc"},{"tid":229,"created_ino":"0x100000002bd"},{"tid":230,"created_ino":"0x100000002be"},{"tid":231,"created_ino":"0x100000002bf"},{"tid":232,"created_ino":"0x100000002c0"},{"tid":233,"created_ino":"0x100000002c1"},{"tid":234,"created_ino":"0x100000002c2"},{"tid":235,"created_ino":"0x100000002c3"},{"tid":236,"created_ino":"0x100000002c4"},{"tid":237,"created_ino":"0x100000002c5"},{"tid":238,"created_ino":"0x100000002c6"},{"tid":239,"created_ino":"0x100000002c7"},{"tid":240,"created_ino":"0x100000002c8"},{"tid":241,"created_ino":"0x100000002c9"},{"tid":242,"created_ino":"0x100000002ca"},{"tid":243,"created_ino":"0x100000002cb"},{"tid":244,"created_ino":"0x100000002cc"},{"tid":245,"created_ino":"0x100000002cd"},{"tid":246,"created_ino":"0x100000002ce"},{"tid":247,"created_ino":"0x100000002cf"},{"tid":248,"created_ino":"0x100000002d0"},{"tid":249,"created_ino":"0x100000002d1"},{"tid":250,"created_ino":"0x100000002d2"},{"tid":251,"created_ino":"0x100000002d3"},{"tid":252,"created_ino":"0x100000002d4"},{"tid":253,"created_ino":"0x100000002d5"},{"tid":254,"created_ino":"0x100000002d6"},{"tid":255,"created_ino":"0x100000002d7"},{"tid":256,"created_ino":"0x100000002d8"},{"tid":257,"created_ino":"0x100000002d9"},{"tid":258,"created_ino":"0x100000002da"},{"tid":259,"created_ino":"0x100000002db"},{"tid":260,"created_ino":"0x100000002dc"},{"tid":261,"created_ino":"0x100000002dd"},{"tid":262,"created_ino":"0x100000002de"},{"tid":263,"created_ino":"0x100000002df"},{"tid":264,"created_ino":"0x100000002e0"},{"tid":265,"created_ino":"0x100000002e1"},{"tid":266,"created_ino":"0x100000002e2"},{"tid":267,"created_ino":"0x100000002e3"},{"tid":268,"created_ino":"0x100000002e4"},{"tid":269,"created_ino":"0x100000002e5"},{"tid":270,"created_ino":"0x100000002e6"},{"tid":271,"created_ino":"0x100000002e7"},{"tid":272,"created_ino":"0x100000002e8"},{"tid":273,"created_ino":"0x100000002e9"},{"tid":274,"created_ino":"0x100000002ea"},{"tid":275,"created_ino":"0x100000002eb"},{"tid":276,"created_ino":"0x100000002ec"},{"tid":277,"created_ino":"0x100000002ed"},{"tid":278,"created_ino":"0x100000002ee"},{"tid":279,"created_ino":"0x100000002ef"},{"tid":280,"created_ino":"0x100000002f0"},{"tid":281,"created_ino":"0x100000002f1"},{"tid":282,"created_ino":"0x100000002f2"},{"tid":283,"created_ino":"0x100000002f3"},{"tid":284,"created_ino":"0x100000002f4"},{"tid":285,"created_ino":"0x100000002f5"},{"tid":286,"created_ino":"0x100000002f6"},{"tid":287,"created_ino":"0x100000002f7"},{"tid":288,"created_ino":"0x100000002f8"},{"tid":289,"created_ino":"0x100000002f9"},{"tid":290,"created_ino":"0x100000002fa"},{"tid":291,"created_ino":"0x100000002fb"},{"tid":292,"created_ino":"0x100000002fc"},{"tid":293,"created_ino":"0x100000002fd"},{"tid":294,"created_ino":"0x100000002fe"},{"tid":295,"created_ino":"0x100000002ff"},{"tid":296,"created_ino":"0x10000000300"},{"tid":297,"created_ino":"0x10000000301"},{"tid":298,"created_ino":"0x10000000302"},{"tid":299,"created_ino":"0x10000000303"},{"tid":300,"created_ino":"0x10000000304"},{"tid":301,"created_ino":"0x10000000305"},{"tid":302,"created_ino":"0x10000000306"},{"tid":303,"created_ino":"0x10000000307"},{"tid":304,"created_ino":"0x10000000308"},{"tid":305,"created_ino":"0x10000000309"},{"tid":306,"created_ino":"0x1000000030a"},{"tid":307,"created_ino":"0x1000000030b"},{"tid":308,"created_ino":"0x1000000030c"},{"tid":309,"created_ino":"0x1000000030d"},{"tid":310,"created_ino":"0x1000000030e"},{"tid":311,"created_ino":"0x1000000030f"},{"tid":312,"created_ino":"0x10000000310"},{"tid":313,"created_ino":"0x10000000311"},{"tid":314,"created_ino":"0x10000000312"},{"tid":315,"created_ino":"0x10000000313"},{"tid":316,"created_ino":"0x10000000314"},{"tid":317,"created_ino":"0x10000000315"},{"tid":318,"created_ino":"0x10000000316"},{"tid":319,"created_ino":"0x10000000317"},{"tid":320,"created_ino":"0x10000000318"},{"tid":321,"created_ino":"0x10000000319"},{"tid":322,"created_ino":"0x1000000031a"},{"tid":323,"created_ino":"0x1000000031b"},{"tid":324,"created_ino":"0x1000000031c"},{"tid":325,"created_ino":"0x1000000031d"},{"tid":326,"created_ino":"0x1000000031e"},{"tid":327,"created_ino":"0x1000000031f"},{"tid":328,"created_ino":"0x10000000320"},{"tid":329,"created_ino":"0x10000000321"},{"tid":330,"created_ino":"0x10000000322"},{"tid":331,"created_ino":"0x10000000323"},{"tid":332,"created_ino":"0x10000000324"},{"tid":333,"created_ino":"0x10000000325"},{"tid":334,"created_ino":"0x10000000326"},{"tid":335,"created_ino":"0x10000000327"},{"tid":336,"created_ino":"0x10000000328"},{"tid":337,"created_ino":"0x10000000329"},{"tid":338,"created_ino":"0x1000000032a"},{"tid":339,"created_ino":"0x1000000032b"},{"tid":340,"created_ino":"0x1000000032c"},{"tid":341,"created_ino":"0x1000000032d"},{"tid":342,"created_ino":"0x1000000032e"},{"tid":343,"created_ino":"0x1000000032f"},{"tid":344,"created_ino":"0x10000000330"},{"tid":345,"created_ino":"0x10000000331"},{"tid":346,"created_ino":"0x10000000332"},{"tid":347,"created_ino":"0x10000000333"},{"tid":348,"created_ino":"0x10000000334"},{"tid":349,"created_ino":"0x10000000335"},{"tid":350,"created_ino":"0x10000000336"},{"tid":351,"created_ino":"0x10000000337"},{"tid":352,"created_ino":"0x10000000338"},{"tid":353,"created_ino":"0x10000000339"},{"tid":354,"created_ino":"0x1000000033a"},{"tid":355,"created_ino":"0x1000000033b"},{"tid":356,"created_ino":"0x1000000033c"},{"tid":357,"created_ino":"0x1000000033d"},{"tid":358,"created_ino":"0x1000000033e"},{"tid":359,"created_ino":"0x1000000033f"},{"tid":360,"created_ino":"0x10000000340"},{"tid":361,"created_ino":"0x10000000341"},{"tid":362,"created_ino":"0x10000000342"},{"tid":363,"created_ino":"0x10000000343"},{"tid":364,"created_ino":"0x10000000344"},{"tid":365,"created_ino":"0x10000000345"},{"tid":366,"created_ino":"0x10000000346"},{"tid":367,"created_ino":"0x10000000347"},{"tid":368,"created_ino":"0x10000000348"},{"tid":369,"created_ino":"0x10000000349"},{"tid":370,"created_ino":"0x1000000034a"},{"tid":371,"created_ino":"0x1000000034b"},{"tid":372,"created_ino":"0x1000000034c"},{"tid":373,"created_ino":"0x1000000034d"},{"tid":374,"created_ino":"0x1000000034e"},{"tid":375,"created_ino":"0x1000000034f"},{"tid":376,"created_ino":"0x10000000350"},{"tid":377,"created_ino":"0x10000000351"},{"tid":378,"created_ino":"0x10000000352"},{"tid":379,"created_ino":"0x10000000353"},{"tid":380,"created_ino":"0x10000000354"},{"tid":381,"created_ino":"0x10000000355"},{"tid":382,"created_ino":"0x10000000356"},{"tid":383,"created_ino":"0x10000000357"},{"tid":384,"created_ino":"0x10000000358"},{"tid":385,"created_ino":"0x10000000359"},{"tid":386,"created_ino":"0x1000000035a"},{"tid":387,"created_ino":"0x1000000035b"},{"tid":388,"created_ino":"0x1000000035c"},{"tid":389,"created_ino":"0x1000000035d"},{"tid":390,"created_ino":"0x1000000035e"},{"tid":391,"created_ino":"0x1000000035f"},{"tid":392,"created_ino":"0x10000000360"},{"tid":393,"created_ino":"0x10000000361"},{"tid":394,"created_ino":"0x10000000362"},{"tid":395,"created_ino":"0x10000000363"},{"tid":396,"created_ino":"0x10000000364"},{"tid":397,"created_ino":"0x10000000365"},{"tid":398,"created_ino":"0x10000000366"},{"tid":399,"created_ino":"0x10000000367"},{"tid":400,"created_ino":"0x10000000368"},{"tid":401,"created_ino":"0x10000000369"},{"tid":402,"created_ino":"0x1000000036a"},{"tid":403,"created_ino":"0x1000000036b"},{"tid":404,"created_ino":"0x1000000036c"},{"tid":405,"created_ino":"0x1000000036d"},{"tid":406,"created_ino":"0x1000000036e"},{"tid":407,"created_ino":"0x1000000036f"},{"tid":408,"created_ino":"0x10000000370"},{"tid":409,"created_ino":"0x10000000371"},{"tid":410,"created_ino":"0x10000000372"},{"tid":411,"created_ino":"0x10000000373"},{"tid":412,"created_ino":"0x10000000374"},{"tid":413,"created_ino":"0x10000000375"},{"tid":414,"created_ino":"0x10000000376"},{"tid":415,"created_ino":"0x10000000377"},{"tid":416,"created_ino":"0x10000000378"},{"tid":417,"created_ino":"0x10000000379"},{"tid":418,"created_ino":"0x1000000037a"},{"tid":419,"created_ino":"0x1000000037b"},{"tid":420,"created_ino":"0x1000000037c"},{"tid":421,"created_ino":"0x1000000037d"},{"tid":422,"created_ino":"0x1000000037e"},{"tid":423,"created_ino":"0x1000000037f"},{"tid":424,"created_ino":"0x10000000380"},{"tid":425,"created_ino":"0x10000000381"},{"tid":426,"created_ino":"0x10000000382"},{"tid":427,"created_ino":"0x10000000383"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000384","length":603}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi006","kernel_version":"5.14.0-447.el9.x86_64","root":"/"}}] 2024-05-20T18:02:31.673 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi171", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1431183645, "type": "any" }, "name": { "num": 7406, "type": "client" } }, "id": 7406, "inst": "client.7406 192.168.0.1:0/1431183645", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9331015467856307 }, "state": "open", "uptime": 11.583867398 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi006", "kernel_version": "5.14.0-447.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 29 }, { "created_ino": "0x100000001f6", "tid": 30 }, { "created_ino": "0x100000001f7", "tid": 31 }, { "created_ino": "0x100000001f8", "tid": 32 }, { "created_ino": "0x100000001f9", "tid": 33 }, { "created_ino": "0x100000001fa", "tid": 34 }, { "created_ino": "0x100000001fb", "tid": 35 }, { "created_ino": "0x100000001fc", "tid": 36 }, { "created_ino": "0x100000001fd", "tid": 37 }, { "created_ino": "0x100000001fe", "tid": 38 }, { "created_ino": "0x100000001ff", "tid": 39 }, { "created_ino": "0x10000000200", "tid": 40 }, { "created_ino": "0x10000000201", "tid": 41 }, { "created_ino": "0x10000000202", "tid": 42 }, { "created_ino": "0x10000000203", "tid": 43 }, { "created_ino": "0x10000000204", "tid": 44 }, { "created_ino": "0x10000000205", "tid": 45 }, { "created_ino": "0x10000000206", "tid": 46 }, { "created_ino": "0x10000000207", "tid": 47 }, { "created_ino": "0x10000000208", "tid": 48 }, { "created_ino": "0x10000000209", "tid": 49 }, { "created_ino": "0x1000000020a", "tid": 50 }, { "created_ino": "0x1000000020b", "tid": 51 }, { "created_ino": "0x1000000020c", "tid": 52 }, { "created_ino": "0x1000000020d", "tid": 53 }, { "created_ino": "0x1000000020e", "tid": 54 }, { "created_ino": "0x1000000020f", "tid": 55 }, { "created_ino": "0x10000000210", "tid": 56 }, { "created_ino": "0x10000000211", "tid": 57 }, { "created_ino": "0x10000000212", "tid": 58 }, { "created_ino": "0x10000000213", "tid": 59 }, { "created_ino": "0x10000000214", "tid": 60 }, { "created_ino": "0x10000000215", "tid": 61 }, { "created_ino": "0x10000000216", "tid": 62 }, { "created_ino": "0x10000000217", "tid": 63 }, { "created_ino": "0x10000000218", "tid": 64 }, { "created_ino": "0x10000000219", "tid": 65 }, { "created_ino": "0x1000000021a", "tid": 66 }, { "created_ino": "0x1000000021b", "tid": 67 }, { "created_ino": "0x1000000021c", "tid": 68 }, { "created_ino": "0x1000000021d", "tid": 69 }, { "created_ino": "0x1000000021e", "tid": 70 }, { "created_ino": "0x1000000021f", "tid": 71 }, { "created_ino": "0x10000000220", "tid": 72 }, { "created_ino": "0x10000000221", "tid": 73 }, { "created_ino": "0x10000000222", "tid": 74 }, { "created_ino": "0x10000000223", "tid": 75 }, { "created_ino": "0x10000000224", "tid": 76 }, { "created_ino": "0x10000000225", "tid": 77 }, { "created_ino": "0x10000000226", "tid": 78 }, { "created_ino": "0x10000000227", "tid": 79 }, { "created_ino": "0x10000000228", "tid": 80 }, { "created_ino": "0x10000000229", "tid": 81 }, { "created_ino": "0x1000000022a", "tid": 82 }, { "created_ino": "0x1000000022b", "tid": 83 }, { "created_ino": "0x1000000022c", "tid": 84 }, { "created_ino": "0x1000000022d", "tid": 85 }, { "created_ino": "0x1000000022e", "tid": 86 }, { "created_ino": "0x1000000022f", "tid": 87 }, { "created_ino": "0x10000000230", "tid": 88 }, { "created_ino": "0x10000000231", "tid": 89 }, { "created_ino": "0x10000000232", "tid": 90 }, { "created_ino": "0x10000000233", "tid": 91 }, { "created_ino": "0x10000000234", "tid": 92 }, { "created_ino": "0x10000000235", "tid": 93 }, { "created_ino": "0x10000000236", "tid": 94 }, { "created_ino": "0x10000000237", "tid": 95 }, { "created_ino": "0x10000000238", "tid": 96 }, { "created_ino": "0x10000000239", "tid": 97 }, { "created_ino": "0x1000000023a", "tid": 98 }, { "created_ino": "0x1000000023b", "tid": 99 }, { "created_ino": "0x1000000023c", "tid": 100 }, { "created_ino": "0x1000000023d", "tid": 101 }, { "created_ino": "0x1000000023e", "tid": 102 }, { "created_ino": "0x1000000023f", "tid": 103 }, { "created_ino": "0x10000000240", "tid": 104 }, { "created_ino": "0x10000000241", "tid": 105 }, { "created_ino": "0x10000000242", "tid": 106 }, { "created_ino": "0x10000000243", "tid": 107 }, { "created_ino": "0x10000000244", "tid": 108 }, { "created_ino": "0x10000000245", "tid": 109 }, { "created_ino": "0x10000000246", "tid": 110 }, { "created_ino": "0x10000000247", "tid": 111 }, { "created_ino": "0x10000000248", "tid": 112 }, { "created_ino": "0x10000000249", "tid": 113 }, { "created_ino": "0x1000000024a", "tid": 114 }, { "created_ino": "0x1000000024b", "tid": 115 }, { "created_ino": "0x1000000024c", "tid": 116 }, { "created_ino": "0x1000000024d", "tid": 117 }, { "created_ino": "0x1000000024e", "tid": 118 }, { "created_ino": "0x1000000024f", "tid": 119 }, { "created_ino": "0x10000000250", "tid": 120 }, { "created_ino": "0x10000000251", "tid": 121 }, { "created_ino": "0x10000000252", "tid": 122 }, { "created_ino": "0x10000000253", "tid": 123 }, { "created_ino": "0x10000000254", "tid": 124 }, { "created_ino": "0x10000000255", "tid": 125 }, { "created_ino": "0x10000000256", "tid": 126 }, { "created_ino": "0x10000000257", "tid": 127 }, { "created_ino": "0x10000000258", "tid": 128 }, { "created_ino": "0x10000000259", "tid": 129 }, { "created_ino": "0x1000000025a", "tid": 130 }, { "created_ino": "0x1000000025b", "tid": 131 }, { "created_ino": "0x1000000025c", "tid": 132 }, { "created_ino": "0x1000000025d", "tid": 133 }, { "created_ino": "0x1000000025e", "tid": 134 }, { "created_ino": "0x1000000025f", "tid": 135 }, { "created_ino": "0x10000000260", "tid": 136 }, { "created_ino": "0x10000000261", "tid": 137 }, { "created_ino": "0x10000000262", "tid": 138 }, { "created_ino": "0x10000000263", "tid": 139 }, { "created_ino": "0x10000000264", "tid": 140 }, { "created_ino": "0x10000000265", "tid": 141 }, { "created_ino": "0x10000000266", "tid": 142 }, { "created_ino": "0x10000000267", "tid": 143 }, { "created_ino": "0x10000000268", "tid": 144 }, { "created_ino": "0x10000000269", "tid": 145 }, { "created_ino": "0x1000000026a", "tid": 146 }, { "created_ino": "0x1000000026b", "tid": 147 }, { "created_ino": "0x1000000026c", "tid": 148 }, { "created_ino": "0x1000000026d", "tid": 149 }, { "created_ino": "0x1000000026e", "tid": 150 }, { "created_ino": "0x1000000026f", "tid": 151 }, { "created_ino": "0x10000000270", "tid": 152 }, { "created_ino": "0x10000000271", "tid": 153 }, { "created_ino": "0x10000000272", "tid": 154 }, { "created_ino": "0x10000000273", "tid": 155 }, { "created_ino": "0x10000000274", "tid": 156 }, { "created_ino": "0x10000000275", "tid": 157 }, { "created_ino": "0x10000000276", "tid": 158 }, { "created_ino": "0x10000000277", "tid": 159 }, { "created_ino": "0x10000000278", "tid": 160 }, { "created_ino": "0x10000000279", "tid": 161 }, { "created_ino": "0x1000000027a", "tid": 162 }, { "created_ino": "0x1000000027b", "tid": 163 }, { "created_ino": "0x1000000027c", "tid": 164 }, { "created_ino": "0x1000000027d", "tid": 165 }, { "created_ino": "0x1000000027e", "tid": 166 }, { "created_ino": "0x1000000027f", "tid": 167 }, { "created_ino": "0x10000000280", "tid": 168 }, { "created_ino": "0x10000000281", "tid": 169 }, { "created_ino": "0x10000000282", "tid": 170 }, { "created_ino": "0x10000000283", "tid": 171 }, { "created_ino": "0x10000000284", "tid": 172 }, { "created_ino": "0x10000000285", "tid": 173 }, { "created_ino": "0x10000000286", "tid": 174 }, { "created_ino": "0x10000000287", "tid": 175 }, { "created_ino": "0x10000000288", "tid": 176 }, { "created_ino": "0x10000000289", "tid": 177 }, { "created_ino": "0x1000000028a", "tid": 178 }, { "created_ino": "0x1000000028b", "tid": 179 }, { "created_ino": "0x1000000028c", "tid": 180 }, { "created_ino": "0x1000000028d", "tid": 181 }, { "created_ino": "0x1000000028e", "tid": 182 }, { "created_ino": "0x1000000028f", "tid": 183 }, { "created_ino": "0x10000000290", "tid": 184 }, { "created_ino": "0x10000000291", "tid": 185 }, { "created_ino": "0x10000000292", "tid": 186 }, { "created_ino": "0x10000000293", "tid": 187 }, { "created_ino": "0x10000000294", "tid": 188 }, { "created_ino": "0x10000000295", "tid": 189 }, { "created_ino": "0x10000000296", "tid": 190 }, { "created_ino": "0x10000000297", "tid": 191 }, { "created_ino": "0x10000000298", "tid": 192 }, { "created_ino": "0x10000000299", "tid": 193 }, { "created_ino": "0x1000000029a", "tid": 194 }, { "created_ino": "0x1000000029b", "tid": 195 }, { "created_ino": "0x1000000029c", "tid": 196 }, { "created_ino": "0x1000000029d", "tid": 197 }, { "created_ino": "0x1000000029e", "tid": 198 }, { "created_ino": "0x1000000029f", "tid": 199 }, { "created_ino": "0x100000002a0", "tid": 200 }, { "created_ino": "0x100000002a1", "tid": 201 }, { "created_ino": "0x100000002a2", "tid": 202 }, { "created_ino": "0x100000002a3", "tid": 203 }, { "created_ino": "0x100000002a4", "tid": 204 }, { "created_ino": "0x100000002a5", "tid": 205 }, { "created_ino": "0x100000002a6", "tid": 206 }, { "created_ino": "0x100000002a7", "tid": 207 }, { "created_ino": "0x100000002a8", "tid": 208 }, { "created_ino": "0x100000002a9", "tid": 209 }, { "created_ino": "0x100000002aa", "tid": 210 }, { "created_ino": "0x100000002ab", "tid": 211 }, { "created_ino": "0x100000002ac", "tid": 212 }, { "created_ino": "0x100000002ad", "tid": 213 }, { "created_ino": "0x100000002ae", "tid": 214 }, { "created_ino": "0x100000002af", "tid": 215 }, { "created_ino": "0x100000002b0", "tid": 216 }, { "created_ino": "0x100000002b1", "tid": 217 }, { "created_ino": "0x100000002b2", "tid": 218 }, { "created_ino": "0x100000002b3", "tid": 219 }, { "created_ino": "0x100000002b4", "tid": 220 }, { "created_ino": "0x100000002b5", "tid": 221 }, { "created_ino": "0x100000002b6", "tid": 222 }, { "created_ino": "0x100000002b7", "tid": 223 }, { "created_ino": "0x100000002b8", "tid": 224 }, { "created_ino": "0x100000002b9", "tid": 225 }, { "created_ino": "0x100000002ba", "tid": 226 }, { "created_ino": "0x100000002bb", "tid": 227 }, { "created_ino": "0x100000002bc", "tid": 228 }, { "created_ino": "0x100000002bd", "tid": 229 }, { "created_ino": "0x100000002be", "tid": 230 }, { "created_ino": "0x100000002bf", "tid": 231 }, { "created_ino": "0x100000002c0", "tid": 232 }, { "created_ino": "0x100000002c1", "tid": 233 }, { "created_ino": "0x100000002c2", "tid": 234 }, { "created_ino": "0x100000002c3", "tid": 235 }, { "created_ino": "0x100000002c4", "tid": 236 }, { "created_ino": "0x100000002c5", "tid": 237 }, { "created_ino": "0x100000002c6", "tid": 238 }, { "created_ino": "0x100000002c7", "tid": 239 }, { "created_ino": "0x100000002c8", "tid": 240 }, { "created_ino": "0x100000002c9", "tid": 241 }, { "created_ino": "0x100000002ca", "tid": 242 }, { "created_ino": "0x100000002cb", "tid": 243 }, { "created_ino": "0x100000002cc", "tid": 244 }, { "created_ino": "0x100000002cd", "tid": 245 }, { "created_ino": "0x100000002ce", "tid": 246 }, { "created_ino": "0x100000002cf", "tid": 247 }, { "created_ino": "0x100000002d0", "tid": 248 }, { "created_ino": "0x100000002d1", "tid": 249 }, { "created_ino": "0x100000002d2", "tid": 250 }, { "created_ino": "0x100000002d3", "tid": 251 }, { "created_ino": "0x100000002d4", "tid": 252 }, { "created_ino": "0x100000002d5", "tid": 253 }, { "created_ino": "0x100000002d6", "tid": 254 }, { "created_ino": "0x100000002d7", "tid": 255 }, { "created_ino": "0x100000002d8", "tid": 256 }, { "created_ino": "0x100000002d9", "tid": 257 }, { "created_ino": "0x100000002da", "tid": 258 }, { "created_ino": "0x100000002db", "tid": 259 }, { "created_ino": "0x100000002dc", "tid": 260 }, { "created_ino": "0x100000002dd", "tid": 261 }, { "created_ino": "0x100000002de", "tid": 262 }, { "created_ino": "0x100000002df", "tid": 263 }, { "created_ino": "0x100000002e0", "tid": 264 }, { "created_ino": "0x100000002e1", "tid": 265 }, { "created_ino": "0x100000002e2", "tid": 266 }, { "created_ino": "0x100000002e3", "tid": 267 }, { "created_ino": "0x100000002e4", "tid": 268 }, { "created_ino": "0x100000002e5", "tid": 269 }, { "created_ino": "0x100000002e6", "tid": 270 }, { "created_ino": "0x100000002e7", "tid": 271 }, { "created_ino": "0x100000002e8", "tid": 272 }, { "created_ino": "0x100000002e9", "tid": 273 }, { "created_ino": "0x100000002ea", "tid": 274 }, { "created_ino": "0x100000002eb", "tid": 275 }, { "created_ino": "0x100000002ec", "tid": 276 }, { "created_ino": "0x100000002ed", "tid": 277 }, { "created_ino": "0x100000002ee", "tid": 278 }, { "created_ino": "0x100000002ef", "tid": 279 }, { "created_ino": "0x100000002f0", "tid": 280 }, { "created_ino": "0x100000002f1", "tid": 281 }, { "created_ino": "0x100000002f2", "tid": 282 }, { "created_ino": "0x100000002f3", "tid": 283 }, { "created_ino": "0x100000002f4", "tid": 284 }, { "created_ino": "0x100000002f5", "tid": 285 }, { "created_ino": "0x100000002f6", "tid": 286 }, { "created_ino": "0x100000002f7", "tid": 287 }, { "created_ino": "0x100000002f8", "tid": 288 }, { "created_ino": "0x100000002f9", "tid": 289 }, { "created_ino": "0x100000002fa", "tid": 290 }, { "created_ino": "0x100000002fb", "tid": 291 }, { "created_ino": "0x100000002fc", "tid": 292 }, { "created_ino": "0x100000002fd", "tid": 293 }, { "created_ino": "0x100000002fe", "tid": 294 }, { "created_ino": "0x100000002ff", "tid": 295 }, { "created_ino": "0x10000000300", "tid": 296 }, { "created_ino": "0x10000000301", "tid": 297 }, { "created_ino": "0x10000000302", "tid": 298 }, { "created_ino": "0x10000000303", "tid": 299 }, { "created_ino": "0x10000000304", "tid": 300 }, { "created_ino": "0x10000000305", "tid": 301 }, { "created_ino": "0x10000000306", "tid": 302 }, { "created_ino": "0x10000000307", "tid": 303 }, { "created_ino": "0x10000000308", "tid": 304 }, { "created_ino": "0x10000000309", "tid": 305 }, { "created_ino": "0x1000000030a", "tid": 306 }, { "created_ino": "0x1000000030b", "tid": 307 }, { "created_ino": "0x1000000030c", "tid": 308 }, { "created_ino": "0x1000000030d", "tid": 309 }, { "created_ino": "0x1000000030e", "tid": 310 }, { "created_ino": "0x1000000030f", "tid": 311 }, { "created_ino": "0x10000000310", "tid": 312 }, { "created_ino": "0x10000000311", "tid": 313 }, { "created_ino": "0x10000000312", "tid": 314 }, { "created_ino": "0x10000000313", "tid": 315 }, { "created_ino": "0x10000000314", "tid": 316 }, { "created_ino": "0x10000000315", "tid": 317 }, { "created_ino": "0x10000000316", "tid": 318 }, { "created_ino": "0x10000000317", "tid": 319 }, { "created_ino": "0x10000000318", "tid": 320 }, { "created_ino": "0x10000000319", "tid": 321 }, { "created_ino": "0x1000000031a", "tid": 322 }, { "created_ino": "0x1000000031b", "tid": 323 }, { "created_ino": "0x1000000031c", "tid": 324 }, { "created_ino": "0x1000000031d", "tid": 325 }, { "created_ino": "0x1000000031e", "tid": 326 }, { "created_ino": "0x1000000031f", "tid": 327 }, { "created_ino": "0x10000000320", "tid": 328 }, { "created_ino": "0x10000000321", "tid": 329 }, { "created_ino": "0x10000000322", "tid": 330 }, { "created_ino": "0x10000000323", "tid": 331 }, { "created_ino": "0x10000000324", "tid": 332 }, { "created_ino": "0x10000000325", "tid": 333 }, { "created_ino": "0x10000000326", "tid": 334 }, { "created_ino": "0x10000000327", "tid": 335 }, { "created_ino": "0x10000000328", "tid": 336 }, { "created_ino": "0x10000000329", "tid": 337 }, { "created_ino": "0x1000000032a", "tid": 338 }, { "created_ino": "0x1000000032b", "tid": 339 }, { "created_ino": "0x1000000032c", "tid": 340 }, { "created_ino": "0x1000000032d", "tid": 341 }, { "created_ino": "0x1000000032e", "tid": 342 }, { "created_ino": "0x1000000032f", "tid": 343 }, { "created_ino": "0x10000000330", "tid": 344 }, { "created_ino": "0x10000000331", "tid": 345 }, { "created_ino": "0x10000000332", "tid": 346 }, { "created_ino": "0x10000000333", "tid": 347 }, { "created_ino": "0x10000000334", "tid": 348 }, { "created_ino": "0x10000000335", "tid": 349 }, { "created_ino": "0x10000000336", "tid": 350 }, { "created_ino": "0x10000000337", "tid": 351 }, { "created_ino": "0x10000000338", "tid": 352 }, { "created_ino": "0x10000000339", "tid": 353 }, { "created_ino": "0x1000000033a", "tid": 354 }, { "created_ino": "0x1000000033b", "tid": 355 }, { "created_ino": "0x1000000033c", "tid": 356 }, { "created_ino": "0x1000000033d", "tid": 357 }, { "created_ino": "0x1000000033e", "tid": 358 }, { "created_ino": "0x1000000033f", "tid": 359 }, { "created_ino": "0x10000000340", "tid": 360 }, { "created_ino": "0x10000000341", "tid": 361 }, { "created_ino": "0x10000000342", "tid": 362 }, { "created_ino": "0x10000000343", "tid": 363 }, { "created_ino": "0x10000000344", "tid": 364 }, { "created_ino": "0x10000000345", "tid": 365 }, { "created_ino": "0x10000000346", "tid": 366 }, { "created_ino": "0x10000000347", "tid": 367 }, { "created_ino": "0x10000000348", "tid": 368 }, { "created_ino": "0x10000000349", "tid": 369 }, { "created_ino": "0x1000000034a", "tid": 370 }, { "created_ino": "0x1000000034b", "tid": 371 }, { "created_ino": "0x1000000034c", "tid": 372 }, { "created_ino": "0x1000000034d", "tid": 373 }, { "created_ino": "0x1000000034e", "tid": 374 }, { "created_ino": "0x1000000034f", "tid": 375 }, { "created_ino": "0x10000000350", "tid": 376 }, { "created_ino": "0x10000000351", "tid": 377 }, { "created_ino": "0x10000000352", "tid": 378 }, { "created_ino": "0x10000000353", "tid": 379 }, { "created_ino": "0x10000000354", "tid": 380 }, { "created_ino": "0x10000000355", "tid": 381 }, { "created_ino": "0x10000000356", "tid": 382 }, { "created_ino": "0x10000000357", "tid": 383 }, { "created_ino": "0x10000000358", "tid": 384 }, { "created_ino": "0x10000000359", "tid": 385 }, { "created_ino": "0x1000000035a", "tid": 386 }, { "created_ino": "0x1000000035b", "tid": 387 }, { "created_ino": "0x1000000035c", "tid": 388 }, { "created_ino": "0x1000000035d", "tid": 389 }, { "created_ino": "0x1000000035e", "tid": 390 }, { "created_ino": "0x1000000035f", "tid": 391 }, { "created_ino": "0x10000000360", "tid": 392 }, { "created_ino": "0x10000000361", "tid": 393 }, { "created_ino": "0x10000000362", "tid": 394 }, { "created_ino": "0x10000000363", "tid": 395 }, { "created_ino": "0x10000000364", "tid": 396 }, { "created_ino": "0x10000000365", "tid": 397 }, { "created_ino": "0x10000000366", "tid": 398 }, { "created_ino": "0x10000000367", "tid": 399 }, { "created_ino": "0x10000000368", "tid": 400 }, { "created_ino": "0x10000000369", "tid": 401 }, { "created_ino": "0x1000000036a", "tid": 402 }, { "created_ino": "0x1000000036b", "tid": 403 }, { "created_ino": "0x1000000036c", "tid": 404 }, { "created_ino": "0x1000000036d", "tid": 405 }, { "created_ino": "0x1000000036e", "tid": 406 }, { "created_ino": "0x1000000036f", "tid": 407 }, { "created_ino": "0x10000000370", "tid": 408 }, { "created_ino": "0x10000000371", "tid": 409 }, { "created_ino": "0x10000000372", "tid": 410 }, { "created_ino": "0x10000000373", "tid": 411 }, { "created_ino": "0x10000000374", "tid": 412 }, { "created_ino": "0x10000000375", "tid": 413 }, { "created_ino": "0x10000000376", "tid": 414 }, { "created_ino": "0x10000000377", "tid": 415 }, { "created_ino": "0x10000000378", "tid": 416 }, { "created_ino": "0x10000000379", "tid": 417 }, { "created_ino": "0x1000000037a", "tid": 418 }, { "created_ino": "0x1000000037b", "tid": 419 }, { "created_ino": "0x1000000037c", "tid": 420 }, { "created_ino": "0x1000000037d", "tid": 421 }, { "created_ino": "0x1000000037e", "tid": 422 }, { "created_ino": "0x1000000037f", "tid": 423 }, { "created_ino": "0x10000000380", "tid": 424 }, { "created_ino": "0x10000000381", "tid": 425 }, { "created_ino": "0x10000000382", "tid": 426 }, { "created_ino": "0x10000000383", "tid": 427 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.6:0", "nonce": 1252216099, "type": "any" }, "name": { "num": 7400, "type": "client" } }, "id": 7400, "inst": "client.7400 172.21.15.6:0/1252216099", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 201, "num_completed_flushes": 0, "num_completed_requests": 399, "num_leases": 400, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 603, "start": "0x10000000384" } ], "recall_caps": { "halflife": 60, "value": 1510.2638664466913 }, "recall_caps_throttle": { "halflife": 1.5, "value": 418.5509641633769 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 129.99162547357182 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 198.90599480380905 }, "request_load_avg": 385, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1178.0559731402318 }, "state": "open", "uptime": 12.725854326 } ] 2024-05-20T18:02:31.674 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-20T18:02:31.674 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:02:31.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:02:31.719 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:02:31.763 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:02:31.763 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:02:31.763 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 400\nabs_path = "/home/ubuntu/cephtest/mnt.0/."\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi006') 2024-05-20T18:02:31.763 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:31.763 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:31.779 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:31.780 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:31.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:31.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.992+0000 7faf85251640 1 Processor -- start 2024-05-20T18:02:31.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.992+0000 7faf85251640 1 -- start start 2024-05-20T18:02:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.993+0000 7faf85251640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faf8006d3d0 0x7faf8006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.993+0000 7faf85251640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf800b8190 0x7faf800b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf85251640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8006dd20 con 0x7faf80162820 2024-05-20T18:02:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf85251640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7faf800d0630 con 0x7faf800b8190 2024-05-20T18:02:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf85251640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7faf800d39c0 con 0x7faf8006d3d0 2024-05-20T18:02:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7f59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf800b8190 0x7faf800b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faf80162820 0x7faf800b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47826/0 (socket says 172.21.15.6:47826) 2024-05-20T18:02:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7ed9d640 1 -- 172.21.15.6:0/3794624895 learned_addr learned my addr 172.21.15.6:0/3794624895 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7e59c640 1 --2- 172.21.15.6:0/3794624895 >> v2:172.21.15.171:3300/0 conn(0x7faf8006d3d0 0x7faf8006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7f59e640 1 -- 172.21.15.6:0/3794624895 >> v2:172.21.15.171:3300/0 conn(0x7faf8006d3d0 msgr2=0x7faf8006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7f59e640 1 --2- 172.21.15.6:0/3794624895 >> v2:172.21.15.171:3300/0 conn(0x7faf8006d3d0 0x7faf8006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7f59e640 1 -- 172.21.15.6:0/3794624895 >> v1:172.21.15.6:6789/0 conn(0x7faf80162820 legacy=0x7faf800b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7f59e640 1 -- 172.21.15.6:0/3794624895 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf800d3ca0 con 0x7faf800b8190 2024-05-20T18:02:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.994+0000 7faf7dd9b640 1 -- 172.21.15.6:0/3794624895 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646903491 0 0) 0x7faf70001110 con 0x7faf80162820 2024-05-20T18:02:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.995+0000 7faf7f59e640 1 --2- 172.21.15.6:0/3794624895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf800b85a0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7faf800d1230 tx=0x7faf7802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d83689b2684e3e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.995+0000 7faf7dd9b640 1 -- 172.21.15.6:0/3794624895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78007740 con 0x7faf800b8190 2024-05-20T18:02:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.995+0000 7faf7dd9b640 1 -- 172.21.15.6:0/3794624895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf780078e0 con 0x7faf800b8190 2024-05-20T18:02:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.995+0000 7faf7dd9b640 1 -- 172.21.15.6:0/3794624895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf78007cb0 con 0x7faf800b8190 2024-05-20T18:02:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.996+0000 7faf85251640 1 -- 172.21.15.6:0/3794624895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 msgr2=0x7faf800b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.996+0000 7faf85251640 1 --2- 172.21.15.6:0/3794624895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf800b85a0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7faf800d1230 tx=0x7faf7802a680 comp rx=0 tx=0).stop 2024-05-20T18:02:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.996+0000 7faf85251640 1 -- 172.21.15.6:0/3794624895 shutdown_connections 2024-05-20T18:02:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.996+0000 7faf85251640 1 --2- 172.21.15.6:0/3794624895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf800b85a0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.996+0000 7faf85251640 1 --2- 172.21.15.6:0/3794624895 >> v2:172.21.15.171:3300/0 conn(0x7faf8006d3d0 0x7faf8006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.996+0000 7faf85251640 1 -- 172.21.15.6:0/3794624895 >> 172.21.15.6:0/3794624895 conn(0x7faf800d4bd0 msgr2=0x7faf800d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.996+0000 7faf85251640 1 -- 172.21.15.6:0/3794624895 shutdown_connections 2024-05-20T18:02:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.996+0000 7faf85251640 1 -- 172.21.15.6:0/3794624895 wait complete. 2024-05-20T18:02:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.998+0000 7faf85251640 1 Processor -- start 2024-05-20T18:02:31.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.998+0000 7faf85251640 1 -- start start 2024-05-20T18:02:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf85251640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf8006d3d0 0x7faf8015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf85251640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf80157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf85251640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf80162820 0x7faf80149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf85251640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faf800d0300 con 0x7faf800b8190 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf85251640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faf800d4260 con 0x7faf8006d3d0 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf85251640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faf800b4050 con 0x7faf80162820 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf7e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf80157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf7e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf80157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43744/0 (socket says 172.21.15.6:43744) 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf7e59c640 1 -- 172.21.15.6:0/228775462 learned_addr learned my addr 172.21.15.6:0/228775462 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:31.999+0000 7faf7ed9d640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf8006d3d0 0x7faf8015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf7f59e640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf80162820 0x7faf80149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf7e59c640 1 -- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf80162820 msgr2=0x7faf80149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf7e59c640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf80162820 0x7faf80149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf7e59c640 1 -- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf8006d3d0 msgr2=0x7faf8015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf7e59c640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf8006d3d0 0x7faf8015a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf7e59c640 1 -- 172.21.15.6:0/228775462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8015ae30 con 0x7faf800b8190 2024-05-20T18:02:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf7f59e640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf80162820 0x7faf80149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf7e59c640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf80157df0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7faf7400d620 tx=0x7faf7400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf677fe640 1 -- 172.21.15.6:0/228775462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7400b620 con 0x7faf800b8190 2024-05-20T18:02:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf677fe640 1 -- 172.21.15.6:0/228775462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf74019070 con 0x7faf800b8190 2024-05-20T18:02:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf80148a00 con 0x7faf800b8190 2024-05-20T18:02:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf677fe640 1 -- 172.21.15.6:0/228775462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7400ba00 con 0x7faf800b8190 2024-05-20T18:02:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.000+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf80148fc0 con 0x7faf800b8190 2024-05-20T18:02:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.001+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf80075b00 con 0x7faf800b8190 2024-05-20T18:02:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.002+0000 7faf677fe640 1 -- 172.21.15.6:0/228775462 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf7400bba0 con 0x7faf800b8190 2024-05-20T18:02:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.002+0000 7faf677fe640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf6c06be30 0x7faf6c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.002+0000 7faf677fe640 1 -- 172.21.15.6:0/228775462 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7faf7408b3b0 con 0x7faf800b8190 2024-05-20T18:02:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.003+0000 7faf7ed9d640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf6c06be30 0x7faf6c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.003+0000 7faf7ed9d640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf6c06be30 0x7faf6c06e340 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7faf70007fd0 tx=0x7faf70007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.007+0000 7faf677fe640 1 -- 172.21.15.6:0/228775462 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faf74059b30 con 0x7faf800b8190 2024-05-20T18:02:32.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.194+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf80148790 con 0x7faf800b8190 2024-05-20T18:02:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.195+0000 7faf677fe640 1 -- 172.21.15.6:0/228775462 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16844 (secure 0 0 0) 0x7faf74059430 con 0x7faf800b8190 2024-05-20T18:02:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:32.193 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":137,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:13.150220+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:09.651858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:10.498810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf6c06be30 msgr2=0x7faf6c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf6c06be30 0x7faf6c06e340 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7faf70007fd0 tx=0x7faf70007de0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 msgr2=0x7faf80157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf80157df0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7faf7400d620 tx=0x7faf7400dae0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 shutdown_connections 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7faf6c06be30 0x7faf6c06e340 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faf80162820 0x7faf80149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf800b8190 0x7faf80157df0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 --2- 172.21.15.6:0/228775462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf8006d3d0 0x7faf8015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 >> 172.21.15.6:0/228775462 conn(0x7faf800d4bd0 msgr2=0x7faf8015d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 shutdown_connections 2024-05-20T18:02:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.197+0000 7faf85251640 1 -- 172.21.15.6:0/228775462 wait complete. 2024-05-20T18:02:32.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:02:09.651858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:02:10.498810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:02:32.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:02:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.327+0000 7fbdc00ca640 1 Processor -- start 2024-05-20T18:02:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.327+0000 7fbdc00ca640 1 -- start start 2024-05-20T18:02:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.328+0000 7fbdc00ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdb8162820 0x7fbdb80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.328+0000 7fbdc00ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 0x7fbdb806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.328+0000 7fbdc00ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb806dd20 con 0x7fbdb806d910 2024-05-20T18:02:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.328+0000 7fbdc00ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb80d0630 con 0x7fbdb8162820 2024-05-20T18:02:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.328+0000 7fbdc00ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb80d39c0 con 0x7fbdb80b3e80 2024-05-20T18:02:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.329+0000 7fbdbde66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdb8162820 0x7fbdb80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.329+0000 7fbdbde66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdb8162820 0x7fbdb80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43756/0 (socket says 172.21.15.6:43756) 2024-05-20T18:02:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.329+0000 7fbdbde66640 1 -- 172.21.15.6:0/3576212584 learned_addr learned my addr 172.21.15.6:0/3576212584 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.329+0000 7fbdbd665640 1 --2- 172.21.15.6:0/3576212584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 0x7fbdb806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.329+0000 7fbdbde66640 1 -- 172.21.15.6:0/3576212584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 msgr2=0x7fbdb806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.329+0000 7fbdbde66640 1 --2- 172.21.15.6:0/3576212584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 0x7fbdb806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.329+0000 7fbdbde66640 1 -- 172.21.15.6:0/3576212584 >> v1:172.21.15.171:6789/0 conn(0x7fbdb806d910 legacy=0x7fbdb80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.329+0000 7fbdbde66640 1 -- 172.21.15.6:0/3576212584 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb80d3ca0 con 0x7fbdb8162820 2024-05-20T18:02:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.330+0000 7fbdbde66640 1 --2- 172.21.15.6:0/3576212584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb8162820 0x7fbdb80b3940 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009870 tx=0x7fbdb402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8879b1b0b91d060d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.330+0000 7fbdbce64640 1 -- 172.21.15.6:0/3576212584 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4037070 con 0x7fbdb8162820 2024-05-20T18:02:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.330+0000 7fbdbce64640 1 -- 172.21.15.6:0/3576212584 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb4032440 con 0x7fbdb8162820 2024-05-20T18:02:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.330+0000 7fbdbce64640 1 -- 172.21.15.6:0/3576212584 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4032810 con 0x7fbdb8162820 2024-05-20T18:02:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.330+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3576212584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb8162820 msgr2=0x7fbdb80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.330+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3576212584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb8162820 0x7fbdb80b3940 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009870 tx=0x7fbdb402a210 comp rx=0 tx=0).stop 2024-05-20T18:02:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.331+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3576212584 shutdown_connections 2024-05-20T18:02:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.331+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3576212584 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 0x7fbdb806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.331+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3576212584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb8162820 0x7fbdb80b3940 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.331+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3576212584 >> 172.21.15.6:0/3576212584 conn(0x7fbdb80d4bd0 msgr2=0x7fbdb80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.331+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3576212584 shutdown_connections 2024-05-20T18:02:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.331+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3576212584 wait complete. 2024-05-20T18:02:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.332+0000 7fbdc00ca640 1 Processor -- start 2024-05-20T18:02:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.332+0000 7fbdc00ca640 1 -- start start 2024-05-20T18:02:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdc00ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb806d910 0x7fbdb80ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdc00ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 0x7fbdb8148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdc00ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdb8162820 0x7fbdb8149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdc00ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80d0300 con 0x7fbdb806d910 2024-05-20T18:02:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdc00ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80d4260 con 0x7fbdb8162820 2024-05-20T18:02:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdc00ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb80b91a0 con 0x7fbdb80b3e80 2024-05-20T18:02:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb806d910 0x7fbdb80ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb806d910 0x7fbdb80ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43760/0 (socket says 172.21.15.6:43760) 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 -- 172.21.15.6:0/3611138011 learned_addr learned my addr 172.21.15.6:0/3611138011 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbd665640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 0x7fbdb8148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbe667640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdb8162820 0x7fbdb8149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 -- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 msgr2=0x7fbdb8148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 0x7fbdb8148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 -- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdb8162820 msgr2=0x7fbdb8149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdb8162820 0x7fbdb8149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 -- 172.21.15.6:0/3611138011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb81470c0 con 0x7fbdb806d910 2024-05-20T18:02:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbe667640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdb8162820 0x7fbdb8149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.334+0000 7fbdbde66640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb806d910 0x7fbdb80ced80 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4000c00 tx=0x7fbdb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.335+0000 7fbdae7fc640 1 -- 172.21.15.6:0/3611138011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4041020 con 0x7fbdb806d910 2024-05-20T18:02:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.335+0000 7fbdae7fc640 1 -- 172.21.15.6:0/3611138011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb40306c0 con 0x7fbdb806d910 2024-05-20T18:02:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.335+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb81473a0 con 0x7fbdb806d910 2024-05-20T18:02:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.335+0000 7fbdae7fc640 1 -- 172.21.15.6:0/3611138011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4037040 con 0x7fbdb806d910 2024-05-20T18:02:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.335+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb8147960 con 0x7fbdb806d910 2024-05-20T18:02:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.336+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb8075b00 con 0x7fbdb806d910 2024-05-20T18:02:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.336+0000 7fbdae7fc640 1 -- 172.21.15.6:0/3611138011 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdb4044020 con 0x7fbdb806d910 2024-05-20T18:02:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.337+0000 7fbdae7fc640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd9c06be30 0x7fbd9c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.337+0000 7fbdae7fc640 1 -- 172.21.15.6:0/3611138011 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fbdb40ab830 con 0x7fbdb806d910 2024-05-20T18:02:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.337+0000 7fbdbd665640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd9c06be30 0x7fbd9c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.338+0000 7fbdbd665640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd9c06be30 0x7fbd9c06e340 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbdb81eaf50 tx=0x7fbda8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.342+0000 7fbdae7fc640 1 -- 172.21.15.6:0/3611138011 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbdb404b030 con 0x7fbdb806d910 2024-05-20T18:02:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.525+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbdb80d51f0 con 0x7fbdb806d910 2024-05-20T18:02:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.526+0000 7fbdae7fc640 1 -- 172.21.15.6:0/3611138011 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) ==== 93+0+10 (secure 0 0 0) 0x7fbdb806dd20 con 0x7fbdb806d910 2024-05-20T18:02:32.524 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.527+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd9c06be30 msgr2=0x7fbd9c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.527+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd9c06be30 0x7fbd9c06e340 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbdb81eaf50 tx=0x7fbda8008040 comp rx=0 tx=0).stop 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.527+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb806d910 msgr2=0x7fbdb80ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.527+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb806d910 0x7fbdb80ced80 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4000c00 tx=0x7fbdb40046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.528+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 shutdown_connections 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.528+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd9c06be30 0x7fbd9c06e340 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.528+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbdb8162820 0x7fbdb8149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.528+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbdb80b3e80 0x7fbdb8148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.528+0000 7fbdc00ca640 1 --2- 172.21.15.6:0/3611138011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdb806d910 0x7fbdb80ced80 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.528+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 >> 172.21.15.6:0/3611138011 conn(0x7fbdb80d4bd0 msgr2=0x7fbdb80b9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.528+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 shutdown_connections 2024-05-20T18:02:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.528+0000 7fbdc00ca640 1 -- 172.21.15.6:0/3611138011 wait complete. 2024-05-20T18:02:32.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:02:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.656+0000 7f3edd2de640 1 Processor -- start 2024-05-20T18:02:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.656+0000 7f3edd2de640 1 -- start start 2024-05-20T18:02:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.657+0000 7f3edd2de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed8162820 0x7f3ed80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.657+0000 7f3edd2de640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3ed80b3e80 0x7f3ed806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3edd2de640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed806dd20 con 0x7f3ed806d910 2024-05-20T18:02:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3edd2de640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed80d0630 con 0x7f3ed80b3e80 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3edd2de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed80d39c0 con 0x7f3ed8162820 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3ed806d910 0x7f3ed80d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47830/0 (socket says 172.21.15.6:47830) 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed77fe640 1 -- 172.21.15.6:0/2967481597 learned_addr learned my addr 172.21.15.6:0/2967481597 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed67fc640 1 --2- 172.21.15.6:0/2967481597 >> v2:172.21.15.171:3300/0 conn(0x7f3ed80b3e80 0x7f3ed806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed6ffd640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed8162820 0x7f3ed80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708002080 0 0) 0x7f3ed0001110 con 0x7f3ed806d910 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec0003520 con 0x7f3ed806d910 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3537394023 0 0) 0x7f3ec0003520 con 0x7f3ed806d910 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed8162820 msgr2=0x7f3ed80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed8162820 0x7f3ed80b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 >> v2:172.21.15.171:3300/0 conn(0x7f3ed80b3e80 msgr2=0x7f3ed806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 --2- 172.21.15.6:0/2967481597 >> v2:172.21.15.171:3300/0 conn(0x7f3ed80b3e80 0x7f3ed806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed80d3ca0 con 0x7f3ed806d910 2024-05-20T18:02:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f3ed0001840 con 0x7f3ed806d910 2024-05-20T18:02:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 >> v1:172.21.15.6:6789/0 conn(0x7f3ed806d910 legacy=0x7f3ed80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed8162820 0x7f3ec00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ec0003f30 0x7f3ec0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ec0004d40 0x7f3ec0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed80d0630 con 0x7f3ec0004d40 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed80d39c0 con 0x7f3ec0003f30 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.658+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec000ba10 con 0x7f3ed8162820 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.659+0000 7f3ed77fe640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ec0004d40 0x7f3ec0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.659+0000 7f3ed67fc640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ec0003f30 0x7f3ec0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.659+0000 7f3ed6ffd640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed8162820 0x7f3ec00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.659+0000 7f3ed77fe640 1 -- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed8162820 msgr2=0x7f3ec00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.659+0000 7f3ed77fe640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed8162820 0x7f3ec00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.659+0000 7f3ed77fe640 1 -- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ec0003f30 msgr2=0x7f3ec0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.659+0000 7f3ed77fe640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ec0003f30 0x7f3ec0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.659+0000 7f3ed77fe640 1 -- 172.21.15.6:0/2967481597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec0003520 con 0x7f3ec0004d40 2024-05-20T18:02:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3ed77fe640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ec0004d40 0x7f3ec0005150 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c490 tx=0x7f3ec0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0da2b8da35db82e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000c0e0 con 0x7f3ec0004d40 2024-05-20T18:02:32.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0034070 con 0x7f3ec0004d40 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3ed5ffb640 1 -- 172.21.15.6:0/2967481597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0005d70 con 0x7f3ec0004d40 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3edd2de640 1 -- 172.21.15.6:0/2967481597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ec0004d40 msgr2=0x7f3ec0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3edd2de640 1 --2- 172.21.15.6:0/2967481597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ec0004d40 0x7f3ec0005150 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c490 tx=0x7f3ec0005830 comp rx=0 tx=0).stop 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3ed77fe640 1 -- 172.21.15.6:0/2967481597 reap_dead start 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3edd2de640 1 -- 172.21.15.6:0/2967481597 shutdown_connections 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3edd2de640 1 -- 172.21.15.6:0/2967481597 >> 172.21.15.6:0/2967481597 conn(0x7f3ed80d4bd0 msgr2=0x7f3ed80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.660+0000 7f3edd2de640 1 -- 172.21.15.6:0/2967481597 shutdown_connections 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.661+0000 7f3edd2de640 1 -- 172.21.15.6:0/2967481597 wait complete. 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.662+0000 7f3edd2de640 1 Processor -- start 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.663+0000 7f3edd2de640 1 -- start start 2024-05-20T18:02:32.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3edd2de640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed814af40 0x7f3ed80cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3edd2de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed80ce360 0x7f3ed814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3edd2de640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ed814e000 0x7f3ed80c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3edd2de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed80d0300 con 0x7f3ed80ce360 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3edd2de640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed80d4260 con 0x7f3ed814e000 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3edd2de640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed80b91a0 con 0x7f3ed814af40 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed80ce360 0x7f3ed814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed80ce360 0x7f3ed814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43766/0 (socket says 172.21.15.6:43766) 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 -- 172.21.15.6:0/4094908491 learned_addr learned my addr 172.21.15.6:0/4094908491 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed6ffd640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed814af40 0x7f3ed80cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed77fe640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ed814e000 0x7f3ed80c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 -- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed814af40 msgr2=0x7f3ed80cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed814af40 0x7f3ed80cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 -- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ed814e000 msgr2=0x7f3ed80c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ed814e000 0x7f3ed80c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 -- 172.21.15.6:0/4094908491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed80ce770 con 0x7f3ed80ce360 2024-05-20T18:02:32.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed77fe640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ed814e000 0x7f3ed80c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:32.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.664+0000 7f3ed67fc640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed80ce360 0x7f3ed814dac0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc011980 tx=0x7f3ecc011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.665+0000 7f3ebf7fe640 1 -- 172.21.15.6:0/4094908491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc019070 con 0x7f3ed80ce360 2024-05-20T18:02:32.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.665+0000 7f3ebf7fe640 1 -- 172.21.15.6:0/4094908491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc004240 con 0x7f3ed80ce360 2024-05-20T18:02:32.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.665+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed81f98d0 con 0x7f3ed80ce360 2024-05-20T18:02:32.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.665+0000 7f3ebf7fe640 1 -- 172.21.15.6:0/4094908491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00f8e0 con 0x7f3ed80ce360 2024-05-20T18:02:32.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.665+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed81f8df0 con 0x7f3ed80ce360 2024-05-20T18:02:32.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.666+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed8161a50 con 0x7f3ed80ce360 2024-05-20T18:02:32.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.667+0000 7f3ebf7fe640 1 -- 172.21.15.6:0/4094908491 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ecc01c070 con 0x7f3ed80ce360 2024-05-20T18:02:32.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.667+0000 7f3ebf7fe640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ec406be60 0x7f3ec406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.667+0000 7f3ebf7fe640 1 -- 172.21.15.6:0/4094908491 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f3ecc08b380 con 0x7f3ed80ce360 2024-05-20T18:02:32.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.667+0000 7f3ed6ffd640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ec406be60 0x7f3ec406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.668+0000 7f3ed6ffd640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ec406be60 0x7f3ec406e370 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80ba590 tx=0x7f3ec800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.672+0000 7f3ebf7fe640 1 -- 172.21.15.6:0/4094908491 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3ed8161a50 con 0x7f3ed80ce360 2024-05-20T18:02:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.855+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3ed80ba5c0 con 0x7f3ed80ce360 2024-05-20T18:02:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.855+0000 7f3ebf7fe640 1 -- 172.21.15.6:0/4094908491 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) ==== 104+0+11 (secure 0 0 0) 0x7f3ed80ce770 con 0x7f3ed80ce360 2024-05-20T18:02:32.853 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ec406be60 msgr2=0x7f3ec406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ec406be60 0x7f3ec406e370 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80ba590 tx=0x7f3ec800b040 comp rx=0 tx=0).stop 2024-05-20T18:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed80ce360 msgr2=0x7f3ed814dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed80ce360 0x7f3ed814dac0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc011980 tx=0x7f3ecc011e40 comp rx=0 tx=0).stop 2024-05-20T18:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 shutdown_connections 2024-05-20T18:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f3ec406be60 0x7f3ec406e370 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ed814e000 0x7f3ed80c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed80ce360 0x7f3ed814dac0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 --2- 172.21.15.6:0/4094908491 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3ed814af40 0x7f3ed80cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 >> 172.21.15.6:0/4094908491 conn(0x7f3ed80d4bd0 msgr2=0x7f3ed8160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 shutdown_connections 2024-05-20T18:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.857+0000 7f3edd2de640 1 -- 172.21.15.6:0/4094908491 wait complete. 2024-05-20T18:02:32.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:02:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.986+0000 7f8c79f64640 1 Processor -- start 2024-05-20T18:02:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.986+0000 7f8c79f64640 1 -- start start 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c79f64640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740af330 0x7f8c740af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c79f64640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c740d1610 0x7f8c740d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c79f64640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8c740b1e50 0x7f8c740b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c79f64640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7406c840 con 0x7f8c740d1610 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c79f64640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8c740d20d0 con 0x7f8c740b1e50 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c79f64640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7406cae0 con 0x7f8c740af330 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c72ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c740d1610 0x7f8c740d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c72ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c740d1610 0x7f8c740d1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43770/0 (socket says 172.21.15.6:43770) 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.987+0000 7f8c72ffd640 1 -- 172.21.15.6:0/4184859859 learned_addr learned my addr 172.21.15.6:0/4184859859 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c737fe640 1 --2- 172.21.15.6:0/4184859859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740af330 0x7f8c740af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c73fff640 1 --2- 172.21.15.6:0/4184859859 >> v2:172.21.15.171:3300/0 conn(0x7f8c740b1e50 0x7f8c740b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c72ffd640 1 -- 172.21.15.6:0/4184859859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740af330 msgr2=0x7f8c740af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c72ffd640 1 --2- 172.21.15.6:0/4184859859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740af330 0x7f8c740af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c72ffd640 1 -- 172.21.15.6:0/4184859859 >> v2:172.21.15.171:3300/0 conn(0x7f8c740b1e50 msgr2=0x7f8c740b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c72ffd640 1 --2- 172.21.15.6:0/4184859859 >> v2:172.21.15.171:3300/0 conn(0x7f8c740b1e50 0x7f8c740b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c72ffd640 1 -- 172.21.15.6:0/4184859859 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7406cdc0 con 0x7f8c740d1610 2024-05-20T18:02:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c73fff640 1 --2- 172.21.15.6:0/4184859859 >> v2:172.21.15.171:3300/0 conn(0x7f8c740b1e50 0x7f8c740b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.988+0000 7f8c72ffd640 1 --2- 172.21.15.6:0/4184859859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740d1610 0x7f8c740d1a20 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f8c7409b610 tx=0x7f8c6802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae76d50dbd623e8c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c727fc640 1 -- 172.21.15.6:0/4184859859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c68037070 con 0x7f8c740d1610 2024-05-20T18:02:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c727fc640 1 -- 172.21.15.6:0/4184859859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c68032440 con 0x7f8c740d1610 2024-05-20T18:02:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c727fc640 1 -- 172.21.15.6:0/4184859859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c68032810 con 0x7f8c740d1610 2024-05-20T18:02:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 -- 172.21.15.6:0/4184859859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740d1610 msgr2=0x7f8c740d1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 --2- 172.21.15.6:0/4184859859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740d1610 0x7f8c740d1a20 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f8c7409b610 tx=0x7f8c6802a140 comp rx=0 tx=0).stop 2024-05-20T18:02:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 -- 172.21.15.6:0/4184859859 shutdown_connections 2024-05-20T18:02:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 --2- 172.21.15.6:0/4184859859 >> v2:172.21.15.171:3300/0 conn(0x7f8c740b1e50 0x7f8c740b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 --2- 172.21.15.6:0/4184859859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740d1610 0x7f8c740d1a20 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 --2- 172.21.15.6:0/4184859859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740af330 0x7f8c740af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 -- 172.21.15.6:0/4184859859 >> 172.21.15.6:0/4184859859 conn(0x7f8c740b6670 msgr2=0x7f8c740b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 -- 172.21.15.6:0/4184859859 shutdown_connections 2024-05-20T18:02:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.989+0000 7f8c79f64640 1 -- 172.21.15.6:0/4184859859 wait complete. 2024-05-20T18:02:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.991+0000 7f8c79f64640 1 Processor -- start 2024-05-20T18:02:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.991+0000 7f8c79f64640 1 -- start start 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c79f64640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740af330 0x7f8c741f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c79f64640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740b1e50 0x7f8c74153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c79f64640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c740d1610 0x7f8c740cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c79f64640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7415d350 con 0x7f8c740af330 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c79f64640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c740b27a0 con 0x7f8c740d1610 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c79f64640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c74159d30 con 0x7f8c740b1e50 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740af330 0x7f8c741f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740af330 0x7f8c741f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43786/0 (socket says 172.21.15.6:43786) 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 -- 172.21.15.6:0/3890207578 learned_addr learned my addr 172.21.15.6:0/3890207578 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c72ffd640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740b1e50 0x7f8c74153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c73fff640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c740d1610 0x7f8c740cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 -- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740b1e50 msgr2=0x7f8c74153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740b1e50 0x7f8c74153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 -- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c740d1610 msgr2=0x7f8c740cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c740d1610 0x7f8c740cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 -- 172.21.15.6:0/3890207578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c74154a00 con 0x7f8c740af330 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c73fff640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c740d1610 0x7f8c740cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.993+0000 7f8c737fe640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740af330 0x7f8c741f1fd0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400d5a0 tx=0x7f8c6400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.994+0000 7f8c5bfff640 1 -- 172.21.15.6:0/3890207578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64019070 con 0x7f8c740af330 2024-05-20T18:02:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.994+0000 7f8c5bfff640 1 -- 172.21.15.6:0/3890207578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c64004240 con 0x7f8c740af330 2024-05-20T18:02:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.994+0000 7f8c5bfff640 1 -- 172.21.15.6:0/3890207578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64003610 con 0x7f8c740af330 2024-05-20T18:02:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.994+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c74154ce0 con 0x7f8c740af330 2024-05-20T18:02:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.994+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c741552a0 con 0x7f8c740af330 2024-05-20T18:02:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.995+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c74075b00 con 0x7f8c740af330 2024-05-20T18:02:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.995+0000 7f8c5bfff640 1 -- 172.21.15.6:0/3890207578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c6401c070 con 0x7f8c740af330 2024-05-20T18:02:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.996+0000 7f8c5bfff640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c6006be60 0x7f8c6006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.996+0000 7f8c5bfff640 1 -- 172.21.15.6:0/3890207578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f8c6408a9f0 con 0x7f8c740af330 2024-05-20T18:02:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.996+0000 7f8c72ffd640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c6006be60 0x7f8c6006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:32.996+0000 7f8c72ffd640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c6006be60 0x7f8c6006e370 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8c68034000 tx=0x7f8c6802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.000+0000 7f8c5bfff640 1 -- 172.21.15.6:0/3890207578 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8c64058a90 con 0x7f8c740af330 2024-05-20T18:02:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.183+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8c740cdc30 con 0x7f8c740af330 2024-05-20T18:02:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.184+0000 7f8c5bfff640 1 -- 172.21.15.6:0/3890207578 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) ==== 100+0+11 (secure 0 0 0) 0x7f8c6405cd90 con 0x7f8c740af330 2024-05-20T18:02:33.182 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:02:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c6006be60 msgr2=0x7f8c6006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c6006be60 0x7f8c6006e370 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8c68034000 tx=0x7f8c6802e000 comp rx=0 tx=0).stop 2024-05-20T18:02:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740af330 msgr2=0x7f8c741f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740af330 0x7f8c741f1fd0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400d5a0 tx=0x7f8c6400da60 comp rx=0 tx=0).stop 2024-05-20T18:02:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 shutdown_connections 2024-05-20T18:02:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f8c6006be60 0x7f8c6006e370 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c740d1610 0x7f8c740cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c740b1e50 0x7f8c74153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 --2- 172.21.15.6:0/3890207578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c740af330 0x7f8c741f1fd0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 >> 172.21.15.6:0/3890207578 conn(0x7f8c740b6670 msgr2=0x7f8c740afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:33.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 shutdown_connections 2024-05-20T18:02:33.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.186+0000 7f8c79f64640 1 -- 172.21.15.6:0/3890207578 wait complete. 2024-05-20T18:02:33.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:02:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.313+0000 7fcd62bb7640 1 Processor -- start 2024-05-20T18:02:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.313+0000 7fcd62bb7640 1 -- start start 2024-05-20T18:02:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd62bb7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd5c163a10 0x7fcd5c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd62bb7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcd5c0b4010 0x7fcd5c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd62bb7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd62bb7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcd5c0d3ca0 con 0x7fcd5c163a10 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd62bb7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcd5c0d0370 con 0x7fcd5c0b4010 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd62bb7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcd5c0d0650 con 0x7fcd5c0d14b0 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd60953640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd5c163a10 0x7fcd5c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd60953640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd5c163a10 0x7fcd5c0d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43798/0 (socket says 172.21.15.6:43798) 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.314+0000 7fcd60953640 1 -- 172.21.15.6:0/2196584837 learned_addr learned my addr 172.21.15.6:0/2196584837 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.315+0000 7fcd61154640 1 --2- 172.21.15.6:0/2196584837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.315+0000 7fcd5bfff640 1 --2- 172.21.15.6:0/2196584837 >> v2:172.21.15.171:3300/0 conn(0x7fcd5c0b4010 0x7fcd5c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.315+0000 7fcd60953640 1 -- 172.21.15.6:0/2196584837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 msgr2=0x7fcd5c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.315+0000 7fcd60953640 1 --2- 172.21.15.6:0/2196584837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c0d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.315+0000 7fcd60953640 1 -- 172.21.15.6:0/2196584837 >> v2:172.21.15.171:3300/0 conn(0x7fcd5c0b4010 msgr2=0x7fcd5c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.315+0000 7fcd60953640 1 --2- 172.21.15.6:0/2196584837 >> v2:172.21.15.171:3300/0 conn(0x7fcd5c0b4010 0x7fcd5c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.315+0000 7fcd60953640 1 -- 172.21.15.6:0/2196584837 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5c0d3650 con 0x7fcd5c163a10 2024-05-20T18:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.315+0000 7fcd60953640 1 --2- 172.21.15.6:0/2196584837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c163a10 0x7fcd5c0d4130 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0b7f80 tx=0x7fcd4c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07c057e5aabc23a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd5b7fe640 1 -- 172.21.15.6:0/2196584837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c036070 con 0x7fcd5c163a10 2024-05-20T18:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd5b7fe640 1 -- 172.21.15.6:0/2196584837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4c031600 con 0x7fcd5c163a10 2024-05-20T18:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd5b7fe640 1 -- 172.21.15.6:0/2196584837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0319d0 con 0x7fcd5c163a10 2024-05-20T18:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 -- 172.21.15.6:0/2196584837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c163a10 msgr2=0x7fcd5c0d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/2196584837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c163a10 0x7fcd5c0d4130 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0b7f80 tx=0x7fcd4c02a6a0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 -- 172.21.15.6:0/2196584837 shutdown_connections 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/2196584837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/2196584837 >> v2:172.21.15.171:3300/0 conn(0x7fcd5c0b4010 0x7fcd5c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/2196584837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c163a10 0x7fcd5c0d4130 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 -- 172.21.15.6:0/2196584837 >> 172.21.15.6:0/2196584837 conn(0x7fcd5c06d240 msgr2=0x7fcd5c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 -- 172.21.15.6:0/2196584837 shutdown_connections 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.316+0000 7fcd62bb7640 1 -- 172.21.15.6:0/2196584837 wait complete. 2024-05-20T18:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.318+0000 7fcd62bb7640 1 Processor -- start 2024-05-20T18:02:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.318+0000 7fcd62bb7640 1 -- start start 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd62bb7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0b4010 0x7fcd5c146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd62bb7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd62bb7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd5c163a10 0x7fcd5c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd62bb7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c0d1e00 con 0x7fcd5c0b4010 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd62bb7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c0d0040 con 0x7fcd5c163a10 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd62bb7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcd5c0b8210 con 0x7fcd5c0d14b0 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0b4010 0x7fcd5c146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0b4010 0x7fcd5c146cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43804/0 (socket says 172.21.15.6:43804) 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 -- 172.21.15.6:0/1957721334 learned_addr learned my addr 172.21.15.6:0/1957721334 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd5bfff640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd61154640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd5c163a10 0x7fcd5c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 -- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 msgr2=0x7fcd5c144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 -- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd5c163a10 msgr2=0x7fcd5c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd5c163a10 0x7fcd5c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 -- 172.21.15.6:0/1957721334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5c1556b0 con 0x7fcd5c0b4010 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd5bfff640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd61154640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd5c163a10 0x7fcd5c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd60953640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0b4010 0x7fcd5c146cf0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c000f80 tx=0x7fcd4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd597fa640 1 -- 172.21.15.6:0/1957721334 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c036050 con 0x7fcd5c0b4010 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.320+0000 7fcd597fa640 1 -- 172.21.15.6:0/1957721334 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4c042070 con 0x7fcd5c0b4010 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.321+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5c155950 con 0x7fcd5c0b4010 2024-05-20T18:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.321+0000 7fcd597fa640 1 -- 172.21.15.6:0/1957721334 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c009510 con 0x7fcd5c0b4010 2024-05-20T18:02:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.321+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5c155f10 con 0x7fcd5c0b4010 2024-05-20T18:02:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.322+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd5c075b00 con 0x7fcd5c0b4010 2024-05-20T18:02:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.322+0000 7fcd597fa640 1 -- 172.21.15.6:0/1957721334 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd4c007c70 con 0x7fcd5c0b4010 2024-05-20T18:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.323+0000 7fcd597fa640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd4806be30 0x7fcd4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.323+0000 7fcd597fa640 1 -- 172.21.15.6:0/1957721334 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fcd4c0abfe0 con 0x7fcd5c0b4010 2024-05-20T18:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.323+0000 7fcd5bfff640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd4806be30 0x7fcd4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.323+0000 7fcd5bfff640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd4806be30 0x7fcd4806e340 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c1547b0 tx=0x7fcd50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.327+0000 7fcd597fa640 1 -- 172.21.15.6:0/1957721334 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcd4c07a770 con 0x7fcd5c0b4010 2024-05-20T18:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.523+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcd5c0cfc00 con 0x7fcd5c0b4010 2024-05-20T18:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.523+0000 7fcd597fa640 1 -- 172.21.15.6:0/1957721334 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v137) ==== 80+0+0 (secure 0 0 0) 0x7fcd4c07a070 con 0x7fcd5c0b4010 2024-05-20T18:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.525+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd4806be30 msgr2=0x7fcd4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.525+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd4806be30 0x7fcd4806e340 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c1547b0 tx=0x7fcd50008040 comp rx=0 tx=0).stop 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.525+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0b4010 msgr2=0x7fcd5c146cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.525+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0b4010 0x7fcd5c146cf0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c000f80 tx=0x7fcd4c004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.526+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 shutdown_connections 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.526+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd4806be30 0x7fcd4806e340 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.526+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd5c163a10 0x7fcd5c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.526+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd5c0d14b0 0x7fcd5c144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.526+0000 7fcd62bb7640 1 --2- 172.21.15.6:0/1957721334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd5c0b4010 0x7fcd5c146cf0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.526+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 >> 172.21.15.6:0/1957721334 conn(0x7fcd5c06d240 msgr2=0x7fcd5c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.526+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 shutdown_connections 2024-05-20T18:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.526+0000 7fcd62bb7640 1 -- 172.21.15.6:0/1957721334 wait complete. 2024-05-20T18:02:33.535 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T18:02:33.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:33.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T18:02:33.634 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:02:33.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:33.635 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T18:02:33.650 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:02:33.651 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:02:33.651 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:33.668 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:02:33.669 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:33.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.843+0000 7fd5fee14640 1 Processor -- start 2024-05-20T18:02:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.843+0000 7fd5fee14640 1 -- start start 2024-05-20T18:02:33.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5fee14640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5fee14640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5f80b3e80 0x7fd5f806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5fee14640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f806dd20 con 0x7fd5f806d910 2024-05-20T18:02:33.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5fee14640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f80d0630 con 0x7fd5f80b3e80 2024-05-20T18:02:33.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5fee14640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f80d39c0 con 0x7fd5f8162820 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5f7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5f80b3e80 0x7fd5f806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5fd3b1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd5f806d910 0x7fd5f80d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47832/0 (socket says 172.21.15.6:47832) 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5fd3b1640 1 -- 172.21.15.6:0/901133500 learned_addr learned my addr 172.21.15.6:0/901133500 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5fcbb0640 1 --2- 172.21.15.6:0/901133500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5f7fff640 1 -- 172.21.15.6:0/901133500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 msgr2=0x7fd5f80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5f7fff640 1 --2- 172.21.15.6:0/901133500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f80b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5f7fff640 1 -- 172.21.15.6:0/901133500 >> v1:172.21.15.6:6789/0 conn(0x7fd5f806d910 legacy=0x7fd5f80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5f77fe640 1 -- 172.21.15.6:0/901133500 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719496153 0 0) 0x7fd5f0001490 con 0x7fd5f806d910 2024-05-20T18:02:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.845+0000 7fd5f7fff640 1 -- 172.21.15.6:0/901133500 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f80d3ca0 con 0x7fd5f80b3e80 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.846+0000 7fd5f7fff640 1 --2- 172.21.15.6:0/901133500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f806d3d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0097a0 tx=0x7fd5ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46092f7c71f5bded server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.846+0000 7fd5f77fe640 1 -- 172.21.15.6:0/901133500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec037070 con 0x7fd5f80b3e80 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.846+0000 7fd5f77fe640 1 -- 172.21.15.6:0/901133500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec032440 con 0x7fd5f80b3e80 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.846+0000 7fd5f77fe640 1 -- 172.21.15.6:0/901133500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec032810 con 0x7fd5f80b3e80 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.847+0000 7fd5fee14640 1 -- 172.21.15.6:0/901133500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 msgr2=0x7fd5f806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.847+0000 7fd5fee14640 1 --2- 172.21.15.6:0/901133500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f806d3d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0097a0 tx=0x7fd5ec02a180 comp rx=0 tx=0).stop 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.847+0000 7fd5fee14640 1 -- 172.21.15.6:0/901133500 shutdown_connections 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.847+0000 7fd5fee14640 1 --2- 172.21.15.6:0/901133500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f806d3d0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.847+0000 7fd5fee14640 1 --2- 172.21.15.6:0/901133500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f80b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.847+0000 7fd5fee14640 1 -- 172.21.15.6:0/901133500 >> 172.21.15.6:0/901133500 conn(0x7fd5f80d4bd0 msgr2=0x7fd5f80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.847+0000 7fd5fee14640 1 -- 172.21.15.6:0/901133500 shutdown_connections 2024-05-20T18:02:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.847+0000 7fd5fee14640 1 -- 172.21.15.6:0/901133500 wait complete. 2024-05-20T18:02:33.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.849+0000 7fd5fee14640 1 Processor -- start 2024-05-20T18:02:33.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.849+0000 7fd5fee14640 1 -- start start 2024-05-20T18:02:33.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5fee14640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5f806d910 0x7fd5f814af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5fee14640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f814d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5fee14640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5fee14640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80d0300 con 0x7fd5f80b3e80 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5fee14640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80d4260 con 0x7fd5f806d910 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5fee14640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f80b91a0 con 0x7fd5f8162820 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f814d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f814d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43828/0 (socket says 172.21.15.6:43828) 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.850+0000 7fd5f7fff640 1 -- 172.21.15.6:0/733198181 learned_addr learned my addr 172.21.15.6:0/733198181 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5fd3b1640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5fcbb0640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5f806d910 0x7fd5f814af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f7fff640 1 -- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 msgr2=0x7fd5f814def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f7fff640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f814def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f7fff640 1 -- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5f806d910 msgr2=0x7fd5f814af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f7fff640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5f806d910 0x7fd5f814af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f7fff640 1 -- 172.21.15.6:0/733198181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f814b9c0 con 0x7fd5f80b3e80 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5fd3b1640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f814def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f7fff640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f814d9b0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0098c0 tx=0x7fd5ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f57fa640 1 -- 172.21.15.6:0/733198181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec037040 con 0x7fd5f80b3e80 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f57fa640 1 -- 172.21.15.6:0/733198181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec030770 con 0x7fd5f80b3e80 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f814bc30 con 0x7fd5f80b3e80 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5f57fa640 1 -- 172.21.15.6:0/733198181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec030b40 con 0x7fd5f80b3e80 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.851+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f80cbc50 con 0x7fd5f80b3e80 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.852+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f80ca2c0 con 0x7fd5f80b3e80 2024-05-20T18:02:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.853+0000 7fd5f57fa640 1 -- 172.21.15.6:0/733198181 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5ec044020 con 0x7fd5f80b3e80 2024-05-20T18:02:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.853+0000 7fd5f57fa640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5e406be30 0x7fd5e406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.853+0000 7fd5f57fa640 1 -- 172.21.15.6:0/733198181 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fd5ec0ab310 con 0x7fd5f80b3e80 2024-05-20T18:02:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.853+0000 7fd5fcbb0640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5e406be30 0x7fd5e406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.854+0000 7fd5fcbb0640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5e406be30 0x7fd5e406e340 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8006fd0 tx=0x7fd5e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:33.858+0000 7fd5f57fa640 1 -- 172.21.15.6:0/733198181 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd5ec032e20 con 0x7fd5f80b3e80 2024-05-20T18:02:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.040+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5f8075b00 con 0x7fd5f80b3e80 2024-05-20T18:02:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.041+0000 7fd5f57fa640 1 -- 172.21.15.6:0/733198181 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16844 (secure 0 0 0) 0x7fd5ec079b30 con 0x7fd5f80b3e80 2024-05-20T18:02:34.039 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:34.039 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":137,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:13.150220+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:09.651858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:10.498810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5e406be30 msgr2=0x7fd5e406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5e406be30 0x7fd5e406e340 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8006fd0 tx=0x7fd5e8008040 comp rx=0 tx=0).stop 2024-05-20T18:02:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 msgr2=0x7fd5f814d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f814d9b0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0098c0 tx=0x7fd5ec0046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 shutdown_connections 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd5e406be30 0x7fd5e406e340 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd5f8162820 0x7fd5f814def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5f80b3e80 0x7fd5f814d9b0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 --2- 172.21.15.6:0/733198181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5f806d910 0x7fd5f814af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 >> 172.21.15.6:0/733198181 conn(0x7fd5f80d4bd0 msgr2=0x7fd5f8161bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 shutdown_connections 2024-05-20T18:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.043+0000 7fd5fee14640 1 -- 172.21.15.6:0/733198181 wait complete. 2024-05-20T18:02:34.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:02:09.651858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:02:10.498810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:02:34.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:02:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.173+0000 7fcbbf3f5640 1 Processor -- start 2024-05-20T18:02:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.173+0000 7fcbbf3f5640 1 -- start start 2024-05-20T18:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.174+0000 7fcbbf3f5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbf3f5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbb806dae0 0x7fcbb80b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbf3f5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb80d0630 con 0x7fcbb80b3e80 2024-05-20T18:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbf3f5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb80d39c0 con 0x7fcbb806dae0 2024-05-20T18:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbf3f5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb80d3ca0 con 0x7fcbb8162820 2024-05-20T18:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd992640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbb806dae0 0x7fcbb80b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd992640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbb806dae0 0x7fcbb80b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43834/0 (socket says 172.21.15.6:43834) 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd992640 1 -- 172.21.15.6:0/4079817907 learned_addr learned my addr 172.21.15.6:0/4079817907 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd191640 1 --2- 172.21.15.6:0/4079817907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd992640 1 -- 172.21.15.6:0/4079817907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 msgr2=0x7fcbb80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd992640 1 --2- 172.21.15.6:0/4079817907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb80b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd992640 1 -- 172.21.15.6:0/4079817907 >> v1:172.21.15.171:6789/0 conn(0x7fcbb80b3e80 legacy=0x7fcbb806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd992640 1 -- 172.21.15.6:0/4079817907 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb80d3f80 con 0x7fcbb806dae0 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.175+0000 7fcbbd191640 1 --2- 172.21.15.6:0/4079817907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb80b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.176+0000 7fcbbd992640 1 --2- 172.21.15.6:0/4079817907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb806dae0 0x7fcbb80b8190 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009e50 tx=0x7fcbb002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238a2d59fb26d1c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.176+0000 7fcbaffff640 1 -- 172.21.15.6:0/4079817907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0036070 con 0x7fcbb806dae0 2024-05-20T18:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.176+0000 7fcbaffff640 1 -- 172.21.15.6:0/4079817907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb0031600 con 0x7fcbb806dae0 2024-05-20T18:02:34.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.176+0000 7fcbaffff640 1 -- 172.21.15.6:0/4079817907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00319d0 con 0x7fcbb806dae0 2024-05-20T18:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.177+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/4079817907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb806dae0 msgr2=0x7fcbb80b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.177+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/4079817907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb806dae0 0x7fcbb80b8190 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009e50 tx=0x7fcbb002a710 comp rx=0 tx=0).stop 2024-05-20T18:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.177+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/4079817907 shutdown_connections 2024-05-20T18:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.177+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/4079817907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb806dae0 0x7fcbb80b8190 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.177+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/4079817907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb80b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.177+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/4079817907 >> 172.21.15.6:0/4079817907 conn(0x7fcbb80d4bd0 msgr2=0x7fcbb80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.177+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/4079817907 shutdown_connections 2024-05-20T18:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.177+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/4079817907 wait complete. 2024-05-20T18:02:34.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.179+0000 7fcbbf3f5640 1 Processor -- start 2024-05-20T18:02:34.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.179+0000 7fcbbf3f5640 1 -- start start 2024-05-20T18:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbf3f5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80b3e80 0x7fcbb80b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbf3f5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbf3f5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cc5f0 0x7fcbb815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbf3f5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb80d4780 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbf3f5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb80d0300 con 0x7fcbb80b3e80 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbf3f5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb80d4900 con 0x7fcbb8162820 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbd992640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cc5f0 0x7fcbb815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbd992640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cc5f0 0x7fcbb815bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43848/0 (socket says 172.21.15.6:43848) 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbd992640 1 -- 172.21.15.6:0/104232931 learned_addr learned my addr 172.21.15.6:0/104232931 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbc990640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbd191640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80b3e80 0x7fcbb80b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbd992640 1 -- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 msgr2=0x7fcbb815b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbd992640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb815b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbd992640 1 -- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80b3e80 msgr2=0x7fcbb80b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.180+0000 7fcbbd992640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80b3e80 0x7fcbb80b70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.181+0000 7fcbbd992640 1 -- 172.21.15.6:0/104232931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb80ce200 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.181+0000 7fcbbd992640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cc5f0 0x7fcbb815bdd0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009f70 tx=0x7fcbb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.181+0000 7fcbadffb640 1 -- 172.21.15.6:0/104232931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb003f020 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.181+0000 7fcbadffb640 1 -- 172.21.15.6:0/104232931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb0037040 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.181+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb80ce4e0 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.181+0000 7fcbadffb640 1 -- 172.21.15.6:0/104232931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0036070 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.181+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb80ceaa0 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.182+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb80cdf60 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.183+0000 7fcbadffb640 1 -- 172.21.15.6:0/104232931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbb0042020 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.183+0000 7fcbadffb640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb9c06be60 0x7fcb9c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.183+0000 7fcbadffb640 1 -- 172.21.15.6:0/104232931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fcbb00ab490 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.184+0000 7fcbbd191640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb9c06be60 0x7fcb9c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.184+0000 7fcbbd191640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb9c06be60 0x7fcb9c06e370 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40096d0 tx=0x7fcbb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.188+0000 7fcbadffb640 1 -- 172.21.15.6:0/104232931 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcbb80cdf60 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.373+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcbb8075b00 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.373+0000 7fcbadffb640 1 -- 172.21.15.6:0/104232931 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) ==== 93+0+10 (secure 0 0 0) 0x7fcbb0049030 con 0x7fcbb80cc5f0 2024-05-20T18:02:34.371 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb9c06be60 msgr2=0x7fcb9c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb9c06be60 0x7fcb9c06e370 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40096d0 tx=0x7fcbb4008040 comp rx=0 tx=0).stop 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cc5f0 msgr2=0x7fcbb815bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cc5f0 0x7fcbb815bdd0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009f70 tx=0x7fcbb0004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 shutdown_connections 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb9c06be60 0x7fcb9c06e370 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb80cc5f0 0x7fcbb815bdd0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcbb8162820 0x7fcbb815b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 --2- 172.21.15.6:0/104232931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcbb80b3e80 0x7fcbb80b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 >> 172.21.15.6:0/104232931 conn(0x7fcbb80d4bd0 msgr2=0x7fcbb815c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 shutdown_connections 2024-05-20T18:02:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.375+0000 7fcbbf3f5640 1 -- 172.21.15.6:0/104232931 wait complete. 2024-05-20T18:02:34.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:02:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.504+0000 7fae43b5e640 1 Processor -- start 2024-05-20T18:02:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.504+0000 7fae43b5e640 1 -- start start 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.505+0000 7fae43b5e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae3c0b00b0 0x7fae3c0b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.505+0000 7fae43b5e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae3c0b52e0 con 0x7fae3c15fd80 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.505+0000 7fae43b5e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae3c15c040 con 0x7fae3c06c4c0 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.505+0000 7fae43b5e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fae3c15c690 con 0x7fae3c0b00b0 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.506+0000 7fae418fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae3c0b00b0 0x7fae3c0b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.506+0000 7fae410f9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fae3c15fd80 0x7fae3c06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47848/0 (socket says 172.21.15.6:47848) 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.506+0000 7fae410f9640 1 -- 172.21.15.6:0/1940668103 learned_addr learned my addr 172.21.15.6:0/1940668103 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.506+0000 7fae418fa640 1 -- 172.21.15.6:0/1940668103 >> v1:172.21.15.171:6789/0 conn(0x7fae3c06c4c0 legacy=0x7fae3c0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.506+0000 7fae418fa640 1 -- 172.21.15.6:0/1940668103 >> v1:172.21.15.6:6789/0 conn(0x7fae3c15fd80 legacy=0x7fae3c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.506+0000 7fae418fa640 1 -- 172.21.15.6:0/1940668103 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c15c320 con 0x7fae3c0b00b0 2024-05-20T18:02:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.506+0000 7fae408f8640 1 -- 172.21.15.6:0/1940668103 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419487793 0 0) 0x7fae3c0b52e0 con 0x7fae3c15fd80 2024-05-20T18:02:34.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.507+0000 7fae418fa640 1 --2- 172.21.15.6:0/1940668103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b4c00 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fae380097a0 tx=0x7fae3802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e263a04a6bd62f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.507+0000 7fae408f8640 1 -- 172.21.15.6:0/1940668103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38037070 con 0x7fae3c0b00b0 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.507+0000 7fae408f8640 1 -- 172.21.15.6:0/1940668103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3802ae50 con 0x7fae3c0b00b0 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.507+0000 7fae408f8640 1 -- 172.21.15.6:0/1940668103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38032660 con 0x7fae3c0b00b0 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.507+0000 7fae43b5e640 1 -- 172.21.15.6:0/1940668103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 msgr2=0x7fae3c0b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.507+0000 7fae43b5e640 1 --2- 172.21.15.6:0/1940668103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b4c00 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fae380097a0 tx=0x7fae3802a140 comp rx=0 tx=0).stop 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.507+0000 7fae43b5e640 1 -- 172.21.15.6:0/1940668103 shutdown_connections 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.508+0000 7fae43b5e640 1 --2- 172.21.15.6:0/1940668103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b4c00 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.508+0000 7fae43b5e640 1 -- 172.21.15.6:0/1940668103 >> 172.21.15.6:0/1940668103 conn(0x7fae3c0cd2a0 msgr2=0x7fae3c0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.508+0000 7fae43b5e640 1 -- 172.21.15.6:0/1940668103 shutdown_connections 2024-05-20T18:02:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.508+0000 7fae43b5e640 1 -- 172.21.15.6:0/1940668103 wait complete. 2024-05-20T18:02:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.509+0000 7fae43b5e640 1 Processor -- start 2024-05-20T18:02:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.509+0000 7fae43b5e640 1 -- start start 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae43b5e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae43b5e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae3c15fd80 0x7fae3c14d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae43b5e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae3c09a4f0 0x7fae3c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae43b5e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c15bdb0 con 0x7fae3c0b00b0 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae43b5e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fae3c15bc30 con 0x7fae3c09a4f0 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae43b5e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fae3c15cb20 con 0x7fae3c15fd80 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43868/0 (socket says 172.21.15.6:43868) 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 -- 172.21.15.6:0/3666413866 learned_addr learned my addr 172.21.15.6:0/3666413866 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae410f9640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae3c15fd80 0x7fae3c14d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae420fb640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae3c09a4f0 0x7fae3c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 -- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae3c15fd80 msgr2=0x7fae3c14d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae3c15fd80 0x7fae3c14d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 -- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae3c09a4f0 msgr2=0x7fae3c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae3c09a4f0 0x7fae3c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 -- 172.21.15.6:0/3666413866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3c09acd0 con 0x7fae3c0b00b0 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae418fa640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b1f70 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fae380098c0 tx=0x7fae380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae327fc640 1 -- 172.21.15.6:0/3666413866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38042070 con 0x7fae3c0b00b0 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae327fc640 1 -- 172.21.15.6:0/3666413866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae3803e670 con 0x7fae3c0b00b0 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.511+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3c09afb0 con 0x7fae3c0b00b0 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.512+0000 7fae327fc640 1 -- 172.21.15.6:0/3666413866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38037040 con 0x7fae3c0b00b0 2024-05-20T18:02:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.512+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3c09b570 con 0x7fae3c0b00b0 2024-05-20T18:02:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.512+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae3c075b00 con 0x7fae3c0b00b0 2024-05-20T18:02:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.513+0000 7fae327fc640 1 -- 172.21.15.6:0/3666413866 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae38045070 con 0x7fae3c0b00b0 2024-05-20T18:02:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.514+0000 7fae327fc640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae2006be60 0x7fae2006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.514+0000 7fae327fc640 1 -- 172.21.15.6:0/3666413866 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fae380ab330 con 0x7fae3c0b00b0 2024-05-20T18:02:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.514+0000 7fae410f9640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae2006be60 0x7fae2006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.514+0000 7fae410f9640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae2006be60 0x7fae2006e370 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fae2c000f60 tx=0x7fae2c007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.518+0000 7fae327fc640 1 -- 172.21.15.6:0/3666413866 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fae38079be0 con 0x7fae3c0b00b0 2024-05-20T18:02:34.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.700+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fae3c06cd30 con 0x7fae3c0b00b0 2024-05-20T18:02:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.701+0000 7fae327fc640 1 -- 172.21.15.6:0/3666413866 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) ==== 104+0+11 (secure 0 0 0) 0x7fae380794e0 con 0x7fae3c0b00b0 2024-05-20T18:02:34.699 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.702+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae2006be60 msgr2=0x7fae2006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.702+0000 7fae43b5e640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae2006be60 0x7fae2006e370 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fae2c000f60 tx=0x7fae2c007c00 comp rx=0 tx=0).stop 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.702+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 msgr2=0x7fae3c0b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.702+0000 7fae43b5e640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b1f70 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fae380098c0 tx=0x7fae380046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.702+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 shutdown_connections 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.702+0000 7fae43b5e640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fae2006be60 0x7fae2006e370 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.702+0000 7fae43b5e640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae3c09a4f0 0x7fae3c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.702+0000 7fae43b5e640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fae3c15fd80 0x7fae3c14d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.703+0000 7fae43b5e640 1 --2- 172.21.15.6:0/3666413866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae3c0b00b0 0x7fae3c0b1f70 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.703+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 >> 172.21.15.6:0/3666413866 conn(0x7fae3c0cd2a0 msgr2=0x7fae3c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.703+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 shutdown_connections 2024-05-20T18:02:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.703+0000 7fae43b5e640 1 -- 172.21.15.6:0/3666413866 wait complete. 2024-05-20T18:02:34.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:02:34.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.831+0000 7f35b0f96640 1 Processor -- start 2024-05-20T18:02:34.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.831+0000 7f35b0f96640 1 -- start start 2024-05-20T18:02:34.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35b0f96640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f35ac162820 0x7f35ac0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35b0f96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35ac06dae0 0x7f35ac0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35b0f96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac0d0630 con 0x7f35ac0b3e80 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35b0f96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac0d39c0 con 0x7f35ac06dae0 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35b0f96640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac0d3ca0 con 0x7f35ac162820 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35aad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35ac06dae0 0x7f35ac0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35a9d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f35ac0b3e80 0x7f35ac06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47854/0 (socket says 172.21.15.6:47854) 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35a9d9b640 1 -- 172.21.15.6:0/3856116663 learned_addr learned my addr 172.21.15.6:0/3856116663 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35aa59c640 1 --2- 172.21.15.6:0/3856116663 >> v2:172.21.15.171:3300/0 conn(0x7f35ac162820 0x7f35ac0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35aad9d640 1 -- 172.21.15.6:0/3856116663 >> v2:172.21.15.171:3300/0 conn(0x7f35ac162820 msgr2=0x7f35ac0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35aad9d640 1 --2- 172.21.15.6:0/3856116663 >> v2:172.21.15.171:3300/0 conn(0x7f35ac162820 0x7f35ac0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35aad9d640 1 -- 172.21.15.6:0/3856116663 >> v1:172.21.15.6:6789/0 conn(0x7f35ac0b3e80 legacy=0x7f35ac06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35aad9d640 1 -- 172.21.15.6:0/3856116663 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac0d3f80 con 0x7f35ac06dae0 2024-05-20T18:02:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.833+0000 7f35a959a640 1 -- 172.21.15.6:0/3856116663 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530903625 0 0) 0x7f35ac0d0630 con 0x7f35ac0b3e80 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.834+0000 7f35aad9d640 1 --2- 172.21.15.6:0/3856116663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac06dae0 0x7f35ac0b8190 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0b7740 tx=0x7f35a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5db3cb0e17137f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.834+0000 7f35a959a640 1 -- 172.21.15.6:0/3856116663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4037070 con 0x7f35ac06dae0 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.834+0000 7f35a959a640 1 -- 172.21.15.6:0/3856116663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4032440 con 0x7f35ac06dae0 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.834+0000 7f35a959a640 1 -- 172.21.15.6:0/3856116663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4032810 con 0x7f35ac06dae0 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.835+0000 7f35b0f96640 1 -- 172.21.15.6:0/3856116663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac06dae0 msgr2=0x7f35ac0b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.835+0000 7f35b0f96640 1 --2- 172.21.15.6:0/3856116663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac06dae0 0x7f35ac0b8190 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0b7740 tx=0x7f35a402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.835+0000 7f35b0f96640 1 -- 172.21.15.6:0/3856116663 shutdown_connections 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.835+0000 7f35b0f96640 1 --2- 172.21.15.6:0/3856116663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac06dae0 0x7f35ac0b8190 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.835+0000 7f35b0f96640 1 --2- 172.21.15.6:0/3856116663 >> v2:172.21.15.171:3300/0 conn(0x7f35ac162820 0x7f35ac0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.835+0000 7f35b0f96640 1 -- 172.21.15.6:0/3856116663 >> 172.21.15.6:0/3856116663 conn(0x7f35ac0d4bd0 msgr2=0x7f35ac0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.835+0000 7f35b0f96640 1 -- 172.21.15.6:0/3856116663 shutdown_connections 2024-05-20T18:02:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.835+0000 7f35b0f96640 1 -- 172.21.15.6:0/3856116663 wait complete. 2024-05-20T18:02:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.837+0000 7f35b0f96640 1 Processor -- start 2024-05-20T18:02:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.837+0000 7f35b0f96640 1 -- start start 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.838+0000 7f35b0f96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35ac0b3e80 0x7f35ac147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.838+0000 7f35b0f96640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35ac162820 0x7f35ac155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35b0f96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac1477b0 0x7f35ac155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35b0f96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac0d4780 con 0x7f35ac1477b0 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35b0f96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac0d0300 con 0x7f35ac0b3e80 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35b0f96640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac0d4900 con 0x7f35ac162820 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac1477b0 0x7f35ac155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac1477b0 0x7f35ac155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43876/0 (socket says 172.21.15.6:43876) 2024-05-20T18:02:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 -- 172.21.15.6:0/2053363888 learned_addr learned my addr 172.21.15.6:0/2053363888 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aa59c640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35ac0b3e80 0x7f35ac147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35a9d9b640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35ac162820 0x7f35ac155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 -- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35ac162820 msgr2=0x7f35ac155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35ac162820 0x7f35ac155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 -- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35ac0b3e80 msgr2=0x7f35ac147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35ac0b3e80 0x7f35ac147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 -- 172.21.15.6:0/2053363888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac15f4c0 con 0x7f35ac1477b0 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aa59c640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35ac0b3e80 0x7f35ac147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35a9d9b640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35ac162820 0x7f35ac155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35aad9d640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac1477b0 0x7f35ac155fe0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f35a4035040 tx=0x7f35a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f359affd640 1 -- 172.21.15.6:0/2053363888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4037040 con 0x7f35ac1477b0 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f359affd640 1 -- 172.21.15.6:0/2053363888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4042070 con 0x7f35ac1477b0 2024-05-20T18:02:34.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.839+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac15f7a0 con 0x7f35ac1477b0 2024-05-20T18:02:34.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.840+0000 7f359affd640 1 -- 172.21.15.6:0/2053363888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4030b30 con 0x7f35ac1477b0 2024-05-20T18:02:34.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.840+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac15fd60 con 0x7f35ac1477b0 2024-05-20T18:02:34.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.840+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac1e9300 con 0x7f35ac1477b0 2024-05-20T18:02:34.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.841+0000 7f359affd640 1 -- 172.21.15.6:0/2053363888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35a4030cd0 con 0x7f35ac1477b0 2024-05-20T18:02:34.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.842+0000 7f359affd640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:34.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.842+0000 7f359affd640 1 -- 172.21.15.6:0/2053363888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f35a40abc70 con 0x7f35ac1477b0 2024-05-20T18:02:34.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.842+0000 7f35aa59c640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:34.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.842+0000 7f35aa59c640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f359c009a80 tx=0x7f359c0039d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:34.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:34.846+0000 7f359affd640 1 -- 172.21.15.6:0/2053363888 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f35ac1e9300 con 0x7f35ac1477b0 2024-05-20T18:02:35.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.029+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f35ac075b00 con 0x7f35ac1477b0 2024-05-20T18:02:35.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.029+0000 7f359affd640 1 -- 172.21.15.6:0/2053363888 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) ==== 100+0+11 (secure 0 0 0) 0x7f35a4032e20 con 0x7f35ac1477b0 2024-05-20T18:02:35.027 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 msgr2=0x7f358c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f359c009a80 tx=0x7f359c0039d0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac1477b0 msgr2=0x7f35ac155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac1477b0 0x7f35ac155fe0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f35a4035040 tx=0x7f35a40046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 shutdown_connections 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f358c06be30 0x7f358c06e340 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35ac1477b0 0x7f35ac155fe0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35ac162820 0x7f35ac155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 --2- 172.21.15.6:0/2053363888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35ac0b3e80 0x7f35ac147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 >> 172.21.15.6:0/2053363888 conn(0x7f35ac0d4bd0 msgr2=0x7f35ac15c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:35.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.031+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 shutdown_connections 2024-05-20T18:02:35.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.032+0000 7f35b0f96640 1 -- 172.21.15.6:0/2053363888 wait complete. 2024-05-20T18:02:35.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:02:35.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.159+0000 7f98ea4fe640 1 Processor -- start 2024-05-20T18:02:35.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.159+0000 7f98ea4fe640 1 -- start start 2024-05-20T18:02:35.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98ea4fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98e4162820 0x7f98e40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98ea4fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e406dae0 0x7f98e40b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98ea4fe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98e40d0630 con 0x7f98e40b3e80 2024-05-20T18:02:35.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98ea4fe640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f98e40d39c0 con 0x7f98e4162820 2024-05-20T18:02:35.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98ea4fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f98e40d3ca0 con 0x7f98e406dae0 2024-05-20T18:02:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98e3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98e4162820 0x7f98e40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98e3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98e4162820 0x7f98e40b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43878/0 (socket says 172.21.15.6:43878) 2024-05-20T18:02:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98e3fff640 1 -- 172.21.15.6:0/690882717 learned_addr learned my addr 172.21.15.6:0/690882717 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98e8a9b640 1 --2- 172.21.15.6:0/690882717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e406dae0 0x7f98e40b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98e3fff640 1 -- 172.21.15.6:0/690882717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e406dae0 msgr2=0x7f98e40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98e3fff640 1 --2- 172.21.15.6:0/690882717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e406dae0 0x7f98e40b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98e3fff640 1 -- 172.21.15.6:0/690882717 >> v1:172.21.15.171:6789/0 conn(0x7f98e40b3e80 legacy=0x7f98e406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:35.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.161+0000 7f98e3fff640 1 -- 172.21.15.6:0/690882717 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e40d3f80 con 0x7f98e4162820 2024-05-20T18:02:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.162+0000 7f98e3fff640 1 --2- 172.21.15.6:0/690882717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e4162820 0x7f98e40b3940 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009870 tx=0x7f98d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b1ec8d857c7c03 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.162+0000 7f98e37fe640 1 -- 172.21.15.6:0/690882717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4037070 con 0x7f98e4162820 2024-05-20T18:02:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.162+0000 7f98e37fe640 1 -- 172.21.15.6:0/690882717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d4032440 con 0x7f98e4162820 2024-05-20T18:02:35.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.162+0000 7f98e37fe640 1 -- 172.21.15.6:0/690882717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4032810 con 0x7f98e4162820 2024-05-20T18:02:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.163+0000 7f98ea4fe640 1 -- 172.21.15.6:0/690882717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e4162820 msgr2=0x7f98e40b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.163+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/690882717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e4162820 0x7f98e40b3940 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009870 tx=0x7f98d402a270 comp rx=0 tx=0).stop 2024-05-20T18:02:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.163+0000 7f98ea4fe640 1 -- 172.21.15.6:0/690882717 shutdown_connections 2024-05-20T18:02:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.163+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/690882717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e406dae0 0x7f98e40b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.163+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/690882717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e4162820 0x7f98e40b3940 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.163+0000 7f98ea4fe640 1 -- 172.21.15.6:0/690882717 >> 172.21.15.6:0/690882717 conn(0x7f98e40d4bd0 msgr2=0x7f98e40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.163+0000 7f98ea4fe640 1 -- 172.21.15.6:0/690882717 shutdown_connections 2024-05-20T18:02:35.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.163+0000 7f98ea4fe640 1 -- 172.21.15.6:0/690882717 wait complete. 2024-05-20T18:02:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.165+0000 7f98ea4fe640 1 Processor -- start 2024-05-20T18:02:35.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.165+0000 7f98ea4fe640 1 -- start start 2024-05-20T18:02:35.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98ea4fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e40b3e80 0x7f98e415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98ea4fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e4162820 0x7f98e40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98ea4fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e40b4d10 0x7f98e41f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98ea4fe640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f98e40d4780 con 0x7f98e40b4d10 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98ea4fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f98e40d0300 con 0x7f98e40b3e80 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98ea4fe640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f98e40d4900 con 0x7f98e4162820 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98e8a9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e40b4d10 0x7f98e41f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98e8a9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e40b4d10 0x7f98e41f4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43882/0 (socket says 172.21.15.6:43882) 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98e8a9b640 1 -- 172.21.15.6:0/477084191 learned_addr learned my addr 172.21.15.6:0/477084191 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.166+0000 7f98dbfff640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e4162820 0x7f98e40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e3fff640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e40b3e80 0x7f98e415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e8a9b640 1 -- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e4162820 msgr2=0x7f98e40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e8a9b640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e4162820 0x7f98e40b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e8a9b640 1 -- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e40b3e80 msgr2=0x7f98e415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e8a9b640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e40b3e80 0x7f98e415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e8a9b640 1 -- 172.21.15.6:0/477084191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e40b5540 con 0x7f98e40b4d10 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e8a9b640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e40b4d10 0x7f98e41f4f90 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f98dc007d40 tx=0x7f98dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e17fa640 1 -- 172.21.15.6:0/477084191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc014420 con 0x7f98e40b4d10 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e17fa640 1 -- 172.21.15.6:0/477084191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc019070 con 0x7f98e40b4d10 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98e17fa640 1 -- 172.21.15.6:0/477084191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc014820 con 0x7f98e40b4d10 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e40b5820 con 0x7f98e40b4d10 2024-05-20T18:02:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.167+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e40b5de0 con 0x7f98e40b4d10 2024-05-20T18:02:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.168+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e40b52b0 con 0x7f98e40b4d10 2024-05-20T18:02:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.169+0000 7f98e17fa640 1 -- 172.21.15.6:0/477084191 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98dc0149c0 con 0x7f98e40b4d10 2024-05-20T18:02:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.169+0000 7f98e17fa640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98c406be30 0x7f98c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.169+0000 7f98e17fa640 1 -- 172.21.15.6:0/477084191 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f98dc08b730 con 0x7f98e40b4d10 2024-05-20T18:02:35.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.170+0000 7f98e3fff640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98c406be30 0x7f98c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.170+0000 7f98e3fff640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98c406be30 0x7f98c406e340 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f98d4034000 tx=0x7f98d402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.174+0000 7f98e17fa640 1 -- 172.21.15.6:0/477084191 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f98dc059870 con 0x7f98e40b4d10 2024-05-20T18:02:35.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.369+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f98e415f710 con 0x7f98e40b4d10 2024-05-20T18:02:35.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.370+0000 7f98e17fa640 1 -- 172.21.15.6:0/477084191 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v137) ==== 80+0+0 (secure 0 0 0) 0x7f98dc05db70 con 0x7f98e40b4d10 2024-05-20T18:02:35.368 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:02:35.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98c406be30 msgr2=0x7f98c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98c406be30 0x7f98c406e340 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f98d4034000 tx=0x7f98d402e000 comp rx=0 tx=0).stop 2024-05-20T18:02:35.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e40b4d10 msgr2=0x7f98e41f4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e40b4d10 0x7f98e41f4f90 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f98dc007d40 tx=0x7f98dc00e4b0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 shutdown_connections 2024-05-20T18:02:35.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f98c406be30 0x7f98c406e340 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e40b4d10 0x7f98e41f4f90 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98e4162820 0x7f98e40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 --2- 172.21.15.6:0/477084191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98e40b3e80 0x7f98e415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 >> 172.21.15.6:0/477084191 conn(0x7f98e40d4bd0 msgr2=0x7f98e415d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:35.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 shutdown_connections 2024-05-20T18:02:35.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.372+0000 7f98ea4fe640 1 -- 172.21.15.6:0/477084191 wait complete. 2024-05-20T18:02:35.381 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T18:02:35.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:35.381 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T18:02:35.415 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:02:35.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:35.415 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T18:02:35.473 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:02:35.474 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:35.474 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:35.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:02:35.494 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:02:35.494 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:02:35.494 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:35.531 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:02:35.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:35.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.647+0000 7fa0cb972640 1 Processor -- start 2024-05-20T18:02:35.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.647+0000 7fa0cb972640 1 -- start start 2024-05-20T18:02:35.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0cb972640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0c40af030 0x7fa0c40af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0cb972640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c406c180 0x7fa0c406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0cb972640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c40af980 con 0x7fa0c415f700 2024-05-20T18:02:35.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0cb972640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c406bcf0 con 0x7fa0c40af030 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0cb972640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c4160430 con 0x7fa0c406c180 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0c970e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0c40af030 0x7fa0c40af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0c970e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0c40af030 0x7fa0c40af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43894/0 (socket says 172.21.15.6:43894) 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0c970e640 1 -- 172.21.15.6:0/2828564053 learned_addr learned my addr 172.21.15.6:0/2828564053 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0c9f0f640 1 --2- 172.21.15.6:0/2828564053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c406c180 0x7fa0c406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0c970e640 1 -- 172.21.15.6:0/2828564053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c406c180 msgr2=0x7fa0c406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0c970e640 1 --2- 172.21.15.6:0/2828564053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c406c180 0x7fa0c406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0c970e640 1 -- 172.21.15.6:0/2828564053 >> v1:172.21.15.171:6789/0 conn(0x7fa0c415f700 legacy=0x7fa0c415fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.649+0000 7fa0c970e640 1 -- 172.21.15.6:0/2828564053 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c406b6a0 con 0x7fa0c40af030 2024-05-20T18:02:35.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.650+0000 7fa0c970e640 1 --2- 172.21.15.6:0/2828564053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c40af030 0x7fa0c40af440 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009e50 tx=0x7fa0c002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6455f4697cec5229 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:35.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.650+0000 7fa0bbfff640 1 -- 172.21.15.6:0/2828564053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0036070 con 0x7fa0c40af030 2024-05-20T18:02:35.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.650+0000 7fa0bbfff640 1 -- 172.21.15.6:0/2828564053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c0031600 con 0x7fa0c40af030 2024-05-20T18:02:35.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.650+0000 7fa0bbfff640 1 -- 172.21.15.6:0/2828564053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00319d0 con 0x7fa0c40af030 2024-05-20T18:02:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.651+0000 7fa0cb972640 1 -- 172.21.15.6:0/2828564053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c40af030 msgr2=0x7fa0c40af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.651+0000 7fa0cb972640 1 --2- 172.21.15.6:0/2828564053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c40af030 0x7fa0c40af440 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009e50 tx=0x7fa0c002a710 comp rx=0 tx=0).stop 2024-05-20T18:02:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.651+0000 7fa0cb972640 1 -- 172.21.15.6:0/2828564053 shutdown_connections 2024-05-20T18:02:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.651+0000 7fa0cb972640 1 --2- 172.21.15.6:0/2828564053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c406c180 0x7fa0c406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.651+0000 7fa0cb972640 1 --2- 172.21.15.6:0/2828564053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c40af030 0x7fa0c40af440 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.651+0000 7fa0cb972640 1 -- 172.21.15.6:0/2828564053 >> 172.21.15.6:0/2828564053 conn(0x7fa0c40b6620 msgr2=0x7fa0c40b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.651+0000 7fa0cb972640 1 -- 172.21.15.6:0/2828564053 shutdown_connections 2024-05-20T18:02:35.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.651+0000 7fa0cb972640 1 -- 172.21.15.6:0/2828564053 wait complete. 2024-05-20T18:02:35.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.653+0000 7fa0cb972640 1 Processor -- start 2024-05-20T18:02:35.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.653+0000 7fa0cb972640 1 -- start start 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0cb972640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c406c180 0x7fa0c4156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0cb972640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0c40af030 0x7fa0c415e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0cb972640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c415f700 0x7fa0c415e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0cb972640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c406cad0 con 0x7fa0c406c180 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0cb972640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c4159aa0 con 0x7fa0c40af030 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0cb972640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c406cc50 con 0x7fa0c415f700 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0c970e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c406c180 0x7fa0c4156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0c970e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c406c180 0x7fa0c4156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43902/0 (socket says 172.21.15.6:43902) 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.654+0000 7fa0c970e640 1 -- 172.21.15.6:0/606179261 learned_addr learned my addr 172.21.15.6:0/606179261 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:35.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c9f0f640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c415f700 0x7fa0c415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c970e640 1 -- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c415f700 msgr2=0x7fa0c415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c970e640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c415f700 0x7fa0c415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c970e640 1 -- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0c40af030 msgr2=0x7fa0c415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c8f0d640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0c40af030 0x7fa0c415e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c970e640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0c40af030 0x7fa0c415e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c970e640 1 -- 172.21.15.6:0/606179261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c409ed70 con 0x7fa0c406c180 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c9f0f640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c415f700 0x7fa0c415e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c8f0d640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0c40af030 0x7fa0c415e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0c970e640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c406c180 0x7fa0c4156300 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0034040 tx=0x7fa0c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0b9ffb640 1 -- 172.21.15.6:0/606179261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0036050 con 0x7fa0c406c180 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0b9ffb640 1 -- 172.21.15.6:0/606179261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c0042070 con 0x7fa0c406c180 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c409f050 con 0x7fa0c406c180 2024-05-20T18:02:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0b9ffb640 1 -- 172.21.15.6:0/606179261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0009510 con 0x7fa0c406c180 2024-05-20T18:02:35.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.655+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c4159cc0 con 0x7fa0c406c180 2024-05-20T18:02:35.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.656+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c4075b00 con 0x7fa0c406c180 2024-05-20T18:02:35.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.657+0000 7fa0b9ffb640 1 -- 172.21.15.6:0/606179261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0c0007c70 con 0x7fa0c406c180 2024-05-20T18:02:35.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.657+0000 7fa0b9ffb640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa0a806be30 0x7fa0a806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:35.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.658+0000 7fa0b9ffb640 1 -- 172.21.15.6:0/606179261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fa0c00abec0 con 0x7fa0c406c180 2024-05-20T18:02:35.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.658+0000 7fa0c8f0d640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa0a806be30 0x7fa0a806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:35.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.658+0000 7fa0c8f0d640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa0a806be30 0x7fa0a806e340 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4070280 tx=0x7fa0b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:35.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.662+0000 7fa0b9ffb640 1 -- 172.21.15.6:0/606179261 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa0c007a640 con 0x7fa0c406c180 2024-05-20T18:02:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.882+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0c40d1630 con 0x7fa0c406c180 2024-05-20T18:02:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.883+0000 7fa0b9ffb640 1 -- 172.21.15.6:0/606179261 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5182 (secure 0 0 0) 0x7fa0c0079f40 con 0x7fa0c406c180 2024-05-20T18:02:35.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:35.881 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":99,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:11.519092+0000","modified":"2024-05-20T18:02:32.173141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6835/1253645410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1253645410},{"type":"v1","addr":"172.21.15.6:6835","nonce":1253645410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":10}]} 2024-05-20T18:02:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 99 2024-05-20T18:02:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa0a806be30 msgr2=0x7fa0a806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa0a806be30 0x7fa0a806e340 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4070280 tx=0x7fa0b4009040 comp rx=0 tx=0).stop 2024-05-20T18:02:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c406c180 msgr2=0x7fa0c4156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c406c180 0x7fa0c4156300 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0034040 tx=0x7fa0c0004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 shutdown_connections 2024-05-20T18:02:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa0a806be30 0x7fa0a806e340 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0c415f700 0x7fa0c415e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0c40af030 0x7fa0c415e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 --2- 172.21.15.6:0/606179261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0c406c180 0x7fa0c4156300 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 >> 172.21.15.6:0/606179261 conn(0x7fa0c40b6620 msgr2=0x7fa0c409a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 shutdown_connections 2024-05-20T18:02:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:35.885+0000 7fa0cb972640 1 -- 172.21.15.6:0/606179261 wait complete. 2024-05-20T18:02:35.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.010+0000 7f2b34945640 1 Processor -- start 2024-05-20T18:02:36.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.010+0000 7f2b34945640 1 -- start start 2024-05-20T18:02:36.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b34945640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b3015f220 0x7f2b300d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b34945640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2b300cfae0 0x7f2b300ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b34945640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b300cda20 con 0x7f2b300d0e00 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b34945640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f2b300cdd00 con 0x7f2b3015f220 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b34945640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2b300cdfe0 con 0x7f2b300cfae0 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b3015f220 0x7f2b300d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2dd9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2b300d0e00 0x7f2b300cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47864/0 (socket says 172.21.15.6:47864) 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2dd9b640 1 -- 172.21.15.6:0/1487044561 learned_addr learned my addr 172.21.15.6:0/1487044561 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2ed9d640 1 --2- 172.21.15.6:0/1487044561 >> v2:172.21.15.171:3300/0 conn(0x7f2b300cfae0 0x7f2b300ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2e59c640 1 -- 172.21.15.6:0/1487044561 >> v2:172.21.15.171:3300/0 conn(0x7f2b300cfae0 msgr2=0x7f2b300ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2e59c640 1 --2- 172.21.15.6:0/1487044561 >> v2:172.21.15.171:3300/0 conn(0x7f2b300cfae0 0x7f2b300ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2e59c640 1 -- 172.21.15.6:0/1487044561 >> v1:172.21.15.6:6789/0 conn(0x7f2b300d0e00 legacy=0x7f2b300cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2e59c640 1 -- 172.21.15.6:0/1487044561 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b300ce2c0 con 0x7f2b3015f220 2024-05-20T18:02:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.012+0000 7f2b2d59a640 1 -- 172.21.15.6:0/1487044561 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038103160 0 0) 0x7f2b300cda20 con 0x7f2b300d0e00 2024-05-20T18:02:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.013+0000 7f2b2e59c640 1 --2- 172.21.15.6:0/1487044561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b3015f220 0x7f2b300d08c0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f2b3006e3e0 tx=0x7f2b2002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8dd326e80d65dc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.013+0000 7f2b2d59a640 1 -- 172.21.15.6:0/1487044561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20037070 con 0x7f2b3015f220 2024-05-20T18:02:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.013+0000 7f2b2d59a640 1 -- 172.21.15.6:0/1487044561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b20032440 con 0x7f2b3015f220 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.013+0000 7f2b2d59a640 1 -- 172.21.15.6:0/1487044561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2002ae60 con 0x7f2b3015f220 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.014+0000 7f2b34945640 1 -- 172.21.15.6:0/1487044561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b3015f220 msgr2=0x7f2b300d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.014+0000 7f2b34945640 1 --2- 172.21.15.6:0/1487044561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b3015f220 0x7f2b300d08c0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f2b3006e3e0 tx=0x7f2b2002a110 comp rx=0 tx=0).stop 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.014+0000 7f2b34945640 1 -- 172.21.15.6:0/1487044561 shutdown_connections 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.014+0000 7f2b34945640 1 --2- 172.21.15.6:0/1487044561 >> v2:172.21.15.171:3300/0 conn(0x7f2b300cfae0 0x7f2b300ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.014+0000 7f2b34945640 1 --2- 172.21.15.6:0/1487044561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b3015f220 0x7f2b300d08c0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.014+0000 7f2b34945640 1 -- 172.21.15.6:0/1487044561 >> 172.21.15.6:0/1487044561 conn(0x7f2b300b44d0 msgr2=0x7f2b300b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.014+0000 7f2b34945640 1 -- 172.21.15.6:0/1487044561 shutdown_connections 2024-05-20T18:02:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.014+0000 7f2b34945640 1 -- 172.21.15.6:0/1487044561 wait complete. 2024-05-20T18:02:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.016+0000 7f2b34945640 1 Processor -- start 2024-05-20T18:02:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.016+0000 7f2b34945640 1 -- start start 2024-05-20T18:02:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b34945640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b300d0e00 0x7f2b30151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b34945640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b3015f220 0x7f2b30161df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b34945640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b30162330 0x7f2b301f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b34945640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3015f7b0 con 0x7f2b300d0e00 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b34945640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3015f630 con 0x7f2b30162330 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b34945640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2b300ced20 con 0x7f2b3015f220 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b2e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b300d0e00 0x7f2b30151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b2e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b300d0e00 0x7f2b30151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43920/0 (socket says 172.21.15.6:43920) 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.017+0000 7f2b2e59c640 1 -- 172.21.15.6:0/2408544863 learned_addr learned my addr 172.21.15.6:0/2408544863 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2dd9b640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b3015f220 0x7f2b30161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2ed9d640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b30162330 0x7f2b301f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2e59c640 1 -- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b3015f220 msgr2=0x7f2b30161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2e59c640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b3015f220 0x7f2b30161df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2e59c640 1 -- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b30162330 msgr2=0x7f2b301f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2e59c640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b30162330 0x7f2b301f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2e59c640 1 -- 172.21.15.6:0/2408544863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b30162740 con 0x7f2b300d0e00 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2ed9d640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b30162330 0x7f2b301f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b2e59c640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b300d0e00 0x7f2b30151560 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f2b20000c00 tx=0x7f2b200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b1effd640 1 -- 172.21.15.6:0/2408544863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20037040 con 0x7f2b300d0e00 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b1effd640 1 -- 172.21.15.6:0/2408544863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b20042070 con 0x7f2b300d0e00 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3015aa30 con 0x7f2b300d0e00 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b1effd640 1 -- 172.21.15.6:0/2408544863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20030bd0 con 0x7f2b300d0e00 2024-05-20T18:02:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.018+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b3015aff0 con 0x7f2b300d0e00 2024-05-20T18:02:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.019+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b300cf050 con 0x7f2b300d0e00 2024-05-20T18:02:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.020+0000 7f2b1effd640 1 -- 172.21.15.6:0/2408544863 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b20047460 con 0x7f2b300d0e00 2024-05-20T18:02:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.021+0000 7f2b1effd640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b1006be30 0x7f2b1006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.021+0000 7f2b1effd640 1 -- 172.21.15.6:0/2408544863 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f2b200ab980 con 0x7f2b300d0e00 2024-05-20T18:02:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.021+0000 7f2b2dd9b640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b1006be30 0x7f2b1006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.021+0000 7f2b2dd9b640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b1006be30 0x7f2b1006e340 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2b300d2710 tx=0x7f2b24007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.025+0000 7f2b1effd640 1 -- 172.21.15.6:0/2408544863 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2b300cf050 con 0x7f2b300d0e00 2024-05-20T18:02:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.213+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b30075b00 con 0x7f2b300d0e00 2024-05-20T18:02:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.215+0000 7f2b1effd640 1 -- 172.21.15.6:0/2408544863 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16844 (secure 0 0 0) 0x7f2b30162740 con 0x7f2b300d0e00 2024-05-20T18:02:36.213 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:36.213 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":137,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:13.150220+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:09.651858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:10.498810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b1006be30 msgr2=0x7f2b1006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b1006be30 0x7f2b1006e340 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2b300d2710 tx=0x7f2b24007de0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b300d0e00 msgr2=0x7f2b30151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b300d0e00 0x7f2b30151560 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f2b20000c00 tx=0x7f2b200046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 shutdown_connections 2024-05-20T18:02:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f2b1006be30 0x7f2b1006e340 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2b30162330 0x7f2b301f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2b3015f220 0x7f2b30161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 --2- 172.21.15.6:0/2408544863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b300d0e00 0x7f2b30151560 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 >> 172.21.15.6:0/2408544863 conn(0x7f2b300b44d0 msgr2=0x7f2b300b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 shutdown_connections 2024-05-20T18:02:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.217+0000 7f2b34945640 1 -- 172.21.15.6:0/2408544863 wait complete. 2024-05-20T18:02:36.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:02:09.651858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:02:10.498810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:02:36.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:02:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.347+0000 7fd41119d640 1 Processor -- start 2024-05-20T18:02:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.347+0000 7fd41119d640 1 -- start start 2024-05-20T18:02:36.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.348+0000 7fd41119d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd40c0d19b0 0x7fd40c15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.348+0000 7fd41119d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40c1605a0 con 0x7fd40c0b3d70 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.348+0000 7fd41119d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40c15ffe0 con 0x7fd40c0cf860 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.348+0000 7fd41119d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fd40c0b4180 con 0x7fd40c0d19b0 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.348+0000 7fd403fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd40c0b3d70 0x7fd40c0d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47880/0 (socket says 172.21.15.6:47880) 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.348+0000 7fd403fff640 1 -- 172.21.15.6:0/13806470 learned_addr learned my addr 172.21.15.6:0/13806470 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.348+0000 7fd41099c640 1 --2- 172.21.15.6:0/13806470 >> v2:172.21.15.6:3300/0 conn(0x7fd40c0d19b0 0x7fd40c15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.349+0000 7fd40b7fe640 1 -- 172.21.15.6:0/13806470 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994537939 0 0) 0x7fd40c1605a0 con 0x7fd40c0b3d70 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.349+0000 7fd40b7fe640 1 -- 172.21.15.6:0/13806470 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f8003520 con 0x7fd40c0b3d70 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.349+0000 7fd41099c640 1 -- 172.21.15.6:0/13806470 >> v1:172.21.15.171:6789/0 conn(0x7fd40c0cf860 legacy=0x7fd40c163520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.349+0000 7fd41099c640 1 -- 172.21.15.6:0/13806470 >> v1:172.21.15.6:6789/0 conn(0x7fd40c0b3d70 legacy=0x7fd40c0d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.349+0000 7fd41099c640 1 -- 172.21.15.6:0/13806470 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c1602c0 con 0x7fd40c0d19b0 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.349+0000 7fd41099c640 1 --2- 172.21.15.6:0/13806470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0d19b0 0x7fd40c15f680 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fd404009d90 tx=0x7fd40402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fcbc6457774574 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd40b7fe640 1 -- 172.21.15.6:0/13806470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd404007740 con 0x7fd40c0d19b0 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd40b7fe640 1 -- 172.21.15.6:0/13806470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4040078e0 con 0x7fd40c0d19b0 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd40b7fe640 1 -- 172.21.15.6:0/13806470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd404007c90 con 0x7fd40c0d19b0 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd41119d640 1 -- 172.21.15.6:0/13806470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0d19b0 msgr2=0x7fd40c15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd41119d640 1 --2- 172.21.15.6:0/13806470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0d19b0 0x7fd40c15f680 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fd404009d90 tx=0x7fd40402a660 comp rx=0 tx=0).stop 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd41119d640 1 -- 172.21.15.6:0/13806470 shutdown_connections 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd41119d640 1 --2- 172.21.15.6:0/13806470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0d19b0 0x7fd40c15f680 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd41119d640 1 -- 172.21.15.6:0/13806470 >> 172.21.15.6:0/13806470 conn(0x7fd40c06dbb0 msgr2=0x7fd40c06b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd41119d640 1 -- 172.21.15.6:0/13806470 shutdown_connections 2024-05-20T18:02:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.350+0000 7fd41119d640 1 -- 172.21.15.6:0/13806470 wait complete. 2024-05-20T18:02:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.352+0000 7fd41119d640 1 Processor -- start 2024-05-20T18:02:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.352+0000 7fd41119d640 1 -- start start 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41119d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd40c0b3d70 0x7fd40c0b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41119d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0cf860 0x7fd40c1f9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41119d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd40c0d19b0 0x7fd40c1f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41119d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c15fbc0 con 0x7fd40c0cf860 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41119d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c163000 con 0x7fd40c0d19b0 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41119d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd40c15fd40 con 0x7fd40c0b3d70 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0cf860 0x7fd40c1f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0cf860 0x7fd40c1f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43946/0 (socket says 172.21.15.6:43946) 2024-05-20T18:02:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 -- 172.21.15.6:0/3509528482 learned_addr learned my addr 172.21.15.6:0/3509528482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41099c640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd40c0d19b0 0x7fd40c1f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd40bfff640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd40c0b3d70 0x7fd40c0b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 -- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd40c0b3d70 msgr2=0x7fd40c0b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd40c0b3d70 0x7fd40c0b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 -- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd40c0d19b0 msgr2=0x7fd40c1f9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd40c0d19b0 0x7fd40c1f9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 -- 172.21.15.6:0/3509528482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c1f5e70 con 0x7fd40c0cf860 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41099c640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd40c0d19b0 0x7fd40c1f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd403fff640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0cf860 0x7fd40c1f9810 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400c440 tx=0x7fd3f400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd4097fa640 1 -- 172.21.15.6:0/3509528482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4017070 con 0x7fd40c0cf860 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd4097fa640 1 -- 172.21.15.6:0/3509528482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f4005ce0 con 0x7fd40c0cf860 2024-05-20T18:02:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c0b70b0 con 0x7fd40c0cf860 2024-05-20T18:02:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.354+0000 7fd4097fa640 1 -- 172.21.15.6:0/3509528482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40072b0 con 0x7fd40c0cf860 2024-05-20T18:02:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.355+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c0b4fa0 con 0x7fd40c0cf860 2024-05-20T18:02:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.355+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40c075980 con 0x7fd40c0cf860 2024-05-20T18:02:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.356+0000 7fd4097fa640 1 -- 172.21.15.6:0/3509528482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3f401a070 con 0x7fd40c0cf860 2024-05-20T18:02:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.357+0000 7fd4097fa640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd3ec06be30 0x7fd3ec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.357+0000 7fd4097fa640 1 -- 172.21.15.6:0/3509528482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fd3f408a350 con 0x7fd40c0cf860 2024-05-20T18:02:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.357+0000 7fd40bfff640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd3ec06be30 0x7fd3ec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.357+0000 7fd40bfff640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd3ec06be30 0x7fd3ec06e340 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0d11f0 tx=0x7fd3fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.361+0000 7fd4097fa640 1 -- 172.21.15.6:0/3509528482 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd3f4058550 con 0x7fd40c0cf860 2024-05-20T18:02:36.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.543+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd40c15e450 con 0x7fd40c0cf860 2024-05-20T18:02:36.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.544+0000 7fd4097fa640 1 -- 172.21.15.6:0/3509528482 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) ==== 93+0+10 (secure 0 0 0) 0x7fd3f405c850 con 0x7fd40c0cf860 2024-05-20T18:02:36.548 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:02:36.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.545+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd3ec06be30 msgr2=0x7fd3ec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.545+0000 7fd41119d640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd3ec06be30 0x7fd3ec06e340 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0d11f0 tx=0x7fd3fc009040 comp rx=0 tx=0).stop 2024-05-20T18:02:36.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0cf860 msgr2=0x7fd40c1f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0cf860 0x7fd40c1f9810 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400c440 tx=0x7fd3f400c900 comp rx=0 tx=0).stop 2024-05-20T18:02:36.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 shutdown_connections 2024-05-20T18:02:36.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd3ec06be30 0x7fd3ec06e340 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd40c0d19b0 0x7fd40c1f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0cf860 0x7fd40c1f9810 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 --2- 172.21.15.6:0/3509528482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd40c0b3d70 0x7fd40c0b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 >> 172.21.15.6:0/3509528482 conn(0x7fd40c06dbb0 msgr2=0x7fd40c0d5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:36.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 shutdown_connections 2024-05-20T18:02:36.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.546+0000 7fd41119d640 1 -- 172.21.15.6:0/3509528482 wait complete. 2024-05-20T18:02:36.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:02:36.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.679+0000 7fb403c3d640 1 Processor -- start 2024-05-20T18:02:36.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.679+0000 7fb403c3d640 1 -- start start 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb403c3d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3fc0b1e10 0x7fb3fc15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb403c3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc070850 0x7fb3fc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb403c3d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3fc0cd580 con 0x7fb3fc15d530 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb403c3d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb3fc0ce190 con 0x7fb3fc0b1e10 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb403c3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3fc0cd860 con 0x7fb3fc070850 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb4011d8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3fc0b1e10 0x7fb3fc15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb4011d8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3fc0b1e10 0x7fb3fc15aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43954/0 (socket says 172.21.15.6:43954) 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb4011d8640 1 -- 172.21.15.6:0/1328632028 learned_addr learned my addr 172.21.15.6:0/1328632028 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.680+0000 7fb4021da640 1 --2- 172.21.15.6:0/1328632028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc070850 0x7fb3fc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.681+0000 7fb4011d8640 1 -- 172.21.15.6:0/1328632028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc070850 msgr2=0x7fb3fc070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.681+0000 7fb4011d8640 1 --2- 172.21.15.6:0/1328632028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc070850 0x7fb3fc070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.681+0000 7fb4011d8640 1 -- 172.21.15.6:0/1328632028 >> v1:172.21.15.171:6789/0 conn(0x7fb3fc15d530 legacy=0x7fb3fc0b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.681+0000 7fb4011d8640 1 -- 172.21.15.6:0/1328632028 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3fc0cdb40 con 0x7fb3fc0b1e10 2024-05-20T18:02:36.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.681+0000 7fb4009d7640 1 -- 172.21.15.6:0/1328632028 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669740339 0 0) 0x7fb3fc0cd580 con 0x7fb3fc15d530 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.681+0000 7fb4011d8640 1 --2- 172.21.15.6:0/1328632028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc0b1e10 0x7fb3fc15aaa0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009870 tx=0x7fb3f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c0424c958307d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb4009d7640 1 -- 172.21.15.6:0/1328632028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0037070 con 0x7fb3fc0b1e10 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb4009d7640 1 -- 172.21.15.6:0/1328632028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f0032440 con 0x7fb3fc0b1e10 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb4009d7640 1 -- 172.21.15.6:0/1328632028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0032810 con 0x7fb3fc0b1e10 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb403c3d640 1 -- 172.21.15.6:0/1328632028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc0b1e10 msgr2=0x7fb3fc15aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb403c3d640 1 --2- 172.21.15.6:0/1328632028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc0b1e10 0x7fb3fc15aaa0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009870 tx=0x7fb3f002a270 comp rx=0 tx=0).stop 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb403c3d640 1 -- 172.21.15.6:0/1328632028 shutdown_connections 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb403c3d640 1 --2- 172.21.15.6:0/1328632028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc070850 0x7fb3fc070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb403c3d640 1 --2- 172.21.15.6:0/1328632028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc0b1e10 0x7fb3fc15aaa0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.682+0000 7fb403c3d640 1 -- 172.21.15.6:0/1328632028 >> 172.21.15.6:0/1328632028 conn(0x7fb3fc0d29d0 msgr2=0x7fb3fc0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:36.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.683+0000 7fb403c3d640 1 -- 172.21.15.6:0/1328632028 shutdown_connections 2024-05-20T18:02:36.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.683+0000 7fb403c3d640 1 -- 172.21.15.6:0/1328632028 wait complete. 2024-05-20T18:02:36.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.684+0000 7fb403c3d640 1 Processor -- start 2024-05-20T18:02:36.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.684+0000 7fb403c3d640 1 -- start start 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb403c3d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3fc070850 0x7fb3fc0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb403c3d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc0b1e10 0x7fb3fc152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb403c3d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc15d530 0x7fb3fc15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb403c3d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc0711a0 con 0x7fb3fc15d530 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb403c3d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc0cd230 con 0x7fb3fc070850 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb403c3d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb3fc071320 con 0x7fb3fc0b1e10 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc15d530 0x7fb3fc15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc15d530 0x7fb3fc15f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43960/0 (socket says 172.21.15.6:43960) 2024-05-20T18:02:36.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 -- 172.21.15.6:0/181182701 learned_addr learned my addr 172.21.15.6:0/181182701 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4019d9640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3fc070850 0x7fb3fc0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4011d8640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc0b1e10 0x7fb3fc152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 -- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc0b1e10 msgr2=0x7fb3fc152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc0b1e10 0x7fb3fc152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 -- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3fc070850 msgr2=0x7fb3fc0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3fc070850 0x7fb3fc0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 -- 172.21.15.6:0/181182701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3fc15a2d0 con 0x7fb3fc15d530 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.686+0000 7fb4021da640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc15d530 0x7fb3fc15f770 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00efc0 tx=0x7fb3ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.687+0000 7fb3fa7fc640 1 -- 172.21.15.6:0/181182701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec018020 con 0x7fb3fc15d530 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.687+0000 7fb3fa7fc640 1 -- 172.21.15.6:0/181182701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ec014480 con 0x7fb3fc15d530 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.687+0000 7fb3fa7fc640 1 -- 172.21.15.6:0/181182701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec009e60 con 0x7fb3fc15d530 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.687+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3fc153420 con 0x7fb3fc15d530 2024-05-20T18:02:36.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.687+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3fc0cb730 con 0x7fb3fc15d530 2024-05-20T18:02:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.688+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3fc075b00 con 0x7fb3fc15d530 2024-05-20T18:02:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.688+0000 7fb3fa7fc640 1 -- 172.21.15.6:0/181182701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3ec005d10 con 0x7fb3fc15d530 2024-05-20T18:02:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.689+0000 7fb3fa7fc640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb3e806be60 0x7fb3e806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:36.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.689+0000 7fb3fa7fc640 1 -- 172.21.15.6:0/181182701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fb3ec08bd00 con 0x7fb3fc15d530 2024-05-20T18:02:36.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.689+0000 7fb4019d9640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb3e806be60 0x7fb3e806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:36.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.690+0000 7fb4019d9640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb3e806be60 0x7fb3e806e370 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4000f60 tx=0x7fb3f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.694+0000 7fb3fa7fc640 1 -- 172.21.15.6:0/181182701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb3ec022030 con 0x7fb3fc15d530 2024-05-20T18:02:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.876+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb3fc0cc210 con 0x7fb3fc15d530 2024-05-20T18:02:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.877+0000 7fb3fa7fc640 1 -- 172.21.15.6:0/181182701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) ==== 104+0+11 (secure 0 0 0) 0x7fb3fc15a2d0 con 0x7fb3fc15d530 2024-05-20T18:02:36.875 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:02:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb3e806be60 msgr2=0x7fb3e806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb3e806be60 0x7fb3e806e370 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4000f60 tx=0x7fb3f4009040 comp rx=0 tx=0).stop 2024-05-20T18:02:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc15d530 msgr2=0x7fb3fc15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc15d530 0x7fb3fc15f770 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec00efc0 tx=0x7fb3ec00c490 comp rx=0 tx=0).stop 2024-05-20T18:02:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 shutdown_connections 2024-05-20T18:02:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb3e806be60 0x7fb3e806e370 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3fc15d530 0x7fb3fc15f770 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3fc0b1e10 0x7fb3fc152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 --2- 172.21.15.6:0/181182701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3fc070850 0x7fb3fc0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 >> 172.21.15.6:0/181182701 conn(0x7fb3fc0d29d0 msgr2=0x7fb3fc0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 shutdown_connections 2024-05-20T18:02:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:36.879+0000 7fb403c3d640 1 -- 172.21.15.6:0/181182701 wait complete. 2024-05-20T18:02:36.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:02:37.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.008+0000 7f4c665aa640 1 Processor -- start 2024-05-20T18:02:37.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.009+0000 7f4c665aa640 1 -- start start 2024-05-20T18:02:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c665aa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4c60162820 0x7f4c600b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c665aa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c600d0630 con 0x7f4c600b3e80 2024-05-20T18:02:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c665aa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c600d39c0 con 0x7f4c6006dae0 2024-05-20T18:02:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c665aa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4c600d3ca0 con 0x7f4c60162820 2024-05-20T18:02:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c57fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4c600b3e80 0x7f4c6006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47884/0 (socket says 172.21.15.6:47884) 2024-05-20T18:02:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c57fff640 1 -- 172.21.15.6:0/230249068 learned_addr learned my addr 172.21.15.6:0/230249068 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/230249068 >> v2:172.21.15.171:3300/0 conn(0x7f4c60162820 0x7f4c600b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778269381 0 0) 0x7f4c600d0630 con 0x7f4c600b3e80 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.010+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c4c003520 con 0x7f4c600b3e80 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3765094916 0 0) 0x7f4c4c003520 con 0x7f4c600b3e80 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 >> v2:172.21.15.171:3300/0 conn(0x7f4c60162820 msgr2=0x7f4c600b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 --2- 172.21.15.6:0/230249068 >> v2:172.21.15.171:3300/0 conn(0x7f4c60162820 0x7f4c600b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 >> v1:172.21.15.171:6789/0 conn(0x7f4c6006dae0 legacy=0x7f4c600b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c600d3f80 con 0x7f4c600b3e80 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f4c48001670 con 0x7f4c600b3e80 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 >> v1:172.21.15.6:6789/0 conn(0x7f4c600b3e80 legacy=0x7f4c6006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c4c0039b0 0x7f4c4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c4c004800 0x7f4c4c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0051c0 0x7f4c4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4c600d3ca0 con 0x7f4c4c0039b0 2024-05-20T18:02:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c00c160 con 0x7f4c4c0051c0 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c00c360 con 0x7f4c4c004800 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c4c0039b0 0x7f4c4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c57fff640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c4c004800 0x7f4c4c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c64b47640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0051c0 0x7f4c4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5ffff640 1 -- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c4c004800 msgr2=0x7f4c4c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c4c004800 0x7f4c4c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5ffff640 1 -- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0051c0 msgr2=0x7f4c4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0051c0 0x7f4c4c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c5ffff640 1 -- 172.21.15.6:0/230249068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c003520 con 0x7f4c4c0039b0 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c64b47640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0051c0 0x7f4c4c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.011+0000 7f4c64b47640 1 -- 172.21.15.6:0/230249068 reap_dead start 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.012+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c4c0039b0 0x7f4c4c003e20 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009ac0 tx=0x7f4c4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3760c7b48bc32a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.012+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50036070 con 0x7f4c4c0039b0 2024-05-20T18:02:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.012+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c50031400 con 0x7f4c4c0039b0 2024-05-20T18:02:37.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.012+0000 7f4c5f7fe640 1 -- 172.21.15.6:0/230249068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50009690 con 0x7f4c4c0039b0 2024-05-20T18:02:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.013+0000 7f4c665aa640 1 -- 172.21.15.6:0/230249068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c4c0039b0 msgr2=0x7f4c4c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.013+0000 7f4c665aa640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c4c0039b0 0x7f4c4c003e20 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009ac0 tx=0x7f4c4c005830 comp rx=0 tx=0).stop 2024-05-20T18:02:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.013+0000 7f4c665aa640 1 -- 172.21.15.6:0/230249068 shutdown_connections 2024-05-20T18:02:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.013+0000 7f4c665aa640 1 --2- 172.21.15.6:0/230249068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c4c0039b0 0x7f4c4c003e20 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.013+0000 7f4c665aa640 1 -- 172.21.15.6:0/230249068 >> 172.21.15.6:0/230249068 conn(0x7f4c600d4bd0 msgr2=0x7f4c600d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.013+0000 7f4c665aa640 1 -- 172.21.15.6:0/230249068 shutdown_connections 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.013+0000 7f4c665aa640 1 -- 172.21.15.6:0/230249068 wait complete. 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.015+0000 7f4c665aa640 1 Processor -- start 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.015+0000 7f4c665aa640 1 -- start start 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c665aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0039b0 0x7f4c600c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c665aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c6014dbd0 0x7f4c6014aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c665aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6014b430 0x7f4c60161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c665aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f4c600d4780 con 0x7f4c6014dbd0 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c665aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4c600d0300 con 0x7f4c4c0039b0 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c665aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4c600d4900 con 0x7f4c6014b430 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c6014dbd0 0x7f4c6014aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c6014dbd0 0x7f4c6014aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43970/0 (socket says 172.21.15.6:43970) 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c57fff640 1 -- 172.21.15.6:0/978481164 learned_addr learned my addr 172.21.15.6:0/978481164 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c64b47640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6014b430 0x7f4c60161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0039b0 0x7f4c600c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c57fff640 1 -- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6014b430 msgr2=0x7f4c60161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c57fff640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6014b430 0x7f4c60161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c57fff640 1 -- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0039b0 msgr2=0x7f4c600c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c57fff640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0039b0 0x7f4c600c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.016+0000 7f4c57fff640 1 -- 172.21.15.6:0/978481164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c600ca800 con 0x7f4c6014dbd0 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.017+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0039b0 0x7f4c600c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.017+0000 7f4c57fff640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c6014dbd0 0x7f4c6014aef0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4c48007370 tx=0x7f4c48007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.017+0000 7f4c5d7fa640 1 -- 172.21.15.6:0/978481164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4801a070 con 0x7f4c6014dbd0 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.017+0000 7f4c5d7fa640 1 -- 172.21.15.6:0/978481164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4800f940 con 0x7f4c6014dbd0 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.017+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c600caae0 con 0x7f4c6014dbd0 2024-05-20T18:02:37.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.017+0000 7f4c5d7fa640 1 -- 172.21.15.6:0/978481164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800fd50 con 0x7f4c6014dbd0 2024-05-20T18:02:37.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.017+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c600cb0a0 con 0x7f4c6014dbd0 2024-05-20T18:02:37.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.018+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c60075b00 con 0x7f4c6014dbd0 2024-05-20T18:02:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.019+0000 7f4c5d7fa640 1 -- 172.21.15.6:0/978481164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c4801d070 con 0x7f4c6014dbd0 2024-05-20T18:02:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.019+0000 7f4c5d7fa640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4c4006be30 0x7f4c4006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.019+0000 7f4c5d7fa640 1 -- 172.21.15.6:0/978481164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f4c4808aae0 con 0x7f4c6014dbd0 2024-05-20T18:02:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.020+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4c4006be30 0x7f4c4006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.020+0000 7f4c5ffff640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4c4006be30 0x7f4c4006e340 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4c50033000 tx=0x7f4c50008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.024+0000 7f4c5d7fa640 1 -- 172.21.15.6:0/978481164 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4c48059270 con 0x7f4c6014dbd0 2024-05-20T18:02:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.212+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4c600d5290 con 0x7f4c6014dbd0 2024-05-20T18:02:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.212+0000 7f4c5d7fa640 1 -- 172.21.15.6:0/978481164 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) ==== 100+0+11 (secure 0 0 0) 0x7f4c48058b70 con 0x7f4c6014dbd0 2024-05-20T18:02:37.211 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4c4006be30 msgr2=0x7f4c4006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4c4006be30 0x7f4c4006e340 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4c50033000 tx=0x7f4c50008030 comp rx=0 tx=0).stop 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c6014dbd0 msgr2=0x7f4c6014aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c6014dbd0 0x7f4c6014aef0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4c48007370 tx=0x7f4c48007830 comp rx=0 tx=0).stop 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 shutdown_connections 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f4c4006be30 0x7f4c4006e340 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4c6014b430 0x7f4c60161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c6014dbd0 0x7f4c6014aef0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 --2- 172.21.15.6:0/978481164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c4c0039b0 0x7f4c600c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 >> 172.21.15.6:0/978481164 conn(0x7f4c600d4bd0 msgr2=0x7f4c6015e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 shutdown_connections 2024-05-20T18:02:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.214+0000 7f4c665aa640 1 -- 172.21.15.6:0/978481164 wait complete. 2024-05-20T18:02:37.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.341+0000 7ffa455e3640 1 Processor -- start 2024-05-20T18:02:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.341+0000 7ffa455e3640 1 -- start start 2024-05-20T18:02:37.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa455e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa40162820 0x7ffa400b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa455e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa400b3e80 0x7ffa4006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa455e3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffa4006d910 0x7ffa400d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa455e3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7ffa4006dd20 con 0x7ffa40162820 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa455e3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ffa400d0630 con 0x7ffa4006d910 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa455e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa400d39c0 con 0x7ffa400b3e80 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa3effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa40162820 0x7ffa400b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa3effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa40162820 0x7ffa400b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43984/0 (socket says 172.21.15.6:43984) 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa3effd640 1 -- 172.21.15.6:0/3644774391 learned_addr learned my addr 172.21.15.6:0/3644774391 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa37fff640 1 --2- 172.21.15.6:0/3644774391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa400b3e80 0x7ffa4006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa3f7fe640 1 --2- 172.21.15.6:0/3644774391 >> v2:172.21.15.171:3300/0 conn(0x7ffa4006d910 0x7ffa400d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa3effd640 1 -- 172.21.15.6:0/3644774391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa400b3e80 msgr2=0x7ffa4006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa3effd640 1 --2- 172.21.15.6:0/3644774391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa400b3e80 0x7ffa4006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa3effd640 1 -- 172.21.15.6:0/3644774391 >> v2:172.21.15.171:3300/0 conn(0x7ffa4006d910 msgr2=0x7ffa400d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.342+0000 7ffa3effd640 1 --2- 172.21.15.6:0/3644774391 >> v2:172.21.15.171:3300/0 conn(0x7ffa4006d910 0x7ffa400d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.343+0000 7ffa3effd640 1 -- 172.21.15.6:0/3644774391 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa400d3ca0 con 0x7ffa40162820 2024-05-20T18:02:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.343+0000 7ffa37fff640 1 --2- 172.21.15.6:0/3644774391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa400b3e80 0x7ffa4006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.343+0000 7ffa3f7fe640 1 --2- 172.21.15.6:0/3644774391 >> v2:172.21.15.171:3300/0 conn(0x7ffa4006d910 0x7ffa400d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.343+0000 7ffa3effd640 1 --2- 172.21.15.6:0/3644774391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40162820 0x7ffa400b3940 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ffa4008d5e0 tx=0x7ffa3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcf7daecb50213 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.343+0000 7ffa3e7fc640 1 -- 172.21.15.6:0/3644774391 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30037070 con 0x7ffa40162820 2024-05-20T18:02:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.343+0000 7ffa3e7fc640 1 -- 172.21.15.6:0/3644774391 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa30032440 con 0x7ffa40162820 2024-05-20T18:02:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.343+0000 7ffa3e7fc640 1 -- 172.21.15.6:0/3644774391 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30032810 con 0x7ffa40162820 2024-05-20T18:02:37.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 -- 172.21.15.6:0/3644774391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40162820 msgr2=0x7ffa400b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 --2- 172.21.15.6:0/3644774391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40162820 0x7ffa400b3940 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ffa4008d5e0 tx=0x7ffa3002a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 -- 172.21.15.6:0/3644774391 shutdown_connections 2024-05-20T18:02:37.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 --2- 172.21.15.6:0/3644774391 >> v2:172.21.15.171:3300/0 conn(0x7ffa4006d910 0x7ffa400d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 --2- 172.21.15.6:0/3644774391 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa400b3e80 0x7ffa4006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 --2- 172.21.15.6:0/3644774391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa40162820 0x7ffa400b3940 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 -- 172.21.15.6:0/3644774391 >> 172.21.15.6:0/3644774391 conn(0x7ffa400d4bd0 msgr2=0x7ffa400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 -- 172.21.15.6:0/3644774391 shutdown_connections 2024-05-20T18:02:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.344+0000 7ffa455e3640 1 -- 172.21.15.6:0/3644774391 wait complete. 2024-05-20T18:02:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.346+0000 7ffa455e3640 1 Processor -- start 2024-05-20T18:02:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.346+0000 7ffa455e3640 1 -- start start 2024-05-20T18:02:37.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.347+0000 7ffa455e3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa4006d910 0x7ffa4014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.347+0000 7ffa455e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa400b3e80 0x7ffa400cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.347+0000 7ffa455e3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa40162820 0x7ffa400ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.347+0000 7ffa455e3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ffa400d0300 con 0x7ffa400b3e80 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.347+0000 7ffa455e3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa400d4260 con 0x7ffa40162820 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.347+0000 7ffa455e3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffa400d4780 con 0x7ffa4006d910 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa400b3e80 0x7ffa400cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa400b3e80 0x7ffa400cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43996/0 (socket says 172.21.15.6:43996) 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 -- 172.21.15.6:0/37236782 learned_addr learned my addr 172.21.15.6:0/37236782 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa3f7fe640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa40162820 0x7ffa400ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa3effd640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa4006d910 0x7ffa4014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 -- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa4006d910 msgr2=0x7ffa4014a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa4006d910 0x7ffa4014a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 -- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa40162820 msgr2=0x7ffa400ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa40162820 0x7ffa400ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 -- 172.21.15.6:0/37236782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa400ceb40 con 0x7ffa400b3e80 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa3effd640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa4006d910 0x7ffa4014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa3f7fe640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa40162820 0x7ffa400ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa37fff640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa400b3e80 0x7ffa400cdda0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c820 tx=0x7ffa2800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa377fe640 1 -- 172.21.15.6:0/37236782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28015070 con 0x7ffa400b3e80 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa377fe640 1 -- 172.21.15.6:0/37236782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa28007a30 con 0x7ffa400b3e80 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa400cee20 con 0x7ffa400b3e80 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.348+0000 7ffa377fe640 1 -- 172.21.15.6:0/37236782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28007de0 con 0x7ffa400b3e80 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.349+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa400cf3e0 con 0x7ffa400b3e80 2024-05-20T18:02:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.349+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa400ce8b0 con 0x7ffa400b3e80 2024-05-20T18:02:37.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.350+0000 7ffa377fe640 1 -- 172.21.15.6:0/37236782 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa28018070 con 0x7ffa400b3e80 2024-05-20T18:02:37.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.350+0000 7ffa377fe640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa2006be30 0x7ffa2006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.351+0000 7ffa377fe640 1 -- 172.21.15.6:0/37236782 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7ffa2808af80 con 0x7ffa400b3e80 2024-05-20T18:02:37.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.351+0000 7ffa3effd640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa2006be30 0x7ffa2006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.351+0000 7ffa3effd640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa2006be30 0x7ffa2006e340 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ffa30034000 tx=0x7ffa3002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.355+0000 7ffa377fe640 1 -- 172.21.15.6:0/37236782 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffa28059710 con 0x7ffa400b3e80 2024-05-20T18:02:37.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:02:37.384 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:02:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.576+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa40075b00 con 0x7ffa400b3e80 2024-05-20T18:02:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.577+0000 7ffa377fe640 1 -- 172.21.15.6:0/37236782 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5182 (secure 0 0 0) 0x7ffa28059010 con 0x7ffa400b3e80 2024-05-20T18:02:37.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:37.575 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":99,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:11.519092+0000","modified":"2024-05-20T18:02:32.173141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6835/1253645410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1253645410},{"type":"v1","addr":"172.21.15.6:6835","nonce":1253645410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":10}]} 2024-05-20T18:02:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 99 2024-05-20T18:02:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa2006be30 msgr2=0x7ffa2006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa2006be30 0x7ffa2006e340 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ffa30034000 tx=0x7ffa3002e000 comp rx=0 tx=0).stop 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa400b3e80 msgr2=0x7ffa400cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa400b3e80 0x7ffa400cdda0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c820 tx=0x7ffa2800cce0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 shutdown_connections 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ffa2006be30 0x7ffa2006e340 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa40162820 0x7ffa400ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa400b3e80 0x7ffa400cdda0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 --2- 172.21.15.6:0/37236782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa4006d910 0x7ffa4014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 >> 172.21.15.6:0/37236782 conn(0x7ffa400d4bd0 msgr2=0x7ffa400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 shutdown_connections 2024-05-20T18:02:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.579+0000 7ffa455e3640 1 -- 172.21.15.6:0/37236782 wait complete. 2024-05-20T18:02:37.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.705+0000 7f0699f2f640 1 Processor -- start 2024-05-20T18:02:37.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.705+0000 7f0699f2f640 1 -- start start 2024-05-20T18:02:37.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.706+0000 7f0699f2f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f069406d3d0 0x7f069406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.706+0000 7f0699f2f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069406dd20 con 0x7f06940b8190 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.706+0000 7f0699f2f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06940d0630 con 0x7f0694162820 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.706+0000 7f0699f2f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f06940d39c0 con 0x7f069406d3d0 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.706+0000 7f0692ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f069406d3d0 0x7f069406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.706+0000 7f0692ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f069406d3d0 0x7f069406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32900/0 (socket says 172.21.15.6:32900) 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.706+0000 7f0693fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f06940b8190 0x7f06940b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39502/0 (socket says 172.21.15.6:39502) 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.706+0000 7f0692ffd640 1 -- 172.21.15.6:0/4096090025 learned_addr learned my addr 172.21.15.6:0/4096090025 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.707+0000 7f0692ffd640 1 -- 172.21.15.6:0/4096090025 >> v1:172.21.15.171:6789/0 conn(0x7f0694162820 legacy=0x7f06940b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.707+0000 7f0692ffd640 1 -- 172.21.15.6:0/4096090025 >> v1:172.21.15.6:6789/0 conn(0x7f06940b8190 legacy=0x7f06940b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.707+0000 7f0692ffd640 1 -- 172.21.15.6:0/4096090025 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06940d3ca0 con 0x7f069406d3d0 2024-05-20T18:02:37.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.707+0000 7f06927fc640 1 -- 172.21.15.6:0/4096090025 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258312252 0 0) 0x7f068c001490 con 0x7f06940b8190 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.707+0000 7f0692ffd640 1 --2- 172.21.15.6:0/4096090025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069406d7e0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f067c009870 tx=0x7f067c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6dd1271dc61d32 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.707+0000 7f06927fc640 1 -- 172.21.15.6:0/4096090025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c037070 con 0x7f069406d3d0 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f06927fc640 1 -- 172.21.15.6:0/4096090025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c032440 con 0x7f069406d3d0 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f06927fc640 1 -- 172.21.15.6:0/4096090025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c032810 con 0x7f069406d3d0 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f0699f2f640 1 -- 172.21.15.6:0/4096090025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 msgr2=0x7f069406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f0699f2f640 1 --2- 172.21.15.6:0/4096090025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069406d7e0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f067c009870 tx=0x7f067c02a2a0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f0699f2f640 1 -- 172.21.15.6:0/4096090025 shutdown_connections 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f0699f2f640 1 --2- 172.21.15.6:0/4096090025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069406d7e0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f0699f2f640 1 -- 172.21.15.6:0/4096090025 >> 172.21.15.6:0/4096090025 conn(0x7f06940d4bd0 msgr2=0x7f06940d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f0699f2f640 1 -- 172.21.15.6:0/4096090025 shutdown_connections 2024-05-20T18:02:37.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.708+0000 7f0699f2f640 1 -- 172.21.15.6:0/4096090025 wait complete. 2024-05-20T18:02:37.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.710+0000 7f0699f2f640 1 Processor -- start 2024-05-20T18:02:37.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.710+0000 7f0699f2f640 1 -- start start 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0699f2f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0699f2f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940b8190 0x7f06940b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0699f2f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0694162820 0x7f069415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0699f2f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f06940d0300 con 0x7f069406d3d0 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0699f2f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f06940d42e0 con 0x7f0694162820 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0699f2f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f06940b4050 con 0x7f06940b8190 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069414b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32916/0 (socket says 172.21.15.6:32916) 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 -- 172.21.15.6:0/1601822819 learned_addr learned my addr 172.21.15.6:0/1601822819 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0692ffd640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940b8190 0x7f06940b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0693fff640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0694162820 0x7f069415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 -- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940b8190 msgr2=0x7f06940b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940b8190 0x7f06940b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 -- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0694162820 msgr2=0x7f069415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0694162820 0x7f069415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 -- 172.21.15.6:0/1601822819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06940b4cc0 con 0x7f069406d3d0 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0693fff640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0694162820 0x7f069415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f06937fe640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069414b160 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f068400b3f0 tx=0x7f068400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f068bfff640 1 -- 172.21.15.6:0/1601822819 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684015020 con 0x7f069406d3d0 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f068bfff640 1 -- 172.21.15.6:0/1601822819 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684011830 con 0x7f069406d3d0 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f068bfff640 1 -- 172.21.15.6:0/1601822819 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684011c20 con 0x7f069406d3d0 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.712+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06940b4fa0 con 0x7f069406d3d0 2024-05-20T18:02:37.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.713+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06940b5560 con 0x7f069406d3d0 2024-05-20T18:02:37.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.714+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0694075b00 con 0x7f069406d3d0 2024-05-20T18:02:37.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.714+0000 7f068bfff640 1 -- 172.21.15.6:0/1601822819 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0684018020 con 0x7f069406d3d0 2024-05-20T18:02:37.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.715+0000 7f068bfff640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f067406be30 0x7f067406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:37.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.715+0000 7f068bfff640 1 -- 172.21.15.6:0/1601822819 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f068408ac60 con 0x7f069406d3d0 2024-05-20T18:02:37.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.715+0000 7f0692ffd640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f067406be30 0x7f067406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:37.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.716+0000 7f0692ffd640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f067406be30 0x7f067406e340 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f067c034000 tx=0x7f067c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:37.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.719+0000 7f068bfff640 1 -- 172.21.15.6:0/1601822819 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f068401f030 con 0x7f069406d3d0 2024-05-20T18:02:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.903+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f069415d610 con 0x7f069406d3d0 2024-05-20T18:02:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.904+0000 7f068bfff640 1 -- 172.21.15.6:0/1601822819 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16844 (secure 0 0 0) 0x7f06840593f0 con 0x7f069406d3d0 2024-05-20T18:02:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:37.903 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":137,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:13.150220+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:09.651858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:10.498810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f067406be30 msgr2=0x7f067406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f067406be30 0x7f067406e340 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f067c034000 tx=0x7f067c02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 msgr2=0x7f069414b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069414b160 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f068400b3f0 tx=0x7f068400b8b0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 shutdown_connections 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f067406be30 0x7f067406e340 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0694162820 0x7f069415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06940b8190 0x7f06940b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 --2- 172.21.15.6:0/1601822819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f069406d3d0 0x7f069414b160 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.906+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 >> 172.21.15.6:0/1601822819 conn(0x7f06940d4bd0 msgr2=0x7f069415f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.907+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 shutdown_connections 2024-05-20T18:02:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:37.907+0000 7f0699f2f640 1 -- 172.21.15.6:0/1601822819 wait complete. 2024-05-20T18:02:37.916 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T18:02:37.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.032+0000 7f83c063d640 1 Processor -- start 2024-05-20T18:02:38.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.033+0000 7f83c063d640 1 -- start start 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.034+0000 7f83c063d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f83b815d060 0x7f83b80b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.034+0000 7f83c063d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b80b5b30 con 0x7f83b80b47b0 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.034+0000 7f83c063d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b80b39f0 con 0x7f83b80b5720 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.034+0000 7f83c063d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f83b80b3cd0 con 0x7f83b815d060 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.034+0000 7f83be3d9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f83b80b47b0 0x7f83b80afad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39506/0 (socket says 172.21.15.6:39506) 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.034+0000 7f83be3d9640 1 -- 172.21.15.6:0/3529727479 learned_addr learned my addr 172.21.15.6:0/3529727479 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.034+0000 7f83bdbd8640 1 --2- 172.21.15.6:0/3529727479 >> v2:172.21.15.171:3300/0 conn(0x7f83b815d060 0x7f83b80b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.035+0000 7f83bdbd8640 1 -- 172.21.15.6:0/3529727479 >> v1:172.21.15.171:6789/0 conn(0x7f83b80b5720 legacy=0x7f83b806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.035+0000 7f83bdbd8640 1 -- 172.21.15.6:0/3529727479 >> v1:172.21.15.6:6789/0 conn(0x7f83b80b47b0 legacy=0x7f83b80afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.035+0000 7f83bdbd8640 1 -- 172.21.15.6:0/3529727479 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b80b3fb0 con 0x7f83b815d060 2024-05-20T18:02:38.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.036+0000 7f83bdbd8640 1 --2- 172.21.15.6:0/3529727479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 0x7f83b80b51e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f83a80097a0 tx=0x7f83a802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ad61f0153ee2d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.036+0000 7f83bd3d7640 1 -- 172.21.15.6:0/3529727479 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8037070 con 0x7f83b815d060 2024-05-20T18:02:38.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.036+0000 7f83bd3d7640 1 -- 172.21.15.6:0/3529727479 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a8032440 con 0x7f83b815d060 2024-05-20T18:02:38.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.036+0000 7f83bd3d7640 1 -- 172.21.15.6:0/3529727479 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8032810 con 0x7f83b815d060 2024-05-20T18:02:38.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.037+0000 7f83c063d640 1 -- 172.21.15.6:0/3529727479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 msgr2=0x7f83b80b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.037+0000 7f83c063d640 1 --2- 172.21.15.6:0/3529727479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 0x7f83b80b51e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f83a80097a0 tx=0x7f83a802a230 comp rx=0 tx=0).stop 2024-05-20T18:02:38.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.037+0000 7f83c063d640 1 -- 172.21.15.6:0/3529727479 shutdown_connections 2024-05-20T18:02:38.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.037+0000 7f83c063d640 1 --2- 172.21.15.6:0/3529727479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 0x7f83b80b51e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.037+0000 7f83c063d640 1 -- 172.21.15.6:0/3529727479 >> 172.21.15.6:0/3529727479 conn(0x7f83b80cd2a0 msgr2=0x7f83b80cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:38.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.037+0000 7f83c063d640 1 -- 172.21.15.6:0/3529727479 shutdown_connections 2024-05-20T18:02:38.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.037+0000 7f83c063d640 1 -- 172.21.15.6:0/3529727479 wait complete. 2024-05-20T18:02:38.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.039+0000 7f83c063d640 1 Processor -- start 2024-05-20T18:02:38.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.039+0000 7f83c063d640 1 -- start start 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83c063d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83b80b5720 0x7f83b815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83c063d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 0x7f83b814c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83c063d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80cc1b0 0x7f83b815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83c063d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8159de0 con 0x7f83b80cc1b0 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83c063d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8159c60 con 0x7f83b815d060 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83c063d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f83b806fae0 con 0x7f83b80b5720 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80cc1b0 0x7f83b815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80cc1b0 0x7f83b815a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32922/0 (socket says 172.21.15.6:32922) 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 -- 172.21.15.6:0/2116591683 learned_addr learned my addr 172.21.15.6:0/2116591683 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:38.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83be3d9640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83b80b5720 0x7f83b815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bdbd8640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 0x7f83b814c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 -- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83b80b5720 msgr2=0x7f83b815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83b80b5720 0x7f83b815f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 -- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 msgr2=0x7f83b814c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 0x7f83b814c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 -- 172.21.15.6:0/2116591683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b80c9c70 con 0x7f83b80cc1b0 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.041+0000 7f83bebda640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80cc1b0 0x7f83b815a590 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f83b000c6e0 tx=0x7f83b000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.042+0000 7f83aeffd640 1 -- 172.21.15.6:0/2116591683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0003b70 con 0x7f83b80cc1b0 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.042+0000 7f83aeffd640 1 -- 172.21.15.6:0/2116591683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b0003d30 con 0x7f83b80cc1b0 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.042+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b8160060 con 0x7f83b80cc1b0 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.042+0000 7f83aeffd640 1 -- 172.21.15.6:0/2116591683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0005310 con 0x7f83b80cc1b0 2024-05-20T18:02:38.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.042+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b80ca1c0 con 0x7f83b80cc1b0 2024-05-20T18:02:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.043+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b8075b00 con 0x7f83b80cc1b0 2024-05-20T18:02:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.044+0000 7f83aeffd640 1 -- 172.21.15.6:0/2116591683 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83b00054b0 con 0x7f83b80cc1b0 2024-05-20T18:02:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.044+0000 7f83aeffd640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f839c06be60 0x7f839c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.044+0000 7f83aeffd640 1 -- 172.21.15.6:0/2116591683 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f83b008ae00 con 0x7f83b80cc1b0 2024-05-20T18:02:38.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.044+0000 7f83be3d9640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f839c06be60 0x7f839c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.045+0000 7f83be3d9640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f839c06be60 0x7f839c06e370 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f83b4005880 tx=0x7f83b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.049+0000 7f83aeffd640 1 -- 172.21.15.6:0/2116591683 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f83b0058ec0 con 0x7f83b80cc1b0 2024-05-20T18:02:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.270+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83b80ce1f0 con 0x7f83b80cc1b0 2024-05-20T18:02:38.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.270+0000 7f83aeffd640 1 -- 172.21.15.6:0/2116591683 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5182 (secure 0 0 0) 0x7f83b005d1c0 con 0x7f83b80cc1b0 2024-05-20T18:02:38.269 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:38.269 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":99,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:11.519092+0000","modified":"2024-05-20T18:02:32.173141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6835/1253645410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1253645410},{"type":"v1","addr":"172.21.15.6:6835","nonce":1253645410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":10}]} 2024-05-20T18:02:38.269 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 99 2024-05-20T18:02:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f839c06be60 msgr2=0x7f839c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f839c06be60 0x7f839c06e370 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f83b4005880 tx=0x7f83b4009040 comp rx=0 tx=0).stop 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80cc1b0 msgr2=0x7f83b815a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80cc1b0 0x7f83b815a590 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f83b000c6e0 tx=0x7f83b000cba0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 shutdown_connections 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f839c06be60 0x7f839c06e370 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83b80cc1b0 0x7f83b815a590 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83b815d060 0x7f83b814c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 --2- 172.21.15.6:0/2116591683 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83b80b5720 0x7f83b815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 >> 172.21.15.6:0/2116591683 conn(0x7f83b80cd2a0 msgr2=0x7f83b80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 shutdown_connections 2024-05-20T18:02:38.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.272+0000 7f83c063d640 1 -- 172.21.15.6:0/2116591683 wait complete. 2024-05-20T18:02:38.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:38.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.398+0000 7f9637856640 1 Processor -- start 2024-05-20T18:02:38.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.398+0000 7f9637856640 1 -- start start 2024-05-20T18:02:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9637856640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9630162820 0x7f96300b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9637856640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f963006dae0 0x7f96300b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9637856640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96300d0630 con 0x7f96300b3e80 2024-05-20T18:02:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9637856640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f96300d39c0 con 0x7f9630162820 2024-05-20T18:02:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9637856640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f96300d3ca0 con 0x7f963006dae0 2024-05-20T18:02:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9634df1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f96300b3e80 0x7f963006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39522/0 (socket says 172.21.15.6:39522) 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9634df1640 1 -- 172.21.15.6:0/1576528640 learned_addr learned my addr 172.21.15.6:0/1576528640 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9635df3640 1 --2- 172.21.15.6:0/1576528640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f963006dae0 0x7f96300b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f96355f2640 1 --2- 172.21.15.6:0/1576528640 >> v2:172.21.15.171:3300/0 conn(0x7f9630162820 0x7f96300b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9627fff640 1 -- 172.21.15.6:0/1576528640 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471584077 0 0) 0x7f96300d0630 con 0x7f96300b3e80 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9627fff640 1 -- 172.21.15.6:0/1576528640 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f961c003520 con 0x7f96300b3e80 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9635df3640 1 -- 172.21.15.6:0/1576528640 >> v2:172.21.15.171:3300/0 conn(0x7f9630162820 msgr2=0x7f96300b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9635df3640 1 --2- 172.21.15.6:0/1576528640 >> v2:172.21.15.171:3300/0 conn(0x7f9630162820 0x7f96300b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9635df3640 1 -- 172.21.15.6:0/1576528640 >> v1:172.21.15.6:6789/0 conn(0x7f96300b3e80 legacy=0x7f963006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.400+0000 7f9635df3640 1 -- 172.21.15.6:0/1576528640 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96300d3f80 con 0x7f963006dae0 2024-05-20T18:02:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.401+0000 7f9635df3640 1 --2- 172.21.15.6:0/1576528640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f963006dae0 0x7f96300b8190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9628009d90 tx=0x7f962802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d2b403cf0611e63 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9627fff640 1 -- 172.21.15.6:0/1576528640 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628007740 con 0x7f963006dae0 2024-05-20T18:02:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9627fff640 1 -- 172.21.15.6:0/1576528640 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96280078e0 con 0x7f963006dae0 2024-05-20T18:02:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9627fff640 1 -- 172.21.15.6:0/1576528640 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628007c90 con 0x7f963006dae0 2024-05-20T18:02:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9637856640 1 -- 172.21.15.6:0/1576528640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f963006dae0 msgr2=0x7f96300b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9637856640 1 --2- 172.21.15.6:0/1576528640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f963006dae0 0x7f96300b8190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9628009d90 tx=0x7f962802a660 comp rx=0 tx=0).stop 2024-05-20T18:02:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9637856640 1 -- 172.21.15.6:0/1576528640 shutdown_connections 2024-05-20T18:02:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9637856640 1 --2- 172.21.15.6:0/1576528640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f963006dae0 0x7f96300b8190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9637856640 1 --2- 172.21.15.6:0/1576528640 >> v2:172.21.15.171:3300/0 conn(0x7f9630162820 0x7f96300b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9637856640 1 -- 172.21.15.6:0/1576528640 >> 172.21.15.6:0/1576528640 conn(0x7f96300d4bd0 msgr2=0x7f96300d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.402+0000 7f9637856640 1 -- 172.21.15.6:0/1576528640 shutdown_connections 2024-05-20T18:02:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.403+0000 7f9637856640 1 -- 172.21.15.6:0/1576528640 wait complete. 2024-05-20T18:02:38.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.404+0000 7f9637856640 1 Processor -- start 2024-05-20T18:02:38.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.404+0000 7f9637856640 1 -- start start 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9637856640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96300b3e80 0x7f963015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9637856640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630162820 0x7f9630144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9637856640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9630160990 0x7f9630160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9637856640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96300d4780 con 0x7f9630162820 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9637856640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f96300d0300 con 0x7f9630160990 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9637856640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f96300d4900 con 0x7f96300b3e80 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630162820 0x7f9630144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630162820 0x7f9630144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32932/0 (socket says 172.21.15.6:32932) 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 -- 172.21.15.6:0/855606960 learned_addr learned my addr 172.21.15.6:0/855606960 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f96355f2640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96300b3e80 0x7f963015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9635df3640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9630160990 0x7f9630160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 -- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96300b3e80 msgr2=0x7f963015fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96300b3e80 0x7f963015fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 -- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9630160990 msgr2=0x7f9630160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9630160990 0x7f9630160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 -- 172.21.15.6:0/855606960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96301450c0 con 0x7f9630162820 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f96355f2640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96300b3e80 0x7f963015fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9635df3640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9630160990 0x7f9630160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9634df1640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630162820 0x7f9630144b80 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f962000c3c0 tx=0x7f962000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9625ffb640 1 -- 172.21.15.6:0/855606960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620017070 con 0x7f9630162820 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9625ffb640 1 -- 172.21.15.6:0/855606960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9620005ce0 con 0x7f9630162820 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96301612e0 con 0x7f9630162820 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.406+0000 7f9625ffb640 1 -- 172.21.15.6:0/855606960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96200072f0 con 0x7f9630162820 2024-05-20T18:02:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.407+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96301583f0 con 0x7f9630162820 2024-05-20T18:02:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.408+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9630075b00 con 0x7f9630162820 2024-05-20T18:02:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.408+0000 7f9625ffb640 1 -- 172.21.15.6:0/855606960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f962001a070 con 0x7f9630162820 2024-05-20T18:02:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.409+0000 7f9625ffb640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f961406be60 0x7f961406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.409+0000 7f9625ffb640 1 -- 172.21.15.6:0/855606960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f962008a460 con 0x7f9630162820 2024-05-20T18:02:38.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.409+0000 7f96355f2640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f961406be60 0x7f961406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.409+0000 7f96355f2640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f961406be60 0x7f961406e370 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f962c006fd0 tx=0x7f962c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.413+0000 7f9625ffb640 1 -- 172.21.15.6:0/855606960 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9620058b50 con 0x7f9630162820 2024-05-20T18:02:38.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.635+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96301e88d0 con 0x7f9630162820 2024-05-20T18:02:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.636+0000 7f9625ffb640 1 -- 172.21.15.6:0/855606960 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) ==== 94+0+5182 (secure 0 0 0) 0x7f9620058450 con 0x7f9630162820 2024-05-20T18:02:38.634 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:38.634 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":99,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:11.519092+0000","modified":"2024-05-20T18:02:32.173141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9141":{"gid":9141,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":8,"addr":"172.21.15.6:6835/1253645410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1253645410},{"type":"v1","addr":"172.21.15.6:6835","nonce":1253645410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9141,"qdb_cluster":[9141]},"id":10}]} 2024-05-20T18:02:38.634 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 99 2024-05-20T18:02:38.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f961406be60 msgr2=0x7f961406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f961406be60 0x7f961406e370 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f962c006fd0 tx=0x7f962c008040 comp rx=0 tx=0).stop 2024-05-20T18:02:38.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630162820 msgr2=0x7f9630144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630162820 0x7f9630144b80 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f962000c3c0 tx=0x7f962000c880 comp rx=0 tx=0).stop 2024-05-20T18:02:38.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 shutdown_connections 2024-05-20T18:02:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f961406be60 0x7f961406e370 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9630160990 0x7f9630160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630162820 0x7f9630144b80 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 --2- 172.21.15.6:0/855606960 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96300b3e80 0x7f963015fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 >> 172.21.15.6:0/855606960 conn(0x7f96300d4bd0 msgr2=0x7f963006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 shutdown_connections 2024-05-20T18:02:38.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.638+0000 7f9637856640 1 -- 172.21.15.6:0/855606960 wait complete. 2024-05-20T18:02:38.648 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.765+0000 7f7b2a37e640 1 Processor -- start 2024-05-20T18:02:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.765+0000 7f7b2a37e640 1 -- start start 2024-05-20T18:02:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b2a37e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b24162820 0x7f7b240b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b2a37e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7b2406dae0 0x7f7b240b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b2a37e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b240d0630 con 0x7f7b240b3e80 2024-05-20T18:02:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b2a37e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7b240d39c0 con 0x7f7b24162820 2024-05-20T18:02:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b2a37e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7b240d3ca0 con 0x7f7b2406dae0 2024-05-20T18:02:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b23fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b24162820 0x7f7b240b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b237fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7b240b3e80 0x7f7b2406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39538/0 (socket says 172.21.15.6:39538) 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b237fe640 1 -- 172.21.15.6:0/3988279495 learned_addr learned my addr 172.21.15.6:0/3988279495 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b2891b640 1 --2- 172.21.15.6:0/3988279495 >> v2:172.21.15.171:3300/0 conn(0x7f7b2406dae0 0x7f7b240b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b23fff640 1 -- 172.21.15.6:0/3988279495 >> v2:172.21.15.171:3300/0 conn(0x7f7b2406dae0 msgr2=0x7f7b240b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b23fff640 1 --2- 172.21.15.6:0/3988279495 >> v2:172.21.15.171:3300/0 conn(0x7f7b2406dae0 0x7f7b240b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b23fff640 1 -- 172.21.15.6:0/3988279495 >> v1:172.21.15.6:6789/0 conn(0x7f7b240b3e80 legacy=0x7f7b2406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.767+0000 7f7b23fff640 1 -- 172.21.15.6:0/3988279495 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b240d3f80 con 0x7f7b24162820 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.766+0000 7f7b22ffd640 1 -- 172.21.15.6:0/3988279495 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459472376 0 0) 0x7f7b240d0630 con 0x7f7b240b3e80 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.767+0000 7f7b23fff640 1 --2- 172.21.15.6:0/3988279495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b24162820 0x7f7b240b3940 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f7b2408e070 tx=0x7f7b1402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b367baf7f0c55dc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.767+0000 7f7b22ffd640 1 -- 172.21.15.6:0/3988279495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14037070 con 0x7f7b24162820 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.767+0000 7f7b22ffd640 1 -- 172.21.15.6:0/3988279495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14032440 con 0x7f7b24162820 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b22ffd640 1 -- 172.21.15.6:0/3988279495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14032810 con 0x7f7b24162820 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b2a37e640 1 -- 172.21.15.6:0/3988279495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b24162820 msgr2=0x7f7b240b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/3988279495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b24162820 0x7f7b240b3940 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f7b2408e070 tx=0x7f7b1402a1a0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b2a37e640 1 -- 172.21.15.6:0/3988279495 shutdown_connections 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/3988279495 >> v2:172.21.15.171:3300/0 conn(0x7f7b2406dae0 0x7f7b240b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/3988279495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b24162820 0x7f7b240b3940 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b2a37e640 1 -- 172.21.15.6:0/3988279495 >> 172.21.15.6:0/3988279495 conn(0x7f7b240d4bd0 msgr2=0x7f7b240d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b2a37e640 1 -- 172.21.15.6:0/3988279495 shutdown_connections 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.768+0000 7f7b2a37e640 1 -- 172.21.15.6:0/3988279495 wait complete. 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.770+0000 7f7b2a37e640 1 Processor -- start 2024-05-20T18:02:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.770+0000 7f7b2a37e640 1 -- start start 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.771+0000 7f7b2a37e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240b3e80 0x7f7b240b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.771+0000 7f7b2a37e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b24162820 0x7f7b24155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.771+0000 7f7b2a37e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240b6270 0x7f7b240b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.771+0000 7f7b2a37e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7b240d4780 con 0x7f7b240b3e80 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.771+0000 7f7b2a37e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7b240d0300 con 0x7f7b240b6270 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.771+0000 7f7b2a37e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7b240d4900 con 0x7f7b24162820 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240b3e80 0x7f7b240b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240b3e80 0x7f7b240b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32954/0 (socket says 172.21.15.6:32954) 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 -- 172.21.15.6:0/1050634000 learned_addr learned my addr 172.21.15.6:0/1050634000 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b237fe640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b24162820 0x7f7b24155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b2891b640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240b6270 0x7f7b240b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 -- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b24162820 msgr2=0x7f7b24155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b24162820 0x7f7b24155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 -- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240b6270 msgr2=0x7f7b240b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240b6270 0x7f7b240b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 -- 172.21.15.6:0/1050634000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b240b6bc0 con 0x7f7b240b3e80 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b23fff640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240b3e80 0x7f7b240b54c0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b20ff9640 1 -- 172.21.15.6:0/1050634000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14037040 con 0x7f7b240b3e80 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b20ff9640 1 -- 172.21.15.6:0/1050634000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14042070 con 0x7f7b240b3e80 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b20ff9640 1 -- 172.21.15.6:0/1050634000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14030bd0 con 0x7f7b240b3e80 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b240c96f0 con 0x7f7b240b3e80 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.772+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b240c9cb0 con 0x7f7b240b3e80 2024-05-20T18:02:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.773+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b240d0510 con 0x7f7b240b3e80 2024-05-20T18:02:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.774+0000 7f7b20ff9640 1 -- 172.21.15.6:0/1050634000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b14047460 con 0x7f7b240b3e80 2024-05-20T18:02:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.774+0000 7f7b20ff9640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b1006be30 0x7f7b1006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.775+0000 7f7b20ff9640 1 -- 172.21.15.6:0/1050634000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f7b140aba70 con 0x7f7b240b3e80 2024-05-20T18:02:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.775+0000 7f7b237fe640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b1006be30 0x7f7b1006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.775+0000 7f7b237fe640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b1006be30 0x7f7b1006e340 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7b24161fd0 tx=0x7f7b18007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.779+0000 7f7b20ff9640 1 -- 172.21.15.6:0/1050634000 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7b240d0510 con 0x7f7b240b3e80 2024-05-20T18:02:38.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.967+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b24075b00 con 0x7f7b240b3e80 2024-05-20T18:02:38.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.968+0000 7f7b20ff9640 1 -- 172.21.15.6:0/1050634000 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16844 (secure 0 0 0) 0x7f7b1404d060 con 0x7f7b240b3e80 2024-05-20T18:02:38.966 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:38.970 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":137,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:13.150220+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:09.651858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:10.498810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:38.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b1006be30 msgr2=0x7f7b1006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b1006be30 0x7f7b1006e340 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7b24161fd0 tx=0x7f7b18007c00 comp rx=0 tx=0).stop 2024-05-20T18:02:38.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240b3e80 msgr2=0x7f7b240b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:38.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240b3e80 0x7f7b240b54c0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b140046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 shutdown_connections 2024-05-20T18:02:38.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7b1006be30 0x7f7b1006e340 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240b6270 0x7f7b240b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b24162820 0x7f7b24155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 --2- 172.21.15.6:0/1050634000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b240b3e80 0x7f7b240b54c0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 >> 172.21.15.6:0/1050634000 conn(0x7f7b240d4bd0 msgr2=0x7f7b24161270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 shutdown_connections 2024-05-20T18:02:38.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:38.970+0000 7f7b2a37e640 1 -- 172.21.15.6:0/1050634000 wait complete. 2024-05-20T18:02:38.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T18:02:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.098+0000 7f76e9b3e640 1 Processor -- start 2024-05-20T18:02:39.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.098+0000 7f76e9b3e640 1 -- start start 2024-05-20T18:02:39.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e9b3e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e4162820 0x7f76e40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e9b3e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f76e406dae0 0x7f76e40b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e9b3e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e40d0630 con 0x7f76e40b3e80 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e9b3e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f76e40d39c0 con 0x7f76e406dae0 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e9b3e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76e40d3ca0 con 0x7f76e4162820 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f76e40b3e80 0x7f76e406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39542/0 (socket says 172.21.15.6:39542) 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e2ffd640 1 -- 172.21.15.6:0/579527318 learned_addr learned my addr 172.21.15.6:0/579527318 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e37fe640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e4162820 0x7f76e40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080876455 0 0) 0x7f76e40d0630 con 0x7f76e40b3e80 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76cc003520 con 0x7f76e40b3e80 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e3fff640 1 --2- 172.21.15.6:0/579527318 >> v2:172.21.15.171:3300/0 conn(0x7f76e406dae0 0x7f76e40b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2682239194 0 0) 0x7f76cc003520 con 0x7f76e40b3e80 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e4162820 msgr2=0x7f76e40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e4162820 0x7f76e40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 >> v2:172.21.15.171:3300/0 conn(0x7f76e406dae0 msgr2=0x7f76e40b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 --2- 172.21.15.6:0/579527318 >> v2:172.21.15.171:3300/0 conn(0x7f76e406dae0 0x7f76e40b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e40d3f80 con 0x7f76e40b3e80 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f76d8001670 con 0x7f76e40b3e80 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 >> v1:172.21.15.6:6789/0 conn(0x7f76e40b3e80 legacy=0x7f76e406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e4162820 0x7f76cc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc003f30 0x7f76cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc004d40 0x7f76cc005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76e40d39c0 con 0x7f76cc004d40 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76e40d3ca0 con 0x7f76cc003f30 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.100+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76cc00ba10 con 0x7f76e4162820 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.101+0000 7f76e3fff640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc004d40 0x7f76cc005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.101+0000 7f76e37fe640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e4162820 0x7f76cc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.101+0000 7f76e2ffd640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc003f30 0x7f76cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.101+0000 7f76e3fff640 1 -- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e4162820 msgr2=0x7f76cc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.101+0000 7f76e3fff640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e4162820 0x7f76cc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.101+0000 7f76e3fff640 1 -- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc003f30 msgr2=0x7f76cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.101+0000 7f76e3fff640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc003f30 0x7f76cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.101+0000 7f76e3fff640 1 -- 172.21.15.6:0/579527318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc003520 con 0x7f76cc004d40 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e3fff640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc004d40 0x7f76cc005150 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009f90 tx=0x7f76cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1498cc5924bcf381 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc009c10 con 0x7f76cc004d40 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc036070 con 0x7f76cc004d40 2024-05-20T18:02:39.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e27fc640 1 -- 172.21.15.6:0/579527318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc031880 con 0x7f76cc004d40 2024-05-20T18:02:39.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e9b3e640 1 -- 172.21.15.6:0/579527318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc004d40 msgr2=0x7f76cc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e9b3e640 1 --2- 172.21.15.6:0/579527318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc004d40 0x7f76cc005150 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009f90 tx=0x7f76cc005830 comp rx=0 tx=0).stop 2024-05-20T18:02:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e3fff640 1 -- 172.21.15.6:0/579527318 reap_dead start 2024-05-20T18:02:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e9b3e640 1 -- 172.21.15.6:0/579527318 shutdown_connections 2024-05-20T18:02:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.102+0000 7f76e9b3e640 1 -- 172.21.15.6:0/579527318 >> 172.21.15.6:0/579527318 conn(0x7f76e40d4bd0 msgr2=0x7f76e40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.103+0000 7f76e9b3e640 1 -- 172.21.15.6:0/579527318 shutdown_connections 2024-05-20T18:02:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.103+0000 7f76e9b3e640 1 -- 172.21.15.6:0/579527318 wait complete. 2024-05-20T18:02:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.104+0000 7f76e9b3e640 1 Processor -- start 2024-05-20T18:02:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.105+0000 7f76e9b3e640 1 -- start start 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e9b3e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e40c8280 0x7f76e40c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e9b3e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76e4154780 0x7f76e4154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e9b3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40b4b60 0x7f76e40b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e9b3e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76e40d4780 con 0x7f76e40b4b60 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e9b3e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76e40d0300 con 0x7f76e4154780 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e9b3e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76e40d4900 con 0x7f76e40c8280 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40b4b60 0x7f76e40b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40b4b60 0x7f76e40b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32976/0 (socket says 172.21.15.6:32976) 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 -- 172.21.15.6:0/2324883327 learned_addr learned my addr 172.21.15.6:0/2324883327 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e37fe640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e40c8280 0x7f76e40c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e2ffd640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76e4154780 0x7f76e4154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 -- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e40c8280 msgr2=0x7f76e40c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e40c8280 0x7f76e40c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 -- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76e4154780 msgr2=0x7f76e4154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76e4154780 0x7f76e4154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 -- 172.21.15.6:0/2324883327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e4155650 con 0x7f76e40b4b60 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e2ffd640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76e4154780 0x7f76e4154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.106+0000 7f76e3fff640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40b4b60 0x7f76e40b4f70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009f90 tx=0x7f76dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.107+0000 7f76cbfff640 1 -- 172.21.15.6:0/2324883327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc009c10 con 0x7f76e40b4b60 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.107+0000 7f76cbfff640 1 -- 172.21.15.6:0/2324883327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc031df0 con 0x7f76e40b4b60 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.107+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e40c8690 con 0x7f76e40b4b60 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.107+0000 7f76cbfff640 1 -- 172.21.15.6:0/2324883327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc003bd0 con 0x7f76e40b4b60 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.107+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e40cd5c0 con 0x7f76e40b4b60 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.108+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e4075b00 con 0x7f76e40b4b60 2024-05-20T18:02:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.108+0000 7f76cbfff640 1 -- 172.21.15.6:0/2324883327 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76dc005d10 con 0x7f76e40b4b60 2024-05-20T18:02:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.109+0000 7f76cbfff640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76d006be30 0x7f76d006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.109+0000 7f76cbfff640 1 -- 172.21.15.6:0/2324883327 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f76dc0ac2c0 con 0x7f76e40b4b60 2024-05-20T18:02:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.109+0000 7f76e37fe640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76d006be30 0x7f76d006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.110+0000 7f76e37fe640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76d006be30 0x7f76d006e340 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f76e40b6590 tx=0x7f76d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.114+0000 7f76cbfff640 1 -- 172.21.15.6:0/2324883327 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f76dc04a060 con 0x7f76e40b4b60 2024-05-20T18:02:39.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.335+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f76e4068890 con 0x7f76e40b4b60 2024-05-20T18:02:39.333 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T18:02:39.335+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T18:02:39.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.337+0000 7f76cbfff640 1 -- 172.21.15.6:0/2324883327 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v100) ==== 161+0+0 (secure 0 0 0) 0x7f76e4155650 con 0x7f76e40b4b60 2024-05-20T18:02:39.335 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T18:02:39.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76d006be30 msgr2=0x7f76d006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76d006be30 0x7f76d006e340 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f76e40b6590 tx=0x7f76d4008040 comp rx=0 tx=0).stop 2024-05-20T18:02:39.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40b4b60 msgr2=0x7f76e40b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40b4b60 0x7f76e40b4f70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009f90 tx=0x7f76dc009750 comp rx=0 tx=0).stop 2024-05-20T18:02:39.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 shutdown_connections 2024-05-20T18:02:39.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76d006be30 0x7f76d006e340 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40b4b60 0x7f76e40b4f70 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76e4154780 0x7f76e4154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 --2- 172.21.15.6:0/2324883327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76e40c8280 0x7f76e40c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 >> 172.21.15.6:0/2324883327 conn(0x7f76e40d4bd0 msgr2=0x7f76e40b8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 shutdown_connections 2024-05-20T18:02:39.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.339+0000 7f76e9b3e640 1 -- 172.21.15.6:0/2324883327 wait complete. 2024-05-20T18:02:39.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T18:02:39.404 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T18:02:39.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.472+0000 7fc63b099640 1 Processor -- start 2024-05-20T18:02:39.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.472+0000 7fc63b099640 1 -- start start 2024-05-20T18:02:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc63b099640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6340cd680 0x7fc63415f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc63b099640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc63406c6c0 0x7fc63406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc63b099640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63406d0f0 con 0x7fc6340cf3d0 2024-05-20T18:02:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc63b099640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc6340cda90 con 0x7fc6340cd680 2024-05-20T18:02:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc63b099640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc63415f760 con 0x7fc63406c6c0 2024-05-20T18:02:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc638e35640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6340cd680 0x7fc63415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc639636640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6340cf3d0 0x7fc6340cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39554/0 (socket says 172.21.15.6:39554) 2024-05-20T18:02:39.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc639636640 1 -- 172.21.15.6:0/3758494794 learned_addr learned my addr 172.21.15.6:0/3758494794 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.473+0000 7fc638e35640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6340cd680 0x7fc63415f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33002/0 (socket says 172.21.15.6:33002) 2024-05-20T18:02:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.474+0000 7fc62bfff640 1 --2- 172.21.15.6:0/3758494794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc63406c6c0 0x7fc63406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.474+0000 7fc638e35640 1 -- 172.21.15.6:0/3758494794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc63406c6c0 msgr2=0x7fc63406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.474+0000 7fc638e35640 1 --2- 172.21.15.6:0/3758494794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc63406c6c0 0x7fc63406cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.474+0000 7fc638e35640 1 -- 172.21.15.6:0/3758494794 >> v1:172.21.15.6:6789/0 conn(0x7fc6340cf3d0 legacy=0x7fc6340cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.474+0000 7fc638e35640 1 -- 172.21.15.6:0/3758494794 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63406d3d0 con 0x7fc6340cd680 2024-05-20T18:02:39.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.474+0000 7fc62b7fe640 1 -- 172.21.15.6:0/3758494794 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646272738 0 0) 0x7fc63406d0f0 con 0x7fc6340cf3d0 2024-05-20T18:02:39.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc638e35640 1 --2- 172.21.15.6:0/3758494794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6340cd680 0x7fc63415f220 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc6300097a0 tx=0x7fc63002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23b25f8a98add86 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:39.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc62b7fe640 1 -- 172.21.15.6:0/3758494794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630037070 con 0x7fc6340cd680 2024-05-20T18:02:39.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc62b7fe640 1 -- 172.21.15.6:0/3758494794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63002ae50 con 0x7fc6340cd680 2024-05-20T18:02:39.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc62b7fe640 1 -- 172.21.15.6:0/3758494794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630032660 con 0x7fc6340cd680 2024-05-20T18:02:39.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc63b099640 1 -- 172.21.15.6:0/3758494794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6340cd680 msgr2=0x7fc63415f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc63b099640 1 --2- 172.21.15.6:0/3758494794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6340cd680 0x7fc63415f220 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc6300097a0 tx=0x7fc63002a100 comp rx=0 tx=0).stop 2024-05-20T18:02:39.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc63b099640 1 -- 172.21.15.6:0/3758494794 shutdown_connections 2024-05-20T18:02:39.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc63b099640 1 --2- 172.21.15.6:0/3758494794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc63406c6c0 0x7fc63406cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc63b099640 1 --2- 172.21.15.6:0/3758494794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6340cd680 0x7fc63415f220 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.475+0000 7fc63b099640 1 -- 172.21.15.6:0/3758494794 >> 172.21.15.6:0/3758494794 conn(0x7fc6340b44d0 msgr2=0x7fc6340b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:39.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.476+0000 7fc63b099640 1 -- 172.21.15.6:0/3758494794 shutdown_connections 2024-05-20T18:02:39.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.476+0000 7fc63b099640 1 -- 172.21.15.6:0/3758494794 wait complete. 2024-05-20T18:02:39.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.477+0000 7fc63b099640 1 Processor -- start 2024-05-20T18:02:39.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.477+0000 7fc63b099640 1 -- start start 2024-05-20T18:02:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc63b099640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63406c6c0 0x7fc634151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc63b099640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6340cd680 0x7fc6340b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc63b099640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6340cf3d0 0x7fc6340c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc63b099640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc63406d990 con 0x7fc63406c6c0 2024-05-20T18:02:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc63b099640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc6340d0b40 con 0x7fc6340cd680 2024-05-20T18:02:39.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc63b099640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc6340d2460 con 0x7fc6340cf3d0 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63406c6c0 0x7fc634151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63406c6c0 0x7fc634151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33004/0 (socket says 172.21.15.6:33004) 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 -- 172.21.15.6:0/3268274855 learned_addr learned my addr 172.21.15.6:0/3268274855 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc639636640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6340cf3d0 0x7fc6340c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc62bfff640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6340cd680 0x7fc6340b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 -- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6340cf3d0 msgr2=0x7fc6340c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6340cf3d0 0x7fc6340c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 -- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6340cd680 msgr2=0x7fc6340b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6340cd680 0x7fc6340b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 -- 172.21.15.6:0/3268274855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6341f6d50 con 0x7fc63406c6c0 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc62bfff640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6340cd680 0x7fc6340b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.479+0000 7fc638e35640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63406c6c0 0x7fc634151f50 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fc6300098c0 tx=0x7fc6300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.480+0000 7fc6297fa640 1 -- 172.21.15.6:0/3268274855 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630041030 con 0x7fc63406c6c0 2024-05-20T18:02:39.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.480+0000 7fc6297fa640 1 -- 172.21.15.6:0/3268274855 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63002ac50 con 0x7fc63406c6c0 2024-05-20T18:02:39.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.480+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6340b7f40 con 0x7fc63406c6c0 2024-05-20T18:02:39.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.480+0000 7fc6297fa640 1 -- 172.21.15.6:0/3268274855 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630037040 con 0x7fc63406c6c0 2024-05-20T18:02:39.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.480+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6340b59c0 con 0x7fc63406c6c0 2024-05-20T18:02:39.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.481+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc634075b00 con 0x7fc63406c6c0 2024-05-20T18:02:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.481+0000 7fc6297fa640 1 -- 172.21.15.6:0/3268274855 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc630044070 con 0x7fc63406c6c0 2024-05-20T18:02:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.482+0000 7fc6297fa640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62006be60 0x7fc62006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.482+0000 7fc6297fa640 1 -- 172.21.15.6:0/3268274855 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 6187+0+0 (secure 0 0 0) 0x7fc6300ab520 con 0x7fc63406c6c0 2024-05-20T18:02:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.482+0000 7fc62bfff640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62006be60 0x7fc62006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:39.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.483+0000 7fc62bfff640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62006be60 0x7fc62006e370 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc6340c9540 tx=0x7fc624008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:39.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.487+0000 7fc6297fa640 1 -- 172.21.15.6:0/3268274855 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc630044e40 con 0x7fc63406c6c0 2024-05-20T18:02:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:39.715+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc6340b8940 con 0x7fc63406c6c0 2024-05-20T18:02:40.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.339+0000 7fc6297fa640 1 -- 172.21.15.6:0/3268274855 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v101) ==== 104+0+0 (secure 0 0 0) 0x7fc630079c50 con 0x7fc63406c6c0 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.341+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62006be60 msgr2=0x7fc62006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.341+0000 7fc63b099640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62006be60 0x7fc62006e370 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc6340c9540 tx=0x7fc624008040 comp rx=0 tx=0).stop 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.341+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63406c6c0 msgr2=0x7fc634151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.341+0000 7fc63b099640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63406c6c0 0x7fc634151f50 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fc6300098c0 tx=0x7fc6300046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.342+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 shutdown_connections 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.342+0000 7fc63b099640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc62006be60 0x7fc62006e370 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.342+0000 7fc63b099640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc6340cf3d0 0x7fc6340c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.342+0000 7fc63b099640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc6340cd680 0x7fc6340b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.342+0000 7fc63b099640 1 --2- 172.21.15.6:0/3268274855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc63406c6c0 0x7fc634151f50 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.342+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 >> 172.21.15.6:0/3268274855 conn(0x7fc6340b44d0 msgr2=0x7fc6340708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.342+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 shutdown_connections 2024-05-20T18:02:40.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.342+0000 7fc63b099640 1 -- 172.21.15.6:0/3268274855 wait complete. 2024-05-20T18:02:40.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T18:02:40.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.479+0000 7f287895e640 1 Processor -- start 2024-05-20T18:02:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.479+0000 7f287895e640 1 -- start start 2024-05-20T18:02:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f287895e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f28740b3860 0x7f28740d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f287895e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f287408c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f287895e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f287408c670 con 0x7f287406d870 2024-05-20T18:02:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f287895e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f28740d0450 con 0x7f28740b3860 2024-05-20T18:02:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f287895e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28740d3b10 con 0x7f287408bd20 2024-05-20T18:02:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f2871d9b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f287406d870 0x7f287415f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:40370/0 (socket says 172.21.15.6:40370) 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f2872d9d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f287408c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f287259c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f28740b3860 0x7f28740d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.481+0000 7f2871d9b640 1 -- 172.21.15.6:0/3974623505 learned_addr learned my addr 172.21.15.6:0/3974623505 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.482+0000 7f2872d9d640 1 -- 172.21.15.6:0/3974623505 >> v2:172.21.15.171:3300/0 conn(0x7f28740b3860 msgr2=0x7f28740d45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.482+0000 7f2872d9d640 1 --2- 172.21.15.6:0/3974623505 >> v2:172.21.15.171:3300/0 conn(0x7f28740b3860 0x7f28740d45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.482+0000 7f2872d9d640 1 -- 172.21.15.6:0/3974623505 >> v1:172.21.15.171:6789/0 conn(0x7f287406d870 legacy=0x7f287415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.482+0000 7f2872d9d640 1 -- 172.21.15.6:0/3974623505 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28740d3df0 con 0x7f287408bd20 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.482+0000 7f287159a640 1 -- 172.21.15.6:0/3974623505 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101807606 0 0) 0x7f285c001110 con 0x7f287406d870 2024-05-20T18:02:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.482+0000 7f287259c640 1 --2- 172.21.15.6:0/3974623505 >> v2:172.21.15.171:3300/0 conn(0x7f28740b3860 0x7f28740d45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.482+0000 7f2872d9d640 1 --2- 172.21.15.6:0/3974623505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f287408c130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f286c009d90 tx=0x7f286c02a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d0a943a4eeb350a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287159a640 1 -- 172.21.15.6:0/3974623505 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c007740 con 0x7f287408bd20 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287159a640 1 -- 172.21.15.6:0/3974623505 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f286c0078e0 con 0x7f287408bd20 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287159a640 1 -- 172.21.15.6:0/3974623505 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c007cb0 con 0x7f287408bd20 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287895e640 1 -- 172.21.15.6:0/3974623505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 msgr2=0x7f287408c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287895e640 1 --2- 172.21.15.6:0/3974623505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f287408c130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f286c009d90 tx=0x7f286c02a530 comp rx=0 tx=0).stop 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287895e640 1 -- 172.21.15.6:0/3974623505 shutdown_connections 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287895e640 1 --2- 172.21.15.6:0/3974623505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f287408c130 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287895e640 1 --2- 172.21.15.6:0/3974623505 >> v2:172.21.15.171:3300/0 conn(0x7f28740b3860 0x7f28740d45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287895e640 1 -- 172.21.15.6:0/3974623505 >> 172.21.15.6:0/3974623505 conn(0x7f28740b6d10 msgr2=0x7f287406d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287895e640 1 -- 172.21.15.6:0/3974623505 shutdown_connections 2024-05-20T18:02:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.483+0000 7f287895e640 1 -- 172.21.15.6:0/3974623505 wait complete. 2024-05-20T18:02:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.485+0000 7f287895e640 1 Processor -- start 2024-05-20T18:02:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.485+0000 7f287895e640 1 -- start start 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f287895e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287406d870 0x7f28741e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f287895e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f28741f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f287895e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28740b3860 0x7f28741f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f287895e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28740b81b0 con 0x7f28740b3860 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f287895e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28740d0730 con 0x7f287406d870 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f287895e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28740b8330 con 0x7f287408bd20 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28740b3860 0x7f28741f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28740b3860 0x7f28741f93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33012/0 (socket says 172.21.15.6:33012) 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 -- 172.21.15.6:0/117327087 learned_addr learned my addr 172.21.15.6:0/117327087 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f287259c640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287406d870 0x7f28741e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2871d9b640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f28741f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 -- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 msgr2=0x7f28741f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f28741f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 -- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287406d870 msgr2=0x7f28741e3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287406d870 0x7f28741e3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 -- 172.21.15.6:0/117327087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2874158df0 con 0x7f28740b3860 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.487+0000 7f2872d9d640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28740b3860 0x7f28741f93f0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f286c009d90 tx=0x7f286c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.488+0000 7f286affd640 1 -- 172.21.15.6:0/117327087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c03f070 con 0x7f28740b3860 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.488+0000 7f286affd640 1 -- 172.21.15.6:0/117327087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f286c031bc0 con 0x7f28740b3860 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.488+0000 7f286affd640 1 -- 172.21.15.6:0/117327087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c009450 con 0x7f28740b3860 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.488+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2874153940 con 0x7f28740b3860 2024-05-20T18:02:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.488+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2874153f00 con 0x7f28740b3860 2024-05-20T18:02:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.489+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28740690b0 con 0x7f28740b3860 2024-05-20T18:02:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.489+0000 7f286affd640 1 -- 172.21.15.6:0/117327087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f286c03b410 con 0x7f28740b3860 2024-05-20T18:02:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.490+0000 7f286affd640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f285406be60 0x7f285406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.490+0000 7f286affd640 1 -- 172.21.15.6:0/117327087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 6187+0+0 (secure 0 0 0) 0x7f286c0ac390 con 0x7f28740b3860 2024-05-20T18:02:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.490+0000 7f287259c640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f285406be60 0x7f285406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:40.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.491+0000 7f287259c640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f285406be60 0x7f285406e370 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2864009560 tx=0x7f2864009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:40.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.495+0000 7f286affd640 1 -- 172.21.15.6:0/117327087 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f286c07a480 con 0x7f28740b3860 2024-05-20T18:02:40.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:40.683+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f28740b3640 con 0x7f28740b3860 2024-05-20T18:02:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.344+0000 7f286affd640 1 -- 172.21.15.6:0/117327087 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v139) ==== 181+0+0 (secure 0 0 0) 0x7f286c07e780 con 0x7f28740b3860 2024-05-20T18:02:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T18:02:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f285406be60 msgr2=0x7f285406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f285406be60 0x7f285406e370 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2864009560 tx=0x7f2864009190 comp rx=0 tx=0).stop 2024-05-20T18:02:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28740b3860 msgr2=0x7f28741f93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28740b3860 0x7f28741f93f0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f286c009d90 tx=0x7f286c004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 shutdown_connections 2024-05-20T18:02:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f285406be60 0x7f285406e370 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28740b3860 0x7f28741f93f0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f287408bd20 0x7f28741f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 --2- 172.21.15.6:0/117327087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f287406d870 0x7f28741e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 >> 172.21.15.6:0/117327087 conn(0x7f28740b6d10 msgr2=0x7f28740b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 shutdown_connections 2024-05-20T18:02:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.348+0000 7f287895e640 1 -- 172.21.15.6:0/117327087 wait complete. 2024-05-20T18:02:41.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T18:02:41.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.488+0000 7f15d3432640 1 Processor -- start 2024-05-20T18:02:41.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.488+0000 7f15d3432640 1 -- start start 2024-05-20T18:02:41.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d3432640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15cc0d3510 0x7f15cc0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:41.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d3432640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f15cc0d1830 0x7f15cc0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:41.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d3432640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 0x7f15cc0b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:41.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d3432640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc0d0160 con 0x7f15cc0d3510 2024-05-20T18:02:41.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d3432640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc0cda00 con 0x7f15cc0d1830 2024-05-20T18:02:41.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d3432640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc0cdce0 con 0x7f15cc0cea20 2024-05-20T18:02:41.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d11ce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15cc0d3510 0x7f15cc0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:41.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d11ce640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15cc0d3510 0x7f15cc0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33022/0 (socket says 172.21.15.6:33022) 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.489+0000 7f15d11ce640 1 -- 172.21.15.6:0/2317844159 learned_addr learned my addr 172.21.15.6:0/2317844159 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.490+0000 7f15d09cd640 1 --2- 172.21.15.6:0/2317844159 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0d1830 0x7f15cc0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.490+0000 7f15d19cf640 1 --2- 172.21.15.6:0/2317844159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 0x7f15cc0b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.490+0000 7f15d11ce640 1 -- 172.21.15.6:0/2317844159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 msgr2=0x7f15cc0b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.490+0000 7f15d11ce640 1 --2- 172.21.15.6:0/2317844159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 0x7f15cc0b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.490+0000 7f15d11ce640 1 -- 172.21.15.6:0/2317844159 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0d1830 msgr2=0x7f15cc0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.490+0000 7f15d11ce640 1 --2- 172.21.15.6:0/2317844159 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0d1830 0x7f15cc0ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.490+0000 7f15d11ce640 1 -- 172.21.15.6:0/2317844159 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc0cdfc0 con 0x7f15cc0d3510 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15d11ce640 1 --2- 172.21.15.6:0/2317844159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b18e0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f15cc15da40 tx=0x7f15c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f910ce1418539f65 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:41.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15c3fff640 1 -- 172.21.15.6:0/2317844159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8037070 con 0x7f15cc0d3510 2024-05-20T18:02:41.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15c3fff640 1 -- 172.21.15.6:0/2317844159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c8032440 con 0x7f15cc0d3510 2024-05-20T18:02:41.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15c3fff640 1 -- 172.21.15.6:0/2317844159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8032810 con 0x7f15cc0d3510 2024-05-20T18:02:41.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15d3432640 1 -- 172.21.15.6:0/2317844159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 msgr2=0x7f15cc0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:41.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15d3432640 1 --2- 172.21.15.6:0/2317844159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b18e0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f15cc15da40 tx=0x7f15c802a140 comp rx=0 tx=0).stop 2024-05-20T18:02:41.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15d3432640 1 -- 172.21.15.6:0/2317844159 shutdown_connections 2024-05-20T18:02:41.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15d3432640 1 --2- 172.21.15.6:0/2317844159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 0x7f15cc0b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15d3432640 1 --2- 172.21.15.6:0/2317844159 >> v2:172.21.15.171:3300/0 conn(0x7f15cc0d1830 0x7f15cc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15d3432640 1 --2- 172.21.15.6:0/2317844159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b18e0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.491+0000 7f15d3432640 1 -- 172.21.15.6:0/2317844159 >> 172.21.15.6:0/2317844159 conn(0x7f15cc0d29f0 msgr2=0x7f15cc0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:41.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.492+0000 7f15d3432640 1 -- 172.21.15.6:0/2317844159 shutdown_connections 2024-05-20T18:02:41.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.492+0000 7f15d3432640 1 -- 172.21.15.6:0/2317844159 wait complete. 2024-05-20T18:02:41.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.493+0000 7f15d3432640 1 Processor -- start 2024-05-20T18:02:41.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.493+0000 7f15d3432640 1 -- start start 2024-05-20T18:02:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d3432640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 0x7f15cc150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d3432640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0d1830 0x7f15cc1f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d3432640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d3432640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc0cff00 con 0x7f15cc0d3510 2024-05-20T18:02:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d3432640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc0cfd80 con 0x7f15cc0d1830 2024-05-20T18:02:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d3432640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc0b1e20 con 0x7f15cc0cea20 2024-05-20T18:02:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:41.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33030/0 (socket says 172.21.15.6:33030) 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 -- 172.21.15.6:0/483164478 learned_addr learned my addr 172.21.15.6:0/483164478 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d11ce640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 0x7f15cc150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d09cd640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0d1830 0x7f15cc1f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 -- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 msgr2=0x7f15cc150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 0x7f15cc150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 -- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0d1830 msgr2=0x7f15cc1f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0d1830 0x7f15cc1f33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 -- 172.21.15.6:0/483164478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc1513b0 con 0x7f15cc0d3510 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.495+0000 7f15d19cf640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b4c30 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f15c400cbb0 tx=0x7f15c400a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:41.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.496+0000 7f15c1ffb640 1 -- 172.21.15.6:0/483164478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4015070 con 0x7f15cc0d3510 2024-05-20T18:02:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.496+0000 7f15c1ffb640 1 -- 172.21.15.6:0/483164478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c400abd0 con 0x7f15cc0d3510 2024-05-20T18:02:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.496+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc1f3920 con 0x7f15cc0d3510 2024-05-20T18:02:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.496+0000 7f15c1ffb640 1 -- 172.21.15.6:0/483164478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c400d040 con 0x7f15cc0d3510 2024-05-20T18:02:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.496+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15cc0c8030 con 0x7f15cc0d3510 2024-05-20T18:02:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.497+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc0690b0 con 0x7f15cc0d3510 2024-05-20T18:02:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.498+0000 7f15c1ffb640 1 -- 172.21.15.6:0/483164478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15c4018070 con 0x7f15cc0d3510 2024-05-20T18:02:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.498+0000 7f15c1ffb640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b006be30 0x7f15b006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:41.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.498+0000 7f15c1ffb640 1 -- 172.21.15.6:0/483164478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5749+0+0 (secure 0 0 0) 0x7f15c408a9d0 con 0x7f15cc0d3510 2024-05-20T18:02:41.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.499+0000 7f15d11ce640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b006be30 0x7f15b006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:41.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.499+0000 7f15d11ce640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b006be30 0x7f15b006e340 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f15c8034000 tx=0x7f15c802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:41.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.503+0000 7f15c1ffb640 1 -- 172.21.15.6:0/483164478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f15cc1513b0 con 0x7f15cc0d3510 2024-05-20T18:02:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:41.685+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f15cc0cc330 con 0x7f15cc0d3510 2024-05-20T18:02:42.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.345+0000 7f15c1ffb640 1 -- 172.21.15.6:0/483164478 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v140) ==== 169+0+0 (secure 0 0 0) 0x7f15c4058d90 con 0x7f15cc0d3510 2024-05-20T18:02:42.344 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T18:02:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.349+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b006be30 msgr2=0x7f15b006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.349+0000 7f15d3432640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b006be30 0x7f15b006e340 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f15c8034000 tx=0x7f15c802e000 comp rx=0 tx=0).stop 2024-05-20T18:02:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.349+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 msgr2=0x7f15cc0b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.349+0000 7f15d3432640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b4c30 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f15c400cbb0 tx=0x7f15c400a4c0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.350+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 shutdown_connections 2024-05-20T18:02:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.350+0000 7f15d3432640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f15b006be30 0x7f15b006e340 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.350+0000 7f15d3432640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15cc0d3510 0x7f15cc0b4c30 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.350+0000 7f15d3432640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15cc0d1830 0x7f15cc1f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.350+0000 7f15d3432640 1 --2- 172.21.15.6:0/483164478 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f15cc0cea20 0x7f15cc150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.350+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 >> 172.21.15.6:0/483164478 conn(0x7f15cc0d29f0 msgr2=0x7f15cc0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:42.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.350+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 shutdown_connections 2024-05-20T18:02:42.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.350+0000 7f15d3432640 1 -- 172.21.15.6:0/483164478 wait complete. 2024-05-20T18:02:42.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-05-20T18:02:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.489+0000 7f05e3145640 1 Processor -- start 2024-05-20T18:02:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.489+0000 7f05e3145640 1 -- start start 2024-05-20T18:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.490+0000 7f05e3145640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f05dc162820 0x7f05dc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.490+0000 7f05e3145640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05dc0b3e80 0x7f05dc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.490+0000 7f05e3145640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 0x7f05dc0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.490+0000 7f05e3145640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f05dc06dd20 con 0x7f05dc0b3e80 2024-05-20T18:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.490+0000 7f05e3145640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f05dc0d0630 con 0x7f05dc162820 2024-05-20T18:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.490+0000 7f05e3145640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc0d39c0 con 0x7f05dc06d910 2024-05-20T18:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.490+0000 7f05d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05dc0b3e80 0x7f05dc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05dc0b3e80 0x7f05dc06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33034/0 (socket says 172.21.15.6:33034) 2024-05-20T18:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05d3fff640 1 -- 172.21.15.6:0/352209597 learned_addr learned my addr 172.21.15.6:0/352209597 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05e0ee1640 1 --2- 172.21.15.6:0/352209597 >> v2:172.21.15.171:3300/0 conn(0x7f05dc162820 0x7f05dc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05e16e2640 1 --2- 172.21.15.6:0/352209597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 0x7f05dc0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05d3fff640 1 -- 172.21.15.6:0/352209597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 msgr2=0x7f05dc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05d3fff640 1 --2- 172.21.15.6:0/352209597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 0x7f05dc0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05d3fff640 1 -- 172.21.15.6:0/352209597 >> v2:172.21.15.171:3300/0 conn(0x7f05dc162820 msgr2=0x7f05dc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05d3fff640 1 --2- 172.21.15.6:0/352209597 >> v2:172.21.15.171:3300/0 conn(0x7f05dc162820 0x7f05dc0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.491+0000 7f05d3fff640 1 -- 172.21.15.6:0/352209597 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc0d3ca0 con 0x7f05dc0b3e80 2024-05-20T18:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.492+0000 7f05d3fff640 1 --2- 172.21.15.6:0/352209597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc06d3d0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0b7740 tx=0x7f05cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6c0520dbd9c06c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.492+0000 7f05d37fe640 1 -- 172.21.15.6:0/352209597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc037070 con 0x7f05dc0b3e80 2024-05-20T18:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.492+0000 7f05d37fe640 1 -- 172.21.15.6:0/352209597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05cc032440 con 0x7f05dc0b3e80 2024-05-20T18:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.492+0000 7f05d37fe640 1 -- 172.21.15.6:0/352209597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc032810 con 0x7f05dc0b3e80 2024-05-20T18:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 -- 172.21.15.6:0/352209597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 msgr2=0x7f05dc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 --2- 172.21.15.6:0/352209597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc06d3d0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0b7740 tx=0x7f05cc02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 -- 172.21.15.6:0/352209597 shutdown_connections 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 --2- 172.21.15.6:0/352209597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 0x7f05dc0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 --2- 172.21.15.6:0/352209597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc06d3d0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 --2- 172.21.15.6:0/352209597 >> v2:172.21.15.171:3300/0 conn(0x7f05dc162820 0x7f05dc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 -- 172.21.15.6:0/352209597 >> 172.21.15.6:0/352209597 conn(0x7f05dc0d4bd0 msgr2=0x7f05dc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 -- 172.21.15.6:0/352209597 shutdown_connections 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.493+0000 7f05e3145640 1 -- 172.21.15.6:0/352209597 wait complete. 2024-05-20T18:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.494+0000 7f05e3145640 1 Processor -- start 2024-05-20T18:02:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.494+0000 7f05e3145640 1 -- start start 2024-05-20T18:02:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e3145640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 0x7f05dc14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e3145640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e3145640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05dc162820 0x7f05dc0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e3145640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc0d0300 con 0x7f05dc0b3e80 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e3145640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc0d4260 con 0x7f05dc162820 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e3145640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc0d4780 con 0x7f05dc06d910 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc0cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33046/0 (socket says 172.21.15.6:33046) 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05d3fff640 1 -- 172.21.15.6:0/1047404819 learned_addr learned my addr 172.21.15.6:0/1047404819 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e0ee1640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 0x7f05dc14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e16e2640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05dc162820 0x7f05dc0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05d3fff640 1 -- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 msgr2=0x7f05dc14aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05d3fff640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 0x7f05dc14aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05d3fff640 1 -- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05dc162820 msgr2=0x7f05dc0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05d3fff640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05dc162820 0x7f05dc0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05d3fff640 1 -- 172.21.15.6:0/1047404819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc0cd780 con 0x7f05dc0b3e80 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.496+0000 7f05e16e2640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05dc162820 0x7f05dc0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.497+0000 7f05d3fff640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc0cca10 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f05cc02a220 tx=0x7f05cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.497+0000 7f05d17fa640 1 -- 172.21.15.6:0/1047404819 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc041020 con 0x7f05dc0b3e80 2024-05-20T18:02:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.497+0000 7f05d17fa640 1 -- 172.21.15.6:0/1047404819 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05cc0306c0 con 0x7f05dc0b3e80 2024-05-20T18:02:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.497+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc0cda60 con 0x7f05dc0b3e80 2024-05-20T18:02:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.497+0000 7f05d17fa640 1 -- 172.21.15.6:0/1047404819 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc037040 con 0x7f05dc0b3e80 2024-05-20T18:02:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.497+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc0ce020 con 0x7f05dc0b3e80 2024-05-20T18:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.498+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05dc0cd4f0 con 0x7f05dc0b3e80 2024-05-20T18:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.498+0000 7f05d17fa640 1 -- 172.21.15.6:0/1047404819 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05cc044020 con 0x7f05dc0b3e80 2024-05-20T18:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.499+0000 7f05d17fa640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05c806be30 0x7f05c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.499+0000 7f05d17fa640 1 -- 172.21.15.6:0/1047404819 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f05cc0ab550 con 0x7f05dc0b3e80 2024-05-20T18:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.499+0000 7f05e0ee1640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05c806be30 0x7f05c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.500+0000 7f05e0ee1640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05c806be30 0x7f05c806e340 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f05d80079a0 tx=0x7f05d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.504+0000 7f05d17fa640 1 -- 172.21.15.6:0/1047404819 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f05cc04b030 con 0x7f05dc0b3e80 2024-05-20T18:02:42.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.691+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f05dc075b00 con 0x7f05dc0b3e80 2024-05-20T18:02:42.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.695+0000 7f05d17fa640 1 -- 172.21.15.6:0/1047404819 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v61) ==== 107+0+0 (secure 0 0 0) 0x7f05cc079fe0 con 0x7f05dc0b3e80 2024-05-20T18:02:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05c806be30 msgr2=0x7f05c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05c806be30 0x7f05c806e340 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f05d80079a0 tx=0x7f05d8008040 comp rx=0 tx=0).stop 2024-05-20T18:02:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 msgr2=0x7f05dc0cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc0cca10 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f05cc02a220 tx=0x7f05cc0046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 shutdown_connections 2024-05-20T18:02:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f05c806be30 0x7f05c806e340 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05dc162820 0x7f05dc0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05dc0b3e80 0x7f05dc0cca10 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 --2- 172.21.15.6:0/1047404819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05dc06d910 0x7f05dc14aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 >> 172.21.15.6:0/1047404819 conn(0x7f05dc0d4bd0 msgr2=0x7f05dc0cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 shutdown_connections 2024-05-20T18:02:42.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.697+0000 7f05e3145640 1 -- 172.21.15.6:0/1047404819 wait complete. 2024-05-20T18:02:42.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-05-20T18:02:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.825+0000 7f667759e640 1 Processor -- start 2024-05-20T18:02:42.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.825+0000 7f667759e640 1 -- start start 2024-05-20T18:02:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f667759e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f66780cf860 0x7f66780b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f667759e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6678163520 0x7f66780d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f667759e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66781605a0 con 0x7f6678163930 2024-05-20T18:02:42.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f667759e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f667815ffe0 con 0x7f6678163520 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f667759e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f66781602c0 con 0x7f66780cf860 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f6675d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6678163520 0x7f66780d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f6675d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6678163520 0x7f66780d12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33050/0 (socket says 172.21.15.6:33050) 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f6675d9b640 1 -- 172.21.15.6:0/836282184 learned_addr learned my addr 172.21.15.6:0/836282184 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f667659c640 1 --2- 172.21.15.6:0/836282184 >> v2:172.21.15.171:3300/0 conn(0x7f66780cf860 0x7f66780b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f6675d9b640 1 -- 172.21.15.6:0/836282184 >> v2:172.21.15.171:3300/0 conn(0x7f66780cf860 msgr2=0x7f66780b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f6675d9b640 1 --2- 172.21.15.6:0/836282184 >> v2:172.21.15.171:3300/0 conn(0x7f66780cf860 0x7f66780b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f6675d9b640 1 -- 172.21.15.6:0/836282184 >> v1:172.21.15.171:6789/0 conn(0x7f6678163930 legacy=0x7f66780d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.827+0000 7f6675d9b640 1 -- 172.21.15.6:0/836282184 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6678162d20 con 0x7f6678163520 2024-05-20T18:02:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.828+0000 7f6675d9b640 1 --2- 172.21.15.6:0/836282184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66780d12a0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f66780b7570 tx=0x7f666002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd185d8cc0ed52fa server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:42.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.828+0000 7f667559a640 1 -- 172.21.15.6:0/836282184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660037070 con 0x7f6678163520 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.828+0000 7f667559a640 1 -- 172.21.15.6:0/836282184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6660032440 con 0x7f6678163520 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.828+0000 7f667559a640 1 -- 172.21.15.6:0/836282184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660032810 con 0x7f6678163520 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.829+0000 7f667759e640 1 -- 172.21.15.6:0/836282184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 msgr2=0x7f66780d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.829+0000 7f667759e640 1 --2- 172.21.15.6:0/836282184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66780d12a0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f66780b7570 tx=0x7f666002a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.829+0000 7f667759e640 1 -- 172.21.15.6:0/836282184 shutdown_connections 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.829+0000 7f667759e640 1 --2- 172.21.15.6:0/836282184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66780d12a0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.829+0000 7f667759e640 1 --2- 172.21.15.6:0/836282184 >> v2:172.21.15.171:3300/0 conn(0x7f66780cf860 0x7f66780b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.829+0000 7f667759e640 1 -- 172.21.15.6:0/836282184 >> 172.21.15.6:0/836282184 conn(0x7f667806dbb0 msgr2=0x7f667806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.829+0000 7f667759e640 1 -- 172.21.15.6:0/836282184 shutdown_connections 2024-05-20T18:02:42.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.829+0000 7f667759e640 1 -- 172.21.15.6:0/836282184 wait complete. 2024-05-20T18:02:42.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.831+0000 7f667759e640 1 Processor -- start 2024-05-20T18:02:42.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.831+0000 7f667759e640 1 -- start start 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.832+0000 7f667759e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66780cf860 0x7f6678155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.832+0000 7f667759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66781f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.832+0000 7f667759e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6678163930 0x7f66781f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.832+0000 7f667759e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f66780d39d0 con 0x7f6678163520 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.832+0000 7f667759e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66780d3850 con 0x7f6678163930 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.832+0000 7f667759e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f66780d3b50 con 0x7f66780cf860 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66781f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66781f97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33058/0 (socket says 172.21.15.6:33058) 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 -- 172.21.15.6:0/2301652031 learned_addr learned my addr 172.21.15.6:0/2301652031 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f667659c640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66780cf860 0x7f6678155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 -- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66780cf860 msgr2=0x7f6678155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66780cf860 0x7f6678155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6676d9d640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6678163930 0x7f66781f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 -- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6678163930 msgr2=0x7f66781f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6678163930 0x7f66781f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 -- 172.21.15.6:0/2301652031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66781f62e0 con 0x7f6678163520 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6676d9d640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6678163930 0x7f66781f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f6675d9b640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66781f97d0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f6660000c00 tx=0x7f66600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f666effd640 1 -- 172.21.15.6:0/2301652031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660041020 con 0x7f6678163520 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f666effd640 1 -- 172.21.15.6:0/2301652031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66600306c0 con 0x7f6678163520 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f666effd640 1 -- 172.21.15.6:0/2301652031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6660037040 con 0x7f6678163520 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66781f65c0 con 0x7f6678163520 2024-05-20T18:02:42.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.833+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66781f92b0 con 0x7f6678163520 2024-05-20T18:02:42.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.834+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6678075980 con 0x7f6678163520 2024-05-20T18:02:42.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.835+0000 7f666effd640 1 -- 172.21.15.6:0/2301652031 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6660044020 con 0x7f6678163520 2024-05-20T18:02:42.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.835+0000 7f666effd640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f665806be30 0x7f665806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:42.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.836+0000 7f666effd640 1 -- 172.21.15.6:0/2301652031 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f66600ab540 con 0x7f6678163520 2024-05-20T18:02:42.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.836+0000 7f667659c640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f665806be30 0x7f665806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:42.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.836+0000 7f667659c640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f665806be30 0x7f665806e340 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f66780d11f0 tx=0x7f667000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:42.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:42.840+0000 7f666effd640 1 -- 172.21.15.6:0/2301652031 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f666004b030 con 0x7f6678163520 2024-05-20T18:02:43.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.023+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7f66781564d0 con 0x7f6678163520 2024-05-20T18:02:43.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.027+0000 7f666effd640 1 -- 172.21.15.6:0/2301652031 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v62) ==== 105+0+0 (secure 0 0 0) 0x7f666007a0f0 con 0x7f6678163520 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f665806be30 msgr2=0x7f665806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f665806be30 0x7f665806e340 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f66780d11f0 tx=0x7f667000b040 comp rx=0 tx=0).stop 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 msgr2=0x7f66781f97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66781f97d0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f6660000c00 tx=0x7f66600046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 shutdown_connections 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f665806be30 0x7f665806e340 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6678163930 0x7f66781f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6678163520 0x7f66781f97d0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 --2- 172.21.15.6:0/2301652031 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66780cf860 0x7f6678155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 >> 172.21.15.6:0/2301652031 conn(0x7f667806dbb0 msgr2=0x7f66780b80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 shutdown_connections 2024-05-20T18:02:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.029+0000 7f667759e640 1 -- 172.21.15.6:0/2301652031 wait complete. 2024-05-20T18:02:43.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-05-20T18:02:43.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.164+0000 7efc9ffc2640 1 Processor -- start 2024-05-20T18:02:43.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.164+0000 7efc9ffc2640 1 -- start start 2024-05-20T18:02:43.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.165+0000 7efc9ffc2640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efc98162820 0x7efc980b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.165+0000 7efc9ffc2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc980d0630 con 0x7efc9806dae0 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.165+0000 7efc9ffc2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc980d39c0 con 0x7efc980b3e80 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.165+0000 7efc9ffc2640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efc980d3ca0 con 0x7efc98162820 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.165+0000 7efc9e55f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efc9806dae0 0x7efc980b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39564/0 (socket says 172.21.15.6:39564) 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.165+0000 7efc9e55f640 1 -- 172.21.15.6:0/3690363360 learned_addr learned my addr 172.21.15.6:0/3690363360 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3690363360 >> v2:172.21.15.171:3300/0 conn(0x7efc98162820 0x7efc980b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544582923 0 0) 0x7efc980d0630 con 0x7efc9806dae0 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc84003520 con 0x7efc9806dae0 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3743549373 0 0) 0x7efc84003520 con 0x7efc9806dae0 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 >> v2:172.21.15.171:3300/0 conn(0x7efc98162820 msgr2=0x7efc980b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:43.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 --2- 172.21.15.6:0/3690363360 >> v2:172.21.15.171:3300/0 conn(0x7efc98162820 0x7efc980b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 >> v1:172.21.15.171:6789/0 conn(0x7efc980b3e80 legacy=0x7efc9806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc980d3f80 con 0x7efc9806dae0 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7efc900019f0 con 0x7efc9806dae0 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3690363360 >> v2:172.21.15.171:3300/0 conn(0x7efc98162820 0x7efc980b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 >> v1:172.21.15.6:6789/0 conn(0x7efc9806dae0 legacy=0x7efc980b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc840039b0 0x7efc84003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc84004800 0x7efc84004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840051c0 0x7efc8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc980d3ca0 con 0x7efc840039b0 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc8400c160 con 0x7efc84004800 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc8400c360 con 0x7efc840051c0 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc840039b0 0x7efc84003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.166+0000 7efc9d55d640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc84004800 0x7efc84004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9e55f640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840051c0 0x7efc8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9dd5e640 1 -- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840051c0 msgr2=0x7efc8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840051c0 0x7efc8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9dd5e640 1 -- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc84004800 msgr2=0x7efc84004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc84004800 0x7efc84004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9dd5e640 1 -- 172.21.15.6:0/3690363360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc84003520 con 0x7efc840039b0 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9e55f640 1 -- 172.21.15.6:0/3690363360 reap_dead start 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9d55d640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc84004800 0x7efc84004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.167+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc840039b0 0x7efc84003e20 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7efc94009c90 tx=0x7efc84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05b8866b14492ce server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94036070 con 0x7efc840039b0 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc94031400 con 0x7efc840039b0 2024-05-20T18:02:43.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9cd5c640 1 -- 172.21.15.6:0/3690363360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94009860 con 0x7efc840039b0 2024-05-20T18:02:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3690363360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc840039b0 msgr2=0x7efc84003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9ffc2640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc840039b0 0x7efc84003e20 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7efc94009c90 tx=0x7efc84005830 comp rx=0 tx=0).stop 2024-05-20T18:02:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3690363360 shutdown_connections 2024-05-20T18:02:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9ffc2640 1 --2- 172.21.15.6:0/3690363360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc840039b0 0x7efc84003e20 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3690363360 >> 172.21.15.6:0/3690363360 conn(0x7efc980d4bd0 msgr2=0x7efc980d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3690363360 shutdown_connections 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.168+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3690363360 wait complete. 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.170+0000 7efc9ffc2640 1 Processor -- start 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.170+0000 7efc9ffc2640 1 -- start start 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9ffc2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840039b0 0x7efc98160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9ffc2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ac780 0x7efc980cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9ffc2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc980acb90 0x7efc980cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9ffc2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc980d4780 con 0x7efc980ac780 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9ffc2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc980d0300 con 0x7efc980acb90 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9ffc2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc980d4900 con 0x7efc840039b0 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ac780 0x7efc980cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ac780 0x7efc980cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33076/0 (socket says 172.21.15.6:33076) 2024-05-20T18:02:43.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 -- 172.21.15.6:0/3397923724 learned_addr learned my addr 172.21.15.6:0/3397923724 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840039b0 0x7efc98160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9e55f640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc980acb90 0x7efc980cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 -- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840039b0 msgr2=0x7efc98160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840039b0 0x7efc98160700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 -- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc980acb90 msgr2=0x7efc980cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc980acb90 0x7efc980cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 -- 172.21.15.6:0/3397923724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc980ad2f0 con 0x7efc980ac780 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9d55d640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ac780 0x7efc980cd130 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7efc8800e480 tx=0x7efc8800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc8e7fc640 1 -- 172.21.15.6:0/3397923724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc880052e0 con 0x7efc980ac780 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc8e7fc640 1 -- 172.21.15.6:0/3397923724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc88018070 con 0x7efc980ac780 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc980ad5d0 con 0x7efc980ac780 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.172+0000 7efc8e7fc640 1 -- 172.21.15.6:0/3397923724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88003810 con 0x7efc980ac780 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.173+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc980adb90 con 0x7efc980ac780 2024-05-20T18:02:43.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.174+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc98075b00 con 0x7efc980ac780 2024-05-20T18:02:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.174+0000 7efc8e7fc640 1 -- 172.21.15.6:0/3397923724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc880039b0 con 0x7efc980ac780 2024-05-20T18:02:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.175+0000 7efc8e7fc640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7c06be60 0x7efc7c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.175+0000 7efc8e7fc640 1 -- 172.21.15.6:0/3397923724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7efc8808a9f0 con 0x7efc980ac780 2024-05-20T18:02:43.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.175+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7c06be60 0x7efc7c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.175+0000 7efc9dd5e640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7c06be60 0x7efc7c06e370 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7efc94033000 tx=0x7efc94008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.179+0000 7efc8e7fc640 1 -- 172.21.15.6:0/3397923724 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efc88059510 con 0x7efc980ac780 2024-05-20T18:02:43.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.367+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7efc98160c40 con 0x7efc980ac780 2024-05-20T18:02:43.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.370+0000 7efc8e7fc640 1 -- 172.21.15.6:0/3397923724 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v63) ==== 111+0+0 (secure 0 0 0) 0x7efc88058e10 con 0x7efc980ac780 2024-05-20T18:02:43.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7c06be60 msgr2=0x7efc7c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7c06be60 0x7efc7c06e370 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7efc94033000 tx=0x7efc94008030 comp rx=0 tx=0).stop 2024-05-20T18:02:43.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ac780 msgr2=0x7efc980cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ac780 0x7efc980cd130 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7efc8800e480 tx=0x7efc8800e940 comp rx=0 tx=0).stop 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 shutdown_connections 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7c06be60 0x7efc7c06e370 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc980acb90 0x7efc980cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc980ac780 0x7efc980cd130 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 --2- 172.21.15.6:0/3397923724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc840039b0 0x7efc98160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 >> 172.21.15.6:0/3397923724 conn(0x7efc980d4bd0 msgr2=0x7efc980b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 shutdown_connections 2024-05-20T18:02:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.372+0000 7efc9ffc2640 1 -- 172.21.15.6:0/3397923724 wait complete. 2024-05-20T18:02:43.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T18:02:43.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.500+0000 7f51222d7640 1 Processor -- start 2024-05-20T18:02:43.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.500+0000 7f51222d7640 1 -- start start 2024-05-20T18:02:43.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.501+0000 7f51222d7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c15d530 0x7f511c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.501+0000 7f51222d7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f511c070850 0x7f511c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.501+0000 7f51222d7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511c0cd580 con 0x7f511c0b1700 2024-05-20T18:02:43.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.501+0000 7f51222d7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f511c0ce190 con 0x7f511c070850 2024-05-20T18:02:43.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.501+0000 7f51222d7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f511c0cd860 con 0x7f511c15d530 2024-05-20T18:02:43.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.501+0000 7f5120874640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f511c070850 0x7f511c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f511b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f511c0b1700 0x7f511c0b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39572/0 (socket says 172.21.15.6:39572) 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f511b7fe640 1 -- 172.21.15.6:0/4188111993 learned_addr learned my addr 172.21.15.6:0/4188111993 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f511bfff640 1 --2- 172.21.15.6:0/4188111993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c15d530 0x7f511c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f511affd640 1 -- 172.21.15.6:0/4188111993 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545021694 0 0) 0x7f511c0cd580 con 0x7f511c0b1700 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f511affd640 1 -- 172.21.15.6:0/4188111993 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5104003520 con 0x7f511c0b1700 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f5120874640 1 -- 172.21.15.6:0/4188111993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c15d530 msgr2=0x7f511c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f5120874640 1 --2- 172.21.15.6:0/4188111993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c15d530 0x7f511c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f5120874640 1 -- 172.21.15.6:0/4188111993 >> v1:172.21.15.6:6789/0 conn(0x7f511c0b1700 legacy=0x7f511c0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.502+0000 7f5120874640 1 -- 172.21.15.6:0/4188111993 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c0cdb40 con 0x7f511c070850 2024-05-20T18:02:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.503+0000 7f5120874640 1 --2- 172.21.15.6:0/4188111993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c070850 0x7f511c070c60 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f5114009d90 tx=0x7f511402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b7f494fd57593d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.503+0000 7f511affd640 1 -- 172.21.15.6:0/4188111993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114007740 con 0x7f511c070850 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.503+0000 7f511affd640 1 -- 172.21.15.6:0/4188111993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51140078e0 con 0x7f511c070850 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.503+0000 7f511affd640 1 -- 172.21.15.6:0/4188111993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114007cb0 con 0x7f511c070850 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.503+0000 7f51222d7640 1 -- 172.21.15.6:0/4188111993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c070850 msgr2=0x7f511c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.503+0000 7f51222d7640 1 --2- 172.21.15.6:0/4188111993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c070850 0x7f511c070c60 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f5114009d90 tx=0x7f511402a660 comp rx=0 tx=0).stop 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.504+0000 7f51222d7640 1 -- 172.21.15.6:0/4188111993 shutdown_connections 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.504+0000 7f51222d7640 1 --2- 172.21.15.6:0/4188111993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c070850 0x7f511c070c60 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.504+0000 7f51222d7640 1 --2- 172.21.15.6:0/4188111993 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c15d530 0x7f511c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.504+0000 7f51222d7640 1 -- 172.21.15.6:0/4188111993 >> 172.21.15.6:0/4188111993 conn(0x7f511c0d29d0 msgr2=0x7f511c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.504+0000 7f51222d7640 1 -- 172.21.15.6:0/4188111993 shutdown_connections 2024-05-20T18:02:43.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.504+0000 7f51222d7640 1 -- 172.21.15.6:0/4188111993 wait complete. 2024-05-20T18:02:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.505+0000 7f51222d7640 1 Processor -- start 2024-05-20T18:02:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.506+0000 7f51222d7640 1 -- start start 2024-05-20T18:02:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f51222d7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c070850 0x7f511c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f51222d7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c0b1700 0x7f511c0b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f51222d7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f511c15d530 0x7f511c0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f51222d7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f511c0711a0 con 0x7f511c0b1700 2024-05-20T18:02:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f51222d7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f511c0cd230 con 0x7f511c15d530 2024-05-20T18:02:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f51222d7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f511c071320 con 0x7f511c070850 2024-05-20T18:02:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c0b1700 0x7f511c0b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c0b1700 0x7f511c0b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33100/0 (socket says 172.21.15.6:33100) 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511b7fe640 1 -- 172.21.15.6:0/3372430846 learned_addr learned my addr 172.21.15.6:0/3372430846 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511bfff640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c070850 0x7f511c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f5120874640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f511c15d530 0x7f511c0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511b7fe640 1 -- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c070850 msgr2=0x7f511c0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511b7fe640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c070850 0x7f511c0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511b7fe640 1 -- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f511c15d530 msgr2=0x7f511c0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511b7fe640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f511c15d530 0x7f511c0b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.507+0000 7f511b7fe640 1 -- 172.21.15.6:0/3372430846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511c157e10 con 0x7f511c0b1700 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.508+0000 7f511b7fe640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c0b1700 0x7f511c0b6340 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f511000c3c0 tx=0x7f511000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.508+0000 7f5118ff9640 1 -- 172.21.15.6:0/3372430846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110017070 con 0x7f511c0b1700 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.508+0000 7f5118ff9640 1 -- 172.21.15.6:0/3372430846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5110005ce0 con 0x7f511c0b1700 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.508+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511c0c9120 con 0x7f511c0b1700 2024-05-20T18:02:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.508+0000 7f5118ff9640 1 -- 172.21.15.6:0/3372430846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110007310 con 0x7f511c0b1700 2024-05-20T18:02:43.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.508+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f511c06d9c0 con 0x7f511c0b1700 2024-05-20T18:02:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.509+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511c0b13b0 con 0x7f511c0b1700 2024-05-20T18:02:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.510+0000 7f5118ff9640 1 -- 172.21.15.6:0/3372430846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f511001a070 con 0x7f511c0b1700 2024-05-20T18:02:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.510+0000 7f5118ff9640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510806be60 0x7f510806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.510+0000 7f5118ff9640 1 -- 172.21.15.6:0/3372430846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f511008a030 con 0x7f511c0b1700 2024-05-20T18:02:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.510+0000 7f511bfff640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510806be60 0x7f510806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.511+0000 7f511bfff640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510806be60 0x7f510806e370 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f510c006fd0 tx=0x7f510c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.515+0000 7f5118ff9640 1 -- 172.21.15.6:0/3372430846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5110058b50 con 0x7f511c0b1700 2024-05-20T18:02:43.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.699+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f511c075b00 con 0x7f511c0b1700 2024-05-20T18:02:43.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.702+0000 7f5118ff9640 1 -- 172.21.15.6:0/3372430846 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7f5110058450 con 0x7f511c0b1700 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510806be60 msgr2=0x7f510806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510806be60 0x7f510806e370 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f510c006fd0 tx=0x7f510c008040 comp rx=0 tx=0).stop 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c0b1700 msgr2=0x7f511c0b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c0b1700 0x7f511c0b6340 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f511000c3c0 tx=0x7f511000c880 comp rx=0 tx=0).stop 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 shutdown_connections 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f510806be60 0x7f510806e370 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f511c15d530 0x7f511c0b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f511c0b1700 0x7f511c0b6340 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 --2- 172.21.15.6:0/3372430846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f511c070850 0x7f511c0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 >> 172.21.15.6:0/3372430846 conn(0x7f511c0d29d0 msgr2=0x7f511c0d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 shutdown_connections 2024-05-20T18:02:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.705+0000 7f51222d7640 1 -- 172.21.15.6:0/3372430846 wait complete. 2024-05-20T18:02:43.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-05-20T18:02:43.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.832+0000 7f082e902640 1 Processor -- start 2024-05-20T18:02:43.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.832+0000 7f082e902640 1 -- start start 2024-05-20T18:02:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.833+0000 7f082e902640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f082815d530 0x7f082815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.833+0000 7f082e902640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0828070850 0x7f0828070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.833+0000 7f082e902640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08280cd580 con 0x7f08280b1700 2024-05-20T18:02:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.833+0000 7f082e902640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f08280ce190 con 0x7f0828070850 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.833+0000 7f082e902640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f08280cd860 con 0x7f082815d530 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f082ce9f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0828070850 0x7f0828070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f08277fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f08280b1700 0x7f08280b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39574/0 (socket says 172.21.15.6:39574) 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f082ce9f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0828070850 0x7f0828070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33104/0 (socket says 172.21.15.6:33104) 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f08277fe640 1 -- 172.21.15.6:0/2971971616 learned_addr learned my addr 172.21.15.6:0/2971971616 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f0827fff640 1 --2- 172.21.15.6:0/2971971616 >> v2:172.21.15.171:3300/0 conn(0x7f082815d530 0x7f082815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f082ce9f640 1 -- 172.21.15.6:0/2971971616 >> v2:172.21.15.171:3300/0 conn(0x7f082815d530 msgr2=0x7f082815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f082ce9f640 1 --2- 172.21.15.6:0/2971971616 >> v2:172.21.15.171:3300/0 conn(0x7f082815d530 0x7f082815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f082ce9f640 1 -- 172.21.15.6:0/2971971616 >> v1:172.21.15.6:6789/0 conn(0x7f08280b1700 legacy=0x7f08280b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f082ce9f640 1 -- 172.21.15.6:0/2971971616 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08280cdb40 con 0x7f0828070850 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f0826ffd640 1 -- 172.21.15.6:0/2971971616 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678020603 0 0) 0x7f08280cd580 con 0x7f08280b1700 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.834+0000 7f0827fff640 1 --2- 172.21.15.6:0/2971971616 >> v2:172.21.15.171:3300/0 conn(0x7f082815d530 0x7f082815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.835+0000 7f082ce9f640 1 --2- 172.21.15.6:0/2971971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0828070850 0x7f0828070c60 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f082804f790 tx=0x7f082002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390d5a1f52fae96d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.835+0000 7f0826ffd640 1 -- 172.21.15.6:0/2971971616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820007740 con 0x7f0828070850 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.835+0000 7f0826ffd640 1 -- 172.21.15.6:0/2971971616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08200078e0 con 0x7f0828070850 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.835+0000 7f0826ffd640 1 -- 172.21.15.6:0/2971971616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820007cb0 con 0x7f0828070850 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.836+0000 7f082e902640 1 -- 172.21.15.6:0/2971971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0828070850 msgr2=0x7f0828070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.836+0000 7f082e902640 1 --2- 172.21.15.6:0/2971971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0828070850 0x7f0828070c60 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f082804f790 tx=0x7f082002a680 comp rx=0 tx=0).stop 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.836+0000 7f082e902640 1 -- 172.21.15.6:0/2971971616 shutdown_connections 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.836+0000 7f082e902640 1 --2- 172.21.15.6:0/2971971616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0828070850 0x7f0828070c60 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.836+0000 7f082e902640 1 --2- 172.21.15.6:0/2971971616 >> v2:172.21.15.171:3300/0 conn(0x7f082815d530 0x7f082815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.836+0000 7f082e902640 1 -- 172.21.15.6:0/2971971616 >> 172.21.15.6:0/2971971616 conn(0x7f08280d29d0 msgr2=0x7f08280d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.836+0000 7f082e902640 1 -- 172.21.15.6:0/2971971616 shutdown_connections 2024-05-20T18:02:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.836+0000 7f082e902640 1 -- 172.21.15.6:0/2971971616 wait complete. 2024-05-20T18:02:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.837+0000 7f082e902640 1 Processor -- start 2024-05-20T18:02:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.838+0000 7f082e902640 1 -- start start 2024-05-20T18:02:43.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f082e902640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0828070850 0x7f08280b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f082e902640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08280b1700 0x7f0828158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f082e902640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f082815d530 0x7f082815c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f082e902640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f08280711a0 con 0x7f08280b1700 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f082e902640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08280cd230 con 0x7f0828070850 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f082e902640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0828071320 con 0x7f082815d530 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f08277fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08280b1700 0x7f0828158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f08277fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08280b1700 0x7f0828158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33112/0 (socket says 172.21.15.6:33112) 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f08277fe640 1 -- 172.21.15.6:0/1897729280 learned_addr learned my addr 172.21.15.6:0/1897729280 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f082ce9f640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f082815d530 0x7f082815c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f0827fff640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0828070850 0x7f08280b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f08277fe640 1 -- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f082815d530 msgr2=0x7f082815c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f08277fe640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f082815d530 0x7f082815c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f08277fe640 1 -- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0828070850 msgr2=0x7f08280b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:43.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f08277fe640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0828070850 0x7f08280b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.839+0000 7f08277fe640 1 -- 172.21.15.6:0/1897729280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08280c67e0 con 0x7f08280b1700 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.840+0000 7f082ce9f640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f082815d530 0x7f082815c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.840+0000 7f0827fff640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0828070850 0x7f08280b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.840+0000 7f08277fe640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08280b1700 0x7f0828158db0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c430 tx=0x7f081c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.840+0000 7f0824ff9640 1 -- 172.21.15.6:0/1897729280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c0074e0 con 0x7f08280b1700 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.840+0000 7f0824ff9640 1 -- 172.21.15.6:0/1897729280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f081c0047e0 con 0x7f08280b1700 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.840+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08280c6ac0 con 0x7f08280b1700 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.840+0000 7f0824ff9640 1 -- 172.21.15.6:0/1897729280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c004bd0 con 0x7f08280b1700 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.840+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08280c7080 con 0x7f08280b1700 2024-05-20T18:02:43.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.841+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0828075b00 con 0x7f08280b1700 2024-05-20T18:02:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.842+0000 7f0824ff9640 1 -- 172.21.15.6:0/1897729280 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f081c011070 con 0x7f08280b1700 2024-05-20T18:02:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.842+0000 7f0824ff9640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f081406be60 0x7f081406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.842+0000 7f0824ff9640 1 -- 172.21.15.6:0/1897729280 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f081c08a9c0 con 0x7f08280b1700 2024-05-20T18:02:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.843+0000 7f0827fff640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f081406be60 0x7f081406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:43.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.843+0000 7f0827fff640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f081406be60 0x7f081406e370 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f08280d29a0 tx=0x7f0818008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:43.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:43.847+0000 7f0824ff9640 1 -- 172.21.15.6:0/1897729280 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f081c00e280 con 0x7f08280b1700 2024-05-20T18:02:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.033+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7f082815db50 con 0x7f08280b1700 2024-05-20T18:02:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.036+0000 7f0824ff9640 1 -- 172.21.15.6:0/1897729280 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v65) ==== 102+0+0 (secure 0 0 0) 0x7f081c059440 con 0x7f08280b1700 2024-05-20T18:02:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f081406be60 msgr2=0x7f081406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f081406be60 0x7f081406e370 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f08280d29a0 tx=0x7f0818008040 comp rx=0 tx=0).stop 2024-05-20T18:02:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08280b1700 msgr2=0x7f0828158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08280b1700 0x7f0828158db0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f081c00c430 tx=0x7f081c00c8f0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 shutdown_connections 2024-05-20T18:02:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f081406be60 0x7f081406e370 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f082815d530 0x7f082815c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08280b1700 0x7f0828158db0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 --2- 172.21.15.6:0/1897729280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0828070850 0x7f08280b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 >> 172.21.15.6:0/1897729280 conn(0x7f08280d29d0 msgr2=0x7f082815f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 shutdown_connections 2024-05-20T18:02:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.039+0000 7f082e902640 1 -- 172.21.15.6:0/1897729280 wait complete. 2024-05-20T18:02:44.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root' 2024-05-20T18:02:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.165+0000 7f7c111cc640 1 Processor -- start 2024-05-20T18:02:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.165+0000 7f7c111cc640 1 -- start start 2024-05-20T18:02:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c111cc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c06d3d0 0x7f7c0c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c111cc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7c0c0b8190 0x7f7c0c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c111cc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c06dd20 con 0x7f7c0c162820 2024-05-20T18:02:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c111cc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0c0d0630 con 0x7f7c0c0b8190 2024-05-20T18:02:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c111cc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c0d39c0 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c03fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c06d3d0 0x7f7c0c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c0b59e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7c0c0b8190 0x7f7c0c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c0ad9d640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7c0c162820 0x7f7c0c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:40390/0 (socket says 172.21.15.6:40390) 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c0b59e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7c0c0b8190 0x7f7c0c0b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:33788/0 (socket says 172.21.15.6:33788) 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c0b59e640 1 -- 172.21.15.6:0/2305566764 learned_addr learned my addr 172.21.15.6:0/2305566764 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.167+0000 7f7c03fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c06d3d0 0x7f7c0c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:46654/0 (socket says 172.21.15.6:46654) 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.168+0000 7f7c03fff640 1 -- 172.21.15.6:0/2305566764 >> v2:172.21.15.171:3300/0 conn(0x7f7c0c0b8190 msgr2=0x7f7c0c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.168+0000 7f7c03fff640 1 --2- 172.21.15.6:0/2305566764 >> v2:172.21.15.171:3300/0 conn(0x7f7c0c0b8190 0x7f7c0c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.168+0000 7f7c03fff640 1 -- 172.21.15.6:0/2305566764 >> v1:172.21.15.171:6789/0 conn(0x7f7c0c162820 legacy=0x7f7c0c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.168+0000 7f7c03fff640 1 -- 172.21.15.6:0/2305566764 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c0d3ca0 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.168+0000 7f7c0b59e640 1 --2- 172.21.15.6:0/2305566764 >> v2:172.21.15.171:3300/0 conn(0x7f7c0c0b8190 0x7f7c0c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.168+0000 7f7c03fff640 1 --2- 172.21.15.6:0/2305566764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c06d3d0 0x7f7c0c06d7e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40097a0 tx=0x7f7bf402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=365c55d5769dcb46 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c0a59c640 1 -- 172.21.15.6:0/2305566764 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4037070 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c0a59c640 1 -- 172.21.15.6:0/2305566764 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf4032440 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c0a59c640 1 -- 172.21.15.6:0/2305566764 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4032810 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c111cc640 1 -- 172.21.15.6:0/2305566764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c06d3d0 msgr2=0x7f7c0c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c111cc640 1 --2- 172.21.15.6:0/2305566764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c06d3d0 0x7f7c0c06d7e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40097a0 tx=0x7f7bf402a180 comp rx=0 tx=0).stop 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c111cc640 1 -- 172.21.15.6:0/2305566764 shutdown_connections 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c111cc640 1 --2- 172.21.15.6:0/2305566764 >> v2:172.21.15.171:3300/0 conn(0x7f7c0c0b8190 0x7f7c0c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c111cc640 1 --2- 172.21.15.6:0/2305566764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c06d3d0 0x7f7c0c06d7e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.169+0000 7f7c111cc640 1 -- 172.21.15.6:0/2305566764 >> 172.21.15.6:0/2305566764 conn(0x7f7c0c0d4bd0 msgr2=0x7f7c0c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.170+0000 7f7c111cc640 1 -- 172.21.15.6:0/2305566764 shutdown_connections 2024-05-20T18:02:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.170+0000 7f7c111cc640 1 -- 172.21.15.6:0/2305566764 wait complete. 2024-05-20T18:02:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.171+0000 7f7c111cc640 1 Processor -- start 2024-05-20T18:02:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.172+0000 7f7c111cc640 1 -- start start 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c111cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c0c06d3d0 0x7f7c0c0b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c111cc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c0c0b8190 0x7f7c0c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c111cc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c162820 0x7f7c0c158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c111cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c0d0300 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c111cc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c0d4260 con 0x7f7c0c0b8190 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c111cc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c0b4050 con 0x7f7c0c162820 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c0c06d3d0 0x7f7c0c0b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c0c06d3d0 0x7f7c0c0b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33124/0 (socket says 172.21.15.6:33124) 2024-05-20T18:02:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0ad9d640 1 -- 172.21.15.6:0/44556436 learned_addr learned my addr 172.21.15.6:0/44556436 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0b59e640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c162820 0x7f7c0c158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c03fff640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c0c0b8190 0x7f7c0c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0ad9d640 1 -- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c162820 msgr2=0x7f7c0c158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0ad9d640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c162820 0x7f7c0c158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0ad9d640 1 -- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c0c0b8190 msgr2=0x7f7c0c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0ad9d640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c0c0b8190 0x7f7c0c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c0ad9d640 1 -- 172.21.15.6:0/44556436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c0ccdc0 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.173+0000 7f7c03fff640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c0c0b8190 0x7f7c0c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.174+0000 7f7c0ad9d640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c0c06d3d0 0x7f7c0c0b3130 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00c3c0 tx=0x7f7bfc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.174+0000 7f7c037fe640 1 -- 172.21.15.6:0/44556436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0074e0 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.174+0000 7f7c037fe640 1 -- 172.21.15.6:0/44556436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc007680 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.174+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c0cd0a0 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.174+0000 7f7c037fe640 1 -- 172.21.15.6:0/44556436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc004a00 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.174+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c15c4a0 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.175+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c15c700 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.175+0000 7f7c037fe640 1 -- 172.21.15.6:0/44556436 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bfc01a020 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.176+0000 7f7c037fe640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bec06be30 0x7f7bec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.176+0000 7f7c037fe640 1 -- 172.21.15.6:0/44556436 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f7bfc08a340 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.176+0000 7f7c03fff640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bec06be30 0x7f7bec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:44.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.177+0000 7f7c03fff640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bec06be30 0x7f7bec06e340 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4034000 tx=0x7f7bf402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.180+0000 7f7c037fe640 1 -- 172.21.15.6:0/44556436 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7c0c06dd20 con 0x7f7c0c06d3d0 2024-05-20T18:02:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:44.437+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]} v 0) -- 0x7f7c0c075b00 con 0x7f7c0c06d3d0 2024-05-20T18:02:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.357+0000 7f7c037fe640 1 -- 172.21.15.6:0/44556436 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]}]=0 v508) ==== 148+0+0 (secure 0 0 0) 0x7f7bfc058ef0 con 0x7f7c0c06d3d0 2024-05-20T18:02:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bec06be30 msgr2=0x7f7bec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bec06be30 0x7f7bec06e340 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4034000 tx=0x7f7bf402e000 comp rx=0 tx=0).stop 2024-05-20T18:02:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c0c06d3d0 msgr2=0x7f7c0c0b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c0c06d3d0 0x7f7c0c0b3130 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00c3c0 tx=0x7f7bfc00c880 comp rx=0 tx=0).stop 2024-05-20T18:02:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 shutdown_connections 2024-05-20T18:02:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7bec06be30 0x7f7bec06e340 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c0c162820 0x7f7c0c158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c0c0b8190 0x7f7c0c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 --2- 172.21.15.6:0/44556436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c0c06d3d0 0x7f7c0c0b3130 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 >> 172.21.15.6:0/44556436 conn(0x7f7c0c0d4bd0 msgr2=0x7f7c0c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 shutdown_connections 2024-05-20T18:02:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.360+0000 7f7c111cc640 1 -- 172.21.15.6:0/44556436 wait complete. 2024-05-20T18:02:45.372 INFO:tasks.cephfs_test_runner:test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-05-20T18:02:45.372 INFO:tasks.cephfs_test_runner:Starting test: test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) When a client has a bug (which we will simulate) preventing it from releasing caps, 2024-05-20T18:02:45.372 INFO:tasks.cephfs_test_runner:test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) 2024-05-20T18:02:45.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:45.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.497+0000 7f1052a61640 1 Processor -- start 2024-05-20T18:02:45.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.497+0000 7f1052a61640 1 -- start start 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f1052a61640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f104c0af030 0x7f104c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f1052a61640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f104c06c180 0x7f104c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f1052a61640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104c0af980 con 0x7f104c15f700 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f1052a61640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f104c06bcf0 con 0x7f104c06c180 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f1052a61640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f104c160430 con 0x7f104c0af030 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f1050ffe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f104c06c180 0x7f104c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f1050ffe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f104c06c180 0x7f104c06c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33130/0 (socket says 172.21.15.6:33130) 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f1050ffe640 1 -- 172.21.15.6:0/2429886842 learned_addr learned my addr 172.21.15.6:0/2429886842 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.498+0000 7f104bfff640 1 --2- 172.21.15.6:0/2429886842 >> v2:172.21.15.171:3300/0 conn(0x7f104c0af030 0x7f104c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.499+0000 7f1050ffe640 1 -- 172.21.15.6:0/2429886842 >> v2:172.21.15.171:3300/0 conn(0x7f104c0af030 msgr2=0x7f104c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:45.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.499+0000 7f1050ffe640 1 --2- 172.21.15.6:0/2429886842 >> v2:172.21.15.171:3300/0 conn(0x7f104c0af030 0x7f104c0af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.499+0000 7f1050ffe640 1 -- 172.21.15.6:0/2429886842 >> v1:172.21.15.171:6789/0 conn(0x7f104c15f700 legacy=0x7f104c15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.499+0000 7f1050ffe640 1 -- 172.21.15.6:0/2429886842 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c06b6a0 con 0x7f104c06c180 2024-05-20T18:02:45.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.499+0000 7f104bfff640 1 --2- 172.21.15.6:0/2429886842 >> v2:172.21.15.171:3300/0 conn(0x7f104c0af030 0x7f104c0af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:45.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.499+0000 7f1050ffe640 1 --2- 172.21.15.6:0/2429886842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c06c180 0x7f104c06c590 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f104c06f310 tx=0x7f104402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4281bf961e8c6e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:45.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f104affd640 1 -- 172.21.15.6:0/2429886842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044036070 con 0x7f104c06c180 2024-05-20T18:02:45.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f104affd640 1 -- 172.21.15.6:0/2429886842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1044031600 con 0x7f104c06c180 2024-05-20T18:02:45.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f104affd640 1 -- 172.21.15.6:0/2429886842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10440319d0 con 0x7f104c06c180 2024-05-20T18:02:45.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f1052a61640 1 -- 172.21.15.6:0/2429886842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c06c180 msgr2=0x7f104c06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f1052a61640 1 --2- 172.21.15.6:0/2429886842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c06c180 0x7f104c06c590 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f104c06f310 tx=0x7f104402a730 comp rx=0 tx=0).stop 2024-05-20T18:02:45.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f1052a61640 1 -- 172.21.15.6:0/2429886842 shutdown_connections 2024-05-20T18:02:45.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f1052a61640 1 --2- 172.21.15.6:0/2429886842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c06c180 0x7f104c06c590 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f1052a61640 1 --2- 172.21.15.6:0/2429886842 >> v2:172.21.15.171:3300/0 conn(0x7f104c0af030 0x7f104c0af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.500+0000 7f1052a61640 1 -- 172.21.15.6:0/2429886842 >> 172.21.15.6:0/2429886842 conn(0x7f104c0b6620 msgr2=0x7f104c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:45.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.501+0000 7f1052a61640 1 -- 172.21.15.6:0/2429886842 shutdown_connections 2024-05-20T18:02:45.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.501+0000 7f1052a61640 1 -- 172.21.15.6:0/2429886842 wait complete. 2024-05-20T18:02:45.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.502+0000 7f1052a61640 1 Processor -- start 2024-05-20T18:02:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.503+0000 7f1052a61640 1 -- start start 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f1052a61640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f104c06c180 0x7f104c09d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f1052a61640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c0af030 0x7f104c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f1052a61640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f104c15f700 0x7f104c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f1052a61640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f104c06cad0 con 0x7f104c0af030 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f1052a61640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f104c159aa0 con 0x7f104c15f700 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f1052a61640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f104c06cc50 con 0x7f104c06c180 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c0af030 0x7f104c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c0af030 0x7f104c159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33132/0 (socket says 172.21.15.6:33132) 2024-05-20T18:02:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104b7fe640 1 -- 172.21.15.6:0/3834086908 learned_addr learned my addr 172.21.15.6:0/3834086908 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104bfff640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f104c06c180 0x7f104c09d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f1050ffe640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f104c15f700 0x7f104c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104b7fe640 1 -- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f104c06c180 msgr2=0x7f104c09d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104b7fe640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f104c06c180 0x7f104c09d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104b7fe640 1 -- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f104c15f700 msgr2=0x7f104c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104b7fe640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f104c15f700 0x7f104c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104b7fe640 1 -- 172.21.15.6:0/3834086908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c09d560 con 0x7f104c0af030 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f104bfff640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f104c06c180 0x7f104c09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.504+0000 7f1050ffe640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f104c15f700 0x7f104c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.505+0000 7f104b7fe640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c0af030 0x7f104c159c60 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f104000c390 tx=0x7f104000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.505+0000 7f1048ff9640 1 -- 172.21.15.6:0/3834086908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040017070 con 0x7f104c0af030 2024-05-20T18:02:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.505+0000 7f1048ff9640 1 -- 172.21.15.6:0/3834086908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10400052d0 con 0x7f104c0af030 2024-05-20T18:02:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.505+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c15a720 con 0x7f104c0af030 2024-05-20T18:02:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.505+0000 7f1048ff9640 1 -- 172.21.15.6:0/3834086908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1040003830 con 0x7f104c0af030 2024-05-20T18:02:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.505+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c15ace0 con 0x7f104c0af030 2024-05-20T18:02:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.506+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104c09b320 con 0x7f104c0af030 2024-05-20T18:02:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.506+0000 7f1048ff9640 1 -- 172.21.15.6:0/3834086908 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f104001a070 con 0x7f104c0af030 2024-05-20T18:02:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.507+0000 7f1048ff9640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f103806be30 0x7f103806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.507+0000 7f1048ff9640 1 -- 172.21.15.6:0/3834086908 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f1040089fb0 con 0x7f104c0af030 2024-05-20T18:02:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.507+0000 7f104bfff640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f103806be30 0x7f103806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.508+0000 7f104bfff640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f103806be30 0x7f103806e340 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f103c006fd0 tx=0x7f103c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:45.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.511+0000 7f1048ff9640 1 -- 172.21.15.6:0/3834086908 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f104c09b320 con 0x7f104c0af030 2024-05-20T18:02:45.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.699+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f104c075b00 con 0x7f104c0af030 2024-05-20T18:02:45.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.700+0000 7f1048ff9640 1 -- 172.21.15.6:0/3834086908 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+13253 (secure 0 0 0) 0x7f104c0af980 con 0x7f104c0af030 2024-05-20T18:02:45.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:45.698 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":140,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:42.345324+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/1253645410":"2024-05-21T18:02:39.336924+0000","172.21.15.6:6832/1253645410":"2024-05-21T18:02:39.336924+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f103806be30 msgr2=0x7f103806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f103806be30 0x7f103806e340 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f103c006fd0 tx=0x7f103c008040 comp rx=0 tx=0).stop 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c0af030 msgr2=0x7f104c159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c0af030 0x7f104c159c60 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f104000c390 tx=0x7f104000c850 comp rx=0 tx=0).stop 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 shutdown_connections 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f103806be30 0x7f103806e340 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f104c15f700 0x7f104c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f104c0af030 0x7f104c159c60 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 --2- 172.21.15.6:0/3834086908 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f104c06c180 0x7f104c09d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.702+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 >> 172.21.15.6:0/3834086908 conn(0x7f104c0b6620 msgr2=0x7f104c070880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.703+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 shutdown_connections 2024-05-20T18:02:45.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.703+0000 7f1052a61640 1 -- 172.21.15.6:0/3834086908 wait complete. 2024-05-20T18:02:45.712 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:02:45.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:02:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.831+0000 7f2836e5d640 1 Processor -- start 2024-05-20T18:02:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.831+0000 7f2836e5d640 1 -- start start 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.832+0000 7f2836e5d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f283006d3d0 0x7f283006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.832+0000 7f2836e5d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f28300b8190 0x7f28300b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.832+0000 7f2836e5d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283006dd20 con 0x7f2830162820 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.832+0000 7f2836e5d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f28300d0630 con 0x7f28300b8190 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.832+0000 7f2836e5d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28300d39c0 con 0x7f283006d3d0 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f2834bf9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2830162820 0x7f28300b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39590/0 (socket says 172.21.15.6:39590) 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f2834bf9640 1 -- 172.21.15.6:0/3777324922 learned_addr learned my addr 172.21.15.6:0/3777324922 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282ffff640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f283006d3d0 0x7f283006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f28353fa640 1 --2- 172.21.15.6:0/3777324922 >> v2:172.21.15.171:3300/0 conn(0x7f28300b8190 0x7f28300b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820074407 0 0) 0x7f2820001110 con 0x7f2830162820 2024-05-20T18:02:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2818003520 con 0x7f2830162820 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 905778685 0 0) 0x7f2818003520 con 0x7f2830162820 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f283006d3d0 msgr2=0x7f283006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f283006d3d0 0x7f283006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 >> v2:172.21.15.171:3300/0 conn(0x7f28300b8190 msgr2=0x7f28300b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 --2- 172.21.15.6:0/3777324922 >> v2:172.21.15.171:3300/0 conn(0x7f28300b8190 0x7f28300b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28300d3ca0 con 0x7f2830162820 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f2820001840 con 0x7f2830162820 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f28353fa640 1 --2- 172.21.15.6:0/3777324922 >> v2:172.21.15.171:3300/0 conn(0x7f28300b8190 0x7f28300b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 >> v1:172.21.15.6:6789/0 conn(0x7f2830162820 legacy=0x7f28300b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28180039b0 0x7f2818003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2818004800 0x7f2818004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2818005150 0x7f281800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28300d0630 con 0x7f28180039b0 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28300d39c0 con 0x7f2818005150 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f281800bf80 con 0x7f2818004800 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f282ffff640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f283006d3d0 0x7f283006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.833+0000 7f2834bf9640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28180039b0 0x7f2818003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.834+0000 7f28353fa640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2818005150 0x7f281800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.834+0000 7f282ffff640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2818004800 0x7f2818004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.834+0000 7f2834bf9640 1 -- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2818004800 msgr2=0x7f2818004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.834+0000 7f2834bf9640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2818004800 0x7f2818004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.834+0000 7f2834bf9640 1 -- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2818005150 msgr2=0x7f281800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.834+0000 7f2834bf9640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2818005150 0x7f281800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.834+0000 7f2834bf9640 1 -- 172.21.15.6:0/3777324922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2818003520 con 0x7f28180039b0 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f2834bf9640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28180039b0 0x7f2818003e20 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f282000c4c0 tx=0x7f2818005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e44aaba4337dea5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282000c0e0 con 0x7f28180039b0 2024-05-20T18:02:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820034070 con 0x7f28180039b0 2024-05-20T18:02:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f282f7fe640 1 -- 172.21.15.6:0/3777324922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820005d30 con 0x7f28180039b0 2024-05-20T18:02:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f2836e5d640 1 -- 172.21.15.6:0/3777324922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28180039b0 msgr2=0x7f2818003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f2836e5d640 1 --2- 172.21.15.6:0/3777324922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28180039b0 0x7f2818003e20 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f282000c4c0 tx=0x7f2818005830 comp rx=0 tx=0).stop 2024-05-20T18:02:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f28353fa640 1 -- 172.21.15.6:0/3777324922 reap_dead start 2024-05-20T18:02:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f2836e5d640 1 -- 172.21.15.6:0/3777324922 shutdown_connections 2024-05-20T18:02:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f2836e5d640 1 -- 172.21.15.6:0/3777324922 >> 172.21.15.6:0/3777324922 conn(0x7f28300d4bd0 msgr2=0x7f28300d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.835+0000 7f2836e5d640 1 -- 172.21.15.6:0/3777324922 shutdown_connections 2024-05-20T18:02:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.836+0000 7f2836e5d640 1 -- 172.21.15.6:0/3777324922 wait complete. 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.837+0000 7f2836e5d640 1 Processor -- start 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.837+0000 7f2836e5d640 1 -- start start 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f2836e5d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28180039b0 0x7f28301f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f2836e5d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2830152c00 0x7f283015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f2836e5d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2830153010 0x7f283015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f2836e5d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28300d0300 con 0x7f2830153010 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f2836e5d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28300d4260 con 0x7f2830152c00 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f2836e5d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28300b4050 con 0x7f28180039b0 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f28353fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2830153010 0x7f283015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f28353fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2830153010 0x7f283015b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33148/0 (socket says 172.21.15.6:33148) 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f28353fa640 1 -- 172.21.15.6:0/3079280035 learned_addr learned my addr 172.21.15.6:0/3079280035 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f2834bf9640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28180039b0 0x7f28301f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f282ffff640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2830152c00 0x7f283015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f28353fa640 1 -- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28180039b0 msgr2=0x7f28301f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f28353fa640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28180039b0 0x7f28301f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f28353fa640 1 -- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2830152c00 msgr2=0x7f283015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f28353fa640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2830152c00 0x7f283015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.839+0000 7f28353fa640 1 -- 172.21.15.6:0/3079280035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28301f6290 con 0x7f2830153010 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.840+0000 7f28353fa640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2830153010 0x7f283015b8a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f283008e090 tx=0x7f282800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.840+0000 7f282d7fa640 1 -- 172.21.15.6:0/3079280035 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828015430 con 0x7f2830153010 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.840+0000 7f282d7fa640 1 -- 172.21.15.6:0/3079280035 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282801d070 con 0x7f2830153010 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.840+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28300cbc80 con 0x7f2830153010 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.840+0000 7f282d7fa640 1 -- 172.21.15.6:0/3079280035 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828015810 con 0x7f2830153010 2024-05-20T18:02:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.840+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28300b5a10 con 0x7f2830153010 2024-05-20T18:02:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.841+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28300cbe50 con 0x7f2830153010 2024-05-20T18:02:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.842+0000 7f282d7fa640 1 -- 172.21.15.6:0/3079280035 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28280159b0 con 0x7f2830153010 2024-05-20T18:02:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.842+0000 7f282d7fa640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281c06be60 0x7f281c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.842+0000 7f282d7fa640 1 -- 172.21.15.6:0/3079280035 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f282808b6c0 con 0x7f2830153010 2024-05-20T18:02:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.842+0000 7f2834bf9640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281c06be60 0x7f281c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.843+0000 7f2834bf9640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281c06be60 0x7f281c06e370 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2820033000 tx=0x7f2820009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:45.847+0000 7f282d7fa640 1 -- 172.21.15.6:0/3079280035 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f28301f6290 con 0x7f2830153010 2024-05-20T18:02:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.029+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2830075b00 con 0x7f2830153010 2024-05-20T18:02:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.029+0000 7f282d7fa640 1 -- 172.21.15.6:0/3079280035 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) ==== 93+0+10 (secure 0 0 0) 0x7f2828010040 con 0x7f2830153010 2024-05-20T18:02:46.027 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281c06be60 msgr2=0x7f281c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281c06be60 0x7f281c06e370 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2820033000 tx=0x7f2820009030 comp rx=0 tx=0).stop 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2830153010 msgr2=0x7f283015b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2830153010 0x7f283015b8a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f283008e090 tx=0x7f282800f580 comp rx=0 tx=0).stop 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 shutdown_connections 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f281c06be60 0x7f281c06e370 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2830153010 0x7f283015b8a0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2830152c00 0x7f283015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 --2- 172.21.15.6:0/3079280035 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28180039b0 0x7f28301f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 >> 172.21.15.6:0/3079280035 conn(0x7f28300d4bd0 msgr2=0x7f283015c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.031+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 shutdown_connections 2024-05-20T18:02:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.032+0000 7f2836e5d640 1 -- 172.21.15.6:0/3079280035 wait complete. 2024-05-20T18:02:46.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug' 2024-05-20T18:02:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.157+0000 7f4604e0d640 1 Processor -- start 2024-05-20T18:02:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.157+0000 7f4604e0d640 1 -- start start 2024-05-20T18:02:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f4604e0d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f460006d3d0 0x7f460006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f4604e0d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f460006dd20 con 0x7f46000b8190 2024-05-20T18:02:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f4604e0d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46000d0630 con 0x7f4600162820 2024-05-20T18:02:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f4604e0d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f46000d39c0 con 0x7f460006d3d0 2024-05-20T18:02:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f45fed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f46000b8190 0x7f46000b85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39602/0 (socket says 172.21.15.6:39602) 2024-05-20T18:02:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f45fed9d640 1 -- 172.21.15.6:0/3147741565 learned_addr learned my addr 172.21.15.6:0/3147741565 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f45fdd9b640 1 --2- 172.21.15.6:0/3147741565 >> v2:172.21.15.171:3300/0 conn(0x7f460006d3d0 0x7f460006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f45fd59a640 1 -- 172.21.15.6:0/3147741565 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559515875 0 0) 0x7f45f8001490 con 0x7f46000b8190 2024-05-20T18:02:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f45fd59a640 1 -- 172.21.15.6:0/3147741565 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45ec003520 con 0x7f46000b8190 2024-05-20T18:02:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f45fdd9b640 1 -- 172.21.15.6:0/3147741565 >> v1:172.21.15.171:6789/0 conn(0x7f4600162820 legacy=0x7f46000b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f45fdd9b640 1 -- 172.21.15.6:0/3147741565 >> v1:172.21.15.6:6789/0 conn(0x7f46000b8190 legacy=0x7f46000b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.159+0000 7f45fdd9b640 1 -- 172.21.15.6:0/3147741565 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46000d3ca0 con 0x7f460006d3d0 2024-05-20T18:02:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.160+0000 7f45fdd9b640 1 --2- 172.21.15.6:0/3147741565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 0x7f460006d7e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f45e80097a0 tx=0x7f45e802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53f72dde41ed7a8b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.160+0000 7f45fd59a640 1 -- 172.21.15.6:0/3147741565 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8037070 con 0x7f460006d3d0 2024-05-20T18:02:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.160+0000 7f45fd59a640 1 -- 172.21.15.6:0/3147741565 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e8032440 con 0x7f460006d3d0 2024-05-20T18:02:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.160+0000 7f45fd59a640 1 -- 172.21.15.6:0/3147741565 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e80327f0 con 0x7f460006d3d0 2024-05-20T18:02:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.161+0000 7f4604e0d640 1 -- 172.21.15.6:0/3147741565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 msgr2=0x7f460006d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.161+0000 7f4604e0d640 1 --2- 172.21.15.6:0/3147741565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 0x7f460006d7e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f45e80097a0 tx=0x7f45e802a230 comp rx=0 tx=0).stop 2024-05-20T18:02:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.161+0000 7f4604e0d640 1 -- 172.21.15.6:0/3147741565 shutdown_connections 2024-05-20T18:02:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.161+0000 7f4604e0d640 1 --2- 172.21.15.6:0/3147741565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 0x7f460006d7e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.161+0000 7f4604e0d640 1 -- 172.21.15.6:0/3147741565 >> 172.21.15.6:0/3147741565 conn(0x7f46000d4bd0 msgr2=0x7f46000d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.161+0000 7f4604e0d640 1 -- 172.21.15.6:0/3147741565 shutdown_connections 2024-05-20T18:02:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.161+0000 7f4604e0d640 1 -- 172.21.15.6:0/3147741565 wait complete. 2024-05-20T18:02:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.163+0000 7f4604e0d640 1 Processor -- start 2024-05-20T18:02:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.163+0000 7f4604e0d640 1 -- start start 2024-05-20T18:02:46.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.164+0000 7f4604e0d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 0x7f460015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.164+0000 7f4604e0d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46000b8190 0x7f46000ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.164+0000 7f4604e0d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600162820 0x7f46000cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.164+0000 7f4604e0d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f46000d0300 con 0x7f4600162820 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.164+0000 7f4604e0d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f46000d42e0 con 0x7f460006d3d0 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.164+0000 7f4604e0d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f46000b4050 con 0x7f46000b8190 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600162820 0x7f46000cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600162820 0x7f46000cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33158/0 (socket says 172.21.15.6:33158) 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 -- 172.21.15.6:0/2403648118 learned_addr learned my addr 172.21.15.6:0/2403648118 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fdd9b640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46000b8190 0x7f46000ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fe59c640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 0x7f460015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 -- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46000b8190 msgr2=0x7f46000ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46000b8190 0x7f46000ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 -- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 msgr2=0x7f460015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 0x7f460015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 -- 172.21.15.6:0/2403648118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46000cbe20 con 0x7f4600162820 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fe59c640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 0x7f460015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45fed9d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600162820 0x7f46000cd120 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f45f800cb40 tx=0x7f45f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45f6ffd640 1 -- 172.21.15.6:0/2403648118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8017070 con 0x7f4600162820 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45f6ffd640 1 -- 172.21.15.6:0/2403648118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f800ac40 con 0x7f4600162820 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f45f6ffd640 1 -- 172.21.15.6:0/2403648118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8012400 con 0x7f4600162820 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46000cc100 con 0x7f4600162820 2024-05-20T18:02:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.165+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46000cd660 con 0x7f4600162820 2024-05-20T18:02:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.167+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46001e8bf0 con 0x7f4600162820 2024-05-20T18:02:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.167+0000 7f45f6ffd640 1 -- 172.21.15.6:0/2403648118 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45f801a070 con 0x7f4600162820 2024-05-20T18:02:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.168+0000 7f45f6ffd640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45e006be60 0x7f45e006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.168+0000 7f45f6ffd640 1 -- 172.21.15.6:0/2403648118 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f45f808ab30 con 0x7f4600162820 2024-05-20T18:02:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.168+0000 7f45fe59c640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45e006be60 0x7f45e006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.169+0000 7f45fe59c640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45e006be60 0x7f45e006e370 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f45f0001660 tx=0x7f45f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.172+0000 7f45f6ffd640 1 -- 172.21.15.6:0/2403648118 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f460006dd20 con 0x7f4600162820 2024-05-20T18:02:46.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:46.426+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]} v 0) -- 0x7f4600075b00 con 0x7f4600162820 2024-05-20T18:02:47.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.365+0000 7f45f6ffd640 1 -- 172.21.15.6:0/2403648118 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]}]=0 v510) ==== 154+0+0 (secure 0 0 0) 0x7f45f80595c0 con 0x7f4600162820 2024-05-20T18:02:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45e006be60 msgr2=0x7f45e006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45e006be60 0x7f45e006e370 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f45f0001660 tx=0x7f45f0009040 comp rx=0 tx=0).stop 2024-05-20T18:02:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600162820 msgr2=0x7f46000cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600162820 0x7f46000cd120 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f45f800cb40 tx=0x7f45f800a060 comp rx=0 tx=0).stop 2024-05-20T18:02:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 shutdown_connections 2024-05-20T18:02:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f45e006be60 0x7f45e006e370 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4600162820 0x7f46000cd120 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46000b8190 0x7f46000ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 --2- 172.21.15.6:0/2403648118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f460006d3d0 0x7f460015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 >> 172.21.15.6:0/2403648118 conn(0x7f46000d4bd0 msgr2=0x7f46000b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 shutdown_connections 2024-05-20T18:02:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.368+0000 7f4604e0d640 1 -- 172.21.15.6:0/2403648118 wait complete. 2024-05-20T18:02:47.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-20T18:02:47.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.508+0000 7fe35a406640 1 Processor -- start 2024-05-20T18:02:47.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.508+0000 7fe35a406640 1 -- start start 2024-05-20T18:02:47.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe35a406640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406d3d0 0x7fe35406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:47.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe35a406640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3540b8190 0x7fe3540b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:47.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe35a406640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35406dd20 con 0x7fe354162820 2024-05-20T18:02:47.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe35a406640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fe3540d0630 con 0x7fe3540b8190 2024-05-20T18:02:47.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe35a406640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540d39c0 con 0x7fe35406d3d0 2024-05-20T18:02:47.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe3589a3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3540b8190 0x7fe3540b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:47.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe353fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe354162820 0x7fe3540b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39616/0 (socket says 172.21.15.6:39616) 2024-05-20T18:02:47.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe3589a3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3540b8190 0x7fe3540b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33170/0 (socket says 172.21.15.6:33170) 2024-05-20T18:02:47.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe353fff640 1 -- 172.21.15.6:0/2939322728 learned_addr learned my addr 172.21.15.6:0/2939322728 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:47.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.509+0000 7fe3537fe640 1 --2- 172.21.15.6:0/2939322728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406d3d0 0x7fe35406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:47.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.510+0000 7fe3589a3640 1 -- 172.21.15.6:0/2939322728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406d3d0 msgr2=0x7fe35406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:47.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.510+0000 7fe3589a3640 1 --2- 172.21.15.6:0/2939322728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406d3d0 0x7fe35406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.510+0000 7fe3589a3640 1 -- 172.21.15.6:0/2939322728 >> v1:172.21.15.6:6789/0 conn(0x7fe354162820 legacy=0x7fe3540b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:47.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.510+0000 7fe3589a3640 1 -- 172.21.15.6:0/2939322728 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3540d3ca0 con 0x7fe3540b8190 2024-05-20T18:02:47.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.510+0000 7fe3589a3640 1 --2- 172.21.15.6:0/2939322728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3540b8190 0x7fe3540b85a0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009d90 tx=0x7fe34c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c922648c3d681345 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:47.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.510+0000 7fe352ffd640 1 -- 172.21.15.6:0/2939322728 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c007740 con 0x7fe3540b8190 2024-05-20T18:02:47.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe352ffd640 1 -- 172.21.15.6:0/2939322728 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c0078e0 con 0x7fe3540b8190 2024-05-20T18:02:47.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe352ffd640 1 -- 172.21.15.6:0/2939322728 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c007cb0 con 0x7fe3540b8190 2024-05-20T18:02:47.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe35a406640 1 -- 172.21.15.6:0/2939322728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3540b8190 msgr2=0x7fe3540b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:47.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe35a406640 1 --2- 172.21.15.6:0/2939322728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3540b8190 0x7fe3540b85a0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009d90 tx=0x7fe34c02a660 comp rx=0 tx=0).stop 2024-05-20T18:02:47.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe35a406640 1 -- 172.21.15.6:0/2939322728 shutdown_connections 2024-05-20T18:02:47.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe35a406640 1 --2- 172.21.15.6:0/2939322728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3540b8190 0x7fe3540b85a0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe35a406640 1 --2- 172.21.15.6:0/2939322728 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406d3d0 0x7fe35406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe35a406640 1 -- 172.21.15.6:0/2939322728 >> 172.21.15.6:0/2939322728 conn(0x7fe3540d4bd0 msgr2=0x7fe3540d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:47.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe35a406640 1 -- 172.21.15.6:0/2939322728 shutdown_connections 2024-05-20T18:02:47.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.511+0000 7fe35a406640 1 -- 172.21.15.6:0/2939322728 wait complete. 2024-05-20T18:02:47.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.513+0000 7fe35a406640 1 Processor -- start 2024-05-20T18:02:47.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.513+0000 7fe35a406640 1 -- start start 2024-05-20T18:02:47.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe35a406640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe35406d3d0 0x7fe3540b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:47.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe35a406640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3540b8190 0x7fe354152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:47.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe35a406640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354162820 0x7fe3540cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:47.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe35a406640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540d0300 con 0x7fe35406d3d0 2024-05-20T18:02:47.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe35a406640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540d4260 con 0x7fe354162820 2024-05-20T18:02:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe35a406640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540b4050 con 0x7fe3540b8190 2024-05-20T18:02:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe35406d3d0 0x7fe3540b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe35406d3d0 0x7fe3540b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33184/0 (socket says 172.21.15.6:33184) 2024-05-20T18:02:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 -- 172.21.15.6:0/1414779514 learned_addr learned my addr 172.21.15.6:0/1414779514 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe3537fe640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3540b8190 0x7fe354152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe3589a3640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354162820 0x7fe3540cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:47.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 -- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3540b8190 msgr2=0x7fe354152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3540b8190 0x7fe354152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 -- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354162820 msgr2=0x7fe3540cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354162820 0x7fe3540cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 -- 172.21.15.6:0/1414779514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3540b4e80 con 0x7fe35406d3d0 2024-05-20T18:02:47.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe3589a3640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354162820 0x7fe3540cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe353fff640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe35406d3d0 0x7fe3540b4630 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c3f0 tx=0x7fe34400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.515+0000 7fe350ff9640 1 -- 172.21.15.6:0/1414779514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344017070 con 0x7fe35406d3d0 2024-05-20T18:02:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.516+0000 7fe350ff9640 1 -- 172.21.15.6:0/1414779514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344005ce0 con 0x7fe35406d3d0 2024-05-20T18:02:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.516+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3540b5160 con 0x7fe35406d3d0 2024-05-20T18:02:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.516+0000 7fe350ff9640 1 -- 172.21.15.6:0/1414779514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3440072f0 con 0x7fe35406d3d0 2024-05-20T18:02:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.516+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3541533b0 con 0x7fe35406d3d0 2024-05-20T18:02:47.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.517+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe354075b00 con 0x7fe35406d3d0 2024-05-20T18:02:47.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.517+0000 7fe350ff9640 1 -- 172.21.15.6:0/1414779514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe34401a070 con 0x7fe35406d3d0 2024-05-20T18:02:47.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.518+0000 7fe350ff9640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe34006be30 0x7fe34006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:47.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.518+0000 7fe350ff9640 1 -- 172.21.15.6:0/1414779514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7fe344089fe0 con 0x7fe35406d3d0 2024-05-20T18:02:47.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.518+0000 7fe3537fe640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe34006be30 0x7fe34006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:47.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.519+0000 7fe3537fe640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe34006be30 0x7fe34006e340 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe354161c00 tx=0x7fe348008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:47.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.523+0000 7fe350ff9640 1 -- 172.21.15.6:0/1414779514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe35406dd20 con 0x7fe35406d3d0 2024-05-20T18:02:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.705+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe35406d980 con 0x7fe35406d3d0 2024-05-20T18:02:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.709+0000 7fe350ff9640 1 -- 172.21.15.6:0/1414779514 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v66)=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7fe3440584b0 con 0x7fe35406d3d0 2024-05-20T18:02:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe34006be30 msgr2=0x7fe34006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe34006be30 0x7fe34006e340 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe354161c00 tx=0x7fe348008040 comp rx=0 tx=0).stop 2024-05-20T18:02:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe35406d3d0 msgr2=0x7fe3540b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe35406d3d0 0x7fe3540b4630 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c3f0 tx=0x7fe34400c8b0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 shutdown_connections 2024-05-20T18:02:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe34006be30 0x7fe34006e340 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354162820 0x7fe3540cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3540b8190 0x7fe354152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 --2- 172.21.15.6:0/1414779514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe35406d3d0 0x7fe3540b4630 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:47.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 >> 172.21.15.6:0/1414779514 conn(0x7fe3540d4bd0 msgr2=0x7fe354160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:47.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 shutdown_connections 2024-05-20T18:02:47.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:47.711+0000 7fe35a406640 1 -- 172.21.15.6:0/1414779514 wait complete. 2024-05-20T18:02:47.721 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:02:47.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:02:47.757 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:02:47.804 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:02:47.804 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:47.804 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:47.820 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:02:47.821 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:02:47.821 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:47.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:02:47.839 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:02:47.839 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:47.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:02:47.877 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:02:47.877 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:02:47.896 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:02:47.897 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-20T18:02:47.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.033+0000 7f7b1c7c3640 1 Processor -- start 2024-05-20T18:02:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.033+0000 7f7b1c7c3640 1 -- start start 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.034+0000 7f7b1c7c3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7b14163a10 0x7f7b140d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.034+0000 7f7b1c7c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b140d14b0 0x7f7b140d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.034+0000 7f7b1c7c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b140d0370 con 0x7f7b140b4010 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.034+0000 7f7b1c7c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7b140d3ca0 con 0x7f7b140d14b0 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.034+0000 7f7b1c7c3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7b140d0650 con 0x7f7b14163a10 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.034+0000 7f7b1ad60640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b140d14b0 0x7f7b140d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.034+0000 7f7b1ad60640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b140d14b0 0x7f7b140d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46854/0 (socket says 172.21.15.6:46854) 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.034+0000 7f7b1ad60640 1 -- 172.21.15.6:0/1750406554 learned_addr learned my addr 172.21.15.6:0/1750406554 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.035+0000 7f7b1a55f640 1 --2- 172.21.15.6:0/1750406554 >> v2:172.21.15.171:3300/0 conn(0x7f7b14163a10 0x7f7b140d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.035+0000 7f7b1ad60640 1 -- 172.21.15.6:0/1750406554 >> v2:172.21.15.171:3300/0 conn(0x7f7b14163a10 msgr2=0x7f7b140d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.035+0000 7f7b1ad60640 1 --2- 172.21.15.6:0/1750406554 >> v2:172.21.15.171:3300/0 conn(0x7f7b14163a10 0x7f7b140d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.035+0000 7f7b1ad60640 1 -- 172.21.15.6:0/1750406554 >> v1:172.21.15.171:6789/0 conn(0x7f7b140b4010 legacy=0x7f7b140cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.035+0000 7f7b1ad60640 1 -- 172.21.15.6:0/1750406554 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b140d3650 con 0x7f7b140d14b0 2024-05-20T18:02:48.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.035+0000 7f7b1a55f640 1 --2- 172.21.15.6:0/1750406554 >> v2:172.21.15.171:3300/0 conn(0x7f7b14163a10 0x7f7b140d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.036+0000 7f7b1ad60640 1 --2- 172.21.15.6:0/1750406554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b140d14b0 0x7f7b140d18c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f7b140cf1c0 tx=0x7f7b0c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad0fc82f1a1cd17 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.036+0000 7f7b1955d640 1 -- 172.21.15.6:0/1750406554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c036070 con 0x7f7b140d14b0 2024-05-20T18:02:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.036+0000 7f7b1955d640 1 -- 172.21.15.6:0/1750406554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c031600 con 0x7f7b140d14b0 2024-05-20T18:02:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.036+0000 7f7b1955d640 1 -- 172.21.15.6:0/1750406554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0319d0 con 0x7f7b140d14b0 2024-05-20T18:02:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.036+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/1750406554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b140d14b0 msgr2=0x7f7b140d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.036+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/1750406554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b140d14b0 0x7f7b140d18c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f7b140cf1c0 tx=0x7f7b0c02a730 comp rx=0 tx=0).stop 2024-05-20T18:02:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.037+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/1750406554 shutdown_connections 2024-05-20T18:02:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.037+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/1750406554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b140d14b0 0x7f7b140d18c0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.037+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/1750406554 >> v2:172.21.15.171:3300/0 conn(0x7f7b14163a10 0x7f7b140d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.037+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/1750406554 >> 172.21.15.6:0/1750406554 conn(0x7f7b1406d240 msgr2=0x7f7b1406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.037+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/1750406554 shutdown_connections 2024-05-20T18:02:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.037+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/1750406554 wait complete. 2024-05-20T18:02:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.038+0000 7f7b1c7c3640 1 Processor -- start 2024-05-20T18:02:48.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.038+0000 7f7b1c7c3640 1 -- start start 2024-05-20T18:02:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1c7c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b140b4010 0x7f7b140ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1c7c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b140d14b0 0x7f7b140ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1c7c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b14163a10 0x7f7b141f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1c7c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7b140b8210 con 0x7f7b14163a10 2024-05-20T18:02:48.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1c7c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7b140d1e00 con 0x7f7b140d14b0 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1c7c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7b140b8390 con 0x7f7b140b4010 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b14163a10 0x7f7b141f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b14163a10 0x7f7b141f80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46860/0 (socket says 172.21.15.6:46860) 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 -- 172.21.15.6:0/3854867649 learned_addr learned my addr 172.21.15.6:0/3854867649 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1a55f640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b140b4010 0x7f7b140ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b19d5e640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b140d14b0 0x7f7b140ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 -- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b140b4010 msgr2=0x7f7b140ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b140b4010 0x7f7b140ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 -- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b140d14b0 msgr2=0x7f7b140ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b140d14b0 0x7f7b140ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 -- 172.21.15.6:0/3854867649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1414b800 con 0x7f7b14163a10 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b19d5e640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b140d14b0 0x7f7b140ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b1ad60640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b14163a10 0x7f7b141f80e0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009f40 tx=0x7f7b0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.040+0000 7f7b06ffd640 1 -- 172.21.15.6:0/3854867649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c03f020 con 0x7f7b14163a10 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.041+0000 7f7b06ffd640 1 -- 172.21.15.6:0/3854867649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c037040 con 0x7f7b14163a10 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.041+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1414bae0 con 0x7f7b14163a10 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.041+0000 7f7b06ffd640 1 -- 172.21.15.6:0/3854867649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c036070 con 0x7f7b14163a10 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.041+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1414c0a0 con 0x7f7b14163a10 2024-05-20T18:02:48.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.041+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b14075b00 con 0x7f7b14163a10 2024-05-20T18:02:48.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.042+0000 7f7b06ffd640 1 -- 172.21.15.6:0/3854867649 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b0c042020 con 0x7f7b14163a10 2024-05-20T18:02:48.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.043+0000 7f7b06ffd640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7af806be30 0x7f7af806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.043+0000 7f7b06ffd640 1 -- 172.21.15.6:0/3854867649 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f7b0c0ab550 con 0x7f7b14163a10 2024-05-20T18:02:48.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.043+0000 7f7b1a55f640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7af806be30 0x7f7af806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.043+0000 7f7b1a55f640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7af806be30 0x7f7af806e340 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7b10006fd0 tx=0x7f7b10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:48.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.047+0000 7f7b06ffd640 1 -- 172.21.15.6:0/3854867649 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7b0c049020 con 0x7f7b14163a10 2024-05-20T18:02:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.273+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b140d3050 con 0x7f7b14163a10 2024-05-20T18:02:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.273+0000 7f7b06ffd640 1 -- 172.21.15.6:0/3854867649 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+3868 (secure 0 0 0) 0x7f7b0c079f40 con 0x7f7b14163a10 2024-05-20T18:02:48.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:48.272 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":101,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/1090308250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":1090308250},{"type":"v1","addr":"172.21.15.171:6836","nonce":1090308250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/1498136636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":1498136636},{"type":"v1","addr":"172.21.15.171:6837","nonce":1498136636}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/822698931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":822698931},{"type":"v1","addr":"172.21.15.6:6834","nonce":822698931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":9546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2739823242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2739823242},{"type":"v1","addr":"172.21.15.6:6835","nonce":2739823242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[]} 2024-05-20T18:02:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 101 2024-05-20T18:02:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7af806be30 msgr2=0x7f7af806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7af806be30 0x7f7af806e340 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7b10006fd0 tx=0x7f7b10008040 comp rx=0 tx=0).stop 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b14163a10 msgr2=0x7f7b141f80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b14163a10 0x7f7b141f80e0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009f40 tx=0x7f7b0c004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 shutdown_connections 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7af806be30 0x7f7af806e340 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b14163a10 0x7f7b141f80e0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b140d14b0 0x7f7b140ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 --2- 172.21.15.6:0/3854867649 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b140b4010 0x7f7b140ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 >> 172.21.15.6:0/3854867649 conn(0x7f7b1406d240 msgr2=0x7f7b140ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 shutdown_connections 2024-05-20T18:02:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.275+0000 7f7b1c7c3640 1 -- 172.21.15.6:0/3854867649 wait complete. 2024-05-20T18:02:48.285 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-20T18:02:48.285 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-20T18:02:48.285 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T18:02:48.285 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:02:48.285 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-20T18:02:48.286 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-20T18:02:48.286 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T18:02:48.286 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:02:48.286 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-20T18:02:48.286 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-20T18:02:48.286 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T18:02:48.286 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:02:48.287 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-20T18:02:48.287 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-20T18:02:48.287 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T18:02:48.287 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:02:48.296 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T18:02:48.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-20T18:02:48.299 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T18:02:48.299 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-20T18:02:48.299 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T18:02:48.300 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-20T18:02:48.301 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T18:02:48.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-20T18:02:48.341 INFO:tasks.ceph.mds.b:Started 2024-05-20T18:02:48.342 DEBUG:teuthology.parallel:result is None 2024-05-20T18:02:48.343 INFO:tasks.ceph.mds.c:Started 2024-05-20T18:02:48.343 INFO:tasks.ceph.mds.d:Started 2024-05-20T18:02:48.343 DEBUG:teuthology.parallel:result is None 2024-05-20T18:02:48.343 DEBUG:teuthology.parallel:result is None 2024-05-20T18:02:48.344 INFO:tasks.ceph.mds.a:Started 2024-05-20T18:02:48.344 DEBUG:teuthology.parallel:result is None 2024-05-20T18:02:48.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-20T18:02:48.435 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T18:02:48.435 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2024-05-20T18:02:48.436 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-05-20T18:02:48.436 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-05-20T18:02:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.468+0000 7fa097698640 1 Processor -- start 2024-05-20T18:02:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.469+0000 7fa097698640 1 -- start start 2024-05-20T18:02:48.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa097698640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa09015d530 0x7fa09015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa097698640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa0900b1700 0x7fa0900b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa097698640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 0x7fa090070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa097698640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa0900ce190 con 0x7fa09015d530 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa097698640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa0900cd580 con 0x7fa0900b1700 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa097698640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0900cd860 con 0x7fa090070850 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa095434640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa09015d530 0x7fa09015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa095434640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa09015d530 0x7fa09015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46918/0 (socket says 172.21.15.6:46918) 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa095434640 1 -- 172.21.15.6:0/44599173 learned_addr learned my addr 172.21.15.6:0/44599173 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa095c35640 1 --2- 172.21.15.6:0/44599173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 0x7fa090070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.470+0000 7fa094c33640 1 --2- 172.21.15.6:0/44599173 >> v2:172.21.15.171:3300/0 conn(0x7fa0900b1700 0x7fa0900b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.471+0000 7fa095434640 1 -- 172.21.15.6:0/44599173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 msgr2=0x7fa090070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:48.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.471+0000 7fa095434640 1 --2- 172.21.15.6:0/44599173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 0x7fa090070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.471+0000 7fa095434640 1 -- 172.21.15.6:0/44599173 >> v2:172.21.15.171:3300/0 conn(0x7fa0900b1700 msgr2=0x7fa0900b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.471+0000 7fa095434640 1 --2- 172.21.15.6:0/44599173 >> v2:172.21.15.171:3300/0 conn(0x7fa0900b1700 0x7fa0900b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.471+0000 7fa095434640 1 -- 172.21.15.6:0/44599173 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0900cdb40 con 0x7fa09015d530 2024-05-20T18:02:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.471+0000 7fa094c33640 1 --2- 172.21.15.6:0/44599173 >> v2:172.21.15.171:3300/0 conn(0x7fa0900b1700 0x7fa0900b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.471+0000 7fa095434640 1 --2- 172.21.15.6:0/44599173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa09015aaa0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fa0900d3ad0 tx=0x7fa08c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7887e13c64063 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.471+0000 7fa087fff640 1 -- 172.21.15.6:0/44599173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c037070 con 0x7fa09015d530 2024-05-20T18:02:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa087fff640 1 -- 172.21.15.6:0/44599173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c032440 con 0x7fa09015d530 2024-05-20T18:02:48.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa087fff640 1 -- 172.21.15.6:0/44599173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c032810 con 0x7fa09015d530 2024-05-20T18:02:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 -- 172.21.15.6:0/44599173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 msgr2=0x7fa09015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 --2- 172.21.15.6:0/44599173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa09015aaa0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fa0900d3ad0 tx=0x7fa08c02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 -- 172.21.15.6:0/44599173 shutdown_connections 2024-05-20T18:02:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 --2- 172.21.15.6:0/44599173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 0x7fa090070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 --2- 172.21.15.6:0/44599173 >> v2:172.21.15.171:3300/0 conn(0x7fa0900b1700 0x7fa0900b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 --2- 172.21.15.6:0/44599173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa09015aaa0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 -- 172.21.15.6:0/44599173 >> 172.21.15.6:0/44599173 conn(0x7fa0900d29d0 msgr2=0x7fa0900d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 -- 172.21.15.6:0/44599173 shutdown_connections 2024-05-20T18:02:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.472+0000 7fa097698640 1 -- 172.21.15.6:0/44599173 wait complete. 2024-05-20T18:02:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.474+0000 7fa097698640 1 Processor -- start 2024-05-20T18:02:48.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.474+0000 7fa097698640 1 -- start start 2024-05-20T18:02:48.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.475+0000 7fa097698640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 0x7fa090157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa097698640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0900b1700 0x7fa090148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa097698640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa0900b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa097698640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa0900b2050 con 0x7fa09015d530 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa097698640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa0900cd230 con 0x7fa0900b1700 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa097698640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0900711a0 con 0x7fa090070850 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa0900b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa0900b6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46934/0 (socket says 172.21.15.6:46934) 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 -- 172.21.15.6:0/3567889127 learned_addr learned my addr 172.21.15.6:0/3567889127 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095434640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 0x7fa090157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa094c33640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0900b1700 0x7fa090148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 -- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 msgr2=0x7fa090157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 0x7fa090157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 -- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0900b1700 msgr2=0x7fa090148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0900b1700 0x7fa090148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 -- 172.21.15.6:0/3567889127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0901492f0 con 0x7fa09015d530 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa095c35640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa0900b6ca0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fa08800eed0 tx=0x7fa08800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa085ffb640 1 -- 172.21.15.6:0/3567889127 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088018020 con 0x7fa09015d530 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa085ffb640 1 -- 172.21.15.6:0/3567889127 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08800bd10 con 0x7fa09015d530 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa085ffb640 1 -- 172.21.15.6:0/3567889127 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088014640 con 0x7fa09015d530 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.476+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa090157f90 con 0x7fa09015d530 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.477+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa090158550 con 0x7fa09015d530 2024-05-20T18:02:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.478+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa090075b00 con 0x7fa09015d530 2024-05-20T18:02:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.478+0000 7fa085ffb640 1 -- 172.21.15.6:0/3567889127 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa088005d10 con 0x7fa09015d530 2024-05-20T18:02:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.479+0000 7fa085ffb640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa07406be30 0x7fa07406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.479+0000 7fa095434640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa07406be30 0x7fa07406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.479+0000 7fa085ffb640 1 -- 172.21.15.6:0/3567889127 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7fa08808b4a0 con 0x7fa09015d530 2024-05-20T18:02:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.480+0000 7fa095434640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa07406be30 0x7fa07406e340 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa08c034000 tx=0x7fa08c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.484+0000 7fa085ffb640 1 -- 172.21.15.6:0/3567889127 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa088022030 con 0x7fa09015d530 2024-05-20T18:02:48.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:48.681+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa0900c6190 con 0x7fa09015d530 2024-05-20T18:02:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.380+0000 7fa085ffb640 1 -- 172.21.15.6:0/3567889127 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v142) ==== 97+0+0 (secure 0 0 0) 0x7fa0880598e0 con 0x7fa09015d530 2024-05-20T18:02:49.378 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa07406be30 msgr2=0x7fa07406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa07406be30 0x7fa07406e340 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa08c034000 tx=0x7fa08c02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 msgr2=0x7fa0900b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa0900b6ca0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fa08800eed0 tx=0x7fa08800b480 comp rx=0 tx=0).stop 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 shutdown_connections 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa07406be30 0x7fa07406e340 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa09015d530 0x7fa0900b6ca0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0900b1700 0x7fa090148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 --2- 172.21.15.6:0/3567889127 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa090070850 0x7fa090157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.383+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 >> 172.21.15.6:0/3567889127 conn(0x7fa0900d29d0 msgr2=0x7fa0900d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.384+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 shutdown_connections 2024-05-20T18:02:49.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.384+0000 7fa097698640 1 -- 172.21.15.6:0/3567889127 wait complete. 2024-05-20T18:02:49.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-20T18:02:49.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.521+0000 7f5258f4c640 1 Processor -- start 2024-05-20T18:02:49.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.521+0000 7f5258f4c640 1 -- start start 2024-05-20T18:02:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f5258f4c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5254168050 0x7f525416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f5258f4c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52540d0630 con 0x7f5254162820 2024-05-20T18:02:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f5258f4c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52540d39c0 con 0x7f525406d3d0 2024-05-20T18:02:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f5258f4c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f52540d3ca0 con 0x7f5254168050 2024-05-20T18:02:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f525259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5254162820 0x7f52540b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33908/0 (socket says 172.21.15.6:33908) 2024-05-20T18:02:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f525259c640 1 -- 172.21.15.6:0/675443674 learned_addr learned my addr 172.21.15.6:0/675443674 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f5252d9d640 1 --2- 172.21.15.6:0/675443674 >> v2:172.21.15.171:3300/0 conn(0x7f5254168050 0x7f525416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212006631 0 0) 0x7f52540d0630 con 0x7f5254162820 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5240003520 con 0x7f5254162820 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.523+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1048380350 0 0) 0x7f5240003520 con 0x7f5254162820 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 >> v2:172.21.15.171:3300/0 conn(0x7f5254168050 msgr2=0x7f525416a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 --2- 172.21.15.6:0/675443674 >> v2:172.21.15.171:3300/0 conn(0x7f5254168050 0x7f525416a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 >> v1:172.21.15.171:6789/0 conn(0x7f525406d3d0 legacy=0x7f525406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52540d3f80 con 0x7f5254162820 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5244001670 con 0x7f5254162820 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 >> v1:172.21.15.6:6789/0 conn(0x7f5254162820 legacy=0x7f52540b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52400039b0 0x7f5240003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5240004800 0x7f5240004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f524000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52540d3ca0 con 0x7f5240005150 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f524000c0c0 con 0x7f52400039b0 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f524000c2c0 con 0x7f5240004800 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f5252d9d640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f524000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f525259c640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52400039b0 0x7f5240003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f5251d9b640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5240004800 0x7f5240004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f5252d9d640 1 -- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5240004800 msgr2=0x7f5240004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f5252d9d640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5240004800 0x7f5240004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f5252d9d640 1 -- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52400039b0 msgr2=0x7f5240003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f5252d9d640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52400039b0 0x7f5240003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f5252d9d640 1 -- 172.21.15.6:0/675443674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5240003520 con 0x7f5240005150 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.524+0000 7f5251d9b640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5240004800 0x7f5240004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.525+0000 7f5252d9d640 1 -- 172.21.15.6:0/675443674 reap_dead start 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.525+0000 7f5252d9d640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f524000b9c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f524c009fc0 tx=0x7f5240005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422d9938f6977e4f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.525+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c035020 con 0x7f5240005150 2024-05-20T18:02:49.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.525+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c003b90 con 0x7f5240005150 2024-05-20T18:02:49.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.525+0000 7f525159a640 1 -- 172.21.15.6:0/675443674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c009c10 con 0x7f5240005150 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.526+0000 7f5258f4c640 1 -- 172.21.15.6:0/675443674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 msgr2=0x7f524000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.526+0000 7f5258f4c640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f524000b9c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f524c009fc0 tx=0x7f5240005830 comp rx=0 tx=0).stop 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.526+0000 7f5258f4c640 1 -- 172.21.15.6:0/675443674 shutdown_connections 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.526+0000 7f5258f4c640 1 --2- 172.21.15.6:0/675443674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f524000b9c0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.526+0000 7f5258f4c640 1 -- 172.21.15.6:0/675443674 >> 172.21.15.6:0/675443674 conn(0x7f52540d4bd0 msgr2=0x7f52540d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.526+0000 7f5258f4c640 1 -- 172.21.15.6:0/675443674 shutdown_connections 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.526+0000 7f5258f4c640 1 -- 172.21.15.6:0/675443674 wait complete. 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.528+0000 7f5258f4c640 1 Processor -- start 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.528+0000 7f5258f4c640 1 -- start start 2024-05-20T18:02:49.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f5258f4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f525415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f5258f4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52541565d0 0x7f525415f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f5258f4c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5254152fa0 0x7f52541f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f5258f4c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f52540d4780 con 0x7f5240005150 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f5258f4c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f52540d0300 con 0x7f5254152fa0 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f5258f4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f52540d4900 con 0x7f52541565d0 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f525259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f525415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f525259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f525415df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46950/0 (socket says 172.21.15.6:46950) 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f525259c640 1 -- 172.21.15.6:0/4073418844 learned_addr learned my addr 172.21.15.6:0/4073418844 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f525259c640 1 -- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52541565d0 msgr2=0x7f525415f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f525259c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52541565d0 0x7f525415f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f525259c640 1 -- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5254152fa0 msgr2=0x7f52541f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f525259c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5254152fa0 0x7f52541f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.529+0000 7f525259c640 1 -- 172.21.15.6:0/4073418844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525415e7c0 con 0x7f5240005150 2024-05-20T18:02:49.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.530+0000 7f525259c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f525415df70 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f5244007340 tx=0x7f5244007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:49.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.530+0000 7f524affd640 1 -- 172.21.15.6:0/4073418844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524401a070 con 0x7f5240005150 2024-05-20T18:02:49.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.530+0000 7f524affd640 1 -- 172.21.15.6:0/4073418844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524400f860 con 0x7f5240005150 2024-05-20T18:02:49.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.530+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525415eaa0 con 0x7f5240005150 2024-05-20T18:02:49.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.530+0000 7f524affd640 1 -- 172.21.15.6:0/4073418844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524400fc30 con 0x7f5240005150 2024-05-20T18:02:49.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.530+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525415f060 con 0x7f5240005150 2024-05-20T18:02:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.531+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5254075b00 con 0x7f5240005150 2024-05-20T18:02:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.531+0000 7f524affd640 1 -- 172.21.15.6:0/4073418844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f524401d070 con 0x7f5240005150 2024-05-20T18:02:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.532+0000 7f524affd640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f523406be60 0x7f523406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.532+0000 7f524affd640 1 -- 172.21.15.6:0/4073418844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5249+0+0 (secure 0 0 0) 0x7f524408a630 con 0x7f5240005150 2024-05-20T18:02:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.532+0000 7f5251d9b640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f523406be60 0x7f523406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.533+0000 7f5251d9b640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f523406be60 0x7f523406e370 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f523c007980 tx=0x7f523c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:49.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.537+0000 7f524affd640 1 -- 172.21.15.6:0/4073418844 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5244059110 con 0x7f5240005150 2024-05-20T18:02:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.796+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5254160eb0 con 0x7f5240005150 2024-05-20T18:02:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.797+0000 7f524affd640 1 -- 172.21.15.6:0/4073418844 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f5244058a10 con 0x7f5240005150 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm19UgOhAAc4qczXg8X5MHg7QUWao0nA==", 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:49.795 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmkP7pCxAAOeqL0u2s08DgoRggzf/0eQ==", 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmxkRYBhAAITAiXPyueRtKOoBPDefpUw==", 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmLdO5ExAASWsT4kJDfhT8RVcsmG3H8w==", 2024-05-20T18:02:49.797 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDLjUtmLIdMNhAAuYDGF3/t2sWgDiLk6zrc/w==", 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:49.798 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDOjUtmcBijNRAA/hqSr5CKDdde2rM2XeRbRw==", 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.799 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDRjUtmswwiNRAAynn4GtWBO9rescrtQMjwzQ==", 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDUjUtmngDRNBAAhcgTDjxmUmoXVlVmHs+4yg==", 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDajUtmY6tVOhAA+77ljkIPvs7T+oksmbYfQA==", 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.801 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDdjUtmB7fjOBAAnKpMwmpeJgLhROdEWnBqMg==", 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDgjUtmfiFlOBAAUSJh1sW5wUe4xtxQwnUsxA==", 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:49.802 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDjjUtmfM/2NhAAOq4u2gJi6c38qtRf3759OQ==", 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.803 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg==", 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmqmt5IBAA459V6vf6gW5U0LC/wvyMpg==", 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:02:49.804 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtmzWmhHBAAnF32Bmj26Qi09r3zW37OaQ==", 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDIjUtm0hE7JBAA5xK2Ne85d4z1ikwyPNdWOg==", 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm8Gp+GxAAxU1GFMZj7LI2xwDXEILrag==", 2024-05-20T18:02:49.806 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtm+f81NhAAysdsGmSAWxyLHKeHp0FqiA==", 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHjUtmS81rMRAALHXZPisASNpbLYmDPit0hQ==", 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-05-20T18:02:49.808 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.798+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f523406be60 msgr2=0x7f523406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.798+0000 7f5258f4c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f523406be60 0x7f523406e370 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f523c007980 tx=0x7f523c009040 comp rx=0 tx=0).stop 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.798+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 msgr2=0x7f525415df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.798+0000 7f5258f4c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f525415df70 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f5244007340 tx=0x7f5244007800 comp rx=0 tx=0).stop 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.798+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 shutdown_connections 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.798+0000 7f5258f4c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f523406be60 0x7f523406e370 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.798+0000 7f5258f4c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5254152fa0 0x7f52541f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.799+0000 7f5258f4c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52541565d0 0x7f525415f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.799+0000 7f5258f4c640 1 --2- 172.21.15.6:0/4073418844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5240005150 0x7f525415df70 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.799+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 >> 172.21.15.6:0/4073418844 conn(0x7f52540d4bd0 msgr2=0x7f52541613d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:49.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.799+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 shutdown_connections 2024-05-20T18:02:49.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.799+0000 7f5258f4c640 1 -- 172.21.15.6:0/4073418844 wait complete. 2024-05-20T18:02:49.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:49.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.928+0000 7ff20117e640 1 Processor -- start 2024-05-20T18:02:49.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.928+0000 7ff20117e640 1 -- start start 2024-05-20T18:02:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.929+0000 7ff20117e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 0x7ff1fc0b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.929+0000 7ff20117e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1fc0d1ac0 con 0x7ff1fc0d10e0 2024-05-20T18:02:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.929+0000 7ff20117e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1fc0d1da0 con 0x7ff1fc0cf850 2024-05-20T18:02:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.929+0000 7ff20117e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1fc0d2080 con 0x7ff1fc0d14f0 2024-05-20T18:02:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.929+0000 7ff1fad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff1fc0d10e0 0x7ff1fc0cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33910/0 (socket says 172.21.15.6:33910) 2024-05-20T18:02:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.929+0000 7ff1fad9d640 1 -- 172.21.15.6:0/2702485527 learned_addr learned my addr 172.21.15.6:0/2702485527 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 0x7ff1fc0b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149642650 0 0) 0x7ff1fc0d1ac0 con 0x7ff1fc0d10e0 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e8003520 con 0x7ff1fc0d10e0 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2679597707 0 0) 0x7ff1e8003520 con 0x7ff1fc0d10e0 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 msgr2=0x7ff1fc0b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 0x7ff1fc0b6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 >> v1:172.21.15.171:6789/0 conn(0x7ff1fc0cf850 legacy=0x7ff1fc0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1fc0d2360 con 0x7ff1fc0d10e0 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 0x7ff1fc0b6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7ff1ec001670 con 0x7ff1fc0d10e0 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 >> v1:172.21.15.6:6789/0 conn(0x7ff1fc0d10e0 legacy=0x7ff1fc0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e80039e0 0x7ff1e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 0x7ff1e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e8004d40 0x7ff1e8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc0d2080 con 0x7ff1e8004d40 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e800ba70 con 0x7ff1e80039e0 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e800bc20 con 0x7ff1fc0d14f0 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e8004d40 0x7ff1e8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1fad9d640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e80039e0 0x7ff1e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.930+0000 7ff1f259c640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 0x7ff1e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fb59e640 1 -- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 msgr2=0x7ff1e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1fc0d14f0 0x7ff1e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fb59e640 1 -- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e80039e0 msgr2=0x7ff1e8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1e80039e0 0x7ff1e8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fb59e640 1 -- 172.21.15.6:0/2702485527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e8003520 con 0x7ff1e8004d40 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e8004d40 0x7ff1e8005150 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc0b23f0 tx=0x7ff1e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c53303621f008f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4033070 con 0x7ff1e8004d40 2024-05-20T18:02:49.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f4003b90 con 0x7ff1e8004d40 2024-05-20T18:02:49.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.931+0000 7ff1fa59c640 1 -- 172.21.15.6:0/2702485527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4009de0 con 0x7ff1e8004d40 2024-05-20T18:02:49.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.932+0000 7ff20117e640 1 -- 172.21.15.6:0/2702485527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e8004d40 msgr2=0x7ff1e8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.932+0000 7ff20117e640 1 --2- 172.21.15.6:0/2702485527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e8004d40 0x7ff1e8005150 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc0b23f0 tx=0x7ff1e8005830 comp rx=0 tx=0).stop 2024-05-20T18:02:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.932+0000 7ff1fb59e640 1 -- 172.21.15.6:0/2702485527 reap_dead start 2024-05-20T18:02:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.932+0000 7ff20117e640 1 -- 172.21.15.6:0/2702485527 shutdown_connections 2024-05-20T18:02:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.932+0000 7ff20117e640 1 -- 172.21.15.6:0/2702485527 >> 172.21.15.6:0/2702485527 conn(0x7ff1fc0b44d0 msgr2=0x7ff1fc0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.932+0000 7ff20117e640 1 -- 172.21.15.6:0/2702485527 shutdown_connections 2024-05-20T18:02:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.932+0000 7ff20117e640 1 -- 172.21.15.6:0/2702485527 wait complete. 2024-05-20T18:02:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.934+0000 7ff20117e640 1 Processor -- start 2024-05-20T18:02:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.934+0000 7ff20117e640 1 -- start start 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff20117e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e8004d40 0x7ff1fc0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff20117e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1fc0cbb00 0x7ff1fc0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff20117e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1fc15eb80 0x7ff1fc15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff20117e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc0b8440 con 0x7ff1fc15eb80 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff20117e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc0b82c0 con 0x7ff1fc0cbb00 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff20117e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff1fc0709f0 con 0x7ff1e8004d40 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1fc15eb80 0x7ff1fc15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1fc15eb80 0x7ff1fc15ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46964/0 (socket says 172.21.15.6:46964) 2024-05-20T18:02:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 -- 172.21.15.6:0/2719925508 learned_addr learned my addr 172.21.15.6:0/2719925508 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fad9d640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e8004d40 0x7ff1fc0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1f259c640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1fc0cbb00 0x7ff1fc0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 -- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e8004d40 msgr2=0x7ff1fc0ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e8004d40 0x7ff1fc0ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 -- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1fc0cbb00 msgr2=0x7ff1fc0cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1fc0cbb00 0x7ff1fc0cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 -- 172.21.15.6:0/2719925508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1fc0ae340 con 0x7ff1fc15eb80 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.936+0000 7ff1fb59e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1fc15eb80 0x7ff1fc15ef90 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7ff1f402b010 tx=0x7ff1f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.937+0000 7ff1f3fff640 1 -- 172.21.15.6:0/2719925508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4033040 con 0x7ff1fc15eb80 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.937+0000 7ff1f3fff640 1 -- 172.21.15.6:0/2719925508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f4009a50 con 0x7ff1fc15eb80 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.937+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc0a9a60 con 0x7ff1fc15eb80 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.937+0000 7ff1f3fff640 1 -- 172.21.15.6:0/2719925508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4042410 con 0x7ff1fc15eb80 2024-05-20T18:02:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.937+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc0aa020 con 0x7ff1fc15eb80 2024-05-20T18:02:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.938+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1fc075b00 con 0x7ff1fc15eb80 2024-05-20T18:02:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.939+0000 7ff1f3fff640 1 -- 172.21.15.6:0/2719925508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1f4040030 con 0x7ff1fc15eb80 2024-05-20T18:02:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.939+0000 7ff1f3fff640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1dc06be30 0x7ff1dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.939+0000 7ff1f3fff640 1 -- 172.21.15.6:0/2719925508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5249+0+0 (secure 0 0 0) 0x7ff1f40aae10 con 0x7ff1fc15eb80 2024-05-20T18:02:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.939+0000 7ff1fad9d640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1dc06be30 0x7ff1dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.940+0000 7ff1fad9d640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1dc06be30 0x7ff1dc06e340 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000c00 tx=0x7ff1ec001e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:49.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:49.943+0000 7ff1f3fff640 1 -- 172.21.15.6:0/2719925508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff1f4079330 con 0x7ff1fc15eb80 2024-05-20T18:02:50.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.132+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1fc0ab0b0 con 0x7ff1fc15eb80 2024-05-20T18:02:50.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.133+0000 7ff1f3fff640 1 -- 172.21.15.6:0/2719925508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+13126 (secure 0 0 0) 0x7ff1f407d630 con 0x7ff1fc15eb80 2024-05-20T18:02:50.131 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:50.131 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":144,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:49.394619+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1dc06be30 msgr2=0x7ff1dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1dc06be30 0x7ff1dc06e340 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000c00 tx=0x7ff1ec001e20 comp rx=0 tx=0).stop 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1fc15eb80 msgr2=0x7ff1fc15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1fc15eb80 0x7ff1fc15ef90 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7ff1f402b010 tx=0x7ff1f4009750 comp rx=0 tx=0).stop 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 shutdown_connections 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7ff1dc06be30 0x7ff1dc06e340 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1fc15eb80 0x7ff1fc15ef90 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1fc0cbb00 0x7ff1fc0cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 --2- 172.21.15.6:0/2719925508 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff1e8004d40 0x7ff1fc0ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 >> 172.21.15.6:0/2719925508 conn(0x7ff1fc0b44d0 msgr2=0x7ff1fc0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 shutdown_connections 2024-05-20T18:02:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.135+0000 7ff20117e640 1 -- 172.21.15.6:0/2719925508 wait complete. 2024-05-20T18:02:50.145 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:02:50.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:02:50.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.264+0000 7fb733caf640 1 Processor -- start 2024-05-20T18:02:50.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.265+0000 7fb733caf640 1 -- start start 2024-05-20T18:02:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb733caf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb72c06d3d0 0x7fb72c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb733caf640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c06dd20 con 0x7fb72c162820 2024-05-20T18:02:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb733caf640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c0d0630 con 0x7fb72c0b8190 2024-05-20T18:02:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb733caf640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb72c0d39c0 con 0x7fb72c06d3d0 2024-05-20T18:02:50.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb73124a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb72c06d3d0 0x7fb72c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb731a4b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb72c162820 0x7fb72c0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33918/0 (socket says 172.21.15.6:33918) 2024-05-20T18:02:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb73124a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb72c06d3d0 0x7fb72c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46968/0 (socket says 172.21.15.6:46968) 2024-05-20T18:02:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb73124a640 1 -- 172.21.15.6:0/154752686 learned_addr learned my addr 172.21.15.6:0/154752686 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb73124a640 1 -- 172.21.15.6:0/154752686 >> v1:172.21.15.171:6789/0 conn(0x7fb72c0b8190 legacy=0x7fb72c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb73124a640 1 -- 172.21.15.6:0/154752686 >> v1:172.21.15.6:6789/0 conn(0x7fb72c162820 legacy=0x7fb72c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb73124a640 1 -- 172.21.15.6:0/154752686 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0d3ca0 con 0x7fb72c06d3d0 2024-05-20T18:02:50.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.266+0000 7fb730a49640 1 -- 172.21.15.6:0/154752686 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333149185 0 0) 0x7fb71c001490 con 0x7fb72c162820 2024-05-20T18:02:50.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.267+0000 7fb73124a640 1 --2- 172.21.15.6:0/154752686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c06d3d0 0x7fb72c06d7e0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fb720009870 tx=0x7fb72002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c2c2d16c00fd1f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.267+0000 7fb730a49640 1 -- 172.21.15.6:0/154752686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720037070 con 0x7fb72c06d3d0 2024-05-20T18:02:50.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.267+0000 7fb730a49640 1 -- 172.21.15.6:0/154752686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb720032440 con 0x7fb72c06d3d0 2024-05-20T18:02:50.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.267+0000 7fb730a49640 1 -- 172.21.15.6:0/154752686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720032810 con 0x7fb72c06d3d0 2024-05-20T18:02:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.268+0000 7fb733caf640 1 -- 172.21.15.6:0/154752686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c06d3d0 msgr2=0x7fb72c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.268+0000 7fb733caf640 1 --2- 172.21.15.6:0/154752686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c06d3d0 0x7fb72c06d7e0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fb720009870 tx=0x7fb72002a2a0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.268+0000 7fb733caf640 1 -- 172.21.15.6:0/154752686 shutdown_connections 2024-05-20T18:02:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.268+0000 7fb733caf640 1 --2- 172.21.15.6:0/154752686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c06d3d0 0x7fb72c06d7e0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.268+0000 7fb733caf640 1 -- 172.21.15.6:0/154752686 >> 172.21.15.6:0/154752686 conn(0x7fb72c0d4bd0 msgr2=0x7fb72c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.268+0000 7fb733caf640 1 -- 172.21.15.6:0/154752686 shutdown_connections 2024-05-20T18:02:50.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.268+0000 7fb733caf640 1 -- 172.21.15.6:0/154752686 wait complete. 2024-05-20T18:02:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.270+0000 7fb733caf640 1 Processor -- start 2024-05-20T18:02:50.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.270+0000 7fb733caf640 1 -- start start 2024-05-20T18:02:50.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.271+0000 7fb733caf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb72c06d3d0 0x7fb72c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.271+0000 7fb733caf640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb72c0b8190 0x7fb72c1f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.271+0000 7fb733caf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c162820 0x7fb72c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.271+0000 7fb733caf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0d0300 con 0x7fb72c162820 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.271+0000 7fb733caf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0d42e0 con 0x7fb72c06d3d0 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.271+0000 7fb733caf640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c0b4050 con 0x7fb72c0b8190 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.271+0000 7fb73224c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c162820 0x7fb72c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73224c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c162820 0x7fb72c0b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46970/0 (socket says 172.21.15.6:46970) 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73224c640 1 -- 172.21.15.6:0/3027890715 learned_addr learned my addr 172.21.15.6:0/3027890715 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73124a640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb72c0b8190 0x7fb72c1f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb731a4b640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb72c06d3d0 0x7fb72c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73224c640 1 -- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb72c0b8190 msgr2=0x7fb72c1f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73224c640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb72c0b8190 0x7fb72c1f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73224c640 1 -- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb72c06d3d0 msgr2=0x7fb72c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73224c640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb72c06d3d0 0x7fb72c154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73224c640 1 -- 172.21.15.6:0/3027890715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0cada0 con 0x7fb72c162820 2024-05-20T18:02:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73124a640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb72c0b8190 0x7fb72c1f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb73224c640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c162820 0x7fb72c0b5c00 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fb72400b490 tx=0x7fb72400b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb72a7fc640 1 -- 172.21.15.6:0/3027890715 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724015020 con 0x7fb72c162820 2024-05-20T18:02:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb72a7fc640 1 -- 172.21.15.6:0/3027890715 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb724011850 con 0x7fb72c162820 2024-05-20T18:02:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb72a7fc640 1 -- 172.21.15.6:0/3027890715 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724011c40 con 0x7fb72c162820 2024-05-20T18:02:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c0cb080 con 0x7fb72c162820 2024-05-20T18:02:50.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.272+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c0c8950 con 0x7fb72c162820 2024-05-20T18:02:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.273+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c0cab10 con 0x7fb72c162820 2024-05-20T18:02:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.274+0000 7fb72a7fc640 1 -- 172.21.15.6:0/3027890715 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb724018020 con 0x7fb72c162820 2024-05-20T18:02:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.275+0000 7fb72a7fc640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb71806be30 0x7fb71806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.275+0000 7fb72a7fc640 1 -- 172.21.15.6:0/3027890715 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5249+0+0 (secure 0 0 0) 0x7fb72408ab50 con 0x7fb72c162820 2024-05-20T18:02:50.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.275+0000 7fb731a4b640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb71806be30 0x7fb71806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.276+0000 7fb731a4b640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb71806be30 0x7fb71806e340 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb71c007ed0 tx=0x7fb71c007e60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.279+0000 7fb72a7fc640 1 -- 172.21.15.6:0/3027890715 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb72401f020 con 0x7fb72c162820 2024-05-20T18:02:50.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.464+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb72c075b00 con 0x7fb72c162820 2024-05-20T18:02:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.465+0000 7fb72a7fc640 1 -- 172.21.15.6:0/3027890715 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) ==== 93+0+10 (secure 0 0 0) 0x7fb7240172c0 con 0x7fb72c162820 2024-05-20T18:02:50.463 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:02:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb71806be30 msgr2=0x7fb71806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb71806be30 0x7fb71806e340 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb71c007ed0 tx=0x7fb71c007e60 comp rx=0 tx=0).stop 2024-05-20T18:02:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c162820 msgr2=0x7fb72c0b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c162820 0x7fb72c0b5c00 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fb72400b490 tx=0x7fb72400b950 comp rx=0 tx=0).stop 2024-05-20T18:02:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 shutdown_connections 2024-05-20T18:02:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb71806be30 0x7fb71806e340 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb72c162820 0x7fb72c0b5c00 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb72c0b8190 0x7fb72c1f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 --2- 172.21.15.6:0/3027890715 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb72c06d3d0 0x7fb72c154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 >> 172.21.15.6:0/3027890715 conn(0x7fb72c0d4bd0 msgr2=0x7fb72c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 shutdown_connections 2024-05-20T18:02:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.467+0000 7fb733caf640 1 -- 172.21.15.6:0/3027890715 wait complete. 2024-05-20T18:02:50.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-20T18:02:50.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.593+0000 7f58681ea640 1 Processor -- start 2024-05-20T18:02:50.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.593+0000 7f58681ea640 1 -- start start 2024-05-20T18:02:50.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f58681ea640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5860162820 0x7f58600b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f58681ea640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f586006dae0 0x7f58600b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f58681ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58600d0630 con 0x7f58600b3e80 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f58681ea640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f58600d39c0 con 0x7f586006dae0 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f58681ea640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f58600d3ca0 con 0x7f5860162820 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f5866787640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f586006dae0 0x7f58600b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f5866787640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f586006dae0 0x7f58600b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46982/0 (socket says 172.21.15.6:46982) 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f5866787640 1 -- 172.21.15.6:0/4065248348 learned_addr learned my addr 172.21.15.6:0/4065248348 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f5865f86640 1 --2- 172.21.15.6:0/4065248348 >> v2:172.21.15.171:3300/0 conn(0x7f5860162820 0x7f58600b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f5866787640 1 -- 172.21.15.6:0/4065248348 >> v2:172.21.15.171:3300/0 conn(0x7f5860162820 msgr2=0x7f58600b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f5866787640 1 --2- 172.21.15.6:0/4065248348 >> v2:172.21.15.171:3300/0 conn(0x7f5860162820 0x7f58600b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f5866787640 1 -- 172.21.15.6:0/4065248348 >> v1:172.21.15.171:6789/0 conn(0x7f58600b3e80 legacy=0x7f586006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.595+0000 7f5866787640 1 -- 172.21.15.6:0/4065248348 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58600d3f80 con 0x7f586006dae0 2024-05-20T18:02:50.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.596+0000 7f5866787640 1 --2- 172.21.15.6:0/4065248348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586006dae0 0x7f58600b8190 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f58600b7740 tx=0x7f585802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcf484d9bec3552 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.596+0000 7f5864f84640 1 -- 172.21.15.6:0/4065248348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858036070 con 0x7f586006dae0 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.596+0000 7f5864f84640 1 -- 172.21.15.6:0/4065248348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5858031600 con 0x7f586006dae0 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.596+0000 7f5864f84640 1 -- 172.21.15.6:0/4065248348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58580319d0 con 0x7f586006dae0 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.597+0000 7f58681ea640 1 -- 172.21.15.6:0/4065248348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586006dae0 msgr2=0x7f58600b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.597+0000 7f58681ea640 1 --2- 172.21.15.6:0/4065248348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586006dae0 0x7f58600b8190 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f58600b7740 tx=0x7f585802a730 comp rx=0 tx=0).stop 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.597+0000 7f58681ea640 1 -- 172.21.15.6:0/4065248348 shutdown_connections 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.597+0000 7f58681ea640 1 --2- 172.21.15.6:0/4065248348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f586006dae0 0x7f58600b8190 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.597+0000 7f58681ea640 1 --2- 172.21.15.6:0/4065248348 >> v2:172.21.15.171:3300/0 conn(0x7f5860162820 0x7f58600b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.597+0000 7f58681ea640 1 -- 172.21.15.6:0/4065248348 >> 172.21.15.6:0/4065248348 conn(0x7f58600d4bd0 msgr2=0x7f58600d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.597+0000 7f58681ea640 1 -- 172.21.15.6:0/4065248348 shutdown_connections 2024-05-20T18:02:50.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.597+0000 7f58681ea640 1 -- 172.21.15.6:0/4065248348 wait complete. 2024-05-20T18:02:50.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.599+0000 7f58681ea640 1 Processor -- start 2024-05-20T18:02:50.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.599+0000 7f58681ea640 1 -- start start 2024-05-20T18:02:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f58681ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58600b3e80 0x7f586015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f58681ea640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5860162820 0x7f58601e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f58681ea640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58601ea260 0x7f58600cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f58681ea640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f58600d4780 con 0x7f58601ea260 2024-05-20T18:02:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f58681ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58600d0300 con 0x7f58600b3e80 2024-05-20T18:02:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f58681ea640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f58600d4900 con 0x7f5860162820 2024-05-20T18:02:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5866787640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58601ea260 0x7f58600cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5866787640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58601ea260 0x7f58600cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46990/0 (socket says 172.21.15.6:46990) 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5866787640 1 -- 172.21.15.6:0/1559293677 learned_addr learned my addr 172.21.15.6:0/1559293677 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5865f86640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58600b3e80 0x7f586015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5865785640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5860162820 0x7f58601e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5866787640 1 -- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5860162820 msgr2=0x7f58601e9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5866787640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5860162820 0x7f58601e9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5866787640 1 -- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58600b3e80 msgr2=0x7f586015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.600+0000 7f5866787640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58600b3e80 0x7f586015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.601+0000 7f5866787640 1 -- 172.21.15.6:0/1559293677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58601ea670 con 0x7f58601ea260 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.601+0000 7f5866787640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58601ea260 0x7f58600cdc80 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f5858009f40 tx=0x7f5858004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.601+0000 7f58567fc640 1 -- 172.21.15.6:0/1559293677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858036050 con 0x7f58601ea260 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.601+0000 7f58567fc640 1 -- 172.21.15.6:0/1559293677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5858042070 con 0x7f58601ea260 2024-05-20T18:02:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.601+0000 7f58567fc640 1 -- 172.21.15.6:0/1559293677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858009510 con 0x7f58601ea260 2024-05-20T18:02:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.601+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58600c93d0 con 0x7f58601ea260 2024-05-20T18:02:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.601+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58600c9990 con 0x7f58601ea260 2024-05-20T18:02:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.602+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5860075b00 con 0x7f58601ea260 2024-05-20T18:02:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.603+0000 7f58567fc640 1 -- 172.21.15.6:0/1559293677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5858007c70 con 0x7f58601ea260 2024-05-20T18:02:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.603+0000 7f58567fc640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.603+0000 7f58567fc640 1 -- 172.21.15.6:0/1559293677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5249+0+0 (secure 0 0 0) 0x7f58580abb70 con 0x7f58601ea260 2024-05-20T18:02:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.603+0000 7f5865f86640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.604+0000 7f5865f86640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f585c009a30 tx=0x7f585c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.608+0000 7f58567fc640 1 -- 172.21.15.6:0/1559293677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f58601ea670 con 0x7f58601ea260 2024-05-20T18:02:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.791+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5860160e70 con 0x7f58601ea260 2024-05-20T18:02:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.792+0000 7f58567fc640 1 -- 172.21.15.6:0/1559293677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v144) ==== 84+0+65 (secure 0 0 0) 0x7f585807a650 con 0x7f58601ea260 2024-05-20T18:02:50.790 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:50.790 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2024-05-20T18:02:50.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-05-20T18:02:50.791 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2024-05-20T18:02:50.791 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2024-05-20T18:02:50.791 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-05-20T18:02:50.791 INFO:teuthology.orchestra.run.smithi006.stdout:] 2024-05-20T18:02:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 msgr2=0x7f584406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f585c009a30 tx=0x7f585c008040 comp rx=0 tx=0).stop 2024-05-20T18:02:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58601ea260 msgr2=0x7f58600cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58601ea260 0x7f58600cdc80 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f5858009f40 tx=0x7f5858004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 shutdown_connections 2024-05-20T18:02:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f584406be30 0x7f584406e340 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58601ea260 0x7f58600cdc80 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5860162820 0x7f58601e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 --2- 172.21.15.6:0/1559293677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58600b3e80 0x7f586015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 >> 172.21.15.6:0/1559293677 conn(0x7f58600d4bd0 msgr2=0x7f58600b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 shutdown_connections 2024-05-20T18:02:50.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.794+0000 7f58681ea640 1 -- 172.21.15.6:0/1559293677 wait complete. 2024-05-20T18:02:50.803 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-20T18:02:50.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-20T18:02:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.923+0000 7f096c6ca640 1 Processor -- start 2024-05-20T18:02:50.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.923+0000 7f096c6ca640 1 -- start start 2024-05-20T18:02:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096c6ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09640d2330 0x7f096406d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096c6ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f096406d660 0x7f09640cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096c6ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f09640cdf70 0x7f09640ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096c6ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f096409c3b0 con 0x7f09640d2330 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096c6ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f096406dda0 con 0x7f09640cdf70 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096c6ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09640d2740 con 0x7f096406d660 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096a466640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09640d2330 0x7f096406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096a466640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f09640d2330 0x7f096406d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47006/0 (socket says 172.21.15.6:47006) 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096a466640 1 -- 172.21.15.6:0/3114415053 learned_addr learned my addr 172.21.15.6:0/3114415053 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f0969c65640 1 --2- 172.21.15.6:0/3114415053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f096406d660 0x7f09640cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096ac67640 1 --2- 172.21.15.6:0/3114415053 >> v2:172.21.15.171:3300/0 conn(0x7f09640cdf70 0x7f09640ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096a466640 1 -- 172.21.15.6:0/3114415053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f096406d660 msgr2=0x7f09640cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096a466640 1 --2- 172.21.15.6:0/3114415053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f096406d660 0x7f09640cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096a466640 1 -- 172.21.15.6:0/3114415053 >> v2:172.21.15.171:3300/0 conn(0x7f09640cdf70 msgr2=0x7f09640ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096a466640 1 --2- 172.21.15.6:0/3114415053 >> v2:172.21.15.171:3300/0 conn(0x7f09640cdf70 0x7f09640ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.925+0000 7f096a466640 1 -- 172.21.15.6:0/3114415053 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09640b81a0 con 0x7f09640d2330 2024-05-20T18:02:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.926+0000 7f096a466640 1 --2- 172.21.15.6:0/3114415053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f096406d120 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f09640ccdd0 tx=0x7f095402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4ba05a2aec0ff5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.926+0000 7f0969464640 1 -- 172.21.15.6:0/3114415053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954036070 con 0x7f09640d2330 2024-05-20T18:02:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.926+0000 7f0969464640 1 -- 172.21.15.6:0/3114415053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0954031600 con 0x7f09640d2330 2024-05-20T18:02:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.926+0000 7f0969464640 1 -- 172.21.15.6:0/3114415053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540319d0 con 0x7f09640d2330 2024-05-20T18:02:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 -- 172.21.15.6:0/3114415053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 msgr2=0x7f096406d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 --2- 172.21.15.6:0/3114415053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f096406d120 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f09640ccdd0 tx=0x7f095402a6f0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 -- 172.21.15.6:0/3114415053 shutdown_connections 2024-05-20T18:02:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 --2- 172.21.15.6:0/3114415053 >> v2:172.21.15.171:3300/0 conn(0x7f09640cdf70 0x7f09640ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 --2- 172.21.15.6:0/3114415053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f096406d660 0x7f09640cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 --2- 172.21.15.6:0/3114415053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f096406d120 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 -- 172.21.15.6:0/3114415053 >> 172.21.15.6:0/3114415053 conn(0x7f09640cf450 msgr2=0x7f09640cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 -- 172.21.15.6:0/3114415053 shutdown_connections 2024-05-20T18:02:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.927+0000 7f096c6ca640 1 -- 172.21.15.6:0/3114415053 wait complete. 2024-05-20T18:02:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.929+0000 7f096c6ca640 1 Processor -- start 2024-05-20T18:02:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.929+0000 7f096c6ca640 1 -- start start 2024-05-20T18:02:50.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.930+0000 7f096c6ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f096406d660 0x7f09640c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.930+0000 7f096c6ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09640cdf70 0x7f096415c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.930+0000 7f096c6ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f09640c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.930+0000 7f096c6ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f09640d3800 con 0x7f09640d2330 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.930+0000 7f096c6ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f096406da70 con 0x7f096406d660 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.930+0000 7f096c6ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f09640d3980 con 0x7f09640cdf70 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f09640c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f09640c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47020/0 (socket says 172.21.15.6:47020) 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 -- 172.21.15.6:0/2656537458 learned_addr learned my addr 172.21.15.6:0/2656537458 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096a466640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f096406d660 0x7f09640c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f0969c65640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09640cdf70 0x7f096415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 -- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09640cdf70 msgr2=0x7f096415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09640cdf70 0x7f096415c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 -- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f096406d660 msgr2=0x7f09640c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f096406d660 0x7f09640c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 -- 172.21.15.6:0/2656537458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09640ca9b0 con 0x7f09640d2330 2024-05-20T18:02:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096ac67640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f09640c6da0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f095c00e820 tx=0x7f095c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f0962ffd640 1 -- 172.21.15.6:0/2656537458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c017070 con 0x7f09640d2330 2024-05-20T18:02:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f0962ffd640 1 -- 172.21.15.6:0/2656537458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095c00ee70 con 0x7f09640d2330 2024-05-20T18:02:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09640ca3f0 con 0x7f09640d2330 2024-05-20T18:02:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f0962ffd640 1 -- 172.21.15.6:0/2656537458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c00cb60 con 0x7f09640d2330 2024-05-20T18:02:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.931+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09640c65a0 con 0x7f09640d2330 2024-05-20T18:02:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.932+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09640ca160 con 0x7f09640d2330 2024-05-20T18:02:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.933+0000 7f0962ffd640 1 -- 172.21.15.6:0/2656537458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f095c01a070 con 0x7f09640d2330 2024-05-20T18:02:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.934+0000 7f0962ffd640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f095006be30 0x7f095006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.934+0000 7f0962ffd640 1 -- 172.21.15.6:0/2656537458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5249+0+0 (secure 0 0 0) 0x7f095c08ac20 con 0x7f09640d2330 2024-05-20T18:02:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.934+0000 7f096a466640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f095006be30 0x7f095006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.935+0000 7f096a466640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f095006be30 0x7f095006e340 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0954033000 tx=0x7f0954009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:50.938+0000 7f0962ffd640 1 -- 172.21.15.6:0/2656537458 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f095c059660 con 0x7f09640d2330 2024-05-20T18:02:51.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.122+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f09640690b0 con 0x7f09640d2330 2024-05-20T18:02:51.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.385+0000 7f0962ffd640 1 -- 172.21.15.6:0/2656537458 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v145) ==== 138+0+0 (secure 0 0 0) 0x7f095c058f60 con 0x7f09640d2330 2024-05-20T18:02:51.383 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2024-05-20T18:02:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.388+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f095006be30 msgr2=0x7f095006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.388+0000 7f096c6ca640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f095006be30 0x7f095006e340 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0954033000 tx=0x7f0954009000 comp rx=0 tx=0).stop 2024-05-20T18:02:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.388+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 msgr2=0x7f09640c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.388+0000 7f096c6ca640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f09640c6da0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f095c00e820 tx=0x7f095c00ec20 comp rx=0 tx=0).stop 2024-05-20T18:02:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.389+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 shutdown_connections 2024-05-20T18:02:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.389+0000 7f096c6ca640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f095006be30 0x7f095006e340 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.389+0000 7f096c6ca640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09640d2330 0x7f09640c6da0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.389+0000 7f096c6ca640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f09640cdf70 0x7f096415c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.389+0000 7f096c6ca640 1 --2- 172.21.15.6:0/2656537458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f096406d660 0x7f09640c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.389+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 >> 172.21.15.6:0/2656537458 conn(0x7f09640cf450 msgr2=0x7f09640b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:51.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.390+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 shutdown_connections 2024-05-20T18:02:51.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.390+0000 7f096c6ca640 1 -- 172.21.15.6:0/2656537458 wait complete. 2024-05-20T18:02:51.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-20T18:02:51.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.530+0000 7efc99b1a640 1 Processor -- start 2024-05-20T18:02:51.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.530+0000 7efc99b1a640 1 -- start start 2024-05-20T18:02:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.531+0000 7efc99b1a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc940b0a00 0x7efc9415c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.531+0000 7efc99b1a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efc9406c630 0x7efc9406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.531+0000 7efc99b1a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9406dfa0 con 0x7efc940ce9b0 2024-05-20T18:02:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc99b1a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efc940b3000 con 0x7efc9406c630 2024-05-20T18:02:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc99b1a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc940b2cf0 con 0x7efc940b0a00 2024-05-20T18:02:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc93fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efc940ce9b0 0x7efc940cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33926/0 (socket says 172.21.15.6:33926) 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc93fff640 1 -- 172.21.15.6:0/1218413840 learned_addr learned my addr 172.21.15.6:0/1218413840 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305318348 0 0) 0x7efc9406dfa0 con 0x7efc940ce9b0 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc937fe640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc940b0a00 0x7efc9415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc8bfff640 1 --2- 172.21.15.6:0/1218413840 >> v2:172.21.15.171:3300/0 conn(0x7efc9406c630 0x7efc9406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc80003520 con 0x7efc940ce9b0 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3955848852 0 0) 0x7efc80003520 con 0x7efc940ce9b0 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc940b0a00 msgr2=0x7efc9415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc940b0a00 0x7efc9415c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 >> v2:172.21.15.171:3300/0 conn(0x7efc9406c630 msgr2=0x7efc9406ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 --2- 172.21.15.6:0/1218413840 >> v2:172.21.15.171:3300/0 conn(0x7efc9406c630 0x7efc9406ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9415ca90 con 0x7efc940ce9b0 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7efc8c0019f0 con 0x7efc940ce9b0 2024-05-20T18:02:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 >> v1:172.21.15.6:6789/0 conn(0x7efc940ce9b0 legacy=0x7efc940cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800039b0 0x7efc80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc940b0a00 0x7efc80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc80004d40 0x7efc80005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc940b3000 con 0x7efc800039b0 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc940b2cf0 con 0x7efc80004d40 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc8000b9c0 con 0x7efc940b0a00 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.532+0000 7efc937fe640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800039b0 0x7efc80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.533+0000 7efc93fff640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc80004d40 0x7efc80005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.533+0000 7efc8bfff640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc940b0a00 0x7efc80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.533+0000 7efc937fe640 1 -- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc940b0a00 msgr2=0x7efc80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.533+0000 7efc937fe640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc940b0a00 0x7efc80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.533+0000 7efc937fe640 1 -- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc80004d40 msgr2=0x7efc80005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.533+0000 7efc937fe640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc80004d40 0x7efc80005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.533+0000 7efc937fe640 1 -- 172.21.15.6:0/1218413840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc80003520 con 0x7efc800039b0 2024-05-20T18:02:51.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.533+0000 7efc93fff640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc80004d40 0x7efc80005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.534+0000 7efc937fe640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800039b0 0x7efc80003e20 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7efc84009ac0 tx=0x7efc80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad63701001425b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.534+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc84036070 con 0x7efc800039b0 2024-05-20T18:02:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.534+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc84031400 con 0x7efc800039b0 2024-05-20T18:02:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.534+0000 7efc92ffd640 1 -- 172.21.15.6:0/1218413840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc84009690 con 0x7efc800039b0 2024-05-20T18:02:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.535+0000 7efc99b1a640 1 -- 172.21.15.6:0/1218413840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800039b0 msgr2=0x7efc80003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.535+0000 7efc99b1a640 1 --2- 172.21.15.6:0/1218413840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc800039b0 0x7efc80003e20 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7efc84009ac0 tx=0x7efc80005830 comp rx=0 tx=0).stop 2024-05-20T18:02:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.535+0000 7efc93fff640 1 -- 172.21.15.6:0/1218413840 reap_dead start 2024-05-20T18:02:51.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.535+0000 7efc99b1a640 1 -- 172.21.15.6:0/1218413840 shutdown_connections 2024-05-20T18:02:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.535+0000 7efc99b1a640 1 -- 172.21.15.6:0/1218413840 >> 172.21.15.6:0/1218413840 conn(0x7efc94073670 msgr2=0x7efc940b6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.535+0000 7efc99b1a640 1 -- 172.21.15.6:0/1218413840 shutdown_connections 2024-05-20T18:02:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.535+0000 7efc99b1a640 1 -- 172.21.15.6:0/1218413840 wait complete. 2024-05-20T18:02:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.536+0000 7efc99b1a640 1 Processor -- start 2024-05-20T18:02:51.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.536+0000 7efc99b1a640 1 -- start start 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc99b1a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc800039b0 0x7efc94137990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc99b1a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc94137ed0 0x7efc941382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc99b1a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc94154020 0x7efc94154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc99b1a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efc9415d2f0 con 0x7efc94154020 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc99b1a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efc9415d010 con 0x7efc94137ed0 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc99b1a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efc94159d70 con 0x7efc800039b0 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc94154020 0x7efc94154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc94154020 0x7efc94154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47040/0 (socket says 172.21.15.6:47040) 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 -- 172.21.15.6:0/777520195 learned_addr learned my addr 172.21.15.6:0/777520195 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc937fe640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc800039b0 0x7efc94137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc8bfff640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc94137ed0 0x7efc941382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 -- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc800039b0 msgr2=0x7efc94137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc800039b0 0x7efc94137990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 -- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc94137ed0 msgr2=0x7efc941382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc94137ed0 0x7efc941382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 -- 172.21.15.6:0/777520195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc94157500 con 0x7efc94154020 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc937fe640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc800039b0 0x7efc94137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.538+0000 7efc93fff640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc94154020 0x7efc94154430 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7efc940b2f70 tx=0x7efc8c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.539+0000 7efc90ff9640 1 -- 172.21.15.6:0/777520195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c007a80 con 0x7efc94154020 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.539+0000 7efc90ff9640 1 -- 172.21.15.6:0/777520195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8c018070 con 0x7efc94154020 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.539+0000 7efc90ff9640 1 -- 172.21.15.6:0/777520195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c013420 con 0x7efc94154020 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.539+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc941552d0 con 0x7efc94154020 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.539+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc94155890 con 0x7efc94154020 2024-05-20T18:02:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.540+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc94155040 con 0x7efc94154020 2024-05-20T18:02:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.541+0000 7efc90ff9640 1 -- 172.21.15.6:0/777520195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc8c0135c0 con 0x7efc94154020 2024-05-20T18:02:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.541+0000 7efc90ff9640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7406be60 0x7efc7406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.541+0000 7efc90ff9640 1 -- 172.21.15.6:0/777520195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5619+0+0 (secure 0 0 0) 0x7efc8c08b2c0 con 0x7efc94154020 2024-05-20T18:02:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.542+0000 7efc937fe640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7406be60 0x7efc7406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.542+0000 7efc937fe640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7406be60 0x7efc7406e370 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7efc84033000 tx=0x7efc84008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.546+0000 7efc90ff9640 1 -- 172.21.15.6:0/777520195 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efc8c059c30 con 0x7efc94154020 2024-05-20T18:02:51.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:51.731+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efc940690b0 con 0x7efc94154020 2024-05-20T18:02:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.391+0000 7efc90ff9640 1 -- 172.21.15.6:0/777520195 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v146) ==== 170+0+0 (secure 0 0 0) 0x7efc8c059530 con 0x7efc94154020 2024-05-20T18:02:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2024-05-20T18:02:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.400+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7406be60 msgr2=0x7efc7406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.400+0000 7efc99b1a640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7406be60 0x7efc7406e370 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7efc84033000 tx=0x7efc84008030 comp rx=0 tx=0).stop 2024-05-20T18:02:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.400+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc94154020 msgr2=0x7efc94154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.400+0000 7efc99b1a640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc94154020 0x7efc94154430 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7efc940b2f70 tx=0x7efc8c00e530 comp rx=0 tx=0).stop 2024-05-20T18:02:52.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.409+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 shutdown_connections 2024-05-20T18:02:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.409+0000 7efc99b1a640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efc7406be60 0x7efc7406e370 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.409+0000 7efc99b1a640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc94154020 0x7efc94154430 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.409+0000 7efc99b1a640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc94137ed0 0x7efc941382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.409+0000 7efc99b1a640 1 --2- 172.21.15.6:0/777520195 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efc800039b0 0x7efc94137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.409+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 >> 172.21.15.6:0/777520195 conn(0x7efc94073670 msgr2=0x7efc9409a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:52.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.412+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 shutdown_connections 2024-05-20T18:02:52.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.412+0000 7efc99b1a640 1 -- 172.21.15.6:0/777520195 wait complete. 2024-05-20T18:02:52.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-20T18:02:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.554+0000 7f6246cf0640 1 Processor -- start 2024-05-20T18:02:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.554+0000 7f6246cf0640 1 -- start start 2024-05-20T18:02:52.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f6246cf0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6240162820 0x7f62400b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:52.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f6246cf0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f624006dae0 0x7f62400b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:52.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f6246cf0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62400d0630 con 0x7f62400b3e80 2024-05-20T18:02:52.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f6246cf0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f62400d39c0 con 0x7f624006dae0 2024-05-20T18:02:52.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f6246cf0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f62400d3ca0 con 0x7f6240162820 2024-05-20T18:02:52.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f624528d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f624006dae0 0x7f62400b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:52.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f624528d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f624006dae0 0x7f62400b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47046/0 (socket says 172.21.15.6:47046) 2024-05-20T18:02:52.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f624528d640 1 -- 172.21.15.6:0/1143078089 learned_addr learned my addr 172.21.15.6:0/1143078089 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:52.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f6244a8c640 1 --2- 172.21.15.6:0/1143078089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6240162820 0x7f62400b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:52.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f624528d640 1 -- 172.21.15.6:0/1143078089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6240162820 msgr2=0x7f62400b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:52.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f624528d640 1 --2- 172.21.15.6:0/1143078089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6240162820 0x7f62400b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f624528d640 1 -- 172.21.15.6:0/1143078089 >> v1:172.21.15.171:6789/0 conn(0x7f62400b3e80 legacy=0x7f624006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:52.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.556+0000 7f624528d640 1 -- 172.21.15.6:0/1143078089 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62400d3f80 con 0x7f624006dae0 2024-05-20T18:02:52.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.557+0000 7f624528d640 1 --2- 172.21.15.6:0/1143078089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006dae0 0x7f62400b8190 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f6238009e50 tx=0x7f623802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb358a556347809e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:52.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.557+0000 7f623f7fe640 1 -- 172.21.15.6:0/1143078089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238036070 con 0x7f624006dae0 2024-05-20T18:02:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.557+0000 7f623f7fe640 1 -- 172.21.15.6:0/1143078089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6238031600 con 0x7f624006dae0 2024-05-20T18:02:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.557+0000 7f623f7fe640 1 -- 172.21.15.6:0/1143078089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62380319d0 con 0x7f624006dae0 2024-05-20T18:02:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.558+0000 7f6246cf0640 1 -- 172.21.15.6:0/1143078089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006dae0 msgr2=0x7f62400b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.558+0000 7f6246cf0640 1 --2- 172.21.15.6:0/1143078089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006dae0 0x7f62400b8190 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f6238009e50 tx=0x7f623802a710 comp rx=0 tx=0).stop 2024-05-20T18:02:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.558+0000 7f6246cf0640 1 -- 172.21.15.6:0/1143078089 shutdown_connections 2024-05-20T18:02:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.558+0000 7f6246cf0640 1 --2- 172.21.15.6:0/1143078089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f624006dae0 0x7f62400b8190 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.558+0000 7f6246cf0640 1 --2- 172.21.15.6:0/1143078089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6240162820 0x7f62400b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.558+0000 7f6246cf0640 1 -- 172.21.15.6:0/1143078089 >> 172.21.15.6:0/1143078089 conn(0x7f62400d4bd0 msgr2=0x7f62400d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.558+0000 7f6246cf0640 1 -- 172.21.15.6:0/1143078089 shutdown_connections 2024-05-20T18:02:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.558+0000 7f6246cf0640 1 -- 172.21.15.6:0/1143078089 wait complete. 2024-05-20T18:02:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.560+0000 7f6246cf0640 1 Processor -- start 2024-05-20T18:02:52.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.560+0000 7f6246cf0640 1 -- start start 2024-05-20T18:02:52.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f6246cf0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62400b3e80 0x7f62400c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f6246cf0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6240162820 0x7f62400caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f6246cf0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400c9250 0x7f6240155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f6246cf0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f62400d4780 con 0x7f62400c9250 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f6246cf0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f62400d0300 con 0x7f6240162820 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f6246cf0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f62400d4900 con 0x7f62400b3e80 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f624528d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400c9250 0x7f6240155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f624528d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400c9250 0x7f6240155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47050/0 (socket says 172.21.15.6:47050) 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f624528d640 1 -- 172.21.15.6:0/4246267832 learned_addr learned my addr 172.21.15.6:0/4246267832 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f6244a8c640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62400b3e80 0x7f62400c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.561+0000 7f623ffff640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6240162820 0x7f62400caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f624528d640 1 -- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62400b3e80 msgr2=0x7f62400c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f624528d640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62400b3e80 0x7f62400c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f624528d640 1 -- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6240162820 msgr2=0x7f62400caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f624528d640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6240162820 0x7f62400caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f624528d640 1 -- 172.21.15.6:0/4246267832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624015ee30 con 0x7f62400c9250 2024-05-20T18:02:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f624528d640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400c9250 0x7f6240155790 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f6238034040 tx=0x7f6238004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f623d7fa640 1 -- 172.21.15.6:0/4246267832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238036050 con 0x7f62400c9250 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f623d7fa640 1 -- 172.21.15.6:0/4246267832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6238042070 con 0x7f62400c9250 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f623d7fa640 1 -- 172.21.15.6:0/4246267832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238009510 con 0x7f62400c9250 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624015f110 con 0x7f62400c9250 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.562+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624015f6d0 con 0x7f62400c9250 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.563+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624015eba0 con 0x7f62400c9250 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.564+0000 7f623d7fa640 1 -- 172.21.15.6:0/4246267832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6238007bf0 con 0x7f62400c9250 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.564+0000 7f623d7fa640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f622c06be60 0x7f622c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.565+0000 7f623d7fa640 1 -- 172.21.15.6:0/4246267832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 6001+0+0 (secure 0 0 0) 0x7f62380abd70 con 0x7f62400c9250 2024-05-20T18:02:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.565+0000 7f6244a8c640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f622c06be60 0x7f622c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.567+0000 7f6244a8c640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f622c06be60 0x7f622c06e370 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6230009aa0 tx=0x7f6230009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:52.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.570+0000 7f623d7fa640 1 -- 172.21.15.6:0/4246267832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6238079fa0 con 0x7f62400c9250 2024-05-20T18:02:52.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:52.792+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f62400d5510 con 0x7f62400c9250 2024-05-20T18:02:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.393+0000 7f623d7fa640 1 -- 172.21.15.6:0/4246267832 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v104) ==== 174+0+0 (secure 0 0 0) 0x7f62400d5510 con 0x7f62400c9250 2024-05-20T18:02:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 23 and data pool 24 2024-05-20T18:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.398+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f622c06be60 msgr2=0x7f622c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.398+0000 7f6246cf0640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f622c06be60 0x7f622c06e370 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6230009aa0 tx=0x7f6230009190 comp rx=0 tx=0).stop 2024-05-20T18:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.398+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400c9250 msgr2=0x7f6240155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.398+0000 7f6246cf0640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400c9250 0x7f6240155790 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f6238034040 tx=0x7f6238004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.399+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 shutdown_connections 2024-05-20T18:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.399+0000 7f6246cf0640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f622c06be60 0x7f622c06e370 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.399+0000 7f6246cf0640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400c9250 0x7f6240155790 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.399+0000 7f6246cf0640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6240162820 0x7f62400caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.399+0000 7f6246cf0640 1 --2- 172.21.15.6:0/4246267832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f62400b3e80 0x7f62400c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.399+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 >> 172.21.15.6:0/4246267832 conn(0x7f62400d4bd0 msgr2=0x7f6240161120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:53.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.400+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 shutdown_connections 2024-05-20T18:02:53.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.400+0000 7f6246cf0640 1 -- 172.21.15.6:0/4246267832 wait complete. 2024-05-20T18:02:53.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:53.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.558+0000 7fbd8f98f640 1 Processor -- start 2024-05-20T18:02:53.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.558+0000 7fbd8f98f640 1 -- start start 2024-05-20T18:02:53.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8f98f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd880cf250 0x7fbd8815f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8f98f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd880d0550 con 0x7fbd880d3220 2024-05-20T18:02:53.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8f98f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd880d0830 con 0x7fbd880b6680 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8f98f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8815f9a0 con 0x7fbd880cf250 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8d72b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd880cf250 0x7fbd8815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8d72b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd880cf250 0x7fbd8815f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47060/0 (socket says 172.21.15.6:47060) 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8d72b640 1 -- 172.21.15.6:0/3174271774 learned_addr learned my addr 172.21.15.6:0/3174271774 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8df2c640 1 --1- 172.21.15.6:0/3174271774 >> v1:172.21.15.6:6789/0 conn(0x7fbd880d3220 0x7fbd880d3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33940/0 (socket says 172.21.15.6:33940) 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8d72b640 1 -- 172.21.15.6:0/3174271774 >> v1:172.21.15.171:6789/0 conn(0x7fbd880b6680 legacy=0x7fbd880b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8d72b640 1 -- 172.21.15.6:0/3174271774 >> v1:172.21.15.6:6789/0 conn(0x7fbd880d3220 legacy=0x7fbd880d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd87fff640 1 -- 172.21.15.6:0/3174271774 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515096751 0 0) 0x7fbd880d0550 con 0x7fbd880d3220 2024-05-20T18:02:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.560+0000 7fbd8d72b640 1 -- 172.21.15.6:0/3174271774 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd880d2a20 con 0x7fbd880cf250 2024-05-20T18:02:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.561+0000 7fbd8d72b640 1 --2- 172.21.15.6:0/3174271774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd8815f460 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009e50 tx=0x7fbd7802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8f7e39ad129d34 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.561+0000 7fbd87fff640 1 -- 172.21.15.6:0/3174271774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78036070 con 0x7fbd880cf250 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.561+0000 7fbd87fff640 1 -- 172.21.15.6:0/3174271774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd78031600 con 0x7fbd880cf250 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.561+0000 7fbd87fff640 1 -- 172.21.15.6:0/3174271774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd780319f0 con 0x7fbd880cf250 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.562+0000 7fbd8f98f640 1 -- 172.21.15.6:0/3174271774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 msgr2=0x7fbd8815f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.562+0000 7fbd8f98f640 1 --2- 172.21.15.6:0/3174271774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd8815f460 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009e50 tx=0x7fbd7802a7c0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.562+0000 7fbd8f98f640 1 -- 172.21.15.6:0/3174271774 shutdown_connections 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.562+0000 7fbd8f98f640 1 --2- 172.21.15.6:0/3174271774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd8815f460 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.562+0000 7fbd8f98f640 1 -- 172.21.15.6:0/3174271774 >> 172.21.15.6:0/3174271774 conn(0x7fbd880d1860 msgr2=0x7fbd880d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.562+0000 7fbd8f98f640 1 -- 172.21.15.6:0/3174271774 shutdown_connections 2024-05-20T18:02:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.562+0000 7fbd8f98f640 1 -- 172.21.15.6:0/3174271774 wait complete. 2024-05-20T18:02:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.564+0000 7fbd8f98f640 1 Processor -- start 2024-05-20T18:02:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.564+0000 7fbd8f98f640 1 -- start start 2024-05-20T18:02:53.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8f98f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd880b6680 0x7fbd88153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8f98f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd881e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8f98f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd880d3220 0x7fbd8814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8f98f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fbd880d27d0 con 0x7fbd880cf250 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8f98f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbd880d0140 con 0x7fbd880d3220 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8f98f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbd880d02c0 con 0x7fbd880b6680 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8cf2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd881e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8cf2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd881e9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47062/0 (socket says 172.21.15.6:47062) 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.565+0000 7fbd8cf2a640 1 -- 172.21.15.6:0/989143502 learned_addr learned my addr 172.21.15.6:0/989143502 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8df2c640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd880d3220 0x7fbd8814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8d72b640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd880b6680 0x7fbd88153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8cf2a640 1 -- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd880b6680 msgr2=0x7fbd88153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8cf2a640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd880b6680 0x7fbd88153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8cf2a640 1 -- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd880d3220 msgr2=0x7fbd8814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8cf2a640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd880d3220 0x7fbd8814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8cf2a640 1 -- 172.21.15.6:0/989143502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd881ea3f0 con 0x7fbd880cf250 2024-05-20T18:02:53.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8cf2a640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd881e9eb0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00c430 tx=0x7fbd7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:53.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd85ffb640 1 -- 172.21.15.6:0/989143502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c017070 con 0x7fbd880cf250 2024-05-20T18:02:53.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd85ffb640 1 -- 172.21.15.6:0/989143502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c0052d0 con 0x7fbd880cf250 2024-05-20T18:02:53.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd88150de0 con 0x7fbd880cf250 2024-05-20T18:02:53.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd85ffb640 1 -- 172.21.15.6:0/989143502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c003830 con 0x7fbd880cf250 2024-05-20T18:02:53.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.566+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd88151360 con 0x7fbd880cf250 2024-05-20T18:02:53.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.567+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd88075b00 con 0x7fbd880cf250 2024-05-20T18:02:53.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.568+0000 7fbd85ffb640 1 -- 172.21.15.6:0/989143502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd7c01a070 con 0x7fbd880cf250 2024-05-20T18:02:53.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.569+0000 7fbd85ffb640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd7406be30 0x7fbd7406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.569+0000 7fbd85ffb640 1 -- 172.21.15.6:0/989143502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 6101+0+0 (secure 0 0 0) 0x7fbd7c08a300 con 0x7fbd880cf250 2024-05-20T18:02:53.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.569+0000 7fbd8d72b640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd7406be30 0x7fbd7406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.570+0000 7fbd8d72b640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd7406be30 0x7fbd7406e340 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbd78033000 tx=0x7fbd78009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:53.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.574+0000 7fbd85ffb640 1 -- 172.21.15.6:0/989143502 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbd7c058b20 con 0x7fbd880cf250 2024-05-20T18:02:53.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.757+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd88151ce0 con 0x7fbd880cf250 2024-05-20T18:02:53.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.758+0000 7fbd85ffb640 1 -- 172.21.15.6:0/989143502 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+16849 (secure 0 0 0) 0x7fbd7c058420 con 0x7fbd880cf250 2024-05-20T18:02:53.757 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":147,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:52.794289+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:51.154710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:51.763678+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd7406be30 msgr2=0x7fbd7406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd7406be30 0x7fbd7406e340 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbd78033000 tx=0x7fbd78009000 comp rx=0 tx=0).stop 2024-05-20T18:02:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 msgr2=0x7fbd881e9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd881e9eb0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00c430 tx=0x7fbd7c00c8f0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 shutdown_connections 2024-05-20T18:02:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fbd7406be30 0x7fbd7406e340 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd880d3220 0x7fbd8814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd880cf250 0x7fbd881e9eb0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 --2- 172.21.15.6:0/989143502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd880b6680 0x7fbd88153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 >> 172.21.15.6:0/989143502 conn(0x7fbd880d1860 msgr2=0x7fbd880b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:53.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 shutdown_connections 2024-05-20T18:02:53.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.761+0000 7fbd8f98f640 1 -- 172.21.15.6:0/989143502 wait complete. 2024-05-20T18:02:53.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.887+0000 7f16a99e0640 1 Processor -- start 2024-05-20T18:02:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.887+0000 7f16a99e0640 1 -- start start 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a99e0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a4162820 0x7f16a40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a99e0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f16a40b3e80 0x7f16a406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a99e0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a406dd20 con 0x7f16a406d910 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a99e0640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f16a40d0630 con 0x7f16a40b3e80 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a99e0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16a40d39c0 con 0x7f16a4162820 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f16a406d910 0x7f16a40d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33946/0 (socket says 172.21.15.6:33946) 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a37fe640 1 -- 172.21.15.6:0/1558215197 learned_addr learned my addr 172.21.15.6:0/1558215197 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a2ffd640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a4162820 0x7f16a40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273381674 0 0) 0x7f169c001110 con 0x7f16a406d910 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a27fc640 1 --2- 172.21.15.6:0/1558215197 >> v2:172.21.15.171:3300/0 conn(0x7f16a40b3e80 0x7f16a406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f168c003520 con 0x7f16a406d910 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2574832710 0 0) 0x7f168c003520 con 0x7f16a406d910 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a4162820 msgr2=0x7f16a40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a4162820 0x7f16a40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 >> v2:172.21.15.171:3300/0 conn(0x7f16a40b3e80 msgr2=0x7f16a406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 --2- 172.21.15.6:0/1558215197 >> v2:172.21.15.171:3300/0 conn(0x7f16a40b3e80 0x7f16a406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a40d3ca0 con 0x7f16a406d910 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.889+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f169c001840 con 0x7f16a406d910 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 >> v1:172.21.15.6:6789/0 conn(0x7f16a406d910 legacy=0x7f16a40d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a1ffb640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f168c0039b0 0x7f168c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a1ffb640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f168c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a1ffb640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a4162820 0x7f168c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40d0630 con 0x7f168c004800 2024-05-20T18:02:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40d39c0 con 0x7f168c0039b0 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f168c00b9c0 con 0x7f16a4162820 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a27fc640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f168c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a2ffd640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f168c0039b0 0x7f168c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a37fe640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a4162820 0x7f168c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a27fc640 1 -- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a4162820 msgr2=0x7f168c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a27fc640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a4162820 0x7f168c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a27fc640 1 -- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f168c0039b0 msgr2=0x7f168c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a27fc640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f168c0039b0 0x7f168c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.890+0000 7f16a27fc640 1 -- 172.21.15.6:0/1558215197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c003520 con 0x7f168c004800 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.891+0000 7f16a27fc640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f168c004c10 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f1698009a90 tx=0x7f168c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b1c8cac127023b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.891+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698036070 con 0x7f168c004800 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.891+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1698031400 con 0x7f168c004800 2024-05-20T18:02:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.891+0000 7f16a1ffb640 1 -- 172.21.15.6:0/1558215197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698009690 con 0x7f168c004800 2024-05-20T18:02:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.892+0000 7f16a99e0640 1 -- 172.21.15.6:0/1558215197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 msgr2=0x7f168c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.892+0000 7f16a99e0640 1 --2- 172.21.15.6:0/1558215197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f168c004c10 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f1698009a90 tx=0x7f168c005830 comp rx=0 tx=0).stop 2024-05-20T18:02:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.892+0000 7f16a37fe640 1 -- 172.21.15.6:0/1558215197 reap_dead start 2024-05-20T18:02:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.892+0000 7f16a99e0640 1 -- 172.21.15.6:0/1558215197 shutdown_connections 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.892+0000 7f16a99e0640 1 -- 172.21.15.6:0/1558215197 >> 172.21.15.6:0/1558215197 conn(0x7f16a40d4bd0 msgr2=0x7f16a40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.892+0000 7f16a99e0640 1 -- 172.21.15.6:0/1558215197 shutdown_connections 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.892+0000 7f16a99e0640 1 -- 172.21.15.6:0/1558215197 wait complete. 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.893+0000 7f16a99e0640 1 Processor -- start 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.894+0000 7f16a99e0640 1 -- start start 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a99e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f16a40cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a99e0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cc400 0x7f16a40ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a99e0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40ca8e0 0x7f16a415acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a99e0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40d0300 con 0x7f168c004800 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a99e0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40d4260 con 0x7f16a40cc400 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a99e0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16a40b91a0 con 0x7f16a40ca8e0 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f16a40cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f16a40cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47074/0 (socket says 172.21.15.6:47074) 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a2ffd640 1 -- 172.21.15.6:0/1294386337 learned_addr learned my addr 172.21.15.6:0/1294386337 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a37fe640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40ca8e0 0x7f16a415acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a27fc640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cc400 0x7f16a40ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a2ffd640 1 -- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40ca8e0 msgr2=0x7f16a415acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a2ffd640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40ca8e0 0x7f16a415acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a2ffd640 1 -- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cc400 msgr2=0x7f16a40ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.895+0000 7f16a2ffd640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cc400 0x7f16a40ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.896+0000 7f16a2ffd640 1 -- 172.21.15.6:0/1294386337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a40cacf0 con 0x7f168c004800 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.896+0000 7f16a2ffd640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f16a40cbec0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f1694009f90 tx=0x7f169400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.896+0000 7f168bfff640 1 -- 172.21.15.6:0/1294386337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169400fea0 con 0x7f168c004800 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.896+0000 7f168bfff640 1 -- 172.21.15.6:0/1294386337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1694015630 con 0x7f168c004800 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.896+0000 7f168bfff640 1 -- 172.21.15.6:0/1294386337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694015a20 con 0x7f168c004800 2024-05-20T18:02:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.896+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a414fd10 con 0x7f168c004800 2024-05-20T18:02:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.896+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a41502b0 con 0x7f168c004800 2024-05-20T18:02:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.897+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a4075b00 con 0x7f168c004800 2024-05-20T18:02:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.898+0000 7f168bfff640 1 -- 172.21.15.6:0/1294386337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1694015bc0 con 0x7f168c004800 2024-05-20T18:02:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.898+0000 7f168bfff640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f169006be30 0x7f169006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.898+0000 7f168bfff640 1 -- 172.21.15.6:0/1294386337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 6101+0+0 (secure 0 0 0) 0x7f169408bf00 con 0x7f168c004800 2024-05-20T18:02:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.898+0000 7f16a27fc640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f169006be30 0x7f169006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.899+0000 7f16a27fc640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f169006be30 0x7f169006e340 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1698033000 tx=0x7f1698008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:53.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:53.903+0000 7f168bfff640 1 -- 172.21.15.6:0/1294386337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f16a40cacf0 con 0x7f168c004800 2024-05-20T18:02:54.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.087+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16a40c7840 con 0x7f168c004800 2024-05-20T18:02:54.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.089+0000 7f168bfff640 1 -- 172.21.15.6:0/1294386337 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+16849 (secure 0 0 0) 0x7f1694019030 con 0x7f168c004800 2024-05-20T18:02:54.087 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:54.087 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":147,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:52.794289+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:51.154710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:51.763678+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:54.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f169006be30 msgr2=0x7f169006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:54.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f169006be30 0x7f169006e340 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1698033000 tx=0x7f1698008030 comp rx=0 tx=0).stop 2024-05-20T18:02:54.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 msgr2=0x7f16a40cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:54.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f16a40cbec0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f1694009f90 tx=0x7f169400f580 comp rx=0 tx=0).stop 2024-05-20T18:02:54.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 shutdown_connections 2024-05-20T18:02:54.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f169006be30 0x7f169006e340 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40ca8e0 0x7f16a415acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cc400 0x7f16a40ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 --2- 172.21.15.6:0/1294386337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f168c004800 0x7f16a40cbec0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 >> 172.21.15.6:0/1294386337 conn(0x7f16a40d4bd0 msgr2=0x7f16a40b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 shutdown_connections 2024-05-20T18:02:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.091+0000 7f16a99e0640 1 -- 172.21.15.6:0/1294386337 wait complete. 2024-05-20T18:02:54.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-20T18:02:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.221+0000 7f6912d38640 1 Processor -- start 2024-05-20T18:02:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.221+0000 7f6912d38640 1 -- start start 2024-05-20T18:02:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f6912d38640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f690c163a10 0x7f690c0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f6912d38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0b4010 0x7f690c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f6912d38640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f690c0d14b0 0x7f690c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f6912d38640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f690c0d3ca0 con 0x7f690c0d14b0 2024-05-20T18:02:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f6912d38640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f690c0d0370 con 0x7f690c163a10 2024-05-20T18:02:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f6912d38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f690c0d0650 con 0x7f690c0b4010 2024-05-20T18:02:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f69112d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f690c0d14b0 0x7f690c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f69112d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f690c0d14b0 0x7f690c0d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47086/0 (socket says 172.21.15.6:47086) 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.222+0000 7f69112d5640 1 -- 172.21.15.6:0/2369467378 learned_addr learned my addr 172.21.15.6:0/2369467378 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.223+0000 7f690bfff640 1 --2- 172.21.15.6:0/2369467378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0b4010 0x7f690c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.223+0000 7f6910ad4640 1 --2- 172.21.15.6:0/2369467378 >> v2:172.21.15.171:3300/0 conn(0x7f690c163a10 0x7f690c0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.223+0000 7f69112d5640 1 -- 172.21.15.6:0/2369467378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0b4010 msgr2=0x7f690c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.223+0000 7f69112d5640 1 --2- 172.21.15.6:0/2369467378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0b4010 0x7f690c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.223+0000 7f69112d5640 1 -- 172.21.15.6:0/2369467378 >> v2:172.21.15.171:3300/0 conn(0x7f690c163a10 msgr2=0x7f690c0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.223+0000 7f69112d5640 1 --2- 172.21.15.6:0/2369467378 >> v2:172.21.15.171:3300/0 conn(0x7f690c163a10 0x7f690c0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.223+0000 7f69112d5640 1 -- 172.21.15.6:0/2369467378 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690c0d3650 con 0x7f690c0d14b0 2024-05-20T18:02:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.223+0000 7f6910ad4640 1 --2- 172.21.15.6:0/2369467378 >> v2:172.21.15.171:3300/0 conn(0x7f690c163a10 0x7f690c0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.224+0000 7f69112d5640 1 --2- 172.21.15.6:0/2369467378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0d14b0 0x7f690c0d18c0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f690c0cf1c0 tx=0x7f690402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9297952a71283fb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.224+0000 7f690b7fe640 1 -- 172.21.15.6:0/2369467378 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6904036070 con 0x7f690c0d14b0 2024-05-20T18:02:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.224+0000 7f690b7fe640 1 -- 172.21.15.6:0/2369467378 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6904031600 con 0x7f690c0d14b0 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.224+0000 7f690b7fe640 1 -- 172.21.15.6:0/2369467378 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69040319d0 con 0x7f690c0d14b0 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.224+0000 7f6912d38640 1 -- 172.21.15.6:0/2369467378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0d14b0 msgr2=0x7f690c0d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.224+0000 7f6912d38640 1 --2- 172.21.15.6:0/2369467378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0d14b0 0x7f690c0d18c0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f690c0cf1c0 tx=0x7f690402a6a0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.225+0000 7f6912d38640 1 -- 172.21.15.6:0/2369467378 shutdown_connections 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.225+0000 7f6912d38640 1 --2- 172.21.15.6:0/2369467378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0d14b0 0x7f690c0d18c0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.225+0000 7f6912d38640 1 --2- 172.21.15.6:0/2369467378 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0b4010 0x7f690c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.225+0000 7f6912d38640 1 --2- 172.21.15.6:0/2369467378 >> v2:172.21.15.171:3300/0 conn(0x7f690c163a10 0x7f690c0d4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.225+0000 7f6912d38640 1 -- 172.21.15.6:0/2369467378 >> 172.21.15.6:0/2369467378 conn(0x7f690c06d240 msgr2=0x7f690c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.225+0000 7f6912d38640 1 -- 172.21.15.6:0/2369467378 shutdown_connections 2024-05-20T18:02:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.225+0000 7f6912d38640 1 -- 172.21.15.6:0/2369467378 wait complete. 2024-05-20T18:02:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.226+0000 7f6912d38640 1 Processor -- start 2024-05-20T18:02:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.226+0000 7f6912d38640 1 -- start start 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6912d38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0b4010 0x7f690c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6912d38640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0d14b0 0x7f690c1e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6912d38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f690c163a10 0x7f690c1f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6912d38640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f690c0d1e00 con 0x7f690c0b4010 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6912d38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f690c0d0040 con 0x7f690c163a10 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6912d38640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f690c0b8210 con 0x7f690c0d14b0 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6910ad4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0b4010 0x7f690c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6910ad4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0b4010 0x7f690c15c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47094/0 (socket says 172.21.15.6:47094) 2024-05-20T18:02:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6910ad4640 1 -- 172.21.15.6:0/2829298160 learned_addr learned my addr 172.21.15.6:0/2829298160 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f690bfff640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0d14b0 0x7f690c1e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f69112d5640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f690c163a10 0x7f690c1f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6910ad4640 1 -- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0d14b0 msgr2=0x7f690c1e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6910ad4640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0d14b0 0x7f690c1e9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6910ad4640 1 -- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f690c163a10 msgr2=0x7f690c1f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6910ad4640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f690c163a10 0x7f690c1f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f6910ad4640 1 -- 172.21.15.6:0/2829298160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690c15ce60 con 0x7f690c0b4010 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.228+0000 7f69112d5640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f690c163a10 0x7f690c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.229+0000 7f6910ad4640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0b4010 0x7f690c15c920 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f690000d800 tx=0x7f690000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.229+0000 7f69097fa640 1 -- 172.21.15.6:0/2829298160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000096a0 con 0x7f690c0b4010 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.229+0000 7f69097fa640 1 -- 172.21.15.6:0/2829298160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6900019070 con 0x7f690c0b4010 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.229+0000 7f69097fa640 1 -- 172.21.15.6:0/2829298160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6900009a80 con 0x7f690c0b4010 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.229+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690c0ac2c0 con 0x7f690c0b4010 2024-05-20T18:02:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.229+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690c0ac5a0 con 0x7f690c0b4010 2024-05-20T18:02:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.230+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f690c075b00 con 0x7f690c0b4010 2024-05-20T18:02:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.230+0000 7f69097fa640 1 -- 172.21.15.6:0/2829298160 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6900009c20 con 0x7f690c0b4010 2024-05-20T18:02:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.231+0000 7f69097fa640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f68f006be60 0x7f68f006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.231+0000 7f69097fa640 1 -- 172.21.15.6:0/2829298160 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 6101+0+0 (secure 0 0 0) 0x7f690008b340 con 0x7f690c0b4010 2024-05-20T18:02:54.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.231+0000 7f690bfff640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f68f006be60 0x7f68f006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:54.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.232+0000 7f690bfff640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f68f006be60 0x7f68f006e370 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f690c0b9d90 tx=0x7f68f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:54.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.236+0000 7f69097fa640 1 -- 172.21.15.6:0/2829298160 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f690c15ce60 con 0x7f690c0b4010 2024-05-20T18:02:54.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:54.460+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f690c0d3050 con 0x7f690c0b4010 2024-05-20T18:02:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.419+0000 7f69097fa640 1 -- 172.21.15.6:0/2829298160 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v107) ==== 118+0+0 (secure 0 0 0) 0x7f6900059b60 con 0x7f690c0b4010 2024-05-20T18:02:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f68f006be60 msgr2=0x7f68f006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f68f006be60 0x7f68f006e370 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f690c0b9d90 tx=0x7f68f8008040 comp rx=0 tx=0).stop 2024-05-20T18:02:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0b4010 msgr2=0x7f690c15c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0b4010 0x7f690c15c920 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f690000d800 tx=0x7f690000dcc0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 shutdown_connections 2024-05-20T18:02:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f68f006be60 0x7f68f006e370 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f690c163a10 0x7f690c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f690c0d14b0 0x7f690c1e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 --2- 172.21.15.6:0/2829298160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f690c0b4010 0x7f690c15c920 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 >> 172.21.15.6:0/2829298160 conn(0x7f690c06d240 msgr2=0x7f690c0b8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 shutdown_connections 2024-05-20T18:02:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.422+0000 7f6912d38640 1 -- 172.21.15.6:0/2829298160 wait complete. 2024-05-20T18:02:55.434 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-20T18:02:55.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-20T18:02:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.562+0000 7f18bff79640 1 Processor -- start 2024-05-20T18:02:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.562+0000 7f18bff79640 1 -- start start 2024-05-20T18:02:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.563+0000 7f18bff79640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f18b80d10e0 0x7f18b80cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.563+0000 7f18bff79640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18b80d14f0 0x7f18b80cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.563+0000 7f18bff79640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b80d1ac0 con 0x7f18b80cd4d0 2024-05-20T18:02:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.563+0000 7f18bff79640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f18b80d1da0 con 0x7f18b80d14f0 2024-05-20T18:02:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.563+0000 7f18bff79640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f18b80d2080 con 0x7f18b80d10e0 2024-05-20T18:02:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.563+0000 7f18bd514640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18b80d14f0 0x7f18b80cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18be516640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18b80cd4d0 0x7f18b80cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33956/0 (socket says 172.21.15.6:33956) 2024-05-20T18:02:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18be516640 1 -- 172.21.15.6:0/188423465 learned_addr learned my addr 172.21.15.6:0/188423465 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18bd514640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18b80d14f0 0x7f18b80cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47102/0 (socket says 172.21.15.6:47102) 2024-05-20T18:02:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18bdd15640 1 --2- 172.21.15.6:0/188423465 >> v2:172.21.15.171:3300/0 conn(0x7f18b80d10e0 0x7f18b80cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18bd514640 1 -- 172.21.15.6:0/188423465 >> v2:172.21.15.171:3300/0 conn(0x7f18b80d10e0 msgr2=0x7f18b80cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18bd514640 1 --2- 172.21.15.6:0/188423465 >> v2:172.21.15.171:3300/0 conn(0x7f18b80d10e0 0x7f18b80cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18bd514640 1 -- 172.21.15.6:0/188423465 >> v1:172.21.15.6:6789/0 conn(0x7f18b80cd4d0 legacy=0x7f18b80cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18bcd13640 1 -- 172.21.15.6:0/188423465 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592386086 0 0) 0x7f18b80d1ac0 con 0x7f18b80cd4d0 2024-05-20T18:02:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.564+0000 7f18bd514640 1 -- 172.21.15.6:0/188423465 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b80d2360 con 0x7f18b80d14f0 2024-05-20T18:02:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.565+0000 7f18bd514640 1 --2- 172.21.15.6:0/188423465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d14f0 0x7f18b80cf680 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f18b80ccfc0 tx=0x7f18a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9077d5bf1509b82 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.565+0000 7f18bcd13640 1 -- 172.21.15.6:0/188423465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8037070 con 0x7f18b80d14f0 2024-05-20T18:02:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.565+0000 7f18bcd13640 1 -- 172.21.15.6:0/188423465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a8032440 con 0x7f18b80d14f0 2024-05-20T18:02:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.565+0000 7f18bcd13640 1 -- 172.21.15.6:0/188423465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8032810 con 0x7f18b80d14f0 2024-05-20T18:02:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.565+0000 7f18bff79640 1 -- 172.21.15.6:0/188423465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d14f0 msgr2=0x7f18b80cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.565+0000 7f18bff79640 1 --2- 172.21.15.6:0/188423465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d14f0 0x7f18b80cf680 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f18b80ccfc0 tx=0x7f18a802a1a0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.566+0000 7f18bff79640 1 -- 172.21.15.6:0/188423465 shutdown_connections 2024-05-20T18:02:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.566+0000 7f18bff79640 1 --2- 172.21.15.6:0/188423465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d14f0 0x7f18b80cf680 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.566+0000 7f18bff79640 1 --2- 172.21.15.6:0/188423465 >> v2:172.21.15.171:3300/0 conn(0x7f18b80d10e0 0x7f18b80cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.566+0000 7f18bff79640 1 -- 172.21.15.6:0/188423465 >> 172.21.15.6:0/188423465 conn(0x7f18b80b44d0 msgr2=0x7f18b80b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.566+0000 7f18bff79640 1 -- 172.21.15.6:0/188423465 shutdown_connections 2024-05-20T18:02:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.566+0000 7f18bff79640 1 -- 172.21.15.6:0/188423465 wait complete. 2024-05-20T18:02:55.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.567+0000 7f18bff79640 1 Processor -- start 2024-05-20T18:02:55.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.567+0000 7f18bff79640 1 -- start start 2024-05-20T18:02:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bff79640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18b80cd4d0 0x7f18b80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bff79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d10e0 0x7f18b80c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bff79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18b80d14f0 0x7f18b8150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bff79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f18b80b8440 con 0x7f18b80d10e0 2024-05-20T18:02:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bff79640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f18b80b82c0 con 0x7f18b80cd4d0 2024-05-20T18:02:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bff79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f18b80709f0 con 0x7f18b80d14f0 2024-05-20T18:02:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d10e0 0x7f18b80c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d10e0 0x7f18b80c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47112/0 (socket says 172.21.15.6:47112) 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 -- 172.21.15.6:0/863191910 learned_addr learned my addr 172.21.15.6:0/863191910 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bdd15640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18b80cd4d0 0x7f18b80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18be516640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18b80d14f0 0x7f18b8150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 -- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18b80d14f0 msgr2=0x7f18b8150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18b80d14f0 0x7f18b8150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 -- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18b80cd4d0 msgr2=0x7f18b80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18b80cd4d0 0x7f18b80a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 -- 172.21.15.6:0/863191910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b80c8b00 con 0x7f18b80d10e0 2024-05-20T18:02:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bdd15640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18b80cd4d0 0x7f18b80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18be516640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18b80d14f0 0x7f18b8150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:02:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.569+0000 7f18bd514640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d10e0 0x7f18b80c8190 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f18a8000c00 tx=0x7f18a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.570+0000 7f18ae7fc640 1 -- 172.21.15.6:0/863191910 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8037040 con 0x7f18b80d10e0 2024-05-20T18:02:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.570+0000 7f18ae7fc640 1 -- 172.21.15.6:0/863191910 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a8042070 con 0x7f18b80d10e0 2024-05-20T18:02:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.570+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b80c8de0 con 0x7f18b80d10e0 2024-05-20T18:02:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.570+0000 7f18ae7fc640 1 -- 172.21.15.6:0/863191910 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8030bd0 con 0x7f18b80d10e0 2024-05-20T18:02:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.570+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b80c64d0 con 0x7f18b80d10e0 2024-05-20T18:02:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.571+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b8075b00 con 0x7f18b80d10e0 2024-05-20T18:02:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.571+0000 7f18ae7fc640 1 -- 172.21.15.6:0/863191910 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18a8047460 con 0x7f18b80d10e0 2024-05-20T18:02:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.572+0000 7f18ae7fc640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f189c06be30 0x7f189c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.572+0000 7f18ae7fc640 1 -- 172.21.15.6:0/863191910 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f18a80abd60 con 0x7f18b80d10e0 2024-05-20T18:02:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.573+0000 7f18bdd15640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f189c06be30 0x7f189c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.573+0000 7f18bdd15640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f189c06be30 0x7f189c06e340 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f18b400b820 tx=0x7f18b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:55.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.577+0000 7f18ae7fc640 1 -- 172.21.15.6:0/863191910 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f18a8032e20 con 0x7f18b80d10e0 2024-05-20T18:02:55.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:55.805+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f18b80c8820 con 0x7f18b80d10e0 2024-05-20T18:02:56.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.427+0000 7f18ae7fc640 1 -- 172.21.15.6:0/863191910 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v108) ==== 122+0+0 (secure 0 0 0) 0x7f18a8045360 con 0x7f18b80d10e0 2024-05-20T18:02:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f189c06be30 msgr2=0x7f189c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f189c06be30 0x7f189c06e340 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f18b400b820 tx=0x7f18b4008040 comp rx=0 tx=0).stop 2024-05-20T18:02:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d10e0 msgr2=0x7f18b80c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d10e0 0x7f18b80c8190 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f18a8000c00 tx=0x7f18a80046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 shutdown_connections 2024-05-20T18:02:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f189c06be30 0x7f189c06e340 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f18b80d14f0 0x7f18b8150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18b80d10e0 0x7f18b80c8190 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 --2- 172.21.15.6:0/863191910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18b80cd4d0 0x7f18b80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 >> 172.21.15.6:0/863191910 conn(0x7f18b80b44d0 msgr2=0x7f18b815f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 shutdown_connections 2024-05-20T18:02:56.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.430+0000 7f18bff79640 1 -- 172.21.15.6:0/863191910 wait complete. 2024-05-20T18:02:56.442 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-20T18:02:56.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:56.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.567+0000 7f91e2ed7640 1 Processor -- start 2024-05-20T18:02:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.567+0000 7f91e2ed7640 1 -- start start 2024-05-20T18:02:56.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.568+0000 7f91e2ed7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f91dc06d3d0 0x7f91dc06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.568+0000 7f91e2ed7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91dc0b8190 0x7f91dc0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.568+0000 7f91e2ed7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91dc06dd20 con 0x7f91dc162820 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.568+0000 7f91e2ed7640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f91dc0d0630 con 0x7f91dc0b8190 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.568+0000 7f91e2ed7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f91dc0d39c0 con 0x7f91dc06d3d0 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.568+0000 7f91e1474640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91dc0b8190 0x7f91dc0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.568+0000 7f91e0c73640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f91dc162820 0x7f91dc0b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33960/0 (socket says 172.21.15.6:33960) 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.568+0000 7f91e0c73640 1 -- 172.21.15.6:0/974013354 learned_addr learned my addr 172.21.15.6:0/974013354 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.569+0000 7f91dbfff640 1 --2- 172.21.15.6:0/974013354 >> v2:172.21.15.171:3300/0 conn(0x7f91dc06d3d0 0x7f91dc06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.569+0000 7f91e1474640 1 -- 172.21.15.6:0/974013354 >> v2:172.21.15.171:3300/0 conn(0x7f91dc06d3d0 msgr2=0x7f91dc06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.569+0000 7f91e1474640 1 --2- 172.21.15.6:0/974013354 >> v2:172.21.15.171:3300/0 conn(0x7f91dc06d3d0 0x7f91dc06d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.569+0000 7f91e1474640 1 -- 172.21.15.6:0/974013354 >> v1:172.21.15.6:6789/0 conn(0x7f91dc162820 legacy=0x7f91dc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.569+0000 7f91e1474640 1 -- 172.21.15.6:0/974013354 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91dc0d3ca0 con 0x7f91dc0b8190 2024-05-20T18:02:56.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.569+0000 7f91db7fe640 1 -- 172.21.15.6:0/974013354 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646284100 0 0) 0x7f91d0001110 con 0x7f91dc162820 2024-05-20T18:02:56.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91e1474640 1 --2- 172.21.15.6:0/974013354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0b8190 0x7f91dc0b85a0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0d1230 tx=0x7f91d402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82570669b572283c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:56.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91db7fe640 1 -- 172.21.15.6:0/974013354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4007740 con 0x7f91dc0b8190 2024-05-20T18:02:56.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91db7fe640 1 -- 172.21.15.6:0/974013354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d40078e0 con 0x7f91dc0b8190 2024-05-20T18:02:56.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91db7fe640 1 -- 172.21.15.6:0/974013354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4007cb0 con 0x7f91dc0b8190 2024-05-20T18:02:56.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91e2ed7640 1 -- 172.21.15.6:0/974013354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0b8190 msgr2=0x7f91dc0b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/974013354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0b8190 0x7f91dc0b85a0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0d1230 tx=0x7f91d402a680 comp rx=0 tx=0).stop 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91e2ed7640 1 -- 172.21.15.6:0/974013354 shutdown_connections 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/974013354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc0b8190 0x7f91dc0b85a0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/974013354 >> v2:172.21.15.171:3300/0 conn(0x7f91dc06d3d0 0x7f91dc06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.570+0000 7f91e2ed7640 1 -- 172.21.15.6:0/974013354 >> 172.21.15.6:0/974013354 conn(0x7f91dc0d4bd0 msgr2=0x7f91dc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.571+0000 7f91e2ed7640 1 -- 172.21.15.6:0/974013354 shutdown_connections 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.571+0000 7f91e2ed7640 1 -- 172.21.15.6:0/974013354 wait complete. 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.572+0000 7f91e2ed7640 1 Processor -- start 2024-05-20T18:02:56.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.572+0000 7f91e2ed7640 1 -- start start 2024-05-20T18:02:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e2ed7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91dc06d3d0 0x7f91dc15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e2ed7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91dc0b8190 0x7f91dc157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e2ed7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc162820 0x7f91dc149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e2ed7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc0d0300 con 0x7f91dc162820 2024-05-20T18:02:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e2ed7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc0d4260 con 0x7f91dc06d3d0 2024-05-20T18:02:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e2ed7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f91dc0b4050 con 0x7f91dc0b8190 2024-05-20T18:02:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc162820 0x7f91dc149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc162820 0x7f91dc149aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47124/0 (socket says 172.21.15.6:47124) 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 -- 172.21.15.6:0/3469005864 learned_addr learned my addr 172.21.15.6:0/3469005864 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e0c73640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91dc06d3d0 0x7f91dc15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91dbfff640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91dc0b8190 0x7f91dc157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 -- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91dc0b8190 msgr2=0x7f91dc157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91dc0b8190 0x7f91dc157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 -- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91dc06d3d0 msgr2=0x7f91dc15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91dc06d3d0 0x7f91dc15a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 -- 172.21.15.6:0/3469005864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91dc15ae30 con 0x7f91dc162820 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e0c73640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91dc06d3d0 0x7f91dc15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.574+0000 7f91e1474640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc162820 0x7f91dc149aa0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009e50 tx=0x7f91d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.575+0000 7f91d97fa640 1 -- 172.21.15.6:0/3469005864 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d403f070 con 0x7f91dc162820 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.575+0000 7f91d97fa640 1 -- 172.21.15.6:0/3469005864 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d4031bf0 con 0x7f91dc162820 2024-05-20T18:02:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.575+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91dc148a00 con 0x7f91dc162820 2024-05-20T18:02:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.575+0000 7f91d97fa640 1 -- 172.21.15.6:0/3469005864 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4044460 con 0x7f91dc162820 2024-05-20T18:02:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.575+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91dc148fc0 con 0x7f91dc162820 2024-05-20T18:02:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.576+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91dc075b00 con 0x7f91dc162820 2024-05-20T18:02:56.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.576+0000 7f91d97fa640 1 -- 172.21.15.6:0/3469005864 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91d4007790 con 0x7f91dc162820 2024-05-20T18:02:56.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.577+0000 7f91d97fa640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f91c006be30 0x7f91c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.577+0000 7f91d97fa640 1 -- 172.21.15.6:0/3469005864 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f91d40ac8f0 con 0x7f91dc162820 2024-05-20T18:02:56.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.577+0000 7f91e0c73640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f91c006be30 0x7f91c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.578+0000 7f91e0c73640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f91c006be30 0x7f91c006e340 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f91d0000f60 tx=0x7f91d0007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:56.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.581+0000 7f91d97fa640 1 -- 172.21.15.6:0/3469005864 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f91d407b110 con 0x7f91dc162820 2024-05-20T18:02:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.806+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91dc067b60 con 0x7f91dc162820 2024-05-20T18:02:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.806+0000 7f91d97fa640 1 -- 172.21.15.6:0/3469005864 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5188 (secure 0 0 0) 0x7f91d407aa10 con 0x7f91dc162820 2024-05-20T18:02:56.804 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:56.804 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":108,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2941924108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2941924108},{"type":"v1","addr":"172.21.15.6:6835","nonce":2941924108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/701117749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":701117749},{"type":"v1","addr":"172.21.15.171:6837","nonce":701117749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3661458750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3661458750},{"type":"v1","addr":"172.21.15.171:6836","nonce":3661458750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:52.794622+0000","modified":"2024-05-20T18:02:55.807339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9654":{"gid":9654,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3621358319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3621358319},{"type":"v1","addr":"172.21.15.6:6834","nonce":3621358319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9654,"qdb_cluster":[9654]},"id":11}]} 2024-05-20T18:02:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 108 2024-05-20T18:02:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f91c006be30 msgr2=0x7f91c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f91c006be30 0x7f91c006e340 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f91d0000f60 tx=0x7f91d0007ca0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc162820 msgr2=0x7f91dc149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc162820 0x7f91dc149aa0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009e50 tx=0x7f91d4004a40 comp rx=0 tx=0).stop 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 shutdown_connections 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f91c006be30 0x7f91c006e340 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91dc162820 0x7f91dc149aa0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f91dc0b8190 0x7f91dc157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 --2- 172.21.15.6:0/3469005864 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91dc06d3d0 0x7f91dc15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 >> 172.21.15.6:0/3469005864 conn(0x7f91dc0d4bd0 msgr2=0x7f91dc15d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 shutdown_connections 2024-05-20T18:02:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.808+0000 7f91e2ed7640 1 -- 172.21.15.6:0/3469005864 wait complete. 2024-05-20T18:02:56.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:02:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.935+0000 7fdea3f57640 1 Processor -- start 2024-05-20T18:02:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.935+0000 7fdea3f57640 1 -- start start 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.936+0000 7fdea3f57640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde9c071630 0x7fde9c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.936+0000 7fdea3f57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 0x7fde9c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.936+0000 7fdea3f57640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde9c0711a0 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.936+0000 7fdea3f57640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fde9c15f790 con 0x7fde9c071630 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.936+0000 7fdea3f57640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c06e590 con 0x7fde9c070850 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.936+0000 7fdea1cf3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde9c071630 0x7fde9c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.936+0000 7fdea14f2640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fde9c0cd1b0 0x7fde9c06d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33964/0 (socket says 172.21.15.6:33964) 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.936+0000 7fdea14f2640 1 -- 172.21.15.6:0/1924134840 learned_addr learned my addr 172.21.15.6:0/1924134840 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.937+0000 7fdea24f4640 1 --2- 172.21.15.6:0/1924134840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 0x7fde9c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.937+0000 7fdea1cf3640 1 -- 172.21.15.6:0/1924134840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 msgr2=0x7fde9c070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.937+0000 7fdea1cf3640 1 --2- 172.21.15.6:0/1924134840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 0x7fde9c070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.937+0000 7fdea1cf3640 1 -- 172.21.15.6:0/1924134840 >> v1:172.21.15.6:6789/0 conn(0x7fde9c0cd1b0 legacy=0x7fde9c06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.937+0000 7fdea1cf3640 1 -- 172.21.15.6:0/1924134840 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c0ce2b0 con 0x7fde9c071630 2024-05-20T18:02:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.937+0000 7fdea0cf1640 1 -- 172.21.15.6:0/1924134840 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926578728 0 0) 0x7fde8c001110 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea1cf3640 1 --2- 172.21.15.6:0/1924134840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c071630 0x7fde9c15f250 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fde980097a0 tx=0x7fde9802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200d57fb97e1c560 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea0cf1640 1 -- 172.21.15.6:0/1924134840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98037070 con 0x7fde9c071630 2024-05-20T18:02:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea0cf1640 1 -- 172.21.15.6:0/1924134840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9802ae50 con 0x7fde9c071630 2024-05-20T18:02:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea0cf1640 1 -- 172.21.15.6:0/1924134840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98032660 con 0x7fde9c071630 2024-05-20T18:02:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea3f57640 1 -- 172.21.15.6:0/1924134840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c071630 msgr2=0x7fde9c15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea3f57640 1 --2- 172.21.15.6:0/1924134840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c071630 0x7fde9c15f250 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fde980097a0 tx=0x7fde9802a100 comp rx=0 tx=0).stop 2024-05-20T18:02:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea3f57640 1 -- 172.21.15.6:0/1924134840 shutdown_connections 2024-05-20T18:02:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea3f57640 1 --2- 172.21.15.6:0/1924134840 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 0x7fde9c070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea3f57640 1 --2- 172.21.15.6:0/1924134840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c071630 0x7fde9c15f250 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.938+0000 7fdea3f57640 1 -- 172.21.15.6:0/1924134840 >> 172.21.15.6:0/1924134840 conn(0x7fde9c0d29d0 msgr2=0x7fde9c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.939+0000 7fdea3f57640 1 -- 172.21.15.6:0/1924134840 shutdown_connections 2024-05-20T18:02:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.939+0000 7fdea3f57640 1 -- 172.21.15.6:0/1924134840 wait complete. 2024-05-20T18:02:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.940+0000 7fdea3f57640 1 Processor -- start 2024-05-20T18:02:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.940+0000 7fdea3f57640 1 -- start start 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea3f57640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 0x7fde9c1e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea3f57640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde9c071630 0x7fde9c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea3f57640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c0cd1b0 0x7fde9c1f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea3f57640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c06ded0 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea3f57640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c06cfc0 con 0x7fde9c071630 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea3f57640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c06d2a0 con 0x7fde9c070850 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c0cd1b0 0x7fde9c1f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c0cd1b0 0x7fde9c1f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47138/0 (socket says 172.21.15.6:47138) 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 -- 172.21.15.6:0/2986739326 learned_addr learned my addr 172.21.15.6:0/2986739326 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea1cf3640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 0x7fde9c1e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea14f2640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde9c071630 0x7fde9c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 -- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 msgr2=0x7fde9c1e8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 0x7fde9c1e8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 -- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde9c071630 msgr2=0x7fde9c157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde9c071630 0x7fde9c157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 -- 172.21.15.6:0/2986739326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c160ec0 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.942+0000 7fdea24f4640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c0cd1b0 0x7fde9c1f92e0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fde94007e60 tx=0x7fde9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.943+0000 7fde927fc640 1 -- 172.21.15.6:0/2986739326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94014420 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.943+0000 7fde927fc640 1 -- 172.21.15.6:0/2986739326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde94019070 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.943+0000 7fde927fc640 1 -- 172.21.15.6:0/2986739326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94014820 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.943+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9c161140 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.943+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9c1ea630 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.944+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde9c0b5c80 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.944+0000 7fde927fc640 1 -- 172.21.15.6:0/2986739326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde940149c0 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.945+0000 7fde927fc640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde8006be30 0x7fde8006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.945+0000 7fde927fc640 1 -- 172.21.15.6:0/2986739326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fde9408b960 con 0x7fde9c0cd1b0 2024-05-20T18:02:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.945+0000 7fdea1cf3640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde8006be30 0x7fde8006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.945+0000 7fdea1cf3640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde8006be30 0x7fde8006e340 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fde98034000 tx=0x7fde9802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:56.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:56.949+0000 7fde927fc640 1 -- 172.21.15.6:0/2986739326 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fde9c160ec0 con 0x7fde9c0cd1b0 2024-05-20T18:02:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.135+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde9c075b00 con 0x7fde9c0cd1b0 2024-05-20T18:02:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.137+0000 7fde927fc640 1 -- 172.21.15.6:0/2986739326 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) ==== 74+0+16836 (secure 0 0 0) 0x7fde9405a050 con 0x7fde9c0cd1b0 2024-05-20T18:02:57.135 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:57.135 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":148,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:54.405297+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:51.154710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:51.763678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:02:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde8006be30 msgr2=0x7fde8006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde8006be30 0x7fde8006e340 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fde98034000 tx=0x7fde9802e000 comp rx=0 tx=0).stop 2024-05-20T18:02:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c0cd1b0 msgr2=0x7fde9c1f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c0cd1b0 0x7fde9c1f92e0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fde94007e60 tx=0x7fde9400e4b0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 shutdown_connections 2024-05-20T18:02:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fde8006be30 0x7fde8006e340 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde9c0cd1b0 0x7fde9c1f92e0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde9c071630 0x7fde9c157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 --2- 172.21.15.6:0/2986739326 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde9c070850 0x7fde9c1e8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 >> 172.21.15.6:0/2986739326 conn(0x7fde9c0d29d0 msgr2=0x7fde9c15b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 shutdown_connections 2024-05-20T18:02:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.139+0000 7fdea3f57640 1 -- 172.21.15.6:0/2986739326 wait complete. 2024-05-20T18:02:57.149 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-20T18:02:57.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:02:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.266+0000 7f1cbb38b640 1 Processor -- start 2024-05-20T18:02:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.266+0000 7f1cbb38b640 1 -- start start 2024-05-20T18:02:57.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.267+0000 7f1cbb38b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cb406d3d0 0x7f1cb406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.267+0000 7f1cbb38b640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1cb40b8190 0x7f1cb40b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.267+0000 7f1cbb38b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb406dd20 con 0x7f1cb4162820 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.267+0000 7f1cbb38b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb40d0630 con 0x7f1cb406d3d0 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.267+0000 7f1cbb38b640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb40d39c0 con 0x7f1cb40b8190 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.267+0000 7f1cb8926640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cb406d3d0 0x7f1cb406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.267+0000 7f1cb8926640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1cb406d3d0 0x7f1cb406d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47150/0 (socket says 172.21.15.6:47150) 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.267+0000 7f1cb8926640 1 -- 172.21.15.6:0/2323926413 learned_addr learned my addr 172.21.15.6:0/2323926413 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.268+0000 7f1cb9928640 1 --2- 172.21.15.6:0/2323926413 >> v2:172.21.15.171:3300/0 conn(0x7f1cb40b8190 0x7f1cb40b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.268+0000 7f1cb8926640 1 -- 172.21.15.6:0/2323926413 >> v2:172.21.15.171:3300/0 conn(0x7f1cb40b8190 msgr2=0x7f1cb40b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.268+0000 7f1cb8926640 1 --2- 172.21.15.6:0/2323926413 >> v2:172.21.15.171:3300/0 conn(0x7f1cb40b8190 0x7f1cb40b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.268+0000 7f1cb8926640 1 -- 172.21.15.6:0/2323926413 >> v1:172.21.15.171:6789/0 conn(0x7f1cb4162820 legacy=0x7f1cb40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.268+0000 7f1cb8926640 1 -- 172.21.15.6:0/2323926413 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb40d3ca0 con 0x7f1cb406d3d0 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.268+0000 7f1cb8926640 1 --2- 172.21.15.6:0/2323926413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb406d7e0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f1cb408e070 tx=0x7f1ca402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef576dfaecc825a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cabfff640 1 -- 172.21.15.6:0/2323926413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4037070 con 0x7f1cb406d3d0 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cabfff640 1 -- 172.21.15.6:0/2323926413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca4032440 con 0x7f1cb406d3d0 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cabfff640 1 -- 172.21.15.6:0/2323926413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4032810 con 0x7f1cb406d3d0 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cbb38b640 1 -- 172.21.15.6:0/2323926413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 msgr2=0x7f1cb406d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/2323926413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb406d7e0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f1cb408e070 tx=0x7f1ca402a230 comp rx=0 tx=0).stop 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cbb38b640 1 -- 172.21.15.6:0/2323926413 shutdown_connections 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/2323926413 >> v2:172.21.15.171:3300/0 conn(0x7f1cb40b8190 0x7f1cb40b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/2323926413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb406d7e0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.269+0000 7f1cbb38b640 1 -- 172.21.15.6:0/2323926413 >> 172.21.15.6:0/2323926413 conn(0x7f1cb40d4bd0 msgr2=0x7f1cb40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:57.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.270+0000 7f1cbb38b640 1 -- 172.21.15.6:0/2323926413 shutdown_connections 2024-05-20T18:02:57.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.270+0000 7f1cbb38b640 1 -- 172.21.15.6:0/2323926413 wait complete. 2024-05-20T18:02:57.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.271+0000 7f1cbb38b640 1 Processor -- start 2024-05-20T18:02:57.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.271+0000 7f1cbb38b640 1 -- start start 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cbb38b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb414afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cbb38b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cb40b8190 0x7f1cb40cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cbb38b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cb4162820 0x7f1cb40ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cbb38b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40d0300 con 0x7f1cb406d3d0 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cbb38b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40d4260 con 0x7f1cb40b8190 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cbb38b640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1cb40b4050 con 0x7f1cb4162820 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb414afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb414afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47152/0 (socket says 172.21.15.6:47152) 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 -- 172.21.15.6:0/1687056482 learned_addr learned my addr 172.21.15.6:0/1687056482 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb8926640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cb40b8190 0x7f1cb40cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9928640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cb4162820 0x7f1cb40ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 -- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cb4162820 msgr2=0x7f1cb40ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cb4162820 0x7f1cb40ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 -- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cb40b8190 msgr2=0x7f1cb40cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cb40b8190 0x7f1cb40cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 -- 172.21.15.6:0/1687056482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb414b4f0 con 0x7f1cb406d3d0 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1cb9127640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb414afb0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000b3f0 tx=0x7f1cb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1ca9ffb640 1 -- 172.21.15.6:0/1687056482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0015020 con 0x7f1cb406d3d0 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.273+0000 7f1ca9ffb640 1 -- 172.21.15.6:0/1687056482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb0011830 con 0x7f1cb406d3d0 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.274+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb40cae90 con 0x7f1cb406d3d0 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.274+0000 7f1ca9ffb640 1 -- 172.21.15.6:0/1687056482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0011c20 con 0x7f1cb406d3d0 2024-05-20T18:02:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.274+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb40cbc80 con 0x7f1cb406d3d0 2024-05-20T18:02:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.275+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb4075b00 con 0x7f1cb406d3d0 2024-05-20T18:02:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.275+0000 7f1ca9ffb640 1 -- 172.21.15.6:0/1687056482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cb0018020 con 0x7f1cb406d3d0 2024-05-20T18:02:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.276+0000 7f1ca9ffb640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c9806be60 0x7f1c9806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.276+0000 7f1ca9ffb640 1 -- 172.21.15.6:0/1687056482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f1cb008ab80 con 0x7f1cb406d3d0 2024-05-20T18:02:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.276+0000 7f1cb8926640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c9806be60 0x7f1c9806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.277+0000 7f1cb8926640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c9806be60 0x7f1c9806e370 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4034000 tx=0x7f1ca402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.281+0000 7f1ca9ffb640 1 -- 172.21.15.6:0/1687056482 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1cb001f030 con 0x7f1cb406d3d0 2024-05-20T18:02:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.464+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1cb40cb960 con 0x7f1c9806be60 2024-05-20T18:02:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.471+0000 7f1ca9ffb640 1 -- 172.21.15.6:0/1687056482 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252410 (secure 0 0 0) 0x7f1ca407fa10 con 0x7f1c9806be60 2024-05-20T18:02:57.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:02:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.473+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c9806be60 msgr2=0x7f1c9806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.473+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c9806be60 0x7f1c9806e370 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4034000 tx=0x7f1ca402e000 comp rx=0 tx=0).stop 2024-05-20T18:02:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.473+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 msgr2=0x7f1cb414afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.473+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb414afb0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000b3f0 tx=0x7f1cb000b8b0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.474+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 shutdown_connections 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.474+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1c9806be60 0x7f1c9806e370 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.474+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1cb4162820 0x7f1cb40ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.474+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cb40b8190 0x7f1cb40cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.474+0000 7f1cbb38b640 1 --2- 172.21.15.6:0/1687056482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1cb406d3d0 0x7f1cb414afb0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.474+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 >> 172.21.15.6:0/1687056482 conn(0x7f1cb40d4bd0 msgr2=0x7f1cb4160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.474+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 shutdown_connections 2024-05-20T18:02:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.474+0000 7f1cbb38b640 1 -- 172.21.15.6:0/1687056482 wait complete. 2024-05-20T18:02:57.483 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-05-20T18:02:56.385531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273424,"kb_used_data":15628,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701296,"statfs":{"total":773094113280,"available":772814127104,"internally_reserved":0,"allocated":16003072,"data_stored":8032013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.997582"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.419498+0000","last_change":"2024-05-20T18:02:53.416483+0000","last_active":"2024-05-20T18:02:53.419498+0000","last_peered":"2024-05-20T18:02:53.419498+0000","last_clean":"2024-05-20T18:02:53.419498+0000","last_became_active":"2024-05-20T18:02:53.416164+0000","last_became_peered":"2024-05-20T18:02:53.416164+0000","last_unstale":"2024-05-20T18:02:53.419498+0000","last_undegraded":"2024-05-20T18:02:53.419498+0000","last_fullsized":"2024-05-20T18:02:53.419498+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:49:28.845834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.420267+0000","last_change":"2024-05-20T18:02:53.419122+0000","last_active":"2024-05-20T18:02:53.420267+0000","last_peered":"2024-05-20T18:02:53.420267+0000","last_clean":"2024-05-20T18:02:53.420267+0000","last_became_active":"2024-05-20T18:02:53.418792+0000","last_became_peered":"2024-05-20T18:02:53.418792+0000","last_unstale":"2024-05-20T18:02:53.420267+0000","last_undegraded":"2024-05-20T18:02:53.420267+0000","last_fullsized":"2024-05-20T18:02:53.420267+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:25:34.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422760+0000","last_change":"2024-05-20T18:02:53.418784+0000","last_active":"2024-05-20T18:02:53.422760+0000","last_peered":"2024-05-20T18:02:53.422760+0000","last_clean":"2024-05-20T18:02:53.422760+0000","last_became_active":"2024-05-20T18:02:53.418465+0000","last_became_peered":"2024-05-20T18:02:53.418465+0000","last_unstale":"2024-05-20T18:02:53.422760+0000","last_undegraded":"2024-05-20T18:02:53.422760+0000","last_fullsized":"2024-05-20T18:02:53.422760+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:00.861776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.417276+0000","last_change":"2024-05-20T18:02:53.412594+0000","last_active":"2024-05-20T18:02:53.417276+0000","last_peered":"2024-05-20T18:02:53.417276+0000","last_clean":"2024-05-20T18:02:53.417276+0000","last_became_active":"2024-05-20T18:02:53.412283+0000","last_became_peered":"2024-05-20T18:02:53.412283+0000","last_unstale":"2024-05-20T18:02:53.417276+0000","last_undegraded":"2024-05-20T18:02:53.417276+0000","last_fullsized":"2024-05-20T18:02:53.417276+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:31.314611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429513+0000","last_change":"2024-05-20T18:02:53.421430+0000","last_active":"2024-05-20T18:02:53.429513+0000","last_peered":"2024-05-20T18:02:53.429513+0000","last_clean":"2024-05-20T18:02:53.429513+0000","last_became_active":"2024-05-20T18:02:53.420333+0000","last_became_peered":"2024-05-20T18:02:53.420333+0000","last_unstale":"2024-05-20T18:02:53.429513+0000","last_undegraded":"2024-05-20T18:02:53.429513+0000","last_fullsized":"2024-05-20T18:02:53.429513+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:57:20.271746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.425318+0000","last_change":"2024-05-20T18:02:53.421765+0000","last_active":"2024-05-20T18:02:53.425318+0000","last_peered":"2024-05-20T18:02:53.425318+0000","last_clean":"2024-05-20T18:02:53.425318+0000","last_became_active":"2024-05-20T18:02:53.421341+0000","last_became_peered":"2024-05-20T18:02:53.421341+0000","last_unstale":"2024-05-20T18:02:53.425318+0000","last_undegraded":"2024-05-20T18:02:53.425318+0000","last_fullsized":"2024-05-20T18:02:53.425318+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:43:35.011589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.431538+0000","last_change":"2024-05-20T18:02:53.422729+0000","last_active":"2024-05-20T18:02:53.431538+0000","last_peered":"2024-05-20T18:02:53.431538+0000","last_clean":"2024-05-20T18:02:53.431538+0000","last_became_active":"2024-05-20T18:02:53.422217+0000","last_became_peered":"2024-05-20T18:02:53.422217+0000","last_unstale":"2024-05-20T18:02:53.431538+0000","last_undegraded":"2024-05-20T18:02:53.431538+0000","last_fullsized":"2024-05-20T18:02:53.431538+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:19:09.280475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434017+0000","last_change":"2024-05-20T18:02:53.425742+0000","last_active":"2024-05-20T18:02:53.434017+0000","last_peered":"2024-05-20T18:02:53.434017+0000","last_clean":"2024-05-20T18:02:53.434017+0000","last_became_active":"2024-05-20T18:02:53.425220+0000","last_became_peered":"2024-05-20T18:02:53.425220+0000","last_unstale":"2024-05-20T18:02:53.434017+0000","last_undegraded":"2024-05-20T18:02:53.434017+0000","last_fullsized":"2024-05-20T18:02:53.434017+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:32.569732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.430448+0000","last_change":"2024-05-20T18:02:53.423386+0000","last_active":"2024-05-20T18:02:53.430448+0000","last_peered":"2024-05-20T18:02:53.430448+0000","last_clean":"2024-05-20T18:02:53.430448+0000","last_became_active":"2024-05-20T18:02:53.422991+0000","last_became_peered":"2024-05-20T18:02:53.422991+0000","last_unstale":"2024-05-20T18:02:53.430448+0000","last_undegraded":"2024-05-20T18:02:53.430448+0000","last_fullsized":"2024-05-20T18:02:53.430448+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:34.476650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422971+0000","last_change":"2024-05-20T18:02:53.418017+0000","last_active":"2024-05-20T18:02:53.422971+0000","last_peered":"2024-05-20T18:02:53.422971+0000","last_clean":"2024-05-20T18:02:53.422971+0000","last_became_active":"2024-05-20T18:02:53.417704+0000","last_became_peered":"2024-05-20T18:02:53.417704+0000","last_unstale":"2024-05-20T18:02:53.422971+0000","last_undegraded":"2024-05-20T18:02:53.422971+0000","last_fullsized":"2024-05-20T18:02:53.422971+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:40:07.593172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.413045+0000","last_change":"2024-05-20T18:02:53.410631+0000","last_active":"2024-05-20T18:02:53.413045+0000","last_peered":"2024-05-20T18:02:53.413045+0000","last_clean":"2024-05-20T18:02:53.413045+0000","last_became_active":"2024-05-20T18:02:53.410308+0000","last_became_peered":"2024-05-20T18:02:53.410308+0000","last_unstale":"2024-05-20T18:02:53.413045+0000","last_undegraded":"2024-05-20T18:02:53.413045+0000","last_fullsized":"2024-05-20T18:02:53.413045+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:32:39.020851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.424943+0000","last_change":"2024-05-20T18:02:53.422253+0000","last_active":"2024-05-20T18:02:53.424943+0000","last_peered":"2024-05-20T18:02:53.424943+0000","last_clean":"2024-05-20T18:02:53.424943+0000","last_became_active":"2024-05-20T18:02:53.421006+0000","last_became_peered":"2024-05-20T18:02:53.421006+0000","last_unstale":"2024-05-20T18:02:53.424943+0000","last_undegraded":"2024-05-20T18:02:53.424943+0000","last_fullsized":"2024-05-20T18:02:53.424943+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:20.881593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434981+0000","last_change":"2024-05-20T18:02:53.432687+0000","last_active":"2024-05-20T18:02:53.434981+0000","last_peered":"2024-05-20T18:02:53.434981+0000","last_clean":"2024-05-20T18:02:53.434981+0000","last_became_active":"2024-05-20T18:02:53.432254+0000","last_became_peered":"2024-05-20T18:02:53.432254+0000","last_unstale":"2024-05-20T18:02:53.434981+0000","last_undegraded":"2024-05-20T18:02:53.434981+0000","last_fullsized":"2024-05-20T18:02:53.434981+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:56.518408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429349+0000","last_change":"2024-05-20T18:02:53.423257+0000","last_active":"2024-05-20T18:02:53.429349+0000","last_peered":"2024-05-20T18:02:53.429349+0000","last_clean":"2024-05-20T18:02:53.429349+0000","last_became_active":"2024-05-20T18:02:53.422924+0000","last_became_peered":"2024-05-20T18:02:53.422924+0000","last_unstale":"2024-05-20T18:02:53.429349+0000","last_undegraded":"2024-05-20T18:02:53.429349+0000","last_fullsized":"2024-05-20T18:02:53.429349+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:36.080606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.426650+0000","last_change":"2024-05-20T18:02:53.425968+0000","last_active":"2024-05-20T18:02:53.426650+0000","last_peered":"2024-05-20T18:02:53.426650+0000","last_clean":"2024-05-20T18:02:53.426650+0000","last_became_active":"2024-05-20T18:02:53.425641+0000","last_became_peered":"2024-05-20T18:02:53.425641+0000","last_unstale":"2024-05-20T18:02:53.426650+0000","last_undegraded":"2024-05-20T18:02:53.426650+0000","last_fullsized":"2024-05-20T18:02:53.426650+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:47:14.195208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441898+0000","last_change":"2024-05-20T18:02:53.436842+0000","last_active":"2024-05-20T18:02:53.441898+0000","last_peered":"2024-05-20T18:02:53.441898+0000","last_clean":"2024-05-20T18:02:53.441898+0000","last_became_active":"2024-05-20T18:02:53.436506+0000","last_became_peered":"2024-05-20T18:02:53.436506+0000","last_unstale":"2024-05-20T18:02:53.441898+0000","last_undegraded":"2024-05-20T18:02:53.441898+0000","last_fullsized":"2024-05-20T18:02:53.441898+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:33:07.155998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.421545+0000","last_change":"2024-05-20T18:02:53.410553+0000","last_active":"2024-05-20T18:02:53.421545+0000","last_peered":"2024-05-20T18:02:53.421545+0000","last_clean":"2024-05-20T18:02:53.421545+0000","last_became_active":"2024-05-20T18:02:53.410189+0000","last_became_peered":"2024-05-20T18:02:53.410189+0000","last_unstale":"2024-05-20T18:02:53.421545+0000","last_undegraded":"2024-05-20T18:02:53.421545+0000","last_fullsized":"2024-05-20T18:02:53.421545+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:31.160538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.432656+0000","last_change":"2024-05-20T18:02:53.429982+0000","last_active":"2024-05-20T18:02:53.432656+0000","last_peered":"2024-05-20T18:02:53.432656+0000","last_clean":"2024-05-20T18:02:53.432656+0000","last_became_active":"2024-05-20T18:02:53.429638+0000","last_became_peered":"2024-05-20T18:02:53.429638+0000","last_unstale":"2024-05-20T18:02:53.432656+0000","last_undegraded":"2024-05-20T18:02:53.432656+0000","last_fullsized":"2024-05-20T18:02:53.432656+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:36:56.326919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.423439+0000","last_change":"2024-05-20T18:02:53.422717+0000","last_active":"2024-05-20T18:02:53.423439+0000","last_peered":"2024-05-20T18:02:53.423439+0000","last_clean":"2024-05-20T18:02:53.423439+0000","last_became_active":"2024-05-20T18:02:53.422398+0000","last_became_peered":"2024-05-20T18:02:53.422398+0000","last_unstale":"2024-05-20T18:02:53.423439+0000","last_undegraded":"2024-05-20T18:02:53.423439+0000","last_fullsized":"2024-05-20T18:02:53.423439+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:38:15.146363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.436341+0000","last_change":"2024-05-20T18:02:53.431617+0000","last_active":"2024-05-20T18:02:53.436341+0000","last_peered":"2024-05-20T18:02:53.436341+0000","last_clean":"2024-05-20T18:02:53.436341+0000","last_became_active":"2024-05-20T18:02:53.431318+0000","last_became_peered":"2024-05-20T18:02:53.431318+0000","last_unstale":"2024-05-20T18:02:53.436341+0000","last_undegraded":"2024-05-20T18:02:53.436341+0000","last_fullsized":"2024-05-20T18:02:53.436341+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:42.204644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.438280+0000","last_change":"2024-05-20T18:02:53.433219+0000","last_active":"2024-05-20T18:02:53.438280+0000","last_peered":"2024-05-20T18:02:53.438280+0000","last_clean":"2024-05-20T18:02:53.438280+0000","last_became_active":"2024-05-20T18:02:53.432868+0000","last_became_peered":"2024-05-20T18:02:53.432868+0000","last_unstale":"2024-05-20T18:02:53.438280+0000","last_undegraded":"2024-05-20T18:02:53.438280+0000","last_fullsized":"2024-05-20T18:02:53.438280+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:24:54.657040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422513+0000","last_change":"2024-05-20T18:02:53.420618+0000","last_active":"2024-05-20T18:02:53.422513+0000","last_peered":"2024-05-20T18:02:53.422513+0000","last_clean":"2024-05-20T18:02:53.422513+0000","last_became_active":"2024-05-20T18:02:53.420257+0000","last_became_peered":"2024-05-20T18:02:53.420257+0000","last_unstale":"2024-05-20T18:02:53.422513+0000","last_undegraded":"2024-05-20T18:02:53.422513+0000","last_fullsized":"2024-05-20T18:02:53.422513+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:40:07.593172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.428472+0000","last_change":"2024-05-20T18:02:53.416091+0000","last_active":"2024-05-20T18:02:53.428472+0000","last_peered":"2024-05-20T18:02:53.428472+0000","last_clean":"2024-05-20T18:02:53.428472+0000","last_became_active":"2024-05-20T18:02:53.415757+0000","last_became_peered":"2024-05-20T18:02:53.415757+0000","last_unstale":"2024-05-20T18:02:53.428472+0000","last_undegraded":"2024-05-20T18:02:53.428472+0000","last_fullsized":"2024-05-20T18:02:53.428472+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:38:23.759106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.414198+0000","last_change":"2024-05-20T18:02:53.411824+0000","last_active":"2024-05-20T18:02:53.414198+0000","last_peered":"2024-05-20T18:02:53.414198+0000","last_clean":"2024-05-20T18:02:53.414198+0000","last_became_active":"2024-05-20T18:02:53.411503+0000","last_became_peered":"2024-05-20T18:02:53.411503+0000","last_unstale":"2024-05-20T18:02:53.414198+0000","last_undegraded":"2024-05-20T18:02:53.414198+0000","last_fullsized":"2024-05-20T18:02:53.414198+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:40.089264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434938+0000","last_change":"2024-05-20T18:02:53.432670+0000","last_active":"2024-05-20T18:02:53.434938+0000","last_peered":"2024-05-20T18:02:53.434938+0000","last_clean":"2024-05-20T18:02:53.434938+0000","last_became_active":"2024-05-20T18:02:53.432328+0000","last_became_peered":"2024-05-20T18:02:53.432328+0000","last_unstale":"2024-05-20T18:02:53.434938+0000","last_undegraded":"2024-05-20T18:02:53.434938+0000","last_fullsized":"2024-05-20T18:02:53.434938+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:19:15.767572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.428078+0000","last_change":"2024-05-20T18:02:53.423897+0000","last_active":"2024-05-20T18:02:53.428078+0000","last_peered":"2024-05-20T18:02:53.428078+0000","last_clean":"2024-05-20T18:02:53.428078+0000","last_became_active":"2024-05-20T18:02:53.423079+0000","last_became_peered":"2024-05-20T18:02:53.423079+0000","last_unstale":"2024-05-20T18:02:53.428078+0000","last_undegraded":"2024-05-20T18:02:53.428078+0000","last_fullsized":"2024-05-20T18:02:53.428078+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:06:58.143039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.420596+0000","last_change":"2024-05-20T18:02:53.418630+0000","last_active":"2024-05-20T18:02:53.420596+0000","last_peered":"2024-05-20T18:02:53.420596+0000","last_clean":"2024-05-20T18:02:53.420596+0000","last_became_active":"2024-05-20T18:02:53.418323+0000","last_became_peered":"2024-05-20T18:02:53.418323+0000","last_unstale":"2024-05-20T18:02:53.420596+0000","last_undegraded":"2024-05-20T18:02:53.420596+0000","last_fullsized":"2024-05-20T18:02:53.420596+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:14.795475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.435403+0000","last_change":"2024-05-20T18:02:53.427408+0000","last_active":"2024-05-20T18:02:53.435403+0000","last_peered":"2024-05-20T18:02:53.435403+0000","last_clean":"2024-05-20T18:02:53.435403+0000","last_became_active":"2024-05-20T18:02:53.427042+0000","last_became_peered":"2024-05-20T18:02:53.427042+0000","last_unstale":"2024-05-20T18:02:53.435403+0000","last_undegraded":"2024-05-20T18:02:53.435403+0000","last_fullsized":"2024-05-20T18:02:53.435403+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:45:37.243981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.433019+0000","last_change":"2024-05-20T18:02:53.432459+0000","last_active":"2024-05-20T18:02:53.433019+0000","last_peered":"2024-05-20T18:02:53.433019+0000","last_clean":"2024-05-20T18:02:53.433019+0000","last_became_active":"2024-05-20T18:02:53.432090+0000","last_became_peered":"2024-05-20T18:02:53.432090+0000","last_unstale":"2024-05-20T18:02:53.433019+0000","last_undegraded":"2024-05-20T18:02:53.433019+0000","last_fullsized":"2024-05-20T18:02:53.433019+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:34.476650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.427314+0000","last_change":"2024-05-20T18:02:53.425144+0000","last_active":"2024-05-20T18:02:53.427314+0000","last_peered":"2024-05-20T18:02:53.427314+0000","last_clean":"2024-05-20T18:02:53.427314+0000","last_became_active":"2024-05-20T18:02:53.424830+0000","last_became_peered":"2024-05-20T18:02:53.424830+0000","last_unstale":"2024-05-20T18:02:53.427314+0000","last_undegraded":"2024-05-20T18:02:53.427314+0000","last_fullsized":"2024-05-20T18:02:53.427314+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:30.330170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.416139+0000","last_change":"2024-05-20T18:02:53.413591+0000","last_active":"2024-05-20T18:02:53.416139+0000","last_peered":"2024-05-20T18:02:53.416139+0000","last_clean":"2024-05-20T18:02:53.416139+0000","last_became_active":"2024-05-20T18:02:53.413265+0000","last_became_peered":"2024-05-20T18:02:53.413265+0000","last_unstale":"2024-05-20T18:02:53.416139+0000","last_undegraded":"2024-05-20T18:02:53.416139+0000","last_fullsized":"2024-05-20T18:02:53.416139+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:57.389854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.424749+0000","last_change":"2024-05-20T18:02:53.421746+0000","last_active":"2024-05-20T18:02:53.424749+0000","last_peered":"2024-05-20T18:02:53.424749+0000","last_clean":"2024-05-20T18:02:53.424749+0000","last_became_active":"2024-05-20T18:02:53.421436+0000","last_became_peered":"2024-05-20T18:02:53.421436+0000","last_unstale":"2024-05-20T18:02:53.424749+0000","last_undegraded":"2024-05-20T18:02:53.424749+0000","last_fullsized":"2024-05-20T18:02:53.424749+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:35.043785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441900+0000","last_change":"2024-05-20T18:02:53.437018+0000","last_active":"2024-05-20T18:02:53.441900+0000","last_peered":"2024-05-20T18:02:53.441900+0000","last_clean":"2024-05-20T18:02:53.441900+0000","last_became_active":"2024-05-20T18:02:53.436432+0000","last_became_peered":"2024-05-20T18:02:53.436432+0000","last_unstale":"2024-05-20T18:02:53.441900+0000","last_undegraded":"2024-05-20T18:02:53.441900+0000","last_fullsized":"2024-05-20T18:02:53.441900+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:38:23.759106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"147'4","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441613+0000","last_change":"2024-05-20T18:02:52.406029+0000","last_active":"2024-05-20T18:02:53.441613+0000","last_peered":"2024-05-20T18:02:53.441613+0000","last_clean":"2024-05-20T18:02:53.441613+0000","last_became_active":"2024-05-20T18:02:52.405714+0000","last_became_peered":"2024-05-20T18:02:52.405714+0000","last_unstale":"2024-05-20T18:02:53.441613+0000","last_undegraded":"2024-05-20T18:02:53.441613+0000","last_fullsized":"2024-05-20T18:02:53.441613+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:40.306068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.431780+0000","last_change":"2024-05-20T18:02:53.415020+0000","last_active":"2024-05-20T18:02:53.431780+0000","last_peered":"2024-05-20T18:02:53.431780+0000","last_clean":"2024-05-20T18:02:53.431780+0000","last_became_active":"2024-05-20T18:02:53.414689+0000","last_became_peered":"2024-05-20T18:02:53.414689+0000","last_unstale":"2024-05-20T18:02:53.431780+0000","last_undegraded":"2024-05-20T18:02:53.431780+0000","last_fullsized":"2024-05-20T18:02:53.431780+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:32:58.298508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429710+0000","last_change":"2024-05-20T18:02:52.419169+0000","last_active":"2024-05-20T18:02:53.429710+0000","last_peered":"2024-05-20T18:02:53.429710+0000","last_clean":"2024-05-20T18:02:53.429710+0000","last_became_active":"2024-05-20T18:02:52.418437+0000","last_became_peered":"2024-05-20T18:02:52.418437+0000","last_unstale":"2024-05-20T18:02:53.429710+0000","last_undegraded":"2024-05-20T18:02:53.429710+0000","last_fullsized":"2024-05-20T18:02:53.429710+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:57.199293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429322+0000","last_change":"2024-05-20T18:02:53.422743+0000","last_active":"2024-05-20T18:02:53.429322+0000","last_peered":"2024-05-20T18:02:53.429322+0000","last_clean":"2024-05-20T18:02:53.429322+0000","last_became_active":"2024-05-20T18:02:53.422369+0000","last_became_peered":"2024-05-20T18:02:53.422369+0000","last_unstale":"2024-05-20T18:02:53.429322+0000","last_undegraded":"2024-05-20T18:02:53.429322+0000","last_fullsized":"2024-05-20T18:02:53.429322+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:24:37.132713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434459+0000","last_change":"2024-05-20T18:02:52.410536+0000","last_active":"2024-05-20T18:02:53.434459+0000","last_peered":"2024-05-20T18:02:53.434459+0000","last_clean":"2024-05-20T18:02:53.434459+0000","last_became_active":"2024-05-20T18:02:52.410221+0000","last_became_peered":"2024-05-20T18:02:52.410221+0000","last_unstale":"2024-05-20T18:02:53.434459+0000","last_undegraded":"2024-05-20T18:02:53.434459+0000","last_fullsized":"2024-05-20T18:02:53.434459+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:36:55.320839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.439095+0000","last_change":"2024-05-20T18:02:53.436149+0000","last_active":"2024-05-20T18:02:53.439095+0000","last_peered":"2024-05-20T18:02:53.439095+0000","last_clean":"2024-05-20T18:02:53.439095+0000","last_became_active":"2024-05-20T18:02:53.435735+0000","last_became_peered":"2024-05-20T18:02:53.435735+0000","last_unstale":"2024-05-20T18:02:53.439095+0000","last_undegraded":"2024-05-20T18:02:53.439095+0000","last_fullsized":"2024-05-20T18:02:53.439095+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:32.569732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.432670+0000","last_change":"2024-05-20T18:02:52.410389+0000","last_active":"2024-05-20T18:02:53.432670+0000","last_peered":"2024-05-20T18:02:53.432670+0000","last_clean":"2024-05-20T18:02:53.432670+0000","last_became_active":"2024-05-20T18:02:52.410018+0000","last_became_peered":"2024-05-20T18:02:52.410018+0000","last_unstale":"2024-05-20T18:02:53.432670+0000","last_undegraded":"2024-05-20T18:02:53.432670+0000","last_fullsized":"2024-05-20T18:02:53.432670+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:40:37.999406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422856+0000","last_change":"2024-05-20T18:02:53.418062+0000","last_active":"2024-05-20T18:02:53.422856+0000","last_peered":"2024-05-20T18:02:53.422856+0000","last_clean":"2024-05-20T18:02:53.422856+0000","last_became_active":"2024-05-20T18:02:53.417765+0000","last_became_peered":"2024-05-20T18:02:53.417765+0000","last_unstale":"2024-05-20T18:02:53.422856+0000","last_undegraded":"2024-05-20T18:02:53.422856+0000","last_fullsized":"2024-05-20T18:02:53.422856+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:43:35.011589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.433808+0000","last_change":"2024-05-20T18:02:52.421940+0000","last_active":"2024-05-20T18:02:53.433808+0000","last_peered":"2024-05-20T18:02:53.433808+0000","last_clean":"2024-05-20T18:02:53.433808+0000","last_became_active":"2024-05-20T18:02:52.421617+0000","last_became_peered":"2024-05-20T18:02:52.421617+0000","last_unstale":"2024-05-20T18:02:53.433808+0000","last_undegraded":"2024-05-20T18:02:53.433808+0000","last_fullsized":"2024-05-20T18:02:53.433808+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:48.438358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.440932+0000","last_change":"2024-05-20T18:02:53.436046+0000","last_active":"2024-05-20T18:02:53.440932+0000","last_peered":"2024-05-20T18:02:53.440932+0000","last_clean":"2024-05-20T18:02:53.440932+0000","last_became_active":"2024-05-20T18:02:53.435718+0000","last_became_peered":"2024-05-20T18:02:53.435718+0000","last_unstale":"2024-05-20T18:02:53.440932+0000","last_undegraded":"2024-05-20T18:02:53.440932+0000","last_fullsized":"2024-05-20T18:02:53.440932+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:28.401124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441156+0000","last_change":"2024-05-20T18:02:52.422134+0000","last_active":"2024-05-20T18:02:53.441156+0000","last_peered":"2024-05-20T18:02:53.441156+0000","last_clean":"2024-05-20T18:02:53.441156+0000","last_became_active":"2024-05-20T18:02:52.421603+0000","last_became_peered":"2024-05-20T18:02:52.421603+0000","last_unstale":"2024-05-20T18:02:53.441156+0000","last_undegraded":"2024-05-20T18:02:53.441156+0000","last_fullsized":"2024-05-20T18:02:53.441156+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:43:34.005509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.428181+0000","last_change":"2024-05-20T18:02:53.424716+0000","last_active":"2024-05-20T18:02:53.428181+0000","last_peered":"2024-05-20T18:02:53.428181+0000","last_clean":"2024-05-20T18:02:53.428181+0000","last_became_active":"2024-05-20T18:02:53.423549+0000","last_became_peered":"2024-05-20T18:02:53.423549+0000","last_unstale":"2024-05-20T18:02:53.428181+0000","last_undegraded":"2024-05-20T18:02:53.428181+0000","last_fullsized":"2024-05-20T18:02:53.428181+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:11:31.636197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.414461+0000","last_change":"2024-05-20T18:02:52.417787+0000","last_active":"2024-05-20T18:02:53.414461+0000","last_peered":"2024-05-20T18:02:53.414461+0000","last_clean":"2024-05-20T18:02:53.414461+0000","last_became_active":"2024-05-20T18:02:52.417462+0000","last_became_peered":"2024-05-20T18:02:52.417462+0000","last_unstale":"2024-05-20T18:02:53.414461+0000","last_undegraded":"2024-05-20T18:02:53.414461+0000","last_fullsized":"2024-05-20T18:02:53.414461+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:27:49.821860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.409986+0000","last_change":"2024-05-20T18:02:53.406552+0000","last_active":"2024-05-20T18:02:53.409986+0000","last_peered":"2024-05-20T18:02:53.409986+0000","last_clean":"2024-05-20T18:02:53.409986+0000","last_became_active":"2024-05-20T18:02:53.405076+0000","last_became_peered":"2024-05-20T18:02:53.405076+0000","last_unstale":"2024-05-20T18:02:53.409986+0000","last_undegraded":"2024-05-20T18:02:53.409986+0000","last_fullsized":"2024-05-20T18:02:53.409986+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:46:41.669706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.400298+0000","last_change":"2024-05-20T18:02:52.412631+0000","last_active":"2024-05-20T18:02:53.400298+0000","last_peered":"2024-05-20T18:02:53.400298+0000","last_clean":"2024-05-20T18:02:53.400298+0000","last_became_active":"2024-05-20T18:02:52.412294+0000","last_became_peered":"2024-05-20T18:02:52.412294+0000","last_unstale":"2024-05-20T18:02:53.400298+0000","last_undegraded":"2024-05-20T18:02:53.400298+0000","last_fullsized":"2024-05-20T18:02:53.400298+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:38:14.140284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441876+0000","last_change":"2024-05-20T18:02:53.436158+0000","last_active":"2024-05-20T18:02:53.441876+0000","last_peered":"2024-05-20T18:02:53.441876+0000","last_clean":"2024-05-20T18:02:53.441876+0000","last_became_active":"2024-05-20T18:02:53.435825+0000","last_became_peered":"2024-05-20T18:02:53.435825+0000","last_unstale":"2024-05-20T18:02:53.441876+0000","last_undegraded":"2024-05-20T18:02:53.441876+0000","last_fullsized":"2024-05-20T18:02:53.441876+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:58.205373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.404517+0000","last_change":"2024-05-20T18:02:52.410321+0000","last_active":"2024-05-20T18:02:53.404517+0000","last_peered":"2024-05-20T18:02:53.404517+0000","last_clean":"2024-05-20T18:02:53.404517+0000","last_became_active":"2024-05-20T18:02:52.409475+0000","last_became_peered":"2024-05-20T18:02:52.409475+0000","last_unstale":"2024-05-20T18:02:53.404517+0000","last_undegraded":"2024-05-20T18:02:53.404517+0000","last_fullsized":"2024-05-20T18:02:53.404517+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:59.426597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434929+0000","last_change":"2024-05-20T18:02:53.430756+0000","last_active":"2024-05-20T18:02:53.434929+0000","last_peered":"2024-05-20T18:02:53.434929+0000","last_clean":"2024-05-20T18:02:53.434929+0000","last_became_active":"2024-05-20T18:02:53.430448+0000","last_became_peered":"2024-05-20T18:02:53.430448+0000","last_unstale":"2024-05-20T18:02:53.434929+0000","last_undegraded":"2024-05-20T18:02:53.434929+0000","last_fullsized":"2024-05-20T18:02:53.434929+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:04:36.994283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"147'3","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.430651+0000","last_change":"2024-05-20T18:02:52.405128+0000","last_active":"2024-05-20T18:02:53.430651+0000","last_peered":"2024-05-20T18:02:53.430651+0000","last_clean":"2024-05-20T18:02:53.430651+0000","last_became_active":"2024-05-20T18:02:52.404788+0000","last_became_peered":"2024-05-20T18:02:52.404788+0000","last_unstale":"2024-05-20T18:02:53.430651+0000","last_undegraded":"2024-05-20T18:02:53.430651+0000","last_fullsized":"2024-05-20T18:02:53.430651+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:05:03.069330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.433942+0000","last_change":"2024-05-20T18:02:53.430340+0000","last_active":"2024-05-20T18:02:53.433942+0000","last_peered":"2024-05-20T18:02:53.433942+0000","last_clean":"2024-05-20T18:02:53.433942+0000","last_became_active":"2024-05-20T18:02:53.430004+0000","last_became_peered":"2024-05-20T18:02:53.430004+0000","last_unstale":"2024-05-20T18:02:53.433942+0000","last_undegraded":"2024-05-20T18:02:53.433942+0000","last_fullsized":"2024-05-20T18:02:53.433942+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:14:17.937921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"147'6","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441002+0000","last_change":"2024-05-20T18:02:52.414886+0000","last_active":"2024-05-20T18:02:53.441002+0000","last_peered":"2024-05-20T18:02:53.441002+0000","last_clean":"2024-05-20T18:02:53.441002+0000","last_became_active":"2024-05-20T18:02:52.414561+0000","last_became_peered":"2024-05-20T18:02:52.414561+0000","last_unstale":"2024-05-20T18:02:53.441002+0000","last_undegraded":"2024-05-20T18:02:53.441002+0000","last_fullsized":"2024-05-20T18:02:53.441002+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:35:09.177661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.419163+0000","last_change":"2024-05-20T18:02:53.417011+0000","last_active":"2024-05-20T18:02:53.419163+0000","last_peered":"2024-05-20T18:02:53.419163+0000","last_clean":"2024-05-20T18:02:53.419163+0000","last_became_active":"2024-05-20T18:02:53.416669+0000","last_became_peered":"2024-05-20T18:02:53.416669+0000","last_unstale":"2024-05-20T18:02:53.419163+0000","last_undegraded":"2024-05-20T18:02:53.419163+0000","last_fullsized":"2024-05-20T18:02:53.419163+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:33:07.155998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.423852+0000","last_change":"2024-05-20T18:02:52.418366+0000","last_active":"2024-05-20T18:02:53.423852+0000","last_peered":"2024-05-20T18:02:53.423852+0000","last_clean":"2024-05-20T18:02:53.423852+0000","last_became_active":"2024-05-20T18:02:52.417989+0000","last_became_peered":"2024-05-20T18:02:52.417989+0000","last_unstale":"2024-05-20T18:02:53.423852+0000","last_undegraded":"2024-05-20T18:02:53.423852+0000","last_fullsized":"2024-05-20T18:02:53.423852+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:19.875513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.430429+0000","last_change":"2024-05-20T18:02:53.422236+0000","last_active":"2024-05-20T18:02:53.430429+0000","last_peered":"2024-05-20T18:02:53.430429+0000","last_clean":"2024-05-20T18:02:53.430429+0000","last_became_active":"2024-05-20T18:02:53.421901+0000","last_became_peered":"2024-05-20T18:02:53.421901+0000","last_unstale":"2024-05-20T18:02:53.430429+0000","last_undegraded":"2024-05-20T18:02:53.430429+0000","last_fullsized":"2024-05-20T18:02:53.430429+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:20.881593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.405066+0000","last_change":"2024-05-20T18:02:52.412838+0000","last_active":"2024-05-20T18:02:53.405066+0000","last_peered":"2024-05-20T18:02:53.405066+0000","last_clean":"2024-05-20T18:02:53.405066+0000","last_became_active":"2024-05-20T18:02:52.412514+0000","last_became_peered":"2024-05-20T18:02:52.412514+0000","last_unstale":"2024-05-20T18:02:53.405066+0000","last_undegraded":"2024-05-20T18:02:53.405066+0000","last_fullsized":"2024-05-20T18:02:53.405066+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:26:23.472365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.416926+0000","last_change":"2024-05-20T18:02:53.414496+0000","last_active":"2024-05-20T18:02:53.416926+0000","last_peered":"2024-05-20T18:02:53.416926+0000","last_clean":"2024-05-20T18:02:53.416926+0000","last_became_active":"2024-05-20T18:02:53.413881+0000","last_became_peered":"2024-05-20T18:02:53.413881+0000","last_unstale":"2024-05-20T18:02:53.416926+0000","last_undegraded":"2024-05-20T18:02:53.416926+0000","last_fullsized":"2024-05-20T18:02:53.416926+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:49.444438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.402266+0000","last_change":"2024-05-20T18:02:52.419378+0000","last_active":"2024-05-20T18:02:53.402266+0000","last_peered":"2024-05-20T18:02:53.402266+0000","last_clean":"2024-05-20T18:02:53.402266+0000","last_became_active":"2024-05-20T18:02:52.419077+0000","last_became_peered":"2024-05-20T18:02:52.419077+0000","last_unstale":"2024-05-20T18:02:53.402266+0000","last_undegraded":"2024-05-20T18:02:53.402266+0000","last_fullsized":"2024-05-20T18:02:53.402266+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:33:06.149919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.425117+0000","last_change":"2024-05-20T18:02:53.420472+0000","last_active":"2024-05-20T18:02:53.425117+0000","last_peered":"2024-05-20T18:02:53.425117+0000","last_clean":"2024-05-20T18:02:53.425117+0000","last_became_active":"2024-05-20T18:02:53.420115+0000","last_became_peered":"2024-05-20T18:02:53.420115+0000","last_unstale":"2024-05-20T18:02:53.425117+0000","last_undegraded":"2024-05-20T18:02:53.425117+0000","last_fullsized":"2024-05-20T18:02:53.425117+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:45:34.941174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"147'8","reported_seq":20,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434087+0000","last_change":"2024-05-20T18:02:52.409736+0000","last_active":"2024-05-20T18:02:53.434087+0000","last_peered":"2024-05-20T18:02:53.434087+0000","last_clean":"2024-05-20T18:02:53.434087+0000","last_became_active":"2024-05-20T18:02:52.409410+0000","last_became_peered":"2024-05-20T18:02:52.409410+0000","last_unstale":"2024-05-20T18:02:53.434087+0000","last_undegraded":"2024-05-20T18:02:53.434087+0000","last_fullsized":"2024-05-20T18:02:53.434087+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:47:13.189129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.424594+0000","last_change":"2024-05-20T18:02:53.414599+0000","last_active":"2024-05-20T18:02:53.424594+0000","last_peered":"2024-05-20T18:02:53.424594+0000","last_clean":"2024-05-20T18:02:53.424594+0000","last_became_active":"2024-05-20T18:02:53.414294+0000","last_became_peered":"2024-05-20T18:02:53.414294+0000","last_unstale":"2024-05-20T18:02:53.424594+0000","last_undegraded":"2024-05-20T18:02:53.424594+0000","last_fullsized":"2024-05-20T18:02:53.424594+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:25:34.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.433481+0000","last_change":"2024-05-20T18:02:52.406125+0000","last_active":"2024-05-20T18:02:53.433481+0000","last_peered":"2024-05-20T18:02:53.433481+0000","last_clean":"2024-05-20T18:02:53.433481+0000","last_became_active":"2024-05-20T18:02:52.405752+0000","last_became_peered":"2024-05-20T18:02:52.405752+0000","last_unstale":"2024-05-20T18:02:53.433481+0000","last_undegraded":"2024-05-20T18:02:53.433481+0000","last_fullsized":"2024-05-20T18:02:53.433481+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:45:00.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.416214+0000","last_change":"2024-05-20T18:02:53.413182+0000","last_active":"2024-05-20T18:02:53.416214+0000","last_peered":"2024-05-20T18:02:53.416214+0000","last_clean":"2024-05-20T18:02:53.416214+0000","last_became_active":"2024-05-20T18:02:53.412852+0000","last_became_peered":"2024-05-20T18:02:53.412852+0000","last_unstale":"2024-05-20T18:02:53.416214+0000","last_undegraded":"2024-05-20T18:02:53.416214+0000","last_fullsized":"2024-05-20T18:02:53.416214+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:00.861776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.430358+0000","last_change":"2024-05-20T18:02:52.411544+0000","last_active":"2024-05-20T18:02:53.430358+0000","last_peered":"2024-05-20T18:02:53.430358+0000","last_clean":"2024-05-20T18:02:53.430358+0000","last_became_active":"2024-05-20T18:02:52.411144+0000","last_became_peered":"2024-05-20T18:02:52.411144+0000","last_unstale":"2024-05-20T18:02:53.430358+0000","last_undegraded":"2024-05-20T18:02:53.430358+0000","last_fullsized":"2024-05-20T18:02:53.430358+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:15:30.326643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.406216+0000","last_change":"2024-05-20T18:02:53.405275+0000","last_active":"2024-05-20T18:02:53.406216+0000","last_peered":"2024-05-20T18:02:53.406216+0000","last_clean":"2024-05-20T18:02:53.406216+0000","last_became_active":"2024-05-20T18:02:53.404902+0000","last_became_peered":"2024-05-20T18:02:53.404902+0000","last_unstale":"2024-05-20T18:02:53.406216+0000","last_undegraded":"2024-05-20T18:02:53.406216+0000","last_fullsized":"2024-05-20T18:02:53.406216+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:54:13.433062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429371+0000","last_change":"2024-05-20T18:02:52.415624+0000","last_active":"2024-05-20T18:02:53.429371+0000","last_peered":"2024-05-20T18:02:53.429371+0000","last_clean":"2024-05-20T18:02:53.429371+0000","last_became_active":"2024-05-20T18:02:52.415239+0000","last_became_peered":"2024-05-20T18:02:52.415239+0000","last_unstale":"2024-05-20T18:02:53.429371+0000","last_undegraded":"2024-05-20T18:02:53.429371+0000","last_fullsized":"2024-05-20T18:02:53.429371+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:31.563652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.412847+0000","last_change":"2024-05-20T18:02:53.411569+0000","last_active":"2024-05-20T18:02:53.412847+0000","last_peered":"2024-05-20T18:02:53.412847+0000","last_clean":"2024-05-20T18:02:53.412847+0000","last_became_active":"2024-05-20T18:02:53.411233+0000","last_became_peered":"2024-05-20T18:02:53.411233+0000","last_unstale":"2024-05-20T18:02:53.412847+0000","last_undegraded":"2024-05-20T18:02:53.412847+0000","last_fullsized":"2024-05-20T18:02:53.412847+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:05:58.839566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.401026+0000","last_change":"2024-05-20T18:02:52.419211+0000","last_active":"2024-05-20T18:02:53.401026+0000","last_peered":"2024-05-20T18:02:53.401026+0000","last_clean":"2024-05-20T18:02:53.401026+0000","last_became_active":"2024-05-20T18:02:52.418873+0000","last_became_peered":"2024-05-20T18:02:52.418873+0000","last_unstale":"2024-05-20T18:02:53.401026+0000","last_undegraded":"2024-05-20T18:02:53.401026+0000","last_fullsized":"2024-05-20T18:02:53.401026+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:47:36.392428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.432241+0000","last_change":"2024-05-20T18:02:53.426396+0000","last_active":"2024-05-20T18:02:53.432241+0000","last_peered":"2024-05-20T18:02:53.432241+0000","last_clean":"2024-05-20T18:02:53.432241+0000","last_became_active":"2024-05-20T18:02:53.425930+0000","last_became_peered":"2024-05-20T18:02:53.425930+0000","last_unstale":"2024-05-20T18:02:53.432241+0000","last_undegraded":"2024-05-20T18:02:53.432241+0000","last_fullsized":"2024-05-20T18:02:53.432241+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:01:47.237578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.428495+0000","last_change":"2024-05-20T18:02:52.419246+0000","last_active":"2024-05-20T18:02:53.428495+0000","last_peered":"2024-05-20T18:02:53.428495+0000","last_clean":"2024-05-20T18:02:53.428495+0000","last_became_active":"2024-05-20T18:02:52.418920+0000","last_became_peered":"2024-05-20T18:02:52.418920+0000","last_unstale":"2024-05-20T18:02:53.428495+0000","last_undegraded":"2024-05-20T18:02:53.428495+0000","last_fullsized":"2024-05-20T18:02:53.428495+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:19:08.274395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429448+0000","last_change":"2024-05-20T18:02:53.423433+0000","last_active":"2024-05-20T18:02:53.429448+0000","last_peered":"2024-05-20T18:02:53.429448+0000","last_clean":"2024-05-20T18:02:53.429448+0000","last_became_active":"2024-05-20T18:02:53.423083+0000","last_became_peered":"2024-05-20T18:02:53.423083+0000","last_unstale":"2024-05-20T18:02:53.429448+0000","last_undegraded":"2024-05-20T18:02:53.429448+0000","last_fullsized":"2024-05-20T18:02:53.429448+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:56.730330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.402608+0000","last_change":"2024-05-20T18:02:52.409171+0000","last_active":"2024-05-20T18:02:53.402608+0000","last_peered":"2024-05-20T18:02:53.402608+0000","last_clean":"2024-05-20T18:02:53.402608+0000","last_became_active":"2024-05-20T18:02:52.408704+0000","last_became_peered":"2024-05-20T18:02:52.408704+0000","last_unstale":"2024-05-20T18:02:53.402608+0000","last_undegraded":"2024-05-20T18:02:53.402608+0000","last_fullsized":"2024-05-20T18:02:53.402608+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:29.324091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.435886+0000","last_change":"2024-05-20T18:02:53.429534+0000","last_active":"2024-05-20T18:02:53.435886+0000","last_peered":"2024-05-20T18:02:53.435886+0000","last_clean":"2024-05-20T18:02:53.435886+0000","last_became_active":"2024-05-20T18:02:53.429141+0000","last_became_peered":"2024-05-20T18:02:53.429141+0000","last_unstale":"2024-05-20T18:02:53.435886+0000","last_undegraded":"2024-05-20T18:02:53.435886+0000","last_fullsized":"2024-05-20T18:02:53.435886+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:52:45.607219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.414668+0000","last_change":"2024-05-20T18:02:52.411613+0000","last_active":"2024-05-20T18:02:53.414668+0000","last_peered":"2024-05-20T18:02:53.414668+0000","last_clean":"2024-05-20T18:02:53.414668+0000","last_became_active":"2024-05-20T18:02:52.408181+0000","last_became_peered":"2024-05-20T18:02:52.408181+0000","last_unstale":"2024-05-20T18:02:53.414668+0000","last_undegraded":"2024-05-20T18:02:53.414668+0000","last_fullsized":"2024-05-20T18:02:53.414668+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:06.526013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.427439+0000","last_change":"2024-05-20T18:02:53.424251+0000","last_active":"2024-05-20T18:02:53.427439+0000","last_peered":"2024-05-20T18:02:53.427439+0000","last_clean":"2024-05-20T18:02:53.427439+0000","last_became_active":"2024-05-20T18:02:53.423970+0000","last_became_peered":"2024-05-20T18:02:53.423970+0000","last_unstale":"2024-05-20T18:02:53.427439+0000","last_undegraded":"2024-05-20T18:02:53.427439+0000","last_fullsized":"2024-05-20T18:02:53.427439+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:19:09.280475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.415416+0000","last_change":"2024-05-20T18:02:52.412486+0000","last_active":"2024-05-20T18:02:53.415416+0000","last_peered":"2024-05-20T18:02:53.415416+0000","last_clean":"2024-05-20T18:02:53.415416+0000","last_became_active":"2024-05-20T18:02:52.412113+0000","last_became_peered":"2024-05-20T18:02:52.412113+0000","last_unstale":"2024-05-20T18:02:53.415416+0000","last_undegraded":"2024-05-20T18:02:53.415416+0000","last_fullsized":"2024-05-20T18:02:53.415416+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:30.154459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.414641+0000","last_change":"2024-05-20T18:02:53.412575+0000","last_active":"2024-05-20T18:02:53.414641+0000","last_peered":"2024-05-20T18:02:53.414641+0000","last_clean":"2024-05-20T18:02:53.414641+0000","last_became_active":"2024-05-20T18:02:53.412243+0000","last_became_peered":"2024-05-20T18:02:53.412243+0000","last_unstale":"2024-05-20T18:02:53.414641+0000","last_undegraded":"2024-05-20T18:02:53.414641+0000","last_fullsized":"2024-05-20T18:02:53.414641+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:28:16.433038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.423847+0000","last_change":"2024-05-20T18:02:52.414779+0000","last_active":"2024-05-20T18:02:53.423847+0000","last_peered":"2024-05-20T18:02:53.423847+0000","last_clean":"2024-05-20T18:02:53.423847+0000","last_became_active":"2024-05-20T18:02:52.414470+0000","last_became_peered":"2024-05-20T18:02:52.414470+0000","last_unstale":"2024-05-20T18:02:53.423847+0000","last_undegraded":"2024-05-20T18:02:53.423847+0000","last_fullsized":"2024-05-20T18:02:53.423847+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:33.470570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422507+0000","last_change":"2024-05-20T18:02:53.413063+0000","last_active":"2024-05-20T18:02:53.422507+0000","last_peered":"2024-05-20T18:02:53.422507+0000","last_clean":"2024-05-20T18:02:53.422507+0000","last_became_active":"2024-05-20T18:02:53.412637+0000","last_became_peered":"2024-05-20T18:02:53.412637+0000","last_unstale":"2024-05-20T18:02:53.422507+0000","last_undegraded":"2024-05-20T18:02:53.422507+0000","last_fullsized":"2024-05-20T18:02:53.422507+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:05:11.661698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.404393+0000","last_change":"2024-05-20T18:02:52.414953+0000","last_active":"2024-05-20T18:02:53.404393+0000","last_peered":"2024-05-20T18:02:53.404393+0000","last_clean":"2024-05-20T18:02:53.404393+0000","last_became_active":"2024-05-20T18:02:52.414603+0000","last_became_peered":"2024-05-20T18:02:52.414603+0000","last_unstale":"2024-05-20T18:02:53.404393+0000","last_undegraded":"2024-05-20T18:02:53.404393+0000","last_fullsized":"2024-05-20T18:02:53.404393+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:05:22.544040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.425331+0000","last_change":"2024-05-20T18:02:53.419913+0000","last_active":"2024-05-20T18:02:53.425331+0000","last_peered":"2024-05-20T18:02:53.425331+0000","last_clean":"2024-05-20T18:02:53.425331+0000","last_became_active":"2024-05-20T18:02:53.419582+0000","last_became_peered":"2024-05-20T18:02:53.419582+0000","last_unstale":"2024-05-20T18:02:53.425331+0000","last_undegraded":"2024-05-20T18:02:53.425331+0000","last_fullsized":"2024-05-20T18:02:53.425331+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:35.206417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.404497+0000","last_change":"2024-05-20T18:02:52.415946+0000","last_active":"2024-05-20T18:02:53.404497+0000","last_peered":"2024-05-20T18:02:53.404497+0000","last_clean":"2024-05-20T18:02:53.404497+0000","last_became_active":"2024-05-20T18:02:52.415630+0000","last_became_peered":"2024-05-20T18:02:52.415630+0000","last_unstale":"2024-05-20T18:02:53.404497+0000","last_undegraded":"2024-05-20T18:02:53.404497+0000","last_fullsized":"2024-05-20T18:02:53.404497+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:53.782943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.425142+0000","last_change":"2024-05-20T18:02:53.413382+0000","last_active":"2024-05-20T18:02:53.425142+0000","last_peered":"2024-05-20T18:02:53.425142+0000","last_clean":"2024-05-20T18:02:53.425142+0000","last_became_active":"2024-05-20T18:02:53.413034+0000","last_became_peered":"2024-05-20T18:02:53.413034+0000","last_unstale":"2024-05-20T18:02:53.425142+0000","last_undegraded":"2024-05-20T18:02:53.425142+0000","last_fullsized":"2024-05-20T18:02:53.425142+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:14.795475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.415258+0000","last_change":"2024-05-20T18:02:52.412886+0000","last_active":"2024-05-20T18:02:53.415258+0000","last_peered":"2024-05-20T18:02:53.415258+0000","last_clean":"2024-05-20T18:02:53.415258+0000","last_became_active":"2024-05-20T18:02:52.412573+0000","last_became_peered":"2024-05-20T18:02:52.412573+0000","last_unstale":"2024-05-20T18:02:53.415258+0000","last_undegraded":"2024-05-20T18:02:53.415258+0000","last_fullsized":"2024-05-20T18:02:53.415258+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:06.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.417303+0000","last_change":"2024-05-20T18:02:53.413321+0000","last_active":"2024-05-20T18:02:53.417303+0000","last_peered":"2024-05-20T18:02:53.417303+0000","last_clean":"2024-05-20T18:02:53.417303+0000","last_became_active":"2024-05-20T18:02:53.413016+0000","last_became_peered":"2024-05-20T18:02:53.413016+0000","last_unstale":"2024-05-20T18:02:53.417303+0000","last_undegraded":"2024-05-20T18:02:53.417303+0000","last_fullsized":"2024-05-20T18:02:53.417303+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:02:04.708770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.400825+0000","last_change":"2024-05-20T18:02:52.413474+0000","last_active":"2024-05-20T18:02:53.400825+0000","last_peered":"2024-05-20T18:02:53.400825+0000","last_clean":"2024-05-20T18:02:53.400825+0000","last_became_active":"2024-05-20T18:02:52.413128+0000","last_became_peered":"2024-05-20T18:02:52.413128+0000","last_unstale":"2024-05-20T18:02:53.400825+0000","last_undegraded":"2024-05-20T18:02:53.400825+0000","last_fullsized":"2024-05-20T18:02:53.400825+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:13:50.846232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.442390+0000","last_change":"2024-05-20T18:02:53.442020+0000","last_active":"2024-05-20T18:02:53.442390+0000","last_peered":"2024-05-20T18:02:53.442390+0000","last_clean":"2024-05-20T18:02:53.442390+0000","last_became_active":"2024-05-20T18:02:53.441690+0000","last_became_peered":"2024-05-20T18:02:53.441690+0000","last_unstale":"2024-05-20T18:02:53.442390+0000","last_undegraded":"2024-05-20T18:02:53.442390+0000","last_fullsized":"2024-05-20T18:02:53.442390+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:57:20.271746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.405237+0000","last_change":"2024-05-20T18:02:52.406136+0000","last_active":"2024-05-20T18:02:53.405237+0000","last_peered":"2024-05-20T18:02:53.405237+0000","last_clean":"2024-05-20T18:02:53.405237+0000","last_became_active":"2024-05-20T18:02:52.405770+0000","last_became_peered":"2024-05-20T18:02:52.405770+0000","last_unstale":"2024-05-20T18:02:53.405237+0000","last_undegraded":"2024-05-20T18:02:53.405237+0000","last_fullsized":"2024-05-20T18:02:53.405237+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:20:14.180265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434832+0000","last_change":"2024-05-20T18:02:53.431480+0000","last_active":"2024-05-20T18:02:53.434832+0000","last_peered":"2024-05-20T18:02:53.434832+0000","last_clean":"2024-05-20T18:02:53.434832+0000","last_became_active":"2024-05-20T18:02:53.431157+0000","last_became_peered":"2024-05-20T18:02:53.431157+0000","last_unstale":"2024-05-20T18:02:53.434832+0000","last_undegraded":"2024-05-20T18:02:53.434832+0000","last_fullsized":"2024-05-20T18:02:53.434832+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:46:32.248836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.402359+0000","last_change":"2024-05-20T18:02:52.411329+0000","last_active":"2024-05-20T18:02:53.402359+0000","last_peered":"2024-05-20T18:02:53.402359+0000","last_clean":"2024-05-20T18:02:53.402359+0000","last_became_active":"2024-05-20T18:02:52.411033+0000","last_became_peered":"2024-05-20T18:02:52.411033+0000","last_unstale":"2024-05-20T18:02:53.402359+0000","last_undegraded":"2024-05-20T18:02:53.402359+0000","last_fullsized":"2024-05-20T18:02:53.402359+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:34.037705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.436291+0000","last_change":"2024-05-20T18:02:53.431151+0000","last_active":"2024-05-20T18:02:53.436291+0000","last_peered":"2024-05-20T18:02:53.436291+0000","last_clean":"2024-05-20T18:02:53.436291+0000","last_became_active":"2024-05-20T18:02:53.430857+0000","last_became_peered":"2024-05-20T18:02:53.430857+0000","last_unstale":"2024-05-20T18:02:53.436291+0000","last_undegraded":"2024-05-20T18:02:53.436291+0000","last_fullsized":"2024-05-20T18:02:53.436291+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:45:39.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.408101+0000","last_change":"2024-05-20T18:02:52.419269+0000","last_active":"2024-05-20T18:02:53.408101+0000","last_peered":"2024-05-20T18:02:53.408101+0000","last_clean":"2024-05-20T18:02:53.408101+0000","last_became_active":"2024-05-20T18:02:52.418966+0000","last_became_peered":"2024-05-20T18:02:52.418966+0000","last_unstale":"2024-05-20T18:02:53.408101+0000","last_undegraded":"2024-05-20T18:02:53.408101+0000","last_fullsized":"2024-05-20T18:02:53.408101+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:40:06.587092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.420992+0000","last_change":"2024-05-20T18:02:53.417860+0000","last_active":"2024-05-20T18:02:53.420992+0000","last_peered":"2024-05-20T18:02:53.420992+0000","last_clean":"2024-05-20T18:02:53.420992+0000","last_became_active":"2024-05-20T18:02:53.417021+0000","last_became_peered":"2024-05-20T18:02:53.417021+0000","last_unstale":"2024-05-20T18:02:53.420992+0000","last_undegraded":"2024-05-20T18:02:53.420992+0000","last_fullsized":"2024-05-20T18:02:53.420992+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:05:11.661698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.404196+0000","last_change":"2024-05-20T18:02:52.414960+0000","last_active":"2024-05-20T18:02:53.404196+0000","last_peered":"2024-05-20T18:02:53.404196+0000","last_clean":"2024-05-20T18:02:53.404196+0000","last_became_active":"2024-05-20T18:02:52.414654+0000","last_became_peered":"2024-05-20T18:02:52.414654+0000","last_unstale":"2024-05-20T18:02:53.404196+0000","last_undegraded":"2024-05-20T18:02:53.404196+0000","last_fullsized":"2024-05-20T18:02:53.404196+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:09:38.380785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":403,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.410528+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:02:53.410528+0000","last_peered":"2024-05-20T18:02:53.410528+0000","last_clean":"2024-05-20T18:02:53.410528+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:02:53.410528+0000","last_undegraded":"2024-05-20T18:02:53.410528+0000","last_fullsized":"2024-05-20T18:02:53.410528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33560,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338280,"statfs":{"total":96636764160,"available":96602398720,"internally_reserved":0,"allocated":2433024,"data_stored":1441984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37156,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334684,"statfs":{"total":96636764160,"available":96598716416,"internally_reserved":0,"allocated":1851392,"data_stored":858783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1855488,"data_stored":858817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37172,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334668,"statfs":{"total":96636764160,"available":96598700032,"internally_reserved":0,"allocated":1867776,"data_stored":859547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1839104,"data_stored":851616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1839104,"data_stored":851616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1863680,"data_stored":860395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33584,"kb_used_data":2396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338256,"statfs":{"total":96636764160,"available":96602374144,"internally_reserved":0,"allocated":2453504,"data_stored":1449255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:02:57.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:02:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.641+0000 7fb87d6e9640 1 Processor -- start 2024-05-20T18:02:57.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.641+0000 7fb87d6e9640 1 -- start start 2024-05-20T18:02:57.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb87d6e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8780b6620 0x7fb8780ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb87d6e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8780b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb87d6e9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8781634a0 con 0x7fb8780b85b0 2024-05-20T18:02:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb87d6e9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb8780d3480 con 0x7fb8780b6620 2024-05-20T18:02:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb87d6e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb878163780 con 0x7fb878162ce0 2024-05-20T18:02:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb876ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8780b6620 0x7fb8780ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb876ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8780b6620 0x7fb8780ba3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47162/0 (socket says 172.21.15.6:47162) 2024-05-20T18:02:57.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb876ffd640 1 -- 172.21.15.6:0/4218559879 learned_addr learned my addr 172.21.15.6:0/4218559879 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.642+0000 7fb8767fc640 1 --2- 172.21.15.6:0/4218559879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8780b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.643+0000 7fb876ffd640 1 -- 172.21.15.6:0/4218559879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 msgr2=0x7fb8780b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.643+0000 7fb876ffd640 1 --2- 172.21.15.6:0/4218559879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8780b8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.643+0000 7fb876ffd640 1 -- 172.21.15.6:0/4218559879 >> v1:172.21.15.171:6789/0 conn(0x7fb8780b85b0 legacy=0x7fb8780d3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.643+0000 7fb876ffd640 1 -- 172.21.15.6:0/4218559879 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb878163a60 con 0x7fb8780b6620 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.643+0000 7fb876ffd640 1 --2- 172.21.15.6:0/4218559879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780ba3c0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fb868009870 tx=0x7fb86802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69298a96a7f25e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.643+0000 7fb875ffb640 1 -- 172.21.15.6:0/4218559879 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868037070 con 0x7fb8780b6620 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb875ffb640 1 -- 172.21.15.6:0/4218559879 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb868032440 con 0x7fb8780b6620 2024-05-20T18:02:57.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb875ffb640 1 -- 172.21.15.6:0/4218559879 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868032810 con 0x7fb8780b6620 2024-05-20T18:02:57.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4218559879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 msgr2=0x7fb8780ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4218559879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780ba3c0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fb868009870 tx=0x7fb86802a210 comp rx=0 tx=0).stop 2024-05-20T18:02:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4218559879 shutdown_connections 2024-05-20T18:02:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4218559879 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8780b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4218559879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780ba3c0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4218559879 >> 172.21.15.6:0/4218559879 conn(0x7fb87806d240 msgr2=0x7fb87806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:57.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4218559879 shutdown_connections 2024-05-20T18:02:57.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.644+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4218559879 wait complete. 2024-05-20T18:02:57.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.646+0000 7fb87d6e9640 1 Processor -- start 2024-05-20T18:02:57.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.646+0000 7fb87d6e9640 1 -- start start 2024-05-20T18:02:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.647+0000 7fb87d6e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb87d6e9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8780b85b0 0x7fb878153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb87d6e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8781f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb87d6e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781630f0 con 0x7fb8780b6620 2024-05-20T18:02:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb87d6e9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8780d4300 con 0x7fb8780b85b0 2024-05-20T18:02:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb87d6e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb8780cb340 con 0x7fb878162ce0 2024-05-20T18:02:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47172/0 (socket says 172.21.15.6:47172) 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 -- 172.21.15.6:0/4282819312 learned_addr learned my addr 172.21.15.6:0/4282819312 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb8777fe640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8781f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb8767fc640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8780b85b0 0x7fb878153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 -- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 msgr2=0x7fb8781f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8781f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 -- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8780b85b0 msgr2=0x7fb878153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8780b85b0 0x7fb878153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 -- 172.21.15.6:0/4282819312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8781535d0 con 0x7fb8780b6620 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb8767fc640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8780b85b0 0x7fb878153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb8777fe640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8781f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb876ffd640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780cae00 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fb86802a250 tx=0x7fb8680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb85f7fe640 1 -- 172.21.15.6:0/4282819312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868037040 con 0x7fb8780b6620 2024-05-20T18:02:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb85f7fe640 1 -- 172.21.15.6:0/4282819312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb868042070 con 0x7fb8780b6620 2024-05-20T18:02:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8781f5ed0 con 0x7fb8780b6620 2024-05-20T18:02:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.648+0000 7fb85f7fe640 1 -- 172.21.15.6:0/4282819312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868030bd0 con 0x7fb8780b6620 2024-05-20T18:02:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.649+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8780ab560 con 0x7fb8780b6620 2024-05-20T18:02:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.649+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb878075b00 con 0x7fb8780b6620 2024-05-20T18:02:57.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.650+0000 7fb85f7fe640 1 -- 172.21.15.6:0/4282819312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb868047460 con 0x7fb8780b6620 2024-05-20T18:02:57.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.650+0000 7fb85f7fe640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb86406be60 0x7fb86406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:57.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.651+0000 7fb85f7fe640 1 -- 172.21.15.6:0/4282819312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fb8680abc30 con 0x7fb8780b6620 2024-05-20T18:02:57.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.651+0000 7fb8767fc640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb86406be60 0x7fb86406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:57.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.651+0000 7fb8767fc640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb86406be60 0x7fb86406e370 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb878160140 tx=0x7fb86c0075b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.655+0000 7fb85f7fe640 1 -- 172.21.15.6:0/4282819312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb86807a450 con 0x7fb8780b6620 2024-05-20T18:02:57.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.835+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8780d2fa0 con 0x7fb86406be60 2024-05-20T18:02:57.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.842+0000 7fb85f7fe640 1 -- 172.21.15.6:0/4282819312 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252410 (secure 0 0 0) 0x7fb8780d2fa0 con 0x7fb86406be60 2024-05-20T18:02:57.842 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:57.843 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:02:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb86406be60 msgr2=0x7fb86406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb86406be60 0x7fb86406e370 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb878160140 tx=0x7fb86c0075b0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 msgr2=0x7fb8780cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780cae00 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fb86802a250 tx=0x7fb8680046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 shutdown_connections 2024-05-20T18:02:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb86406be60 0x7fb86406e370 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb878162ce0 0x7fb8781f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8780b85b0 0x7fb878153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 --2- 172.21.15.6:0/4282819312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8780b6620 0x7fb8780cae00 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 >> 172.21.15.6:0/4282819312 conn(0x7fb87806d240 msgr2=0x7fb878161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 shutdown_connections 2024-05-20T18:02:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:57.845+0000 7fb87d6e9640 1 -- 172.21.15.6:0/4282819312 wait complete. 2024-05-20T18:02:57.855 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-05-20T18:02:56.385531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273424,"kb_used_data":15628,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701296,"statfs":{"total":773094113280,"available":772814127104,"internally_reserved":0,"allocated":16003072,"data_stored":8032013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.997582"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.419498+0000","last_change":"2024-05-20T18:02:53.416483+0000","last_active":"2024-05-20T18:02:53.419498+0000","last_peered":"2024-05-20T18:02:53.419498+0000","last_clean":"2024-05-20T18:02:53.419498+0000","last_became_active":"2024-05-20T18:02:53.416164+0000","last_became_peered":"2024-05-20T18:02:53.416164+0000","last_unstale":"2024-05-20T18:02:53.419498+0000","last_undegraded":"2024-05-20T18:02:53.419498+0000","last_fullsized":"2024-05-20T18:02:53.419498+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:49:28.845834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.420267+0000","last_change":"2024-05-20T18:02:53.419122+0000","last_active":"2024-05-20T18:02:53.420267+0000","last_peered":"2024-05-20T18:02:53.420267+0000","last_clean":"2024-05-20T18:02:53.420267+0000","last_became_active":"2024-05-20T18:02:53.418792+0000","last_became_peered":"2024-05-20T18:02:53.418792+0000","last_unstale":"2024-05-20T18:02:53.420267+0000","last_undegraded":"2024-05-20T18:02:53.420267+0000","last_fullsized":"2024-05-20T18:02:53.420267+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:25:34.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422760+0000","last_change":"2024-05-20T18:02:53.418784+0000","last_active":"2024-05-20T18:02:53.422760+0000","last_peered":"2024-05-20T18:02:53.422760+0000","last_clean":"2024-05-20T18:02:53.422760+0000","last_became_active":"2024-05-20T18:02:53.418465+0000","last_became_peered":"2024-05-20T18:02:53.418465+0000","last_unstale":"2024-05-20T18:02:53.422760+0000","last_undegraded":"2024-05-20T18:02:53.422760+0000","last_fullsized":"2024-05-20T18:02:53.422760+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:00.861776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.417276+0000","last_change":"2024-05-20T18:02:53.412594+0000","last_active":"2024-05-20T18:02:53.417276+0000","last_peered":"2024-05-20T18:02:53.417276+0000","last_clean":"2024-05-20T18:02:53.417276+0000","last_became_active":"2024-05-20T18:02:53.412283+0000","last_became_peered":"2024-05-20T18:02:53.412283+0000","last_unstale":"2024-05-20T18:02:53.417276+0000","last_undegraded":"2024-05-20T18:02:53.417276+0000","last_fullsized":"2024-05-20T18:02:53.417276+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:46:31.314611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429513+0000","last_change":"2024-05-20T18:02:53.421430+0000","last_active":"2024-05-20T18:02:53.429513+0000","last_peered":"2024-05-20T18:02:53.429513+0000","last_clean":"2024-05-20T18:02:53.429513+0000","last_became_active":"2024-05-20T18:02:53.420333+0000","last_became_peered":"2024-05-20T18:02:53.420333+0000","last_unstale":"2024-05-20T18:02:53.429513+0000","last_undegraded":"2024-05-20T18:02:53.429513+0000","last_fullsized":"2024-05-20T18:02:53.429513+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:57:20.271746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.425318+0000","last_change":"2024-05-20T18:02:53.421765+0000","last_active":"2024-05-20T18:02:53.425318+0000","last_peered":"2024-05-20T18:02:53.425318+0000","last_clean":"2024-05-20T18:02:53.425318+0000","last_became_active":"2024-05-20T18:02:53.421341+0000","last_became_peered":"2024-05-20T18:02:53.421341+0000","last_unstale":"2024-05-20T18:02:53.425318+0000","last_undegraded":"2024-05-20T18:02:53.425318+0000","last_fullsized":"2024-05-20T18:02:53.425318+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:43:35.011589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.431538+0000","last_change":"2024-05-20T18:02:53.422729+0000","last_active":"2024-05-20T18:02:53.431538+0000","last_peered":"2024-05-20T18:02:53.431538+0000","last_clean":"2024-05-20T18:02:53.431538+0000","last_became_active":"2024-05-20T18:02:53.422217+0000","last_became_peered":"2024-05-20T18:02:53.422217+0000","last_unstale":"2024-05-20T18:02:53.431538+0000","last_undegraded":"2024-05-20T18:02:53.431538+0000","last_fullsized":"2024-05-20T18:02:53.431538+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:19:09.280475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434017+0000","last_change":"2024-05-20T18:02:53.425742+0000","last_active":"2024-05-20T18:02:53.434017+0000","last_peered":"2024-05-20T18:02:53.434017+0000","last_clean":"2024-05-20T18:02:53.434017+0000","last_became_active":"2024-05-20T18:02:53.425220+0000","last_became_peered":"2024-05-20T18:02:53.425220+0000","last_unstale":"2024-05-20T18:02:53.434017+0000","last_undegraded":"2024-05-20T18:02:53.434017+0000","last_fullsized":"2024-05-20T18:02:53.434017+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:32.569732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.430448+0000","last_change":"2024-05-20T18:02:53.423386+0000","last_active":"2024-05-20T18:02:53.430448+0000","last_peered":"2024-05-20T18:02:53.430448+0000","last_clean":"2024-05-20T18:02:53.430448+0000","last_became_active":"2024-05-20T18:02:53.422991+0000","last_became_peered":"2024-05-20T18:02:53.422991+0000","last_unstale":"2024-05-20T18:02:53.430448+0000","last_undegraded":"2024-05-20T18:02:53.430448+0000","last_fullsized":"2024-05-20T18:02:53.430448+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:34.476650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422971+0000","last_change":"2024-05-20T18:02:53.418017+0000","last_active":"2024-05-20T18:02:53.422971+0000","last_peered":"2024-05-20T18:02:53.422971+0000","last_clean":"2024-05-20T18:02:53.422971+0000","last_became_active":"2024-05-20T18:02:53.417704+0000","last_became_peered":"2024-05-20T18:02:53.417704+0000","last_unstale":"2024-05-20T18:02:53.422971+0000","last_undegraded":"2024-05-20T18:02:53.422971+0000","last_fullsized":"2024-05-20T18:02:53.422971+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:40:07.593172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.413045+0000","last_change":"2024-05-20T18:02:53.410631+0000","last_active":"2024-05-20T18:02:53.413045+0000","last_peered":"2024-05-20T18:02:53.413045+0000","last_clean":"2024-05-20T18:02:53.413045+0000","last_became_active":"2024-05-20T18:02:53.410308+0000","last_became_peered":"2024-05-20T18:02:53.410308+0000","last_unstale":"2024-05-20T18:02:53.413045+0000","last_undegraded":"2024-05-20T18:02:53.413045+0000","last_fullsized":"2024-05-20T18:02:53.413045+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:32:39.020851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.424943+0000","last_change":"2024-05-20T18:02:53.422253+0000","last_active":"2024-05-20T18:02:53.424943+0000","last_peered":"2024-05-20T18:02:53.424943+0000","last_clean":"2024-05-20T18:02:53.424943+0000","last_became_active":"2024-05-20T18:02:53.421006+0000","last_became_peered":"2024-05-20T18:02:53.421006+0000","last_unstale":"2024-05-20T18:02:53.424943+0000","last_undegraded":"2024-05-20T18:02:53.424943+0000","last_fullsized":"2024-05-20T18:02:53.424943+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:20.881593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434981+0000","last_change":"2024-05-20T18:02:53.432687+0000","last_active":"2024-05-20T18:02:53.434981+0000","last_peered":"2024-05-20T18:02:53.434981+0000","last_clean":"2024-05-20T18:02:53.434981+0000","last_became_active":"2024-05-20T18:02:53.432254+0000","last_became_peered":"2024-05-20T18:02:53.432254+0000","last_unstale":"2024-05-20T18:02:53.434981+0000","last_undegraded":"2024-05-20T18:02:53.434981+0000","last_fullsized":"2024-05-20T18:02:53.434981+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:56.518408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429349+0000","last_change":"2024-05-20T18:02:53.423257+0000","last_active":"2024-05-20T18:02:53.429349+0000","last_peered":"2024-05-20T18:02:53.429349+0000","last_clean":"2024-05-20T18:02:53.429349+0000","last_became_active":"2024-05-20T18:02:53.422924+0000","last_became_peered":"2024-05-20T18:02:53.422924+0000","last_unstale":"2024-05-20T18:02:53.429349+0000","last_undegraded":"2024-05-20T18:02:53.429349+0000","last_fullsized":"2024-05-20T18:02:53.429349+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:37:36.080606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.426650+0000","last_change":"2024-05-20T18:02:53.425968+0000","last_active":"2024-05-20T18:02:53.426650+0000","last_peered":"2024-05-20T18:02:53.426650+0000","last_clean":"2024-05-20T18:02:53.426650+0000","last_became_active":"2024-05-20T18:02:53.425641+0000","last_became_peered":"2024-05-20T18:02:53.425641+0000","last_unstale":"2024-05-20T18:02:53.426650+0000","last_undegraded":"2024-05-20T18:02:53.426650+0000","last_fullsized":"2024-05-20T18:02:53.426650+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:47:14.195208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441898+0000","last_change":"2024-05-20T18:02:53.436842+0000","last_active":"2024-05-20T18:02:53.441898+0000","last_peered":"2024-05-20T18:02:53.441898+0000","last_clean":"2024-05-20T18:02:53.441898+0000","last_became_active":"2024-05-20T18:02:53.436506+0000","last_became_peered":"2024-05-20T18:02:53.436506+0000","last_unstale":"2024-05-20T18:02:53.441898+0000","last_undegraded":"2024-05-20T18:02:53.441898+0000","last_fullsized":"2024-05-20T18:02:53.441898+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:33:07.155998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.421545+0000","last_change":"2024-05-20T18:02:53.410553+0000","last_active":"2024-05-20T18:02:53.421545+0000","last_peered":"2024-05-20T18:02:53.421545+0000","last_clean":"2024-05-20T18:02:53.421545+0000","last_became_active":"2024-05-20T18:02:53.410189+0000","last_became_peered":"2024-05-20T18:02:53.410189+0000","last_unstale":"2024-05-20T18:02:53.421545+0000","last_undegraded":"2024-05-20T18:02:53.421545+0000","last_fullsized":"2024-05-20T18:02:53.421545+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:31.160538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.432656+0000","last_change":"2024-05-20T18:02:53.429982+0000","last_active":"2024-05-20T18:02:53.432656+0000","last_peered":"2024-05-20T18:02:53.432656+0000","last_clean":"2024-05-20T18:02:53.432656+0000","last_became_active":"2024-05-20T18:02:53.429638+0000","last_became_peered":"2024-05-20T18:02:53.429638+0000","last_unstale":"2024-05-20T18:02:53.432656+0000","last_undegraded":"2024-05-20T18:02:53.432656+0000","last_fullsized":"2024-05-20T18:02:53.432656+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:36:56.326919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.423439+0000","last_change":"2024-05-20T18:02:53.422717+0000","last_active":"2024-05-20T18:02:53.423439+0000","last_peered":"2024-05-20T18:02:53.423439+0000","last_clean":"2024-05-20T18:02:53.423439+0000","last_became_active":"2024-05-20T18:02:53.422398+0000","last_became_peered":"2024-05-20T18:02:53.422398+0000","last_unstale":"2024-05-20T18:02:53.423439+0000","last_undegraded":"2024-05-20T18:02:53.423439+0000","last_fullsized":"2024-05-20T18:02:53.423439+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:38:15.146363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.436341+0000","last_change":"2024-05-20T18:02:53.431617+0000","last_active":"2024-05-20T18:02:53.436341+0000","last_peered":"2024-05-20T18:02:53.436341+0000","last_clean":"2024-05-20T18:02:53.436341+0000","last_became_active":"2024-05-20T18:02:53.431318+0000","last_became_peered":"2024-05-20T18:02:53.431318+0000","last_unstale":"2024-05-20T18:02:53.436341+0000","last_undegraded":"2024-05-20T18:02:53.436341+0000","last_fullsized":"2024-05-20T18:02:53.436341+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:35:42.204644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.438280+0000","last_change":"2024-05-20T18:02:53.433219+0000","last_active":"2024-05-20T18:02:53.438280+0000","last_peered":"2024-05-20T18:02:53.438280+0000","last_clean":"2024-05-20T18:02:53.438280+0000","last_became_active":"2024-05-20T18:02:53.432868+0000","last_became_peered":"2024-05-20T18:02:53.432868+0000","last_unstale":"2024-05-20T18:02:53.438280+0000","last_undegraded":"2024-05-20T18:02:53.438280+0000","last_fullsized":"2024-05-20T18:02:53.438280+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:24:54.657040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422513+0000","last_change":"2024-05-20T18:02:53.420618+0000","last_active":"2024-05-20T18:02:53.422513+0000","last_peered":"2024-05-20T18:02:53.422513+0000","last_clean":"2024-05-20T18:02:53.422513+0000","last_became_active":"2024-05-20T18:02:53.420257+0000","last_became_peered":"2024-05-20T18:02:53.420257+0000","last_unstale":"2024-05-20T18:02:53.422513+0000","last_undegraded":"2024-05-20T18:02:53.422513+0000","last_fullsized":"2024-05-20T18:02:53.422513+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:40:07.593172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.428472+0000","last_change":"2024-05-20T18:02:53.416091+0000","last_active":"2024-05-20T18:02:53.428472+0000","last_peered":"2024-05-20T18:02:53.428472+0000","last_clean":"2024-05-20T18:02:53.428472+0000","last_became_active":"2024-05-20T18:02:53.415757+0000","last_became_peered":"2024-05-20T18:02:53.415757+0000","last_unstale":"2024-05-20T18:02:53.428472+0000","last_undegraded":"2024-05-20T18:02:53.428472+0000","last_fullsized":"2024-05-20T18:02:53.428472+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:38:23.759106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.414198+0000","last_change":"2024-05-20T18:02:53.411824+0000","last_active":"2024-05-20T18:02:53.414198+0000","last_peered":"2024-05-20T18:02:53.414198+0000","last_clean":"2024-05-20T18:02:53.414198+0000","last_became_active":"2024-05-20T18:02:53.411503+0000","last_became_peered":"2024-05-20T18:02:53.411503+0000","last_unstale":"2024-05-20T18:02:53.414198+0000","last_undegraded":"2024-05-20T18:02:53.414198+0000","last_fullsized":"2024-05-20T18:02:53.414198+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:40.089264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434938+0000","last_change":"2024-05-20T18:02:53.432670+0000","last_active":"2024-05-20T18:02:53.434938+0000","last_peered":"2024-05-20T18:02:53.434938+0000","last_clean":"2024-05-20T18:02:53.434938+0000","last_became_active":"2024-05-20T18:02:53.432328+0000","last_became_peered":"2024-05-20T18:02:53.432328+0000","last_unstale":"2024-05-20T18:02:53.434938+0000","last_undegraded":"2024-05-20T18:02:53.434938+0000","last_fullsized":"2024-05-20T18:02:53.434938+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:19:15.767572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.428078+0000","last_change":"2024-05-20T18:02:53.423897+0000","last_active":"2024-05-20T18:02:53.428078+0000","last_peered":"2024-05-20T18:02:53.428078+0000","last_clean":"2024-05-20T18:02:53.428078+0000","last_became_active":"2024-05-20T18:02:53.423079+0000","last_became_peered":"2024-05-20T18:02:53.423079+0000","last_unstale":"2024-05-20T18:02:53.428078+0000","last_undegraded":"2024-05-20T18:02:53.428078+0000","last_fullsized":"2024-05-20T18:02:53.428078+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:06:58.143039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.420596+0000","last_change":"2024-05-20T18:02:53.418630+0000","last_active":"2024-05-20T18:02:53.420596+0000","last_peered":"2024-05-20T18:02:53.420596+0000","last_clean":"2024-05-20T18:02:53.420596+0000","last_became_active":"2024-05-20T18:02:53.418323+0000","last_became_peered":"2024-05-20T18:02:53.418323+0000","last_unstale":"2024-05-20T18:02:53.420596+0000","last_undegraded":"2024-05-20T18:02:53.420596+0000","last_fullsized":"2024-05-20T18:02:53.420596+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:14.795475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.435403+0000","last_change":"2024-05-20T18:02:53.427408+0000","last_active":"2024-05-20T18:02:53.435403+0000","last_peered":"2024-05-20T18:02:53.435403+0000","last_clean":"2024-05-20T18:02:53.435403+0000","last_became_active":"2024-05-20T18:02:53.427042+0000","last_became_peered":"2024-05-20T18:02:53.427042+0000","last_unstale":"2024-05-20T18:02:53.435403+0000","last_undegraded":"2024-05-20T18:02:53.435403+0000","last_fullsized":"2024-05-20T18:02:53.435403+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:45:37.243981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.433019+0000","last_change":"2024-05-20T18:02:53.432459+0000","last_active":"2024-05-20T18:02:53.433019+0000","last_peered":"2024-05-20T18:02:53.433019+0000","last_clean":"2024-05-20T18:02:53.433019+0000","last_became_active":"2024-05-20T18:02:53.432090+0000","last_became_peered":"2024-05-20T18:02:53.432090+0000","last_unstale":"2024-05-20T18:02:53.433019+0000","last_undegraded":"2024-05-20T18:02:53.433019+0000","last_fullsized":"2024-05-20T18:02:53.433019+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:34.476650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.427314+0000","last_change":"2024-05-20T18:02:53.425144+0000","last_active":"2024-05-20T18:02:53.427314+0000","last_peered":"2024-05-20T18:02:53.427314+0000","last_clean":"2024-05-20T18:02:53.427314+0000","last_became_active":"2024-05-20T18:02:53.424830+0000","last_became_peered":"2024-05-20T18:02:53.424830+0000","last_unstale":"2024-05-20T18:02:53.427314+0000","last_undegraded":"2024-05-20T18:02:53.427314+0000","last_fullsized":"2024-05-20T18:02:53.427314+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:30.330170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.416139+0000","last_change":"2024-05-20T18:02:53.413591+0000","last_active":"2024-05-20T18:02:53.416139+0000","last_peered":"2024-05-20T18:02:53.416139+0000","last_clean":"2024-05-20T18:02:53.416139+0000","last_became_active":"2024-05-20T18:02:53.413265+0000","last_became_peered":"2024-05-20T18:02:53.413265+0000","last_unstale":"2024-05-20T18:02:53.416139+0000","last_undegraded":"2024-05-20T18:02:53.416139+0000","last_fullsized":"2024-05-20T18:02:53.416139+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:57.389854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.424749+0000","last_change":"2024-05-20T18:02:53.421746+0000","last_active":"2024-05-20T18:02:53.424749+0000","last_peered":"2024-05-20T18:02:53.424749+0000","last_clean":"2024-05-20T18:02:53.424749+0000","last_became_active":"2024-05-20T18:02:53.421436+0000","last_became_peered":"2024-05-20T18:02:53.421436+0000","last_unstale":"2024-05-20T18:02:53.424749+0000","last_undegraded":"2024-05-20T18:02:53.424749+0000","last_fullsized":"2024-05-20T18:02:53.424749+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:35.043785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441900+0000","last_change":"2024-05-20T18:02:53.437018+0000","last_active":"2024-05-20T18:02:53.441900+0000","last_peered":"2024-05-20T18:02:53.441900+0000","last_clean":"2024-05-20T18:02:53.441900+0000","last_became_active":"2024-05-20T18:02:53.436432+0000","last_became_peered":"2024-05-20T18:02:53.436432+0000","last_unstale":"2024-05-20T18:02:53.441900+0000","last_undegraded":"2024-05-20T18:02:53.441900+0000","last_fullsized":"2024-05-20T18:02:53.441900+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:38:23.759106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"147'4","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441613+0000","last_change":"2024-05-20T18:02:52.406029+0000","last_active":"2024-05-20T18:02:53.441613+0000","last_peered":"2024-05-20T18:02:53.441613+0000","last_clean":"2024-05-20T18:02:53.441613+0000","last_became_active":"2024-05-20T18:02:52.405714+0000","last_became_peered":"2024-05-20T18:02:52.405714+0000","last_unstale":"2024-05-20T18:02:53.441613+0000","last_undegraded":"2024-05-20T18:02:53.441613+0000","last_fullsized":"2024-05-20T18:02:53.441613+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:24:40.306068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.431780+0000","last_change":"2024-05-20T18:02:53.415020+0000","last_active":"2024-05-20T18:02:53.431780+0000","last_peered":"2024-05-20T18:02:53.431780+0000","last_clean":"2024-05-20T18:02:53.431780+0000","last_became_active":"2024-05-20T18:02:53.414689+0000","last_became_peered":"2024-05-20T18:02:53.414689+0000","last_unstale":"2024-05-20T18:02:53.431780+0000","last_undegraded":"2024-05-20T18:02:53.431780+0000","last_fullsized":"2024-05-20T18:02:53.431780+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:32:58.298508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429710+0000","last_change":"2024-05-20T18:02:52.419169+0000","last_active":"2024-05-20T18:02:53.429710+0000","last_peered":"2024-05-20T18:02:53.429710+0000","last_clean":"2024-05-20T18:02:53.429710+0000","last_became_active":"2024-05-20T18:02:52.418437+0000","last_became_peered":"2024-05-20T18:02:52.418437+0000","last_unstale":"2024-05-20T18:02:53.429710+0000","last_undegraded":"2024-05-20T18:02:53.429710+0000","last_fullsized":"2024-05-20T18:02:53.429710+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:57.199293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429322+0000","last_change":"2024-05-20T18:02:53.422743+0000","last_active":"2024-05-20T18:02:53.429322+0000","last_peered":"2024-05-20T18:02:53.429322+0000","last_clean":"2024-05-20T18:02:53.429322+0000","last_became_active":"2024-05-20T18:02:53.422369+0000","last_became_peered":"2024-05-20T18:02:53.422369+0000","last_unstale":"2024-05-20T18:02:53.429322+0000","last_undegraded":"2024-05-20T18:02:53.429322+0000","last_fullsized":"2024-05-20T18:02:53.429322+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:24:37.132713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434459+0000","last_change":"2024-05-20T18:02:52.410536+0000","last_active":"2024-05-20T18:02:53.434459+0000","last_peered":"2024-05-20T18:02:53.434459+0000","last_clean":"2024-05-20T18:02:53.434459+0000","last_became_active":"2024-05-20T18:02:52.410221+0000","last_became_peered":"2024-05-20T18:02:52.410221+0000","last_unstale":"2024-05-20T18:02:53.434459+0000","last_undegraded":"2024-05-20T18:02:53.434459+0000","last_fullsized":"2024-05-20T18:02:53.434459+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:36:55.320839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.439095+0000","last_change":"2024-05-20T18:02:53.436149+0000","last_active":"2024-05-20T18:02:53.439095+0000","last_peered":"2024-05-20T18:02:53.439095+0000","last_clean":"2024-05-20T18:02:53.439095+0000","last_became_active":"2024-05-20T18:02:53.435735+0000","last_became_peered":"2024-05-20T18:02:53.435735+0000","last_unstale":"2024-05-20T18:02:53.439095+0000","last_undegraded":"2024-05-20T18:02:53.439095+0000","last_fullsized":"2024-05-20T18:02:53.439095+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:32.569732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.432670+0000","last_change":"2024-05-20T18:02:52.410389+0000","last_active":"2024-05-20T18:02:53.432670+0000","last_peered":"2024-05-20T18:02:53.432670+0000","last_clean":"2024-05-20T18:02:53.432670+0000","last_became_active":"2024-05-20T18:02:52.410018+0000","last_became_peered":"2024-05-20T18:02:52.410018+0000","last_unstale":"2024-05-20T18:02:53.432670+0000","last_undegraded":"2024-05-20T18:02:53.432670+0000","last_fullsized":"2024-05-20T18:02:53.432670+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:40:37.999406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422856+0000","last_change":"2024-05-20T18:02:53.418062+0000","last_active":"2024-05-20T18:02:53.422856+0000","last_peered":"2024-05-20T18:02:53.422856+0000","last_clean":"2024-05-20T18:02:53.422856+0000","last_became_active":"2024-05-20T18:02:53.417765+0000","last_became_peered":"2024-05-20T18:02:53.417765+0000","last_unstale":"2024-05-20T18:02:53.422856+0000","last_undegraded":"2024-05-20T18:02:53.422856+0000","last_fullsized":"2024-05-20T18:02:53.422856+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:43:35.011589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.433808+0000","last_change":"2024-05-20T18:02:52.421940+0000","last_active":"2024-05-20T18:02:53.433808+0000","last_peered":"2024-05-20T18:02:53.433808+0000","last_clean":"2024-05-20T18:02:53.433808+0000","last_became_active":"2024-05-20T18:02:52.421617+0000","last_became_peered":"2024-05-20T18:02:52.421617+0000","last_unstale":"2024-05-20T18:02:53.433808+0000","last_undegraded":"2024-05-20T18:02:53.433808+0000","last_fullsized":"2024-05-20T18:02:53.433808+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:48.438358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.440932+0000","last_change":"2024-05-20T18:02:53.436046+0000","last_active":"2024-05-20T18:02:53.440932+0000","last_peered":"2024-05-20T18:02:53.440932+0000","last_clean":"2024-05-20T18:02:53.440932+0000","last_became_active":"2024-05-20T18:02:53.435718+0000","last_became_peered":"2024-05-20T18:02:53.435718+0000","last_unstale":"2024-05-20T18:02:53.440932+0000","last_undegraded":"2024-05-20T18:02:53.440932+0000","last_fullsized":"2024-05-20T18:02:53.440932+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:28.401124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441156+0000","last_change":"2024-05-20T18:02:52.422134+0000","last_active":"2024-05-20T18:02:53.441156+0000","last_peered":"2024-05-20T18:02:53.441156+0000","last_clean":"2024-05-20T18:02:53.441156+0000","last_became_active":"2024-05-20T18:02:52.421603+0000","last_became_peered":"2024-05-20T18:02:52.421603+0000","last_unstale":"2024-05-20T18:02:53.441156+0000","last_undegraded":"2024-05-20T18:02:53.441156+0000","last_fullsized":"2024-05-20T18:02:53.441156+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:43:34.005509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.428181+0000","last_change":"2024-05-20T18:02:53.424716+0000","last_active":"2024-05-20T18:02:53.428181+0000","last_peered":"2024-05-20T18:02:53.428181+0000","last_clean":"2024-05-20T18:02:53.428181+0000","last_became_active":"2024-05-20T18:02:53.423549+0000","last_became_peered":"2024-05-20T18:02:53.423549+0000","last_unstale":"2024-05-20T18:02:53.428181+0000","last_undegraded":"2024-05-20T18:02:53.428181+0000","last_fullsized":"2024-05-20T18:02:53.428181+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:11:31.636197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.414461+0000","last_change":"2024-05-20T18:02:52.417787+0000","last_active":"2024-05-20T18:02:53.414461+0000","last_peered":"2024-05-20T18:02:53.414461+0000","last_clean":"2024-05-20T18:02:53.414461+0000","last_became_active":"2024-05-20T18:02:52.417462+0000","last_became_peered":"2024-05-20T18:02:52.417462+0000","last_unstale":"2024-05-20T18:02:53.414461+0000","last_undegraded":"2024-05-20T18:02:53.414461+0000","last_fullsized":"2024-05-20T18:02:53.414461+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:27:49.821860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.409986+0000","last_change":"2024-05-20T18:02:53.406552+0000","last_active":"2024-05-20T18:02:53.409986+0000","last_peered":"2024-05-20T18:02:53.409986+0000","last_clean":"2024-05-20T18:02:53.409986+0000","last_became_active":"2024-05-20T18:02:53.405076+0000","last_became_peered":"2024-05-20T18:02:53.405076+0000","last_unstale":"2024-05-20T18:02:53.409986+0000","last_undegraded":"2024-05-20T18:02:53.409986+0000","last_fullsized":"2024-05-20T18:02:53.409986+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:46:41.669706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.400298+0000","last_change":"2024-05-20T18:02:52.412631+0000","last_active":"2024-05-20T18:02:53.400298+0000","last_peered":"2024-05-20T18:02:53.400298+0000","last_clean":"2024-05-20T18:02:53.400298+0000","last_became_active":"2024-05-20T18:02:52.412294+0000","last_became_peered":"2024-05-20T18:02:52.412294+0000","last_unstale":"2024-05-20T18:02:53.400298+0000","last_undegraded":"2024-05-20T18:02:53.400298+0000","last_fullsized":"2024-05-20T18:02:53.400298+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:38:14.140284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441876+0000","last_change":"2024-05-20T18:02:53.436158+0000","last_active":"2024-05-20T18:02:53.441876+0000","last_peered":"2024-05-20T18:02:53.441876+0000","last_clean":"2024-05-20T18:02:53.441876+0000","last_became_active":"2024-05-20T18:02:53.435825+0000","last_became_peered":"2024-05-20T18:02:53.435825+0000","last_unstale":"2024-05-20T18:02:53.441876+0000","last_undegraded":"2024-05-20T18:02:53.441876+0000","last_fullsized":"2024-05-20T18:02:53.441876+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:40:58.205373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.404517+0000","last_change":"2024-05-20T18:02:52.410321+0000","last_active":"2024-05-20T18:02:53.404517+0000","last_peered":"2024-05-20T18:02:53.404517+0000","last_clean":"2024-05-20T18:02:53.404517+0000","last_became_active":"2024-05-20T18:02:52.409475+0000","last_became_peered":"2024-05-20T18:02:52.409475+0000","last_unstale":"2024-05-20T18:02:53.404517+0000","last_undegraded":"2024-05-20T18:02:53.404517+0000","last_fullsized":"2024-05-20T18:02:53.404517+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:59.426597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434929+0000","last_change":"2024-05-20T18:02:53.430756+0000","last_active":"2024-05-20T18:02:53.434929+0000","last_peered":"2024-05-20T18:02:53.434929+0000","last_clean":"2024-05-20T18:02:53.434929+0000","last_became_active":"2024-05-20T18:02:53.430448+0000","last_became_peered":"2024-05-20T18:02:53.430448+0000","last_unstale":"2024-05-20T18:02:53.434929+0000","last_undegraded":"2024-05-20T18:02:53.434929+0000","last_fullsized":"2024-05-20T18:02:53.434929+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:04:36.994283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"147'3","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.430651+0000","last_change":"2024-05-20T18:02:52.405128+0000","last_active":"2024-05-20T18:02:53.430651+0000","last_peered":"2024-05-20T18:02:53.430651+0000","last_clean":"2024-05-20T18:02:53.430651+0000","last_became_active":"2024-05-20T18:02:52.404788+0000","last_became_peered":"2024-05-20T18:02:52.404788+0000","last_unstale":"2024-05-20T18:02:53.430651+0000","last_undegraded":"2024-05-20T18:02:53.430651+0000","last_fullsized":"2024-05-20T18:02:53.430651+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:05:03.069330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.433942+0000","last_change":"2024-05-20T18:02:53.430340+0000","last_active":"2024-05-20T18:02:53.433942+0000","last_peered":"2024-05-20T18:02:53.433942+0000","last_clean":"2024-05-20T18:02:53.433942+0000","last_became_active":"2024-05-20T18:02:53.430004+0000","last_became_peered":"2024-05-20T18:02:53.430004+0000","last_unstale":"2024-05-20T18:02:53.433942+0000","last_undegraded":"2024-05-20T18:02:53.433942+0000","last_fullsized":"2024-05-20T18:02:53.433942+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:14:17.937921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"147'6","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.441002+0000","last_change":"2024-05-20T18:02:52.414886+0000","last_active":"2024-05-20T18:02:53.441002+0000","last_peered":"2024-05-20T18:02:53.441002+0000","last_clean":"2024-05-20T18:02:53.441002+0000","last_became_active":"2024-05-20T18:02:52.414561+0000","last_became_peered":"2024-05-20T18:02:52.414561+0000","last_unstale":"2024-05-20T18:02:53.441002+0000","last_undegraded":"2024-05-20T18:02:53.441002+0000","last_fullsized":"2024-05-20T18:02:53.441002+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:35:09.177661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.419163+0000","last_change":"2024-05-20T18:02:53.417011+0000","last_active":"2024-05-20T18:02:53.419163+0000","last_peered":"2024-05-20T18:02:53.419163+0000","last_clean":"2024-05-20T18:02:53.419163+0000","last_became_active":"2024-05-20T18:02:53.416669+0000","last_became_peered":"2024-05-20T18:02:53.416669+0000","last_unstale":"2024-05-20T18:02:53.419163+0000","last_undegraded":"2024-05-20T18:02:53.419163+0000","last_fullsized":"2024-05-20T18:02:53.419163+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:33:07.155998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.423852+0000","last_change":"2024-05-20T18:02:52.418366+0000","last_active":"2024-05-20T18:02:53.423852+0000","last_peered":"2024-05-20T18:02:53.423852+0000","last_clean":"2024-05-20T18:02:53.423852+0000","last_became_active":"2024-05-20T18:02:52.417989+0000","last_became_peered":"2024-05-20T18:02:52.417989+0000","last_unstale":"2024-05-20T18:02:53.423852+0000","last_undegraded":"2024-05-20T18:02:53.423852+0000","last_fullsized":"2024-05-20T18:02:53.423852+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:19.875513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.430429+0000","last_change":"2024-05-20T18:02:53.422236+0000","last_active":"2024-05-20T18:02:53.430429+0000","last_peered":"2024-05-20T18:02:53.430429+0000","last_clean":"2024-05-20T18:02:53.430429+0000","last_became_active":"2024-05-20T18:02:53.421901+0000","last_became_peered":"2024-05-20T18:02:53.421901+0000","last_unstale":"2024-05-20T18:02:53.430429+0000","last_undegraded":"2024-05-20T18:02:53.430429+0000","last_fullsized":"2024-05-20T18:02:53.430429+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:16:20.881593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.405066+0000","last_change":"2024-05-20T18:02:52.412838+0000","last_active":"2024-05-20T18:02:53.405066+0000","last_peered":"2024-05-20T18:02:53.405066+0000","last_clean":"2024-05-20T18:02:53.405066+0000","last_became_active":"2024-05-20T18:02:52.412514+0000","last_became_peered":"2024-05-20T18:02:52.412514+0000","last_unstale":"2024-05-20T18:02:53.405066+0000","last_undegraded":"2024-05-20T18:02:53.405066+0000","last_fullsized":"2024-05-20T18:02:53.405066+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:26:23.472365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.416926+0000","last_change":"2024-05-20T18:02:53.414496+0000","last_active":"2024-05-20T18:02:53.416926+0000","last_peered":"2024-05-20T18:02:53.416926+0000","last_clean":"2024-05-20T18:02:53.416926+0000","last_became_active":"2024-05-20T18:02:53.413881+0000","last_became_peered":"2024-05-20T18:02:53.413881+0000","last_unstale":"2024-05-20T18:02:53.416926+0000","last_undegraded":"2024-05-20T18:02:53.416926+0000","last_fullsized":"2024-05-20T18:02:53.416926+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:50:49.444438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.402266+0000","last_change":"2024-05-20T18:02:52.419378+0000","last_active":"2024-05-20T18:02:53.402266+0000","last_peered":"2024-05-20T18:02:53.402266+0000","last_clean":"2024-05-20T18:02:53.402266+0000","last_became_active":"2024-05-20T18:02:52.419077+0000","last_became_peered":"2024-05-20T18:02:52.419077+0000","last_unstale":"2024-05-20T18:02:53.402266+0000","last_undegraded":"2024-05-20T18:02:53.402266+0000","last_fullsized":"2024-05-20T18:02:53.402266+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:33:06.149919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.425117+0000","last_change":"2024-05-20T18:02:53.420472+0000","last_active":"2024-05-20T18:02:53.425117+0000","last_peered":"2024-05-20T18:02:53.425117+0000","last_clean":"2024-05-20T18:02:53.425117+0000","last_became_active":"2024-05-20T18:02:53.420115+0000","last_became_peered":"2024-05-20T18:02:53.420115+0000","last_unstale":"2024-05-20T18:02:53.425117+0000","last_undegraded":"2024-05-20T18:02:53.425117+0000","last_fullsized":"2024-05-20T18:02:53.425117+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:45:34.941174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"147'8","reported_seq":20,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434087+0000","last_change":"2024-05-20T18:02:52.409736+0000","last_active":"2024-05-20T18:02:53.434087+0000","last_peered":"2024-05-20T18:02:53.434087+0000","last_clean":"2024-05-20T18:02:53.434087+0000","last_became_active":"2024-05-20T18:02:52.409410+0000","last_became_peered":"2024-05-20T18:02:52.409410+0000","last_unstale":"2024-05-20T18:02:53.434087+0000","last_undegraded":"2024-05-20T18:02:53.434087+0000","last_fullsized":"2024-05-20T18:02:53.434087+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:47:13.189129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.424594+0000","last_change":"2024-05-20T18:02:53.414599+0000","last_active":"2024-05-20T18:02:53.424594+0000","last_peered":"2024-05-20T18:02:53.424594+0000","last_clean":"2024-05-20T18:02:53.424594+0000","last_became_active":"2024-05-20T18:02:53.414294+0000","last_became_peered":"2024-05-20T18:02:53.414294+0000","last_unstale":"2024-05-20T18:02:53.424594+0000","last_undegraded":"2024-05-20T18:02:53.424594+0000","last_fullsized":"2024-05-20T18:02:53.424594+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:25:34.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.433481+0000","last_change":"2024-05-20T18:02:52.406125+0000","last_active":"2024-05-20T18:02:53.433481+0000","last_peered":"2024-05-20T18:02:53.433481+0000","last_clean":"2024-05-20T18:02:53.433481+0000","last_became_active":"2024-05-20T18:02:52.405752+0000","last_became_peered":"2024-05-20T18:02:52.405752+0000","last_unstale":"2024-05-20T18:02:53.433481+0000","last_undegraded":"2024-05-20T18:02:53.433481+0000","last_fullsized":"2024-05-20T18:02:53.433481+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:45:00.235260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.416214+0000","last_change":"2024-05-20T18:02:53.413182+0000","last_active":"2024-05-20T18:02:53.416214+0000","last_peered":"2024-05-20T18:02:53.416214+0000","last_clean":"2024-05-20T18:02:53.416214+0000","last_became_active":"2024-05-20T18:02:53.412852+0000","last_became_peered":"2024-05-20T18:02:53.412852+0000","last_unstale":"2024-05-20T18:02:53.416214+0000","last_undegraded":"2024-05-20T18:02:53.416214+0000","last_fullsized":"2024-05-20T18:02:53.416214+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:00.861776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.430358+0000","last_change":"2024-05-20T18:02:52.411544+0000","last_active":"2024-05-20T18:02:53.430358+0000","last_peered":"2024-05-20T18:02:53.430358+0000","last_clean":"2024-05-20T18:02:53.430358+0000","last_became_active":"2024-05-20T18:02:52.411144+0000","last_became_peered":"2024-05-20T18:02:52.411144+0000","last_unstale":"2024-05-20T18:02:53.430358+0000","last_undegraded":"2024-05-20T18:02:53.430358+0000","last_fullsized":"2024-05-20T18:02:53.430358+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:15:30.326643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.406216+0000","last_change":"2024-05-20T18:02:53.405275+0000","last_active":"2024-05-20T18:02:53.406216+0000","last_peered":"2024-05-20T18:02:53.406216+0000","last_clean":"2024-05-20T18:02:53.406216+0000","last_became_active":"2024-05-20T18:02:53.404902+0000","last_became_peered":"2024-05-20T18:02:53.404902+0000","last_unstale":"2024-05-20T18:02:53.406216+0000","last_undegraded":"2024-05-20T18:02:53.406216+0000","last_fullsized":"2024-05-20T18:02:53.406216+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:54:13.433062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"147'1","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429371+0000","last_change":"2024-05-20T18:02:52.415624+0000","last_active":"2024-05-20T18:02:53.429371+0000","last_peered":"2024-05-20T18:02:53.429371+0000","last_clean":"2024-05-20T18:02:53.429371+0000","last_became_active":"2024-05-20T18:02:52.415239+0000","last_became_peered":"2024-05-20T18:02:52.415239+0000","last_unstale":"2024-05-20T18:02:53.429371+0000","last_undegraded":"2024-05-20T18:02:53.429371+0000","last_fullsized":"2024-05-20T18:02:53.429371+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:18:31.563652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.412847+0000","last_change":"2024-05-20T18:02:53.411569+0000","last_active":"2024-05-20T18:02:53.412847+0000","last_peered":"2024-05-20T18:02:53.412847+0000","last_clean":"2024-05-20T18:02:53.412847+0000","last_became_active":"2024-05-20T18:02:53.411233+0000","last_became_peered":"2024-05-20T18:02:53.411233+0000","last_unstale":"2024-05-20T18:02:53.412847+0000","last_undegraded":"2024-05-20T18:02:53.412847+0000","last_fullsized":"2024-05-20T18:02:53.412847+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:05:58.839566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.401026+0000","last_change":"2024-05-20T18:02:52.419211+0000","last_active":"2024-05-20T18:02:53.401026+0000","last_peered":"2024-05-20T18:02:53.401026+0000","last_clean":"2024-05-20T18:02:53.401026+0000","last_became_active":"2024-05-20T18:02:52.418873+0000","last_became_peered":"2024-05-20T18:02:52.418873+0000","last_unstale":"2024-05-20T18:02:53.401026+0000","last_undegraded":"2024-05-20T18:02:53.401026+0000","last_fullsized":"2024-05-20T18:02:53.401026+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T00:47:36.392428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.432241+0000","last_change":"2024-05-20T18:02:53.426396+0000","last_active":"2024-05-20T18:02:53.432241+0000","last_peered":"2024-05-20T18:02:53.432241+0000","last_clean":"2024-05-20T18:02:53.432241+0000","last_became_active":"2024-05-20T18:02:53.425930+0000","last_became_peered":"2024-05-20T18:02:53.425930+0000","last_unstale":"2024-05-20T18:02:53.432241+0000","last_undegraded":"2024-05-20T18:02:53.432241+0000","last_fullsized":"2024-05-20T18:02:53.432241+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:01:47.237578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.428495+0000","last_change":"2024-05-20T18:02:52.419246+0000","last_active":"2024-05-20T18:02:53.428495+0000","last_peered":"2024-05-20T18:02:53.428495+0000","last_clean":"2024-05-20T18:02:53.428495+0000","last_became_active":"2024-05-20T18:02:52.418920+0000","last_became_peered":"2024-05-20T18:02:52.418920+0000","last_unstale":"2024-05-20T18:02:53.428495+0000","last_undegraded":"2024-05-20T18:02:53.428495+0000","last_fullsized":"2024-05-20T18:02:53.428495+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:19:08.274395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.429448+0000","last_change":"2024-05-20T18:02:53.423433+0000","last_active":"2024-05-20T18:02:53.429448+0000","last_peered":"2024-05-20T18:02:53.429448+0000","last_clean":"2024-05-20T18:02:53.429448+0000","last_became_active":"2024-05-20T18:02:53.423083+0000","last_became_peered":"2024-05-20T18:02:53.423083+0000","last_unstale":"2024-05-20T18:02:53.429448+0000","last_undegraded":"2024-05-20T18:02:53.429448+0000","last_fullsized":"2024-05-20T18:02:53.429448+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:56.730330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.402608+0000","last_change":"2024-05-20T18:02:52.409171+0000","last_active":"2024-05-20T18:02:53.402608+0000","last_peered":"2024-05-20T18:02:53.402608+0000","last_clean":"2024-05-20T18:02:53.402608+0000","last_became_active":"2024-05-20T18:02:52.408704+0000","last_became_peered":"2024-05-20T18:02:52.408704+0000","last_unstale":"2024-05-20T18:02:53.402608+0000","last_undegraded":"2024-05-20T18:02:53.402608+0000","last_fullsized":"2024-05-20T18:02:53.402608+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:15:29.324091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.435886+0000","last_change":"2024-05-20T18:02:53.429534+0000","last_active":"2024-05-20T18:02:53.435886+0000","last_peered":"2024-05-20T18:02:53.435886+0000","last_clean":"2024-05-20T18:02:53.435886+0000","last_became_active":"2024-05-20T18:02:53.429141+0000","last_became_peered":"2024-05-20T18:02:53.429141+0000","last_unstale":"2024-05-20T18:02:53.435886+0000","last_undegraded":"2024-05-20T18:02:53.435886+0000","last_fullsized":"2024-05-20T18:02:53.435886+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:52:45.607219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.414668+0000","last_change":"2024-05-20T18:02:52.411613+0000","last_active":"2024-05-20T18:02:53.414668+0000","last_peered":"2024-05-20T18:02:53.414668+0000","last_clean":"2024-05-20T18:02:53.414668+0000","last_became_active":"2024-05-20T18:02:52.408181+0000","last_became_peered":"2024-05-20T18:02:52.408181+0000","last_unstale":"2024-05-20T18:02:53.414668+0000","last_undegraded":"2024-05-20T18:02:53.414668+0000","last_fullsized":"2024-05-20T18:02:53.414668+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:47:06.526013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.427439+0000","last_change":"2024-05-20T18:02:53.424251+0000","last_active":"2024-05-20T18:02:53.427439+0000","last_peered":"2024-05-20T18:02:53.427439+0000","last_clean":"2024-05-20T18:02:53.427439+0000","last_became_active":"2024-05-20T18:02:53.423970+0000","last_became_peered":"2024-05-20T18:02:53.423970+0000","last_unstale":"2024-05-20T18:02:53.427439+0000","last_undegraded":"2024-05-20T18:02:53.427439+0000","last_fullsized":"2024-05-20T18:02:53.427439+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:19:09.280475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.415416+0000","last_change":"2024-05-20T18:02:52.412486+0000","last_active":"2024-05-20T18:02:53.415416+0000","last_peered":"2024-05-20T18:02:53.415416+0000","last_clean":"2024-05-20T18:02:53.415416+0000","last_became_active":"2024-05-20T18:02:52.412113+0000","last_became_peered":"2024-05-20T18:02:52.412113+0000","last_unstale":"2024-05-20T18:02:53.415416+0000","last_undegraded":"2024-05-20T18:02:53.415416+0000","last_fullsized":"2024-05-20T18:02:53.415416+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T23:17:30.154459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.414641+0000","last_change":"2024-05-20T18:02:53.412575+0000","last_active":"2024-05-20T18:02:53.414641+0000","last_peered":"2024-05-20T18:02:53.414641+0000","last_clean":"2024-05-20T18:02:53.414641+0000","last_became_active":"2024-05-20T18:02:53.412243+0000","last_became_peered":"2024-05-20T18:02:53.412243+0000","last_unstale":"2024-05-20T18:02:53.414641+0000","last_undegraded":"2024-05-20T18:02:53.414641+0000","last_fullsized":"2024-05-20T18:02:53.414641+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:28:16.433038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"147'2","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.423847+0000","last_change":"2024-05-20T18:02:52.414779+0000","last_active":"2024-05-20T18:02:53.423847+0000","last_peered":"2024-05-20T18:02:53.423847+0000","last_clean":"2024-05-20T18:02:53.423847+0000","last_became_active":"2024-05-20T18:02:52.414470+0000","last_became_peered":"2024-05-20T18:02:52.414470+0000","last_unstale":"2024-05-20T18:02:53.423847+0000","last_undegraded":"2024-05-20T18:02:53.423847+0000","last_fullsized":"2024-05-20T18:02:53.423847+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:54:33.470570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.422507+0000","last_change":"2024-05-20T18:02:53.413063+0000","last_active":"2024-05-20T18:02:53.422507+0000","last_peered":"2024-05-20T18:02:53.422507+0000","last_clean":"2024-05-20T18:02:53.422507+0000","last_became_active":"2024-05-20T18:02:53.412637+0000","last_became_peered":"2024-05-20T18:02:53.412637+0000","last_unstale":"2024-05-20T18:02:53.422507+0000","last_undegraded":"2024-05-20T18:02:53.422507+0000","last_fullsized":"2024-05-20T18:02:53.422507+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:05:11.661698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.404393+0000","last_change":"2024-05-20T18:02:52.414953+0000","last_active":"2024-05-20T18:02:53.404393+0000","last_peered":"2024-05-20T18:02:53.404393+0000","last_clean":"2024-05-20T18:02:53.404393+0000","last_became_active":"2024-05-20T18:02:52.414603+0000","last_became_peered":"2024-05-20T18:02:52.414603+0000","last_unstale":"2024-05-20T18:02:53.404393+0000","last_undegraded":"2024-05-20T18:02:53.404393+0000","last_fullsized":"2024-05-20T18:02:53.404393+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:05:22.544040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.425331+0000","last_change":"2024-05-20T18:02:53.419913+0000","last_active":"2024-05-20T18:02:53.425331+0000","last_peered":"2024-05-20T18:02:53.425331+0000","last_clean":"2024-05-20T18:02:53.425331+0000","last_became_active":"2024-05-20T18:02:53.419582+0000","last_became_peered":"2024-05-20T18:02:53.419582+0000","last_unstale":"2024-05-20T18:02:53.425331+0000","last_undegraded":"2024-05-20T18:02:53.425331+0000","last_fullsized":"2024-05-20T18:02:53.425331+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:35.206417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.404497+0000","last_change":"2024-05-20T18:02:52.415946+0000","last_active":"2024-05-20T18:02:53.404497+0000","last_peered":"2024-05-20T18:02:53.404497+0000","last_clean":"2024-05-20T18:02:53.404497+0000","last_became_active":"2024-05-20T18:02:52.415630+0000","last_became_peered":"2024-05-20T18:02:52.415630+0000","last_unstale":"2024-05-20T18:02:53.404497+0000","last_undegraded":"2024-05-20T18:02:53.404497+0000","last_fullsized":"2024-05-20T18:02:53.404497+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T22:41:53.782943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.425142+0000","last_change":"2024-05-20T18:02:53.413382+0000","last_active":"2024-05-20T18:02:53.425142+0000","last_peered":"2024-05-20T18:02:53.425142+0000","last_clean":"2024-05-20T18:02:53.425142+0000","last_became_active":"2024-05-20T18:02:53.413034+0000","last_became_peered":"2024-05-20T18:02:53.413034+0000","last_unstale":"2024-05-20T18:02:53.425142+0000","last_undegraded":"2024-05-20T18:02:53.425142+0000","last_fullsized":"2024-05-20T18:02:53.425142+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:41:14.795475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.415258+0000","last_change":"2024-05-20T18:02:52.412886+0000","last_active":"2024-05-20T18:02:53.415258+0000","last_peered":"2024-05-20T18:02:53.415258+0000","last_clean":"2024-05-20T18:02:53.415258+0000","last_became_active":"2024-05-20T18:02:52.412573+0000","last_became_peered":"2024-05-20T18:02:52.412573+0000","last_unstale":"2024-05-20T18:02:53.415258+0000","last_undegraded":"2024-05-20T18:02:53.415258+0000","last_fullsized":"2024-05-20T18:02:53.415258+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T19:48:06.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.417303+0000","last_change":"2024-05-20T18:02:53.413321+0000","last_active":"2024-05-20T18:02:53.417303+0000","last_peered":"2024-05-20T18:02:53.417303+0000","last_clean":"2024-05-20T18:02:53.417303+0000","last_became_active":"2024-05-20T18:02:53.413016+0000","last_became_peered":"2024-05-20T18:02:53.413016+0000","last_unstale":"2024-05-20T18:02:53.417303+0000","last_undegraded":"2024-05-20T18:02:53.417303+0000","last_fullsized":"2024-05-20T18:02:53.417303+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:02:04.708770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.400825+0000","last_change":"2024-05-20T18:02:52.413474+0000","last_active":"2024-05-20T18:02:53.400825+0000","last_peered":"2024-05-20T18:02:53.400825+0000","last_clean":"2024-05-20T18:02:53.400825+0000","last_became_active":"2024-05-20T18:02:52.413128+0000","last_became_peered":"2024-05-20T18:02:52.413128+0000","last_unstale":"2024-05-20T18:02:53.400825+0000","last_undegraded":"2024-05-20T18:02:53.400825+0000","last_fullsized":"2024-05-20T18:02:53.400825+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:13:50.846232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.442390+0000","last_change":"2024-05-20T18:02:53.442020+0000","last_active":"2024-05-20T18:02:53.442390+0000","last_peered":"2024-05-20T18:02:53.442390+0000","last_clean":"2024-05-20T18:02:53.442390+0000","last_became_active":"2024-05-20T18:02:53.441690+0000","last_became_peered":"2024-05-20T18:02:53.441690+0000","last_unstale":"2024-05-20T18:02:53.442390+0000","last_undegraded":"2024-05-20T18:02:53.442390+0000","last_fullsized":"2024-05-20T18:02:53.442390+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:57:20.271746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.405237+0000","last_change":"2024-05-20T18:02:52.406136+0000","last_active":"2024-05-20T18:02:53.405237+0000","last_peered":"2024-05-20T18:02:53.405237+0000","last_clean":"2024-05-20T18:02:53.405237+0000","last_became_active":"2024-05-20T18:02:52.405770+0000","last_became_peered":"2024-05-20T18:02:52.405770+0000","last_unstale":"2024-05-20T18:02:53.405237+0000","last_undegraded":"2024-05-20T18:02:53.405237+0000","last_fullsized":"2024-05-20T18:02:53.405237+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:20:14.180265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.434832+0000","last_change":"2024-05-20T18:02:53.431480+0000","last_active":"2024-05-20T18:02:53.434832+0000","last_peered":"2024-05-20T18:02:53.434832+0000","last_clean":"2024-05-20T18:02:53.434832+0000","last_became_active":"2024-05-20T18:02:53.431157+0000","last_became_peered":"2024-05-20T18:02:53.431157+0000","last_unstale":"2024-05-20T18:02:53.434832+0000","last_undegraded":"2024-05-20T18:02:53.434832+0000","last_fullsized":"2024-05-20T18:02:53.434832+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:46:32.248836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.402359+0000","last_change":"2024-05-20T18:02:52.411329+0000","last_active":"2024-05-20T18:02:53.402359+0000","last_peered":"2024-05-20T18:02:53.402359+0000","last_clean":"2024-05-20T18:02:53.402359+0000","last_became_active":"2024-05-20T18:02:52.411033+0000","last_became_peered":"2024-05-20T18:02:52.411033+0000","last_unstale":"2024-05-20T18:02:53.402359+0000","last_undegraded":"2024-05-20T18:02:53.402359+0000","last_fullsized":"2024-05-20T18:02:53.402359+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T21:28:34.037705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.436291+0000","last_change":"2024-05-20T18:02:53.431151+0000","last_active":"2024-05-20T18:02:53.436291+0000","last_peered":"2024-05-20T18:02:53.436291+0000","last_clean":"2024-05-20T18:02:53.436291+0000","last_became_active":"2024-05-20T18:02:53.430857+0000","last_became_peered":"2024-05-20T18:02:53.430857+0000","last_unstale":"2024-05-20T18:02:53.436291+0000","last_undegraded":"2024-05-20T18:02:53.436291+0000","last_fullsized":"2024-05-20T18:02:53.436291+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:45:39.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.408101+0000","last_change":"2024-05-20T18:02:52.419269+0000","last_active":"2024-05-20T18:02:53.408101+0000","last_peered":"2024-05-20T18:02:53.408101+0000","last_clean":"2024-05-20T18:02:53.408101+0000","last_became_active":"2024-05-20T18:02:52.418966+0000","last_became_peered":"2024-05-20T18:02:52.418966+0000","last_unstale":"2024-05-20T18:02:53.408101+0000","last_undegraded":"2024-05-20T18:02:53.408101+0000","last_fullsized":"2024-05-20T18:02:53.408101+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T18:40:06.587092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.420992+0000","last_change":"2024-05-20T18:02:53.417860+0000","last_active":"2024-05-20T18:02:53.420992+0000","last_peered":"2024-05-20T18:02:53.420992+0000","last_clean":"2024-05-20T18:02:53.420992+0000","last_became_active":"2024-05-20T18:02:53.417021+0000","last_became_peered":"2024-05-20T18:02:53.417021+0000","last_unstale":"2024-05-20T18:02:53.420992+0000","last_undegraded":"2024-05-20T18:02:53.420992+0000","last_fullsized":"2024-05-20T18:02:53.420992+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:52.387250+0000","last_clean_scrub_stamp":"2024-05-20T18:02:52.387250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:05:11.661698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.404196+0000","last_change":"2024-05-20T18:02:52.414960+0000","last_active":"2024-05-20T18:02:53.404196+0000","last_peered":"2024-05-20T18:02:53.404196+0000","last_clean":"2024-05-20T18:02:53.404196+0000","last_became_active":"2024-05-20T18:02:52.414654+0000","last_became_peered":"2024-05-20T18:02:52.414654+0000","last_unstale":"2024-05-20T18:02:53.404196+0000","last_undegraded":"2024-05-20T18:02:53.404196+0000","last_fullsized":"2024-05-20T18:02:53.404196+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T18:02:51.381170+0000","last_clean_scrub_stamp":"2024-05-20T18:02:51.381170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:09:38.380785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":403,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-05-20T18:02:53.410528+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:02:53.410528+0000","last_peered":"2024-05-20T18:02:53.410528+0000","last_clean":"2024-05-20T18:02:53.410528+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:02:53.410528+0000","last_undegraded":"2024-05-20T18:02:53.410528+0000","last_fullsized":"2024-05-20T18:02:53.410528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33560,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338280,"statfs":{"total":96636764160,"available":96602398720,"internally_reserved":0,"allocated":2433024,"data_stored":1441984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37156,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334684,"statfs":{"total":96636764160,"available":96598716416,"internally_reserved":0,"allocated":1851392,"data_stored":858783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1855488,"data_stored":858817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37172,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334668,"statfs":{"total":96636764160,"available":96598700032,"internally_reserved":0,"allocated":1867776,"data_stored":859547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1839104,"data_stored":851616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1839104,"data_stored":851616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1863680,"data_stored":860395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33584,"kb_used_data":2396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338256,"statfs":{"total":96636764160,"available":96602374144,"internally_reserved":0,"allocated":2453504,"data_stored":1449255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:02:57.859 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-20T18:02:57.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-20T18:02:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.020+0000 7f28f1596640 1 Processor -- start 2024-05-20T18:02:58.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.020+0000 7f28f1596640 1 -- start start 2024-05-20T18:02:58.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28f1596640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28ec162820 0x7f28ec0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28f1596640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f28ec0b3e80 0x7f28ec06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28f1596640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28f1596640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f28ec06dd20 con 0x7f28ec162820 2024-05-20T18:02:58.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28f1596640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f28ec0d0630 con 0x7f28ec0b3e80 2024-05-20T18:02:58.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28f1596640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec0d39c0 con 0x7f28ec06d910 2024-05-20T18:02:58.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28ec162820 0x7f28ec0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28ec162820 0x7f28ec0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55360/0 (socket says 172.21.15.6:55360) 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eaffd640 1 -- 172.21.15.6:0/1502322779 learned_addr learned my addr 172.21.15.6:0/1502322779 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28ea7fc640 1 --2- 172.21.15.6:0/1502322779 >> v2:172.21.15.171:3300/0 conn(0x7f28ec0b3e80 0x7f28ec06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eb7fe640 1 --2- 172.21.15.6:0/1502322779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eaffd640 1 -- 172.21.15.6:0/1502322779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 msgr2=0x7f28ec0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eaffd640 1 --2- 172.21.15.6:0/1502322779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eaffd640 1 -- 172.21.15.6:0/1502322779 >> v2:172.21.15.171:3300/0 conn(0x7f28ec0b3e80 msgr2=0x7f28ec06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eaffd640 1 --2- 172.21.15.6:0/1502322779 >> v2:172.21.15.171:3300/0 conn(0x7f28ec0b3e80 0x7f28ec06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eaffd640 1 -- 172.21.15.6:0/1502322779 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec0d3ca0 con 0x7f28ec162820 2024-05-20T18:02:58.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.022+0000 7f28eb7fe640 1 --2- 172.21.15.6:0/1502322779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.023+0000 7f28eaffd640 1 --2- 172.21.15.6:0/1502322779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec0b3940 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0d1230 tx=0x7f28dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2423ed16d4f27b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.023+0000 7f28e9ffb640 1 -- 172.21.15.6:0/1502322779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc037070 con 0x7f28ec162820 2024-05-20T18:02:58.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.023+0000 7f28e9ffb640 1 -- 172.21.15.6:0/1502322779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc032440 con 0x7f28ec162820 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.023+0000 7f28e9ffb640 1 -- 172.21.15.6:0/1502322779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc032810 con 0x7f28ec162820 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 -- 172.21.15.6:0/1502322779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 msgr2=0x7f28ec0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 --2- 172.21.15.6:0/1502322779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec0b3940 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0d1230 tx=0x7f28dc02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 -- 172.21.15.6:0/1502322779 shutdown_connections 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 --2- 172.21.15.6:0/1502322779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 --2- 172.21.15.6:0/1502322779 >> v2:172.21.15.171:3300/0 conn(0x7f28ec0b3e80 0x7f28ec06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 --2- 172.21.15.6:0/1502322779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec0b3940 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 -- 172.21.15.6:0/1502322779 >> 172.21.15.6:0/1502322779 conn(0x7f28ec0d4bd0 msgr2=0x7f28ec0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 -- 172.21.15.6:0/1502322779 shutdown_connections 2024-05-20T18:02:58.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.024+0000 7f28f1596640 1 -- 172.21.15.6:0/1502322779 wait complete. 2024-05-20T18:02:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.026+0000 7f28f1596640 1 Processor -- start 2024-05-20T18:02:58.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.026+0000 7f28f1596640 1 -- start start 2024-05-20T18:02:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28f1596640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28f1596640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ec0b3e80 0x7f28ec0b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28f1596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28f1596640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec0d0300 con 0x7f28ec162820 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28f1596640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec0d4260 con 0x7f28ec0b3e80 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28f1596640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec0d4780 con 0x7f28ec06d910 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28eb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28eb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec14eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55370/0 (socket says 172.21.15.6:55370) 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.027+0000 7f28eb7fe640 1 -- 172.21.15.6:0/152259009 learned_addr learned my addr 172.21.15.6:0/152259009 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28ea7fc640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ec0b3e80 0x7f28ec0b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28eaffd640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28eb7fe640 1 -- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 msgr2=0x7f28ec0cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28eb7fe640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28eb7fe640 1 -- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ec0b3e80 msgr2=0x7f28ec0b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28eb7fe640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ec0b3e80 0x7f28ec0b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28eb7fe640 1 -- 172.21.15.6:0/152259009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec14f530 con 0x7f28ec162820 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28eb7fe640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec14eff0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f28e4007d80 tx=0x7f28e400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:58.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28e37fe640 1 -- 172.21.15.6:0/152259009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e401a070 con 0x7f28ec162820 2024-05-20T18:02:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28e37fe640 1 -- 172.21.15.6:0/152259009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e4015400 con 0x7f28ec162820 2024-05-20T18:02:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec0cbf60 con 0x7f28ec162820 2024-05-20T18:02:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28e37fe640 1 -- 172.21.15.6:0/152259009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40157f0 con 0x7f28ec162820 2024-05-20T18:02:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.028+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec0cc520 con 0x7f28ec162820 2024-05-20T18:02:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.029+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ec075b00 con 0x7f28ec162820 2024-05-20T18:02:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.030+0000 7f28e37fe640 1 -- 172.21.15.6:0/152259009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28e401d070 con 0x7f28ec162820 2024-05-20T18:02:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.030+0000 7f28e37fe640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28cc06be60 0x7f28cc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.031+0000 7f28e37fe640 1 -- 172.21.15.6:0/152259009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f28e408b0d0 con 0x7f28ec162820 2024-05-20T18:02:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.031+0000 7f28eaffd640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28cc06be60 0x7f28cc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.031+0000 7f28eaffd640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28cc06be60 0x7f28cc06e370 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f28dc034000 tx=0x7f28dc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:58.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.035+0000 7f28e37fe640 1 -- 172.21.15.6:0/152259009 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f28e4010070 con 0x7f28ec162820 2024-05-20T18:02:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.288+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f28ec0b3950 con 0x7f28ec162820 2024-05-20T18:02:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.291+0000 7f28e37fe640 1 -- 172.21.15.6:0/152259009 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f28e40592a0 con 0x7f28ec162820 2024-05-20T18:02:58.289 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-05-20T18:02:58.289 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDIjUtmwyCDGBAAnIndIIhe8oj5npOqRhojOg== 2024-05-20T18:02:58.289 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2024-05-20T18:02:58.289 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2024-05-20T18:02:58.289 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-20T18:02:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28cc06be60 msgr2=0x7f28cc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28cc06be60 0x7f28cc06e370 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f28dc034000 tx=0x7f28dc02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 msgr2=0x7f28ec14eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec14eff0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f28e4007d80 tx=0x7f28e400d4a0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 shutdown_connections 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f28cc06be60 0x7f28cc06e370 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28ec162820 0x7f28ec14eff0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28ec0b3e80 0x7f28ec0b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 --2- 172.21.15.6:0/152259009 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28ec06d910 0x7f28ec0cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 >> 172.21.15.6:0/152259009 conn(0x7f28ec0d4bd0 msgr2=0x7f28ec0cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 shutdown_connections 2024-05-20T18:02:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.294+0000 7f28f1596640 1 -- 172.21.15.6:0/152259009 wait complete. 2024-05-20T18:02:58.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:02:58.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.421+0000 7fcbaa39d640 1 Processor -- start 2024-05-20T18:02:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.422+0000 7fcbaa39d640 1 -- start start 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.423+0000 7fcbaa39d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcba40d5590 0x7fcba408d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.423+0000 7fcbaa39d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 0x7fcba40b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.423+0000 7fcbaa39d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcba40cf7e0 con 0x7fcba406ceb0 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.423+0000 7fcbaa39d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcba40d3340 con 0x7fcba40d5590 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.423+0000 7fcbaa39d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcba40d2730 con 0x7fcba415edc0 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.423+0000 7fcba939b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcba40d5590 0x7fcba408d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.423+0000 7fcba9b9c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcba406ceb0 0x7fcba406d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46840/0 (socket says 172.21.15.6:46840) 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.423+0000 7fcba9b9c640 1 -- 172.21.15.6:0/4092125784 learned_addr learned my addr 172.21.15.6:0/4092125784 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.424+0000 7fcba8b9a640 1 --2- 172.21.15.6:0/4092125784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 0x7fcba40b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.424+0000 7fcba939b640 1 -- 172.21.15.6:0/4092125784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 msgr2=0x7fcba40b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.424+0000 7fcba939b640 1 --2- 172.21.15.6:0/4092125784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 0x7fcba40b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.424+0000 7fcba939b640 1 -- 172.21.15.6:0/4092125784 >> v1:172.21.15.6:6789/0 conn(0x7fcba406ceb0 legacy=0x7fcba406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.424+0000 7fcb97fff640 1 -- 172.21.15.6:0/4092125784 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12399596 0 0) 0x7fcba40cf7e0 con 0x7fcba406ceb0 2024-05-20T18:02:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.424+0000 7fcba939b640 1 -- 172.21.15.6:0/4092125784 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba40d2a10 con 0x7fcba40d5590 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.424+0000 7fcba939b640 1 --2- 172.21.15.6:0/4092125784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba40d5590 0x7fcba408d4a0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fcb980097a0 tx=0x7fcb9802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d80b5e5644a6b59 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcb97fff640 1 -- 172.21.15.6:0/4092125784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98037070 con 0x7fcba40d5590 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcb97fff640 1 -- 172.21.15.6:0/4092125784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98032440 con 0x7fcba40d5590 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcb97fff640 1 -- 172.21.15.6:0/4092125784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98032810 con 0x7fcba40d5590 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcbaa39d640 1 -- 172.21.15.6:0/4092125784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba40d5590 msgr2=0x7fcba408d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/4092125784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba40d5590 0x7fcba408d4a0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fcb980097a0 tx=0x7fcb9802a180 comp rx=0 tx=0).stop 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcbaa39d640 1 -- 172.21.15.6:0/4092125784 shutdown_connections 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/4092125784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 0x7fcba40b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/4092125784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba40d5590 0x7fcba408d4a0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcbaa39d640 1 -- 172.21.15.6:0/4092125784 >> 172.21.15.6:0/4092125784 conn(0x7fcba40b6b60 msgr2=0x7fcba40d49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcbaa39d640 1 -- 172.21.15.6:0/4092125784 shutdown_connections 2024-05-20T18:02:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.425+0000 7fcbaa39d640 1 -- 172.21.15.6:0/4092125784 wait complete. 2024-05-20T18:02:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.427+0000 7fcbaa39d640 1 Processor -- start 2024-05-20T18:02:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.427+0000 7fcbaa39d640 1 -- start start 2024-05-20T18:02:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.428+0000 7fcbaa39d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba406ceb0 0x7fcba4158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcbaa39d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcba40d5590 0x7fcba415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcbaa39d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 0x7fcba41f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcbaa39d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcba40b84a0 con 0x7fcba406ceb0 2024-05-20T18:02:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcbaa39d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcba40d2fd0 con 0x7fcba40d5590 2024-05-20T18:02:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcbaa39d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcba415f1d0 con 0x7fcba415edc0 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba406ceb0 0x7fcba4158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba406ceb0 0x7fcba4158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55390/0 (socket says 172.21.15.6:55390) 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 -- 172.21.15.6:0/890473593 learned_addr learned my addr 172.21.15.6:0/890473593 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba8b9a640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcba40d5590 0x7fcba415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba9b9c640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 0x7fcba41f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 -- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 msgr2=0x7fcba41f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 0x7fcba41f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 -- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcba40d5590 msgr2=0x7fcba415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcba40d5590 0x7fcba415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 -- 172.21.15.6:0/890473593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba41f57b0 con 0x7fcba406ceb0 2024-05-20T18:02:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.429+0000 7fcba939b640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba406ceb0 0x7fcba4158790 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fcb98000c00 tx=0x7fcb980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.432+0000 7fcb95ffb640 1 -- 172.21.15.6:0/890473593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98037040 con 0x7fcba406ceb0 2024-05-20T18:02:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.432+0000 7fcb95ffb640 1 -- 172.21.15.6:0/890473593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98042070 con 0x7fcba406ceb0 2024-05-20T18:02:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.432+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba4160a10 con 0x7fcba406ceb0 2024-05-20T18:02:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.432+0000 7fcb95ffb640 1 -- 172.21.15.6:0/890473593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98030bb0 con 0x7fcba406ceb0 2024-05-20T18:02:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.432+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba4160fd0 con 0x7fcba406ceb0 2024-05-20T18:02:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.433+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba41f5980 con 0x7fcba406ceb0 2024-05-20T18:02:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.434+0000 7fcb95ffb640 1 -- 172.21.15.6:0/890473593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb98047460 con 0x7fcba406ceb0 2024-05-20T18:02:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.434+0000 7fcb95ffb640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb8806be30 0x7fcb8806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.434+0000 7fcb95ffb640 1 -- 172.21.15.6:0/890473593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fcb980aba00 con 0x7fcba406ceb0 2024-05-20T18:02:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.434+0000 7fcba8b9a640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb8806be30 0x7fcb8806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.435+0000 7fcba8b9a640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb8806be30 0x7fcb8806e340 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fcba40b8f30 tx=0x7fcba0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:58.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.439+0000 7fcb95ffb640 1 -- 172.21.15.6:0/890473593 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcb98032e20 con 0x7fcba406ceb0 2024-05-20T18:02:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.662+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcba4075980 con 0x7fcba406ceb0 2024-05-20T18:02:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.663+0000 7fcb95ffb640 1 -- 172.21.15.6:0/890473593 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5188 (secure 0 0 0) 0x7fcb98079c60 con 0x7fcba406ceb0 2024-05-20T18:02:58.661 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:02:58.661 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":108,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2941924108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2941924108},{"type":"v1","addr":"172.21.15.6:6835","nonce":2941924108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/701117749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":701117749},{"type":"v1","addr":"172.21.15.171:6837","nonce":701117749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3661458750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3661458750},{"type":"v1","addr":"172.21.15.171:6836","nonce":3661458750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:52.794622+0000","modified":"2024-05-20T18:02:55.807339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9654":{"gid":9654,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3621358319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3621358319},{"type":"v1","addr":"172.21.15.6:6834","nonce":3621358319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9654,"qdb_cluster":[9654]},"id":11}]} 2024-05-20T18:02:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 108 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb8806be30 msgr2=0x7fcb8806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb8806be30 0x7fcb8806e340 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fcba40b8f30 tx=0x7fcba0008040 comp rx=0 tx=0).stop 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba406ceb0 msgr2=0x7fcba4158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba406ceb0 0x7fcba4158790 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fcb98000c00 tx=0x7fcb980046c0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 shutdown_connections 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcb8806be30 0x7fcb8806e340 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcba415edc0 0x7fcba41f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcba40d5590 0x7fcba415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 --2- 172.21.15.6:0/890473593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcba406ceb0 0x7fcba4158790 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 >> 172.21.15.6:0/890473593 conn(0x7fcba40b6b60 msgr2=0x7fcba40ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:58.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 shutdown_connections 2024-05-20T18:02:58.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:58.665+0000 7fcbaa39d640 1 -- 172.21.15.6:0/890473593 wait complete. 2024-05-20T18:02:59.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 108, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-20T18:02:52.794622+0000', 'modified': '2024-05-20T18:02:55.807339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9654}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9654': {'gid': 9654, 'name': 'a', 'rank': 0, 'incarnation': 104, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6834/3621358319', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 3621358319}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 3621358319}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9654, 'qdb_cluster': [9654]} 2024-05-20T18:02:59.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-20T18:02:59.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-20T18:02:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.198+0000 7f077f279640 1 Processor -- start 2024-05-20T18:02:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.198+0000 7f077f279640 1 -- start start 2024-05-20T18:02:59.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077f279640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f077806d3d0 0x7f077806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077f279640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07780b8190 0x7f07780b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077f279640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077806dd20 con 0x7f0778162820 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077f279640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f07780d0630 con 0x7f07780b8190 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077f279640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f07780d39c0 con 0x7f077806d3d0 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077d816640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07780b8190 0x7f07780b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077d816640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07780b8190 0x7f07780b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55394/0 (socket says 172.21.15.6:55394) 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077d816640 1 -- 172.21.15.6:0/1942397188 learned_addr learned my addr 172.21.15.6:0/1942397188 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077c814640 1 --2- 172.21.15.6:0/1942397188 >> v2:172.21.15.171:3300/0 conn(0x7f077806d3d0 0x7f077806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077d816640 1 -- 172.21.15.6:0/1942397188 >> v2:172.21.15.171:3300/0 conn(0x7f077806d3d0 msgr2=0x7f077806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077d816640 1 --2- 172.21.15.6:0/1942397188 >> v2:172.21.15.171:3300/0 conn(0x7f077806d3d0 0x7f077806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077d816640 1 -- 172.21.15.6:0/1942397188 >> v1:172.21.15.171:6789/0 conn(0x7f0778162820 legacy=0x7f07780b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077d816640 1 -- 172.21.15.6:0/1942397188 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07780d3ca0 con 0x7f07780b8190 2024-05-20T18:02:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.200+0000 7f077c814640 1 --2- 172.21.15.6:0/1942397188 >> v2:172.21.15.171:3300/0 conn(0x7f077806d3d0 0x7f077806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.201+0000 7f077d816640 1 --2- 172.21.15.6:0/1942397188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07780b8190 0x7f07780b85a0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f07780d1230 tx=0x7f077002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253089209633ee57 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.201+0000 7f076ffff640 1 -- 172.21.15.6:0/1942397188 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770036070 con 0x7f07780b8190 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.201+0000 7f076ffff640 1 -- 172.21.15.6:0/1942397188 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0770031600 con 0x7f07780b8190 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.201+0000 7f076ffff640 1 -- 172.21.15.6:0/1942397188 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700319d0 con 0x7f07780b8190 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.202+0000 7f077f279640 1 -- 172.21.15.6:0/1942397188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07780b8190 msgr2=0x7f07780b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.202+0000 7f077f279640 1 --2- 172.21.15.6:0/1942397188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07780b8190 0x7f07780b85a0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f07780d1230 tx=0x7f077002a730 comp rx=0 tx=0).stop 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.202+0000 7f077f279640 1 -- 172.21.15.6:0/1942397188 shutdown_connections 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.202+0000 7f077f279640 1 --2- 172.21.15.6:0/1942397188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07780b8190 0x7f07780b85a0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.202+0000 7f077f279640 1 --2- 172.21.15.6:0/1942397188 >> v2:172.21.15.171:3300/0 conn(0x7f077806d3d0 0x7f077806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.202+0000 7f077f279640 1 -- 172.21.15.6:0/1942397188 >> 172.21.15.6:0/1942397188 conn(0x7f07780d4bd0 msgr2=0x7f07780d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.202+0000 7f077f279640 1 -- 172.21.15.6:0/1942397188 shutdown_connections 2024-05-20T18:02:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.202+0000 7f077f279640 1 -- 172.21.15.6:0/1942397188 wait complete. 2024-05-20T18:02:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.204+0000 7f077f279640 1 Processor -- start 2024-05-20T18:02:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.204+0000 7f077f279640 1 -- start start 2024-05-20T18:02:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077f279640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077806d3d0 0x7f0778150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077f279640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07780b8190 0x7f07781e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077f279640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0778162820 0x7f077814dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077f279640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07780d0300 con 0x7f077806d3d0 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077f279640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f07780d4260 con 0x7f07780b8190 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077f279640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f07780b4050 con 0x7f0778162820 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077d015640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077806d3d0 0x7f0778150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077d015640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077806d3d0 0x7f0778150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55400/0 (socket says 172.21.15.6:55400) 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.205+0000 7f077d015640 1 -- 172.21.15.6:0/1150696044 learned_addr learned my addr 172.21.15.6:0/1150696044 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077d816640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0778162820 0x7f077814dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077c814640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07780b8190 0x7f07781e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077d015640 1 -- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0778162820 msgr2=0x7f077814dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077d015640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0778162820 0x7f077814dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077d015640 1 -- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07780b8190 msgr2=0x7f07781e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077d015640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07780b8190 0x7f07781e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077d015640 1 -- 172.21.15.6:0/1150696044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07781ea320 con 0x7f077806d3d0 2024-05-20T18:02:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077d015640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077806d3d0 0x7f0778150010 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f077400c3c0 tx=0x7f077400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f076dffb640 1 -- 172.21.15.6:0/1150696044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07740052d0 con 0x7f077806d3d0 2024-05-20T18:02:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f076dffb640 1 -- 172.21.15.6:0/1150696044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0774005490 con 0x7f077806d3d0 2024-05-20T18:02:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077f279640 1 -- 172.21.15.6:0/1150696044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07780c94d0 con 0x7f077806d3d0 2024-05-20T18:02:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f076dffb640 1 -- 172.21.15.6:0/1150696044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774007260 con 0x7f077806d3d0 2024-05-20T18:02:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.206+0000 7f077f279640 1 -- 172.21.15.6:0/1150696044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07780c9a90 con 0x7f077806d3d0 2024-05-20T18:02:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.208+0000 7f076dffb640 1 -- 172.21.15.6:0/1150696044 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0774007400 con 0x7f077806d3d0 2024-05-20T18:02:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.209+0000 7f076dffb640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f075c06be30 0x7f075c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.209+0000 7f076dffb640 1 -- 172.21.15.6:0/1150696044 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f077408a440 con 0x7f077806d3d0 2024-05-20T18:02:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.209+0000 7f077c814640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f075c06be30 0x7f075c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.210+0000 7f077c814640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f075c06be30 0x7f075c06e340 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f07781f98c0 tx=0x7f0768008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.210+0000 7f07861f5740 1 Processor -- start 2024-05-20T18:02:59.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.210+0000 7f07861f5740 1 -- start start 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f07861f5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af9e270 0x55826b369700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f07861f5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 0x55826b3660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f07861f5740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b33f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f07861f5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55826b2a24d0 con 0x55826af9e270 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f07861f5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55826b24a3e0 con 0x55826af753b0 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f07861f5740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55826b29e490 con 0x55826af7d590 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f077d015640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af9e270 0x55826b369700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f077d015640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af9e270 0x55826b369700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55404/0 (socket says 172.21.15.6:55404) 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f077d015640 1 -- 172.21.15.6:0/436588017 learned_addr learned my addr 172.21.15.6:0/436588017 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f077d816640 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b33f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.211+0000 7f077c814640 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 0x55826b3660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f077d015640 1 -- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 msgr2=0x55826b33f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f077d015640 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b33f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f077d015640 1 -- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 msgr2=0x55826b3660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f077d015640 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 0x55826b3660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f077d015640 1 -- 172.21.15.6:0/436588017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55826afb62d0 con 0x55826af9e270 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f077c814640 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 0x55826b3660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f077d015640 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af9e270 0x55826b369700 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f0774088810 tx=0x7f0774000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40410ff8ddfc0fd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f0762ffd640 1 -- 172.21.15.6:0/436588017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07740568f0 con 0x55826af9e270 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f0762ffd640 1 -- 172.21.15.6:0/436588017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0774054c60 con 0x55826af9e270 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.212+0000 7f0762ffd640 1 -- 172.21.15.6:0/436588017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774060f80 con 0x55826af9e270 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 -- 172.21.15.6:0/436588017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af9e270 msgr2=0x55826b369700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af9e270 0x55826b369700 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f0774088810 tx=0x7f0774000ed0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 -- 172.21.15.6:0/436588017 shutdown_connections 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b33f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 0x55826b3660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 --2- 172.21.15.6:0/436588017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af9e270 0x55826b369700 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 -- 172.21.15.6:0/436588017 >> 172.21.15.6:0/436588017 conn(0x55826af923c0 msgr2=0x55826b33eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 -- 172.21.15.6:0/436588017 shutdown_connections 2024-05-20T18:02:59.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.213+0000 7f07861f5740 1 -- 172.21.15.6:0/436588017 wait complete. 2024-05-20T18:02:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.214+0000 7f07861f5740 1 -- start start 2024-05-20T18:02:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.214+0000 7f07861f5740 1 Processor -- start 2024-05-20T18:02:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.215+0000 7f07861f5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b38bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.215+0000 7f07861f5740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b363810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.215+0000 7f07861f5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b36c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.215+0000 7f07861f5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55826b25d8e0 con 0x55826af753b0 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.215+0000 7f07861f5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55826b3833d0 con 0x55826af9e270 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.215+0000 7f07861f5740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55826b3642b0 con 0x55826af7d590 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.215+0000 7f07861f5740 10 client.0 _ll_register_callbacks cb 0x55826b22a9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.215+0000 7f077d015640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b38bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d015640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b38bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55416/0 (socket says 172.21.15.6:55416) 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d015640 1 -- 172.21.15.6:0/1017368311 learned_addr learned my addr 172.21.15.6:0/1017368311 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077c814640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b363810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d816640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b36c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d015640 1 -- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 msgr2=0x55826b363810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d015640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b363810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d015640 1 -- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 msgr2=0x55826b36c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d015640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b36c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d015640 1 -- 172.21.15.6:0/1017368311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55826b0806b0 con 0x55826af753b0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077c814640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b363810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d816640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b36c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f077d015640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b38bc90 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f07740077f0 tx=0x7f0774088740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae60790dc5d7a675 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f0757fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f0757fff640 1 -- 172.21.15.6:0/1017368311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774060d40 con 0x55826af753b0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f0757fff640 1 -- 172.21.15.6:0/1017368311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f0774060ee0 con 0x55826af753b0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f07861f5740 1 -- 172.21.15.6:0/1017368311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0774054c60 con 0x55826af753b0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f0757fff640 1 -- 172.21.15.6:0/1017368311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f077405db30 con 0x55826af753b0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f07861f5740 10 client.9801 fetch_fsmap learned FSMap version 108 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.216+0000 7f07861f5740 1 -- 172.21.15.6:0/1017368311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x55826b363d50 con 0x55826af753b0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f0757fff640 1 -- 172.21.15.6:0/1017368311 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0774054c60 con 0x55826af753b0 2024-05-20T18:02:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f0757fff640 1 -- 172.21.15.6:0/1017368311 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 108) ==== 3494+0+0 (secure 0 0 0) 0x7f0774057a40 con 0x55826af753b0 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f07861f5740 10 client.9801 fetch_fsmap finished waiting for FSMap version 108 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f07861f5740 10 client.9801 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f07861f5740 20 client.9801 populate_metadata read hostname 'smithi006' 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f07861f5740 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] conn(0x55826af5ce40 0x55826b382390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f07861f5740 4 client.9801 mds_command: new command op to 9654 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f07861f5740 1 -- 172.21.15.6:0/1017368311 --> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55826b2afc00 con 0x55826af5ce40 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f077c814640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] conn(0x55826af5ce40 0x55826b382390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f0757fff640 10 client.9801 ms_handle_connect on v2:172.21.15.6:6832/3621358319 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.217+0000 7f077c814640 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] conn(0x55826af5ce40 0x55826b382390 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47276a18bcb0842a server_cookie=44db8aef3f8fc350 in_seq=0 out_seq=0 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f0757fff640 1 -- 172.21.15.6:0/1017368311 <== mds.0 v2:172.21.15.6:6832/3621358319 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55826b2afc00 con 0x55826af5ce40 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f0757fff640 10 client.9801 handle_command_reply: tid=0 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 client.9801 shutdown 2024-05-20T18:02:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 -- 172.21.15.6:0/1017368311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 msgr2=0x55826b38bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b38bc90 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f07740077f0 tx=0x7f0774088740 comp rx=0 tx=0).stop 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 -- 172.21.15.6:0/1017368311 shutdown_connections 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] conn(0x55826af5ce40 0x55826b382390 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b36c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b363810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f0757fff640 0 client.9801 ms_handle_reset on v2:172.21.15.6:6832/3621358319 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 --2- 172.21.15.6:0/1017368311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b38bc90 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.218+0000 7f07861f5740 1 -- 172.21.15.6:0/1017368311 >> 172.21.15.6:0/1017368311 conn(0x55826af923c0 msgr2=0x55826b33eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.219+0000 7f07861f5740 1 -- 172.21.15.6:0/1017368311 shutdown_connections 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.219+0000 7f07861f5740 1 -- 172.21.15.6:0/1017368311 wait complete. 2024-05-20T18:02:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.219+0000 7f07861f5740 20 client.9801 trim_cache size 0 max 16384 2024-05-20T18:02:59.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.238+0000 7f07861f5740 1 Processor -- start 2024-05-20T18:02:59.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.238+0000 7f07861f5740 1 -- start start 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f07861f5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 0x55826b3630c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f07861f5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af7d590 0x55826b3813f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f07861f5740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af9e270 0x55826b369700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f07861f5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f07782013d0 con 0x55826af7d590 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f07861f5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f07781e87c0 con 0x55826af753b0 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f07861f5740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0778200d80 con 0x55826af9e270 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af7d590 0x55826b3813f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af7d590 0x55826b3813f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55428/0 (socket says 172.21.15.6:55428) 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 -- 172.21.15.6:0/2479231731 learned_addr learned my addr 172.21.15.6:0/2479231731 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 -- 172.21.15.6:0/2479231731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af9e270 msgr2=0x55826b369700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 --2- 172.21.15.6:0/2479231731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af9e270 0x55826b369700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 -- 172.21.15.6:0/2479231731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 msgr2=0x55826b3630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 --2- 172.21.15.6:0/2479231731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 0x55826b3630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 -- 172.21.15.6:0/2479231731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55826b36d750 con 0x55826af7d590 2024-05-20T18:02:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.239+0000 7f077c814640 1 --2- 172.21.15.6:0/2479231731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af7d590 0x55826b3813f0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f0768006fd0 tx=0x7f0768015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5958e45e508fc110 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07627fc640 1 -- 172.21.15.6:0/2479231731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076801b040 con 0x55826af7d590 2024-05-20T18:02:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07627fc640 1 -- 172.21.15.6:0/2479231731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076801c040 con 0x55826af7d590 2024-05-20T18:02:59.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07627fc640 1 -- 172.21.15.6:0/2479231731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0768004230 con 0x55826af7d590 2024-05-20T18:02:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 -- 172.21.15.6:0/2479231731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af7d590 msgr2=0x55826b3813f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 --2- 172.21.15.6:0/2479231731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af7d590 0x55826b3813f0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f0768006fd0 tx=0x7f0768015000 comp rx=0 tx=0).stop 2024-05-20T18:02:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 -- 172.21.15.6:0/2479231731 shutdown_connections 2024-05-20T18:02:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 --2- 172.21.15.6:0/2479231731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af9e270 0x55826b369700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 --2- 172.21.15.6:0/2479231731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af7d590 0x55826b3813f0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 --2- 172.21.15.6:0/2479231731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af753b0 0x55826b3630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 -- 172.21.15.6:0/2479231731 >> 172.21.15.6:0/2479231731 conn(0x55826af923c0 msgr2=0x55826b33dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 -- 172.21.15.6:0/2479231731 shutdown_connections 2024-05-20T18:02:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.240+0000 7f07861f5740 1 -- 172.21.15.6:0/2479231731 wait complete. 2024-05-20T18:02:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.241+0000 7f07861f5740 1 -- start start 2024-05-20T18:02:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.241+0000 7f07861f5740 1 Processor -- start 2024-05-20T18:02:59.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f07861f5740 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b400810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f07861f5740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b369700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f07861f5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b369c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f07861f5740 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x55826b3857e0 con 0x55826af753b0 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f07861f5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55826b25d8e0 con 0x55826af9e270 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f07861f5740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55826b385e00 con 0x55826af7d590 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f07861f5740 10 client.0 _ll_register_callbacks cb 0x7f0770034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b400810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b400810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55444/0 (socket says 172.21.15.6:55444) 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 -- 172.21.15.6:0/3455661307 learned_addr learned my addr 172.21.15.6:0/3455661307 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077c814640 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b369700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d816640 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b369c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 -- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 msgr2=0x55826b369700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b369700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 -- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 msgr2=0x55826b369c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b369c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 -- 172.21.15.6:0/3455661307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55826b384b40 con 0x55826af753b0 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d816640 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b369c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f077d015640 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b400810 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f077400cfd0 tx=0x7f077400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90eedb441f730c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.243+0000 7f0757fff640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f0757fff640 1 -- 172.21.15.6:0/3455661307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077407b060 con 0x55826af753b0 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f0757fff640 1 -- 172.21.15.6:0/3455661307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f0774057a40 con 0x55826af753b0 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 1 -- 172.21.15.6:0/3455661307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f076801c040 con 0x55826af753b0 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f0757fff640 1 -- 172.21.15.6:0/3455661307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f0774081050 con 0x55826af753b0 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 10 client.9807 fetch_fsmap learned FSMap version 108 2024-05-20T18:02:59.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 1 -- 172.21.15.6:0/3455661307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) -- 0x55826b384b40 con 0x55826af753b0 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f0757fff640 1 -- 172.21.15.6:0/3455661307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076801c040 con 0x55826af753b0 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f0757fff640 1 -- 172.21.15.6:0/3455661307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 108) ==== 3494+0+0 (secure 0 0 0) 0x7f0774060d40 con 0x55826af753b0 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 10 client.9807 fetch_fsmap finished waiting for FSMap version 108 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 10 client.9807 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 20 client.9807 populate_metadata read hostname 'smithi006' 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] conn(0x55826b4016c0 0x55826b395190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 4 client.9807 mds_command: new command op to 9654 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f07861f5740 1 -- 172.21.15.6:0/3455661307 --> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] -- command(tid 0: {"prefix": "status"}) -- 0x55826b2a9f50 con 0x55826b4016c0 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f077c814640 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] conn(0x55826b4016c0 0x55826b395190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.244+0000 7f0757fff640 10 client.9807 ms_handle_connect on v2:172.21.15.6:6832/3621358319 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f077c814640 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] conn(0x55826b4016c0 0x55826b395190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f83415aae6289529 server_cookie=45c1295801ff4996 in_seq=0 out_seq=0 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f0757fff640 1 -- 172.21.15.6:0/3455661307 <== mds.0 v2:172.21.15.6:6832/3621358319 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55826b2a9f50 con 0x55826b4016c0 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f0757fff640 10 client.9807 handle_command_reply: tid=0 2024-05-20T18:02:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 client.9807 shutdown 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 -- 172.21.15.6:0/3455661307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 msgr2=0x55826b400810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b400810 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f077400cfd0 tx=0x7f077400a000 comp rx=0 tx=0).stop 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 -- 172.21.15.6:0/3455661307 shutdown_connections 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.6:6832/3621358319,v1:172.21.15.6:6834/3621358319] conn(0x55826b4016c0 0x55826b395190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55826af9e270 0x55826b369c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f0757fff640 0 client.9807 ms_handle_reset on v2:172.21.15.6:6832/3621358319 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55826af7d590 0x55826b369700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 --2- 172.21.15.6:0/3455661307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55826af753b0 0x55826b400810 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 -- 172.21.15.6:0/3455661307 >> 172.21.15.6:0/3455661307 conn(0x55826af923c0 msgr2=0x55826b33dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 -- 172.21.15.6:0/3455661307 shutdown_connections 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 1 -- 172.21.15.6:0/3455661307 wait complete. 2024-05-20T18:02:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.245+0000 7f07861f5740 20 client.9807 trim_cache size 0 max 16384 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "08ecd7a5-bb84-4836-85d5-8cdd45e39724", 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9654, 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 5.8510301140000003, 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 108, 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 148, 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 148, 2024-05-20T18:02:59.249 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 10.806481071 2024-05-20T18:02:59.250 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:02:59.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 -- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f075c06be30 msgr2=0x7f075c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f075c06be30 0x7f075c06e340 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f07781f98c0 tx=0x7f0768008040 comp rx=0 tx=0).stop 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 -- 172.21.15.6:0/1150696044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077806d3d0 msgr2=0x7f0778150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077806d3d0 0x7f0778150010 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f077400c3c0 tx=0x7f077400c880 comp rx=0 tx=0).stop 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 -- 172.21.15.6:0/1150696044 shutdown_connections 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f075c06be30 0x7f075c06e340 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0778162820 0x7f077814dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07780b8190 0x7f07781e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 --2- 172.21.15.6:0/1150696044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f077806d3d0 0x7f0778150010 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 -- 172.21.15.6:0/1150696044 >> 172.21.15.6:0/1150696044 conn(0x7f07780d4bd0 msgr2=0x7f077815e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 -- 172.21.15.6:0/1150696044 shutdown_connections 2024-05-20T18:02:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.246+0000 7f077f279640 1 -- 172.21.15.6:0/1150696044 wait complete. 2024-05-20T18:02:59.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:02:59.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.372+0000 7f8527832640 1 Processor -- start 2024-05-20T18:02:59.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.373+0000 7f8527832640 1 -- start start 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.374+0000 7f8527832640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200d10e0 0x7f85200cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.374+0000 7f8527832640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f85200d14f0 0x7f85200cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.374+0000 7f8527832640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85200d1ac0 con 0x7f85200cd4d0 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.374+0000 7f8527832640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f85200d1da0 con 0x7f85200d14f0 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.374+0000 7f8527832640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f85200d2080 con 0x7f85200d10e0 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.374+0000 7f85255ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200d10e0 0x7f85200cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.374+0000 7f8524dcd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f85200d14f0 0x7f85200cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f8525dcf640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f85200cd4d0 0x7f85200cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:41678/0 (socket says 172.21.15.6:41678) 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f8524dcd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f85200d14f0 0x7f85200cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.6:43692/0 (socket says 172.21.15.6:43692) 2024-05-20T18:02:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f85255ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200d10e0 0x7f85200cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:45766/0 (socket says 172.21.15.6:45766) 2024-05-20T18:02:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f8525dcf640 1 -- 172.21.15.6:0/1662205685 learned_addr learned my addr 172.21.15.6:0/1662205685 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:02:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f85255ce640 1 -- 172.21.15.6:0/1662205685 >> v2:172.21.15.171:3300/0 conn(0x7f85200d14f0 msgr2=0x7f85200cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:02:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f85255ce640 1 --2- 172.21.15.6:0/1662205685 >> v2:172.21.15.171:3300/0 conn(0x7f85200d14f0 0x7f85200cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f85255ce640 1 -- 172.21.15.6:0/1662205685 >> v1:172.21.15.171:6789/0 conn(0x7f85200cd4d0 legacy=0x7f85200cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f85255ce640 1 -- 172.21.15.6:0/1662205685 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85200d2360 con 0x7f85200d10e0 2024-05-20T18:02:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f8513fff640 1 -- 172.21.15.6:0/1662205685 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387246797 0 0) 0x7f85200d1ac0 con 0x7f85200cd4d0 2024-05-20T18:02:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.375+0000 7f8524dcd640 1 --2- 172.21.15.6:0/1662205685 >> v2:172.21.15.171:3300/0 conn(0x7f85200d14f0 0x7f85200cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:02:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.376+0000 7f85255ce640 1 --2- 172.21.15.6:0/1662205685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200d10e0 0x7f85200cf140 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f851c0097a0 tx=0x7f851c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b9d28c5e76a40 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.376+0000 7f8513fff640 1 -- 172.21.15.6:0/1662205685 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c037070 con 0x7f85200d10e0 2024-05-20T18:02:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.376+0000 7f8513fff640 1 -- 172.21.15.6:0/1662205685 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f851c032440 con 0x7f85200d10e0 2024-05-20T18:02:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.376+0000 7f8513fff640 1 -- 172.21.15.6:0/1662205685 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c032810 con 0x7f85200d10e0 2024-05-20T18:02:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.377+0000 7f8527832640 1 -- 172.21.15.6:0/1662205685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200d10e0 msgr2=0x7f85200cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.377+0000 7f8527832640 1 --2- 172.21.15.6:0/1662205685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200d10e0 0x7f85200cf140 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f851c0097a0 tx=0x7f851c02a180 comp rx=0 tx=0).stop 2024-05-20T18:02:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.377+0000 7f8527832640 1 -- 172.21.15.6:0/1662205685 shutdown_connections 2024-05-20T18:02:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.377+0000 7f8527832640 1 --2- 172.21.15.6:0/1662205685 >> v2:172.21.15.171:3300/0 conn(0x7f85200d14f0 0x7f85200cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.377+0000 7f8527832640 1 --2- 172.21.15.6:0/1662205685 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200d10e0 0x7f85200cf140 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.377+0000 7f8527832640 1 -- 172.21.15.6:0/1662205685 >> 172.21.15.6:0/1662205685 conn(0x7f85200b44d0 msgr2=0x7f85200b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.377+0000 7f8527832640 1 -- 172.21.15.6:0/1662205685 shutdown_connections 2024-05-20T18:02:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.377+0000 7f8527832640 1 -- 172.21.15.6:0/1662205685 wait complete. 2024-05-20T18:02:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.379+0000 7f8527832640 1 Processor -- start 2024-05-20T18:02:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.379+0000 7f8527832640 1 -- start start 2024-05-20T18:02:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8527832640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200cd4d0 0x7f85200c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8527832640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85200d10e0 0x7f8520147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8527832640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85200d14f0 0x7f85201482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8527832640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f85200b8440 con 0x7f85200d10e0 2024-05-20T18:02:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8527832640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f85200b82c0 con 0x7f85200d14f0 2024-05-20T18:02:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8527832640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f85200709f0 con 0x7f85200cd4d0 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8524dcd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85200d10e0 0x7f8520147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8524dcd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85200d10e0 0x7f8520147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55446/0 (socket says 172.21.15.6:55446) 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8524dcd640 1 -- 172.21.15.6:0/310131393 learned_addr learned my addr 172.21.15.6:0/310131393 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8525dcf640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85200d14f0 0x7f85201482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f85255ce640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200cd4d0 0x7f85200c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8524dcd640 1 -- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200cd4d0 msgr2=0x7f85200c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8524dcd640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200cd4d0 0x7f85200c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8524dcd640 1 -- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85200d14f0 msgr2=0x7f85201482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8524dcd640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85200d14f0 0x7f85201482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8524dcd640 1 -- 172.21.15.6:0/310131393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85201575a0 con 0x7f85200d10e0 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.380+0000 7f8525dcf640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85200d14f0 0x7f85201482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.381+0000 7f8524dcd640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85200d10e0 0x7f8520147d60 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f851400e8a0 tx=0x7f851400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.381+0000 7f8511ffb640 1 -- 172.21.15.6:0/310131393 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514017070 con 0x7f85200d10e0 2024-05-20T18:02:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.381+0000 7f8511ffb640 1 -- 172.21.15.6:0/310131393 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f851400c940 con 0x7f85200d10e0 2024-05-20T18:02:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.381+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8520145d70 con 0x7f85200d10e0 2024-05-20T18:02:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.381+0000 7f8511ffb640 1 -- 172.21.15.6:0/310131393 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851400cd30 con 0x7f85200d10e0 2024-05-20T18:02:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.381+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8520146330 con 0x7f85200d10e0 2024-05-20T18:02:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.382+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85200cc090 con 0x7f85200d10e0 2024-05-20T18:02:59.381 INFO:tasks.ceph.mds.a.smithi006.stderr:2024-05-20T18:02:59.383+0000 7fb8bbae9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T18:02:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.383+0000 7f8511ffb640 1 -- 172.21.15.6:0/310131393 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f851401a070 con 0x7f85200d10e0 2024-05-20T18:02:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.383+0000 7f8511ffb640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850406be30 0x7f850406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:02:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.383+0000 7f8511ffb640 1 -- 172.21.15.6:0/310131393 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f851408b200 con 0x7f85200d10e0 2024-05-20T18:02:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.384+0000 7f85255ce640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850406be30 0x7f850406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:02:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.384+0000 7f85255ce640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850406be30 0x7f850406e340 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f851c034000 tx=0x7f851c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:02:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.388+0000 7f8511ffb640 1 -- 172.21.15.6:0/310131393 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f85140592a0 con 0x7f85200d10e0 2024-05-20T18:02:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.610+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8520075b00 con 0x7f85200d10e0 2024-05-20T18:02:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.611+0000 7f8511ffb640 1 -- 172.21.15.6:0/310131393 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v108) ==== 53+0+73 (secure 0 0 0) 0x7f851405d5a0 con 0x7f85200d10e0 2024-05-20T18:02:59.609 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850406be30 msgr2=0x7f850406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850406be30 0x7f850406e340 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f851c034000 tx=0x7f851c02e000 comp rx=0 tx=0).stop 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85200d10e0 msgr2=0x7f8520147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85200d10e0 0x7f8520147d60 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f851400e8a0 tx=0x7f851400ed60 comp rx=0 tx=0).stop 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 shutdown_connections 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f850406be30 0x7f850406e340 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85200d14f0 0x7f85201482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85200d10e0 0x7f8520147d60 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 --2- 172.21.15.6:0/310131393 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85200cd4d0 0x7f85200c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:02:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 >> 172.21.15.6:0/310131393 conn(0x7f85200b44d0 msgr2=0x7f852015ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:02:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 shutdown_connections 2024-05-20T18:02:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59.613+0000 7f8527832640 1 -- 172.21.15.6:0/310131393 wait complete. 2024-05-20T18:02:59.622 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:02:59.622 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:02:59.622 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-05-20T18:02:59.622 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-20T18:02:59.622 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-20T18:02:59.623 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:02:59.623 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:02:59.623 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:02:59.625 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:02:59.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:59.625 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-05-20T18:02:59.642 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:02:59.642 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:02:59.642 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:02:59.642 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:59.642 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-05-20T18:02:59.642 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:59.642 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42134sec preferred_lft 42134sec 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link noprefixroute 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:59.643 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::a05d:65ff:fe78:8947/64 scope link 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 8a:9e:f4:ac:1a:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::889e:f4ff:feac:1a39/64 scope link 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:02:59.644 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 6a:69:cd:e9:cb:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T18:02:59.645 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::6869:cdff:fee9:cbed/64 scope link 2024-05-20T18:02:59.645 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:02:59.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:59.645 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:02:59.707 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-05-20T18:02:59.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:59.708 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-05-20T18:02:59.765 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-05-20T18:02:59.765 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:02:59.765 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-20T18:02:59.765 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-20T18:02:59.765 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:02:59.766 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:02:59.766 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-05-20T18:02:59.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-20T18:02:59.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-20T18:02:59.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-20T18:02:59.766 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-05-20T18:02:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:02:59.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:02:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:02:59.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:59.896 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T18:02:59.912 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T18:02:59.912 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T18:02:59.912 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:02:59.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:02:59.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-05-20T18:02:59.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:02:59.979 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-20T18:03:00.036 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-20T18:03:00.037 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:03:00.037 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:03:00.092 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-20T18:03:00.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:00.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:03:00.188 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:03:00.189 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:03:00.198 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:03:00.198 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:03:00.198 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:03:00.198 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with new device syntax: 0@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:03:00.198 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:03:00.199 INFO:teuthology.orchestra.run.smithi006.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-20T18:03:00.199 INFO:teuthology.orchestra.run.smithi006.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:03:00.199 INFO:teuthology.orchestra.run.smithi006.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:03:00.199 INFO:teuthology.orchestra.run.smithi006.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:03:00.199 INFO:teuthology.orchestra.run.smithi006.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:03:00.200 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:03:00.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:00.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-20T18:03:00.226 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:03:00.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:03:00.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:03:00.329 INFO:teuthology.orchestra.run.smithi006.stdout:client8815 2024-05-20T18:03:00.330 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:03:00.330 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:00.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-20T18:03:00.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.506+0000 7f832a509640 1 Processor -- start 2024-05-20T18:03:00.504 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.506+0000 7f832a509640 1 -- start start 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f832a509640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8324162820 0x7f83240b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f832a509640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83240b3e80 0x7f832406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f832a509640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832406dd20 con 0x7f832406d910 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f832a509640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f83240d0630 con 0x7f83240b3e80 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f832a509640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f83240d39c0 con 0x7f8324162820 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f83237fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83240b3e80 0x7f832406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f83237fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83240b3e80 0x7f832406d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55460/0 (socket says 172.21.15.6:55460) 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f83237fe640 1 -- 172.21.15.6:0/2207708606 learned_addr learned my addr 172.21.15.6:0/2207708606 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.507+0000 7f8323fff640 1 --2- 172.21.15.6:0/2207708606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8324162820 0x7f83240b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.508+0000 7f83237fe640 1 -- 172.21.15.6:0/2207708606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8324162820 msgr2=0x7f83240b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:00.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.508+0000 7f83237fe640 1 --2- 172.21.15.6:0/2207708606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8324162820 0x7f83240b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.508+0000 7f83237fe640 1 -- 172.21.15.6:0/2207708606 >> v1:172.21.15.171:6789/0 conn(0x7f832406d910 legacy=0x7f83240d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:00.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.508+0000 7f83237fe640 1 -- 172.21.15.6:0/2207708606 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83240d3ca0 con 0x7f83240b3e80 2024-05-20T18:03:00.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.508+0000 7f8323fff640 1 --2- 172.21.15.6:0/2207708606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8324162820 0x7f83240b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.508+0000 7f83237fe640 1 --2- 172.21.15.6:0/2207708606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83240b3e80 0x7f832406d3d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f8318009870 tx=0x7f831802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2766c23179142286 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f8322ffd640 1 -- 172.21.15.6:0/2207708606 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8318037070 con 0x7f83240b3e80 2024-05-20T18:03:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f8322ffd640 1 -- 172.21.15.6:0/2207708606 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8318032440 con 0x7f83240b3e80 2024-05-20T18:03:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f8322ffd640 1 -- 172.21.15.6:0/2207708606 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8318032810 con 0x7f83240b3e80 2024-05-20T18:03:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f832a509640 1 -- 172.21.15.6:0/2207708606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83240b3e80 msgr2=0x7f832406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:00.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f832a509640 1 --2- 172.21.15.6:0/2207708606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83240b3e80 0x7f832406d3d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f8318009870 tx=0x7f831802a270 comp rx=0 tx=0).stop 2024-05-20T18:03:00.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f832a509640 1 -- 172.21.15.6:0/2207708606 shutdown_connections 2024-05-20T18:03:00.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f832a509640 1 --2- 172.21.15.6:0/2207708606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83240b3e80 0x7f832406d3d0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f832a509640 1 --2- 172.21.15.6:0/2207708606 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8324162820 0x7f83240b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f832a509640 1 -- 172.21.15.6:0/2207708606 >> 172.21.15.6:0/2207708606 conn(0x7f83240d4bd0 msgr2=0x7f83240d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:00.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f832a509640 1 -- 172.21.15.6:0/2207708606 shutdown_connections 2024-05-20T18:03:00.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.509+0000 7f832a509640 1 -- 172.21.15.6:0/2207708606 wait complete. 2024-05-20T18:03:00.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.511+0000 7f832a509640 1 Processor -- start 2024-05-20T18:03:00.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.511+0000 7f832a509640 1 -- start start 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f832a509640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832406d910 0x7f83241e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f832a509640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83240b3e80 0x7f83240cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f832a509640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8324162820 0x7f83240c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f832a509640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f83240d0300 con 0x7f832406d910 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f832a509640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f83240d4260 con 0x7f8324162820 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f832a509640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f83240b91a0 con 0x7f83240b3e80 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832406d910 0x7f83241e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832406d910 0x7f83241e9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55472/0 (socket says 172.21.15.6:55472) 2024-05-20T18:03:00.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 -- 172.21.15.6:0/2133148006 learned_addr learned my addr 172.21.15.6:0/2133148006 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f83237fe640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83240b3e80 0x7f83240cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8328aa6640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8324162820 0x7f83240c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 -- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83240b3e80 msgr2=0x7f83240cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83240b3e80 0x7f83240cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 -- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8324162820 msgr2=0x7f83240c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8324162820 0x7f83240c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 -- 172.21.15.6:0/2133148006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83240c8dc0 con 0x7f832406d910 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.513+0000 7f8323fff640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832406d910 0x7f83241e9560 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f831400d800 tx=0x7f831400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.514+0000 7f8320ff9640 1 -- 172.21.15.6:0/2133148006 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314004030 con 0x7f832406d910 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.514+0000 7f8320ff9640 1 -- 172.21.15.6:0/2133148006 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83140041d0 con 0x7f832406d910 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.514+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83240c90a0 con 0x7f832406d910 2024-05-20T18:03:00.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.514+0000 7f8320ff9640 1 -- 172.21.15.6:0/2133148006 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83140096a0 con 0x7f832406d910 2024-05-20T18:03:00.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.514+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83240c9660 con 0x7f832406d910 2024-05-20T18:03:00.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.515+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8324075b00 con 0x7f832406d910 2024-05-20T18:03:00.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.515+0000 7f8320ff9640 1 -- 172.21.15.6:0/2133148006 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8314009840 con 0x7f832406d910 2024-05-20T18:03:00.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.516+0000 7f8320ff9640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f831006be30 0x7f831006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:00.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.516+0000 7f8320ff9640 1 -- 172.21.15.6:0/2133148006 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f831408b180 con 0x7f832406d910 2024-05-20T18:03:00.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.516+0000 7f83237fe640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f831006be30 0x7f831006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:00.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.517+0000 7f83237fe640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f831006be30 0x7f831006e340 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8318034000 tx=0x7f831802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:00.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.521+0000 7f8320ff9640 1 -- 172.21.15.6:0/2133148006 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8314059350 con 0x7f832406d910 2024-05-20T18:03:00.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.741+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8324161d60 con 0x7f832406d910 2024-05-20T18:03:00.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.741+0000 7f8320ff9640 1 -- 172.21.15.6:0/2133148006 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v108) ==== 53+0+73 (secure 0 0 0) 0x7f831405d650 con 0x7f832406d910 2024-05-20T18:03:00.740 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f831006be30 msgr2=0x7f831006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f831006be30 0x7f831006e340 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8318034000 tx=0x7f831802e000 comp rx=0 tx=0).stop 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832406d910 msgr2=0x7f83241e9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832406d910 0x7f83241e9560 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f831400d800 tx=0x7f831400dcc0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 shutdown_connections 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f831006be30 0x7f831006e340 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8324162820 0x7f83240c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83240b3e80 0x7f83240cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 --2- 172.21.15.6:0/2133148006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832406d910 0x7f83241e9560 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.743+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 >> 172.21.15.6:0/2133148006 conn(0x7f83240d4bd0 msgr2=0x7f8324160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.744+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 shutdown_connections 2024-05-20T18:03:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:00.744+0000 7f832a509640 1 -- 172.21.15.6:0/2133148006 wait complete. 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-20T18:03:00.753 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:03:00.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:00.754 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:03:00.774 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42144sec preferred_lft 42144sec 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff 2024-05-20T18:03:00.775 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::fc46:7fff:fe13:8ea5/64 scope link 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether da:6b:83:ea:82:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::d86b:83ff:feea:8249/64 scope link 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:30:5e:a0:cc:9e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c30:5eff:fea0:cc9e/64 scope link 2024-05-20T18:03:00.776 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-05-20T18:03:00.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:00.777 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-20T18:03:00.842 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-05-20T18:03:00.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:00.844 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-05-20T18:03:00.903 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-05-20T18:03:00.903 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-20T18:03:00.903 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-20T18:03:00.903 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-20T18:03:00.903 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-20T18:03:00.904 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-20T18:03:00.904 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-05-20T18:03:00.904 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-20T18:03:00.904 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-20T18:03:00.904 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-20T18:03:00.904 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-05-20T18:03:00.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:03:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-20T18:03:01.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:03:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:03:01.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:01.038 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T18:03:01.054 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T18:03:01.054 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T18:03:01.054 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:03:01.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:01.055 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-05-20T18:03:01.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:03:01.121 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-20T18:03:01.176 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-20T18:03:01.177 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-20T18:03:01.177 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:03:01.232 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-20T18:03:01.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:01.232 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:03:01.326 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:03:01.327 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:03:01.336 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-20T18:03:01.336 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-20T18:03:01.336 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-05-20T18:03:01.336 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@08ecd7a5-bb84-4836-85d5-8cdd45e39724.cephfs=/ 2024-05-20T18:03:01.336 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.6:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-05-20T18:03:01.337 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-20T18:03:01.337 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-05-20T18:03:01.337 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-20T18:03:01.337 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-05-20T18:03:01.337 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-20T18:03:01.339 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-20T18:03:01.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:01.339 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-20T18:03:01.363 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-20T18:03:01.454 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:03:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-20T18:03:01.456 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-20T18:03:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-20T18:03:01.462 INFO:teuthology.orchestra.run.smithi171.stdout:client9819 2024-05-20T18:03:01.462 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:03:01.462 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:01.479 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-20T18:03:01.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:03:01.541 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-20T18:03:01.581 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-20T18:03:01.582 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:03:01.582 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:03:01.582 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:01.603 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:03:01.603 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:01.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:03:01.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.824+0000 7efebf5b7640 1 Processor -- start 2024-05-20T18:03:01.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.825+0000 7efebf5b7640 1 -- start start 2024-05-20T18:03:01.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efebf5b7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efeb8168050 0x7efeb816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efebf5b7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb80d0630 con 0x7efeb806d3d0 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efebf5b7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb80d39c0 con 0x7efeb8162820 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efebf5b7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7efeb80d3ca0 con 0x7efeb8168050 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efebcb52640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efeb806d3d0 0x7efeb806d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46844/0 (socket says 172.21.15.6:46844) 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efebcb52640 1 -- 172.21.15.6:0/2919474752 learned_addr learned my addr 172.21.15.6:0/2919474752 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efebdb54640 1 --2- 172.21.15.6:0/2919474752 >> v2:172.21.15.171:3300/0 conn(0x7efeb8168050 0x7efeb816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efeaffff640 1 -- 172.21.15.6:0/2919474752 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694485829 0 0) 0x7efeb80d0630 con 0x7efeb806d3d0 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.826+0000 7efeaffff640 1 -- 172.21.15.6:0/2919474752 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efea4003520 con 0x7efeb806d3d0 2024-05-20T18:03:01.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.827+0000 7efeaffff640 1 -- 172.21.15.6:0/2919474752 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128089590 0 0) 0x7efeb80d39c0 con 0x7efeb8162820 2024-05-20T18:03:01.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.827+0000 7efeaffff640 1 -- 172.21.15.6:0/2919474752 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeb80d0630 con 0x7efeb8162820 2024-05-20T18:03:01.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.827+0000 7efeaffff640 1 -- 172.21.15.6:0/2919474752 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1097169613 0 0) 0x7efea4003520 con 0x7efeb806d3d0 2024-05-20T18:03:01.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.827+0000 7efebdb54640 1 -- 172.21.15.6:0/2919474752 >> v1:172.21.15.171:6789/0 conn(0x7efeb8162820 legacy=0x7efeb80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:01.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.827+0000 7efebdb54640 1 -- 172.21.15.6:0/2919474752 >> v1:172.21.15.6:6789/0 conn(0x7efeb806d3d0 legacy=0x7efeb806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:01.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.827+0000 7efebdb54640 1 -- 172.21.15.6:0/2919474752 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb80d3f80 con 0x7efeb8168050 2024-05-20T18:03:01.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efebdb54640 1 --2- 172.21.15.6:0/2919474752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 0x7efeb816a470 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009d90 tx=0x7efeb002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62787c489e6eb3b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:01.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efeaffff640 1 -- 172.21.15.6:0/2919474752 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8001670 con 0x7efeb8168050 2024-05-20T18:03:01.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efeaffff640 1 -- 172.21.15.6:0/2919474752 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb0007540 con 0x7efeb8168050 2024-05-20T18:03:01.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efeaffff640 1 -- 172.21.15.6:0/2919474752 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb00078f0 con 0x7efeb8168050 2024-05-20T18:03:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efebf5b7640 1 -- 172.21.15.6:0/2919474752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 msgr2=0x7efeb816a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efebf5b7640 1 --2- 172.21.15.6:0/2919474752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 0x7efeb816a470 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009d90 tx=0x7efeb002a680 comp rx=0 tx=0).stop 2024-05-20T18:03:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efebf5b7640 1 -- 172.21.15.6:0/2919474752 shutdown_connections 2024-05-20T18:03:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efebf5b7640 1 --2- 172.21.15.6:0/2919474752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 0x7efeb816a470 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.828+0000 7efebf5b7640 1 -- 172.21.15.6:0/2919474752 >> 172.21.15.6:0/2919474752 conn(0x7efeb80d4bd0 msgr2=0x7efeb80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.829+0000 7efebf5b7640 1 -- 172.21.15.6:0/2919474752 shutdown_connections 2024-05-20T18:03:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.829+0000 7efebf5b7640 1 -- 172.21.15.6:0/2919474752 wait complete. 2024-05-20T18:03:01.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.830+0000 7efebf5b7640 1 Processor -- start 2024-05-20T18:03:01.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.830+0000 7efebf5b7640 1 -- start start 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebf5b7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efeb806d3d0 0x7efeb80cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebf5b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8162820 0x7efeb8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebf5b7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 0x7efeb80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebf5b7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7efeb80b91a0 con 0x7efeb8162820 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebf5b7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efeb80d0300 con 0x7efeb8168050 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebf5b7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7efeb80b4050 con 0x7efeb806d3d0 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8162820 0x7efeb8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8162820 0x7efeb8154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55482/0 (socket says 172.21.15.6:55482) 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 -- 172.21.15.6:0/2869011250 learned_addr learned my addr 172.21.15.6:0/2869011250 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebd353640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efeb806d3d0 0x7efeb80cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebdb54640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 0x7efeb80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 -- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efeb806d3d0 msgr2=0x7efeb80cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efeb806d3d0 0x7efeb80cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 -- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 msgr2=0x7efeb80c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 0x7efeb80c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 -- 172.21.15.6:0/2869011250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb815f550 con 0x7efeb8162820 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efebcb52640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8162820 0x7efeb8154990 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7efea800c4f0 tx=0x7efea800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.832+0000 7efeadffb640 1 -- 172.21.15.6:0/2869011250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8017070 con 0x7efeb8162820 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.833+0000 7efeadffb640 1 -- 172.21.15.6:0/2869011250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8005ce0 con 0x7efeb8162820 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.833+0000 7efeadffb640 1 -- 172.21.15.6:0/2869011250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8007290 con 0x7efeb8162820 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.833+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb815f830 con 0x7efeb8162820 2024-05-20T18:03:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.833+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb815fdf0 con 0x7efeb8162820 2024-05-20T18:03:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.834+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb8075b00 con 0x7efeb8162820 2024-05-20T18:03:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.834+0000 7efeadffb640 1 -- 172.21.15.6:0/2869011250 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efea801a070 con 0x7efeb8162820 2024-05-20T18:03:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.835+0000 7efeadffb640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe9c06be30 0x7efe9c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.835+0000 7efeadffb640 1 -- 172.21.15.6:0/2869011250 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7efea808a540 con 0x7efeb8162820 2024-05-20T18:03:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.835+0000 7efebd353640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe9c06be30 0x7efe9c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.836+0000 7efebd353640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe9c06be30 0x7efe9c06e340 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efeb40011e0 tx=0x7efeb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:01.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:01.839+0000 7efeadffb640 1 -- 172.21.15.6:0/2869011250 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efea80585e0 con 0x7efeb8162820 2024-05-20T18:03:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.023+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efeb815d9e0 con 0x7efeb8162820 2024-05-20T18:03:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.024+0000 7efeadffb640 1 -- 172.21.15.6:0/2869011250 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) ==== 74+0+16836 (secure 0 0 0) 0x7efea805c8e0 con 0x7efeb8162820 2024-05-20T18:03:02.022 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:02.023 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":148,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:54.405297+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:51.154710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:51.763678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:03:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe9c06be30 msgr2=0x7efe9c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe9c06be30 0x7efe9c06e340 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efeb40011e0 tx=0x7efeb4009040 comp rx=0 tx=0).stop 2024-05-20T18:03:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8162820 msgr2=0x7efeb8154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8162820 0x7efeb8154990 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7efea800c4f0 tx=0x7efea800c9b0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 shutdown_connections 2024-05-20T18:03:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7efe9c06be30 0x7efe9c06e340 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb8168050 0x7efeb80c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efeb8162820 0x7efeb8154990 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 --2- 172.21.15.6:0/2869011250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efeb806d3d0 0x7efeb80cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 >> 172.21.15.6:0/2869011250 conn(0x7efeb80d4bd0 msgr2=0x7efeb81619c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 shutdown_connections 2024-05-20T18:03:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.026+0000 7efebf5b7640 1 -- 172.21.15.6:0/2869011250 wait complete. 2024-05-20T18:03:02.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:02:51.154710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:02:51.763678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:03:02.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:03:02.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.156+0000 7f648276c640 1 Processor -- start 2024-05-20T18:03:02.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.156+0000 7f648276c640 1 -- start start 2024-05-20T18:03:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f648276c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f647c06d3d0 0x7f647c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f648276c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0b8190 0x7f647c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f648276c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c06dd20 con 0x7f647c162820 2024-05-20T18:03:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f648276c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f647c0d0630 con 0x7f647c06d3d0 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f648276c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0d39c0 con 0x7f647c0b8190 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f647b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f647c06d3d0 0x7f647c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f647b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f647c06d3d0 0x7f647c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55496/0 (socket says 172.21.15.6:55496) 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f647b7fe640 1 -- 172.21.15.6:0/3382945386 learned_addr learned my addr 172.21.15.6:0/3382945386 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f6480d09640 1 --2- 172.21.15.6:0/3382945386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0b8190 0x7f647c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f647b7fe640 1 -- 172.21.15.6:0/3382945386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0b8190 msgr2=0x7f647c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f647b7fe640 1 --2- 172.21.15.6:0/3382945386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0b8190 0x7f647c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f647b7fe640 1 -- 172.21.15.6:0/3382945386 >> v1:172.21.15.171:6789/0 conn(0x7f647c162820 legacy=0x7f647c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.158+0000 7f647b7fe640 1 -- 172.21.15.6:0/3382945386 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0d3ca0 con 0x7f647c06d3d0 2024-05-20T18:03:02.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.159+0000 7f647b7fe640 1 --2- 172.21.15.6:0/3382945386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c06d7e0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f6470009870 tx=0x7f647002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4841d2cc92242f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.159+0000 7f647affd640 1 -- 172.21.15.6:0/3382945386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470037070 con 0x7f647c06d3d0 2024-05-20T18:03:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.159+0000 7f647affd640 1 -- 172.21.15.6:0/3382945386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6470032440 con 0x7f647c06d3d0 2024-05-20T18:03:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.159+0000 7f647affd640 1 -- 172.21.15.6:0/3382945386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470032810 con 0x7f647c06d3d0 2024-05-20T18:03:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.160+0000 7f648276c640 1 -- 172.21.15.6:0/3382945386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 msgr2=0x7f647c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.160+0000 7f648276c640 1 --2- 172.21.15.6:0/3382945386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c06d7e0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f6470009870 tx=0x7f647002a270 comp rx=0 tx=0).stop 2024-05-20T18:03:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.160+0000 7f648276c640 1 -- 172.21.15.6:0/3382945386 shutdown_connections 2024-05-20T18:03:02.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.160+0000 7f648276c640 1 --2- 172.21.15.6:0/3382945386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c0b8190 0x7f647c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.160+0000 7f648276c640 1 --2- 172.21.15.6:0/3382945386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c06d7e0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.160+0000 7f648276c640 1 -- 172.21.15.6:0/3382945386 >> 172.21.15.6:0/3382945386 conn(0x7f647c0d4bd0 msgr2=0x7f647c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.160+0000 7f648276c640 1 -- 172.21.15.6:0/3382945386 shutdown_connections 2024-05-20T18:03:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.160+0000 7f648276c640 1 -- 172.21.15.6:0/3382945386 wait complete. 2024-05-20T18:03:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.162+0000 7f648276c640 1 Processor -- start 2024-05-20T18:03:02.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.162+0000 7f648276c640 1 -- start start 2024-05-20T18:03:02.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f648276c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f648276c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0b8190 0x7f647c1f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f648276c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c162820 0x7f647c1f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f648276c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0d0300 con 0x7f647c06d3d0 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f648276c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0d4260 con 0x7f647c0b8190 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f648276c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0b4050 con 0x7f647c162820 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f647bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f647bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c0b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55512/0 (socket says 172.21.15.6:55512) 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.163+0000 7f647bfff640 1 -- 172.21.15.6:0/3046980850 learned_addr learned my addr 172.21.15.6:0/3046980850 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:02.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f647b7fe640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0b8190 0x7f647c1f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f6480d09640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c162820 0x7f647c1f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f647bfff640 1 -- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c162820 msgr2=0x7f647c1f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f647bfff640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c162820 0x7f647c1f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f647bfff640 1 -- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0b8190 msgr2=0x7f647c1f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f647bfff640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0b8190 0x7f647c1f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f647bfff640 1 -- 172.21.15.6:0/3046980850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0b56c0 con 0x7f647c06d3d0 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f647b7fe640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0b8190 0x7f647c1f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f6480d09640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c162820 0x7f647c1f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f647bfff640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c0b4d20 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f646c00c3f0 tx=0x7f646c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f6478ff9640 1 -- 172.21.15.6:0/3046980850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c0052d0 con 0x7f647c06d3d0 2024-05-20T18:03:02.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f6478ff9640 1 -- 172.21.15.6:0/3046980850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c005490 con 0x7f647c06d3d0 2024-05-20T18:03:02.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f6478ff9640 1 -- 172.21.15.6:0/3046980850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c007260 con 0x7f647c06d3d0 2024-05-20T18:03:02.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c0b59a0 con 0x7f647c06d3d0 2024-05-20T18:03:02.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.164+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c14cec0 con 0x7f647c06d3d0 2024-05-20T18:03:02.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.165+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c075b00 con 0x7f647c06d3d0 2024-05-20T18:03:02.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.166+0000 7f6478ff9640 1 -- 172.21.15.6:0/3046980850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f646c007400 con 0x7f647c06d3d0 2024-05-20T18:03:02.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.166+0000 7f6478ff9640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f646806be30 0x7f646806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.166+0000 7f6478ff9640 1 -- 172.21.15.6:0/3046980850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f646c08a430 con 0x7f647c06d3d0 2024-05-20T18:03:02.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.167+0000 7f647b7fe640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f646806be30 0x7f646806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.167+0000 7f647b7fe640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f646806be30 0x7f646806e340 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6470034000 tx=0x7f647002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.171+0000 7f6478ff9640 1 -- 172.21.15.6:0/3046980850 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f647c06dd20 con 0x7f647c06d3d0 2024-05-20T18:03:02.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.356+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f647c160880 con 0x7f647c06d3d0 2024-05-20T18:03:02.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.356+0000 7f6478ff9640 1 -- 172.21.15.6:0/3046980850 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v148) ==== 93+0+10 (secure 0 0 0) 0x7f646c058ce0 con 0x7f647c06d3d0 2024-05-20T18:03:02.354 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:03:02.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f646806be30 msgr2=0x7f646806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f646806be30 0x7f646806e340 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6470034000 tx=0x7f647002e000 comp rx=0 tx=0).stop 2024-05-20T18:03:02.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 msgr2=0x7f647c0b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c0b4d20 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f646c00c3f0 tx=0x7f646c00c8b0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 shutdown_connections 2024-05-20T18:03:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f646806be30 0x7f646806e340 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f647c162820 0x7f647c1f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f647c0b8190 0x7f647c1f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 --2- 172.21.15.6:0/3046980850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f647c06d3d0 0x7f647c0b4d20 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 >> 172.21.15.6:0/3046980850 conn(0x7f647c0d4bd0 msgr2=0x7f647c15f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 shutdown_connections 2024-05-20T18:03:02.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.358+0000 7f648276c640 1 -- 172.21.15.6:0/3046980850 wait complete. 2024-05-20T18:03:02.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:03:02.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.487+0000 7f40ebe91640 1 Processor -- start 2024-05-20T18:03:02.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.488+0000 7f40ebe91640 1 -- start start 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40ebe91640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4168050 0x7f40e416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40ebe91640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e40d0630 con 0x7f40e4162820 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40ebe91640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e40d39c0 con 0x7f40e406d3d0 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40ebe91640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40e40d3ca0 con 0x7f40e4168050 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40e9c2d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40e4162820 0x7f40e40b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46856/0 (socket says 172.21.15.6:46856) 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40e9c2d640 1 -- 172.21.15.6:0/2661739946 learned_addr learned my addr 172.21.15.6:0/2661739946 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40ea42e640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4168050 0x7f40e416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185078861 0 0) 0x7f40e40d0630 con 0x7f40e4162820 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.489+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40d0003520 con 0x7f40e4162820 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3767494947 0 0) 0x7f40d0003520 con 0x7f40e4162820 2024-05-20T18:03:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4168050 msgr2=0x7f40e416a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4168050 0x7f40e416a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 >> v1:172.21.15.171:6789/0 conn(0x7f40e406d3d0 legacy=0x7f40e406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e40d3f80 con 0x7f40e4162820 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f40e00019f0 con 0x7f40e4162820 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 >> v1:172.21.15.6:6789/0 conn(0x7f40e4162820 legacy=0x7f40e40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40d0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40d0004800 0x7f40d0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4168050 0x7f40d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40e40d3ca0 con 0x7f40d00039e0 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40d000baf0 con 0x7f40d0004800 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40d000bcf0 con 0x7f40e4168050 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e9c2d640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40d0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40ea42e640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4168050 0x7f40d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e942c640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40d0004800 0x7f40d0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e9c2d640 1 -- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4168050 msgr2=0x7f40d0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e9c2d640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e4168050 0x7f40d0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e9c2d640 1 -- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40d0004800 msgr2=0x7f40d0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e9c2d640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40d0004800 0x7f40d0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.490+0000 7f40e9c2d640 1 -- 172.21.15.6:0/2661739946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d0003520 con 0x7f40d00039e0 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.491+0000 7f40e9c2d640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40d0003e50 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f40e000a810 tx=0x7f40d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900567d3e5b3de8e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.491+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e000a460 con 0x7f40d00039e0 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.491+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e002f070 con 0x7f40d00039e0 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.491+0000 7f40e8c2b640 1 -- 172.21.15.6:0/2661739946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e002bc90 con 0x7f40d00039e0 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.492+0000 7f40ebe91640 1 -- 172.21.15.6:0/2661739946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 msgr2=0x7f40d0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.492+0000 7f40ebe91640 1 --2- 172.21.15.6:0/2661739946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40d0003e50 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f40e000a810 tx=0x7f40d0005830 comp rx=0 tx=0).stop 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.492+0000 7f40ea42e640 1 -- 172.21.15.6:0/2661739946 reap_dead start 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.492+0000 7f40ebe91640 1 -- 172.21.15.6:0/2661739946 shutdown_connections 2024-05-20T18:03:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.492+0000 7f40ebe91640 1 -- 172.21.15.6:0/2661739946 >> 172.21.15.6:0/2661739946 conn(0x7f40e40d4bd0 msgr2=0x7f40e40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:02.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.492+0000 7f40ebe91640 1 -- 172.21.15.6:0/2661739946 shutdown_connections 2024-05-20T18:03:02.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.492+0000 7f40ebe91640 1 -- 172.21.15.6:0/2661739946 wait complete. 2024-05-20T18:03:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.494+0000 7f40ebe91640 1 Processor -- start 2024-05-20T18:03:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.494+0000 7f40ebe91640 1 -- start start 2024-05-20T18:03:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40ebe91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40e4150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40ebe91640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40e4150d20 0x7f40e40b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40ebe91640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e40b6ad0 0x7f40e40b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40ebe91640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40e40b91a0 con 0x7f40d00039e0 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40ebe91640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40e40d0300 con 0x7f40e4150d20 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40ebe91640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40e40b4050 con 0x7f40e40b6ad0 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40e9c2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40e4150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40e9c2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40e4150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55524/0 (socket says 172.21.15.6:55524) 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40e9c2d640 1 -- 172.21.15.6:0/1971917920 learned_addr learned my addr 172.21.15.6:0/1971917920 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40e942c640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40e4150d20 0x7f40e40b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.495+0000 7f40ea42e640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e40b6ad0 0x7f40e40b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40e9c2d640 1 -- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e40b6ad0 msgr2=0x7f40e40b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40e9c2d640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e40b6ad0 0x7f40e40b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40e9c2d640 1 -- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40e4150d20 msgr2=0x7f40e40b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40e9c2d640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40e4150d20 0x7f40e40b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40e9c2d640 1 -- 172.21.15.6:0/1971917920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e40b6ee0 con 0x7f40d00039e0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40e9c2d640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40e4150550 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f40e000a810 tx=0x7f40e40b7a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40da7fc640 1 -- 172.21.15.6:0/1971917920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e000a460 con 0x7f40d00039e0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40da7fc640 1 -- 172.21.15.6:0/1971917920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e0004d60 con 0x7f40d00039e0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e4158ae0 con 0x7f40d00039e0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40da7fc640 1 -- 172.21.15.6:0/1971917920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0001fb0 con 0x7f40d00039e0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.496+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e41590a0 con 0x7f40d00039e0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.497+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e40cf490 con 0x7f40d00039e0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.498+0000 7f40da7fc640 1 -- 172.21.15.6:0/1971917920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40e0034670 con 0x7f40d00039e0 2024-05-20T18:03:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.498+0000 7f40da7fc640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.499+0000 7f40da7fc640 1 -- 172.21.15.6:0/1971917920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f40e00ab5e0 con 0x7f40d00039e0 2024-05-20T18:03:02.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.499+0000 7f40e942c640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.499+0000 7f40e942c640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f40e4160ca0 tx=0x7f40d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.503+0000 7f40da7fc640 1 -- 172.21.15.6:0/1971917920 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f40e40cf490 con 0x7f40d00039e0 2024-05-20T18:03:02.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.687+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f40e4075b00 con 0x7f40d00039e0 2024-05-20T18:03:02.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.687+0000 7f40da7fc640 1 -- 172.21.15.6:0/1971917920 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) ==== 104+0+11 (secure 0 0 0) 0x7f40e40b6ee0 con 0x7f40d00039e0 2024-05-20T18:03:02.685 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 msgr2=0x7f40c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f40e4160ca0 tx=0x7f40d4009040 comp rx=0 tx=0).stop 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 msgr2=0x7f40e4150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40e4150550 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f40e000a810 tx=0x7f40e40b7a20 comp rx=0 tx=0).stop 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 shutdown_connections 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f40c806be30 0x7f40c806e340 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40e40b6ad0 0x7f40e40b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40e4150d20 0x7f40e40b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 --2- 172.21.15.6:0/1971917920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40d00039e0 0x7f40e4150550 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.689+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 >> 172.21.15.6:0/1971917920 conn(0x7f40e40d4bd0 msgr2=0x7f40e40b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.690+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 shutdown_connections 2024-05-20T18:03:02.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.690+0000 7f40ebe91640 1 -- 172.21.15.6:0/1971917920 wait complete. 2024-05-20T18:03:02.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:03:02.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.819+0000 7f322eb3e640 1 Processor -- start 2024-05-20T18:03:02.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.819+0000 7f322eb3e640 1 -- start start 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.820+0000 7f322eb3e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f322815d530 0x7f322815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.820+0000 7f322eb3e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32280b1700 0x7f32280b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.820+0000 7f322eb3e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32280cd580 con 0x7f3228070850 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.820+0000 7f322eb3e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f32280ce190 con 0x7f322815d530 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.820+0000 7f322eb3e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32280cd860 con 0x7f32280b1700 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.820+0000 7f322d0db640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3228070850 0x7f3228070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46870/0 (socket says 172.21.15.6:46870) 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.820+0000 7f322d0db640 1 -- 172.21.15.6:0/989977612 learned_addr learned my addr 172.21.15.6:0/989977612 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.820+0000 7f322c8da640 1 --2- 172.21.15.6:0/989977612 >> v2:172.21.15.171:3300/0 conn(0x7f322815d530 0x7f322815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f3227fff640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32280b1700 0x7f32280b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107775376 0 0) 0x7f32280cd580 con 0x7f3228070850 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3214003520 con 0x7f3228070850 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1628352033 0 0) 0x7f3214003520 con 0x7f3228070850 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32280b1700 msgr2=0x7f32280b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32280b1700 0x7f32280b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 >> v2:172.21.15.171:3300/0 conn(0x7f322815d530 msgr2=0x7f322815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 --2- 172.21.15.6:0/989977612 >> v2:172.21.15.171:3300/0 conn(0x7f322815d530 0x7f322815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32280cdb40 con 0x7f3228070850 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f3220001670 con 0x7f3228070850 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 >> v1:172.21.15.6:6789/0 conn(0x7f3228070850 legacy=0x7f3228070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f3214003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3214004800 0x7f3214004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214005150 0x7f321400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f32280ce190 con 0x7f32140039b0 2024-05-20T18:03:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32280cd860 con 0x7f3214005150 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f321400bf80 con 0x7f3214004800 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f3227fff640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32280b1700 0x7f32280b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f322c8da640 1 --2- 172.21.15.6:0/989977612 >> v2:172.21.15.171:3300/0 conn(0x7f322815d530 0x7f322815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f322c8da640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f3214003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f322d0db640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214005150 0x7f321400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f3227fff640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3214004800 0x7f3214004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f322c8da640 1 -- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3214004800 msgr2=0x7f3214004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f322c8da640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3214004800 0x7f3214004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f322c8da640 1 -- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214005150 msgr2=0x7f321400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.821+0000 7f322c8da640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3214005150 0x7f321400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.822+0000 7f322c8da640 1 -- 172.21.15.6:0/989977612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3214003520 con 0x7f32140039b0 2024-05-20T18:03:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.822+0000 7f322c8da640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f3214003e20 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f3210009c60 tx=0x7f3214005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9b47f998b81e57 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.822+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210036070 con 0x7f32140039b0 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.822+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3210031400 con 0x7f32140039b0 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.822+0000 7f32277fe640 1 -- 172.21.15.6:0/989977612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210009860 con 0x7f32140039b0 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.823+0000 7f322eb3e640 1 -- 172.21.15.6:0/989977612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 msgr2=0x7f3214003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.823+0000 7f322eb3e640 1 --2- 172.21.15.6:0/989977612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f3214003e20 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f3210009c60 tx=0x7f3214005830 comp rx=0 tx=0).stop 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.823+0000 7f322d0db640 1 -- 172.21.15.6:0/989977612 reap_dead start 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.823+0000 7f322eb3e640 1 -- 172.21.15.6:0/989977612 shutdown_connections 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.823+0000 7f322eb3e640 1 -- 172.21.15.6:0/989977612 >> 172.21.15.6:0/989977612 conn(0x7f32280d29d0 msgr2=0x7f32280d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.823+0000 7f322eb3e640 1 -- 172.21.15.6:0/989977612 shutdown_connections 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.823+0000 7f322eb3e640 1 -- 172.21.15.6:0/989977612 wait complete. 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.825+0000 7f322eb3e640 1 Processor -- start 2024-05-20T18:03:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.825+0000 7f322eb3e640 1 -- start start 2024-05-20T18:03:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.826+0000 7f322eb3e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f322815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.826+0000 7f322eb3e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3228157ee0 0x7f32281545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.826+0000 7f322eb3e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32281582f0 0x7f3228154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.826+0000 7f322eb3e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f3228071370 con 0x7f32140039b0 2024-05-20T18:03:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.826+0000 7f322eb3e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32280cd230 con 0x7f32281582f0 2024-05-20T18:03:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.826+0000 7f322eb3e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32280714f0 con 0x7f3228157ee0 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f322815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f322815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55548/0 (socket says 172.21.15.6:55548) 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 -- 172.21.15.6:0/4182219383 learned_addr learned my addr 172.21.15.6:0/4182219383 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f3227fff640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3228157ee0 0x7f32281545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322d0db640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32281582f0 0x7f3228154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 -- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3228157ee0 msgr2=0x7f32281545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3228157ee0 0x7f32281545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 -- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32281582f0 msgr2=0x7f3228154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32281582f0 0x7f3228154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 -- 172.21.15.6:0/4182219383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322815ba80 con 0x7f32140039b0 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322d0db640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32281582f0 0x7f3228154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f3227fff640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3228157ee0 0x7f32281545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322c8da640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f322815ca60 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f3210009c60 tx=0x7f3210004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f32257fa640 1 -- 172.21.15.6:0/4182219383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210040020 con 0x7f32140039b0 2024-05-20T18:03:02.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f32257fa640 1 -- 172.21.15.6:0/4182219383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321003b6a0 con 0x7f32140039b0 2024-05-20T18:03:02.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f32257fa640 1 -- 172.21.15.6:0/4182219383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210036040 con 0x7f32140039b0 2024-05-20T18:03:02.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322815bd60 con 0x7f32140039b0 2024-05-20T18:03:02.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.827+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322806c6d0 con 0x7f32140039b0 2024-05-20T18:03:02.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.828+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3228075b00 con 0x7f32140039b0 2024-05-20T18:03:02.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.829+0000 7f32257fa640 1 -- 172.21.15.6:0/4182219383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3210043020 con 0x7f32140039b0 2024-05-20T18:03:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.829+0000 7f32257fa640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320806be30 0x7f320806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.830+0000 7f32257fa640 1 -- 172.21.15.6:0/4182219383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f32100ab550 con 0x7f32140039b0 2024-05-20T18:03:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.830+0000 7f3227fff640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320806be30 0x7f320806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.830+0000 7f3227fff640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320806be30 0x7f320806e340 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3218009fd0 tx=0x7f321800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:02.834+0000 7f32257fa640 1 -- 172.21.15.6:0/4182219383 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f321004a070 con 0x7f32140039b0 2024-05-20T18:03:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.017+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f32280c6180 con 0x7f32140039b0 2024-05-20T18:03:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.017+0000 7f32257fa640 1 -- 172.21.15.6:0/4182219383 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) ==== 100+0+11 (secure 0 0 0) 0x7f3210031e20 con 0x7f32140039b0 2024-05-20T18:03:03.015 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:03:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.019+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320806be30 msgr2=0x7f320806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.019+0000 7f322eb3e640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320806be30 0x7f320806e340 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3218009fd0 tx=0x7f321800b040 comp rx=0 tx=0).stop 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.019+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 msgr2=0x7f322815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.019+0000 7f322eb3e640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f322815ca60 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f3210009c60 tx=0x7f3210004730 comp rx=0 tx=0).stop 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.019+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 shutdown_connections 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.020+0000 7f322eb3e640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f320806be30 0x7f320806e340 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.020+0000 7f322eb3e640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32281582f0 0x7f3228154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.020+0000 7f322eb3e640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3228157ee0 0x7f32281545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.020+0000 7f322eb3e640 1 --2- 172.21.15.6:0/4182219383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32140039b0 0x7f322815ca60 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.020+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 >> 172.21.15.6:0/4182219383 conn(0x7f32280d29d0 msgr2=0x7f322815e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.020+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 shutdown_connections 2024-05-20T18:03:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.020+0000 7f322eb3e640 1 -- 172.21.15.6:0/4182219383 wait complete. 2024-05-20T18:03:03.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:03:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.147+0000 7f96da86e640 1 Processor -- start 2024-05-20T18:03:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.147+0000 7f96da86e640 1 -- start start 2024-05-20T18:03:03.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.148+0000 7f96da86e640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f96d40b1e10 0x7f96d415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.148+0000 7f96da86e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d40cd580 con 0x7f96d415d530 2024-05-20T18:03:03.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.148+0000 7f96da86e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96d40cd860 con 0x7f96d4070850 2024-05-20T18:03:03.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.148+0000 7f96da86e640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f96d40ce190 con 0x7f96d40b1e10 2024-05-20T18:03:03.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.148+0000 7f96d3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f96d415d530 0x7f96d40b1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46882/0 (socket says 172.21.15.6:46882) 2024-05-20T18:03:03.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.148+0000 7f96d3fff640 1 -- 172.21.15.6:0/4223118044 learned_addr learned my addr 172.21.15.6:0/4223118044 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:03.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.149+0000 7f96d37fe640 1 --2- 172.21.15.6:0/4223118044 >> v2:172.21.15.171:3300/0 conn(0x7f96d40b1e10 0x7f96d415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.149+0000 7f96d2ffd640 1 -- 172.21.15.6:0/4223118044 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707888635 0 0) 0x7f96d40cd580 con 0x7f96d415d530 2024-05-20T18:03:03.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.149+0000 7f96d2ffd640 1 -- 172.21.15.6:0/4223118044 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96bc003520 con 0x7f96d415d530 2024-05-20T18:03:03.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.149+0000 7f96d37fe640 1 -- 172.21.15.6:0/4223118044 >> v1:172.21.15.171:6789/0 conn(0x7f96d4070850 legacy=0x7f96d4070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.149+0000 7f96d37fe640 1 -- 172.21.15.6:0/4223118044 >> v1:172.21.15.6:6789/0 conn(0x7f96d415d530 legacy=0x7f96d40b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.149+0000 7f96d37fe640 1 -- 172.21.15.6:0/4223118044 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d40cdb40 con 0x7f96d40b1e10 2024-05-20T18:03:03.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.150+0000 7f96d37fe640 1 --2- 172.21.15.6:0/4223118044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 0x7f96d415aaa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f96c80097a0 tx=0x7f96c802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7a760fabd054321 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.150+0000 7f96d2ffd640 1 -- 172.21.15.6:0/4223118044 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8037070 con 0x7f96d40b1e10 2024-05-20T18:03:03.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.150+0000 7f96d2ffd640 1 -- 172.21.15.6:0/4223118044 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c8032440 con 0x7f96d40b1e10 2024-05-20T18:03:03.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.150+0000 7f96d2ffd640 1 -- 172.21.15.6:0/4223118044 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c8032810 con 0x7f96d40b1e10 2024-05-20T18:03:03.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.151+0000 7f96da86e640 1 -- 172.21.15.6:0/4223118044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 msgr2=0x7f96d415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.151+0000 7f96da86e640 1 --2- 172.21.15.6:0/4223118044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 0x7f96d415aaa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f96c80097a0 tx=0x7f96c802a230 comp rx=0 tx=0).stop 2024-05-20T18:03:03.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.151+0000 7f96da86e640 1 -- 172.21.15.6:0/4223118044 shutdown_connections 2024-05-20T18:03:03.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.151+0000 7f96da86e640 1 --2- 172.21.15.6:0/4223118044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 0x7f96d415aaa0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.151+0000 7f96da86e640 1 -- 172.21.15.6:0/4223118044 >> 172.21.15.6:0/4223118044 conn(0x7f96d40d29d0 msgr2=0x7f96d40d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:03.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.151+0000 7f96da86e640 1 -- 172.21.15.6:0/4223118044 shutdown_connections 2024-05-20T18:03:03.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.151+0000 7f96da86e640 1 -- 172.21.15.6:0/4223118044 wait complete. 2024-05-20T18:03:03.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.152+0000 7f96da86e640 1 Processor -- start 2024-05-20T18:03:03.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.153+0000 7f96da86e640 1 -- start start 2024-05-20T18:03:03.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96da86e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d4070850 0x7f96d414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96da86e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 0x7f96d40cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96da86e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d415d530 0x7f96d40cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96da86e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4071370 con 0x7f96d415d530 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96da86e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f96d40cd230 con 0x7f96d40b1e10 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96da86e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f96d40714f0 con 0x7f96d4070850 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d8e0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d415d530 0x7f96d40cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d8e0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d415d530 0x7f96d40cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55562/0 (socket says 172.21.15.6:55562) 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d8e0b640 1 -- 172.21.15.6:0/2179784504 learned_addr learned my addr 172.21.15.6:0/2179784504 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d37fe640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 0x7f96d40cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d3fff640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d4070850 0x7f96d414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d8e0b640 1 -- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d4070850 msgr2=0x7f96d414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d8e0b640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d4070850 0x7f96d414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d8e0b640 1 -- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 msgr2=0x7f96d40cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.154+0000 7f96d8e0b640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 0x7f96d40cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.155+0000 7f96d8e0b640 1 -- 172.21.15.6:0/2179784504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d40cb050 con 0x7f96d415d530 2024-05-20T18:03:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.155+0000 7f96d8e0b640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d415d530 0x7f96d40cc3b0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00c680 tx=0x7f96cc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.155+0000 7f96d0ff9640 1 -- 172.21.15.6:0/2179784504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc003b70 con 0x7f96d415d530 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.155+0000 7f96d0ff9640 1 -- 172.21.15.6:0/2179784504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96cc003d10 con 0x7f96d415d530 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.155+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d40c70b0 con 0x7f96d415d530 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.155+0000 7f96d0ff9640 1 -- 172.21.15.6:0/2179784504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc005310 con 0x7f96d415d530 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.155+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d40c9220 con 0x7f96d415d530 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.156+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d4075b00 con 0x7f96d415d530 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.157+0000 7f96d0ff9640 1 -- 172.21.15.6:0/2179784504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96cc0054b0 con 0x7f96d415d530 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.157+0000 7f96d0ff9640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f96c006be60 0x7f96c006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.157+0000 7f96d0ff9640 1 -- 172.21.15.6:0/2179784504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f96cc08aec0 con 0x7f96d415d530 2024-05-20T18:03:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.158+0000 7f96d3fff640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f96c006be60 0x7f96c006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.158+0000 7f96d3fff640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f96c006be60 0x7f96c006e370 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f96c40011e0 tx=0x7f96c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.162+0000 7f96d0ff9640 1 -- 172.21.15.6:0/2179784504 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f96cc059650 con 0x7f96d415d530 2024-05-20T18:03:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.357+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96d40d1190 con 0x7f96d415d530 2024-05-20T18:03:03.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.358+0000 7f96d0ff9640 1 -- 172.21.15.6:0/2179784504 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v148) ==== 80+0+0 (secure 0 0 0) 0x7f96cc058f50 con 0x7f96d415d530 2024-05-20T18:03:03.356 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.359+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f96c006be60 msgr2=0x7f96c006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.359+0000 7f96da86e640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f96c006be60 0x7f96c006e370 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f96c40011e0 tx=0x7f96c4009040 comp rx=0 tx=0).stop 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.359+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d415d530 msgr2=0x7f96d40cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.359+0000 7f96da86e640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d415d530 0x7f96d40cc3b0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00c680 tx=0x7f96cc00cb40 comp rx=0 tx=0).stop 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.359+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 shutdown_connections 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.359+0000 7f96da86e640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f96c006be60 0x7f96c006e370 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.359+0000 7f96da86e640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96d415d530 0x7f96d40cc3b0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.359+0000 7f96da86e640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96d40b1e10 0x7f96d40cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.360+0000 7f96da86e640 1 --2- 172.21.15.6:0/2179784504 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f96d4070850 0x7f96d414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.360+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 >> 172.21.15.6:0/2179784504 conn(0x7f96d40d29d0 msgr2=0x7f96d415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.360+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 shutdown_connections 2024-05-20T18:03:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.360+0000 7f96da86e640 1 -- 172.21.15.6:0/2179784504 wait complete. 2024-05-20T18:03:03.369 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-20T18:03:03.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:03.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-20T18:03:03.399 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:03:03.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:03.400 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-20T18:03:03.457 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:03:03.457 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:03:03.457 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:03.477 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:03:03.477 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:03.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:03:03.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.653+0000 7fdf019ff640 1 Processor -- start 2024-05-20T18:03:03.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.653+0000 7fdf019ff640 1 -- start start 2024-05-20T18:03:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.654+0000 7fdf019ff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdefc0b7f40 0x7fdefc0d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.654+0000 7fdf019ff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdefc0d1440 0x7fdefc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdf019ff640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdefc06dca0 con 0x7fdefc06cb70 2024-05-20T18:03:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdf019ff640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdefc09be50 con 0x7fdefc0b7f40 2024-05-20T18:03:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdf019ff640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdefc06d6e0 con 0x7fdefc0d1440 2024-05-20T18:03:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdefc0b7f40 0x7fdefc0d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdefc06cb70 0x7fdefc1634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46896/0 (socket says 172.21.15.6:46896) 2024-05-20T18:03:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdefc0b7f40 0x7fdefc0d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55574/0 (socket says 172.21.15.6:55574) 2024-05-20T18:03:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefb7fe640 1 -- 172.21.15.6:0/4100456710 learned_addr learned my addr 172.21.15.6:0/4100456710 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefa7fc640 1 --2- 172.21.15.6:0/4100456710 >> v2:172.21.15.171:3300/0 conn(0x7fdefc0d1440 0x7fdefc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefaffd640 1 -- 172.21.15.6:0/4100456710 >> v2:172.21.15.171:3300/0 conn(0x7fdefc0d1440 msgr2=0x7fdefc06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefaffd640 1 --2- 172.21.15.6:0/4100456710 >> v2:172.21.15.171:3300/0 conn(0x7fdefc0d1440 0x7fdefc06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefaffd640 1 -- 172.21.15.6:0/4100456710 >> v1:172.21.15.6:6789/0 conn(0x7fdefc06cb70 legacy=0x7fdefc1634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdef9ffb640 1 -- 172.21.15.6:0/4100456710 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947529971 0 0) 0x7fdef4001490 con 0x7fdefc06cb70 2024-05-20T18:03:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.655+0000 7fdefaffd640 1 -- 172.21.15.6:0/4100456710 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc06d9c0 con 0x7fdefc0b7f40 2024-05-20T18:03:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.656+0000 7fdefaffd640 1 --2- 172.21.15.6:0/4100456710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0b7f40 0x7fdefc0d0f00 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0d23f0 tx=0x7fdeec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51401b554abca05 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.656+0000 7fdef9ffb640 1 -- 172.21.15.6:0/4100456710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec037070 con 0x7fdefc0b7f40 2024-05-20T18:03:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.656+0000 7fdef9ffb640 1 -- 172.21.15.6:0/4100456710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeec032440 con 0x7fdefc0b7f40 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.656+0000 7fdef9ffb640 1 -- 172.21.15.6:0/4100456710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec02ae60 con 0x7fdefc0b7f40 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.657+0000 7fdf019ff640 1 -- 172.21.15.6:0/4100456710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0b7f40 msgr2=0x7fdefc0d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.657+0000 7fdf019ff640 1 --2- 172.21.15.6:0/4100456710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0b7f40 0x7fdefc0d0f00 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0d23f0 tx=0x7fdeec02a110 comp rx=0 tx=0).stop 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.657+0000 7fdf019ff640 1 -- 172.21.15.6:0/4100456710 shutdown_connections 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.657+0000 7fdf019ff640 1 --2- 172.21.15.6:0/4100456710 >> v2:172.21.15.171:3300/0 conn(0x7fdefc0d1440 0x7fdefc06c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.657+0000 7fdf019ff640 1 --2- 172.21.15.6:0/4100456710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0b7f40 0x7fdefc0d0f00 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.657+0000 7fdf019ff640 1 -- 172.21.15.6:0/4100456710 >> 172.21.15.6:0/4100456710 conn(0x7fdefc0cf270 msgr2=0x7fdefc0cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.657+0000 7fdf019ff640 1 -- 172.21.15.6:0/4100456710 shutdown_connections 2024-05-20T18:03:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.657+0000 7fdf019ff640 1 -- 172.21.15.6:0/4100456710 wait complete. 2024-05-20T18:03:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.659+0000 7fdf019ff640 1 Processor -- start 2024-05-20T18:03:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.659+0000 7fdf019ff640 1 -- start start 2024-05-20T18:03:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdf019ff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdefc06cb70 0x7fdefc1f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdf019ff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdefc0b7f40 0x7fdefc1dcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdf019ff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0d1440 0x7fdefc09f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdf019ff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc08bc70 con 0x7fdefc0d1440 2024-05-20T18:03:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdf019ff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc08baf0 con 0x7fdefc0b7f40 2024-05-20T18:03:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdf019ff640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdefc0ce510 con 0x7fdefc06cb70 2024-05-20T18:03:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdefb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0d1440 0x7fdefc09f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdefb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0d1440 0x7fdefc09f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55582/0 (socket says 172.21.15.6:55582) 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdefb7fe640 1 -- 172.21.15.6:0/2613699505 learned_addr learned my addr 172.21.15.6:0/2613699505 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdefaffd640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdefc06cb70 0x7fdefc1f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.660+0000 7fdefa7fc640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdefc0b7f40 0x7fdefc1dcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdefb7fe640 1 -- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdefc06cb70 msgr2=0x7fdefc1f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdefb7fe640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdefc06cb70 0x7fdefc1f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdefb7fe640 1 -- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdefc0b7f40 msgr2=0x7fdefc1dcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdefb7fe640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdefc0b7f40 0x7fdefc1dcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdefb7fe640 1 -- 172.21.15.6:0/2613699505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc0b1950 con 0x7fdefc0d1440 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdefb7fe640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0d1440 0x7fdefc09f570 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c700 tx=0x7fdef400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdef3fff640 1 -- 172.21.15.6:0/2613699505 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4018070 con 0x7fdefc0d1440 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdef3fff640 1 -- 172.21.15.6:0/2613699505 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef400ce10 con 0x7fdefc0d1440 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdefc0b1390 con 0x7fdefc0d1440 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdef3fff640 1 -- 172.21.15.6:0/2613699505 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef400a880 con 0x7fdefc0d1440 2024-05-20T18:03:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.661+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdefc0b1d20 con 0x7fdefc0d1440 2024-05-20T18:03:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.662+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdefc070770 con 0x7fdefc0d1440 2024-05-20T18:03:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.663+0000 7fdef3fff640 1 -- 172.21.15.6:0/2613699505 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdef401b070 con 0x7fdefc0d1440 2024-05-20T18:03:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.663+0000 7fdef3fff640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdedc06be30 0x7fdedc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.664+0000 7fdef3fff640 1 -- 172.21.15.6:0/2613699505 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fdef408a5b0 con 0x7fdefc0d1440 2024-05-20T18:03:03.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.664+0000 7fdefaffd640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdedc06be30 0x7fdedc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.664+0000 7fdefaffd640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdedc06be30 0x7fdedc06e340 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdeec034000 tx=0x7fdeec02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.668+0000 7fdef3fff640 1 -- 172.21.15.6:0/2613699505 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdefc070770 con 0x7fdefc0d1440 2024-05-20T18:03:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.853+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdefc0b1b20 con 0x7fdefc0d1440 2024-05-20T18:03:03.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.854+0000 7fdef3fff640 1 -- 172.21.15.6:0/2613699505 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) ==== 74+0+16836 (secure 0 0 0) 0x7fdefc06dca0 con 0x7fdefc0d1440 2024-05-20T18:03:03.852 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:03.853 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":148,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:54.405297+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:51.154710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:51.763678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdedc06be30 msgr2=0x7fdedc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdedc06be30 0x7fdedc06e340 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdeec034000 tx=0x7fdeec02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0d1440 msgr2=0x7fdefc09f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0d1440 0x7fdefc09f570 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c700 tx=0x7fdef400cbc0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 shutdown_connections 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdedc06be30 0x7fdedc06e340 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdefc0d1440 0x7fdefc09f570 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdefc0b7f40 0x7fdefc1dcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 --2- 172.21.15.6:0/2613699505 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdefc06cb70 0x7fdefc1f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.856+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 >> 172.21.15.6:0/2613699505 conn(0x7fdefc0cf270 msgr2=0x7fdefc0b5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.857+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 shutdown_connections 2024-05-20T18:03:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.857+0000 7fdf019ff640 1 -- 172.21.15.6:0/2613699505 wait complete. 2024-05-20T18:03:03.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:02:51.154710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:02:51.763678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:03:03.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:03:03.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.986+0000 7f73cde21640 1 Processor -- start 2024-05-20T18:03:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.986+0000 7f73cde21640 1 -- start start 2024-05-20T18:03:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73cde21640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f73c806d3d0 0x7f73c806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73cde21640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c80b8190 0x7f73c80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73cde21640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c806dd20 con 0x7f73c8162820 2024-05-20T18:03:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73cde21640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f73c80d0630 con 0x7f73c806d3d0 2024-05-20T18:03:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73cde21640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f73c80d39c0 con 0x7f73c80b8190 2024-05-20T18:03:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73c7fff640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c80b8190 0x7f73c80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73c6ffd640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f73c806d3d0 0x7f73c806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73c77fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f73c8162820 0x7f73c80b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:41732/0 (socket says 172.21.15.6:41732) 2024-05-20T18:03:03.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.988+0000 7f73c77fe640 1 -- 172.21.15.6:0/1587355274 learned_addr learned my addr 172.21.15.6:0/1587355274 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.989+0000 7f73c6ffd640 1 -- 172.21.15.6:0/1587355274 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c80b8190 msgr2=0x7f73c80b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.989+0000 7f73c6ffd640 1 --2- 172.21.15.6:0/1587355274 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c80b8190 0x7f73c80b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.989+0000 7f73c6ffd640 1 -- 172.21.15.6:0/1587355274 >> v1:172.21.15.171:6789/0 conn(0x7f73c8162820 legacy=0x7f73c80b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.989+0000 7f73c6ffd640 1 -- 172.21.15.6:0/1587355274 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c80d3ca0 con 0x7f73c806d3d0 2024-05-20T18:03:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.989+0000 7f73c6ffd640 1 --2- 172.21.15.6:0/1587355274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c806d3d0 0x7f73c806d7e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0097a0 tx=0x7f73bc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a997857e8f1f0d37 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73c67fc640 1 -- 172.21.15.6:0/1587355274 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc037070 con 0x7f73c806d3d0 2024-05-20T18:03:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73c67fc640 1 -- 172.21.15.6:0/1587355274 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73bc032440 con 0x7f73c806d3d0 2024-05-20T18:03:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73c67fc640 1 -- 172.21.15.6:0/1587355274 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc032810 con 0x7f73c806d3d0 2024-05-20T18:03:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73cde21640 1 -- 172.21.15.6:0/1587355274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c806d3d0 msgr2=0x7f73c806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73cde21640 1 --2- 172.21.15.6:0/1587355274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c806d3d0 0x7f73c806d7e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f73bc0097a0 tx=0x7f73bc02a180 comp rx=0 tx=0).stop 2024-05-20T18:03:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73cde21640 1 -- 172.21.15.6:0/1587355274 shutdown_connections 2024-05-20T18:03:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73cde21640 1 --2- 172.21.15.6:0/1587355274 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c80b8190 0x7f73c80b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73cde21640 1 --2- 172.21.15.6:0/1587355274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c806d3d0 0x7f73c806d7e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.990+0000 7f73cde21640 1 -- 172.21.15.6:0/1587355274 >> 172.21.15.6:0/1587355274 conn(0x7f73c80d4bd0 msgr2=0x7f73c80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.991+0000 7f73cde21640 1 -- 172.21.15.6:0/1587355274 shutdown_connections 2024-05-20T18:03:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.991+0000 7f73cde21640 1 -- 172.21.15.6:0/1587355274 wait complete. 2024-05-20T18:03:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.992+0000 7f73cde21640 1 Processor -- start 2024-05-20T18:03:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.993+0000 7f73cde21640 1 -- start start 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73cde21640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73c806d3d0 0x7f73c814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73cde21640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c80b8190 0x7f73c80c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73cde21640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c8162820 0x7f73c80c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73cde21640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f73c80d0300 con 0x7f73c806d3d0 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73cde21640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f73c80d4260 con 0x7f73c80b8190 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73cde21640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f73c80b4050 con 0x7f73c8162820 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73c806d3d0 0x7f73c814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73c806d3d0 0x7f73c814e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55590/0 (socket says 172.21.15.6:55590) 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c77fe640 1 -- 172.21.15.6:0/2012399854 learned_addr learned my addr 172.21.15.6:0/2012399854 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c7fff640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c8162820 0x7f73c80c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c6ffd640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c80b8190 0x7f73c80c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c77fe640 1 -- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c8162820 msgr2=0x7f73c80c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c77fe640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c8162820 0x7f73c80c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c77fe640 1 -- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c80b8190 msgr2=0x7f73c80c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c77fe640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c80b8190 0x7f73c80c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.994+0000 7f73c77fe640 1 -- 172.21.15.6:0/2012399854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c814e840 con 0x7f73c806d3d0 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.995+0000 7f73c77fe640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73c806d3d0 0x7f73c814e300 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f73b800c3f0 tx=0x7f73b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.995+0000 7f73affff640 1 -- 172.21.15.6:0/2012399854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8017070 con 0x7f73c806d3d0 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.995+0000 7f73affff640 1 -- 172.21.15.6:0/2012399854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b8005ce0 con 0x7f73c806d3d0 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.995+0000 7f73affff640 1 -- 172.21.15.6:0/2012399854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80072f0 con 0x7f73c806d3d0 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.995+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c80b5c60 con 0x7f73c806d3d0 2024-05-20T18:03:03.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.995+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c80c8eb0 con 0x7f73c806d3d0 2024-05-20T18:03:03.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.996+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c80b6180 con 0x7f73c806d3d0 2024-05-20T18:03:03.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.997+0000 7f73affff640 1 -- 172.21.15.6:0/2012399854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73b801a070 con 0x7f73c806d3d0 2024-05-20T18:03:03.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.997+0000 7f73affff640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f73b406be30 0x7f73b406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:03.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.997+0000 7f73affff640 1 -- 172.21.15.6:0/2012399854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f73b808a3a0 con 0x7f73c806d3d0 2024-05-20T18:03:03.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.998+0000 7f73c6ffd640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f73b406be30 0x7f73b406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:03.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:03.998+0000 7f73c6ffd640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f73b406be30 0x7f73b406e340 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f73bc034000 tx=0x7f73bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:03.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.002+0000 7f73affff640 1 -- 172.21.15.6:0/2012399854 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f73c80b6180 con 0x7f73c806d3d0 2024-05-20T18:03:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.185+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73c8075b00 con 0x7f73c806d3d0 2024-05-20T18:03:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.186+0000 7f73affff640 1 -- 172.21.15.6:0/2012399854 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v148) ==== 93+0+10 (secure 0 0 0) 0x7f73c806dd20 con 0x7f73c806d3d0 2024-05-20T18:03:04.184 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:03:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f73b406be30 msgr2=0x7f73b406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f73b406be30 0x7f73b406e340 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f73bc034000 tx=0x7f73bc02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73c806d3d0 msgr2=0x7f73c814e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73c806d3d0 0x7f73c814e300 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f73b800c3f0 tx=0x7f73b800c8b0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 shutdown_connections 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f73b406be30 0x7f73b406e340 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f73c8162820 0x7f73c80c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f73c80b8190 0x7f73c80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 --2- 172.21.15.6:0/2012399854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73c806d3d0 0x7f73c814e300 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 >> 172.21.15.6:0/2012399854 conn(0x7f73c80d4bd0 msgr2=0x7f73c815f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 shutdown_connections 2024-05-20T18:03:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.188+0000 7f73cde21640 1 -- 172.21.15.6:0/2012399854 wait complete. 2024-05-20T18:03:04.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:03:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.317+0000 7f7ec6a84640 1 Processor -- start 2024-05-20T18:03:04.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.317+0000 7f7ec6a84640 1 -- start start 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.318+0000 7f7ec6a84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec00d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.318+0000 7f7ec6a84640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec00d0370 con 0x7f7ec0163a10 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.318+0000 7f7ec6a84640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec00d0650 con 0x7f7ec00b4010 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.318+0000 7f7ec6a84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00d3ca0 con 0x7f7ec00d1bc0 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.318+0000 7f7ec4820640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7ec0163a10 0x7f7ec00cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46900/0 (socket says 172.21.15.6:46900) 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.318+0000 7f7ec4820640 1 -- 172.21.15.6:0/1804582836 learned_addr learned my addr 172.21.15.6:0/1804582836 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.319+0000 7f7ec5021640 1 --2- 172.21.15.6:0/1804582836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec00d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.319+0000 7f7ebf7fe640 1 -- 172.21.15.6:0/1804582836 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206116370 0 0) 0x7f7ec00d0370 con 0x7f7ec0163a10 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.319+0000 7f7ebf7fe640 1 -- 172.21.15.6:0/1804582836 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb0003520 con 0x7f7ec0163a10 2024-05-20T18:03:04.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.319+0000 7f7ebf7fe640 1 -- 172.21.15.6:0/1804582836 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171835365 0 0) 0x7f7ec00d0650 con 0x7f7ec00b4010 2024-05-20T18:03:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.319+0000 7f7ebf7fe640 1 -- 172.21.15.6:0/1804582836 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ec00d0370 con 0x7f7ec00b4010 2024-05-20T18:03:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.319+0000 7f7ec5021640 1 -- 172.21.15.6:0/1804582836 >> v1:172.21.15.171:6789/0 conn(0x7f7ec00b4010 legacy=0x7f7ec00d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.319+0000 7f7ec5021640 1 -- 172.21.15.6:0/1804582836 >> v1:172.21.15.6:6789/0 conn(0x7f7ec0163a10 legacy=0x7f7ec00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.319+0000 7f7ec5021640 1 -- 172.21.15.6:0/1804582836 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec00d3650 con 0x7f7ec00d1bc0 2024-05-20T18:03:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.320+0000 7f7ec5021640 1 --2- 172.21.15.6:0/1804582836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec00d4130 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009dc0 tx=0x7f7eb802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f89e549ae66196 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.320+0000 7f7ebf7fe640 1 -- 172.21.15.6:0/1804582836 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8007740 con 0x7f7ec00d1bc0 2024-05-20T18:03:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.320+0000 7f7ebf7fe640 1 -- 172.21.15.6:0/1804582836 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb80078e0 con 0x7f7ec00d1bc0 2024-05-20T18:03:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.320+0000 7f7ebf7fe640 1 -- 172.21.15.6:0/1804582836 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8007c90 con 0x7f7ec00d1bc0 2024-05-20T18:03:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.321+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1804582836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 msgr2=0x7f7ec00d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.321+0000 7f7ec6a84640 1 --2- 172.21.15.6:0/1804582836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec00d4130 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009dc0 tx=0x7f7eb802a6d0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.321+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1804582836 shutdown_connections 2024-05-20T18:03:04.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.321+0000 7f7ec6a84640 1 --2- 172.21.15.6:0/1804582836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec00d4130 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.321+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1804582836 >> 172.21.15.6:0/1804582836 conn(0x7f7ec006d240 msgr2=0x7f7ec006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.321+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1804582836 shutdown_connections 2024-05-20T18:03:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.321+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1804582836 wait complete. 2024-05-20T18:03:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.322+0000 7f7ec6a84640 1 Processor -- start 2024-05-20T18:03:04.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.323+0000 7f7ec6a84640 1 -- start start 2024-05-20T18:03:04.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec6a84640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec00b4010 0x7f7ec01551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec6a84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec6a84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ec0163a10 0x7f7ec0157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec6a84640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00b8390 con 0x7f7ec00b4010 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec6a84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00b8210 con 0x7f7ec0163a10 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec6a84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00b8510 con 0x7f7ec00d1bc0 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec4820640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec00b4010 0x7f7ec01551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec4820640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec00b4010 0x7f7ec01551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55596/0 (socket says 172.21.15.6:55596) 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec4820640 1 -- 172.21.15.6:0/1957964498 learned_addr learned my addr 172.21.15.6:0/1957964498 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ebffff640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec5021640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ec0163a10 0x7f7ec0157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec4820640 1 -- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 msgr2=0x7f7ec0155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec4820640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec0155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec4820640 1 -- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ec0163a10 msgr2=0x7f7ec0157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec4820640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ec0163a10 0x7f7ec0157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec4820640 1 -- 172.21.15.6:0/1957964498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec01541a0 con 0x7f7ec00b4010 2024-05-20T18:03:04.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ebffff640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.324+0000 7f7ec5021640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ec0163a10 0x7f7ec0157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.325+0000 7f7ec4820640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec00b4010 0x7f7ec01551d0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400c410 tx=0x7f7eb400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.325+0000 7f7ebd7fa640 1 -- 172.21.15.6:0/1957964498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4017070 con 0x7f7ec00b4010 2024-05-20T18:03:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.325+0000 7f7ebd7fa640 1 -- 172.21.15.6:0/1957964498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb4005ce0 con 0x7f7ec00b4010 2024-05-20T18:03:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.325+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec0154410 con 0x7f7ec00b4010 2024-05-20T18:03:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.325+0000 7f7ebd7fa640 1 -- 172.21.15.6:0/1957964498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40072d0 con 0x7f7ec00b4010 2024-05-20T18:03:04.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.325+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec01549d0 con 0x7f7ec00b4010 2024-05-20T18:03:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.326+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec0075b00 con 0x7f7ec00b4010 2024-05-20T18:03:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.326+0000 7f7ebd7fa640 1 -- 172.21.15.6:0/1957964498 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7eb401a070 con 0x7f7ec00b4010 2024-05-20T18:03:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.327+0000 7f7ebd7fa640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ea406be60 0x7f7ea406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.327+0000 7f7ebd7fa640 1 -- 172.21.15.6:0/1957964498 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f7eb408a300 con 0x7f7ec00b4010 2024-05-20T18:03:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.328+0000 7f7ebffff640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ea406be60 0x7f7ea406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.328+0000 7f7ebffff640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ea406be60 0x7f7ea406e370 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00b7660 tx=0x7f7eac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.332+0000 7f7ebd7fa640 1 -- 172.21.15.6:0/1957964498 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7eb4058440 con 0x7f7ec00b4010 2024-05-20T18:03:04.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.516+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7ec00d3050 con 0x7f7ec00b4010 2024-05-20T18:03:04.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.516+0000 7f7ebd7fa640 1 -- 172.21.15.6:0/1957964498 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) ==== 104+0+11 (secure 0 0 0) 0x7f7eb405c740 con 0x7f7ec00b4010 2024-05-20T18:03:04.514 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:03:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ea406be60 msgr2=0x7f7ea406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ea406be60 0x7f7ea406e370 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00b7660 tx=0x7f7eac009040 comp rx=0 tx=0).stop 2024-05-20T18:03:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec00b4010 msgr2=0x7f7ec01551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec00b4010 0x7f7ec01551d0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400c410 tx=0x7f7eb400c8d0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 shutdown_connections 2024-05-20T18:03:04.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7ea406be60 0x7f7ea406e370 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ec0163a10 0x7f7ec0157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7ec00d1bc0 0x7f7ec0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 --2- 172.21.15.6:0/1957964498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec00b4010 0x7f7ec01551d0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 >> 172.21.15.6:0/1957964498 conn(0x7f7ec006d240 msgr2=0x7f7ec00d4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:04.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 shutdown_connections 2024-05-20T18:03:04.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.518+0000 7f7ec6a84640 1 -- 172.21.15.6:0/1957964498 wait complete. 2024-05-20T18:03:04.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:03:04.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.648+0000 7fc79960d640 1 Processor -- start 2024-05-20T18:03:04.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.648+0000 7fc79960d640 1 -- start start 2024-05-20T18:03:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc79960d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc79406d3d0 0x7fc79406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc79960d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79406dd20 con 0x7fc794162820 2024-05-20T18:03:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc79960d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7940d0630 con 0x7fc7940b8190 2024-05-20T18:03:04.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc79960d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc7940d39c0 con 0x7fc79406d3d0 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc792ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc794162820 0x7fc7940b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46906/0 (socket says 172.21.15.6:46906) 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc792ffd640 1 -- 172.21.15.6:0/4098452768 learned_addr learned my addr 172.21.15.6:0/4098452768 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2873696478 0 0) 0x7fc784001110 con 0x7fc794162820 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc780003520 con 0x7fc794162820 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc78bfff640 1 --2- 172.21.15.6:0/4098452768 >> v2:172.21.15.171:3300/0 conn(0x7fc79406d3d0 0x7fc79406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.650+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3082217884 0 0) 0x7fc780003520 con 0x7fc794162820 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 >> v2:172.21.15.171:3300/0 conn(0x7fc79406d3d0 msgr2=0x7fc79406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 --2- 172.21.15.6:0/4098452768 >> v2:172.21.15.171:3300/0 conn(0x7fc79406d3d0 0x7fc79406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 >> v1:172.21.15.171:6789/0 conn(0x7fc7940b8190 legacy=0x7fc7940b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7940d3ca0 con 0x7fc794162820 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fc784001840 con 0x7fc794162820 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 >> v1:172.21.15.6:6789/0 conn(0x7fc794162820 legacy=0x7fc7940b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7800039b0 0x7fc780003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc780004800 0x7fc780004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940d39c0 con 0x7fc7800051c0 2024-05-20T18:03:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc78000c160 con 0x7fc780004800 2024-05-20T18:03:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc78000c360 con 0x7fc7800039b0 2024-05-20T18:03:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc78bfff640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc780004800 0x7fc780004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc792ffd640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7800039b0 0x7fc780003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7937fe640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7937fe640 1 -- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7800039b0 msgr2=0x7fc780003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7937fe640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7800039b0 0x7fc780003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7937fe640 1 -- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc780004800 msgr2=0x7fc780004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7937fe640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc780004800 0x7fc780004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc7937fe640 1 -- 172.21.15.6:0/4098452768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc780003520 con 0x7fc7800051c0 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.651+0000 7fc78bfff640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc780004800 0x7fc780004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.652+0000 7fc7937fe640 1 -- 172.21.15.6:0/4098452768 reap_dead start 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.652+0000 7fc7937fe640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fc78c001e50 tx=0x7fc780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69c2147ee2ce370 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.652+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c009690 con 0x7fc7800051c0 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.652+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78c02ade0 con 0x7fc7800051c0 2024-05-20T18:03:04.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.652+0000 7fc7927fc640 1 -- 172.21.15.6:0/4098452768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c001a70 con 0x7fc7800051c0 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.653+0000 7fc79960d640 1 -- 172.21.15.6:0/4098452768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 msgr2=0x7fc78000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.653+0000 7fc79960d640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fc78c001e50 tx=0x7fc780005830 comp rx=0 tx=0).stop 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.653+0000 7fc79960d640 1 -- 172.21.15.6:0/4098452768 shutdown_connections 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.653+0000 7fc79960d640 1 --2- 172.21.15.6:0/4098452768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.653+0000 7fc79960d640 1 -- 172.21.15.6:0/4098452768 >> 172.21.15.6:0/4098452768 conn(0x7fc7940d4bd0 msgr2=0x7fc7940d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.653+0000 7fc79960d640 1 -- 172.21.15.6:0/4098452768 shutdown_connections 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.653+0000 7fc79960d640 1 -- 172.21.15.6:0/4098452768 wait complete. 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.655+0000 7fc79960d640 1 Processor -- start 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.655+0000 7fc79960d640 1 -- start start 2024-05-20T18:03:04.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc79960d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc7941f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc79960d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7940cb090 0x7fc7940ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc79960d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7940c8700 0x7fc7940c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc79960d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940d0300 con 0x7fc7800051c0 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc79960d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940d4260 con 0x7fc7940cb090 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc79960d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7940d4780 con 0x7fc7940c8700 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc792ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc7941f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc792ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc7941f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55614/0 (socket says 172.21.15.6:55614) 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc792ffd640 1 -- 172.21.15.6:0/2573763241 learned_addr learned my addr 172.21.15.6:0/2573763241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc7937fe640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7940c8700 0x7fc7940c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc78bfff640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7940cb090 0x7fc7940ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc792ffd640 1 -- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7940c8700 msgr2=0x7fc7940c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc792ffd640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7940c8700 0x7fc7940c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc792ffd640 1 -- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7940cb090 msgr2=0x7fc7940ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc792ffd640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7940cb090 0x7fc7940ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.656+0000 7fc792ffd640 1 -- 172.21.15.6:0/2573763241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7940ccf80 con 0x7fc7800051c0 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.657+0000 7fc792ffd640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc7941f24e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fc784007370 tx=0x7fc784007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.657+0000 7fc78b7fe640 1 -- 172.21.15.6:0/2573763241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78401a070 con 0x7fc7800051c0 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.657+0000 7fc78b7fe640 1 -- 172.21.15.6:0/2573763241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78400f960 con 0x7fc7800051c0 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.657+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7940cd260 con 0x7fc7800051c0 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.657+0000 7fc78b7fe640 1 -- 172.21.15.6:0/2573763241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78400fd30 con 0x7fc7800051c0 2024-05-20T18:03:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.657+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7940cd820 con 0x7fc7800051c0 2024-05-20T18:03:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.658+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc794075b00 con 0x7fc7800051c0 2024-05-20T18:03:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.658+0000 7fc78b7fe640 1 -- 172.21.15.6:0/2573763241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc78401d070 con 0x7fc7800051c0 2024-05-20T18:03:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.659+0000 7fc78b7fe640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc77406be60 0x7fc77406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.659+0000 7fc78b7fe640 1 -- 172.21.15.6:0/2573763241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fc78408a9c0 con 0x7fc7800051c0 2024-05-20T18:03:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.659+0000 7fc78bfff640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc77406be60 0x7fc77406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.660+0000 7fc78bfff640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc77406be60 0x7fc77406e370 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc794159e80 tx=0x7fc77c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.663+0000 7fc78b7fe640 1 -- 172.21.15.6:0/2573763241 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc78408ce20 con 0x7fc7800051c0 2024-05-20T18:03:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.846+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc7940cb940 con 0x7fc7800051c0 2024-05-20T18:03:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.846+0000 7fc78b7fe640 1 -- 172.21.15.6:0/2573763241 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) ==== 100+0+11 (secure 0 0 0) 0x7fc79406dd20 con 0x7fc7800051c0 2024-05-20T18:03:04.844 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc77406be60 msgr2=0x7fc77406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc77406be60 0x7fc77406e370 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc794159e80 tx=0x7fc77c008040 comp rx=0 tx=0).stop 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 msgr2=0x7fc7941f24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc7941f24e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fc784007370 tx=0x7fc784007830 comp rx=0 tx=0).stop 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 shutdown_connections 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc77406be60 0x7fc77406e370 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7940c8700 0x7fc7940c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7940cb090 0x7fc7940ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 --2- 172.21.15.6:0/2573763241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7800051c0 0x7fc7941f24e0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 >> 172.21.15.6:0/2573763241 conn(0x7fc7940d4bd0 msgr2=0x7fc7940b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 shutdown_connections 2024-05-20T18:03:04.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.848+0000 7fc79960d640 1 -- 172.21.15.6:0/2573763241 wait complete. 2024-05-20T18:03:04.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-20T18:03:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.976+0000 7fc1e0cca640 1 Processor -- start 2024-05-20T18:03:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.976+0000 7fc1e0cca640 1 -- start start 2024-05-20T18:03:04.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1e0cca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1dc0cf850 0x7fc1dc0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1e0cca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1dc0d1ac0 con 0x7fc1dc0d10e0 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1e0cca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1dc0d1da0 con 0x7fc1dc0d14f0 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1e0cca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc1dc0d2080 con 0x7fc1dc0cf850 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1d9d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc1dc0cf850 0x7fc1dc0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1da59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc1dc0d10e0 0x7fc1dc0cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46908/0 (socket says 172.21.15.6:46908) 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1da59c640 1 -- 172.21.15.6:0/12595005 learned_addr learned my addr 172.21.15.6:0/12595005 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1d9d9b640 1 -- 172.21.15.6:0/12595005 >> v1:172.21.15.171:6789/0 conn(0x7fc1dc0d14f0 legacy=0x7fc1dc0b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1d959a640 1 -- 172.21.15.6:0/12595005 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476756525 0 0) 0x7fc1dc0d1ac0 con 0x7fc1dc0d10e0 2024-05-20T18:03:04.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1d9d9b640 1 -- 172.21.15.6:0/12595005 >> v1:172.21.15.6:6789/0 conn(0x7fc1dc0d10e0 legacy=0x7fc1dc0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.978+0000 7fc1d9d9b640 1 -- 172.21.15.6:0/12595005 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc0d2360 con 0x7fc1dc0cf850 2024-05-20T18:03:04.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.979+0000 7fc1d9d9b640 1 --2- 172.21.15.6:0/12595005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0b6200 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00097a0 tx=0x7fc1d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd6c14a7affcded server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.979+0000 7fc1d959a640 1 -- 172.21.15.6:0/12595005 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0037070 con 0x7fc1dc0cf850 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.979+0000 7fc1d959a640 1 -- 172.21.15.6:0/12595005 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0032440 con 0x7fc1dc0cf850 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.979+0000 7fc1d959a640 1 -- 172.21.15.6:0/12595005 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0032810 con 0x7fc1dc0cf850 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.980+0000 7fc1e0cca640 1 -- 172.21.15.6:0/12595005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 msgr2=0x7fc1dc0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.980+0000 7fc1e0cca640 1 --2- 172.21.15.6:0/12595005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0b6200 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00097a0 tx=0x7fc1d002a1e0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.980+0000 7fc1e0cca640 1 -- 172.21.15.6:0/12595005 shutdown_connections 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.980+0000 7fc1e0cca640 1 --2- 172.21.15.6:0/12595005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0b6200 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.980+0000 7fc1e0cca640 1 -- 172.21.15.6:0/12595005 >> 172.21.15.6:0/12595005 conn(0x7fc1dc0b44d0 msgr2=0x7fc1dc0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.980+0000 7fc1e0cca640 1 -- 172.21.15.6:0/12595005 shutdown_connections 2024-05-20T18:03:04.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.980+0000 7fc1e0cca640 1 -- 172.21.15.6:0/12595005 wait complete. 2024-05-20T18:03:04.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.982+0000 7fc1e0cca640 1 Processor -- start 2024-05-20T18:03:04.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.982+0000 7fc1e0cca640 1 -- start start 2024-05-20T18:03:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1e0cca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1e0cca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1dc0d10e0 0x7fc1dc15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1e0cca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1dc0d14f0 0x7fc1dc157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1e0cca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc0b8440 con 0x7fc1dc0cf850 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1e0cca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc1dc0b82c0 con 0x7fc1dc0d10e0 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1e0cca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc1dc0709f0 con 0x7fc1dc0d14f0 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1da59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1da59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55630/0 (socket says 172.21.15.6:55630) 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1da59c640 1 -- 172.21.15.6:0/481331238 learned_addr learned my addr 172.21.15.6:0/481331238 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1d9d9b640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1dc0d10e0 0x7fc1dc15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.983+0000 7fc1dad9d640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1dc0d14f0 0x7fc1dc157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1da59c640 1 -- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1dc0d14f0 msgr2=0x7fc1dc157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1da59c640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1dc0d14f0 0x7fc1dc157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1da59c640 1 -- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1dc0d10e0 msgr2=0x7fc1dc15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1da59c640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1dc0d10e0 0x7fc1dc15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1da59c640 1 -- 172.21.15.6:0/481331238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1dc1584f0 con 0x7fc1dc0cf850 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1dad9d640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1dc0d14f0 0x7fc1dc157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1da59c640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0c9750 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c7f0 tx=0x7fc1cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1caffd640 1 -- 172.21.15.6:0/481331238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc018070 con 0x7fc1dc0cf850 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1caffd640 1 -- 172.21.15.6:0/481331238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc00a5e0 con 0x7fc1dc0cf850 2024-05-20T18:03:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1dc0c9da0 con 0x7fc1dc0cf850 2024-05-20T18:03:04.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1caffd640 1 -- 172.21.15.6:0/481331238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00a9d0 con 0x7fc1dc0cf850 2024-05-20T18:03:04.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.984+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1dc0ca360 con 0x7fc1dc0cf850 2024-05-20T18:03:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.985+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1dc075b00 con 0x7fc1dc0cf850 2024-05-20T18:03:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.986+0000 7fc1caffd640 1 -- 172.21.15.6:0/481331238 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1cc00ab70 con 0x7fc1dc0cf850 2024-05-20T18:03:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.986+0000 7fc1caffd640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc1bc06be60 0x7fc1bc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.987+0000 7fc1caffd640 1 -- 172.21.15.6:0/481331238 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fc1cc08a530 con 0x7fc1dc0cf850 2024-05-20T18:03:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.987+0000 7fc1d9d9b640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc1bc06be60 0x7fc1bc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.987+0000 7fc1d9d9b640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc1bc06be60 0x7fc1bc06e370 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0034000 tx=0x7fc1d002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:04.991+0000 7fc1caffd640 1 -- 172.21.15.6:0/481331238 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc1dc1584f0 con 0x7fc1dc0cf850 2024-05-20T18:03:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.189+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc1dc160540 con 0x7fc1dc0cf850 2024-05-20T18:03:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.189+0000 7fc1caffd640 1 -- 172.21.15.6:0/481331238 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v148) ==== 80+0+0 (secure 0 0 0) 0x7fc1cc058680 con 0x7fc1dc0cf850 2024-05-20T18:03:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2024-05-20T18:03:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc1bc06be60 msgr2=0x7fc1bc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc1bc06be60 0x7fc1bc06e370 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0034000 tx=0x7fc1d002e000 comp rx=0 tx=0).stop 2024-05-20T18:03:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 msgr2=0x7fc1dc0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0c9750 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00c7f0 tx=0x7fc1cc00ccb0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 shutdown_connections 2024-05-20T18:03:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc1bc06be60 0x7fc1bc06e370 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1dc0d14f0 0x7fc1dc157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1dc0d10e0 0x7fc1dc15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 --2- 172.21.15.6:0/481331238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1dc0cf850 0x7fc1dc0c9750 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 >> 172.21.15.6:0/481331238 conn(0x7fc1dc0b44d0 msgr2=0x7fc1dc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 shutdown_connections 2024-05-20T18:03:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.191+0000 7fc1e0cca640 1 -- 172.21.15.6:0/481331238 wait complete. 2024-05-20T18:03:05.200 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-20T18:03:05.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:05.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-20T18:03:05.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:03:05.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:05.235 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-20T18:03:05.294 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:03:05.295 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:03:05.295 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:05.312 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:03:05.312 INFO:tasks.cephfs.mount:Terminating background process 2024-05-20T18:03:05.312 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:03:05.313 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:05.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:03:05.355 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:03:05.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.472+0000 7f899fcca640 1 Processor -- start 2024-05-20T18:03:05.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.472+0000 7f899fcca640 1 -- start start 2024-05-20T18:03:05.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899fcca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8998168050 0x7f899816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899fcca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89980d0630 con 0x7f8998162820 2024-05-20T18:03:05.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899fcca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89980d39c0 con 0x7f899806d3d0 2024-05-20T18:03:05.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899fcca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f89980d3ca0 con 0x7f8998168050 2024-05-20T18:03:05.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899da66640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8998162820 0x7f89980b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46922/0 (socket says 172.21.15.6:46922) 2024-05-20T18:03:05.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899da66640 1 -- 172.21.15.6:0/624185136 learned_addr learned my addr 172.21.15.6:0/624185136 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:05.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899e267640 1 --2- 172.21.15.6:0/624185136 >> v2:172.21.15.171:3300/0 conn(0x7f8998168050 0x7f899816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854428491 0 0) 0x7f89980d0630 con 0x7f8998162820 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8984003520 con 0x7f8998162820 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883805853 0 0) 0x7f89980d39c0 con 0x7f899806d3d0 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89980d0630 con 0x7f899806d3d0 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 365610456 0 0) 0x7f8984003520 con 0x7f8998162820 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 >> v2:172.21.15.171:3300/0 conn(0x7f8998168050 msgr2=0x7f899816a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 --2- 172.21.15.6:0/624185136 >> v2:172.21.15.171:3300/0 conn(0x7f8998168050 0x7f899816a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 >> v1:172.21.15.171:6789/0 conn(0x7f899806d3d0 legacy=0x7f899806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89980d3f80 con 0x7f8998162820 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f8994001670 con 0x7f8998162820 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.474+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 >> v1:172.21.15.6:6789/0 conn(0x7f8998162820 legacy=0x7f89980b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899ca64640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f8984003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899ca64640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984004800 0x7f8984004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899ca64640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89840051a0 0x7f898400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f89980d3ca0 con 0x7f8984003b40 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f898400c140 con 0x7f8984004800 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f898400c340 con 0x7f89840051a0 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899da66640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f8984003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899e267640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89840051a0 0x7f898400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899d265640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984004800 0x7f8984004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899da66640 1 -- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89840051a0 msgr2=0x7f898400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899da66640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89840051a0 0x7f898400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899da66640 1 -- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984004800 msgr2=0x7f8984004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899da66640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984004800 0x7f8984004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899da66640 1 -- 172.21.15.6:0/624185136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8984003520 con 0x7f8984003b40 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899d265640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8984004800 0x7f8984004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:05.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899e267640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89840051a0 0x7f898400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:05.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.475+0000 7f899e267640 1 -- 172.21.15.6:0/624185136 reap_dead start 2024-05-20T18:03:05.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.476+0000 7f899da66640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f8984003f90 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f89840057e0 tx=0x7f8984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd120b0502de2149 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:05.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.476+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994007ce0 con 0x7f8984003b40 2024-05-20T18:03:05.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.476+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8994005ad0 con 0x7f8984003b40 2024-05-20T18:03:05.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.476+0000 7f899ca64640 1 -- 172.21.15.6:0/624185136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994007070 con 0x7f8984003b40 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.477+0000 7f899fcca640 1 -- 172.21.15.6:0/624185136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 msgr2=0x7f8984003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.477+0000 7f899fcca640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f8984003f90 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f89840057e0 tx=0x7f8984005830 comp rx=0 tx=0).stop 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.477+0000 7f899fcca640 1 -- 172.21.15.6:0/624185136 shutdown_connections 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.477+0000 7f899fcca640 1 --2- 172.21.15.6:0/624185136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f8984003f90 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.477+0000 7f899fcca640 1 -- 172.21.15.6:0/624185136 >> 172.21.15.6:0/624185136 conn(0x7f89980d4bd0 msgr2=0x7f89980d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.477+0000 7f899fcca640 1 -- 172.21.15.6:0/624185136 shutdown_connections 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.477+0000 7f899fcca640 1 -- 172.21.15.6:0/624185136 wait complete. 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.478+0000 7f899fcca640 1 Processor -- start 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.479+0000 7f899fcca640 1 -- start start 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899fcca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f899814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899fcca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89980c9e30 0x7f89980caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899fcca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8998159f10 0x7f89980cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899fcca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f89980d4780 con 0x7f8984003b40 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899fcca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89980d0300 con 0x7f8998159f10 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899fcca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f89980d4900 con 0x7f89980c9e30 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899da66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f899814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899da66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f899814bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55638/0 (socket says 172.21.15.6:55638) 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899da66640 1 -- 172.21.15.6:0/39951836 learned_addr learned my addr 172.21.15.6:0/39951836 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899d265640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89980c9e30 0x7f89980caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899e267640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8998159f10 0x7f89980cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899da66640 1 -- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89980c9e30 msgr2=0x7f89980caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899da66640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89980c9e30 0x7f89980caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899da66640 1 -- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8998159f10 msgr2=0x7f89980cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899da66640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8998159f10 0x7f89980cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.480+0000 7f899da66640 1 -- 172.21.15.6:0/39951836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899814c520 con 0x7f8984003b40 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.481+0000 7f899da66640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f899814bfe0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f899402ad20 tx=0x7f89980d0800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.481+0000 7f898e7fc640 1 -- 172.21.15.6:0/39951836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994037040 con 0x7f8984003b40 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.481+0000 7f898e7fc640 1 -- 172.21.15.6:0/39951836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8994041070 con 0x7f8984003b40 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.481+0000 7f898e7fc640 1 -- 172.21.15.6:0/39951836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994001670 con 0x7f8984003b40 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.481+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89980ccea0 con 0x7f8984003b40 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.481+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89980c9070 con 0x7f8984003b40 2024-05-20T18:03:05.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.482+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899808dd50 con 0x7f8984003b40 2024-05-20T18:03:05.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.482+0000 7f898e7fc640 1 -- 172.21.15.6:0/39951836 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89940049e0 con 0x7f8984003b40 2024-05-20T18:03:05.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.483+0000 7f898e7fc640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f897c06be30 0x7f897c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.483+0000 7f898e7fc640 1 -- 172.21.15.6:0/39951836 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f89940aaa60 con 0x7f8984003b40 2024-05-20T18:03:05.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.483+0000 7f899d265640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f897c06be30 0x7f897c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.484+0000 7f899d265640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f897c06be30 0x7f897c06e340 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8998161c10 tx=0x7f8988009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:05.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.488+0000 7f898e7fc640 1 -- 172.21.15.6:0/39951836 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f899808dd50 con 0x7f8984003b40 2024-05-20T18:03:05.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.710+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89980b58f0 con 0x7f8984003b40 2024-05-20T18:03:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.711+0000 7f898e7fc640 1 -- 172.21.15.6:0/39951836 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5188 (secure 0 0 0) 0x7f8994079e20 con 0x7f8984003b40 2024-05-20T18:03:05.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:05.709 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":108,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2941924108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2941924108},{"type":"v1","addr":"172.21.15.6:6835","nonce":2941924108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/701117749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":701117749},{"type":"v1","addr":"172.21.15.171:6837","nonce":701117749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3661458750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3661458750},{"type":"v1","addr":"172.21.15.171:6836","nonce":3661458750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:52.794622+0000","modified":"2024-05-20T18:02:55.807339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9654":{"gid":9654,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3621358319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3621358319},{"type":"v1","addr":"172.21.15.6:6834","nonce":3621358319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9654,"qdb_cluster":[9654]},"id":11}]} 2024-05-20T18:03:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 108 2024-05-20T18:03:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f897c06be30 msgr2=0x7f897c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f897c06be30 0x7f897c06e340 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8998161c10 tx=0x7f8988009040 comp rx=0 tx=0).stop 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 msgr2=0x7f899814bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f899814bfe0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f899402ad20 tx=0x7f89980d0800 comp rx=0 tx=0).stop 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 shutdown_connections 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f897c06be30 0x7f897c06e340 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8998159f10 0x7f89980cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f89980c9e30 0x7f89980caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 --2- 172.21.15.6:0/39951836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8984003b40 0x7f899814bfe0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 >> 172.21.15.6:0/39951836 conn(0x7f89980d4bd0 msgr2=0x7f8998160620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 shutdown_connections 2024-05-20T18:03:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.713+0000 7f899fcca640 1 -- 172.21.15.6:0/39951836 wait complete. 2024-05-20T18:03:05.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:03:05.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.840+0000 7f1a802ca640 1 Processor -- start 2024-05-20T18:03:05.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.840+0000 7f1a802ca640 1 -- start start 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a802ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a78162820 0x7f1a780b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a802ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1a7806dae0 0x7f1a780b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a802ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a780d0630 con 0x7f1a780b3e80 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a802ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1a780d39c0 con 0x7f1a7806dae0 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a802ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1a780d3ca0 con 0x7f1a78162820 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a7e066640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a78162820 0x7f1a780b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a7d865640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1a780b3e80 0x7f1a7806d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:41774/0 (socket says 172.21.15.6:41774) 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a7d865640 1 -- 172.21.15.6:0/3405074322 learned_addr learned my addr 172.21.15.6:0/3405074322 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a7e867640 1 --2- 172.21.15.6:0/3405074322 >> v2:172.21.15.171:3300/0 conn(0x7f1a7806dae0 0x7f1a780b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.842+0000 7f1a7d064640 1 -- 172.21.15.6:0/3405074322 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074157632 0 0) 0x7f1a780d0630 con 0x7f1a780b3e80 2024-05-20T18:03:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.843+0000 7f1a7d064640 1 -- 172.21.15.6:0/3405074322 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a60003520 con 0x7f1a780b3e80 2024-05-20T18:03:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.843+0000 7f1a7e066640 1 -- 172.21.15.6:0/3405074322 >> v2:172.21.15.171:3300/0 conn(0x7f1a7806dae0 msgr2=0x7f1a780b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.843+0000 7f1a7e066640 1 --2- 172.21.15.6:0/3405074322 >> v2:172.21.15.171:3300/0 conn(0x7f1a7806dae0 0x7f1a780b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.843+0000 7f1a7e066640 1 -- 172.21.15.6:0/3405074322 >> v1:172.21.15.171:6789/0 conn(0x7f1a780b3e80 legacy=0x7f1a7806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.843+0000 7f1a7e066640 1 -- 172.21.15.6:0/3405074322 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a780d3f80 con 0x7f1a78162820 2024-05-20T18:03:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.843+0000 7f1a7e867640 1 --2- 172.21.15.6:0/3405074322 >> v2:172.21.15.171:3300/0 conn(0x7f1a7806dae0 0x7f1a780b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:05.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.843+0000 7f1a7e066640 1 --2- 172.21.15.6:0/3405074322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a78162820 0x7f1a780b3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009d90 tx=0x7f1a6802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941dfc4328c397d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:05.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a7d064640 1 -- 172.21.15.6:0/3405074322 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68007740 con 0x7f1a78162820 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a7d064640 1 -- 172.21.15.6:0/3405074322 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a680078e0 con 0x7f1a78162820 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a7d064640 1 -- 172.21.15.6:0/3405074322 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68007c90 con 0x7f1a78162820 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a802ca640 1 -- 172.21.15.6:0/3405074322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a78162820 msgr2=0x7f1a780b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a802ca640 1 --2- 172.21.15.6:0/3405074322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a78162820 0x7f1a780b3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009d90 tx=0x7f1a6802a660 comp rx=0 tx=0).stop 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a802ca640 1 -- 172.21.15.6:0/3405074322 shutdown_connections 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a802ca640 1 --2- 172.21.15.6:0/3405074322 >> v2:172.21.15.171:3300/0 conn(0x7f1a7806dae0 0x7f1a780b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a802ca640 1 --2- 172.21.15.6:0/3405074322 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a78162820 0x7f1a780b3940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a802ca640 1 -- 172.21.15.6:0/3405074322 >> 172.21.15.6:0/3405074322 conn(0x7f1a780d4bd0 msgr2=0x7f1a780d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.844+0000 7f1a802ca640 1 -- 172.21.15.6:0/3405074322 shutdown_connections 2024-05-20T18:03:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.845+0000 7f1a802ca640 1 -- 172.21.15.6:0/3405074322 wait complete. 2024-05-20T18:03:05.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.846+0000 7f1a802ca640 1 Processor -- start 2024-05-20T18:03:05.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.846+0000 7f1a802ca640 1 -- start start 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a802ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780b3e80 0x7f1a781558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a802ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78162820 0x7f1a781f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a802ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a781589a0 0x7f1a781f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a802ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1a780d4780 con 0x7f1a780b3e80 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a802ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1a780d0300 con 0x7f1a78162820 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a802ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1a780d4900 con 0x7f1a781589a0 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780b3e80 0x7f1a781558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780b3e80 0x7f1a781558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55648/0 (socket says 172.21.15.6:55648) 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 -- 172.21.15.6:0/178582947 learned_addr learned my addr 172.21.15.6:0/178582947 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e867640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a781589a0 0x7f1a781f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7d865640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78162820 0x7f1a781f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 -- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a781589a0 msgr2=0x7f1a781f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a781589a0 0x7f1a781f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 -- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78162820 msgr2=0x7f1a781f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78162820 0x7f1a781f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 -- 172.21.15.6:0/178582947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a780cd010 con 0x7f1a780b3e80 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.848+0000 7f1a7e066640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780b3e80 0x7f1a781558b0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009eb0 tx=0x7f1a68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.849+0000 7f1a76ffd640 1 -- 172.21.15.6:0/178582947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68009450 con 0x7f1a780b3e80 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.849+0000 7f1a76ffd640 1 -- 172.21.15.6:0/178582947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a68004240 con 0x7f1a780b3e80 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.849+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a780cd2f0 con 0x7f1a780b3e80 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.849+0000 7f1a76ffd640 1 -- 172.21.15.6:0/178582947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a680045f0 con 0x7f1a780b3e80 2024-05-20T18:03:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.849+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a780cd8b0 con 0x7f1a780b3e80 2024-05-20T18:03:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.850+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a78075b00 con 0x7f1a780b3e80 2024-05-20T18:03:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.850+0000 7f1a76ffd640 1 -- 172.21.15.6:0/178582947 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a6803b410 con 0x7f1a780b3e80 2024-05-20T18:03:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.851+0000 7f1a76ffd640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a6406be30 0x7f1a6406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.851+0000 7f1a76ffd640 1 -- 172.21.15.6:0/178582947 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f1a680ac160 con 0x7f1a780b3e80 2024-05-20T18:03:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.851+0000 7f1a7d865640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a6406be30 0x7f1a6406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:05.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.852+0000 7f1a7d865640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a6406be30 0x7f1a6406e340 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c8c60 tx=0x7f1a6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:05.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:05.855+0000 7f1a76ffd640 1 -- 172.21.15.6:0/178582947 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1a6803f030 con 0x7f1a780b3e80 2024-05-20T18:03:06.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.038+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a78160830 con 0x7f1a780b3e80 2024-05-20T18:03:06.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.039+0000 7f1a76ffd640 1 -- 172.21.15.6:0/178582947 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) ==== 74+0+16836 (secure 0 0 0) 0x7f1a6807a330 con 0x7f1a780b3e80 2024-05-20T18:03:06.037 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:06.038 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":148,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:54.405297+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:51.154710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:51.763678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:03:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a6406be30 msgr2=0x7f1a6406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a6406be30 0x7f1a6406e340 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c8c60 tx=0x7f1a6c009040 comp rx=0 tx=0).stop 2024-05-20T18:03:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780b3e80 msgr2=0x7f1a781558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780b3e80 0x7f1a781558b0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009eb0 tx=0x7f1a68004a40 comp rx=0 tx=0).stop 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 shutdown_connections 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1a6406be30 0x7f1a6406e340 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1a781589a0 0x7f1a781f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78162820 0x7f1a781f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 --2- 172.21.15.6:0/178582947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780b3e80 0x7f1a781558b0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 >> 172.21.15.6:0/178582947 conn(0x7f1a780d4bd0 msgr2=0x7f1a780b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 shutdown_connections 2024-05-20T18:03:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.041+0000 7f1a802ca640 1 -- 172.21.15.6:0/178582947 wait complete. 2024-05-20T18:03:06.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-20T17:52:54.275635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-20T18:02:51.154710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '147', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2024-05-20T18:02:51.763678+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-20T18:03:06.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-20T18:03:06.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.171+0000 7f9da12a2640 1 Processor -- start 2024-05-20T18:03:06.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.171+0000 7f9da12a2640 1 -- start start 2024-05-20T18:03:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9da12a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d9c071630 0x7f9d9c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9da12a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c0cd1b0 0x7f9d9c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9da12a2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9c0ce2b0 con 0x7f9d9c070850 2024-05-20T18:03:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9da12a2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9c15f790 con 0x7f9d9c071630 2024-05-20T18:03:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9da12a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9c06e590 con 0x7f9d9c0cd1b0 2024-05-20T18:03:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9d9affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d9c071630 0x7f9d9c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9d9b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9d9c070850 0x7f9d9c070c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46930/0 (socket says 172.21.15.6:46930) 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9d9affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9d9c071630 0x7f9d9c15f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55650/0 (socket says 172.21.15.6:55650) 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9d9b7fe640 1 -- 172.21.15.6:0/4103055470 learned_addr learned my addr 172.21.15.6:0/4103055470 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.172+0000 7f9d927fc640 1 --2- 172.21.15.6:0/4103055470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c0cd1b0 0x7f9d9c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.173+0000 7f9d9affd640 1 -- 172.21.15.6:0/4103055470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c0cd1b0 msgr2=0x7f9d9c06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.173+0000 7f9d9affd640 1 --2- 172.21.15.6:0/4103055470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c0cd1b0 0x7f9d9c06d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.173+0000 7f9d9affd640 1 -- 172.21.15.6:0/4103055470 >> v1:172.21.15.6:6789/0 conn(0x7f9d9c070850 legacy=0x7f9d9c070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.173+0000 7f9d9affd640 1 -- 172.21.15.6:0/4103055470 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c06cce0 con 0x7f9d9c071630 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.173+0000 7f9d9a7fc640 1 -- 172.21.15.6:0/4103055470 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532172603 0 0) 0x7f9d9c0ce2b0 con 0x7f9d9c070850 2024-05-20T18:03:06.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.173+0000 7f9d9affd640 1 --2- 172.21.15.6:0/4103055470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c15f250 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0097a0 tx=0x7f9d8c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e14ba4f6d553c0c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9d9a7fc640 1 -- 172.21.15.6:0/4103055470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c037070 con 0x7f9d9c071630 2024-05-20T18:03:06.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9d9a7fc640 1 -- 172.21.15.6:0/4103055470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8c02ae50 con 0x7f9d9c071630 2024-05-20T18:03:06.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9d9a7fc640 1 -- 172.21.15.6:0/4103055470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c032660 con 0x7f9d9c071630 2024-05-20T18:03:06.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9da12a2640 1 -- 172.21.15.6:0/4103055470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 msgr2=0x7f9d9c15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9da12a2640 1 --2- 172.21.15.6:0/4103055470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c15f250 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0097a0 tx=0x7f9d8c02a100 comp rx=0 tx=0).stop 2024-05-20T18:03:06.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9da12a2640 1 -- 172.21.15.6:0/4103055470 shutdown_connections 2024-05-20T18:03:06.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9da12a2640 1 --2- 172.21.15.6:0/4103055470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c0cd1b0 0x7f9d9c06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9da12a2640 1 --2- 172.21.15.6:0/4103055470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c15f250 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9da12a2640 1 -- 172.21.15.6:0/4103055470 >> 172.21.15.6:0/4103055470 conn(0x7f9d9c0d29d0 msgr2=0x7f9d9c0d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:06.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9da12a2640 1 -- 172.21.15.6:0/4103055470 shutdown_connections 2024-05-20T18:03:06.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.174+0000 7f9da12a2640 1 -- 172.21.15.6:0/4103055470 wait complete. 2024-05-20T18:03:06.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.176+0000 7f9da12a2640 1 Processor -- start 2024-05-20T18:03:06.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.176+0000 7f9da12a2640 1 -- start start 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9da12a2640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c070850 0x7f9d9c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9da12a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9da12a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9c0cd1b0 0x7f9d9c0cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9da12a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c06d2a0 con 0x7f9d9c071630 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9da12a2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c06c990 con 0x7f9d9c0cd1b0 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9da12a2640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9c06dd00 con 0x7f9d9c070850 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55664/0 (socket says 172.21.15.6:55664) 2024-05-20T18:03:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 -- 172.21.15.6:0/652316057 learned_addr learned my addr 172.21.15.6:0/652316057 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d9affd640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c070850 0x7f9d9c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d9b7fe640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9c0cd1b0 0x7f9d9c0cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 -- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c070850 msgr2=0x7f9d9c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c070850 0x7f9d9c159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 -- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9c0cd1b0 msgr2=0x7f9d9c0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9c0cd1b0 0x7f9d9c0cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 -- 172.21.15.6:0/652316057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c1e7ab0 con 0x7f9d9c071630 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d9b7fe640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9c0cd1b0 0x7f9d9c0cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.178+0000 7f9d927fc640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c0cf200 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400e870 tx=0x7f9d8400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.179+0000 7f9d93fff640 1 -- 172.21.15.6:0/652316057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84017070 con 0x7f9d9c071630 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.179+0000 7f9d93fff640 1 -- 172.21.15.6:0/652316057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8400c940 con 0x7f9d9c071630 2024-05-20T18:03:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.179+0000 7f9d93fff640 1 -- 172.21.15.6:0/652316057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400cd30 con 0x7f9d9c071630 2024-05-20T18:03:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.179+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9c1e7d50 con 0x7f9d9c071630 2024-05-20T18:03:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.179+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9c1eac00 con 0x7f9d9c071630 2024-05-20T18:03:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.180+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d9c075b00 con 0x7f9d9c071630 2024-05-20T18:03:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.180+0000 7f9d93fff640 1 -- 172.21.15.6:0/652316057 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d8401a070 con 0x7f9d9c071630 2024-05-20T18:03:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.181+0000 7f9d93fff640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7c06be30 0x7f9d7c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.181+0000 7f9d93fff640 1 -- 172.21.15.6:0/652316057 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f9d8408adf0 con 0x7f9d9c071630 2024-05-20T18:03:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.181+0000 7f9d9affd640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7c06be30 0x7f9d7c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.182+0000 7f9d9affd640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7c06be30 0x7f9d7c06e340 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c034000 tx=0x7f9d8c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.186+0000 7f9d93fff640 1 -- 172.21.15.6:0/652316057 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9d84058fc0 con 0x7f9d9c071630 2024-05-20T18:03:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.367+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9d9c15ee10 con 0x7f9d9c071630 2024-05-20T18:03:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.367+0000 7f9d93fff640 1 -- 172.21.15.6:0/652316057 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v148) ==== 93+0+10 (secure 0 0 0) 0x7f9d8405d2c0 con 0x7f9d9c071630 2024-05-20T18:03:06.365 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-05-20T18:03:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7c06be30 msgr2=0x7f9d7c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7c06be30 0x7f9d7c06e340 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c034000 tx=0x7f9d8c02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 msgr2=0x7f9d9c0cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c0cf200 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400e870 tx=0x7f9d8400ed30 comp rx=0 tx=0).stop 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 shutdown_connections 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f9d7c06be30 0x7f9d7c06e340 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d9c0cd1b0 0x7f9d9c0cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d9c071630 0x7f9d9c0cf200 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 --2- 172.21.15.6:0/652316057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d9c070850 0x7f9d9c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 >> 172.21.15.6:0/652316057 conn(0x7f9d9c0d29d0 msgr2=0x7f9d9c15c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 shutdown_connections 2024-05-20T18:03:06.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.369+0000 7f9da12a2640 1 -- 172.21.15.6:0/652316057 wait complete. 2024-05-20T18:03:06.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-20T18:03:06.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.499+0000 7fc17631d640 1 Processor -- start 2024-05-20T18:03:06.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.499+0000 7fc17631d640 1 -- start start 2024-05-20T18:03:06.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc17631d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc17631d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc1700b3e80 0x7fc17006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc17631d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc17006d910 0x7fc1700d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc17631d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc17006dd20 con 0x7fc17006d910 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc17631d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc1700d0630 con 0x7fc1700b3e80 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc17631d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc1700d39c0 con 0x7fc170162820 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc1748ba640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc17006d910 0x7fc1700d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc1748ba640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc17006d910 0x7fc1700d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55676/0 (socket says 172.21.15.6:55676) 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc1748ba640 1 -- 172.21.15.6:0/3759092634 learned_addr learned my addr 172.21.15.6:0/3759092634 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc16ffff640 1 --2- 172.21.15.6:0/3759092634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc16f7fe640 1 --2- 172.21.15.6:0/3759092634 >> v2:172.21.15.171:3300/0 conn(0x7fc1700b3e80 0x7fc17006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc1748ba640 1 -- 172.21.15.6:0/3759092634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 msgr2=0x7fc1700b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc1748ba640 1 --2- 172.21.15.6:0/3759092634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc1748ba640 1 -- 172.21.15.6:0/3759092634 >> v2:172.21.15.171:3300/0 conn(0x7fc1700b3e80 msgr2=0x7fc17006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc1748ba640 1 --2- 172.21.15.6:0/3759092634 >> v2:172.21.15.171:3300/0 conn(0x7fc1700b3e80 0x7fc17006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc1748ba640 1 -- 172.21.15.6:0/3759092634 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1700d3ca0 con 0x7fc17006d910 2024-05-20T18:03:06.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.501+0000 7fc16ffff640 1 --2- 172.21.15.6:0/3759092634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:06.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.502+0000 7fc1748ba640 1 --2- 172.21.15.6:0/3759092634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700d27a0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fc17008d710 tx=0x7fc16802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f827039d322474b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.502+0000 7fc16effd640 1 -- 172.21.15.6:0/3759092634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168036070 con 0x7fc17006d910 2024-05-20T18:03:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.502+0000 7fc16effd640 1 -- 172.21.15.6:0/3759092634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc168031600 con 0x7fc17006d910 2024-05-20T18:03:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.502+0000 7fc16effd640 1 -- 172.21.15.6:0/3759092634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1680319d0 con 0x7fc17006d910 2024-05-20T18:03:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 -- 172.21.15.6:0/3759092634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 msgr2=0x7fc1700d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 --2- 172.21.15.6:0/3759092634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700d27a0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fc17008d710 tx=0x7fc16802a6a0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 -- 172.21.15.6:0/3759092634 shutdown_connections 2024-05-20T18:03:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 --2- 172.21.15.6:0/3759092634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700d27a0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 --2- 172.21.15.6:0/3759092634 >> v2:172.21.15.171:3300/0 conn(0x7fc1700b3e80 0x7fc17006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 --2- 172.21.15.6:0/3759092634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 -- 172.21.15.6:0/3759092634 >> 172.21.15.6:0/3759092634 conn(0x7fc1700d4bd0 msgr2=0x7fc1700d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:06.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 -- 172.21.15.6:0/3759092634 shutdown_connections 2024-05-20T18:03:06.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.503+0000 7fc17631d640 1 -- 172.21.15.6:0/3759092634 wait complete. 2024-05-20T18:03:06.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.505+0000 7fc17631d640 1 Processor -- start 2024-05-20T18:03:06.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.505+0000 7fc17631d640 1 -- start start 2024-05-20T18:03:06.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc17631d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc17631d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1700b3e80 0x7fc170157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc17631d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc17631d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc1700d0300 con 0x7fc17006d910 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc17631d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc1700d4260 con 0x7fc1700b3e80 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc17631d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc1700d4780 con 0x7fc170162820 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc16ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55684/0 (socket says 172.21.15.6:55684) 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.506+0000 7fc16ffff640 1 -- 172.21.15.6:0/2783292588 learned_addr learned my addr 172.21.15.6:0/2783292588 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16f7fe640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1700b3e80 0x7fc170157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc1748ba640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16ffff640 1 -- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 msgr2=0x7fc1700caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16ffff640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16ffff640 1 -- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1700b3e80 msgr2=0x7fc170157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16ffff640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1700b3e80 0x7fc170157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16ffff640 1 -- 172.21.15.6:0/2783292588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1701f9b70 con 0x7fc17006d910 2024-05-20T18:03:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16f7fe640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1700b3e80 0x7fc170157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16ffff640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700c9020 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c820 tx=0x7fc16000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16cff9640 1 -- 172.21.15.6:0/2783292588 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160015070 con 0x7fc17006d910 2024-05-20T18:03:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16cff9640 1 -- 172.21.15.6:0/2783292588 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc160007a30 con 0x7fc17006d910 2024-05-20T18:03:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc16cff9640 1 -- 172.21.15.6:0/2783292588 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160007de0 con 0x7fc17006d910 2024-05-20T18:03:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1700c8700 con 0x7fc17006d910 2024-05-20T18:03:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.507+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1700c8cc0 con 0x7fc17006d910 2024-05-20T18:03:06.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.508+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1700cf6e0 con 0x7fc17006d910 2024-05-20T18:03:06.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.509+0000 7fc16cff9640 1 -- 172.21.15.6:0/2783292588 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc160018070 con 0x7fc17006d910 2024-05-20T18:03:06.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.510+0000 7fc16cff9640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc15c06be60 0x7fc15c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.510+0000 7fc16cff9640 1 -- 172.21.15.6:0/2783292588 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fc16008afa0 con 0x7fc17006d910 2024-05-20T18:03:06.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.510+0000 7fc16f7fe640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc15c06be60 0x7fc15c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.511+0000 7fc16f7fe640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc15c06be60 0x7fc15c06e370 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc164006fd0 tx=0x7fc164008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.515+0000 7fc16cff9640 1 -- 172.21.15.6:0/2783292588 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc1700cf6e0 con 0x7fc17006d910 2024-05-20T18:03:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.696+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc170075b00 con 0x7fc17006d910 2024-05-20T18:03:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.697+0000 7fc16cff9640 1 -- 172.21.15.6:0/2783292588 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) ==== 104+0+11 (secure 0 0 0) 0x7fc160059690 con 0x7fc17006d910 2024-05-20T18:03:06.695 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-05-20T18:03:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc15c06be60 msgr2=0x7fc15c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc15c06be60 0x7fc15c06e370 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc164006fd0 tx=0x7fc164008040 comp rx=0 tx=0).stop 2024-05-20T18:03:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 msgr2=0x7fc1700c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700c9020 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c820 tx=0x7fc16000cce0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 shutdown_connections 2024-05-20T18:03:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc15c06be60 0x7fc15c06e370 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc170162820 0x7fc1700caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1700b3e80 0x7fc170157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 --2- 172.21.15.6:0/2783292588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17006d910 0x7fc1700c9020 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 >> 172.21.15.6:0/2783292588 conn(0x7fc1700d4bd0 msgr2=0x7fc1700d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 shutdown_connections 2024-05-20T18:03:06.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.699+0000 7fc17631d640 1 -- 172.21.15.6:0/2783292588 wait complete. 2024-05-20T18:03:06.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-20T18:03:06.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.829+0000 7fb91c5aa640 1 Processor -- start 2024-05-20T18:03:06.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.829+0000 7fb91c5aa640 1 -- start start 2024-05-20T18:03:06.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.830+0000 7fb91c5aa640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb9140af740 0x7fb9140b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.830+0000 7fb91c5aa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb9140b2390 0x7fb91406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.830+0000 7fb91c5aa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91406c840 con 0x7fb9140af330 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.830+0000 7fb91c5aa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb9140afb50 con 0x7fb9140b2390 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.830+0000 7fb91c5aa640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb9140d20d0 con 0x7fb9140af740 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.830+0000 7fb91ab47640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb9140b2390 0x7fb91406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.830+0000 7fb91a346640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb9140af330 0x7fb9140d1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46942/0 (socket says 172.21.15.6:46942) 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.830+0000 7fb91a346640 1 -- 172.21.15.6:0/355542124 learned_addr learned my addr 172.21.15.6:0/355542124 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.831+0000 7fb919b45640 1 --2- 172.21.15.6:0/355542124 >> v2:172.21.15.171:3300/0 conn(0x7fb9140af740 0x7fb9140b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.831+0000 7fb91ab47640 1 -- 172.21.15.6:0/355542124 >> v2:172.21.15.171:3300/0 conn(0x7fb9140af740 msgr2=0x7fb9140b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.831+0000 7fb91ab47640 1 --2- 172.21.15.6:0/355542124 >> v2:172.21.15.171:3300/0 conn(0x7fb9140af740 0x7fb9140b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.831+0000 7fb91ab47640 1 -- 172.21.15.6:0/355542124 >> v1:172.21.15.6:6789/0 conn(0x7fb9140af330 legacy=0x7fb9140d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.831+0000 7fb91ab47640 1 -- 172.21.15.6:0/355542124 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91406cae0 con 0x7fb9140b2390 2024-05-20T18:03:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.831+0000 7fb919b45640 1 --2- 172.21.15.6:0/355542124 >> v2:172.21.15.171:3300/0 conn(0x7fb9140af740 0x7fb9140b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.831+0000 7fb91ab47640 1 --2- 172.21.15.6:0/355542124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140b2390 0x7fb91406d5c0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fb914073280 tx=0x7fb90402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3525b3e1a8272c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb919344640 1 -- 172.21.15.6:0/355542124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904007740 con 0x7fb9140b2390 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb919344640 1 -- 172.21.15.6:0/355542124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9040078e0 con 0x7fb9140b2390 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb919344640 1 -- 172.21.15.6:0/355542124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904007cb0 con 0x7fb9140b2390 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb91c5aa640 1 -- 172.21.15.6:0/355542124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140b2390 msgr2=0x7fb91406d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/355542124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140b2390 0x7fb91406d5c0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fb914073280 tx=0x7fb90402a5f0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb91c5aa640 1 -- 172.21.15.6:0/355542124 shutdown_connections 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/355542124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140b2390 0x7fb91406d5c0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/355542124 >> v2:172.21.15.171:3300/0 conn(0x7fb9140af740 0x7fb9140b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb91c5aa640 1 -- 172.21.15.6:0/355542124 >> 172.21.15.6:0/355542124 conn(0x7fb9140b6670 msgr2=0x7fb9140b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb91c5aa640 1 -- 172.21.15.6:0/355542124 shutdown_connections 2024-05-20T18:03:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.832+0000 7fb91c5aa640 1 -- 172.21.15.6:0/355542124 wait complete. 2024-05-20T18:03:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.834+0000 7fb91c5aa640 1 Processor -- start 2024-05-20T18:03:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.834+0000 7fb91c5aa640 1 -- start start 2024-05-20T18:03:06.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.835+0000 7fb91c5aa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9140af330 0x7fb91415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.835+0000 7fb91c5aa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140af740 0x7fb914159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.835+0000 7fb91c5aa640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9140b2390 0x7fb91415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.835+0000 7fb91c5aa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9140b27a0 con 0x7fb9140af740 2024-05-20T18:03:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.835+0000 7fb91c5aa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb91406d0a0 con 0x7fb9140af330 2024-05-20T18:03:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.835+0000 7fb91c5aa640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb91415d350 con 0x7fb9140b2390 2024-05-20T18:03:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140af740 0x7fb914159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140af740 0x7fb914159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55702/0 (socket says 172.21.15.6:55702) 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 -- 172.21.15.6:0/866125542 learned_addr learned my addr 172.21.15.6:0/866125542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb91a346640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9140af330 0x7fb91415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb91ab47640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9140b2390 0x7fb91415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 -- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9140b2390 msgr2=0x7fb91415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9140b2390 0x7fb91415a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 -- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9140af330 msgr2=0x7fb91415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9140af330 0x7fb91415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 -- 172.21.15.6:0/866125542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91415ee20 con 0x7fb9140af740 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb91a346640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9140af330 0x7fb91415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb919b45640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140af740 0x7fb914159d30 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c7c0 tx=0x7fb90800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb912ffd640 1 -- 172.21.15.6:0/866125542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908015070 con 0x7fb9140af740 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb912ffd640 1 -- 172.21.15.6:0/866125542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb908007820 con 0x7fb9140af740 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91415f100 con 0x7fb9140af740 2024-05-20T18:03:06.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb912ffd640 1 -- 172.21.15.6:0/866125542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908007bf0 con 0x7fb9140af740 2024-05-20T18:03:06.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.836+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9140cf4f0 con 0x7fb9140af740 2024-05-20T18:03:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.837+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb914075b00 con 0x7fb9140af740 2024-05-20T18:03:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.838+0000 7fb912ffd640 1 -- 172.21.15.6:0/866125542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb908018070 con 0x7fb9140af740 2024-05-20T18:03:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.838+0000 7fb912ffd640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb90006be30 0x7fb90006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.839+0000 7fb912ffd640 1 -- 172.21.15.6:0/866125542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fb90808aff0 con 0x7fb9140af740 2024-05-20T18:03:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.839+0000 7fb91a346640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb90006be30 0x7fb90006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.839+0000 7fb91a346640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb90006be30 0x7fb90006e340 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb90c000f60 tx=0x7fb90c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:06.843+0000 7fb912ffd640 1 -- 172.21.15.6:0/866125542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb9080596e0 con 0x7fb9140af740 2024-05-20T18:03:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.026+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb91409a900 con 0x7fb9140af740 2024-05-20T18:03:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.026+0000 7fb912ffd640 1 -- 172.21.15.6:0/866125542 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) ==== 100+0+11 (secure 0 0 0) 0x7fb908058fe0 con 0x7fb9140af740 2024-05-20T18:03:07.024 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2024-05-20T18:03:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb90006be30 msgr2=0x7fb90006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb90006be30 0x7fb90006e340 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb90c000f60 tx=0x7fb90c009040 comp rx=0 tx=0).stop 2024-05-20T18:03:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140af740 msgr2=0x7fb914159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140af740 0x7fb914159d30 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c7c0 tx=0x7fb90800cc80 comp rx=0 tx=0).stop 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 shutdown_connections 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb90006be30 0x7fb90006e340 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9140b2390 0x7fb91415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9140af740 0x7fb914159d30 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 --2- 172.21.15.6:0/866125542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9140af330 0x7fb91415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 >> 172.21.15.6:0/866125542 conn(0x7fb9140b6670 msgr2=0x7fb914157220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 shutdown_connections 2024-05-20T18:03:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.028+0000 7fb91c5aa640 1 -- 172.21.15.6:0/866125542 wait complete. 2024-05-20T18:03:07.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:03:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.155+0000 7effe62ca640 1 Processor -- start 2024-05-20T18:03:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.155+0000 7effe62ca640 1 -- start start 2024-05-20T18:03:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effe62ca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7effe0162820 0x7effe00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effe62ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe00d0630 con 0x7effe00b3e80 2024-05-20T18:03:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effe62ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe00d39c0 con 0x7effe006dae0 2024-05-20T18:03:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effe62ca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7effe00d3ca0 con 0x7effe0162820 2024-05-20T18:03:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdf7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7effe00b3e80 0x7effe006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46954/0 (socket says 172.21.15.6:46954) 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdf7fe640 1 -- 172.21.15.6:0/2000276200 learned_addr learned my addr 172.21.15.6:0/2000276200 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdffff640 1 --2- 172.21.15.6:0/2000276200 >> v2:172.21.15.171:3300/0 conn(0x7effe0162820 0x7effe00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdeffd640 1 -- 172.21.15.6:0/2000276200 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497349948 0 0) 0x7effe00d0630 con 0x7effe00b3e80 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdeffd640 1 -- 172.21.15.6:0/2000276200 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc8003520 con 0x7effe00b3e80 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdeffd640 1 -- 172.21.15.6:0/2000276200 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465741960 0 0) 0x7effe00d39c0 con 0x7effe006dae0 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdeffd640 1 -- 172.21.15.6:0/2000276200 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effe00d0630 con 0x7effe006dae0 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdeffd640 1 -- 172.21.15.6:0/2000276200 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 251193361 0 0) 0x7effc8003520 con 0x7effe00b3e80 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdffff640 1 -- 172.21.15.6:0/2000276200 >> v1:172.21.15.171:6789/0 conn(0x7effe006dae0 legacy=0x7effe00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdffff640 1 -- 172.21.15.6:0/2000276200 >> v1:172.21.15.6:6789/0 conn(0x7effe00b3e80 legacy=0x7effe006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.156+0000 7effdffff640 1 -- 172.21.15.6:0/2000276200 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe00d3f80 con 0x7effe0162820 2024-05-20T18:03:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.157+0000 7effdffff640 1 --2- 172.21.15.6:0/2000276200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 0x7effe00b3940 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7effd00097a0 tx=0x7effd002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f88e4ba6a9f5879 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.157+0000 7effdeffd640 1 -- 172.21.15.6:0/2000276200 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0037070 con 0x7effe0162820 2024-05-20T18:03:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.157+0000 7effdeffd640 1 -- 172.21.15.6:0/2000276200 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd002ac50 con 0x7effe0162820 2024-05-20T18:03:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.157+0000 7effdeffd640 1 -- 172.21.15.6:0/2000276200 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4001670 con 0x7effe0162820 2024-05-20T18:03:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.158+0000 7effe62ca640 1 -- 172.21.15.6:0/2000276200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 msgr2=0x7effe00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.158+0000 7effe62ca640 1 --2- 172.21.15.6:0/2000276200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 0x7effe00b3940 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7effd00097a0 tx=0x7effd002a1c0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.158+0000 7effe62ca640 1 -- 172.21.15.6:0/2000276200 shutdown_connections 2024-05-20T18:03:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.158+0000 7effe62ca640 1 --2- 172.21.15.6:0/2000276200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 0x7effe00b3940 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.158+0000 7effe62ca640 1 -- 172.21.15.6:0/2000276200 >> 172.21.15.6:0/2000276200 conn(0x7effe00d4bd0 msgr2=0x7effe00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.158+0000 7effe62ca640 1 -- 172.21.15.6:0/2000276200 shutdown_connections 2024-05-20T18:03:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.158+0000 7effe62ca640 1 -- 172.21.15.6:0/2000276200 wait complete. 2024-05-20T18:03:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.160+0000 7effe62ca640 1 Processor -- start 2024-05-20T18:03:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.160+0000 7effe62ca640 1 -- start start 2024-05-20T18:03:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe62ca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effe00b3e80 0x7effe00b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe62ca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 0x7effe0144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe62ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0147890 0x7effe00ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe62ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7effe00d4780 con 0x7effe0147890 2024-05-20T18:03:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe62ca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7effe00d0300 con 0x7effe0162820 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe62ca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7effe00d4900 con 0x7effe00b3e80 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0147890 0x7effe00ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0147890 0x7effe00ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55706/0 (socket says 172.21.15.6:55706) 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 -- 172.21.15.6:0/2772013707 learned_addr learned my addr 172.21.15.6:0/2772013707 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effdffff640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effe00b3e80 0x7effe00b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effdf7fe640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 0x7effe0144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 -- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effe00b3e80 msgr2=0x7effe00b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effe00b3e80 0x7effe00b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 -- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 msgr2=0x7effe0144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 0x7effe0144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 -- 172.21.15.6:0/2772013707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe00b4990 con 0x7effe0147890 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effdffff640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effe00b3e80 0x7effe00b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe4867640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0147890 0x7effe00ca280 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7effd800c6e0 tx=0x7effd800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effdcff9640 1 -- 172.21.15.6:0/2772013707 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8003b70 con 0x7effe0147890 2024-05-20T18:03:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effdcff9640 1 -- 172.21.15.6:0/2772013707 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd8003d10 con 0x7effe0147890 2024-05-20T18:03:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe00b7020 con 0x7effe0147890 2024-05-20T18:03:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effdcff9640 1 -- 172.21.15.6:0/2772013707 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd80052d0 con 0x7effe0147890 2024-05-20T18:03:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.162+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe00c9aa0 con 0x7effe0147890 2024-05-20T18:03:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.163+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe0075b00 con 0x7effe0147890 2024-05-20T18:03:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.164+0000 7effdcff9640 1 -- 172.21.15.6:0/2772013707 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effd8005470 con 0x7effe0147890 2024-05-20T18:03:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.164+0000 7effdcff9640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7effcc06be30 0x7effcc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.164+0000 7effdcff9640 1 -- 172.21.15.6:0/2772013707 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7effd808af40 con 0x7effe0147890 2024-05-20T18:03:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.165+0000 7effdffff640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7effcc06be30 0x7effcc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.165+0000 7effdffff640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7effcc06be30 0x7effcc06e340 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7effd0034000 tx=0x7effd002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.169+0000 7effdcff9640 1 -- 172.21.15.6:0/2772013707 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7effd80596d0 con 0x7effe0147890 2024-05-20T18:03:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.389+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effe01e7f60 con 0x7effe0147890 2024-05-20T18:03:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.390+0000 7effdcff9640 1 -- 172.21.15.6:0/2772013707 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5188 (secure 0 0 0) 0x7effd8058fd0 con 0x7effe0147890 2024-05-20T18:03:07.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:07.388 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":108,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2941924108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2941924108},{"type":"v1","addr":"172.21.15.6:6835","nonce":2941924108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/701117749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":701117749},{"type":"v1","addr":"172.21.15.171:6837","nonce":701117749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3661458750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3661458750},{"type":"v1","addr":"172.21.15.171:6836","nonce":3661458750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:52.794622+0000","modified":"2024-05-20T18:02:55.807339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9654":{"gid":9654,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3621358319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3621358319},{"type":"v1","addr":"172.21.15.6:6834","nonce":3621358319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9654,"qdb_cluster":[9654]},"id":11}]} 2024-05-20T18:03:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 108 2024-05-20T18:03:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.391+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7effcc06be30 msgr2=0x7effcc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.391+0000 7effe62ca640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7effcc06be30 0x7effcc06e340 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7effd0034000 tx=0x7effd002e000 comp rx=0 tx=0).stop 2024-05-20T18:03:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0147890 msgr2=0x7effe00ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0147890 0x7effe00ca280 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7effd800c6e0 tx=0x7effd800cba0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 shutdown_connections 2024-05-20T18:03:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7effcc06be30 0x7effcc06e340 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effe0147890 0x7effe00ca280 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effe0162820 0x7effe0144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 --2- 172.21.15.6:0/2772013707 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7effe00b3e80 0x7effe00b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 >> 172.21.15.6:0/2772013707 conn(0x7effe00d4bd0 msgr2=0x7effe006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 shutdown_connections 2024-05-20T18:03:07.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.392+0000 7effe62ca640 1 -- 172.21.15.6:0/2772013707 wait complete. 2024-05-20T18:03:07.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:03:07.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:03:07.471 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:03:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.521+0000 7fb0e7656640 1 Processor -- start 2024-05-20T18:03:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.521+0000 7fb0e7656640 1 -- start start 2024-05-20T18:03:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e7656640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0e00cf250 0x7fb0e015f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e7656640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb0e00d3220 0x7fb0e00d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e7656640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e00d0550 con 0x7fb0e00b6680 2024-05-20T18:03:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e7656640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e015f9a0 con 0x7fb0e00cf250 2024-05-20T18:03:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e7656640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e00d0b10 con 0x7fb0e00d3220 2024-05-20T18:03:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e53f2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0e00cf250 0x7fb0e015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e4bf1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb0e00b6680 0x7fb0e00b6a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46958/0 (socket says 172.21.15.6:46958) 2024-05-20T18:03:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e4bf1640 1 -- 172.21.15.6:0/1290342805 learned_addr learned my addr 172.21.15.6:0/1290342805 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e53f2640 1 -- 172.21.15.6:0/1290342805 >> v2:172.21.15.171:3300/0 conn(0x7fb0e00d3220 msgr2=0x7fb0e00d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e53f2640 1 --2- 172.21.15.6:0/1290342805 >> v2:172.21.15.171:3300/0 conn(0x7fb0e00d3220 0x7fb0e00d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e53f2640 1 -- 172.21.15.6:0/1290342805 >> v1:172.21.15.6:6789/0 conn(0x7fb0e00b6680 legacy=0x7fb0e00b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.522+0000 7fb0e53f2640 1 -- 172.21.15.6:0/1290342805 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e00d0830 con 0x7fb0e00cf250 2024-05-20T18:03:07.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0e53f2640 1 --2- 172.21.15.6:0/1290342805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e015f460 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00d11c0 tx=0x7fb0dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4df13164f5d69c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0d7fff640 1 -- 172.21.15.6:0/1290342805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc037070 con 0x7fb0e00cf250 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0d7fff640 1 -- 172.21.15.6:0/1290342805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc032440 con 0x7fb0e00cf250 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0d7fff640 1 -- 172.21.15.6:0/1290342805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc032810 con 0x7fb0e00cf250 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0e7656640 1 -- 172.21.15.6:0/1290342805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 msgr2=0x7fb0e015f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0e7656640 1 --2- 172.21.15.6:0/1290342805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e015f460 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00d11c0 tx=0x7fb0dc02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0e7656640 1 -- 172.21.15.6:0/1290342805 shutdown_connections 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0e7656640 1 --2- 172.21.15.6:0/1290342805 >> v2:172.21.15.171:3300/0 conn(0x7fb0e00d3220 0x7fb0e00d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0e7656640 1 --2- 172.21.15.6:0/1290342805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e015f460 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.523+0000 7fb0e7656640 1 -- 172.21.15.6:0/1290342805 >> 172.21.15.6:0/1290342805 conn(0x7fb0e00d1860 msgr2=0x7fb0e00d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.524+0000 7fb0e7656640 1 -- 172.21.15.6:0/1290342805 shutdown_connections 2024-05-20T18:03:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.524+0000 7fb0e7656640 1 -- 172.21.15.6:0/1290342805 wait complete. 2024-05-20T18:03:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.525+0000 7fb0e7656640 1 Processor -- start 2024-05-20T18:03:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.526+0000 7fb0e7656640 1 -- start start 2024-05-20T18:03:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e7656640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e00b6680 0x7fb0e00ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e7656640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e00b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e7656640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e00d3220 0x7fb0e00b9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e7656640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00d2d00 con 0x7fb0e00cf250 2024-05-20T18:03:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e7656640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00d27d0 con 0x7fb0e00b6680 2024-05-20T18:03:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e7656640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e00d0140 con 0x7fb0e00d3220 2024-05-20T18:03:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e4bf1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e00b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e4bf1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e00b92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55722/0 (socket says 172.21.15.6:55722) 2024-05-20T18:03:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e4bf1640 1 -- 172.21.15.6:0/2964463739 learned_addr learned my addr 172.21.15.6:0/2964463739 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e53f2640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e00b6680 0x7fb0e00ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e5bf3640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e00d3220 0x7fb0e00b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e4bf1640 1 -- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e00d3220 msgr2=0x7fb0e00b9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e4bf1640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e00d3220 0x7fb0e00b9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e4bf1640 1 -- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e00b6680 msgr2=0x7fb0e00ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e4bf1640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e00b6680 0x7fb0e00ce900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.527+0000 7fb0e4bf1640 1 -- 172.21.15.6:0/2964463739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e0154520 con 0x7fb0e00cf250 2024-05-20T18:03:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.528+0000 7fb0e4bf1640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e00b92d0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c3c0 tx=0x7fb0d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.528+0000 7fb0d5ffb640 1 -- 172.21.15.6:0/2964463739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0017070 con 0x7fb0e00cf250 2024-05-20T18:03:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.528+0000 7fb0d5ffb640 1 -- 172.21.15.6:0/2964463739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d0005ce0 con 0x7fb0e00cf250 2024-05-20T18:03:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.528+0000 7fb0d5ffb640 1 -- 172.21.15.6:0/2964463739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00072f0 con 0x7fb0e00cf250 2024-05-20T18:03:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.528+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e0154800 con 0x7fb0e00cf250 2024-05-20T18:03:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.528+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e0154dc0 con 0x7fb0e00cf250 2024-05-20T18:03:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.529+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e0163d90 con 0x7fb0e00cf250 2024-05-20T18:03:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.530+0000 7fb0d5ffb640 1 -- 172.21.15.6:0/2964463739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0d001a070 con 0x7fb0e00cf250 2024-05-20T18:03:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.530+0000 7fb0d5ffb640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb0c406be30 0x7fb0c406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.530+0000 7fb0d5ffb640 1 -- 172.21.15.6:0/2964463739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fb0d008a360 con 0x7fb0e00cf250 2024-05-20T18:03:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.530+0000 7fb0e53f2640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb0c406be30 0x7fb0c406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.531+0000 7fb0e53f2640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb0c406be30 0x7fb0c406e340 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc034000 tx=0x7fb0dc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.536+0000 7fb0d5ffb640 1 -- 172.21.15.6:0/2964463739 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb0e0163d90 con 0x7fb0e00cf250 2024-05-20T18:03:07.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.722+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0e0075b00 con 0x7fb0e00cf250 2024-05-20T18:03:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.723+0000 7fb0d5ffb640 1 -- 172.21.15.6:0/2964463739 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) ==== 74+0+16836 (secure 0 0 0) 0x7fb0d00584a0 con 0x7fb0e00cf250 2024-05-20T18:03:07.729 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:07.729 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":148,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:54.405297+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:51.154710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:51.763678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb0c406be30 msgr2=0x7fb0c406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb0c406be30 0x7fb0c406e340 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc034000 tx=0x7fb0dc02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 msgr2=0x7fb0e00b92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e00b92d0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c3c0 tx=0x7fb0d000c880 comp rx=0 tx=0).stop 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 shutdown_connections 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb0c406be30 0x7fb0c406e340 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb0e00d3220 0x7fb0e00b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0e00cf250 0x7fb0e00b92d0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 --2- 172.21.15.6:0/2964463739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0e00b6680 0x7fb0e00ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 >> 172.21.15.6:0/2964463739 conn(0x7fb0e00d1860 msgr2=0x7fb0e015d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 shutdown_connections 2024-05-20T18:03:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.726+0000 7fb0e7656640 1 -- 172.21.15.6:0/2964463739 wait complete. 2024-05-20T18:03:07.741 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T18:03:07.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:03:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.901+0000 7fd386db7640 1 Processor -- start 2024-05-20T18:03:07.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.901+0000 7fd386db7640 1 -- start start 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd386db7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd38015f700 0x7fd38015fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd386db7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd380160430 con 0x7fd3800af030 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd386db7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38006b6a0 con 0x7fd38006c180 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd386db7640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd38006bcf0 con 0x7fd38015f700 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd384b53640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd3800af030 0x7fd3800af440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35092/0 (socket says 172.21.15.6:35092) 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd384b53640 1 -- 172.21.15.6:0/1547424063 learned_addr learned my addr 172.21.15.6:0/1547424063 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd37ffff640 1 --2- 172.21.15.6:0/1547424063 >> v2:172.21.15.171:3300/0 conn(0x7fd38015f700 0x7fd38015fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714462121 0 0) 0x7fd380160430 con 0x7fd3800af030 2024-05-20T18:03:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.902+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd368003520 con 0x7fd3800af030 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2917303194 0 0) 0x7fd368003520 con 0x7fd3800af030 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 >> v2:172.21.15.171:3300/0 conn(0x7fd38015f700 msgr2=0x7fd38015fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 --2- 172.21.15.6:0/1547424063 >> v2:172.21.15.171:3300/0 conn(0x7fd38015f700 0x7fd38015fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 >> v1:172.21.15.171:6789/0 conn(0x7fd38006c180 legacy=0x7fd38006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38006b980 con 0x7fd3800af030 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7fd370001690 con 0x7fd3800af030 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 >> v1:172.21.15.6:6789/0 conn(0x7fd3800af030 legacy=0x7fd3800af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd368004800 0x7fd368004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3680051c0 0x7fd36800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd38006bcf0 con 0x7fd3680039b0 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd36800c160 con 0x7fd368004800 2024-05-20T18:03:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd36800c360 con 0x7fd3680051c0 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37ffff640 1 --2- 172.21.15.6:0/1547424063 >> v2:172.21.15.171:3300/0 conn(0x7fd38015f700 0x7fd38015fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd384b53640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd385354640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3680051c0 0x7fd36800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37ffff640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd368004800 0x7fd368004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd384b53640 1 -- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3680051c0 msgr2=0x7fd36800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd384b53640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3680051c0 0x7fd36800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd384b53640 1 -- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd368004800 msgr2=0x7fd368004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd384b53640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd368004800 0x7fd368004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd384b53640 1 -- 172.21.15.6:0/1547424063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd368003520 con 0x7fd3680039b0 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd37ffff640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd368004800 0x7fd368004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.903+0000 7fd385354640 1 -- 172.21.15.6:0/1547424063 reap_dead start 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.904+0000 7fd384b53640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fd38015d280 tx=0x7fd368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a15196e162348a server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.904+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370007d10 con 0x7fd3680039b0 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.904+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd370005af0 con 0x7fd3680039b0 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.904+0000 7fd37f7fe640 1 -- 172.21.15.6:0/1547424063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370007070 con 0x7fd3680039b0 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.905+0000 7fd386db7640 1 -- 172.21.15.6:0/1547424063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 msgr2=0x7fd368003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.905+0000 7fd386db7640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fd38015d280 tx=0x7fd368005830 comp rx=0 tx=0).stop 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.905+0000 7fd386db7640 1 -- 172.21.15.6:0/1547424063 shutdown_connections 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.905+0000 7fd386db7640 1 --2- 172.21.15.6:0/1547424063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd368003e20 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.905+0000 7fd386db7640 1 -- 172.21.15.6:0/1547424063 >> 172.21.15.6:0/1547424063 conn(0x7fd3800b6620 msgr2=0x7fd3800b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.905+0000 7fd386db7640 1 -- 172.21.15.6:0/1547424063 shutdown_connections 2024-05-20T18:03:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.905+0000 7fd386db7640 1 -- 172.21.15.6:0/1547424063 wait complete. 2024-05-20T18:03:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.907+0000 7fd386db7640 1 Processor -- start 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.907+0000 7fd386db7640 1 -- start start 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd386db7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd38015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd386db7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380161120 0x7fd3801f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd386db7640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3801f5460 0x7fd380146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd386db7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800af5c0 con 0x7fd3680039b0 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd386db7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800af440 con 0x7fd380161120 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd386db7640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd3800af740 con 0x7fd3801f5460 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd384b53640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd38015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd384b53640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd38015a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43308/0 (socket says 172.21.15.6:43308) 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd384b53640 1 -- 172.21.15.6:0/2446862581 learned_addr learned my addr 172.21.15.6:0/2446862581 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd37ffff640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380161120 0x7fd3801f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.908+0000 7fd385354640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3801f5460 0x7fd380146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd384b53640 1 -- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3801f5460 msgr2=0x7fd380146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd384b53640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3801f5460 0x7fd380146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd384b53640 1 -- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380161120 msgr2=0x7fd3801f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd384b53640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380161120 0x7fd3801f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd384b53640 1 -- 172.21.15.6:0/2446862581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3801621f0 con 0x7fd3680039b0 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd384b53640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd38015a0e0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fd37000c240 tx=0x7fd380160600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd37d7fa640 1 -- 172.21.15.6:0/2446862581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370040020 con 0x7fd3680039b0 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd37d7fa640 1 -- 172.21.15.6:0/2446862581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd370001650 con 0x7fd3680039b0 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd380161950 con 0x7fd3680039b0 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd37d7fa640 1 -- 172.21.15.6:0/2446862581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370037040 con 0x7fd3680039b0 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.909+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd380161f10 con 0x7fd3680039b0 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.910+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd380075b00 con 0x7fd3680039b0 2024-05-20T18:03:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.911+0000 7fd37d7fa640 1 -- 172.21.15.6:0/2446862581 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd370043020 con 0x7fd3680039b0 2024-05-20T18:03:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.911+0000 7fd37d7fa640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd36c06be30 0x7fd36c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.911+0000 7fd37d7fa640 1 -- 172.21.15.6:0/2446862581 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fd3700aad90 con 0x7fd3680039b0 2024-05-20T18:03:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.912+0000 7fd37ffff640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd36c06be30 0x7fd36c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.912+0000 7fd37ffff640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd36c06be30 0x7fd36c06e340 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd3740090e0 tx=0x7fd374008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:07.916+0000 7fd37d7fa640 1 -- 172.21.15.6:0/2446862581 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd37004a030 con 0x7fd3680039b0 2024-05-20T18:03:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.137+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3800d1630 con 0x7fd3680039b0 2024-05-20T18:03:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.138+0000 7fd37d7fa640 1 -- 172.21.15.6:0/2446862581 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5188 (secure 0 0 0) 0x7fd370030380 con 0x7fd3680039b0 2024-05-20T18:03:08.136 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:08.136 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":108,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2941924108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2941924108},{"type":"v1","addr":"172.21.15.6:6835","nonce":2941924108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/701117749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":701117749},{"type":"v1","addr":"172.21.15.171:6837","nonce":701117749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3661458750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3661458750},{"type":"v1","addr":"172.21.15.171:6836","nonce":3661458750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:52.794622+0000","modified":"2024-05-20T18:02:55.807339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9654":{"gid":9654,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3621358319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3621358319},{"type":"v1","addr":"172.21.15.6:6834","nonce":3621358319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9654,"qdb_cluster":[9654]},"id":11}]} 2024-05-20T18:03:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 108 2024-05-20T18:03:08.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd36c06be30 msgr2=0x7fd36c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd36c06be30 0x7fd36c06e340 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd3740090e0 tx=0x7fd374008040 comp rx=0 tx=0).stop 2024-05-20T18:03:08.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 msgr2=0x7fd38015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd38015a0e0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fd37000c240 tx=0x7fd380160600 comp rx=0 tx=0).stop 2024-05-20T18:03:08.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 shutdown_connections 2024-05-20T18:03:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fd36c06be30 0x7fd36c06e340 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd3801f5460 0x7fd380146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd380161120 0x7fd3801f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 --2- 172.21.15.6:0/2446862581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3680039b0 0x7fd38015a0e0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 >> 172.21.15.6:0/2446862581 conn(0x7fd3800b6620 msgr2=0x7fd38015fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 shutdown_connections 2024-05-20T18:03:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.140+0000 7fd386db7640 1 -- 172.21.15.6:0/2446862581 wait complete. 2024-05-20T18:03:08.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:03:08.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.270+0000 7f16aac44640 1 Processor -- start 2024-05-20T18:03:08.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.270+0000 7f16aac44640 1 -- start start 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16aac44640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a415f220 0x7f16a40cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16aac44640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a40cfd20 con 0x7f16a40cd680 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16aac44640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a406d0f0 con 0x7f16a40cf910 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16aac44640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16a40cda90 con 0x7f16a415f220 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a89e0640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f16a40cd680 0x7f16a406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35098/0 (socket says 172.21.15.6:35098) 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a89e0640 1 -- 172.21.15.6:0/90321063 learned_addr learned my addr 172.21.15.6:0/90321063 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a3fff640 1 --2- 172.21.15.6:0/90321063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a415f220 0x7f16a40cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a37fe640 1 -- 172.21.15.6:0/90321063 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3939070592 0 0) 0x7f1694001110 con 0x7f16a40cd680 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a37fe640 1 -- 172.21.15.6:0/90321063 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1690003520 con 0x7f16a40cd680 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a37fe640 1 -- 172.21.15.6:0/90321063 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 28786146 0 0) 0x7f16a406d0f0 con 0x7f16a40cf910 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a37fe640 1 -- 172.21.15.6:0/90321063 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1694001110 con 0x7f16a40cf910 2024-05-20T18:03:08.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a37fe640 1 -- 172.21.15.6:0/90321063 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3185680044 0 0) 0x7f1690003520 con 0x7f16a40cd680 2024-05-20T18:03:08.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a3fff640 1 -- 172.21.15.6:0/90321063 >> v1:172.21.15.171:6789/0 conn(0x7f16a40cf910 legacy=0x7f16a40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a3fff640 1 -- 172.21.15.6:0/90321063 >> v1:172.21.15.6:6789/0 conn(0x7f16a40cd680 legacy=0x7f16a406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.271+0000 7f16a3fff640 1 -- 172.21.15.6:0/90321063 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a406d3d0 con 0x7f16a415f220 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.272+0000 7f16a3fff640 1 --2- 172.21.15.6:0/90321063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a415f220 0x7f16a40cf3d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097d0 tx=0x7f168c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adbfa7e24c522e63 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.272+0000 7f16a37fe640 1 -- 172.21.15.6:0/90321063 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c037070 con 0x7f16a415f220 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.272+0000 7f16a37fe640 1 -- 172.21.15.6:0/90321063 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c02ab90 con 0x7f16a415f220 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.272+0000 7f16a37fe640 1 -- 172.21.15.6:0/90321063 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694001840 con 0x7f16a415f220 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.272+0000 7f16aac44640 1 -- 172.21.15.6:0/90321063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a415f220 msgr2=0x7f16a40cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.273+0000 7f16aac44640 1 --2- 172.21.15.6:0/90321063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a415f220 0x7f16a40cf3d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097d0 tx=0x7f168c02a100 comp rx=0 tx=0).stop 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.273+0000 7f16aac44640 1 -- 172.21.15.6:0/90321063 shutdown_connections 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.273+0000 7f16aac44640 1 --2- 172.21.15.6:0/90321063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a415f220 0x7f16a40cf3d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.273+0000 7f16aac44640 1 -- 172.21.15.6:0/90321063 >> 172.21.15.6:0/90321063 conn(0x7f16a40b44d0 msgr2=0x7f16a40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.273+0000 7f16aac44640 1 -- 172.21.15.6:0/90321063 shutdown_connections 2024-05-20T18:03:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.273+0000 7f16aac44640 1 -- 172.21.15.6:0/90321063 wait complete. 2024-05-20T18:03:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.274+0000 7f16aac44640 1 Processor -- start 2024-05-20T18:03:08.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.274+0000 7f16aac44640 1 -- start start 2024-05-20T18:03:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16aac44640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40cd680 0x7f16a41f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16aac44640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cf910 0x7f16a40c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16aac44640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16a415f220 0x7f16a40c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16aac44640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f16a406d990 con 0x7f16a415f220 2024-05-20T18:03:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16aac44640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16a40d0bc0 con 0x7f16a40cf910 2024-05-20T18:03:08.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16aac44640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f16a406cdd0 con 0x7f16a40cd680 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a91e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16a415f220 0x7f16a40c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a91e1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16a415f220 0x7f16a40c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43318/0 (socket says 172.21.15.6:43318) 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a91e1640 1 -- 172.21.15.6:0/2332690605 learned_addr learned my addr 172.21.15.6:0/2332690605 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a89e0640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40cd680 0x7f16a41f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a3fff640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cf910 0x7f16a40c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a91e1640 1 -- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40cd680 msgr2=0x7f16a41f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a91e1640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40cd680 0x7f16a41f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a91e1640 1 -- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cf910 msgr2=0x7f16a40c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a91e1640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cf910 0x7f16a40c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.276+0000 7f16a91e1640 1 -- 172.21.15.6:0/2332690605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a40b7d90 con 0x7f16a415f220 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.277+0000 7f16a91e1640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16a415f220 0x7f16a40c7a40 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f169c00c6b0 tx=0x7f169c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.277+0000 7f16a17fa640 1 -- 172.21.15.6:0/2332690605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c003b70 con 0x7f16a415f220 2024-05-20T18:03:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.277+0000 7f16a17fa640 1 -- 172.21.15.6:0/2332690605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f169c003d10 con 0x7f16a415f220 2024-05-20T18:03:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.277+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a40b8070 con 0x7f16a415f220 2024-05-20T18:03:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.277+0000 7f16a17fa640 1 -- 172.21.15.6:0/2332690605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c005310 con 0x7f16a415f220 2024-05-20T18:03:08.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.277+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a415fa30 con 0x7f16a415f220 2024-05-20T18:03:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.278+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a4075b00 con 0x7f16a415f220 2024-05-20T18:03:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.278+0000 7f16a17fa640 1 -- 172.21.15.6:0/2332690605 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f169c0054b0 con 0x7f16a415f220 2024-05-20T18:03:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.279+0000 7f16a17fa640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f168406be30 0x7f168406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.279+0000 7f16a17fa640 1 -- 172.21.15.6:0/2332690605 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f169c08aff0 con 0x7f16a415f220 2024-05-20T18:03:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.279+0000 7f16a89e0640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f168406be30 0x7f168406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.281+0000 7f16a89e0640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f168406be30 0x7f168406e340 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1694005880 tx=0x7f1694009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.284+0000 7f16a17fa640 1 -- 172.21.15.6:0/2332690605 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f169c059700 con 0x7f16a415f220 2024-05-20T18:03:08.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.509+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16a40b8940 con 0x7f16a415f220 2024-05-20T18:03:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.510+0000 7f16a17fa640 1 -- 172.21.15.6:0/2332690605 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) ==== 95+0+5188 (secure 0 0 0) 0x7f169c059000 con 0x7f16a415f220 2024-05-20T18:03:08.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:08.507 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":108,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2941924108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2941924108},{"type":"v1","addr":"172.21.15.6:6835","nonce":2941924108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/701117749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":701117749},{"type":"v1","addr":"172.21.15.171:6837","nonce":701117749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3661458750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3661458750},{"type":"v1","addr":"172.21.15.171:6836","nonce":3661458750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-20T18:02:52.794622+0000","modified":"2024-05-20T18:02:55.807339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9654":{"gid":9654,"name":"a","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/3621358319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3621358319},{"type":"v1","addr":"172.21.15.6:6834","nonce":3621358319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9654,"qdb_cluster":[9654]},"id":11}]} 2024-05-20T18:03:08.507 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 108 2024-05-20T18:03:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f168406be30 msgr2=0x7f168406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f168406be30 0x7f168406e340 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1694005880 tx=0x7f1694009040 comp rx=0 tx=0).stop 2024-05-20T18:03:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16a415f220 msgr2=0x7f16a40c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16a415f220 0x7f16a40c7a40 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f169c00c6b0 tx=0x7f169c00cb70 comp rx=0 tx=0).stop 2024-05-20T18:03:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 shutdown_connections 2024-05-20T18:03:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f168406be30 0x7f168406e340 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16a415f220 0x7f16a40c7a40 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16a40cf910 0x7f16a40c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 --2- 172.21.15.6:0/2332690605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16a40cd680 0x7f16a41f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 >> 172.21.15.6:0/2332690605 conn(0x7f16a40b44d0 msgr2=0x7f16a40ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 shutdown_connections 2024-05-20T18:03:08.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.512+0000 7f16aac44640 1 -- 172.21.15.6:0/2332690605 wait complete. 2024-05-20T18:03:08.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:03:08.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.638+0000 7f1331aca640 1 Processor -- start 2024-05-20T18:03:08.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.639+0000 7f1331aca640 1 -- start start 2024-05-20T18:03:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f1331aca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f132c06d3d0 0x7f132c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f1331aca640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f132c0b8190 0x7f132c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f1331aca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132c06dd20 con 0x7f132c162820 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f1331aca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f132c0d0630 con 0x7f132c06d3d0 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f1331aca640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f132c0d39c0 con 0x7f132c0b8190 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f132affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f132c06d3d0 0x7f132c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f132affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f132c06d3d0 0x7f132c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43334/0 (socket says 172.21.15.6:43334) 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f132affd640 1 -- 172.21.15.6:0/3108611039 learned_addr learned my addr 172.21.15.6:0/3108611039 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f132bfff640 1 --2- 172.21.15.6:0/3108611039 >> v2:172.21.15.171:3300/0 conn(0x7f132c0b8190 0x7f132c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f132affd640 1 -- 172.21.15.6:0/3108611039 >> v2:172.21.15.171:3300/0 conn(0x7f132c0b8190 msgr2=0x7f132c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f132affd640 1 --2- 172.21.15.6:0/3108611039 >> v2:172.21.15.171:3300/0 conn(0x7f132c0b8190 0x7f132c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f132affd640 1 -- 172.21.15.6:0/3108611039 >> v1:172.21.15.171:6789/0 conn(0x7f132c162820 legacy=0x7f132c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.640+0000 7f132affd640 1 -- 172.21.15.6:0/3108611039 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c0d3ca0 con 0x7f132c06d3d0 2024-05-20T18:03:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.641+0000 7f132affd640 1 --2- 172.21.15.6:0/3108611039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c06d7e0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f132c08e070 tx=0x7f132002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8f7baa2bc377d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.641+0000 7f132a7fc640 1 -- 172.21.15.6:0/3108611039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320037070 con 0x7f132c06d3d0 2024-05-20T18:03:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.641+0000 7f132a7fc640 1 -- 172.21.15.6:0/3108611039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1320032440 con 0x7f132c06d3d0 2024-05-20T18:03:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.641+0000 7f132a7fc640 1 -- 172.21.15.6:0/3108611039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320032810 con 0x7f132c06d3d0 2024-05-20T18:03:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.642+0000 7f1331aca640 1 -- 172.21.15.6:0/3108611039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 msgr2=0x7f132c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.642+0000 7f1331aca640 1 --2- 172.21.15.6:0/3108611039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c06d7e0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f132c08e070 tx=0x7f132002a270 comp rx=0 tx=0).stop 2024-05-20T18:03:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.642+0000 7f1331aca640 1 -- 172.21.15.6:0/3108611039 shutdown_connections 2024-05-20T18:03:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.642+0000 7f1331aca640 1 --2- 172.21.15.6:0/3108611039 >> v2:172.21.15.171:3300/0 conn(0x7f132c0b8190 0x7f132c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.642+0000 7f1331aca640 1 --2- 172.21.15.6:0/3108611039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c06d7e0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.642+0000 7f1331aca640 1 -- 172.21.15.6:0/3108611039 >> 172.21.15.6:0/3108611039 conn(0x7f132c0d4bd0 msgr2=0x7f132c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.642+0000 7f1331aca640 1 -- 172.21.15.6:0/3108611039 shutdown_connections 2024-05-20T18:03:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.642+0000 7f1331aca640 1 -- 172.21.15.6:0/3108611039 wait complete. 2024-05-20T18:03:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.644+0000 7f1331aca640 1 Processor -- start 2024-05-20T18:03:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.644+0000 7f1331aca640 1 -- start start 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.645+0000 7f1331aca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.645+0000 7f1331aca640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132c0b8190 0x7f132c1e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.645+0000 7f1331aca640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f132c162820 0x7f132c1f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.645+0000 7f1331aca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f132c0d0300 con 0x7f132c06d3d0 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.645+0000 7f1331aca640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f132c0d4260 con 0x7f132c162820 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.645+0000 7f1331aca640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f132c0b4050 con 0x7f132c0b8190 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c1589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43348/0 (socket says 172.21.15.6:43348) 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 -- 172.21.15.6:0/2558557887 learned_addr learned my addr 172.21.15.6:0/2558557887 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132bfff640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f132c162820 0x7f132c1f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 -- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132c0b8190 msgr2=0x7f132c1e8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132affd640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132c0b8190 0x7f132c1e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132c0b8190 0x7f132c1e8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 -- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f132c162820 msgr2=0x7f132c1f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f132c162820 0x7f132c1f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 -- 172.21.15.6:0/2558557887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c1f5500 con 0x7f132c06d3d0 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132bfff640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f132c162820 0x7f132c1f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132affd640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132c0b8190 0x7f132c1e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f132b7fe640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c1589a0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c3f0 tx=0x7f131c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f1313fff640 1 -- 172.21.15.6:0/2558557887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0052d0 con 0x7f132c06d3d0 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f1313fff640 1 -- 172.21.15.6:0/2558557887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131c005490 con 0x7f132c06d3d0 2024-05-20T18:03:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132c1f67f0 con 0x7f132c06d3d0 2024-05-20T18:03:08.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f1313fff640 1 -- 172.21.15.6:0/2558557887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c007260 con 0x7f132c06d3d0 2024-05-20T18:03:08.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.646+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132c1f57d0 con 0x7f132c06d3d0 2024-05-20T18:03:08.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.647+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132c075b00 con 0x7f132c06d3d0 2024-05-20T18:03:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.648+0000 7f1313fff640 1 -- 172.21.15.6:0/2558557887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f131c007400 con 0x7f132c06d3d0 2024-05-20T18:03:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.649+0000 7f1313fff640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f131806be60 0x7f131806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.649+0000 7f1313fff640 1 -- 172.21.15.6:0/2558557887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f131c08a4e0 con 0x7f132c06d3d0 2024-05-20T18:03:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.649+0000 7f132affd640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f131806be60 0x7f131806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.650+0000 7f132affd640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f131806be60 0x7f131806e370 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1320034000 tx=0x7f132002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.653+0000 7f1313fff640 1 -- 172.21.15.6:0/2558557887 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f132c06dd20 con 0x7f132c06d3d0 2024-05-20T18:03:08.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.837+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f132c0ba950 con 0x7f132c06d3d0 2024-05-20T18:03:08.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.839+0000 7f1313fff640 1 -- 172.21.15.6:0/2558557887 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) ==== 74+0+16836 (secure 0 0 0) 0x7f131c058d00 con 0x7f132c06d3d0 2024-05-20T18:03:08.836 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:08.836 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":148,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:02:54.405297+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-05-20T18:02:51.154710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-05-20T18:02:51.763678+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:03:08.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f131806be60 msgr2=0x7f131806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f131806be60 0x7f131806e370 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1320034000 tx=0x7f132002e000 comp rx=0 tx=0).stop 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 msgr2=0x7f132c1589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c1589a0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f131c00c3f0 tx=0x7f131c00c8b0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 shutdown_connections 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f131806be60 0x7f131806e370 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f132c162820 0x7f132c1f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132c0b8190 0x7f132c1e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 --2- 172.21.15.6:0/2558557887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f132c06d3d0 0x7f132c1589a0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 >> 172.21.15.6:0/2558557887 conn(0x7f132c0d4bd0 msgr2=0x7f132c160620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 shutdown_connections 2024-05-20T18:03:08.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.841+0000 7f1331aca640 1 -- 172.21.15.6:0/2558557887 wait complete. 2024-05-20T18:03:08.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-20T18:03:08.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.969+0000 7f2a0ee91640 1 Processor -- start 2024-05-20T18:03:08.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.969+0000 7f2a0ee91640 1 -- start start 2024-05-20T18:03:08.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0ee91640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2a0815f220 0x7f2a080cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0ee91640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a080d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0ee91640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a080cfd20 con 0x7f2a080cd680 2024-05-20T18:03:08.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0ee91640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2a080cda90 con 0x7f2a0815f220 2024-05-20T18:03:08.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0ee91640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0806d0f0 con 0x7f2a080cf910 2024-05-20T18:03:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a07fff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2a0815f220 0x7f2a080cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0d42e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a080d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0d42e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a080d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:38898/0 (socket says 172.21.15.6:38898) 2024-05-20T18:03:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0cc2d640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2a080cd680 0x7f2a0806c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:51516/0 (socket says 172.21.15.6:51516) 2024-05-20T18:03:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0d42e640 1 -- 172.21.15.6:0/651350273 learned_addr learned my addr 172.21.15.6:0/651350273 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a077fe640 1 -- 172.21.15.6:0/651350273 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767477424 0 0) 0x7f29f8001110 con 0x7f2a080cd680 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a077fe640 1 -- 172.21.15.6:0/651350273 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29f0003520 con 0x7f2a080cd680 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0d42e640 1 -- 172.21.15.6:0/651350273 >> v2:172.21.15.171:3300/0 conn(0x7f2a0815f220 msgr2=0x7f2a080cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0d42e640 1 --2- 172.21.15.6:0/651350273 >> v2:172.21.15.171:3300/0 conn(0x7f2a0815f220 0x7f2a080cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0d42e640 1 -- 172.21.15.6:0/651350273 >> v1:172.21.15.171:6789/0 conn(0x7f2a080cd680 legacy=0x7f2a0806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.971+0000 7f2a0d42e640 1 -- 172.21.15.6:0/651350273 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0806d3d0 con 0x7f2a080cf910 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.972+0000 7f2a07fff640 1 --2- 172.21.15.6:0/651350273 >> v2:172.21.15.171:3300/0 conn(0x7f2a0815f220 0x7f2a080cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.972+0000 7f2a0d42e640 1 --2- 172.21.15.6:0/651350273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a080d1060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e50 tx=0x7f2a0002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4127e5eb4031005c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.972+0000 7f2a077fe640 1 -- 172.21.15.6:0/651350273 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00036070 con 0x7f2a080cf910 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a077fe640 1 -- 172.21.15.6:0/651350273 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00031600 con 0x7f2a080cf910 2024-05-20T18:03:08.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a077fe640 1 -- 172.21.15.6:0/651350273 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a000319d0 con 0x7f2a080cf910 2024-05-20T18:03:08.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a0ee91640 1 -- 172.21.15.6:0/651350273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 msgr2=0x7f2a080d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/651350273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a080d1060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e50 tx=0x7f2a0002a680 comp rx=0 tx=0).stop 2024-05-20T18:03:08.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a0ee91640 1 -- 172.21.15.6:0/651350273 shutdown_connections 2024-05-20T18:03:08.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/651350273 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a080d1060 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/651350273 >> v2:172.21.15.171:3300/0 conn(0x7f2a0815f220 0x7f2a080cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a0ee91640 1 -- 172.21.15.6:0/651350273 >> 172.21.15.6:0/651350273 conn(0x7f2a080b44d0 msgr2=0x7f2a080b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:08.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a0ee91640 1 -- 172.21.15.6:0/651350273 shutdown_connections 2024-05-20T18:03:08.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.973+0000 7f2a0ee91640 1 -- 172.21.15.6:0/651350273 wait complete. 2024-05-20T18:03:08.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.975+0000 7f2a0ee91640 1 Processor -- start 2024-05-20T18:03:08.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.975+0000 7f2a0ee91640 1 -- start start 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0ee91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a080cd680 0x7f2a080c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0ee91640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a0815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0ee91640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a0815f220 0x7f2a081e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0ee91640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0806d990 con 0x7f2a080cd680 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0ee91640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080d0b80 con 0x7f2a0815f220 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0ee91640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0806cdd0 con 0x7f2a080cf910 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a080cd680 0x7f2a080c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a080cd680 0x7f2a080c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43356/0 (socket says 172.21.15.6:43356) 2024-05-20T18:03:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 -- 172.21.15.6:0/1117543053 learned_addr learned my addr 172.21.15.6:0/1117543053 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a07fff640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a0815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0d42e640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a0815f220 0x7f2a081e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 -- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 msgr2=0x7f2a0815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a0815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 -- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a0815f220 msgr2=0x7f2a081e8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a0815f220 0x7f2a081e8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 -- 172.21.15.6:0/1117543053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a08144220 con 0x7f2a080cd680 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a0cc2d640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a080cd680 0x7f2a080c53f0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c700 tx=0x7f29f800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.977+0000 7f2a057fa640 1 -- 172.21.15.6:0/1117543053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8018070 con 0x7f2a080cd680 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.978+0000 7f2a057fa640 1 -- 172.21.15.6:0/1117543053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f8007270 con 0x7f2a080cd680 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.978+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a08144500 con 0x7f2a080cd680 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.978+0000 7f2a057fa640 1 -- 172.21.15.6:0/1117543053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8007660 con 0x7f2a080cd680 2024-05-20T18:03:08.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.978+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a08144ac0 con 0x7f2a080cd680 2024-05-20T18:03:08.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.978+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a08144f00 con 0x7f2a080cd680 2024-05-20T18:03:08.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.979+0000 7f2a057fa640 1 -- 172.21.15.6:0/1117543053 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29f801b070 con 0x7f2a080cd680 2024-05-20T18:03:08.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.980+0000 7f2a057fa640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29f406be30 0x7f29f406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:08.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.980+0000 7f2a057fa640 1 -- 172.21.15.6:0/1117543053 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f29f808a0e0 con 0x7f2a080cd680 2024-05-20T18:03:08.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.980+0000 7f2a07fff640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29f406be30 0x7f29f406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:08.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.980+0000 7f2a07fff640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29f406be30 0x7f29f406e340 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2a08157600 tx=0x7f29fc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:08.984+0000 7f2a057fa640 1 -- 172.21.15.6:0/1117543053 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2a080cfd20 con 0x7f2a080cd680 2024-05-20T18:03:09.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.205+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2a08075b00 con 0x7f2a080cd680 2024-05-20T18:03:09.202 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-05-20T18:03:09.206+0000 7ff7a3657640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-20T18:03:09.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.207+0000 7f2a057fa640 1 -- 172.21.15.6:0/1117543053 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v109) ==== 161+0+0 (secure 0 0 0) 0x7f29f80582b0 con 0x7f2a080cd680 2024-05-20T18:03:09.204 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-20T18:03:09.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29f406be30 msgr2=0x7f29f406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:09.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29f406be30 0x7f29f406e340 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2a08157600 tx=0x7f29fc009190 comp rx=0 tx=0).stop 2024-05-20T18:03:09.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a080cd680 msgr2=0x7f2a080c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:09.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a080cd680 0x7f2a080c53f0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c700 tx=0x7f29f800cbc0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 shutdown_connections 2024-05-20T18:03:09.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f29f406be30 0x7f29f406e340 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a0815f220 0x7f2a081e8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a080cf910 0x7f2a0815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 --2- 172.21.15.6:0/1117543053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a080cd680 0x7f2a080c53f0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 >> 172.21.15.6:0/1117543053 conn(0x7f2a080b44d0 msgr2=0x7f2a080ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:09.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 shutdown_connections 2024-05-20T18:03:09.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.210+0000 7f2a0ee91640 1 -- 172.21.15.6:0/1117543053 wait complete. 2024-05-20T18:03:09.208 INFO:tasks.ceph.mds.a.smithi006.stderr: -2037> 2024-05-20T18:02:59.383+0000 7fb8bbae9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-20T18:03:09.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-20T18:03:09.266 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2024-05-20T18:03:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.344+0000 7f04671e0640 1 Processor -- start 2024-05-20T18:03:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.344+0000 7f04671e0640 1 -- start start 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.345+0000 7f04671e0640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0460162820 0x7f04600b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.345+0000 7f04671e0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f046006dae0 0x7f04600b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.345+0000 7f04671e0640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04600d0630 con 0x7f04600b3e80 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.345+0000 7f04671e0640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f04600d39c0 con 0x7f046006dae0 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.345+0000 7f04671e0640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f04600d3ca0 con 0x7f0460162820 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.345+0000 7f046577d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f046006dae0 0x7f04600b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.345+0000 7f045ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04600b3e80 0x7f046006d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35126/0 (socket says 172.21.15.6:35126) 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.345+0000 7f045ffff640 1 -- 172.21.15.6:0/209397567 learned_addr learned my addr 172.21.15.6:0/209397567 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.346+0000 7f0464f7c640 1 --2- 172.21.15.6:0/209397567 >> v2:172.21.15.171:3300/0 conn(0x7f0460162820 0x7f04600b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.346+0000 7f046577d640 1 -- 172.21.15.6:0/209397567 >> v2:172.21.15.171:3300/0 conn(0x7f0460162820 msgr2=0x7f04600b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:09.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.346+0000 7f046577d640 1 --2- 172.21.15.6:0/209397567 >> v2:172.21.15.171:3300/0 conn(0x7f0460162820 0x7f04600b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.346+0000 7f046577d640 1 -- 172.21.15.6:0/209397567 >> v1:172.21.15.6:6789/0 conn(0x7f04600b3e80 legacy=0x7f046006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.346+0000 7f045f7fe640 1 -- 172.21.15.6:0/209397567 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22531458 0 0) 0x7f04600d0630 con 0x7f04600b3e80 2024-05-20T18:03:09.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.346+0000 7f046577d640 1 -- 172.21.15.6:0/209397567 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600d3f80 con 0x7f046006dae0 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f046577d640 1 --2- 172.21.15.6:0/209397567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f046006dae0 0x7f04600b8190 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f04600b7740 tx=0x7f045802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddada575efe0a9fc server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f045f7fe640 1 -- 172.21.15.6:0/209397567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458007740 con 0x7f046006dae0 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f045f7fe640 1 -- 172.21.15.6:0/209397567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04580078e0 con 0x7f046006dae0 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f045f7fe640 1 -- 172.21.15.6:0/209397567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458007cb0 con 0x7f046006dae0 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f04671e0640 1 -- 172.21.15.6:0/209397567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f046006dae0 msgr2=0x7f04600b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f04671e0640 1 --2- 172.21.15.6:0/209397567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f046006dae0 0x7f04600b8190 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f04600b7740 tx=0x7f045802a680 comp rx=0 tx=0).stop 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f04671e0640 1 -- 172.21.15.6:0/209397567 shutdown_connections 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f04671e0640 1 --2- 172.21.15.6:0/209397567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f046006dae0 0x7f04600b8190 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f04671e0640 1 --2- 172.21.15.6:0/209397567 >> v2:172.21.15.171:3300/0 conn(0x7f0460162820 0x7f04600b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f04671e0640 1 -- 172.21.15.6:0/209397567 >> 172.21.15.6:0/209397567 conn(0x7f04600d4bd0 msgr2=0x7f04600d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f04671e0640 1 -- 172.21.15.6:0/209397567 shutdown_connections 2024-05-20T18:03:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.347+0000 7f04671e0640 1 -- 172.21.15.6:0/209397567 wait complete. 2024-05-20T18:03:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.349+0000 7f04671e0640 1 Processor -- start 2024-05-20T18:03:09.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.349+0000 7f04671e0640 1 -- start start 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f04671e0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04600b3e80 0x7f04600b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f04671e0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0460162820 0x7f04601584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f04671e0640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04600b61e0 0x7f04600b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f04671e0640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f04600d4780 con 0x7f04600b3e80 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f04671e0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04600d0300 con 0x7f0460162820 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f04671e0640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f04600d4900 con 0x7f04600b61e0 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04600b3e80 0x7f04600b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04600b3e80 0x7f04600b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43378/0 (socket says 172.21.15.6:43378) 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 -- 172.21.15.6:0/1124933200 learned_addr learned my addr 172.21.15.6:0/1124933200 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f045ffff640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0460162820 0x7f04601584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:09.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f046577d640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04600b61e0 0x7f04600b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 -- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04600b61e0 msgr2=0x7f04600b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04600b61e0 0x7f04600b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 -- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0460162820 msgr2=0x7f04601584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0460162820 0x7f04601584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 -- 172.21.15.6:0/1124933200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460156a60 con 0x7f04600b3e80 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f0464f7c640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04600b3e80 0x7f04600b5ca0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f045400d5f0 tx=0x7f045400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f045d7fa640 1 -- 172.21.15.6:0/1124933200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04540125f0 con 0x7f04600b3e80 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f045d7fa640 1 -- 172.21.15.6:0/1124933200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0454019070 con 0x7f04600b3e80 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0460156d40 con 0x7f04600b3e80 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.351+0000 7f045d7fa640 1 -- 172.21.15.6:0/1124933200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04540129d0 con 0x7f04600b3e80 2024-05-20T18:03:09.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.352+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0460157300 con 0x7f04600b3e80 2024-05-20T18:03:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.353+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0460075b00 con 0x7f04600b3e80 2024-05-20T18:03:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.353+0000 7f045d7fa640 1 -- 172.21.15.6:0/1124933200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0454012b70 con 0x7f04600b3e80 2024-05-20T18:03:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.354+0000 7f045d7fa640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f044406be30 0x7f044406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:09.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.354+0000 7f045d7fa640 1 -- 172.21.15.6:0/1124933200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6187+0+0 (secure 0 0 0) 0x7f045408b450 con 0x7f04600b3e80 2024-05-20T18:03:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.354+0000 7f045ffff640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f044406be30 0x7f044406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:09.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.354+0000 7f045ffff640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f044406be30 0x7f044406e340 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f046015ba80 tx=0x7f044c007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:09.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.358+0000 7f045d7fa640 1 -- 172.21.15.6:0/1124933200 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0454059c20 con 0x7f04600b3e80 2024-05-20T18:03:09.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:09.586+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f04600b85a0 con 0x7f04600b3e80 2024-05-20T18:03:10.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.209+0000 7f045d7fa640 1 -- 172.21.15.6:0/1124933200 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v110) ==== 104+0+0 (secure 0 0 0) 0x7f0454059520 con 0x7f04600b3e80 2024-05-20T18:03:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f044406be30 msgr2=0x7f044406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f044406be30 0x7f044406e340 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f046015ba80 tx=0x7f044c007c00 comp rx=0 tx=0).stop 2024-05-20T18:03:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04600b3e80 msgr2=0x7f04600b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04600b3e80 0x7f04600b5ca0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f045400d5f0 tx=0x7f045400dab0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 shutdown_connections 2024-05-20T18:03:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f044406be30 0x7f044406e340 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04600b61e0 0x7f04600b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0460162820 0x7f04601584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 --2- 172.21.15.6:0/1124933200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04600b3e80 0x7f04600b5ca0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 >> 172.21.15.6:0/1124933200 conn(0x7f04600d4bd0 msgr2=0x7f046015f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:10.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 shutdown_connections 2024-05-20T18:03:10.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.212+0000 7f04671e0640 1 -- 172.21.15.6:0/1124933200 wait complete. 2024-05-20T18:03:10.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-20T18:03:10.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.352+0000 7f40bf4cc640 1 Processor -- start 2024-05-20T18:03:10.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.353+0000 7f40bf4cc640 1 -- start start 2024-05-20T18:03:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.354+0000 7f40bf4cc640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f40b80b3860 0x7f40b80d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.354+0000 7f40bf4cc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40b808bd20 0x7f40b808c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.354+0000 7f40bf4cc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b808c670 con 0x7f40b806d870 2024-05-20T18:03:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.354+0000 7f40bf4cc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f40b80d0450 con 0x7f40b808bd20 2024-05-20T18:03:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.354+0000 7f40bf4cc640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f40b80d3b10 con 0x7f40b80b3860 2024-05-20T18:03:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.354+0000 7f40bda69640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40b808bd20 0x7f40b808c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.354+0000 7f40bda69640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40b808bd20 0x7f40b808c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43380/0 (socket says 172.21.15.6:43380) 2024-05-20T18:03:10.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.354+0000 7f40bda69640 1 -- 172.21.15.6:0/1036084240 learned_addr learned my addr 172.21.15.6:0/1036084240 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.355+0000 7f40bd268640 1 --2- 172.21.15.6:0/1036084240 >> v2:172.21.15.171:3300/0 conn(0x7f40b80b3860 0x7f40b80d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.355+0000 7f40bda69640 1 -- 172.21.15.6:0/1036084240 >> v2:172.21.15.171:3300/0 conn(0x7f40b80b3860 msgr2=0x7f40b80d45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.355+0000 7f40bda69640 1 --2- 172.21.15.6:0/1036084240 >> v2:172.21.15.171:3300/0 conn(0x7f40b80b3860 0x7f40b80d45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.355+0000 7f40bda69640 1 -- 172.21.15.6:0/1036084240 >> v1:172.21.15.6:6789/0 conn(0x7f40b806d870 legacy=0x7f40b815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.355+0000 7f40affff640 1 -- 172.21.15.6:0/1036084240 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653989987 0 0) 0x7f40a8001110 con 0x7f40b806d870 2024-05-20T18:03:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.355+0000 7f40bda69640 1 -- 172.21.15.6:0/1036084240 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b80d3df0 con 0x7f40b808bd20 2024-05-20T18:03:10.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.355+0000 7f40bda69640 1 --2- 172.21.15.6:0/1036084240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b808bd20 0x7f40b808c130 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f40b808dcf0 tx=0x7f40b002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52860bad72ba83e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:10.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40affff640 1 -- 172.21.15.6:0/1036084240 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0036070 con 0x7f40b808bd20 2024-05-20T18:03:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40affff640 1 -- 172.21.15.6:0/1036084240 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b0031600 con 0x7f40b808bd20 2024-05-20T18:03:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40affff640 1 -- 172.21.15.6:0/1036084240 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b00319d0 con 0x7f40b808bd20 2024-05-20T18:03:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40bf4cc640 1 -- 172.21.15.6:0/1036084240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b808bd20 msgr2=0x7f40b808c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/1036084240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b808bd20 0x7f40b808c130 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f40b808dcf0 tx=0x7f40b002a610 comp rx=0 tx=0).stop 2024-05-20T18:03:10.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40bf4cc640 1 -- 172.21.15.6:0/1036084240 shutdown_connections 2024-05-20T18:03:10.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/1036084240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b808bd20 0x7f40b808c130 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/1036084240 >> v2:172.21.15.171:3300/0 conn(0x7f40b80b3860 0x7f40b80d45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40bf4cc640 1 -- 172.21.15.6:0/1036084240 >> 172.21.15.6:0/1036084240 conn(0x7f40b80b6d10 msgr2=0x7f40b806d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:10.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40bf4cc640 1 -- 172.21.15.6:0/1036084240 shutdown_connections 2024-05-20T18:03:10.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.356+0000 7f40bf4cc640 1 -- 172.21.15.6:0/1036084240 wait complete. 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.358+0000 7f40bf4cc640 1 Processor -- start 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.358+0000 7f40bf4cc640 1 -- start start 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bf4cc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b806d870 0x7f40b80ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bf4cc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b808bd20 0x7f40b8157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bf4cc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b80b3860 0x7f40b80ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bf4cc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f40b80b81b0 con 0x7f40b806d870 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bf4cc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f40b80d0730 con 0x7f40b80b3860 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bf4cc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40b80b8330 con 0x7f40b808bd20 2024-05-20T18:03:10.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b806d870 0x7f40b80ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b806d870 0x7f40b80ad240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43386/0 (socket says 172.21.15.6:43386) 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 -- 172.21.15.6:0/351171441 learned_addr learned my addr 172.21.15.6:0/351171441 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bda69640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b80b3860 0x7f40b80ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bca67640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b808bd20 0x7f40b8157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 -- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b808bd20 msgr2=0x7f40b8157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b808bd20 0x7f40b8157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 -- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b80b3860 msgr2=0x7f40b80ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b80b3860 0x7f40b80ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 -- 172.21.15.6:0/351171441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b80ac1a0 con 0x7f40b806d870 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bd268640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b806d870 0x7f40b80ad240 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f40b400d600 tx=0x7f40b400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40adffb640 1 -- 172.21.15.6:0/351171441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4004240 con 0x7f40b806d870 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40adffb640 1 -- 172.21.15.6:0/351171441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b40043e0 con 0x7f40b806d870 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b80ac480 con 0x7f40b806d870 2024-05-20T18:03:10.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.360+0000 7f40adffb640 1 -- 172.21.15.6:0/351171441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4003830 con 0x7f40b806d870 2024-05-20T18:03:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.361+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b80aca40 con 0x7f40b806d870 2024-05-20T18:03:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.362+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b80690b0 con 0x7f40b806d870 2024-05-20T18:03:10.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.362+0000 7f40adffb640 1 -- 172.21.15.6:0/351171441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40b40039d0 con 0x7f40b806d870 2024-05-20T18:03:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.363+0000 7f40adffb640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409c06be60 0x7f409c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.363+0000 7f40adffb640 1 -- 172.21.15.6:0/351171441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6187+0+0 (secure 0 0 0) 0x7f40b408b3b0 con 0x7f40b806d870 2024-05-20T18:03:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.363+0000 7f40bca67640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409c06be60 0x7f409c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:10.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.363+0000 7f40bca67640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409c06be60 0x7f409c06e370 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f40b80ce910 tx=0x7f40a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:10.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.367+0000 7f40adffb640 1 -- 172.21.15.6:0/351171441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f40b4059a50 con 0x7f40b806d870 2024-05-20T18:03:10.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:10.552+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f40b80b6230 con 0x7f40b806d870 2024-05-20T18:03:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.471+0000 7f40adffb640 1 -- 172.21.15.6:0/351171441 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v150) ==== 181+0+0 (secure 0 0 0) 0x7f40b4059350 con 0x7f40b806d870 2024-05-20T18:03:11.468 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2024-05-20T18:03:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409c06be60 msgr2=0x7f409c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409c06be60 0x7f409c06e370 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f40b80ce910 tx=0x7f40a8009040 comp rx=0 tx=0).stop 2024-05-20T18:03:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b806d870 msgr2=0x7f40b80ad240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b806d870 0x7f40b80ad240 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f40b400d600 tx=0x7f40b400dac0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 shutdown_connections 2024-05-20T18:03:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f409c06be60 0x7f409c06e370 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40b80b3860 0x7f40b80ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40b808bd20 0x7f40b8157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 --2- 172.21.15.6:0/351171441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40b806d870 0x7f40b80ad240 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.475+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 >> 172.21.15.6:0/351171441 conn(0x7f40b80b6d10 msgr2=0x7f40b815ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.476+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 shutdown_connections 2024-05-20T18:03:11.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.476+0000 7f40bf4cc640 1 -- 172.21.15.6:0/351171441 wait complete. 2024-05-20T18:03:11.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-20T18:03:11.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.617+0000 7f1137b2a640 1 Processor -- start 2024-05-20T18:03:11.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.618+0000 7f1137b2a640 1 -- start start 2024-05-20T18:03:11.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f1137b2a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f11300cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:11.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f1137b2a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f11300cdf70 0x7f11300ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:11.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f1137b2a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11300d2740 con 0x7f11300d2330 2024-05-20T18:03:11.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f1137b2a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f113009c3b0 con 0x7f11300cdf70 2024-05-20T18:03:11.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f1137b2a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f113006dda0 con 0x7f113006d830 2024-05-20T18:03:11.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f11360c7640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f11300cdf70 0x7f11300ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:11.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f11350c5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f11300cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:11.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f11358c6640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f11300d2330 0x7f113006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:51530/0 (socket says 172.21.15.6:51530) 2024-05-20T18:03:11.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f11358c6640 1 -- 172.21.15.6:0/4287050877 learned_addr learned my addr 172.21.15.6:0/4287050877 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:11.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.619+0000 7f11350c5640 1 --2- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f11300cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.6:38968/0 (socket says 172.21.15.6:38968) 2024-05-20T18:03:11.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.620+0000 7f11360c7640 1 -- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 msgr2=0x7f11300cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.620+0000 7f11360c7640 1 --2- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f11300cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.620+0000 7f11360c7640 1 -- 172.21.15.6:0/4287050877 >> v1:172.21.15.171:6789/0 conn(0x7f11300d2330 legacy=0x7f113006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.620+0000 7f11360c7640 1 -- 172.21.15.6:0/4287050877 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11300b81a0 con 0x7f11300cdf70 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.620+0000 7f11350c5640 1 --2- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f11300cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.621+0000 7f11360c7640 1 --2- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 0x7f11300ce380 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1128009d90 tx=0x7f112802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=659631ff3901a128 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.621+0000 7f11348c4640 1 -- 172.21.15.6:0/4287050877 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128007740 con 0x7f11300cdf70 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.621+0000 7f11348c4640 1 -- 172.21.15.6:0/4287050877 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11280078e0 con 0x7f11300cdf70 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.621+0000 7f11348c4640 1 -- 172.21.15.6:0/4287050877 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128007cb0 con 0x7f11300cdf70 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.622+0000 7f1137b2a640 1 -- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 msgr2=0x7f11300ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.622+0000 7f1137b2a640 1 --2- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 0x7f11300ce380 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1128009d90 tx=0x7f112802a660 comp rx=0 tx=0).stop 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.622+0000 7f1137b2a640 1 -- 172.21.15.6:0/4287050877 shutdown_connections 2024-05-20T18:03:11.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.622+0000 7f1137b2a640 1 --2- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 0x7f11300ce380 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.622+0000 7f1137b2a640 1 --2- 172.21.15.6:0/4287050877 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f11300cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.622+0000 7f1137b2a640 1 -- 172.21.15.6:0/4287050877 >> 172.21.15.6:0/4287050877 conn(0x7f11300cf450 msgr2=0x7f11300cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:11.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.622+0000 7f1137b2a640 1 -- 172.21.15.6:0/4287050877 shutdown_connections 2024-05-20T18:03:11.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.622+0000 7f1137b2a640 1 -- 172.21.15.6:0/4287050877 wait complete. 2024-05-20T18:03:11.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.623+0000 7f1137b2a640 1 Processor -- start 2024-05-20T18:03:11.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.624+0000 7f1137b2a640 1 -- start start 2024-05-20T18:03:11.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f1137b2a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f113015e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:11.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f1137b2a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 0x7f11300cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:11.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f1137b2a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11300d2330 0x7f11300cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:11.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f1137b2a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f11300d3980 con 0x7f11300d2330 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f1137b2a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f11300d3800 con 0x7f11300cdf70 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f1137b2a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f11300b4180 con 0x7f113006d830 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11360c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11300d2330 0x7f11300cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11360c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11300d2330 0x7f11300cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43388/0 (socket says 172.21.15.6:43388) 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11360c7640 1 -- 172.21.15.6:0/342874702 learned_addr learned my addr 172.21.15.6:0/342874702 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11350c5640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 0x7f11300cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11358c6640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f113015e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11360c7640 1 -- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 msgr2=0x7f113015e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11360c7640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f113015e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11360c7640 1 -- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 msgr2=0x7f11300cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11360c7640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 0x7f11300cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.625+0000 7f11360c7640 1 -- 172.21.15.6:0/342874702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113015f100 con 0x7f11300d2330 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.626+0000 7f11360c7640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11300d2330 0x7f11300cb160 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f112802ac50 tx=0x7f1128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:11.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.626+0000 7f11267fc640 1 -- 172.21.15.6:0/342874702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112803f070 con 0x7f11300d2330 2024-05-20T18:03:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.626+0000 7f11267fc640 1 -- 172.21.15.6:0/342874702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1128031bc0 con 0x7f11300d2330 2024-05-20T18:03:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.626+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11300c9cd0 con 0x7f11300d2330 2024-05-20T18:03:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.626+0000 7f11267fc640 1 -- 172.21.15.6:0/342874702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128009450 con 0x7f11300d2330 2024-05-20T18:03:11.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.626+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11300ca290 con 0x7f11300d2330 2024-05-20T18:03:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.627+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11300690b0 con 0x7f11300d2330 2024-05-20T18:03:11.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.628+0000 7f11267fc640 1 -- 172.21.15.6:0/342874702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f112803b410 con 0x7f11300d2330 2024-05-20T18:03:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.628+0000 7f11267fc640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111406be30 0x7f111406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.628+0000 7f11267fc640 1 -- 172.21.15.6:0/342874702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5749+0+0 (secure 0 0 0) 0x7f11280ac5a0 con 0x7f11300d2330 2024-05-20T18:03:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.628+0000 7f11358c6640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111406be30 0x7f111406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:11.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.629+0000 7f11358c6640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111406be30 0x7f111406e340 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f112c0058d0 tx=0x7f112c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:11.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.633+0000 7f11267fc640 1 -- 172.21.15.6:0/342874702 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f112807a840 con 0x7f11300d2330 2024-05-20T18:03:11.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:11.815+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f113015ee90 con 0x7f11300d2330 2024-05-20T18:03:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.476+0000 7f11267fc640 1 -- 172.21.15.6:0/342874702 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v151) ==== 169+0+0 (secure 0 0 0) 0x7f112807eb40 con 0x7f11300d2330 2024-05-20T18:03:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2024-05-20T18:03:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.480+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111406be30 msgr2=0x7f111406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.480+0000 7f1137b2a640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111406be30 0x7f111406e340 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f112c0058d0 tx=0x7f112c009040 comp rx=0 tx=0).stop 2024-05-20T18:03:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.480+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11300d2330 msgr2=0x7f11300cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.480+0000 7f1137b2a640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11300d2330 0x7f11300cb160 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f112802ac50 tx=0x7f1128004a40 comp rx=0 tx=0).stop 2024-05-20T18:03:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.483+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 shutdown_connections 2024-05-20T18:03:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.483+0000 7f1137b2a640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111406be30 0x7f111406e340 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.483+0000 7f1137b2a640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11300d2330 0x7f11300cb160 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.483+0000 7f1137b2a640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11300cdf70 0x7f11300cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.483+0000 7f1137b2a640 1 --2- 172.21.15.6:0/342874702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f113006d830 0x7f113015e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.483+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 >> 172.21.15.6:0/342874702 conn(0x7f11300cf450 msgr2=0x7f1130162e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.484+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 shutdown_connections 2024-05-20T18:03:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.484+0000 7f1137b2a640 1 -- 172.21.15.6:0/342874702 wait complete. 2024-05-20T18:03:12.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-20T18:03:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.630+0000 7fc25dabc640 1 Processor -- start 2024-05-20T18:03:12.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.630+0000 7fc25dabc640 1 -- start start 2024-05-20T18:03:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.631+0000 7fc25dabc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc258168050 0x7fc25816a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.631+0000 7fc25dabc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2580d0630 con 0x7fc258162820 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.631+0000 7fc25dabc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2580d39c0 con 0x7fc25806d3d0 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.631+0000 7fc25dabc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fc2580d3ca0 con 0x7fc258168050 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.631+0000 7fc257fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc258168050 0x7fc25816a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.631+0000 7fc2577fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc258162820 0x7fc2580b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35140/0 (socket says 172.21.15.6:35140) 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.631+0000 7fc2577fe640 1 -- 172.21.15.6:0/3680582226 learned_addr learned my addr 172.21.15.6:0/3680582226 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.632+0000 7fc257fff640 1 -- 172.21.15.6:0/3680582226 >> v1:172.21.15.171:6789/0 conn(0x7fc25806d3d0 legacy=0x7fc25806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.632+0000 7fc257fff640 1 -- 172.21.15.6:0/3680582226 >> v1:172.21.15.6:6789/0 conn(0x7fc258162820 legacy=0x7fc2580b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.632+0000 7fc2567fc640 1 -- 172.21.15.6:0/3680582226 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941965739 0 0) 0x7fc2580d0630 con 0x7fc258162820 2024-05-20T18:03:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.632+0000 7fc257fff640 1 -- 172.21.15.6:0/3680582226 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2580d3f80 con 0x7fc258168050 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.632+0000 7fc257fff640 1 --2- 172.21.15.6:0/3680582226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258168050 0x7fc25816a470 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fc250009d90 tx=0x7fc25002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172f176dcc9a693b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.632+0000 7fc2567fc640 1 -- 172.21.15.6:0/3680582226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250007740 con 0x7fc258168050 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc2567fc640 1 -- 172.21.15.6:0/3680582226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2500078e0 con 0x7fc258168050 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc2567fc640 1 -- 172.21.15.6:0/3680582226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250007cb0 con 0x7fc258168050 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc25dabc640 1 -- 172.21.15.6:0/3680582226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258168050 msgr2=0x7fc25816a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc25dabc640 1 --2- 172.21.15.6:0/3680582226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258168050 0x7fc25816a470 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fc250009d90 tx=0x7fc25002a6f0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc25dabc640 1 -- 172.21.15.6:0/3680582226 shutdown_connections 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc25dabc640 1 --2- 172.21.15.6:0/3680582226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258168050 0x7fc25816a470 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc25dabc640 1 -- 172.21.15.6:0/3680582226 >> 172.21.15.6:0/3680582226 conn(0x7fc2580d4bd0 msgr2=0x7fc2580d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc25dabc640 1 -- 172.21.15.6:0/3680582226 shutdown_connections 2024-05-20T18:03:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.633+0000 7fc25dabc640 1 -- 172.21.15.6:0/3680582226 wait complete. 2024-05-20T18:03:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.635+0000 7fc25dabc640 1 Processor -- start 2024-05-20T18:03:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.635+0000 7fc25dabc640 1 -- start start 2024-05-20T18:03:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.636+0000 7fc25dabc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc25806d3d0 0x7fc258142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.636+0000 7fc25dabc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258162820 0x7fc2580b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.636+0000 7fc25dabc640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc258168050 0x7fc2580b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.636+0000 7fc25dabc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580b91a0 con 0x7fc258162820 2024-05-20T18:03:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.636+0000 7fc25dabc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc2580d0300 con 0x7fc25806d3d0 2024-05-20T18:03:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.636+0000 7fc25dabc640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc2580b4050 con 0x7fc258168050 2024-05-20T18:03:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258162820 0x7fc2580b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258162820 0x7fc2580b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43404/0 (socket says 172.21.15.6:43404) 2024-05-20T18:03:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 -- 172.21.15.6:0/474906180 learned_addr learned my addr 172.21.15.6:0/474906180 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc2577fe640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc25806d3d0 0x7fc258142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc257fff640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc258168050 0x7fc2580b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 -- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc258168050 msgr2=0x7fc2580b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc258168050 0x7fc2580b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 -- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc25806d3d0 msgr2=0x7fc258142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc25806d3d0 0x7fc258142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 -- 172.21.15.6:0/474906180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc258154f20 con 0x7fc258162820 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc256ffd640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258162820 0x7fc2580b62f0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c430 tx=0x7fc24c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc23ffff640 1 -- 172.21.15.6:0/474906180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c017070 con 0x7fc258162820 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc23ffff640 1 -- 172.21.15.6:0/474906180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24c0052d0 con 0x7fc258162820 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc23ffff640 1 -- 172.21.15.6:0/474906180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c003830 con 0x7fc258162820 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.637+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc258155200 con 0x7fc258162820 2024-05-20T18:03:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.638+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2581557c0 con 0x7fc258162820 2024-05-20T18:03:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.638+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2580b6dd0 con 0x7fc258162820 2024-05-20T18:03:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.639+0000 7fc23ffff640 1 -- 172.21.15.6:0/474906180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc24c01a070 con 0x7fc258162820 2024-05-20T18:03:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.640+0000 7fc23ffff640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc24406be30 0x7fc24406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.640+0000 7fc23ffff640 1 -- 172.21.15.6:0/474906180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fc24c08a050 con 0x7fc258162820 2024-05-20T18:03:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.640+0000 7fc2577fe640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc24406be30 0x7fc24406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.641+0000 7fc2577fe640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc24406be30 0x7fc24406e340 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc248000f60 tx=0x7fc248007d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.645+0000 7fc23ffff640 1 -- 172.21.15.6:0/474906180 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc24c058b70 con 0x7fc258162820 2024-05-20T18:03:12.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.830+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc2580d4780 con 0x7fc258162820 2024-05-20T18:03:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.833+0000 7fc23ffff640 1 -- 172.21.15.6:0/474906180 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v67) ==== 104+0+0 (secure 0 0 0) 0x7fc2580d4780 con 0x7fc258162820 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc24406be30 msgr2=0x7fc24406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc24406be30 0x7fc24406e340 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc248000f60 tx=0x7fc248007d00 comp rx=0 tx=0).stop 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258162820 msgr2=0x7fc2580b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258162820 0x7fc2580b62f0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c430 tx=0x7fc24c00c8f0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 shutdown_connections 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fc24406be30 0x7fc24406e340 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc258168050 0x7fc2580b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc258162820 0x7fc2580b62f0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 --2- 172.21.15.6:0/474906180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc25806d3d0 0x7fc258142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 >> 172.21.15.6:0/474906180 conn(0x7fc2580d4bd0 msgr2=0x7fc25815cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 shutdown_connections 2024-05-20T18:03:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.835+0000 7fc25dabc640 1 -- 172.21.15.6:0/474906180 wait complete. 2024-05-20T18:03:12.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug' 2024-05-20T18:03:12.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.964+0000 7f76d2d4c640 1 Processor -- start 2024-05-20T18:03:12.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.964+0000 7f76d2d4c640 1 -- start start 2024-05-20T18:03:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76d2d4c640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f76cc162820 0x7f76cc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76d2d4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc06dae0 0x7f76cc0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76d2d4c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc0d0630 con 0x7f76cc0b3e80 2024-05-20T18:03:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76d2d4c640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f76cc0d39c0 con 0x7f76cc162820 2024-05-20T18:03:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76d2d4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76cc0d3ca0 con 0x7f76cc06dae0 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76d12e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc06dae0 0x7f76cc0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76cbfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f76cc0b3e80 0x7f76cc06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:51548/0 (socket says 172.21.15.6:51548) 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76d0ae8640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f76cc162820 0x7f76cc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76cbfff640 1 -- 172.21.15.6:0/3449666007 learned_addr learned my addr 172.21.15.6:0/3449666007 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.966+0000 7f76d0ae8640 1 -- 172.21.15.6:0/3449666007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc06dae0 msgr2=0x7f76cc0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.967+0000 7f76d0ae8640 1 --2- 172.21.15.6:0/3449666007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc06dae0 0x7f76cc0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.967+0000 7f76d0ae8640 1 -- 172.21.15.6:0/3449666007 >> v1:172.21.15.171:6789/0 conn(0x7f76cc0b3e80 legacy=0x7f76cc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.967+0000 7f76d0ae8640 1 -- 172.21.15.6:0/3449666007 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc0d3f80 con 0x7f76cc162820 2024-05-20T18:03:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.967+0000 7f76d12e9640 1 --2- 172.21.15.6:0/3449666007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc06dae0 0x7f76cc0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.967+0000 7f76d0ae8640 1 --2- 172.21.15.6:0/3449666007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc162820 0x7f76cc0b3940 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f76c00097a0 tx=0x7f76c002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c316a48efac416f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76cb7fe640 1 -- 172.21.15.6:0/3449666007 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0037070 con 0x7f76cc162820 2024-05-20T18:03:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76cb7fe640 1 -- 172.21.15.6:0/3449666007 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c0032440 con 0x7f76cc162820 2024-05-20T18:03:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76cb7fe640 1 -- 172.21.15.6:0/3449666007 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0032810 con 0x7f76cc162820 2024-05-20T18:03:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3449666007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc162820 msgr2=0x7f76cc0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3449666007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc162820 0x7f76cc0b3940 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f76c00097a0 tx=0x7f76c002a180 comp rx=0 tx=0).stop 2024-05-20T18:03:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3449666007 shutdown_connections 2024-05-20T18:03:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3449666007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc06dae0 0x7f76cc0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3449666007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc162820 0x7f76cc0b3940 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3449666007 >> 172.21.15.6:0/3449666007 conn(0x7f76cc0d4bd0 msgr2=0x7f76cc0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3449666007 shutdown_connections 2024-05-20T18:03:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.968+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3449666007 wait complete. 2024-05-20T18:03:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.970+0000 7f76d2d4c640 1 Processor -- start 2024-05-20T18:03:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.970+0000 7f76d2d4c640 1 -- start start 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76d2d4c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc0b3e80 0x7f76cc150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76d2d4c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc162820 0x7f76cc0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76d2d4c640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc0cc900 0x7f76cc0b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76d2d4c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc0d4780 con 0x7f76cc162820 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76d2d4c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc0d0300 con 0x7f76cc0b3e80 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76d2d4c640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f76cc0d4900 con 0x7f76cc0cc900 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc162820 0x7f76cc0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc162820 0x7f76cc0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43406/0 (socket says 172.21.15.6:43406) 2024-05-20T18:03:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 -- 172.21.15.6:0/3424814639 learned_addr learned my addr 172.21.15.6:0/3424814639 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76d0ae8640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc0b3e80 0x7f76cc150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76d12e9640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc0cc900 0x7f76cc0b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 -- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc0cc900 msgr2=0x7f76cc0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc0cc900 0x7f76cc0b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 -- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc0b3e80 msgr2=0x7f76cc150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc0b3e80 0x7f76cc150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 -- 172.21.15.6:0/3424814639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc150560 con 0x7f76cc162820 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.972+0000 7f76cbfff640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc162820 0x7f76cc0c9ce0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c3f0 tx=0x7f76b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.973+0000 7f76c97fa640 1 -- 172.21.15.6:0/3424814639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8017070 con 0x7f76cc162820 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.973+0000 7f76c97fa640 1 -- 172.21.15.6:0/3424814639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b8005ce0 con 0x7f76cc162820 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.973+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc0cb5d0 con 0x7f76cc162820 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.973+0000 7f76c97fa640 1 -- 172.21.15.6:0/3424814639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b80072f0 con 0x7f76cc162820 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.973+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76cc0c9240 con 0x7f76cc162820 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.974+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76cc075b00 con 0x7f76cc162820 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.974+0000 7f76c97fa640 1 -- 172.21.15.6:0/3424814639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76b801a070 con 0x7f76cc162820 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.975+0000 7f76c97fa640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76b006be30 0x7f76b006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.975+0000 7f76c97fa640 1 -- 172.21.15.6:0/3424814639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f76b8089fe0 con 0x7f76cc162820 2024-05-20T18:03:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.975+0000 7f76d0ae8640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76b006be30 0x7f76b006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:12.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.976+0000 7f76d0ae8640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76b006be30 0x7f76b006e340 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f76c0034000 tx=0x7f76c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:12.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:12.979+0000 7f76c97fa640 1 -- 172.21.15.6:0/3424814639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f76cc150560 con 0x7f76cc162820 2024-05-20T18:03:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.237+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]} v 0) -- 0x7f76cc15b710 con 0x7f76cc162820 2024-05-20T18:03:13.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.478+0000 7f76c97fa640 1 -- 172.21.15.6:0/3424814639 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]}]=0 v536) ==== 151+0+0 (secure 0 0 0) 0x7f76b8058430 con 0x7f76cc162820 2024-05-20T18:03:13.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76b006be30 msgr2=0x7f76b006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:13.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76b006be30 0x7f76b006e340 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f76c0034000 tx=0x7f76c002e000 comp rx=0 tx=0).stop 2024-05-20T18:03:13.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc162820 msgr2=0x7f76cc0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:13.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc162820 0x7f76cc0c9ce0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c3f0 tx=0x7f76b800c8b0 comp rx=0 tx=0).stop 2024-05-20T18:03:13.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 shutdown_connections 2024-05-20T18:03:13.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f76b006be30 0x7f76b006e340 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:13.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76cc0cc900 0x7f76cc0b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:13.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76cc162820 0x7f76cc0c9ce0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:13.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 --2- 172.21.15.6:0/3424814639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76cc0b3e80 0x7f76cc150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:13.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.480+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 >> 172.21.15.6:0/3424814639 conn(0x7f76cc0d4bd0 msgr2=0x7f76cc161d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:13.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.481+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 shutdown_connections 2024-05-20T18:03:13.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:13.481+0000 7f76d2d4c640 1 -- 172.21.15.6:0/3424814639 wait complete. 2024-05-20T18:03:13.492 INFO:tasks.cephfs_test_runner:When a client has a bug (which we will simulate) preventing it from releasing caps, ... skipped 'Require FUSE client to inject client release failure' 2024-05-20T18:03:13.492 INFO:tasks.cephfs_test_runner: 2024-05-20T18:03:13.493 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-20T18:03:13.493 INFO:tasks.cephfs_test_runner:Ran 10 tests in 557.408s 2024-05-20T18:03:13.493 INFO:tasks.cephfs_test_runner: 2024-05-20T18:03:13.493 INFO:tasks.cephfs_test_runner:OK (skipped=4) 2024-05-20T18:03:13.493 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-20T18:03:13.522 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-20T18:03:13.556 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-20T18:03:13.556 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:03:13.556 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:13.581 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:03:13.581 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-05-20T18:03:13.581 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:13.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19930 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-20T18:03:13.643 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:03:13.643 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:13.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:03:13.667 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-20T18:03:13.668 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-20T18:03:13.732 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=351 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-20T18:03:13.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:13.732 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T18:03:13.755 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-20T18:03:13.755 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-20T18:03:13.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:13.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-20T18:03:13.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:13.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-20T18:03:13.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:13.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-05-20T18:03:14.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:14.002 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-05-20T18:03:14.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:14.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-05-20T18:03:14.094 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2024-05-20T18:03:14.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:03:14.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:14.096 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T18:03:14.116 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-20T18:03:14.116 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-20T18:03:14.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:14.116 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-20T18:03:14.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:14.186 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-20T18:03:14.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:14.256 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-05-20T18:03:14.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:14.357 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-05-20T18:03:14.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-20T18:03:14.373 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-05-20T18:03:14.442 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-05-20T18:03:14.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:03:14.444 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-20T18:03:14.454 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-20T18:03:14.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:03:14.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.578+0000 7f7a7e3d5640 1 Processor -- start 2024-05-20T18:03:14.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.578+0000 7f7a7e3d5640 1 -- start start 2024-05-20T18:03:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a7e3d5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7a7815d5f0 0x7f7a781576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a7e3d5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a7806c9a0 0x7f7a780ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a7e3d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a780cec00 0x7f7a7806e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a7e3d5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7806b900 con 0x7f7a7806c9a0 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a7e3d5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7806bbe0 con 0x7f7a7815d5f0 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a7e3d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7806bec0 con 0x7f7a780cec00 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a6ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a7806c9a0 0x7f7a780ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a6ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a7806c9a0 0x7f7a780ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43408/0 (socket says 172.21.15.6:43408) 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a6ffff640 1 -- 172.21.15.6:0/4172000007 learned_addr learned my addr 172.21.15.6:0/4172000007 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a77fff640 1 --2- 172.21.15.6:0/4172000007 >> v2:172.21.15.171:3300/0 conn(0x7f7a7815d5f0 0x7f7a781576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a7c972640 1 --2- 172.21.15.6:0/4172000007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a780cec00 0x7f7a7806e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a6ffff640 1 -- 172.21.15.6:0/4172000007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a780cec00 msgr2=0x7f7a7806e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a6ffff640 1 --2- 172.21.15.6:0/4172000007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a780cec00 0x7f7a7806e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a6ffff640 1 -- 172.21.15.6:0/4172000007 >> v2:172.21.15.171:3300/0 conn(0x7f7a7815d5f0 msgr2=0x7f7a781576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a6ffff640 1 --2- 172.21.15.6:0/4172000007 >> v2:172.21.15.171:3300/0 conn(0x7f7a7815d5f0 0x7f7a781576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a6ffff640 1 -- 172.21.15.6:0/4172000007 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7806c1a0 con 0x7f7a7806c9a0 2024-05-20T18:03:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.580+0000 7f7a7c972640 1 --2- 172.21.15.6:0/4172000007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a780cec00 0x7f7a7806e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.581+0000 7f7a6ffff640 1 --2- 172.21.15.6:0/4172000007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7806c9a0 0x7f7a780ce6c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f7a7806d110 tx=0x7f7a6002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e65a8c48ec6c48 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.581+0000 7f7a777fe640 1 -- 172.21.15.6:0/4172000007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60037070 con 0x7f7a7806c9a0 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.581+0000 7f7a777fe640 1 -- 172.21.15.6:0/4172000007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a60032440 con 0x7f7a7806c9a0 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.581+0000 7f7a777fe640 1 -- 172.21.15.6:0/4172000007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60032810 con 0x7f7a7806c9a0 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/4172000007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7806c9a0 msgr2=0x7f7a780ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/4172000007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7806c9a0 0x7f7a780ce6c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f7a7806d110 tx=0x7f7a6002a140 comp rx=0 tx=0).stop 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/4172000007 shutdown_connections 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/4172000007 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a780cec00 0x7f7a7806e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/4172000007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7806c9a0 0x7f7a780ce6c0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/4172000007 >> v2:172.21.15.171:3300/0 conn(0x7f7a7815d5f0 0x7f7a781576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/4172000007 >> 172.21.15.6:0/4172000007 conn(0x7f7a780cd2a0 msgr2=0x7f7a780cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/4172000007 shutdown_connections 2024-05-20T18:03:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.582+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/4172000007 wait complete. 2024-05-20T18:03:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.584+0000 7f7a7e3d5640 1 Processor -- start 2024-05-20T18:03:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.584+0000 7f7a7e3d5640 1 -- start start 2024-05-20T18:03:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7e3d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a7806c9a0 0x7f7a78156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7e3d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a780cec00 0x7f7a7813e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7e3d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7815d5f0 0x7f7a7806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7e3d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7806b520 con 0x7f7a7815d5f0 2024-05-20T18:03:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7e3d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7806cdb0 con 0x7f7a780cec00 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7e3d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7806b6a0 con 0x7f7a7806c9a0 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7c972640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7815d5f0 0x7f7a7806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7c972640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7815d5f0 0x7f7a7806e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43424/0 (socket says 172.21.15.6:43424) 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.585+0000 7f7a7c972640 1 -- 172.21.15.6:0/2620144625 learned_addr learned my addr 172.21.15.6:0/2620144625 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a77fff640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a7806c9a0 0x7f7a78156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a6ffff640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a780cec00 0x7f7a7813e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a7c972640 1 -- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a7806c9a0 msgr2=0x7f7a78156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a7c972640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a7806c9a0 0x7f7a78156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a7c972640 1 -- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a780cec00 msgr2=0x7f7a7813e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a7c972640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a780cec00 0x7f7a7813e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a7c972640 1 -- 172.21.15.6:0/2620144625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a78156d60 con 0x7f7a7815d5f0 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a77fff640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a7806c9a0 0x7f7a78156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a6ffff640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a780cec00 0x7f7a7813e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a7c972640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7815d5f0 0x7f7a7806e3c0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f7a70007db0 tx=0x7f7a7000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a757fa640 1 -- 172.21.15.6:0/2620144625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7001a070 con 0x7f7a7815d5f0 2024-05-20T18:03:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a757fa640 1 -- 172.21.15.6:0/2620144625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a70003990 con 0x7f7a7815d5f0 2024-05-20T18:03:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a78153590 con 0x7f7a7815d5f0 2024-05-20T18:03:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a757fa640 1 -- 172.21.15.6:0/2620144625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70003d80 con 0x7f7a7815d5f0 2024-05-20T18:03:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.586+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a78153b50 con 0x7f7a7815d5f0 2024-05-20T18:03:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.587+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a78075b00 con 0x7f7a7815d5f0 2024-05-20T18:03:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.588+0000 7f7a757fa640 1 -- 172.21.15.6:0/2620144625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a7001d070 con 0x7f7a7815d5f0 2024-05-20T18:03:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.588+0000 7f7a757fa640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.589+0000 7f7a757fa640 1 -- 172.21.15.6:0/2620144625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f7a7008afe0 con 0x7f7a7815d5f0 2024-05-20T18:03:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.589+0000 7f7a77fff640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.589+0000 7f7a77fff640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7a780b0490 tx=0x7f7a68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:14.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.593+0000 7f7a757fa640 1 -- 172.21.15.6:0/2620144625 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7a78156d60 con 0x7f7a7815d5f0 2024-05-20T18:03:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.774+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a78152990 con 0x7f7a5806be30 2024-05-20T18:03:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.775+0000 7f7a757fa640 1 -- 172.21.15.6:0/2620144625 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13502 (secure 0 0 0) 0x7f7a78152990 con 0x7f7a5806be30 2024-05-20T18:03:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:03:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 msgr2=0x7f7a5806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7a780b0490 tx=0x7f7a68008040 comp rx=0 tx=0).stop 2024-05-20T18:03:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7815d5f0 msgr2=0x7f7a7806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7815d5f0 0x7f7a7806e3c0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f7a70007db0 tx=0x7f7a7000d4a0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 shutdown_connections 2024-05-20T18:03:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f7a5806be30 0x7f7a5806e340 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a7815d5f0 0x7f7a7806e3c0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a780cec00 0x7f7a7813e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 --2- 172.21.15.6:0/2620144625 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a7806c9a0 0x7f7a78156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 >> 172.21.15.6:0/2620144625 conn(0x7f7a780cd2a0 msgr2=0x7f7a78151d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 shutdown_connections 2024-05-20T18:03:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.777+0000 7f7a7e3d5640 1 -- 172.21.15.6:0/2620144625 wait complete. 2024-05-20T18:03:14.785 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-05-20T18:03:14.390397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":273840,"kb_used_data":16072,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700880,"statfs":{"total":773094113280,"available":772813701120,"internally_reserved":0,"allocated":16457728,"data_stored":8255136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4050,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001558"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":411,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-20T18:03:12.499693+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:03:12.499693+0000","last_peered":"2024-05-20T18:03:12.499693+0000","last_clean":"2024-05-20T18:03:12.499693+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:03:12.499693+0000","last_undegraded":"2024-05-20T18:03:12.499693+0000","last_fullsized":"2024-05-20T18:03:12.499693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:03:14.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:03:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.904+0000 7fb95a3d5640 1 Processor -- start 2024-05-20T18:03:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.904+0000 7fb95a3d5640 1 -- start start 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.905+0000 7fb95a3d5640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb954162820 0x7fb9540b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.905+0000 7fb95a3d5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9540d0630 con 0x7fb9540b3e80 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.905+0000 7fb95a3d5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9540d39c0 con 0x7fb95406dae0 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.905+0000 7fb95a3d5640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb9540d3ca0 con 0x7fb954162820 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.905+0000 7fb9537fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb9540b3e80 0x7fb95406d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35144/0 (socket says 172.21.15.6:35144) 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.905+0000 7fb9537fe640 1 -- 172.21.15.6:0/1784458863 learned_addr learned my addr 172.21.15.6:0/1784458863 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.905+0000 7fb953fff640 1 --2- 172.21.15.6:0/1784458863 >> v2:172.21.15.171:3300/0 conn(0x7fb954162820 0x7fb9540b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.906+0000 7fb952ffd640 1 -- 172.21.15.6:0/1784458863 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2711101896 0 0) 0x7fb9540d0630 con 0x7fb9540b3e80 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.906+0000 7fb952ffd640 1 -- 172.21.15.6:0/1784458863 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb93c003520 con 0x7fb9540b3e80 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.906+0000 7fb952ffd640 1 -- 172.21.15.6:0/1784458863 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2708590120 0 0) 0x7fb93c003520 con 0x7fb9540b3e80 2024-05-20T18:03:14.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.906+0000 7fb953fff640 1 -- 172.21.15.6:0/1784458863 >> v1:172.21.15.171:6789/0 conn(0x7fb95406dae0 legacy=0x7fb9540b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.906+0000 7fb953fff640 1 -- 172.21.15.6:0/1784458863 >> v1:172.21.15.6:6789/0 conn(0x7fb9540b3e80 legacy=0x7fb95406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.906+0000 7fb953fff640 1 -- 172.21.15.6:0/1784458863 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9540d3f80 con 0x7fb954162820 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.907+0000 7fb953fff640 1 --2- 172.21.15.6:0/1784458863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb954162820 0x7fb9540b3940 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb9440097a0 tx=0x7fb94402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d86f8917a38ab46 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.907+0000 7fb952ffd640 1 -- 172.21.15.6:0/1784458863 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944037070 con 0x7fb954162820 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.907+0000 7fb952ffd640 1 -- 172.21.15.6:0/1784458863 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94402ab60 con 0x7fb954162820 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.907+0000 7fb952ffd640 1 -- 172.21.15.6:0/1784458863 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948001670 con 0x7fb954162820 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.908+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1784458863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb954162820 msgr2=0x7fb9540b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.908+0000 7fb95a3d5640 1 --2- 172.21.15.6:0/1784458863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb954162820 0x7fb9540b3940 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb9440097a0 tx=0x7fb94402a0d0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.908+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1784458863 shutdown_connections 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.908+0000 7fb95a3d5640 1 --2- 172.21.15.6:0/1784458863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb954162820 0x7fb9540b3940 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.908+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1784458863 >> 172.21.15.6:0/1784458863 conn(0x7fb9540d4bd0 msgr2=0x7fb9540d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.908+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1784458863 shutdown_connections 2024-05-20T18:03:14.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.908+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1784458863 wait complete. 2024-05-20T18:03:14.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.909+0000 7fb95a3d5640 1 Processor -- start 2024-05-20T18:03:14.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.910+0000 7fb95a3d5640 1 -- start start 2024-05-20T18:03:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb95a3d5640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3e80 0x7fb9540b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb95a3d5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954162820 0x7fb9540b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb95a3d5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb95415f400 0x7fb9541598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb95a3d5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540d4780 con 0x7fb954162820 2024-05-20T18:03:14.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb95a3d5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540d0300 con 0x7fb95415f400 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb95a3d5640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540d4900 con 0x7fb9540b3e80 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954162820 0x7fb9540b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954162820 0x7fb9540b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43440/0 (socket says 172.21.15.6:43440) 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb9537fe640 1 -- 172.21.15.6:0/1834126476 learned_addr learned my addr 172.21.15.6:0/1834126476 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb953fff640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3e80 0x7fb9540b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb958972640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb95415f400 0x7fb9541598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb9537fe640 1 -- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3e80 msgr2=0x7fb9540b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb9537fe640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3e80 0x7fb9540b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb9537fe640 1 -- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb95415f400 msgr2=0x7fb9541598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb9537fe640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb95415f400 0x7fb9541598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.911+0000 7fb9537fe640 1 -- 172.21.15.6:0/1834126476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9541f5a20 con 0x7fb954162820 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.912+0000 7fb9537fe640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954162820 0x7fb9540b6230 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c4b0 tx=0x7fb94800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:14.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.912+0000 7fb950ff9640 1 -- 172.21.15.6:0/1834126476 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948018070 con 0x7fb954162820 2024-05-20T18:03:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.912+0000 7fb950ff9640 1 -- 172.21.15.6:0/1834126476 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9480074e0 con 0x7fb954162820 2024-05-20T18:03:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.912+0000 7fb950ff9640 1 -- 172.21.15.6:0/1834126476 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948004a20 con 0x7fb954162820 2024-05-20T18:03:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.912+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9541f5d00 con 0x7fb954162820 2024-05-20T18:03:14.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.912+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9541f62c0 con 0x7fb954162820 2024-05-20T18:03:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.913+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb954075b00 con 0x7fb954162820 2024-05-20T18:03:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.914+0000 7fb950ff9640 1 -- 172.21.15.6:0/1834126476 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb948004bc0 con 0x7fb954162820 2024-05-20T18:03:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.914+0000 7fb950ff9640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb94006be30 0x7fb94006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.914+0000 7fb950ff9640 1 -- 172.21.15.6:0/1834126476 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fb948089f00 con 0x7fb954162820 2024-05-20T18:03:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.915+0000 7fb953fff640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb94006be30 0x7fb94006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.915+0000 7fb953fff640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb94006be30 0x7fb94006e340 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb944034000 tx=0x7fb94402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:14.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:14.919+0000 7fb950ff9640 1 -- 172.21.15.6:0/1834126476 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb9480583d0 con 0x7fb954162820 2024-05-20T18:03:15.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.099+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9540cfec0 con 0x7fb94006be30 2024-05-20T18:03:15.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.100+0000 7fb950ff9640 1 -- 172.21.15.6:0/1834126476 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13502 (secure 0 0 0) 0x7fb9540cfec0 con 0x7fb94006be30 2024-05-20T18:03:15.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:03:15.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb94006be30 msgr2=0x7fb94006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb94006be30 0x7fb94006e340 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb944034000 tx=0x7fb94402e000 comp rx=0 tx=0).stop 2024-05-20T18:03:15.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954162820 msgr2=0x7fb9540b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954162820 0x7fb9540b6230 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c4b0 tx=0x7fb94800c970 comp rx=0 tx=0).stop 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 shutdown_connections 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fb94006be30 0x7fb94006e340 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb95415f400 0x7fb9541598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954162820 0x7fb9540b6230 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 --2- 172.21.15.6:0/1834126476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9540b3e80 0x7fb9540b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 >> 172.21.15.6:0/1834126476 conn(0x7fb9540d4bd0 msgr2=0x7fb9540cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 shutdown_connections 2024-05-20T18:03:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.102+0000 7fb95a3d5640 1 -- 172.21.15.6:0/1834126476 wait complete. 2024-05-20T18:03:15.111 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-05-20T18:03:14.390397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":273840,"kb_used_data":16072,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700880,"statfs":{"total":773094113280,"available":772813701120,"internally_reserved":0,"allocated":16457728,"data_stored":8255136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4050,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001558"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":411,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-20T18:03:12.499693+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:03:12.499693+0000","last_peered":"2024-05-20T18:03:12.499693+0000","last_clean":"2024-05-20T18:03:12.499693+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:03:12.499693+0000","last_undegraded":"2024-05-20T18:03:12.499693+0000","last_fullsized":"2024-05-20T18:03:12.499693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:03:15.111 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-20T18:03:15.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:03:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.229+0000 7fcd4f4a8640 1 Processor -- start 2024-05-20T18:03:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.230+0000 7fcd4f4a8640 1 -- start start 2024-05-20T18:03:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.231+0000 7fcd4f4a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d14f0 0x7fcd480b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.231+0000 7fcd4f4a8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd480d1ac0 con 0x7fcd480cf850 2024-05-20T18:03:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.231+0000 7fcd4f4a8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd480d1da0 con 0x7fcd480d10e0 2024-05-20T18:03:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.231+0000 7fcd4f4a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcd480d2080 con 0x7fcd480d14f0 2024-05-20T18:03:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.231+0000 7fcd4ca43640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcd480cf850 0x7fcd480b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35156/0 (socket says 172.21.15.6:35156) 2024-05-20T18:03:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.231+0000 7fcd4ca43640 1 -- 172.21.15.6:0/4107819312 learned_addr learned my addr 172.21.15.6:0/4107819312 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:15.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.231+0000 7fcd4da45640 1 --2- 172.21.15.6:0/4107819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d14f0 0x7fcd480b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.232+0000 7fcd47fff640 1 -- 172.21.15.6:0/4107819312 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571443213 0 0) 0x7fcd480d1ac0 con 0x7fcd480cf850 2024-05-20T18:03:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.232+0000 7fcd47fff640 1 -- 172.21.15.6:0/4107819312 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd30003520 con 0x7fcd480cf850 2024-05-20T18:03:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.232+0000 7fcd47fff640 1 -- 172.21.15.6:0/4107819312 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214273423 0 0) 0x7fcd480d1da0 con 0x7fcd480d10e0 2024-05-20T18:03:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.232+0000 7fcd47fff640 1 -- 172.21.15.6:0/4107819312 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd480d1ac0 con 0x7fcd480d10e0 2024-05-20T18:03:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.232+0000 7fcd4da45640 1 -- 172.21.15.6:0/4107819312 >> v1:172.21.15.171:6789/0 conn(0x7fcd480d10e0 legacy=0x7fcd480cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.232+0000 7fcd4da45640 1 -- 172.21.15.6:0/4107819312 >> v1:172.21.15.6:6789/0 conn(0x7fcd480cf850 legacy=0x7fcd480b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.232+0000 7fcd4da45640 1 -- 172.21.15.6:0/4107819312 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd480d2360 con 0x7fcd480d14f0 2024-05-20T18:03:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.232+0000 7fcd4da45640 1 --2- 172.21.15.6:0/4107819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d14f0 0x7fcd480b6910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd400097d0 tx=0x7fcd4002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d7dcebc0728a84e server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.233+0000 7fcd47fff640 1 -- 172.21.15.6:0/4107819312 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40037070 con 0x7fcd480d14f0 2024-05-20T18:03:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.233+0000 7fcd47fff640 1 -- 172.21.15.6:0/4107819312 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd40032440 con 0x7fcd480d14f0 2024-05-20T18:03:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.233+0000 7fcd47fff640 1 -- 172.21.15.6:0/4107819312 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40032810 con 0x7fcd480d14f0 2024-05-20T18:03:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.233+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/4107819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d14f0 msgr2=0x7fcd480b6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.233+0000 7fcd4f4a8640 1 --2- 172.21.15.6:0/4107819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d14f0 0x7fcd480b6910 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd400097d0 tx=0x7fcd4002a210 comp rx=0 tx=0).stop 2024-05-20T18:03:15.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.233+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/4107819312 shutdown_connections 2024-05-20T18:03:15.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.233+0000 7fcd4f4a8640 1 --2- 172.21.15.6:0/4107819312 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d14f0 0x7fcd480b6910 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.233+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/4107819312 >> 172.21.15.6:0/4107819312 conn(0x7fcd480b44d0 msgr2=0x7fcd480b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:15.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.234+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/4107819312 shutdown_connections 2024-05-20T18:03:15.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.234+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/4107819312 wait complete. 2024-05-20T18:03:15.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.235+0000 7fcd4f4a8640 1 Processor -- start 2024-05-20T18:03:15.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.235+0000 7fcd4f4a8640 1 -- start start 2024-05-20T18:03:15.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4f4a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd480cf850 0x7fcd481600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4f4a8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d10e0 0x7fcd481f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4f4a8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd480d14f0 0x7fcd4815f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4f4a8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcd480b8440 con 0x7fcd480cf850 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4f4a8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcd480b82c0 con 0x7fcd480d14f0 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4f4a8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcd480709f0 con 0x7fcd480d10e0 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd480cf850 0x7fcd481600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd480cf850 0x7fcd481600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43446/0 (socket says 172.21.15.6:43446) 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 -- 172.21.15.6:0/2591339531 learned_addr learned my addr 172.21.15.6:0/2591339531 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4ca43640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d10e0 0x7fcd481f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4da45640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd480d14f0 0x7fcd4815f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 -- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d10e0 msgr2=0x7fcd481f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d10e0 0x7fcd481f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 -- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd480d14f0 msgr2=0x7fcd4815f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd480d14f0 0x7fcd4815f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 -- 172.21.15.6:0/2591339531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd48159110 con 0x7fcd480cf850 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4d244640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd480cf850 0x7fcd481600a0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800c7a0 tx=0x7fcd3800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd45ffb640 1 -- 172.21.15.6:0/2591339531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38003b70 con 0x7fcd480cf850 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd45ffb640 1 -- 172.21.15.6:0/2591339531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd38003d10 con 0x7fcd480cf850 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd45ffb640 1 -- 172.21.15.6:0/2591339531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800aa90 con 0x7fcd480cf850 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.237+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4815ac50 con 0x7fcd480cf850 2024-05-20T18:03:15.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.238+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4815b210 con 0x7fcd480cf850 2024-05-20T18:03:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.239+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd481458f0 con 0x7fcd480cf850 2024-05-20T18:03:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.239+0000 7fcd45ffb640 1 -- 172.21.15.6:0/2591339531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd3800ac30 con 0x7fcd480cf850 2024-05-20T18:03:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.240+0000 7fcd45ffb640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd3406be30 0x7fcd3406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.240+0000 7fcd45ffb640 1 -- 172.21.15.6:0/2591339531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fcd3808ab90 con 0x7fcd480cf850 2024-05-20T18:03:15.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.240+0000 7fcd4ca43640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd3406be30 0x7fcd3406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.240+0000 7fcd4ca43640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd3406be30 0x7fcd3406e340 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fcd480b58e0 tx=0x7fcd3c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.244+0000 7fcd45ffb640 1 -- 172.21.15.6:0/2591339531 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcd481458f0 con 0x7fcd480cf850 2024-05-20T18:03:15.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.423+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd481605e0 con 0x7fcd3406be30 2024-05-20T18:03:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.424+0000 7fcd45ffb640 1 -- 172.21.15.6:0/2591339531 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13502 (secure 0 0 0) 0x7fcd3c005850 con 0x7fcd3406be30 2024-05-20T18:03:15.421 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:15.422 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd3406be30 msgr2=0x7fcd3406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd3406be30 0x7fcd3406e340 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fcd480b58e0 tx=0x7fcd3c007d30 comp rx=0 tx=0).stop 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd480cf850 msgr2=0x7fcd481600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd480cf850 0x7fcd481600a0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800c7a0 tx=0x7fcd3800cc60 comp rx=0 tx=0).stop 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 shutdown_connections 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcd3406be30 0x7fcd3406e340 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd480d14f0 0x7fcd4815f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd480d10e0 0x7fcd481f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 --2- 172.21.15.6:0/2591339531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd480cf850 0x7fcd481600a0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 >> 172.21.15.6:0/2591339531 conn(0x7fcd480b44d0 msgr2=0x7fcd4815baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 shutdown_connections 2024-05-20T18:03:15.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.426+0000 7fcd4f4a8640 1 -- 172.21.15.6:0/2591339531 wait complete. 2024-05-20T18:03:15.434 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-05-20T18:03:14.390397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":273840,"kb_used_data":16072,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700880,"statfs":{"total":773094113280,"available":772813701120,"internally_reserved":0,"allocated":16457728,"data_stored":8255136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4050,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001558"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":411,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-20T18:03:12.499693+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:03:12.499693+0000","last_peered":"2024-05-20T18:03:12.499693+0000","last_clean":"2024-05-20T18:03:12.499693+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:03:12.499693+0000","last_undegraded":"2024-05-20T18:03:12.499693+0000","last_fullsized":"2024-05-20T18:03:12.499693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:03:15.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-20T18:03:15.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.554+0000 7f113618f640 1 Processor -- start 2024-05-20T18:03:15.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.554+0000 7f113618f640 1 -- start start 2024-05-20T18:03:15.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f113618f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1130162820 0x7f11300b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f113618f640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f11300b3e80 0x7f113006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f113618f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f113006d910 0x7f11300d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f113618f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f113006dd20 con 0x7f113006d910 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f113618f640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f11300d0630 con 0x7f11300b3e80 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f113618f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f11300d39c0 con 0x7f1130162820 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f112ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f113006d910 0x7f11300d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f112ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f113006d910 0x7f11300d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43448/0 (socket says 172.21.15.6:43448) 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f112ffff640 1 -- 172.21.15.6:0/2646649740 learned_addr learned my addr 172.21.15.6:0/2646649740 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f112f7fe640 1 --2- 172.21.15.6:0/2646649740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1130162820 0x7f11300b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.555+0000 7f1126ffd640 1 --2- 172.21.15.6:0/2646649740 >> v2:172.21.15.171:3300/0 conn(0x7f11300b3e80 0x7f113006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.556+0000 7f112ffff640 1 -- 172.21.15.6:0/2646649740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1130162820 msgr2=0x7f11300b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:15.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.556+0000 7f112ffff640 1 --2- 172.21.15.6:0/2646649740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1130162820 0x7f11300b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.556+0000 7f112ffff640 1 -- 172.21.15.6:0/2646649740 >> v2:172.21.15.171:3300/0 conn(0x7f11300b3e80 msgr2=0x7f113006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:15.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.556+0000 7f112ffff640 1 --2- 172.21.15.6:0/2646649740 >> v2:172.21.15.171:3300/0 conn(0x7f11300b3e80 0x7f113006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.556+0000 7f112ffff640 1 -- 172.21.15.6:0/2646649740 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11300d3ca0 con 0x7f113006d910 2024-05-20T18:03:15.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.556+0000 7f112ffff640 1 --2- 172.21.15.6:0/2646649740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f113006d910 0x7f11300d27a0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f113008d710 tx=0x7f112802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8066f65ecdd7e211 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:15.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.556+0000 7f112effd640 1 -- 172.21.15.6:0/2646649740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128036070 con 0x7f113006d910 2024-05-20T18:03:15.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.556+0000 7f112effd640 1 -- 172.21.15.6:0/2646649740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1128031600 con 0x7f113006d910 2024-05-20T18:03:15.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f112effd640 1 -- 172.21.15.6:0/2646649740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11280319d0 con 0x7f113006d910 2024-05-20T18:03:15.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 -- 172.21.15.6:0/2646649740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f113006d910 msgr2=0x7f11300d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 --2- 172.21.15.6:0/2646649740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f113006d910 0x7f11300d27a0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f113008d710 tx=0x7f112802a6a0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 -- 172.21.15.6:0/2646649740 shutdown_connections 2024-05-20T18:03:15.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 --2- 172.21.15.6:0/2646649740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f113006d910 0x7f11300d27a0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 --2- 172.21.15.6:0/2646649740 >> v2:172.21.15.171:3300/0 conn(0x7f11300b3e80 0x7f113006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 --2- 172.21.15.6:0/2646649740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1130162820 0x7f11300b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 -- 172.21.15.6:0/2646649740 >> 172.21.15.6:0/2646649740 conn(0x7f11300d4bd0 msgr2=0x7f11300d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:15.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 -- 172.21.15.6:0/2646649740 shutdown_connections 2024-05-20T18:03:15.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.557+0000 7f113618f640 1 -- 172.21.15.6:0/2646649740 wait complete. 2024-05-20T18:03:15.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.559+0000 7f113618f640 1 Processor -- start 2024-05-20T18:03:15.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.559+0000 7f113618f640 1 -- start start 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.560+0000 7f113618f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113006d910 0x7f11301f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f113618f640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11300b3e80 0x7f11300ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f113618f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1130162820 0x7f11300caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f113618f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f11300d0300 con 0x7f1130162820 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f113618f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f11300d4260 con 0x7f113006d910 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f113618f640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f11300d4780 con 0x7f11300b3e80 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1130162820 0x7f11300caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1130162820 0x7f11300caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43450/0 (socket says 172.21.15.6:43450) 2024-05-20T18:03:15.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 -- 172.21.15.6:0/3539193242 learned_addr learned my addr 172.21.15.6:0/3539193242 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f1126ffd640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11300b3e80 0x7f11300ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112f7fe640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113006d910 0x7f11301f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 -- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11300b3e80 msgr2=0x7f11300ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11300b3e80 0x7f11300ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 -- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113006d910 msgr2=0x7f11301f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113006d910 0x7f11301f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 -- 172.21.15.6:0/3539193242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11300b5220 con 0x7f1130162820 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112ffff640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1130162820 0x7f11300caa20 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f1128034040 tx=0x7f1128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112cff9640 1 -- 172.21.15.6:0/3539193242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128036050 con 0x7f1130162820 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112cff9640 1 -- 172.21.15.6:0/3539193242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1128042070 con 0x7f1130162820 2024-05-20T18:03:15.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11300b5500 con 0x7f1130162820 2024-05-20T18:03:15.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f112cff9640 1 -- 172.21.15.6:0/3539193242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128009510 con 0x7f1130162820 2024-05-20T18:03:15.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.561+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11300b5ac0 con 0x7f1130162820 2024-05-20T18:03:15.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.563+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1130075b00 con 0x7f1130162820 2024-05-20T18:03:15.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.563+0000 7f112cff9640 1 -- 172.21.15.6:0/3539193242 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1128007bf0 con 0x7f1130162820 2024-05-20T18:03:15.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.564+0000 7f112cff9640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111006be60 0x7f111006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:15.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.564+0000 7f112cff9640 1 -- 172.21.15.6:0/3539193242 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f11280abac0 con 0x7f1130162820 2024-05-20T18:03:15.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.564+0000 7f112f7fe640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111006be60 0x7f111006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:15.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.564+0000 7f112f7fe640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111006be60 0x7f111006e370 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1120009a30 tx=0x7f1120008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:15.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.568+0000 7f112cff9640 1 -- 172.21.15.6:0/3539193242 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f112807a540 con 0x7f1130162820 2024-05-20T18:03:15.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.752+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f113006d3d0 con 0x7f1130162820 2024-05-20T18:03:15.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.753+0000 7f112cff9640 1 -- 172.21.15.6:0/3539193242 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+13253 (secure 0 0 0) 0x7f1128079e40 con 0x7f1130162820 2024-05-20T18:03:15.750 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:15.750 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":151,"fsid":"08ecd7a5-bb84-4836-85d5-8cdd45e39724","created":"2024-05-20T17:52:41.985640+0000","modified":"2024-05-20T18:03:12.471822+0000","last_up_change":"2024-05-20T17:52:53.441667+0000","last_in_change":"2024-05-20T17:52:44.265143+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-20T17:52:54.275635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"915f317c-23cc-4e5f-9f78-2097fbed2b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6801","nonce":3479934487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6803","nonce":3479934487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6807","nonce":3479934487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3479934487},{"type":"v1","addr":"172.21.15.6:6805","nonce":3479934487}]},"public_addr":"172.21.15.6:6801/3479934487","cluster_addr":"172.21.15.6:6803/3479934487","heartbeat_back_addr":"172.21.15.6:6807/3479934487","heartbeat_front_addr":"172.21.15.6:6805/3479934487","state":["exists","up"]},{"osd":1,"uuid":"863e9650-3913-4b12-9b45-96f971609e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6817","nonce":3797721472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6819","nonce":3797721472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6823","nonce":3797721472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":3797721472},{"type":"v1","addr":"172.21.15.6:6821","nonce":3797721472}]},"public_addr":"172.21.15.6:6817/3797721472","cluster_addr":"172.21.15.6:6819/3797721472","heartbeat_back_addr":"172.21.15.6:6823/3797721472","heartbeat_front_addr":"172.21.15.6:6821/3797721472","state":["exists","up"]},{"osd":2,"uuid":"0d5b615b-1eed-4fd6-90e8-6b17ee4c4d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6809","nonce":1176387809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6811","nonce":1176387809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6815","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6816","nonce":1176387809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1176387809},{"type":"v1","addr":"172.21.15.6:6813","nonce":1176387809}]},"public_addr":"172.21.15.6:6809/1176387809","cluster_addr":"172.21.15.6:6811/1176387809","heartbeat_back_addr":"172.21.15.6:6816/1176387809","heartbeat_front_addr":"172.21.15.6:6813/1176387809","state":["exists","up"]},{"osd":3,"uuid":"ab635f53-4e80-4a6f-ae82-e692c74b395e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6825","nonce":3198189897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6827","nonce":3198189897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6831","nonce":3198189897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3198189897},{"type":"v1","addr":"172.21.15.6:6829","nonce":3198189897}]},"public_addr":"172.21.15.6:6825/3198189897","cluster_addr":"172.21.15.6:6827/3198189897","heartbeat_back_addr":"172.21.15.6:6831/3198189897","heartbeat_front_addr":"172.21.15.6:6829/3198189897","state":["exists","up"]},{"osd":4,"uuid":"f931e244-af1d-46da-a74f-2b92254e5b4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6818","nonce":2946312774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6823","nonce":2946312774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6829","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6831","nonce":2946312774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":2946312774},{"type":"v1","addr":"172.21.15.171:6827","nonce":2946312774}]},"public_addr":"172.21.15.171:6818/2946312774","cluster_addr":"172.21.15.171:6823/2946312774","heartbeat_back_addr":"172.21.15.171:6831/2946312774","heartbeat_front_addr":"172.21.15.171:6827/2946312774","state":["exists","up"]},{"osd":5,"uuid":"ea4a7acf-d2e6-444c-970f-cb33606423ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6801","nonce":569633911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6803","nonce":569633911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6807","nonce":569633911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":569633911},{"type":"v1","addr":"172.21.15.171:6805","nonce":569633911}]},"public_addr":"172.21.15.171:6801/569633911","cluster_addr":"172.21.15.171:6803/569633911","heartbeat_back_addr":"172.21.15.171:6807/569633911","heartbeat_front_addr":"172.21.15.171:6805/569633911","state":["exists","up"]},{"osd":6,"uuid":"86c9adf8-c087-4714-9db2-c51d697d3b83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6817","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6819","nonce":2330779284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6822","nonce":2330779284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6830","nonce":2330779284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2330779284},{"type":"v1","addr":"172.21.15.171:6826","nonce":2330779284}]},"public_addr":"172.21.15.171:6819/2330779284","cluster_addr":"172.21.15.171:6822/2330779284","heartbeat_back_addr":"172.21.15.171:6830/2330779284","heartbeat_front_addr":"172.21.15.171:6826/2330779284","state":["exists","up"]},{"osd":7,"uuid":"d2dfe8c6-2af6-4217-bc36-3d516d2c3d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6809","nonce":3357029460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6811","nonce":3357029460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6815","nonce":3357029460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3357029460},{"type":"v1","addr":"172.21.15.171:6813","nonce":3357029460}]},"public_addr":"172.21.15.171:6809/3357029460","cluster_addr":"172.21.15.171:6811/3357029460","heartbeat_back_addr":"172.21.15.171:6815/3357029460","heartbeat_front_addr":"172.21.15.171:6813/3357029460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.365233+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.459876+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.420574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.482449+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.476083+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.394072+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.458429+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-20T17:52:49.421192+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6834/3621358319":"2024-05-21T18:03:09.206017+0000","172.21.15.6:6832/3621358319":"2024-05-21T18:03:09.206017+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-20T18:03:15.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111006be60 msgr2=0x7f111006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111006be60 0x7f111006e370 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1120009a30 tx=0x7f1120008040 comp rx=0 tx=0).stop 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1130162820 msgr2=0x7f11300caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1130162820 0x7f11300caa20 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f1128034040 tx=0x7f1128004a40 comp rx=0 tx=0).stop 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 shutdown_connections 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f111006be60 0x7f111006e370 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1130162820 0x7f11300caa20 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f11300b3e80 0x7f11300ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 --2- 172.21.15.6:0/3539193242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f113006d910 0x7f11301f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 >> 172.21.15.6:0/3539193242 conn(0x7f11300d4bd0 msgr2=0x7f11300b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 shutdown_connections 2024-05-20T18:03:15.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:15.755+0000 7f113618f640 1 -- 172.21.15.6:0/3539193242 wait complete. 2024-05-20T18:03:16.764 INFO:tasks.ceph:Scrubbing osd.0 2024-05-20T18:03:16.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-20T18:03:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.901+0000 7f8370844640 1 Processor -- start 2024-05-20T18:03:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.901+0000 7f8370844640 1 -- start start 2024-05-20T18:03:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f8370844640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f836c0b3860 0x7f836c0d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f8370844640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c08bd20 0x7f836c08c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f8370844640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f836c08c670 con 0x7f836c06d870 2024-05-20T18:03:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f8370844640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f836c0d0450 con 0x7f836c0b3860 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f8370844640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f836c0d3b10 con 0x7f836c08bd20 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f836a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f836c0b3860 0x7f836c0d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f836a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f836c0b3860 0x7f836c0d45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43460/0 (socket says 172.21.15.6:43460) 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f836a59c640 1 -- 172.21.15.6:0/4136505847 learned_addr learned my addr 172.21.15.6:0/4136505847 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.903+0000 7f836ad9d640 1 --2- 172.21.15.6:0/4136505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c08bd20 0x7f836c08c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.904+0000 7f836a59c640 1 -- 172.21.15.6:0/4136505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c08bd20 msgr2=0x7f836c08c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.904+0000 7f836a59c640 1 --2- 172.21.15.6:0/4136505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c08bd20 0x7f836c08c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.904+0000 7f836a59c640 1 -- 172.21.15.6:0/4136505847 >> v1:172.21.15.171:6789/0 conn(0x7f836c06d870 legacy=0x7f836c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.904+0000 7f836a59c640 1 -- 172.21.15.6:0/4136505847 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c0d3df0 con 0x7f836c0b3860 2024-05-20T18:03:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.904+0000 7f836a59c640 1 --2- 172.21.15.6:0/4136505847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 0x7f836c0d45f0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f835c009870 tx=0x7f835c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c441c6f663d6bee8 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.904+0000 7f836959a640 1 -- 172.21.15.6:0/4136505847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c037070 con 0x7f836c0b3860 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.904+0000 7f836959a640 1 -- 172.21.15.6:0/4136505847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835c032440 con 0x7f836c0b3860 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f836959a640 1 -- 172.21.15.6:0/4136505847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c032810 con 0x7f836c0b3860 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f8370844640 1 -- 172.21.15.6:0/4136505847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 msgr2=0x7f836c0d45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f8370844640 1 --2- 172.21.15.6:0/4136505847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 0x7f836c0d45f0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f835c009870 tx=0x7f835c02a130 comp rx=0 tx=0).stop 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f8370844640 1 -- 172.21.15.6:0/4136505847 shutdown_connections 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f8370844640 1 --2- 172.21.15.6:0/4136505847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c08bd20 0x7f836c08c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f8370844640 1 --2- 172.21.15.6:0/4136505847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 0x7f836c0d45f0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f8370844640 1 -- 172.21.15.6:0/4136505847 >> 172.21.15.6:0/4136505847 conn(0x7f836c0b6d10 msgr2=0x7f836c06d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f8370844640 1 -- 172.21.15.6:0/4136505847 shutdown_connections 2024-05-20T18:03:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.905+0000 7f8370844640 1 -- 172.21.15.6:0/4136505847 wait complete. 2024-05-20T18:03:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.907+0000 7f8370844640 1 Processor -- start 2024-05-20T18:03:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.907+0000 7f8370844640 1 -- start start 2024-05-20T18:03:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f8370844640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c06d870 0x7f836c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f8370844640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f836c08bd20 0x7f836c1f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f8370844640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 0x7f836c1f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f8370844640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f836c0b81b0 con 0x7f836c0b3860 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f8370844640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f836c0d0730 con 0x7f836c08bd20 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f8370844640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f836c0b8330 con 0x7f836c06d870 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 0x7f836c1f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 0x7f836c1f8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43474/0 (socket says 172.21.15.6:43474) 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 -- 172.21.15.6:0/2970694085 learned_addr learned my addr 172.21.15.6:0/2970694085 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f8369d9b640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f836c08bd20 0x7f836c1f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836a59c640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c06d870 0x7f836c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 -- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c06d870 msgr2=0x7f836c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f836c06d870 0x7f836c1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 -- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f836c08bd20 msgr2=0x7f836c1f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f836c08bd20 0x7f836c1f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 -- 172.21.15.6:0/2970694085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c153330 con 0x7f836c0b3860 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.909+0000 7f836ad9d640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 0x7f836c1f8fd0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f836400efc0 tx=0x7f836400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.910+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364018020 con 0x7f836c0b3860 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.910+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8364014480 con 0x7f836c0b3860 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.910+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c153610 con 0x7f836c0b3860 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.910+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364009e60 con 0x7f836c0b3860 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.910+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c153bd0 con 0x7f836c0b3860 2024-05-20T18:03:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.911+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f836c153fb0 con 0x7f836c0b3860 2024-05-20T18:03:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.912+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8364005d10 con 0x7f836c0b3860 2024-05-20T18:03:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.912+0000 7f8362ffd640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834c06be30 0x7f834c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.912+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f836408b8b0 con 0x7f836c0b3860 2024-05-20T18:03:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.912+0000 7f8362ffd640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7f834c072320 0x7f834c0747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.912+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 --> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8364012e50 con 0x7f834c072320 2024-05-20T18:03:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.912+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f83640902c0 con 0x7f836c0b3860 2024-05-20T18:03:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.912+0000 7f836a59c640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834c06be30 0x7f834c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.912+0000 7f8369d9b640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7f834c072320 0x7f834c0747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.913+0000 7f8369d9b640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7f834c072320 0x7f834c0747b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.913+0000 7f836a59c640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834c06be30 0x7f834c06e340 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f835c034000 tx=0x7f835c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.913+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 <== osd.0 v2:172.21.15.6:6800/3479934487 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8364012e50 con 0x7f834c072320 2024-05-20T18:03:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 --> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f836c0cfa30 con 0x7f834c072320 2024-05-20T18:03:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8362ffd640 1 -- 172.21.15.6:0/2970694085 <== osd.0 v2:172.21.15.6:6800/3479934487 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f836c0cfa30 con 0x7f834c072320 2024-05-20T18:03:16.924 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:03:16.924 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-20T18:03:16.924 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:03:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7f834c072320 msgr2=0x7f834c0747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.6:6800/3479934487,v1:172.21.15.6:6801/3479934487] conn(0x7f834c072320 0x7f834c0747b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834c06be30 msgr2=0x7f834c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f834c06be30 0x7f834c06e340 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f835c034000 tx=0x7f835c02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 msgr2=0x7f836c1f8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 --2- 172.21.15.6:0/2970694085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f836c0b3860 0x7f836c1f8fd0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f836400efc0 tx=0x7f836400c490 comp rx=0 tx=0).stop 2024-05-20T18:03:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f836ad9d640 1 -- 172.21.15.6:0/2970694085 reap_dead start 2024-05-20T18:03:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 shutdown_connections 2024-05-20T18:03:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.927+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 >> 172.21.15.6:0/2970694085 conn(0x7f836c0b6d10 msgr2=0x7f836c0b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.928+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 shutdown_connections 2024-05-20T18:03:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:16.928+0000 7f8370844640 1 -- 172.21.15.6:0/2970694085 wait complete. 2024-05-20T18:03:16.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-20T18:03:17.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.054+0000 7f921993e640 1 Processor -- start 2024-05-20T18:03:17.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.054+0000 7f921993e640 1 -- start start 2024-05-20T18:03:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f921993e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f921416a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f921993e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140d0630 con 0x7f9214162820 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f921993e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140d39c0 con 0x7f921406d3d0 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f921993e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92140d3ca0 con 0x7f9214168050 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f9212ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9214162820 0x7f92140b3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35160/0 (socket says 172.21.15.6:35160) 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f9212ffd640 1 -- 172.21.15.6:0/534116294 learned_addr learned my addr 172.21.15.6:0/534116294 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f92137fe640 1 --2- 172.21.15.6:0/534116294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f921416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f9211ffb640 1 -- 172.21.15.6:0/534116294 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94902553 0 0) 0x7f92140d0630 con 0x7f9214162820 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f9211ffb640 1 -- 172.21.15.6:0/534116294 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91fc003520 con 0x7f9214162820 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f9211ffb640 1 -- 172.21.15.6:0/534116294 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511764982 0 0) 0x7f92140d39c0 con 0x7f921406d3d0 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f9211ffb640 1 -- 172.21.15.6:0/534116294 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92140d0630 con 0x7f921406d3d0 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f9211ffb640 1 -- 172.21.15.6:0/534116294 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 187769855 0 0) 0x7f91fc003520 con 0x7f9214162820 2024-05-20T18:03:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f92137fe640 1 -- 172.21.15.6:0/534116294 >> v1:172.21.15.171:6789/0 conn(0x7f921406d3d0 legacy=0x7f921406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.056+0000 7f92137fe640 1 -- 172.21.15.6:0/534116294 >> v1:172.21.15.6:6789/0 conn(0x7f9214162820 legacy=0x7f92140b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.057+0000 7f92137fe640 1 -- 172.21.15.6:0/534116294 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92140d3f80 con 0x7f9214168050 2024-05-20T18:03:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.057+0000 7f92137fe640 1 --2- 172.21.15.6:0/534116294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f921416a470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f920c0097d0 tx=0x7f920c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e3dc7389ace849f server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f9211ffb640 1 -- 172.21.15.6:0/534116294 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c037070 con 0x7f9214168050 2024-05-20T18:03:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f9211ffb640 1 -- 172.21.15.6:0/534116294 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c02ac30 con 0x7f9214168050 2024-05-20T18:03:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f9211ffb640 1 -- 172.21.15.6:0/534116294 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92040019f0 con 0x7f9214168050 2024-05-20T18:03:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f921993e640 1 -- 172.21.15.6:0/534116294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 msgr2=0x7f921416a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f921993e640 1 --2- 172.21.15.6:0/534116294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f921416a470 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f920c0097d0 tx=0x7f920c02a1a0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f921993e640 1 -- 172.21.15.6:0/534116294 shutdown_connections 2024-05-20T18:03:17.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f921993e640 1 --2- 172.21.15.6:0/534116294 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f921416a470 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f921993e640 1 -- 172.21.15.6:0/534116294 >> 172.21.15.6:0/534116294 conn(0x7f92140d4bd0 msgr2=0x7f92140d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:17.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f921993e640 1 -- 172.21.15.6:0/534116294 shutdown_connections 2024-05-20T18:03:17.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.058+0000 7f921993e640 1 -- 172.21.15.6:0/534116294 wait complete. 2024-05-20T18:03:17.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.060+0000 7f921993e640 1 Processor -- start 2024-05-20T18:03:17.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.060+0000 7f921993e640 1 -- start start 2024-05-20T18:03:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f921993e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f921406d3d0 0x7f9214156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f921993e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9214162820 0x7f92141507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f921993e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f9214157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f921993e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f92140b91a0 con 0x7f9214162820 2024-05-20T18:03:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f921993e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92140d0300 con 0x7f921406d3d0 2024-05-20T18:03:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f921993e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92140b4050 con 0x7f9214168050 2024-05-20T18:03:17.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9214162820 0x7f92141507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9214162820 0x7f92141507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43488/0 (socket says 172.21.15.6:43488) 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 -- 172.21.15.6:0/2374748734 learned_addr learned my addr 172.21.15.6:0/2374748734 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f9212ffd640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f921406d3d0 0x7f9214156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92137fe640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f9214157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 -- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 msgr2=0x7f9214157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f9214157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 -- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f921406d3d0 msgr2=0x7f9214156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f921406d3d0 0x7f9214156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 -- 172.21.15.6:0/2374748734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92140b65e0 con 0x7f9214162820 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f9212ffd640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f921406d3d0 0x7f9214156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92137fe640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f9214157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:17.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.062+0000 7f92127fc640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9214162820 0x7f92141507f0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f920800c430 tx=0x7f920800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.063+0000 7f91fbfff640 1 -- 172.21.15.6:0/2374748734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208017070 con 0x7f9214162820 2024-05-20T18:03:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.063+0000 7f91fbfff640 1 -- 172.21.15.6:0/2374748734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92080052f0 con 0x7f9214162820 2024-05-20T18:03:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.063+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92140b68c0 con 0x7f9214162820 2024-05-20T18:03:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.063+0000 7f91fbfff640 1 -- 172.21.15.6:0/2374748734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208003830 con 0x7f9214162820 2024-05-20T18:03:17.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.063+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92140b6e80 con 0x7f9214162820 2024-05-20T18:03:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.064+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9214075b00 con 0x7f9214162820 2024-05-20T18:03:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.064+0000 7f91fbfff640 1 -- 172.21.15.6:0/2374748734 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f920801a070 con 0x7f9214162820 2024-05-20T18:03:17.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.065+0000 7f91fbfff640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f920006be60 0x7f920006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.065+0000 7f91fbfff640 1 -- 172.21.15.6:0/2374748734 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f920808a140 con 0x7f9214162820 2024-05-20T18:03:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.065+0000 7f9212ffd640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f920006be60 0x7f920006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.066+0000 7f9212ffd640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f920006be60 0x7f920006e370 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9204001560 tx=0x7f9204009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.069+0000 7f91fbfff640 1 -- 172.21.15.6:0/2374748734 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9208058bd0 con 0x7f9214162820 2024-05-20T18:03:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.252+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f92140b6370 con 0x7f920006be60 2024-05-20T18:03:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.253+0000 7f91fbfff640 1 -- 172.21.15.6:0/2374748734 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f92140b6370 con 0x7f920006be60 2024-05-20T18:03:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f920006be60 msgr2=0x7f920006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f920006be60 0x7f920006e370 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9204001560 tx=0x7f9204009040 comp rx=0 tx=0).stop 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9214162820 msgr2=0x7f92141507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9214162820 0x7f92141507f0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f920800c430 tx=0x7f920800c8f0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 shutdown_connections 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f920006be60 0x7f920006e370 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9214168050 0x7f9214157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9214162820 0x7f92141507f0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 --2- 172.21.15.6:0/2374748734 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f921406d3d0 0x7f9214156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 >> 172.21.15.6:0/2374748734 conn(0x7f92140d4bd0 msgr2=0x7f9214161720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 shutdown_connections 2024-05-20T18:03:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.255+0000 7f921993e640 1 -- 172.21.15.6:0/2374748734 wait complete. 2024-05-20T18:03:17.263 INFO:tasks.ceph:Scrubbing osd.1 2024-05-20T18:03:17.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-20T18:03:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.385+0000 7fcfa1291640 1 Processor -- start 2024-05-20T18:03:17.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.385+0000 7fcfa1291640 1 -- start start 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.386+0000 7fcfa1291640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0d45f0 0x7fcf9c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.386+0000 7fcfa1291640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf9c08bd20 0x7fcf9c08c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.386+0000 7fcfa1291640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf9c08c670 con 0x7fcf9c0b3860 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.386+0000 7fcfa1291640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcf9c0d0450 con 0x7fcf9c08bd20 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.386+0000 7fcfa1291640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9c0d3b10 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.387+0000 7fcf9b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf9c08bd20 0x7fcf9c08c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.387+0000 7fcf9b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf9c08bd20 0x7fcf9c08c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43504/0 (socket says 172.21.15.6:43504) 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.387+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/1107072428 learned_addr learned my addr 172.21.15.6:0/1107072428 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.387+0000 7fcf9a7fc640 1 --2- 172.21.15.6:0/1107072428 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0d45f0 0x7fcf9c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.387+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/1107072428 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0d45f0 msgr2=0x7fcf9c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:17.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.387+0000 7fcf9b7fe640 1 --2- 172.21.15.6:0/1107072428 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0d45f0 0x7fcf9c06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.387+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/1107072428 >> v1:172.21.15.171:6789/0 conn(0x7fcf9c0b3860 legacy=0x7fcf9c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.387+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/1107072428 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c0d3df0 con 0x7fcf9c08bd20 2024-05-20T18:03:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.388+0000 7fcf9b7fe640 1 --2- 172.21.15.6:0/1107072428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c08bd20 0x7fcf9c08c130 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009e50 tx=0x7fcf9402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f95841124148d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.388+0000 7fcf99ffb640 1 -- 172.21.15.6:0/1107072428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94036070 con 0x7fcf9c08bd20 2024-05-20T18:03:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.388+0000 7fcf99ffb640 1 -- 172.21.15.6:0/1107072428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf94031600 con 0x7fcf9c08bd20 2024-05-20T18:03:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.388+0000 7fcf99ffb640 1 -- 172.21.15.6:0/1107072428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940319d0 con 0x7fcf9c08bd20 2024-05-20T18:03:17.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.388+0000 7fcfa1291640 1 -- 172.21.15.6:0/1107072428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c08bd20 msgr2=0x7fcf9c08c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.388+0000 7fcfa1291640 1 --2- 172.21.15.6:0/1107072428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c08bd20 0x7fcf9c08c130 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009e50 tx=0x7fcf9402a5f0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.389+0000 7fcfa1291640 1 -- 172.21.15.6:0/1107072428 shutdown_connections 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.389+0000 7fcfa1291640 1 --2- 172.21.15.6:0/1107072428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c08bd20 0x7fcf9c08c130 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.389+0000 7fcfa1291640 1 --2- 172.21.15.6:0/1107072428 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0d45f0 0x7fcf9c06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.389+0000 7fcfa1291640 1 -- 172.21.15.6:0/1107072428 >> 172.21.15.6:0/1107072428 conn(0x7fcf9c0b6d10 msgr2=0x7fcf9c06d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.389+0000 7fcfa1291640 1 -- 172.21.15.6:0/1107072428 shutdown_connections 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.389+0000 7fcfa1291640 1 -- 172.21.15.6:0/1107072428 wait complete. 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.390+0000 7fcfa1291640 1 Processor -- start 2024-05-20T18:03:17.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.391+0000 7fcfa1291640 1 -- start start 2024-05-20T18:03:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcfa1291640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c08bd20 0x7fcf9c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcfa1291640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0b3860 0x7fcf9c1e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcfa1291640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c0d45f0 0x7fcf9c1e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcfa1291640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c0b81b0 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcfa1291640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c0d0730 con 0x7fcf9c08bd20 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcfa1291640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9c0b8330 con 0x7fcf9c0b3860 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c0d45f0 0x7fcf9c1e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c0d45f0 0x7fcf9c1e4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43516/0 (socket says 172.21.15.6:43516) 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/206425811 learned_addr learned my addr 172.21.15.6:0/206425811 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9a7fc640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0b3860 0x7fcf9c1e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9affd640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c08bd20 0x7fcf9c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0b3860 msgr2=0x7fcf9c1e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9b7fe640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf9c0b3860 0x7fcf9c1e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c08bd20 msgr2=0x7fcf9c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9b7fe640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf9c08bd20 0x7fcf9c15a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.392+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/206425811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c157e50 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.393+0000 7fcf9b7fe640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c0d45f0 0x7fcf9c1e4bd0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009e50 tx=0x7fcf94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.393+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94036050 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.393+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf94042070 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.393+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9c157920 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.393+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94009510 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.393+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9c1e8200 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.394+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf9c0b9a40 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.394+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf94007bd0 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.395+0000 7fcf837fe640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf8806be30 0x7fcf8806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.395+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fcf940aba30 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.395+0000 7fcf837fe640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7fcf88072320 0x7fcf880747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.395+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 --> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf9404ae80 con 0x7fcf88072320 2024-05-20T18:03:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.395+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7fcf940b02c0 con 0x7fcf9c0d45f0 2024-05-20T18:03:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.395+0000 7fcf9affd640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf8806be30 0x7fcf8806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.395+0000 7fcf9a7fc640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7fcf88072320 0x7fcf880747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.396+0000 7fcf9a7fc640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7fcf88072320 0x7fcf880747b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.396+0000 7fcf9affd640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf8806be30 0x7fcf8806e340 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0d15d0 tx=0x7fcf8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.396+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 <== osd.1 v2:172.21.15.6:6814/3797721472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf9404ae80 con 0x7fcf88072320 2024-05-20T18:03:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 --> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcf9c1e7fb0 con 0x7fcf88072320 2024-05-20T18:03:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcf837fe640 1 -- 172.21.15.6:0/206425811 <== osd.1 v2:172.21.15.6:6814/3797721472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcf9c1e7fb0 con 0x7fcf88072320 2024-05-20T18:03:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:03:17.407 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-20T18:03:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:03:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7fcf88072320 msgr2=0x7fcf880747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.6:6814/3797721472,v1:172.21.15.6:6817/3797721472] conn(0x7fcf88072320 0x7fcf880747b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf8806be30 msgr2=0x7fcf8806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcf8806be30 0x7fcf8806e340 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0d15d0 tx=0x7fcf8c009040 comp rx=0 tx=0).stop 2024-05-20T18:03:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c0d45f0 msgr2=0x7fcf9c1e4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 --2- 172.21.15.6:0/206425811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf9c0d45f0 0x7fcf9c1e4bd0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009e50 tx=0x7fcf94004a40 comp rx=0 tx=0).stop 2024-05-20T18:03:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcf9b7fe640 1 -- 172.21.15.6:0/206425811 reap_dead start 2024-05-20T18:03:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 shutdown_connections 2024-05-20T18:03:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 >> 172.21.15.6:0/206425811 conn(0x7fcf9c0b6d10 msgr2=0x7fcf9c0b9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 shutdown_connections 2024-05-20T18:03:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.410+0000 7fcfa1291640 1 -- 172.21.15.6:0/206425811 wait complete. 2024-05-20T18:03:17.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-20T18:03:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.538+0000 7fa3620b8640 1 Processor -- start 2024-05-20T18:03:17.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.538+0000 7fa3620b8640 1 -- start start 2024-05-20T18:03:17.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa3620b8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa35c06d3d0 0x7fa35c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa3620b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c0b8190 0x7fa35c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa3620b8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35c06dd20 con 0x7fa35c162820 2024-05-20T18:03:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa3620b8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa35c0d0630 con 0x7fa35c06d3d0 2024-05-20T18:03:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa3620b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa35c0d39c0 con 0x7fa35c0b8190 2024-05-20T18:03:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa35c06d3d0 0x7fa35c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa35c06d3d0 0x7fa35c06d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43532/0 (socket says 172.21.15.6:43532) 2024-05-20T18:03:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35affd640 1 -- 172.21.15.6:0/2165510640 learned_addr learned my addr 172.21.15.6:0/2165510640 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35bfff640 1 --2- 172.21.15.6:0/2165510640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c0b8190 0x7fa35c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35affd640 1 -- 172.21.15.6:0/2165510640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c0b8190 msgr2=0x7fa35c0b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35affd640 1 --2- 172.21.15.6:0/2165510640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c0b8190 0x7fa35c0b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35affd640 1 -- 172.21.15.6:0/2165510640 >> v1:172.21.15.6:6789/0 conn(0x7fa35c162820 legacy=0x7fa35c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35a7fc640 1 -- 172.21.15.6:0/2165510640 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326233572 0 0) 0x7fa34c001110 con 0x7fa35c162820 2024-05-20T18:03:17.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.540+0000 7fa35affd640 1 -- 172.21.15.6:0/2165510640 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c0d3ca0 con 0x7fa35c06d3d0 2024-05-20T18:03:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.541+0000 7fa35affd640 1 --2- 172.21.15.6:0/2165510640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c06d3d0 0x7fa35c06d7e0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fa350009870 tx=0x7fa35002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c69dde2435a6ea server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.541+0000 7fa35a7fc640 1 -- 172.21.15.6:0/2165510640 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350037070 con 0x7fa35c06d3d0 2024-05-20T18:03:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.541+0000 7fa35a7fc640 1 -- 172.21.15.6:0/2165510640 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa350032440 con 0x7fa35c06d3d0 2024-05-20T18:03:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.541+0000 7fa35a7fc640 1 -- 172.21.15.6:0/2165510640 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350032810 con 0x7fa35c06d3d0 2024-05-20T18:03:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.542+0000 7fa3620b8640 1 -- 172.21.15.6:0/2165510640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c06d3d0 msgr2=0x7fa35c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.542+0000 7fa3620b8640 1 --2- 172.21.15.6:0/2165510640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c06d3d0 0x7fa35c06d7e0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fa350009870 tx=0x7fa35002a270 comp rx=0 tx=0).stop 2024-05-20T18:03:17.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.542+0000 7fa3620b8640 1 -- 172.21.15.6:0/2165510640 shutdown_connections 2024-05-20T18:03:17.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.542+0000 7fa3620b8640 1 --2- 172.21.15.6:0/2165510640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c0b8190 0x7fa35c0b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.542+0000 7fa3620b8640 1 --2- 172.21.15.6:0/2165510640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c06d3d0 0x7fa35c06d7e0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.542+0000 7fa3620b8640 1 -- 172.21.15.6:0/2165510640 >> 172.21.15.6:0/2165510640 conn(0x7fa35c0d4bd0 msgr2=0x7fa35c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:17.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.542+0000 7fa3620b8640 1 -- 172.21.15.6:0/2165510640 shutdown_connections 2024-05-20T18:03:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.542+0000 7fa3620b8640 1 -- 172.21.15.6:0/2165510640 wait complete. 2024-05-20T18:03:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.544+0000 7fa3620b8640 1 Processor -- start 2024-05-20T18:03:17.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.544+0000 7fa3620b8640 1 -- start start 2024-05-20T18:03:17.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa3620b8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa35c06d3d0 0x7fa35c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa3620b8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c0b8190 0x7fa35c1f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa3620b8640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c162820 0x7fa35c15fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa3620b8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c0d0300 con 0x7fa35c0b8190 2024-05-20T18:03:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa3620b8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c0d4260 con 0x7fa35c06d3d0 2024-05-20T18:03:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa3620b8640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa35c0b4050 con 0x7fa35c162820 2024-05-20T18:03:17.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa35affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c0b8190 0x7fa35c1f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa35affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c0b8190 0x7fa35c1f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43534/0 (socket says 172.21.15.6:43534) 2024-05-20T18:03:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.545+0000 7fa35affd640 1 -- 172.21.15.6:0/3312094248 learned_addr learned my addr 172.21.15.6:0/3312094248 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35bfff640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c162820 0x7fa35c15fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35affd640 1 -- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c162820 msgr2=0x7fa35c15fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35affd640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c162820 0x7fa35c15fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35affd640 1 -- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa35c06d3d0 msgr2=0x7fa35c0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35b7fe640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa35c06d3d0 0x7fa35c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35affd640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa35c06d3d0 0x7fa35c0ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35affd640 1 -- 172.21.15.6:0/3312094248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c0cbe20 con 0x7fa35c0b8190 2024-05-20T18:03:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35bfff640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c162820 0x7fa35c15fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:17.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35b7fe640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa35c06d3d0 0x7fa35c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:17.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa35affd640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c0b8190 0x7fa35c1f5170 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fa350009870 tx=0x7fa3500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa343fff640 1 -- 172.21.15.6:0/3312094248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350041020 con 0x7fa35c0b8190 2024-05-20T18:03:17.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa343fff640 1 -- 172.21.15.6:0/3312094248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3500306c0 con 0x7fa35c0b8190 2024-05-20T18:03:17.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35c0cb1f0 con 0x7fa35c0b8190 2024-05-20T18:03:17.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa343fff640 1 -- 172.21.15.6:0/3312094248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350037040 con 0x7fa35c0b8190 2024-05-20T18:03:17.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.546+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35c0cb7b0 con 0x7fa35c0b8190 2024-05-20T18:03:17.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.547+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35c075b00 con 0x7fa35c0b8190 2024-05-20T18:03:17.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.548+0000 7fa343fff640 1 -- 172.21.15.6:0/3312094248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa350044020 con 0x7fa35c0b8190 2024-05-20T18:03:17.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.549+0000 7fa343fff640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa34806be30 0x7fa34806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.549+0000 7fa343fff640 1 -- 172.21.15.6:0/3312094248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fa3500ab200 con 0x7fa35c0b8190 2024-05-20T18:03:17.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.549+0000 7fa35b7fe640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa34806be30 0x7fa34806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.550+0000 7fa35b7fe640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa34806be30 0x7fa34806e340 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa34c000f60 tx=0x7fa34c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.554+0000 7fa343fff640 1 -- 172.21.15.6:0/3312094248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa35004b070 con 0x7fa35c0b8190 2024-05-20T18:03:17.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.737+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa35c0caf80 con 0x7fa34806be30 2024-05-20T18:03:17.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.738+0000 7fa343fff640 1 -- 172.21.15.6:0/3312094248 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa35c0caf80 con 0x7fa34806be30 2024-05-20T18:03:17.735 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa34806be30 msgr2=0x7fa34806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa34806be30 0x7fa34806e340 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa34c000f60 tx=0x7fa34c009040 comp rx=0 tx=0).stop 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c0b8190 msgr2=0x7fa35c1f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c0b8190 0x7fa35c1f5170 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fa350009870 tx=0x7fa3500046c0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 shutdown_connections 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa34806be30 0x7fa34806e340 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa35c162820 0x7fa35c15fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa35c0b8190 0x7fa35c1f5170 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 --2- 172.21.15.6:0/3312094248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa35c06d3d0 0x7fa35c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 >> 172.21.15.6:0/3312094248 conn(0x7fa35c0d4bd0 msgr2=0x7fa35c15f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:17.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 shutdown_connections 2024-05-20T18:03:17.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.740+0000 7fa3620b8640 1 -- 172.21.15.6:0/3312094248 wait complete. 2024-05-20T18:03:17.748 INFO:tasks.ceph:Scrubbing osd.2 2024-05-20T18:03:17.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-20T18:03:17.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.870+0000 7f5376365640 1 Processor -- start 2024-05-20T18:03:17.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.870+0000 7f5376365640 1 -- start start 2024-05-20T18:03:17.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5376365640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f53700b3850 0x7f537015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5376365640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700d04a0 0x7f53700b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5376365640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53700b6b80 0x7f537008bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5376365640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f5370162d60 con 0x7f53700b6b80 2024-05-20T18:03:17.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5376365640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f53700b6f90 con 0x7f53700b3850 2024-05-20T18:03:17.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5376365640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5370162fb0 con 0x7f53700d04a0 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5374902640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53700b6b80 0x7f537008bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5374902640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53700b6b80 0x7f537008bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58632/0 (socket says 172.21.15.6:58632) 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5374902640 1 -- 172.21.15.6:0/1772100398 learned_addr learned my addr 172.21.15.6:0/1772100398 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f536f7fe640 1 --2- 172.21.15.6:0/1772100398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700d04a0 0x7f53700b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f536ffff640 1 --2- 172.21.15.6:0/1772100398 >> v2:172.21.15.171:3300/0 conn(0x7f53700b3850 0x7f537015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5374902640 1 -- 172.21.15.6:0/1772100398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700d04a0 msgr2=0x7f53700b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5374902640 1 --2- 172.21.15.6:0/1772100398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700d04a0 0x7f53700b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5374902640 1 -- 172.21.15.6:0/1772100398 >> v2:172.21.15.171:3300/0 conn(0x7f53700b3850 msgr2=0x7f537015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5374902640 1 --2- 172.21.15.6:0/1772100398 >> v2:172.21.15.171:3300/0 conn(0x7f53700b3850 0x7f537015f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.872+0000 7f5374902640 1 -- 172.21.15.6:0/1772100398 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5370163290 con 0x7f53700b6b80 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.873+0000 7f5374902640 1 --2- 172.21.15.6:0/1772100398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700b6b80 0x7f537008bc90 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f53700b77b0 tx=0x7f536802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b8814d8f816a81 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.873+0000 7f536effd640 1 -- 172.21.15.6:0/1772100398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368036070 con 0x7f53700b6b80 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.873+0000 7f536effd640 1 -- 172.21.15.6:0/1772100398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5368031600 con 0x7f53700b6b80 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.873+0000 7f536effd640 1 -- 172.21.15.6:0/1772100398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53680319d0 con 0x7f53700b6b80 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 -- 172.21.15.6:0/1772100398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700b6b80 msgr2=0x7f537008bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 --2- 172.21.15.6:0/1772100398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700b6b80 0x7f537008bc90 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f53700b77b0 tx=0x7f536802a610 comp rx=0 tx=0).stop 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 -- 172.21.15.6:0/1772100398 shutdown_connections 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 --2- 172.21.15.6:0/1772100398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700b6b80 0x7f537008bc90 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 --2- 172.21.15.6:0/1772100398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700d04a0 0x7f53700b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 --2- 172.21.15.6:0/1772100398 >> v2:172.21.15.171:3300/0 conn(0x7f53700b3850 0x7f537015f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 -- 172.21.15.6:0/1772100398 >> 172.21.15.6:0/1772100398 conn(0x7f53700d1820 msgr2=0x7f53700d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:17.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 -- 172.21.15.6:0/1772100398 shutdown_connections 2024-05-20T18:03:17.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.874+0000 7f5376365640 1 -- 172.21.15.6:0/1772100398 wait complete. 2024-05-20T18:03:17.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.876+0000 7f5376365640 1 Processor -- start 2024-05-20T18:03:17.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.876+0000 7f5376365640 1 -- start start 2024-05-20T18:03:17.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5376365640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53700b3850 0x7f53701f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5376365640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700b6b80 0x7f53701608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5376365640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700d04a0 0x7f5370155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5376365640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f53700b8180 con 0x7f53700d04a0 2024-05-20T18:03:17.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5376365640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5370163850 con 0x7f53700b3850 2024-05-20T18:03:17.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5376365640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53700b8300 con 0x7f53700b6b80 2024-05-20T18:03:17.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5374902640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700d04a0 0x7f5370155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5374902640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700d04a0 0x7f5370155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58636/0 (socket says 172.21.15.6:58636) 2024-05-20T18:03:17.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.877+0000 7f5374902640 1 -- 172.21.15.6:0/3562900186 learned_addr learned my addr 172.21.15.6:0/3562900186 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:17.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f536ffff640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53700b3850 0x7f53701f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f536f7fe640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700b6b80 0x7f53701608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f5374902640 1 -- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700b6b80 msgr2=0x7f53701608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f5374902640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53700b6b80 0x7f53701608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f5374902640 1 -- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53700b3850 msgr2=0x7f53701f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f5374902640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53700b3850 0x7f53701f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f5374902640 1 -- 172.21.15.6:0/3562900186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5370161050 con 0x7f53700d04a0 2024-05-20T18:03:17.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f536ffff640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53700b3850 0x7f53701f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:17.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f5374902640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700d04a0 0x7f5370155d40 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f5368009f40 tx=0x7f5368004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536803f020 con 0x7f53700d04a0 2024-05-20T18:03:17.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5368037040 con 0x7f53700d04a0 2024-05-20T18:03:17.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368036070 con 0x7f53700d04a0 2024-05-20T18:03:17.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5370161330 con 0x7f53700d04a0 2024-05-20T18:03:17.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.878+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53701e8e30 con 0x7f53700d04a0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.879+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53700690b0 con 0x7f53700d04a0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.880+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5368042020 con 0x7f53700d04a0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.880+0000 7f536cff9640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f535c06be60 0x7f535c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.880+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f53680ab3a0 con 0x7f53700d04a0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.880+0000 7f536cff9640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f535c072350 0x7f535c0747e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.880+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 --> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5368045e50 con 0x7f535c072350 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.880+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f53680b2050 con 0x7f53700d04a0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.881+0000 7f536f7fe640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f535c072350 0x7f535c0747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.881+0000 7f536ffff640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f535c06be60 0x7f535c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.881+0000 7f536f7fe640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f535c072350 0x7f535c0747e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.881+0000 7f536ffff640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f535c06be60 0x7f535c06e370 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5360006fd0 tx=0x7f5360008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.882+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 <== osd.2 v2:172.21.15.6:6808/1176387809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5368045e50 con 0x7f535c072350 2024-05-20T18:03:17.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 --> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5370160df0 con 0x7f535c072350 2024-05-20T18:03:17.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f536cff9640 1 -- 172.21.15.6:0/3562900186 <== osd.2 v2:172.21.15.6:6808/1176387809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5364009bd0 con 0x7f535c072350 2024-05-20T18:03:17.892 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:03:17.893 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-20T18:03:17.893 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:03:17.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f535c072350 msgr2=0x7f535c0747e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f5376365640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.6:6808/1176387809,v1:172.21.15.6:6809/1176387809] conn(0x7f535c072350 0x7f535c0747e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f535c06be60 msgr2=0x7f535c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f5376365640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f535c06be60 0x7f535c06e370 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5360006fd0 tx=0x7f5360008040 comp rx=0 tx=0).stop 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700d04a0 msgr2=0x7f5370155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f5376365640 1 --2- 172.21.15.6:0/3562900186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53700d04a0 0x7f5370155d40 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f5368009f40 tx=0x7f5368004a40 comp rx=0 tx=0).stop 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.895+0000 7f5374902640 1 -- 172.21.15.6:0/3562900186 reap_dead start 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.896+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 shutdown_connections 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.896+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 >> 172.21.15.6:0/3562900186 conn(0x7f53700d1820 msgr2=0x7f537015cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.896+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 shutdown_connections 2024-05-20T18:03:17.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:17.896+0000 7f5376365640 1 -- 172.21.15.6:0/3562900186 wait complete. 2024-05-20T18:03:17.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-20T18:03:18.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.022+0000 7f90c2eeb640 1 Processor -- start 2024-05-20T18:03:18.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.022+0000 7f90c2eeb640 1 -- start start 2024-05-20T18:03:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.023+0000 7f90c2eeb640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f90bc0b4010 0x7f90bc0d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.023+0000 7f90c2eeb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90bc0d0370 con 0x7f90bc0d14b0 2024-05-20T18:03:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.023+0000 7f90c2eeb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90bc0d0650 con 0x7f90bc163a10 2024-05-20T18:03:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.023+0000 7f90c2eeb640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f90bc0d3ca0 con 0x7f90bc0b4010 2024-05-20T18:03:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.023+0000 7f90c1488640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f90bc0d14b0 0x7f90bc0d18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42060/0 (socket says 172.21.15.6:42060) 2024-05-20T18:03:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.023+0000 7f90c1488640 1 -- 172.21.15.6:0/119619848 learned_addr learned my addr 172.21.15.6:0/119619848 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bbfff640 1 --2- 172.21.15.6:0/119619848 >> v2:172.21.15.171:3300/0 conn(0x7f90bc0b4010 0x7f90bc0d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698095575 0 0) 0x7f90bc0d0370 con 0x7f90bc0d14b0 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a8003520 con 0x7f90bc0d14b0 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1264296182 0 0) 0x7f90a8003520 con 0x7f90bc0d14b0 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 >> v2:172.21.15.171:3300/0 conn(0x7f90bc0b4010 msgr2=0x7f90bc0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 --2- 172.21.15.6:0/119619848 >> v2:172.21.15.171:3300/0 conn(0x7f90bc0b4010 0x7f90bc0d4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 >> v1:172.21.15.171:6789/0 conn(0x7f90bc163a10 legacy=0x7f90bc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc0d3650 con 0x7f90bc0d14b0 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f90b4001670 con 0x7f90bc0d14b0 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 >> v1:172.21.15.6:6789/0 conn(0x7f90bc0d14b0 legacy=0x7f90bc0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90a80039b0 0x7f90a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90a8004800 0x7f90a8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80051c0 0x7f90a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc0d3ca0 con 0x7f90a80039b0 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f90a800c160 con 0x7f90a80051c0 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f90a800c360 con 0x7f90a8004800 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90c0c87640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90a80039b0 0x7f90a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90c1488640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80051c0 0x7f90a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.024+0000 7f90bbfff640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90a8004800 0x7f90a8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90c0c87640 1 -- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90a8004800 msgr2=0x7f90a8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90c0c87640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90a8004800 0x7f90a8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90c0c87640 1 -- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80051c0 msgr2=0x7f90a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90c0c87640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80051c0 0x7f90a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90c0c87640 1 -- 172.21.15.6:0/119619848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a8003520 con 0x7f90a80039b0 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90c1488640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80051c0 0x7f90a800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90c1488640 1 -- 172.21.15.6:0/119619848 reap_dead start 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90c0c87640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90a80039b0 0x7f90a8003e20 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f90ac001720 tx=0x7f90a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc19cc29d2f1f466 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac001370 con 0x7f90a80039b0 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ac0052d0 con 0x7f90a80039b0 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.025+0000 7f90bb7fe640 1 -- 172.21.15.6:0/119619848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac02aaf0 con 0x7f90a80039b0 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.026+0000 7f90c2eeb640 1 -- 172.21.15.6:0/119619848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90a80039b0 msgr2=0x7f90a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.026+0000 7f90c2eeb640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90a80039b0 0x7f90a8003e20 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f90ac001720 tx=0x7f90a8005830 comp rx=0 tx=0).stop 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.026+0000 7f90c2eeb640 1 -- 172.21.15.6:0/119619848 shutdown_connections 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.026+0000 7f90c2eeb640 1 --2- 172.21.15.6:0/119619848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90a80039b0 0x7f90a8003e20 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.026+0000 7f90c2eeb640 1 -- 172.21.15.6:0/119619848 >> 172.21.15.6:0/119619848 conn(0x7f90bc06d240 msgr2=0x7f90bc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.026+0000 7f90c2eeb640 1 -- 172.21.15.6:0/119619848 shutdown_connections 2024-05-20T18:03:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.026+0000 7f90c2eeb640 1 -- 172.21.15.6:0/119619848 wait complete. 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.028+0000 7f90c2eeb640 1 Processor -- start 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.028+0000 7f90c2eeb640 1 -- start start 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c2eeb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80039b0 0x7f90bc151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c2eeb640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90bc1f9020 0x7f90bc15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c2eeb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90bc0b7150 0x7f90bc15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c2eeb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc0d42b0 con 0x7f90bc0b7150 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c2eeb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc0d4130 con 0x7f90a80039b0 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c2eeb640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f90bc0d4430 con 0x7f90bc1f9020 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90bc0b7150 0x7f90bc15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90bc0b7150 0x7f90bc15a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58646/0 (socket says 172.21.15.6:58646) 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 -- 172.21.15.6:0/1199428619 learned_addr learned my addr 172.21.15.6:0/1199428619 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90bbfff640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90bc1f9020 0x7f90bc15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c0c87640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80039b0 0x7f90bc151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 -- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90bc1f9020 msgr2=0x7f90bc15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90bc1f9020 0x7f90bc15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 -- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80039b0 msgr2=0x7f90bc151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80039b0 0x7f90bc151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 -- 172.21.15.6:0/1199428619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc158360 con 0x7f90bc0b7150 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c0c87640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80039b0 0x7f90bc151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c1488640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90bc0b7150 0x7f90bc15a670 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f90bc068090 tx=0x7f90b400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90b97fa640 1 -- 172.21.15.6:0/1199428619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b400c5b0 con 0x7f90bc0b7150 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90b97fa640 1 -- 172.21.15.6:0/1199428619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b4018070 con 0x7f90bc0b7150 2024-05-20T18:03:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90bc158640 con 0x7f90bc0b7150 2024-05-20T18:03:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90b97fa640 1 -- 172.21.15.6:0/1199428619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b400c9b0 con 0x7f90bc0b7150 2024-05-20T18:03:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.030+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90bc158c00 con 0x7f90bc0b7150 2024-05-20T18:03:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.032+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90bc1580d0 con 0x7f90bc0b7150 2024-05-20T18:03:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.032+0000 7f90b97fa640 1 -- 172.21.15.6:0/1199428619 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90b400cb50 con 0x7f90bc0b7150 2024-05-20T18:03:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.032+0000 7f90b97fa640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f909c06be30 0x7f909c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.033+0000 7f90b97fa640 1 -- 172.21.15.6:0/1199428619 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f90b408a970 con 0x7f90bc0b7150 2024-05-20T18:03:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.033+0000 7f90c0c87640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f909c06be30 0x7f909c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.034+0000 7f90c0c87640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f909c06be30 0x7f909c06e340 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f90ac032000 tx=0x7f90ac02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.037+0000 7f90b97fa640 1 -- 172.21.15.6:0/1199428619 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f90b4059400 con 0x7f90bc0b7150 2024-05-20T18:03:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.220+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f90bc0ceaa0 con 0x7f909c06be30 2024-05-20T18:03:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.221+0000 7f90b97fa640 1 -- 172.21.15.6:0/1199428619 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f90bc0ceaa0 con 0x7f909c06be30 2024-05-20T18:03:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2024-05-20T18:03:18.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f909c06be30 msgr2=0x7f909c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f909c06be30 0x7f909c06e340 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f90ac032000 tx=0x7f90ac02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90bc0b7150 msgr2=0x7f90bc15a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90bc0b7150 0x7f90bc15a670 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f90bc068090 tx=0x7f90b400eb90 comp rx=0 tx=0).stop 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 shutdown_connections 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f909c06be30 0x7f909c06e340 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90bc0b7150 0x7f90bc15a670 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f90bc1f9020 0x7f90bc15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 --2- 172.21.15.6:0/1199428619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a80039b0 0x7f90bc151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 >> 172.21.15.6:0/1199428619 conn(0x7f90bc06d240 msgr2=0x7f90bc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 shutdown_connections 2024-05-20T18:03:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.223+0000 7f90c2eeb640 1 -- 172.21.15.6:0/1199428619 wait complete. 2024-05-20T18:03:18.235 INFO:tasks.ceph:Scrubbing osd.3 2024-05-20T18:03:18.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-20T18:03:18.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.357+0000 7f984a9ce640 1 Processor -- start 2024-05-20T18:03:18.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.358+0000 7f984a9ce640 1 -- start start 2024-05-20T18:03:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f984a9ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98440d45f0 0x7f984406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f984a9ce640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98440d0450 con 0x7f98440b3860 2024-05-20T18:03:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f984a9ce640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98440d3b10 con 0x7f984408bd20 2024-05-20T18:03:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f984a9ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f98440d3df0 con 0x7f98440d45f0 2024-05-20T18:03:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f9843fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f98440b3860 0x7f984415f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42076/0 (socket says 172.21.15.6:42076) 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f9843fff640 1 -- 172.21.15.6:0/1678670849 learned_addr learned my addr 172.21.15.6:0/1678670849 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715977687 0 0) 0x7f98440d0450 con 0x7f98440b3860 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f98437fe640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98440d45f0 0x7f984406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.359+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f982c003520 con 0x7f98440b3860 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 334790004 0 0) 0x7f982c003520 con 0x7f98440b3860 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98440d45f0 msgr2=0x7f984406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98440d45f0 0x7f984406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 >> v1:172.21.15.171:6789/0 conn(0x7f984408bd20 legacy=0x7f984408c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98440d40d0 con 0x7f98440b3860 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f9834001670 con 0x7f98440b3860 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 >> v1:172.21.15.6:6789/0 conn(0x7f98440b3860 legacy=0x7f984415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f982c0039e0 0x7f982c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98440d45f0 0x7f982c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c004d40 0x7f982c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f98440d3df0 con 0x7f982c004d40 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f982c00bbb0 con 0x7f982c0039e0 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f982c00bdb0 con 0x7f98440d45f0 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9848f6b640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c004d40 0x7f982c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9843fff640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f982c0039e0 0x7f982c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f98437fe640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98440d45f0 0x7f982c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9848f6b640 1 -- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98440d45f0 msgr2=0x7f982c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9848f6b640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98440d45f0 0x7f982c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9848f6b640 1 -- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f982c0039e0 msgr2=0x7f982c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9848f6b640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f982c0039e0 0x7f982c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.360+0000 7f9848f6b640 1 -- 172.21.15.6:0/1678670849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c003520 con 0x7f982c004d40 2024-05-20T18:03:18.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.361+0000 7f9848f6b640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c004d40 0x7f982c005150 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f983c001e20 tx=0x7f982c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c887cc0574b5289 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.361+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c001a70 con 0x7f982c004d40 2024-05-20T18:03:18.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.361+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c02ae40 con 0x7f982c004d40 2024-05-20T18:03:18.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.361+0000 7f9842ffd640 1 -- 172.21.15.6:0/1678670849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c003bb0 con 0x7f982c004d40 2024-05-20T18:03:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.362+0000 7f984a9ce640 1 -- 172.21.15.6:0/1678670849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c004d40 msgr2=0x7f982c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.362+0000 7f984a9ce640 1 --2- 172.21.15.6:0/1678670849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c004d40 0x7f982c005150 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f983c001e20 tx=0x7f982c005830 comp rx=0 tx=0).stop 2024-05-20T18:03:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.362+0000 7f9848f6b640 1 -- 172.21.15.6:0/1678670849 reap_dead start 2024-05-20T18:03:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.362+0000 7f984a9ce640 1 -- 172.21.15.6:0/1678670849 shutdown_connections 2024-05-20T18:03:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.362+0000 7f984a9ce640 1 -- 172.21.15.6:0/1678670849 >> 172.21.15.6:0/1678670849 conn(0x7f98440b6d10 msgr2=0x7f984406d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.362+0000 7f984a9ce640 1 -- 172.21.15.6:0/1678670849 shutdown_connections 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.362+0000 7f984a9ce640 1 -- 172.21.15.6:0/1678670849 wait complete. 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.364+0000 7f984a9ce640 1 Processor -- start 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.364+0000 7f984a9ce640 1 -- start start 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f984a9ce640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f982c004d40 0x7f984414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f984a9ce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98440cb160 0x7f984415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f984a9ce640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98440c9050 0x7f98440c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f984a9ce640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f984406d9f0 con 0x7f98440c9050 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f984a9ce640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f984406d870 con 0x7f98440cb160 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f984a9ce640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f984406db70 con 0x7f982c004d40 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f9848f6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98440c9050 0x7f98440c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f9848f6b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98440c9050 0x7f98440c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58654/0 (socket says 172.21.15.6:58654) 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.365+0000 7f9848f6b640 1 -- 172.21.15.6:0/824580335 learned_addr learned my addr 172.21.15.6:0/824580335 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9843fff640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f982c004d40 0x7f984414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f98437fe640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98440cb160 0x7f984415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9848f6b640 1 -- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f982c004d40 msgr2=0x7f984414dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9848f6b640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f982c004d40 0x7f984414dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9848f6b640 1 -- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98440cb160 msgr2=0x7f984415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9848f6b640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98440cb160 0x7f984415c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9848f6b640 1 -- 172.21.15.6:0/824580335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98440c99a0 con 0x7f98440c9050 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9848f6b640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98440c9050 0x7f98440c9460 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f983c02a8f0 tx=0x7f983c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c037040 con 0x7f98440c9050 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c041070 con 0x7f98440c9050 2024-05-20T18:03:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984414e520 con 0x7f98440c9050 2024-05-20T18:03:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c001a70 con 0x7f98440c9050 2024-05-20T18:03:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.366+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98441e80a0 con 0x7f98440c9050 2024-05-20T18:03:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.367+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98440690b0 con 0x7f98440c9050 2024-05-20T18:03:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.368+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f983c0052f0 con 0x7f98440c9050 2024-05-20T18:03:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.368+0000 7f9840ff9640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f983006be60 0x7f983006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.368+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f983c0ab3c0 con 0x7f98440c9050 2024-05-20T18:03:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.369+0000 7f9840ff9640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f9830072350 0x7f98300747e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.369+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 --> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f983c04ee50 con 0x7f9830072350 2024-05-20T18:03:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.369+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f983c0ab8a0 con 0x7f98440c9050 2024-05-20T18:03:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.369+0000 7f98437fe640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f9830072350 0x7f98300747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.369+0000 7f9843fff640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f983006be60 0x7f983006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.369+0000 7f98437fe640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f9830072350 0x7f98300747e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.369+0000 7f9843fff640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f983006be60 0x7f983006e370 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9834000c00 tx=0x7f9834009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.370+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 <== osd.3 v2:172.21.15.6:6824/3198189897 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f983c04ee50 con 0x7f9830072350 2024-05-20T18:03:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.383+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 --> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f984415d260 con 0x7f9830072350 2024-05-20T18:03:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.383+0000 7f9840ff9640 1 -- 172.21.15.6:0/824580335 <== osd.3 v2:172.21.15.6:6824/3198189897 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f984415d260 con 0x7f9830072350 2024-05-20T18:03:18.380 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:03:18.381 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-20T18:03:18.381 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:03:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f9830072350 msgr2=0x7f98300747e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.6:6824/3198189897,v1:172.21.15.6:6825/3198189897] conn(0x7f9830072350 0x7f98300747e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f983006be60 msgr2=0x7f983006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f983006be60 0x7f983006e370 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9834000c00 tx=0x7f9834009040 comp rx=0 tx=0).stop 2024-05-20T18:03:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98440c9050 msgr2=0x7f98440c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 --2- 172.21.15.6:0/824580335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98440c9050 0x7f98440c9460 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f983c02a8f0 tx=0x7f983c0014a0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f9848f6b640 1 -- 172.21.15.6:0/824580335 reap_dead start 2024-05-20T18:03:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 shutdown_connections 2024-05-20T18:03:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 >> 172.21.15.6:0/824580335 conn(0x7f98440b6d10 msgr2=0x7f98440ba110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 shutdown_connections 2024-05-20T18:03:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.384+0000 7f984a9ce640 1 -- 172.21.15.6:0/824580335 wait complete. 2024-05-20T18:03:18.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-20T18:03:18.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.512+0000 7fa59ef79640 1 Processor -- start 2024-05-20T18:03:18.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.512+0000 7fa59ef79640 1 -- start start 2024-05-20T18:03:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.513+0000 7fa59ef79640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa59815ca00 0x7fa59815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.513+0000 7fa59ef79640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5980b4c00 0x7fa5980cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.513+0000 7fa59ef79640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5980b51c0 con 0x7fa5980b0020 2024-05-20T18:03:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.513+0000 7fa59ef79640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fa59815bf20 con 0x7fa5980b4c00 2024-05-20T18:03:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.513+0000 7fa59ef79640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa59815c200 con 0x7fa59815ca00 2024-05-20T18:03:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.513+0000 7fa59d516640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa5980b4c00 0x7fa5980cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.513+0000 7fa59cd15640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa5980b0020 0x7fa5980ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42080/0 (socket says 172.21.15.6:42080) 2024-05-20T18:03:18.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.513+0000 7fa59cd15640 1 -- 172.21.15.6:0/3557433418 learned_addr learned my addr 172.21.15.6:0/3557433418 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.514+0000 7fa597fff640 1 --2- 172.21.15.6:0/3557433418 >> v2:172.21.15.171:3300/0 conn(0x7fa59815ca00 0x7fa59815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.514+0000 7fa59d516640 1 -- 172.21.15.6:0/3557433418 >> v2:172.21.15.171:3300/0 conn(0x7fa59815ca00 msgr2=0x7fa59815fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.514+0000 7fa59d516640 1 --2- 172.21.15.6:0/3557433418 >> v2:172.21.15.171:3300/0 conn(0x7fa59815ca00 0x7fa59815fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.514+0000 7fa59d516640 1 -- 172.21.15.6:0/3557433418 >> v1:172.21.15.6:6789/0 conn(0x7fa5980b0020 legacy=0x7fa5980ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.514+0000 7fa59d516640 1 -- 172.21.15.6:0/3557433418 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59815c4e0 con 0x7fa5980b4c00 2024-05-20T18:03:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.514+0000 7fa597fff640 1 --2- 172.21.15.6:0/3557433418 >> v2:172.21.15.171:3300/0 conn(0x7fa59815ca00 0x7fa59815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:18.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.514+0000 7fa59d516640 1 --2- 172.21.15.6:0/3557433418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b4c00 0x7fa5980cedd0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa5980d17a0 tx=0x7fa59002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c59011b1d75c12 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.514+0000 7fa5977fe640 1 -- 172.21.15.6:0/3557433418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590007740 con 0x7fa5980b4c00 2024-05-20T18:03:18.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa5977fe640 1 -- 172.21.15.6:0/3557433418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5900078e0 con 0x7fa5980b4c00 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa5977fe640 1 -- 172.21.15.6:0/3557433418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590007cb0 con 0x7fa5980b4c00 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa59ef79640 1 -- 172.21.15.6:0/3557433418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b4c00 msgr2=0x7fa5980cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3557433418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b4c00 0x7fa5980cedd0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa5980d17a0 tx=0x7fa59002a5f0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa59ef79640 1 -- 172.21.15.6:0/3557433418 shutdown_connections 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3557433418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b4c00 0x7fa5980cedd0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3557433418 >> v2:172.21.15.171:3300/0 conn(0x7fa59815ca00 0x7fa59815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa59ef79640 1 -- 172.21.15.6:0/3557433418 >> 172.21.15.6:0/3557433418 conn(0x7fa5980cd2a0 msgr2=0x7fa5980cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa59ef79640 1 -- 172.21.15.6:0/3557433418 shutdown_connections 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.515+0000 7fa59ef79640 1 -- 172.21.15.6:0/3557433418 wait complete. 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.517+0000 7fa59ef79640 1 Processor -- start 2024-05-20T18:03:18.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.517+0000 7fa59ef79640 1 -- start start 2024-05-20T18:03:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.518+0000 7fa59ef79640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b0020 0x7fa5980c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.518+0000 7fa59ef79640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5980b4c00 0x7fa598155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59ef79640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa59815ca00 0x7fa5980ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59ef79640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fa5980cf310 con 0x7fa5980b0020 2024-05-20T18:03:18.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59ef79640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5980b54a0 con 0x7fa59815ca00 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59ef79640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa5980cf490 con 0x7fa5980b4c00 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b0020 0x7fa5980c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b0020 0x7fa5980c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58666/0 (socket says 172.21.15.6:58666) 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 -- 172.21.15.6:0/3615524457 learned_addr learned my addr 172.21.15.6:0/3615524457 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59d516640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa59815ca00 0x7fa5980ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa597fff640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5980b4c00 0x7fa598155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 -- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5980b4c00 msgr2=0x7fa598155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5980b4c00 0x7fa598155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 -- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa59815ca00 msgr2=0x7fa5980ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa59815ca00 0x7fa5980ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 -- 172.21.15.6:0/3615524457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa598158aa0 con 0x7fa5980b0020 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59cd15640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b0020 0x7fa5980c9bd0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c3c0 tx=0x7fa58c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa5957fa640 1 -- 172.21.15.6:0/3615524457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c017070 con 0x7fa5980b0020 2024-05-20T18:03:18.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa5957fa640 1 -- 172.21.15.6:0/3615524457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58c005ce0 con 0x7fa5980b0020 2024-05-20T18:03:18.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5980ad830 con 0x7fa5980b0020 2024-05-20T18:03:18.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa5957fa640 1 -- 172.21.15.6:0/3615524457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0072f0 con 0x7fa5980b0020 2024-05-20T18:03:18.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.519+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5980addf0 con 0x7fa5980b0020 2024-05-20T18:03:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.520+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa598075b00 con 0x7fa5980b0020 2024-05-20T18:03:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.521+0000 7fa5957fa640 1 -- 172.21.15.6:0/3615524457 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa58c01a070 con 0x7fa5980b0020 2024-05-20T18:03:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.522+0000 7fa5957fa640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa57c06be30 0x7fa57c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.522+0000 7fa5957fa640 1 -- 172.21.15.6:0/3615524457 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fa58c08a1a0 con 0x7fa5980b0020 2024-05-20T18:03:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.522+0000 7fa597fff640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa57c06be30 0x7fa57c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.522+0000 7fa597fff640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa57c06be30 0x7fa57c06e340 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa598070010 tx=0x7fa584008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.526+0000 7fa5957fa640 1 -- 172.21.15.6:0/3615524457 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa58c058ba0 con 0x7fa5980b0020 2024-05-20T18:03:18.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.710+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa59806cd30 con 0x7fa57c06be30 2024-05-20T18:03:18.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.711+0000 7fa5957fa640 1 -- 172.21.15.6:0/3615524457 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa59806cd30 con 0x7fa57c06be30 2024-05-20T18:03:18.709 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2024-05-20T18:03:18.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa57c06be30 msgr2=0x7fa57c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa57c06be30 0x7fa57c06e340 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa598070010 tx=0x7fa584008040 comp rx=0 tx=0).stop 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b0020 msgr2=0x7fa5980c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b0020 0x7fa5980c9bd0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c3c0 tx=0x7fa58c00c880 comp rx=0 tx=0).stop 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 shutdown_connections 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa57c06be30 0x7fa57c06e340 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa59815ca00 0x7fa5980ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5980b4c00 0x7fa598155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 --2- 172.21.15.6:0/3615524457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5980b0020 0x7fa5980c9bd0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 >> 172.21.15.6:0/3615524457 conn(0x7fa5980cd2a0 msgr2=0x7fa5980b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 shutdown_connections 2024-05-20T18:03:18.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.713+0000 7fa59ef79640 1 -- 172.21.15.6:0/3615524457 wait complete. 2024-05-20T18:03:18.721 INFO:tasks.ceph:Scrubbing osd.4 2024-05-20T18:03:18.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-20T18:03:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.844+0000 7faa174e9640 1 Processor -- start 2024-05-20T18:03:18.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.845+0000 7faa174e9640 1 -- start start 2024-05-20T18:03:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa174e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa100b3860 0x7faa100d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa174e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1008bd20 0x7faa1008c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa174e9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1008c670 con 0x7faa1006d870 2024-05-20T18:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa174e9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7faa100d0450 con 0x7faa100b3860 2024-05-20T18:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa174e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa100d3b10 con 0x7faa1008bd20 2024-05-20T18:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa15285640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa100b3860 0x7faa100d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa15285640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa100b3860 0x7faa100d45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58678/0 (socket says 172.21.15.6:58678) 2024-05-20T18:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa14a84640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faa1006d870 0x7faa1015f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42082/0 (socket says 172.21.15.6:42082) 2024-05-20T18:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa15285640 1 -- 172.21.15.6:0/2778821248 learned_addr learned my addr 172.21.15.6:0/2778821248 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:18.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa15a86640 1 --2- 172.21.15.6:0/2778821248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1008bd20 0x7faa1008c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa15285640 1 -- 172.21.15.6:0/2778821248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1008bd20 msgr2=0x7faa1008c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa15285640 1 --2- 172.21.15.6:0/2778821248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1008bd20 0x7faa1008c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa15285640 1 -- 172.21.15.6:0/2778821248 >> v1:172.21.15.6:6789/0 conn(0x7faa1006d870 legacy=0x7faa1015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa15285640 1 -- 172.21.15.6:0/2778821248 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa100d3df0 con 0x7faa100b3860 2024-05-20T18:03:18.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.846+0000 7faa0ffff640 1 -- 172.21.15.6:0/2778821248 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341416802 0 0) 0x7faa04001110 con 0x7faa1006d870 2024-05-20T18:03:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.847+0000 7faa15285640 1 --2- 172.21.15.6:0/2778821248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa100b3860 0x7faa100d45f0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7faa00009e50 tx=0x7faa0002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28056598548cd249 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.847+0000 7faa0ffff640 1 -- 172.21.15.6:0/2778821248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00036070 con 0x7faa100b3860 2024-05-20T18:03:18.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.847+0000 7faa0ffff640 1 -- 172.21.15.6:0/2778821248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa00031600 con 0x7faa100b3860 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.847+0000 7faa0ffff640 1 -- 172.21.15.6:0/2778821248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa000319d0 con 0x7faa100b3860 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.848+0000 7faa174e9640 1 -- 172.21.15.6:0/2778821248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa100b3860 msgr2=0x7faa100d45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.848+0000 7faa174e9640 1 --2- 172.21.15.6:0/2778821248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa100b3860 0x7faa100d45f0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7faa00009e50 tx=0x7faa0002a5f0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.848+0000 7faa174e9640 1 -- 172.21.15.6:0/2778821248 shutdown_connections 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.848+0000 7faa174e9640 1 --2- 172.21.15.6:0/2778821248 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1008bd20 0x7faa1008c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.848+0000 7faa174e9640 1 --2- 172.21.15.6:0/2778821248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa100b3860 0x7faa100d45f0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.848+0000 7faa174e9640 1 -- 172.21.15.6:0/2778821248 >> 172.21.15.6:0/2778821248 conn(0x7faa100b6d10 msgr2=0x7faa1006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.848+0000 7faa174e9640 1 -- 172.21.15.6:0/2778821248 shutdown_connections 2024-05-20T18:03:18.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.848+0000 7faa174e9640 1 -- 172.21.15.6:0/2778821248 wait complete. 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.850+0000 7faa174e9640 1 Processor -- start 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.850+0000 7faa174e9640 1 -- start start 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa174e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa1006d870 0x7faa100ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa174e9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1008bd20 0x7faa100c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa174e9640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa100b3860 0x7faa10159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa174e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7faa100b81b0 con 0x7faa1006d870 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa174e9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa100d0730 con 0x7faa1008bd20 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa174e9640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa100b8330 con 0x7faa100b3860 2024-05-20T18:03:18.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa15285640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa1006d870 0x7faa100ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa15285640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa1006d870 0x7faa100ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58684/0 (socket says 172.21.15.6:58684) 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.851+0000 7faa15285640 1 -- 172.21.15.6:0/4210989209 learned_addr learned my addr 172.21.15.6:0/4210989209 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa15a86640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa100b3860 0x7faa10159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa14a84640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1008bd20 0x7faa100c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa15285640 1 -- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa100b3860 msgr2=0x7faa10159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa15285640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa100b3860 0x7faa10159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa15285640 1 -- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1008bd20 msgr2=0x7faa100c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa15285640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1008bd20 0x7faa100c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa15285640 1 -- 172.21.15.6:0/4210989209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa100c91e0 con 0x7faa1006d870 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa15a86640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa100b3860 0x7faa10159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa14a84640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1008bd20 0x7faa100c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:18.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa15285640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa1006d870 0x7faa100ca280 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7faa00009e50 tx=0x7faa00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00036050 con 0x7faa1006d870 2024-05-20T18:03:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa00037040 con 0x7faa1006d870 2024-05-20T18:03:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa100c94c0 con 0x7faa1006d870 2024-05-20T18:03:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00009510 con 0x7faa1006d870 2024-05-20T18:03:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.852+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa100c9a80 con 0x7faa1006d870 2024-05-20T18:03:18.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.853+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa100690b0 con 0x7faa1006d870 2024-05-20T18:03:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.854+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa00044020 con 0x7faa1006d870 2024-05-20T18:03:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.854+0000 7faa0dffb640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9fc06be30 0x7fa9fc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.855+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7faa000ab280 con 0x7faa1006d870 2024-05-20T18:03:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.855+0000 7faa0dffb640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7fa9fc072320 0x7fa9fc0747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.855+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 --> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa00032e50 con 0x7fa9fc072320 2024-05-20T18:03:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.855+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7faa000b2050 con 0x7faa1006d870 2024-05-20T18:03:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.855+0000 7faa14a84640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9fc06be30 0x7fa9fc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.855+0000 7faa15a86640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7fa9fc072320 0x7fa9fc0747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.855+0000 7faa14a84640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9fc06be30 0x7fa9fc06e340 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7faa100cf480 tx=0x7faa04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.856+0000 7faa15a86640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7fa9fc072320 0x7fa9fc0747b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.856+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 <== osd.4 v2:172.21.15.171:6816/2946312774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa00032e50 con 0x7fa9fc072320 2024-05-20T18:03:18.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.870+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 --> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faa100b4610 con 0x7fa9fc072320 2024-05-20T18:03:18.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.870+0000 7faa0dffb640 1 -- 172.21.15.6:0/4210989209 <== osd.4 v2:172.21.15.171:6816/2946312774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faa100b4610 con 0x7fa9fc072320 2024-05-20T18:03:18.867 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:03:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-20T18:03:18.867 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:03:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7fa9fc072320 msgr2=0x7fa9fc0747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6816/2946312774,v1:172.21.15.171:6818/2946312774] conn(0x7fa9fc072320 0x7fa9fc0747b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9fc06be30 msgr2=0x7fa9fc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fa9fc06be30 0x7fa9fc06e340 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7faa100cf480 tx=0x7faa04009040 comp rx=0 tx=0).stop 2024-05-20T18:03:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa1006d870 msgr2=0x7faa100ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 --2- 172.21.15.6:0/4210989209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa1006d870 0x7faa100ca280 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7faa00009e50 tx=0x7faa00004a40 comp rx=0 tx=0).stop 2024-05-20T18:03:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa15a86640 1 -- 172.21.15.6:0/4210989209 reap_dead start 2024-05-20T18:03:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 shutdown_connections 2024-05-20T18:03:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 >> 172.21.15.6:0/4210989209 conn(0x7faa100b6d10 msgr2=0x7faa1006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 shutdown_connections 2024-05-20T18:03:18.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.871+0000 7faa174e9640 1 -- 172.21.15.6:0/4210989209 wait complete. 2024-05-20T18:03:18.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-20T18:03:18.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.997+0000 7f54f707a640 1 Processor -- start 2024-05-20T18:03:18.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.997+0000 7f54f707a640 1 -- start start 2024-05-20T18:03:18.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f707a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f54f0162820 0x7f54f00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f707a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:18.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f707a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f006dd20 con 0x7f54f006d910 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f707a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f54f00d0630 con 0x7f54f0162820 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f707a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f54f00d39c0 con 0x7f54f00b3e80 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f5617640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f54f006d910 0x7f54f00d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42092/0 (socket says 172.21.15.6:42092) 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f5617640 1 -- 172.21.15.6:0/4177930000 learned_addr learned my addr 172.21.15.6:0/4177930000 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f4e16640 1 --2- 172.21.15.6:0/4177930000 >> v2:172.21.15.171:3300/0 conn(0x7f54f0162820 0x7f54f00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54effff640 1 --2- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54ef7fe640 1 -- 172.21.15.6:0/4177930000 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973686286 0 0) 0x7f54e8001490 con 0x7f54f006d910 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54ef7fe640 1 -- 172.21.15.6:0/4177930000 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54dc003520 con 0x7f54f006d910 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f4e16640 1 -- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 msgr2=0x7f54f006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f4e16640 1 --2- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f4e16640 1 -- 172.21.15.6:0/4177930000 >> v1:172.21.15.6:6789/0 conn(0x7f54f006d910 legacy=0x7f54f00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54f4e16640 1 -- 172.21.15.6:0/4177930000 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f00d3ca0 con 0x7f54f0162820 2024-05-20T18:03:18.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:18.999+0000 7f54effff640 1 --2- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.000+0000 7f54f4e16640 1 --2- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 0x7f54f00b3940 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f54e00097a0 tx=0x7f54e002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dceef54624bc8ee server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54ef7fe640 1 -- 172.21.15.6:0/4177930000 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0037070 con 0x7f54f0162820 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54ef7fe640 1 -- 172.21.15.6:0/4177930000 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e0032440 con 0x7f54f0162820 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54ef7fe640 1 -- 172.21.15.6:0/4177930000 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0032810 con 0x7f54f0162820 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54f707a640 1 -- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 msgr2=0x7f54f00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54f707a640 1 --2- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 0x7f54f00b3940 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f54e00097a0 tx=0x7f54e002a180 comp rx=0 tx=0).stop 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54f707a640 1 -- 172.21.15.6:0/4177930000 shutdown_connections 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54f707a640 1 --2- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54f707a640 1 --2- 172.21.15.6:0/4177930000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 0x7f54f00b3940 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54f707a640 1 -- 172.21.15.6:0/4177930000 >> 172.21.15.6:0/4177930000 conn(0x7f54f00d4bd0 msgr2=0x7f54f00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54f707a640 1 -- 172.21.15.6:0/4177930000 shutdown_connections 2024-05-20T18:03:18.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.001+0000 7f54f707a640 1 -- 172.21.15.6:0/4177930000 wait complete. 2024-05-20T18:03:19.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.003+0000 7f54f707a640 1 Processor -- start 2024-05-20T18:03:19.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.003+0000 7f54f707a640 1 -- start start 2024-05-20T18:03:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f707a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54f006d910 0x7f54f015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f707a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f015ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f707a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 0x7f54f01f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f707a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00d0300 con 0x7f54f006d910 2024-05-20T18:03:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f707a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00d4260 con 0x7f54f0162820 2024-05-20T18:03:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f707a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f54f00b91a0 con 0x7f54f00b3e80 2024-05-20T18:03:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54f006d910 0x7f54f015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54f006d910 0x7f54f015d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58688/0 (socket says 172.21.15.6:58688) 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 -- 172.21.15.6:0/3583312729 learned_addr learned my addr 172.21.15.6:0/3583312729 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54effff640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f015ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f5617640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 0x7f54f01f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 -- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 msgr2=0x7f54f015ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f015ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 -- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 msgr2=0x7f54f01f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 0x7f54f01f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 -- 172.21.15.6:0/3583312729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f015de70 con 0x7f54f006d910 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f5617640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 0x7f54f01f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54effff640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f015ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54f4e16640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54f006d910 0x7f54f015d930 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f54e0035040 tx=0x7f54e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.005+0000 7f54ed7fa640 1 -- 172.21.15.6:0/3583312729 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0041030 con 0x7f54f006d910 2024-05-20T18:03:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.006+0000 7f54ed7fa640 1 -- 172.21.15.6:0/3583312729 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e003d4e0 con 0x7f54f006d910 2024-05-20T18:03:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.006+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f01f50b0 con 0x7f54f006d910 2024-05-20T18:03:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.006+0000 7f54ed7fa640 1 -- 172.21.15.6:0/3583312729 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0037040 con 0x7f54f006d910 2024-05-20T18:03:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.006+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f00cc170 con 0x7f54f006d910 2024-05-20T18:03:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.007+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f0075b00 con 0x7f54f006d910 2024-05-20T18:03:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.007+0000 7f54ed7fa640 1 -- 172.21.15.6:0/3583312729 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54e0044070 con 0x7f54f006d910 2024-05-20T18:03:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.008+0000 7f54ed7fa640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54d006be30 0x7f54d006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.008+0000 7f54ed7fa640 1 -- 172.21.15.6:0/3583312729 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f54e00ab350 con 0x7f54f006d910 2024-05-20T18:03:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.008+0000 7f54effff640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54d006be30 0x7f54d006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.009+0000 7f54effff640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54d006be30 0x7f54d006e340 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f54f00cba30 tx=0x7f54d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.012+0000 7f54ed7fa640 1 -- 172.21.15.6:0/3583312729 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f54e0079e80 con 0x7f54f006d910 2024-05-20T18:03:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.196+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f54f00cf2a0 con 0x7f54d006be30 2024-05-20T18:03:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.196+0000 7f54ed7fa640 1 -- 172.21.15.6:0/3583312729 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f54f00cf2a0 con 0x7f54d006be30 2024-05-20T18:03:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54d006be30 msgr2=0x7f54d006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54d006be30 0x7f54d006e340 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f54f00cba30 tx=0x7f54d8008040 comp rx=0 tx=0).stop 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54f006d910 msgr2=0x7f54f015d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54f006d910 0x7f54f015d930 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f54e0035040 tx=0x7f54e00046c0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 shutdown_connections 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f54d006be30 0x7f54d006e340 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54f0162820 0x7f54f01f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f54f00b3e80 0x7f54f015ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.198+0000 7f54f707a640 1 --2- 172.21.15.6:0/3583312729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54f006d910 0x7f54f015d930 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.199+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 >> 172.21.15.6:0/3583312729 conn(0x7f54f00d4bd0 msgr2=0x7f54f00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.199+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 shutdown_connections 2024-05-20T18:03:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.199+0000 7f54f707a640 1 -- 172.21.15.6:0/3583312729 wait complete. 2024-05-20T18:03:19.207 INFO:tasks.ceph:Scrubbing osd.5 2024-05-20T18:03:19.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-20T18:03:19.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.328+0000 7fec50c4a640 1 Processor -- start 2024-05-20T18:03:19.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.328+0000 7fec50c4a640 1 -- start start 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec50c4a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c0d45f0 0x7fec4c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec50c4a640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fec4c08bd20 0x7fec4c08c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec50c4a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec4c08c670 con 0x7fec4c0b3860 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec50c4a640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fec4c0d0450 con 0x7fec4c08bd20 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec50c4a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c0d3b10 con 0x7fec4c0d45f0 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec49d9b640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c0d45f0 0x7fec4c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec4ad9d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fec4c08bd20 0x7fec4c08c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec4a59c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fec4c0b3860 0x7fec4c15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:56048/0 (socket says 172.21.15.6:56048) 2024-05-20T18:03:19.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.330+0000 7fec4a59c640 1 -- 172.21.15.6:0/2620334137 learned_addr learned my addr 172.21.15.6:0/2620334137 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.331+0000 7fec4959a640 1 -- 172.21.15.6:0/2620334137 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655714543 0 0) 0x7fec3c001110 con 0x7fec4c0b3860 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.331+0000 7fec4959a640 1 -- 172.21.15.6:0/2620334137 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec34003520 con 0x7fec4c0b3860 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.331+0000 7fec49d9b640 1 -- 172.21.15.6:0/2620334137 >> v2:172.21.15.171:3300/0 conn(0x7fec4c08bd20 msgr2=0x7fec4c08c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.331+0000 7fec49d9b640 1 --2- 172.21.15.6:0/2620334137 >> v2:172.21.15.171:3300/0 conn(0x7fec4c08bd20 0x7fec4c08c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.331+0000 7fec49d9b640 1 -- 172.21.15.6:0/2620334137 >> v1:172.21.15.171:6789/0 conn(0x7fec4c0b3860 legacy=0x7fec4c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.331+0000 7fec49d9b640 1 -- 172.21.15.6:0/2620334137 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c0d3df0 con 0x7fec4c0d45f0 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.331+0000 7fec4ad9d640 1 --2- 172.21.15.6:0/2620334137 >> v2:172.21.15.171:3300/0 conn(0x7fec4c08bd20 0x7fec4c08c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.331+0000 7fec49d9b640 1 --2- 172.21.15.6:0/2620334137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c0d45f0 0x7fec4c06d870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec400097a0 tx=0x7fec4002a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abbed76ccd698838 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec4959a640 1 -- 172.21.15.6:0/2620334137 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec40037070 con 0x7fec4c0d45f0 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec4959a640 1 -- 172.21.15.6:0/2620334137 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4002adb0 con 0x7fec4c0d45f0 2024-05-20T18:03:19.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec4959a640 1 -- 172.21.15.6:0/2620334137 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec40032660 con 0x7fec4c0d45f0 2024-05-20T18:03:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec50c4a640 1 -- 172.21.15.6:0/2620334137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c0d45f0 msgr2=0x7fec4c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec50c4a640 1 --2- 172.21.15.6:0/2620334137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c0d45f0 0x7fec4c06d870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec400097a0 tx=0x7fec4002a060 comp rx=0 tx=0).stop 2024-05-20T18:03:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec50c4a640 1 -- 172.21.15.6:0/2620334137 shutdown_connections 2024-05-20T18:03:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec50c4a640 1 --2- 172.21.15.6:0/2620334137 >> v2:172.21.15.171:3300/0 conn(0x7fec4c08bd20 0x7fec4c08c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec50c4a640 1 --2- 172.21.15.6:0/2620334137 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c0d45f0 0x7fec4c06d870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec50c4a640 1 -- 172.21.15.6:0/2620334137 >> 172.21.15.6:0/2620334137 conn(0x7fec4c0b6d10 msgr2=0x7fec4c06d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec50c4a640 1 -- 172.21.15.6:0/2620334137 shutdown_connections 2024-05-20T18:03:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.332+0000 7fec50c4a640 1 -- 172.21.15.6:0/2620334137 wait complete. 2024-05-20T18:03:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.334+0000 7fec50c4a640 1 Processor -- start 2024-05-20T18:03:19.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.334+0000 7fec50c4a640 1 -- start start 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec50c4a640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c08bd20 0x7fec4c0c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec50c4a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec4c0b3860 0x7fec4c1f8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec50c4a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec4c0d45f0 0x7fec4c0b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec50c4a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0b81b0 con 0x7fec4c0d45f0 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec50c4a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0d0730 con 0x7fec4c0b3860 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec50c4a640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c0b8330 con 0x7fec4c08bd20 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec4c0d45f0 0x7fec4c0b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec4c0d45f0 0x7fec4c0b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58702/0 (socket says 172.21.15.6:58702) 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 -- 172.21.15.6:0/2819425716 learned_addr learned my addr 172.21.15.6:0/2819425716 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4a59c640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c08bd20 0x7fec4c0c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec49d9b640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec4c0b3860 0x7fec4c1f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 -- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c08bd20 msgr2=0x7fec4c0c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c08bd20 0x7fec4c0c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 -- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec4c0b3860 msgr2=0x7fec4c1f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec4c0b3860 0x7fec4c1f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 -- 172.21.15.6:0/2819425716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c0c9980 con 0x7fec4c0d45f0 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4a59c640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fec4c08bd20 0x7fec4c0c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.336+0000 7fec4ad9d640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec4c0d45f0 0x7fec4c0b91b0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fec4400efb0 tx=0x7fec4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.337+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44018020 con 0x7fec4c0d45f0 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.337+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec44014480 con 0x7fec4c0d45f0 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.337+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c0c9c60 con 0x7fec4c0d45f0 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.337+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44014850 con 0x7fec4c0d45f0 2024-05-20T18:03:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.337+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c0ca220 con 0x7fec4c0d45f0 2024-05-20T18:03:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.338+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec4c0690b0 con 0x7fec4c0d45f0 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.338+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec44005d10 con 0x7fec4c0d45f0 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.339+0000 7fec3affd640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec2c06be60 0x7fec2c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.339+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fec4408bbb0 con 0x7fec4c0d45f0 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.339+0000 7fec3affd640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7fec2c072350 0x7fec2c0747e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.339+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 --> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec4400be50 con 0x7fec2c072350 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.339+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7fec4408e2b0 con 0x7fec4c0d45f0 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.339+0000 7fec4a59c640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec2c06be60 0x7fec2c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.339+0000 7fec49d9b640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7fec2c072350 0x7fec2c0747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.340+0000 7fec4a59c640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec2c06be60 0x7fec2c06e370 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fec3c007fd0 tx=0x7fec3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.340+0000 7fec49d9b640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7fec2c072350 0x7fec2c0747e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.341+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 <== osd.5 v2:172.21.15.171:6800/569633911 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec4400be50 con 0x7fec2c072350 2024-05-20T18:03:19.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.354+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 --> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec4c0c96d0 con 0x7fec2c072350 2024-05-20T18:03:19.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec3affd640 1 -- 172.21.15.6:0/2819425716 <== osd.5 v2:172.21.15.171:6800/569633911 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fec4c0c96d0 con 0x7fec2c072350 2024-05-20T18:03:19.351 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:03:19.352 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-20T18:03:19.352 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7fec2c072350 msgr2=0x7fec2c0747e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6800/569633911,v1:172.21.15.171:6801/569633911] conn(0x7fec2c072350 0x7fec2c0747e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec2c06be60 msgr2=0x7fec2c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fec2c06be60 0x7fec2c06e370 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fec3c007fd0 tx=0x7fec3c009040 comp rx=0 tx=0).stop 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec4c0d45f0 msgr2=0x7fec4c0b91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 --2- 172.21.15.6:0/2819425716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec4c0d45f0 0x7fec4c0b91b0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fec4400efb0 tx=0x7fec4400c490 comp rx=0 tx=0).stop 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec4ad9d640 1 -- 172.21.15.6:0/2819425716 reap_dead start 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 shutdown_connections 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 >> 172.21.15.6:0/2819425716 conn(0x7fec4c0b6d10 msgr2=0x7fec4c15f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 shutdown_connections 2024-05-20T18:03:19.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.355+0000 7fec50c4a640 1 -- 172.21.15.6:0/2819425716 wait complete. 2024-05-20T18:03:19.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-20T18:03:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.481+0000 7fdbec1c3640 1 Processor -- start 2024-05-20T18:03:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.482+0000 7fdbec1c3640 1 -- start start 2024-05-20T18:03:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbec1c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbe40cd710 0x7fdbe4162e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbec1c3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdbe406d6b0 0x7fdbe415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbec1c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 0x7fdbe40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbec1c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe40d0ba0 con 0x7fdbe40cd710 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbec1c3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe40cfd20 con 0x7fdbe406d6b0 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbec1c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe406c8c0 con 0x7fdbe40cf3d0 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbe9f5f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbe40cd710 0x7fdbe4162e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbe9f5f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbe40cd710 0x7fdbe4162e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58712/0 (socket says 172.21.15.6:58712) 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbe9f5f640 1 -- 172.21.15.6:0/603905072 learned_addr learned my addr 172.21.15.6:0/603905072 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbe975e640 1 --2- 172.21.15.6:0/603905072 >> v2:172.21.15.171:3300/0 conn(0x7fdbe406d6b0 0x7fdbe415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbea760640 1 --2- 172.21.15.6:0/603905072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 0x7fdbe40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.483+0000 7fdbe9f5f640 1 -- 172.21.15.6:0/603905072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 msgr2=0x7fdbe40cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.484+0000 7fdbe9f5f640 1 --2- 172.21.15.6:0/603905072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 0x7fdbe40cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.484+0000 7fdbe9f5f640 1 -- 172.21.15.6:0/603905072 >> v2:172.21.15.171:3300/0 conn(0x7fdbe406d6b0 msgr2=0x7fdbe415f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.484+0000 7fdbe9f5f640 1 --2- 172.21.15.6:0/603905072 >> v2:172.21.15.171:3300/0 conn(0x7fdbe406d6b0 0x7fdbe415f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.484+0000 7fdbe9f5f640 1 -- 172.21.15.6:0/603905072 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe406dac0 con 0x7fdbe40cd710 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.484+0000 7fdbe9f5f640 1 --2- 172.21.15.6:0/603905072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe40cd710 0x7fdbe4162e00 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fdbe406dc90 tx=0x7fdbe002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b616f540622ea7d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.484+0000 7fdbe8f5d640 1 -- 172.21.15.6:0/603905072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0037070 con 0x7fdbe40cd710 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.484+0000 7fdbe8f5d640 1 -- 172.21.15.6:0/603905072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe0032440 con 0x7fdbe40cd710 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.484+0000 7fdbe8f5d640 1 -- 172.21.15.6:0/603905072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0032810 con 0x7fdbe40cd710 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 -- 172.21.15.6:0/603905072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe40cd710 msgr2=0x7fdbe4162e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/603905072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe40cd710 0x7fdbe4162e00 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fdbe406dc90 tx=0x7fdbe002a1c0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 -- 172.21.15.6:0/603905072 shutdown_connections 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/603905072 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 0x7fdbe40cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/603905072 >> v2:172.21.15.171:3300/0 conn(0x7fdbe406d6b0 0x7fdbe415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/603905072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe40cd710 0x7fdbe4162e00 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 -- 172.21.15.6:0/603905072 >> 172.21.15.6:0/603905072 conn(0x7fdbe40b44d0 msgr2=0x7fdbe40b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 -- 172.21.15.6:0/603905072 shutdown_connections 2024-05-20T18:03:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.485+0000 7fdbec1c3640 1 -- 172.21.15.6:0/603905072 wait complete. 2024-05-20T18:03:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.487+0000 7fdbec1c3640 1 Processor -- start 2024-05-20T18:03:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.487+0000 7fdbec1c3640 1 -- start start 2024-05-20T18:03:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbec1c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe406d6b0 0x7fdbe40b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbec1c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe40cd710 0x7fdbe40cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbec1c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 0x7fdbe40ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbec1c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe41639a0 con 0x7fdbe406d6b0 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbec1c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe41636c0 con 0x7fdbe40cd710 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbec1c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe4163c80 con 0x7fdbe40cf3d0 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbe9f5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe406d6b0 0x7fdbe40b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbe9f5f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe406d6b0 0x7fdbe40b5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58722/0 (socket says 172.21.15.6:58722) 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.488+0000 7fdbe9f5f640 1 -- 172.21.15.6:0/3657866536 learned_addr learned my addr 172.21.15.6:0/3657866536 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbea760640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 0x7fdbe40ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbe975e640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe40cd710 0x7fdbe40cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbe9f5f640 1 -- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 msgr2=0x7fdbe40ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbe9f5f640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 0x7fdbe40ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbe9f5f640 1 -- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe40cd710 msgr2=0x7fdbe40cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbe9f5f640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe40cd710 0x7fdbe40cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbe9f5f640 1 -- 172.21.15.6:0/3657866536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe40c9b90 con 0x7fdbe406d6b0 2024-05-20T18:03:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbe9f5f640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe406d6b0 0x7fdbe40b5ff0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fdbe002a200 tx=0x7fdbe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbda7fc640 1 -- 172.21.15.6:0/3657866536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0041020 con 0x7fdbe406d6b0 2024-05-20T18:03:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbda7fc640 1 -- 172.21.15.6:0/3657866536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe003d620 con 0x7fdbe406d6b0 2024-05-20T18:03:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe40b6530 con 0x7fdbe406d6b0 2024-05-20T18:03:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbda7fc640 1 -- 172.21.15.6:0/3657866536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0037040 con 0x7fdbe406d6b0 2024-05-20T18:03:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.489+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe40b6d20 con 0x7fdbe406d6b0 2024-05-20T18:03:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.490+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe4075b00 con 0x7fdbe406d6b0 2024-05-20T18:03:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.491+0000 7fdbda7fc640 1 -- 172.21.15.6:0/3657866536 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbe0044020 con 0x7fdbe406d6b0 2024-05-20T18:03:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.491+0000 7fdbda7fc640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbc806be30 0x7fdbc806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.492+0000 7fdbda7fc640 1 -- 172.21.15.6:0/3657866536 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fdbe00ab3f0 con 0x7fdbe406d6b0 2024-05-20T18:03:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.492+0000 7fdbe975e640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbc806be30 0x7fdbc806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.492+0000 7fdbe975e640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbc806be30 0x7fdbc806e340 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4162fc0 tx=0x7fdbd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.496+0000 7fdbda7fc640 1 -- 172.21.15.6:0/3657866536 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdbe004b030 con 0x7fdbe406d6b0 2024-05-20T18:03:19.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.685+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fdbe40c9d70 con 0x7fdbc806be30 2024-05-20T18:03:19.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.686+0000 7fdbda7fc640 1 -- 172.21.15.6:0/3657866536 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdbe40c9d70 con 0x7fdbc806be30 2024-05-20T18:03:19.683 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2024-05-20T18:03:19.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbc806be30 msgr2=0x7fdbc806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbc806be30 0x7fdbc806e340 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4162fc0 tx=0x7fdbd4008040 comp rx=0 tx=0).stop 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe406d6b0 msgr2=0x7fdbe40b5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe406d6b0 0x7fdbe40b5ff0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fdbe002a200 tx=0x7fdbe00046c0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 shutdown_connections 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fdbc806be30 0x7fdbc806e340 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdbe40cf3d0 0x7fdbe40ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdbe40cd710 0x7fdbe40cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 --2- 172.21.15.6:0/3657866536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbe406d6b0 0x7fdbe40b5ff0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 >> 172.21.15.6:0/3657866536 conn(0x7fdbe40b44d0 msgr2=0x7fdbe41618c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.688+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 shutdown_connections 2024-05-20T18:03:19.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.689+0000 7fdbec1c3640 1 -- 172.21.15.6:0/3657866536 wait complete. 2024-05-20T18:03:19.696 INFO:tasks.ceph:Scrubbing osd.6 2024-05-20T18:03:19.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-20T18:03:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.819+0000 7f1be8b84640 1 Processor -- start 2024-05-20T18:03:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.819+0000 7f1be8b84640 1 -- start start 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be8b84640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1be40d1830 0x7f1be40ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be8b84640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1be40cea20 0x7f1be40b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be8b84640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be40d0160 con 0x7f1be40d3510 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be8b84640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f1be40b1ff0 con 0x7f1be40cea20 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be8b84640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1be40cda00 con 0x7f1be40d1830 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1be40cea20 0x7f1be40b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1be40cea20 0x7f1be40b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58724/0 (socket says 172.21.15.6:58724) 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be2d9d640 1 -- 172.21.15.6:0/2510782272 learned_addr learned my addr 172.21.15.6:0/2510782272 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.820+0000 7f1be259c640 1 --1- 172.21.15.6:0/2510782272 >> v1:172.21.15.6:6789/0 conn(0x7f1be40d3510 0x7f1be40b18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42100/0 (socket says 172.21.15.6:42100) 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.821+0000 7f1be1d9b640 1 --2- 172.21.15.6:0/2510782272 >> v2:172.21.15.171:3300/0 conn(0x7f1be40d1830 0x7f1be40ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.821+0000 7f1be2d9d640 1 -- 172.21.15.6:0/2510782272 >> v2:172.21.15.171:3300/0 conn(0x7f1be40d1830 msgr2=0x7f1be40ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.821+0000 7f1be2d9d640 1 --2- 172.21.15.6:0/2510782272 >> v2:172.21.15.171:3300/0 conn(0x7f1be40d1830 0x7f1be40ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.821+0000 7f1be2d9d640 1 -- 172.21.15.6:0/2510782272 >> v1:172.21.15.6:6789/0 conn(0x7f1be40d3510 legacy=0x7f1be40b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.821+0000 7f1be2d9d640 1 -- 172.21.15.6:0/2510782272 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be40cdce0 con 0x7f1be40cea20 2024-05-20T18:03:19.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.821+0000 7f1be159a640 1 -- 172.21.15.6:0/2510782272 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999379183 0 0) 0x7f1be40d0160 con 0x7f1be40d3510 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.822+0000 7f1be2d9d640 1 --2- 172.21.15.6:0/2510782272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40cea20 0x7f1be40b21d0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f1be415da40 tx=0x7f1bdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314796d860e319ee server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.822+0000 7f1be159a640 1 -- 172.21.15.6:0/2510782272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc037070 con 0x7f1be40cea20 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.822+0000 7f1be159a640 1 -- 172.21.15.6:0/2510782272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc032440 con 0x7f1be40cea20 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.822+0000 7f1be159a640 1 -- 172.21.15.6:0/2510782272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc032810 con 0x7f1be40cea20 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.822+0000 7f1be8b84640 1 -- 172.21.15.6:0/2510782272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40cea20 msgr2=0x7f1be40b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.822+0000 7f1be8b84640 1 --2- 172.21.15.6:0/2510782272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40cea20 0x7f1be40b21d0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f1be415da40 tx=0x7f1bdc02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.823+0000 7f1be8b84640 1 -- 172.21.15.6:0/2510782272 shutdown_connections 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.823+0000 7f1be8b84640 1 --2- 172.21.15.6:0/2510782272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40cea20 0x7f1be40b21d0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.823+0000 7f1be8b84640 1 --2- 172.21.15.6:0/2510782272 >> v2:172.21.15.171:3300/0 conn(0x7f1be40d1830 0x7f1be40ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.823+0000 7f1be8b84640 1 -- 172.21.15.6:0/2510782272 >> 172.21.15.6:0/2510782272 conn(0x7f1be40d29f0 msgr2=0x7f1be40d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.823+0000 7f1be8b84640 1 -- 172.21.15.6:0/2510782272 shutdown_connections 2024-05-20T18:03:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.823+0000 7f1be8b84640 1 -- 172.21.15.6:0/2510782272 wait complete. 2024-05-20T18:03:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.824+0000 7f1be8b84640 1 Processor -- start 2024-05-20T18:03:19.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.825+0000 7f1be8b84640 1 -- start start 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be8b84640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1be40cea20 0x7f1be41f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be8b84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1be40d1830 0x7f1be415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be8b84640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40d3510 0x7f1be415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be8b84640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f1be40cfd80 con 0x7f1be40d3510 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be8b84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1be40cd6b0 con 0x7f1be40d1830 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be8b84640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1be40cff00 con 0x7f1be40cea20 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40d3510 0x7f1be415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40d3510 0x7f1be415bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58738/0 (socket says 172.21.15.6:58738) 2024-05-20T18:03:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be2d9d640 1 -- 172.21.15.6:0/1289104833 learned_addr learned my addr 172.21.15.6:0/1289104833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be1d9b640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1be40d1830 0x7f1be415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be259c640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1be40cea20 0x7f1be41f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be2d9d640 1 -- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1be40cea20 msgr2=0x7f1be41f3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be2d9d640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1be40cea20 0x7f1be41f3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be2d9d640 1 -- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1be40d1830 msgr2=0x7f1be415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be2d9d640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1be40d1830 0x7f1be415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.826+0000 7f1be2d9d640 1 -- 172.21.15.6:0/1289104833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be40b2250 con 0x7f1be40d3510 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.827+0000 7f1be2d9d640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40d3510 0x7f1be415bb70 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0090b0 tx=0x7f1bdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.827+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc041020 con 0x7f1be40d3510 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.827+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc0306c0 con 0x7f1be40d3510 2024-05-20T18:03:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.827+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be40b2530 con 0x7f1be40d3510 2024-05-20T18:03:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.827+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc037040 con 0x7f1be40d3510 2024-05-20T18:03:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.827+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be40b2af0 con 0x7f1be40d3510 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.828+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1be40b2ed0 con 0x7f1be40d3510 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.828+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bdc044020 con 0x7f1be40d3510 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.829+0000 7f1bdaffd640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bc406be30 0x7f1bc406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.829+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f1bdc0ab310 con 0x7f1be40d3510 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.829+0000 7f1bdaffd640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7f1bc4072320 0x7f1bc40747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.829+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 --> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bdc02be50 con 0x7f1bc4072320 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.829+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7f1bdc0b2050 con 0x7f1be40d3510 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.829+0000 7f1be259c640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bc406be30 0x7f1bc406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.829+0000 7f1be1d9b640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7f1bc4072320 0x7f1bc40747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.830+0000 7f1be259c640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bc406be30 0x7f1bc406e340 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40012e0 tx=0x7f1bd4001630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.830+0000 7f1be1d9b640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7f1bc4072320 0x7f1bc40747b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.831+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 <== osd.6 v2:172.21.15.171:6817/2330779284 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1bdc02be50 con 0x7f1bc4072320 2024-05-20T18:03:19.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.844+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 --> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1be41f3bf0 con 0x7f1bc4072320 2024-05-20T18:03:19.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.844+0000 7f1bdaffd640 1 -- 172.21.15.6:0/1289104833 <== osd.6 v2:172.21.15.171:6817/2330779284 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1be41f3bf0 con 0x7f1bc4072320 2024-05-20T18:03:19.841 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:03:19.841 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-20T18:03:19.841 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7f1bc4072320 msgr2=0x7f1bc40747b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6817/2330779284,v1:172.21.15.171:6819/2330779284] conn(0x7f1bc4072320 0x7f1bc40747b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bc406be30 msgr2=0x7f1bc406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f1bc406be30 0x7f1bc406e340 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40012e0 tx=0x7f1bd4001630 comp rx=0 tx=0).stop 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40d3510 msgr2=0x7f1be415bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 --2- 172.21.15.6:0/1289104833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1be40d3510 0x7f1be415bb70 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0090b0 tx=0x7f1bdc0046c0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be2d9d640 1 -- 172.21.15.6:0/1289104833 reap_dead start 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 shutdown_connections 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 >> 172.21.15.6:0/1289104833 conn(0x7f1be40d29f0 msgr2=0x7f1be40b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 shutdown_connections 2024-05-20T18:03:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.845+0000 7f1be8b84640 1 -- 172.21.15.6:0/1289104833 wait complete. 2024-05-20T18:03:19.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-20T18:03:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.971+0000 7f50c6073640 1 Processor -- start 2024-05-20T18:03:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.971+0000 7f50c6073640 1 -- start start 2024-05-20T18:03:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50c6073640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c0162820 0x7f50c00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50c6073640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f50c006dae0 0x7f50c00b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50c6073640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c00d0630 con 0x7f50c00b3e80 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50c6073640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f50c00d39c0 con 0x7f50c0162820 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50c6073640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f50c00d3ca0 con 0x7f50c006dae0 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c0162820 0x7f50c00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bf7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50c0162820 0x7f50c00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58740/0 (socket says 172.21.15.6:58740) 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bf7fe640 1 -- 172.21.15.6:0/1257544600 learned_addr learned my addr 172.21.15.6:0/1257544600 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bffff640 1 --2- 172.21.15.6:0/1257544600 >> v2:172.21.15.171:3300/0 conn(0x7f50c006dae0 0x7f50c00b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bf7fe640 1 -- 172.21.15.6:0/1257544600 >> v2:172.21.15.171:3300/0 conn(0x7f50c006dae0 msgr2=0x7f50c00b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bf7fe640 1 --2- 172.21.15.6:0/1257544600 >> v2:172.21.15.171:3300/0 conn(0x7f50c006dae0 0x7f50c00b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bf7fe640 1 -- 172.21.15.6:0/1257544600 >> v1:172.21.15.171:6789/0 conn(0x7f50c00b3e80 legacy=0x7f50c006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bf7fe640 1 -- 172.21.15.6:0/1257544600 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c00d3f80 con 0x7f50c0162820 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.973+0000 7f50bffff640 1 --2- 172.21.15.6:0/1257544600 >> v2:172.21.15.171:3300/0 conn(0x7f50c006dae0 0x7f50c00b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.974+0000 7f50bf7fe640 1 --2- 172.21.15.6:0/1257544600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c00b3940 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f50c008e070 tx=0x7f50b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca824c4136dfd02 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.974+0000 7f50be7fc640 1 -- 172.21.15.6:0/1257544600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0037070 con 0x7f50c0162820 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.974+0000 7f50be7fc640 1 -- 172.21.15.6:0/1257544600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b0032440 con 0x7f50c0162820 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.974+0000 7f50be7fc640 1 -- 172.21.15.6:0/1257544600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0032810 con 0x7f50c0162820 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.975+0000 7f50c6073640 1 -- 172.21.15.6:0/1257544600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 msgr2=0x7f50c00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.975+0000 7f50c6073640 1 --2- 172.21.15.6:0/1257544600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c00b3940 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f50c008e070 tx=0x7f50b002a230 comp rx=0 tx=0).stop 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.975+0000 7f50c6073640 1 -- 172.21.15.6:0/1257544600 shutdown_connections 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.975+0000 7f50c6073640 1 --2- 172.21.15.6:0/1257544600 >> v2:172.21.15.171:3300/0 conn(0x7f50c006dae0 0x7f50c00b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.975+0000 7f50c6073640 1 --2- 172.21.15.6:0/1257544600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c00b3940 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.975+0000 7f50c6073640 1 -- 172.21.15.6:0/1257544600 >> 172.21.15.6:0/1257544600 conn(0x7f50c00d4bd0 msgr2=0x7f50c00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.975+0000 7f50c6073640 1 -- 172.21.15.6:0/1257544600 shutdown_connections 2024-05-20T18:03:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.975+0000 7f50c6073640 1 -- 172.21.15.6:0/1257544600 wait complete. 2024-05-20T18:03:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.977+0000 7f50c6073640 1 Processor -- start 2024-05-20T18:03:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.977+0000 7f50c6073640 1 -- start start 2024-05-20T18:03:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50c6073640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50c00b3e80 0x7f50c00cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50c6073640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c014bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50c6073640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50c006d3d0 0x7f50c006d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50c6073640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00d4780 con 0x7f50c0162820 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50c6073640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00d0300 con 0x7f50c00b3e80 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50c6073640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f50c00d4900 con 0x7f50c006d3d0 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c014bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c014bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58748/0 (socket says 172.21.15.6:58748) 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.978+0000 7f50beffd640 1 -- 172.21.15.6:0/839254261 learned_addr learned my addr 172.21.15.6:0/839254261 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50bffff640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50c006d3d0 0x7f50c006d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50bf7fe640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50c00b3e80 0x7f50c00cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50beffd640 1 -- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50c006d3d0 msgr2=0x7f50c006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50beffd640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50c006d3d0 0x7f50c006d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50beffd640 1 -- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50c00b3e80 msgr2=0x7f50c00cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50beffd640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50c00b3e80 0x7f50c00cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50beffd640 1 -- 172.21.15.6:0/839254261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c006dd20 con 0x7f50c0162820 2024-05-20T18:03:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50beffd640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c014bdd0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b3f0 tx=0x7f50b400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50a7fff640 1 -- 172.21.15.6:0/839254261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4015020 con 0x7f50c0162820 2024-05-20T18:03:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50a7fff640 1 -- 172.21.15.6:0/839254261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b4011830 con 0x7f50c0162820 2024-05-20T18:03:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c014c890 con 0x7f50c0162820 2024-05-20T18:03:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50a7fff640 1 -- 172.21.15.6:0/839254261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4011c20 con 0x7f50c0162820 2024-05-20T18:03:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.979+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c0149f50 con 0x7f50c0162820 2024-05-20T18:03:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.980+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c014c5e0 con 0x7f50c0162820 2024-05-20T18:03:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.981+0000 7f50a7fff640 1 -- 172.21.15.6:0/839254261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50b4018020 con 0x7f50c0162820 2024-05-20T18:03:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.981+0000 7f50a7fff640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f50ac06be60 0x7f50ac06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.981+0000 7f50a7fff640 1 -- 172.21.15.6:0/839254261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f50b408a940 con 0x7f50c0162820 2024-05-20T18:03:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.982+0000 7f50bf7fe640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f50ac06be60 0x7f50ac06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.982+0000 7f50bf7fe640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f50ac06be60 0x7f50ac06e370 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f50b0034000 tx=0x7f50b002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:19.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:19.986+0000 7f50a7fff640 1 -- 172.21.15.6:0/839254261 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f50b401f030 con 0x7f50c0162820 2024-05-20T18:03:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.172+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f50c0149a90 con 0x7f50ac06be60 2024-05-20T18:03:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.173+0000 7f50a7fff640 1 -- 172.21.15.6:0/839254261 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50c0149a90 con 0x7f50ac06be60 2024-05-20T18:03:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2024-05-20T18:03:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f50ac06be60 msgr2=0x7f50ac06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f50ac06be60 0x7f50ac06e370 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f50b0034000 tx=0x7f50b002e000 comp rx=0 tx=0).stop 2024-05-20T18:03:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 msgr2=0x7f50c014bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c014bdd0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b3f0 tx=0x7f50b400b8b0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 shutdown_connections 2024-05-20T18:03:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f50ac06be60 0x7f50ac06e370 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f50c006d3d0 0x7f50c006d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0162820 0x7f50c014bdd0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 --2- 172.21.15.6:0/839254261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50c00b3e80 0x7f50c00cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 >> 172.21.15.6:0/839254261 conn(0x7f50c00d4bd0 msgr2=0x7f50c015d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 shutdown_connections 2024-05-20T18:03:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.175+0000 7f50c6073640 1 -- 172.21.15.6:0/839254261 wait complete. 2024-05-20T18:03:20.183 INFO:tasks.ceph:Scrubbing osd.7 2024-05-20T18:03:20.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-20T18:03:20.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.305+0000 7fcfd937e640 1 Processor -- start 2024-05-20T18:03:20.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.305+0000 7fcfd937e640 1 -- start start 2024-05-20T18:03:20.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.306+0000 7fcfd937e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfd406d830 0x7fcfd40cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.306+0000 7fcfd937e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40cdf70 0x7fcfd40ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.306+0000 7fcfd937e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfd40d2740 con 0x7fcfd40d2330 2024-05-20T18:03:20.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.306+0000 7fcfd937e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7fcfd409c3b0 con 0x7fcfd406d830 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.306+0000 7fcfd937e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd406dda0 con 0x7fcfd40cdf70 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd27fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfd406d830 0x7fcfd40cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd27fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfd406d830 0x7fcfd40cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58758/0 (socket says 172.21.15.6:58758) 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcfd40d2330 0x7fcfd406d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42104/0 (socket says 172.21.15.6:42104) 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd27fc640 1 -- 172.21.15.6:0/3446570382 learned_addr learned my addr 172.21.15.6:0/3446570382 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd37fe640 1 --2- 172.21.15.6:0/3446570382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40cdf70 0x7fcfd40ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd27fc640 1 -- 172.21.15.6:0/3446570382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40cdf70 msgr2=0x7fcfd40ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd27fc640 1 --2- 172.21.15.6:0/3446570382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40cdf70 0x7fcfd40ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd27fc640 1 -- 172.21.15.6:0/3446570382 >> v1:172.21.15.6:6789/0 conn(0x7fcfd40d2330 legacy=0x7fcfd406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.307+0000 7fcfd27fc640 1 -- 172.21.15.6:0/3446570382 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd40b81a0 con 0x7fcfd406d830 2024-05-20T18:03:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.308+0000 7fcfd27fc640 1 --2- 172.21.15.6:0/3446570382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 0x7fcfd40cda30 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009870 tx=0x7fcfc802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5a5d405bd8596c server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.308+0000 7fcfd1ffb640 1 -- 172.21.15.6:0/3446570382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8037070 con 0x7fcfd406d830 2024-05-20T18:03:20.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.308+0000 7fcfd1ffb640 1 -- 172.21.15.6:0/3446570382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc8032440 con 0x7fcfd406d830 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.308+0000 7fcfd1ffb640 1 -- 172.21.15.6:0/3446570382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8032810 con 0x7fcfd406d830 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.308+0000 7fcfd937e640 1 -- 172.21.15.6:0/3446570382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 msgr2=0x7fcfd40cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.308+0000 7fcfd937e640 1 --2- 172.21.15.6:0/3446570382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 0x7fcfd40cda30 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009870 tx=0x7fcfc802a250 comp rx=0 tx=0).stop 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.309+0000 7fcfd937e640 1 -- 172.21.15.6:0/3446570382 shutdown_connections 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.309+0000 7fcfd937e640 1 --2- 172.21.15.6:0/3446570382 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40cdf70 0x7fcfd40ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.309+0000 7fcfd937e640 1 --2- 172.21.15.6:0/3446570382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 0x7fcfd40cda30 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.309+0000 7fcfd937e640 1 -- 172.21.15.6:0/3446570382 >> 172.21.15.6:0/3446570382 conn(0x7fcfd40cf450 msgr2=0x7fcfd40cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.309+0000 7fcfd937e640 1 -- 172.21.15.6:0/3446570382 shutdown_connections 2024-05-20T18:03:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.309+0000 7fcfd937e640 1 -- 172.21.15.6:0/3446570382 wait complete. 2024-05-20T18:03:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.311+0000 7fcfd937e640 1 Processor -- start 2024-05-20T18:03:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.311+0000 7fcfd937e640 1 -- start start 2024-05-20T18:03:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd937e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 0x7fcfd41f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd937e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd40cdf70 0x7fcfd41f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd937e640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40d2330 0x7fcfd415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd937e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd40d3980 con 0x7fcfd406d830 2024-05-20T18:03:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd937e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd40d3800 con 0x7fcfd40cdf70 2024-05-20T18:03:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd937e640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd40b4180 con 0x7fcfd40d2330 2024-05-20T18:03:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 0x7fcfd41f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 0x7fcfd41f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58766/0 (socket says 172.21.15.6:58766) 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd2ffd640 1 -- 172.21.15.6:0/4062405302 learned_addr learned my addr 172.21.15.6:0/4062405302 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd37fe640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40d2330 0x7fcfd415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd27fc640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd40cdf70 0x7fcfd41f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd2ffd640 1 -- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40d2330 msgr2=0x7fcfd415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd2ffd640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfd40d2330 0x7fcfd415c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd2ffd640 1 -- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd40cdf70 msgr2=0x7fcfd41f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd2ffd640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfd40cdf70 0x7fcfd41f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.312+0000 7fcfd2ffd640 1 -- 172.21.15.6:0/4062405302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd4161d40 con 0x7fcfd406d830 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.313+0000 7fcfd2ffd640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 0x7fcfd41f5810 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c3c0 tx=0x7fcfc400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.313+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4017070 con 0x7fcfd406d830 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.313+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc40074e0 con 0x7fcfd406d830 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.313+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd4162020 con 0x7fcfd406d830 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.313+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40059a0 con 0x7fcfd406d830 2024-05-20T18:03:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.313+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd415d910 con 0x7fcfd406d830 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.314+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcfd4162540 con 0x7fcfd406d830 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.315+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfc401a070 con 0x7fcfd406d830 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.315+0000 7fcfbb7fe640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfc006be60 0x7fcfc006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.315+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fcfc4089f00 con 0x7fcfd406d830 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.315+0000 7fcfbb7fe640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fcfc0072350 0x7fcfc00747e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.315+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 --> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfc4014ec0 con 0x7fcfc0072350 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.315+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=151) ==== 24+0+0 (secure 0 0 0) 0x7fcfc408c600 con 0x7fcfd406d830 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.315+0000 7fcfd27fc640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfc006be60 0x7fcfc006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.315+0000 7fcfd37fe640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fcfc0072350 0x7fcfc00747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.316+0000 7fcfd27fc640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfc006be60 0x7fcfc006e370 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8034000 tx=0x7fcfc802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.316+0000 7fcfd37fe640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fcfc0072350 0x7fcfc00747e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.317+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 <== osd.7 v2:172.21.15.171:6808/3357029460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcfc4014ec0 con 0x7fcfc0072350 2024-05-20T18:03:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.330+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 --> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcfd40690b0 con 0x7fcfc0072350 2024-05-20T18:03:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfbb7fe640 1 -- 172.21.15.6:0/4062405302 <== osd.7 v2:172.21.15.171:6808/3357029460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcfd40690b0 con 0x7fcfc0072350 2024-05-20T18:03:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-05-20T18:03:20.328 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-20T18:03:20.328 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fcfc0072350 msgr2=0x7fcfc00747e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6808/3357029460,v1:172.21.15.171:6809/3357029460] conn(0x7fcfc0072350 0x7fcfc00747e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfc006be60 msgr2=0x7fcfc006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fcfc006be60 0x7fcfc006e370 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8034000 tx=0x7fcfc802e000 comp rx=0 tx=0).stop 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 msgr2=0x7fcfd41f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 --2- 172.21.15.6:0/4062405302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfd406d830 0x7fcfd41f5810 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c3c0 tx=0x7fcfc400c880 comp rx=0 tx=0).stop 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd37fe640 1 -- 172.21.15.6:0/4062405302 reap_dead start 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 shutdown_connections 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 >> 172.21.15.6:0/4062405302 conn(0x7fcfd40cf450 msgr2=0x7fcfd4071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 shutdown_connections 2024-05-20T18:03:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.331+0000 7fcfd937e640 1 -- 172.21.15.6:0/4062405302 wait complete. 2024-05-20T18:03:20.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-20T18:03:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.459+0000 7f7231e61640 1 Processor -- start 2024-05-20T18:03:20.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.459+0000 7f7231e61640 1 -- start start 2024-05-20T18:03:20.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f7231e61640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f722c09a990 0x7f722c09ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f7231e61640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c0d10d0 0x7f722c0d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f7231e61640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f722c0cce10 con 0x7f722c0d1a20 2024-05-20T18:03:20.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f7231e61640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f722c09b2e0 con 0x7f722c09a990 2024-05-20T18:03:20.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f7231e61640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f722c0cd0d0 con 0x7f722c0d10d0 2024-05-20T18:03:20.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f722affd640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c0d10d0 0x7f722c0d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f722b7fe640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f722c09a990 0x7f722c09ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f722bfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f722c0d1a20 0x7f722c0cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:56060/0 (socket says 172.21.15.6:56060) 2024-05-20T18:03:20.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.460+0000 7f722bfff640 1 -- 172.21.15.6:0/1619148623 learned_addr learned my addr 172.21.15.6:0/1619148623 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.461+0000 7f722a7fc640 1 -- 172.21.15.6:0/1619148623 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635651237 0 0) 0x7f722c0cce10 con 0x7f722c0d1a20 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.461+0000 7f722a7fc640 1 -- 172.21.15.6:0/1619148623 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7214003520 con 0x7f722c0d1a20 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.461+0000 7f722b7fe640 1 -- 172.21.15.6:0/1619148623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c0d10d0 msgr2=0x7f722c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.461+0000 7f722b7fe640 1 --2- 172.21.15.6:0/1619148623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c0d10d0 0x7f722c0d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.461+0000 7f722b7fe640 1 -- 172.21.15.6:0/1619148623 >> v1:172.21.15.171:6789/0 conn(0x7f722c0d1a20 legacy=0x7f722c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.461+0000 7f722b7fe640 1 -- 172.21.15.6:0/1619148623 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c0cd3b0 con 0x7f722c09a990 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.461+0000 7f722affd640 1 --2- 172.21.15.6:0/1619148623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c0d10d0 0x7f722c0d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.462+0000 7f722b7fe640 1 --2- 172.21.15.6:0/1619148623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c09a990 0x7f722c09ada0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f721c0097a0 tx=0x7f721c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=459c91c0bdd8f125 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.462+0000 7f722a7fc640 1 -- 172.21.15.6:0/1619148623 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c037070 con 0x7f722c09a990 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.462+0000 7f722a7fc640 1 -- 172.21.15.6:0/1619148623 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c032440 con 0x7f722c09a990 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.462+0000 7f722a7fc640 1 -- 172.21.15.6:0/1619148623 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0327f0 con 0x7f722c09a990 2024-05-20T18:03:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.463+0000 7f7231e61640 1 -- 172.21.15.6:0/1619148623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c09a990 msgr2=0x7f722c09ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.463+0000 7f7231e61640 1 --2- 172.21.15.6:0/1619148623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c09a990 0x7f722c09ada0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f721c0097a0 tx=0x7f721c02a180 comp rx=0 tx=0).stop 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.463+0000 7f7231e61640 1 -- 172.21.15.6:0/1619148623 shutdown_connections 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.463+0000 7f7231e61640 1 --2- 172.21.15.6:0/1619148623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c0d10d0 0x7f722c0d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.463+0000 7f7231e61640 1 --2- 172.21.15.6:0/1619148623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c09a990 0x7f722c09ada0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.463+0000 7f7231e61640 1 -- 172.21.15.6:0/1619148623 >> 172.21.15.6:0/1619148623 conn(0x7f722c0b6660 msgr2=0x7f722c0b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.463+0000 7f7231e61640 1 -- 172.21.15.6:0/1619148623 shutdown_connections 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.463+0000 7f7231e61640 1 -- 172.21.15.6:0/1619148623 wait complete. 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.465+0000 7f7231e61640 1 Processor -- start 2024-05-20T18:03:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.465+0000 7f7231e61640 1 -- start start 2024-05-20T18:03:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f7231e61640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c09a990 0x7f722c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f7231e61640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f722c0d10d0 0x7f722c162150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f7231e61640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c0d1a20 0x7f722c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f7231e61640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f722c0d0c50 con 0x7f722c0d10d0 2024-05-20T18:03:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f7231e61640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f722c0d0ad0 con 0x7f722c0d1a20 2024-05-20T18:03:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f7231e61640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f722c0cca20 con 0x7f722c09a990 2024-05-20T18:03:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f722affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f722c0d10d0 0x7f722c162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f722affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f722c0d10d0 0x7f722c162150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58774/0 (socket says 172.21.15.6:58774) 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f722affd640 1 -- 172.21.15.6:0/3959786581 learned_addr learned my addr 172.21.15.6:0/3959786581 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f722bfff640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c0d1a20 0x7f722c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.466+0000 7f722b7fe640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c09a990 0x7f722c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f722affd640 1 -- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c09a990 msgr2=0x7f722c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f722affd640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c09a990 0x7f722c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f722affd640 1 -- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c0d1a20 msgr2=0x7f722c1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f722affd640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c0d1a20 0x7f722c1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f722affd640 1 -- 172.21.15.6:0/3959786581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c0b14c0 con 0x7f722c0d10d0 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f722affd640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f722c0d10d0 0x7f722c162150 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f722000e960 tx=0x7f722000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f7213fff640 1 -- 172.21.15.6:0/3959786581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220017070 con 0x7f722c0d10d0 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f7213fff640 1 -- 172.21.15.6:0/3959786581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722000ca00 con 0x7f722c0d10d0 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f7213fff640 1 -- 172.21.15.6:0/3959786581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722000cdd0 con 0x7f722c0d10d0 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c0b17a0 con 0x7f722c0d10d0 2024-05-20T18:03:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.467+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c0b1d60 con 0x7f722c0d10d0 2024-05-20T18:03:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.468+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f722c0b1230 con 0x7f722c0d10d0 2024-05-20T18:03:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.469+0000 7f7213fff640 1 -- 172.21.15.6:0/3959786581 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f722001a070 con 0x7f722c0d10d0 2024-05-20T18:03:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.469+0000 7f7213fff640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f721806be30 0x7f721806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.469+0000 7f7213fff640 1 -- 172.21.15.6:0/3959786581 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f722008aff0 con 0x7f722c0d10d0 2024-05-20T18:03:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.469+0000 7f722b7fe640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f721806be30 0x7f721806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.470+0000 7f722b7fe640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f721806be30 0x7f721806e340 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f721c034000 tx=0x7f721c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.474+0000 7f7213fff640 1 -- 172.21.15.6:0/3959786581 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7220059a80 con 0x7f722c0d10d0 2024-05-20T18:03:20.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.659+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f722c075b00 con 0x7f721806be30 2024-05-20T18:03:20.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.660+0000 7f7213fff640 1 -- 172.21.15.6:0/3959786581 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f722c075b00 con 0x7f721806be30 2024-05-20T18:03:20.657 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f721806be30 msgr2=0x7f721806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f721806be30 0x7f721806e340 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f721c034000 tx=0x7f721c02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f722c0d10d0 msgr2=0x7f722c162150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f722c0d10d0 0x7f722c162150 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f722000e960 tx=0x7f722000ee20 comp rx=0 tx=0).stop 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 shutdown_connections 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f721806be30 0x7f721806e340 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f722c0d1a20 0x7f722c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f722c0d10d0 0x7f722c162150 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 --2- 172.21.15.6:0/3959786581 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f722c09a990 0x7f722c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 >> 172.21.15.6:0/3959786581 conn(0x7f722c0b6660 msgr2=0x7f722c15a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 shutdown_connections 2024-05-20T18:03:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.662+0000 7f7231e61640 1 -- 172.21.15.6:0/3959786581 wait complete. 2024-05-20T18:03:20.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:03:20.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.788+0000 7f74d85c3640 1 Processor -- start 2024-05-20T18:03:20.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.788+0000 7f74d85c3640 1 -- start start 2024-05-20T18:03:20.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.789+0000 7f74d85c3640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f74d00cd1b0 0x7f74d015f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.789+0000 7f74d85c3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74d0070850 0x7f74d0070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.789+0000 7f74d85c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d00711a0 con 0x7f74d0071630 2024-05-20T18:03:20.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d85c3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f74d015f790 con 0x7f74d0070850 2024-05-20T18:03:20.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d85c3640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f74d006e590 con 0x7f74d00cd1b0 2024-05-20T18:03:20.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d6b60640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74d0070850 0x7f74d0070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d6b60640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74d0070850 0x7f74d0070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58790/0 (socket says 172.21.15.6:58790) 2024-05-20T18:03:20.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d6b60640 1 -- 172.21.15.6:0/1650030158 learned_addr learned my addr 172.21.15.6:0/1650030158 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:20.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d5b5e640 1 --2- 172.21.15.6:0/1650030158 >> v2:172.21.15.171:3300/0 conn(0x7f74d00cd1b0 0x7f74d015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d6b60640 1 -- 172.21.15.6:0/1650030158 >> v2:172.21.15.171:3300/0 conn(0x7f74d00cd1b0 msgr2=0x7f74d015f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:20.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d6b60640 1 --2- 172.21.15.6:0/1650030158 >> v2:172.21.15.171:3300/0 conn(0x7f74d00cd1b0 0x7f74d015f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d6b60640 1 -- 172.21.15.6:0/1650030158 >> v1:172.21.15.171:6789/0 conn(0x7f74d0071630 legacy=0x7f74d006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:20.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.790+0000 7f74d6b60640 1 -- 172.21.15.6:0/1650030158 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d00ce2b0 con 0x7f74d0070850 2024-05-20T18:03:20.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.791+0000 7f74d6b60640 1 --2- 172.21.15.6:0/1650030158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0070850 0x7f74d0070c60 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f74d00ccfa0 tx=0x7f74c802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f567f7c9a3dd8a9b server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.791+0000 7f74d535d640 1 -- 172.21.15.6:0/1650030158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c8036070 con 0x7f74d0070850 2024-05-20T18:03:20.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.791+0000 7f74d535d640 1 -- 172.21.15.6:0/1650030158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c8031600 con 0x7f74d0070850 2024-05-20T18:03:20.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.791+0000 7f74d535d640 1 -- 172.21.15.6:0/1650030158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c80319d0 con 0x7f74d0070850 2024-05-20T18:03:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.792+0000 7f74d85c3640 1 -- 172.21.15.6:0/1650030158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0070850 msgr2=0x7f74d0070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.792+0000 7f74d85c3640 1 --2- 172.21.15.6:0/1650030158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0070850 0x7f74d0070c60 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f74d00ccfa0 tx=0x7f74c802a660 comp rx=0 tx=0).stop 2024-05-20T18:03:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.792+0000 7f74d85c3640 1 -- 172.21.15.6:0/1650030158 shutdown_connections 2024-05-20T18:03:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.792+0000 7f74d85c3640 1 --2- 172.21.15.6:0/1650030158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0070850 0x7f74d0070c60 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.792+0000 7f74d85c3640 1 --2- 172.21.15.6:0/1650030158 >> v2:172.21.15.171:3300/0 conn(0x7f74d00cd1b0 0x7f74d015f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.792+0000 7f74d85c3640 1 -- 172.21.15.6:0/1650030158 >> 172.21.15.6:0/1650030158 conn(0x7f74d00d29d0 msgr2=0x7f74d00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.792+0000 7f74d85c3640 1 -- 172.21.15.6:0/1650030158 shutdown_connections 2024-05-20T18:03:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.792+0000 7f74d85c3640 1 -- 172.21.15.6:0/1650030158 wait complete. 2024-05-20T18:03:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.793+0000 7f74d85c3640 1 Processor -- start 2024-05-20T18:03:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.794+0000 7f74d85c3640 1 -- start start 2024-05-20T18:03:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d85c3640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74d0070850 0x7f74d01e99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d85c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0071630 0x7f74d01ea740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d85c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74d00cd1b0 0x7f74d01eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d85c3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f74d006ded0 con 0x7f74d0071630 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d85c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74d006cfc0 con 0x7f74d00cd1b0 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d85c3640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f74d006d2a0 con 0x7f74d0070850 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d5b5e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0071630 0x7f74d01ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d5b5e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0071630 0x7f74d01ea740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58804/0 (socket says 172.21.15.6:58804) 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d5b5e640 1 -- 172.21.15.6:0/883702970 learned_addr learned my addr 172.21.15.6:0/883702970 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d6b60640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74d00cd1b0 0x7f74d01eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d635f640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74d0070850 0x7f74d01e99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d5b5e640 1 -- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74d0070850 msgr2=0x7f74d01e99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d5b5e640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74d0070850 0x7f74d01e99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d5b5e640 1 -- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74d00cd1b0 msgr2=0x7f74d01eac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d5b5e640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74d00cd1b0 0x7f74d01eac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.795+0000 7f74d5b5e640 1 -- 172.21.15.6:0/883702970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d0162820 con 0x7f74d0071630 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.796+0000 7f74d5b5e640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0071630 0x7f74d01ea740 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f74c000c820 tx=0x7f74c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.796+0000 7f74c6ffd640 1 -- 172.21.15.6:0/883702970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0015070 con 0x7f74d0071630 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.796+0000 7f74c6ffd640 1 -- 172.21.15.6:0/883702970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c0004020 con 0x7f74d0071630 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.796+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d01f9520 con 0x7f74d0071630 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.796+0000 7f74c6ffd640 1 -- 172.21.15.6:0/883702970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c00043f0 con 0x7f74d0071630 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.796+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d0160680 con 0x7f74d0071630 2024-05-20T18:03:20.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.797+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d0075b00 con 0x7f74d0071630 2024-05-20T18:03:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.797+0000 7f74c6ffd640 1 -- 172.21.15.6:0/883702970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74c0007830 con 0x7f74d0071630 2024-05-20T18:03:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.798+0000 7f74c6ffd640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74b406be60 0x7f74b406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.798+0000 7f74c6ffd640 1 -- 172.21.15.6:0/883702970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f74c008a9c0 con 0x7f74d0071630 2024-05-20T18:03:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.798+0000 7f74d635f640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74b406be60 0x7f74b406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.799+0000 7f74d635f640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74b406be60 0x7f74b406e370 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f74cc006fd0 tx=0x7f74cc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.803+0000 7f74c6ffd640 1 -- 172.21.15.6:0/883702970 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f74c008ce20 con 0x7f74d0071630 2024-05-20T18:03:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.984+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74d01625b0 con 0x7f74b406be60 2024-05-20T18:03:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.985+0000 7f74c6ffd640 1 -- 172.21.15.6:0/883702970 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13369 (secure 0 0 0) 0x7f74d01625b0 con 0x7f74b406be60 2024-05-20T18:03:20.982 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:03:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74b406be60 msgr2=0x7f74b406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74b406be60 0x7f74b406e370 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f74cc006fd0 tx=0x7f74cc009060 comp rx=0 tx=0).stop 2024-05-20T18:03:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0071630 msgr2=0x7f74d01ea740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0071630 0x7f74d01ea740 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f74c000c820 tx=0x7f74c000cce0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 shutdown_connections 2024-05-20T18:03:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f74b406be60 0x7f74b406e370 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74d00cd1b0 0x7f74d01eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d0071630 0x7f74d01ea740 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 --2- 172.21.15.6:0/883702970 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f74d0070850 0x7f74d01e99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 >> 172.21.15.6:0/883702970 conn(0x7f74d00d29d0 msgr2=0x7f74d015c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 shutdown_connections 2024-05-20T18:03:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:20.987+0000 7f74d85c3640 1 -- 172.21.15.6:0/883702970 wait complete. 2024-05-20T18:03:20.995 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":457,"stamp":"2024-05-20T18:03:20.391827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":273840,"kb_used_data":16072,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700880,"statfs":{"total":773094113280,"available":772813701120,"internally_reserved":0,"allocated":16457728,"data_stored":8255136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.919436"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":411,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-20T18:03:12.499693+0000","last_change":"2024-05-20T17:52:56.431479+0000","last_active":"2024-05-20T18:03:12.499693+0000","last_peered":"2024-05-20T18:03:12.499693+0000","last_clean":"2024-05-20T18:03:12.499693+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:03:12.499693+0000","last_undegraded":"2024-05-20T18:03:12.499693+0000","last_fullsized":"2024-05-20T18:03:12.499693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-20T17:52:54.466325+0000","last_clean_scrub_stamp":"2024-05-20T17:52:54.466325+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-21T20:34:15.222249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33624,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338216,"statfs":{"total":96636764160,"available":96602333184,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:03:20.997 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-20T17:52:54.466325+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=20, tm_hour=17, tm_min=52, tm_sec=54, tm_wday=0, tm_yday=141, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=20, tm_hour=18, tm_min=3, tm_sec=15, tm_wday=0, tm_yday=141, tm_isdst=0) 2024-05-20T18:03:20.997 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-20T18:03:37.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:03:37.552 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:03:40.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-20T18:03:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.133+0000 7f5eca938640 1 Processor -- start 2024-05-20T18:03:41.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.133+0000 7f5eca938640 1 -- start start 2024-05-20T18:03:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.134+0000 7f5eca938640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec40b0020 0x7f5ec415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.134+0000 7f5eca938640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5ec415ca00 0x7f5ec406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.134+0000 7f5eca938640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec40b51c0 con 0x7f5ec40b4c00 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.134+0000 7f5eca938640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec415bf20 con 0x7f5ec415ca00 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.134+0000 7f5eca938640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec415c200 con 0x7f5ec40b0020 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.134+0000 7f5ec8ed5640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ec40b4c00 0x7f5ec40ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51688/0 (socket says 172.21.15.6:51688) 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.134+0000 7f5ec8ed5640 1 -- 172.21.15.6:0/2381732266 learned_addr learned my addr 172.21.15.6:0/2381732266 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.134+0000 7f5ec3fff640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec40b0020 0x7f5ec415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec37fe640 1 --2- 172.21.15.6:0/2381732266 >> v2:172.21.15.171:3300/0 conn(0x7f5ec415ca00 0x7f5ec406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318982147 0 0) 0x7f5ec40b51c0 con 0x7f5ec40b4c00 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eac003520 con 0x7f5ec40b4c00 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2927528800 0 0) 0x7f5eac003520 con 0x7f5ec40b4c00 2024-05-20T18:03:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec40b0020 msgr2=0x7f5ec415fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec40b0020 0x7f5ec415fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 >> v2:172.21.15.171:3300/0 conn(0x7f5ec415ca00 msgr2=0x7f5ec406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 --2- 172.21.15.6:0/2381732266 >> v2:172.21.15.171:3300/0 conn(0x7f5ec415ca00 0x7f5ec406bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec415c4e0 con 0x7f5ec40b4c00 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1182472843 0 0) 0x7f5ebc0019f0 con 0x7f5ec40b4c00 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 >> v1:172.21.15.6:6789/0 conn(0x7f5ec40b4c00 legacy=0x7f5ec40ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac0039b0 0x7f5eac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eac004800 0x7f5eac004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec40b0020 0x7f5eac005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec415bf20 con 0x7f5eac004800 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec415c200 con 0x7f5eac0039b0 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5eac00dc80 con 0x7f5ec40b0020 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec37fe640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eac004800 0x7f5eac004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec8ed5640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec40b0020 0x7f5eac005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.135+0000 7f5ec3fff640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac0039b0 0x7f5eac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.136+0000 7f5ec37fe640 1 -- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec40b0020 msgr2=0x7f5eac005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.136+0000 7f5ec37fe640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec40b0020 0x7f5eac005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.136+0000 7f5ec37fe640 1 -- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac0039b0 msgr2=0x7f5eac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.136+0000 7f5ec37fe640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac0039b0 0x7f5eac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.136+0000 7f5ec37fe640 1 -- 172.21.15.6:0/2381732266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eac003520 con 0x7f5eac004800 2024-05-20T18:03:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.136+0000 7f5ec37fe640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eac004800 0x7f5eac004c10 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009a90 tx=0x7f5eac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdbc7d32eca116d server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.136+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8036070 con 0x7f5eac004800 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb8031400 con 0x7f5eac004800 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5ec2ffd640 1 -- 172.21.15.6:0/2381732266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8009690 con 0x7f5eac004800 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5eca938640 1 -- 172.21.15.6:0/2381732266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eac004800 msgr2=0x7f5eac004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5eca938640 1 --2- 172.21.15.6:0/2381732266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5eac004800 0x7f5eac004c10 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009a90 tx=0x7f5eac005830 comp rx=0 tx=0).stop 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5ec8ed5640 1 -- 172.21.15.6:0/2381732266 reap_dead start 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5eca938640 1 -- 172.21.15.6:0/2381732266 shutdown_connections 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5eca938640 1 -- 172.21.15.6:0/2381732266 >> 172.21.15.6:0/2381732266 conn(0x7f5ec40cd2a0 msgr2=0x7f5ec40cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5eca938640 1 -- 172.21.15.6:0/2381732266 shutdown_connections 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.137+0000 7f5eca938640 1 -- 172.21.15.6:0/2381732266 wait complete. 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.139+0000 7f5eca938640 1 Processor -- start 2024-05-20T18:03:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.140+0000 7f5eca938640 1 -- start start 2024-05-20T18:03:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5eca938640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac004800 0x7f5ec4144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5eca938640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec409a4f0 0x7f5ec415f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5eca938640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec415fb90 0x7f5ec4145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5eca938640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec406c2f0 con 0x7f5ec415fb90 2024-05-20T18:03:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5eca938640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec40b54a0 con 0x7f5eac004800 2024-05-20T18:03:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5eca938640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec406c470 con 0x7f5ec409a4f0 2024-05-20T18:03:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec8ed5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec415fb90 0x7f5ec4145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec8ed5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec415fb90 0x7f5ec4145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33380/0 (socket says 172.21.15.6:33380) 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec8ed5640 1 -- 172.21.15.6:0/3553574496 learned_addr learned my addr 172.21.15.6:0/3553574496 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec37fe640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec409a4f0 0x7f5ec415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec3fff640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac004800 0x7f5ec4144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec8ed5640 1 -- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec409a4f0 msgr2=0x7f5ec415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec8ed5640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec409a4f0 0x7f5ec415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec8ed5640 1 -- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac004800 msgr2=0x7f5ec4144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec8ed5640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac004800 0x7f5ec4144b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.141+0000 7f5ec8ed5640 1 -- 172.21.15.6:0/3553574496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec4145050 con 0x7f5ec415fb90 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.142+0000 7f5ec8ed5640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec415fb90 0x7f5ec4145380 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f5ec406d0b0 tx=0x7f5ebc007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.142+0000 7f5ec0ff9640 1 -- 172.21.15.6:0/3553574496 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00ace0 con 0x7f5ec415fb90 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.142+0000 7f5ec0ff9640 1 -- 172.21.15.6:0/3553574496 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc019070 con 0x7f5ec415fb90 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.142+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec4156a40 con 0x7f5ec415fb90 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.142+0000 7f5ec0ff9640 1 -- 172.21.15.6:0/3553574496 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc013630 con 0x7f5ec415fb90 2024-05-20T18:03:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.142+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec4157000 con 0x7f5ec415fb90 2024-05-20T18:03:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.143+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec4075b00 con 0x7f5ec415fb90 2024-05-20T18:03:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.144+0000 7f5ec0ff9640 1 -- 172.21.15.6:0/3553574496 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ebc0137d0 con 0x7f5ec415fb90 2024-05-20T18:03:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.144+0000 7f5ec0ff9640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5eb006be30 0x7f5eb006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.144+0000 7f5ec0ff9640 1 -- 172.21.15.6:0/3553574496 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f5ebc08b360 con 0x7f5ec415fb90 2024-05-20T18:03:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.144+0000 7f5ec3fff640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5eb006be30 0x7f5eb006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.145+0000 7f5ec3fff640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5eb006be30 0x7f5eb006e340 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400aae0 tx=0x7f5eb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.149+0000 7f5ec0ff9640 1 -- 172.21.15.6:0/3553574496 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5ebc059e80 con 0x7f5ec415fb90 2024-05-20T18:03:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.329+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 --> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ec40676a0 con 0x7f5eb006be30 2024-05-20T18:03:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.330+0000 7f5ec0ff9640 1 -- 172.21.15.6:0/3553574496 <== mgr.4100 v2:172.21.15.171:6832/1002457044 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f5ec40676a0 con 0x7f5eb006be30 2024-05-20T18:03:41.328 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-05-20T18:03:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5eb006be30 msgr2=0x7f5eb006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5eb006be30 0x7f5eb006e340 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400aae0 tx=0x7f5eb4008040 comp rx=0 tx=0).stop 2024-05-20T18:03:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec415fb90 msgr2=0x7f5ec4145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec415fb90 0x7f5ec4145380 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f5ec406d0b0 tx=0x7f5ebc007bd0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 shutdown_connections 2024-05-20T18:03:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f5eb006be30 0x7f5eb006e340 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ec415fb90 0x7f5ec4145380 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ec409a4f0 0x7f5ec415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 --2- 172.21.15.6:0/3553574496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5eac004800 0x7f5ec4144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 >> 172.21.15.6:0/3553574496 conn(0x7f5ec40cd2a0 msgr2=0x7f5ec40b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 shutdown_connections 2024-05-20T18:03:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.332+0000 7f5eca938640 1 -- 172.21.15.6:0/3553574496 wait complete. 2024-05-20T18:03:41.340 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2024-05-20T18:03:40.396181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":273832,"kb_used_data":16072,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700888,"statfs":{"total":773094113280,"available":772813709312,"internally_reserved":0,"allocated":16457728,"data_stored":8255136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002690"},"pg_stats":[{"pgid":"1.0","version":"151'119","reported_seq":422,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-05-20T18:03:21.448382+0000","last_change":"2024-05-20T18:03:21.448421+0000","last_active":"2024-05-20T18:03:21.448382+0000","last_peered":"2024-05-20T18:03:21.448382+0000","last_clean":"2024-05-20T18:03:21.448382+0000","last_became_active":"2024-05-20T17:52:56.430302+0000","last_became_peered":"2024-05-20T17:52:56.430302+0000","last_unstale":"2024-05-20T18:03:21.448382+0000","last_undegraded":"2024-05-20T18:03:21.448382+0000","last_fullsized":"2024-05-20T18:03:21.448382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"151'119","last_scrub_stamp":"2024-05-20T18:03:21.448295+0000","last_deep_scrub":"151'119","last_deep_scrub_stamp":"2024-05-20T18:03:21.448295+0000","last_clean_scrub_stamp":"2024-05-20T18:03:21.448295+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:25:40.785374+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33620,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338220,"statfs":{"total":96636764160,"available":96602337280,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37204,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33048,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33044,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1908736,"data_stored":884300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574980,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33620,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338220,"statfs":{"total":96636764160,"available":96602337280,"internally_reserved":0,"allocated":2502656,"data_stored":1474668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-20T18:03:41.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-20T18:03:41.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.458+0000 7f496203d640 1 Processor -- start 2024-05-20T18:03:41.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.458+0000 7f496203d640 1 -- start start 2024-05-20T18:03:41.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f496203d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f495c0cf250 0x7f495c15f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f496203d640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f495c0b6680 0x7f495c0b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f496203d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f496203d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 -- 0x7f495c15f9a0 con 0x7f495c0cf250 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f496203d640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f495c0d0b10 con 0x7f495c0b6680 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f496203d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f495c0d27d0 con 0x7f495c163020 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f495b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f495c0cf250 0x7f495c15f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f495b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f495c0cf250 0x7f495c15f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33384/0 (socket says 172.21.15.6:33384) 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f495b7fe640 1 -- 172.21.15.6:0/3972979825 learned_addr learned my addr 172.21.15.6:0/3972979825 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f495bfff640 1 --2- 172.21.15.6:0/3972979825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f495affd640 1 --2- 172.21.15.6:0/3972979825 >> v2:172.21.15.171:3300/0 conn(0x7f495c0b6680 0x7f495c0b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.459+0000 7f495b7fe640 1 -- 172.21.15.6:0/3972979825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 msgr2=0x7f495c163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495b7fe640 1 --2- 172.21.15.6:0/3972979825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495b7fe640 1 -- 172.21.15.6:0/3972979825 >> v2:172.21.15.171:3300/0 conn(0x7f495c0b6680 msgr2=0x7f495c0b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:41.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495b7fe640 1 --2- 172.21.15.6:0/3972979825 >> v2:172.21.15.171:3300/0 conn(0x7f495c0b6680 0x7f495c0b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495b7fe640 1 -- 172.21.15.6:0/3972979825 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c0b6fd0 con 0x7f495c0cf250 2024-05-20T18:03:41.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495affd640 1 --2- 172.21.15.6:0/3972979825 >> v2:172.21.15.171:3300/0 conn(0x7f495c0b6680 0x7f495c0b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:41.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495bfff640 1 --2- 172.21.15.6:0/3972979825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495b7fe640 1 --2- 172.21.15.6:0/3972979825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c15f460 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f495c0d4bb0 tx=0x7f494c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39ec9bc8d247b03 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495a7fc640 1 -- 172.21.15.6:0/3972979825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c037070 con 0x7f495c0cf250 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.460+0000 7f495a7fc640 1 -- 172.21.15.6:0/3972979825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c032440 con 0x7f495c0cf250 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f495a7fc640 1 -- 172.21.15.6:0/3972979825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c032810 con 0x7f495c0cf250 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 -- 172.21.15.6:0/3972979825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 msgr2=0x7f495c15f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 --2- 172.21.15.6:0/3972979825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c15f460 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f495c0d4bb0 tx=0x7f494c02a1e0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 -- 172.21.15.6:0/3972979825 shutdown_connections 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 --2- 172.21.15.6:0/3972979825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 --2- 172.21.15.6:0/3972979825 >> v2:172.21.15.171:3300/0 conn(0x7f495c0b6680 0x7f495c0b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 --2- 172.21.15.6:0/3972979825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c15f460 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 -- 172.21.15.6:0/3972979825 >> 172.21.15.6:0/3972979825 conn(0x7f495c0d1860 msgr2=0x7f495c0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 -- 172.21.15.6:0/3972979825 shutdown_connections 2024-05-20T18:03:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.461+0000 7f496203d640 1 -- 172.21.15.6:0/3972979825 wait complete. 2024-05-20T18:03:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.463+0000 7f496203d640 1 Processor -- start 2024-05-20T18:03:41.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.463+0000 7f496203d640 1 -- start start 2024-05-20T18:03:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f496203d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f495c0b6680 0x7f495c157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f496203d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c1f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f496203d640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c1f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f496203d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7f495c0d2a20 con 0x7f495c0cf250 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f496203d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f495c0d0830 con 0x7f495c0b6680 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f496203d640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f495c0d2d00 con 0x7f495c163020 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c1f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c1f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33392/0 (socket says 172.21.15.6:33392) 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 -- 172.21.15.6:0/879205352 learned_addr learned my addr 172.21.15.6:0/879205352 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495bfff640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c1f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495b7fe640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f495c0b6680 0x7f495c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 -- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 msgr2=0x7f495c1f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c1f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 -- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f495c0b6680 msgr2=0x7f495c157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f495c0b6680 0x7f495c157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 -- 172.21.15.6:0/879205352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c161a70 con 0x7f495c0cf250 2024-05-20T18:03:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.465+0000 7f495affd640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c1f5b40 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f495000c820 tx=0x7f495000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.466+0000 7f4943fff640 1 -- 172.21.15.6:0/879205352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950015070 con 0x7f495c0cf250 2024-05-20T18:03:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.466+0000 7f4943fff640 1 -- 172.21.15.6:0/879205352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4950007a30 con 0x7f495c0cf250 2024-05-20T18:03:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.466+0000 7f4943fff640 1 -- 172.21.15.6:0/879205352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950007de0 con 0x7f495c0cf250 2024-05-20T18:03:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.466+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c1609d0 con 0x7f495c0cf250 2024-05-20T18:03:41.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.466+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c160f90 con 0x7f495c0cf250 2024-05-20T18:03:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.467+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c073110 con 0x7f495c0cf250 2024-05-20T18:03:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.467+0000 7f4943fff640 1 -- 172.21.15.6:0/879205352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4950018070 con 0x7f495c0cf250 2024-05-20T18:03:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.468+0000 7f4943fff640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f494806be60 0x7f494806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.468+0000 7f4943fff640 1 -- 172.21.15.6:0/879205352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7f495008ab90 con 0x7f495c0cf250 2024-05-20T18:03:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.468+0000 7f495b7fe640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f494806be60 0x7f494806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.469+0000 7f495b7fe640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f494806be60 0x7f494806e370 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f494c034000 tx=0x7f494c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.472+0000 7f4943fff640 1 -- 172.21.15.6:0/879205352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f495c073110 con 0x7f495c0cf250 2024-05-20T18:03:41.654 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.656+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f495c160760 con 0x7f495c0cf250 2024-05-20T18:03:41.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.660+0000 7f4943fff640 1 -- 172.21.15.6:0/879205352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v68)=0 v68) ==== 123+0+0 (secure 0 0 0) 0x7f4950058fc0 con 0x7f495c0cf250 2024-05-20T18:03:41.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.661+0000 7f4943fff640 1 -- 172.21.15.6:0/879205352 <== mon.0 v2:172.21.15.6:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4950090080 con 0x7f495c0cf250 2024-05-20T18:03:41.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f494806be60 msgr2=0x7f494806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f494806be60 0x7f494806e370 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f494c034000 tx=0x7f494c02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:41.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 msgr2=0x7f495c1f5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c1f5b40 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f495000c820 tx=0x7f495000cce0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 shutdown_connections 2024-05-20T18:03:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7f494806be60 0x7f494806e370 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f495c163020 0x7f495c1f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f495c0cf250 0x7f495c1f5b40 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 --2- 172.21.15.6:0/879205352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f495c0b6680 0x7f495c157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 >> 172.21.15.6:0/879205352 conn(0x7f495c0d1860 msgr2=0x7f495c0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.662+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 shutdown_connections 2024-05-20T18:03:41.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.663+0000 7f496203d640 1 -- 172.21.15.6:0/879205352 wait complete. 2024-05-20T18:03:41.671 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-20T18:03:41.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-20T18:03:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.788+0000 7fe881b85640 1 Processor -- start 2024-05-20T18:03:41.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.788+0000 7fe881b85640 1 -- start start 2024-05-20T18:03:41.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.789+0000 7fe881b85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.789+0000 7fe881b85640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe87c06dae0 0x7fe87c0b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.789+0000 7fe881b85640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0d0630 con 0x7fe87c0b3e80 2024-05-20T18:03:41.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.789+0000 7fe881b85640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c0d39c0 con 0x7fe87c06dae0 2024-05-20T18:03:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.789+0000 7fe881b85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c0d3ca0 con 0x7fe87c162820 2024-05-20T18:03:41.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe87b7fe640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe87bfff640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe87c06dae0 0x7fe87c0b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe873fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fe87c0b3e80 0x7fe87c06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.6:53534/0 (socket says 172.21.15.6:53534) 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe873fff640 1 -- 172.21.15.6:0/982188510 learned_addr learned my addr 172.21.15.6:0/982188510 (peer_addr_for_me v1:172.21.15.6:0/0) 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe87b7fe640 1 -- 172.21.15.6:0/982188510 >> v2:172.21.15.171:3300/0 conn(0x7fe87c06dae0 msgr2=0x7fe87c0b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe87b7fe640 1 --2- 172.21.15.6:0/982188510 >> v2:172.21.15.171:3300/0 conn(0x7fe87c06dae0 0x7fe87c0b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe87b7fe640 1 -- 172.21.15.6:0/982188510 >> v1:172.21.15.171:6789/0 conn(0x7fe87c0b3e80 legacy=0x7fe87c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe87b7fe640 1 -- 172.21.15.6:0/982188510 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0d3f80 con 0x7fe87c162820 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe87affd640 1 -- 172.21.15.6:0/982188510 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2312325711 0 0) 0x7fe87c0d0630 con 0x7fe87c0b3e80 2024-05-20T18:03:41.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.790+0000 7fe87bfff640 1 --2- 172.21.15.6:0/982188510 >> v2:172.21.15.171:3300/0 conn(0x7fe87c06dae0 0x7fe87c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-20T18:03:41.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.791+0000 7fe87b7fe640 1 --2- 172.21.15.6:0/982188510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c0b3940 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0097a0 tx=0x7fe86c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426d2e561246b198 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe87affd640 1 -- 172.21.15.6:0/982188510 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c037070 con 0x7fe87c162820 2024-05-20T18:03:41.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe87affd640 1 -- 172.21.15.6:0/982188510 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe86c032440 con 0x7fe87c162820 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe87affd640 1 -- 172.21.15.6:0/982188510 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c032830 con 0x7fe87c162820 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe881b85640 1 -- 172.21.15.6:0/982188510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 msgr2=0x7fe87c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe881b85640 1 --2- 172.21.15.6:0/982188510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c0b3940 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0097a0 tx=0x7fe86c02a180 comp rx=0 tx=0).stop 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe881b85640 1 -- 172.21.15.6:0/982188510 shutdown_connections 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe881b85640 1 --2- 172.21.15.6:0/982188510 >> v2:172.21.15.171:3300/0 conn(0x7fe87c06dae0 0x7fe87c0b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe881b85640 1 --2- 172.21.15.6:0/982188510 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c0b3940 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe881b85640 1 -- 172.21.15.6:0/982188510 >> 172.21.15.6:0/982188510 conn(0x7fe87c0d4bd0 msgr2=0x7fe87c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe881b85640 1 -- 172.21.15.6:0/982188510 shutdown_connections 2024-05-20T18:03:41.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.792+0000 7fe881b85640 1 -- 172.21.15.6:0/982188510 wait complete. 2024-05-20T18:03:41.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.794+0000 7fe881b85640 1 Processor -- start 2024-05-20T18:03:41.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.794+0000 7fe881b85640 1 -- start start 2024-05-20T18:03:41.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.795+0000 7fe881b85640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe87c0b3e80 0x7fe87c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.795+0000 7fe881b85640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c1f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.795+0000 7fe881b85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c15a3f0 0x7fe87c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.795+0000 7fe881b85640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0d4780 con 0x7fe87c15a3f0 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.795+0000 7fe881b85640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0d0300 con 0x7fe87c0b3e80 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.795+0000 7fe881b85640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c0d4900 con 0x7fe87c162820 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c15a3f0 0x7fe87c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c15a3f0 0x7fe87c15a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33394/0 (socket says 172.21.15.6:33394) 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 -- 172.21.15.6:0/4264338151 learned_addr learned my addr 172.21.15.6:0/4264338151 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87b7fe640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe87c0b3e80 0x7fe87c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe873fff640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c1f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 -- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 msgr2=0x7fe87c1f8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c1f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 -- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe87c0b3e80 msgr2=0x7fe87c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe87c0b3e80 0x7fe87c14ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 -- 172.21.15.6:0/4264338151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c15ad40 con 0x7fe87c15a3f0 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe87bfff640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c15a3f0 0x7fe87c15a800 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fe874009e60 tx=0x7fe87400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe878ff9640 1 -- 172.21.15.6:0/4264338151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874018030 con 0x7fe87c15a3f0 2024-05-20T18:03:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe878ff9640 1 -- 172.21.15.6:0/4264338151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe87400cdf0 con 0x7fe87c15a3f0 2024-05-20T18:03:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c14f170 con 0x7fe87c15a3f0 2024-05-20T18:03:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe878ff9640 1 -- 172.21.15.6:0/4264338151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874003bd0 con 0x7fe87c15a3f0 2024-05-20T18:03:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.796+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c0ca6c0 con 0x7fe87c15a3f0 2024-05-20T18:03:41.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.797+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c075b00 con 0x7fe87c15a3f0 2024-05-20T18:03:41.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.798+0000 7fe878ff9640 1 -- 172.21.15.6:0/4264338151 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe874005d10 con 0x7fe87c15a3f0 2024-05-20T18:03:41.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.799+0000 7fe878ff9640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe85c06be60 0x7fe85c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-20T18:03:41.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.799+0000 7fe878ff9640 1 -- 172.21.15.6:0/4264338151 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5335+0+0 (secure 0 0 0) 0x7fe87408b740 con 0x7fe87c15a3f0 2024-05-20T18:03:41.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.799+0000 7fe87b7fe640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe85c06be60 0x7fe85c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-20T18:03:41.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.799+0000 7fe87b7fe640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe85c06be60 0x7fe85c06e370 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe86c034000 tx=0x7fe86c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-20T18:03:41.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:41.803+0000 7fe878ff9640 1 -- 172.21.15.6:0/4264338151 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe874022070 con 0x7fe87c15a3f0 2024-05-20T18:03:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.024+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe87c15fb40 con 0x7fe87c15a3f0 2024-05-20T18:03:42.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.024+0000 7fe878ff9640 1 -- 172.21.15.6:0/4264338151 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+3871 (secure 0 0 0) 0x7fe87c15ad40 con 0x7fe87c15a3f0 2024-05-20T18:03:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-05-20T18:03:42.022 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":110,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2941924108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2941924108},{"type":"v1","addr":"172.21.15.6:6835","nonce":2941924108}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":7613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/701117749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6835","nonce":701117749},{"type":"v1","addr":"172.21.15.171:6837","nonce":701117749}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":8689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6836/3661458750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3661458750},{"type":"v1","addr":"172.21.15.171:6836","nonce":3661458750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103},{"gid":9957,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1829767918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1829767918},{"type":"v1","addr":"172.21.15.6:6834","nonce":1829767918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[]} 2024-05-20T18:03:42.023 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 110 2024-05-20T18:03:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe85c06be60 msgr2=0x7fe85c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:42.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe85c06be60 0x7fe85c06e370 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe86c034000 tx=0x7fe86c02e000 comp rx=0 tx=0).stop 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c15a3f0 msgr2=0x7fe87c15a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c15a3f0 0x7fe87c15a800 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fe874009e60 tx=0x7fe87400c490 comp rx=0 tx=0).stop 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 shutdown_connections 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:6832/1002457044,v1:172.21.15.171:6833/1002457044] conn(0x7fe85c06be60 0x7fe85c06e370 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe87c15a3f0 0x7fe87c15a800 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe87c162820 0x7fe87c1f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 --2- 172.21.15.6:0/4264338151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe87c0b3e80 0x7fe87c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 >> 172.21.15.6:0/4264338151 conn(0x7fe87c0d4bd0 msgr2=0x7fe87c15e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 shutdown_connections 2024-05-20T18:03:42.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-05-20T18:03:42.026+0000 7fe881b85640 1 -- 172.21.15.6:0/4264338151 wait complete. 2024-05-20T18:03:42.036 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-20T18:03:42.036 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-20T18:03:42.036 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-20T18:03:42.036 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.048 INFO:tasks.ceph.mds.a:Stopped 2024-05-20T18:03:42.049 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-20T18:03:42.049 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.099 INFO:tasks.ceph.mds.c:Stopped 2024-05-20T18:03:42.099 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-20T18:03:42.099 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.111 INFO:tasks.ceph.mds.b:Stopped 2024-05-20T18:03:42.112 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-20T18:03:42.112 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.163 INFO:tasks.ceph.mds.d:Stopped 2024-05-20T18:03:42.163 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-20T18:03:42.164 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-20T18:03:42.164 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.193 INFO:tasks.ceph.osd.0:Stopped 2024-05-20T18:03:42.193 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-20T18:03:42.193 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.260 INFO:tasks.ceph.osd.1:Stopped 2024-05-20T18:03:42.260 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-20T18:03:42.260 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.332 INFO:tasks.ceph.osd.2:Stopped 2024-05-20T18:03:42.333 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-20T18:03:42.333 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.399 INFO:tasks.ceph.osd.3:Stopped 2024-05-20T18:03:42.400 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-20T18:03:42.400 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.436 INFO:tasks.ceph.osd.4:Stopped 2024-05-20T18:03:42.437 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-20T18:03:42.437 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.510 INFO:tasks.ceph.osd.5:Stopped 2024-05-20T18:03:42.512 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-20T18:03:42.512 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.584 INFO:tasks.ceph.osd.6:Stopped 2024-05-20T18:03:42.584 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-20T18:03:42.584 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.659 INFO:tasks.ceph.osd.7:Stopped 2024-05-20T18:03:42.659 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-20T18:03:42.659 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-20T18:03:42.659 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.686 INFO:tasks.ceph.mgr.y:Stopped 2024-05-20T18:03:42.686 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-20T18:03:42.686 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.731 INFO:tasks.ceph.mgr.x:Stopped 2024-05-20T18:03:42.732 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-20T18:03:42.732 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-20T18:03:42.732 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.744 INFO:tasks.ceph.mon.a:Stopped 2024-05-20T18:03:42.744 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-20T18:03:42.744 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.787 INFO:tasks.ceph.mon.b:Stopped 2024-05-20T18:03:42.787 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-20T18:03:42.787 INFO:teuthology.orchestra.run:waiting for 300 2024-05-20T18:03:42.839 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-20T18:03:42.839 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-20T18:03:42.839 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-20T18:03:42.839 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-20T18:03:42.839 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-20T18:03:42.839 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-20T18:03:42.840 INFO:tasks.ceph.mon.c:Stopped 2024-05-20T18:03:42.840 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-20T18:03:42.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'responding to mclientcaps\(revoke\)' | egrep -v 'not advance its oldest_client_tid' | egrep -v 'failing to advance its oldest client/flush tid' | egrep -v 'Too many inodes in cache' | egrep -v 'failing to respond to cache pressure' | egrep -v 'slow requests are blocked' | egrep -v 'failing to respond to capability release' | egrep -v 'MDS cache is too large' | egrep -v '\(MDS_CLIENT_OLDEST_TID\)' | egrep -v '\(MDS_CACHE_OVERSIZED\)' | head -n 1 2024-05-20T18:03:42.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:03:42.877 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-20T18:03:43.115 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:03:43.116 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-20T18:03:43.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:03:43.257 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-20T18:03:43.313 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:03:43.313 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-20T18:03:43.364 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:03:43.364 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-20T18:03:43.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:03:43.571 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-20T18:03:43.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:03:43.686 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-20T18:03:43.741 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:03:43.741 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-20T18:03:43.791 INFO:tasks.ceph:Archiving mon data... 2024-05-20T18:03:43.793 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/data/mon.a.tgz 2024-05-20T18:03:43.793 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-05-20T18:03:43.811 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.D6zgTChYkt 2024-05-20T18:03:43.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.D6zgTChYkt 2024-05-20T18:03:43.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.D6zgTChYkt 2024-05-20T18:03:44.064 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.D6zgTChYkt is 456KB 2024-05-20T18:03:44.164 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.D6zgTChYkt 2024-05-20T18:03:44.179 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/data/mon.b.tgz 2024-05-20T18:03:44.179 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-05-20T18:03:44.200 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.fcTWBSVKam 2024-05-20T18:03:44.200 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fcTWBSVKam 2024-05-20T18:03:44.362 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.fcTWBSVKam 2024-05-20T18:03:44.447 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.fcTWBSVKam is 470KB 2024-05-20T18:03:44.547 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.fcTWBSVKam 2024-05-20T18:03:44.562 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/data/mon.c.tgz 2024-05-20T18:03:44.563 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-05-20T18:03:44.617 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.XEsE1rpQ5j 2024-05-20T18:03:44.617 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.XEsE1rpQ5j 2024-05-20T18:03:44.768 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.XEsE1rpQ5j 2024-05-20T18:03:44.852 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.XEsE1rpQ5j is 470KB 2024-05-20T18:03:44.951 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.XEsE1rpQ5j 2024-05-20T18:03:44.966 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-20T18:03:44.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-20T18:03:44.969 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-20T18:03:45.052 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-20T18:03:45.089 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-20T18:03:45.121 INFO:tasks.ceph:Archiving crash dumps... 2024-05-20T18:03:45.135 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/remote/smithi006/crash 2024-05-20T18:03:45.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-20T18:03:45.206 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/remote/smithi171/crash 2024-05-20T18:03:45.213 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-20T18:03:45.247 INFO:tasks.ceph:Shutting down logrotate 2024-05-20T18:03:45.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:03:45.266 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-20T18:03:45.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-20T18:03:45.375 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-20T18:03:45.400 INFO:tasks.ceph:Compressing logs... 2024-05-20T18:03:45.400 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T18:03:45.425 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58660.log 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79136.log 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66655.log 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57504.log 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58660.log.gz 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.66655.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44536.log 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79136.log.gz 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57504.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66655.log.gz 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72726.log 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57504.log.gz 2024-05-20T18:03:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2024-05-20T18:03:45.453 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44536.log.gz 2024-05-20T18:03:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52004.log 2024-05-20T18:03:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72726.log: /var/log/ceph/ceph-client.admin.46964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66300.log 2024-05-20T18:03:45.508 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37403.log 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47457.log 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37403.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.47457.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37403.log.gz 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37312.log 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47457.log.gz 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48929.log 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37312.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37312.log.gz 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.48929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48929.log.gz 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-20T18:03:45.509 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48449.log 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.48449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37483.log 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48449.log.gz 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37443.log 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37483.log.gz 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37563.log 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37443.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37443.log.gz 2024-05-20T18:03:45.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37563.log: gzip -5 --verbose -- 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37563.log.gz 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr: /var/log/ceph/ceph-mon.c.log 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.49408.log 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43952.log 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.49408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.49408.log.gz 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.43952.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.1.47937.log 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph-client.1.43952.log.gz 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46867.log 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.47937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47937.log.gz 2024-05-20T18:03:45.511 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45430.log 2024-05-20T18:03:45.512 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.46867.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.1.46867.log.gz 2024-05-20T18:03:45.512 INFO:teuthology.orchestra.run.smithi171.stderr: -5 --verbose -- /var/log/ceph/ceph-client.1.44933.log 2024-05-20T18:03:45.512 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46388.log 2024-05-20T18:03:45.512 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.44933.log: /var/log/ceph/ceph-client.1.45430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45430.log.gz 2024-05-20T18:03:45.512 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44933.log.gz 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45909.log 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.46388.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44350.log 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph-client.1.46388.log.gz 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.45909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37523.log 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.3.44350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45909.log.gz 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44350.log.gz 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37352.log 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37523.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37523.log.gz 2024-05-20T18:03:45.513 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37352.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37352.log.gz 2024-05-20T18:03:45.514 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-20T18:03:45.514 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37272.log 2024-05-20T18:03:45.514 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-20T18:03:45.514 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37272.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37272.log.gz 2024-05-20T18:03:45.642 INFO:teuthology.orchestra.run.smithi171.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-20T18:03:45.791 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2024-05-20T18:03:45.791 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84437.log 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52004.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.72726.log.gz 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52004.log.gz 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68685.log 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84437.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66300.log.gz 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84437.log.gz 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.48830.log 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68685.log.gz 2024-05-20T18:03:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47207.log/var/log/ceph/ceph-client.admin.45306.log: 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.48830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80326.log 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.48830.log.gz 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65691.log 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47207.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47207.log.gz 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74332.log 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67027.log 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80326.log.gz 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65691.log.gz 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64585.log 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74332.log.gz 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59343.log 2024-05-20T18:03:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81919.log 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67027.log.gz 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64503.log 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64585.log.gz 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59343.log.gz 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57084.log 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64503.log: gzip -5 --verbose 89.3% -- /var/log/ceph/ceph-client.admin.65232.log -- replaced with /var/log/ceph/ceph-client.admin.81919.log.gz 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64503.log.gz 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.57084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52809.log 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57084.log.gz 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83285.log 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65232.log.gz 2024-05-20T18:03:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79489.log 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81110.log 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52809.log.gz 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72980.log 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.83285.log.gz 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79489.log.gz 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63535.log 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.72980.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81110.log.gz 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82087.log 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72980.log.gz 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63619.log 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63535.log.gz 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82213.log 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.82087.log.gz 2024-05-20T18:03:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79615.log 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63619.log: /var/log/ceph/ceph-client.admin.82213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76137.log 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63619.log.gz 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47446.log 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.82213.log.gz 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79615.log.gz 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60395.log 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47446.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76137.log.gz 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69184.log 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47446.log.gz 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63021.log 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60395.log.gz 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58253.log 2024-05-20T18:03:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63063.log 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69184.log.gz 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83159.log 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63021.log.gz 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58253.log.gz 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66613.log 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71155.log 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63063.log.gz 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83159.log.gz 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57772.log 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66613.log.gz 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63931.log 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71155.log: /var/log/ceph/ceph-client.admin.57772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59385.log 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71155.log.gz 2024-05-20T18:03:45.797 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57772.log.gz 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67638.log 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63931.log.gz 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.59385.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72134.log 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80707.log 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59385.log.gz 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67638.log.gz 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50056.log 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72134.log.gz 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.80707.log: -- /var/log/ceph/ceph-client.admin.75065.log 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62651.log 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80707.log.gz 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50056.log.gz 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79443.log 2024-05-20T18:03:45.798 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75065.log.gz 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81420.log 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79443.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62651.log.gz 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71468.log 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79443.log.gz 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62342.log 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81420.log.gz 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64076.log 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62342.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71468.log.gz 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62150.log 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64076.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62342.log.gz 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59511.log 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64076.log.gz 2024-05-20T18:03:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80200.log 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62150.log.gz 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75233.log 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59511.log.gz 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44344.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80200.log.gz 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55007.log 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gz 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76614.log 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75233.log: /var/log/ceph/ceph-client.admin.55007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73269.log 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75233.log.gz 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76614.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.55007.log.gz 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63225.log 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76614.log.gz 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61982.log 2024-05-20T18:03:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63225.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73269.log.gz 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61144.log 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63225.log.gz 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60831.log 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61982.log.gz 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73643.log 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61144.log: /var/log/ceph/ceph-client.admin.60831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63703.log 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61144.log.gz 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60831.log.gz/var/log/ceph/ceph-client.admin.73643.log: 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50665.log 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73643.log.gz 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54697.log 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50665.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63703.log.gz 2024-05-20T18:03:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70389.log 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50665.log.gz 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78525.log 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54697.log.gz 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.70389.log: -- /var/log/ceph/ceph-client.admin.73311.log 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77016.log 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70389.log.gz 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3%/var/log/ceph/ceph-client.admin.73311.log: -- replaced with /var/log/ceph/ceph-client.admin.78525.log.gz 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69792.log 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73311.log.gz 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75532.log 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69792.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77016.log.gz 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66571.log 2024-05-20T18:03:45.802 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69792.log.gz 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61586.log 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75532.log.gz 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64034.log 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68908.log 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66571.log.gz 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61586.log.gz 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67350.log 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64034.log.gz 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66216.log 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67350.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68908.log.gz 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58108.log 2024-05-20T18:03:45.803 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67350.log.gz 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46961.log 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66216.log.gz 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58108.log.gz 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74290.log 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46961.log: /var/log/ceph/ceph-client.admin.43499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83881.log 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74290.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz --verbose 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.78357.log 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74290.log.gz 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56704.log 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78357.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83881.log.gz 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78357.log.gz 2024-05-20T18:03:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52206.log 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44428.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56704.log.gz 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65817.log 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52206.log.gz 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60747.log 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72600.log 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65817.log.gz/var/log/ceph/ceph-client.admin.60747.log: 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55530.log 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60747.log.gz 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73601.log 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72600.log.gz 2024-05-20T18:03:45.805 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47362.log 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76740.log 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55530.log.gz 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47362.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73601.log.gz 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85549.log 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47362.log.gz 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44386.log 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56536.log 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76740.log.gz 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73685.log 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85549.log.gz 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44386.log.gz 2024-05-20T18:03:45.806 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60065.log 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56536.log.gz 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82003.log 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60065.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.73685.log.gz 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54965.log 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82003.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60065.log.gz 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81236.log 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.82003.log.gz 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56896.log 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81236.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54965.log.gz 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61060.log 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81236.log.gz 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46114.log 2024-05-20T18:03:45.807 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.56896.log.gz/var/log/ceph/ceph-client.admin.61060.log: -- 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.85297.log 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75788.log 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61060.log.gz 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85297.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46114.log.gz 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77918.log 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75788.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85297.log.gz 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76782.log 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77918.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75788.log.gz 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69268.log 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77918.log.gz 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50335.log 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76782.log.gz 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2024-05-20T18:03:45.808 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50335.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69268.log.gz 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79741.log 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51817.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50335.log.gz 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51313.log 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61544.log 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79741.log: /var/log/ceph/ceph-client.admin.51313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84581.log 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79741.log.gz 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81690.log 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51313.log.gz 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84581.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61544.log.gz 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85843.log 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81690.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84581.log.gz 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-20T18:03:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85843.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81690.log.gz 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85255.log 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85843.log.gz 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45862.log 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72348.log 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85255.log.gz 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59078.log 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45862.log.gz 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84353.log 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59078.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72348.log.gz 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52334.log 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84353.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59078.log.gz 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50965.log 2024-05-20T18:03:45.810 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84353.log.gz 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49384.log 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50965.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.52334.log.gz -- 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.72558.log 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50965.log.gz 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55217.log 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49384.log.gz 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83117.log 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55217.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72558.log.gz 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69495.log 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55217.log.gz 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56452.log 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83117.log.gz 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56746.log 2024-05-20T18:03:45.811 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69495.log.gz 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71911.log 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56746.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56452.log.gz 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57342.log 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56746.log.gz 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55175.log 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71911.log.gz 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73227.log 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81504.log 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57342.log.gz 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73227.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55175.log.gz 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81877.log 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81504.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73227.log.gzgzip 2024-05-20T18:03:45.812 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69900.log 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.81504.log.gz 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65382.log 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81877.log.gz 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67111.log 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69900.log.gz 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47866.log 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67111.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65382.log.gz 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52716.log 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67111.log.gz 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77566.log 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52716.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47866.log.gz 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84269.log 2024-05-20T18:03:45.813 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77566.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.52716.log.gz -5 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83201.log 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77566.log.gz 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81774.log 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83201.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84269.log.gz 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55362.log 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81774.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.62802.log 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83201.log.gz 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81774.log.gz 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78315.log 2024-05-20T18:03:45.814 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55362.log.gz 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73059.log 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46619.log 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62802.log.gz 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78315.log.gz 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66174.log 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73059.log.gz 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66174.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.47698.log -- replaced with /var/log/ceph/ceph-client.admin.46619.log.gz 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66174.log.gz 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37693.log 2024-05-20T18:03:45.815 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61801.log 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37693.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47698.log.gz 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49006.log 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37693.log.gz 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66072.log 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61801.log.gz 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64328.log 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49006.log.gz 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80284.log 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64328.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66072.log.gz 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49594.log 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82766.log 2024-05-20T18:03:45.816 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64328.log.gz 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80284.log.gz 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65316.log 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49594.log.gz 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84726.log 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65274.log 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82766.log.gz 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71827.log 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65274.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84726.log.gz 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.65316.log.gz 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71197.log 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65274.log.gz 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71827.log: /var/log/ceph/ceph-client.admin.71197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84227.log 2024-05-20T18:03:45.817 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71827.log.gz 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80242.log 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71197.log.gz 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76908.log 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84227.log.gz 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84810.log 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54283.log 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80242.log.gz 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76908.log: /var/log/ceph/ceph-client.admin.84810.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76908.log.gz 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55320.log 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84810.log.gz 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77205.log 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54283.log: /var/log/ceph/ceph-client.admin.55320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77650.log 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54283.log.gz 2024-05-20T18:03:45.818 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55320.log.gz 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69624.log 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77205.log.gz 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63309.log 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77650.log: /var/log/ceph/ceph-client.admin.69624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52851.log 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77650.log.gz 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69624.log.gz/var/log/ceph/ceph-client.admin.63309.log: 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63992.log 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63309.log.gz 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49468.log 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65775.log 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52851.log.gz 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63992.log: /var/log/ceph/ceph-client.admin.49468.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63992.log.gz 2024-05-20T18:03:45.819 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68600.log 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49468.log.gz 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75191.log 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65775.log.gz 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58463.log 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75191.log: gzip -5 89.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.68600.log.gz 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.70305.log 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75191.log.gz 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82129.log 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58463.log.gz 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84001.log 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82129.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70305.log.gz 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78002.log 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82129.log.gz 2024-05-20T18:03:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70819.log 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84001.log.gz 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84539.log 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83351.log 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78002.log.gz 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70819.log.gz 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49342.log 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84539.log.gz 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59171.log 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62979.log 88.4% 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83351.log.gz 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49342.log.gz 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64244.log 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59171.log.gz 2024-05-20T18:03:45.821 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49720.log 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64244.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62979.log.gz 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56057.log 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64244.log.gz 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55572.log 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49720.log.gz 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66009.log 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55572.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56057.log.gz 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75881.log 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55572.log.gz 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67392.log 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66009.log.gz 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74981.log 2024-05-20T18:03:45.822 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67392.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75881.log.gz 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80158.log 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67392.log.gz 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74981.log.gz 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53233.log 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45616.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80158.log.gz 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85885.log 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78441.log 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53233.log.gz 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79220.log 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78441.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85885.log.gz 2024-05-20T18:03:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85633.log 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78441.log.gz 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70167.log 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79220.log.gz 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5/var/log/ceph/ceph-client.admin.85633.log: --verbose -- /var/log/ceph/ceph-client.admin.73539.log 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59213.log 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.85633.log.gz 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70167.log.gz 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79264.log 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73539.log.gz 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46966.log 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57630.log 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59213.log.gz 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79264.log.gz 2024-05-20T18:03:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68474.log 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46966.log.gz 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56662.log 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57630.log: /var/log/ceph/ceph-client.admin.68474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46967.log 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57630.log.gz 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68474.log.gz 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64797.log 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56662.log.gz 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82945.log 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46967.log: /var/log/ceph/ceph-client.admin.64797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55656.log 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46967.log.gz 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64797.log.gz 2024-05-20T18:03:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82255.log 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.82945.log.gz 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46072.log 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55656.log: /var/log/ceph/ceph-client.admin.82255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59427.log 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55656.log.gz 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82255.log.gz 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71342.log 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46072.log.gz 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77121.log 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59427.log: /var/log/ceph/ceph-client.admin.71342.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59427.log.gz 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71342.log.gz 2024-05-20T18:03:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56830.log 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77121.log.gz 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79573.log 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57672.log 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50881.log 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.56830.log.gz 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79573.log.gz 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.57672.log: -- /var/log/ceph/ceph-client.admin.50707.log 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50881.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57672.log.gz 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70509.log 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50881.log.gz 2024-05-20T18:03:45.827 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76866.log 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50707.log: /var/log/ceph/ceph-client.admin.70509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51649.log 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50707.log.gz 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76866.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.72039.log 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70509.log.gz 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76866.log.gz 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67153.log 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51649.log.gz 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76656.log 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72039.log: /var/log/ceph/ceph-client.admin.67153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58821.log 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72039.log.gz 2024-05-20T18:03:45.828 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76656.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67153.log.gz 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82810.log 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.76656.log.gz /var/log/ceph/ceph-client.admin.52502.log 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58821.log: /var/log/ceph/ceph-client.admin.82810.log: gzip -5 89.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.58821.log.gz -- 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.69449.log 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.82810.log.gz 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49678.log 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52502.log: /var/log/ceph/ceph-client.admin.69449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77792.log 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49678.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69449.log.gz 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54164.log 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49678.log.gz 2024-05-20T18:03:45.829 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78735.log 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77792.log.gz 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84085.log 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54164.log: /var/log/ceph/ceph-client.admin.78735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54755.log 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78735.log.gz 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43803.log 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54164.log.gz 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52290.log 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54755.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84085.log.gz 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43803.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54755.log.gz 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68242.log 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43803.log.gz 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67596.log 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52290.log: /var/log/ceph/ceph-client.admin.68242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44951.log 2024-05-20T18:03:45.830 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52290.log.gz 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68242.log.gz 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77834.log 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61270.log 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67596.log.gz 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44951.log: /var/log/ceph/ceph-client.admin.77834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78044.log 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77834.log.gz 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51007.log 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78044.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31308.log 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61270.log.gz 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78044.log.gz 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85675.log 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.31308.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51007.log.gz 2024-05-20T18:03:45.831 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31308.log.gz 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- 92.6% /var/log/ceph/ceph-client.admin.72218.log 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62066.log 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85675.log: /var/log/ceph/ceph-client.admin.72218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58990.log 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85675.log.gz 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72218.log.gz 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61894.log 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55404.log 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62066.log.gz 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58990.log: /var/log/ceph/ceph-client.admin.61894.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58990.log.gz 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74752.log 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61894.log.gz 2024-05-20T18:03:45.832 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56494.log 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55404.log: /var/log/ceph/ceph-client.admin.74752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71869.log 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55404.log.gz 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74752.log.gz 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48391.log 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71869.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56494.log.gz 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46294.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71869.log.gz 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76824.log 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2024-05-20T18:03:45.833 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.48391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48391.log.gz 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57982.log 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76824.log.gz 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81068.log 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78399.log 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57982.log.gz 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46285.log 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81068.log: /var/log/ceph/ceph-client.admin.78399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43418.log 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81068.log.gz 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78399.log.gz 2024-05-20T18:03:45.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52248.log 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66258.log 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46285.log.gz 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43418.log.gz 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52460.log 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66258.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56099.log 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52248.log.gz 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66258.log.gz 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79699.log 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56099.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52460.log.gzgzip 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.76329.log 2024-05-20T18:03:45.835 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56099.log.gz 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43887.log 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76329.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79699.log.gz 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73818.log 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76329.log.gz 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84623.log 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84497.log 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43887.log.gz 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84623.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73818.log.gz 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58150.log 2024-05-20T18:03:45.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84497.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84623.log.gz 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76095.log 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50923.log 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84497.log.gz 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58150.log.gz 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74542.log 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50923.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76095.log.gz 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67990.log 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50923.log.gz 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82680.log 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74542.log.gz 2024-05-20T18:03:45.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59301.log 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75923.log 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67990.log.gz 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82680.log: /var/log/ceph/ceph-client.admin.59301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65148.log 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82680.log.gz 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59301.log.gz 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82045.log 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65148.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77446.log 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75923.log.gz 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65148.log.gz 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78777.log 2024-05-20T18:03:45.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77446.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.82045.log.gz 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65733.log 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77446.log.gz 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.78777.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64892.log 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65733.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 87.4% 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78777.log.gz 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65733.log.gz 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76053.log 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.1.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64892.log.gz 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77079.log 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.y.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76053.log.gz 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85045.log 2024-05-20T18:03:45.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58024.log 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.77079.log.gz/var/log/ceph/ceph-client.admin.85045.log: 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74710.log 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.85045.log.gz 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79783.log 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58024.log: /var/log/ceph/ceph-client.admin.74710.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58024.log.gz 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74710.log.gz 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47404.log 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64934.log 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46292.log 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.79783.log.gz 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47404.log.gz 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57940.log 2024-05-20T18:03:45.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57588.log 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64934.log.gz 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57940.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46292.log.gz 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57940.log.gz 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50839.log 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63105.log 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57588.log.gz 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72083.log 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50839.log.gz 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45222.log 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85507.log 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72083.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63105.log.gz 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45222.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72083.log.gz 2024-05-20T18:03:45.841 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45222.log.gz 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54040.log 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46958.log 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9%/var/log/ceph/ceph-client.admin.54040.log: -- replaced with /var/log/ceph/ceph-client.admin.85507.log.gz 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49426.log 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54040.log.gz 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77734.log 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46958.log: /var/log/ceph/ceph-client.admin.49426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78609.log 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77734.log: 88.0% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46958.log.gz 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49426.log.gz 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77734.log.gz 2024-05-20T18:03:45.842 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70593.log 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57426.log 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70593.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78609.log.gz 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52586.log 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70593.log.gz 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57426.log.gz 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60495.log 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.52586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75744.log 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3%/var/log/ceph/ceph-client.admin.60495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54923.log 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52586.log.gz 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75744.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60495.log.gz 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63577.log 2024-05-20T18:03:45.843 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75744.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75574.log 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54923.log: /var/log/ceph/ceph-client.admin.63577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54613.log 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75574.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54923.log.gz 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63577.log.gz 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75574.log.gz 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.60023.log 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64669.log 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54613.log.gz 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52046.log 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60023.log: /var/log/ceph/ceph-client.admin.64669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65570.log 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52046.log: 88.5% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64669.log.gz 2024-05-20T18:03:45.844 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60023.log.gz 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70903.log 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52046.log.gz 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.65570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56578.log 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65570.log.gz 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70903.log: /var/log/ceph/ceph-client.admin.56578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83959.log 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47319.log: 88.8% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56578.log.gz 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70903.log.gz 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68158.log 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46296.log 2024-05-20T18:03:45.845 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83959.log.gz 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76535.log 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68158.log.gz 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64202.log 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7%/var/log/ceph/ceph-client.0.76535.log: -- replaced with /var/log/ceph/ceph-client.admin.46296.log.gz 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76535.log.gz 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64202.log: gzip -5 88.8% --verbose -- /var/log/ceph/ceph-client.admin.81564.log 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64202.log.gz 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67680.log 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.81564.log: /var/log/ceph/ceph-client.admin.70551.log 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2024-05-20T18:03:45.846 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81564.log.gz 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70987.log 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67680.log.gz 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47908.log 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2%/var/log/ceph/ceph-client.admin.70987.log: -- replaced with /var/log/ceph/ceph-client.admin.70551.log.gz 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60453.log 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70987.log.gz 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82722.log 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82861.log 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60453.log: /var/log/ceph/ceph-client.admin.82722.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47908.log.gz 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60453.log.gz 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57814.log 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82722.log.gz 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.82861.log: -- /var/log/ceph/ceph-client.admin.79094.log 2024-05-20T18:03:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57814.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82861.log.gz 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51229.log 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57814.log.gz 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85759.log 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79094.log: gzip/var/log/ceph/ceph-client.admin.51229.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71745.log 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85759.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51229.log.gz 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79094.log.gz 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85759.log.gz 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73185.log 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48526.log 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71745.log.gz 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45138.log 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73185.log.gz 2024-05-20T18:03:45.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53710.log 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48526.log.gz 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78254.log 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45138.log: /var/log/ceph/ceph-client.admin.53710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85213.log 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78254.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45138.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53710.log.gz 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78254.log.gz 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72792.log 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81294.log 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85213.log.gz 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70635.log 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72792.log.gz 2024-05-20T18:03:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49888.log 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51049.log 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8%/var/log/ceph/ceph-client.admin.70635.log: -- replaced with /var/log/ceph/ceph-client.admin.81294.log.gz 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49888.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70635.log.gz 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49888.log.gz 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79178.log 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57163.log 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79178.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51049.log.gz 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44086.log 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79178.log.gz 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85087.log 2024-05-20T18:03:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57163.log: /var/log/ceph/ceph-client.admin.44086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55488.log 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85087.log: 89.1% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57163.log.gz 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44086.log.gz 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85087.log.gz 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76698.log 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.55488.log: -- /var/log/ceph/ceph-client.admin.62864.log 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76698.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55488.log.gz 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51859.log 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76698.log.gz 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60149.log 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62864.log: /var/log/ceph/ceph-client.admin.51859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57730.log 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62864.log.gz 2024-05-20T18:03:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60149.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51859.log.gz 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49216.log 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57730.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54571.log 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60149.log.gz 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57730.log.gz 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.49216.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71426.log 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54571.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49216.log.gz 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68558.log 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54571.log.gz 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85717.log 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78872.log 88.6% 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71426.log.gz 2024-05-20T18:03:45.852 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68558.log.gz 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85717.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85717.log.gz 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64286.log 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59034.log 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78872.log.gz 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53752.log 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64286.log.gz 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76011.log 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6%/var/log/ceph/ceph-client.admin.53752.log: -- replaced with /var/log/ceph/ceph-client.admin.59034.log.gz 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80906.log 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53752.log.gz 2024-05-20T18:03:45.853 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58192.log 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76011.log: /var/log/ceph/ceph-client.admin.80906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75370.log 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58192.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.76011.log.gz 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80906.log.gz 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58192.log.gz 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84043.log 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53425.log 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84043.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75370.log.gz 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59619.log 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84043.log.gz/var/log/ceph/ceph-client.admin.53425.log: 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60621.log 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53425.log.gz 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76263.log 2024-05-20T18:03:45.854 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59619.log.gzgzip 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50251.log 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60621.log: /var/log/ceph/ceph-client.admin.76263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55049.log 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50251.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60621.log.gz 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50251.log.gz 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.76263.log.gz 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85591.log 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64118.log 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55049.log.gz 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62276.log 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85591.log.gz 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64627.log 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74668.log 2024-05-20T18:03:45.855 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64118.log.gz/var/log/ceph/ceph-client.admin.62276.log: 2024-05-20T18:03:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2024-05-20T18:03:45.859 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64627.log.gz 2024-05-20T18:03:45.859 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74668.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.62276.log.gz 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55930.log 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74668.log.gz 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69100.log 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9%/var/log/ceph/ceph-client.admin.55930.log: -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58740.log 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55930.log.gz 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60705.log 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69100.log: /var/log/ceph/ceph-client.admin.58740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51481.log 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60705.log: 88.2% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58740.log.gz 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69100.log.gz 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60705.log.gz 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56788.log 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.51481.log: /var/log/ceph/ceph-client.admin.81835.log 2024-05-20T18:03:45.860 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56788.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72684.log 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51481.log.gz 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56788.log.gz 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81835.log: /var/log/ceph/ceph-client.admin.72684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63267.log 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81835.log.gz 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72684.log.gz 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44132.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68812.log 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82595.log 2024-05-20T18:03:45.861 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63267.log.gz 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81648.log 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68812.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66943.log 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82595.log: /var/log/ceph/ceph-client.admin.81648.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66943.log: 89.0% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81648.log.gz 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82595.log.gz 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69407.log 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66943.log.gz 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81378.log 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51187.log 2024-05-20T18:03:45.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69407.log: /var/log/ceph/ceph-client.admin.81378.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69407.log.gz 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81378.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83755.log 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51187.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51187.log.gz 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68728.log 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57898.log 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83755.log: /var/log/ceph/ceph-client.admin.68728.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83755.log.gz 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68728.log.gzgzip 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51397.log 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57898.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57898.log.gz 2024-05-20T18:03:45.863 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58295.log 2024-05-20T18:03:45.864 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50419.log 2024-05-20T18:03:45.864 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51397.log: /var/log/ceph/ceph-client.admin.58295.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51397.log.gz 2024-05-20T18:03:45.864 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58295.log.gz 2024-05-20T18:03:45.864 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67255.log 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53191.log 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50419.log: /var/log/ceph/ceph-client.admin.67255.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50419.log.gz 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60269.log 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67255.log.gz 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53191.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53191.log.gz 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71300.log 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80116.log 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60269.log: /var/log/ceph/ceph-client.admin.71300.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60269.log.gz 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71300.log.gz 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83075.log 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80116.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80116.log.gz 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37326.log 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50581.log 2024-05-20T18:03:45.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83075.log: /var/log/ceph/ceph-client.admin.37326.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83075.log.gz 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37326.log.gz 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47530.log 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85339.log 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50581.log: /var/log/ceph/ceph-client.admin.47530.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50581.log.gz 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47530.log.gz 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46030.log 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77362.log 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46030.log: /var/log/ceph/ceph-client.admin.85339.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.85339.log.gz 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46030.log.gz 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72642.log 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66132.log 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77362.log: /var/log/ceph/ceph-client.admin.72642.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77362.log.gz 2024-05-20T18:03:45.866 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72642.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66841.log 2024-05-20T18:03:45.867 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.867 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54529.log 2024-05-20T18:03:45.868 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66132.log: /var/log/ceph/ceph-client.admin.66841.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66132.log.gz 2024-05-20T18:03:45.868 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 89.4% -5 --verbose -- /var/log/ceph/ceph-client.0.70088.log 2024-05-20T18:03:45.868 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66841.log.gz 2024-05-20T18:03:45.868 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63661.log 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54529.log: /var/log/ceph/ceph-client.0.70088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70088.log.gz 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54529.log.gz 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58905.log 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55831.log 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63661.log.gz 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58905.log.gz 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59129.log 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70777.log 2024-05-20T18:03:45.869 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55831.log.gz 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53317.log 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70777.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59129.log.gz 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70777.log.gzgzip 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50539.log 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80948.log 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50539.log: /var/log/ceph/ceph-client.admin.53317.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53317.log.gz 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50539.log.gz 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60579.log 2024-05-20T18:03:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68116.log 2024-05-20T18:03:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80948.log: /var/log/ceph/ceph-client.admin.60579.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80948.log.gz 2024-05-20T18:03:45.871 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60579.log.gz 2024-05-20T18:03:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77163.log 2024-05-20T18:03:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67764.log 2024-05-20T18:03:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77163.log: /var/log/ceph/ceph-client.admin.68116.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68116.log.gz 2024-05-20T18:03:45.871 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77163.log.gz 2024-05-20T18:03:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74148.log 2024-05-20T18:03:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74855.log 2024-05-20T18:03:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67764.log: /var/log/ceph/ceph-client.admin.74148.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67764.log.gz 2024-05-20T18:03:45.872 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74148.log.gz 2024-05-20T18:03:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65859.log 2024-05-20T18:03:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66529.log 2024-05-20T18:03:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74855.log: /var/log/ceph/ceph-client.admin.65859.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74855.log.gz 2024-05-20T18:03:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61671.log 2024-05-20T18:03:45.873 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65859.log.gz 2024-05-20T18:03:45.873 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2024-05-20T18:03:45.873 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61671.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66529.log.gz 2024-05-20T18:03:45.873 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61671.log.gz 2024-05-20T18:03:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85381.log 2024-05-20T18:03:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77960.log 2024-05-20T18:03:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46291.log: /var/log/ceph/ceph-client.admin.85381.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-05-20T18:03:45.874 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85381.log.gz 2024-05-20T18:03:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72432.log 2024-05-20T18:03:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56187.log 2024-05-20T18:03:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72432.log: /var/log/ceph/ceph-client.admin.77960.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77960.log.gz 2024-05-20T18:03:45.875 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72432.log.gz 2024-05-20T18:03:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46628.log 2024-05-20T18:03:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56187.log: /var/log/ceph/ceph-client.admin.77692.log 2024-05-20T18:03:45.875 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56187.log.gz 2024-05-20T18:03:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46628.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46628.log.gz 2024-05-20T18:03:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57856.log 2024-05-20T18:03:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81961.log 2024-05-20T18:03:45.876 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77692.log.gz 2024-05-20T18:03:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69666.log 2024-05-20T18:03:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81961.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57856.log.gz 2024-05-20T18:03:45.876 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81961.log.gz 2024-05-20T18:03:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78212.log 2024-05-20T18:03:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61936.log 2024-05-20T18:03:45.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69666.log: /var/log/ceph/ceph-client.admin.78212.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69666.log.gz 2024-05-20T18:03:45.877 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61186.log 2024-05-20T18:03:45.877 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78212.log.gz 2024-05-20T18:03:45.877 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68200.log 2024-05-20T18:03:45.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61936.log: /var/log/ceph/ceph-client.admin.61186.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61936.log.gz 2024-05-20T18:03:45.877 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61186.log.gz 2024-05-20T18:03:45.877 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46828.log 2024-05-20T18:03:45.878 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60915.log 2024-05-20T18:03:45.878 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68200.log: /var/log/ceph/ceph-client.admin.46828.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68200.log.gz 2024-05-20T18:03:45.878 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46828.log.gz 2024-05-20T18:03:45.878 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82297.log 2024-05-20T18:03:45.878 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51901.log 2024-05-20T18:03:45.879 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60915.log: /var/log/ceph/ceph-client.admin.82297.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60915.log.gz 2024-05-20T18:03:45.879 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.82297.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.51145.log 2024-05-20T18:03:45.879 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.879 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71665.log 2024-05-20T18:03:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51145.log: /var/log/ceph/ceph-client.admin.51901.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51901.log.gz 2024-05-20T18:03:45.880 INFO:teuthology.orchestra.run.smithi006.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51145.log.gz 2024-05-20T18:03:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73461.log 2024-05-20T18:03:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83713.log 2024-05-20T18:03:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71665.log: /var/log/ceph/ceph-client.admin.73461.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71665.log.gz 2024-05-20T18:03:45.880 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73461.log.gz 2024-05-20T18:03:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49972.log 2024-05-20T18:03:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81336.log 2024-05-20T18:03:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83713.log: /var/log/ceph/ceph-client.admin.49972.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83713.log.gz 2024-05-20T18:03:45.881 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49972.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55278.log 2024-05-20T18:03:45.881 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78170.log 2024-05-20T18:03:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55278.log: /var/log/ceph/ceph-client.admin.81336.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81336.log.gz 2024-05-20T18:03:45.882 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55278.log.gz 2024-05-20T18:03:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78567.log 2024-05-20T18:03:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74813.log 2024-05-20T18:03:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78170.log: /var/log/ceph/ceph-client.admin.78567.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78170.log.gz 2024-05-20T18:03:45.882 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53023.log 2024-05-20T18:03:45.882 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78567.log.gz 2024-05-20T18:03:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45820.log 2024-05-20T18:03:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74813.log: /var/log/ceph/ceph-client.admin.53023.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74813.log.gz 2024-05-20T18:03:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82991.log 2024-05-20T18:03:45.883 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53023.log.gz 2024-05-20T18:03:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75839.log 2024-05-20T18:03:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82991.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45820.log.gz 2024-05-20T18:03:45.883 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82991.log.gz 2024-05-20T18:03:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63451.log 2024-05-20T18:03:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73101.log 2024-05-20T18:03:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75839.log: /var/log/ceph/ceph-client.admin.63451.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75839.log.gz 2024-05-20T18:03:45.884 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63451.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67822.log 2024-05-20T18:03:45.884 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52418.log 2024-05-20T18:03:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73101.log: /var/log/ceph/ceph-client.admin.67822.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73101.log.gz 2024-05-20T18:03:45.884 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77488.log 2024-05-20T18:03:45.885 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67822.log.gz 2024-05-20T18:03:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2024-05-20T18:03:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52418.log: /var/log/ceph/ceph-client.admin.77488.log: 88.7% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52418.log.gz 2024-05-20T18:03:45.885 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77488.log.gz 2024-05-20T18:03:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43718.log 2024-05-20T18:03:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85129.log 2024-05-20T18:03:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45946.log: /var/log/ceph/ceph-client.admin.43718.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2024-05-20T18:03:45.886 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43718.log.gz 2024-05-20T18:03:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68642.log 2024-05-20T18:03:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70347.log 2024-05-20T18:03:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85129.log: /var/log/ceph/ceph-client.admin.68642.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.85129.log.gz 2024-05-20T18:03:45.886 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68642.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79849.log 2024-05-20T18:03:45.886 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2024-05-20T18:03:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79849.log: /var/log/ceph/ceph-client.admin.70347.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70347.log.gz 2024-05-20T18:03:45.887 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79849.log.gz 2024-05-20T18:03:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70263.log 2024-05-20T18:03:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63147.log 2024-05-20T18:03:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44176.log: /var/log/ceph/ceph-client.admin.70263.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2024-05-20T18:03:45.887 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70263.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59553.log 2024-05-20T18:03:45.887 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53794.log 2024-05-20T18:03:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63147.log: /var/log/ceph/ceph-client.admin.59553.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63147.log.gz 2024-05-20T18:03:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2024-05-20T18:03:45.888 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59553.log.gz/var/log/ceph/ceph-client.admin.53794.log: 2024-05-20T18:03:45.888 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69058.log 2024-05-20T18:03:45.888 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53794.log.gz/var/log/ceph/ceph-client.admin.44218.log: 2024-05-20T18:03:45.888 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69356.log 2024-05-20T18:03:45.889 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2024-05-20T18:03:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62234.log 2024-05-20T18:03:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69058.log: /var/log/ceph/ceph-client.admin.69356.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69058.log.gz 2024-05-20T18:03:45.889 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69356.log.gz 2024-05-20T18:03:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62609.log 2024-05-20T18:03:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50749.log/var/log/ceph/ceph-client.admin.62234.log: 2024-05-20T18:03:45.889 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62234.log.gz 2024-05-20T18:03:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61713.log 2024-05-20T18:03:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50749.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62609.log.gz 2024-05-20T18:03:45.890 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50749.log.gz 2024-05-20T18:03:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58505.log 2024-05-20T18:03:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72474.log 2024-05-20T18:03:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61713.log: /var/log/ceph/ceph-client.admin.58505.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61713.log.gz 2024-05-20T18:03:45.890 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58505.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54409.log 2024-05-20T18:03:45.891 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72176.log 2024-05-20T18:03:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54409.log: /var/log/ceph/ceph-client.admin.72474.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72474.log.gz 2024-05-20T18:03:45.891 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54409.log.gz 2024-05-20T18:03:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54797.log 2024-05-20T18:03:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78483.log 2024-05-20T18:03:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72176.log: /var/log/ceph/ceph-client.admin.54797.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72176.log.gz 2024-05-20T18:03:45.892 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54797.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47572.log 2024-05-20T18:03:45.892 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47824.log 2024-05-20T18:03:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78483.log: /var/log/ceph/ceph-client.admin.47572.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78483.log.gz 2024-05-20T18:03:45.892 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68390.log 2024-05-20T18:03:45.892 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47572.log.gz 2024-05-20T18:03:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52981.log 2024-05-20T18:03:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47824.log: /var/log/ceph/ceph-client.admin.68390.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47824.log.gz 2024-05-20T18:03:45.893 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68390.log.gz 2024-05-20T18:03:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61628.log 2024-05-20T18:03:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57546.log 2024-05-20T18:03:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52981.log: /var/log/ceph/ceph-client.admin.61628.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52981.log.gz 2024-05-20T18:03:45.893 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61628.log.gz 2024-05-20T18:03:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74500.log 2024-05-20T18:03:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51439.log 2024-05-20T18:03:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57546.log: /var/log/ceph/ceph-client.admin.74500.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57546.log.gz 2024-05-20T18:03:45.894 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46968.log 2024-05-20T18:03:45.894 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74500.log.gz 2024-05-20T18:03:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50623.log 2024-05-20T18:03:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51439.log: /var/log/ceph/ceph-client.admin.46968.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51439.log.gz 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46968.log.gz 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66487.log 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78086.log 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50623.log: /var/log/ceph/ceph-client.admin.66487.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50623.log.gz 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66487.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67722.log 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46632.log 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78086.log: /var/log/ceph/ceph-client.admin.67722.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78086.log.gz 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67722.log.gz 2024-05-20T18:03:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72390.log 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66883.log 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72390.log: /var/log/ceph/ceph-client.admin.46632.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46632.log.gz 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72390.log.gz 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65901.log 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59469.log 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66883.log: /var/log/ceph/ceph-client.admin.65901.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66883.log.gz 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65901.log.gz 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46286.log 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80368.log 2024-05-20T18:03:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46286.log: /var/log/ceph/ceph-client.admin.59469.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59469.log.gz 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46286.log.gz 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46963.log 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.80368.log: -- /var/log/ceph/ceph-client.admin.74939.log 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80368.log.gz/var/log/ceph/ceph-client.admin.46963.log: 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75969.log 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46963.log.gz 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62530.log 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74939.log.gz 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82392.log 2024-05-20T18:03:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.62530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62530.log.gz 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75969.log.gz 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67213.log 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49048.log 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82392.log.gz 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49174.log 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49048.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67213.log.gz 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49048.log.gz 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67864.log 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72306.log 2024-05-20T18:03:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49174.log: /var/log/ceph/ceph-client.admin.67864.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49174.log.gz 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67864.log.gz 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66343.log 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52672.log 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66343.log: /var/log/ceph/ceph-client.admin.72306.log: 88.4% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66343.log.gz 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72306.log.gz 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52126.log 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75149.log 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52672.log: /var/log/ceph/ceph-client.admin.52126.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52672.log.gz 2024-05-20T18:03:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79401.log 2024-05-20T18:03:45.900 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52126.log.gz/var/log/ceph/ceph-client.admin.75149.log: 2024-05-20T18:03:45.900 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71029.log 2024-05-20T18:03:45.900 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75149.log.gz 2024-05-20T18:03:45.900 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81462.log 2024-05-20T18:03:45.900 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79401.log: /var/log/ceph/ceph-client.admin.71029.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79401.log.gz 2024-05-20T18:03:45.900 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71029.log.gz 2024-05-20T18:03:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74897.log 2024-05-20T18:03:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.81462.log: /var/log/ceph/ceph-client.admin.49258.log 2024-05-20T18:03:45.901 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81462.log.gz 2024-05-20T18:03:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2024-05-20T18:03:45.901 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74897.log.gz 2024-05-20T18:03:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49258.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49258.log.gz 2024-05-20T18:03:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68770.log 2024-05-20T18:03:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83539.log 2024-05-20T18:03:45.902 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2024-05-20T18:03:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51355.log 2024-05-20T18:03:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.83539.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68770.log.gz 2024-05-20T18:03:45.902 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.83539.log.gz 2024-05-20T18:03:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52544.log 2024-05-20T18:03:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52939.log 2024-05-20T18:03:45.903 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51355.log.gz 2024-05-20T18:03:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80410.log 2024-05-20T18:03:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52939.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52544.log.gz 2024-05-20T18:03:45.903 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52939.log.gz 2024-05-20T18:03:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75275.log 2024-05-20T18:03:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.80410.log: -- /var/log/ceph/ceph-client.admin.78693.log 2024-05-20T18:03:45.903 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5%/var/log/ceph/ceph-client.admin.75275.log: -- replaced with /var/log/ceph/ceph-client.admin.80410.log.gz 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49090.log 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78693.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75275.log.gz 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78693.log.gz 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48072.log 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83033.log 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49090.log: /var/log/ceph/ceph-client.admin.48072.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48072.log.gz 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49090.log.gz 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66715.log 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.83033.log: /var/log/ceph/ceph-client.admin.78651.log 2024-05-20T18:03:45.904 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.83033.log.gz 2024-05-20T18:03:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69312.log 2024-05-20T18:03:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78651.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66715.log.gz 2024-05-20T18:03:45.905 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78651.log.gz 2024-05-20T18:03:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69582.log 2024-05-20T18:03:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45532.log 2024-05-20T18:03:45.905 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69312.log.gz 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69582.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69582.log.gz 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54451.log 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73143.log 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45532.log.gz 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74458.log 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73143.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54451.log.gz 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73143.log.gz 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60353.log 2024-05-20T18:03:45.906 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71113.log 2024-05-20T18:03:45.907 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74458.log: /var/log/ceph/ceph-client.admin.60353.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74458.log.gz 2024-05-20T18:03:45.907 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51523.log 2024-05-20T18:03:45.907 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60353.log.gz 2024-05-20T18:03:45.907 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84311.log 2024-05-20T18:03:45.907 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51523.log: 89.2% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51523.log.gz 2024-05-20T18:03:45.907 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71113.log.gz 2024-05-20T18:03:45.907 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58379.log 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61018.log 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84311.log: /var/log/ceph/ceph-client.admin.58379.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84311.log.gz 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55751.log 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58379.log.gz 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52767.log 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61018.log.gz 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55751.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55751.log.gz 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71953.log 2024-05-20T18:03:45.908 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56322.log 2024-05-20T18:03:45.909 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52767.log: /var/log/ceph/ceph-client.admin.71953.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52767.log.gz 2024-05-20T18:03:45.909 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71953.log.gzgzip 2024-05-20T18:03:45.909 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56620.log 2024-05-20T18:03:45.909 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77876.log 2024-05-20T18:03:45.909 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56620.log: /var/log/ceph/ceph-client.admin.56322.log: 88.1% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56322.log.gz 2024-05-20T18:03:45.909 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56620.log.gz 2024-05-20T18:03:45.909 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59807.log 2024-05-20T18:03:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50377.log 2024-05-20T18:03:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77876.log: /var/log/ceph/ceph-client.0.59807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59807.log.gz 2024-05-20T18:03:45.910 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77876.log.gz 2024-05-20T18:03:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60976.log 2024-05-20T18:03:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50461.log 2024-05-20T18:03:45.910 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50377.log.gz 2024-05-20T18:03:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58337.log 2024-05-20T18:03:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50461.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60976.log.gz 2024-05-20T18:03:45.911 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50461.log.gz 2024-05-20T18:03:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51775.log 2024-05-20T18:03:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61445.log 2024-05-20T18:03:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58337.log: /var/log/ceph/ceph-client.admin.51775.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58337.log.gz 2024-05-20T18:03:45.911 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51775.log.gz 2024-05-20T18:03:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60789.log 2024-05-20T18:03:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71510.log 2024-05-20T18:03:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60789.log: /var/log/ceph/ceph-client.admin.61445.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61445.log.gz 2024-05-20T18:03:45.912 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60789.log.gz 2024-05-20T18:03:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64976.log 2024-05-20T18:03:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56238.log 2024-05-20T18:03:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71510.log: /var/log/ceph/ceph-client.admin.64976.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71510.log.gz 2024-05-20T18:03:45.912 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64976.log.gz 2024-05-20T18:03:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52628.log 2024-05-20T18:03:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55446.log 2024-05-20T18:03:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56238.log: /var/log/ceph/ceph-client.admin.52628.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56238.log.gz 2024-05-20T18:03:45.913 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52628.log.gz 2024-05-20T18:03:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51691.log 2024-05-20T18:03:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69142.log 2024-05-20T18:03:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55446.log: /var/log/ceph/ceph-client.admin.51691.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51691.log.gz 2024-05-20T18:03:45.914 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55446.log.gz 2024-05-20T18:03:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51271.log 2024-05-20T18:03:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85801.log 2024-05-20T18:03:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69142.log: /var/log/ceph/ceph-client.admin.51271.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69142.log.gz 2024-05-20T18:03:45.914 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51271.log.gz 2024-05-20T18:03:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77320.log 2024-05-20T18:03:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78128.log 2024-05-20T18:03:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85801.log: /var/log/ceph/ceph-client.admin.77320.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85801.log.gz 2024-05-20T18:03:45.915 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77320.log.gz 2024-05-20T18:03:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60311.log 2024-05-20T18:03:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79052.log 2024-05-20T18:03:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60311.log: /var/log/ceph/ceph-client.admin.78128.log: 87.5% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60311.log.gz 2024-05-20T18:03:45.916 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78128.log.gz 2024-05-20T18:03:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81152.log 2024-05-20T18:03:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51733.log 2024-05-20T18:03:45.916 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79052.log.gz 2024-05-20T18:03:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73944.log 2024-05-20T18:03:45.917 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81152.log.gz 2024-05-20T18:03:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65106.log 2024-05-20T18:03:45.918 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51733.log.gz 2024-05-20T18:03:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64160.log 2024-05-20T18:03:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65106.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73944.log.gz 2024-05-20T18:03:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79359.log 2024-05-20T18:03:45.919 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65106.log.gz 2024-05-20T18:03:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74584.log 2024-05-20T18:03:45.919 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64160.log.gz/var/log/ceph/ceph-client.admin.79359.log: 2024-05-20T18:03:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45988.log 2024-05-20T18:03:45.920 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79359.log.gz 2024-05-20T18:03:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74584.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74584.log.gz 2024-05-20T18:03:45.920 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75658.log 2024-05-20T18:03:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67906.log 2024-05-20T18:03:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45988.log: /var/log/ceph/ceph-client.admin.75658.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45988.log.gz 2024-05-20T18:03:45.920 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70431.log 2024-05-20T18:03:45.920 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75658.log.gz 2024-05-20T18:03:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67906.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67906.log.gz 2024-05-20T18:03:45.921 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60663.log 2024-05-20T18:03:45.921 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50293.log 2024-05-20T18:03:45.921 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70431.log: /var/log/ceph/ceph-client.admin.60663.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70431.log.gz 2024-05-20T18:03:45.921 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85423.log 2024-05-20T18:03:45.921 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60663.log.gz/var/log/ceph/ceph-client.admin.50293.log: 2024-05-20T18:03:45.921 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77404.log 2024-05-20T18:03:45.921 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50293.log.gz 2024-05-20T18:03:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58565.log 2024-05-20T18:03:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85423.log: /var/log/ceph/ceph-client.admin.77404.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85423.log.gz 2024-05-20T18:03:45.922 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77404.log.gz 2024-05-20T18:03:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2024-05-20T18:03:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63493.log 2024-05-20T18:03:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43845.log: /var/log/ceph/ceph-client.admin.58565.log: 89.4% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz -- replaced with /var/log/ceph/ceph-client.admin.58565.log.gz 2024-05-20T18:03:45.922 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61852.log 2024-05-20T18:03:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74190.log 2024-05-20T18:03:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63493.log: /var/log/ceph/ceph-client.admin.61852.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63493.log.gz 2024-05-20T18:03:45.923 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61852.log.gz 2024-05-20T18:03:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73986.log 2024-05-20T18:03:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84395.log 2024-05-20T18:03:45.923 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74190.log.gz 2024-05-20T18:03:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58863.log 2024-05-20T18:03:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84395.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73986.log.gz 2024-05-20T18:03:45.924 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84395.log.gz 2024-05-20T18:03:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76179.log 2024-05-20T18:03:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66799.log 2024-05-20T18:03:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58863.log: /var/log/ceph/ceph-client.admin.76179.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58863.log.gz 2024-05-20T18:03:45.924 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76179.log.gz 2024-05-20T18:03:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2024-05-20T18:03:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47740.log 2024-05-20T18:03:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66799.log: /var/log/ceph/ceph-client.admin.43761.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66799.log.gz 2024-05-20T18:03:45.925 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2024-05-20T18:03:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63393.log 2024-05-20T18:03:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47164.log 2024-05-20T18:03:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47740.log: /var/log/ceph/ceph-client.admin.63393.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47740.log.gz 2024-05-20T18:03:45.925 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.63393.log.gz 2024-05-20T18:03:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58066.log 2024-05-20T18:03:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55091.log 2024-05-20T18:03:45.926 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47164.log: /var/log/ceph/ceph-client.admin.58066.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47164.log.gz 2024-05-20T18:03:45.926 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58066.log.gz 2024-05-20T18:03:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79531.log 2024-05-20T18:03:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58948.log 2024-05-20T18:03:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55091.log: /var/log/ceph/ceph-client.admin.79531.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55091.log.gz 2024-05-20T18:03:45.927 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79531.log.gz 2024-05-20T18:03:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45778.log 2024-05-20T18:03:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51607.log 2024-05-20T18:03:45.927 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45778.log: /var/log/ceph/ceph-client.admin.58948.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45778.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58948.log.gz 2024-05-20T18:03:45.928 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53107.log 2024-05-20T18:03:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78952.log 2024-05-20T18:03:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51607.log: /var/log/ceph/ceph-client.admin.53107.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51607.log.gz 2024-05-20T18:03:45.928 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53107.log.gz 2024-05-20T18:03:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48964.log 2024-05-20T18:03:45.928 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82171.log 2024-05-20T18:03:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.78952.log: /var/log/ceph/ceph-client.admin.48964.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78952.log.gz 2024-05-20T18:03:45.929 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48964.log.gz 2024-05-20T18:03:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68432.log 2024-05-20T18:03:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65190.log 2024-05-20T18:03:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68432.log: /var/log/ceph/ceph-client.admin.82171.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82171.log.gz 2024-05-20T18:03:45.929 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68432.log.gz 2024-05-20T18:03:45.929 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54325.log 2024-05-20T18:03:45.930 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61102.log 2024-05-20T18:03:45.930 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65190.log: /var/log/ceph/ceph-client.admin.54325.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65190.log.gz 2024-05-20T18:03:45.930 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86039.log 2024-05-20T18:03:45.930 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54325.log.gz 2024-05-20T18:03:45.930 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59259.log 2024-05-20T18:03:45.930 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61102.log: /var/log/ceph/ceph-client.admin.86039.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61102.log.gz 2024-05-20T18:03:45.930 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86039.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47656.log 2024-05-20T18:03:45.931 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:45.932 INFO:teuthology.orchestra.run.smithi171.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-20T18:03:45.947 INFO:teuthology.orchestra.run.smithi171.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-20T18:03:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63351.log 2024-05-20T18:03:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59259.log: /var/log/ceph/ceph-client.admin.47656.log: 88.3% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47656.log.gz 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59259.log.gz 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55972.log 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59886.log 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63351.log.gz 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80822.log 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55972.log.gz/var/log/ceph/ceph-client.admin.59886.log: 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49846.log 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59886.log.gz 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55614.log 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80822.log: /var/log/ceph/ceph-client.admin.49846.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80822.log.gz 2024-05-20T18:03:46.035 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49846.log.gz 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62024.log 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.55614.log: /var/log/ceph/ceph-client.admin.49300.log 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55614.log.gz 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52376.log 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49300.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62024.log.gz 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49300.log.gz 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80864.log 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51962.log 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52376.log: /var/log/ceph/ceph-client.admin.80864.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52376.log.gz 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80864.log.gz 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50098.log 2024-05-20T18:03:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79308.log 2024-05-20T18:03:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51962.log: /var/log/ceph/ceph-client.admin.50098.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51962.log.gz 2024-05-20T18:03:46.037 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50098.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84665.log 2024-05-20T18:03:46.037 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59981.log 2024-05-20T18:03:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79308.log: /var/log/ceph/ceph-client.admin.84665.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84665.log.gz 2024-05-20T18:03:46.037 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79308.log.gz 2024-05-20T18:03:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81606.log 2024-05-20T18:03:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53275.log 2024-05-20T18:03:46.038 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59981.log.gz 2024-05-20T18:03:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69538.log 2024-05-20T18:03:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53275.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81606.log.gz 2024-05-20T18:03:46.038 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53275.log.gz 2024-05-20T18:03:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62108.log 2024-05-20T18:03:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54102.log 2024-05-20T18:03:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69538.log: /var/log/ceph/ceph-client.admin.62108.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69538.log.gz 2024-05-20T18:03:46.038 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62108.log.gzgzip 2024-05-20T18:03:46.039 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45264.log 2024-05-20T18:03:46.039 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83797.log 2024-05-20T18:03:46.039 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54102.log: /var/log/ceph/ceph-client.admin.45264.log: 87.4% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54102.log.gz 2024-05-20T18:03:46.039 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45264.log.gz 2024-05-20T18:03:46.039 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69708.log 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45490.log 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83797.log: /var/log/ceph/ceph-client.admin.69708.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83797.log.gz 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69708.log.gz 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64711.log 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83618.log 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45490.log: /var/log/ceph/ceph-client.admin.64711.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45490.log.gz 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64711.log.gz 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63871.log 2024-05-20T18:03:46.040 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62693.log 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83618.log: /var/log/ceph/ceph-client.admin.63871.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83618.log.gz 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63871.log.gz 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47782.log 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56014.log 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47782.log: /var/log/ceph/ceph-client.admin.62693.log: 87.8% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62693.log.gz 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47782.log.gz 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61228.log 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56014.log: /var/log/ceph/ceph-client.admin.61228.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56014.log.gz 2024-05-20T18:03:46.041 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61228.log.gzgzip 2024-05-20T18:03:46.042 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50140.log 2024-05-20T18:03:46.042 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37590.log 2024-05-20T18:03:46.042 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46625.log: /var/log/ceph/ceph-client.admin.50140.log: 88.3% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50140.log.gz 2024-05-20T18:03:46.042 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2024-05-20T18:03:46.042 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70735.log 2024-05-20T18:03:46.042 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47488.log 2024-05-20T18:03:46.042 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37590.log.gz 2024-05-20T18:03:46.042 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74626.log 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47488.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70735.log.gz 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47488.log.gz 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69750.log 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80665.log 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69750.log: /var/log/ceph/ceph-client.admin.74626.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74626.log.gz 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69750.log.gz 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66985.log 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75023.log 2024-05-20T18:03:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80665.log: /var/log/ceph/ceph-client.admin.66985.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80665.log.gz 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66985.log.gz 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68348.log 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75023.log: /var/log/ceph/ceph-client.admin.45180.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75023.log.gz 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57258.log 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75450.log 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57258.log: /var/log/ceph/ceph-client.admin.68348.log: 87.6% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57258.log.gz -- replaced with /var/log/ceph/ceph-client.admin.68348.log.gz 2024-05-20T18:03:46.044 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85997.log 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66757.log 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75450.log: /var/log/ceph/ceph-client.admin.85997.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75450.log.gz 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.85997.log.gz 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49762.log 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45904.log 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66757.log: /var/log/ceph/ceph-client.admin.49762.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66757.log.gz 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49762.log.gz 2024-05-20T18:03:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65649.log 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75700.log 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45904.log: /var/log/ceph/ceph-client.admin.65649.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45904.log.gz 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65649.log.gz 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72516.log 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72516.log: /var/log/ceph/ceph-client.admin.75700.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75700.log.gz 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72516.log.gz 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63745.log 2024-05-20T18:03:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74416.log 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.63745.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63745.log.gz 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60107.log 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74416.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74416.log.gz 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67476.log 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60107.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60107.log.gz 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57300.log 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67476.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67476.log.gz 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60537.log 2024-05-20T18:03:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57300.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57300.log.gz 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56143.log 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60537.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60537.log.gz 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54839.log 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56143.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56143.log.gz 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60227.log 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54839.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54839.log.gz 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68032.log 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60227.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60227.log.gz 2024-05-20T18:03:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64753.log 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68032.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68032.log.gz 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73860.log 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64753.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64753.log.gz 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83839.log 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73860.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73860.log.gz 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70945.log 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83839.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83839.log.gz 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68516.log 2024-05-20T18:03:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70945.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70945.log.gz 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65022.log 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68516.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68516.log.gz 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43676.log 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65022.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65022.log.gz 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84852.log 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43676.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43676.log.gz 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67948.log 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84852.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84852.log.gz 2024-05-20T18:03:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80623.log 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67948.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67948.log.gz 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75616.log 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80623.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80623.log.gz 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83243.log 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75616.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75616.log.gz 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45406.log 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.83243.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83243.log.gz 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49132.log 2024-05-20T18:03:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45406.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45406.log.gz 2024-05-20T18:03:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43595.log 2024-05-20T18:03:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49132.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49132.log.gz 2024-05-20T18:03:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74232.log 2024-05-20T18:03:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43595.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43595.log.gz 2024-05-20T18:03:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80990.log 2024-05-20T18:03:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74232.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74232.log.gz 2024-05-20T18:03:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46631.log 2024-05-20T18:03:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80990.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.80990.log.gz 2024-05-20T18:03:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46630.log 2024-05-20T18:03:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46631.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46631.log.gz 2024-05-20T18:03:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45348.log 2024-05-20T18:03:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46630.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46630.log.gz 2024-05-20T18:03:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58421.log 2024-05-20T18:03:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45348.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45348.log.gz 2024-05-20T18:03:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79657.log 2024-05-20T18:03:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58421.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58421.log.gz 2024-05-20T18:03:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49930.log 2024-05-20T18:03:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.79657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79657.log.gz 2024-05-20T18:03:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2024-05-20T18:03:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49930.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49930.log.gz 2024-05-20T18:03:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62192.log 2024-05-20T18:03:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45694.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84768.log 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62192.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62192.log.gz 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56368.log 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84768.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84768.log.gz 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46622.log 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56368.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56368.log.gz 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82472.log 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46622.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46622.log.gz 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73353.log 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82472.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82472.log.gz 2024-05-20T18:03:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67518.log 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73353.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73353.log.gz 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69226.log 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67518.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67518.log.gz 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80037.log 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69226.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69226.log.gz 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57384.log 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.80037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80037.log.gz 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77608.log 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57384.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57384.log.gz 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64841.log 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.77608.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77608.log.gz 2024-05-20T18:03:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85957.log 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64841.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64841.log.gz 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70861.log 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85957.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.85957.log.gz 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71995.log 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70861.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70861.log.gz 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82637.log 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71995.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71995.log.gz 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50014.log 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82637.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82637.log.gz 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81194.log 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50014.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50014.log.gz 2024-05-20T18:03:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49510.log 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81194.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81194.log.gz 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44470.log 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49510.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49510.log.gz 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67069.log 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44470.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44470.log.gz 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55133.log 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67069.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67069.log.gz 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53149.log 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55133.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55133.log.gz 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80518.log 2024-05-20T18:03:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53149.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53149.log.gz 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56280.log 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80518.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80518.log.gz 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49804.log 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56280.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56280.log.gz 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66445.log 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49804.log.gz 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82903.log 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66445.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66445.log.gz 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81732.log 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82903.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.82903.log.gz 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56410.log 2024-05-20T18:03:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.81732.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81732.log.gz 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74064.log 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56410.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56410.log.gz 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73902.log 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74064.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74064.log.gz 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64423.log 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.73902.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73902.log.gz 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64423.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64423.log.gz 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65064.log 2024-05-20T18:03:46.060 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47614.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69834.log 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65064.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65064.log.gz 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44260.log 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.69834.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69834.log.gz 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60873.log 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44260.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44260.log.gz 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71570.log 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60873.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60873.log.gz 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61757.log 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71570.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71570.log.gz 2024-05-20T18:03:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63829.log 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61757.log.gz 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46626.log 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63829.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63829.log.gz 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54655.log 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46626.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46626.log.gz 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44035.log 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54655.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54655.log.gz 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49636.log 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44035.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44035.log.gz 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68285.log 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49636.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49636.log.gz 2024-05-20T18:03:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52897.log 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68285.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68285.log.gz 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85171.log 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52897.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52897.log.gz 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71384.log 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85171.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.85171.log.gz 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75107.log 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71384.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71384.log.gz 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84127.log 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.75107.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75107.log.gz 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49552.log 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84127.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84127.log.gz 2024-05-20T18:03:46.064 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61365.log 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49552.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49552.log.gz 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45448.log 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61365.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61365.log.gz 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84185.log 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45448.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45448.log.gz 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82553.log 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.84185.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84185.log.gz 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74374.log 2024-05-20T18:03:46.065 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.82553.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82553.log.gz 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71071.log 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74374.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74374.log.gz 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70677.log 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71071.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71071.log.gz 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66385.log 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.70677.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70677.log.gz 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68074.log 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66385.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66385.log.gz 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53631.log 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68074.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68074.log.gz 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53065.log 2024-05-20T18:03:46.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.53631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53631.log.gz 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51565.log 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53065.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53065.log.gz 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67434.log 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51565.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51565.log.gz 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45736.log 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67434.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67434.log.gz 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72264.log 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45736.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45736.log.gz 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80581.log 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.72264.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72264.log.gz 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2024-05-20T18:03:46.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.80581.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80581.log.gz 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43929.log 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44302.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54367.log 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43929.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43929.log.gz 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47275.log 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54367.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54367.log.gz 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54881.log 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47275.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47275.log.gz 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74106.log 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54881.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54881.log.gz 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63787.log 2024-05-20T18:03:46.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.74106.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74106.log.gz 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71258.log 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63787.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63787.log.gz 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76221.log 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.71258.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71258.log.gz 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85465.log 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.76221.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76221.log.gz 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43991.log 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.85465.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85465.log.gz 2024-05-20T18:03:46.069 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43991.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43991.log.gz 2024-05-20T18:03:46.639 INFO:teuthology.orchestra.run.smithi006.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-20T18:03:46.661 INFO:teuthology.orchestra.run.smithi006.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-20T18:03:46.728 INFO:teuthology.orchestra.run.smithi171.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-20T18:03:46.998 INFO:teuthology.orchestra.run.smithi171.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-20T18:03:47.049 INFO:teuthology.orchestra.run.smithi171.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-20T18:03:47.062 INFO:teuthology.orchestra.run.smithi171.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-20T18:03:47.063 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-05-20T18:03:47.063 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m1.600s 2024-05-20T18:03:47.063 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m6.686s 2024-05-20T18:03:47.064 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m0.256s 2024-05-20T18:03:47.066 INFO:teuthology.orchestra.run.smithi006.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-20T18:03:47.253 INFO:teuthology.orchestra.run.smithi006.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-20T18:03:47.260 INFO:teuthology.orchestra.run.smithi006.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-20T18:03:47.475 INFO:teuthology.orchestra.run.smithi006.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-20T18:03:47.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-20T18:03:47.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-20T18:03:47.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-20T18:03:47.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-20T18:03:47.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-20T18:03:47.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-20T18:03:47.958 INFO:teuthology.orchestra.run.smithi006.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-20T18:03:47.960 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-05-20T18:03:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m2.521s 2024-05-20T18:03:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:user 0m11.294s 2024-05-20T18:03:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m0.852s 2024-05-20T18:03:47.962 INFO:tasks.ceph:Archiving logs... 2024-05-20T18:03:47.962 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/remote/smithi006/log 2024-05-20T18:03:48.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T18:03:50.431 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/remote/smithi171/log 2024-05-20T18:03:50.432 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-20T18:03:51.518 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-20T18:03:51.528 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-20T18:03:51.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T18:03:51.531 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-20T18:03:51.624 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-20T18:03:51.638 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-20T18:03:51.638 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T18:03:51.642 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-20T18:03:51.658 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: ntpq: command not found 2024-05-20T18:03:51.660 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-05-20T18:03:51.663 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T18:03:51.663 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-05-20T18:03:51.663 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 38 +1024us[+1112us] +/- 64ms 2024-05-20T18:03:51.663 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -2285us[-2196us] +/- 63ms 2024-05-20T18:03:51.663 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +1404us[+1492us] +/- 63ms 2024-05-20T18:03:51.663 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T18:03:51.665 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-20T18:03:51.666 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-05-20T18:03:51.666 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 40 +1114us[+1114us] +/- 64ms 2024-05-20T18:03:51.666 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -2189us[-2155us] +/- 63ms 2024-05-20T18:03:51.666 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +1486us[+1486us] +/- 63ms 2024-05-20T18:03:51.666 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-20T18:03:51.666 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-20T18:03:51.676 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-20T18:03:51.677 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-20T18:03:51.694 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-20T18:03:51.801 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-20T18:03:51.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T18:03:51.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:03:51.905 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-20T18:03:51.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:03:51.936 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-20T18:03:51.948 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-20T18:03:51.985 INFO:teuthology.task.internal:Duration was 1083.628335 seconds 2024-05-20T18:03:51.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-20T18:03:52.007 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-20T18:03:52.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T18:03:52.011 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-20T18:03:52.051 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T18:03:52.051 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-20T18:03:52.342 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-20T18:03:52.343 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-05-20T18:03:52.343 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T18:03:52.406 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-05-20T18:03:52.406 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-20T18:03:52.444 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-20T18:03:52.444 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T18:03:52.448 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-20T18:03:52.511 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-20T18:03:52.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T18:03:52.517 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-20T18:03:52.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-20T18:03:52.675 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-20T18:03:52.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T18:03:52.703 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-20T18:03:52.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-20T18:03:52.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:03:52.746 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:03:52.768 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-05-20T18:03:52.792 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-05-20T18:03:52.805 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:03:52.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:03:52.837 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-20T18:03:52.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-20T18:03:52.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-20T18:03:52.875 INFO:teuthology.task.internal:Transferring archived files... 2024-05-20T18:03:52.876 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/remote/smithi006 2024-05-20T18:03:52.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T18:03:52.917 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-20_15:44:59-fs-wip-pdonnell-testing-20240517.203521-squid-debug-distro-default-smithi/7715689/remote/smithi171 2024-05-20T18:03:52.917 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-20T18:03:52.957 INFO:teuthology.task.internal:Removing archive directory... 2024-05-20T18:03:52.958 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T18:03:52.960 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-20T18:03:53.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-20T18:03:53.016 INFO:teuthology.task.internal:Not uploading archives. 2024-05-20T18:03:53.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-20T18:03:53.030 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-20T18:03:53.030 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T18:03:53.033 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-20T18:03:53.046 INFO:teuthology.orchestra.run.smithi006.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 18:03 /home/ubuntu/cephtest 2024-05-20T18:03:53.062 INFO:teuthology.orchestra.run.smithi171.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 20 18:03 /home/ubuntu/cephtest 2024-05-20T18:03:53.063 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-20T18:03:53.074 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-20T18:03:53.112 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-limits} duration: 1083.6283349990845 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-20T18:03:53.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-20T18:03:53.206 INFO:teuthology.run:pass